2024-05-08T18:16:01.835 INFO:root:teuthology version: 0.0.1.dev271+g1ae7ad8 2024-05-08T18:16:01.835 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --owner scheduled_ivancich@teuthology --name ivancich-2024-05-08_17:43:43-rgw-wip-eric-testing-1-distro-default-smithi --archive /home/teuthworker/archive/ivancich-2024-05-08_17:43:43-rgw-wip-eric-testing-1-distro-default-smithi/7697884 --description rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_user_quota} -- /home/teuthworker/archive/ivancich-2024-05-08_17:43:43-rgw-wip-eric-testing-1-distro-default-smithi/7697884/orig.config.yaml 2024-05-08T18:16:01.872 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-08T18:16:01.948 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/ivancich-2024-05-08_17:43:43-rgw-wip-eric-testing-1-distro-default-smithi/7697884 branch: wip-eric-testing-1 description: rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_user_quota} email: ivancich@redhat.com first_in_suite: false job_id: '7697884' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: ivancich-2024-05-08_17:43:43-rgw-wip-eric-testing-1-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-eric-testing-1 ceph: conf: client: rgw relaxed s3 bucket names: true mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum sha1: 27d371685027569bcfa4efc661d3d3186f3a1776 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 27d371685027569bcfa4efc661d3d3186f3a1776 rgw: frontend: beast s3tests: force-branch: ceph-master thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-eric-testing-1 sha1: 27d371685027569bcfa4efc661d3d3186f3a1776 owner: scheduled_ivancich@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 831 sha1: 27d371685027569bcfa4efc661d3d3186f3a1776 sleep_before_teardown: 0 subset: 1/50 suite: rgw suite_branch: wip-eric-testing-1 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_27d371685027569bcfa4efc661d3d3186f3a1776/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 27d371685027569bcfa4efc661d3d3186f3a1776 targets: smithi097.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPBICeI8VHkH+nYI8mIVjflTGhs+K5nl5PHRsJqcGbJpjXws9CTk2aNsgDTezng/ReS32D0KRy1wulGZFRbb+Dk= smithi151.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPkbHRZfyEf561s8Gnorvd5eQw9Ic1K1xZKeNVwzw7ym63PLcB04ZKhJ9F9MWDh/eMwKtPaERJOFoO0IygQmnjw= tasks: - install: null - ceph: null - rgw: - client.0 - thrashosds: ceph_objectstore_tool: false chance_pgnum_grow: 1 chance_pgnum_shrink: 1 chance_pgpnum_fix: 1 chance_test_min_size: 0 op_delay: 30 timeout: 1200 - workunit: clients: client.0: - rgw/s3_user_quota.pl teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 1ae7ad82388e92a475afff437d49054826c019a1 timestamp: 2024-05-08_17:43:43 tube: smithi user: ivancich verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-05-08T18:16:01.949 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_27d371685027569bcfa4efc661d3d3186f3a1776/qa; will attempt to use it 2024-05-08T18:16:01.949 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_27d371685027569bcfa4efc661d3d3186f3a1776/qa/tasks 2024-05-08T18:16:01.949 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-08T18:16:01.951 INFO:teuthology.task.internal:Checking packages... 2024-05-08T18:16:01.974 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '27d371685027569bcfa4efc661d3d3186f3a1776' 2024-05-08T18:16:01.974 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-08T18:16:01.974 INFO:teuthology.packaging:ref: None 2024-05-08T18:16:01.974 INFO:teuthology.packaging:tag: None 2024-05-08T18:16:01.975 INFO:teuthology.packaging:branch: wip-eric-testing-1 2024-05-08T18:16:01.975 INFO:teuthology.packaging:sha1: 27d371685027569bcfa4efc661d3d3186f3a1776 2024-05-08T18:16:01.975 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-eric-testing-1 2024-05-08T18:16:02.120 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3525-g27d37168-1jammy 2024-05-08T18:16:02.121 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-08T18:16:02.127 INFO:teuthology.task.internal:no buildpackages task found 2024-05-08T18:16:02.127 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-08T18:16:02.191 INFO:teuthology.task.internal:Saving configuration 2024-05-08T18:16:02.205 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-08T18:16:02.211 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-08T18:16:02.235 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi097.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/ivancich-2024-05-08_17:43:43-rgw-wip-eric-testing-1-distro-default-smithi/7697884', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-08 18:09:57.881860', 'locked_by': 'scheduled_ivancich@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIL03qxSAzN5yPLACcN8Dmp9L6Hk1ppW+dbQZL2JDCFOp'} 2024-05-08T18:16:02.260 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi151.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/ivancich-2024-05-08_17:43:43-rgw-wip-eric-testing-1-distro-default-smithi/7697884', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-08 18:09:57.883453', 'locked_by': 'scheduled_ivancich@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIMRoiYvQ3tZi+zxDet4gaZotVN/tVLofdka2TtNUtrg6'} 2024-05-08T18:16:02.260 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-08T18:16:02.265 INFO:teuthology.task.internal:roles: ubuntu@smithi097.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-05-08T18:16:02.266 INFO:teuthology.task.internal:roles: ubuntu@smithi151.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-05-08T18:16:02.266 INFO:teuthology.run_tasks:Running task console_log... 2024-05-08T18:16:02.334 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f91442ad0d0>, signals=[15]) 2024-05-08T18:16:02.335 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-08T18:16:02.341 INFO:teuthology.task.internal:Opening connections... 2024-05-08T18:16:02.341 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi097.front.sepia.ceph.com 2024-05-08T18:16:02.343 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T18:16:02.424 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi151.front.sepia.ceph.com 2024-05-08T18:16:02.425 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T18:16:02.501 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-08T18:16:02.508 DEBUG:teuthology.orchestra.run.smithi097:> uname -m 2024-05-08T18:16:02.514 INFO:teuthology.orchestra.run.smithi097.stdout:x86_64 2024-05-08T18:16:02.514 DEBUG:teuthology.orchestra.run.smithi097:> cat /etc/os-release 2024-05-08T18:16:02.561 INFO:teuthology.orchestra.run.smithi097.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-05-08T18:16:02.561 INFO:teuthology.orchestra.run.smithi097.stdout:NAME="Ubuntu" 2024-05-08T18:16:02.562 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION_ID="22.04" 2024-05-08T18:16:02.562 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-05-08T18:16:02.562 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION_CODENAME=jammy 2024-05-08T18:16:02.562 INFO:teuthology.orchestra.run.smithi097.stdout:ID=ubuntu 2024-05-08T18:16:02.562 INFO:teuthology.orchestra.run.smithi097.stdout:ID_LIKE=debian 2024-05-08T18:16:02.562 INFO:teuthology.orchestra.run.smithi097.stdout:HOME_URL="https://www.ubuntu.com/" 2024-05-08T18:16:02.562 INFO:teuthology.orchestra.run.smithi097.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-05-08T18:16:02.562 INFO:teuthology.orchestra.run.smithi097.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-05-08T18:16:02.562 INFO:teuthology.orchestra.run.smithi097.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-05-08T18:16:02.562 INFO:teuthology.orchestra.run.smithi097.stdout:UBUNTU_CODENAME=jammy 2024-05-08T18:16:02.563 INFO:teuthology.lock.ops:Updating smithi097.front.sepia.ceph.com on lock server 2024-05-08T18:16:02.584 DEBUG:teuthology.orchestra.run.smithi151:> uname -m 2024-05-08T18:16:02.588 INFO:teuthology.orchestra.run.smithi151.stdout:x86_64 2024-05-08T18:16:02.589 DEBUG:teuthology.orchestra.run.smithi151:> cat /etc/os-release 2024-05-08T18:16:02.635 INFO:teuthology.orchestra.run.smithi151.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-05-08T18:16:02.635 INFO:teuthology.orchestra.run.smithi151.stdout:NAME="Ubuntu" 2024-05-08T18:16:02.635 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_ID="22.04" 2024-05-08T18:16:02.636 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-05-08T18:16:02.636 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_CODENAME=jammy 2024-05-08T18:16:02.636 INFO:teuthology.orchestra.run.smithi151.stdout:ID=ubuntu 2024-05-08T18:16:02.636 INFO:teuthology.orchestra.run.smithi151.stdout:ID_LIKE=debian 2024-05-08T18:16:02.636 INFO:teuthology.orchestra.run.smithi151.stdout:HOME_URL="https://www.ubuntu.com/" 2024-05-08T18:16:02.636 INFO:teuthology.orchestra.run.smithi151.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-05-08T18:16:02.636 INFO:teuthology.orchestra.run.smithi151.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-05-08T18:16:02.636 INFO:teuthology.orchestra.run.smithi151.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-05-08T18:16:02.636 INFO:teuthology.orchestra.run.smithi151.stdout:UBUNTU_CODENAME=jammy 2024-05-08T18:16:02.636 INFO:teuthology.lock.ops:Updating smithi151.front.sepia.ceph.com on lock server 2024-05-08T18:16:02.658 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-08T18:16:02.668 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-08T18:16:02.673 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-08T18:16:02.674 DEBUG:teuthology.orchestra.run.smithi097:> test '!' -e /home/ubuntu/cephtest 2024-05-08T18:16:02.676 DEBUG:teuthology.orchestra.run.smithi151:> test '!' -e /home/ubuntu/cephtest 2024-05-08T18:16:02.683 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-08T18:16:02.689 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-08T18:16:02.689 DEBUG:teuthology.orchestra.run.smithi097:> test -z $(ls -A /var/lib/ceph) 2024-05-08T18:16:02.723 DEBUG:teuthology.orchestra.run.smithi151:> test -z $(ls -A /var/lib/ceph) 2024-05-08T18:16:02.739 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-08T18:16:02.787 INFO:teuthology.run_tasks:Running task kernel... 2024-05-08T18:16:02.801 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-05-08T18:16:02.801 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-05-08T18:16:02.801 DEBUG:teuthology.orchestra.run.smithi097:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-08T18:16:02.802 DEBUG:teuthology.orchestra.run.smithi151:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-08T18:16:02.806 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T18:16:02.806 DEBUG:teuthology.orchestra.run.smithi097:> uname -r 2024-05-08T18:16:02.807 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T18:16:02.807 DEBUG:teuthology.orchestra.run.smithi151:> uname -r 2024-05-08T18:16:02.854 INFO:teuthology.orchestra.run.smithi097.stdout:5.15.0-56-generic 2024-05-08T18:16:02.854 INFO:teuthology.task.kernel:Running kernel on smithi097: 5.15.0-56-generic 2024-05-08T18:16:02.854 DEBUG:teuthology.orchestra.run.smithi097:> sudo apt-get clean 2024-05-08T18:16:02.856 INFO:teuthology.orchestra.run.smithi151.stdout:5.15.0-56-generic 2024-05-08T18:16:02.856 INFO:teuthology.task.kernel:Running kernel on smithi151: 5.15.0-56-generic 2024-05-08T18:16:02.856 DEBUG:teuthology.orchestra.run.smithi151:> sudo apt-get clean 2024-05-08T18:16:02.966 DEBUG:teuthology.orchestra.run.smithi151:> sudo apt-get update 2024-05-08T18:16:02.992 DEBUG:teuthology.orchestra.run.smithi097:> sudo apt-get update 2024-05-08T18:16:03.102 INFO:teuthology.orchestra.run.smithi151.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-08T18:16:03.134 INFO:teuthology.orchestra.run.smithi151.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-05-08T18:16:03.155 INFO:teuthology.orchestra.run.smithi097.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-08T18:16:03.155 INFO:teuthology.orchestra.run.smithi097.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-05-08T18:16:03.155 INFO:teuthology.orchestra.run.smithi097.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-05-08T18:16:03.213 INFO:teuthology.orchestra.run.smithi151.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-05-08T18:16:03.216 INFO:teuthology.orchestra.run.smithi151.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-05-08T18:16:03.243 INFO:teuthology.orchestra.run.smithi097.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-05-08T18:16:03.336 INFO:teuthology.orchestra.run.smithi151.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,638 kB] 2024-05-08T18:16:03.393 INFO:teuthology.orchestra.run.smithi097.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [458 kB] 2024-05-08T18:16:03.442 INFO:teuthology.orchestra.run.smithi151.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [624 kB] 2024-05-08T18:16:03.450 INFO:teuthology.orchestra.run.smithi151.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [307 kB] 2024-05-08T18:16:03.453 INFO:teuthology.orchestra.run.smithi151.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-05-08T18:16:03.453 INFO:teuthology.orchestra.run.smithi151.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,864 kB] 2024-05-08T18:16:03.466 INFO:teuthology.orchestra.run.smithi097.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [624 kB] 2024-05-08T18:16:03.474 INFO:teuthology.orchestra.run.smithi151.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-05-08T18:16:03.474 INFO:teuthology.orchestra.run.smithi151.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [316 kB] 2024-05-08T18:16:03.478 INFO:teuthology.orchestra.run.smithi151.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-05-08T18:16:03.478 INFO:teuthology.orchestra.run.smithi151.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,073 kB] 2024-05-08T18:16:03.483 INFO:teuthology.orchestra.run.smithi097.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,421 kB] 2024-05-08T18:16:03.490 INFO:teuthology.orchestra.run.smithi151.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [702 kB] 2024-05-08T18:16:03.498 INFO:teuthology.orchestra.run.smithi151.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [245 kB] 2024-05-08T18:16:03.517 INFO:teuthology.orchestra.run.smithi151.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-05-08T18:16:03.518 INFO:teuthology.orchestra.run.smithi151.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-05-08T18:16:03.519 INFO:teuthology.orchestra.run.smithi151.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-05-08T18:16:03.519 INFO:teuthology.orchestra.run.smithi151.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-05-08T18:16:03.525 INFO:teuthology.orchestra.run.smithi151.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-05-08T18:16:03.525 INFO:teuthology.orchestra.run.smithi151.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-05-08T18:16:03.526 INFO:teuthology.orchestra.run.smithi151.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.3 kB] 2024-05-08T18:16:03.527 INFO:teuthology.orchestra.run.smithi151.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-05-08T18:16:03.527 INFO:teuthology.orchestra.run.smithi151.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-05-08T18:16:03.535 INFO:teuthology.orchestra.run.smithi097.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [246 kB] 2024-05-08T18:16:03.539 INFO:teuthology.orchestra.run.smithi097.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-05-08T18:16:03.539 INFO:teuthology.orchestra.run.smithi097.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,807 kB] 2024-05-08T18:16:03.545 INFO:teuthology.orchestra.run.smithi151.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.0 kB] 2024-05-08T18:16:03.545 INFO:teuthology.orchestra.run.smithi151.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.2 kB] 2024-05-08T18:16:03.546 INFO:teuthology.orchestra.run.smithi151.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-05-08T18:16:03.546 INFO:teuthology.orchestra.run.smithi151.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-05-08T18:16:03.552 INFO:teuthology.orchestra.run.smithi097.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,638 kB] 2024-05-08T18:16:03.564 INFO:teuthology.orchestra.run.smithi097.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-05-08T18:16:03.565 INFO:teuthology.orchestra.run.smithi097.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [307 kB] 2024-05-08T18:16:03.569 INFO:teuthology.orchestra.run.smithi097.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-05-08T18:16:03.569 INFO:teuthology.orchestra.run.smithi097.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [602 kB] 2024-05-08T18:16:03.575 INFO:teuthology.orchestra.run.smithi097.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [849 kB] 2024-05-08T18:16:03.584 INFO:teuthology.orchestra.run.smithi097.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-05-08T18:16:03.607 INFO:teuthology.orchestra.run.smithi097.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-05-08T18:16:03.607 INFO:teuthology.orchestra.run.smithi097.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-05-08T18:16:03.608 INFO:teuthology.orchestra.run.smithi097.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-05-08T18:16:03.608 INFO:teuthology.orchestra.run.smithi097.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [307 kB] 2024-05-08T18:16:03.608 INFO:teuthology.orchestra.run.smithi097.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-05-08T18:16:03.608 INFO:teuthology.orchestra.run.smithi097.stdout:Get:23 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-05-08T18:16:03.613 INFO:teuthology.orchestra.run.smithi097.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-05-08T18:16:03.614 INFO:teuthology.orchestra.run.smithi097.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,864 kB] 2024-05-08T18:16:03.633 INFO:teuthology.orchestra.run.smithi151.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [458 kB] 2024-05-08T18:16:03.642 INFO:teuthology.orchestra.run.smithi097.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-05-08T18:16:03.643 INFO:teuthology.orchestra.run.smithi097.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [316 kB] 2024-05-08T18:16:03.647 INFO:teuthology.orchestra.run.smithi097.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-05-08T18:16:03.647 INFO:teuthology.orchestra.run.smithi097.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [702 kB] 2024-05-08T18:16:03.655 INFO:teuthology.orchestra.run.smithi097.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,073 kB] 2024-05-08T18:16:03.665 INFO:teuthology.orchestra.run.smithi097.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [245 kB] 2024-05-08T18:16:03.667 INFO:teuthology.orchestra.run.smithi097.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-05-08T18:16:03.667 INFO:teuthology.orchestra.run.smithi097.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-05-08T18:16:03.668 INFO:teuthology.orchestra.run.smithi097.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-05-08T18:16:03.677 INFO:teuthology.orchestra.run.smithi097.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-05-08T18:16:03.677 INFO:teuthology.orchestra.run.smithi097.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-05-08T18:16:03.677 INFO:teuthology.orchestra.run.smithi097.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.3 kB] 2024-05-08T18:16:03.679 INFO:teuthology.orchestra.run.smithi097.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-05-08T18:16:03.689 INFO:teuthology.orchestra.run.smithi097.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-05-08T18:16:03.690 INFO:teuthology.orchestra.run.smithi097.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-05-08T18:16:03.690 INFO:teuthology.orchestra.run.smithi097.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.2 kB] 2024-05-08T18:16:03.690 INFO:teuthology.orchestra.run.smithi097.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.0 kB] 2024-05-08T18:16:03.690 INFO:teuthology.orchestra.run.smithi097.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-05-08T18:16:03.697 INFO:teuthology.orchestra.run.smithi097.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-05-08T18:16:03.924 INFO:teuthology.orchestra.run.smithi151.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,421 kB] 2024-05-08T18:16:04.095 INFO:teuthology.orchestra.run.smithi151.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [246 kB] 2024-05-08T18:16:04.108 INFO:teuthology.orchestra.run.smithi151.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-05-08T18:16:04.109 INFO:teuthology.orchestra.run.smithi151.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-05-08T18:16:04.111 INFO:teuthology.orchestra.run.smithi151.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,807 kB] 2024-05-08T18:16:04.197 INFO:teuthology.orchestra.run.smithi151.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [307 kB] 2024-05-08T18:16:04.205 INFO:teuthology.orchestra.run.smithi151.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-05-08T18:16:04.205 INFO:teuthology.orchestra.run.smithi151.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [602 kB] 2024-05-08T18:16:04.220 INFO:teuthology.orchestra.run.smithi151.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [849 kB] 2024-05-08T18:16:04.404 INFO:teuthology.orchestra.run.smithi151.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-05-08T18:16:04.812 INFO:teuthology.orchestra.run.smithi151.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-05-08T18:16:04.818 INFO:teuthology.orchestra.run.smithi151.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-05-08T18:16:04.819 INFO:teuthology.orchestra.run.smithi151.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-05-08T18:16:04.833 INFO:teuthology.orchestra.run.smithi151.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-05-08T18:16:04.836 INFO:teuthology.orchestra.run.smithi151.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-05-08T18:16:09.190 INFO:teuthology.orchestra.run.smithi151.stdout:Fetched 13.4 MB in 2s (7,187 kB/s) 2024-05-08T18:16:09.214 INFO:teuthology.orchestra.run.smithi097.stdout:Fetched 13.4 MB in 2s (7,048 kB/s) 2024-05-08T18:16:10.581 INFO:teuthology.orchestra.run.smithi097.stdout:Reading package lists... 2024-05-08T18:16:10.598 DEBUG:teuthology.orchestra.run.smithi097:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-05-08T18:16:10.660 INFO:teuthology.orchestra.run.smithi151.stdout:Reading package lists... 2024-05-08T18:16:10.660 INFO:teuthology.orchestra.run.smithi097.stdout:Reading package lists... 2024-05-08T18:16:10.677 DEBUG:teuthology.orchestra.run.smithi151:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-05-08T18:16:10.738 INFO:teuthology.orchestra.run.smithi151.stdout:Reading package lists... 2024-05-08T18:16:10.861 INFO:teuthology.orchestra.run.smithi097.stdout:Building dependency tree... 2024-05-08T18:16:10.862 INFO:teuthology.orchestra.run.smithi097.stdout:Reading state information... 2024-05-08T18:16:10.938 INFO:teuthology.orchestra.run.smithi151.stdout:Building dependency tree... 2024-05-08T18:16:10.938 INFO:teuthology.orchestra.run.smithi151.stdout:Reading state information... 2024-05-08T18:16:11.037 INFO:teuthology.orchestra.run.smithi097.stdout:The following packages were automatically installed and are no longer required: 2024-05-08T18:16:11.037 INFO:teuthology.orchestra.run.smithi097.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-08T18:16:11.037 INFO:teuthology.orchestra.run.smithi097.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-08T18:16:11.038 INFO:teuthology.orchestra.run.smithi097.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-08T18:16:11.038 INFO:teuthology.orchestra.run.smithi097.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-05-08T18:16:11.038 INFO:teuthology.orchestra.run.smithi097.stdout: python2.7-minimal 2024-05-08T18:16:11.038 INFO:teuthology.orchestra.run.smithi097.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-08T18:16:11.040 INFO:teuthology.orchestra.run.smithi097.stdout:The following additional packages will be installed: 2024-05-08T18:16:11.040 INFO:teuthology.orchestra.run.smithi097.stdout: linux-generic linux-headers-5.15.0-106 linux-headers-5.15.0-106-generic 2024-05-08T18:16:11.040 INFO:teuthology.orchestra.run.smithi097.stdout: linux-headers-generic linux-image-5.15.0-106-generic 2024-05-08T18:16:11.040 INFO:teuthology.orchestra.run.smithi097.stdout: linux-modules-5.15.0-106-generic linux-modules-extra-5.15.0-106-generic 2024-05-08T18:16:11.041 INFO:teuthology.orchestra.run.smithi097.stdout:Suggested packages: 2024-05-08T18:16:11.042 INFO:teuthology.orchestra.run.smithi097.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-05-08T18:16:11.042 INFO:teuthology.orchestra.run.smithi097.stdout:Recommended packages: 2024-05-08T18:16:11.042 INFO:teuthology.orchestra.run.smithi097.stdout: thermald 2024-05-08T18:16:11.095 INFO:teuthology.orchestra.run.smithi097.stdout:The following NEW packages will be installed: 2024-05-08T18:16:11.095 INFO:teuthology.orchestra.run.smithi097.stdout: linux-headers-5.15.0-106 linux-headers-5.15.0-106-generic 2024-05-08T18:16:11.095 INFO:teuthology.orchestra.run.smithi097.stdout: linux-image-5.15.0-106-generic linux-modules-5.15.0-106-generic 2024-05-08T18:16:11.095 INFO:teuthology.orchestra.run.smithi097.stdout: linux-modules-extra-5.15.0-106-generic 2024-05-08T18:16:11.096 INFO:teuthology.orchestra.run.smithi097.stdout:The following packages will be upgraded: 2024-05-08T18:16:11.097 INFO:teuthology.orchestra.run.smithi097.stdout: linux-generic linux-headers-generic linux-image-generic 2024-05-08T18:16:11.118 INFO:teuthology.orchestra.run.smithi151.stdout:The following packages were automatically installed and are no longer required: 2024-05-08T18:16:11.118 INFO:teuthology.orchestra.run.smithi151.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-08T18:16:11.118 INFO:teuthology.orchestra.run.smithi151.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-08T18:16:11.119 INFO:teuthology.orchestra.run.smithi151.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-08T18:16:11.119 INFO:teuthology.orchestra.run.smithi151.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-05-08T18:16:11.119 INFO:teuthology.orchestra.run.smithi151.stdout: python2.7-minimal 2024-05-08T18:16:11.119 INFO:teuthology.orchestra.run.smithi151.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-08T18:16:11.120 INFO:teuthology.orchestra.run.smithi151.stdout:The following additional packages will be installed: 2024-05-08T18:16:11.120 INFO:teuthology.orchestra.run.smithi151.stdout: linux-generic linux-headers-5.15.0-106 linux-headers-5.15.0-106-generic 2024-05-08T18:16:11.121 INFO:teuthology.orchestra.run.smithi151.stdout: linux-headers-generic linux-image-5.15.0-106-generic 2024-05-08T18:16:11.121 INFO:teuthology.orchestra.run.smithi151.stdout: linux-modules-5.15.0-106-generic linux-modules-extra-5.15.0-106-generic 2024-05-08T18:16:11.122 INFO:teuthology.orchestra.run.smithi151.stdout:Suggested packages: 2024-05-08T18:16:11.122 INFO:teuthology.orchestra.run.smithi151.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-05-08T18:16:11.122 INFO:teuthology.orchestra.run.smithi151.stdout:Recommended packages: 2024-05-08T18:16:11.123 INFO:teuthology.orchestra.run.smithi151.stdout: thermald 2024-05-08T18:16:11.180 INFO:teuthology.orchestra.run.smithi151.stdout:The following NEW packages will be installed: 2024-05-08T18:16:11.180 INFO:teuthology.orchestra.run.smithi151.stdout: linux-headers-5.15.0-106 linux-headers-5.15.0-106-generic 2024-05-08T18:16:11.180 INFO:teuthology.orchestra.run.smithi151.stdout: linux-image-5.15.0-106-generic linux-modules-5.15.0-106-generic 2024-05-08T18:16:11.181 INFO:teuthology.orchestra.run.smithi151.stdout: linux-modules-extra-5.15.0-106-generic 2024-05-08T18:16:11.182 INFO:teuthology.orchestra.run.smithi151.stdout:The following packages will be upgraded: 2024-05-08T18:16:11.183 INFO:teuthology.orchestra.run.smithi151.stdout: linux-generic linux-headers-generic linux-image-generic 2024-05-08T18:16:11.238 INFO:teuthology.orchestra.run.smithi151.stdout:3 upgraded, 5 newly installed, 0 to remove and 316 not upgraded. 2024-05-08T18:16:11.238 INFO:teuthology.orchestra.run.smithi151.stdout:Need to get 113 MB of archives. 2024-05-08T18:16:11.238 INFO:teuthology.orchestra.run.smithi151.stdout:After this operation, 583 MB of additional disk space will be used. 2024-05-08T18:16:11.238 INFO:teuthology.orchestra.run.smithi151.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-106-generic amd64 5.15.0-106.116 [22.7 MB] 2024-05-08T18:16:11.357 INFO:teuthology.orchestra.run.smithi097.stdout:3 upgraded, 5 newly installed, 0 to remove and 316 not upgraded. 2024-05-08T18:16:11.358 INFO:teuthology.orchestra.run.smithi097.stdout:Need to get 113 MB of archives. 2024-05-08T18:16:11.358 INFO:teuthology.orchestra.run.smithi097.stdout:After this operation, 583 MB of additional disk space will be used. 2024-05-08T18:16:11.358 INFO:teuthology.orchestra.run.smithi097.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-106-generic amd64 5.15.0-106.116 [22.7 MB] 2024-05-08T18:16:11.741 INFO:teuthology.orchestra.run.smithi151.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-106-generic amd64 5.15.0-106.116 [11.5 MB] 2024-05-08T18:16:11.870 INFO:teuthology.orchestra.run.smithi151.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-106-generic amd64 5.15.0-106.116 [63.9 MB] 2024-05-08T18:16:12.980 INFO:teuthology.orchestra.run.smithi151.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.106.106 [1,692 B] 2024-05-08T18:16:12.980 INFO:teuthology.orchestra.run.smithi151.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.106.106 [2,502 B] 2024-05-08T18:16:12.980 INFO:teuthology.orchestra.run.smithi151.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-106 all 5.15.0-106.116 [12.3 MB] 2024-05-08T18:16:13.011 INFO:teuthology.orchestra.run.smithi097.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-106-generic amd64 5.15.0-106.116 [11.5 MB] 2024-05-08T18:16:13.151 INFO:teuthology.orchestra.run.smithi151.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-106-generic amd64 5.15.0-106.116 [2,876 kB] 2024-05-08T18:16:13.190 INFO:teuthology.orchestra.run.smithi151.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.106.106 [2,366 B] 2024-05-08T18:16:13.578 INFO:teuthology.orchestra.run.smithi151.stdout:Fetched 113 MB in 2s (56.7 MB/s) 2024-05-08T18:16:13.589 INFO:teuthology.orchestra.run.smithi097.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-106-generic amd64 5.15.0-106.116 [63.9 MB] 2024-05-08T18:16:13.755 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package linux-modules-5.15.0-106-generic. 2024-05-08T18:16:15.837 INFO:teuthology.orchestra.run.smithi151.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-05-08T18:16:15.841 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../0-linux-modules-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-08T18:16:15.968 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking linux-modules-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-08T18:16:16.517 INFO:teuthology.orchestra.run.smithi097.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.106.106 [1,692 B] 2024-05-08T18:16:16.517 INFO:teuthology.orchestra.run.smithi097.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.106.106 [2,502 B] 2024-05-08T18:16:16.517 INFO:teuthology.orchestra.run.smithi097.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-106 all 5.15.0-106.116 [12.3 MB] 2024-05-08T18:16:17.115 INFO:teuthology.orchestra.run.smithi097.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-106-generic amd64 5.15.0-106.116 [2,876 kB] 2024-05-08T18:16:17.173 INFO:teuthology.orchestra.run.smithi097.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.106.106 [2,366 B] 2024-05-08T18:16:17.595 INFO:teuthology.orchestra.run.smithi097.stdout:Fetched 113 MB in 6s (18.7 MB/s) 2024-05-08T18:16:17.773 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package linux-modules-5.15.0-106-generic. 2024-05-08T18:16:18.186 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package linux-image-5.15.0-106-generic. 2024-05-08T18:16:18.208 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../1-linux-image-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-08T18:16:18.299 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking linux-image-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-08T18:16:18.773 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-106-generic. 2024-05-08T18:16:18.794 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-08T18:16:18.923 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking linux-modules-extra-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-08T18:16:19.751 INFO:teuthology.orchestra.run.smithi097.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-05-08T18:16:19.755 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../0-linux-modules-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-08T18:16:19.854 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking linux-modules-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-08T18:16:22.331 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package linux-image-5.15.0-106-generic. 2024-05-08T18:16:22.352 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../1-linux-image-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-08T18:16:22.453 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking linux-image-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-08T18:16:22.900 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-106-generic. 2024-05-08T18:16:22.921 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-08T18:16:22.967 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking linux-modules-extra-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-08T18:16:26.048 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../3-linux-generic_5.15.0.106.106_amd64.deb ... 2024-05-08T18:16:26.175 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking linux-generic (5.15.0.106.106) over (5.15.0.56.54) ... 2024-05-08T18:16:26.533 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.106.106_amd64.deb ... 2024-05-08T18:16:26.653 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking linux-image-generic (5.15.0.106.106) over (5.15.0.56.54) ... 2024-05-08T18:16:26.965 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package linux-headers-5.15.0-106. 2024-05-08T18:16:26.987 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../5-linux-headers-5.15.0-106_5.15.0-106.116_all.deb ... 2024-05-08T18:16:27.031 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking linux-headers-5.15.0-106 (5.15.0-106.116) ... 2024-05-08T18:16:29.377 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../3-linux-generic_5.15.0.106.106_amd64.deb ... 2024-05-08T18:16:29.479 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking linux-generic (5.15.0.106.106) over (5.15.0.56.54) ... 2024-05-08T18:16:29.795 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.106.106_amd64.deb ... 2024-05-08T18:16:29.916 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking linux-image-generic (5.15.0.106.106) over (5.15.0.56.54) ... 2024-05-08T18:16:30.244 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package linux-headers-5.15.0-106. 2024-05-08T18:16:30.267 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../5-linux-headers-5.15.0-106_5.15.0-106.116_all.deb ... 2024-05-08T18:16:30.302 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking linux-headers-5.15.0-106 (5.15.0-106.116) ... 2024-05-08T18:16:32.624 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package linux-headers-5.15.0-106-generic. 2024-05-08T18:16:32.662 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../6-linux-headers-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-08T18:16:32.707 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking linux-headers-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-08T18:16:35.785 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package linux-headers-5.15.0-106-generic. 2024-05-08T18:16:35.822 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../6-linux-headers-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-08T18:16:35.860 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking linux-headers-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-08T18:16:35.963 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.106.106_amd64.deb ... 2024-05-08T18:16:36.085 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking linux-headers-generic (5.15.0.106.106) over (5.15.0.56.54) ... 2024-05-08T18:16:36.451 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up linux-headers-5.15.0-106 (5.15.0-106.116) ... 2024-05-08T18:16:36.598 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up linux-headers-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-08T18:16:36.724 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up linux-headers-generic (5.15.0.106.106) ... 2024-05-08T18:16:36.853 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up linux-image-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-08T18:16:38.170 INFO:teuthology.orchestra.run.smithi151.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-05-08T18:16:38.170 INFO:teuthology.orchestra.run.smithi151.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-05-08T18:16:38.170 INFO:teuthology.orchestra.run.smithi151.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-106-generic 2024-05-08T18:16:38.171 INFO:teuthology.orchestra.run.smithi151.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-106-generic 2024-05-08T18:16:38.313 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up linux-modules-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-08T18:16:39.823 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up linux-modules-extra-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-08T18:16:39.880 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.106.106_amd64.deb ... 2024-05-08T18:16:39.989 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking linux-headers-generic (5.15.0.106.106) over (5.15.0.56.54) ... 2024-05-08T18:16:40.322 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up linux-headers-5.15.0-106 (5.15.0-106.116) ... 2024-05-08T18:16:40.452 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up linux-headers-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-08T18:16:40.553 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up linux-headers-generic (5.15.0.106.106) ... 2024-05-08T18:16:40.690 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up linux-image-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-08T18:16:41.224 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up linux-image-generic (5.15.0.106.106) ... 2024-05-08T18:16:41.350 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up linux-generic (5.15.0.106.106) ... 2024-05-08T18:16:41.476 INFO:teuthology.orchestra.run.smithi151.stdout:Processing triggers for linux-image-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-08T18:16:41.554 INFO:teuthology.orchestra.run.smithi151.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-05-08T18:16:41.554 INFO:teuthology.orchestra.run.smithi151.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-106-generic 2024-05-08T18:16:42.016 INFO:teuthology.orchestra.run.smithi097.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-05-08T18:16:42.017 INFO:teuthology.orchestra.run.smithi097.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-05-08T18:16:42.017 INFO:teuthology.orchestra.run.smithi097.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-106-generic 2024-05-08T18:16:42.017 INFO:teuthology.orchestra.run.smithi097.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-106-generic 2024-05-08T18:16:42.184 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up linux-modules-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-08T18:16:43.585 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up linux-modules-extra-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-08T18:16:45.220 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up linux-image-generic (5.15.0.106.106) ... 2024-05-08T18:16:45.371 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up linux-generic (5.15.0.106.106) ... 2024-05-08T18:16:45.498 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for linux-image-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-08T18:16:45.566 INFO:teuthology.orchestra.run.smithi097.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-05-08T18:16:45.566 INFO:teuthology.orchestra.run.smithi097.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-106-generic 2024-05-08T18:16:56.244 INFO:teuthology.orchestra.run.smithi151.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-05-08T18:16:56.244 INFO:teuthology.orchestra.run.smithi151.stdout:Sourcing file `/etc/default/grub' 2024-05-08T18:16:56.268 INFO:teuthology.orchestra.run.smithi151.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-08T18:16:56.286 INFO:teuthology.orchestra.run.smithi151.stdout:Generating grub configuration file ... 2024-05-08T18:16:56.614 INFO:teuthology.orchestra.run.smithi151.stdout:Found linux image: /boot/vmlinuz-5.15.0-106-generic 2024-05-08T18:16:56.636 INFO:teuthology.orchestra.run.smithi151.stdout:Found initrd image: /boot/initrd.img-5.15.0-106-generic 2024-05-08T18:16:56.960 INFO:teuthology.orchestra.run.smithi151.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-05-08T18:16:56.966 INFO:teuthology.orchestra.run.smithi151.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-05-08T18:16:57.034 INFO:teuthology.orchestra.run.smithi151.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-05-08T18:16:57.039 INFO:teuthology.orchestra.run.smithi151.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-05-08T18:16:57.195 INFO:teuthology.orchestra.run.smithi151.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-05-08T18:16:57.195 INFO:teuthology.orchestra.run.smithi151.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-05-08T18:16:57.195 INFO:teuthology.orchestra.run.smithi151.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-05-08T18:16:57.238 INFO:teuthology.orchestra.run.smithi151.stdout:done 2024-05-08T18:16:57.736 DEBUG:teuthology.orchestra.run.smithi151:> dpkg -s linux-image-generic 2024-05-08T18:16:57.767 INFO:teuthology.orchestra.run.smithi151.stdout:Package: linux-image-generic 2024-05-08T18:16:57.767 INFO:teuthology.orchestra.run.smithi151.stdout:Status: install ok installed 2024-05-08T18:16:57.767 INFO:teuthology.orchestra.run.smithi151.stdout:Priority: optional 2024-05-08T18:16:57.767 INFO:teuthology.orchestra.run.smithi151.stdout:Section: kernel 2024-05-08T18:16:57.767 INFO:teuthology.orchestra.run.smithi151.stdout:Installed-Size: 21 2024-05-08T18:16:57.767 INFO:teuthology.orchestra.run.smithi151.stdout:Maintainer: Ubuntu Kernel Team 2024-05-08T18:16:57.767 INFO:teuthology.orchestra.run.smithi151.stdout:Architecture: amd64 2024-05-08T18:16:57.767 INFO:teuthology.orchestra.run.smithi151.stdout:Source: linux-meta 2024-05-08T18:16:57.768 INFO:teuthology.orchestra.run.smithi151.stdout:Version: 5.15.0.106.106 2024-05-08T18:16:57.768 INFO:teuthology.orchestra.run.smithi151.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-106), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-05-08T18:16:57.768 INFO:teuthology.orchestra.run.smithi151.stdout:Depends: linux-image-5.15.0-106-generic, linux-modules-extra-5.15.0-106-generic, linux-firmware, intel-microcode, amd64-microcode 2024-05-08T18:16:57.768 INFO:teuthology.orchestra.run.smithi151.stdout:Recommends: thermald 2024-05-08T18:16:57.768 INFO:teuthology.orchestra.run.smithi151.stdout:Description: Generic Linux kernel image 2024-05-08T18:16:57.768 INFO:teuthology.orchestra.run.smithi151.stdout: This package will always depend on the latest generic kernel image 2024-05-08T18:16:57.768 INFO:teuthology.orchestra.run.smithi151.stdout: available. 2024-05-08T18:16:57.768 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-106-generic 2024-05-08T18:16:57.768 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-08T18:16:57.768 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-08T18:16:57.768 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-05-08T18:16:57.769 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi151.front.sepia.ceph.com, path=None, version=distro) 2024-05-08T18:16:57.769 DEBUG:teuthology.orchestra.run.smithi151:> sudo apt-get clean 2024-05-08T18:16:57.982 DEBUG:teuthology.orchestra.run.smithi151:> sudo apt-get update 2024-05-08T18:16:58.145 INFO:teuthology.orchestra.run.smithi151.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-08T18:16:58.157 INFO:teuthology.orchestra.run.smithi151.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-05-08T18:16:58.178 INFO:teuthology.orchestra.run.smithi151.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-05-08T18:16:58.279 INFO:teuthology.orchestra.run.smithi151.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-05-08T18:16:59.481 INFO:teuthology.orchestra.run.smithi151.stdout:Reading package lists... 2024-05-08T18:16:59.499 DEBUG:teuthology.orchestra.run.smithi151:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-05-08T18:16:59.562 INFO:teuthology.orchestra.run.smithi151.stdout:Reading package lists... 2024-05-08T18:16:59.618 INFO:teuthology.orchestra.run.smithi097.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-05-08T18:16:59.618 INFO:teuthology.orchestra.run.smithi097.stdout:Sourcing file `/etc/default/grub' 2024-05-08T18:16:59.627 INFO:teuthology.orchestra.run.smithi097.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-08T18:16:59.647 INFO:teuthology.orchestra.run.smithi097.stdout:Generating grub configuration file ... 2024-05-08T18:16:59.764 INFO:teuthology.orchestra.run.smithi151.stdout:Building dependency tree... 2024-05-08T18:16:59.765 INFO:teuthology.orchestra.run.smithi151.stdout:Reading state information... 2024-05-08T18:16:59.942 INFO:teuthology.orchestra.run.smithi151.stdout:linux-image-generic is already the newest version (5.15.0.106.106). 2024-05-08T18:16:59.942 INFO:teuthology.orchestra.run.smithi151.stdout:The following packages were automatically installed and are no longer required: 2024-05-08T18:16:59.942 INFO:teuthology.orchestra.run.smithi151.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-08T18:16:59.942 INFO:teuthology.orchestra.run.smithi151.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-08T18:16:59.942 INFO:teuthology.orchestra.run.smithi151.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-08T18:16:59.942 INFO:teuthology.orchestra.run.smithi151.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-08T18:16:59.943 INFO:teuthology.orchestra.run.smithi151.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-08T18:16:59.943 INFO:teuthology.orchestra.run.smithi151.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-08T18:16:59.946 INFO:teuthology.orchestra.run.smithi097.stdout:Found linux image: /boot/vmlinuz-5.15.0-106-generic 2024-05-08T18:16:59.970 INFO:teuthology.orchestra.run.smithi097.stdout:Found initrd image: /boot/initrd.img-5.15.0-106-generic 2024-05-08T18:16:59.984 INFO:teuthology.orchestra.run.smithi151.stdout:0 upgraded, 0 newly installed, 0 to remove and 316 not upgraded. 2024-05-08T18:16:59.986 DEBUG:teuthology.orchestra.run.smithi151:> dpkg -s linux-image-generic 2024-05-08T18:17:00.001 INFO:teuthology.orchestra.run.smithi151.stdout:Package: linux-image-generic 2024-05-08T18:17:00.001 INFO:teuthology.orchestra.run.smithi151.stdout:Status: install ok installed 2024-05-08T18:17:00.002 INFO:teuthology.orchestra.run.smithi151.stdout:Priority: optional 2024-05-08T18:17:00.002 INFO:teuthology.orchestra.run.smithi151.stdout:Section: kernel 2024-05-08T18:17:00.002 INFO:teuthology.orchestra.run.smithi151.stdout:Installed-Size: 21 2024-05-08T18:17:00.002 INFO:teuthology.orchestra.run.smithi151.stdout:Maintainer: Ubuntu Kernel Team 2024-05-08T18:17:00.002 INFO:teuthology.orchestra.run.smithi151.stdout:Architecture: amd64 2024-05-08T18:17:00.002 INFO:teuthology.orchestra.run.smithi151.stdout:Source: linux-meta 2024-05-08T18:17:00.002 INFO:teuthology.orchestra.run.smithi151.stdout:Version: 5.15.0.106.106 2024-05-08T18:17:00.002 INFO:teuthology.orchestra.run.smithi151.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-106), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-05-08T18:17:00.002 INFO:teuthology.orchestra.run.smithi151.stdout:Depends: linux-image-5.15.0-106-generic, linux-modules-extra-5.15.0-106-generic, linux-firmware, intel-microcode, amd64-microcode 2024-05-08T18:17:00.002 INFO:teuthology.orchestra.run.smithi151.stdout:Recommends: thermald 2024-05-08T18:17:00.002 INFO:teuthology.orchestra.run.smithi151.stdout:Description: Generic Linux kernel image 2024-05-08T18:17:00.002 INFO:teuthology.orchestra.run.smithi151.stdout: This package will always depend on the latest generic kernel image 2024-05-08T18:17:00.003 INFO:teuthology.orchestra.run.smithi151.stdout: available. 2024-05-08T18:17:00.003 DEBUG:teuthology.orchestra.run.smithi151:> mktemp 2024-05-08T18:17:00.047 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/tmp.6eBemfC0pe 2024-05-08T18:17:00.047 DEBUG:teuthology.orchestra.run.smithi151:> sudo cp /boot/grub/grub.cfg /tmp/tmp.6eBemfC0pe 2024-05-08T18:17:00.104 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 0666 /tmp/tmp.6eBemfC0pe 2024-05-08T18:17:00.221 DEBUG:teuthology.orchestra.remote:smithi151:/tmp/tmp.6eBemfC0pe is 10KB 2024-05-08T18:17:00.235 DEBUG:teuthology.orchestra.run.smithi151:> rm -fr /tmp/tmp.6eBemfC0pe 2024-05-08T18:17:00.240 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-05-08T18:17:00.254 INFO:teuthology.orchestra.run.smithi097.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-05-08T18:17:00.260 INFO:teuthology.orchestra.run.smithi097.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-05-08T18:17:00.295 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-05-08T18:17:00.295 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-05-08T18:17:00.295 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-05-08T18:17:00.328 INFO:teuthology.orchestra.run.smithi097.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-05-08T18:17:00.334 INFO:teuthology.orchestra.run.smithi097.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-05-08T18:17:00.365 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-106-generic 2024-05-08T18:17:00.365 DEBUG:teuthology.orchestra.run.smithi151:> sudo update-grub 2024-05-08T18:17:00.494 INFO:teuthology.orchestra.run.smithi097.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-05-08T18:17:00.495 INFO:teuthology.orchestra.run.smithi097.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-05-08T18:17:00.495 INFO:teuthology.orchestra.run.smithi097.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-05-08T18:17:00.534 INFO:teuthology.orchestra.run.smithi097.stdout:done 2024-05-08T18:17:01.012 DEBUG:teuthology.orchestra.run.smithi097:> dpkg -s linux-image-generic 2024-05-08T18:17:01.032 INFO:teuthology.orchestra.run.smithi097.stdout:Package: linux-image-generic 2024-05-08T18:17:01.032 INFO:teuthology.orchestra.run.smithi097.stdout:Status: install ok installed 2024-05-08T18:17:01.032 INFO:teuthology.orchestra.run.smithi097.stdout:Priority: optional 2024-05-08T18:17:01.032 INFO:teuthology.orchestra.run.smithi097.stdout:Section: kernel 2024-05-08T18:17:01.032 INFO:teuthology.orchestra.run.smithi097.stdout:Installed-Size: 21 2024-05-08T18:17:01.032 INFO:teuthology.orchestra.run.smithi097.stdout:Maintainer: Ubuntu Kernel Team 2024-05-08T18:17:01.032 INFO:teuthology.orchestra.run.smithi097.stdout:Architecture: amd64 2024-05-08T18:17:01.032 INFO:teuthology.orchestra.run.smithi097.stdout:Source: linux-meta 2024-05-08T18:17:01.032 INFO:teuthology.orchestra.run.smithi097.stdout:Version: 5.15.0.106.106 2024-05-08T18:17:01.033 INFO:teuthology.orchestra.run.smithi097.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-106), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-05-08T18:17:01.033 INFO:teuthology.orchestra.run.smithi097.stdout:Depends: linux-image-5.15.0-106-generic, linux-modules-extra-5.15.0-106-generic, linux-firmware, intel-microcode, amd64-microcode 2024-05-08T18:17:01.033 INFO:teuthology.orchestra.run.smithi097.stdout:Recommends: thermald 2024-05-08T18:17:01.033 INFO:teuthology.orchestra.run.smithi097.stdout:Description: Generic Linux kernel image 2024-05-08T18:17:01.033 INFO:teuthology.orchestra.run.smithi097.stdout: This package will always depend on the latest generic kernel image 2024-05-08T18:17:01.033 INFO:teuthology.orchestra.run.smithi097.stdout: available. 2024-05-08T18:17:01.033 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-106-generic 2024-05-08T18:17:01.033 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-08T18:17:01.033 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-08T18:17:01.033 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-05-08T18:17:01.033 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi097.front.sepia.ceph.com, path=None, version=distro) 2024-05-08T18:17:01.033 DEBUG:teuthology.orchestra.run.smithi097:> sudo apt-get clean 2024-05-08T18:17:01.220 DEBUG:teuthology.orchestra.run.smithi097:> sudo apt-get update 2024-05-08T18:17:01.358 INFO:teuthology.orchestra.run.smithi097.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-05-08T18:17:01.553 INFO:teuthology.orchestra.run.smithi097.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-08T18:17:01.623 INFO:teuthology.orchestra.run.smithi097.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-05-08T18:17:01.705 INFO:teuthology.orchestra.run.smithi097.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-05-08T18:17:01.820 INFO:teuthology.orchestra.run.smithi151.stderr:Sourcing file `/etc/default/grub' 2024-05-08T18:17:01.821 INFO:teuthology.orchestra.run.smithi151.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-08T18:17:01.824 INFO:teuthology.orchestra.run.smithi151.stderr:Generating grub configuration file ... 2024-05-08T18:17:02.013 INFO:teuthology.orchestra.run.smithi151.stderr:Found linux image: /boot/vmlinuz-5.15.0-106-generic 2024-05-08T18:17:02.019 INFO:teuthology.orchestra.run.smithi151.stderr:Found initrd image: /boot/initrd.img-5.15.0-106-generic 2024-05-08T18:17:02.311 INFO:teuthology.orchestra.run.smithi151.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-05-08T18:17:02.317 INFO:teuthology.orchestra.run.smithi151.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-05-08T18:17:02.357 INFO:teuthology.orchestra.run.smithi151.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-05-08T18:17:02.362 INFO:teuthology.orchestra.run.smithi151.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-05-08T18:17:02.478 INFO:teuthology.orchestra.run.smithi151.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-05-08T18:17:02.478 INFO:teuthology.orchestra.run.smithi151.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-05-08T18:17:02.478 INFO:teuthology.orchestra.run.smithi151.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-05-08T18:17:02.500 INFO:teuthology.orchestra.run.smithi151.stderr:done 2024-05-08T18:17:02.509 DEBUG:teuthology.orchestra.run.smithi151:> sudo shutdown -r now 2024-05-08T18:17:02.821 INFO:teuthology.orchestra.run.smithi097.stdout:Reading package lists... 2024-05-08T18:17:02.838 DEBUG:teuthology.orchestra.run.smithi097:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-05-08T18:17:02.897 INFO:teuthology.orchestra.run.smithi097.stdout:Reading package lists... 2024-05-08T18:17:03.096 INFO:teuthology.orchestra.run.smithi097.stdout:Building dependency tree... 2024-05-08T18:17:03.096 INFO:teuthology.orchestra.run.smithi097.stdout:Reading state information... 2024-05-08T18:17:03.262 INFO:teuthology.orchestra.run.smithi097.stdout:linux-image-generic is already the newest version (5.15.0.106.106). 2024-05-08T18:17:03.263 INFO:teuthology.orchestra.run.smithi097.stdout:The following packages were automatically installed and are no longer required: 2024-05-08T18:17:03.263 INFO:teuthology.orchestra.run.smithi097.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-08T18:17:03.263 INFO:teuthology.orchestra.run.smithi097.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-08T18:17:03.263 INFO:teuthology.orchestra.run.smithi097.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-08T18:17:03.263 INFO:teuthology.orchestra.run.smithi097.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-08T18:17:03.263 INFO:teuthology.orchestra.run.smithi097.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-08T18:17:03.263 INFO:teuthology.orchestra.run.smithi097.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-08T18:17:03.301 INFO:teuthology.orchestra.run.smithi097.stdout:0 upgraded, 0 newly installed, 0 to remove and 316 not upgraded. 2024-05-08T18:17:03.303 DEBUG:teuthology.orchestra.run.smithi097:> dpkg -s linux-image-generic 2024-05-08T18:17:03.315 INFO:teuthology.orchestra.run.smithi097.stdout:Package: linux-image-generic 2024-05-08T18:17:03.315 INFO:teuthology.orchestra.run.smithi097.stdout:Status: install ok installed 2024-05-08T18:17:03.315 INFO:teuthology.orchestra.run.smithi097.stdout:Priority: optional 2024-05-08T18:17:03.315 INFO:teuthology.orchestra.run.smithi097.stdout:Section: kernel 2024-05-08T18:17:03.315 INFO:teuthology.orchestra.run.smithi097.stdout:Installed-Size: 21 2024-05-08T18:17:03.315 INFO:teuthology.orchestra.run.smithi097.stdout:Maintainer: Ubuntu Kernel Team 2024-05-08T18:17:03.315 INFO:teuthology.orchestra.run.smithi097.stdout:Architecture: amd64 2024-05-08T18:17:03.315 INFO:teuthology.orchestra.run.smithi097.stdout:Source: linux-meta 2024-05-08T18:17:03.316 INFO:teuthology.orchestra.run.smithi097.stdout:Version: 5.15.0.106.106 2024-05-08T18:17:03.316 INFO:teuthology.orchestra.run.smithi097.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-106), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-05-08T18:17:03.316 INFO:teuthology.orchestra.run.smithi097.stdout:Depends: linux-image-5.15.0-106-generic, linux-modules-extra-5.15.0-106-generic, linux-firmware, intel-microcode, amd64-microcode 2024-05-08T18:17:03.316 INFO:teuthology.orchestra.run.smithi097.stdout:Recommends: thermald 2024-05-08T18:17:03.316 INFO:teuthology.orchestra.run.smithi097.stdout:Description: Generic Linux kernel image 2024-05-08T18:17:03.316 INFO:teuthology.orchestra.run.smithi097.stdout: This package will always depend on the latest generic kernel image 2024-05-08T18:17:03.316 INFO:teuthology.orchestra.run.smithi097.stdout: available. 2024-05-08T18:17:03.316 DEBUG:teuthology.orchestra.run.smithi097:> mktemp 2024-05-08T18:17:03.361 INFO:teuthology.orchestra.run.smithi097.stdout:/tmp/tmp.ocC9cAaces 2024-05-08T18:17:03.361 DEBUG:teuthology.orchestra.run.smithi097:> sudo cp /boot/grub/grub.cfg /tmp/tmp.ocC9cAaces 2024-05-08T18:17:03.416 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 0666 /tmp/tmp.ocC9cAaces 2024-05-08T18:17:03.521 DEBUG:teuthology.orchestra.remote:smithi097:/tmp/tmp.ocC9cAaces is 10KB 2024-05-08T18:17:03.534 DEBUG:teuthology.orchestra.run.smithi097:> rm -fr /tmp/tmp.ocC9cAaces 2024-05-08T18:17:03.539 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-05-08T18:17:03.592 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-05-08T18:17:03.592 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-05-08T18:17:03.592 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-05-08T18:17:03.675 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-106-generic 2024-05-08T18:17:03.675 DEBUG:teuthology.orchestra.run.smithi097:> sudo update-grub 2024-05-08T18:17:04.986 INFO:teuthology.orchestra.run.smithi097.stderr:Sourcing file `/etc/default/grub' 2024-05-08T18:17:04.987 INFO:teuthology.orchestra.run.smithi097.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-08T18:17:04.990 INFO:teuthology.orchestra.run.smithi097.stderr:Generating grub configuration file ... 2024-05-08T18:17:05.170 INFO:teuthology.orchestra.run.smithi097.stderr:Found linux image: /boot/vmlinuz-5.15.0-106-generic 2024-05-08T18:17:05.176 INFO:teuthology.orchestra.run.smithi097.stderr:Found initrd image: /boot/initrd.img-5.15.0-106-generic 2024-05-08T18:17:05.404 INFO:teuthology.orchestra.run.smithi097.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-05-08T18:17:05.410 INFO:teuthology.orchestra.run.smithi097.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-05-08T18:17:05.448 INFO:teuthology.orchestra.run.smithi097.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-05-08T18:17:05.453 INFO:teuthology.orchestra.run.smithi097.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-05-08T18:17:05.558 INFO:teuthology.orchestra.run.smithi097.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-05-08T18:17:05.558 INFO:teuthology.orchestra.run.smithi097.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-05-08T18:17:05.558 INFO:teuthology.orchestra.run.smithi097.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-05-08T18:17:05.575 INFO:teuthology.orchestra.run.smithi097.stderr:done 2024-05-08T18:17:05.592 DEBUG:teuthology.orchestra.run.smithi097:> sudo shutdown -r now 2024-05-08T18:17:32.574 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-05-08T18:17:32.575 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2024-05-08T18:17:32.576 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T18:17:35.598 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-05-08T18:17:35.598 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com' 2024-05-08T18:17:35.598 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T18:17:51.134 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.151 2024-05-08T18:17:53.950 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.97 2024-05-08T18:18:00.137 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2024-05-08T18:18:00.138 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T18:18:02.954 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com' 2024-05-08T18:18:02.955 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T18:18:03.198 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.151 2024-05-08T18:18:06.014 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.97 2024-05-08T18:18:15.206 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2024-05-08T18:18:15.207 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T18:18:18.018 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com' 2024-05-08T18:18:18.019 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T18:18:36.446 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.97 2024-05-08T18:18:51.456 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com' 2024-05-08T18:18:51.457 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T18:18:52.017 ERROR:teuthology.orchestra.connection:Error authenticating with smithi097.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/connection.py", line 106, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 485, in connect self._auth( File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 818, in _auth raise saved_exception File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 794, in _auth self._transport.auth_publickey(username, key) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1664, in auth_publickey raise SSHException("No existing session") paramiko.ssh_exception.SSHException: No existing session 2024-05-08T18:18:56.106 DEBUG:teuthology.orchestra.run.smithi097:> true 2024-05-08T18:18:57.190 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi097.front.sepia.ceph.com' 2024-05-08T18:18:57.190 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-106-generic"... 2024-05-08T18:18:57.190 DEBUG:teuthology.orchestra.run.smithi097:> uname -r 2024-05-08T18:18:57.237 INFO:teuthology.orchestra.run.smithi097.stdout:5.15.0-106-generic 2024-05-08T18:18:57.238 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-106-generic vs 5.15.0-106-generic 2024-05-08T18:18:57.238 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-08T18:18:57.238 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-05-08T18:18:58.239 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-05-08T18:18:58.239 DEBUG:teuthology.orchestra.run.smithi097:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-08T18:18:58.316 INFO:teuthology.orchestra.run.smithi097.stdout:ttyS1 2024-05-08T18:18:58.347 DEBUG:teuthology.parallel:result is None 2024-05-08T18:19:15.210 DEBUG:teuthology.orchestra.remote:timed out 2024-05-08T18:19:30.210 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2024-05-08T18:19:30.211 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T18:19:30.529 DEBUG:teuthology.orchestra.run.smithi151:> true 2024-05-08T18:19:31.104 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi151.front.sepia.ceph.com' 2024-05-08T18:19:31.104 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-106-generic"... 2024-05-08T18:19:31.104 DEBUG:teuthology.orchestra.run.smithi151:> uname -r 2024-05-08T18:19:31.149 INFO:teuthology.orchestra.run.smithi151.stdout:5.15.0-106-generic 2024-05-08T18:19:31.149 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-106-generic vs 5.15.0-106-generic 2024-05-08T18:19:31.150 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-08T18:19:31.150 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-05-08T18:19:32.150 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-05-08T18:19:32.151 DEBUG:teuthology.orchestra.run.smithi151:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-08T18:19:32.229 INFO:teuthology.orchestra.run.smithi151.stdout:ttyS1 2024-05-08T18:19:32.267 DEBUG:teuthology.parallel:result is None 2024-05-08T18:19:32.267 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-08T18:19:32.274 INFO:teuthology.task.internal:Creating test directory... 2024-05-08T18:19:32.275 DEBUG:teuthology.orchestra.run.smithi097:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-08T18:19:32.277 DEBUG:teuthology.orchestra.run.smithi151:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-08T18:19:32.282 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-08T18:19:32.289 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-08T18:19:32.297 INFO:teuthology.task.internal:Creating archive directory... 2024-05-08T18:19:32.297 DEBUG:teuthology.orchestra.run.smithi097:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-08T18:19:32.326 DEBUG:teuthology.orchestra.run.smithi151:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-08T18:19:32.344 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-08T18:19:32.351 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-08T18:19:32.351 DEBUG:teuthology.orchestra.run.smithi097:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-08T18:19:32.382 DEBUG:teuthology.orchestra.run.smithi151:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-08T18:19:32.396 INFO:teuthology.orchestra.run.smithi097.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T18:19:32.403 INFO:teuthology.orchestra.run.smithi151.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T18:19:32.405 INFO:teuthology.orchestra.run.smithi097.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T18:19:32.411 INFO:teuthology.orchestra.run.smithi151.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T18:19:32.412 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-08T18:19:32.420 INFO:teuthology.task.internal:Configuring sudo... 2024-05-08T18:19:32.420 DEBUG:teuthology.orchestra.run.smithi097:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-08T18:19:32.450 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-08T18:19:32.466 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-08T18:19:32.476 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-08T18:19:32.476 DEBUG:teuthology.orchestra.run.smithi097:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-08T18:19:32.506 DEBUG:teuthology.orchestra.run.smithi151:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-08T18:19:32.513 DEBUG:teuthology.orchestra.run.smithi097:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T18:19:32.557 DEBUG:teuthology.orchestra.run.smithi097:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T18:19:32.605 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-05-08T18:19:32.605 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-08T18:19:32.676 DEBUG:teuthology.orchestra.run.smithi151:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T18:19:32.682 DEBUG:teuthology.orchestra.run.smithi151:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T18:19:32.730 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-05-08T18:19:32.730 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-08T18:19:32.794 DEBUG:teuthology.orchestra.run.smithi097:> sudo service rsyslog restart 2024-05-08T18:19:32.797 DEBUG:teuthology.orchestra.run.smithi151:> sudo service rsyslog restart 2024-05-08T18:19:32.873 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-08T18:19:32.880 INFO:teuthology.task.internal:Starting timer... 2024-05-08T18:19:32.880 INFO:teuthology.run_tasks:Running task pcp... 2024-05-08T18:19:32.896 INFO:teuthology.run_tasks:Running task selinux... 2024-05-08T18:19:32.905 DEBUG:teuthology.task.selinux:Excluding smithi097: OS 'ubuntu' does not support SELinux 2024-05-08T18:19:32.905 DEBUG:teuthology.task.selinux:Excluding smithi151: OS 'ubuntu' does not support SELinux 2024-05-08T18:19:32.906 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-08T18:19:32.906 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-05-08T18:19:32.906 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-08T18:19:32.906 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-08T18:19:32.915 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-08T18:19:32.931 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-08T18:19:32.933 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi097.front.sepia.ceph.com,smithi151.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-08T18:26:33.085 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi097.front.sepia.ceph.com'), Remote(name='ubuntu@smithi151.front.sepia.ceph.com')] 2024-05-08T18:26:33.086 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com' 2024-05-08T18:26:33.087 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T18:26:33.169 DEBUG:teuthology.orchestra.run.smithi097:> true 2024-05-08T18:26:33.247 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi097.front.sepia.ceph.com' 2024-05-08T18:26:33.247 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2024-05-08T18:26:33.248 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T18:26:33.328 DEBUG:teuthology.orchestra.run.smithi151:> true 2024-05-08T18:26:33.406 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi151.front.sepia.ceph.com' 2024-05-08T18:26:33.406 INFO:teuthology.run_tasks:Running task clock... 2024-05-08T18:26:33.416 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-08T18:26:33.416 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-08T18:26:33.417 DEBUG:teuthology.orchestra.run.smithi097:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T18:26:33.419 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-08T18:26:33.420 DEBUG:teuthology.orchestra.run.smithi151:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T18:26:33.447 INFO:teuthology.orchestra.run.smithi097.stdout: 8 May 18:26:33 ntpd[17243]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-05-08T18:26:33.447 INFO:teuthology.orchestra.run.smithi097.stdout: 8 May 18:26:33 ntpd[17243]: Command line: ntpd -gq 2024-05-08T18:26:33.447 INFO:teuthology.orchestra.run.smithi097.stdout: 8 May 18:26:33 ntpd[17243]: ---------------------------------------------------- 2024-05-08T18:26:33.447 INFO:teuthology.orchestra.run.smithi097.stdout: 8 May 18:26:33 ntpd[17243]: ntp-4 is maintained by Network Time Foundation, 2024-05-08T18:26:33.447 INFO:teuthology.orchestra.run.smithi097.stdout: 8 May 18:26:33 ntpd[17243]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-05-08T18:26:33.447 INFO:teuthology.orchestra.run.smithi097.stdout: 8 May 18:26:33 ntpd[17243]: corporation. Support and training for ntp-4 are 2024-05-08T18:26:33.447 INFO:teuthology.orchestra.run.smithi097.stdout: 8 May 18:26:33 ntpd[17243]: available at https://www.nwtime.org/support 2024-05-08T18:26:33.447 INFO:teuthology.orchestra.run.smithi097.stdout: 8 May 18:26:33 ntpd[17243]: ---------------------------------------------------- 2024-05-08T18:26:33.448 INFO:teuthology.orchestra.run.smithi097.stdout: 8 May 18:26:33 ntpd[17243]: proto: precision = 0.061 usec (-24) 2024-05-08T18:26:33.448 INFO:teuthology.orchestra.run.smithi097.stdout: 8 May 18:26:33 ntpd[17243]: basedate set to 2022-02-04 2024-05-08T18:26:33.448 INFO:teuthology.orchestra.run.smithi097.stdout: 8 May 18:26:33 ntpd[17243]: gps base set to 2022-02-06 (week 2196) 2024-05-08T18:26:33.448 INFO:teuthology.orchestra.run.smithi097.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-08T18:26:33.449 INFO:teuthology.orchestra.run.smithi097.stdout: 8 May 18:26:33 ntpd[17243]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-08T18:26:33.449 INFO:teuthology.orchestra.run.smithi097.stdout: 8 May 18:26:33 ntpd[17243]: restrict ::: KOD does nothing without LIMITED. 2024-05-08T18:26:33.449 INFO:teuthology.orchestra.run.smithi097.stderr:restrict ::: KOD does nothing without LIMITED. 2024-05-08T18:26:33.450 INFO:teuthology.orchestra.run.smithi097.stdout: 8 May 18:26:33 ntpd[17243]: Listen and drop on 0 v6wildcard [::]:123 2024-05-08T18:26:33.450 INFO:teuthology.orchestra.run.smithi097.stdout: 8 May 18:26:33 ntpd[17243]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-05-08T18:26:33.450 INFO:teuthology.orchestra.run.smithi097.stdout: 8 May 18:26:33 ntpd[17243]: Listen normally on 2 lo 127.0.0.1:123 2024-05-08T18:26:33.450 INFO:teuthology.orchestra.run.smithi097.stdout: 8 May 18:26:33 ntpd[17243]: Listen normally on 3 enp3s0f1 172.21.15.97:123 2024-05-08T18:26:33.450 INFO:teuthology.orchestra.run.smithi097.stdout: 8 May 18:26:33 ntpd[17243]: Listen normally on 4 lo [::1]:123 2024-05-08T18:26:33.450 INFO:teuthology.orchestra.run.smithi097.stdout: 8 May 18:26:33 ntpd[17243]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d805%5]:123 2024-05-08T18:26:33.450 INFO:teuthology.orchestra.run.smithi097.stdout: 8 May 18:26:33 ntpd[17243]: Listening on routing socket on fd #22 for interface updates 2024-05-08T18:26:33.478 INFO:teuthology.orchestra.run.smithi151.stdout: 8 May 18:26:33 ntpd[17240]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-05-08T18:26:33.478 INFO:teuthology.orchestra.run.smithi151.stdout: 8 May 18:26:33 ntpd[17240]: Command line: ntpd -gq 2024-05-08T18:26:33.478 INFO:teuthology.orchestra.run.smithi151.stdout: 8 May 18:26:33 ntpd[17240]: ---------------------------------------------------- 2024-05-08T18:26:33.478 INFO:teuthology.orchestra.run.smithi151.stdout: 8 May 18:26:33 ntpd[17240]: ntp-4 is maintained by Network Time Foundation, 2024-05-08T18:26:33.478 INFO:teuthology.orchestra.run.smithi151.stdout: 8 May 18:26:33 ntpd[17240]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-05-08T18:26:33.478 INFO:teuthology.orchestra.run.smithi151.stdout: 8 May 18:26:33 ntpd[17240]: corporation. Support and training for ntp-4 are 2024-05-08T18:26:33.478 INFO:teuthology.orchestra.run.smithi151.stdout: 8 May 18:26:33 ntpd[17240]: available at https://www.nwtime.org/support 2024-05-08T18:26:33.478 INFO:teuthology.orchestra.run.smithi151.stdout: 8 May 18:26:33 ntpd[17240]: ---------------------------------------------------- 2024-05-08T18:26:33.479 INFO:teuthology.orchestra.run.smithi151.stdout: 8 May 18:26:33 ntpd[17240]: proto: precision = 0.044 usec (-24) 2024-05-08T18:26:33.479 INFO:teuthology.orchestra.run.smithi151.stdout: 8 May 18:26:33 ntpd[17240]: basedate set to 2022-02-04 2024-05-08T18:26:33.479 INFO:teuthology.orchestra.run.smithi151.stdout: 8 May 18:26:33 ntpd[17240]: gps base set to 2022-02-06 (week 2196) 2024-05-08T18:26:33.479 INFO:teuthology.orchestra.run.smithi151.stdout: 8 May 18:26:33 ntpd[17240]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-08T18:26:33.480 INFO:teuthology.orchestra.run.smithi151.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-08T18:26:33.480 INFO:teuthology.orchestra.run.smithi151.stderr:restrict ::: KOD does nothing without LIMITED. 2024-05-08T18:26:33.481 INFO:teuthology.orchestra.run.smithi151.stdout: 8 May 18:26:33 ntpd[17240]: restrict ::: KOD does nothing without LIMITED. 2024-05-08T18:26:33.481 INFO:teuthology.orchestra.run.smithi151.stdout: 8 May 18:26:33 ntpd[17240]: Listen and drop on 0 v6wildcard [::]:123 2024-05-08T18:26:33.481 INFO:teuthology.orchestra.run.smithi151.stdout: 8 May 18:26:33 ntpd[17240]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-05-08T18:26:33.481 INFO:teuthology.orchestra.run.smithi151.stdout: 8 May 18:26:33 ntpd[17240]: Listen normally on 2 lo 127.0.0.1:123 2024-05-08T18:26:33.481 INFO:teuthology.orchestra.run.smithi151.stdout: 8 May 18:26:33 ntpd[17240]: Listen normally on 3 enp3s0f1 172.21.15.151:123 2024-05-08T18:26:33.481 INFO:teuthology.orchestra.run.smithi151.stdout: 8 May 18:26:33 ntpd[17240]: Listen normally on 4 lo [::1]:123 2024-05-08T18:26:33.481 INFO:teuthology.orchestra.run.smithi151.stdout: 8 May 18:26:33 ntpd[17240]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6f63%5]:123 2024-05-08T18:26:33.481 INFO:teuthology.orchestra.run.smithi151.stdout: 8 May 18:26:33 ntpd[17240]: Listening on routing socket on fd #22 for interface updates 2024-05-08T18:26:34.448 INFO:teuthology.orchestra.run.smithi097.stderr: 8 May 18:26:34 ntpd[17243]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:26:34.448 INFO:teuthology.orchestra.run.smithi097.stderr: 8 May 18:26:34 ntpd[17243]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:26:34.448 INFO:teuthology.orchestra.run.smithi097.stderr: 8 May 18:26:34 ntpd[17243]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:26:34.448 INFO:teuthology.orchestra.run.smithi097.stderr: 8 May 18:26:34 ntpd[17243]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:26:34.448 INFO:teuthology.orchestra.run.smithi097.stderr: 8 May 18:26:34 ntpd[17243]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:26:34.448 INFO:teuthology.orchestra.run.smithi097.stderr: 8 May 18:26:34 ntpd[17243]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:26:34.448 INFO:teuthology.orchestra.run.smithi097.stderr: 8 May 18:26:34 ntpd[17243]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T18:26:34.448 INFO:teuthology.orchestra.run.smithi097.stderr: 8 May 18:26:34 ntpd[17243]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T18:26:34.479 INFO:teuthology.orchestra.run.smithi151.stderr: 8 May 18:26:34 ntpd[17240]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:26:34.479 INFO:teuthology.orchestra.run.smithi151.stderr: 8 May 18:26:34 ntpd[17240]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:26:34.479 INFO:teuthology.orchestra.run.smithi151.stderr: 8 May 18:26:34 ntpd[17240]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:26:34.479 INFO:teuthology.orchestra.run.smithi151.stderr: 8 May 18:26:34 ntpd[17240]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:26:34.480 INFO:teuthology.orchestra.run.smithi151.stderr: 8 May 18:26:34 ntpd[17240]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:26:34.480 INFO:teuthology.orchestra.run.smithi151.stderr: 8 May 18:26:34 ntpd[17240]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:26:34.480 INFO:teuthology.orchestra.run.smithi151.stderr: 8 May 18:26:34 ntpd[17240]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:26:34.480 INFO:teuthology.orchestra.run.smithi151.stderr: 8 May 18:26:34 ntpd[17240]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:26:34.480 INFO:teuthology.orchestra.run.smithi151.stderr: 8 May 18:26:34 ntpd[17240]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T18:26:34.480 INFO:teuthology.orchestra.run.smithi151.stderr: 8 May 18:26:34 ntpd[17240]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T18:26:34.480 INFO:teuthology.orchestra.run.smithi151.stderr: 8 May 18:26:34 ntpd[17240]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:26:34.480 INFO:teuthology.orchestra.run.smithi151.stderr: 8 May 18:26:34 ntpd[17240]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:26:34.480 INFO:teuthology.orchestra.run.smithi151.stderr: 8 May 18:26:34 ntpd[17240]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T18:26:34.480 INFO:teuthology.orchestra.run.smithi151.stderr: 8 May 18:26:34 ntpd[17240]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T18:26:36.447 INFO:teuthology.orchestra.run.smithi097.stderr: 8 May 18:26:36 ntpd[17243]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:26:36.448 INFO:teuthology.orchestra.run.smithi097.stderr: 8 May 18:26:36 ntpd[17243]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:26:36.448 INFO:teuthology.orchestra.run.smithi097.stderr: 8 May 18:26:36 ntpd[17243]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:26:36.448 INFO:teuthology.orchestra.run.smithi097.stderr: 8 May 18:26:36 ntpd[17243]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:26:36.448 INFO:teuthology.orchestra.run.smithi097.stderr: 8 May 18:26:36 ntpd[17243]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T18:26:36.448 INFO:teuthology.orchestra.run.smithi097.stderr: 8 May 18:26:36 ntpd[17243]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T18:26:36.479 INFO:teuthology.orchestra.run.smithi151.stderr: 8 May 18:26:36 ntpd[17240]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:26:36.480 INFO:teuthology.orchestra.run.smithi151.stderr: 8 May 18:26:36 ntpd[17240]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:26:36.480 INFO:teuthology.orchestra.run.smithi151.stderr: 8 May 18:26:36 ntpd[17240]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:26:36.480 INFO:teuthology.orchestra.run.smithi151.stderr: 8 May 18:26:36 ntpd[17240]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:26:36.480 INFO:teuthology.orchestra.run.smithi151.stderr: 8 May 18:26:36 ntpd[17240]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:26:36.480 INFO:teuthology.orchestra.run.smithi151.stderr: 8 May 18:26:36 ntpd[17240]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:26:36.480 INFO:teuthology.orchestra.run.smithi151.stderr: 8 May 18:26:36 ntpd[17240]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T18:26:36.480 INFO:teuthology.orchestra.run.smithi151.stderr: 8 May 18:26:36 ntpd[17240]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T18:26:36.480 INFO:teuthology.orchestra.run.smithi151.stderr: 8 May 18:26:36 ntpd[17240]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:26:36.480 INFO:teuthology.orchestra.run.smithi151.stderr: 8 May 18:26:36 ntpd[17240]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:26:36.480 INFO:teuthology.orchestra.run.smithi151.stderr: 8 May 18:26:36 ntpd[17240]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T18:26:36.480 INFO:teuthology.orchestra.run.smithi151.stderr: 8 May 18:26:36 ntpd[17240]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T18:26:37.448 INFO:teuthology.orchestra.run.smithi097.stderr: 8 May 18:26:37 ntpd[17243]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:26:37.448 INFO:teuthology.orchestra.run.smithi097.stderr: 8 May 18:26:37 ntpd[17243]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:26:37.448 INFO:teuthology.orchestra.run.smithi097.stderr: 8 May 18:26:37 ntpd[17243]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:26:37.448 INFO:teuthology.orchestra.run.smithi097.stderr: 8 May 18:26:37 ntpd[17243]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:26:37.448 INFO:teuthology.orchestra.run.smithi097.stderr: 8 May 18:26:37 ntpd[17243]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:26:37.448 INFO:teuthology.orchestra.run.smithi097.stderr: 8 May 18:26:37 ntpd[17243]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:26:37.448 INFO:teuthology.orchestra.run.smithi097.stderr: 8 May 18:26:37 ntpd[17243]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T18:26:37.448 INFO:teuthology.orchestra.run.smithi097.stderr: 8 May 18:26:37 ntpd[17243]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T18:26:37.449 INFO:teuthology.orchestra.run.smithi097.stderr: 8 May 18:26:37 ntpd[17243]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:26:37.449 INFO:teuthology.orchestra.run.smithi097.stderr: 8 May 18:26:37 ntpd[17243]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:26:37.449 INFO:teuthology.orchestra.run.smithi097.stderr: 8 May 18:26:37 ntpd[17243]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T18:26:37.449 INFO:teuthology.orchestra.run.smithi097.stderr: 8 May 18:26:37 ntpd[17243]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T18:26:38.448 INFO:teuthology.orchestra.run.smithi097.stderr: 8 May 18:26:38 ntpd[17243]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:26:38.448 INFO:teuthology.orchestra.run.smithi097.stderr: 8 May 18:26:38 ntpd[17243]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:26:38.448 INFO:teuthology.orchestra.run.smithi097.stderr: 8 May 18:26:38 ntpd[17243]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:26:38.448 INFO:teuthology.orchestra.run.smithi097.stderr: 8 May 18:26:38 ntpd[17243]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:26:38.448 INFO:teuthology.orchestra.run.smithi097.stderr: 8 May 18:26:38 ntpd[17243]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T18:26:38.448 INFO:teuthology.orchestra.run.smithi097.stderr: 8 May 18:26:38 ntpd[17243]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T18:26:38.480 INFO:teuthology.orchestra.run.smithi151.stderr: 8 May 18:26:38 ntpd[17240]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:26:38.480 INFO:teuthology.orchestra.run.smithi151.stderr: 8 May 18:26:38 ntpd[17240]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:26:38.480 INFO:teuthology.orchestra.run.smithi151.stderr: 8 May 18:26:38 ntpd[17240]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:26:38.480 INFO:teuthology.orchestra.run.smithi151.stderr: 8 May 18:26:38 ntpd[17240]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:26:38.480 INFO:teuthology.orchestra.run.smithi151.stderr: 8 May 18:26:38 ntpd[17240]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:26:38.481 INFO:teuthology.orchestra.run.smithi151.stderr: 8 May 18:26:38 ntpd[17240]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:26:38.481 INFO:teuthology.orchestra.run.smithi151.stderr: 8 May 18:26:38 ntpd[17240]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:26:38.481 INFO:teuthology.orchestra.run.smithi151.stderr: 8 May 18:26:38 ntpd[17240]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:26:38.481 INFO:teuthology.orchestra.run.smithi151.stderr: 8 May 18:26:38 ntpd[17240]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T18:26:38.481 INFO:teuthology.orchestra.run.smithi151.stderr: 8 May 18:26:38 ntpd[17240]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T18:26:38.481 INFO:teuthology.orchestra.run.smithi151.stderr: 8 May 18:26:38 ntpd[17240]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:26:38.481 INFO:teuthology.orchestra.run.smithi151.stderr: 8 May 18:26:38 ntpd[17240]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:26:38.481 INFO:teuthology.orchestra.run.smithi151.stderr: 8 May 18:26:38 ntpd[17240]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T18:26:38.481 INFO:teuthology.orchestra.run.smithi151.stderr: 8 May 18:26:38 ntpd[17240]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T18:26:38.481 INFO:teuthology.orchestra.run.smithi151.stderr: 8 May 18:26:38 ntpd[17240]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:26:38.481 INFO:teuthology.orchestra.run.smithi151.stderr: 8 May 18:26:38 ntpd[17240]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:26:38.481 INFO:teuthology.orchestra.run.smithi151.stderr: 8 May 18:26:38 ntpd[17240]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T18:26:38.481 INFO:teuthology.orchestra.run.smithi151.stderr: 8 May 18:26:38 ntpd[17240]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T18:26:39.448 INFO:teuthology.orchestra.run.smithi097.stderr: 8 May 18:26:39 ntpd[17243]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:26:39.448 INFO:teuthology.orchestra.run.smithi097.stderr: 8 May 18:26:39 ntpd[17243]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:26:39.448 INFO:teuthology.orchestra.run.smithi097.stderr: 8 May 18:26:39 ntpd[17243]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:26:39.448 INFO:teuthology.orchestra.run.smithi097.stderr: 8 May 18:26:39 ntpd[17243]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:26:39.448 INFO:teuthology.orchestra.run.smithi097.stderr: 8 May 18:26:39 ntpd[17243]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:26:39.448 INFO:teuthology.orchestra.run.smithi097.stderr: 8 May 18:26:39 ntpd[17243]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:26:39.448 INFO:teuthology.orchestra.run.smithi097.stderr: 8 May 18:26:39 ntpd[17243]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T18:26:39.448 INFO:teuthology.orchestra.run.smithi097.stderr: 8 May 18:26:39 ntpd[17243]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T18:26:39.448 INFO:teuthology.orchestra.run.smithi097.stderr: 8 May 18:26:39 ntpd[17243]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:26:39.448 INFO:teuthology.orchestra.run.smithi097.stderr: 8 May 18:26:39 ntpd[17243]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:26:39.448 INFO:teuthology.orchestra.run.smithi097.stderr: 8 May 18:26:39 ntpd[17243]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T18:26:39.449 INFO:teuthology.orchestra.run.smithi097.stderr: 8 May 18:26:39 ntpd[17243]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T18:26:40.447 INFO:teuthology.orchestra.run.smithi097.stderr: 8 May 18:26:40 ntpd[17243]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:26:40.448 INFO:teuthology.orchestra.run.smithi097.stderr: 8 May 18:26:40 ntpd[17243]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:26:40.448 INFO:teuthology.orchestra.run.smithi097.stderr: 8 May 18:26:40 ntpd[17243]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:26:40.448 INFO:teuthology.orchestra.run.smithi097.stderr: 8 May 18:26:40 ntpd[17243]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:26:40.448 INFO:teuthology.orchestra.run.smithi097.stderr: 8 May 18:26:40 ntpd[17243]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T18:26:40.448 INFO:teuthology.orchestra.run.smithi097.stderr: 8 May 18:26:40 ntpd[17243]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T18:26:40.448 INFO:teuthology.orchestra.run.smithi097.stdout: 8 May 18:26:40 ntpd[17243]: ntpd: time slew -0.000369 s 2024-05-08T18:26:40.448 INFO:teuthology.orchestra.run.smithi097.stdout:ntpd: time slew -0.000369s 2024-05-08T18:26:40.449 INFO:teuthology.orchestra.run.smithi097.stderr: 8 May 18:26:40 ntpd[17243]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-05-08T18:26:40.449 INFO:teuthology.orchestra.run.smithi097.stderr: 8 May 18:26:40 ntpd[17243]: can't open /var/log/ntpstats/loopstats.20240508: Permission denied 2024-05-08T18:26:40.479 INFO:teuthology.orchestra.run.smithi151.stderr: 8 May 18:26:40 ntpd[17240]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:26:40.479 INFO:teuthology.orchestra.run.smithi151.stderr: 8 May 18:26:40 ntpd[17240]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:26:40.479 INFO:teuthology.orchestra.run.smithi151.stderr: 8 May 18:26:40 ntpd[17240]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:26:40.479 INFO:teuthology.orchestra.run.smithi151.stderr: 8 May 18:26:40 ntpd[17240]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:26:40.480 INFO:teuthology.orchestra.run.smithi151.stderr: 8 May 18:26:40 ntpd[17240]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:26:40.480 INFO:teuthology.orchestra.run.smithi151.stderr: 8 May 18:26:40 ntpd[17240]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:26:40.480 INFO:teuthology.orchestra.run.smithi151.stderr: 8 May 18:26:40 ntpd[17240]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:26:40.480 INFO:teuthology.orchestra.run.smithi151.stderr: 8 May 18:26:40 ntpd[17240]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:26:40.480 INFO:teuthology.orchestra.run.smithi151.stderr: 8 May 18:26:40 ntpd[17240]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T18:26:40.480 INFO:teuthology.orchestra.run.smithi151.stderr: 8 May 18:26:40 ntpd[17240]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T18:26:40.480 INFO:teuthology.orchestra.run.smithi151.stdout: 8 May 18:26:40 ntpd[17240]: ntpd: time slew -0.003280 s 2024-05-08T18:26:40.480 INFO:teuthology.orchestra.run.smithi151.stdout:ntpd: time slew -0.003280s 2024-05-08T18:26:40.481 INFO:teuthology.orchestra.run.smithi151.stderr: 8 May 18:26:40 ntpd[17240]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-05-08T18:26:40.481 INFO:teuthology.orchestra.run.smithi151.stderr: 8 May 18:26:40 ntpd[17240]: can't open /var/log/ntpstats/loopstats.20240508: Permission denied 2024-05-08T18:26:40.501 INFO:teuthology.orchestra.run.smithi097.stdout: remote refid st t when poll reach delay offset jitter 2024-05-08T18:26:40.501 INFO:teuthology.orchestra.run.smithi097.stdout:============================================================================== 2024-05-08T18:26:40.501 INFO:teuthology.orchestra.run.smithi097.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-08T18:26:40.501 INFO:teuthology.orchestra.run.smithi097.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-08T18:26:40.501 INFO:teuthology.orchestra.run.smithi097.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-08T18:26:40.501 INFO:teuthology.orchestra.run.smithi097.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-08T18:26:40.536 INFO:teuthology.orchestra.run.smithi151.stdout: remote refid st t when poll reach delay offset jitter 2024-05-08T18:26:40.536 INFO:teuthology.orchestra.run.smithi151.stdout:============================================================================== 2024-05-08T18:26:40.537 INFO:teuthology.orchestra.run.smithi151.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-08T18:26:40.537 INFO:teuthology.orchestra.run.smithi151.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-08T18:26:40.537 INFO:teuthology.orchestra.run.smithi151.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-08T18:26:40.537 INFO:teuthology.orchestra.run.smithi151.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-08T18:26:40.538 INFO:teuthology.run_tasks:Running task install... 2024-05-08T18:26:40.546 DEBUG:teuthology.task.install:project ceph 2024-05-08T18:26:40.546 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '27d371685027569bcfa4efc661d3d3186f3a1776'}} 2024-05-08T18:26:40.546 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '27d371685027569bcfa4efc661d3d3186f3a1776'} 2024-05-08T18:26:40.547 INFO:teuthology.task.install:Using flavor: default 2024-05-08T18:26:40.553 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-08T18:26:40.553 INFO:teuthology.task.install:extra packages: [] 2024-05-08T18:26:40.553 DEBUG:teuthology.orchestra.run.smithi097:> sudo apt-key list | grep Ceph 2024-05-08T18:26:40.554 DEBUG:teuthology.orchestra.run.smithi151:> sudo apt-key list | grep Ceph 2024-05-08T18:26:40.609 INFO:teuthology.orchestra.run.smithi097.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-05-08T18:26:40.634 INFO:teuthology.orchestra.run.smithi151.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-05-08T18:26:40.638 INFO:teuthology.orchestra.run.smithi097.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-05-08T18:26:40.638 INFO:teuthology.orchestra.run.smithi097.stdout:uid [ unknown] Ceph.com (release key) 2024-05-08T18:26:40.638 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-05-08T18:26:40.639 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=27d371685027569bcfa4efc661d3d3186f3a1776 2024-05-08T18:26:40.661 INFO:teuthology.orchestra.run.smithi151.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-05-08T18:26:40.661 INFO:teuthology.orchestra.run.smithi151.stdout:uid [ unknown] Ceph.com (release key) 2024-05-08T18:26:40.662 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-05-08T18:26:40.662 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=27d371685027569bcfa4efc661d3d3186f3a1776 2024-05-08T18:26:40.787 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default/ 2024-05-08T18:26:40.787 INFO:teuthology.task.install.deb:Package version is 19.0.0-3525-g27d37168-1jammy 2024-05-08T18:26:40.962 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default/ 2024-05-08T18:26:40.963 INFO:teuthology.task.install.deb:Package version is 19.0.0-3525-g27d37168-1jammy 2024-05-08T18:26:41.158 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-05-08T18:26:41.158 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-05-08T18:26:41.172 DEBUG:teuthology.orchestra.run.smithi097:> sudo apt-get update 2024-05-08T18:26:41.251 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-05-08T18:26:41.251 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-05-08T18:26:41.266 DEBUG:teuthology.orchestra.run.smithi151:> sudo apt-get update 2024-05-08T18:26:41.350 INFO:teuthology.orchestra.run.smithi097.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-05-08T18:26:41.444 INFO:teuthology.orchestra.run.smithi151.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-08T18:26:41.444 INFO:teuthology.orchestra.run.smithi151.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-05-08T18:26:41.457 INFO:teuthology.orchestra.run.smithi151.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-05-08T18:26:41.460 INFO:teuthology.orchestra.run.smithi097.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-08T18:26:41.479 INFO:teuthology.orchestra.run.smithi151.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-05-08T18:26:41.543 INFO:teuthology.orchestra.run.smithi097.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-05-08T18:26:41.625 INFO:teuthology.orchestra.run.smithi097.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-05-08T18:26:41.639 INFO:teuthology.orchestra.run.smithi097.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy InRelease 2024-05-08T18:26:41.667 INFO:teuthology.orchestra.run.smithi151.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy InRelease 2024-05-08T18:26:41.721 INFO:teuthology.orchestra.run.smithi097.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-05-08T18:26:41.735 INFO:teuthology.orchestra.run.smithi151.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-05-08T18:26:41.803 INFO:teuthology.orchestra.run.smithi151.stdout:Ign:7 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy Release.gpg 2024-05-08T18:26:41.804 INFO:teuthology.orchestra.run.smithi097.stdout:Ign:7 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy Release.gpg 2024-05-08T18:26:41.870 INFO:teuthology.orchestra.run.smithi151.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,418 B] 2024-05-08T18:26:41.887 INFO:teuthology.orchestra.run.smithi097.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-05-08T18:26:41.946 INFO:teuthology.orchestra.run.smithi151.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-05-08T18:26:41.979 INFO:teuthology.orchestra.run.smithi097.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,418 B] 2024-05-08T18:26:42.044 INFO:teuthology.orchestra.run.smithi151.stdout:Fetched 29.3 kB in 1s (50.6 kB/s) 2024-05-08T18:26:42.072 INFO:teuthology.orchestra.run.smithi097.stdout:Fetched 29.3 kB in 1s (41.7 kB/s) 2024-05-08T18:26:43.035 INFO:teuthology.orchestra.run.smithi151.stdout:Reading package lists... 2024-05-08T18:26:43.051 DEBUG:teuthology.orchestra.run.smithi151:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3525-g27d37168-1jammy cephadm=19.0.0-3525-g27d37168-1jammy ceph-mds=19.0.0-3525-g27d37168-1jammy ceph-mgr=19.0.0-3525-g27d37168-1jammy ceph-common=19.0.0-3525-g27d37168-1jammy ceph-fuse=19.0.0-3525-g27d37168-1jammy ceph-test=19.0.0-3525-g27d37168-1jammy ceph-volume=19.0.0-3525-g27d37168-1jammy radosgw=19.0.0-3525-g27d37168-1jammy python3-rados=19.0.0-3525-g27d37168-1jammy python3-rgw=19.0.0-3525-g27d37168-1jammy python3-cephfs=19.0.0-3525-g27d37168-1jammy python3-rbd=19.0.0-3525-g27d37168-1jammy libcephfs2=19.0.0-3525-g27d37168-1jammy libcephfs-dev=19.0.0-3525-g27d37168-1jammy librados2=19.0.0-3525-g27d37168-1jammy librbd1=19.0.0-3525-g27d37168-1jammy rbd-fuse=19.0.0-3525-g27d37168-1jammy 2024-05-08T18:26:43.072 INFO:teuthology.orchestra.run.smithi097.stdout:Reading package lists... 2024-05-08T18:26:43.086 DEBUG:teuthology.orchestra.run.smithi097:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3525-g27d37168-1jammy cephadm=19.0.0-3525-g27d37168-1jammy ceph-mds=19.0.0-3525-g27d37168-1jammy ceph-mgr=19.0.0-3525-g27d37168-1jammy ceph-common=19.0.0-3525-g27d37168-1jammy ceph-fuse=19.0.0-3525-g27d37168-1jammy ceph-test=19.0.0-3525-g27d37168-1jammy ceph-volume=19.0.0-3525-g27d37168-1jammy radosgw=19.0.0-3525-g27d37168-1jammy python3-rados=19.0.0-3525-g27d37168-1jammy python3-rgw=19.0.0-3525-g27d37168-1jammy python3-cephfs=19.0.0-3525-g27d37168-1jammy python3-rbd=19.0.0-3525-g27d37168-1jammy libcephfs2=19.0.0-3525-g27d37168-1jammy libcephfs-dev=19.0.0-3525-g27d37168-1jammy librados2=19.0.0-3525-g27d37168-1jammy librbd1=19.0.0-3525-g27d37168-1jammy rbd-fuse=19.0.0-3525-g27d37168-1jammy 2024-05-08T18:26:43.102 INFO:teuthology.orchestra.run.smithi151.stdout:Reading package lists... 2024-05-08T18:26:43.145 INFO:teuthology.orchestra.run.smithi097.stdout:Reading package lists... 2024-05-08T18:26:43.287 INFO:teuthology.orchestra.run.smithi151.stdout:Building dependency tree... 2024-05-08T18:26:43.287 INFO:teuthology.orchestra.run.smithi151.stdout:Reading state information... 2024-05-08T18:26:43.344 INFO:teuthology.orchestra.run.smithi097.stdout:Building dependency tree... 2024-05-08T18:26:43.345 INFO:teuthology.orchestra.run.smithi097.stdout:Reading state information... 2024-05-08T18:26:43.467 INFO:teuthology.orchestra.run.smithi151.stdout:The following packages were automatically installed and are no longer required: 2024-05-08T18:26:43.467 INFO:teuthology.orchestra.run.smithi151.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-08T18:26:43.467 INFO:teuthology.orchestra.run.smithi151.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-08T18:26:43.468 INFO:teuthology.orchestra.run.smithi151.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-08T18:26:43.468 INFO:teuthology.orchestra.run.smithi151.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-08T18:26:43.468 INFO:teuthology.orchestra.run.smithi151.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-08T18:26:43.469 INFO:teuthology.orchestra.run.smithi151.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-08T18:26:43.469 INFO:teuthology.orchestra.run.smithi151.stdout:The following additional packages will be installed: 2024-05-08T18:26:43.469 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-05-08T18:26:43.469 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-05-08T18:26:43.469 INFO:teuthology.orchestra.run.smithi151.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-05-08T18:26:43.469 INFO:teuthology.orchestra.run.smithi151.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-05-08T18:26:43.470 INFO:teuthology.orchestra.run.smithi151.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-05-08T18:26:43.470 INFO:teuthology.orchestra.run.smithi151.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-05-08T18:26:43.470 INFO:teuthology.orchestra.run.smithi151.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-05-08T18:26:43.470 INFO:teuthology.orchestra.run.smithi151.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-05-08T18:26:43.470 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-05-08T18:26:43.470 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-05-08T18:26:43.471 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-05-08T18:26:43.471 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-05-08T18:26:43.471 INFO:teuthology.orchestra.run.smithi151.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-05-08T18:26:43.471 INFO:teuthology.orchestra.run.smithi151.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-05-08T18:26:43.471 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-05-08T18:26:43.471 INFO:teuthology.orchestra.run.smithi151.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-05-08T18:26:43.471 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-05-08T18:26:43.471 INFO:teuthology.orchestra.run.smithi151.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-05-08T18:26:43.471 INFO:teuthology.orchestra.run.smithi151.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-05-08T18:26:43.471 INFO:teuthology.orchestra.run.smithi151.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-05-08T18:26:43.471 INFO:teuthology.orchestra.run.smithi151.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-05-08T18:26:43.471 INFO:teuthology.orchestra.run.smithi151.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-05-08T18:26:43.471 INFO:teuthology.orchestra.run.smithi151.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-05-08T18:26:43.471 INFO:teuthology.orchestra.run.smithi151.stdout: xmlstarlet zip 2024-05-08T18:26:43.472 INFO:teuthology.orchestra.run.smithi151.stdout:Suggested packages: 2024-05-08T18:26:43.472 INFO:teuthology.orchestra.run.smithi151.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-05-08T18:26:43.472 INFO:teuthology.orchestra.run.smithi151.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-05-08T18:26:43.472 INFO:teuthology.orchestra.run.smithi151.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-05-08T18:26:43.472 INFO:teuthology.orchestra.run.smithi151.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-05-08T18:26:43.472 INFO:teuthology.orchestra.run.smithi151.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-05-08T18:26:43.472 INFO:teuthology.orchestra.run.smithi151.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-05-08T18:26:43.472 INFO:teuthology.orchestra.run.smithi151.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-05-08T18:26:43.472 INFO:teuthology.orchestra.run.smithi151.stdout:Recommended packages: 2024-05-08T18:26:43.472 INFO:teuthology.orchestra.run.smithi151.stdout: btrfs-tools 2024-05-08T18:26:43.543 INFO:teuthology.orchestra.run.smithi097.stdout:The following packages were automatically installed and are no longer required: 2024-05-08T18:26:43.543 INFO:teuthology.orchestra.run.smithi097.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-08T18:26:43.543 INFO:teuthology.orchestra.run.smithi097.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-08T18:26:43.543 INFO:teuthology.orchestra.run.smithi097.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-08T18:26:43.544 INFO:teuthology.orchestra.run.smithi097.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-08T18:26:43.544 INFO:teuthology.orchestra.run.smithi097.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-08T18:26:43.544 INFO:teuthology.orchestra.run.smithi097.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-08T18:26:43.544 INFO:teuthology.orchestra.run.smithi097.stdout:The following additional packages will be installed: 2024-05-08T18:26:43.545 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-05-08T18:26:43.546 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-05-08T18:26:43.546 INFO:teuthology.orchestra.run.smithi097.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-05-08T18:26:43.546 INFO:teuthology.orchestra.run.smithi097.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-05-08T18:26:43.546 INFO:teuthology.orchestra.run.smithi097.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-05-08T18:26:43.546 INFO:teuthology.orchestra.run.smithi097.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-05-08T18:26:43.546 INFO:teuthology.orchestra.run.smithi097.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-05-08T18:26:43.547 INFO:teuthology.orchestra.run.smithi097.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-05-08T18:26:43.547 INFO:teuthology.orchestra.run.smithi097.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-05-08T18:26:43.547 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-05-08T18:26:43.547 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-05-08T18:26:43.547 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-05-08T18:26:43.547 INFO:teuthology.orchestra.run.smithi097.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-05-08T18:26:43.547 INFO:teuthology.orchestra.run.smithi097.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-05-08T18:26:43.547 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-05-08T18:26:43.547 INFO:teuthology.orchestra.run.smithi097.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-05-08T18:26:43.547 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-05-08T18:26:43.547 INFO:teuthology.orchestra.run.smithi097.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-05-08T18:26:43.547 INFO:teuthology.orchestra.run.smithi097.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-05-08T18:26:43.547 INFO:teuthology.orchestra.run.smithi097.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-05-08T18:26:43.547 INFO:teuthology.orchestra.run.smithi097.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-05-08T18:26:43.547 INFO:teuthology.orchestra.run.smithi097.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-05-08T18:26:43.548 INFO:teuthology.orchestra.run.smithi097.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-05-08T18:26:43.548 INFO:teuthology.orchestra.run.smithi097.stdout: xmlstarlet zip 2024-05-08T18:26:43.548 INFO:teuthology.orchestra.run.smithi097.stdout:Suggested packages: 2024-05-08T18:26:43.548 INFO:teuthology.orchestra.run.smithi097.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-05-08T18:26:43.548 INFO:teuthology.orchestra.run.smithi097.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-05-08T18:26:43.549 INFO:teuthology.orchestra.run.smithi097.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-05-08T18:26:43.549 INFO:teuthology.orchestra.run.smithi097.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-05-08T18:26:43.549 INFO:teuthology.orchestra.run.smithi097.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-05-08T18:26:43.549 INFO:teuthology.orchestra.run.smithi097.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-05-08T18:26:43.549 INFO:teuthology.orchestra.run.smithi097.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-05-08T18:26:43.549 INFO:teuthology.orchestra.run.smithi097.stdout:Recommended packages: 2024-05-08T18:26:43.549 INFO:teuthology.orchestra.run.smithi097.stdout: btrfs-tools 2024-05-08T18:26:43.569 INFO:teuthology.orchestra.run.smithi151.stdout:The following NEW packages will be installed: 2024-05-08T18:26:43.569 INFO:teuthology.orchestra.run.smithi151.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-05-08T18:26:43.569 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-05-08T18:26:43.569 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-05-08T18:26:43.569 INFO:teuthology.orchestra.run.smithi151.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-05-08T18:26:43.569 INFO:teuthology.orchestra.run.smithi151.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-05-08T18:26:43.569 INFO:teuthology.orchestra.run.smithi151.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-05-08T18:26:43.570 INFO:teuthology.orchestra.run.smithi151.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-05-08T18:26:43.571 INFO:teuthology.orchestra.run.smithi151.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-05-08T18:26:43.571 INFO:teuthology.orchestra.run.smithi151.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-05-08T18:26:43.571 INFO:teuthology.orchestra.run.smithi151.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-05-08T18:26:43.571 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-05-08T18:26:43.571 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-05-08T18:26:43.571 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-05-08T18:26:43.571 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-05-08T18:26:43.571 INFO:teuthology.orchestra.run.smithi151.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-05-08T18:26:43.571 INFO:teuthology.orchestra.run.smithi151.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-05-08T18:26:43.571 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-05-08T18:26:43.571 INFO:teuthology.orchestra.run.smithi151.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-05-08T18:26:43.571 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-05-08T18:26:43.571 INFO:teuthology.orchestra.run.smithi151.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-05-08T18:26:43.571 INFO:teuthology.orchestra.run.smithi151.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-05-08T18:26:43.572 INFO:teuthology.orchestra.run.smithi151.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-05-08T18:26:43.572 INFO:teuthology.orchestra.run.smithi151.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-05-08T18:26:43.572 INFO:teuthology.orchestra.run.smithi151.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-05-08T18:26:43.572 INFO:teuthology.orchestra.run.smithi151.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-05-08T18:26:43.572 INFO:teuthology.orchestra.run.smithi151.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-05-08T18:26:43.647 INFO:teuthology.orchestra.run.smithi097.stdout:The following NEW packages will be installed: 2024-05-08T18:26:43.648 INFO:teuthology.orchestra.run.smithi097.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-05-08T18:26:43.648 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-05-08T18:26:43.648 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-05-08T18:26:43.648 INFO:teuthology.orchestra.run.smithi097.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-05-08T18:26:43.648 INFO:teuthology.orchestra.run.smithi097.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-05-08T18:26:43.648 INFO:teuthology.orchestra.run.smithi097.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-05-08T18:26:43.648 INFO:teuthology.orchestra.run.smithi097.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-05-08T18:26:43.648 INFO:teuthology.orchestra.run.smithi097.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-05-08T18:26:43.648 INFO:teuthology.orchestra.run.smithi097.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-05-08T18:26:43.648 INFO:teuthology.orchestra.run.smithi097.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-05-08T18:26:43.649 INFO:teuthology.orchestra.run.smithi097.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-05-08T18:26:43.649 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-05-08T18:26:43.649 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-05-08T18:26:43.649 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-05-08T18:26:43.649 INFO:teuthology.orchestra.run.smithi097.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-05-08T18:26:43.650 INFO:teuthology.orchestra.run.smithi097.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-05-08T18:26:43.650 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-05-08T18:26:43.650 INFO:teuthology.orchestra.run.smithi097.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-05-08T18:26:43.650 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-05-08T18:26:43.650 INFO:teuthology.orchestra.run.smithi097.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-05-08T18:26:43.651 INFO:teuthology.orchestra.run.smithi097.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-05-08T18:26:43.651 INFO:teuthology.orchestra.run.smithi097.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-05-08T18:26:43.651 INFO:teuthology.orchestra.run.smithi097.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-05-08T18:26:43.651 INFO:teuthology.orchestra.run.smithi097.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-05-08T18:26:43.651 INFO:teuthology.orchestra.run.smithi097.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-05-08T18:26:43.651 INFO:teuthology.orchestra.run.smithi097.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-05-08T18:26:43.757 INFO:teuthology.orchestra.run.smithi151.stdout:0 upgraded, 118 newly installed, 0 to remove and 303 not upgraded. 2024-05-08T18:26:43.757 INFO:teuthology.orchestra.run.smithi151.stdout:Need to get 181 MB of archives. 2024-05-08T18:26:43.757 INFO:teuthology.orchestra.run.smithi151.stdout:After this operation, 829 MB of additional disk space will be used. 2024-05-08T18:26:43.757 INFO:teuthology.orchestra.run.smithi151.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-05-08T18:26:43.835 INFO:teuthology.orchestra.run.smithi097.stdout:0 upgraded, 118 newly installed, 0 to remove and 303 not upgraded. 2024-05-08T18:26:43.835 INFO:teuthology.orchestra.run.smithi097.stdout:Need to get 181 MB of archives. 2024-05-08T18:26:43.835 INFO:teuthology.orchestra.run.smithi097.stdout:After this operation, 829 MB of additional disk space will be used. 2024-05-08T18:26:43.835 INFO:teuthology.orchestra.run.smithi097.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-05-08T18:26:44.022 INFO:teuthology.orchestra.run.smithi151.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3525-g27d37168-1jammy [3,555 kB] 2024-05-08T18:26:44.100 INFO:teuthology.orchestra.run.smithi097.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3525-g27d37168-1jammy [3,555 kB] 2024-05-08T18:26:44.180 INFO:teuthology.orchestra.run.smithi151.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-05-08T18:26:44.191 INFO:teuthology.orchestra.run.smithi151.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-05-08T18:26:44.267 INFO:teuthology.orchestra.run.smithi097.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-05-08T18:26:44.272 INFO:teuthology.orchestra.run.smithi151.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-05-08T18:26:44.290 INFO:teuthology.orchestra.run.smithi097.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-05-08T18:26:44.512 INFO:teuthology.orchestra.run.smithi151.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-05-08T18:26:44.523 INFO:teuthology.orchestra.run.smithi151.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-05-08T18:26:44.553 INFO:teuthology.orchestra.run.smithi151.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-05-08T18:26:44.565 INFO:teuthology.orchestra.run.smithi151.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-05-08T18:26:44.566 INFO:teuthology.orchestra.run.smithi151.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-05-08T18:26:44.567 INFO:teuthology.orchestra.run.smithi151.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-05-08T18:26:44.587 INFO:teuthology.orchestra.run.smithi151.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-05-08T18:26:44.589 INFO:teuthology.orchestra.run.smithi097.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-05-08T18:26:44.714 INFO:teuthology.orchestra.run.smithi151.stdout:Get:13 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3525-g27d37168-1jammy [3,223 kB] 2024-05-08T18:26:44.786 INFO:teuthology.orchestra.run.smithi097.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3525-g27d37168-1jammy [3,223 kB] 2024-05-08T18:26:44.854 INFO:teuthology.orchestra.run.smithi151.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-05-08T18:26:44.965 INFO:teuthology.orchestra.run.smithi151.stdout:Get:15 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3525-g27d37168-1jammy [712 kB] 2024-05-08T18:26:45.023 INFO:teuthology.orchestra.run.smithi151.stdout:Get:16 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3525-g27d37168-1jammy [356 kB] 2024-05-08T18:26:45.046 INFO:teuthology.orchestra.run.smithi151.stdout:Get:17 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3525-g27d37168-1jammy [32.8 kB] 2024-05-08T18:26:45.048 INFO:teuthology.orchestra.run.smithi151.stdout:Get:18 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3525-g27d37168-1jammy [180 kB] 2024-05-08T18:26:45.071 INFO:teuthology.orchestra.run.smithi151.stdout:Get:19 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3525-g27d37168-1jammy [67.4 kB] 2024-05-08T18:26:45.074 INFO:teuthology.orchestra.run.smithi151.stdout:Get:20 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3525-g27d37168-1jammy [330 kB] 2024-05-08T18:26:45.076 INFO:teuthology.orchestra.run.smithi097.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3525-g27d37168-1jammy [712 kB] 2024-05-08T18:26:45.099 INFO:teuthology.orchestra.run.smithi151.stdout:Get:21 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3525-g27d37168-1jammy [6,900 kB] 2024-05-08T18:26:45.146 INFO:teuthology.orchestra.run.smithi097.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3525-g27d37168-1jammy [356 kB] 2024-05-08T18:26:45.172 INFO:teuthology.orchestra.run.smithi097.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3525-g27d37168-1jammy [32.8 kB] 2024-05-08T18:26:45.173 INFO:teuthology.orchestra.run.smithi097.stdout:Get:10 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3525-g27d37168-1jammy [180 kB] 2024-05-08T18:26:45.193 INFO:teuthology.orchestra.run.smithi097.stdout:Get:11 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3525-g27d37168-1jammy [67.4 kB] 2024-05-08T18:26:45.208 INFO:teuthology.orchestra.run.smithi097.stdout:Get:12 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3525-g27d37168-1jammy [330 kB] 2024-05-08T18:26:45.218 INFO:teuthology.orchestra.run.smithi097.stdout:Get:13 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3525-g27d37168-1jammy [6,900 kB] 2024-05-08T18:26:45.519 INFO:teuthology.orchestra.run.smithi097.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-05-08T18:26:45.573 INFO:teuthology.orchestra.run.smithi097.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-05-08T18:26:45.712 INFO:teuthology.orchestra.run.smithi151.stdout:Get:22 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3525-g27d37168-1jammy [112 kB] 2024-05-08T18:26:45.716 INFO:teuthology.orchestra.run.smithi151.stdout:Get:23 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3525-g27d37168-1jammy [466 kB] 2024-05-08T18:26:45.721 INFO:teuthology.orchestra.run.smithi151.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-05-08T18:26:45.727 INFO:teuthology.orchestra.run.smithi097.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-05-08T18:26:45.776 INFO:teuthology.orchestra.run.smithi151.stdout:Get:25 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3525-g27d37168-1jammy [25.8 MB] 2024-05-08T18:26:45.777 INFO:teuthology.orchestra.run.smithi097.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-05-08T18:26:45.781 INFO:teuthology.orchestra.run.smithi151.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-05-08T18:26:45.781 INFO:teuthology.orchestra.run.smithi097.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-05-08T18:26:45.784 INFO:teuthology.orchestra.run.smithi151.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-05-08T18:26:45.789 INFO:teuthology.orchestra.run.smithi097.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-05-08T18:26:45.857 INFO:teuthology.orchestra.run.smithi097.stdout:Get:20 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3525-g27d37168-1jammy [112 kB] 2024-05-08T18:26:45.860 INFO:teuthology.orchestra.run.smithi097.stdout:Get:21 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3525-g27d37168-1jammy [466 kB] 2024-05-08T18:26:45.891 INFO:teuthology.orchestra.run.smithi097.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-05-08T18:26:45.901 INFO:teuthology.orchestra.run.smithi097.stdout:Get:23 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3525-g27d37168-1jammy [25.8 MB] 2024-05-08T18:26:45.927 INFO:teuthology.orchestra.run.smithi151.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-05-08T18:26:46.020 INFO:teuthology.orchestra.run.smithi151.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-05-08T18:26:46.063 INFO:teuthology.orchestra.run.smithi151.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-05-08T18:26:46.075 INFO:teuthology.orchestra.run.smithi151.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-05-08T18:26:46.078 INFO:teuthology.orchestra.run.smithi151.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-05-08T18:26:46.081 INFO:teuthology.orchestra.run.smithi097.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-05-08T18:26:46.102 INFO:teuthology.orchestra.run.smithi151.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-05-08T18:26:46.322 INFO:teuthology.orchestra.run.smithi151.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-05-08T18:26:46.487 INFO:teuthology.orchestra.run.smithi151.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-05-08T18:26:46.489 INFO:teuthology.orchestra.run.smithi097.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-05-08T18:26:46.527 INFO:teuthology.orchestra.run.smithi097.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-05-08T18:26:46.529 INFO:teuthology.orchestra.run.smithi097.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-05-08T18:26:46.570 INFO:teuthology.orchestra.run.smithi151.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-05-08T18:26:46.599 INFO:teuthology.orchestra.run.smithi151.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-05-08T18:26:46.616 INFO:teuthology.orchestra.run.smithi151.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-05-08T18:26:46.616 INFO:teuthology.orchestra.run.smithi097.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-05-08T18:26:46.660 INFO:teuthology.orchestra.run.smithi151.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-05-08T18:26:46.671 INFO:teuthology.orchestra.run.smithi097.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-05-08T18:26:46.704 INFO:teuthology.orchestra.run.smithi097.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-05-08T18:26:46.716 INFO:teuthology.orchestra.run.smithi097.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-05-08T18:26:46.717 INFO:teuthology.orchestra.run.smithi097.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-05-08T18:26:46.731 INFO:teuthology.orchestra.run.smithi097.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-05-08T18:26:46.732 INFO:teuthology.orchestra.run.smithi097.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-05-08T18:26:46.875 INFO:teuthology.orchestra.run.smithi151.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-05-08T18:26:46.890 INFO:teuthology.orchestra.run.smithi151.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-05-08T18:26:46.896 INFO:teuthology.orchestra.run.smithi151.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-05-08T18:26:46.901 INFO:teuthology.orchestra.run.smithi097.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-05-08T18:26:46.902 INFO:teuthology.orchestra.run.smithi151.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-05-08T18:26:46.923 INFO:teuthology.orchestra.run.smithi151.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-05-08T18:26:46.926 INFO:teuthology.orchestra.run.smithi151.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-05-08T18:26:46.991 INFO:teuthology.orchestra.run.smithi097.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-05-08T18:26:47.023 INFO:teuthology.orchestra.run.smithi097.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-05-08T18:26:47.041 INFO:teuthology.orchestra.run.smithi097.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-05-08T18:26:47.083 INFO:teuthology.orchestra.run.smithi097.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-05-08T18:26:47.092 INFO:teuthology.orchestra.run.smithi151.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-05-08T18:26:47.300 INFO:teuthology.orchestra.run.smithi097.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-05-08T18:26:47.315 INFO:teuthology.orchestra.run.smithi097.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-05-08T18:26:47.321 INFO:teuthology.orchestra.run.smithi097.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-05-08T18:26:47.327 INFO:teuthology.orchestra.run.smithi097.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-05-08T18:26:47.348 INFO:teuthology.orchestra.run.smithi097.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-05-08T18:26:47.353 INFO:teuthology.orchestra.run.smithi097.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-05-08T18:26:47.411 INFO:teuthology.orchestra.run.smithi151.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-05-08T18:26:47.449 INFO:teuthology.orchestra.run.smithi151.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-05-08T18:26:47.461 INFO:teuthology.orchestra.run.smithi151.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-05-08T18:26:47.521 INFO:teuthology.orchestra.run.smithi097.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-05-08T18:26:47.671 INFO:teuthology.orchestra.run.smithi151.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-05-08T18:26:47.672 INFO:teuthology.orchestra.run.smithi151.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-05-08T18:26:47.677 INFO:teuthology.orchestra.run.smithi151.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-05-08T18:26:47.682 INFO:teuthology.orchestra.run.smithi151.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-05-08T18:26:47.697 INFO:teuthology.orchestra.run.smithi151.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-05-08T18:26:47.717 INFO:teuthology.orchestra.run.smithi151.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-05-08T18:26:47.722 INFO:teuthology.orchestra.run.smithi151.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-05-08T18:26:47.854 INFO:teuthology.orchestra.run.smithi097.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-05-08T18:26:47.893 INFO:teuthology.orchestra.run.smithi097.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-05-08T18:26:47.898 INFO:teuthology.orchestra.run.smithi151.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-05-08T18:26:47.922 INFO:teuthology.orchestra.run.smithi097.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-05-08T18:26:48.113 INFO:teuthology.orchestra.run.smithi097.stdout:Get:50 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3525-g27d37168-1jammy [5,095 kB] 2024-05-08T18:26:48.129 INFO:teuthology.orchestra.run.smithi097.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-05-08T18:26:48.129 INFO:teuthology.orchestra.run.smithi097.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-05-08T18:26:48.136 INFO:teuthology.orchestra.run.smithi097.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-05-08T18:26:48.142 INFO:teuthology.orchestra.run.smithi097.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-05-08T18:26:48.152 INFO:teuthology.orchestra.run.smithi151.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-05-08T18:26:48.157 INFO:teuthology.orchestra.run.smithi097.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-05-08T18:26:48.181 INFO:teuthology.orchestra.run.smithi097.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-05-08T18:26:48.187 INFO:teuthology.orchestra.run.smithi097.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-05-08T18:26:48.216 INFO:teuthology.orchestra.run.smithi151.stdout:Get:59 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3525-g27d37168-1jammy [5,095 kB] 2024-05-08T18:26:48.330 INFO:teuthology.orchestra.run.smithi151.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-05-08T18:26:48.343 INFO:teuthology.orchestra.run.smithi151.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-05-08T18:26:48.358 INFO:teuthology.orchestra.run.smithi097.stdout:Get:58 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3525-g27d37168-1jammy [244 kB] 2024-05-08T18:26:48.366 INFO:teuthology.orchestra.run.smithi097.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-05-08T18:26:48.367 INFO:teuthology.orchestra.run.smithi151.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-05-08T18:26:48.376 INFO:teuthology.orchestra.run.smithi097.stdout:Get:60 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3525-g27d37168-1jammy [124 kB] 2024-05-08T18:26:48.384 INFO:teuthology.orchestra.run.smithi097.stdout:Get:61 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3525-g27d37168-1jammy [1,544 kB] 2024-05-08T18:26:48.430 INFO:teuthology.orchestra.run.smithi151.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-05-08T18:26:48.496 INFO:teuthology.orchestra.run.smithi097.stdout:Get:62 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3525-g27d37168-1jammy [6,259 kB] 2024-05-08T18:26:48.631 INFO:teuthology.orchestra.run.smithi097.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-05-08T18:26:48.645 INFO:teuthology.orchestra.run.smithi151.stdout:Get:64 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3525-g27d37168-1jammy [244 kB] 2024-05-08T18:26:48.674 INFO:teuthology.orchestra.run.smithi151.stdout:Get:65 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3525-g27d37168-1jammy [124 kB] 2024-05-08T18:26:48.678 INFO:teuthology.orchestra.run.smithi151.stdout:Get:66 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3525-g27d37168-1jammy [1,544 kB] 2024-05-08T18:26:48.742 INFO:teuthology.orchestra.run.smithi151.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-05-08T18:26:48.744 INFO:teuthology.orchestra.run.smithi151.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-05-08T18:26:48.746 INFO:teuthology.orchestra.run.smithi151.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-05-08T18:26:48.747 INFO:teuthology.orchestra.run.smithi151.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-05-08T18:26:48.749 INFO:teuthology.orchestra.run.smithi151.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-05-08T18:26:48.845 INFO:teuthology.orchestra.run.smithi151.stdout:Get:72 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3525-g27d37168-1jammy [6,259 kB] 2024-05-08T18:26:48.882 INFO:teuthology.orchestra.run.smithi097.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-05-08T18:26:48.927 INFO:teuthology.orchestra.run.smithi097.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-05-08T18:26:48.955 INFO:teuthology.orchestra.run.smithi097.stdout:Get:66 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3525-g27d37168-1jammy [22.8 MB] 2024-05-08T18:26:48.956 INFO:teuthology.orchestra.run.smithi151.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-05-08T18:26:48.971 INFO:teuthology.orchestra.run.smithi097.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-05-08T18:26:49.393 INFO:teuthology.orchestra.run.smithi151.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-05-08T18:26:49.400 INFO:teuthology.orchestra.run.smithi151.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-05-08T18:26:49.462 INFO:teuthology.orchestra.run.smithi151.stdout:Get:76 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3525-g27d37168-1jammy [22.8 MB] 2024-05-08T18:26:49.504 INFO:teuthology.orchestra.run.smithi097.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-05-08T18:26:49.702 INFO:teuthology.orchestra.run.smithi151.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-05-08T18:26:49.702 INFO:teuthology.orchestra.run.smithi151.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-05-08T18:26:49.705 INFO:teuthology.orchestra.run.smithi151.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-05-08T18:26:49.707 INFO:teuthology.orchestra.run.smithi151.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-05-08T18:26:49.708 INFO:teuthology.orchestra.run.smithi151.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-05-08T18:26:49.710 INFO:teuthology.orchestra.run.smithi151.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-05-08T18:26:49.711 INFO:teuthology.orchestra.run.smithi151.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-05-08T18:26:49.715 INFO:teuthology.orchestra.run.smithi151.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-05-08T18:26:49.898 INFO:teuthology.orchestra.run.smithi151.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-05-08T18:26:50.303 INFO:teuthology.orchestra.run.smithi151.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-05-08T18:26:50.350 INFO:teuthology.orchestra.run.smithi151.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-05-08T18:26:50.384 INFO:teuthology.orchestra.run.smithi151.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-05-08T18:26:50.483 INFO:teuthology.orchestra.run.smithi151.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-05-08T18:26:50.524 INFO:teuthology.orchestra.run.smithi151.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-05-08T18:26:50.536 INFO:teuthology.orchestra.run.smithi151.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-05-08T18:26:50.540 INFO:teuthology.orchestra.run.smithi151.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-05-08T18:26:50.588 INFO:teuthology.orchestra.run.smithi151.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-05-08T18:26:50.592 INFO:teuthology.orchestra.run.smithi151.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-05-08T18:26:50.613 INFO:teuthology.orchestra.run.smithi151.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-05-08T18:26:50.691 INFO:teuthology.orchestra.run.smithi097.stdout:Get:69 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3525-g27d37168-1jammy [14.0 kB] 2024-05-08T18:26:50.692 INFO:teuthology.orchestra.run.smithi097.stdout:Get:70 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3525-g27d37168-1jammy [870 kB] 2024-05-08T18:26:50.709 INFO:teuthology.orchestra.run.smithi097.stdout:Get:71 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3525-g27d37168-1jammy [2,438 kB] 2024-05-08T18:26:50.777 INFO:teuthology.orchestra.run.smithi151.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-05-08T18:26:50.869 INFO:teuthology.orchestra.run.smithi097.stdout:Get:72 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3525-g27d37168-1jammy [792 kB] 2024-05-08T18:26:50.930 INFO:teuthology.orchestra.run.smithi097.stdout:Get:73 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3525-g27d37168-1jammy [148 kB] 2024-05-08T18:26:50.935 INFO:teuthology.orchestra.run.smithi097.stdout:Get:74 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3525-g27d37168-1jammy [2,279 kB] 2024-05-08T18:26:51.050 INFO:teuthology.orchestra.run.smithi151.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-05-08T18:26:51.068 INFO:teuthology.orchestra.run.smithi151.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-05-08T18:26:51.096 INFO:teuthology.orchestra.run.smithi097.stdout:Get:75 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3525-g27d37168-1jammy [8,625 kB] 2024-05-08T18:26:51.224 INFO:teuthology.orchestra.run.smithi151.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-05-08T18:26:51.255 INFO:teuthology.orchestra.run.smithi151.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-05-08T18:26:51.457 INFO:teuthology.orchestra.run.smithi151.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-05-08T18:26:51.459 INFO:teuthology.orchestra.run.smithi151.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-05-08T18:26:51.462 INFO:teuthology.orchestra.run.smithi151.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-05-08T18:26:51.494 INFO:teuthology.orchestra.run.smithi151.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-05-08T18:26:51.498 INFO:teuthology.orchestra.run.smithi151.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-05-08T18:26:51.736 INFO:teuthology.orchestra.run.smithi097.stdout:Get:76 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3525-g27d37168-1jammy [14.2 kB] 2024-05-08T18:26:51.736 INFO:teuthology.orchestra.run.smithi097.stdout:Get:77 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3525-g27d37168-1jammy [51.7 MB] 2024-05-08T18:26:51.754 INFO:teuthology.orchestra.run.smithi151.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3525-g27d37168-1jammy [14.0 kB] 2024-05-08T18:26:51.755 INFO:teuthology.orchestra.run.smithi151.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3525-g27d37168-1jammy [870 kB] 2024-05-08T18:26:51.772 INFO:teuthology.orchestra.run.smithi151.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3525-g27d37168-1jammy [2,438 kB] 2024-05-08T18:26:52.026 INFO:teuthology.orchestra.run.smithi151.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3525-g27d37168-1jammy [792 kB] 2024-05-08T18:26:52.113 INFO:teuthology.orchestra.run.smithi151.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3525-g27d37168-1jammy [148 kB] 2024-05-08T18:26:52.118 INFO:teuthology.orchestra.run.smithi151.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3525-g27d37168-1jammy [2,279 kB] 2024-05-08T18:26:52.327 INFO:teuthology.orchestra.run.smithi151.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3525-g27d37168-1jammy [8,625 kB] 2024-05-08T18:26:53.214 INFO:teuthology.orchestra.run.smithi151.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3525-g27d37168-1jammy [14.2 kB] 2024-05-08T18:26:53.215 INFO:teuthology.orchestra.run.smithi151.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3525-g27d37168-1jammy [51.7 MB] 2024-05-08T18:26:55.755 INFO:teuthology.orchestra.run.smithi097.stdout:Get:78 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3525-g27d37168-1jammy [124 kB] 2024-05-08T18:26:55.757 INFO:teuthology.orchestra.run.smithi097.stdout:Get:79 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3525-g27d37168-1jammy [38.9 kB] 2024-05-08T18:26:55.758 INFO:teuthology.orchestra.run.smithi097.stdout:Get:80 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3525-g27d37168-1jammy [13.7 MB] 2024-05-08T18:26:55.826 INFO:teuthology.orchestra.run.smithi097.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-05-08T18:26:55.956 INFO:teuthology.orchestra.run.smithi097.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-05-08T18:26:56.158 INFO:teuthology.orchestra.run.smithi097.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-05-08T18:26:56.189 INFO:teuthology.orchestra.run.smithi097.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-05-08T18:26:56.337 INFO:teuthology.orchestra.run.smithi097.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-05-08T18:26:56.555 INFO:teuthology.orchestra.run.smithi097.stdout:Get:86 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3525-g27d37168-1jammy [91.2 kB] 2024-05-08T18:26:57.778 INFO:teuthology.orchestra.run.smithi151.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3525-g27d37168-1jammy [124 kB] 2024-05-08T18:26:57.780 INFO:teuthology.orchestra.run.smithi151.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3525-g27d37168-1jammy [38.9 kB] 2024-05-08T18:26:57.781 INFO:teuthology.orchestra.run.smithi151.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3525-g27d37168-1jammy [13.7 MB] 2024-05-08T18:26:58.389 INFO:teuthology.orchestra.run.smithi151.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3525-g27d37168-1jammy [91.2 kB] 2024-05-08T18:26:59.017 INFO:teuthology.orchestra.run.smithi151.stdout:Fetched 181 MB in 15s (12.2 MB/s) 2024-05-08T18:26:59.179 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-05-08T18:26:59.279 INFO:teuthology.orchestra.run.smithi151.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-05-08T18:26:59.285 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-05-08T18:26:59.369 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-08T18:26:59.732 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-05-08T18:26:59.758 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-05-08T18:26:59.799 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-08T18:27:00.085 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-05-08T18:27:00.100 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-05-08T18:27:00.135 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-08T18:27:00.146 INFO:teuthology.orchestra.run.smithi097.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-05-08T18:27:00.540 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-05-08T18:27:00.566 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-08T18:27:00.615 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-08T18:27:00.644 INFO:teuthology.orchestra.run.smithi097.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-05-08T18:27:00.652 INFO:teuthology.orchestra.run.smithi097.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-05-08T18:27:01.035 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-05-08T18:27:01.061 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-08T18:27:01.102 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-08T18:27:01.414 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-05-08T18:27:01.441 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-08T18:27:01.472 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-08T18:27:01.926 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-05-08T18:27:01.953 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-05-08T18:27:02.126 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-08T18:27:02.289 INFO:teuthology.orchestra.run.smithi097.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-05-08T18:27:02.292 INFO:teuthology.orchestra.run.smithi097.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-05-08T18:27:02.367 INFO:teuthology.orchestra.run.smithi097.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-05-08T18:27:02.416 INFO:teuthology.orchestra.run.smithi097.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-05-08T18:27:02.441 INFO:teuthology.orchestra.run.smithi097.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-05-08T18:27:02.464 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package librados2. 2024-05-08T18:27:02.470 INFO:teuthology.orchestra.run.smithi097.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-05-08T18:27:02.482 INFO:teuthology.orchestra.run.smithi097.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-05-08T18:27:02.490 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../007-librados2_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:27:02.509 INFO:teuthology.orchestra.run.smithi097.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-05-08T18:27:02.530 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking librados2 (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:27:02.902 INFO:teuthology.orchestra.run.smithi097.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-05-08T18:27:02.967 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package librbd1. 2024-05-08T18:27:02.993 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../008-librbd1_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:27:03.033 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking librbd1 (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:27:03.309 INFO:teuthology.orchestra.run.smithi097.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-05-08T18:27:03.355 INFO:teuthology.orchestra.run.smithi097.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-05-08T18:27:03.390 INFO:teuthology.orchestra.run.smithi097.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-05-08T18:27:03.489 INFO:teuthology.orchestra.run.smithi097.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-05-08T18:27:03.496 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libcephfs2. 2024-05-08T18:27:03.522 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:27:03.528 INFO:teuthology.orchestra.run.smithi097.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-05-08T18:27:03.540 INFO:teuthology.orchestra.run.smithi097.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-05-08T18:27:03.545 INFO:teuthology.orchestra.run.smithi097.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-05-08T18:27:03.562 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libcephfs2 (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:27:03.594 INFO:teuthology.orchestra.run.smithi097.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-05-08T18:27:03.597 INFO:teuthology.orchestra.run.smithi097.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-05-08T18:27:03.618 INFO:teuthology.orchestra.run.smithi097.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-05-08T18:27:03.783 INFO:teuthology.orchestra.run.smithi097.stdout:Get:109 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-05-08T18:27:03.840 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-rados. 2024-05-08T18:27:03.856 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../010-python3-rados_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:27:03.890 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-rados (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:27:04.051 INFO:teuthology.orchestra.run.smithi097.stdout:Get:110 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-05-08T18:27:04.070 INFO:teuthology.orchestra.run.smithi097.stdout:Get:111 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-05-08T18:27:04.194 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-05-08T18:27:04.220 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-3525-g27d37168-1jammy_all.deb ... 2024-05-08T18:27:04.223 INFO:teuthology.orchestra.run.smithi097.stdout:Get:112 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-05-08T18:27:04.253 INFO:teuthology.orchestra.run.smithi097.stdout:Get:113 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-05-08T18:27:04.260 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-ceph-argparse (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:27:04.410 INFO:teuthology.orchestra.run.smithi097.stdout:Get:114 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-05-08T18:27:04.412 INFO:teuthology.orchestra.run.smithi097.stdout:Get:115 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-05-08T18:27:04.415 INFO:teuthology.orchestra.run.smithi097.stdout:Get:116 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-05-08T18:27:04.436 INFO:teuthology.orchestra.run.smithi097.stdout:Get:117 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-05-08T18:27:04.442 INFO:teuthology.orchestra.run.smithi097.stdout:Get:118 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-05-08T18:27:04.513 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-cephfs. 2024-05-08T18:27:04.529 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:27:04.571 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-cephfs (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:27:04.908 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-ceph-common. 2024-05-08T18:27:04.935 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-3525-g27d37168-1jammy_all.deb ... 2024-05-08T18:27:04.978 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-ceph-common (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:27:05.102 INFO:teuthology.orchestra.run.smithi097.stdout:Fetched 181 MB in 21s (8,672 kB/s) 2024-05-08T18:27:05.260 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-05-08T18:27:05.270 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-wcwidth. 2024-05-08T18:27:05.297 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-05-08T18:27:05.329 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-08T18:27:05.355 INFO:teuthology.orchestra.run.smithi097.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-05-08T18:27:05.360 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-05-08T18:27:05.442 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-08T18:27:05.641 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-prettytable. 2024-05-08T18:27:05.667 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-05-08T18:27:05.707 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-05-08T18:27:05.788 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-05-08T18:27:05.814 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-05-08T18:27:05.854 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-08T18:27:05.969 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-rbd. 2024-05-08T18:27:05.991 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:27:06.035 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-rbd (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:27:06.190 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-05-08T18:27:06.217 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-05-08T18:27:06.257 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-08T18:27:06.339 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-05-08T18:27:06.366 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-05-08T18:27:06.397 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-08T18:27:06.684 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-05-08T18:27:06.702 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-05-08T18:27:06.710 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-05-08T18:27:06.728 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-08T18:27:06.750 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-05-08T18:27:06.777 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-08T18:27:07.147 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-05-08T18:27:07.173 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-08T18:27:07.213 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-08T18:27:07.370 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-05-08T18:27:07.397 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-05-08T18:27:07.437 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-08T18:27:07.533 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-05-08T18:27:07.560 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-08T18:27:07.599 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-08T18:27:07.716 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package lua5.1. 2024-05-08T18:27:07.742 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-05-08T18:27:07.774 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-05-08T18:27:07.961 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-05-08T18:27:07.987 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-05-08T18:27:08.027 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-08T18:27:08.086 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package lua-any. 2024-05-08T18:27:08.113 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-05-08T18:27:08.153 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking lua-any (27ubuntu1) ... 2024-05-08T18:27:08.347 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package librados2. 2024-05-08T18:27:08.374 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../007-librados2_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:27:08.406 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package zip. 2024-05-08T18:27:08.413 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking librados2 (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:27:08.432 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-05-08T18:27:08.489 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking zip (3.0-12build2) ... 2024-05-08T18:27:08.777 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package unzip. 2024-05-08T18:27:08.792 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-05-08T18:27:08.827 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-05-08T18:27:08.866 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package librbd1. 2024-05-08T18:27:08.892 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../008-librbd1_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:27:08.933 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking librbd1 (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:27:09.215 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package luarocks. 2024-05-08T18:27:09.241 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-05-08T18:27:09.281 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-05-08T18:27:09.394 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libcephfs2. 2024-05-08T18:27:09.420 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:27:09.460 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libcephfs2 (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:27:09.641 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package librgw2. 2024-05-08T18:27:09.656 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../025-librgw2_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:27:09.699 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking librgw2 (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:27:09.738 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-rados. 2024-05-08T18:27:09.761 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../010-python3-rados_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:27:09.796 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-rados (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:27:10.236 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-rgw. 2024-05-08T18:27:10.241 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-05-08T18:27:10.251 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:27:10.267 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-3525-g27d37168-1jammy_all.deb ... 2024-05-08T18:27:10.294 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-rgw (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:27:10.307 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-ceph-argparse (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:27:10.560 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-cephfs. 2024-05-08T18:27:10.586 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:27:10.626 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-cephfs (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:27:10.631 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package liboath0:amd64. 2024-05-08T18:27:10.657 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-05-08T18:27:10.697 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-05-08T18:27:10.963 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-ceph-common. 2024-05-08T18:27:10.989 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-3525-g27d37168-1jammy_all.deb ... 2024-05-08T18:27:11.001 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libradosstriper1. 2024-05-08T18:27:11.027 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:27:11.029 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-ceph-common (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:27:11.059 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libradosstriper1 (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:27:11.365 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-wcwidth. 2024-05-08T18:27:11.392 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-05-08T18:27:11.432 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-08T18:27:11.455 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-common. 2024-05-08T18:27:11.481 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../029-ceph-common_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:27:11.521 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-common (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:27:11.701 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-prettytable. 2024-05-08T18:27:11.728 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-05-08T18:27:11.759 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-05-08T18:27:11.995 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-rbd. 2024-05-08T18:27:12.011 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:27:12.054 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-rbd (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:27:12.398 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-05-08T18:27:12.425 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-05-08T18:27:12.465 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-08T18:27:12.751 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-05-08T18:27:12.777 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-05-08T18:27:12.817 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-05-08T18:27:12.845 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-base. 2024-05-08T18:27:12.871 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../030-ceph-base_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:27:12.921 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-base (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:27:13.103 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-05-08T18:27:13.118 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-05-08T18:27:13.153 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-08T18:27:13.465 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package lua5.1. 2024-05-08T18:27:13.491 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-05-08T18:27:13.525 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-05-08T18:27:13.531 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-05-08T18:27:13.552 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-05-08T18:27:13.594 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-05-08T18:27:13.842 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package lua-any. 2024-05-08T18:27:13.857 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-05-08T18:27:13.878 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-cheroot. 2024-05-08T18:27:13.892 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking lua-any (27ubuntu1) ... 2024-05-08T18:27:13.905 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-05-08T18:27:13.945 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-08T18:27:14.103 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package zip. 2024-05-08T18:27:14.118 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-05-08T18:27:14.153 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking zip (3.0-12build2) ... 2024-05-08T18:27:14.257 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-05-08T18:27:14.284 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-05-08T18:27:14.324 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-05-08T18:27:14.465 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package unzip. 2024-05-08T18:27:14.491 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-05-08T18:27:14.531 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-05-08T18:27:14.627 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-jaraco.text. 2024-05-08T18:27:14.654 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-05-08T18:27:14.694 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-05-08T18:27:14.951 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package luarocks. 2024-05-08T18:27:14.978 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-05-08T18:27:14.981 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-05-08T18:27:15.008 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-05-08T18:27:15.018 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-05-08T18:27:15.048 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-05-08T18:27:15.334 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-tempora. 2024-05-08T18:27:15.361 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-05-08T18:27:15.393 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-05-08T18:27:15.542 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package librgw2. 2024-05-08T18:27:15.569 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../025-librgw2_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:27:15.609 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking librgw2 (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:27:15.679 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-portend. 2024-05-08T18:27:15.706 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-05-08T18:27:15.746 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-05-08T18:27:16.074 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-05-08T18:27:16.101 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-05-08T18:27:16.111 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-rgw. 2024-05-08T18:27:16.127 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:27:16.158 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-05-08T18:27:16.161 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-rgw (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:27:17.162 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-cherrypy3. 2024-05-08T18:27:17.189 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-05-08T18:27:17.229 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-05-08T18:27:17.257 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package liboath0:amd64. 2024-05-08T18:27:17.284 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-05-08T18:27:17.323 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-05-08T18:27:17.634 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libradosstriper1. 2024-05-08T18:27:17.661 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:27:17.701 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libradosstriper1 (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:27:17.817 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-natsort. 2024-05-08T18:27:17.843 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-05-08T18:27:17.883 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-05-08T18:27:18.029 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-common. 2024-05-08T18:27:18.056 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../029-ceph-common_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:27:18.087 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-common (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:27:18.195 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-logutils. 2024-05-08T18:27:18.222 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-05-08T18:27:18.262 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-05-08T18:27:18.532 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-markupsafe. 2024-05-08T18:27:18.559 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-05-08T18:27:18.599 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-05-08T18:27:18.911 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-mako. 2024-05-08T18:27:18.939 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-05-08T18:27:18.978 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-08T18:27:19.306 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-simplegeneric. 2024-05-08T18:27:19.333 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-05-08T18:27:19.372 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-05-08T18:27:19.442 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-base. 2024-05-08T18:27:19.469 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../030-ceph-base_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:27:19.518 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-base (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:27:19.660 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-singledispatch. 2024-05-08T18:27:19.687 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-05-08T18:27:19.726 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-05-08T18:27:20.021 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-webob. 2024-05-08T18:27:20.048 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-05-08T18:27:20.088 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-05-08T18:27:20.121 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-05-08T18:27:20.148 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-05-08T18:27:20.188 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-05-08T18:27:20.400 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-waitress. 2024-05-08T18:27:20.426 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-05-08T18:27:20.469 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-08T18:27:20.707 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-cheroot. 2024-05-08T18:27:20.734 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-05-08T18:27:20.774 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-08T18:27:20.778 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-tempita. 2024-05-08T18:27:20.805 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-05-08T18:27:20.845 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-05-08T18:27:21.085 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-05-08T18:27:21.111 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-05-08T18:27:21.123 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-paste. 2024-05-08T18:27:21.151 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-05-08T18:27:21.151 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-05-08T18:27:21.190 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-05-08T18:27:21.421 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-jaraco.text. 2024-05-08T18:27:21.447 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-05-08T18:27:21.486 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-05-08T18:27:21.487 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-05-08T18:27:21.501 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-05-08T18:27:21.544 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-05-08T18:27:21.789 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-pastedeploy. 2024-05-08T18:27:21.790 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-05-08T18:27:21.816 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-05-08T18:27:21.817 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-05-08T18:27:21.855 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-05-08T18:27:21.857 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-05-08T18:27:22.160 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-tempora. 2024-05-08T18:27:22.160 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-webtest. 2024-05-08T18:27:22.187 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-05-08T18:27:22.187 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-05-08T18:27:22.226 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-05-08T18:27:22.226 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-05-08T18:27:22.504 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-portend. 2024-05-08T18:27:22.530 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-05-08T18:27:22.538 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-pecan. 2024-05-08T18:27:22.562 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-05-08T18:27:22.564 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-05-08T18:27:22.604 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-05-08T18:27:22.848 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-05-08T18:27:22.875 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-05-08T18:27:22.915 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-05-08T18:27:22.952 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-certifi. 2024-05-08T18:27:22.979 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-05-08T18:27:23.018 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-05-08T18:27:23.243 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-cherrypy3. 2024-05-08T18:27:23.269 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-05-08T18:27:23.305 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-idna. 2024-05-08T18:27:23.309 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-05-08T18:27:23.321 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../055-python3-idna_3.3-1_all.deb ... 2024-05-08T18:27:23.355 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-idna (3.3-1) ... 2024-05-08T18:27:23.650 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-urllib3. 2024-05-08T18:27:23.666 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-natsort. 2024-05-08T18:27:23.678 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-05-08T18:27:23.689 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-05-08T18:27:23.717 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-08T18:27:23.729 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-05-08T18:27:24.049 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-logutils. 2024-05-08T18:27:24.076 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-05-08T18:27:24.079 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-requests. 2024-05-08T18:27:24.098 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-05-08T18:27:24.115 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-05-08T18:27:24.138 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-08T18:27:24.401 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-markupsafe. 2024-05-08T18:27:24.428 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-05-08T18:27:24.468 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-05-08T18:27:24.474 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-werkzeug. 2024-05-08T18:27:24.501 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-05-08T18:27:24.541 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-05-08T18:27:24.746 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-mako. 2024-05-08T18:27:24.773 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-05-08T18:27:24.812 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-08T18:27:24.845 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-05-08T18:27:24.871 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-3525-g27d37168-1jammy_all.deb ... 2024-05-08T18:27:24.911 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:27:25.124 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-simplegeneric. 2024-05-08T18:27:25.140 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-05-08T18:27:25.182 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-05-08T18:27:25.275 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-05-08T18:27:25.302 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:27:25.342 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:27:25.485 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-singledispatch. 2024-05-08T18:27:25.511 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-05-08T18:27:25.551 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-05-08T18:27:25.654 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-bcrypt. 2024-05-08T18:27:25.680 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-05-08T18:27:25.720 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-05-08T18:27:25.979 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-webob. 2024-05-08T18:27:26.005 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-05-08T18:27:26.016 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-openssl. 2024-05-08T18:27:26.042 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-05-08T18:27:26.045 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-05-08T18:27:26.082 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-05-08T18:27:26.374 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-waitress. 2024-05-08T18:27:26.378 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-mgr. 2024-05-08T18:27:26.400 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-05-08T18:27:26.404 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:27:26.443 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-08T18:27:26.444 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-mgr (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:27:26.735 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-tempita. 2024-05-08T18:27:26.761 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-05-08T18:27:26.801 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-05-08T18:27:26.823 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-mon. 2024-05-08T18:27:26.848 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:27:26.889 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-mon (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:27:27.104 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-paste. 2024-05-08T18:27:27.130 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-05-08T18:27:27.187 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-05-08T18:27:27.469 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-osd. 2024-05-08T18:27:27.496 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:27:27.498 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-05-08T18:27:27.514 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-05-08T18:27:27.535 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-osd (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:27:27.557 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-05-08T18:27:27.851 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pastedeploy. 2024-05-08T18:27:27.878 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-05-08T18:27:27.918 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-05-08T18:27:28.221 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-webtest. 2024-05-08T18:27:28.248 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-05-08T18:27:28.287 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-05-08T18:27:28.582 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pecan. 2024-05-08T18:27:28.609 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-05-08T18:27:28.648 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-05-08T18:27:28.656 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph. 2024-05-08T18:27:28.683 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../066-ceph_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:27:28.723 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:27:29.003 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-certifi. 2024-05-08T18:27:29.026 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-fuse. 2024-05-08T18:27:29.030 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-05-08T18:27:29.053 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:27:29.069 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-05-08T18:27:29.092 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-fuse (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:27:29.389 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-idna. 2024-05-08T18:27:29.416 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../055-python3-idna_3.3-1_all.deb ... 2024-05-08T18:27:29.447 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-idna (3.3-1) ... 2024-05-08T18:27:29.455 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-mds. 2024-05-08T18:27:29.481 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:27:29.521 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-mds (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:27:29.733 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-urllib3. 2024-05-08T18:27:29.760 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-05-08T18:27:29.800 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-08T18:27:29.900 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package cephadm. 2024-05-08T18:27:29.926 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../069-cephadm_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:27:29.958 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking cephadm (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:27:30.095 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-requests. 2024-05-08T18:27:30.122 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-05-08T18:27:30.161 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-08T18:27:30.270 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-asyncssh. 2024-05-08T18:27:30.297 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-05-08T18:27:30.336 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-05-08T18:27:30.472 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-werkzeug. 2024-05-08T18:27:30.499 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-05-08T18:27:30.539 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-05-08T18:27:30.631 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python-babel-localedata. 2024-05-08T18:27:30.659 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-05-08T18:27:30.698 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-08T18:27:30.825 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-05-08T18:27:30.852 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-3525-g27d37168-1jammy_all.deb ... 2024-05-08T18:27:30.892 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:27:31.305 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-05-08T18:27:31.331 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:27:31.371 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:27:31.632 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-bcrypt. 2024-05-08T18:27:31.659 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-05-08T18:27:31.699 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-05-08T18:27:31.721 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-babel. 2024-05-08T18:27:31.745 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-05-08T18:27:31.779 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-05-08T18:27:31.985 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-openssl. 2024-05-08T18:27:32.011 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-05-08T18:27:32.051 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-05-08T18:27:32.074 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-jinja2. 2024-05-08T18:27:32.101 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-05-08T18:27:32.141 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-05-08T18:27:32.388 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-mgr. 2024-05-08T18:27:32.414 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:27:32.454 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-mgr (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:27:32.513 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-05-08T18:27:32.541 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-3525-g27d37168-1jammy_all.deb ... 2024-05-08T18:27:32.580 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:27:32.816 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-mon. 2024-05-08T18:27:32.843 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:27:32.882 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-mon (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:27:32.926 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-repoze.lru. 2024-05-08T18:27:32.953 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-05-08T18:27:32.992 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-05-08T18:27:33.304 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-routes. 2024-05-08T18:27:33.331 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-05-08T18:27:33.362 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-05-08T18:27:33.452 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-osd. 2024-05-08T18:27:33.479 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:27:33.519 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-osd (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:27:33.708 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-05-08T18:27:33.735 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-3525-g27d37168-1jammy_all.deb ... 2024-05-08T18:27:33.774 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:27:34.580 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph. 2024-05-08T18:27:34.596 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../066-ceph_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:27:34.647 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:27:34.966 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-fuse. 2024-05-08T18:27:34.993 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:27:35.033 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-fuse (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:27:35.047 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-05-08T18:27:35.063 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-05-08T18:27:35.097 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-08T18:27:35.386 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-mds. 2024-05-08T18:27:35.413 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:27:35.444 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-mds (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:27:35.643 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-joblib. 2024-05-08T18:27:35.670 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-05-08T18:27:35.709 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-05-08T18:27:35.870 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package cephadm. 2024-05-08T18:27:35.896 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../069-cephadm_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:27:36.005 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking cephadm (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:27:36.089 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-05-08T18:27:36.116 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-05-08T18:27:36.157 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-05-08T18:27:36.333 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-asyncssh. 2024-05-08T18:27:36.359 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-05-08T18:27:36.399 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-05-08T18:27:36.459 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-sklearn. 2024-05-08T18:27:36.486 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-05-08T18:27:36.525 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-08T18:27:36.702 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python-babel-localedata. 2024-05-08T18:27:36.729 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-05-08T18:27:36.768 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-08T18:27:37.178 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-05-08T18:27:37.205 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-3525-g27d37168-1jammy_all.deb ... 2024-05-08T18:27:37.331 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:27:37.799 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-babel. 2024-05-08T18:27:37.826 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-05-08T18:27:37.865 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-05-08T18:27:38.327 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-jinja2. 2024-05-08T18:27:38.354 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-05-08T18:27:38.393 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-05-08T18:27:38.737 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-05-08T18:27:38.764 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-3525-g27d37168-1jammy_all.deb ... 2024-05-08T18:27:38.804 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:27:38.968 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-cachetools. 2024-05-08T18:27:38.995 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-05-08T18:27:39.034 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-05-08T18:27:39.149 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-repoze.lru. 2024-05-08T18:27:39.176 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-05-08T18:27:39.215 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-05-08T18:27:39.322 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-pyasn1. 2024-05-08T18:27:39.337 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-05-08T18:27:39.380 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-05-08T18:27:39.493 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-routes. 2024-05-08T18:27:39.520 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-05-08T18:27:39.551 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-05-08T18:27:39.701 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-05-08T18:27:39.728 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-05-08T18:27:39.767 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-05-08T18:27:39.879 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-05-08T18:27:39.906 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-3525-g27d37168-1jammy_all.deb ... 2024-05-08T18:27:39.945 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:27:40.079 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-rsa. 2024-05-08T18:27:40.106 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-05-08T18:27:40.146 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-rsa (4.8-1) ... 2024-05-08T18:27:40.459 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-google-auth. 2024-05-08T18:27:40.486 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-05-08T18:27:40.525 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-05-08T18:27:40.812 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-05-08T18:27:40.828 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-05-08T18:27:40.879 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-08T18:27:41.166 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-websocket. 2024-05-08T18:27:41.175 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-05-08T18:27:41.191 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-05-08T18:27:41.193 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-05-08T18:27:41.225 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-08T18:27:41.232 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-05-08T18:27:41.553 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-kubernetes. 2024-05-08T18:27:41.580 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-05-08T18:27:41.620 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-08T18:27:41.729 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-joblib. 2024-05-08T18:27:41.756 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-05-08T18:27:41.795 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-05-08T18:27:42.174 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-05-08T18:27:42.200 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-05-08T18:27:42.240 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-05-08T18:27:42.276 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-05-08T18:27:42.293 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-3525-g27d37168-1jammy_all.deb ... 2024-05-08T18:27:42.326 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:27:42.538 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-sklearn. 2024-05-08T18:27:42.561 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-05-08T18:27:42.601 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-08T18:27:42.655 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libonig5:amd64. 2024-05-08T18:27:42.683 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-05-08T18:27:42.722 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-08T18:27:43.084 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libjq1:amd64. 2024-05-08T18:27:43.111 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-05-08T18:27:43.150 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-08T18:27:43.286 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-05-08T18:27:43.314 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-3525-g27d37168-1jammy_all.deb ... 2024-05-08T18:27:43.403 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package jq. 2024-05-08T18:27:43.419 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-05-08T18:27:43.437 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:27:43.462 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-05-08T18:27:43.715 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package socat. 2024-05-08T18:27:43.742 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-05-08T18:27:43.782 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-05-08T18:27:44.086 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package xmlstarlet. 2024-05-08T18:27:44.101 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-05-08T18:27:44.144 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-05-08T18:27:44.391 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-cachetools. 2024-05-08T18:27:44.418 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-05-08T18:27:44.458 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-05-08T18:27:44.508 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-test. 2024-05-08T18:27:44.524 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../097-ceph-test_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:27:44.566 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-test (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:27:44.702 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pyasn1. 2024-05-08T18:27:44.729 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-05-08T18:27:44.769 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-05-08T18:27:45.089 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-05-08T18:27:45.116 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-05-08T18:27:45.155 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-05-08T18:27:45.458 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-rsa. 2024-05-08T18:27:45.485 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-05-08T18:27:45.524 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-rsa (4.8-1) ... 2024-05-08T18:27:45.820 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-google-auth. 2024-05-08T18:27:45.847 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-05-08T18:27:45.886 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-05-08T18:27:46.373 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-05-08T18:27:46.400 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-05-08T18:27:46.439 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-08T18:27:46.717 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-websocket. 2024-05-08T18:27:46.745 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-05-08T18:27:46.775 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-05-08T18:27:46.855 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-volume. 2024-05-08T18:27:46.882 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-3525-g27d37168-1jammy_all.deb ... 2024-05-08T18:27:46.930 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-volume (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:27:47.078 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-kubernetes. 2024-05-08T18:27:47.106 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-05-08T18:27:47.145 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-08T18:27:47.234 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libcephfs-dev. 2024-05-08T18:27:47.251 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:27:47.292 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libcephfs-dev (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:27:47.579 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package lua-socket:amd64. 2024-05-08T18:27:47.607 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-05-08T18:27:47.637 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-08T18:27:47.859 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-05-08T18:27:47.887 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-3525-g27d37168-1jammy_all.deb ... 2024-05-08T18:27:47.925 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:27:47.976 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package lua-sec:amd64. 2024-05-08T18:27:48.004 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-05-08T18:27:48.043 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-05-08T18:27:48.253 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libonig5:amd64. 2024-05-08T18:27:48.282 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-05-08T18:27:48.319 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-08T18:27:48.423 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package nvme-cli. 2024-05-08T18:27:48.450 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-05-08T18:27:48.481 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-05-08T18:27:48.597 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libjq1:amd64. 2024-05-08T18:27:48.625 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-05-08T18:27:48.656 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-08T18:27:48.908 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package jq. 2024-05-08T18:27:48.936 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-05-08T18:27:48.975 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-05-08T18:27:49.039 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package pkg-config. 2024-05-08T18:27:49.067 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-05-08T18:27:49.171 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-05-08T18:27:49.211 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package socat. 2024-05-08T18:27:49.238 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-05-08T18:27:49.277 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-05-08T18:27:49.424 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-05-08T18:27:49.452 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-05-08T18:27:49.491 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-05-08T18:27:49.581 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package xmlstarlet. 2024-05-08T18:27:49.608 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-05-08T18:27:49.647 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-05-08T18:27:49.903 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-iniconfig. 2024-05-08T18:27:49.931 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-05-08T18:27:49.969 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-05-08T18:27:50.018 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-test. 2024-05-08T18:27:50.046 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../097-ceph-test_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:27:50.084 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-test (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:27:50.273 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-pastescript. 2024-05-08T18:27:50.301 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-05-08T18:27:50.339 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-05-08T18:27:50.661 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-pluggy. 2024-05-08T18:27:50.688 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-05-08T18:27:50.752 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-05-08T18:27:51.022 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-psutil. 2024-05-08T18:27:51.038 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-05-08T18:27:51.089 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-05-08T18:27:51.426 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-py. 2024-05-08T18:27:51.454 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-05-08T18:27:51.492 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-py (1.10.0-1) ... 2024-05-08T18:27:51.813 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-pygments. 2024-05-08T18:27:51.841 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-05-08T18:27:51.871 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-05-08T18:27:52.297 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-volume. 2024-05-08T18:27:52.318 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-pyinotify. 2024-05-08T18:27:52.324 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-3525-g27d37168-1jammy_all.deb ... 2024-05-08T18:27:52.346 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-05-08T18:27:52.363 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-volume (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:27:52.384 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-05-08T18:27:52.659 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libcephfs-dev. 2024-05-08T18:27:52.674 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:27:52.696 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-toml. 2024-05-08T18:27:52.717 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libcephfs-dev (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:27:52.724 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-05-08T18:27:52.762 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-05-08T18:27:53.036 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package lua-socket:amd64. 2024-05-08T18:27:53.041 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-pytest. 2024-05-08T18:27:53.057 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-05-08T18:27:53.064 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-05-08T18:27:53.094 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-08T18:27:53.099 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-05-08T18:27:53.420 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-simplejson. 2024-05-08T18:27:53.424 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package lua-sec:amd64. 2024-05-08T18:27:53.437 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-05-08T18:27:53.451 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-05-08T18:27:53.478 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-05-08T18:27:53.490 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-05-08T18:27:53.748 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-05-08T18:27:53.765 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-05-08T18:27:53.798 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-05-08T18:27:53.861 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package nvme-cli. 2024-05-08T18:27:53.888 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-05-08T18:27:53.927 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-05-08T18:27:54.332 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package pkg-config. 2024-05-08T18:27:54.360 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-05-08T18:27:54.399 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-05-08T18:27:54.562 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package radosgw. 2024-05-08T18:27:54.590 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../116-radosgw_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:27:54.628 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking radosgw (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:27:54.660 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-05-08T18:27:54.688 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-05-08T18:27:54.726 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-05-08T18:27:55.155 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-iniconfig. 2024-05-08T18:27:55.182 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-05-08T18:27:55.221 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-05-08T18:27:55.432 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package rbd-fuse. 2024-05-08T18:27:55.448 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:27:55.490 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking rbd-fuse (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:27:55.524 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pastescript. 2024-05-08T18:27:55.551 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-05-08T18:27:55.590 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-05-08T18:27:55.786 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-05-08T18:27:55.919 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pluggy. 2024-05-08T18:27:55.946 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-05-08T18:27:55.985 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-05-08T18:27:56.029 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-08T18:27:56.131 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-05-08T18:27:56.254 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-psutil. 2024-05-08T18:27:56.270 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-05-08T18:27:56.304 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-05-08T18:27:56.399 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-05-08T18:27:56.599 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-py. 2024-05-08T18:27:56.626 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-05-08T18:27:56.657 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-py (1.10.0-1) ... 2024-05-08T18:27:56.754 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-05-08T18:27:56.927 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pygments. 2024-05-08T18:27:56.943 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-05-08T18:27:56.977 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-05-08T18:27:57.150 INFO:teuthology.orchestra.run.smithi151.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-05-08T18:27:57.208 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up cephadm (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:27:57.431 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pyinotify. 2024-05-08T18:27:57.458 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-05-08T18:27:57.497 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-05-08T18:27:57.734 INFO:teuthology.orchestra.run.smithi151.stdout:Adding system user cephadm....done 2024-05-08T18:27:57.750 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-toml. 2024-05-08T18:27:57.777 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-05-08T18:27:57.808 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-05-08T18:27:57.882 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-08T18:27:58.134 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-05-08T18:27:58.136 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pytest. 2024-05-08T18:27:58.163 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-05-08T18:27:58.202 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-05-08T18:27:58.402 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-05-08T18:27:58.506 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-simplejson. 2024-05-08T18:27:58.528 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-05-08T18:27:58.533 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-05-08T18:27:58.564 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-05-08T18:27:58.791 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-05-08T18:27:58.796 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-05-08T18:27:58.807 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-05-08T18:27:58.841 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-05-08T18:27:59.048 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-05-08T18:27:59.149 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-py (1.10.0-1) ... 2024-05-08T18:27:59.443 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-05-08T18:27:59.545 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package radosgw. 2024-05-08T18:27:59.573 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../116-radosgw_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:27:59.611 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking radosgw (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:27:59.795 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-05-08T18:28:00.046 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-05-08T18:28:00.315 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-05-08T18:28:00.390 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package rbd-fuse. 2024-05-08T18:28:00.405 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:28:00.447 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking rbd-fuse (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:28:00.592 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-05-08T18:28:00.743 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-05-08T18:28:00.843 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-05-08T18:28:00.994 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-08T18:28:01.094 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-05-08T18:28:01.120 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-05-08T18:28:01.354 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-ceph-argparse (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:28:01.378 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-05-08T18:28:01.664 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-08T18:28:01.735 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-05-08T18:28:01.781 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-08T18:28:01.908 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-05-08T18:28:02.034 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-05-08T18:28:02.162 INFO:teuthology.orchestra.run.smithi097.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-05-08T18:28:02.230 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up cephadm (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:28:02.293 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-05-08T18:28:02.759 INFO:teuthology.orchestra.run.smithi151.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-05-08T18:28:02.763 INFO:teuthology.orchestra.run.smithi097.stdout:Adding system user cephadm....done 2024-05-08T18:28:02.792 INFO:teuthology.orchestra.run.smithi151.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-05-08T18:28:02.839 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-08T18:28:02.919 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-08T18:28:02.965 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-05-08T18:28:03.187 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-05-08T18:28:03.309 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-08T18:28:03.430 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-05-08T18:28:03.460 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-05-08T18:28:03.573 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-05-08T18:28:03.745 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-05-08T18:28:03.824 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-05-08T18:28:04.013 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-05-08T18:28:04.075 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-05-08T18:28:04.201 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-py (1.10.0-1) ... 2024-05-08T18:28:04.322 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up zip (3.0-12build2) ... 2024-05-08T18:28:04.424 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-05-08T18:28:04.503 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-05-08T18:28:04.871 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-05-08T18:28:05.122 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-05-08T18:28:05.134 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-05-08T18:28:05.394 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-05-08T18:28:05.398 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-05-08T18:28:05.520 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-05-08T18:28:05.621 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-08T18:28:05.642 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-05-08T18:28:05.884 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-05-08T18:28:05.914 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-05-08T18:28:06.144 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-05-08T18:28:06.286 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-05-08T18:28:06.395 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-ceph-argparse (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:28:06.551 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-05-08T18:28:06.688 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-08T18:28:06.797 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-08T18:28:06.919 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-08T18:28:06.923 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-05-08T18:28:07.049 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-05-08T18:28:07.212 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-05-08T18:28:07.308 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-05-08T18:28:07.556 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-05-08T18:28:07.695 INFO:teuthology.orchestra.run.smithi097.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-05-08T18:28:07.722 INFO:teuthology.orchestra.run.smithi097.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-05-08T18:28:07.786 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-08T18:28:07.799 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-05-08T18:28:07.912 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-05-08T18:28:07.925 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-ceph-common (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:28:08.210 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-idna (3.3-1) ... 2024-05-08T18:28:08.271 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-08T18:28:08.397 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-05-08T18:28:08.528 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-08T18:28:08.673 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-05-08T18:28:08.933 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-05-08T18:28:09.251 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up zip (3.0-12build2) ... 2024-05-08T18:28:09.377 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-05-08T18:28:09.669 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-05-08T18:28:09.937 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-08T18:28:10.012 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-05-08T18:28:10.047 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-toml (0.10.2-1) ... 2024-05-08T18:28:10.271 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-05-08T18:28:10.307 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-08T18:28:10.397 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-05-08T18:28:10.408 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-05-08T18:28:10.523 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-08T18:28:10.534 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-08T18:28:10.819 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-05-08T18:28:10.832 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-05-08T18:28:11.070 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-05-08T18:28:11.209 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-05-08T18:28:11.313 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-08T18:28:11.423 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-05-08T18:28:11.460 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-05-08T18:28:11.725 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-05-08T18:28:11.836 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-08T18:28:11.993 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-05-08T18:28:12.121 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-05-08T18:28:12.252 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-05-08T18:28:12.491 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-05-08T18:28:12.504 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-05-08T18:28:12.748 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-05-08T18:28:12.763 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-05-08T18:28:12.874 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-ceph-common (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:28:13.015 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-08T18:28:13.116 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-05-08T18:28:13.159 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-idna (3.3-1) ... 2024-05-08T18:28:13.401 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-08T18:28:13.468 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-08T18:28:13.527 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-08T18:28:13.828 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-05-08T18:28:14.138 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-05-08T18:28:14.375 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-08T18:28:14.501 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-05-08T18:28:14.626 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-05-08T18:28:14.674 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-05-08T18:28:14.716 INFO:teuthology.orchestra.run.smithi151.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-05-08T18:28:14.933 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-08T18:28:14.961 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-08T18:28:15.068 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-toml (0.10.2-1) ... 2024-05-08T18:28:15.254 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-05-08T18:28:15.344 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-08T18:28:15.445 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-05-08T18:28:15.546 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-08T18:28:15.647 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-05-08T18:28:15.822 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-05-08T18:28:15.889 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up lua-any (27ubuntu1) ... 2024-05-08T18:28:15.990 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-portend (3.0.0-1) ... 2024-05-08T18:28:16.073 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-05-08T18:28:16.233 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-08T18:28:16.324 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-08T18:28:16.359 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-05-08T18:28:16.450 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-05-08T18:28:16.677 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-05-08T18:28:16.752 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-05-08T18:28:16.978 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-08T18:28:16.994 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-05-08T18:28:17.245 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-05-08T18:28:17.270 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-05-08T18:28:17.388 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-rsa (4.8-1) ... 2024-05-08T18:28:17.496 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-05-08T18:28:17.647 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-05-08T18:28:17.748 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-05-08T18:28:17.907 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-08T18:28:18.007 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-08T18:28:18.133 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-05-08T18:28:18.243 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-05-08T18:28:18.417 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-08T18:28:18.543 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-08T18:28:18.620 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-05-08T18:28:18.836 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-05-08T18:28:18.913 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-05-08T18:28:19.137 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-05-08T18:28:19.256 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-08T18:28:19.366 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up librados2 (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:28:19.371 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-08T18:28:19.489 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-05-08T18:28:19.492 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:28:19.615 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-05-08T18:28:19.618 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-05-08T18:28:19.705 INFO:teuthology.orchestra.run.smithi097.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-05-08T18:28:19.933 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-08T18:28:19.954 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libcephfs2 (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:28:20.068 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-05-08T18:28:20.071 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libradosstriper1 (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:28:20.314 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-05-08T18:28:20.453 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-05-08T18:28:20.591 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up librbd1 (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:28:20.708 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-mgr-modules-core (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:28:20.712 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up lua-any (27ubuntu1) ... 2024-05-08T18:28:20.813 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-portend (3.0.0-1) ... 2024-05-08T18:28:20.834 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-fuse (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:28:21.046 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-08T18:28:21.046 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-08T18:28:21.063 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-08T18:28:21.190 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-05-08T18:28:21.494 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libcephfs-dev (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:28:21.507 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-05-08T18:28:21.620 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-rados (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:28:21.746 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up librgw2 (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:28:21.792 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-08T18:28:21.863 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-08T18:28:22.084 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-05-08T18:28:22.211 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-rsa (4.8-1) ... 2024-05-08T18:28:22.478 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-05-08T18:28:22.738 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-08T18:28:23.074 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-05-08T18:28:23.078 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-rbd (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:28:23.201 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up rbd-fuse (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:28:23.327 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-rgw (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:28:23.451 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-05-08T18:28:23.453 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-cephfs (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:28:23.579 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-common (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:28:23.744 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-05-08T18:28:24.062 INFO:teuthology.orchestra.run.smithi151.stdout:Adding group ceph....done 2024-05-08T18:28:24.088 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-08T18:28:24.214 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up librados2 (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:28:24.323 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:28:24.433 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-05-08T18:28:24.439 INFO:teuthology.orchestra.run.smithi151.stdout:Adding system user ceph....done 2024-05-08T18:28:24.599 INFO:teuthology.orchestra.run.smithi151.stdout:Setting system user ceph properties....done 2024-05-08T18:28:24.612 INFO:teuthology.orchestra.run.smithi151.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-05-08T18:28:24.750 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-05-08T18:28:24.811 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libcephfs2 (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:28:24.912 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libradosstriper1 (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:28:25.013 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-05-08T18:28:25.094 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-05-08T18:28:25.280 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up librbd1 (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:28:25.390 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-mgr-modules-core (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:28:25.491 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-fuse (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:28:25.571 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-test (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:28:25.697 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up radosgw (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:28:25.706 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-08T18:28:25.706 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-08T18:28:26.154 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-08T18:28:26.154 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-08T18:28:26.226 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libcephfs-dev (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:28:26.352 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-rados (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:28:26.469 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up librgw2 (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:28:26.570 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-08T18:28:26.590 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-base (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:28:26.920 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-05-08T18:28:27.426 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-mds (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:28:27.636 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-08T18:28:27.636 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-08T18:28:27.698 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-rbd (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:28:27.800 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up rbd-fuse (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:28:27.909 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-rgw (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:28:28.037 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-cephfs (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:28:28.110 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-mgr (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:28:28.163 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-common (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:28:28.325 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-08T18:28:28.325 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-08T18:28:28.689 INFO:teuthology.orchestra.run.smithi097.stdout:Adding group ceph....done 2024-05-08T18:28:28.795 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-osd (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:28:29.049 INFO:teuthology.orchestra.run.smithi097.stdout:Adding system user ceph....done 2024-05-08T18:28:29.075 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-08T18:28:29.076 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-08T18:28:29.217 INFO:teuthology.orchestra.run.smithi097.stdout:Setting system user ceph properties....done 2024-05-08T18:28:29.235 INFO:teuthology.orchestra.run.smithi097.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-05-08T18:28:29.373 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-05-08T18:28:29.571 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:28:29.680 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:28:29.687 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-05-08T18:28:29.815 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-mon (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:28:30.030 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-08T18:28:30.030 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-08T18:28:30.197 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-test (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:28:30.307 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up radosgw (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:28:30.483 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-mgr-cephadm (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:28:30.659 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:28:30.779 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-08T18:28:30.779 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-08T18:28:30.785 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-mgr-dashboard (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:28:30.928 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-volume (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:28:31.267 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-base (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:28:31.280 INFO:teuthology.orchestra.run.smithi151.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-05-08T18:28:31.373 INFO:teuthology.orchestra.run.smithi151.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-05-08T18:28:31.517 INFO:teuthology.orchestra.run.smithi151.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-05-08T18:28:31.618 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-05-08T18:28:32.102 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-mds (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:28:32.324 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-08T18:28:32.324 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-08T18:28:32.634 INFO:teuthology.orchestra.run.smithi151.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-05-08T18:28:32.820 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-mgr (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:28:33.034 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-08T18:28:33.034 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-08T18:28:33.328 INFO:teuthology.orchestra.run.smithi151.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-05-08T18:28:33.337 DEBUG:teuthology.parallel:result is None 2024-05-08T18:28:33.555 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-osd (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:28:33.832 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-08T18:28:33.832 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-08T18:28:34.315 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:28:34.416 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:28:34.550 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-mon (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:28:34.762 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-08T18:28:34.763 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-08T18:28:35.260 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-mgr-cephadm (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:28:35.386 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:28:35.487 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-mgr-dashboard (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:28:35.638 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-volume (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:28:35.991 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-05-08T18:28:36.083 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-05-08T18:28:36.227 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-05-08T18:28:37.344 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-05-08T18:28:37.990 INFO:teuthology.orchestra.run.smithi097.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-05-08T18:28:37.996 DEBUG:teuthology.parallel:result is None 2024-05-08T18:28:37.997 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=27d371685027569bcfa4efc661d3d3186f3a1776 2024-05-08T18:28:38.224 DEBUG:teuthology.orchestra.run.smithi097:> dpkg-query -W -f '${Version}' ceph 2024-05-08T18:28:38.243 INFO:teuthology.orchestra.run.smithi097.stdout:19.0.0-3525-g27d37168-1jammy 2024-05-08T18:28:38.245 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3525-g27d37168-1jammy 2024-05-08T18:28:38.246 INFO:teuthology.task.install:The correct ceph version 19.0.0-3525-g27d37168-1jammy is installed. 2024-05-08T18:28:38.248 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=27d371685027569bcfa4efc661d3d3186f3a1776 2024-05-08T18:28:38.467 DEBUG:teuthology.orchestra.run.smithi151:> dpkg-query -W -f '${Version}' ceph 2024-05-08T18:28:38.487 INFO:teuthology.orchestra.run.smithi151.stdout:19.0.0-3525-g27d37168-1jammy 2024-05-08T18:28:38.487 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3525-g27d37168-1jammy 2024-05-08T18:28:38.487 INFO:teuthology.task.install:The correct ceph version 19.0.0-3525-g27d37168-1jammy is installed. 2024-05-08T18:28:38.489 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-08T18:28:38.489 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-05-08T18:28:38.489 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-08T18:28:38.504 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-05-08T18:28:38.504 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-08T18:28:38.545 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-08T18:28:38.545 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-05-08T18:28:38.545 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/usr/bin/daemon-helper 2024-05-08T18:28:38.561 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-08T18:28:38.617 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-05-08T18:28:38.617 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/usr/bin/daemon-helper 2024-05-08T18:28:38.630 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-08T18:28:38.683 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-08T18:28:38.683 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-05-08T18:28:38.683 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-08T18:28:38.696 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-08T18:28:38.752 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-05-08T18:28:38.752 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-08T18:28:38.764 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-08T18:28:38.819 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-08T18:28:38.820 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-05-08T18:28:38.820 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/usr/bin/stdin-killer 2024-05-08T18:28:38.833 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-08T18:28:38.888 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-05-08T18:28:38.888 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/usr/bin/stdin-killer 2024-05-08T18:28:38.901 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-08T18:28:38.955 INFO:teuthology.run_tasks:Running task ceph... 2024-05-08T18:28:39.049 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-05-08T18:28:39.049 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 777 /var/log/ceph 2024-05-08T18:28:39.051 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 777 /var/log/ceph 2024-05-08T18:28:39.065 INFO:tasks.ceph:Disabling ceph logrotate... 2024-05-08T18:28:39.065 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-08T18:28:39.106 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-08T18:28:39.120 INFO:tasks.ceph:Creating extra log directories... 2024-05-08T18:28:39.120 DEBUG:teuthology.orchestra.run.smithi097:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-08T18:28:39.162 DEBUG:teuthology.orchestra.run.smithi151:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-08T18:28:39.186 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-05-08T18:28:39.187 INFO:tasks.ceph:config {'conf': {'client': {'rgw relaxed s3 bucket names': True}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-05-08T18:28:39.187 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/ivancich-2024-05-08_17:43:43-rgw-wip-eric-testing-1-distro-default-smithi/7697884', 'branch': 'wip-eric-testing-1', 'description': 'rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_user_quota}', 'email': 'ivancich@redhat.com', 'first_in_suite': False, 'job_id': '7697884', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'ivancich-2024-05-08_17:43:43-rgw-wip-eric-testing-1-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-eric-testing-1'}, 'ceph': {'conf': {'client': {'rgw relaxed s3 bucket names': True}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'sha1': '27d371685027569bcfa4efc661d3d3186f3a1776'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '27d371685027569bcfa4efc661d3d3186f3a1776'}}, 'rgw': {'frontend': 'beast'}, 's3tests': {'force-branch': 'ceph-master'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-eric-testing-1', 'sha1': '27d371685027569bcfa4efc661d3d3186f3a1776'}}, 'owner': 'scheduled_ivancich@teuthology', 'priority': 75, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 831, 'sha1': '27d371685027569bcfa4efc661d3d3186f3a1776', 'sleep_before_teardown': 0, 'subset': '1/50', 'suite': 'rgw', 'suite_branch': 'wip-eric-testing-1', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_27d371685027569bcfa4efc661d3d3186f3a1776/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '27d371685027569bcfa4efc661d3d3186f3a1776', 'targets': {'smithi097.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPBICeI8VHkH+nYI8mIVjflTGhs+K5nl5PHRsJqcGbJpjXws9CTk2aNsgDTezng/ReS32D0KRy1wulGZFRbb+Dk=', 'smithi151.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPkbHRZfyEf561s8Gnorvd5eQw9Ic1K1xZKeNVwzw7ym63PLcB04ZKhJ9F9MWDh/eMwKtPaERJOFoO0IygQmnjw='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'rgw': ['client.0']}, {'thrashosds': {'ceph_objectstore_tool': False, 'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'chance_test_min_size': 0, 'op_delay': 30, 'timeout': 1200}}, {'workunit': {'clients': {'client.0': ['rgw/s3_user_quota.pl']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '1ae7ad82388e92a475afff437d49054826c019a1', 'timestamp': '2024-05-08_17:43:43', 'tube': 'smithi', 'user': 'ivancich', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-05-08T18:28:39.187 DEBUG:teuthology.orchestra.run.smithi097:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-08T18:28:39.218 DEBUG:teuthology.orchestra.run.smithi151:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-08T18:28:39.224 DEBUG:teuthology.orchestra.run.smithi097:> sudo install -d -m0777 -- /var/run/ceph 2024-05-08T18:28:39.266 DEBUG:teuthology.orchestra.run.smithi151:> sudo install -d -m0777 -- /var/run/ceph 2024-05-08T18:28:39.280 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-05-08T18:28:39.280 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/scratch_devs of=/dev/stdout 2024-05-08T18:28:39.325 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-08T18:28:39.325 DEBUG:teuthology.orchestra.run.smithi097:> stat /dev/vg_nvme/lv_1 2024-05-08T18:28:39.373 INFO:teuthology.orchestra.run.smithi097.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-08T18:28:39.373 INFO:teuthology.orchestra.run.smithi097.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T18:28:39.373 INFO:teuthology.orchestra.run.smithi097.stdout:Device: 5h/5d Inode: 890 Links: 1 2024-05-08T18:28:39.373 INFO:teuthology.orchestra.run.smithi097.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T18:28:39.373 INFO:teuthology.orchestra.run.smithi097.stdout:Access: 2024-05-08 18:23:19.119092200 +0000 2024-05-08T18:28:39.373 INFO:teuthology.orchestra.run.smithi097.stdout:Modify: 2024-05-08 18:23:18.839094701 +0000 2024-05-08T18:28:39.373 INFO:teuthology.orchestra.run.smithi097.stdout:Change: 2024-05-08 18:23:18.839094701 +0000 2024-05-08T18:28:39.374 INFO:teuthology.orchestra.run.smithi097.stdout: Birth: - 2024-05-08T18:28:39.374 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-08T18:28:39.427 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records in 2024-05-08T18:28:39.427 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records out 2024-05-08T18:28:39.427 INFO:teuthology.orchestra.run.smithi097.stderr:512 bytes copied, 0.000443309 s, 1.2 MB/s 2024-05-08T18:28:39.428 DEBUG:teuthology.orchestra.run.smithi097:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-08T18:28:39.478 DEBUG:teuthology.orchestra.run.smithi097:> stat /dev/vg_nvme/lv_2 2024-05-08T18:28:39.525 INFO:teuthology.orchestra.run.smithi097.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-08T18:28:39.525 INFO:teuthology.orchestra.run.smithi097.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T18:28:39.525 INFO:teuthology.orchestra.run.smithi097.stdout:Device: 5h/5d Inode: 905 Links: 1 2024-05-08T18:28:39.525 INFO:teuthology.orchestra.run.smithi097.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T18:28:39.525 INFO:teuthology.orchestra.run.smithi097.stdout:Access: 2024-05-08 18:23:19.611087806 +0000 2024-05-08T18:28:39.525 INFO:teuthology.orchestra.run.smithi097.stdout:Modify: 2024-05-08 18:23:19.359090055 +0000 2024-05-08T18:28:39.525 INFO:teuthology.orchestra.run.smithi097.stdout:Change: 2024-05-08 18:23:19.359090055 +0000 2024-05-08T18:28:39.525 INFO:teuthology.orchestra.run.smithi097.stdout: Birth: - 2024-05-08T18:28:39.525 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-08T18:28:39.579 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records in 2024-05-08T18:28:39.579 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records out 2024-05-08T18:28:39.579 INFO:teuthology.orchestra.run.smithi097.stderr:512 bytes copied, 0.00041534 s, 1.2 MB/s 2024-05-08T18:28:39.580 DEBUG:teuthology.orchestra.run.smithi097:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-08T18:28:39.630 DEBUG:teuthology.orchestra.run.smithi097:> stat /dev/vg_nvme/lv_3 2024-05-08T18:28:39.678 INFO:teuthology.orchestra.run.smithi097.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-08T18:28:39.678 INFO:teuthology.orchestra.run.smithi097.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T18:28:39.678 INFO:teuthology.orchestra.run.smithi097.stdout:Device: 5h/5d Inode: 916 Links: 1 2024-05-08T18:28:39.678 INFO:teuthology.orchestra.run.smithi097.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T18:28:39.678 INFO:teuthology.orchestra.run.smithi097.stdout:Access: 2024-05-08 18:23:20.103083410 +0000 2024-05-08T18:28:39.678 INFO:teuthology.orchestra.run.smithi097.stdout:Modify: 2024-05-08 18:23:19.835085805 +0000 2024-05-08T18:28:39.678 INFO:teuthology.orchestra.run.smithi097.stdout:Change: 2024-05-08 18:23:19.835085805 +0000 2024-05-08T18:28:39.678 INFO:teuthology.orchestra.run.smithi097.stdout: Birth: - 2024-05-08T18:28:39.679 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-08T18:28:39.730 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records in 2024-05-08T18:28:39.730 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records out 2024-05-08T18:28:39.730 INFO:teuthology.orchestra.run.smithi097.stderr:512 bytes copied, 0.000350465 s, 1.5 MB/s 2024-05-08T18:28:39.731 DEBUG:teuthology.orchestra.run.smithi097:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-08T18:28:39.783 DEBUG:teuthology.orchestra.run.smithi097:> stat /dev/vg_nvme/lv_4 2024-05-08T18:28:39.829 INFO:teuthology.orchestra.run.smithi097.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-08T18:28:39.829 INFO:teuthology.orchestra.run.smithi097.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T18:28:39.829 INFO:teuthology.orchestra.run.smithi097.stdout:Device: 5h/5d Inode: 941 Links: 1 2024-05-08T18:28:39.829 INFO:teuthology.orchestra.run.smithi097.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T18:28:39.829 INFO:teuthology.orchestra.run.smithi097.stdout:Access: 2024-05-08 18:23:20.611078872 +0000 2024-05-08T18:28:39.829 INFO:teuthology.orchestra.run.smithi097.stdout:Modify: 2024-05-08 18:23:20.351081195 +0000 2024-05-08T18:28:39.829 INFO:teuthology.orchestra.run.smithi097.stdout:Change: 2024-05-08 18:23:20.351081195 +0000 2024-05-08T18:28:39.829 INFO:teuthology.orchestra.run.smithi097.stdout: Birth: - 2024-05-08T18:28:39.829 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-08T18:28:39.882 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records in 2024-05-08T18:28:39.883 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records out 2024-05-08T18:28:39.883 INFO:teuthology.orchestra.run.smithi097.stderr:512 bytes copied, 0.000347611 s, 1.5 MB/s 2024-05-08T18:28:39.884 DEBUG:teuthology.orchestra.run.smithi097:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-08T18:28:39.935 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-08T18:28:39.935 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-05-08T18:28:39.935 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/scratch_devs of=/dev/stdout 2024-05-08T18:28:39.941 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-08T18:28:39.941 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_1 2024-05-08T18:28:39.989 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-08T18:28:39.989 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T18:28:39.989 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 5h/5d Inode: 887 Links: 1 2024-05-08T18:28:39.989 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T18:28:39.989 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2024-05-08 18:23:17.789809314 +0000 2024-05-08T18:28:39.989 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2024-05-08 18:23:17.525772336 +0000 2024-05-08T18:28:39.989 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2024-05-08 18:23:17.525772336 +0000 2024-05-08T18:28:39.989 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: - 2024-05-08T18:28:39.989 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-08T18:28:40.043 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2024-05-08T18:28:40.043 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2024-05-08T18:28:40.043 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.000446364 s, 1.1 MB/s 2024-05-08T18:28:40.045 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-08T18:28:40.096 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_2 2024-05-08T18:28:40.144 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-08T18:28:40.144 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T18:28:40.144 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 5h/5d Inode: 906 Links: 1 2024-05-08T18:28:40.144 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T18:28:40.144 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2024-05-08 18:23:18.277876290 +0000 2024-05-08T18:28:40.144 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2024-05-08 18:23:18.017841173 +0000 2024-05-08T18:28:40.144 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2024-05-08 18:23:18.017841173 +0000 2024-05-08T18:28:40.145 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: - 2024-05-08T18:28:40.145 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-08T18:28:40.198 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2024-05-08T18:28:40.199 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2024-05-08T18:28:40.199 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.000446397 s, 1.1 MB/s 2024-05-08T18:28:40.199 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-08T18:28:40.250 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_3 2024-05-08T18:28:40.297 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-08T18:28:40.298 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T18:28:40.298 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 5h/5d Inode: 917 Links: 1 2024-05-08T18:28:40.298 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T18:28:40.298 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2024-05-08 18:23:18.785944909 +0000 2024-05-08T18:28:40.298 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2024-05-08 18:23:18.517908709 +0000 2024-05-08T18:28:40.299 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2024-05-08 18:23:18.517908709 +0000 2024-05-08T18:28:40.299 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: - 2024-05-08T18:28:40.299 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-08T18:28:40.351 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2024-05-08T18:28:40.351 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2024-05-08T18:28:40.351 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.000427423 s, 1.2 MB/s 2024-05-08T18:28:40.352 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-08T18:28:40.401 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_4 2024-05-08T18:28:40.449 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-08T18:28:40.449 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T18:28:40.449 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 5h/5d Inode: 940 Links: 1 2024-05-08T18:28:40.449 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T18:28:40.449 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2024-05-08 18:23:19.310014495 +0000 2024-05-08T18:28:40.449 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2024-05-08 18:23:19.053980909 +0000 2024-05-08T18:28:40.449 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2024-05-08 18:23:19.053980909 +0000 2024-05-08T18:28:40.449 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: - 2024-05-08T18:28:40.450 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-08T18:28:40.503 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2024-05-08T18:28:40.503 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2024-05-08T18:28:40.504 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.000333602 s, 1.5 MB/s 2024-05-08T18:28:40.505 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-08T18:28:40.555 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-08T18:28:40.555 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi097.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi151.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-08T18:28:40.555 INFO:tasks.ceph:Generating config... 2024-05-08T18:28:40.558 INFO:tasks.ceph:[client] rgw relaxed s3 bucket names = True 2024-05-08T18:28:40.558 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-05-08T18:28:40.558 INFO:tasks.ceph:[mgr] debug ms = 1 2024-05-08T18:28:40.558 INFO:tasks.ceph:[mon] debug mon = 20 2024-05-08T18:28:40.558 INFO:tasks.ceph:[mon] debug ms = 1 2024-05-08T18:28:40.559 INFO:tasks.ceph:[mon] debug paxos = 20 2024-05-08T18:28:40.559 INFO:tasks.ceph:[osd] bdev async discard = True 2024-05-08T18:28:40.559 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-05-08T18:28:40.559 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-05-08T18:28:40.559 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-05-08T18:28:40.559 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-05-08T18:28:40.559 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-05-08T18:28:40.560 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-05-08T18:28:40.560 INFO:tasks.ceph:[osd] debug ms = 1 2024-05-08T18:28:40.560 INFO:tasks.ceph:[osd] debug osd = 20 2024-05-08T18:28:40.560 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-05-08T18:28:40.560 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-05-08T18:28:40.560 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-05-08T18:28:40.561 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-05-08T18:28:40.561 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-05-08T18:28:40.561 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-05-08T18:28:40.561 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-05-08T18:28:40.561 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-05-08T18:28:40.561 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-05-08T18:28:40.562 INFO:tasks.ceph:Setting up mon.a... 2024-05-08T18:28:40.562 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-05-08T18:28:40.597 INFO:teuthology.orchestra.run.smithi097.stdout:creating /etc/ceph/ceph.keyring 2024-05-08T18:28:40.607 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-05-08T18:28:40.685 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-08T18:28:40.741 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.97'), ('mon.c', '[v2:172.21.15.97:3301,v1:172.21.15.97:6790]'), ('mon.b', '172.21.15.151')] 2024-05-08T18:28:40.741 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.97,[v2:172.21.15.97:3301,v1:172.21.15.97:6790],172.21.15.151'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'rgw relaxed s3 bucket names': True}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-05-08T18:28:40.742 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-05-08T18:28:40.742 DEBUG:teuthology.orchestra.run.smithi097:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-05-08T18:28:40.789 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.97 --addv c '[v2:172.21.15.97:3301,v1:172.21.15.97:6790]' --add b 172.21.15.151 --print /home/ubuntu/cephtest/ceph.monmap 2024-05-08T18:28:40.874 INFO:teuthology.orchestra.run.smithi097.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-05-08T18:28:40.874 INFO:teuthology.orchestra.run.smithi097.stdout:monmaptool: generated fsid f135278e-f589-4ad6-a830-fa767ff99171 2024-05-08T18:28:40.874 INFO:teuthology.orchestra.run.smithi097.stdout:setting min_mon_release = quincy 2024-05-08T18:28:40.874 INFO:teuthology.orchestra.run.smithi097.stdout:epoch 0 2024-05-08T18:28:40.874 INFO:teuthology.orchestra.run.smithi097.stdout:fsid f135278e-f589-4ad6-a830-fa767ff99171 2024-05-08T18:28:40.874 INFO:teuthology.orchestra.run.smithi097.stdout:last_changed 2024-05-08T18:28:40.879627+0000 2024-05-08T18:28:40.874 INFO:teuthology.orchestra.run.smithi097.stdout:created 2024-05-08T18:28:40.879627+0000 2024-05-08T18:28:40.875 INFO:teuthology.orchestra.run.smithi097.stdout:min_mon_release 17 (quincy) 2024-05-08T18:28:40.875 INFO:teuthology.orchestra.run.smithi097.stdout:election_strategy: 1 2024-05-08T18:28:40.875 INFO:teuthology.orchestra.run.smithi097.stdout:0: [v2:172.21.15.97:3300/0,v1:172.21.15.97:6789/0] mon.a 2024-05-08T18:28:40.875 INFO:teuthology.orchestra.run.smithi097.stdout:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-05-08T18:28:40.875 INFO:teuthology.orchestra.run.smithi097.stdout:2: [v2:172.21.15.97:3301/0,v1:172.21.15.97:6790/0] mon.c 2024-05-08T18:28:40.875 INFO:teuthology.orchestra.run.smithi097.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-05-08T18:28:40.876 DEBUG:teuthology.orchestra.run.smithi097:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-05-08T18:28:40.925 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID f135278e-f589-4ad6-a830-fa767ff99171... 2024-05-08T18:28:40.926 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-08T18:28:40.970 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-08T18:28:40.998 INFO:teuthology.orchestra.run.smithi097.stdout:[global] 2024-05-08T18:28:40.998 INFO:teuthology.orchestra.run.smithi097.stdout: chdir = "" 2024-05-08T18:28:40.999 INFO:teuthology.orchestra.run.smithi097.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-08T18:28:40.999 INFO:teuthology.orchestra.run.smithi097.stdout: auth supported = cephx 2024-05-08T18:28:40.999 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-05-08T18:28:40.999 INFO:teuthology.orchestra.run.smithi097.stdout: filestore xattr use omap = true 2024-05-08T18:28:40.999 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-05-08T18:28:40.999 INFO:teuthology.orchestra.run.smithi097.stdout: mon clock drift allowed = 1.000 2024-05-08T18:28:40.999 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-05-08T18:28:40.999 INFO:teuthology.orchestra.run.smithi097.stdout: osd crush chooseleaf type = 0 2024-05-08T18:28:40.999 INFO:teuthology.orchestra.run.smithi097.stdout: auth debug = true 2024-05-08T18:28:40.999 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-05-08T18:28:40.999 INFO:teuthology.orchestra.run.smithi097.stdout: ms die on old message = true 2024-05-08T18:28:40.999 INFO:teuthology.orchestra.run.smithi097.stdout: ms die on bug = true 2024-05-08T18:28:40.999 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-05-08T18:28:41.000 INFO:teuthology.orchestra.run.smithi097.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-08T18:28:41.000 INFO:teuthology.orchestra.run.smithi097.stdout: mon pg warn max object skew = 0 2024-05-08T18:28:41.000 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-05-08T18:28:41.000 INFO:teuthology.orchestra.run.smithi097.stdout: # disable pg_autoscaler by default for new pools 2024-05-08T18:28:41.000 INFO:teuthology.orchestra.run.smithi097.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-08T18:28:41.000 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-05-08T18:28:41.000 INFO:teuthology.orchestra.run.smithi097.stdout: osd pool default size = 2 2024-05-08T18:28:41.000 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-05-08T18:28:41.000 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd allow primary affinity = true 2024-05-08T18:28:41.000 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd allow pg remap = true 2024-05-08T18:28:41.000 INFO:teuthology.orchestra.run.smithi097.stdout: mon warn on legacy crush tunables = false 2024-05-08T18:28:41.001 INFO:teuthology.orchestra.run.smithi097.stdout: mon warn on crush straw calc version zero = false 2024-05-08T18:28:41.001 INFO:teuthology.orchestra.run.smithi097.stdout: mon warn on no sortbitwise = false 2024-05-08T18:28:41.001 INFO:teuthology.orchestra.run.smithi097.stdout: mon warn on osd down out interval zero = false 2024-05-08T18:28:41.001 INFO:teuthology.orchestra.run.smithi097.stdout: mon warn on too few osds = false 2024-05-08T18:28:41.001 INFO:teuthology.orchestra.run.smithi097.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-08T18:28:41.001 INFO:teuthology.orchestra.run.smithi097.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-08T18:28:41.001 INFO:teuthology.orchestra.run.smithi097.stdout: mon_allow_pool_size_one = true 2024-05-08T18:28:41.001 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-05-08T18:28:41.001 INFO:teuthology.orchestra.run.smithi097.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-08T18:28:41.001 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-05-08T18:28:41.002 INFO:teuthology.orchestra.run.smithi097.stdout: osd default data pool replay window = 5 2024-05-08T18:28:41.002 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-05-08T18:28:41.002 INFO:teuthology.orchestra.run.smithi097.stdout: mon allow pool delete = true 2024-05-08T18:28:41.002 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-05-08T18:28:41.002 INFO:teuthology.orchestra.run.smithi097.stdout: mon cluster log file level = debug 2024-05-08T18:28:41.002 INFO:teuthology.orchestra.run.smithi097.stdout: debug asserts on shutdown = true 2024-05-08T18:28:41.002 INFO:teuthology.orchestra.run.smithi097.stdout: mon health detail to clog = false 2024-05-08T18:28:41.002 INFO:teuthology.orchestra.run.smithi097.stdout: mon host = "172.21.15.97,[v2:172.21.15.97:3301,v1:172.21.15.97:6790],172.21.15.151" 2024-05-08T18:28:41.002 INFO:teuthology.orchestra.run.smithi097.stdout: fsid = f135278e-f589-4ad6-a830-fa767ff99171 2024-05-08T18:28:41.002 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-05-08T18:28:41.002 INFO:teuthology.orchestra.run.smithi097.stdout:[osd] 2024-05-08T18:28:41.002 INFO:teuthology.orchestra.run.smithi097.stdout: osd journal size = 100 2024-05-08T18:28:41.003 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-05-08T18:28:41.003 INFO:teuthology.orchestra.run.smithi097.stdout: osd scrub load threshold = 5.0 2024-05-08T18:28:41.003 INFO:teuthology.orchestra.run.smithi097.stdout: osd scrub max interval = 600 2024-05-08T18:28:41.003 INFO:teuthology.orchestra.run.smithi097.stdout: osd mclock profile = high_recovery_ops 2024-05-08T18:28:41.003 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-05-08T18:28:41.003 INFO:teuthology.orchestra.run.smithi097.stdout: osd recover clone overlap = true 2024-05-08T18:28:41.003 INFO:teuthology.orchestra.run.smithi097.stdout: osd recovery max chunk = 1048576 2024-05-08T18:28:41.003 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-05-08T18:28:41.003 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug shutdown = true 2024-05-08T18:28:41.003 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug op order = true 2024-05-08T18:28:41.003 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug verify stray on activate = true 2024-05-08T18:28:41.003 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug trim objects = true 2024-05-08T18:28:41.003 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-05-08T18:28:41.003 INFO:teuthology.orchestra.run.smithi097.stdout: osd open classes on start = true 2024-05-08T18:28:41.003 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug pg log writeout = true 2024-05-08T18:28:41.004 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-05-08T18:28:41.004 INFO:teuthology.orchestra.run.smithi097.stdout: osd deep scrub update digest min age = 30 2024-05-08T18:28:41.004 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-05-08T18:28:41.004 INFO:teuthology.orchestra.run.smithi097.stdout: osd map max advance = 10 2024-05-08T18:28:41.004 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-05-08T18:28:41.004 INFO:teuthology.orchestra.run.smithi097.stdout: journal zero on create = true 2024-05-08T18:28:41.004 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-05-08T18:28:41.004 INFO:teuthology.orchestra.run.smithi097.stdout: filestore ondisk finisher threads = 3 2024-05-08T18:28:41.004 INFO:teuthology.orchestra.run.smithi097.stdout: filestore apply finisher threads = 3 2024-05-08T18:28:41.004 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-05-08T18:28:41.004 INFO:teuthology.orchestra.run.smithi097.stdout: bdev debug aio = true 2024-05-08T18:28:41.004 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug misdirected ops = true 2024-05-08T18:28:41.004 INFO:teuthology.orchestra.run.smithi097.stdout: bdev async discard = True 2024-05-08T18:28:41.004 INFO:teuthology.orchestra.run.smithi097.stdout: bdev enable discard = True 2024-05-08T18:28:41.004 INFO:teuthology.orchestra.run.smithi097.stdout: bluestore allocator = bitmap 2024-05-08T18:28:41.005 INFO:teuthology.orchestra.run.smithi097.stdout: bluestore block size = 96636764160 2024-05-08T18:28:41.005 INFO:teuthology.orchestra.run.smithi097.stdout: bluestore fsck on mount = True 2024-05-08T18:28:41.005 INFO:teuthology.orchestra.run.smithi097.stdout: debug bluefs = 1/20 2024-05-08T18:28:41.005 INFO:teuthology.orchestra.run.smithi097.stdout: debug bluestore = 1/20 2024-05-08T18:28:41.005 INFO:teuthology.orchestra.run.smithi097.stdout: debug ms = 1 2024-05-08T18:28:41.005 INFO:teuthology.orchestra.run.smithi097.stdout: debug osd = 20 2024-05-08T18:28:41.005 INFO:teuthology.orchestra.run.smithi097.stdout: debug rocksdb = 4/10 2024-05-08T18:28:41.005 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd backfillfull_ratio = 0.85 2024-05-08T18:28:41.005 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd full ratio = 0.9 2024-05-08T18:28:41.005 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd nearfull ratio = 0.8 2024-05-08T18:28:41.005 INFO:teuthology.orchestra.run.smithi097.stdout: osd blocked scrub grace period = 3600 2024-05-08T18:28:41.005 INFO:teuthology.orchestra.run.smithi097.stdout: osd failsafe full ratio = 0.95 2024-05-08T18:28:41.005 INFO:teuthology.orchestra.run.smithi097.stdout: osd max markdown count = 1000 2024-05-08T18:28:41.005 INFO:teuthology.orchestra.run.smithi097.stdout: osd objectstore = bluestore 2024-05-08T18:28:41.005 INFO:teuthology.orchestra.run.smithi097.stdout: osd shutdown pgref assert = True 2024-05-08T18:28:41.006 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-05-08T18:28:41.006 INFO:teuthology.orchestra.run.smithi097.stdout:[mgr] 2024-05-08T18:28:41.006 INFO:teuthology.orchestra.run.smithi097.stdout: debug ms = 1 2024-05-08T18:28:41.006 INFO:teuthology.orchestra.run.smithi097.stdout: debug mgr = 20 2024-05-08T18:28:41.006 INFO:teuthology.orchestra.run.smithi097.stdout: debug mon = 20 2024-05-08T18:28:41.006 INFO:teuthology.orchestra.run.smithi097.stdout: debug auth = 20 2024-05-08T18:28:41.006 INFO:teuthology.orchestra.run.smithi097.stdout: mon reweight min pgs per osd = 4 2024-05-08T18:28:41.006 INFO:teuthology.orchestra.run.smithi097.stdout: mon reweight min bytes per osd = 10 2024-05-08T18:28:41.006 INFO:teuthology.orchestra.run.smithi097.stdout: mgr/telemetry/nag = false 2024-05-08T18:28:41.006 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-05-08T18:28:41.006 INFO:teuthology.orchestra.run.smithi097.stdout:[mon] 2024-05-08T18:28:41.006 INFO:teuthology.orchestra.run.smithi097.stdout: debug ms = 1 2024-05-08T18:28:41.006 INFO:teuthology.orchestra.run.smithi097.stdout: debug mon = 20 2024-05-08T18:28:41.007 INFO:teuthology.orchestra.run.smithi097.stdout: debug paxos = 20 2024-05-08T18:28:41.007 INFO:teuthology.orchestra.run.smithi097.stdout: debug auth = 20 2024-05-08T18:28:41.007 INFO:teuthology.orchestra.run.smithi097.stdout: mon data avail warn = 5 2024-05-08T18:28:41.007 INFO:teuthology.orchestra.run.smithi097.stdout: mon mgr mkfs grace = 240 2024-05-08T18:28:41.007 INFO:teuthology.orchestra.run.smithi097.stdout: mon reweight min pgs per osd = 4 2024-05-08T18:28:41.007 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd reporter subtree level = osd 2024-05-08T18:28:41.007 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd prime pg temp = true 2024-05-08T18:28:41.007 INFO:teuthology.orchestra.run.smithi097.stdout: mon reweight min bytes per osd = 10 2024-05-08T18:28:41.007 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-05-08T18:28:41.007 INFO:teuthology.orchestra.run.smithi097.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-08T18:28:41.007 INFO:teuthology.orchestra.run.smithi097.stdout: auth mon ticket ttl = 660 # 11m 2024-05-08T18:28:41.007 INFO:teuthology.orchestra.run.smithi097.stdout: auth service ticket ttl = 240 # 4m 2024-05-08T18:28:41.007 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-05-08T18:28:41.007 INFO:teuthology.orchestra.run.smithi097.stdout: # don't complain about insecure global_id in the test suite 2024-05-08T18:28:41.007 INFO:teuthology.orchestra.run.smithi097.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-08T18:28:41.008 INFO:teuthology.orchestra.run.smithi097.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-08T18:28:41.008 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-05-08T18:28:41.008 INFO:teuthology.orchestra.run.smithi097.stdout: # 1m isn't quite enough 2024-05-08T18:28:41.008 INFO:teuthology.orchestra.run.smithi097.stdout: mon_down_mkfs_grace = 2m 2024-05-08T18:28:41.008 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-05-08T18:28:41.008 INFO:teuthology.orchestra.run.smithi097.stdout: mon_warn_on_filestore_osds = false 2024-05-08T18:28:41.008 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-05-08T18:28:41.008 INFO:teuthology.orchestra.run.smithi097.stdout:[client] 2024-05-08T18:28:41.008 INFO:teuthology.orchestra.run.smithi097.stdout: rgw cache enabled = true 2024-05-08T18:28:41.008 INFO:teuthology.orchestra.run.smithi097.stdout: rgw enable ops log = true 2024-05-08T18:28:41.008 INFO:teuthology.orchestra.run.smithi097.stdout: rgw enable usage log = true 2024-05-08T18:28:41.008 INFO:teuthology.orchestra.run.smithi097.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-08T18:28:41.008 INFO:teuthology.orchestra.run.smithi097.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-08T18:28:41.008 INFO:teuthology.orchestra.run.smithi097.stdout: rgw relaxed s3 bucket names = True 2024-05-08T18:28:41.008 INFO:teuthology.orchestra.run.smithi097.stdout:[mon.a] 2024-05-08T18:28:41.008 INFO:teuthology.orchestra.run.smithi097.stdout:[mon.c] 2024-05-08T18:28:41.009 INFO:teuthology.orchestra.run.smithi097.stdout:[mon.b] 2024-05-08T18:28:41.009 INFO:teuthology.orchestra.run.smithi151.stdout:[global] 2024-05-08T18:28:41.009 INFO:teuthology.orchestra.run.smithi151.stdout: chdir = "" 2024-05-08T18:28:41.009 INFO:teuthology.orchestra.run.smithi151.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-08T18:28:41.009 INFO:teuthology.orchestra.run.smithi151.stdout: auth supported = cephx 2024-05-08T18:28:41.009 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-05-08T18:28:41.010 INFO:teuthology.orchestra.run.smithi151.stdout: filestore xattr use omap = true 2024-05-08T18:28:41.010 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-05-08T18:28:41.010 INFO:teuthology.orchestra.run.smithi151.stdout: mon clock drift allowed = 1.000 2024-05-08T18:28:41.010 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-05-08T18:28:41.010 INFO:teuthology.orchestra.run.smithi151.stdout: osd crush chooseleaf type = 0 2024-05-08T18:28:41.010 INFO:teuthology.orchestra.run.smithi151.stdout: auth debug = true 2024-05-08T18:28:41.010 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-05-08T18:28:41.010 INFO:teuthology.orchestra.run.smithi151.stdout: ms die on old message = true 2024-05-08T18:28:41.010 INFO:teuthology.orchestra.run.smithi151.stdout: ms die on bug = true 2024-05-08T18:28:41.010 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-05-08T18:28:41.010 INFO:teuthology.orchestra.run.smithi151.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-08T18:28:41.010 INFO:teuthology.orchestra.run.smithi151.stdout: mon pg warn max object skew = 0 2024-05-08T18:28:41.011 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-05-08T18:28:41.011 INFO:teuthology.orchestra.run.smithi151.stdout: # disable pg_autoscaler by default for new pools 2024-05-08T18:28:41.011 INFO:teuthology.orchestra.run.smithi151.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-08T18:28:41.011 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-05-08T18:28:41.011 INFO:teuthology.orchestra.run.smithi151.stdout: osd pool default size = 2 2024-05-08T18:28:41.011 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-05-08T18:28:41.011 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd allow primary affinity = true 2024-05-08T18:28:41.011 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd allow pg remap = true 2024-05-08T18:28:41.011 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on legacy crush tunables = false 2024-05-08T18:28:41.011 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on crush straw calc version zero = false 2024-05-08T18:28:41.011 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on no sortbitwise = false 2024-05-08T18:28:41.011 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on osd down out interval zero = false 2024-05-08T18:28:41.011 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on too few osds = false 2024-05-08T18:28:41.012 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-08T18:28:41.012 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-08T18:28:41.012 INFO:teuthology.orchestra.run.smithi151.stdout: mon_allow_pool_size_one = true 2024-05-08T18:28:41.012 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-05-08T18:28:41.012 INFO:teuthology.orchestra.run.smithi151.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-08T18:28:41.012 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-05-08T18:28:41.012 INFO:teuthology.orchestra.run.smithi151.stdout: osd default data pool replay window = 5 2024-05-08T18:28:41.012 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-05-08T18:28:41.012 INFO:teuthology.orchestra.run.smithi151.stdout: mon allow pool delete = true 2024-05-08T18:28:41.012 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-05-08T18:28:41.012 INFO:teuthology.orchestra.run.smithi151.stdout: mon cluster log file level = debug 2024-05-08T18:28:41.012 INFO:teuthology.orchestra.run.smithi151.stdout: debug asserts on shutdown = true 2024-05-08T18:28:41.012 INFO:teuthology.orchestra.run.smithi151.stdout: mon health detail to clog = false 2024-05-08T18:28:41.013 INFO:teuthology.orchestra.run.smithi151.stdout: mon host = "172.21.15.97,[v2:172.21.15.97:3301,v1:172.21.15.97:6790],172.21.15.151" 2024-05-08T18:28:41.013 INFO:teuthology.orchestra.run.smithi151.stdout: fsid = f135278e-f589-4ad6-a830-fa767ff99171 2024-05-08T18:28:41.013 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-05-08T18:28:41.013 INFO:teuthology.orchestra.run.smithi151.stdout:[osd] 2024-05-08T18:28:41.013 INFO:teuthology.orchestra.run.smithi151.stdout: osd journal size = 100 2024-05-08T18:28:41.013 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-05-08T18:28:41.013 INFO:teuthology.orchestra.run.smithi151.stdout: osd scrub load threshold = 5.0 2024-05-08T18:28:41.013 INFO:teuthology.orchestra.run.smithi151.stdout: osd scrub max interval = 600 2024-05-08T18:28:41.013 INFO:teuthology.orchestra.run.smithi151.stdout: osd mclock profile = high_recovery_ops 2024-05-08T18:28:41.013 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-05-08T18:28:41.013 INFO:teuthology.orchestra.run.smithi151.stdout: osd recover clone overlap = true 2024-05-08T18:28:41.013 INFO:teuthology.orchestra.run.smithi151.stdout: osd recovery max chunk = 1048576 2024-05-08T18:28:41.013 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-05-08T18:28:41.013 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug shutdown = true 2024-05-08T18:28:41.014 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug op order = true 2024-05-08T18:28:41.014 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug verify stray on activate = true 2024-05-08T18:28:41.014 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug trim objects = true 2024-05-08T18:28:41.014 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-05-08T18:28:41.014 INFO:teuthology.orchestra.run.smithi151.stdout: osd open classes on start = true 2024-05-08T18:28:41.014 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug pg log writeout = true 2024-05-08T18:28:41.014 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-05-08T18:28:41.014 INFO:teuthology.orchestra.run.smithi151.stdout: osd deep scrub update digest min age = 30 2024-05-08T18:28:41.014 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-05-08T18:28:41.014 INFO:teuthology.orchestra.run.smithi151.stdout: osd map max advance = 10 2024-05-08T18:28:41.014 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-05-08T18:28:41.014 INFO:teuthology.orchestra.run.smithi151.stdout: journal zero on create = true 2024-05-08T18:28:41.015 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-05-08T18:28:41.015 INFO:teuthology.orchestra.run.smithi151.stdout: filestore ondisk finisher threads = 3 2024-05-08T18:28:41.015 INFO:teuthology.orchestra.run.smithi151.stdout: filestore apply finisher threads = 3 2024-05-08T18:28:41.015 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-05-08T18:28:41.015 INFO:teuthology.orchestra.run.smithi151.stdout: bdev debug aio = true 2024-05-08T18:28:41.015 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug misdirected ops = true 2024-05-08T18:28:41.015 INFO:teuthology.orchestra.run.smithi151.stdout: bdev async discard = True 2024-05-08T18:28:41.015 INFO:teuthology.orchestra.run.smithi151.stdout: bdev enable discard = True 2024-05-08T18:28:41.015 INFO:teuthology.orchestra.run.smithi151.stdout: bluestore allocator = bitmap 2024-05-08T18:28:41.015 INFO:teuthology.orchestra.run.smithi151.stdout: bluestore block size = 96636764160 2024-05-08T18:28:41.015 INFO:teuthology.orchestra.run.smithi151.stdout: bluestore fsck on mount = True 2024-05-08T18:28:41.015 INFO:teuthology.orchestra.run.smithi151.stdout: debug bluefs = 1/20 2024-05-08T18:28:41.015 INFO:teuthology.orchestra.run.smithi151.stdout: debug bluestore = 1/20 2024-05-08T18:28:41.015 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2024-05-08T18:28:41.015 INFO:teuthology.orchestra.run.smithi151.stdout: debug osd = 20 2024-05-08T18:28:41.016 INFO:teuthology.orchestra.run.smithi151.stdout: debug rocksdb = 4/10 2024-05-08T18:28:41.016 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd backfillfull_ratio = 0.85 2024-05-08T18:28:41.016 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd full ratio = 0.9 2024-05-08T18:28:41.016 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd nearfull ratio = 0.8 2024-05-08T18:28:41.016 INFO:teuthology.orchestra.run.smithi151.stdout: osd blocked scrub grace period = 3600 2024-05-08T18:28:41.016 INFO:teuthology.orchestra.run.smithi151.stdout: osd failsafe full ratio = 0.95 2024-05-08T18:28:41.016 INFO:teuthology.orchestra.run.smithi151.stdout: osd max markdown count = 1000 2024-05-08T18:28:41.016 INFO:teuthology.orchestra.run.smithi151.stdout: osd objectstore = bluestore 2024-05-08T18:28:41.016 INFO:teuthology.orchestra.run.smithi151.stdout: osd shutdown pgref assert = True 2024-05-08T18:28:41.016 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-05-08T18:28:41.016 INFO:teuthology.orchestra.run.smithi151.stdout:[mgr] 2024-05-08T18:28:41.016 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2024-05-08T18:28:41.016 INFO:teuthology.orchestra.run.smithi151.stdout: debug mgr = 20 2024-05-08T18:28:41.016 INFO:teuthology.orchestra.run.smithi151.stdout: debug mon = 20 2024-05-08T18:28:41.017 INFO:teuthology.orchestra.run.smithi151.stdout: debug auth = 20 2024-05-08T18:28:41.017 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min pgs per osd = 4 2024-05-08T18:28:41.017 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min bytes per osd = 10 2024-05-08T18:28:41.017 INFO:teuthology.orchestra.run.smithi151.stdout: mgr/telemetry/nag = false 2024-05-08T18:28:41.017 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-05-08T18:28:41.017 INFO:teuthology.orchestra.run.smithi151.stdout:[mon] 2024-05-08T18:28:41.017 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2024-05-08T18:28:41.017 INFO:teuthology.orchestra.run.smithi151.stdout: debug mon = 20 2024-05-08T18:28:41.017 INFO:teuthology.orchestra.run.smithi151.stdout: debug paxos = 20 2024-05-08T18:28:41.017 INFO:teuthology.orchestra.run.smithi151.stdout: debug auth = 20 2024-05-08T18:28:41.017 INFO:teuthology.orchestra.run.smithi151.stdout: mon data avail warn = 5 2024-05-08T18:28:41.017 INFO:teuthology.orchestra.run.smithi151.stdout: mon mgr mkfs grace = 240 2024-05-08T18:28:41.017 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min pgs per osd = 4 2024-05-08T18:28:41.017 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd reporter subtree level = osd 2024-05-08T18:28:41.018 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd prime pg temp = true 2024-05-08T18:28:41.018 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min bytes per osd = 10 2024-05-08T18:28:41.018 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-05-08T18:28:41.018 INFO:teuthology.orchestra.run.smithi151.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-08T18:28:41.018 INFO:teuthology.orchestra.run.smithi151.stdout: auth mon ticket ttl = 660 # 11m 2024-05-08T18:28:41.018 INFO:teuthology.orchestra.run.smithi151.stdout: auth service ticket ttl = 240 # 4m 2024-05-08T18:28:41.018 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-05-08T18:28:41.018 INFO:teuthology.orchestra.run.smithi151.stdout: # don't complain about insecure global_id in the test suite 2024-05-08T18:28:41.018 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-08T18:28:41.018 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-08T18:28:41.018 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-05-08T18:28:41.018 INFO:teuthology.orchestra.run.smithi151.stdout: # 1m isn't quite enough 2024-05-08T18:28:41.018 INFO:teuthology.orchestra.run.smithi151.stdout: mon_down_mkfs_grace = 2m 2024-05-08T18:28:41.018 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-05-08T18:28:41.019 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_filestore_osds = false 2024-05-08T18:28:41.019 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-05-08T18:28:41.019 INFO:teuthology.orchestra.run.smithi151.stdout:[client] 2024-05-08T18:28:41.019 INFO:teuthology.orchestra.run.smithi151.stdout: rgw cache enabled = true 2024-05-08T18:28:41.019 INFO:teuthology.orchestra.run.smithi151.stdout: rgw enable ops log = true 2024-05-08T18:28:41.019 INFO:teuthology.orchestra.run.smithi151.stdout: rgw enable usage log = true 2024-05-08T18:28:41.019 INFO:teuthology.orchestra.run.smithi151.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-08T18:28:41.019 INFO:teuthology.orchestra.run.smithi151.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-08T18:28:41.019 INFO:teuthology.orchestra.run.smithi151.stdout: rgw relaxed s3 bucket names = True 2024-05-08T18:28:41.019 INFO:teuthology.orchestra.run.smithi151.stdout:[mon.a] 2024-05-08T18:28:41.019 INFO:teuthology.orchestra.run.smithi151.stdout:[mon.c] 2024-05-08T18:28:41.019 INFO:teuthology.orchestra.run.smithi151.stdout:[mon.b] 2024-05-08T18:28:41.021 INFO:tasks.ceph:Creating admin key on mon.a... 2024-05-08T18:28:41.021 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-05-08T18:28:41.113 INFO:tasks.ceph:Copying monmap to all nodes... 2024-05-08T18:28:41.114 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-05-08T18:28:41.114 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-05-08T18:28:41.119 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-05-08T18:28:41.119 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-05-08T18:28:41.164 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi097.front.sepia.ceph.com 2024-05-08T18:28:41.164 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-05-08T18:28:41.164 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-08T18:28:41.164 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-08T18:28:41.229 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-05-08T18:28:41.229 DEBUG:teuthology.orchestra.run.smithi097:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-08T18:28:41.277 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi151.front.sepia.ceph.com 2024-05-08T18:28:41.277 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-05-08T18:28:41.277 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-08T18:28:41.277 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-08T18:28:41.300 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-05-08T18:28:41.300 DEBUG:teuthology.orchestra.run.smithi151:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-08T18:28:41.348 INFO:tasks.ceph:Setting up mon nodes... 2024-05-08T18:28:41.348 INFO:tasks.ceph:Setting up mgr nodes... 2024-05-08T18:28:41.349 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-05-08T18:28:41.393 INFO:teuthology.orchestra.run.smithi097.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-05-08T18:28:41.396 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-05-08T18:28:41.438 INFO:teuthology.orchestra.run.smithi151.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-05-08T18:28:41.450 INFO:tasks.ceph:Setting up mds nodes... 2024-05-08T18:28:41.450 INFO:tasks.ceph_client:Setting up client nodes... 2024-05-08T18:28:41.451 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-08T18:28:41.485 INFO:teuthology.orchestra.run.smithi097.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-05-08T18:28:41.496 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-05-08T18:28:41.532 INFO:teuthology.orchestra.run.smithi151.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-05-08T18:28:41.542 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-05-08T18:28:41.543 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi097.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi151.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-08T18:28:41.543 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-05-08T18:28:41.556 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-08T18:28:41.556 INFO:tasks.ceph:role: osd.0 2024-05-08T18:28:41.556 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi097.front.sepia.ceph.com 2024-05-08T18:28:41.556 DEBUG:teuthology.orchestra.run.smithi097:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-08T18:28:41.620 INFO:teuthology.orchestra.run.smithi097.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T18:28:41.620 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T18:28:41.621 INFO:teuthology.orchestra.run.smithi097.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T18:28:41.621 INFO:teuthology.orchestra.run.smithi097.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-08T18:28:41.621 INFO:teuthology.orchestra.run.smithi097.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T18:28:41.621 INFO:teuthology.orchestra.run.smithi097.stdout: = sunit=0 swidth=0 blks 2024-05-08T18:28:41.621 INFO:teuthology.orchestra.run.smithi097.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T18:28:41.621 INFO:teuthology.orchestra.run.smithi097.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-08T18:28:41.621 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T18:28:41.621 INFO:teuthology.orchestra.run.smithi097.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T18:28:42.103 INFO:teuthology.orchestra.run.smithi097.stdout:Discarding blocks...Done. 2024-05-08T18:28:42.105 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi097.front.sepia.ceph.com -o noatime 2024-05-08T18:28:42.105 DEBUG:teuthology.orchestra.run.smithi097:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-05-08T18:28:42.244 DEBUG:teuthology.orchestra.run.smithi097:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-05-08T18:28:42.256 INFO:teuthology.orchestra.run.smithi097.stderr:sudo: /sbin/restorecon: command not found 2024-05-08T18:28:42.256 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T18:28:42.257 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-05-08T18:28:42.311 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-08T18:28:42.312 INFO:tasks.ceph:role: osd.1 2024-05-08T18:28:42.312 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi097.front.sepia.ceph.com 2024-05-08T18:28:42.312 DEBUG:teuthology.orchestra.run.smithi097:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-08T18:28:42.376 INFO:teuthology.orchestra.run.smithi097.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T18:28:42.376 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T18:28:42.377 INFO:teuthology.orchestra.run.smithi097.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T18:28:42.377 INFO:teuthology.orchestra.run.smithi097.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-08T18:28:42.377 INFO:teuthology.orchestra.run.smithi097.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T18:28:42.377 INFO:teuthology.orchestra.run.smithi097.stdout: = sunit=0 swidth=0 blks 2024-05-08T18:28:42.377 INFO:teuthology.orchestra.run.smithi097.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T18:28:42.377 INFO:teuthology.orchestra.run.smithi097.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-08T18:28:42.377 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T18:28:42.377 INFO:teuthology.orchestra.run.smithi097.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T18:28:42.820 INFO:teuthology.orchestra.run.smithi097.stdout:Discarding blocks...Done. 2024-05-08T18:28:42.822 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi097.front.sepia.ceph.com -o noatime 2024-05-08T18:28:42.822 DEBUG:teuthology.orchestra.run.smithi097:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-05-08T18:28:42.908 DEBUG:teuthology.orchestra.run.smithi097:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-05-08T18:28:42.963 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T18:28:42.964 INFO:teuthology.orchestra.run.smithi097.stderr:sudo: /sbin/restorecon: command not found 2024-05-08T18:28:42.964 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-05-08T18:28:43.021 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-08T18:28:43.021 INFO:tasks.ceph:role: osd.2 2024-05-08T18:28:43.021 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi097.front.sepia.ceph.com 2024-05-08T18:28:43.021 DEBUG:teuthology.orchestra.run.smithi097:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-08T18:28:43.087 INFO:teuthology.orchestra.run.smithi097.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T18:28:43.088 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T18:28:43.088 INFO:teuthology.orchestra.run.smithi097.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T18:28:43.088 INFO:teuthology.orchestra.run.smithi097.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-08T18:28:43.088 INFO:teuthology.orchestra.run.smithi097.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T18:28:43.088 INFO:teuthology.orchestra.run.smithi097.stdout: = sunit=0 swidth=0 blks 2024-05-08T18:28:43.088 INFO:teuthology.orchestra.run.smithi097.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T18:28:43.088 INFO:teuthology.orchestra.run.smithi097.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-08T18:28:43.088 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T18:28:43.088 INFO:teuthology.orchestra.run.smithi097.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T18:28:43.544 INFO:teuthology.orchestra.run.smithi097.stdout:Discarding blocks...Done. 2024-05-08T18:28:43.546 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi097.front.sepia.ceph.com -o noatime 2024-05-08T18:28:43.546 DEBUG:teuthology.orchestra.run.smithi097:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-05-08T18:28:43.677 DEBUG:teuthology.orchestra.run.smithi097:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-05-08T18:28:43.688 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T18:28:43.688 INFO:teuthology.orchestra.run.smithi097.stderr:sudo: /sbin/restorecon: command not found 2024-05-08T18:28:43.689 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-05-08T18:28:43.745 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-08T18:28:43.745 INFO:tasks.ceph:role: osd.3 2024-05-08T18:28:43.745 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi097.front.sepia.ceph.com 2024-05-08T18:28:43.745 DEBUG:teuthology.orchestra.run.smithi097:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-08T18:28:43.807 INFO:teuthology.orchestra.run.smithi097.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T18:28:43.808 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T18:28:43.808 INFO:teuthology.orchestra.run.smithi097.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T18:28:43.808 INFO:teuthology.orchestra.run.smithi097.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-08T18:28:43.808 INFO:teuthology.orchestra.run.smithi097.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T18:28:43.808 INFO:teuthology.orchestra.run.smithi097.stdout: = sunit=0 swidth=0 blks 2024-05-08T18:28:43.808 INFO:teuthology.orchestra.run.smithi097.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T18:28:43.808 INFO:teuthology.orchestra.run.smithi097.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-08T18:28:43.808 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T18:28:43.808 INFO:teuthology.orchestra.run.smithi097.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T18:28:44.305 INFO:teuthology.orchestra.run.smithi097.stdout:Discarding blocks...Done. 2024-05-08T18:28:44.307 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi097.front.sepia.ceph.com -o noatime 2024-05-08T18:28:44.307 DEBUG:teuthology.orchestra.run.smithi097:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-05-08T18:28:44.458 DEBUG:teuthology.orchestra.run.smithi097:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-05-08T18:28:44.470 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T18:28:44.470 INFO:teuthology.orchestra.run.smithi097.stderr:sudo: /sbin/restorecon: command not found 2024-05-08T18:28:44.471 DEBUG:teuthology.orchestra.run.smithi097:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T18:28:44.583 INFO:teuthology.orchestra.run.smithi097.stderr:2024-05-08T18:28:44.584+0000 7f201bd3a7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-05-08T18:28:44.586 INFO:teuthology.orchestra.run.smithi097.stderr:2024-05-08T18:28:44.588+0000 7f201bd3a7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-05-08T18:28:44.586 INFO:teuthology.orchestra.run.smithi097.stderr:2024-05-08T18:28:44.588+0000 7f201bd3a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-08T18:28:44.586 INFO:teuthology.orchestra.run.smithi097.stderr:2024-05-08T18:28:44.588+0000 7f201bd3a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-08T18:28:44.586 INFO:teuthology.orchestra.run.smithi097.stderr:2024-05-08T18:28:44.588+0000 7f201bd3a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-08T18:28:44.588 INFO:teuthology.orchestra.run.smithi097.stderr:2024-05-08T18:28:44.592+0000 7f201bd3a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-05-08T18:28:47.576 DEBUG:teuthology.orchestra.run.smithi097:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-08T18:28:47.590 DEBUG:teuthology.orchestra.run.smithi097:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T18:28:47.669 INFO:teuthology.orchestra.run.smithi097.stderr:2024-05-08T18:28:47.672+0000 7f3bf91eb7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-05-08T18:28:47.670 INFO:teuthology.orchestra.run.smithi097.stderr:2024-05-08T18:28:47.672+0000 7f3bf91eb7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-05-08T18:28:47.670 INFO:teuthology.orchestra.run.smithi097.stderr:2024-05-08T18:28:47.672+0000 7f3bf91eb7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-08T18:28:47.670 INFO:teuthology.orchestra.run.smithi097.stderr:2024-05-08T18:28:47.672+0000 7f3bf91eb7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-08T18:28:47.670 INFO:teuthology.orchestra.run.smithi097.stderr:2024-05-08T18:28:47.672+0000 7f3bf91eb7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-08T18:28:47.671 INFO:teuthology.orchestra.run.smithi097.stderr:2024-05-08T18:28:47.672+0000 7f3bf91eb7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-05-08T18:28:50.656 DEBUG:teuthology.orchestra.run.smithi097:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-05-08T18:28:50.713 DEBUG:teuthology.orchestra.run.smithi097:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T18:28:50.796 INFO:teuthology.orchestra.run.smithi097.stderr:2024-05-08T18:28:50.796+0000 7febef4237c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-05-08T18:28:50.796 INFO:teuthology.orchestra.run.smithi097.stderr:2024-05-08T18:28:50.800+0000 7febef4237c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-05-08T18:28:50.796 INFO:teuthology.orchestra.run.smithi097.stderr:2024-05-08T18:28:50.800+0000 7febef4237c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-08T18:28:50.796 INFO:teuthology.orchestra.run.smithi097.stderr:2024-05-08T18:28:50.800+0000 7febef4237c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-08T18:28:50.797 INFO:teuthology.orchestra.run.smithi097.stderr:2024-05-08T18:28:50.800+0000 7febef4237c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-08T18:28:50.797 INFO:teuthology.orchestra.run.smithi097.stderr:2024-05-08T18:28:50.800+0000 7febef4237c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-05-08T18:28:53.795 DEBUG:teuthology.orchestra.run.smithi097:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-05-08T18:28:53.854 DEBUG:teuthology.orchestra.run.smithi097:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T18:28:53.939 INFO:teuthology.orchestra.run.smithi097.stderr:2024-05-08T18:28:53.940+0000 7f75e0e177c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-05-08T18:28:53.940 INFO:teuthology.orchestra.run.smithi097.stderr:2024-05-08T18:28:53.940+0000 7f75e0e177c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-05-08T18:28:53.940 INFO:teuthology.orchestra.run.smithi097.stderr:2024-05-08T18:28:53.944+0000 7f75e0e177c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-08T18:28:53.940 INFO:teuthology.orchestra.run.smithi097.stderr:2024-05-08T18:28:53.944+0000 7f75e0e177c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-08T18:28:53.940 INFO:teuthology.orchestra.run.smithi097.stderr:2024-05-08T18:28:53.944+0000 7f75e0e177c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-08T18:28:53.941 INFO:teuthology.orchestra.run.smithi097.stderr:2024-05-08T18:28:53.944+0000 7f75e0e177c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-05-08T18:28:56.924 DEBUG:teuthology.orchestra.run.smithi097:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-05-08T18:28:56.981 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-05-08T18:28:56.996 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-08T18:28:56.996 INFO:tasks.ceph:role: osd.4 2024-05-08T18:28:56.996 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi151.front.sepia.ceph.com 2024-05-08T18:28:56.997 DEBUG:teuthology.orchestra.run.smithi151:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-08T18:28:57.059 INFO:teuthology.orchestra.run.smithi151.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T18:28:57.059 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T18:28:57.059 INFO:teuthology.orchestra.run.smithi151.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T18:28:57.059 INFO:teuthology.orchestra.run.smithi151.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-08T18:28:57.059 INFO:teuthology.orchestra.run.smithi151.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T18:28:57.059 INFO:teuthology.orchestra.run.smithi151.stdout: = sunit=0 swidth=0 blks 2024-05-08T18:28:57.059 INFO:teuthology.orchestra.run.smithi151.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T18:28:57.059 INFO:teuthology.orchestra.run.smithi151.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-08T18:28:57.059 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T18:28:57.059 INFO:teuthology.orchestra.run.smithi151.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T18:28:57.544 INFO:teuthology.orchestra.run.smithi151.stdout:Discarding blocks...Done. 2024-05-08T18:28:57.546 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi151.front.sepia.ceph.com -o noatime 2024-05-08T18:28:57.546 DEBUG:teuthology.orchestra.run.smithi151:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-05-08T18:28:57.696 DEBUG:teuthology.orchestra.run.smithi151:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-05-08T18:28:57.708 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T18:28:57.708 INFO:teuthology.orchestra.run.smithi151.stderr:sudo: /sbin/restorecon: command not found 2024-05-08T18:28:57.708 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-05-08T18:28:57.763 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-08T18:28:57.763 INFO:tasks.ceph:role: osd.5 2024-05-08T18:28:57.763 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi151.front.sepia.ceph.com 2024-05-08T18:28:57.763 DEBUG:teuthology.orchestra.run.smithi151:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-08T18:28:57.828 INFO:teuthology.orchestra.run.smithi151.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T18:28:57.828 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T18:28:57.828 INFO:teuthology.orchestra.run.smithi151.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T18:28:57.828 INFO:teuthology.orchestra.run.smithi151.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-08T18:28:57.828 INFO:teuthology.orchestra.run.smithi151.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T18:28:57.828 INFO:teuthology.orchestra.run.smithi151.stdout: = sunit=0 swidth=0 blks 2024-05-08T18:28:57.828 INFO:teuthology.orchestra.run.smithi151.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T18:28:57.829 INFO:teuthology.orchestra.run.smithi151.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-08T18:28:57.829 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T18:28:57.829 INFO:teuthology.orchestra.run.smithi151.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T18:28:58.283 INFO:teuthology.orchestra.run.smithi151.stdout:Discarding blocks...Done. 2024-05-08T18:28:58.285 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi151.front.sepia.ceph.com -o noatime 2024-05-08T18:28:58.285 DEBUG:teuthology.orchestra.run.smithi151:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-05-08T18:28:58.376 DEBUG:teuthology.orchestra.run.smithi151:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-05-08T18:28:58.385 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T18:28:58.386 INFO:teuthology.orchestra.run.smithi151.stderr:sudo: /sbin/restorecon: command not found 2024-05-08T18:28:58.386 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-05-08T18:28:58.437 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-08T18:28:58.437 INFO:tasks.ceph:role: osd.6 2024-05-08T18:28:58.437 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi151.front.sepia.ceph.com 2024-05-08T18:28:58.438 DEBUG:teuthology.orchestra.run.smithi151:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-08T18:28:58.498 INFO:teuthology.orchestra.run.smithi151.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T18:28:58.499 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T18:28:58.499 INFO:teuthology.orchestra.run.smithi151.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T18:28:58.499 INFO:teuthology.orchestra.run.smithi151.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-08T18:28:58.499 INFO:teuthology.orchestra.run.smithi151.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T18:28:58.499 INFO:teuthology.orchestra.run.smithi151.stdout: = sunit=0 swidth=0 blks 2024-05-08T18:28:58.499 INFO:teuthology.orchestra.run.smithi151.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T18:28:58.499 INFO:teuthology.orchestra.run.smithi151.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-08T18:28:58.499 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T18:28:58.499 INFO:teuthology.orchestra.run.smithi151.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T18:28:58.960 INFO:teuthology.orchestra.run.smithi151.stdout:Discarding blocks...Done. 2024-05-08T18:28:58.963 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi151.front.sepia.ceph.com -o noatime 2024-05-08T18:28:58.963 DEBUG:teuthology.orchestra.run.smithi151:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-05-08T18:28:59.048 DEBUG:teuthology.orchestra.run.smithi151:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-05-08T18:28:59.058 INFO:teuthology.orchestra.run.smithi151.stderr:sudo: /sbin/restorecon: command not found 2024-05-08T18:28:59.059 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T18:28:59.059 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-05-08T18:28:59.115 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-08T18:28:59.115 INFO:tasks.ceph:role: osd.7 2024-05-08T18:28:59.115 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi151.front.sepia.ceph.com 2024-05-08T18:28:59.115 DEBUG:teuthology.orchestra.run.smithi151:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-08T18:28:59.175 INFO:teuthology.orchestra.run.smithi151.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T18:28:59.175 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T18:28:59.175 INFO:teuthology.orchestra.run.smithi151.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T18:28:59.175 INFO:teuthology.orchestra.run.smithi151.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-08T18:28:59.175 INFO:teuthology.orchestra.run.smithi151.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T18:28:59.175 INFO:teuthology.orchestra.run.smithi151.stdout: = sunit=0 swidth=0 blks 2024-05-08T18:28:59.176 INFO:teuthology.orchestra.run.smithi151.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T18:28:59.176 INFO:teuthology.orchestra.run.smithi151.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-08T18:28:59.176 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T18:28:59.176 INFO:teuthology.orchestra.run.smithi151.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T18:28:59.688 INFO:teuthology.orchestra.run.smithi151.stdout:Discarding blocks...Done. 2024-05-08T18:28:59.690 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi151.front.sepia.ceph.com -o noatime 2024-05-08T18:28:59.691 DEBUG:teuthology.orchestra.run.smithi151:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-05-08T18:28:59.842 DEBUG:teuthology.orchestra.run.smithi151:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-05-08T18:28:59.853 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T18:28:59.854 INFO:teuthology.orchestra.run.smithi151.stderr:sudo: /sbin/restorecon: command not found 2024-05-08T18:28:59.854 DEBUG:teuthology.orchestra.run.smithi151:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T18:28:59.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T18:28:59.969+0000 7f86313b07c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-05-08T18:28:59.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T18:28:59.973+0000 7f86313b07c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-05-08T18:28:59.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T18:28:59.973+0000 7f86313b07c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-08T18:28:59.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T18:28:59.973+0000 7f86313b07c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-08T18:28:59.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T18:28:59.973+0000 7f86313b07c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-08T18:28:59.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T18:28:59.981+0000 7f86313b07c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-05-08T18:29:03.015 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-05-08T18:29:03.029 DEBUG:teuthology.orchestra.run.smithi151:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T18:29:03.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T18:29:03.113+0000 7fc33f1b57c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-05-08T18:29:03.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T18:29:03.113+0000 7fc33f1b57c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-05-08T18:29:03.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T18:29:03.113+0000 7fc33f1b57c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-08T18:29:03.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T18:29:03.113+0000 7fc33f1b57c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-08T18:29:03.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T18:29:03.113+0000 7fc33f1b57c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-08T18:29:03.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T18:29:03.113+0000 7fc33f1b57c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-05-08T18:29:06.101 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-05-08T18:29:06.157 DEBUG:teuthology.orchestra.run.smithi151:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T18:29:06.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T18:29:06.237+0000 7f5b578277c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-05-08T18:29:06.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T18:29:06.237+0000 7f5b578277c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-05-08T18:29:06.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T18:29:06.241+0000 7f5b578277c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-08T18:29:06.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T18:29:06.241+0000 7f5b578277c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-08T18:29:06.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T18:29:06.241+0000 7f5b578277c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-08T18:29:06.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T18:29:06.241+0000 7f5b578277c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-05-08T18:29:09.224 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-05-08T18:29:09.280 DEBUG:teuthology.orchestra.run.smithi151:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T18:29:09.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T18:29:09.361+0000 7fadc4bd47c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-05-08T18:29:09.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T18:29:09.361+0000 7fadc4bd47c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-05-08T18:29:09.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T18:29:09.361+0000 7fadc4bd47c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-08T18:29:09.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T18:29:09.361+0000 7fadc4bd47c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-08T18:29:09.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T18:29:09.361+0000 7fadc4bd47c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-08T18:29:09.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T18:29:09.361+0000 7fadc4bd47c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-05-08T18:29:12.341 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-05-08T18:29:12.396 INFO:tasks.ceph:Reading keys from all nodes... 2024-05-08T18:29:12.397 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-05-08T18:29:12.397 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-05-08T18:29:12.411 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-05-08T18:29:12.411 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-05-08T18:29:12.472 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-05-08T18:29:12.472 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-05-08T18:29:12.527 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-05-08T18:29:12.527 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-05-08T18:29:12.579 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-05-08T18:29:12.579 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-05-08T18:29:12.631 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-05-08T18:29:12.631 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-05-08T18:29:12.645 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-05-08T18:29:12.645 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-05-08T18:29:12.699 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-05-08T18:29:12.699 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-05-08T18:29:12.755 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-05-08T18:29:12.756 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-05-08T18:29:12.812 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-05-08T18:29:12.812 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-05-08T18:29:12.868 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-05-08T18:29:12.868 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-05-08T18:29:12.873 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-05-08T18:29:12.874 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-05-08T18:29:12.916 INFO:tasks.ceph:Adding keys to all mons... 2024-05-08T18:29:12.916 DEBUG:teuthology.orchestra.run.smithi097:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-08T18:29:12.919 DEBUG:teuthology.orchestra.run.smithi151:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-08T18:29:12.962 INFO:teuthology.orchestra.run.smithi097.stdout:[mgr.y] 2024-05-08T18:29:12.962 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQBZxDtmSrrFFxAA/0fYKljAxmm+yMBu/hDe1g== 2024-05-08T18:29:12.962 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.0] 2024-05-08T18:29:12.962 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQBcxDtme10dIxAATm7w0cSrr4EWBiwndFic2Q== 2024-05-08T18:29:12.962 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.1] 2024-05-08T18:29:12.963 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQBfxDtmQpJCKBAAOph9EeNYfVzmdjv7g4Dltw== 2024-05-08T18:29:12.963 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.2] 2024-05-08T18:29:12.963 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQBixDtmL8jILxAAOs4l/987cufJYI9SLCKUGg== 2024-05-08T18:29:12.963 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.3] 2024-05-08T18:29:12.963 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQBlxDtmU/FXOBAARcJwOJOcGK+wGce1KebdNA== 2024-05-08T18:29:12.963 INFO:teuthology.orchestra.run.smithi097.stdout:[mgr.x] 2024-05-08T18:29:12.963 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQBZxDtmvqZLGhAASaG6gIbKz7jug4vV9iurHw== 2024-05-08T18:29:12.963 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.4] 2024-05-08T18:29:12.963 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQBrxDtmP5QFOhAA9gss4IW6cU14UfsQWlW96g== 2024-05-08T18:29:12.963 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.5] 2024-05-08T18:29:12.963 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQBvxDtmbMTtBhAAN7JRpu2O6PBZHrn5XsEYIw== 2024-05-08T18:29:12.963 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.6] 2024-05-08T18:29:12.963 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQByxDtmsUlqDhAAt7xQR3BSv8nJb9HaZ1caRg== 2024-05-08T18:29:12.964 INFO:teuthology.orchestra.run.smithi097.stdout:[osd.7] 2024-05-08T18:29:12.964 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQB1xDtmS9W9FRAAdmLXtHmm/PsldvQRVNWNzQ== 2024-05-08T18:29:12.964 INFO:teuthology.orchestra.run.smithi097.stdout:[client.0] 2024-05-08T18:29:12.964 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQBZxDtmu6E8HRAA3Avp2h+6Cc8uCLlcufVXbw== 2024-05-08T18:29:12.964 INFO:teuthology.orchestra.run.smithi097.stdout:[client.1] 2024-05-08T18:29:12.964 INFO:teuthology.orchestra.run.smithi097.stdout: key = AQBZxDtmfFbcHxAA7SwC5mXrZA7kRqhVyaVU9w== 2024-05-08T18:29:12.970 INFO:teuthology.orchestra.run.smithi151.stdout:[mgr.y] 2024-05-08T18:29:12.970 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQBZxDtmSrrFFxAA/0fYKljAxmm+yMBu/hDe1g== 2024-05-08T18:29:12.970 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.0] 2024-05-08T18:29:12.970 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQBcxDtme10dIxAATm7w0cSrr4EWBiwndFic2Q== 2024-05-08T18:29:12.970 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.1] 2024-05-08T18:29:12.971 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQBfxDtmQpJCKBAAOph9EeNYfVzmdjv7g4Dltw== 2024-05-08T18:29:12.971 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.2] 2024-05-08T18:29:12.971 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQBixDtmL8jILxAAOs4l/987cufJYI9SLCKUGg== 2024-05-08T18:29:12.971 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.3] 2024-05-08T18:29:12.971 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQBlxDtmU/FXOBAARcJwOJOcGK+wGce1KebdNA== 2024-05-08T18:29:12.971 INFO:teuthology.orchestra.run.smithi151.stdout:[mgr.x] 2024-05-08T18:29:12.971 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQBZxDtmvqZLGhAASaG6gIbKz7jug4vV9iurHw== 2024-05-08T18:29:12.971 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.4] 2024-05-08T18:29:12.971 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQBrxDtmP5QFOhAA9gss4IW6cU14UfsQWlW96g== 2024-05-08T18:29:12.971 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.5] 2024-05-08T18:29:12.971 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQBvxDtmbMTtBhAAN7JRpu2O6PBZHrn5XsEYIw== 2024-05-08T18:29:12.971 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.6] 2024-05-08T18:29:12.971 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQByxDtmsUlqDhAAt7xQR3BSv8nJb9HaZ1caRg== 2024-05-08T18:29:12.971 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.7] 2024-05-08T18:29:12.971 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQB1xDtmS9W9FRAAdmLXtHmm/PsldvQRVNWNzQ== 2024-05-08T18:29:12.972 INFO:teuthology.orchestra.run.smithi151.stdout:[client.0] 2024-05-08T18:29:12.972 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQBZxDtmu6E8HRAA3Avp2h+6Cc8uCLlcufVXbw== 2024-05-08T18:29:12.972 INFO:teuthology.orchestra.run.smithi151.stdout:[client.1] 2024-05-08T18:29:12.972 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQBZxDtmfFbcHxAA7SwC5mXrZA7kRqhVyaVU9w== 2024-05-08T18:29:12.973 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-08T18:29:13.009 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-08T18:29:13.060 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T18:29:13.062 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T18:29:13.144 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T18:29:13.146 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T18:29:13.227 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T18:29:13.233 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T18:29:13.316 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T18:29:13.318 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T18:29:13.358 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-08T18:29:13.397 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-08T18:29:13.437 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T18:29:13.477 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T18:29:13.518 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T18:29:13.557 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T18:29:13.605 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T18:29:13.642 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T18:29:13.684 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T18:29:13.725 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T18:29:13.770 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-08T18:29:13.805 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-08T18:29:13.859 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-08T18:29:13.893 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-08T18:29:13.937 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-05-08T18:29:13.937 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-05-08T18:29:13.987 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-08T18:29:14.075 DEBUG:teuthology.orchestra.run.smithi097:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-05-08T18:29:14.129 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-05-08T18:29:14.182 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-08T18:29:14.269 DEBUG:teuthology.orchestra.run.smithi097:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-05-08T18:29:14.280 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-05-08T18:29:14.294 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-08T18:29:14.387 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-05-08T18:29:14.399 DEBUG:teuthology.orchestra.run.smithi097:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-08T18:29:14.401 DEBUG:teuthology.orchestra.run.smithi151:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-08T18:29:14.443 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-05-08T18:29:14.444 INFO:tasks.ceph.mon.a:Restarting daemon 2024-05-08T18:29:14.444 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-05-08T18:29:14.453 INFO:tasks.ceph.mon.a:Started 2024-05-08T18:29:14.453 INFO:tasks.ceph.mon.c:Restarting daemon 2024-05-08T18:29:14.454 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-05-08T18:29:14.456 INFO:tasks.ceph.mon.c:Started 2024-05-08T18:29:14.457 INFO:tasks.ceph.mon.b:Restarting daemon 2024-05-08T18:29:14.457 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-05-08T18:29:14.489 INFO:tasks.ceph.mon.b:Started 2024-05-08T18:29:14.490 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-05-08T18:29:14.490 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-05-08T18:29:14.491 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-05-08T18:29:14.494 INFO:tasks.ceph.mgr.y:Started 2024-05-08T18:29:14.494 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-05-08T18:29:14.494 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-05-08T18:29:14.497 INFO:tasks.ceph.mgr.x:Started 2024-05-08T18:29:14.497 INFO:tasks.ceph:Setting crush tunables to default 2024-05-08T18:29:14.498 DEBUG:teuthology.orchestra.run.smithi097:> sudo ceph --cluster ceph osd crush tunables default 2024-05-08T18:29:14.955 INFO:teuthology.orchestra.run.smithi097.stderr:adjusted tunables profile to default 2024-05-08T18:29:14.976 INFO:tasks.ceph:check_enable_crimson: False 2024-05-08T18:29:14.976 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-05-08T18:29:14.976 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-05-08T18:29:14.976 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-05-08T18:29:14.986 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-05-08T18:29:14.986 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-05-08T18:29:15.037 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-05-08T18:29:15.037 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-05-08T18:29:15.060 INFO:tasks.ceph.mgr.y.smithi097.stderr:2024-05-08T18:29:15.064+0000 7f5931891180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-08T18:29:15.069 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-05-08T18:29:15.069 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-05-08T18:29:15.114 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-05-08T18:29:15.113+0000 7f233f78d180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-08T18:29:15.121 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-05-08T18:29:15.121 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-05-08T18:29:15.135 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-05-08T18:29:15.135 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-05-08T18:29:15.191 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-05-08T18:29:15.191 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-05-08T18:29:15.247 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-05-08T18:29:15.247 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-05-08T18:29:15.302 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new f135796c-f80c-43a8-889d-e0927bcc3d0a 0 2024-05-08T18:29:15.555 INFO:teuthology.orchestra.run.smithi151.stdout:0 2024-05-08T18:29:15.564 INFO:tasks.ceph.mgr.y.smithi097.stderr:2024-05-08T18:29:15.568+0000 7f5931891180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-08T18:29:15.572 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new b91d895a-2b40-45c1-b355-52dba17032cb 1 2024-05-08T18:29:15.661 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-05-08T18:29:15.661+0000 7f233f78d180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-08T18:29:15.754 INFO:tasks.ceph.mgr.y.smithi097.stderr:2024-05-08T18:29:15.756+0000 7f5931891180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-08T18:29:15.774 INFO:teuthology.orchestra.run.smithi151.stdout:1 2024-05-08T18:29:15.792 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new 35f12106-8d9a-4dcb-a8bc-38e08c81bd5e 2 2024-05-08T18:29:15.875 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-05-08T18:29:15.873+0000 7f233f78d180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-08T18:29:16.002 INFO:teuthology.orchestra.run.smithi151.stdout:2 2024-05-08T18:29:16.018 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new cd78d341-ec40-457e-a713-555b03bc9f16 3 2024-05-08T18:29:16.214 INFO:teuthology.orchestra.run.smithi151.stdout:3 2024-05-08T18:29:16.231 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new 469d890e-5e0c-41cd-ac5b-ef987b70abd0 4 2024-05-08T18:29:16.304 INFO:tasks.ceph.mgr.y.smithi097.stderr:2024-05-08T18:29:16.304+0000 7f5931891180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-08T18:29:16.358 INFO:tasks.ceph.mgr.y.smithi097.stderr:2024-05-08T18:29:16.360+0000 7f5931891180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-08T18:29:16.410 INFO:tasks.ceph.mgr.y.smithi097.stderr:2024-05-08T18:29:16.412+0000 7f5931891180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-08T18:29:16.430 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-05-08T18:29:16.429+0000 7f233f78d180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-08T18:29:16.433 INFO:teuthology.orchestra.run.smithi151.stdout:4 2024-05-08T18:29:16.450 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new dcb25c08-802c-4140-a3d2-929960319860 5 2024-05-08T18:29:16.487 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-05-08T18:29:16.485+0000 7f233f78d180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-08T18:29:16.488 INFO:tasks.ceph.mgr.y.smithi097.stderr:2024-05-08T18:29:16.488+0000 7f5931891180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-08T18:29:16.539 INFO:tasks.ceph.mgr.y.smithi097.stderr:2024-05-08T18:29:16.540+0000 7f5931891180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-08T18:29:16.541 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-05-08T18:29:16.541+0000 7f233f78d180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-08T18:29:16.616 INFO:tasks.ceph.mgr.y.smithi097.stderr:2024-05-08T18:29:16.620+0000 7f5931891180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-08T18:29:16.622 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-05-08T18:29:16.621+0000 7f233f78d180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-08T18:29:16.650 INFO:teuthology.orchestra.run.smithi151.stdout:5 2024-05-08T18:29:16.666 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new 598ab572-7049-4600-9e91-1792360421d2 6 2024-05-08T18:29:16.670 INFO:tasks.ceph.mgr.y.smithi097.stderr:2024-05-08T18:29:16.672+0000 7f5931891180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-08T18:29:16.677 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-05-08T18:29:16.677+0000 7f233f78d180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-08T18:29:16.757 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-05-08T18:29:16.757+0000 7f233f78d180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-08T18:29:16.812 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-05-08T18:29:16.813+0000 7f233f78d180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-08T18:29:16.819 INFO:tasks.ceph.mgr.y.smithi097.stderr:2024-05-08T18:29:16.820+0000 7f5931891180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-08T18:29:16.864 INFO:teuthology.orchestra.run.smithi151.stdout:6 2024-05-08T18:29:16.880 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new c21805e0-4945-4efe-8e65-68bb92d30b69 7 2024-05-08T18:29:16.883 INFO:tasks.ceph.mgr.y.smithi097.stderr:2024-05-08T18:29:16.884+0000 7f5931891180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-08T18:29:16.967 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-05-08T18:29:16.965+0000 7f233f78d180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-08T18:29:17.032 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-05-08T18:29:17.033+0000 7f233f78d180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-08T18:29:17.083 INFO:teuthology.orchestra.run.smithi151.stdout:7 2024-05-08T18:29:17.100 INFO:tasks.ceph.osd.0:Restarting daemon 2024-05-08T18:29:17.101 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-05-08T18:29:17.103 INFO:tasks.ceph.osd.0:Started 2024-05-08T18:29:17.103 INFO:tasks.ceph.osd.1:Restarting daemon 2024-05-08T18:29:17.103 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-05-08T18:29:17.105 INFO:tasks.ceph.osd.1:Started 2024-05-08T18:29:17.106 INFO:tasks.ceph.osd.2:Restarting daemon 2024-05-08T18:29:17.106 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-05-08T18:29:17.108 INFO:tasks.ceph.osd.2:Started 2024-05-08T18:29:17.108 INFO:tasks.ceph.osd.3:Restarting daemon 2024-05-08T18:29:17.108 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-05-08T18:29:17.111 INFO:tasks.ceph.osd.3:Started 2024-05-08T18:29:17.111 INFO:tasks.ceph.osd.4:Restarting daemon 2024-05-08T18:29:17.111 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-05-08T18:29:17.113 INFO:tasks.ceph.osd.4:Started 2024-05-08T18:29:17.113 INFO:tasks.ceph.osd.5:Restarting daemon 2024-05-08T18:29:17.113 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-05-08T18:29:17.115 INFO:tasks.ceph.osd.5:Started 2024-05-08T18:29:17.115 INFO:tasks.ceph.osd.6:Restarting daemon 2024-05-08T18:29:17.116 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-05-08T18:29:17.117 INFO:tasks.ceph.osd.6:Started 2024-05-08T18:29:17.117 INFO:tasks.ceph.osd.7:Restarting daemon 2024-05-08T18:29:17.118 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-05-08T18:29:17.119 INFO:tasks.ceph.osd.7:Started 2024-05-08T18:29:17.120 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T18:29:17.341 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-05-08T18:29:17.342 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":10,"fsid":"f135278e-f589-4ad6-a830-fa767ff99171","created":"2024-05-08T18:29:14.813384+0000","modified":"2024-05-08T18:29:17.082151+0000","last_up_change":"0.000000","last_in_change":"2024-05-08T18:29:17.082151+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"f135796c-f80c-43a8-889d-e0927bcc3d0a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b91d895a-2b40-45c1-b355-52dba17032cb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"35f12106-8d9a-4dcb-a8bc-38e08c81bd5e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"cd78d341-ec40-457e-a713-555b03bc9f16","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"469d890e-5e0c-41cd-ac5b-ef987b70abd0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"dcb25c08-802c-4140-a3d2-929960319860","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"598ab572-7049-4600-9e91-1792360421d2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"c21805e0-4945-4efe-8e65-68bb92d30b69","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T18:29:17.357 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-05-08T18:29:17.357 INFO:tasks.ceph:Waiting for OSDs to come up 2024-05-08T18:29:17.501 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:29:17.504+0000 7f626f0bf7c0 -1 Falling back to public interface 2024-05-08T18:29:17.513 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:29:17.516+0000 7f0b21d437c0 -1 Falling back to public interface 2024-05-08T18:29:17.513 INFO:tasks.ceph.mgr.y.smithi097.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-05-08T18:29:17.513 INFO:tasks.ceph.mgr.y.smithi097.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-05-08T18:29:17.513 INFO:tasks.ceph.mgr.y.smithi097.stderr: from numpy import show_config as show_numpy_config 2024-05-08T18:29:17.513 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:29:17.516+0000 7f67edcbf7c0 -1 Falling back to public interface 2024-05-08T18:29:17.520 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:29:17.524+0000 7ff86aced7c0 -1 Falling back to public interface 2024-05-08T18:29:17.566 INFO:tasks.ceph.mgr.y.smithi097.stderr:2024-05-08T18:29:17.568+0000 7f5931891180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-08T18:29:17.698 INFO:tasks.ceph.mgr.y.smithi097.stderr:2024-05-08T18:29:17.700+0000 7f5931891180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-08T18:29:17.731 INFO:tasks.ceph.mgr.x.smithi151.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-05-08T18:29:17.731 INFO:tasks.ceph.mgr.x.smithi151.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-05-08T18:29:17.731 INFO:tasks.ceph.mgr.x.smithi151.stderr: from numpy import show_config as show_numpy_config 2024-05-08T18:29:17.744 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:29:17.745+0000 7fcf3e1e17c0 -1 Falling back to public interface 2024-05-08T18:29:17.749 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:29:17.749+0000 7f19ae0c77c0 -1 Falling back to public interface 2024-05-08T18:29:17.750 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:29:17.749+0000 7f09064b27c0 -1 Falling back to public interface 2024-05-08T18:29:17.776 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:29:17.777+0000 7f5a63c217c0 -1 Falling back to public interface 2024-05-08T18:29:17.785 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-05-08T18:29:17.785+0000 7f233f78d180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-08T18:29:17.877 INFO:tasks.ceph.mgr.y.smithi097.stderr:2024-05-08T18:29:17.880+0000 7f5931891180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-08T18:29:17.920 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-05-08T18:29:17.921+0000 7f233f78d180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-08T18:29:17.940 INFO:tasks.ceph.mgr.y.smithi097.stderr:2024-05-08T18:29:17.940+0000 7f5931891180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-08T18:29:18.072 INFO:tasks.ceph.mgr.y.smithi097.stderr:2024-05-08T18:29:18.076+0000 7f5931891180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-08T18:29:18.087 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-05-08T18:29:18.085+0000 7f233f78d180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-08T18:29:18.149 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-05-08T18:29:18.149+0000 7f233f78d180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-08T18:29:18.163 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-08T18:29:18.282 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-05-08T18:29:18.281+0000 7f233f78d180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-08T18:29:18.370 INFO:teuthology.misc.health.smithi097.stdout: 2024-05-08T18:29:18.370 INFO:teuthology.misc.health.smithi097.stdout:{"epoch":10,"fsid":"f135278e-f589-4ad6-a830-fa767ff99171","created":"2024-05-08T18:29:14.813384+0000","modified":"2024-05-08T18:29:17.082151+0000","last_up_change":"0.000000","last_in_change":"2024-05-08T18:29:17.082151+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"f135796c-f80c-43a8-889d-e0927bcc3d0a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b91d895a-2b40-45c1-b355-52dba17032cb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"35f12106-8d9a-4dcb-a8bc-38e08c81bd5e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"cd78d341-ec40-457e-a713-555b03bc9f16","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"469d890e-5e0c-41cd-ac5b-ef987b70abd0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"dcb25c08-802c-4140-a3d2-929960319860","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"598ab572-7049-4600-9e91-1792360421d2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"c21805e0-4945-4efe-8e65-68bb92d30b69","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T18:29:18.385 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-05-08T18:29:18.687 INFO:tasks.ceph.mgr.y.smithi097.stderr:2024-05-08T18:29:18.688+0000 7f5931891180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-08T18:29:18.762 INFO:tasks.ceph.mgr.y.smithi097.stderr:2024-05-08T18:29:18.764+0000 7f5931891180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-08T18:29:18.911 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-05-08T18:29:18.909+0000 7f233f78d180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-08T18:29:18.943 INFO:tasks.ceph.mgr.y.smithi097.stderr:2024-05-08T18:29:18.944+0000 7f5931891180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-08T18:29:18.986 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-05-08T18:29:18.985+0000 7f233f78d180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-08T18:29:19.016 INFO:tasks.ceph.mgr.y.smithi097.stderr:2024-05-08T18:29:19.020+0000 7f5931891180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-08T18:29:19.166 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-05-08T18:29:19.165+0000 7f233f78d180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-08T18:29:19.239 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-05-08T18:29:19.237+0000 7f233f78d180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-08T18:29:19.302 INFO:tasks.ceph.mgr.y.smithi097.stderr:2024-05-08T18:29:19.304+0000 7f5931891180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-08T18:29:19.364 INFO:tasks.ceph.mgr.y.smithi097.stderr:2024-05-08T18:29:19.364+0000 7f5931891180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-08T18:29:19.530 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-05-08T18:29:19.529+0000 7f233f78d180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-08T18:29:19.592 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-05-08T18:29:19.593+0000 7f233f78d180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-08T18:29:20.404 INFO:tasks.ceph.mgr.y.smithi097.stderr:2024-05-08T18:29:20.408+0000 7f58d84d8640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-05-08T18:29:20.409 INFO:tasks.ceph.mgr.y.smithi097.stderr:2024-05-08T18:29:20.412+0000 7f58d84d8640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-05-08T18:29:21.188 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:29:21.188+0000 7ff86aced7c0 -1 osd.3 0 log_to_monitors true 2024-05-08T18:29:21.308 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:29:21.308+0000 7f626f0bf7c0 -1 osd.0 0 log_to_monitors true 2024-05-08T18:29:21.401 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:29:21.404+0000 7f0b21d437c0 -1 osd.2 0 log_to_monitors true 2024-05-08T18:29:21.525 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:29:21.528+0000 7f67edcbf7c0 -1 osd.1 0 log_to_monitors true 2024-05-08T18:29:21.575 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:29:21.573+0000 7fcf3e1e17c0 -1 osd.6 0 log_to_monitors true 2024-05-08T18:29:21.711 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:29:21.709+0000 7f19ae0c77c0 -1 osd.4 0 log_to_monitors true 2024-05-08T18:29:21.729 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:29:21.729+0000 7f5a63c217c0 -1 osd.7 0 log_to_monitors true 2024-05-08T18:29:21.742 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:29:21.741+0000 7f09064b27c0 -1 osd.5 0 log_to_monitors true 2024-05-08T18:29:23.979 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:29:23.980+0000 7ff8674a8640 -1 osd.3 0 waiting for initial osdmap 2024-05-08T18:29:23.982 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:29:23.984+0000 7f626b068640 -1 osd.0 0 waiting for initial osdmap 2024-05-08T18:29:24.083 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:29:24.084+0000 7ff85eaca640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T18:29:24.083 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:29:24.084+0000 7f6262e9c640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T18:29:24.778 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:29:24.780+0000 7f67e9c68640 -1 osd.1 0 waiting for initial osdmap 2024-05-08T18:29:24.801 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:29:24.804+0000 7f67e1a9c640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T18:29:24.809 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:29:24.812+0000 7f0b1dcec640 -1 osd.2 0 waiting for initial osdmap 2024-05-08T18:29:24.833 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:29:24.836+0000 7f0b15b20640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T18:29:25.191 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-08T18:29:25.499 INFO:teuthology.misc.health.smithi097.stdout: 2024-05-08T18:29:25.500 INFO:teuthology.misc.health.smithi097.stdout:{"epoch":14,"fsid":"f135278e-f589-4ad6-a830-fa767ff99171","created":"2024-05-08T18:29:14.813384+0000","modified":"2024-05-08T18:29:25.088775+0000","last_up_change":"2024-05-08T18:29:25.088775+0000","last_in_change":"2024-05-08T18:29:17.082151+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"f135796c-f80c-43a8-889d-e0927bcc3d0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2064534873},{"type":"v1","addr":"172.21.15.97:6801","nonce":2064534873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":2064534873},{"type":"v1","addr":"172.21.15.97:6803","nonce":2064534873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":2064534873},{"type":"v1","addr":"172.21.15.97:6807","nonce":2064534873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":2064534873},{"type":"v1","addr":"172.21.15.97:6805","nonce":2064534873}]},"public_addr":"172.21.15.97:6801/2064534873","cluster_addr":"172.21.15.97:6803/2064534873","heartbeat_back_addr":"172.21.15.97:6807/2064534873","heartbeat_front_addr":"172.21.15.97:6805/2064534873","state":["exists","up"]},{"osd":1,"uuid":"b91d895a-2b40-45c1-b355-52dba17032cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":34364184},{"type":"v1","addr":"172.21.15.97:6815","nonce":34364184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":34364184},{"type":"v1","addr":"172.21.15.97:6819","nonce":34364184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":34364184},{"type":"v1","addr":"172.21.15.97:6823","nonce":34364184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":34364184},{"type":"v1","addr":"172.21.15.97:6821","nonce":34364184}]},"public_addr":"172.21.15.97:6815/34364184","cluster_addr":"172.21.15.97:6819/34364184","heartbeat_back_addr":"172.21.15.97:6823/34364184","heartbeat_front_addr":"172.21.15.97:6821/34364184","state":["exists","up"]},{"osd":2,"uuid":"35f12106-8d9a-4dcb-a8bc-38e08c81bd5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":3004545111},{"type":"v1","addr":"172.21.15.97:6809","nonce":3004545111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":3004545111},{"type":"v1","addr":"172.21.15.97:6811","nonce":3004545111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3004545111},{"type":"v1","addr":"172.21.15.97:6817","nonce":3004545111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":3004545111},{"type":"v1","addr":"172.21.15.97:6814","nonce":3004545111}]},"public_addr":"172.21.15.97:6809/3004545111","cluster_addr":"172.21.15.97:6811/3004545111","heartbeat_back_addr":"172.21.15.97:6817/3004545111","heartbeat_front_addr":"172.21.15.97:6814/3004545111","state":["exists","up"]},{"osd":3,"uuid":"cd78d341-ec40-457e-a713-555b03bc9f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":1855786157},{"type":"v1","addr":"172.21.15.97:6825","nonce":1855786157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":1855786157},{"type":"v1","addr":"172.21.15.97:6827","nonce":1855786157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":1855786157},{"type":"v1","addr":"172.21.15.97:6831","nonce":1855786157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":1855786157},{"type":"v1","addr":"172.21.15.97:6829","nonce":1855786157}]},"public_addr":"172.21.15.97:6825/1855786157","cluster_addr":"172.21.15.97:6827/1855786157","heartbeat_back_addr":"172.21.15.97:6831/1855786157","heartbeat_front_addr":"172.21.15.97:6829/1855786157","state":["exists","up"]},{"osd":4,"uuid":"469d890e-5e0c-41cd-ac5b-ef987b70abd0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"dcb25c08-802c-4140-a3d2-929960319860","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"598ab572-7049-4600-9e91-1792360421d2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"c21805e0-4945-4efe-8e65-68bb92d30b69","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T18:29:25.517 DEBUG:teuthology.misc:4 of 8 OSDs are up 2024-05-08T18:29:25.625 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:29:25.625+0000 7fcf3a18a640 -1 osd.6 0 waiting for initial osdmap 2024-05-08T18:29:25.625 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:29:25.625+0000 7f5a603dc640 -1 osd.7 0 waiting for initial osdmap 2024-05-08T18:29:25.629 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:29:25.629+0000 7f19aa070640 -1 osd.4 0 waiting for initial osdmap 2024-05-08T18:29:25.636 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:29:25.637+0000 7f090245b640 -1 osd.5 0 waiting for initial osdmap 2024-05-08T18:29:25.644 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:29:25.645+0000 7fcf31fbe640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T18:29:25.648 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:29:25.649+0000 7f5a579fe640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T18:29:25.656 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:29:25.657+0000 7f08fa28f640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T18:29:25.664 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:29:25.665+0000 7f19a1ea4640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T18:29:32.324 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-08T18:29:32.623 INFO:teuthology.misc.health.smithi097.stdout: 2024-05-08T18:29:32.623 INFO:teuthology.misc.health.smithi097.stdout:{"epoch":17,"fsid":"f135278e-f589-4ad6-a830-fa767ff99171","created":"2024-05-08T18:29:14.813384+0000","modified":"2024-05-08T18:29:28.096260+0000","last_up_change":"2024-05-08T18:29:26.091102+0000","last_in_change":"2024-05-08T18:29:17.082151+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T18:29:25.443461+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f135796c-f80c-43a8-889d-e0927bcc3d0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2064534873},{"type":"v1","addr":"172.21.15.97:6801","nonce":2064534873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":2064534873},{"type":"v1","addr":"172.21.15.97:6803","nonce":2064534873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":2064534873},{"type":"v1","addr":"172.21.15.97:6807","nonce":2064534873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":2064534873},{"type":"v1","addr":"172.21.15.97:6805","nonce":2064534873}]},"public_addr":"172.21.15.97:6801/2064534873","cluster_addr":"172.21.15.97:6803/2064534873","heartbeat_back_addr":"172.21.15.97:6807/2064534873","heartbeat_front_addr":"172.21.15.97:6805/2064534873","state":["exists","up"]},{"osd":1,"uuid":"b91d895a-2b40-45c1-b355-52dba17032cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":34364184},{"type":"v1","addr":"172.21.15.97:6815","nonce":34364184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":34364184},{"type":"v1","addr":"172.21.15.97:6819","nonce":34364184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":34364184},{"type":"v1","addr":"172.21.15.97:6823","nonce":34364184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":34364184},{"type":"v1","addr":"172.21.15.97:6821","nonce":34364184}]},"public_addr":"172.21.15.97:6815/34364184","cluster_addr":"172.21.15.97:6819/34364184","heartbeat_back_addr":"172.21.15.97:6823/34364184","heartbeat_front_addr":"172.21.15.97:6821/34364184","state":["exists","up"]},{"osd":2,"uuid":"35f12106-8d9a-4dcb-a8bc-38e08c81bd5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":3004545111},{"type":"v1","addr":"172.21.15.97:6809","nonce":3004545111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":3004545111},{"type":"v1","addr":"172.21.15.97:6811","nonce":3004545111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3004545111},{"type":"v1","addr":"172.21.15.97:6817","nonce":3004545111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":3004545111},{"type":"v1","addr":"172.21.15.97:6814","nonce":3004545111}]},"public_addr":"172.21.15.97:6809/3004545111","cluster_addr":"172.21.15.97:6811/3004545111","heartbeat_back_addr":"172.21.15.97:6817/3004545111","heartbeat_front_addr":"172.21.15.97:6814/3004545111","state":["exists","up"]},{"osd":3,"uuid":"cd78d341-ec40-457e-a713-555b03bc9f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":1855786157},{"type":"v1","addr":"172.21.15.97:6825","nonce":1855786157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":1855786157},{"type":"v1","addr":"172.21.15.97:6827","nonce":1855786157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":1855786157},{"type":"v1","addr":"172.21.15.97:6831","nonce":1855786157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":1855786157},{"type":"v1","addr":"172.21.15.97:6829","nonce":1855786157}]},"public_addr":"172.21.15.97:6825/1855786157","cluster_addr":"172.21.15.97:6827/1855786157","heartbeat_back_addr":"172.21.15.97:6831/1855786157","heartbeat_front_addr":"172.21.15.97:6829/1855786157","state":["exists","up"]},{"osd":4,"uuid":"469d890e-5e0c-41cd-ac5b-ef987b70abd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":1246653692},{"type":"v1","addr":"172.21.15.151:6810","nonce":1246653692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":1246653692},{"type":"v1","addr":"172.21.15.151:6814","nonce":1246653692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":1246653692},{"type":"v1","addr":"172.21.15.151:6822","nonce":1246653692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":1246653692},{"type":"v1","addr":"172.21.15.151:6818","nonce":1246653692}]},"public_addr":"172.21.15.151:6810/1246653692","cluster_addr":"172.21.15.151:6814/1246653692","heartbeat_back_addr":"172.21.15.151:6822/1246653692","heartbeat_front_addr":"172.21.15.151:6818/1246653692","state":["exists","up"]},{"osd":5,"uuid":"dcb25c08-802c-4140-a3d2-929960319860","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":4257184226},{"type":"v1","addr":"172.21.15.151:6811","nonce":4257184226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6813","nonce":4257184226},{"type":"v1","addr":"172.21.15.151:6815","nonce":4257184226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6821","nonce":4257184226},{"type":"v1","addr":"172.21.15.151:6823","nonce":4257184226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6817","nonce":4257184226},{"type":"v1","addr":"172.21.15.151:6819","nonce":4257184226}]},"public_addr":"172.21.15.151:6811/4257184226","cluster_addr":"172.21.15.151:6815/4257184226","heartbeat_back_addr":"172.21.15.151:6823/4257184226","heartbeat_front_addr":"172.21.15.151:6819/4257184226","state":["exists","up"]},{"osd":6,"uuid":"598ab572-7049-4600-9e91-1792360421d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":974202886},{"type":"v1","addr":"172.21.15.151:6801","nonce":974202886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":974202886},{"type":"v1","addr":"172.21.15.151:6803","nonce":974202886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":974202886},{"type":"v1","addr":"172.21.15.151:6807","nonce":974202886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":974202886},{"type":"v1","addr":"172.21.15.151:6805","nonce":974202886}]},"public_addr":"172.21.15.151:6801/974202886","cluster_addr":"172.21.15.151:6803/974202886","heartbeat_back_addr":"172.21.15.151:6807/974202886","heartbeat_front_addr":"172.21.15.151:6805/974202886","state":["exists","up"]},{"osd":7,"uuid":"c21805e0-4945-4efe-8e65-68bb92d30b69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":2584927373},{"type":"v1","addr":"172.21.15.151:6825","nonce":2584927373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2584927373},{"type":"v1","addr":"172.21.15.151:6827","nonce":2584927373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2584927373},{"type":"v1","addr":"172.21.15.151:6831","nonce":2584927373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2584927373},{"type":"v1","addr":"172.21.15.151:6829","nonce":2584927373}]},"public_addr":"172.21.15.151:6825/2584927373","cluster_addr":"172.21.15.151:6827/2584927373","heartbeat_back_addr":"172.21.15.151:6831/2584927373","heartbeat_front_addr":"172.21.15.151:6829/2584927373","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:29:22.299407+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:29:22.487701+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:29:22.371789+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:29:22.160484+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:29:22.674077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:29:22.713456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:29:22.587563+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:29:22.751830+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T18:29:32.639 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-05-08T18:29:32.639 INFO:tasks.ceph:Creating RBD pool 2024-05-08T18:29:32.639 DEBUG:teuthology.orchestra.run.smithi097:> sudo ceph --cluster ceph osd pool create rbd 8 2024-05-08T18:29:33.472 INFO:teuthology.orchestra.run.smithi097.stderr:pool 'rbd' created 2024-05-08T18:29:33.494 DEBUG:teuthology.orchestra.run.smithi097:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-05-08T18:29:34.474 INFO:teuthology.orchestra.run.smithi097.stderr:enabled application 'rbd' on pool 'rbd' 2024-05-08T18:29:34.501 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-05-08T18:29:34.501 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-08T18:29:34.501 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-05-08T18:29:34.501 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-05-08T18:29:34.502 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-05-08T18:29:34.851 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-05-08T18:29:34.867 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":5,"flags":0,"active_gid":4107,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6832","nonce":1962499397},{"type":"v1","addr":"172.21.15.97:6833","nonce":1962499397}]},"active_addr":"172.21.15.97:6833/1962499397","active_change":"2024-05-08T18:29:19.391536+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4105,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.97:0","nonce":3889742086}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.97:0","nonce":2450111859}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.97:0","nonce":2134633589}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.97:0","nonce":1483100801}]}]} 2024-05-08T18:29:34.873 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-05-08T18:29:34.873 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-05-08T18:29:34.873 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T18:29:35.166 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-05-08T18:29:35.166 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":19,"fsid":"f135278e-f589-4ad6-a830-fa767ff99171","created":"2024-05-08T18:29:14.813384+0000","modified":"2024-05-08T18:29:34.470383+0000","last_up_change":"2024-05-08T18:29:26.091102+0000","last_in_change":"2024-05-08T18:29:17.082151+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T18:29:25.443461+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-05-08T18:29:32.943859+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f135796c-f80c-43a8-889d-e0927bcc3d0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2064534873},{"type":"v1","addr":"172.21.15.97:6801","nonce":2064534873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":2064534873},{"type":"v1","addr":"172.21.15.97:6803","nonce":2064534873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":2064534873},{"type":"v1","addr":"172.21.15.97:6807","nonce":2064534873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":2064534873},{"type":"v1","addr":"172.21.15.97:6805","nonce":2064534873}]},"public_addr":"172.21.15.97:6801/2064534873","cluster_addr":"172.21.15.97:6803/2064534873","heartbeat_back_addr":"172.21.15.97:6807/2064534873","heartbeat_front_addr":"172.21.15.97:6805/2064534873","state":["exists","up"]},{"osd":1,"uuid":"b91d895a-2b40-45c1-b355-52dba17032cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":34364184},{"type":"v1","addr":"172.21.15.97:6815","nonce":34364184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":34364184},{"type":"v1","addr":"172.21.15.97:6819","nonce":34364184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":34364184},{"type":"v1","addr":"172.21.15.97:6823","nonce":34364184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":34364184},{"type":"v1","addr":"172.21.15.97:6821","nonce":34364184}]},"public_addr":"172.21.15.97:6815/34364184","cluster_addr":"172.21.15.97:6819/34364184","heartbeat_back_addr":"172.21.15.97:6823/34364184","heartbeat_front_addr":"172.21.15.97:6821/34364184","state":["exists","up"]},{"osd":2,"uuid":"35f12106-8d9a-4dcb-a8bc-38e08c81bd5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":3004545111},{"type":"v1","addr":"172.21.15.97:6809","nonce":3004545111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":3004545111},{"type":"v1","addr":"172.21.15.97:6811","nonce":3004545111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3004545111},{"type":"v1","addr":"172.21.15.97:6817","nonce":3004545111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":3004545111},{"type":"v1","addr":"172.21.15.97:6814","nonce":3004545111}]},"public_addr":"172.21.15.97:6809/3004545111","cluster_addr":"172.21.15.97:6811/3004545111","heartbeat_back_addr":"172.21.15.97:6817/3004545111","heartbeat_front_addr":"172.21.15.97:6814/3004545111","state":["exists","up"]},{"osd":3,"uuid":"cd78d341-ec40-457e-a713-555b03bc9f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":1855786157},{"type":"v1","addr":"172.21.15.97:6825","nonce":1855786157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":1855786157},{"type":"v1","addr":"172.21.15.97:6827","nonce":1855786157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":1855786157},{"type":"v1","addr":"172.21.15.97:6831","nonce":1855786157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":1855786157},{"type":"v1","addr":"172.21.15.97:6829","nonce":1855786157}]},"public_addr":"172.21.15.97:6825/1855786157","cluster_addr":"172.21.15.97:6827/1855786157","heartbeat_back_addr":"172.21.15.97:6831/1855786157","heartbeat_front_addr":"172.21.15.97:6829/1855786157","state":["exists","up"]},{"osd":4,"uuid":"469d890e-5e0c-41cd-ac5b-ef987b70abd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":1246653692},{"type":"v1","addr":"172.21.15.151:6810","nonce":1246653692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":1246653692},{"type":"v1","addr":"172.21.15.151:6814","nonce":1246653692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":1246653692},{"type":"v1","addr":"172.21.15.151:6822","nonce":1246653692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":1246653692},{"type":"v1","addr":"172.21.15.151:6818","nonce":1246653692}]},"public_addr":"172.21.15.151:6810/1246653692","cluster_addr":"172.21.15.151:6814/1246653692","heartbeat_back_addr":"172.21.15.151:6822/1246653692","heartbeat_front_addr":"172.21.15.151:6818/1246653692","state":["exists","up"]},{"osd":5,"uuid":"dcb25c08-802c-4140-a3d2-929960319860","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":4257184226},{"type":"v1","addr":"172.21.15.151:6811","nonce":4257184226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6813","nonce":4257184226},{"type":"v1","addr":"172.21.15.151:6815","nonce":4257184226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6821","nonce":4257184226},{"type":"v1","addr":"172.21.15.151:6823","nonce":4257184226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6817","nonce":4257184226},{"type":"v1","addr":"172.21.15.151:6819","nonce":4257184226}]},"public_addr":"172.21.15.151:6811/4257184226","cluster_addr":"172.21.15.151:6815/4257184226","heartbeat_back_addr":"172.21.15.151:6823/4257184226","heartbeat_front_addr":"172.21.15.151:6819/4257184226","state":["exists","up"]},{"osd":6,"uuid":"598ab572-7049-4600-9e91-1792360421d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":974202886},{"type":"v1","addr":"172.21.15.151:6801","nonce":974202886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":974202886},{"type":"v1","addr":"172.21.15.151:6803","nonce":974202886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":974202886},{"type":"v1","addr":"172.21.15.151:6807","nonce":974202886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":974202886},{"type":"v1","addr":"172.21.15.151:6805","nonce":974202886}]},"public_addr":"172.21.15.151:6801/974202886","cluster_addr":"172.21.15.151:6803/974202886","heartbeat_back_addr":"172.21.15.151:6807/974202886","heartbeat_front_addr":"172.21.15.151:6805/974202886","state":["exists","up"]},{"osd":7,"uuid":"c21805e0-4945-4efe-8e65-68bb92d30b69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":2584927373},{"type":"v1","addr":"172.21.15.151:6825","nonce":2584927373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2584927373},{"type":"v1","addr":"172.21.15.151:6827","nonce":2584927373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2584927373},{"type":"v1","addr":"172.21.15.151:6831","nonce":2584927373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2584927373},{"type":"v1","addr":"172.21.15.151:6829","nonce":2584927373}]},"public_addr":"172.21.15.151:6825/2584927373","cluster_addr":"172.21.15.151:6827/2584927373","heartbeat_back_addr":"172.21.15.151:6831/2584927373","heartbeat_front_addr":"172.21.15.151:6829/2584927373","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:29:22.299407+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:29:22.487701+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:29:22.371789+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:29:22.160484+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:29:22.674077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:29:22.713456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:29:22.587563+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:29:22.751830+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T18:29:35.184 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-05-08T18:29:35.184 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T18:29:35.459 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-05-08T18:29:35.459 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":19,"fsid":"f135278e-f589-4ad6-a830-fa767ff99171","created":"2024-05-08T18:29:14.813384+0000","modified":"2024-05-08T18:29:34.470383+0000","last_up_change":"2024-05-08T18:29:26.091102+0000","last_in_change":"2024-05-08T18:29:17.082151+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T18:29:25.443461+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-05-08T18:29:32.943859+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f135796c-f80c-43a8-889d-e0927bcc3d0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2064534873},{"type":"v1","addr":"172.21.15.97:6801","nonce":2064534873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":2064534873},{"type":"v1","addr":"172.21.15.97:6803","nonce":2064534873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":2064534873},{"type":"v1","addr":"172.21.15.97:6807","nonce":2064534873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":2064534873},{"type":"v1","addr":"172.21.15.97:6805","nonce":2064534873}]},"public_addr":"172.21.15.97:6801/2064534873","cluster_addr":"172.21.15.97:6803/2064534873","heartbeat_back_addr":"172.21.15.97:6807/2064534873","heartbeat_front_addr":"172.21.15.97:6805/2064534873","state":["exists","up"]},{"osd":1,"uuid":"b91d895a-2b40-45c1-b355-52dba17032cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":34364184},{"type":"v1","addr":"172.21.15.97:6815","nonce":34364184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":34364184},{"type":"v1","addr":"172.21.15.97:6819","nonce":34364184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":34364184},{"type":"v1","addr":"172.21.15.97:6823","nonce":34364184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":34364184},{"type":"v1","addr":"172.21.15.97:6821","nonce":34364184}]},"public_addr":"172.21.15.97:6815/34364184","cluster_addr":"172.21.15.97:6819/34364184","heartbeat_back_addr":"172.21.15.97:6823/34364184","heartbeat_front_addr":"172.21.15.97:6821/34364184","state":["exists","up"]},{"osd":2,"uuid":"35f12106-8d9a-4dcb-a8bc-38e08c81bd5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":3004545111},{"type":"v1","addr":"172.21.15.97:6809","nonce":3004545111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":3004545111},{"type":"v1","addr":"172.21.15.97:6811","nonce":3004545111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3004545111},{"type":"v1","addr":"172.21.15.97:6817","nonce":3004545111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":3004545111},{"type":"v1","addr":"172.21.15.97:6814","nonce":3004545111}]},"public_addr":"172.21.15.97:6809/3004545111","cluster_addr":"172.21.15.97:6811/3004545111","heartbeat_back_addr":"172.21.15.97:6817/3004545111","heartbeat_front_addr":"172.21.15.97:6814/3004545111","state":["exists","up"]},{"osd":3,"uuid":"cd78d341-ec40-457e-a713-555b03bc9f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":1855786157},{"type":"v1","addr":"172.21.15.97:6825","nonce":1855786157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":1855786157},{"type":"v1","addr":"172.21.15.97:6827","nonce":1855786157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":1855786157},{"type":"v1","addr":"172.21.15.97:6831","nonce":1855786157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":1855786157},{"type":"v1","addr":"172.21.15.97:6829","nonce":1855786157}]},"public_addr":"172.21.15.97:6825/1855786157","cluster_addr":"172.21.15.97:6827/1855786157","heartbeat_back_addr":"172.21.15.97:6831/1855786157","heartbeat_front_addr":"172.21.15.97:6829/1855786157","state":["exists","up"]},{"osd":4,"uuid":"469d890e-5e0c-41cd-ac5b-ef987b70abd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":1246653692},{"type":"v1","addr":"172.21.15.151:6810","nonce":1246653692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":1246653692},{"type":"v1","addr":"172.21.15.151:6814","nonce":1246653692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":1246653692},{"type":"v1","addr":"172.21.15.151:6822","nonce":1246653692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":1246653692},{"type":"v1","addr":"172.21.15.151:6818","nonce":1246653692}]},"public_addr":"172.21.15.151:6810/1246653692","cluster_addr":"172.21.15.151:6814/1246653692","heartbeat_back_addr":"172.21.15.151:6822/1246653692","heartbeat_front_addr":"172.21.15.151:6818/1246653692","state":["exists","up"]},{"osd":5,"uuid":"dcb25c08-802c-4140-a3d2-929960319860","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":4257184226},{"type":"v1","addr":"172.21.15.151:6811","nonce":4257184226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6813","nonce":4257184226},{"type":"v1","addr":"172.21.15.151:6815","nonce":4257184226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6821","nonce":4257184226},{"type":"v1","addr":"172.21.15.151:6823","nonce":4257184226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6817","nonce":4257184226},{"type":"v1","addr":"172.21.15.151:6819","nonce":4257184226}]},"public_addr":"172.21.15.151:6811/4257184226","cluster_addr":"172.21.15.151:6815/4257184226","heartbeat_back_addr":"172.21.15.151:6823/4257184226","heartbeat_front_addr":"172.21.15.151:6819/4257184226","state":["exists","up"]},{"osd":6,"uuid":"598ab572-7049-4600-9e91-1792360421d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":974202886},{"type":"v1","addr":"172.21.15.151:6801","nonce":974202886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":974202886},{"type":"v1","addr":"172.21.15.151:6803","nonce":974202886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":974202886},{"type":"v1","addr":"172.21.15.151:6807","nonce":974202886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":974202886},{"type":"v1","addr":"172.21.15.151:6805","nonce":974202886}]},"public_addr":"172.21.15.151:6801/974202886","cluster_addr":"172.21.15.151:6803/974202886","heartbeat_back_addr":"172.21.15.151:6807/974202886","heartbeat_front_addr":"172.21.15.151:6805/974202886","state":["exists","up"]},{"osd":7,"uuid":"c21805e0-4945-4efe-8e65-68bb92d30b69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":2584927373},{"type":"v1","addr":"172.21.15.151:6825","nonce":2584927373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2584927373},{"type":"v1","addr":"172.21.15.151:6827","nonce":2584927373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2584927373},{"type":"v1","addr":"172.21.15.151:6831","nonce":2584927373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2584927373},{"type":"v1","addr":"172.21.15.151:6829","nonce":2584927373}]},"public_addr":"172.21.15.151:6825/2584927373","cluster_addr":"172.21.15.151:6827/2584927373","heartbeat_back_addr":"172.21.15.151:6831/2584927373","heartbeat_front_addr":"172.21.15.151:6829/2584927373","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:29:22.299407+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:29:22.487701+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:29:22.371789+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:29:22.160484+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:29:22.674077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:29:22.713456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:29:22.587563+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:29:22.751830+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T18:29:35.476 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-05-08T18:29:35.477 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-05-08T18:29:35.477 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-05-08T18:29:35.477 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-05-08T18:29:35.478 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-05-08T18:29:35.478 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-05-08T18:29:35.478 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-05-08T18:29:35.479 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-05-08T18:29:35.731 INFO:teuthology.orchestra.run.smithi097.stdout:60129542150 2024-05-08T18:29:35.731 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-08T18:29:35.741 INFO:teuthology.orchestra.run.smithi097.stdout:60129542148 2024-05-08T18:29:35.741 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-08T18:29:35.743 INFO:teuthology.orchestra.run.smithi097.stdout:64424509444 2024-05-08T18:29:35.744 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-08T18:29:35.751 INFO:teuthology.orchestra.run.smithi097.stdout:64424509446 2024-05-08T18:29:35.752 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-08T18:29:35.754 INFO:teuthology.orchestra.run.smithi097.stdout:60129542150 2024-05-08T18:29:35.755 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-08T18:29:35.756 INFO:teuthology.orchestra.run.smithi097.stdout:64424509444 2024-05-08T18:29:35.756 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-08T18:29:35.759 INFO:teuthology.orchestra.run.smithi097.stdout:60129542150 2024-05-08T18:29:35.759 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-08T18:29:35.761 INFO:teuthology.orchestra.run.smithi097.stdout:64424509446 2024-05-08T18:29:35.762 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-08T18:29:36.243 INFO:teuthology.orchestra.run.smithi097.stdout:60129542148 2024-05-08T18:29:36.250 INFO:teuthology.orchestra.run.smithi097.stdout:64424509445 2024-05-08T18:29:36.260 INFO:teuthology.orchestra.run.smithi097.stdout:60129542148 2024-05-08T18:29:36.268 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542148 for osd.0 2024-05-08T18:29:36.283 INFO:teuthology.orchestra.run.smithi097.stdout:64424509443 2024-05-08T18:29:36.286 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.6 2024-05-08T18:29:36.291 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542148 for osd.3 2024-05-08T18:29:36.295 INFO:teuthology.orchestra.run.smithi097.stdout:60129542146 2024-05-08T18:29:36.299 INFO:teuthology.orchestra.run.smithi097.stdout:64424509445 2024-05-08T18:29:36.300 INFO:teuthology.orchestra.run.smithi097.stdout:64424509443 2024-05-08T18:29:36.304 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509443 for osd.4 2024-05-08T18:29:36.313 INFO:teuthology.orchestra.run.smithi097.stdout:60129542148 2024-05-08T18:29:36.323 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509443 for osd.5 2024-05-08T18:29:36.327 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542146 for osd.1 2024-05-08T18:29:36.330 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.7 2024-05-08T18:29:36.333 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542148 for osd.2 2024-05-08T18:29:37.269 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-08T18:29:37.286 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-08T18:29:37.291 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-08T18:29:37.305 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-08T18:29:37.323 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-08T18:29:37.328 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-08T18:29:37.331 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-08T18:29:37.334 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-08T18:29:37.778 INFO:teuthology.orchestra.run.smithi097.stdout:60129542150 2024-05-08T18:29:37.799 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.0 2024-05-08T18:29:37.800 DEBUG:teuthology.parallel:result is None 2024-05-08T18:29:37.833 INFO:teuthology.orchestra.run.smithi097.stdout:64424509447 2024-05-08T18:29:37.845 INFO:teuthology.orchestra.run.smithi097.stdout:60129542150 2024-05-08T18:29:37.852 INFO:teuthology.orchestra.run.smithi097.stdout:64424509445 2024-05-08T18:29:37.854 INFO:teuthology.orchestra.run.smithi097.stdout:64424509447 2024-05-08T18:29:37.861 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509447 for osd.6 2024-05-08T18:29:37.861 DEBUG:teuthology.parallel:result is None 2024-05-08T18:29:37.861 INFO:teuthology.orchestra.run.smithi097.stdout:64424509445 2024-05-08T18:29:37.873 INFO:teuthology.orchestra.run.smithi097.stdout:60129542148 2024-05-08T18:29:37.878 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509447 for osd.7 2024-05-08T18:29:37.879 DEBUG:teuthology.parallel:result is None 2024-05-08T18:29:37.879 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.3 2024-05-08T18:29:37.879 DEBUG:teuthology.parallel:result is None 2024-05-08T18:29:37.885 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509445 for osd.4 2024-05-08T18:29:37.885 DEBUG:teuthology.parallel:result is None 2024-05-08T18:29:37.890 INFO:teuthology.orchestra.run.smithi097.stdout:60129542150 2024-05-08T18:29:37.894 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509445 for osd.5 2024-05-08T18:29:37.895 DEBUG:teuthology.parallel:result is None 2024-05-08T18:29:37.895 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542148 for osd.1 2024-05-08T18:29:37.895 DEBUG:teuthology.parallel:result is None 2024-05-08T18:29:37.907 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.2 2024-05-08T18:29:37.907 DEBUG:teuthology.parallel:result is None 2024-05-08T18:29:37.907 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-08T18:29:37.908 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T18:29:38.214 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-05-08T18:29:38.215 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2024-05-08T18:29:38.231 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2024-05-08T18:29:37.403913+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":218800,"kb_used_data":2624,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755920,"statfs":{"total":773094113280,"available":772870062080,"internally_reserved":0,"allocated":2686976,"data_stored":1663504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001060"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T18:29:35.618348+0000","last_change":"2024-05-08T18:29:34.493537+0000","last_active":"2024-05-08T18:29:35.618348+0000","last_peered":"2024-05-08T18:29:35.618348+0000","last_clean":"2024-05-08T18:29:35.618348+0000","last_became_active":"2024-05-08T18:29:34.492891+0000","last_became_peered":"2024-05-08T18:29:34.492891+0000","last_unstale":"2024-05-08T18:29:35.618348+0000","last_undegraded":"2024-05-08T18:29:35.618348+0000","last_fullsized":"2024-05-08T18:29:35.618348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:09:07.992256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T18:29:35.500980+0000","last_change":"2024-05-08T18:29:34.501273+0000","last_active":"2024-05-08T18:29:35.500980+0000","last_peered":"2024-05-08T18:29:35.500980+0000","last_clean":"2024-05-08T18:29:35.500980+0000","last_became_active":"2024-05-08T18:29:34.500933+0000","last_became_peered":"2024-05-08T18:29:34.500933+0000","last_unstale":"2024-05-08T18:29:35.500980+0000","last_undegraded":"2024-05-08T18:29:35.500980+0000","last_fullsized":"2024-05-08T18:29:35.500980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:35.917391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T18:29:35.618005+0000","last_change":"2024-05-08T18:29:34.603292+0000","last_active":"2024-05-08T18:29:35.618005+0000","last_peered":"2024-05-08T18:29:35.618005+0000","last_clean":"2024-05-08T18:29:35.618005+0000","last_became_active":"2024-05-08T18:29:34.602547+0000","last_became_peered":"2024-05-08T18:29:34.602547+0000","last_unstale":"2024-05-08T18:29:35.618005+0000","last_undegraded":"2024-05-08T18:29:35.618005+0000","last_fullsized":"2024-05-08T18:29:35.618005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:24:55.555475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T18:29:35.500834+0000","last_change":"2024-05-08T18:29:34.606393+0000","last_active":"2024-05-08T18:29:35.500834+0000","last_peered":"2024-05-08T18:29:35.500834+0000","last_clean":"2024-05-08T18:29:35.500834+0000","last_became_active":"2024-05-08T18:29:34.605574+0000","last_became_peered":"2024-05-08T18:29:34.605574+0000","last_unstale":"2024-05-08T18:29:35.500834+0000","last_undegraded":"2024-05-08T18:29:35.500834+0000","last_fullsized":"2024-05-08T18:29:35.500834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:55.793312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T18:29:35.617954+0000","last_change":"2024-05-08T18:29:34.496942+0000","last_active":"2024-05-08T18:29:35.617954+0000","last_peered":"2024-05-08T18:29:35.617954+0000","last_clean":"2024-05-08T18:29:35.617954+0000","last_became_active":"2024-05-08T18:29:34.495882+0000","last_became_peered":"2024-05-08T18:29:34.495882+0000","last_unstale":"2024-05-08T18:29:35.617954+0000","last_undegraded":"2024-05-08T18:29:35.617954+0000","last_fullsized":"2024-05-08T18:29:35.617954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:55.793312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T18:29:35.619851+0000","last_change":"2024-05-08T18:29:34.491071+0000","last_active":"2024-05-08T18:29:35.619851+0000","last_peered":"2024-05-08T18:29:35.619851+0000","last_clean":"2024-05-08T18:29:35.619851+0000","last_became_active":"2024-05-08T18:29:34.490717+0000","last_became_peered":"2024-05-08T18:29:34.490717+0000","last_unstale":"2024-05-08T18:29:35.619851+0000","last_undegraded":"2024-05-08T18:29:35.619851+0000","last_fullsized":"2024-05-08T18:29:35.619851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:55.793312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T18:29:35.617910+0000","last_change":"2024-05-08T18:29:34.497654+0000","last_active":"2024-05-08T18:29:35.617910+0000","last_peered":"2024-05-08T18:29:35.617910+0000","last_clean":"2024-05-08T18:29:35.617910+0000","last_became_active":"2024-05-08T18:29:34.495812+0000","last_became_peered":"2024-05-08T18:29:34.495812+0000","last_unstale":"2024-05-08T18:29:35.617910+0000","last_undegraded":"2024-05-08T18:29:35.617910+0000","last_fullsized":"2024-05-08T18:29:35.617910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:37:02.202613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T18:29:35.617853+0000","last_change":"2024-05-08T18:29:34.496467+0000","last_active":"2024-05-08T18:29:35.617853+0000","last_peered":"2024-05-08T18:29:35.617853+0000","last_clean":"2024-05-08T18:29:35.617853+0000","last_became_active":"2024-05-08T18:29:34.495632+0000","last_became_peered":"2024-05-08T18:29:34.495632+0000","last_unstale":"2024-05-08T18:29:35.617853+0000","last_undegraded":"2024-05-08T18:29:35.617853+0000","last_fullsized":"2024-05-08T18:29:35.617853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:35.917391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":108,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T18:29:35.618000+0000","last_change":"2024-05-08T18:29:27.115522+0000","last_active":"2024-05-08T18:29:35.618000+0000","last_peered":"2024-05-08T18:29:35.618000+0000","last_clean":"2024-05-08T18:29:35.618000+0000","last_became_active":"2024-05-08T18:29:27.112960+0000","last_became_peered":"2024-05-08T18:29:27.112960+0000","last_unstale":"2024-05-08T18:29:35.618000+0000","last_undegraded":"2024-05-08T18:29:35.618000+0000","last_fullsized":"2024-05-08T18:29:35.618000+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:26.091102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:26.091102+0000","last_clean_scrub_stamp":"2024-05-08T18:29:26.091102+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:09:50.296961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509447,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":790528,"data_stored":655025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509447,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":184320,"data_stored":58909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":184320,"data_stored":58909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27216,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":196608,"data_stored":64657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542150,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":184320,"data_stored":58909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":184320,"data_stored":58909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542148,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":184320,"data_stored":58909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27780,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344060,"statfs":{"total":96636764160,"available":96608317440,"internally_reserved":0,"allocated":778240,"data_stored":649277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T18:29:38.232 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T18:29:38.506 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-05-08T18:29:38.507 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2024-05-08T18:29:38.523 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2024-05-08T18:29:37.403913+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":218800,"kb_used_data":2624,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755920,"statfs":{"total":773094113280,"available":772870062080,"internally_reserved":0,"allocated":2686976,"data_stored":1663504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001060"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T18:29:35.618348+0000","last_change":"2024-05-08T18:29:34.493537+0000","last_active":"2024-05-08T18:29:35.618348+0000","last_peered":"2024-05-08T18:29:35.618348+0000","last_clean":"2024-05-08T18:29:35.618348+0000","last_became_active":"2024-05-08T18:29:34.492891+0000","last_became_peered":"2024-05-08T18:29:34.492891+0000","last_unstale":"2024-05-08T18:29:35.618348+0000","last_undegraded":"2024-05-08T18:29:35.618348+0000","last_fullsized":"2024-05-08T18:29:35.618348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:09:07.992256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T18:29:35.500980+0000","last_change":"2024-05-08T18:29:34.501273+0000","last_active":"2024-05-08T18:29:35.500980+0000","last_peered":"2024-05-08T18:29:35.500980+0000","last_clean":"2024-05-08T18:29:35.500980+0000","last_became_active":"2024-05-08T18:29:34.500933+0000","last_became_peered":"2024-05-08T18:29:34.500933+0000","last_unstale":"2024-05-08T18:29:35.500980+0000","last_undegraded":"2024-05-08T18:29:35.500980+0000","last_fullsized":"2024-05-08T18:29:35.500980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:35.917391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T18:29:35.618005+0000","last_change":"2024-05-08T18:29:34.603292+0000","last_active":"2024-05-08T18:29:35.618005+0000","last_peered":"2024-05-08T18:29:35.618005+0000","last_clean":"2024-05-08T18:29:35.618005+0000","last_became_active":"2024-05-08T18:29:34.602547+0000","last_became_peered":"2024-05-08T18:29:34.602547+0000","last_unstale":"2024-05-08T18:29:35.618005+0000","last_undegraded":"2024-05-08T18:29:35.618005+0000","last_fullsized":"2024-05-08T18:29:35.618005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:24:55.555475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T18:29:35.500834+0000","last_change":"2024-05-08T18:29:34.606393+0000","last_active":"2024-05-08T18:29:35.500834+0000","last_peered":"2024-05-08T18:29:35.500834+0000","last_clean":"2024-05-08T18:29:35.500834+0000","last_became_active":"2024-05-08T18:29:34.605574+0000","last_became_peered":"2024-05-08T18:29:34.605574+0000","last_unstale":"2024-05-08T18:29:35.500834+0000","last_undegraded":"2024-05-08T18:29:35.500834+0000","last_fullsized":"2024-05-08T18:29:35.500834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:55.793312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T18:29:35.617954+0000","last_change":"2024-05-08T18:29:34.496942+0000","last_active":"2024-05-08T18:29:35.617954+0000","last_peered":"2024-05-08T18:29:35.617954+0000","last_clean":"2024-05-08T18:29:35.617954+0000","last_became_active":"2024-05-08T18:29:34.495882+0000","last_became_peered":"2024-05-08T18:29:34.495882+0000","last_unstale":"2024-05-08T18:29:35.617954+0000","last_undegraded":"2024-05-08T18:29:35.617954+0000","last_fullsized":"2024-05-08T18:29:35.617954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:55.793312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T18:29:35.619851+0000","last_change":"2024-05-08T18:29:34.491071+0000","last_active":"2024-05-08T18:29:35.619851+0000","last_peered":"2024-05-08T18:29:35.619851+0000","last_clean":"2024-05-08T18:29:35.619851+0000","last_became_active":"2024-05-08T18:29:34.490717+0000","last_became_peered":"2024-05-08T18:29:34.490717+0000","last_unstale":"2024-05-08T18:29:35.619851+0000","last_undegraded":"2024-05-08T18:29:35.619851+0000","last_fullsized":"2024-05-08T18:29:35.619851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:55.793312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T18:29:35.617910+0000","last_change":"2024-05-08T18:29:34.497654+0000","last_active":"2024-05-08T18:29:35.617910+0000","last_peered":"2024-05-08T18:29:35.617910+0000","last_clean":"2024-05-08T18:29:35.617910+0000","last_became_active":"2024-05-08T18:29:34.495812+0000","last_became_peered":"2024-05-08T18:29:34.495812+0000","last_unstale":"2024-05-08T18:29:35.617910+0000","last_undegraded":"2024-05-08T18:29:35.617910+0000","last_fullsized":"2024-05-08T18:29:35.617910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:37:02.202613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T18:29:35.617853+0000","last_change":"2024-05-08T18:29:34.496467+0000","last_active":"2024-05-08T18:29:35.617853+0000","last_peered":"2024-05-08T18:29:35.617853+0000","last_clean":"2024-05-08T18:29:35.617853+0000","last_became_active":"2024-05-08T18:29:34.495632+0000","last_became_peered":"2024-05-08T18:29:34.495632+0000","last_unstale":"2024-05-08T18:29:35.617853+0000","last_undegraded":"2024-05-08T18:29:35.617853+0000","last_fullsized":"2024-05-08T18:29:35.617853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:35.917391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":108,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-08T18:29:35.618000+0000","last_change":"2024-05-08T18:29:27.115522+0000","last_active":"2024-05-08T18:29:35.618000+0000","last_peered":"2024-05-08T18:29:35.618000+0000","last_clean":"2024-05-08T18:29:35.618000+0000","last_became_active":"2024-05-08T18:29:27.112960+0000","last_became_peered":"2024-05-08T18:29:27.112960+0000","last_unstale":"2024-05-08T18:29:35.618000+0000","last_undegraded":"2024-05-08T18:29:35.618000+0000","last_fullsized":"2024-05-08T18:29:35.618000+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:26.091102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:26.091102+0000","last_clean_scrub_stamp":"2024-05-08T18:29:26.091102+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:09:50.296961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509447,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":790528,"data_stored":655025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509447,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":184320,"data_stored":58909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":184320,"data_stored":58909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27216,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":196608,"data_stored":64657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542150,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":184320,"data_stored":58909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":184320,"data_stored":58909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542148,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":184320,"data_stored":58909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27780,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344060,"statfs":{"total":96636764160,"available":96608317440,"internally_reserved":0,"allocated":778240,"data_stored":649277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T18:29:38.524 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-08T18:29:38.524 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-08T18:29:38.524 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-05-08T18:29:38.524 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-08T18:29:38.824 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-05-08T18:29:38.824 INFO:teuthology.orchestra.run.smithi097.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-08T18:29:38.841 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-05-08T18:29:38.841 INFO:teuthology.run_tasks:Running task rgw... 2024-05-08T18:29:38.857 DEBUG:tasks.rgw:config is {'client.0': None} 2024-05-08T18:29:38.857 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-05-08T18:29:38.857 INFO:tasks.rgw:Creating data pools 2024-05-08T18:29:38.857 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-05-08T18:29:38.857 DEBUG:teuthology.orchestra.run.smithi097:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster ceph 2024-05-08T18:29:39.513 INFO:teuthology.orchestra.run.smithi097.stderr:pool 'default.rgw.buckets.data' created 2024-05-08T18:29:39.546 DEBUG:teuthology.orchestra.run.smithi097:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-05-08T18:29:40.522 INFO:teuthology.orchestra.run.smithi097.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-05-08T18:29:40.567 DEBUG:teuthology.orchestra.run.smithi097:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-05-08T18:29:41.546 INFO:teuthology.orchestra.run.smithi097.stderr:pool 'default.rgw.buckets.index' created 2024-05-08T18:29:41.571 DEBUG:teuthology.orchestra.run.smithi097:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-05-08T18:29:42.544 INFO:teuthology.orchestra.run.smithi097.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-05-08T18:29:42.596 DEBUG:tasks.rgw:Pools created 2024-05-08T18:29:42.703 INFO:tasks.rgw:Starting rgw... 2024-05-08T18:29:42.703 INFO:tasks.rgw:rgw client.0 config is {} 2024-05-08T18:29:42.703 INFO:tasks.rgw:Using beast as radosgw frontend 2024-05-08T18:29:42.704 DEBUG:teuthology.orchestra.run.smithi097:> sudo echo -n http://smithi097.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-05-08T18:29:42.720 INFO:teuthology.orchestra.run.smithi097.stdout:http://smithi097.front.sepia.ceph.com:80 2024-05-08T18:29:42.721 DEBUG:teuthology.orchestra.run.smithi097:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-05-08T18:29:42.776 INFO:tasks.rgw.client.0:Restarting daemon 2024-05-08T18:29:42.776 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-05-08T18:29:42.822 INFO:tasks.rgw.client.0:Started 2024-05-08T18:29:42.822 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi097.front.sepia.ceph.com:80/ 2024-05-08T18:29:42.822 DEBUG:teuthology.orchestra.run.smithi097:> curl http://smithi097.front.sepia.ceph.com:80/ 2024-05-08T18:29:42.849 INFO:teuthology.orchestra.run.smithi097.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-05-08T18:29:42.849 INFO:teuthology.orchestra.run.smithi097.stderr: Dload Upload Total Spent Left Speed 2024-05-08T18:29:42.849 INFO:teuthology.orchestra.run.smithi097.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-05-08T18:29:42.850 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-05-08T18:29:42.850 INFO:teuthology.orchestra.run.smithi097.stderr:curl: (7) Failed to connect to smithi097.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-05-08T18:29:43.851 DEBUG:teuthology.orchestra.run.smithi097:> curl http://smithi097.front.sepia.ceph.com:80/ 2024-05-08T18:29:43.863 INFO:teuthology.orchestra.run.smithi097.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-05-08T18:29:43.863 INFO:teuthology.orchestra.run.smithi097.stderr: Dload Upload Total Spent Left Speed 2024-05-08T18:29:43.863 INFO:teuthology.orchestra.run.smithi097.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-05-08T18:29:43.863 INFO:teuthology.orchestra.run.smithi097.stderr:curl: (7) Failed to connect to smithi097.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-05-08T18:29:43.864 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-05-08T18:29:45.865 DEBUG:teuthology.orchestra.run.smithi097:> curl http://smithi097.front.sepia.ceph.com:80/ 2024-05-08T18:29:45.877 INFO:teuthology.orchestra.run.smithi097.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-05-08T18:29:45.877 INFO:teuthology.orchestra.run.smithi097.stderr: Dload Upload Total Spent Left Speed 2024-05-08T18:29:45.877 INFO:teuthology.orchestra.run.smithi097.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-05-08T18:29:45.877 INFO:teuthology.orchestra.run.smithi097.stderr:curl: (7) Failed to connect to smithi097.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-05-08T18:29:45.878 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-05-08T18:29:49.879 DEBUG:teuthology.orchestra.run.smithi097:> curl http://smithi097.front.sepia.ceph.com:80/ 2024-05-08T18:29:49.892 INFO:teuthology.orchestra.run.smithi097.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-05-08T18:29:49.892 INFO:teuthology.orchestra.run.smithi097.stderr: Dload Upload Total Spent Left Speed 2024-05-08T18:29:49.892 INFO:teuthology.orchestra.run.smithi097.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-05-08T18:29:49.892 INFO:teuthology.orchestra.run.smithi097.stderr:curl: (7) Failed to connect to smithi097.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-05-08T18:29:49.893 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-05-08T18:29:57.894 DEBUG:teuthology.orchestra.run.smithi097:> curl http://smithi097.front.sepia.ceph.com:80/ 2024-05-08T18:29:57.906 INFO:teuthology.orchestra.run.smithi097.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-05-08T18:29:57.906 INFO:teuthology.orchestra.run.smithi097.stderr: Dload Upload Total Spent Left Speed 2024-05-08T18:29:57.910 INFO:teuthology.orchestra.run.smithi097.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 59974 0 --:--:-- --:--:-- --:--:-- 62333 2024-05-08T18:29:57.910 INFO:teuthology.orchestra.run.smithi097.stdout:anonymous 2024-05-08T18:29:57.910 INFO:teuthology.run_tasks:Running task thrashosds... 2024-05-08T18:29:57.921 INFO:tasks.thrashosds:config is {'ceph_objectstore_tool': False, 'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'chance_test_min_size': 0, 'op_delay': 30, 'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-05-08T18:29:57.921 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'wip-eric-testing-1'}, 'ceph': {'conf': {'client': {'rgw relaxed s3 bucket names': True}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'sha1': '27d371685027569bcfa4efc661d3d3186f3a1776'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '27d371685027569bcfa4efc661d3d3186f3a1776'}}, 'rgw': {'frontend': 'beast'}, 's3tests': {'force-branch': 'ceph-master'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-eric-testing-1', 'sha1': '27d371685027569bcfa4efc661d3d3186f3a1776'}} 2024-05-08T18:29:57.921 INFO:tasks.thrashosds:config is {'ceph_objectstore_tool': False, 'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'chance_test_min_size': 0, 'op_delay': 30, 'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2024-05-08T18:29:57.922 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-05-08T18:29:58.280 INFO:tasks.thrashosds:Beginning thrashosds... 2024-05-08T18:29:58.281 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-08T18:29:58.281 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T18:29:58.598 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-05-08T18:29:58.605 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2024-05-08T18:29:58.610 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":42,"stamp":"2024-05-08T18:29:57.410321+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595683,"num_objects":194,"num_object_clones":0,"num_object_copies":388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":194,"num_whiteouts":0,"num_read":758,"num_read_kb":506,"num_write":528,"num_write_kb":1668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":481,"ondisk_log_size":481,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":228732,"kb_used_data":4264,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754745988,"statfs":{"total":773094113280,"available":772859891712,"internally_reserved":0,"allocated":4366336,"data_stored":2466206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":229756465},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3702,"num_objects":186,"num_object_clones":0,"num_object_copies":372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":186,"num_whiteouts":0,"num_read":688,"num_read_kb":447,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.772345"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.679147+0000","last_change":"2024-05-08T18:29:40.574221+0000","last_active":"2024-05-08T18:29:51.679147+0000","last_peered":"2024-05-08T18:29:51.679147+0000","last_clean":"2024-05-08T18:29:51.679147+0000","last_became_active":"2024-05-08T18:29:40.573543+0000","last_became_peered":"2024-05-08T18:29:40.573543+0000","last_unstale":"2024-05-08T18:29:51.679147+0000","last_undegraded":"2024-05-08T18:29:51.679147+0000","last_fullsized":"2024-05-08T18:29:51.679147+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:57.223609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.687586+0000","last_change":"2024-05-08T18:29:42.563773+0000","last_active":"2024-05-08T18:29:51.687586+0000","last_peered":"2024-05-08T18:29:51.687586+0000","last_clean":"2024-05-08T18:29:51.687586+0000","last_became_active":"2024-05-08T18:29:42.561201+0000","last_became_peered":"2024-05-08T18:29:42.561201+0000","last_unstale":"2024-05-08T18:29:51.687586+0000","last_undegraded":"2024-05-08T18:29:51.687586+0000","last_fullsized":"2024-05-08T18:29:51.687586+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:55.055481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.684938+0000","last_change":"2024-05-08T18:29:40.549299+0000","last_active":"2024-05-08T18:29:51.684938+0000","last_peered":"2024-05-08T18:29:51.684938+0000","last_clean":"2024-05-08T18:29:51.684938+0000","last_became_active":"2024-05-08T18:29:40.548930+0000","last_became_peered":"2024-05-08T18:29:40.548930+0000","last_unstale":"2024-05-08T18:29:51.684938+0000","last_undegraded":"2024-05-08T18:29:51.684938+0000","last_fullsized":"2024-05-08T18:29:51.684938+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:06:36.198647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.678031+0000","last_change":"2024-05-08T18:29:42.572074+0000","last_active":"2024-05-08T18:29:51.678031+0000","last_peered":"2024-05-08T18:29:51.678031+0000","last_clean":"2024-05-08T18:29:51.678031+0000","last_became_active":"2024-05-08T18:29:42.571344+0000","last_became_peered":"2024-05-08T18:29:42.571344+0000","last_unstale":"2024-05-08T18:29:51.678031+0000","last_undegraded":"2024-05-08T18:29:51.678031+0000","last_fullsized":"2024-05-08T18:29:51.678031+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:36.890277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.700274+0000","last_change":"2024-05-08T18:29:40.539048+0000","last_active":"2024-05-08T18:29:51.700274+0000","last_peered":"2024-05-08T18:29:51.700274+0000","last_clean":"2024-05-08T18:29:51.700274+0000","last_became_active":"2024-05-08T18:29:40.538458+0000","last_became_peered":"2024-05-08T18:29:40.538458+0000","last_unstale":"2024-05-08T18:29:51.700274+0000","last_undegraded":"2024-05-08T18:29:51.700274+0000","last_fullsized":"2024-05-08T18:29:51.700274+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:36:37.796095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.659507+0000","last_change":"2024-05-08T18:29:42.569718+0000","last_active":"2024-05-08T18:29:51.659507+0000","last_peered":"2024-05-08T18:29:51.659507+0000","last_clean":"2024-05-08T18:29:51.659507+0000","last_became_active":"2024-05-08T18:29:42.569026+0000","last_became_peered":"2024-05-08T18:29:42.569026+0000","last_unstale":"2024-05-08T18:29:51.659507+0000","last_undegraded":"2024-05-08T18:29:51.659507+0000","last_fullsized":"2024-05-08T18:29:51.659507+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:42.045615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.689623+0000","last_change":"2024-05-08T18:29:40.557700+0000","last_active":"2024-05-08T18:29:51.689623+0000","last_peered":"2024-05-08T18:29:51.689623+0000","last_clean":"2024-05-08T18:29:51.689623+0000","last_became_active":"2024-05-08T18:29:40.556884+0000","last_became_peered":"2024-05-08T18:29:40.556884+0000","last_unstale":"2024-05-08T18:29:51.689623+0000","last_undegraded":"2024-05-08T18:29:51.689623+0000","last_fullsized":"2024-05-08T18:29:51.689623+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:21:38.354933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.698939+0000","last_change":"2024-05-08T18:29:42.566448+0000","last_active":"2024-05-08T18:29:51.698939+0000","last_peered":"2024-05-08T18:29:51.698939+0000","last_clean":"2024-05-08T18:29:51.698939+0000","last_became_active":"2024-05-08T18:29:42.566058+0000","last_became_peered":"2024-05-08T18:29:42.566058+0000","last_unstale":"2024-05-08T18:29:51.698939+0000","last_undegraded":"2024-05-08T18:29:51.698939+0000","last_fullsized":"2024-05-08T18:29:51.698939+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:53:03.097704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.678413+0000","last_change":"2024-05-08T18:29:40.571195+0000","last_active":"2024-05-08T18:29:51.678413+0000","last_peered":"2024-05-08T18:29:51.678413+0000","last_clean":"2024-05-08T18:29:51.678413+0000","last_became_active":"2024-05-08T18:29:40.570467+0000","last_became_peered":"2024-05-08T18:29:40.570467+0000","last_unstale":"2024-05-08T18:29:51.678413+0000","last_undegraded":"2024-05-08T18:29:51.678413+0000","last_fullsized":"2024-05-08T18:29:51.678413+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:39.986094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.691921+0000","last_change":"2024-05-08T18:29:42.566506+0000","last_active":"2024-05-08T18:29:51.691921+0000","last_peered":"2024-05-08T18:29:51.691921+0000","last_clean":"2024-05-08T18:29:51.691921+0000","last_became_active":"2024-05-08T18:29:42.565740+0000","last_became_peered":"2024-05-08T18:29:42.565740+0000","last_unstale":"2024-05-08T18:29:51.691921+0000","last_undegraded":"2024-05-08T18:29:51.691921+0000","last_fullsized":"2024-05-08T18:29:51.691921+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:58.320701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.687750+0000","last_change":"2024-05-08T18:29:40.538314+0000","last_active":"2024-05-08T18:29:51.687750+0000","last_peered":"2024-05-08T18:29:51.687750+0000","last_clean":"2024-05-08T18:29:51.687750+0000","last_became_active":"2024-05-08T18:29:40.537458+0000","last_became_peered":"2024-05-08T18:29:40.537458+0000","last_unstale":"2024-05-08T18:29:51.687750+0000","last_undegraded":"2024-05-08T18:29:51.687750+0000","last_fullsized":"2024-05-08T18:29:51.687750+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:56.300986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.660630+0000","last_change":"2024-05-08T18:29:42.570054+0000","last_active":"2024-05-08T18:29:51.660630+0000","last_peered":"2024-05-08T18:29:51.660630+0000","last_clean":"2024-05-08T18:29:51.660630+0000","last_became_active":"2024-05-08T18:29:42.569255+0000","last_became_peered":"2024-05-08T18:29:42.569255+0000","last_unstale":"2024-05-08T18:29:51.660630+0000","last_undegraded":"2024-05-08T18:29:51.660630+0000","last_fullsized":"2024-05-08T18:29:51.660630+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:11:01.702482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.678305+0000","last_change":"2024-05-08T18:29:40.559212+0000","last_active":"2024-05-08T18:29:51.678305+0000","last_peered":"2024-05-08T18:29:51.678305+0000","last_clean":"2024-05-08T18:29:51.678305+0000","last_became_active":"2024-05-08T18:29:40.558501+0000","last_became_peered":"2024-05-08T18:29:40.558501+0000","last_unstale":"2024-05-08T18:29:51.678305+0000","last_undegraded":"2024-05-08T18:29:51.678305+0000","last_fullsized":"2024-05-08T18:29:51.678305+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:36:14.096907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.689961+0000","last_change":"2024-05-08T18:29:42.562084+0000","last_active":"2024-05-08T18:29:51.689961+0000","last_peered":"2024-05-08T18:29:51.689961+0000","last_clean":"2024-05-08T18:29:51.689961+0000","last_became_active":"2024-05-08T18:29:42.560699+0000","last_became_peered":"2024-05-08T18:29:42.560699+0000","last_unstale":"2024-05-08T18:29:51.689961+0000","last_undegraded":"2024-05-08T18:29:51.689961+0000","last_fullsized":"2024-05-08T18:29:51.689961+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:09.787597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.665563+0000","last_change":"2024-05-08T18:29:40.564339+0000","last_active":"2024-05-08T18:29:51.665563+0000","last_peered":"2024-05-08T18:29:51.665563+0000","last_clean":"2024-05-08T18:29:51.665563+0000","last_became_active":"2024-05-08T18:29:40.564038+0000","last_became_peered":"2024-05-08T18:29:40.564038+0000","last_unstale":"2024-05-08T18:29:51.665563+0000","last_undegraded":"2024-05-08T18:29:51.665563+0000","last_fullsized":"2024-05-08T18:29:51.665563+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:40:23.287885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.665702+0000","last_change":"2024-05-08T18:29:42.570253+0000","last_active":"2024-05-08T18:29:51.665702+0000","last_peered":"2024-05-08T18:29:51.665702+0000","last_clean":"2024-05-08T18:29:51.665702+0000","last_became_active":"2024-05-08T18:29:42.569917+0000","last_became_peered":"2024-05-08T18:29:42.569917+0000","last_unstale":"2024-05-08T18:29:51.665702+0000","last_undegraded":"2024-05-08T18:29:51.665702+0000","last_fullsized":"2024-05-08T18:29:51.665702+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:14:45.575219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.658773+0000","last_change":"2024-05-08T18:29:42.568116+0000","last_active":"2024-05-08T18:29:51.658773+0000","last_peered":"2024-05-08T18:29:51.658773+0000","last_clean":"2024-05-08T18:29:51.658773+0000","last_became_active":"2024-05-08T18:29:42.567399+0000","last_became_peered":"2024-05-08T18:29:42.567399+0000","last_unstale":"2024-05-08T18:29:51.658773+0000","last_undegraded":"2024-05-08T18:29:51.658773+0000","last_fullsized":"2024-05-08T18:29:51.658773+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:35.037465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.679262+0000","last_change":"2024-05-08T18:29:40.571982+0000","last_active":"2024-05-08T18:29:51.679262+0000","last_peered":"2024-05-08T18:29:51.679262+0000","last_clean":"2024-05-08T18:29:51.679262+0000","last_became_active":"2024-05-08T18:29:40.570600+0000","last_became_peered":"2024-05-08T18:29:40.570600+0000","last_unstale":"2024-05-08T18:29:51.679262+0000","last_undegraded":"2024-05-08T18:29:51.679262+0000","last_fullsized":"2024-05-08T18:29:51.679262+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:54:14.520118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.678165+0000","last_change":"2024-05-08T18:29:42.578449+0000","last_active":"2024-05-08T18:29:51.678165+0000","last_peered":"2024-05-08T18:29:51.678165+0000","last_clean":"2024-05-08T18:29:51.678165+0000","last_became_active":"2024-05-08T18:29:42.577789+0000","last_became_peered":"2024-05-08T18:29:42.577789+0000","last_unstale":"2024-05-08T18:29:51.678165+0000","last_undegraded":"2024-05-08T18:29:51.678165+0000","last_fullsized":"2024-05-08T18:29:51.678165+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:09.787597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.692940+0000","last_change":"2024-05-08T18:29:40.570618+0000","last_active":"2024-05-08T18:29:51.692940+0000","last_peered":"2024-05-08T18:29:51.692940+0000","last_clean":"2024-05-08T18:29:51.692940+0000","last_became_active":"2024-05-08T18:29:40.569519+0000","last_became_peered":"2024-05-08T18:29:40.569519+0000","last_unstale":"2024-05-08T18:29:51.692940+0000","last_undegraded":"2024-05-08T18:29:51.692940+0000","last_fullsized":"2024-05-08T18:29:51.692940+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:09:42.581976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.688118+0000","last_change":"2024-05-08T18:29:42.563056+0000","last_active":"2024-05-08T18:29:51.688118+0000","last_peered":"2024-05-08T18:29:51.688118+0000","last_clean":"2024-05-08T18:29:51.688118+0000","last_became_active":"2024-05-08T18:29:42.562296+0000","last_became_peered":"2024-05-08T18:29:42.562296+0000","last_unstale":"2024-05-08T18:29:51.688118+0000","last_undegraded":"2024-05-08T18:29:51.688118+0000","last_fullsized":"2024-05-08T18:29:51.688118+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:36.890277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.693134+0000","last_change":"2024-05-08T18:29:40.564353+0000","last_active":"2024-05-08T18:29:51.693134+0000","last_peered":"2024-05-08T18:29:51.693134+0000","last_clean":"2024-05-08T18:29:51.693134+0000","last_became_active":"2024-05-08T18:29:40.563516+0000","last_became_peered":"2024-05-08T18:29:40.563516+0000","last_unstale":"2024-05-08T18:29:51.693134+0000","last_undegraded":"2024-05-08T18:29:51.693134+0000","last_fullsized":"2024-05-08T18:29:51.693134+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:06:36.198647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.664096+0000","last_change":"2024-05-08T18:29:42.567006+0000","last_active":"2024-05-08T18:29:51.664096+0000","last_peered":"2024-05-08T18:29:51.664096+0000","last_clean":"2024-05-08T18:29:51.664096+0000","last_became_active":"2024-05-08T18:29:42.566256+0000","last_became_peered":"2024-05-08T18:29:42.566256+0000","last_unstale":"2024-05-08T18:29:51.664096+0000","last_undegraded":"2024-05-08T18:29:51.664096+0000","last_fullsized":"2024-05-08T18:29:51.664096+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:09:44.601690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.660037+0000","last_change":"2024-05-08T18:29:40.573212+0000","last_active":"2024-05-08T18:29:51.660037+0000","last_peered":"2024-05-08T18:29:51.660037+0000","last_clean":"2024-05-08T18:29:51.660037+0000","last_became_active":"2024-05-08T18:29:40.572250+0000","last_became_peered":"2024-05-08T18:29:40.572250+0000","last_unstale":"2024-05-08T18:29:51.660037+0000","last_undegraded":"2024-05-08T18:29:51.660037+0000","last_fullsized":"2024-05-08T18:29:51.660037+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:25:01.595224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.664865+0000","last_change":"2024-05-08T18:29:42.570847+0000","last_active":"2024-05-08T18:29:51.664865+0000","last_peered":"2024-05-08T18:29:51.664865+0000","last_clean":"2024-05-08T18:29:51.664865+0000","last_became_active":"2024-05-08T18:29:42.570435+0000","last_became_peered":"2024-05-08T18:29:42.570435+0000","last_unstale":"2024-05-08T18:29:51.664865+0000","last_undegraded":"2024-05-08T18:29:51.664865+0000","last_fullsized":"2024-05-08T18:29:51.664865+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:21:40.374647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.666544+0000","last_change":"2024-05-08T18:29:40.566815+0000","last_active":"2024-05-08T18:29:51.666544+0000","last_peered":"2024-05-08T18:29:51.666544+0000","last_clean":"2024-05-08T18:29:51.666544+0000","last_became_active":"2024-05-08T18:29:40.566531+0000","last_became_peered":"2024-05-08T18:29:40.566531+0000","last_unstale":"2024-05-08T18:29:51.666544+0000","last_undegraded":"2024-05-08T18:29:51.666544+0000","last_fullsized":"2024-05-08T18:29:51.666544+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:52.462279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.660765+0000","last_change":"2024-05-08T18:29:42.554846+0000","last_active":"2024-05-08T18:29:51.660765+0000","last_peered":"2024-05-08T18:29:51.660765+0000","last_clean":"2024-05-08T18:29:51.660765+0000","last_became_active":"2024-05-08T18:29:42.554115+0000","last_became_peered":"2024-05-08T18:29:42.554115+0000","last_unstale":"2024-05-08T18:29:51.660765+0000","last_undegraded":"2024-05-08T18:29:51.660765+0000","last_fullsized":"2024-05-08T18:29:51.660765+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:22:14.793035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.699171+0000","last_change":"2024-05-08T18:29:40.547776+0000","last_active":"2024-05-08T18:29:51.699171+0000","last_peered":"2024-05-08T18:29:51.699171+0000","last_clean":"2024-05-08T18:29:51.699171+0000","last_became_active":"2024-05-08T18:29:40.547384+0000","last_became_peered":"2024-05-08T18:29:40.547384+0000","last_unstale":"2024-05-08T18:29:51.699171+0000","last_undegraded":"2024-05-08T18:29:51.699171+0000","last_fullsized":"2024-05-08T18:29:51.699171+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:14:26.628603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.658464+0000","last_change":"2024-05-08T18:29:50.685390+0000","last_active":"2024-05-08T18:29:51.658464+0000","last_peered":"2024-05-08T18:29:51.658464+0000","last_clean":"2024-05-08T18:29:51.658464+0000","last_became_active":"2024-05-08T18:29:50.684644+0000","last_became_peered":"2024-05-08T18:29:50.684644+0000","last_unstale":"2024-05-08T18:29:51.658464+0000","last_undegraded":"2024-05-08T18:29:51.658464+0000","last_fullsized":"2024-05-08T18:29:51.658464+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:10:38.951662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.667450+0000","last_change":"2024-05-08T18:29:42.573805+0000","last_active":"2024-05-08T18:29:51.667450+0000","last_peered":"2024-05-08T18:29:51.667450+0000","last_clean":"2024-05-08T18:29:51.667450+0000","last_became_active":"2024-05-08T18:29:42.573296+0000","last_became_peered":"2024-05-08T18:29:42.573296+0000","last_unstale":"2024-05-08T18:29:51.667450+0000","last_undegraded":"2024-05-08T18:29:51.667450+0000","last_fullsized":"2024-05-08T18:29:51.667450+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:21.935293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.678686+0000","last_change":"2024-05-08T18:29:40.570733+0000","last_active":"2024-05-08T18:29:51.678686+0000","last_peered":"2024-05-08T18:29:51.678686+0000","last_clean":"2024-05-08T18:29:51.678686+0000","last_became_active":"2024-05-08T18:29:40.569711+0000","last_became_peered":"2024-05-08T18:29:40.569711+0000","last_unstale":"2024-05-08T18:29:51.678686+0000","last_undegraded":"2024-05-08T18:29:51.678686+0000","last_fullsized":"2024-05-08T18:29:51.678686+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:18:08.784274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.689464+0000","last_change":"2024-05-08T18:29:44.594185+0000","last_active":"2024-05-08T18:29:51.689464+0000","last_peered":"2024-05-08T18:29:51.689464+0000","last_clean":"2024-05-08T18:29:51.689464+0000","last_became_active":"2024-05-08T18:29:44.593442+0000","last_became_peered":"2024-05-08T18:29:44.593442+0000","last_unstale":"2024-05-08T18:29:51.689464+0000","last_undegraded":"2024-05-08T18:29:51.689464+0000","last_fullsized":"2024-05-08T18:29:51.689464+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:52:25.736491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"33'9","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:52.046689+0000","last_change":"2024-05-08T18:29:46.594652+0000","last_active":"2024-05-08T18:29:52.046689+0000","last_peered":"2024-05-08T18:29:52.046689+0000","last_clean":"2024-05-08T18:29:52.046689+0000","last_became_active":"2024-05-08T18:29:46.593656+0000","last_became_peered":"2024-05-08T18:29:46.593656+0000","last_unstale":"2024-05-08T18:29:52.046689+0000","last_undegraded":"2024-05-08T18:29:52.046689+0000","last_fullsized":"2024-05-08T18:29:52.046689+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:50:27.608888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.678824+0000","last_change":"2024-05-08T18:29:48.639834+0000","last_active":"2024-05-08T18:29:51.678824+0000","last_peered":"2024-05-08T18:29:51.678824+0000","last_clean":"2024-05-08T18:29:51.678824+0000","last_became_active":"2024-05-08T18:29:48.639122+0000","last_became_peered":"2024-05-08T18:29:48.639122+0000","last_unstale":"2024-05-08T18:29:51.678824+0000","last_undegraded":"2024-05-08T18:29:51.678824+0000","last_fullsized":"2024-05-08T18:29:51.678824+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:14:22.304773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.687191+0000","last_change":"2024-05-08T18:29:50.672303+0000","last_active":"2024-05-08T18:29:51.687191+0000","last_peered":"2024-05-08T18:29:51.687191+0000","last_clean":"2024-05-08T18:29:51.687191+0000","last_became_active":"2024-05-08T18:29:50.671513+0000","last_became_peered":"2024-05-08T18:29:50.671513+0000","last_unstale":"2024-05-08T18:29:51.687191+0000","last_undegraded":"2024-05-08T18:29:51.687191+0000","last_fullsized":"2024-05-08T18:29:51.687191+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:12:05.780786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.690047+0000","last_change":"2024-05-08T18:29:42.565462+0000","last_active":"2024-05-08T18:29:51.690047+0000","last_peered":"2024-05-08T18:29:51.690047+0000","last_clean":"2024-05-08T18:29:51.690047+0000","last_became_active":"2024-05-08T18:29:42.564741+0000","last_became_peered":"2024-05-08T18:29:42.564741+0000","last_unstale":"2024-05-08T18:29:51.690047+0000","last_undegraded":"2024-05-08T18:29:51.690047+0000","last_fullsized":"2024-05-08T18:29:51.690047+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:25:56.129785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.699171+0000","last_change":"2024-05-08T18:29:40.564796+0000","last_active":"2024-05-08T18:29:51.699171+0000","last_peered":"2024-05-08T18:29:51.699171+0000","last_clean":"2024-05-08T18:29:51.699171+0000","last_became_active":"2024-05-08T18:29:40.564401+0000","last_became_peered":"2024-05-08T18:29:40.564401+0000","last_unstale":"2024-05-08T18:29:51.699171+0000","last_undegraded":"2024-05-08T18:29:51.699171+0000","last_fullsized":"2024-05-08T18:29:51.699171+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:19:11.492397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.667149+0000","last_change":"2024-05-08T18:29:44.587689+0000","last_active":"2024-05-08T18:29:51.667149+0000","last_peered":"2024-05-08T18:29:51.667149+0000","last_clean":"2024-05-08T18:29:51.667149+0000","last_became_active":"2024-05-08T18:29:44.586975+0000","last_became_peered":"2024-05-08T18:29:44.586975+0000","last_unstale":"2024-05-08T18:29:51.667149+0000","last_undegraded":"2024-05-08T18:29:51.667149+0000","last_fullsized":"2024-05-08T18:29:51.667149+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:04:49.020450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"33'6","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:52.433021+0000","last_change":"2024-05-08T18:29:46.600906+0000","last_active":"2024-05-08T18:29:52.433021+0000","last_peered":"2024-05-08T18:29:52.433021+0000","last_clean":"2024-05-08T18:29:52.433021+0000","last_became_active":"2024-05-08T18:29:46.599894+0000","last_became_peered":"2024-05-08T18:29:46.599894+0000","last_unstale":"2024-05-08T18:29:52.433021+0000","last_undegraded":"2024-05-08T18:29:52.433021+0000","last_fullsized":"2024-05-08T18:29:52.433021+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:24:13.568294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.660322+0000","last_change":"2024-05-08T18:29:48.614324+0000","last_active":"2024-05-08T18:29:51.660322+0000","last_peered":"2024-05-08T18:29:51.660322+0000","last_clean":"2024-05-08T18:29:51.660322+0000","last_became_active":"2024-05-08T18:29:48.613591+0000","last_became_peered":"2024-05-08T18:29:48.613591+0000","last_unstale":"2024-05-08T18:29:51.660322+0000","last_undegraded":"2024-05-08T18:29:51.660322+0000","last_fullsized":"2024-05-08T18:29:51.660322+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:47:54.034851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.698697+0000","last_change":"2024-05-08T18:29:50.684773+0000","last_active":"2024-05-08T18:29:51.698697+0000","last_peered":"2024-05-08T18:29:51.698697+0000","last_clean":"2024-05-08T18:29:51.698697+0000","last_became_active":"2024-05-08T18:29:50.683931+0000","last_became_peered":"2024-05-08T18:29:50.683931+0000","last_unstale":"2024-05-08T18:29:51.698697+0000","last_undegraded":"2024-05-08T18:29:51.698697+0000","last_fullsized":"2024-05-08T18:29:51.698697+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:17:10.582636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.701405+0000","last_change":"2024-05-08T18:29:42.574437+0000","last_active":"2024-05-08T18:29:51.701405+0000","last_peered":"2024-05-08T18:29:51.701405+0000","last_clean":"2024-05-08T18:29:51.701405+0000","last_became_active":"2024-05-08T18:29:42.574146+0000","last_became_peered":"2024-05-08T18:29:42.574146+0000","last_unstale":"2024-05-08T18:29:51.701405+0000","last_undegraded":"2024-05-08T18:29:51.701405+0000","last_fullsized":"2024-05-08T18:29:51.701405+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:55:30.468069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.678602+0000","last_change":"2024-05-08T18:29:40.559677+0000","last_active":"2024-05-08T18:29:51.678602+0000","last_peered":"2024-05-08T18:29:51.678602+0000","last_clean":"2024-05-08T18:29:51.678602+0000","last_became_active":"2024-05-08T18:29:40.558819+0000","last_became_peered":"2024-05-08T18:29:40.558819+0000","last_unstale":"2024-05-08T18:29:51.678602+0000","last_undegraded":"2024-05-08T18:29:51.678602+0000","last_fullsized":"2024-05-08T18:29:51.678602+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:28.426657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.669523+0000","last_change":"2024-05-08T18:29:44.596801+0000","last_active":"2024-05-08T18:29:51.669523+0000","last_peered":"2024-05-08T18:29:51.669523+0000","last_clean":"2024-05-08T18:29:51.669523+0000","last_became_active":"2024-05-08T18:29:44.596111+0000","last_became_peered":"2024-05-08T18:29:44.596111+0000","last_unstale":"2024-05-08T18:29:51.669523+0000","last_undegraded":"2024-05-08T18:29:51.669523+0000","last_fullsized":"2024-05-08T18:29:51.669523+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:04.423266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"33'10","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:52.487689+0000","last_change":"2024-05-08T18:29:46.608330+0000","last_active":"2024-05-08T18:29:52.487689+0000","last_peered":"2024-05-08T18:29:52.487689+0000","last_clean":"2024-05-08T18:29:52.487689+0000","last_became_active":"2024-05-08T18:29:46.607580+0000","last_became_peered":"2024-05-08T18:29:46.607580+0000","last_unstale":"2024-05-08T18:29:52.487689+0000","last_undegraded":"2024-05-08T18:29:52.487689+0000","last_fullsized":"2024-05-08T18:29:52.487689+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:22:18.837103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"30'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.678878+0000","last_change":"2024-05-08T18:29:48.642718+0000","last_active":"2024-05-08T18:29:51.678878+0000","last_peered":"2024-05-08T18:29:51.678878+0000","last_clean":"2024-05-08T18:29:51.678878+0000","last_became_active":"2024-05-08T18:29:48.641950+0000","last_became_peered":"2024-05-08T18:29:48.641950+0000","last_unstale":"2024-05-08T18:29:51.678878+0000","last_undegraded":"2024-05-08T18:29:51.678878+0000","last_fullsized":"2024-05-08T18:29:51.678878+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:00:11.720096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.659694+0000","last_change":"2024-05-08T18:29:50.660378+0000","last_active":"2024-05-08T18:29:51.659694+0000","last_peered":"2024-05-08T18:29:51.659694+0000","last_clean":"2024-05-08T18:29:51.659694+0000","last_became_active":"2024-05-08T18:29:50.659649+0000","last_became_peered":"2024-05-08T18:29:50.659649+0000","last_unstale":"2024-05-08T18:29:51.659694+0000","last_undegraded":"2024-05-08T18:29:51.659694+0000","last_fullsized":"2024-05-08T18:29:51.659694+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:34:14.488295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.668605+0000","last_change":"2024-05-08T18:29:42.577267+0000","last_active":"2024-05-08T18:29:51.668605+0000","last_peered":"2024-05-08T18:29:51.668605+0000","last_clean":"2024-05-08T18:29:51.668605+0000","last_became_active":"2024-05-08T18:29:42.576740+0000","last_became_peered":"2024-05-08T18:29:42.576740+0000","last_unstale":"2024-05-08T18:29:51.668605+0000","last_undegraded":"2024-05-08T18:29:51.668605+0000","last_fullsized":"2024-05-08T18:29:51.668605+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:57:14.869860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.691119+0000","last_change":"2024-05-08T18:29:40.547524+0000","last_active":"2024-05-08T18:29:51.691119+0000","last_peered":"2024-05-08T18:29:51.691119+0000","last_clean":"2024-05-08T18:29:51.691119+0000","last_became_active":"2024-05-08T18:29:40.545749+0000","last_became_peered":"2024-05-08T18:29:40.545749+0000","last_unstale":"2024-05-08T18:29:51.691119+0000","last_undegraded":"2024-05-08T18:29:51.691119+0000","last_fullsized":"2024-05-08T18:29:51.691119+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:12:59.146887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.689728+0000","last_change":"2024-05-08T18:29:44.579839+0000","last_active":"2024-05-08T18:29:51.689728+0000","last_peered":"2024-05-08T18:29:51.689728+0000","last_clean":"2024-05-08T18:29:51.689728+0000","last_became_active":"2024-05-08T18:29:44.578142+0000","last_became_peered":"2024-05-08T18:29:44.578142+0000","last_unstale":"2024-05-08T18:29:51.689728+0000","last_undegraded":"2024-05-08T18:29:51.689728+0000","last_fullsized":"2024-05-08T18:29:51.689728+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:51:09.413191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"33'9","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:52.491036+0000","last_change":"2024-05-08T18:29:46.607288+0000","last_active":"2024-05-08T18:29:52.491036+0000","last_peered":"2024-05-08T18:29:52.491036+0000","last_clean":"2024-05-08T18:29:52.491036+0000","last_became_active":"2024-05-08T18:29:46.605154+0000","last_became_peered":"2024-05-08T18:29:46.605154+0000","last_unstale":"2024-05-08T18:29:52.491036+0000","last_undegraded":"2024-05-08T18:29:52.491036+0000","last_fullsized":"2024-05-08T18:29:52.491036+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:23.940519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"30'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.666879+0000","last_change":"2024-05-08T18:29:48.634956+0000","last_active":"2024-05-08T18:29:51.666879+0000","last_peered":"2024-05-08T18:29:51.666879+0000","last_clean":"2024-05-08T18:29:51.666879+0000","last_became_active":"2024-05-08T18:29:48.633858+0000","last_became_peered":"2024-05-08T18:29:48.633858+0000","last_unstale":"2024-05-08T18:29:51.666879+0000","last_undegraded":"2024-05-08T18:29:51.666879+0000","last_fullsized":"2024-05-08T18:29:51.666879+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:50:48.169666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.688193+0000","last_change":"2024-05-08T18:29:42.567744+0000","last_active":"2024-05-08T18:29:51.688193+0000","last_peered":"2024-05-08T18:29:51.688193+0000","last_clean":"2024-05-08T18:29:51.688193+0000","last_became_active":"2024-05-08T18:29:42.566974+0000","last_became_peered":"2024-05-08T18:29:42.566974+0000","last_unstale":"2024-05-08T18:29:51.688193+0000","last_undegraded":"2024-05-08T18:29:51.688193+0000","last_fullsized":"2024-05-08T18:29:51.688193+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:42.045615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.679445+0000","last_change":"2024-05-08T18:29:40.572499+0000","last_active":"2024-05-08T18:29:51.679445+0000","last_peered":"2024-05-08T18:29:51.679445+0000","last_clean":"2024-05-08T18:29:51.679445+0000","last_became_active":"2024-05-08T18:29:40.571322+0000","last_became_peered":"2024-05-08T18:29:40.571322+0000","last_unstale":"2024-05-08T18:29:51.679445+0000","last_undegraded":"2024-05-08T18:29:51.679445+0000","last_fullsized":"2024-05-08T18:29:51.679445+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:31.119374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.677434+0000","last_change":"2024-05-08T18:29:44.597045+0000","last_active":"2024-05-08T18:29:51.677434+0000","last_peered":"2024-05-08T18:29:51.677434+0000","last_clean":"2024-05-08T18:29:51.677434+0000","last_became_active":"2024-05-08T18:29:44.596282+0000","last_became_peered":"2024-05-08T18:29:44.596282+0000","last_unstale":"2024-05-08T18:29:51.677434+0000","last_undegraded":"2024-05-08T18:29:51.677434+0000","last_fullsized":"2024-05-08T18:29:51.677434+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:35:51.288126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"33'19","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:52.592635+0000","last_change":"2024-05-08T18:29:46.590633+0000","last_active":"2024-05-08T18:29:52.592635+0000","last_peered":"2024-05-08T18:29:52.592635+0000","last_clean":"2024-05-08T18:29:52.592635+0000","last_became_active":"2024-05-08T18:29:46.589600+0000","last_became_peered":"2024-05-08T18:29:46.589600+0000","last_unstale":"2024-05-08T18:29:52.592635+0000","last_undegraded":"2024-05-08T18:29:52.592635+0000","last_fullsized":"2024-05-08T18:29:52.592635+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:23.940519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.683895+0000","last_change":"2024-05-08T18:29:48.630758+0000","last_active":"2024-05-08T18:29:51.683895+0000","last_peered":"2024-05-08T18:29:51.683895+0000","last_clean":"2024-05-08T18:29:51.683895+0000","last_became_active":"2024-05-08T18:29:48.630017+0000","last_became_peered":"2024-05-08T18:29:48.630017+0000","last_unstale":"2024-05-08T18:29:51.683895+0000","last_undegraded":"2024-05-08T18:29:51.683895+0000","last_fullsized":"2024-05-08T18:29:51.683895+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:39.879384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.689337+0000","last_change":"2024-05-08T18:29:50.672682+0000","last_active":"2024-05-08T18:29:51.689337+0000","last_peered":"2024-05-08T18:29:51.689337+0000","last_clean":"2024-05-08T18:29:51.689337+0000","last_became_active":"2024-05-08T18:29:50.671923+0000","last_became_peered":"2024-05-08T18:29:50.671923+0000","last_unstale":"2024-05-08T18:29:51.689337+0000","last_undegraded":"2024-05-08T18:29:51.689337+0000","last_fullsized":"2024-05-08T18:29:51.689337+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:38.318890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.658929+0000","last_change":"2024-05-08T18:29:42.554289+0000","last_active":"2024-05-08T18:29:51.658929+0000","last_peered":"2024-05-08T18:29:51.658929+0000","last_clean":"2024-05-08T18:29:51.658929+0000","last_became_active":"2024-05-08T18:29:42.553574+0000","last_became_peered":"2024-05-08T18:29:42.553574+0000","last_unstale":"2024-05-08T18:29:51.658929+0000","last_undegraded":"2024-05-08T18:29:51.658929+0000","last_fullsized":"2024-05-08T18:29:51.658929+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:42.005809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.679397+0000","last_change":"2024-05-08T18:29:40.570169+0000","last_active":"2024-05-08T18:29:51.679397+0000","last_peered":"2024-05-08T18:29:51.679397+0000","last_clean":"2024-05-08T18:29:51.679397+0000","last_became_active":"2024-05-08T18:29:40.569542+0000","last_became_peered":"2024-05-08T18:29:40.569542+0000","last_unstale":"2024-05-08T18:29:51.679397+0000","last_undegraded":"2024-05-08T18:29:51.679397+0000","last_fullsized":"2024-05-08T18:29:51.679397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:08:13.006752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"26'1","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.661881+0000","last_change":"2024-05-08T18:29:44.579659+0000","last_active":"2024-05-08T18:29:51.661881+0000","last_peered":"2024-05-08T18:29:51.661881+0000","last_clean":"2024-05-08T18:29:51.661881+0000","last_became_active":"2024-05-08T18:29:44.579152+0000","last_became_peered":"2024-05-08T18:29:44.579152+0000","last_unstale":"2024-05-08T18:29:51.661881+0000","last_undegraded":"2024-05-08T18:29:51.661881+0000","last_fullsized":"2024-05-08T18:29:51.661881+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:15:00.358583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"33'9","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:52.467870+0000","last_change":"2024-05-08T18:29:46.600224+0000","last_active":"2024-05-08T18:29:52.467870+0000","last_peered":"2024-05-08T18:29:52.467870+0000","last_clean":"2024-05-08T18:29:52.467870+0000","last_became_active":"2024-05-08T18:29:46.599464+0000","last_became_peered":"2024-05-08T18:29:46.599464+0000","last_unstale":"2024-05-08T18:29:52.467870+0000","last_undegraded":"2024-05-08T18:29:52.467870+0000","last_fullsized":"2024-05-08T18:29:52.467870+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:26:40.238188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.663479+0000","last_change":"2024-05-08T18:29:48.637939+0000","last_active":"2024-05-08T18:29:51.663479+0000","last_peered":"2024-05-08T18:29:51.663479+0000","last_clean":"2024-05-08T18:29:51.663479+0000","last_became_active":"2024-05-08T18:29:48.637231+0000","last_became_peered":"2024-05-08T18:29:48.637231+0000","last_unstale":"2024-05-08T18:29:51.663479+0000","last_undegraded":"2024-05-08T18:29:51.663479+0000","last_fullsized":"2024-05-08T18:29:51.663479+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:04.571608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.692655+0000","last_change":"2024-05-08T18:29:50.681831+0000","last_active":"2024-05-08T18:29:51.692655+0000","last_peered":"2024-05-08T18:29:51.692655+0000","last_clean":"2024-05-08T18:29:51.692655+0000","last_became_active":"2024-05-08T18:29:50.681287+0000","last_became_peered":"2024-05-08T18:29:50.681287+0000","last_unstale":"2024-05-08T18:29:51.692655+0000","last_undegraded":"2024-05-08T18:29:51.692655+0000","last_fullsized":"2024-05-08T18:29:51.692655+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:30:24.111488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.692241+0000","last_change":"2024-05-08T18:29:42.562975+0000","last_active":"2024-05-08T18:29:51.692241+0000","last_peered":"2024-05-08T18:29:51.692241+0000","last_clean":"2024-05-08T18:29:51.692241+0000","last_became_active":"2024-05-08T18:29:42.562267+0000","last_became_peered":"2024-05-08T18:29:42.562267+0000","last_unstale":"2024-05-08T18:29:51.692241+0000","last_undegraded":"2024-05-08T18:29:51.692241+0000","last_fullsized":"2024-05-08T18:29:51.692241+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:30.446371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.679564+0000","last_change":"2024-05-08T18:29:40.570736+0000","last_active":"2024-05-08T18:29:51.679564+0000","last_peered":"2024-05-08T18:29:51.679564+0000","last_clean":"2024-05-08T18:29:51.679564+0000","last_became_active":"2024-05-08T18:29:40.569626+0000","last_became_peered":"2024-05-08T18:29:40.569626+0000","last_unstale":"2024-05-08T18:29:51.679564+0000","last_undegraded":"2024-05-08T18:29:51.679564+0000","last_fullsized":"2024-05-08T18:29:51.679564+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:56.300986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"26'1","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.664872+0000","last_change":"2024-05-08T18:29:44.581748+0000","last_active":"2024-05-08T18:29:51.664872+0000","last_peered":"2024-05-08T18:29:51.664872+0000","last_clean":"2024-05-08T18:29:51.664872+0000","last_became_active":"2024-05-08T18:29:44.581067+0000","last_became_peered":"2024-05-08T18:29:44.581067+0000","last_unstale":"2024-05-08T18:29:51.664872+0000","last_undegraded":"2024-05-08T18:29:51.664872+0000","last_fullsized":"2024-05-08T18:29:51.664872+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:44.043691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"33'15","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:52.385307+0000","last_change":"2024-05-08T18:29:46.605887+0000","last_active":"2024-05-08T18:29:52.385307+0000","last_peered":"2024-05-08T18:29:52.385307+0000","last_clean":"2024-05-08T18:29:52.385307+0000","last_became_active":"2024-05-08T18:29:46.604966+0000","last_became_peered":"2024-05-08T18:29:46.604966+0000","last_unstale":"2024-05-08T18:29:52.385307+0000","last_undegraded":"2024-05-08T18:29:52.385307+0000","last_fullsized":"2024-05-08T18:29:52.385307+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:07:54.654205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"30'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.698173+0000","last_change":"2024-05-08T18:29:48.638657+0000","last_active":"2024-05-08T18:29:51.698173+0000","last_peered":"2024-05-08T18:29:51.698173+0000","last_clean":"2024-05-08T18:29:51.698173+0000","last_became_active":"2024-05-08T18:29:48.637758+0000","last_became_peered":"2024-05-08T18:29:48.637758+0000","last_unstale":"2024-05-08T18:29:51.698173+0000","last_undegraded":"2024-05-08T18:29:51.698173+0000","last_fullsized":"2024-05-08T18:29:51.698173+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:45:24.153991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.700588+0000","last_change":"2024-05-08T18:29:50.684501+0000","last_active":"2024-05-08T18:29:51.700588+0000","last_peered":"2024-05-08T18:29:51.700588+0000","last_clean":"2024-05-08T18:29:51.700588+0000","last_became_active":"2024-05-08T18:29:50.683738+0000","last_became_peered":"2024-05-08T18:29:50.683738+0000","last_unstale":"2024-05-08T18:29:51.700588+0000","last_undegraded":"2024-05-08T18:29:51.700588+0000","last_fullsized":"2024-05-08T18:29:51.700588+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:22.834262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.699926+0000","last_change":"2024-05-08T18:29:42.569401+0000","last_active":"2024-05-08T18:29:51.699926+0000","last_peered":"2024-05-08T18:29:51.699926+0000","last_clean":"2024-05-08T18:29:51.699926+0000","last_became_active":"2024-05-08T18:29:42.568659+0000","last_became_peered":"2024-05-08T18:29:42.568659+0000","last_unstale":"2024-05-08T18:29:51.699926+0000","last_undegraded":"2024-05-08T18:29:51.699926+0000","last_fullsized":"2024-05-08T18:29:51.699926+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:35:23.016110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.689971+0000","last_change":"2024-05-08T18:29:40.557076+0000","last_active":"2024-05-08T18:29:51.689971+0000","last_peered":"2024-05-08T18:29:51.689971+0000","last_clean":"2024-05-08T18:29:51.689971+0000","last_became_active":"2024-05-08T18:29:40.555805+0000","last_became_peered":"2024-05-08T18:29:40.555805+0000","last_unstale":"2024-05-08T18:29:51.689971+0000","last_undegraded":"2024-05-08T18:29:51.689971+0000","last_fullsized":"2024-05-08T18:29:51.689971+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:13.946346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.662878+0000","last_change":"2024-05-08T18:29:44.573892+0000","last_active":"2024-05-08T18:29:51.662878+0000","last_peered":"2024-05-08T18:29:51.662878+0000","last_clean":"2024-05-08T18:29:51.662878+0000","last_became_active":"2024-05-08T18:29:44.573308+0000","last_became_peered":"2024-05-08T18:29:44.573308+0000","last_unstale":"2024-05-08T18:29:51.662878+0000","last_undegraded":"2024-05-08T18:29:51.662878+0000","last_fullsized":"2024-05-08T18:29:51.662878+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:37.075348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"33'12","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:52.010416+0000","last_change":"2024-05-08T18:29:46.595585+0000","last_active":"2024-05-08T18:29:52.010416+0000","last_peered":"2024-05-08T18:29:52.010416+0000","last_clean":"2024-05-08T18:29:52.010416+0000","last_became_active":"2024-05-08T18:29:46.594930+0000","last_became_peered":"2024-05-08T18:29:46.594930+0000","last_unstale":"2024-05-08T18:29:52.010416+0000","last_undegraded":"2024-05-08T18:29:52.010416+0000","last_fullsized":"2024-05-08T18:29:52.010416+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:11.768269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.661714+0000","last_change":"2024-05-08T18:29:48.638137+0000","last_active":"2024-05-08T18:29:51.661714+0000","last_peered":"2024-05-08T18:29:51.661714+0000","last_clean":"2024-05-08T18:29:51.661714+0000","last_became_active":"2024-05-08T18:29:48.637370+0000","last_became_peered":"2024-05-08T18:29:48.637370+0000","last_unstale":"2024-05-08T18:29:51.661714+0000","last_undegraded":"2024-05-08T18:29:51.661714+0000","last_fullsized":"2024-05-08T18:29:51.661714+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:15.859849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.684330+0000","last_change":"2024-05-08T18:29:50.688760+0000","last_active":"2024-05-08T18:29:51.684330+0000","last_peered":"2024-05-08T18:29:51.684330+0000","last_clean":"2024-05-08T18:29:51.684330+0000","last_became_active":"2024-05-08T18:29:50.687960+0000","last_became_peered":"2024-05-08T18:29:50.687960+0000","last_unstale":"2024-05-08T18:29:51.684330+0000","last_undegraded":"2024-05-08T18:29:51.684330+0000","last_fullsized":"2024-05-08T18:29:51.684330+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:21:19.624895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.660650+0000","last_change":"2024-05-08T18:29:42.557850+0000","last_active":"2024-05-08T18:29:51.660650+0000","last_peered":"2024-05-08T18:29:51.660650+0000","last_clean":"2024-05-08T18:29:51.660650+0000","last_became_active":"2024-05-08T18:29:42.557119+0000","last_became_peered":"2024-05-08T18:29:42.557119+0000","last_unstale":"2024-05-08T18:29:51.660650+0000","last_undegraded":"2024-05-08T18:29:51.660650+0000","last_fullsized":"2024-05-08T18:29:51.660650+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:25:56.129785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.666074+0000","last_change":"2024-05-08T18:29:40.544530+0000","last_active":"2024-05-08T18:29:51.666074+0000","last_peered":"2024-05-08T18:29:51.666074+0000","last_clean":"2024-05-08T18:29:51.666074+0000","last_became_active":"2024-05-08T18:29:40.544215+0000","last_became_peered":"2024-05-08T18:29:40.544215+0000","last_unstale":"2024-05-08T18:29:51.666074+0000","last_undegraded":"2024-05-08T18:29:51.666074+0000","last_fullsized":"2024-05-08T18:29:51.666074+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:14:26.628603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.664300+0000","last_change":"2024-05-08T18:29:44.588227+0000","last_active":"2024-05-08T18:29:51.664300+0000","last_peered":"2024-05-08T18:29:51.664300+0000","last_clean":"2024-05-08T18:29:51.664300+0000","last_became_active":"2024-05-08T18:29:44.587822+0000","last_became_peered":"2024-05-08T18:29:44.587822+0000","last_unstale":"2024-05-08T18:29:51.664300+0000","last_undegraded":"2024-05-08T18:29:51.664300+0000","last_fullsized":"2024-05-08T18:29:51.664300+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:18:12.841872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"33'11","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:52.528486+0000","last_change":"2024-05-08T18:29:46.603563+0000","last_active":"2024-05-08T18:29:52.528486+0000","last_peered":"2024-05-08T18:29:52.528486+0000","last_clean":"2024-05-08T18:29:52.528486+0000","last_became_active":"2024-05-08T18:29:46.602801+0000","last_became_peered":"2024-05-08T18:29:46.602801+0000","last_unstale":"2024-05-08T18:29:52.528486+0000","last_undegraded":"2024-05-08T18:29:52.528486+0000","last_fullsized":"2024-05-08T18:29:52.528486+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:22:36.338527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.700870+0000","last_change":"2024-05-08T18:29:48.642806+0000","last_active":"2024-05-08T18:29:51.700870+0000","last_peered":"2024-05-08T18:29:51.700870+0000","last_clean":"2024-05-08T18:29:51.700870+0000","last_became_active":"2024-05-08T18:29:48.641813+0000","last_became_peered":"2024-05-08T18:29:48.641813+0000","last_unstale":"2024-05-08T18:29:51.700870+0000","last_undegraded":"2024-05-08T18:29:51.700870+0000","last_fullsized":"2024-05-08T18:29:51.700870+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:50:48.169666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.663138+0000","last_change":"2024-05-08T18:29:50.689819+0000","last_active":"2024-05-08T18:29:51.663138+0000","last_peered":"2024-05-08T18:29:51.663138+0000","last_clean":"2024-05-08T18:29:51.663138+0000","last_became_active":"2024-05-08T18:29:50.686739+0000","last_became_peered":"2024-05-08T18:29:50.686739+0000","last_unstale":"2024-05-08T18:29:51.663138+0000","last_undegraded":"2024-05-08T18:29:51.663138+0000","last_fullsized":"2024-05-08T18:29:51.663138+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:45:34.171402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.660871+0000","last_change":"2024-05-08T18:29:42.552388+0000","last_active":"2024-05-08T18:29:51.660871+0000","last_peered":"2024-05-08T18:29:51.660871+0000","last_clean":"2024-05-08T18:29:51.660871+0000","last_became_active":"2024-05-08T18:29:42.551647+0000","last_became_peered":"2024-05-08T18:29:42.551647+0000","last_unstale":"2024-05-08T18:29:51.660871+0000","last_undegraded":"2024-05-08T18:29:51.660871+0000","last_fullsized":"2024-05-08T18:29:51.660871+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:55.055481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.692401+0000","last_change":"2024-05-08T18:29:40.562946+0000","last_active":"2024-05-08T18:29:51.692401+0000","last_peered":"2024-05-08T18:29:51.692401+0000","last_clean":"2024-05-08T18:29:51.692401+0000","last_became_active":"2024-05-08T18:29:40.550942+0000","last_became_peered":"2024-05-08T18:29:40.550942+0000","last_unstale":"2024-05-08T18:29:51.692401+0000","last_undegraded":"2024-05-08T18:29:51.692401+0000","last_fullsized":"2024-05-08T18:29:51.692401+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:22.579629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.683968+0000","last_change":"2024-05-08T18:29:44.593681+0000","last_active":"2024-05-08T18:29:51.683968+0000","last_peered":"2024-05-08T18:29:51.683968+0000","last_clean":"2024-05-08T18:29:51.683968+0000","last_became_active":"2024-05-08T18:29:44.593242+0000","last_became_peered":"2024-05-08T18:29:44.593242+0000","last_unstale":"2024-05-08T18:29:51.683968+0000","last_undegraded":"2024-05-08T18:29:51.683968+0000","last_fullsized":"2024-05-08T18:29:51.683968+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:57.093364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"33'15","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:52.602698+0000","last_change":"2024-05-08T18:29:46.589514+0000","last_active":"2024-05-08T18:29:52.602698+0000","last_peered":"2024-05-08T18:29:52.602698+0000","last_clean":"2024-05-08T18:29:52.602698+0000","last_became_active":"2024-05-08T18:29:46.588784+0000","last_became_peered":"2024-05-08T18:29:46.588784+0000","last_unstale":"2024-05-08T18:29:52.602698+0000","last_undegraded":"2024-05-08T18:29:52.602698+0000","last_fullsized":"2024-05-08T18:29:52.602698+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:02:30.355168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"30'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.666286+0000","last_change":"2024-05-08T18:29:48.631007+0000","last_active":"2024-05-08T18:29:51.666286+0000","last_peered":"2024-05-08T18:29:51.666286+0000","last_clean":"2024-05-08T18:29:51.666286+0000","last_became_active":"2024-05-08T18:29:48.630229+0000","last_became_peered":"2024-05-08T18:29:48.630229+0000","last_unstale":"2024-05-08T18:29:51.666286+0000","last_undegraded":"2024-05-08T18:29:51.666286+0000","last_fullsized":"2024-05-08T18:29:51.666286+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:44:03.778419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.683829+0000","last_change":"2024-05-08T18:29:50.675105+0000","last_active":"2024-05-08T18:29:51.683829+0000","last_peered":"2024-05-08T18:29:51.683829+0000","last_clean":"2024-05-08T18:29:51.683829+0000","last_became_active":"2024-05-08T18:29:50.674292+0000","last_became_peered":"2024-05-08T18:29:50.674292+0000","last_unstale":"2024-05-08T18:29:51.683829+0000","last_undegraded":"2024-05-08T18:29:51.683829+0000","last_fullsized":"2024-05-08T18:29:51.683829+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:47:15.423647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.661400+0000","last_change":"2024-05-08T18:29:42.579707+0000","last_active":"2024-05-08T18:29:51.661400+0000","last_peered":"2024-05-08T18:29:51.661400+0000","last_clean":"2024-05-08T18:29:51.661400+0000","last_became_active":"2024-05-08T18:29:42.579059+0000","last_became_peered":"2024-05-08T18:29:42.579059+0000","last_unstale":"2024-05-08T18:29:51.661400+0000","last_undegraded":"2024-05-08T18:29:51.661400+0000","last_fullsized":"2024-05-08T18:29:51.661400+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:09.787597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.659549+0000","last_change":"2024-05-08T18:29:40.555327+0000","last_active":"2024-05-08T18:29:51.659549+0000","last_peered":"2024-05-08T18:29:51.659549+0000","last_clean":"2024-05-08T18:29:51.659549+0000","last_became_active":"2024-05-08T18:29:40.554594+0000","last_became_peered":"2024-05-08T18:29:40.554594+0000","last_unstale":"2024-05-08T18:29:51.659549+0000","last_undegraded":"2024-05-08T18:29:51.659549+0000","last_fullsized":"2024-05-08T18:29:51.659549+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:19.841114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"26'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.690483+0000","last_change":"2024-05-08T18:29:44.582434+0000","last_active":"2024-05-08T18:29:51.690483+0000","last_peered":"2024-05-08T18:29:51.690483+0000","last_clean":"2024-05-08T18:29:51.690483+0000","last_became_active":"2024-05-08T18:29:44.581699+0000","last_became_peered":"2024-05-08T18:29:44.581699+0000","last_unstale":"2024-05-08T18:29:51.690483+0000","last_undegraded":"2024-05-08T18:29:51.690483+0000","last_fullsized":"2024-05-08T18:29:51.690483+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:19:29.113643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"33'10","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:52.395752+0000","last_change":"2024-05-08T18:29:46.590860+0000","last_active":"2024-05-08T18:29:52.395752+0000","last_peered":"2024-05-08T18:29:52.395752+0000","last_clean":"2024-05-08T18:29:52.395752+0000","last_became_active":"2024-05-08T18:29:46.590087+0000","last_became_peered":"2024-05-08T18:29:46.590087+0000","last_unstale":"2024-05-08T18:29:52.395752+0000","last_undegraded":"2024-05-08T18:29:52.395752+0000","last_fullsized":"2024-05-08T18:29:52.395752+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:19:58.358449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"30'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.692675+0000","last_change":"2024-05-08T18:29:48.635548+0000","last_active":"2024-05-08T18:29:51.692675+0000","last_peered":"2024-05-08T18:29:51.692675+0000","last_clean":"2024-05-08T18:29:51.692675+0000","last_became_active":"2024-05-08T18:29:48.634801+0000","last_became_peered":"2024-05-08T18:29:48.634801+0000","last_unstale":"2024-05-08T18:29:51.692675+0000","last_undegraded":"2024-05-08T18:29:51.692675+0000","last_fullsized":"2024-05-08T18:29:51.692675+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:04:20.128031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.659664+0000","last_change":"2024-05-08T18:29:50.668279+0000","last_active":"2024-05-08T18:29:51.659664+0000","last_peered":"2024-05-08T18:29:51.659664+0000","last_clean":"2024-05-08T18:29:51.659664+0000","last_became_active":"2024-05-08T18:29:50.667536+0000","last_became_peered":"2024-05-08T18:29:50.667536+0000","last_unstale":"2024-05-08T18:29:51.659664+0000","last_undegraded":"2024-05-08T18:29:51.659664+0000","last_fullsized":"2024-05-08T18:29:51.659664+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:12:05.780786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.684931+0000","last_change":"2024-05-08T18:29:42.563807+0000","last_active":"2024-05-08T18:29:51.684931+0000","last_peered":"2024-05-08T18:29:51.684931+0000","last_clean":"2024-05-08T18:29:51.684931+0000","last_became_active":"2024-05-08T18:29:42.563416+0000","last_became_peered":"2024-05-08T18:29:42.563416+0000","last_unstale":"2024-05-08T18:29:51.684931+0000","last_undegraded":"2024-05-08T18:29:51.684931+0000","last_fullsized":"2024-05-08T18:29:51.684931+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:18:10.803989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.665801+0000","last_change":"2024-05-08T18:29:40.548898+0000","last_active":"2024-05-08T18:29:51.665801+0000","last_peered":"2024-05-08T18:29:51.665801+0000","last_clean":"2024-05-08T18:29:51.665801+0000","last_became_active":"2024-05-08T18:29:40.548591+0000","last_became_peered":"2024-05-08T18:29:40.548591+0000","last_unstale":"2024-05-08T18:29:51.665801+0000","last_undegraded":"2024-05-08T18:29:51.665801+0000","last_fullsized":"2024-05-08T18:29:51.665801+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:27:41.414153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.661213+0000","last_change":"2024-05-08T18:29:44.582578+0000","last_active":"2024-05-08T18:29:51.661213+0000","last_peered":"2024-05-08T18:29:51.661213+0000","last_clean":"2024-05-08T18:29:51.661213+0000","last_became_active":"2024-05-08T18:29:44.581832+0000","last_became_peered":"2024-05-08T18:29:44.581832+0000","last_unstale":"2024-05-08T18:29:51.661213+0000","last_undegraded":"2024-05-08T18:29:51.661213+0000","last_fullsized":"2024-05-08T18:29:51.661213+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:52:25.736491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"33'17","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:52.520380+0000","last_change":"2024-05-08T18:29:46.602459+0000","last_active":"2024-05-08T18:29:52.520380+0000","last_peered":"2024-05-08T18:29:52.520380+0000","last_clean":"2024-05-08T18:29:52.520380+0000","last_became_active":"2024-05-08T18:29:46.601740+0000","last_became_peered":"2024-05-08T18:29:46.601740+0000","last_unstale":"2024-05-08T18:29:52.520380+0000","last_undegraded":"2024-05-08T18:29:52.520380+0000","last_fullsized":"2024-05-08T18:29:52.520380+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:58:31.293922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.691378+0000","last_change":"2024-05-08T18:29:48.640046+0000","last_active":"2024-05-08T18:29:51.691378+0000","last_peered":"2024-05-08T18:29:51.691378+0000","last_clean":"2024-05-08T18:29:51.691378+0000","last_became_active":"2024-05-08T18:29:48.639309+0000","last_became_peered":"2024-05-08T18:29:48.639309+0000","last_unstale":"2024-05-08T18:29:51.691378+0000","last_undegraded":"2024-05-08T18:29:51.691378+0000","last_fullsized":"2024-05-08T18:29:51.691378+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:10.533065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.683663+0000","last_change":"2024-05-08T18:29:50.668361+0000","last_active":"2024-05-08T18:29:51.683663+0000","last_peered":"2024-05-08T18:29:51.683663+0000","last_clean":"2024-05-08T18:29:51.683663+0000","last_became_active":"2024-05-08T18:29:50.667636+0000","last_became_peered":"2024-05-08T18:29:50.667636+0000","last_unstale":"2024-05-08T18:29:51.683663+0000","last_undegraded":"2024-05-08T18:29:51.683663+0000","last_fullsized":"2024-05-08T18:29:51.683663+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:58:35.356885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.692973+0000","last_change":"2024-05-08T18:29:42.584098+0000","last_active":"2024-05-08T18:29:51.692973+0000","last_peered":"2024-05-08T18:29:51.692973+0000","last_clean":"2024-05-08T18:29:51.692973+0000","last_became_active":"2024-05-08T18:29:42.583639+0000","last_became_peered":"2024-05-08T18:29:42.583639+0000","last_unstale":"2024-05-08T18:29:51.692973+0000","last_undegraded":"2024-05-08T18:29:51.692973+0000","last_fullsized":"2024-05-08T18:29:51.692973+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:08:15.026467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":134,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.677714+0000","last_change":"2024-05-08T18:29:27.115522+0000","last_active":"2024-05-08T18:29:51.677714+0000","last_peered":"2024-05-08T18:29:51.677714+0000","last_clean":"2024-05-08T18:29:51.677714+0000","last_became_active":"2024-05-08T18:29:27.112960+0000","last_became_peered":"2024-05-08T18:29:27.112960+0000","last_unstale":"2024-05-08T18:29:51.677714+0000","last_undegraded":"2024-05-08T18:29:51.677714+0000","last_fullsized":"2024-05-08T18:29:51.677714+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:26.091102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:26.091102+0000","last_clean_scrub_stamp":"2024-05-08T18:29:26.091102+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:09:50.296961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.689688+0000","last_change":"2024-05-08T18:29:34.496467+0000","last_active":"2024-05-08T18:29:51.689688+0000","last_peered":"2024-05-08T18:29:51.689688+0000","last_clean":"2024-05-08T18:29:51.689688+0000","last_became_active":"2024-05-08T18:29:34.495632+0000","last_became_peered":"2024-05-08T18:29:34.495632+0000","last_unstale":"2024-05-08T18:29:51.689688+0000","last_undegraded":"2024-05-08T18:29:51.689688+0000","last_fullsized":"2024-05-08T18:29:51.689688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:35.917391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.664397+0000","last_change":"2024-05-08T18:29:40.559945+0000","last_active":"2024-05-08T18:29:51.664397+0000","last_peered":"2024-05-08T18:29:51.664397+0000","last_clean":"2024-05-08T18:29:51.664397+0000","last_became_active":"2024-05-08T18:29:40.559723+0000","last_became_peered":"2024-05-08T18:29:40.559723+0000","last_unstale":"2024-05-08T18:29:51.664397+0000","last_undegraded":"2024-05-08T18:29:51.664397+0000","last_fullsized":"2024-05-08T18:29:51.664397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:39:17.879068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.678273+0000","last_change":"2024-05-08T18:29:44.592445+0000","last_active":"2024-05-08T18:29:51.678273+0000","last_peered":"2024-05-08T18:29:51.678273+0000","last_clean":"2024-05-08T18:29:51.678273+0000","last_became_active":"2024-05-08T18:29:44.587855+0000","last_became_peered":"2024-05-08T18:29:44.587855+0000","last_unstale":"2024-05-08T18:29:51.678273+0000","last_undegraded":"2024-05-08T18:29:51.678273+0000","last_fullsized":"2024-05-08T18:29:51.678273+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:06:05.355648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"33'13","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:52.321389+0000","last_change":"2024-05-08T18:29:46.595394+0000","last_active":"2024-05-08T18:29:52.321389+0000","last_peered":"2024-05-08T18:29:52.321389+0000","last_clean":"2024-05-08T18:29:52.321389+0000","last_became_active":"2024-05-08T18:29:46.594573+0000","last_became_peered":"2024-05-08T18:29:46.594573+0000","last_unstale":"2024-05-08T18:29:52.321389+0000","last_undegraded":"2024-05-08T18:29:52.321389+0000","last_fullsized":"2024-05-08T18:29:52.321389+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:47:11.360684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.700698+0000","last_change":"2024-05-08T18:29:48.632178+0000","last_active":"2024-05-08T18:29:51.700698+0000","last_peered":"2024-05-08T18:29:51.700698+0000","last_clean":"2024-05-08T18:29:51.700698+0000","last_became_active":"2024-05-08T18:29:48.631481+0000","last_became_peered":"2024-05-08T18:29:48.631481+0000","last_unstale":"2024-05-08T18:29:51.700698+0000","last_undegraded":"2024-05-08T18:29:51.700698+0000","last_fullsized":"2024-05-08T18:29:51.700698+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:34.806539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.690891+0000","last_change":"2024-05-08T18:29:50.675319+0000","last_active":"2024-05-08T18:29:51.690891+0000","last_peered":"2024-05-08T18:29:51.690891+0000","last_clean":"2024-05-08T18:29:51.690891+0000","last_became_active":"2024-05-08T18:29:50.674526+0000","last_became_peered":"2024-05-08T18:29:50.674526+0000","last_unstale":"2024-05-08T18:29:51.690891+0000","last_undegraded":"2024-05-08T18:29:51.690891+0000","last_fullsized":"2024-05-08T18:29:51.690891+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:59:06.404586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.701152+0000","last_change":"2024-05-08T18:29:42.568584+0000","last_active":"2024-05-08T18:29:51.701152+0000","last_peered":"2024-05-08T18:29:51.701152+0000","last_clean":"2024-05-08T18:29:51.701152+0000","last_became_active":"2024-05-08T18:29:42.568244+0000","last_became_peered":"2024-05-08T18:29:42.568244+0000","last_unstale":"2024-05-08T18:29:51.701152+0000","last_undegraded":"2024-05-08T18:29:51.701152+0000","last_fullsized":"2024-05-08T18:29:51.701152+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:20.397730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.677423+0000","last_change":"2024-05-08T18:29:34.497654+0000","last_active":"2024-05-08T18:29:51.677423+0000","last_peered":"2024-05-08T18:29:51.677423+0000","last_clean":"2024-05-08T18:29:51.677423+0000","last_became_active":"2024-05-08T18:29:34.495812+0000","last_became_peered":"2024-05-08T18:29:34.495812+0000","last_unstale":"2024-05-08T18:29:51.677423+0000","last_undegraded":"2024-05-08T18:29:51.677423+0000","last_fullsized":"2024-05-08T18:29:51.677423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:37:02.202613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.698554+0000","last_change":"2024-05-08T18:29:40.560653+0000","last_active":"2024-05-08T18:29:51.698554+0000","last_peered":"2024-05-08T18:29:51.698554+0000","last_clean":"2024-05-08T18:29:51.698554+0000","last_became_active":"2024-05-08T18:29:40.560296+0000","last_became_peered":"2024-05-08T18:29:40.560296+0000","last_unstale":"2024-05-08T18:29:51.698554+0000","last_undegraded":"2024-05-08T18:29:51.698554+0000","last_fullsized":"2024-05-08T18:29:51.698554+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:52.462279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.691667+0000","last_change":"2024-05-08T18:29:44.594681+0000","last_active":"2024-05-08T18:29:51.691667+0000","last_peered":"2024-05-08T18:29:51.691667+0000","last_clean":"2024-05-08T18:29:51.691667+0000","last_became_active":"2024-05-08T18:29:44.593917+0000","last_became_peered":"2024-05-08T18:29:44.593917+0000","last_unstale":"2024-05-08T18:29:51.691667+0000","last_undegraded":"2024-05-08T18:29:51.691667+0000","last_fullsized":"2024-05-08T18:29:51.691667+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:59:00.335437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"33'23","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:52.512202+0000","last_change":"2024-05-08T18:29:46.599932+0000","last_active":"2024-05-08T18:29:52.512202+0000","last_peered":"2024-05-08T18:29:52.512202+0000","last_clean":"2024-05-08T18:29:52.512202+0000","last_became_active":"2024-05-08T18:29:46.594789+0000","last_became_peered":"2024-05-08T18:29:46.594789+0000","last_unstale":"2024-05-08T18:29:52.512202+0000","last_undegraded":"2024-05-08T18:29:52.512202+0000","last_fullsized":"2024-05-08T18:29:52.512202+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:04:18.099848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":42,"num_read_kb":27,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.678827+0000","last_change":"2024-05-08T18:29:48.634661+0000","last_active":"2024-05-08T18:29:51.678827+0000","last_peered":"2024-05-08T18:29:51.678827+0000","last_clean":"2024-05-08T18:29:51.678827+0000","last_became_active":"2024-05-08T18:29:48.634044+0000","last_became_peered":"2024-05-08T18:29:48.634044+0000","last_unstale":"2024-05-08T18:29:51.678827+0000","last_undegraded":"2024-05-08T18:29:51.678827+0000","last_fullsized":"2024-05-08T18:29:51.678827+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:01:46.238076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.683381+0000","last_change":"2024-05-08T18:29:50.676536+0000","last_active":"2024-05-08T18:29:51.683381+0000","last_peered":"2024-05-08T18:29:51.683381+0000","last_clean":"2024-05-08T18:29:51.683381+0000","last_became_active":"2024-05-08T18:29:50.675770+0000","last_became_peered":"2024-05-08T18:29:50.675770+0000","last_unstale":"2024-05-08T18:29:51.683381+0000","last_undegraded":"2024-05-08T18:29:51.683381+0000","last_fullsized":"2024-05-08T18:29:51.683381+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:28.003482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.685094+0000","last_change":"2024-05-08T18:29:42.575253+0000","last_active":"2024-05-08T18:29:51.685094+0000","last_peered":"2024-05-08T18:29:51.685094+0000","last_clean":"2024-05-08T18:29:51.685094+0000","last_became_active":"2024-05-08T18:29:42.573621+0000","last_became_peered":"2024-05-08T18:29:42.573621+0000","last_unstale":"2024-05-08T18:29:51.685094+0000","last_undegraded":"2024-05-08T18:29:51.685094+0000","last_fullsized":"2024-05-08T18:29:51.685094+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:59.243324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.662571+0000","last_change":"2024-05-08T18:29:34.491071+0000","last_active":"2024-05-08T18:29:51.662571+0000","last_peered":"2024-05-08T18:29:51.662571+0000","last_clean":"2024-05-08T18:29:51.662571+0000","last_became_active":"2024-05-08T18:29:34.490717+0000","last_became_peered":"2024-05-08T18:29:34.490717+0000","last_unstale":"2024-05-08T18:29:51.662571+0000","last_undegraded":"2024-05-08T18:29:51.662571+0000","last_fullsized":"2024-05-08T18:29:51.662571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:55.793312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.683160+0000","last_change":"2024-05-08T18:29:40.530634+0000","last_active":"2024-05-08T18:29:51.683160+0000","last_peered":"2024-05-08T18:29:51.683160+0000","last_clean":"2024-05-08T18:29:51.683160+0000","last_became_active":"2024-05-08T18:29:40.529804+0000","last_became_peered":"2024-05-08T18:29:40.529804+0000","last_unstale":"2024-05-08T18:29:51.683160+0000","last_undegraded":"2024-05-08T18:29:51.683160+0000","last_fullsized":"2024-05-08T18:29:51.683160+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:59:25.840149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"26'1","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.665195+0000","last_change":"2024-05-08T18:29:44.584678+0000","last_active":"2024-05-08T18:29:51.665195+0000","last_peered":"2024-05-08T18:29:51.665195+0000","last_clean":"2024-05-08T18:29:51.665195+0000","last_became_active":"2024-05-08T18:29:44.584227+0000","last_became_peered":"2024-05-08T18:29:44.584227+0000","last_unstale":"2024-05-08T18:29:51.665195+0000","last_undegraded":"2024-05-08T18:29:51.665195+0000","last_fullsized":"2024-05-08T18:29:51.665195+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:04:01.281207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'15","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:52.515763+0000","last_change":"2024-05-08T18:29:46.608720+0000","last_active":"2024-05-08T18:29:52.515763+0000","last_peered":"2024-05-08T18:29:52.515763+0000","last_clean":"2024-05-08T18:29:52.515763+0000","last_became_active":"2024-05-08T18:29:46.607989+0000","last_became_peered":"2024-05-08T18:29:46.607989+0000","last_unstale":"2024-05-08T18:29:52.515763+0000","last_undegraded":"2024-05-08T18:29:52.515763+0000","last_fullsized":"2024-05-08T18:29:52.515763+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:58:31.293922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.698888+0000","last_change":"2024-05-08T18:29:48.625269+0000","last_active":"2024-05-08T18:29:51.698888+0000","last_peered":"2024-05-08T18:29:51.698888+0000","last_clean":"2024-05-08T18:29:51.698888+0000","last_became_active":"2024-05-08T18:29:48.624545+0000","last_became_peered":"2024-05-08T18:29:48.624545+0000","last_unstale":"2024-05-08T18:29:51.698888+0000","last_undegraded":"2024-05-08T18:29:51.698888+0000","last_fullsized":"2024-05-08T18:29:51.698888+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:16:42.799734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.667917+0000","last_change":"2024-05-08T18:29:50.688851+0000","last_active":"2024-05-08T18:29:51.667917+0000","last_peered":"2024-05-08T18:29:51.667917+0000","last_clean":"2024-05-08T18:29:51.667917+0000","last_became_active":"2024-05-08T18:29:50.687978+0000","last_became_peered":"2024-05-08T18:29:50.687978+0000","last_unstale":"2024-05-08T18:29:51.667917+0000","last_undegraded":"2024-05-08T18:29:51.667917+0000","last_fullsized":"2024-05-08T18:29:51.667917+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:28:29.836446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.684435+0000","last_change":"2024-05-08T18:29:42.574606+0000","last_active":"2024-05-08T18:29:51.684435+0000","last_peered":"2024-05-08T18:29:51.684435+0000","last_clean":"2024-05-08T18:29:51.684435+0000","last_became_active":"2024-05-08T18:29:42.573656+0000","last_became_peered":"2024-05-08T18:29:42.573656+0000","last_unstale":"2024-05-08T18:29:51.684435+0000","last_undegraded":"2024-05-08T18:29:51.684435+0000","last_fullsized":"2024-05-08T18:29:51.684435+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:54:16.539832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.688776+0000","last_change":"2024-05-08T18:29:34.496942+0000","last_active":"2024-05-08T18:29:51.688776+0000","last_peered":"2024-05-08T18:29:51.688776+0000","last_clean":"2024-05-08T18:29:51.688776+0000","last_became_active":"2024-05-08T18:29:34.495882+0000","last_became_peered":"2024-05-08T18:29:34.495882+0000","last_unstale":"2024-05-08T18:29:51.688776+0000","last_undegraded":"2024-05-08T18:29:51.688776+0000","last_fullsized":"2024-05-08T18:29:51.688776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:55.793312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.660494+0000","last_change":"2024-05-08T18:29:40.554353+0000","last_active":"2024-05-08T18:29:51.660494+0000","last_peered":"2024-05-08T18:29:51.660494+0000","last_clean":"2024-05-08T18:29:51.660494+0000","last_became_active":"2024-05-08T18:29:40.553527+0000","last_became_peered":"2024-05-08T18:29:40.553527+0000","last_unstale":"2024-05-08T18:29:51.660494+0000","last_undegraded":"2024-05-08T18:29:51.660494+0000","last_fullsized":"2024-05-08T18:29:51.660494+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:03:42.148647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.699793+0000","last_change":"2024-05-08T18:29:44.597411+0000","last_active":"2024-05-08T18:29:51.699793+0000","last_peered":"2024-05-08T18:29:51.699793+0000","last_clean":"2024-05-08T18:29:51.699793+0000","last_became_active":"2024-05-08T18:29:44.596678+0000","last_became_peered":"2024-05-08T18:29:44.596678+0000","last_unstale":"2024-05-08T18:29:51.699793+0000","last_undegraded":"2024-05-08T18:29:51.699793+0000","last_fullsized":"2024-05-08T18:29:51.699793+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:37:23.674968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'12","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:52.360421+0000","last_change":"2024-05-08T18:29:46.607040+0000","last_active":"2024-05-08T18:29:52.360421+0000","last_peered":"2024-05-08T18:29:52.360421+0000","last_clean":"2024-05-08T18:29:52.360421+0000","last_became_active":"2024-05-08T18:29:46.606367+0000","last_became_peered":"2024-05-08T18:29:46.606367+0000","last_unstale":"2024-05-08T18:29:52.360421+0000","last_undegraded":"2024-05-08T18:29:52.360421+0000","last_fullsized":"2024-05-08T18:29:52.360421+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:59:26.650126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.693344+0000","last_change":"2024-05-08T18:29:48.632665+0000","last_active":"2024-05-08T18:29:51.693344+0000","last_peered":"2024-05-08T18:29:51.693344+0000","last_clean":"2024-05-08T18:29:51.693344+0000","last_became_active":"2024-05-08T18:29:48.631874+0000","last_became_peered":"2024-05-08T18:29:48.631874+0000","last_unstale":"2024-05-08T18:29:51.693344+0000","last_undegraded":"2024-05-08T18:29:51.693344+0000","last_fullsized":"2024-05-08T18:29:51.693344+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:06:09.390017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.687003+0000","last_change":"2024-05-08T18:29:50.683443+0000","last_active":"2024-05-08T18:29:51.687003+0000","last_peered":"2024-05-08T18:29:51.687003+0000","last_clean":"2024-05-08T18:29:51.687003+0000","last_became_active":"2024-05-08T18:29:50.682634+0000","last_became_peered":"2024-05-08T18:29:50.682634+0000","last_unstale":"2024-05-08T18:29:51.687003+0000","last_undegraded":"2024-05-08T18:29:51.687003+0000","last_fullsized":"2024-05-08T18:29:51.687003+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:10:38.951662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.683744+0000","last_change":"2024-05-08T18:29:42.574593+0000","last_active":"2024-05-08T18:29:51.683744+0000","last_peered":"2024-05-08T18:29:51.683744+0000","last_clean":"2024-05-08T18:29:51.683744+0000","last_became_active":"2024-05-08T18:29:42.574288+0000","last_became_peered":"2024-05-08T18:29:42.574288+0000","last_unstale":"2024-05-08T18:29:51.683744+0000","last_undegraded":"2024-05-08T18:29:51.683744+0000","last_fullsized":"2024-05-08T18:29:51.683744+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:58.320701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.690535+0000","last_change":"2024-05-08T18:29:40.556697+0000","last_active":"2024-05-08T18:29:51.690535+0000","last_peered":"2024-05-08T18:29:51.690535+0000","last_clean":"2024-05-08T18:29:51.690535+0000","last_became_active":"2024-05-08T18:29:40.555965+0000","last_became_peered":"2024-05-08T18:29:40.555965+0000","last_unstale":"2024-05-08T18:29:51.690535+0000","last_undegraded":"2024-05-08T18:29:51.690535+0000","last_fullsized":"2024-05-08T18:29:51.690535+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:36:14.096907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.685015+0000","last_change":"2024-05-08T18:29:34.606393+0000","last_active":"2024-05-08T18:29:51.685015+0000","last_peered":"2024-05-08T18:29:51.685015+0000","last_clean":"2024-05-08T18:29:51.685015+0000","last_became_active":"2024-05-08T18:29:34.605574+0000","last_became_peered":"2024-05-08T18:29:34.605574+0000","last_unstale":"2024-05-08T18:29:51.685015+0000","last_undegraded":"2024-05-08T18:29:51.685015+0000","last_fullsized":"2024-05-08T18:29:51.685015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:55.793312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.699174+0000","last_change":"2024-05-08T18:29:44.595127+0000","last_active":"2024-05-08T18:29:51.699174+0000","last_peered":"2024-05-08T18:29:51.699174+0000","last_clean":"2024-05-08T18:29:51.699174+0000","last_became_active":"2024-05-08T18:29:44.594642+0000","last_became_peered":"2024-05-08T18:29:44.594642+0000","last_unstale":"2024-05-08T18:29:51.699174+0000","last_undegraded":"2024-05-08T18:29:51.699174+0000","last_fullsized":"2024-05-08T18:29:51.699174+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:04:49.020450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"33'18","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:52.449141+0000","last_change":"2024-05-08T18:29:46.602279+0000","last_active":"2024-05-08T18:29:52.449141+0000","last_peered":"2024-05-08T18:29:52.449141+0000","last_clean":"2024-05-08T18:29:52.449141+0000","last_became_active":"2024-05-08T18:29:46.599707+0000","last_became_peered":"2024-05-08T18:29:46.599707+0000","last_unstale":"2024-05-08T18:29:52.449141+0000","last_undegraded":"2024-05-08T18:29:52.449141+0000","last_fullsized":"2024-05-08T18:29:52.449141+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:54:48.654215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.658543+0000","last_change":"2024-05-08T18:29:48.639458+0000","last_active":"2024-05-08T18:29:51.658543+0000","last_peered":"2024-05-08T18:29:51.658543+0000","last_clean":"2024-05-08T18:29:51.658543+0000","last_became_active":"2024-05-08T18:29:48.638709+0000","last_became_peered":"2024-05-08T18:29:48.638709+0000","last_unstale":"2024-05-08T18:29:51.658543+0000","last_undegraded":"2024-05-08T18:29:51.658543+0000","last_fullsized":"2024-05-08T18:29:51.658543+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:19:58.182291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.700112+0000","last_change":"2024-05-08T18:29:50.681077+0000","last_active":"2024-05-08T18:29:51.700112+0000","last_peered":"2024-05-08T18:29:51.700112+0000","last_clean":"2024-05-08T18:29:51.700112+0000","last_became_active":"2024-05-08T18:29:50.675766+0000","last_became_peered":"2024-05-08T18:29:50.675766+0000","last_unstale":"2024-05-08T18:29:51.700112+0000","last_undegraded":"2024-05-08T18:29:51.700112+0000","last_fullsized":"2024-05-08T18:29:51.700112+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:09:29.641515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.699923+0000","last_change":"2024-05-08T18:29:42.571265+0000","last_active":"2024-05-08T18:29:51.699923+0000","last_peered":"2024-05-08T18:29:51.699923+0000","last_clean":"2024-05-08T18:29:51.699923+0000","last_became_active":"2024-05-08T18:29:42.570645+0000","last_became_peered":"2024-05-08T18:29:42.570645+0000","last_unstale":"2024-05-08T18:29:51.699923+0000","last_undegraded":"2024-05-08T18:29:51.699923+0000","last_fullsized":"2024-05-08T18:29:51.699923+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:30:29.452640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.685257+0000","last_change":"2024-05-08T18:29:40.531079+0000","last_active":"2024-05-08T18:29:51.685257+0000","last_peered":"2024-05-08T18:29:51.685257+0000","last_clean":"2024-05-08T18:29:51.685257+0000","last_became_active":"2024-05-08T18:29:40.530256+0000","last_became_peered":"2024-05-08T18:29:40.530256+0000","last_unstale":"2024-05-08T18:29:51.685257+0000","last_undegraded":"2024-05-08T18:29:51.685257+0000","last_fullsized":"2024-05-08T18:29:51.685257+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:09:42.581976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.679739+0000","last_change":"2024-05-08T18:29:34.603292+0000","last_active":"2024-05-08T18:29:51.679739+0000","last_peered":"2024-05-08T18:29:51.679739+0000","last_clean":"2024-05-08T18:29:51.679739+0000","last_became_active":"2024-05-08T18:29:34.602547+0000","last_became_peered":"2024-05-08T18:29:34.602547+0000","last_unstale":"2024-05-08T18:29:51.679739+0000","last_undegraded":"2024-05-08T18:29:51.679739+0000","last_fullsized":"2024-05-08T18:29:51.679739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:24:55.555475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.692088+0000","last_change":"2024-05-08T18:29:44.593275+0000","last_active":"2024-05-08T18:29:51.692088+0000","last_peered":"2024-05-08T18:29:51.692088+0000","last_clean":"2024-05-08T18:29:51.692088+0000","last_became_active":"2024-05-08T18:29:44.591870+0000","last_became_peered":"2024-05-08T18:29:44.591870+0000","last_unstale":"2024-05-08T18:29:51.692088+0000","last_undegraded":"2024-05-08T18:29:51.692088+0000","last_fullsized":"2024-05-08T18:29:51.692088+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:35.176971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"33'14","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:52.546955+0000","last_change":"2024-05-08T18:29:46.603499+0000","last_active":"2024-05-08T18:29:52.546955+0000","last_peered":"2024-05-08T18:29:52.546955+0000","last_clean":"2024-05-08T18:29:52.546955+0000","last_became_active":"2024-05-08T18:29:46.602920+0000","last_became_peered":"2024-05-08T18:29:46.602920+0000","last_unstale":"2024-05-08T18:29:52.546955+0000","last_undegraded":"2024-05-08T18:29:52.546955+0000","last_fullsized":"2024-05-08T18:29:52.546955+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:08.504882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"30'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.687940+0000","last_change":"2024-05-08T18:29:48.634915+0000","last_active":"2024-05-08T18:29:51.687940+0000","last_peered":"2024-05-08T18:29:51.687940+0000","last_clean":"2024-05-08T18:29:51.687940+0000","last_became_active":"2024-05-08T18:29:48.634280+0000","last_became_peered":"2024-05-08T18:29:48.634280+0000","last_unstale":"2024-05-08T18:29:51.687940+0000","last_undegraded":"2024-05-08T18:29:51.687940+0000","last_fullsized":"2024-05-08T18:29:51.687940+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:19:58.182291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.669019+0000","last_change":"2024-05-08T18:29:50.688742+0000","last_active":"2024-05-08T18:29:51.669019+0000","last_peered":"2024-05-08T18:29:51.669019+0000","last_clean":"2024-05-08T18:29:51.669019+0000","last_became_active":"2024-05-08T18:29:50.687135+0000","last_became_peered":"2024-05-08T18:29:50.687135+0000","last_unstale":"2024-05-08T18:29:51.669019+0000","last_undegraded":"2024-05-08T18:29:51.669019+0000","last_fullsized":"2024-05-08T18:29:51.669019+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:12:49.040807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.663656+0000","last_change":"2024-05-08T18:29:42.576864+0000","last_active":"2024-05-08T18:29:51.663656+0000","last_peered":"2024-05-08T18:29:51.663656+0000","last_clean":"2024-05-08T18:29:51.663656+0000","last_became_active":"2024-05-08T18:29:42.576392+0000","last_became_peered":"2024-05-08T18:29:42.576392+0000","last_unstale":"2024-05-08T18:29:51.663656+0000","last_undegraded":"2024-05-08T18:29:51.663656+0000","last_fullsized":"2024-05-08T18:29:51.663656+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:23.397435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.668340+0000","last_change":"2024-05-08T18:29:40.565872+0000","last_active":"2024-05-08T18:29:51.668340+0000","last_peered":"2024-05-08T18:29:51.668340+0000","last_clean":"2024-05-08T18:29:51.668340+0000","last_became_active":"2024-05-08T18:29:40.565655+0000","last_became_peered":"2024-05-08T18:29:40.565655+0000","last_unstale":"2024-05-08T18:29:51.668340+0000","last_undegraded":"2024-05-08T18:29:51.668340+0000","last_fullsized":"2024-05-08T18:29:51.668340+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:16:16.521258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.685010+0000","last_change":"2024-05-08T18:29:34.501273+0000","last_active":"2024-05-08T18:29:51.685010+0000","last_peered":"2024-05-08T18:29:51.685010+0000","last_clean":"2024-05-08T18:29:51.685010+0000","last_became_active":"2024-05-08T18:29:34.500933+0000","last_became_peered":"2024-05-08T18:29:34.500933+0000","last_unstale":"2024-05-08T18:29:51.685010+0000","last_undegraded":"2024-05-08T18:29:51.685010+0000","last_fullsized":"2024-05-08T18:29:51.685010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:35.917391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.658826+0000","last_change":"2024-05-08T18:29:44.576227+0000","last_active":"2024-05-08T18:29:51.658826+0000","last_peered":"2024-05-08T18:29:51.658826+0000","last_clean":"2024-05-08T18:29:51.658826+0000","last_became_active":"2024-05-08T18:29:44.575454+0000","last_became_peered":"2024-05-08T18:29:44.575454+0000","last_unstale":"2024-05-08T18:29:51.658826+0000","last_undegraded":"2024-05-08T18:29:51.658826+0000","last_fullsized":"2024-05-08T18:29:51.658826+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:06:05.355648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"33'10","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:52.498326+0000","last_change":"2024-05-08T18:29:46.609633+0000","last_active":"2024-05-08T18:29:52.498326+0000","last_peered":"2024-05-08T18:29:52.498326+0000","last_clean":"2024-05-08T18:29:52.498326+0000","last_became_active":"2024-05-08T18:29:46.603455+0000","last_became_peered":"2024-05-08T18:29:46.603455+0000","last_unstale":"2024-05-08T18:29:52.498326+0000","last_undegraded":"2024-05-08T18:29:52.498326+0000","last_fullsized":"2024-05-08T18:29:52.498326+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:07:54.654205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"30'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.668494+0000","last_change":"2024-05-08T18:29:48.637898+0000","last_active":"2024-05-08T18:29:51.668494+0000","last_peered":"2024-05-08T18:29:51.668494+0000","last_clean":"2024-05-08T18:29:51.668494+0000","last_became_active":"2024-05-08T18:29:48.637070+0000","last_became_peered":"2024-05-08T18:29:48.637070+0000","last_unstale":"2024-05-08T18:29:51.668494+0000","last_undegraded":"2024-05-08T18:29:51.668494+0000","last_fullsized":"2024-05-08T18:29:51.668494+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:03:46.392864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.699377+0000","last_change":"2024-05-08T18:29:50.691526+0000","last_active":"2024-05-08T18:29:51.699377+0000","last_peered":"2024-05-08T18:29:51.699377+0000","last_clean":"2024-05-08T18:29:51.699377+0000","last_became_active":"2024-05-08T18:29:50.690767+0000","last_became_peered":"2024-05-08T18:29:50.690767+0000","last_unstale":"2024-05-08T18:29:51.699377+0000","last_undegraded":"2024-05-08T18:29:51.699377+0000","last_fullsized":"2024-05-08T18:29:51.699377+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:32:29.972139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.659175+0000","last_change":"2024-05-08T18:29:42.562006+0000","last_active":"2024-05-08T18:29:51.659175+0000","last_peered":"2024-05-08T18:29:51.659175+0000","last_clean":"2024-05-08T18:29:51.659175+0000","last_became_active":"2024-05-08T18:29:42.560861+0000","last_became_peered":"2024-05-08T18:29:42.560861+0000","last_unstale":"2024-05-08T18:29:51.659175+0000","last_undegraded":"2024-05-08T18:29:51.659175+0000","last_fullsized":"2024-05-08T18:29:51.659175+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:36.890277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.701441+0000","last_change":"2024-05-08T18:29:40.550529+0000","last_active":"2024-05-08T18:29:51.701441+0000","last_peered":"2024-05-08T18:29:51.701441+0000","last_clean":"2024-05-08T18:29:51.701441+0000","last_became_active":"2024-05-08T18:29:40.550241+0000","last_became_peered":"2024-05-08T18:29:40.550241+0000","last_unstale":"2024-05-08T18:29:51.701441+0000","last_undegraded":"2024-05-08T18:29:51.701441+0000","last_fullsized":"2024-05-08T18:29:51.701441+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:48.294532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.693677+0000","last_change":"2024-05-08T18:29:34.493537+0000","last_active":"2024-05-08T18:29:51.693677+0000","last_peered":"2024-05-08T18:29:51.693677+0000","last_clean":"2024-05-08T18:29:51.693677+0000","last_became_active":"2024-05-08T18:29:34.492891+0000","last_became_peered":"2024-05-08T18:29:34.492891+0000","last_unstale":"2024-05-08T18:29:51.693677+0000","last_undegraded":"2024-05-08T18:29:51.693677+0000","last_fullsized":"2024-05-08T18:29:51.693677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:09:07.992256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.663400+0000","last_change":"2024-05-08T18:29:44.590102+0000","last_active":"2024-05-08T18:29:51.663400+0000","last_peered":"2024-05-08T18:29:51.663400+0000","last_clean":"2024-05-08T18:29:51.663400+0000","last_became_active":"2024-05-08T18:29:44.589471+0000","last_became_peered":"2024-05-08T18:29:44.589471+0000","last_unstale":"2024-05-08T18:29:51.663400+0000","last_undegraded":"2024-05-08T18:29:51.663400+0000","last_fullsized":"2024-05-08T18:29:51.663400+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:14:04.085401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"33'19","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:52.477657+0000","last_change":"2024-05-08T18:29:46.606967+0000","last_active":"2024-05-08T18:29:52.477657+0000","last_peered":"2024-05-08T18:29:52.477657+0000","last_clean":"2024-05-08T18:29:52.477657+0000","last_became_active":"2024-05-08T18:29:46.605693+0000","last_became_peered":"2024-05-08T18:29:46.605693+0000","last_unstale":"2024-05-08T18:29:52.477657+0000","last_undegraded":"2024-05-08T18:29:52.477657+0000","last_fullsized":"2024-05-08T18:29:52.477657+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:24:13.568294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.663761+0000","last_change":"2024-05-08T18:29:48.634271+0000","last_active":"2024-05-08T18:29:51.663761+0000","last_peered":"2024-05-08T18:29:51.663761+0000","last_clean":"2024-05-08T18:29:51.663761+0000","last_became_active":"2024-05-08T18:29:48.633607+0000","last_became_peered":"2024-05-08T18:29:48.633607+0000","last_unstale":"2024-05-08T18:29:51.663761+0000","last_undegraded":"2024-05-08T18:29:51.663761+0000","last_fullsized":"2024-05-08T18:29:51.663761+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:34.806539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.689384+0000","last_change":"2024-05-08T18:29:50.685494+0000","last_active":"2024-05-08T18:29:51.689384+0000","last_peered":"2024-05-08T18:29:51.689384+0000","last_clean":"2024-05-08T18:29:51.689384+0000","last_became_active":"2024-05-08T18:29:50.684818+0000","last_became_peered":"2024-05-08T18:29:50.684818+0000","last_unstale":"2024-05-08T18:29:51.689384+0000","last_undegraded":"2024-05-08T18:29:51.689384+0000","last_fullsized":"2024-05-08T18:29:51.689384+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:22.220842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.700596+0000","last_change":"2024-05-08T18:29:50.682937+0000","last_active":"2024-05-08T18:29:51.700596+0000","last_peered":"2024-05-08T18:29:51.700596+0000","last_clean":"2024-05-08T18:29:51.700596+0000","last_became_active":"2024-05-08T18:29:50.681771+0000","last_became_peered":"2024-05-08T18:29:50.681771+0000","last_unstale":"2024-05-08T18:29:51.700596+0000","last_undegraded":"2024-05-08T18:29:51.700596+0000","last_fullsized":"2024-05-08T18:29:51.700596+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:28:29.836446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.659830+0000","last_change":"2024-05-08T18:29:42.575909+0000","last_active":"2024-05-08T18:29:51.659830+0000","last_peered":"2024-05-08T18:29:51.659830+0000","last_clean":"2024-05-08T18:29:51.659830+0000","last_became_active":"2024-05-08T18:29:42.574877+0000","last_became_peered":"2024-05-08T18:29:42.574877+0000","last_unstale":"2024-05-08T18:29:51.659830+0000","last_undegraded":"2024-05-08T18:29:51.659830+0000","last_fullsized":"2024-05-08T18:29:51.659830+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:33.139089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.659791+0000","last_change":"2024-05-08T18:29:40.566496+0000","last_active":"2024-05-08T18:29:51.659791+0000","last_peered":"2024-05-08T18:29:51.659791+0000","last_clean":"2024-05-08T18:29:51.659791+0000","last_became_active":"2024-05-08T18:29:40.565874+0000","last_became_peered":"2024-05-08T18:29:40.565874+0000","last_unstale":"2024-05-08T18:29:51.659791+0000","last_undegraded":"2024-05-08T18:29:51.659791+0000","last_fullsized":"2024-05-08T18:29:51.659791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:07.239963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.684116+0000","last_change":"2024-05-08T18:29:44.595410+0000","last_active":"2024-05-08T18:29:51.684116+0000","last_peered":"2024-05-08T18:29:51.684116+0000","last_clean":"2024-05-08T18:29:51.684116+0000","last_became_active":"2024-05-08T18:29:44.594286+0000","last_became_peered":"2024-05-08T18:29:44.594286+0000","last_unstale":"2024-05-08T18:29:51.684116+0000","last_undegraded":"2024-05-08T18:29:51.684116+0000","last_fullsized":"2024-05-08T18:29:51.684116+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:38.928160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"33'11","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:52.554306+0000","last_change":"2024-05-08T18:29:46.591009+0000","last_active":"2024-05-08T18:29:52.554306+0000","last_peered":"2024-05-08T18:29:52.554306+0000","last_clean":"2024-05-08T18:29:52.554306+0000","last_became_active":"2024-05-08T18:29:46.588810+0000","last_became_peered":"2024-05-08T18:29:46.588810+0000","last_unstale":"2024-05-08T18:29:52.554306+0000","last_undegraded":"2024-05-08T18:29:52.554306+0000","last_fullsized":"2024-05-08T18:29:52.554306+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:34:45.745300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.663048+0000","last_change":"2024-05-08T18:29:48.634986+0000","last_active":"2024-05-08T18:29:51.663048+0000","last_peered":"2024-05-08T18:29:51.663048+0000","last_clean":"2024-05-08T18:29:51.663048+0000","last_became_active":"2024-05-08T18:29:48.633866+0000","last_became_peered":"2024-05-08T18:29:48.633866+0000","last_unstale":"2024-05-08T18:29:51.663048+0000","last_undegraded":"2024-05-08T18:29:51.663048+0000","last_fullsized":"2024-05-08T18:29:51.663048+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:46.539830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.667267+0000","last_change":"2024-05-08T18:29:50.693408+0000","last_active":"2024-05-08T18:29:51.667267+0000","last_peered":"2024-05-08T18:29:51.667267+0000","last_clean":"2024-05-08T18:29:51.667267+0000","last_became_active":"2024-05-08T18:29:50.692687+0000","last_became_peered":"2024-05-08T18:29:50.692687+0000","last_unstale":"2024-05-08T18:29:51.667267+0000","last_undegraded":"2024-05-08T18:29:51.667267+0000","last_fullsized":"2024-05-08T18:29:51.667267+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:22.834262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.683667+0000","last_change":"2024-05-08T18:29:42.581368+0000","last_active":"2024-05-08T18:29:51.683667+0000","last_peered":"2024-05-08T18:29:51.683667+0000","last_clean":"2024-05-08T18:29:51.683667+0000","last_became_active":"2024-05-08T18:29:42.580887+0000","last_became_peered":"2024-05-08T18:29:42.580887+0000","last_unstale":"2024-05-08T18:29:51.683667+0000","last_undegraded":"2024-05-08T18:29:51.683667+0000","last_fullsized":"2024-05-08T18:29:51.683667+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:08:15.026467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.679480+0000","last_change":"2024-05-08T18:29:40.572770+0000","last_active":"2024-05-08T18:29:51.679480+0000","last_peered":"2024-05-08T18:29:51.679480+0000","last_clean":"2024-05-08T18:29:51.679480+0000","last_became_active":"2024-05-08T18:29:40.572079+0000","last_became_peered":"2024-05-08T18:29:40.572079+0000","last_unstale":"2024-05-08T18:29:51.679480+0000","last_undegraded":"2024-05-08T18:29:51.679480+0000","last_fullsized":"2024-05-08T18:29:51.679480+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:05.929806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.666581+0000","last_change":"2024-05-08T18:29:44.581323+0000","last_active":"2024-05-08T18:29:51.666581+0000","last_peered":"2024-05-08T18:29:51.666581+0000","last_clean":"2024-05-08T18:29:51.666581+0000","last_became_active":"2024-05-08T18:29:44.580805+0000","last_became_peered":"2024-05-08T18:29:44.580805+0000","last_unstale":"2024-05-08T18:29:51.666581+0000","last_undegraded":"2024-05-08T18:29:51.666581+0000","last_fullsized":"2024-05-08T18:29:51.666581+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:35:25.591140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'4","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:52.015333+0000","last_change":"2024-05-08T18:29:46.602495+0000","last_active":"2024-05-08T18:29:52.015333+0000","last_peered":"2024-05-08T18:29:52.015333+0000","last_clean":"2024-05-08T18:29:52.015333+0000","last_became_active":"2024-05-08T18:29:46.599789+0000","last_became_peered":"2024-05-08T18:29:46.599789+0000","last_unstale":"2024-05-08T18:29:52.015333+0000","last_undegraded":"2024-05-08T18:29:52.015333+0000","last_fullsized":"2024-05-08T18:29:52.015333+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:18:16.375808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.677776+0000","last_change":"2024-05-08T18:29:48.642994+0000","last_active":"2024-05-08T18:29:51.677776+0000","last_peered":"2024-05-08T18:29:51.677776+0000","last_clean":"2024-05-08T18:29:51.677776+0000","last_became_active":"2024-05-08T18:29:48.642056+0000","last_became_peered":"2024-05-08T18:29:48.642056+0000","last_unstale":"2024-05-08T18:29:51.677776+0000","last_undegraded":"2024-05-08T18:29:51.677776+0000","last_fullsized":"2024-05-08T18:29:51.677776+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:47:54.034851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.699927+0000","last_change":"2024-05-08T18:29:50.672513+0000","last_active":"2024-05-08T18:29:51.699927+0000","last_peered":"2024-05-08T18:29:51.699927+0000","last_clean":"2024-05-08T18:29:51.699927+0000","last_became_active":"2024-05-08T18:29:50.671781+0000","last_became_peered":"2024-05-08T18:29:50.671781+0000","last_unstale":"2024-05-08T18:29:51.699927+0000","last_undegraded":"2024-05-08T18:29:51.699927+0000","last_fullsized":"2024-05-08T18:29:51.699927+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:45:34.171402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.664319+0000","last_change":"2024-05-08T18:29:42.576843+0000","last_active":"2024-05-08T18:29:51.664319+0000","last_peered":"2024-05-08T18:29:51.664319+0000","last_clean":"2024-05-08T18:29:51.664319+0000","last_became_active":"2024-05-08T18:29:42.576379+0000","last_became_peered":"2024-05-08T18:29:42.576379+0000","last_unstale":"2024-05-08T18:29:51.664319+0000","last_undegraded":"2024-05-08T18:29:51.664319+0000","last_fullsized":"2024-05-08T18:29:51.664319+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:20.471010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.690634+0000","last_change":"2024-05-08T18:29:40.542997+0000","last_active":"2024-05-08T18:29:51.690634+0000","last_peered":"2024-05-08T18:29:51.690634+0000","last_clean":"2024-05-08T18:29:51.690634+0000","last_became_active":"2024-05-08T18:29:40.542239+0000","last_became_peered":"2024-05-08T18:29:40.542239+0000","last_unstale":"2024-05-08T18:29:51.690634+0000","last_undegraded":"2024-05-08T18:29:51.690634+0000","last_fullsized":"2024-05-08T18:29:51.690634+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:14:43.555504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.676958+0000","last_change":"2024-05-08T18:29:44.594178+0000","last_active":"2024-05-08T18:29:51.676958+0000","last_peered":"2024-05-08T18:29:51.676958+0000","last_clean":"2024-05-08T18:29:51.676958+0000","last_became_active":"2024-05-08T18:29:44.592476+0000","last_became_peered":"2024-05-08T18:29:44.592476+0000","last_unstale":"2024-05-08T18:29:51.676958+0000","last_undegraded":"2024-05-08T18:29:51.676958+0000","last_fullsized":"2024-05-08T18:29:51.676958+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:04:16.093662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"33'11","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:52.462061+0000","last_change":"2024-05-08T18:29:46.597288+0000","last_active":"2024-05-08T18:29:52.462061+0000","last_peered":"2024-05-08T18:29:52.462061+0000","last_clean":"2024-05-08T18:29:52.462061+0000","last_became_active":"2024-05-08T18:29:46.596452+0000","last_became_peered":"2024-05-08T18:29:46.596452+0000","last_unstale":"2024-05-08T18:29:52.462061+0000","last_undegraded":"2024-05-08T18:29:52.462061+0000","last_fullsized":"2024-05-08T18:29:52.462061+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:32:43.245753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.691949+0000","last_change":"2024-05-08T18:29:48.635436+0000","last_active":"2024-05-08T18:29:51.691949+0000","last_peered":"2024-05-08T18:29:51.691949+0000","last_clean":"2024-05-08T18:29:51.691949+0000","last_became_active":"2024-05-08T18:29:48.634704+0000","last_became_peered":"2024-05-08T18:29:48.634704+0000","last_unstale":"2024-05-08T18:29:51.691949+0000","last_undegraded":"2024-05-08T18:29:51.691949+0000","last_fullsized":"2024-05-08T18:29:51.691949+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:55:52.238481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.689046+0000","last_change":"2024-05-08T18:29:50.687974+0000","last_active":"2024-05-08T18:29:51.689046+0000","last_peered":"2024-05-08T18:29:51.689046+0000","last_clean":"2024-05-08T18:29:51.689046+0000","last_became_active":"2024-05-08T18:29:50.687045+0000","last_became_peered":"2024-05-08T18:29:50.687045+0000","last_unstale":"2024-05-08T18:29:51.689046+0000","last_undegraded":"2024-05-08T18:29:51.689046+0000","last_fullsized":"2024-05-08T18:29:51.689046+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:55:01.894779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.663855+0000","last_change":"2024-05-08T18:29:42.563779+0000","last_active":"2024-05-08T18:29:51.663855+0000","last_peered":"2024-05-08T18:29:51.663855+0000","last_clean":"2024-05-08T18:29:51.663855+0000","last_became_active":"2024-05-08T18:29:42.562522+0000","last_became_peered":"2024-05-08T18:29:42.562522+0000","last_unstale":"2024-05-08T18:29:51.663855+0000","last_undegraded":"2024-05-08T18:29:51.663855+0000","last_fullsized":"2024-05-08T18:29:51.663855+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:35:23.016110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.701373+0000","last_change":"2024-05-08T18:29:40.541112+0000","last_active":"2024-05-08T18:29:51.701373+0000","last_peered":"2024-05-08T18:29:51.701373+0000","last_clean":"2024-05-08T18:29:51.701373+0000","last_became_active":"2024-05-08T18:29:40.540835+0000","last_became_peered":"2024-05-08T18:29:40.540835+0000","last_unstale":"2024-05-08T18:29:51.701373+0000","last_undegraded":"2024-05-08T18:29:51.701373+0000","last_fullsized":"2024-05-08T18:29:51.701373+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:43:14.995191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.691753+0000","last_change":"2024-05-08T18:29:44.592033+0000","last_active":"2024-05-08T18:29:51.691753+0000","last_peered":"2024-05-08T18:29:51.691753+0000","last_clean":"2024-05-08T18:29:51.691753+0000","last_became_active":"2024-05-08T18:29:44.590454+0000","last_became_peered":"2024-05-08T18:29:44.590454+0000","last_unstale":"2024-05-08T18:29:51.691753+0000","last_undegraded":"2024-05-08T18:29:51.691753+0000","last_fullsized":"2024-05-08T18:29:51.691753+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:11:03.740365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"33'9","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:52.236160+0000","last_change":"2024-05-08T18:29:46.607002+0000","last_active":"2024-05-08T18:29:52.236160+0000","last_peered":"2024-05-08T18:29:52.236160+0000","last_clean":"2024-05-08T18:29:52.236160+0000","last_became_active":"2024-05-08T18:29:46.606172+0000","last_became_peered":"2024-05-08T18:29:46.606172+0000","last_unstale":"2024-05-08T18:29:52.236160+0000","last_undegraded":"2024-05-08T18:29:52.236160+0000","last_fullsized":"2024-05-08T18:29:52.236160+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:37:35.850414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.698549+0000","last_change":"2024-05-08T18:29:48.632948+0000","last_active":"2024-05-08T18:29:51.698549+0000","last_peered":"2024-05-08T18:29:51.698549+0000","last_clean":"2024-05-08T18:29:51.698549+0000","last_became_active":"2024-05-08T18:29:48.631219+0000","last_became_peered":"2024-05-08T18:29:48.631219+0000","last_unstale":"2024-05-08T18:29:51.698549+0000","last_undegraded":"2024-05-08T18:29:51.698549+0000","last_fullsized":"2024-05-08T18:29:51.698549+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:19:01.454355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.693579+0000","last_change":"2024-05-08T18:29:42.570180+0000","last_active":"2024-05-08T18:29:51.693579+0000","last_peered":"2024-05-08T18:29:51.693579+0000","last_clean":"2024-05-08T18:29:51.693579+0000","last_became_active":"2024-05-08T18:29:42.569425+0000","last_became_peered":"2024-05-08T18:29:42.569425+0000","last_unstale":"2024-05-08T18:29:51.693579+0000","last_undegraded":"2024-05-08T18:29:51.693579+0000","last_fullsized":"2024-05-08T18:29:51.693579+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:35.037465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.665688+0000","last_change":"2024-05-08T18:29:40.547711+0000","last_active":"2024-05-08T18:29:51.665688+0000","last_peered":"2024-05-08T18:29:51.665688+0000","last_clean":"2024-05-08T18:29:51.665688+0000","last_became_active":"2024-05-08T18:29:40.547479+0000","last_became_peered":"2024-05-08T18:29:40.547479+0000","last_unstale":"2024-05-08T18:29:51.665688+0000","last_undegraded":"2024-05-08T18:29:51.665688+0000","last_fullsized":"2024-05-08T18:29:51.665688+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:12:40.901620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.700828+0000","last_change":"2024-05-08T18:29:44.591547+0000","last_active":"2024-05-08T18:29:51.700828+0000","last_peered":"2024-05-08T18:29:51.700828+0000","last_clean":"2024-05-08T18:29:51.700828+0000","last_became_active":"2024-05-08T18:29:44.590498+0000","last_became_peered":"2024-05-08T18:29:44.590498+0000","last_unstale":"2024-05-08T18:29:51.700828+0000","last_undegraded":"2024-05-08T18:29:51.700828+0000","last_fullsized":"2024-05-08T18:29:51.700828+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:14:04.085401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"33'12","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:52.582399+0000","last_change":"2024-05-08T18:29:46.600437+0000","last_active":"2024-05-08T18:29:52.582399+0000","last_peered":"2024-05-08T18:29:52.582399+0000","last_clean":"2024-05-08T18:29:52.582399+0000","last_became_active":"2024-05-08T18:29:46.594672+0000","last_became_peered":"2024-05-08T18:29:46.594672+0000","last_unstale":"2024-05-08T18:29:52.582399+0000","last_undegraded":"2024-05-08T18:29:52.582399+0000","last_fullsized":"2024-05-08T18:29:52.582399+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:35:53.294312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.689315+0000","last_change":"2024-05-08T18:29:48.639840+0000","last_active":"2024-05-08T18:29:51.689315+0000","last_peered":"2024-05-08T18:29:51.689315+0000","last_clean":"2024-05-08T18:29:51.689315+0000","last_became_active":"2024-05-08T18:29:48.639120+0000","last_became_peered":"2024-05-08T18:29:48.639120+0000","last_unstale":"2024-05-08T18:29:51.689315+0000","last_undegraded":"2024-05-08T18:29:51.689315+0000","last_fullsized":"2024-05-08T18:29:51.689315+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:13:50.865474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.663655+0000","last_change":"2024-05-08T18:29:50.684843+0000","last_active":"2024-05-08T18:29:51.663655+0000","last_peered":"2024-05-08T18:29:51.663655+0000","last_clean":"2024-05-08T18:29:51.663655+0000","last_became_active":"2024-05-08T18:29:50.684119+0000","last_became_peered":"2024-05-08T18:29:50.684119+0000","last_unstale":"2024-05-08T18:29:51.663655+0000","last_undegraded":"2024-05-08T18:29:51.663655+0000","last_fullsized":"2024-05-08T18:29:51.663655+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:09:29.641515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.701135+0000","last_change":"2024-05-08T18:29:42.575763+0000","last_active":"2024-05-08T18:29:51.701135+0000","last_peered":"2024-05-08T18:29:51.701135+0000","last_clean":"2024-05-08T18:29:51.701135+0000","last_became_active":"2024-05-08T18:29:42.575450+0000","last_became_peered":"2024-05-08T18:29:42.575450+0000","last_unstale":"2024-05-08T18:29:51.701135+0000","last_undegraded":"2024-05-08T18:29:51.701135+0000","last_fullsized":"2024-05-08T18:29:51.701135+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:20.471010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.684269+0000","last_change":"2024-05-08T18:29:40.546101+0000","last_active":"2024-05-08T18:29:51.684269+0000","last_peered":"2024-05-08T18:29:51.684269+0000","last_clean":"2024-05-08T18:29:51.684269+0000","last_became_active":"2024-05-08T18:29:40.545814+0000","last_became_peered":"2024-05-08T18:29:40.545814+0000","last_unstale":"2024-05-08T18:29:51.684269+0000","last_undegraded":"2024-05-08T18:29:51.684269+0000","last_fullsized":"2024-05-08T18:29:51.684269+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:22.579629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.693391+0000","last_change":"2024-05-08T18:29:44.591310+0000","last_active":"2024-05-08T18:29:51.693391+0000","last_peered":"2024-05-08T18:29:51.693391+0000","last_clean":"2024-05-08T18:29:51.693391+0000","last_became_active":"2024-05-08T18:29:44.590394+0000","last_became_peered":"2024-05-08T18:29:44.590394+0000","last_unstale":"2024-05-08T18:29:51.693391+0000","last_undegraded":"2024-05-08T18:29:51.693391+0000","last_fullsized":"2024-05-08T18:29:51.693391+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:02:28.348982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"33'15","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:52.364274+0000","last_change":"2024-05-08T18:29:46.605887+0000","last_active":"2024-05-08T18:29:52.364274+0000","last_peered":"2024-05-08T18:29:52.364274+0000","last_clean":"2024-05-08T18:29:52.364274+0000","last_became_active":"2024-05-08T18:29:46.604917+0000","last_became_peered":"2024-05-08T18:29:46.604917+0000","last_unstale":"2024-05-08T18:29:52.364274+0000","last_undegraded":"2024-05-08T18:29:52.364274+0000","last_fullsized":"2024-05-08T18:29:52.364274+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:22:36.338527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.685147+0000","last_change":"2024-05-08T18:29:48.644420+0000","last_active":"2024-05-08T18:29:51.685147+0000","last_peered":"2024-05-08T18:29:51.685147+0000","last_clean":"2024-05-08T18:29:51.685147+0000","last_became_active":"2024-05-08T18:29:48.643493+0000","last_became_peered":"2024-05-08T18:29:48.643493+0000","last_unstale":"2024-05-08T18:29:51.685147+0000","last_undegraded":"2024-05-08T18:29:51.685147+0000","last_fullsized":"2024-05-08T18:29:51.685147+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:19:33.148012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.691654+0000","last_change":"2024-05-08T18:29:50.687485+0000","last_active":"2024-05-08T18:29:51.691654+0000","last_peered":"2024-05-08T18:29:51.691654+0000","last_clean":"2024-05-08T18:29:51.691654+0000","last_became_active":"2024-05-08T18:29:50.686750+0000","last_became_peered":"2024-05-08T18:29:50.686750+0000","last_unstale":"2024-05-08T18:29:51.691654+0000","last_undegraded":"2024-05-08T18:29:51.691654+0000","last_fullsized":"2024-05-08T18:29:51.691654+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:41.914164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.667159+0000","last_change":"2024-05-08T18:29:42.566571+0000","last_active":"2024-05-08T18:29:51.667159+0000","last_peered":"2024-05-08T18:29:51.667159+0000","last_clean":"2024-05-08T18:29:51.667159+0000","last_became_active":"2024-05-08T18:29:42.563695+0000","last_became_peered":"2024-05-08T18:29:42.563695+0000","last_unstale":"2024-05-08T18:29:51.667159+0000","last_undegraded":"2024-05-08T18:29:51.667159+0000","last_fullsized":"2024-05-08T18:29:51.667159+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:46.887628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.660300+0000","last_change":"2024-05-08T18:29:40.545512+0000","last_active":"2024-05-08T18:29:51.660300+0000","last_peered":"2024-05-08T18:29:51.660300+0000","last_clean":"2024-05-08T18:29:51.660300+0000","last_became_active":"2024-05-08T18:29:40.544216+0000","last_became_peered":"2024-05-08T18:29:40.544216+0000","last_unstale":"2024-05-08T18:29:51.660300+0000","last_undegraded":"2024-05-08T18:29:51.660300+0000","last_fullsized":"2024-05-08T18:29:51.660300+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:37:08.242362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.661019+0000","last_change":"2024-05-08T18:29:44.576107+0000","last_active":"2024-05-08T18:29:51.661019+0000","last_peered":"2024-05-08T18:29:51.661019+0000","last_clean":"2024-05-08T18:29:51.661019+0000","last_became_active":"2024-05-08T18:29:44.575344+0000","last_became_peered":"2024-05-08T18:29:44.575344+0000","last_unstale":"2024-05-08T18:29:51.661019+0000","last_undegraded":"2024-05-08T18:29:51.661019+0000","last_fullsized":"2024-05-08T18:29:51.661019+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:19.731003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"33'11","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:52.560499+0000","last_change":"2024-05-08T18:29:46.584785+0000","last_active":"2024-05-08T18:29:52.560499+0000","last_peered":"2024-05-08T18:29:52.560499+0000","last_clean":"2024-05-08T18:29:52.560499+0000","last_became_active":"2024-05-08T18:29:46.583390+0000","last_became_peered":"2024-05-08T18:29:46.583390+0000","last_unstale":"2024-05-08T18:29:52.560499+0000","last_undegraded":"2024-05-08T18:29:52.560499+0000","last_fullsized":"2024-05-08T18:29:52.560499+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:27:01.747339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.684171+0000","last_change":"2024-05-08T18:29:48.643558+0000","last_active":"2024-05-08T18:29:51.684171+0000","last_peered":"2024-05-08T18:29:51.684171+0000","last_clean":"2024-05-08T18:29:51.684171+0000","last_became_active":"2024-05-08T18:29:48.642773+0000","last_became_peered":"2024-05-08T18:29:48.642773+0000","last_unstale":"2024-05-08T18:29:51.684171+0000","last_undegraded":"2024-05-08T18:29:51.684171+0000","last_fullsized":"2024-05-08T18:29:51.684171+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:59:04.369806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.687638+0000","last_change":"2024-05-08T18:29:50.674796+0000","last_active":"2024-05-08T18:29:51.687638+0000","last_peered":"2024-05-08T18:29:51.687638+0000","last_clean":"2024-05-08T18:29:51.687638+0000","last_became_active":"2024-05-08T18:29:50.674057+0000","last_became_peered":"2024-05-08T18:29:50.674057+0000","last_unstale":"2024-05-08T18:29:51.687638+0000","last_undegraded":"2024-05-08T18:29:51.687638+0000","last_fullsized":"2024-05-08T18:29:51.687638+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:34:14.488295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.665122+0000","last_change":"2024-05-08T18:29:42.577642+0000","last_active":"2024-05-08T18:29:51.665122+0000","last_peered":"2024-05-08T18:29:51.665122+0000","last_clean":"2024-05-08T18:29:51.665122+0000","last_became_active":"2024-05-08T18:29:42.577275+0000","last_became_peered":"2024-05-08T18:29:42.577275+0000","last_unstale":"2024-05-08T18:29:51.665122+0000","last_undegraded":"2024-05-08T18:29:51.665122+0000","last_fullsized":"2024-05-08T18:29:51.665122+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:51:45.155037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.698805+0000","last_change":"2024-05-08T18:29:40.562873+0000","last_active":"2024-05-08T18:29:51.698805+0000","last_peered":"2024-05-08T18:29:51.698805+0000","last_clean":"2024-05-08T18:29:51.698805+0000","last_became_active":"2024-05-08T18:29:40.562594+0000","last_became_peered":"2024-05-08T18:29:40.562594+0000","last_unstale":"2024-05-08T18:29:51.698805+0000","last_undegraded":"2024-05-08T18:29:51.698805+0000","last_fullsized":"2024-05-08T18:29:51.698805+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:16:16.521258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.685433+0000","last_change":"2024-05-08T18:29:44.594152+0000","last_active":"2024-05-08T18:29:51.685433+0000","last_peered":"2024-05-08T18:29:51.685433+0000","last_clean":"2024-05-08T18:29:51.685433+0000","last_became_active":"2024-05-08T18:29:44.593398+0000","last_became_peered":"2024-05-08T18:29:44.593398+0000","last_unstale":"2024-05-08T18:29:51.685433+0000","last_undegraded":"2024-05-08T18:29:51.685433+0000","last_fullsized":"2024-05-08T18:29:51.685433+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:11.825480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"33'10","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:52.536162+0000","last_change":"2024-05-08T18:29:46.602137+0000","last_active":"2024-05-08T18:29:52.536162+0000","last_peered":"2024-05-08T18:29:52.536162+0000","last_clean":"2024-05-08T18:29:52.536162+0000","last_became_active":"2024-05-08T18:29:46.601402+0000","last_became_peered":"2024-05-08T18:29:46.601402+0000","last_unstale":"2024-05-08T18:29:52.536162+0000","last_undegraded":"2024-05-08T18:29:52.536162+0000","last_fullsized":"2024-05-08T18:29:52.536162+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:23.940519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"30'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.692948+0000","last_change":"2024-05-08T18:29:48.635696+0000","last_active":"2024-05-08T18:29:51.692948+0000","last_peered":"2024-05-08T18:29:51.692948+0000","last_clean":"2024-05-08T18:29:51.692948+0000","last_became_active":"2024-05-08T18:29:48.634859+0000","last_became_peered":"2024-05-08T18:29:48.634859+0000","last_unstale":"2024-05-08T18:29:51.692948+0000","last_undegraded":"2024-05-08T18:29:51.692948+0000","last_fullsized":"2024-05-08T18:29:51.692948+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:35:55.322495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.677021+0000","last_change":"2024-05-08T18:29:50.679757+0000","last_active":"2024-05-08T18:29:51.677021+0000","last_peered":"2024-05-08T18:29:51.677021+0000","last_clean":"2024-05-08T18:29:51.677021+0000","last_became_active":"2024-05-08T18:29:50.679011+0000","last_became_peered":"2024-05-08T18:29:50.679011+0000","last_unstale":"2024-05-08T18:29:51.677021+0000","last_undegraded":"2024-05-08T18:29:51.677021+0000","last_fullsized":"2024-05-08T18:29:51.677021+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:34:14.488295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.659577+0000","last_change":"2024-05-08T18:29:42.560354+0000","last_active":"2024-05-08T18:29:51.659577+0000","last_peered":"2024-05-08T18:29:51.659577+0000","last_clean":"2024-05-08T18:29:51.659577+0000","last_became_active":"2024-05-08T18:29:42.559647+0000","last_became_peered":"2024-05-08T18:29:42.559647+0000","last_unstale":"2024-05-08T18:29:51.659577+0000","last_undegraded":"2024-05-08T18:29:51.659577+0000","last_fullsized":"2024-05-08T18:29:51.659577+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:18:10.803989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.689747+0000","last_change":"2024-05-08T18:29:40.557683+0000","last_active":"2024-05-08T18:29:51.689747+0000","last_peered":"2024-05-08T18:29:51.689747+0000","last_clean":"2024-05-08T18:29:51.689747+0000","last_became_active":"2024-05-08T18:29:40.556254+0000","last_became_peered":"2024-05-08T18:29:40.556254+0000","last_unstale":"2024-05-08T18:29:51.689747+0000","last_undegraded":"2024-05-08T18:29:51.689747+0000","last_fullsized":"2024-05-08T18:29:51.689747+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:51:43.135322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.677671+0000","last_change":"2024-05-08T18:29:44.594068+0000","last_active":"2024-05-08T18:29:51.677671+0000","last_peered":"2024-05-08T18:29:51.677671+0000","last_clean":"2024-05-08T18:29:51.677671+0000","last_became_active":"2024-05-08T18:29:44.593322+0000","last_became_peered":"2024-05-08T18:29:44.593322+0000","last_unstale":"2024-05-08T18:29:51.677671+0000","last_undegraded":"2024-05-08T18:29:51.677671+0000","last_fullsized":"2024-05-08T18:29:51.677671+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:19.731003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"33'15","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:52.572003+0000","last_change":"2024-05-08T18:29:46.604700+0000","last_active":"2024-05-08T18:29:52.572003+0000","last_peered":"2024-05-08T18:29:52.572003+0000","last_clean":"2024-05-08T18:29:52.572003+0000","last_became_active":"2024-05-08T18:29:46.603885+0000","last_became_peered":"2024-05-08T18:29:46.603885+0000","last_unstale":"2024-05-08T18:29:52.572003+0000","last_undegraded":"2024-05-08T18:29:52.572003+0000","last_fullsized":"2024-05-08T18:29:52.572003+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:22:36.338527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.697759+0000","last_change":"2024-05-08T18:29:48.640814+0000","last_active":"2024-05-08T18:29:51.697759+0000","last_peered":"2024-05-08T18:29:51.697759+0000","last_clean":"2024-05-08T18:29:51.697759+0000","last_became_active":"2024-05-08T18:29:48.640046+0000","last_became_peered":"2024-05-08T18:29:48.640046+0000","last_unstale":"2024-05-08T18:29:51.697759+0000","last_undegraded":"2024-05-08T18:29:51.697759+0000","last_fullsized":"2024-05-08T18:29:51.697759+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:53:21.219706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.679673+0000","last_change":"2024-05-08T18:29:50.692688+0000","last_active":"2024-05-08T18:29:51.679673+0000","last_peered":"2024-05-08T18:29:51.679673+0000","last_clean":"2024-05-08T18:29:51.679673+0000","last_became_active":"2024-05-08T18:29:50.692123+0000","last_became_peered":"2024-05-08T18:29:50.692123+0000","last_unstale":"2024-05-08T18:29:51.679673+0000","last_undegraded":"2024-05-08T18:29:51.679673+0000","last_fullsized":"2024-05-08T18:29:51.679673+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:38.318890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.659950+0000","last_change":"2024-05-08T18:29:42.558336+0000","last_active":"2024-05-08T18:29:51.659950+0000","last_peered":"2024-05-08T18:29:51.659950+0000","last_clean":"2024-05-08T18:29:51.659950+0000","last_became_active":"2024-05-08T18:29:42.557570+0000","last_became_peered":"2024-05-08T18:29:42.557570+0000","last_unstale":"2024-05-08T18:29:51.659950+0000","last_undegraded":"2024-05-08T18:29:51.659950+0000","last_fullsized":"2024-05-08T18:29:51.659950+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:54:16.539832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.690281+0000","last_change":"2024-05-08T18:29:40.537090+0000","last_active":"2024-05-08T18:29:51.690281+0000","last_peered":"2024-05-08T18:29:51.690281+0000","last_clean":"2024-05-08T18:29:51.690281+0000","last_became_active":"2024-05-08T18:29:40.536188+0000","last_became_peered":"2024-05-08T18:29:40.536188+0000","last_unstale":"2024-05-08T18:29:51.690281+0000","last_undegraded":"2024-05-08T18:29:51.690281+0000","last_fullsized":"2024-05-08T18:29:51.690281+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:22:48.880581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.688881+0000","last_change":"2024-05-08T18:29:44.578901+0000","last_active":"2024-05-08T18:29:51.688881+0000","last_peered":"2024-05-08T18:29:51.688881+0000","last_clean":"2024-05-08T18:29:51.688881+0000","last_became_active":"2024-05-08T18:29:44.578171+0000","last_became_peered":"2024-05-08T18:29:44.578171+0000","last_unstale":"2024-05-08T18:29:51.688881+0000","last_undegraded":"2024-05-08T18:29:51.688881+0000","last_fullsized":"2024-05-08T18:29:51.688881+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:19.731003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"33'9","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.971657+0000","last_change":"2024-05-08T18:29:46.604539+0000","last_active":"2024-05-08T18:29:51.971657+0000","last_peered":"2024-05-08T18:29:51.971657+0000","last_clean":"2024-05-08T18:29:51.971657+0000","last_became_active":"2024-05-08T18:29:46.603728+0000","last_became_peered":"2024-05-08T18:29:46.603728+0000","last_unstale":"2024-05-08T18:29:51.971657+0000","last_undegraded":"2024-05-08T18:29:51.971657+0000","last_fullsized":"2024-05-08T18:29:51.971657+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:12:41.226788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.691293+0000","last_change":"2024-05-08T18:29:48.635813+0000","last_active":"2024-05-08T18:29:51.691293+0000","last_peered":"2024-05-08T18:29:51.691293+0000","last_clean":"2024-05-08T18:29:51.691293+0000","last_became_active":"2024-05-08T18:29:48.634664+0000","last_became_peered":"2024-05-08T18:29:48.634664+0000","last_unstale":"2024-05-08T18:29:51.691293+0000","last_undegraded":"2024-05-08T18:29:51.691293+0000","last_fullsized":"2024-05-08T18:29:51.691293+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:27:23.427365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.668159+0000","last_change":"2024-05-08T18:29:50.687517+0000","last_active":"2024-05-08T18:29:51.668159+0000","last_peered":"2024-05-08T18:29:51.668159+0000","last_clean":"2024-05-08T18:29:51.668159+0000","last_became_active":"2024-05-08T18:29:50.686662+0000","last_became_peered":"2024-05-08T18:29:50.686662+0000","last_unstale":"2024-05-08T18:29:51.668159+0000","last_undegraded":"2024-05-08T18:29:51.668159+0000","last_fullsized":"2024-05-08T18:29:51.668159+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:58:00.455559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.664674+0000","last_change":"2024-05-08T18:29:42.558848+0000","last_active":"2024-05-08T18:29:51.664674+0000","last_peered":"2024-05-08T18:29:51.664674+0000","last_clean":"2024-05-08T18:29:51.664674+0000","last_became_active":"2024-05-08T18:29:42.558390+0000","last_became_peered":"2024-05-08T18:29:42.558390+0000","last_unstale":"2024-05-08T18:29:51.664674+0000","last_undegraded":"2024-05-08T18:29:51.664674+0000","last_fullsized":"2024-05-08T18:29:51.664674+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:55:30.468069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.668785+0000","last_change":"2024-05-08T18:29:40.567772+0000","last_active":"2024-05-08T18:29:51.668785+0000","last_peered":"2024-05-08T18:29:51.668785+0000","last_clean":"2024-05-08T18:29:51.668785+0000","last_became_active":"2024-05-08T18:29:40.567482+0000","last_became_peered":"2024-05-08T18:29:40.567482+0000","last_unstale":"2024-05-08T18:29:51.668785+0000","last_undegraded":"2024-05-08T18:29:51.668785+0000","last_fullsized":"2024-05-08T18:29:51.668785+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:36:37.796095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.658329+0000","last_change":"2024-05-08T18:29:44.596876+0000","last_active":"2024-05-08T18:29:51.658329+0000","last_peered":"2024-05-08T18:29:51.658329+0000","last_clean":"2024-05-08T18:29:51.658329+0000","last_became_active":"2024-05-08T18:29:44.595712+0000","last_became_peered":"2024-05-08T18:29:44.595712+0000","last_unstale":"2024-05-08T18:29:51.658329+0000","last_undegraded":"2024-05-08T18:29:51.658329+0000","last_fullsized":"2024-05-08T18:29:51.658329+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:35:51.288126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"33'5","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:52.194840+0000","last_change":"2024-05-08T18:29:46.598637+0000","last_active":"2024-05-08T18:29:52.194840+0000","last_peered":"2024-05-08T18:29:52.194840+0000","last_clean":"2024-05-08T18:29:52.194840+0000","last_became_active":"2024-05-08T18:29:46.597394+0000","last_became_peered":"2024-05-08T18:29:46.597394+0000","last_unstale":"2024-05-08T18:29:52.194840+0000","last_undegraded":"2024-05-08T18:29:52.194840+0000","last_fullsized":"2024-05-08T18:29:52.194840+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:52:22.540814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.658900+0000","last_change":"2024-05-08T18:29:48.642251+0000","last_active":"2024-05-08T18:29:51.658900+0000","last_peered":"2024-05-08T18:29:51.658900+0000","last_clean":"2024-05-08T18:29:51.658900+0000","last_became_active":"2024-05-08T18:29:48.641666+0000","last_became_peered":"2024-05-08T18:29:48.641666+0000","last_unstale":"2024-05-08T18:29:51.658900+0000","last_undegraded":"2024-05-08T18:29:51.658900+0000","last_fullsized":"2024-05-08T18:29:51.658900+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:13:50.865474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.679200+0000","last_change":"2024-05-08T18:29:50.685668+0000","last_active":"2024-05-08T18:29:51.679200+0000","last_peered":"2024-05-08T18:29:51.679200+0000","last_clean":"2024-05-08T18:29:51.679200+0000","last_became_active":"2024-05-08T18:29:50.684958+0000","last_became_peered":"2024-05-08T18:29:50.684958+0000","last_unstale":"2024-05-08T18:29:51.679200+0000","last_undegraded":"2024-05-08T18:29:51.679200+0000","last_fullsized":"2024-05-08T18:29:51.679200+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:55:01.894779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.658929+0000","last_change":"2024-05-08T18:29:42.562063+0000","last_active":"2024-05-08T18:29:51.658929+0000","last_peered":"2024-05-08T18:29:51.658929+0000","last_clean":"2024-05-08T18:29:51.658929+0000","last_became_active":"2024-05-08T18:29:42.558871+0000","last_became_peered":"2024-05-08T18:29:42.558871+0000","last_unstale":"2024-05-08T18:29:51.658929+0000","last_undegraded":"2024-05-08T18:29:51.658929+0000","last_fullsized":"2024-05-08T18:29:51.658929+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:59.243324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.701156+0000","last_change":"2024-05-08T18:29:40.541070+0000","last_active":"2024-05-08T18:29:51.701156+0000","last_peered":"2024-05-08T18:29:51.701156+0000","last_clean":"2024-05-08T18:29:51.701156+0000","last_became_active":"2024-05-08T18:29:40.540767+0000","last_became_peered":"2024-05-08T18:29:40.540767+0000","last_unstale":"2024-05-08T18:29:51.701156+0000","last_undegraded":"2024-05-08T18:29:51.701156+0000","last_fullsized":"2024-05-08T18:29:51.701156+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:09:39.835826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"26'1","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.683200+0000","last_change":"2024-05-08T18:29:44.592737+0000","last_active":"2024-05-08T18:29:51.683200+0000","last_peered":"2024-05-08T18:29:51.683200+0000","last_clean":"2024-05-08T18:29:51.683200+0000","last_became_active":"2024-05-08T18:29:44.592243+0000","last_became_peered":"2024-05-08T18:29:44.592243+0000","last_unstale":"2024-05-08T18:29:51.683200+0000","last_undegraded":"2024-05-08T18:29:51.683200+0000","last_fullsized":"2024-05-08T18:29:51.683200+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:59.744050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"33'9","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:52.256050+0000","last_change":"2024-05-08T18:29:46.610835+0000","last_active":"2024-05-08T18:29:52.256050+0000","last_peered":"2024-05-08T18:29:52.256050+0000","last_clean":"2024-05-08T18:29:52.256050+0000","last_became_active":"2024-05-08T18:29:46.609903+0000","last_became_peered":"2024-05-08T18:29:46.609903+0000","last_unstale":"2024-05-08T18:29:52.256050+0000","last_undegraded":"2024-05-08T18:29:52.256050+0000","last_fullsized":"2024-05-08T18:29:52.256050+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:37:35.850414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.698582+0000","last_change":"2024-05-08T18:29:48.629822+0000","last_active":"2024-05-08T18:29:51.698582+0000","last_peered":"2024-05-08T18:29:51.698582+0000","last_clean":"2024-05-08T18:29:51.698582+0000","last_became_active":"2024-05-08T18:29:48.629204+0000","last_became_peered":"2024-05-08T18:29:48.629204+0000","last_unstale":"2024-05-08T18:29:51.698582+0000","last_undegraded":"2024-05-08T18:29:51.698582+0000","last_fullsized":"2024-05-08T18:29:51.698582+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:04.571608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.661296+0000","last_change":"2024-05-08T18:29:50.668101+0000","last_active":"2024-05-08T18:29:51.661296+0000","last_peered":"2024-05-08T18:29:51.661296+0000","last_clean":"2024-05-08T18:29:51.661296+0000","last_became_active":"2024-05-08T18:29:50.667357+0000","last_became_peered":"2024-05-08T18:29:50.667357+0000","last_unstale":"2024-05-08T18:29:51.661296+0000","last_undegraded":"2024-05-08T18:29:51.661296+0000","last_fullsized":"2024-05-08T18:29:51.661296+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:55:01.894779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.684828+0000","last_change":"2024-05-08T18:29:42.581366+0000","last_active":"2024-05-08T18:29:51.684828+0000","last_peered":"2024-05-08T18:29:51.684828+0000","last_clean":"2024-05-08T18:29:51.684828+0000","last_became_active":"2024-05-08T18:29:42.580988+0000","last_became_peered":"2024-05-08T18:29:42.580988+0000","last_unstale":"2024-05-08T18:29:51.684828+0000","last_undegraded":"2024-05-08T18:29:51.684828+0000","last_fullsized":"2024-05-08T18:29:51.684828+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:42.005809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.690950+0000","last_change":"2024-05-08T18:29:40.562025+0000","last_active":"2024-05-08T18:29:51.690950+0000","last_peered":"2024-05-08T18:29:51.690950+0000","last_clean":"2024-05-08T18:29:51.690950+0000","last_became_active":"2024-05-08T18:29:40.561277+0000","last_became_peered":"2024-05-08T18:29:40.561277+0000","last_unstale":"2024-05-08T18:29:51.690950+0000","last_undegraded":"2024-05-08T18:29:51.690950+0000","last_fullsized":"2024-05-08T18:29:51.690950+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:59:25.840149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.684728+0000","last_change":"2024-05-08T18:29:42.573832+0000","last_active":"2024-05-08T18:29:51.684728+0000","last_peered":"2024-05-08T18:29:51.684728+0000","last_clean":"2024-05-08T18:29:51.684728+0000","last_became_active":"2024-05-08T18:29:42.573502+0000","last_became_peered":"2024-05-08T18:29:42.573502+0000","last_unstale":"2024-05-08T18:29:51.684728+0000","last_undegraded":"2024-05-08T18:29:51.684728+0000","last_fullsized":"2024-05-08T18:29:51.684728+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:35.037465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.661888+0000","last_change":"2024-05-08T18:29:40.533094+0000","last_active":"2024-05-08T18:29:51.661888+0000","last_peered":"2024-05-08T18:29:51.661888+0000","last_clean":"2024-05-08T18:29:51.661888+0000","last_became_active":"2024-05-08T18:29:40.532246+0000","last_became_peered":"2024-05-08T18:29:40.532246+0000","last_unstale":"2024-05-08T18:29:51.661888+0000","last_undegraded":"2024-05-08T18:29:51.661888+0000","last_fullsized":"2024-05-08T18:29:51.661888+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:37:08.242362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.690748+0000","last_change":"2024-05-08T18:29:42.565298+0000","last_active":"2024-05-08T18:29:51.690748+0000","last_peered":"2024-05-08T18:29:51.690748+0000","last_clean":"2024-05-08T18:29:51.690748+0000","last_became_active":"2024-05-08T18:29:42.564542+0000","last_became_peered":"2024-05-08T18:29:42.564542+0000","last_unstale":"2024-05-08T18:29:51.690748+0000","last_undegraded":"2024-05-08T18:29:51.690748+0000","last_fullsized":"2024-05-08T18:29:51.690748+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:57.706167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.688543+0000","last_change":"2024-05-08T18:29:40.556958+0000","last_active":"2024-05-08T18:29:51.688543+0000","last_peered":"2024-05-08T18:29:51.688543+0000","last_clean":"2024-05-08T18:29:51.688543+0000","last_became_active":"2024-05-08T18:29:40.556091+0000","last_became_peered":"2024-05-08T18:29:40.556091+0000","last_unstale":"2024-05-08T18:29:51.688543+0000","last_undegraded":"2024-05-08T18:29:51.688543+0000","last_fullsized":"2024-05-08T18:29:51.688543+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:39.986094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.684744+0000","last_change":"2024-05-08T18:29:42.574619+0000","last_active":"2024-05-08T18:29:51.684744+0000","last_peered":"2024-05-08T18:29:51.684744+0000","last_clean":"2024-05-08T18:29:51.684744+0000","last_became_active":"2024-05-08T18:29:42.573178+0000","last_became_peered":"2024-05-08T18:29:42.573178+0000","last_unstale":"2024-05-08T18:29:51.684744+0000","last_undegraded":"2024-05-08T18:29:51.684744+0000","last_fullsized":"2024-05-08T18:29:51.684744+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:33.139089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.699153+0000","last_change":"2024-05-08T18:29:40.544338+0000","last_active":"2024-05-08T18:29:51.699153+0000","last_peered":"2024-05-08T18:29:51.699153+0000","last_clean":"2024-05-08T18:29:51.699153+0000","last_became_active":"2024-05-08T18:29:40.544107+0000","last_became_peered":"2024-05-08T18:29:40.544107+0000","last_unstale":"2024-05-08T18:29:51.699153+0000","last_undegraded":"2024-05-08T18:29:51.699153+0000","last_fullsized":"2024-05-08T18:29:51.699153+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:54.200883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.667002+0000","last_change":"2024-05-08T18:29:42.576979+0000","last_active":"2024-05-08T18:29:51.667002+0000","last_peered":"2024-05-08T18:29:51.667002+0000","last_clean":"2024-05-08T18:29:51.667002+0000","last_became_active":"2024-05-08T18:29:42.576395+0000","last_became_peered":"2024-05-08T18:29:42.576395+0000","last_unstale":"2024-05-08T18:29:51.667002+0000","last_undegraded":"2024-05-08T18:29:51.667002+0000","last_fullsized":"2024-05-08T18:29:51.667002+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:53:03.097704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.668355+0000","last_change":"2024-05-08T18:29:40.558142+0000","last_active":"2024-05-08T18:29:51.668355+0000","last_peered":"2024-05-08T18:29:51.668355+0000","last_clean":"2024-05-08T18:29:51.668355+0000","last_became_active":"2024-05-08T18:29:40.557874+0000","last_became_peered":"2024-05-08T18:29:40.557874+0000","last_unstale":"2024-05-08T18:29:51.668355+0000","last_undegraded":"2024-05-08T18:29:51.668355+0000","last_fullsized":"2024-05-08T18:29:51.668355+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:54.200883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.661040+0000","last_change":"2024-05-08T18:29:42.558324+0000","last_active":"2024-05-08T18:29:51.661040+0000","last_peered":"2024-05-08T18:29:51.661040+0000","last_clean":"2024-05-08T18:29:51.661040+0000","last_became_active":"2024-05-08T18:29:42.556774+0000","last_became_peered":"2024-05-08T18:29:42.556774+0000","last_unstale":"2024-05-08T18:29:51.661040+0000","last_undegraded":"2024-05-08T18:29:51.661040+0000","last_fullsized":"2024-05-08T18:29:51.661040+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:02:26.311100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.685803+0000","last_change":"2024-05-08T18:29:40.545648+0000","last_active":"2024-05-08T18:29:51.685803+0000","last_peered":"2024-05-08T18:29:51.685803+0000","last_clean":"2024-05-08T18:29:51.685803+0000","last_became_active":"2024-05-08T18:29:40.545382+0000","last_became_peered":"2024-05-08T18:29:40.545382+0000","last_unstale":"2024-05-08T18:29:51.685803+0000","last_undegraded":"2024-05-08T18:29:51.685803+0000","last_fullsized":"2024-05-08T18:29:51.685803+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:17:47.828990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.664068+0000","last_change":"2024-05-08T18:29:42.562772+0000","last_active":"2024-05-08T18:29:51.664068+0000","last_peered":"2024-05-08T18:29:51.664068+0000","last_clean":"2024-05-08T18:29:51.664068+0000","last_became_active":"2024-05-08T18:29:42.562420+0000","last_became_peered":"2024-05-08T18:29:42.562420+0000","last_unstale":"2024-05-08T18:29:51.664068+0000","last_undegraded":"2024-05-08T18:29:51.664068+0000","last_fullsized":"2024-05-08T18:29:51.664068+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:30:29.452640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.693183+0000","last_change":"2024-05-08T18:29:40.562024+0000","last_active":"2024-05-08T18:29:51.693183+0000","last_peered":"2024-05-08T18:29:51.693183+0000","last_clean":"2024-05-08T18:29:51.693183+0000","last_became_active":"2024-05-08T18:29:40.561326+0000","last_became_peered":"2024-05-08T18:29:40.561326+0000","last_unstale":"2024-05-08T18:29:51.693183+0000","last_undegraded":"2024-05-08T18:29:51.693183+0000","last_fullsized":"2024-05-08T18:29:51.693183+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:21:38.354933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.690860+0000","last_change":"2024-05-08T18:29:42.561419+0000","last_active":"2024-05-08T18:29:51.690860+0000","last_peered":"2024-05-08T18:29:51.690860+0000","last_clean":"2024-05-08T18:29:51.690860+0000","last_became_active":"2024-05-08T18:29:42.560520+0000","last_became_peered":"2024-05-08T18:29:42.560520+0000","last_unstale":"2024-05-08T18:29:51.690860+0000","last_undegraded":"2024-05-08T18:29:51.690860+0000","last_fullsized":"2024-05-08T18:29:51.690860+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:07.949520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.668806+0000","last_change":"2024-05-08T18:29:40.554884+0000","last_active":"2024-05-08T18:29:51.668806+0000","last_peered":"2024-05-08T18:29:51.668806+0000","last_clean":"2024-05-08T18:29:51.668806+0000","last_became_active":"2024-05-08T18:29:40.554603+0000","last_became_peered":"2024-05-08T18:29:40.554603+0000","last_unstale":"2024-05-08T18:29:51.668806+0000","last_undegraded":"2024-05-08T18:29:51.668806+0000","last_fullsized":"2024-05-08T18:29:51.668806+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:09:39.835826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.701114+0000","last_change":"2024-05-08T18:29:42.574689+0000","last_active":"2024-05-08T18:29:51.701114+0000","last_peered":"2024-05-08T18:29:51.701114+0000","last_clean":"2024-05-08T18:29:51.701114+0000","last_became_active":"2024-05-08T18:29:42.573947+0000","last_became_peered":"2024-05-08T18:29:42.573947+0000","last_unstale":"2024-05-08T18:29:51.701114+0000","last_undegraded":"2024-05-08T18:29:51.701114+0000","last_fullsized":"2024-05-08T18:29:51.701114+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:57:14.869860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.688629+0000","last_change":"2024-05-08T18:29:40.554005+0000","last_active":"2024-05-08T18:29:51.688629+0000","last_peered":"2024-05-08T18:29:51.688629+0000","last_clean":"2024-05-08T18:29:51.688629+0000","last_became_active":"2024-05-08T18:29:40.553356+0000","last_became_peered":"2024-05-08T18:29:40.553356+0000","last_unstale":"2024-05-08T18:29:51.688629+0000","last_undegraded":"2024-05-08T18:29:51.688629+0000","last_fullsized":"2024-05-08T18:29:51.688629+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:08:13.006752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.661404+0000","last_change":"2024-05-08T18:29:42.566487+0000","last_active":"2024-05-08T18:29:51.661404+0000","last_peered":"2024-05-08T18:29:51.661404+0000","last_clean":"2024-05-08T18:29:51.661404+0000","last_became_active":"2024-05-08T18:29:42.565760+0000","last_became_peered":"2024-05-08T18:29:42.565760+0000","last_unstale":"2024-05-08T18:29:51.661404+0000","last_undegraded":"2024-05-08T18:29:51.661404+0000","last_fullsized":"2024-05-08T18:29:51.661404+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:57.706167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.664896+0000","last_change":"2024-05-08T18:29:40.552543+0000","last_active":"2024-05-08T18:29:51.664896+0000","last_peered":"2024-05-08T18:29:51.664896+0000","last_clean":"2024-05-08T18:29:51.664896+0000","last_became_active":"2024-05-08T18:29:40.552307+0000","last_became_peered":"2024-05-08T18:29:40.552307+0000","last_unstale":"2024-05-08T18:29:51.664896+0000","last_undegraded":"2024-05-08T18:29:51.664896+0000","last_fullsized":"2024-05-08T18:29:51.664896+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:48.294532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.664730+0000","last_change":"2024-05-08T18:29:42.561658+0000","last_active":"2024-05-08T18:29:51.664730+0000","last_peered":"2024-05-08T18:29:51.664730+0000","last_clean":"2024-05-08T18:29:51.664730+0000","last_became_active":"2024-05-08T18:29:42.561171+0000","last_became_peered":"2024-05-08T18:29:42.561171+0000","last_unstale":"2024-05-08T18:29:51.664730+0000","last_undegraded":"2024-05-08T18:29:51.664730+0000","last_fullsized":"2024-05-08T18:29:51.664730+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:15.966061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.688335+0000","last_change":"2024-05-08T18:29:40.543041+0000","last_active":"2024-05-08T18:29:51.688335+0000","last_peered":"2024-05-08T18:29:51.688335+0000","last_clean":"2024-05-08T18:29:51.688335+0000","last_became_active":"2024-05-08T18:29:40.542398+0000","last_became_peered":"2024-05-08T18:29:40.542398+0000","last_unstale":"2024-05-08T18:29:51.688335+0000","last_undegraded":"2024-05-08T18:29:51.688335+0000","last_fullsized":"2024-05-08T18:29:51.688335+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:33.017750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.660711+0000","last_change":"2024-05-08T18:29:42.579690+0000","last_active":"2024-05-08T18:29:51.660711+0000","last_peered":"2024-05-08T18:29:51.660711+0000","last_clean":"2024-05-08T18:29:51.660711+0000","last_became_active":"2024-05-08T18:29:42.578981+0000","last_became_peered":"2024-05-08T18:29:42.578981+0000","last_unstale":"2024-05-08T18:29:51.660711+0000","last_undegraded":"2024-05-08T18:29:51.660711+0000","last_fullsized":"2024-05-08T18:29:51.660711+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:36:03.084561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.699458+0000","last_change":"2024-05-08T18:29:40.548499+0000","last_active":"2024-05-08T18:29:51.699458+0000","last_peered":"2024-05-08T18:29:51.699458+0000","last_clean":"2024-05-08T18:29:51.699458+0000","last_became_active":"2024-05-08T18:29:40.548177+0000","last_became_peered":"2024-05-08T18:29:40.548177+0000","last_unstale":"2024-05-08T18:29:51.699458+0000","last_undegraded":"2024-05-08T18:29:51.699458+0000","last_fullsized":"2024-05-08T18:29:51.699458+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:27:41.414153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.678185+0000","last_change":"2024-05-08T18:29:42.575892+0000","last_active":"2024-05-08T18:29:51.678185+0000","last_peered":"2024-05-08T18:29:51.678185+0000","last_clean":"2024-05-08T18:29:51.678185+0000","last_became_active":"2024-05-08T18:29:42.573384+0000","last_became_peered":"2024-05-08T18:29:42.573384+0000","last_unstale":"2024-05-08T18:29:51.678185+0000","last_undegraded":"2024-05-08T18:29:51.678185+0000","last_fullsized":"2024-05-08T18:29:51.678185+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:55.055481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.692302+0000","last_change":"2024-05-08T18:29:40.565068+0000","last_active":"2024-05-08T18:29:51.692302+0000","last_peered":"2024-05-08T18:29:51.692302+0000","last_clean":"2024-05-08T18:29:51.692302+0000","last_became_active":"2024-05-08T18:29:40.563231+0000","last_became_peered":"2024-05-08T18:29:40.563231+0000","last_unstale":"2024-05-08T18:29:51.692302+0000","last_undegraded":"2024-05-08T18:29:51.692302+0000","last_fullsized":"2024-05-08T18:29:51.692302+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:17:47.828990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.698486+0000","last_change":"2024-05-08T18:29:42.564338+0000","last_active":"2024-05-08T18:29:51.698486+0000","last_peered":"2024-05-08T18:29:51.698486+0000","last_clean":"2024-05-08T18:29:51.698486+0000","last_became_active":"2024-05-08T18:29:42.563822+0000","last_became_peered":"2024-05-08T18:29:42.563822+0000","last_unstale":"2024-05-08T18:29:51.698486+0000","last_undegraded":"2024-05-08T18:29:51.698486+0000","last_fullsized":"2024-05-08T18:29:51.698486+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:23.397435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.679731+0000","last_change":"2024-05-08T18:29:40.573333+0000","last_active":"2024-05-08T18:29:51.679731+0000","last_peered":"2024-05-08T18:29:51.679731+0000","last_clean":"2024-05-08T18:29:51.679731+0000","last_became_active":"2024-05-08T18:29:40.571195+0000","last_became_peered":"2024-05-08T18:29:40.571195+0000","last_unstale":"2024-05-08T18:29:51.679731+0000","last_undegraded":"2024-05-08T18:29:51.679731+0000","last_fullsized":"2024-05-08T18:29:51.679731+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:33.017750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.663784+0000","last_change":"2024-05-08T18:29:42.563085+0000","last_active":"2024-05-08T18:29:51.663784+0000","last_peered":"2024-05-08T18:29:51.663784+0000","last_clean":"2024-05-08T18:29:51.663784+0000","last_became_active":"2024-05-08T18:29:42.560419+0000","last_became_peered":"2024-05-08T18:29:42.560419+0000","last_unstale":"2024-05-08T18:29:51.663784+0000","last_undegraded":"2024-05-08T18:29:51.663784+0000","last_fullsized":"2024-05-08T18:29:51.663784+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:20.397730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.665785+0000","last_change":"2024-05-08T18:29:40.568890+0000","last_active":"2024-05-08T18:29:51.665785+0000","last_peered":"2024-05-08T18:29:51.665785+0000","last_clean":"2024-05-08T18:29:51.665785+0000","last_became_active":"2024-05-08T18:29:40.568584+0000","last_became_peered":"2024-05-08T18:29:40.568584+0000","last_unstale":"2024-05-08T18:29:51.665785+0000","last_undegraded":"2024-05-08T18:29:51.665785+0000","last_fullsized":"2024-05-08T18:29:51.665785+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:25:01.595224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.677213+0000","last_change":"2024-05-08T18:29:42.574277+0000","last_active":"2024-05-08T18:29:51.677213+0000","last_peered":"2024-05-08T18:29:51.677213+0000","last_clean":"2024-05-08T18:29:51.677213+0000","last_became_active":"2024-05-08T18:29:42.573563+0000","last_became_peered":"2024-05-08T18:29:42.573563+0000","last_unstale":"2024-05-08T18:29:51.677213+0000","last_undegraded":"2024-05-08T18:29:51.677213+0000","last_fullsized":"2024-05-08T18:29:51.677213+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:57.706167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.692029+0000","last_change":"2024-05-08T18:29:40.562058+0000","last_active":"2024-05-08T18:29:51.692029+0000","last_peered":"2024-05-08T18:29:51.692029+0000","last_clean":"2024-05-08T18:29:51.692029+0000","last_became_active":"2024-05-08T18:29:40.561360+0000","last_became_peered":"2024-05-08T18:29:40.561360+0000","last_unstale":"2024-05-08T18:29:51.692029+0000","last_undegraded":"2024-05-08T18:29:51.692029+0000","last_fullsized":"2024-05-08T18:29:51.692029+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:05.929806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.688414+0000","last_change":"2024-05-08T18:29:40.538728+0000","last_active":"2024-05-08T18:29:51.688414+0000","last_peered":"2024-05-08T18:29:51.688414+0000","last_clean":"2024-05-08T18:29:51.688414+0000","last_became_active":"2024-05-08T18:29:40.537925+0000","last_became_peered":"2024-05-08T18:29:40.537925+0000","last_unstale":"2024-05-08T18:29:51.688414+0000","last_undegraded":"2024-05-08T18:29:51.688414+0000","last_fullsized":"2024-05-08T18:29:51.688414+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:28.426657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.700915+0000","last_change":"2024-05-08T18:29:42.574941+0000","last_active":"2024-05-08T18:29:51.700915+0000","last_peered":"2024-05-08T18:29:51.700915+0000","last_clean":"2024-05-08T18:29:51.700915+0000","last_became_active":"2024-05-08T18:29:42.574351+0000","last_became_peered":"2024-05-08T18:29:42.574351+0000","last_unstale":"2024-05-08T18:29:51.700915+0000","last_undegraded":"2024-05-08T18:29:51.700915+0000","last_fullsized":"2024-05-08T18:29:51.700915+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:21.935293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.684116+0000","last_change":"2024-05-08T18:29:40.543714+0000","last_active":"2024-05-08T18:29:51.684116+0000","last_peered":"2024-05-08T18:29:51.684116+0000","last_clean":"2024-05-08T18:29:51.684116+0000","last_became_active":"2024-05-08T18:29:40.542965+0000","last_became_peered":"2024-05-08T18:29:40.542965+0000","last_unstale":"2024-05-08T18:29:51.684116+0000","last_undegraded":"2024-05-08T18:29:51.684116+0000","last_fullsized":"2024-05-08T18:29:51.684116+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:12:59.146887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.690372+0000","last_change":"2024-05-08T18:29:42.560007+0000","last_active":"2024-05-08T18:29:51.690372+0000","last_peered":"2024-05-08T18:29:51.690372+0000","last_clean":"2024-05-08T18:29:51.690372+0000","last_became_active":"2024-05-08T18:29:42.559028+0000","last_became_peered":"2024-05-08T18:29:42.559028+0000","last_unstale":"2024-05-08T18:29:51.690372+0000","last_undegraded":"2024-05-08T18:29:51.690372+0000","last_fullsized":"2024-05-08T18:29:51.690372+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:36:03.084561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":178,"num_object_clones":0,"num_object_copies":356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":178,"num_whiteouts":0,"num_read":688,"num_read_kb":447,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":387,"ondisk_log_size":387,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509451,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32156,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339684,"statfs":{"total":96636764160,"available":96603836416,"internally_reserved":0,"allocated":1003520,"data_stored":751197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509451,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":385024,"data_stored":160169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509449,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31596,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340244,"statfs":{"total":96636764160,"available":96604409856,"internally_reserved":0,"allocated":430080,"data_stored":160997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509449,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":372736,"data_stored":159667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542154,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":401408,"data_stored":160565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542154,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":380928,"data_stored":161160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542152,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":160419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542154,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27984,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343856,"statfs":{"total":96636764160,"available":96608108544,"internally_reserved":0,"allocated":991232,"data_stored":752032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T18:29:58.621 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T18:29:58.936 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-05-08T18:29:58.942 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2024-05-08T18:29:58.951 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":42,"stamp":"2024-05-08T18:29:57.410321+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595683,"num_objects":194,"num_object_clones":0,"num_object_copies":388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":194,"num_whiteouts":0,"num_read":758,"num_read_kb":506,"num_write":528,"num_write_kb":1668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":481,"ondisk_log_size":481,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":228732,"kb_used_data":4264,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754745988,"statfs":{"total":773094113280,"available":772859891712,"internally_reserved":0,"allocated":4366336,"data_stored":2466206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":229756465},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3702,"num_objects":186,"num_object_clones":0,"num_object_copies":372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":186,"num_whiteouts":0,"num_read":688,"num_read_kb":447,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.772345"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.679147+0000","last_change":"2024-05-08T18:29:40.574221+0000","last_active":"2024-05-08T18:29:51.679147+0000","last_peered":"2024-05-08T18:29:51.679147+0000","last_clean":"2024-05-08T18:29:51.679147+0000","last_became_active":"2024-05-08T18:29:40.573543+0000","last_became_peered":"2024-05-08T18:29:40.573543+0000","last_unstale":"2024-05-08T18:29:51.679147+0000","last_undegraded":"2024-05-08T18:29:51.679147+0000","last_fullsized":"2024-05-08T18:29:51.679147+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:57.223609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.687586+0000","last_change":"2024-05-08T18:29:42.563773+0000","last_active":"2024-05-08T18:29:51.687586+0000","last_peered":"2024-05-08T18:29:51.687586+0000","last_clean":"2024-05-08T18:29:51.687586+0000","last_became_active":"2024-05-08T18:29:42.561201+0000","last_became_peered":"2024-05-08T18:29:42.561201+0000","last_unstale":"2024-05-08T18:29:51.687586+0000","last_undegraded":"2024-05-08T18:29:51.687586+0000","last_fullsized":"2024-05-08T18:29:51.687586+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:55.055481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.684938+0000","last_change":"2024-05-08T18:29:40.549299+0000","last_active":"2024-05-08T18:29:51.684938+0000","last_peered":"2024-05-08T18:29:51.684938+0000","last_clean":"2024-05-08T18:29:51.684938+0000","last_became_active":"2024-05-08T18:29:40.548930+0000","last_became_peered":"2024-05-08T18:29:40.548930+0000","last_unstale":"2024-05-08T18:29:51.684938+0000","last_undegraded":"2024-05-08T18:29:51.684938+0000","last_fullsized":"2024-05-08T18:29:51.684938+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:06:36.198647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.678031+0000","last_change":"2024-05-08T18:29:42.572074+0000","last_active":"2024-05-08T18:29:51.678031+0000","last_peered":"2024-05-08T18:29:51.678031+0000","last_clean":"2024-05-08T18:29:51.678031+0000","last_became_active":"2024-05-08T18:29:42.571344+0000","last_became_peered":"2024-05-08T18:29:42.571344+0000","last_unstale":"2024-05-08T18:29:51.678031+0000","last_undegraded":"2024-05-08T18:29:51.678031+0000","last_fullsized":"2024-05-08T18:29:51.678031+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:36.890277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.700274+0000","last_change":"2024-05-08T18:29:40.539048+0000","last_active":"2024-05-08T18:29:51.700274+0000","last_peered":"2024-05-08T18:29:51.700274+0000","last_clean":"2024-05-08T18:29:51.700274+0000","last_became_active":"2024-05-08T18:29:40.538458+0000","last_became_peered":"2024-05-08T18:29:40.538458+0000","last_unstale":"2024-05-08T18:29:51.700274+0000","last_undegraded":"2024-05-08T18:29:51.700274+0000","last_fullsized":"2024-05-08T18:29:51.700274+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:36:37.796095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.659507+0000","last_change":"2024-05-08T18:29:42.569718+0000","last_active":"2024-05-08T18:29:51.659507+0000","last_peered":"2024-05-08T18:29:51.659507+0000","last_clean":"2024-05-08T18:29:51.659507+0000","last_became_active":"2024-05-08T18:29:42.569026+0000","last_became_peered":"2024-05-08T18:29:42.569026+0000","last_unstale":"2024-05-08T18:29:51.659507+0000","last_undegraded":"2024-05-08T18:29:51.659507+0000","last_fullsized":"2024-05-08T18:29:51.659507+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:42.045615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.689623+0000","last_change":"2024-05-08T18:29:40.557700+0000","last_active":"2024-05-08T18:29:51.689623+0000","last_peered":"2024-05-08T18:29:51.689623+0000","last_clean":"2024-05-08T18:29:51.689623+0000","last_became_active":"2024-05-08T18:29:40.556884+0000","last_became_peered":"2024-05-08T18:29:40.556884+0000","last_unstale":"2024-05-08T18:29:51.689623+0000","last_undegraded":"2024-05-08T18:29:51.689623+0000","last_fullsized":"2024-05-08T18:29:51.689623+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:21:38.354933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.698939+0000","last_change":"2024-05-08T18:29:42.566448+0000","last_active":"2024-05-08T18:29:51.698939+0000","last_peered":"2024-05-08T18:29:51.698939+0000","last_clean":"2024-05-08T18:29:51.698939+0000","last_became_active":"2024-05-08T18:29:42.566058+0000","last_became_peered":"2024-05-08T18:29:42.566058+0000","last_unstale":"2024-05-08T18:29:51.698939+0000","last_undegraded":"2024-05-08T18:29:51.698939+0000","last_fullsized":"2024-05-08T18:29:51.698939+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:53:03.097704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.678413+0000","last_change":"2024-05-08T18:29:40.571195+0000","last_active":"2024-05-08T18:29:51.678413+0000","last_peered":"2024-05-08T18:29:51.678413+0000","last_clean":"2024-05-08T18:29:51.678413+0000","last_became_active":"2024-05-08T18:29:40.570467+0000","last_became_peered":"2024-05-08T18:29:40.570467+0000","last_unstale":"2024-05-08T18:29:51.678413+0000","last_undegraded":"2024-05-08T18:29:51.678413+0000","last_fullsized":"2024-05-08T18:29:51.678413+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:39.986094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.691921+0000","last_change":"2024-05-08T18:29:42.566506+0000","last_active":"2024-05-08T18:29:51.691921+0000","last_peered":"2024-05-08T18:29:51.691921+0000","last_clean":"2024-05-08T18:29:51.691921+0000","last_became_active":"2024-05-08T18:29:42.565740+0000","last_became_peered":"2024-05-08T18:29:42.565740+0000","last_unstale":"2024-05-08T18:29:51.691921+0000","last_undegraded":"2024-05-08T18:29:51.691921+0000","last_fullsized":"2024-05-08T18:29:51.691921+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:58.320701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.687750+0000","last_change":"2024-05-08T18:29:40.538314+0000","last_active":"2024-05-08T18:29:51.687750+0000","last_peered":"2024-05-08T18:29:51.687750+0000","last_clean":"2024-05-08T18:29:51.687750+0000","last_became_active":"2024-05-08T18:29:40.537458+0000","last_became_peered":"2024-05-08T18:29:40.537458+0000","last_unstale":"2024-05-08T18:29:51.687750+0000","last_undegraded":"2024-05-08T18:29:51.687750+0000","last_fullsized":"2024-05-08T18:29:51.687750+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:56.300986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.660630+0000","last_change":"2024-05-08T18:29:42.570054+0000","last_active":"2024-05-08T18:29:51.660630+0000","last_peered":"2024-05-08T18:29:51.660630+0000","last_clean":"2024-05-08T18:29:51.660630+0000","last_became_active":"2024-05-08T18:29:42.569255+0000","last_became_peered":"2024-05-08T18:29:42.569255+0000","last_unstale":"2024-05-08T18:29:51.660630+0000","last_undegraded":"2024-05-08T18:29:51.660630+0000","last_fullsized":"2024-05-08T18:29:51.660630+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:11:01.702482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.678305+0000","last_change":"2024-05-08T18:29:40.559212+0000","last_active":"2024-05-08T18:29:51.678305+0000","last_peered":"2024-05-08T18:29:51.678305+0000","last_clean":"2024-05-08T18:29:51.678305+0000","last_became_active":"2024-05-08T18:29:40.558501+0000","last_became_peered":"2024-05-08T18:29:40.558501+0000","last_unstale":"2024-05-08T18:29:51.678305+0000","last_undegraded":"2024-05-08T18:29:51.678305+0000","last_fullsized":"2024-05-08T18:29:51.678305+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:36:14.096907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.689961+0000","last_change":"2024-05-08T18:29:42.562084+0000","last_active":"2024-05-08T18:29:51.689961+0000","last_peered":"2024-05-08T18:29:51.689961+0000","last_clean":"2024-05-08T18:29:51.689961+0000","last_became_active":"2024-05-08T18:29:42.560699+0000","last_became_peered":"2024-05-08T18:29:42.560699+0000","last_unstale":"2024-05-08T18:29:51.689961+0000","last_undegraded":"2024-05-08T18:29:51.689961+0000","last_fullsized":"2024-05-08T18:29:51.689961+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:09.787597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.665563+0000","last_change":"2024-05-08T18:29:40.564339+0000","last_active":"2024-05-08T18:29:51.665563+0000","last_peered":"2024-05-08T18:29:51.665563+0000","last_clean":"2024-05-08T18:29:51.665563+0000","last_became_active":"2024-05-08T18:29:40.564038+0000","last_became_peered":"2024-05-08T18:29:40.564038+0000","last_unstale":"2024-05-08T18:29:51.665563+0000","last_undegraded":"2024-05-08T18:29:51.665563+0000","last_fullsized":"2024-05-08T18:29:51.665563+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:40:23.287885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.665702+0000","last_change":"2024-05-08T18:29:42.570253+0000","last_active":"2024-05-08T18:29:51.665702+0000","last_peered":"2024-05-08T18:29:51.665702+0000","last_clean":"2024-05-08T18:29:51.665702+0000","last_became_active":"2024-05-08T18:29:42.569917+0000","last_became_peered":"2024-05-08T18:29:42.569917+0000","last_unstale":"2024-05-08T18:29:51.665702+0000","last_undegraded":"2024-05-08T18:29:51.665702+0000","last_fullsized":"2024-05-08T18:29:51.665702+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:14:45.575219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.658773+0000","last_change":"2024-05-08T18:29:42.568116+0000","last_active":"2024-05-08T18:29:51.658773+0000","last_peered":"2024-05-08T18:29:51.658773+0000","last_clean":"2024-05-08T18:29:51.658773+0000","last_became_active":"2024-05-08T18:29:42.567399+0000","last_became_peered":"2024-05-08T18:29:42.567399+0000","last_unstale":"2024-05-08T18:29:51.658773+0000","last_undegraded":"2024-05-08T18:29:51.658773+0000","last_fullsized":"2024-05-08T18:29:51.658773+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:35.037465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.679262+0000","last_change":"2024-05-08T18:29:40.571982+0000","last_active":"2024-05-08T18:29:51.679262+0000","last_peered":"2024-05-08T18:29:51.679262+0000","last_clean":"2024-05-08T18:29:51.679262+0000","last_became_active":"2024-05-08T18:29:40.570600+0000","last_became_peered":"2024-05-08T18:29:40.570600+0000","last_unstale":"2024-05-08T18:29:51.679262+0000","last_undegraded":"2024-05-08T18:29:51.679262+0000","last_fullsized":"2024-05-08T18:29:51.679262+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:54:14.520118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.678165+0000","last_change":"2024-05-08T18:29:42.578449+0000","last_active":"2024-05-08T18:29:51.678165+0000","last_peered":"2024-05-08T18:29:51.678165+0000","last_clean":"2024-05-08T18:29:51.678165+0000","last_became_active":"2024-05-08T18:29:42.577789+0000","last_became_peered":"2024-05-08T18:29:42.577789+0000","last_unstale":"2024-05-08T18:29:51.678165+0000","last_undegraded":"2024-05-08T18:29:51.678165+0000","last_fullsized":"2024-05-08T18:29:51.678165+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:09.787597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.692940+0000","last_change":"2024-05-08T18:29:40.570618+0000","last_active":"2024-05-08T18:29:51.692940+0000","last_peered":"2024-05-08T18:29:51.692940+0000","last_clean":"2024-05-08T18:29:51.692940+0000","last_became_active":"2024-05-08T18:29:40.569519+0000","last_became_peered":"2024-05-08T18:29:40.569519+0000","last_unstale":"2024-05-08T18:29:51.692940+0000","last_undegraded":"2024-05-08T18:29:51.692940+0000","last_fullsized":"2024-05-08T18:29:51.692940+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:09:42.581976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.688118+0000","last_change":"2024-05-08T18:29:42.563056+0000","last_active":"2024-05-08T18:29:51.688118+0000","last_peered":"2024-05-08T18:29:51.688118+0000","last_clean":"2024-05-08T18:29:51.688118+0000","last_became_active":"2024-05-08T18:29:42.562296+0000","last_became_peered":"2024-05-08T18:29:42.562296+0000","last_unstale":"2024-05-08T18:29:51.688118+0000","last_undegraded":"2024-05-08T18:29:51.688118+0000","last_fullsized":"2024-05-08T18:29:51.688118+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:36.890277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.693134+0000","last_change":"2024-05-08T18:29:40.564353+0000","last_active":"2024-05-08T18:29:51.693134+0000","last_peered":"2024-05-08T18:29:51.693134+0000","last_clean":"2024-05-08T18:29:51.693134+0000","last_became_active":"2024-05-08T18:29:40.563516+0000","last_became_peered":"2024-05-08T18:29:40.563516+0000","last_unstale":"2024-05-08T18:29:51.693134+0000","last_undegraded":"2024-05-08T18:29:51.693134+0000","last_fullsized":"2024-05-08T18:29:51.693134+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:06:36.198647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.664096+0000","last_change":"2024-05-08T18:29:42.567006+0000","last_active":"2024-05-08T18:29:51.664096+0000","last_peered":"2024-05-08T18:29:51.664096+0000","last_clean":"2024-05-08T18:29:51.664096+0000","last_became_active":"2024-05-08T18:29:42.566256+0000","last_became_peered":"2024-05-08T18:29:42.566256+0000","last_unstale":"2024-05-08T18:29:51.664096+0000","last_undegraded":"2024-05-08T18:29:51.664096+0000","last_fullsized":"2024-05-08T18:29:51.664096+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:09:44.601690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.660037+0000","last_change":"2024-05-08T18:29:40.573212+0000","last_active":"2024-05-08T18:29:51.660037+0000","last_peered":"2024-05-08T18:29:51.660037+0000","last_clean":"2024-05-08T18:29:51.660037+0000","last_became_active":"2024-05-08T18:29:40.572250+0000","last_became_peered":"2024-05-08T18:29:40.572250+0000","last_unstale":"2024-05-08T18:29:51.660037+0000","last_undegraded":"2024-05-08T18:29:51.660037+0000","last_fullsized":"2024-05-08T18:29:51.660037+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:25:01.595224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.664865+0000","last_change":"2024-05-08T18:29:42.570847+0000","last_active":"2024-05-08T18:29:51.664865+0000","last_peered":"2024-05-08T18:29:51.664865+0000","last_clean":"2024-05-08T18:29:51.664865+0000","last_became_active":"2024-05-08T18:29:42.570435+0000","last_became_peered":"2024-05-08T18:29:42.570435+0000","last_unstale":"2024-05-08T18:29:51.664865+0000","last_undegraded":"2024-05-08T18:29:51.664865+0000","last_fullsized":"2024-05-08T18:29:51.664865+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:21:40.374647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.666544+0000","last_change":"2024-05-08T18:29:40.566815+0000","last_active":"2024-05-08T18:29:51.666544+0000","last_peered":"2024-05-08T18:29:51.666544+0000","last_clean":"2024-05-08T18:29:51.666544+0000","last_became_active":"2024-05-08T18:29:40.566531+0000","last_became_peered":"2024-05-08T18:29:40.566531+0000","last_unstale":"2024-05-08T18:29:51.666544+0000","last_undegraded":"2024-05-08T18:29:51.666544+0000","last_fullsized":"2024-05-08T18:29:51.666544+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:52.462279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.660765+0000","last_change":"2024-05-08T18:29:42.554846+0000","last_active":"2024-05-08T18:29:51.660765+0000","last_peered":"2024-05-08T18:29:51.660765+0000","last_clean":"2024-05-08T18:29:51.660765+0000","last_became_active":"2024-05-08T18:29:42.554115+0000","last_became_peered":"2024-05-08T18:29:42.554115+0000","last_unstale":"2024-05-08T18:29:51.660765+0000","last_undegraded":"2024-05-08T18:29:51.660765+0000","last_fullsized":"2024-05-08T18:29:51.660765+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:22:14.793035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.699171+0000","last_change":"2024-05-08T18:29:40.547776+0000","last_active":"2024-05-08T18:29:51.699171+0000","last_peered":"2024-05-08T18:29:51.699171+0000","last_clean":"2024-05-08T18:29:51.699171+0000","last_became_active":"2024-05-08T18:29:40.547384+0000","last_became_peered":"2024-05-08T18:29:40.547384+0000","last_unstale":"2024-05-08T18:29:51.699171+0000","last_undegraded":"2024-05-08T18:29:51.699171+0000","last_fullsized":"2024-05-08T18:29:51.699171+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:14:26.628603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.658464+0000","last_change":"2024-05-08T18:29:50.685390+0000","last_active":"2024-05-08T18:29:51.658464+0000","last_peered":"2024-05-08T18:29:51.658464+0000","last_clean":"2024-05-08T18:29:51.658464+0000","last_became_active":"2024-05-08T18:29:50.684644+0000","last_became_peered":"2024-05-08T18:29:50.684644+0000","last_unstale":"2024-05-08T18:29:51.658464+0000","last_undegraded":"2024-05-08T18:29:51.658464+0000","last_fullsized":"2024-05-08T18:29:51.658464+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:10:38.951662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.667450+0000","last_change":"2024-05-08T18:29:42.573805+0000","last_active":"2024-05-08T18:29:51.667450+0000","last_peered":"2024-05-08T18:29:51.667450+0000","last_clean":"2024-05-08T18:29:51.667450+0000","last_became_active":"2024-05-08T18:29:42.573296+0000","last_became_peered":"2024-05-08T18:29:42.573296+0000","last_unstale":"2024-05-08T18:29:51.667450+0000","last_undegraded":"2024-05-08T18:29:51.667450+0000","last_fullsized":"2024-05-08T18:29:51.667450+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:21.935293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.678686+0000","last_change":"2024-05-08T18:29:40.570733+0000","last_active":"2024-05-08T18:29:51.678686+0000","last_peered":"2024-05-08T18:29:51.678686+0000","last_clean":"2024-05-08T18:29:51.678686+0000","last_became_active":"2024-05-08T18:29:40.569711+0000","last_became_peered":"2024-05-08T18:29:40.569711+0000","last_unstale":"2024-05-08T18:29:51.678686+0000","last_undegraded":"2024-05-08T18:29:51.678686+0000","last_fullsized":"2024-05-08T18:29:51.678686+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:18:08.784274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.689464+0000","last_change":"2024-05-08T18:29:44.594185+0000","last_active":"2024-05-08T18:29:51.689464+0000","last_peered":"2024-05-08T18:29:51.689464+0000","last_clean":"2024-05-08T18:29:51.689464+0000","last_became_active":"2024-05-08T18:29:44.593442+0000","last_became_peered":"2024-05-08T18:29:44.593442+0000","last_unstale":"2024-05-08T18:29:51.689464+0000","last_undegraded":"2024-05-08T18:29:51.689464+0000","last_fullsized":"2024-05-08T18:29:51.689464+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:52:25.736491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"33'9","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:52.046689+0000","last_change":"2024-05-08T18:29:46.594652+0000","last_active":"2024-05-08T18:29:52.046689+0000","last_peered":"2024-05-08T18:29:52.046689+0000","last_clean":"2024-05-08T18:29:52.046689+0000","last_became_active":"2024-05-08T18:29:46.593656+0000","last_became_peered":"2024-05-08T18:29:46.593656+0000","last_unstale":"2024-05-08T18:29:52.046689+0000","last_undegraded":"2024-05-08T18:29:52.046689+0000","last_fullsized":"2024-05-08T18:29:52.046689+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:50:27.608888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.678824+0000","last_change":"2024-05-08T18:29:48.639834+0000","last_active":"2024-05-08T18:29:51.678824+0000","last_peered":"2024-05-08T18:29:51.678824+0000","last_clean":"2024-05-08T18:29:51.678824+0000","last_became_active":"2024-05-08T18:29:48.639122+0000","last_became_peered":"2024-05-08T18:29:48.639122+0000","last_unstale":"2024-05-08T18:29:51.678824+0000","last_undegraded":"2024-05-08T18:29:51.678824+0000","last_fullsized":"2024-05-08T18:29:51.678824+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:14:22.304773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.687191+0000","last_change":"2024-05-08T18:29:50.672303+0000","last_active":"2024-05-08T18:29:51.687191+0000","last_peered":"2024-05-08T18:29:51.687191+0000","last_clean":"2024-05-08T18:29:51.687191+0000","last_became_active":"2024-05-08T18:29:50.671513+0000","last_became_peered":"2024-05-08T18:29:50.671513+0000","last_unstale":"2024-05-08T18:29:51.687191+0000","last_undegraded":"2024-05-08T18:29:51.687191+0000","last_fullsized":"2024-05-08T18:29:51.687191+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:12:05.780786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.690047+0000","last_change":"2024-05-08T18:29:42.565462+0000","last_active":"2024-05-08T18:29:51.690047+0000","last_peered":"2024-05-08T18:29:51.690047+0000","last_clean":"2024-05-08T18:29:51.690047+0000","last_became_active":"2024-05-08T18:29:42.564741+0000","last_became_peered":"2024-05-08T18:29:42.564741+0000","last_unstale":"2024-05-08T18:29:51.690047+0000","last_undegraded":"2024-05-08T18:29:51.690047+0000","last_fullsized":"2024-05-08T18:29:51.690047+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:25:56.129785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.699171+0000","last_change":"2024-05-08T18:29:40.564796+0000","last_active":"2024-05-08T18:29:51.699171+0000","last_peered":"2024-05-08T18:29:51.699171+0000","last_clean":"2024-05-08T18:29:51.699171+0000","last_became_active":"2024-05-08T18:29:40.564401+0000","last_became_peered":"2024-05-08T18:29:40.564401+0000","last_unstale":"2024-05-08T18:29:51.699171+0000","last_undegraded":"2024-05-08T18:29:51.699171+0000","last_fullsized":"2024-05-08T18:29:51.699171+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:19:11.492397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.667149+0000","last_change":"2024-05-08T18:29:44.587689+0000","last_active":"2024-05-08T18:29:51.667149+0000","last_peered":"2024-05-08T18:29:51.667149+0000","last_clean":"2024-05-08T18:29:51.667149+0000","last_became_active":"2024-05-08T18:29:44.586975+0000","last_became_peered":"2024-05-08T18:29:44.586975+0000","last_unstale":"2024-05-08T18:29:51.667149+0000","last_undegraded":"2024-05-08T18:29:51.667149+0000","last_fullsized":"2024-05-08T18:29:51.667149+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:04:49.020450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"33'6","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:52.433021+0000","last_change":"2024-05-08T18:29:46.600906+0000","last_active":"2024-05-08T18:29:52.433021+0000","last_peered":"2024-05-08T18:29:52.433021+0000","last_clean":"2024-05-08T18:29:52.433021+0000","last_became_active":"2024-05-08T18:29:46.599894+0000","last_became_peered":"2024-05-08T18:29:46.599894+0000","last_unstale":"2024-05-08T18:29:52.433021+0000","last_undegraded":"2024-05-08T18:29:52.433021+0000","last_fullsized":"2024-05-08T18:29:52.433021+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:24:13.568294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.660322+0000","last_change":"2024-05-08T18:29:48.614324+0000","last_active":"2024-05-08T18:29:51.660322+0000","last_peered":"2024-05-08T18:29:51.660322+0000","last_clean":"2024-05-08T18:29:51.660322+0000","last_became_active":"2024-05-08T18:29:48.613591+0000","last_became_peered":"2024-05-08T18:29:48.613591+0000","last_unstale":"2024-05-08T18:29:51.660322+0000","last_undegraded":"2024-05-08T18:29:51.660322+0000","last_fullsized":"2024-05-08T18:29:51.660322+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:47:54.034851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.698697+0000","last_change":"2024-05-08T18:29:50.684773+0000","last_active":"2024-05-08T18:29:51.698697+0000","last_peered":"2024-05-08T18:29:51.698697+0000","last_clean":"2024-05-08T18:29:51.698697+0000","last_became_active":"2024-05-08T18:29:50.683931+0000","last_became_peered":"2024-05-08T18:29:50.683931+0000","last_unstale":"2024-05-08T18:29:51.698697+0000","last_undegraded":"2024-05-08T18:29:51.698697+0000","last_fullsized":"2024-05-08T18:29:51.698697+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:17:10.582636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.701405+0000","last_change":"2024-05-08T18:29:42.574437+0000","last_active":"2024-05-08T18:29:51.701405+0000","last_peered":"2024-05-08T18:29:51.701405+0000","last_clean":"2024-05-08T18:29:51.701405+0000","last_became_active":"2024-05-08T18:29:42.574146+0000","last_became_peered":"2024-05-08T18:29:42.574146+0000","last_unstale":"2024-05-08T18:29:51.701405+0000","last_undegraded":"2024-05-08T18:29:51.701405+0000","last_fullsized":"2024-05-08T18:29:51.701405+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:55:30.468069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.678602+0000","last_change":"2024-05-08T18:29:40.559677+0000","last_active":"2024-05-08T18:29:51.678602+0000","last_peered":"2024-05-08T18:29:51.678602+0000","last_clean":"2024-05-08T18:29:51.678602+0000","last_became_active":"2024-05-08T18:29:40.558819+0000","last_became_peered":"2024-05-08T18:29:40.558819+0000","last_unstale":"2024-05-08T18:29:51.678602+0000","last_undegraded":"2024-05-08T18:29:51.678602+0000","last_fullsized":"2024-05-08T18:29:51.678602+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:28.426657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.669523+0000","last_change":"2024-05-08T18:29:44.596801+0000","last_active":"2024-05-08T18:29:51.669523+0000","last_peered":"2024-05-08T18:29:51.669523+0000","last_clean":"2024-05-08T18:29:51.669523+0000","last_became_active":"2024-05-08T18:29:44.596111+0000","last_became_peered":"2024-05-08T18:29:44.596111+0000","last_unstale":"2024-05-08T18:29:51.669523+0000","last_undegraded":"2024-05-08T18:29:51.669523+0000","last_fullsized":"2024-05-08T18:29:51.669523+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:04.423266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"33'10","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:52.487689+0000","last_change":"2024-05-08T18:29:46.608330+0000","last_active":"2024-05-08T18:29:52.487689+0000","last_peered":"2024-05-08T18:29:52.487689+0000","last_clean":"2024-05-08T18:29:52.487689+0000","last_became_active":"2024-05-08T18:29:46.607580+0000","last_became_peered":"2024-05-08T18:29:46.607580+0000","last_unstale":"2024-05-08T18:29:52.487689+0000","last_undegraded":"2024-05-08T18:29:52.487689+0000","last_fullsized":"2024-05-08T18:29:52.487689+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:22:18.837103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"30'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.678878+0000","last_change":"2024-05-08T18:29:48.642718+0000","last_active":"2024-05-08T18:29:51.678878+0000","last_peered":"2024-05-08T18:29:51.678878+0000","last_clean":"2024-05-08T18:29:51.678878+0000","last_became_active":"2024-05-08T18:29:48.641950+0000","last_became_peered":"2024-05-08T18:29:48.641950+0000","last_unstale":"2024-05-08T18:29:51.678878+0000","last_undegraded":"2024-05-08T18:29:51.678878+0000","last_fullsized":"2024-05-08T18:29:51.678878+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:00:11.720096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.659694+0000","last_change":"2024-05-08T18:29:50.660378+0000","last_active":"2024-05-08T18:29:51.659694+0000","last_peered":"2024-05-08T18:29:51.659694+0000","last_clean":"2024-05-08T18:29:51.659694+0000","last_became_active":"2024-05-08T18:29:50.659649+0000","last_became_peered":"2024-05-08T18:29:50.659649+0000","last_unstale":"2024-05-08T18:29:51.659694+0000","last_undegraded":"2024-05-08T18:29:51.659694+0000","last_fullsized":"2024-05-08T18:29:51.659694+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:34:14.488295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.668605+0000","last_change":"2024-05-08T18:29:42.577267+0000","last_active":"2024-05-08T18:29:51.668605+0000","last_peered":"2024-05-08T18:29:51.668605+0000","last_clean":"2024-05-08T18:29:51.668605+0000","last_became_active":"2024-05-08T18:29:42.576740+0000","last_became_peered":"2024-05-08T18:29:42.576740+0000","last_unstale":"2024-05-08T18:29:51.668605+0000","last_undegraded":"2024-05-08T18:29:51.668605+0000","last_fullsized":"2024-05-08T18:29:51.668605+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:57:14.869860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.691119+0000","last_change":"2024-05-08T18:29:40.547524+0000","last_active":"2024-05-08T18:29:51.691119+0000","last_peered":"2024-05-08T18:29:51.691119+0000","last_clean":"2024-05-08T18:29:51.691119+0000","last_became_active":"2024-05-08T18:29:40.545749+0000","last_became_peered":"2024-05-08T18:29:40.545749+0000","last_unstale":"2024-05-08T18:29:51.691119+0000","last_undegraded":"2024-05-08T18:29:51.691119+0000","last_fullsized":"2024-05-08T18:29:51.691119+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:12:59.146887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.689728+0000","last_change":"2024-05-08T18:29:44.579839+0000","last_active":"2024-05-08T18:29:51.689728+0000","last_peered":"2024-05-08T18:29:51.689728+0000","last_clean":"2024-05-08T18:29:51.689728+0000","last_became_active":"2024-05-08T18:29:44.578142+0000","last_became_peered":"2024-05-08T18:29:44.578142+0000","last_unstale":"2024-05-08T18:29:51.689728+0000","last_undegraded":"2024-05-08T18:29:51.689728+0000","last_fullsized":"2024-05-08T18:29:51.689728+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:51:09.413191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"33'9","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:52.491036+0000","last_change":"2024-05-08T18:29:46.607288+0000","last_active":"2024-05-08T18:29:52.491036+0000","last_peered":"2024-05-08T18:29:52.491036+0000","last_clean":"2024-05-08T18:29:52.491036+0000","last_became_active":"2024-05-08T18:29:46.605154+0000","last_became_peered":"2024-05-08T18:29:46.605154+0000","last_unstale":"2024-05-08T18:29:52.491036+0000","last_undegraded":"2024-05-08T18:29:52.491036+0000","last_fullsized":"2024-05-08T18:29:52.491036+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:23.940519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"30'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.666879+0000","last_change":"2024-05-08T18:29:48.634956+0000","last_active":"2024-05-08T18:29:51.666879+0000","last_peered":"2024-05-08T18:29:51.666879+0000","last_clean":"2024-05-08T18:29:51.666879+0000","last_became_active":"2024-05-08T18:29:48.633858+0000","last_became_peered":"2024-05-08T18:29:48.633858+0000","last_unstale":"2024-05-08T18:29:51.666879+0000","last_undegraded":"2024-05-08T18:29:51.666879+0000","last_fullsized":"2024-05-08T18:29:51.666879+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:50:48.169666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.688193+0000","last_change":"2024-05-08T18:29:42.567744+0000","last_active":"2024-05-08T18:29:51.688193+0000","last_peered":"2024-05-08T18:29:51.688193+0000","last_clean":"2024-05-08T18:29:51.688193+0000","last_became_active":"2024-05-08T18:29:42.566974+0000","last_became_peered":"2024-05-08T18:29:42.566974+0000","last_unstale":"2024-05-08T18:29:51.688193+0000","last_undegraded":"2024-05-08T18:29:51.688193+0000","last_fullsized":"2024-05-08T18:29:51.688193+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:42.045615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.679445+0000","last_change":"2024-05-08T18:29:40.572499+0000","last_active":"2024-05-08T18:29:51.679445+0000","last_peered":"2024-05-08T18:29:51.679445+0000","last_clean":"2024-05-08T18:29:51.679445+0000","last_became_active":"2024-05-08T18:29:40.571322+0000","last_became_peered":"2024-05-08T18:29:40.571322+0000","last_unstale":"2024-05-08T18:29:51.679445+0000","last_undegraded":"2024-05-08T18:29:51.679445+0000","last_fullsized":"2024-05-08T18:29:51.679445+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:31.119374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.677434+0000","last_change":"2024-05-08T18:29:44.597045+0000","last_active":"2024-05-08T18:29:51.677434+0000","last_peered":"2024-05-08T18:29:51.677434+0000","last_clean":"2024-05-08T18:29:51.677434+0000","last_became_active":"2024-05-08T18:29:44.596282+0000","last_became_peered":"2024-05-08T18:29:44.596282+0000","last_unstale":"2024-05-08T18:29:51.677434+0000","last_undegraded":"2024-05-08T18:29:51.677434+0000","last_fullsized":"2024-05-08T18:29:51.677434+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:35:51.288126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"33'19","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:52.592635+0000","last_change":"2024-05-08T18:29:46.590633+0000","last_active":"2024-05-08T18:29:52.592635+0000","last_peered":"2024-05-08T18:29:52.592635+0000","last_clean":"2024-05-08T18:29:52.592635+0000","last_became_active":"2024-05-08T18:29:46.589600+0000","last_became_peered":"2024-05-08T18:29:46.589600+0000","last_unstale":"2024-05-08T18:29:52.592635+0000","last_undegraded":"2024-05-08T18:29:52.592635+0000","last_fullsized":"2024-05-08T18:29:52.592635+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:23.940519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.683895+0000","last_change":"2024-05-08T18:29:48.630758+0000","last_active":"2024-05-08T18:29:51.683895+0000","last_peered":"2024-05-08T18:29:51.683895+0000","last_clean":"2024-05-08T18:29:51.683895+0000","last_became_active":"2024-05-08T18:29:48.630017+0000","last_became_peered":"2024-05-08T18:29:48.630017+0000","last_unstale":"2024-05-08T18:29:51.683895+0000","last_undegraded":"2024-05-08T18:29:51.683895+0000","last_fullsized":"2024-05-08T18:29:51.683895+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:39.879384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.689337+0000","last_change":"2024-05-08T18:29:50.672682+0000","last_active":"2024-05-08T18:29:51.689337+0000","last_peered":"2024-05-08T18:29:51.689337+0000","last_clean":"2024-05-08T18:29:51.689337+0000","last_became_active":"2024-05-08T18:29:50.671923+0000","last_became_peered":"2024-05-08T18:29:50.671923+0000","last_unstale":"2024-05-08T18:29:51.689337+0000","last_undegraded":"2024-05-08T18:29:51.689337+0000","last_fullsized":"2024-05-08T18:29:51.689337+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:38.318890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.658929+0000","last_change":"2024-05-08T18:29:42.554289+0000","last_active":"2024-05-08T18:29:51.658929+0000","last_peered":"2024-05-08T18:29:51.658929+0000","last_clean":"2024-05-08T18:29:51.658929+0000","last_became_active":"2024-05-08T18:29:42.553574+0000","last_became_peered":"2024-05-08T18:29:42.553574+0000","last_unstale":"2024-05-08T18:29:51.658929+0000","last_undegraded":"2024-05-08T18:29:51.658929+0000","last_fullsized":"2024-05-08T18:29:51.658929+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:42.005809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.679397+0000","last_change":"2024-05-08T18:29:40.570169+0000","last_active":"2024-05-08T18:29:51.679397+0000","last_peered":"2024-05-08T18:29:51.679397+0000","last_clean":"2024-05-08T18:29:51.679397+0000","last_became_active":"2024-05-08T18:29:40.569542+0000","last_became_peered":"2024-05-08T18:29:40.569542+0000","last_unstale":"2024-05-08T18:29:51.679397+0000","last_undegraded":"2024-05-08T18:29:51.679397+0000","last_fullsized":"2024-05-08T18:29:51.679397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:08:13.006752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"26'1","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.661881+0000","last_change":"2024-05-08T18:29:44.579659+0000","last_active":"2024-05-08T18:29:51.661881+0000","last_peered":"2024-05-08T18:29:51.661881+0000","last_clean":"2024-05-08T18:29:51.661881+0000","last_became_active":"2024-05-08T18:29:44.579152+0000","last_became_peered":"2024-05-08T18:29:44.579152+0000","last_unstale":"2024-05-08T18:29:51.661881+0000","last_undegraded":"2024-05-08T18:29:51.661881+0000","last_fullsized":"2024-05-08T18:29:51.661881+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:15:00.358583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"33'9","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:52.467870+0000","last_change":"2024-05-08T18:29:46.600224+0000","last_active":"2024-05-08T18:29:52.467870+0000","last_peered":"2024-05-08T18:29:52.467870+0000","last_clean":"2024-05-08T18:29:52.467870+0000","last_became_active":"2024-05-08T18:29:46.599464+0000","last_became_peered":"2024-05-08T18:29:46.599464+0000","last_unstale":"2024-05-08T18:29:52.467870+0000","last_undegraded":"2024-05-08T18:29:52.467870+0000","last_fullsized":"2024-05-08T18:29:52.467870+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:26:40.238188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.663479+0000","last_change":"2024-05-08T18:29:48.637939+0000","last_active":"2024-05-08T18:29:51.663479+0000","last_peered":"2024-05-08T18:29:51.663479+0000","last_clean":"2024-05-08T18:29:51.663479+0000","last_became_active":"2024-05-08T18:29:48.637231+0000","last_became_peered":"2024-05-08T18:29:48.637231+0000","last_unstale":"2024-05-08T18:29:51.663479+0000","last_undegraded":"2024-05-08T18:29:51.663479+0000","last_fullsized":"2024-05-08T18:29:51.663479+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:04.571608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.692655+0000","last_change":"2024-05-08T18:29:50.681831+0000","last_active":"2024-05-08T18:29:51.692655+0000","last_peered":"2024-05-08T18:29:51.692655+0000","last_clean":"2024-05-08T18:29:51.692655+0000","last_became_active":"2024-05-08T18:29:50.681287+0000","last_became_peered":"2024-05-08T18:29:50.681287+0000","last_unstale":"2024-05-08T18:29:51.692655+0000","last_undegraded":"2024-05-08T18:29:51.692655+0000","last_fullsized":"2024-05-08T18:29:51.692655+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:30:24.111488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.692241+0000","last_change":"2024-05-08T18:29:42.562975+0000","last_active":"2024-05-08T18:29:51.692241+0000","last_peered":"2024-05-08T18:29:51.692241+0000","last_clean":"2024-05-08T18:29:51.692241+0000","last_became_active":"2024-05-08T18:29:42.562267+0000","last_became_peered":"2024-05-08T18:29:42.562267+0000","last_unstale":"2024-05-08T18:29:51.692241+0000","last_undegraded":"2024-05-08T18:29:51.692241+0000","last_fullsized":"2024-05-08T18:29:51.692241+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:30.446371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.679564+0000","last_change":"2024-05-08T18:29:40.570736+0000","last_active":"2024-05-08T18:29:51.679564+0000","last_peered":"2024-05-08T18:29:51.679564+0000","last_clean":"2024-05-08T18:29:51.679564+0000","last_became_active":"2024-05-08T18:29:40.569626+0000","last_became_peered":"2024-05-08T18:29:40.569626+0000","last_unstale":"2024-05-08T18:29:51.679564+0000","last_undegraded":"2024-05-08T18:29:51.679564+0000","last_fullsized":"2024-05-08T18:29:51.679564+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:56.300986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"26'1","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.664872+0000","last_change":"2024-05-08T18:29:44.581748+0000","last_active":"2024-05-08T18:29:51.664872+0000","last_peered":"2024-05-08T18:29:51.664872+0000","last_clean":"2024-05-08T18:29:51.664872+0000","last_became_active":"2024-05-08T18:29:44.581067+0000","last_became_peered":"2024-05-08T18:29:44.581067+0000","last_unstale":"2024-05-08T18:29:51.664872+0000","last_undegraded":"2024-05-08T18:29:51.664872+0000","last_fullsized":"2024-05-08T18:29:51.664872+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:44.043691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"33'15","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:52.385307+0000","last_change":"2024-05-08T18:29:46.605887+0000","last_active":"2024-05-08T18:29:52.385307+0000","last_peered":"2024-05-08T18:29:52.385307+0000","last_clean":"2024-05-08T18:29:52.385307+0000","last_became_active":"2024-05-08T18:29:46.604966+0000","last_became_peered":"2024-05-08T18:29:46.604966+0000","last_unstale":"2024-05-08T18:29:52.385307+0000","last_undegraded":"2024-05-08T18:29:52.385307+0000","last_fullsized":"2024-05-08T18:29:52.385307+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:07:54.654205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"30'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.698173+0000","last_change":"2024-05-08T18:29:48.638657+0000","last_active":"2024-05-08T18:29:51.698173+0000","last_peered":"2024-05-08T18:29:51.698173+0000","last_clean":"2024-05-08T18:29:51.698173+0000","last_became_active":"2024-05-08T18:29:48.637758+0000","last_became_peered":"2024-05-08T18:29:48.637758+0000","last_unstale":"2024-05-08T18:29:51.698173+0000","last_undegraded":"2024-05-08T18:29:51.698173+0000","last_fullsized":"2024-05-08T18:29:51.698173+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:45:24.153991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.700588+0000","last_change":"2024-05-08T18:29:50.684501+0000","last_active":"2024-05-08T18:29:51.700588+0000","last_peered":"2024-05-08T18:29:51.700588+0000","last_clean":"2024-05-08T18:29:51.700588+0000","last_became_active":"2024-05-08T18:29:50.683738+0000","last_became_peered":"2024-05-08T18:29:50.683738+0000","last_unstale":"2024-05-08T18:29:51.700588+0000","last_undegraded":"2024-05-08T18:29:51.700588+0000","last_fullsized":"2024-05-08T18:29:51.700588+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:22.834262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.699926+0000","last_change":"2024-05-08T18:29:42.569401+0000","last_active":"2024-05-08T18:29:51.699926+0000","last_peered":"2024-05-08T18:29:51.699926+0000","last_clean":"2024-05-08T18:29:51.699926+0000","last_became_active":"2024-05-08T18:29:42.568659+0000","last_became_peered":"2024-05-08T18:29:42.568659+0000","last_unstale":"2024-05-08T18:29:51.699926+0000","last_undegraded":"2024-05-08T18:29:51.699926+0000","last_fullsized":"2024-05-08T18:29:51.699926+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:35:23.016110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.689971+0000","last_change":"2024-05-08T18:29:40.557076+0000","last_active":"2024-05-08T18:29:51.689971+0000","last_peered":"2024-05-08T18:29:51.689971+0000","last_clean":"2024-05-08T18:29:51.689971+0000","last_became_active":"2024-05-08T18:29:40.555805+0000","last_became_peered":"2024-05-08T18:29:40.555805+0000","last_unstale":"2024-05-08T18:29:51.689971+0000","last_undegraded":"2024-05-08T18:29:51.689971+0000","last_fullsized":"2024-05-08T18:29:51.689971+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:13.946346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.662878+0000","last_change":"2024-05-08T18:29:44.573892+0000","last_active":"2024-05-08T18:29:51.662878+0000","last_peered":"2024-05-08T18:29:51.662878+0000","last_clean":"2024-05-08T18:29:51.662878+0000","last_became_active":"2024-05-08T18:29:44.573308+0000","last_became_peered":"2024-05-08T18:29:44.573308+0000","last_unstale":"2024-05-08T18:29:51.662878+0000","last_undegraded":"2024-05-08T18:29:51.662878+0000","last_fullsized":"2024-05-08T18:29:51.662878+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:37.075348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"33'12","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:52.010416+0000","last_change":"2024-05-08T18:29:46.595585+0000","last_active":"2024-05-08T18:29:52.010416+0000","last_peered":"2024-05-08T18:29:52.010416+0000","last_clean":"2024-05-08T18:29:52.010416+0000","last_became_active":"2024-05-08T18:29:46.594930+0000","last_became_peered":"2024-05-08T18:29:46.594930+0000","last_unstale":"2024-05-08T18:29:52.010416+0000","last_undegraded":"2024-05-08T18:29:52.010416+0000","last_fullsized":"2024-05-08T18:29:52.010416+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:11.768269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.661714+0000","last_change":"2024-05-08T18:29:48.638137+0000","last_active":"2024-05-08T18:29:51.661714+0000","last_peered":"2024-05-08T18:29:51.661714+0000","last_clean":"2024-05-08T18:29:51.661714+0000","last_became_active":"2024-05-08T18:29:48.637370+0000","last_became_peered":"2024-05-08T18:29:48.637370+0000","last_unstale":"2024-05-08T18:29:51.661714+0000","last_undegraded":"2024-05-08T18:29:51.661714+0000","last_fullsized":"2024-05-08T18:29:51.661714+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:15.859849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.684330+0000","last_change":"2024-05-08T18:29:50.688760+0000","last_active":"2024-05-08T18:29:51.684330+0000","last_peered":"2024-05-08T18:29:51.684330+0000","last_clean":"2024-05-08T18:29:51.684330+0000","last_became_active":"2024-05-08T18:29:50.687960+0000","last_became_peered":"2024-05-08T18:29:50.687960+0000","last_unstale":"2024-05-08T18:29:51.684330+0000","last_undegraded":"2024-05-08T18:29:51.684330+0000","last_fullsized":"2024-05-08T18:29:51.684330+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:21:19.624895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.660650+0000","last_change":"2024-05-08T18:29:42.557850+0000","last_active":"2024-05-08T18:29:51.660650+0000","last_peered":"2024-05-08T18:29:51.660650+0000","last_clean":"2024-05-08T18:29:51.660650+0000","last_became_active":"2024-05-08T18:29:42.557119+0000","last_became_peered":"2024-05-08T18:29:42.557119+0000","last_unstale":"2024-05-08T18:29:51.660650+0000","last_undegraded":"2024-05-08T18:29:51.660650+0000","last_fullsized":"2024-05-08T18:29:51.660650+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:25:56.129785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.666074+0000","last_change":"2024-05-08T18:29:40.544530+0000","last_active":"2024-05-08T18:29:51.666074+0000","last_peered":"2024-05-08T18:29:51.666074+0000","last_clean":"2024-05-08T18:29:51.666074+0000","last_became_active":"2024-05-08T18:29:40.544215+0000","last_became_peered":"2024-05-08T18:29:40.544215+0000","last_unstale":"2024-05-08T18:29:51.666074+0000","last_undegraded":"2024-05-08T18:29:51.666074+0000","last_fullsized":"2024-05-08T18:29:51.666074+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:14:26.628603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.664300+0000","last_change":"2024-05-08T18:29:44.588227+0000","last_active":"2024-05-08T18:29:51.664300+0000","last_peered":"2024-05-08T18:29:51.664300+0000","last_clean":"2024-05-08T18:29:51.664300+0000","last_became_active":"2024-05-08T18:29:44.587822+0000","last_became_peered":"2024-05-08T18:29:44.587822+0000","last_unstale":"2024-05-08T18:29:51.664300+0000","last_undegraded":"2024-05-08T18:29:51.664300+0000","last_fullsized":"2024-05-08T18:29:51.664300+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:18:12.841872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"33'11","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:52.528486+0000","last_change":"2024-05-08T18:29:46.603563+0000","last_active":"2024-05-08T18:29:52.528486+0000","last_peered":"2024-05-08T18:29:52.528486+0000","last_clean":"2024-05-08T18:29:52.528486+0000","last_became_active":"2024-05-08T18:29:46.602801+0000","last_became_peered":"2024-05-08T18:29:46.602801+0000","last_unstale":"2024-05-08T18:29:52.528486+0000","last_undegraded":"2024-05-08T18:29:52.528486+0000","last_fullsized":"2024-05-08T18:29:52.528486+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:22:36.338527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.700870+0000","last_change":"2024-05-08T18:29:48.642806+0000","last_active":"2024-05-08T18:29:51.700870+0000","last_peered":"2024-05-08T18:29:51.700870+0000","last_clean":"2024-05-08T18:29:51.700870+0000","last_became_active":"2024-05-08T18:29:48.641813+0000","last_became_peered":"2024-05-08T18:29:48.641813+0000","last_unstale":"2024-05-08T18:29:51.700870+0000","last_undegraded":"2024-05-08T18:29:51.700870+0000","last_fullsized":"2024-05-08T18:29:51.700870+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:50:48.169666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.663138+0000","last_change":"2024-05-08T18:29:50.689819+0000","last_active":"2024-05-08T18:29:51.663138+0000","last_peered":"2024-05-08T18:29:51.663138+0000","last_clean":"2024-05-08T18:29:51.663138+0000","last_became_active":"2024-05-08T18:29:50.686739+0000","last_became_peered":"2024-05-08T18:29:50.686739+0000","last_unstale":"2024-05-08T18:29:51.663138+0000","last_undegraded":"2024-05-08T18:29:51.663138+0000","last_fullsized":"2024-05-08T18:29:51.663138+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:45:34.171402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.660871+0000","last_change":"2024-05-08T18:29:42.552388+0000","last_active":"2024-05-08T18:29:51.660871+0000","last_peered":"2024-05-08T18:29:51.660871+0000","last_clean":"2024-05-08T18:29:51.660871+0000","last_became_active":"2024-05-08T18:29:42.551647+0000","last_became_peered":"2024-05-08T18:29:42.551647+0000","last_unstale":"2024-05-08T18:29:51.660871+0000","last_undegraded":"2024-05-08T18:29:51.660871+0000","last_fullsized":"2024-05-08T18:29:51.660871+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:55.055481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.692401+0000","last_change":"2024-05-08T18:29:40.562946+0000","last_active":"2024-05-08T18:29:51.692401+0000","last_peered":"2024-05-08T18:29:51.692401+0000","last_clean":"2024-05-08T18:29:51.692401+0000","last_became_active":"2024-05-08T18:29:40.550942+0000","last_became_peered":"2024-05-08T18:29:40.550942+0000","last_unstale":"2024-05-08T18:29:51.692401+0000","last_undegraded":"2024-05-08T18:29:51.692401+0000","last_fullsized":"2024-05-08T18:29:51.692401+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:22.579629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.683968+0000","last_change":"2024-05-08T18:29:44.593681+0000","last_active":"2024-05-08T18:29:51.683968+0000","last_peered":"2024-05-08T18:29:51.683968+0000","last_clean":"2024-05-08T18:29:51.683968+0000","last_became_active":"2024-05-08T18:29:44.593242+0000","last_became_peered":"2024-05-08T18:29:44.593242+0000","last_unstale":"2024-05-08T18:29:51.683968+0000","last_undegraded":"2024-05-08T18:29:51.683968+0000","last_fullsized":"2024-05-08T18:29:51.683968+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:57.093364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"33'15","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:52.602698+0000","last_change":"2024-05-08T18:29:46.589514+0000","last_active":"2024-05-08T18:29:52.602698+0000","last_peered":"2024-05-08T18:29:52.602698+0000","last_clean":"2024-05-08T18:29:52.602698+0000","last_became_active":"2024-05-08T18:29:46.588784+0000","last_became_peered":"2024-05-08T18:29:46.588784+0000","last_unstale":"2024-05-08T18:29:52.602698+0000","last_undegraded":"2024-05-08T18:29:52.602698+0000","last_fullsized":"2024-05-08T18:29:52.602698+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:02:30.355168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"30'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.666286+0000","last_change":"2024-05-08T18:29:48.631007+0000","last_active":"2024-05-08T18:29:51.666286+0000","last_peered":"2024-05-08T18:29:51.666286+0000","last_clean":"2024-05-08T18:29:51.666286+0000","last_became_active":"2024-05-08T18:29:48.630229+0000","last_became_peered":"2024-05-08T18:29:48.630229+0000","last_unstale":"2024-05-08T18:29:51.666286+0000","last_undegraded":"2024-05-08T18:29:51.666286+0000","last_fullsized":"2024-05-08T18:29:51.666286+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:44:03.778419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.683829+0000","last_change":"2024-05-08T18:29:50.675105+0000","last_active":"2024-05-08T18:29:51.683829+0000","last_peered":"2024-05-08T18:29:51.683829+0000","last_clean":"2024-05-08T18:29:51.683829+0000","last_became_active":"2024-05-08T18:29:50.674292+0000","last_became_peered":"2024-05-08T18:29:50.674292+0000","last_unstale":"2024-05-08T18:29:51.683829+0000","last_undegraded":"2024-05-08T18:29:51.683829+0000","last_fullsized":"2024-05-08T18:29:51.683829+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:47:15.423647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.661400+0000","last_change":"2024-05-08T18:29:42.579707+0000","last_active":"2024-05-08T18:29:51.661400+0000","last_peered":"2024-05-08T18:29:51.661400+0000","last_clean":"2024-05-08T18:29:51.661400+0000","last_became_active":"2024-05-08T18:29:42.579059+0000","last_became_peered":"2024-05-08T18:29:42.579059+0000","last_unstale":"2024-05-08T18:29:51.661400+0000","last_undegraded":"2024-05-08T18:29:51.661400+0000","last_fullsized":"2024-05-08T18:29:51.661400+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:09.787597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.659549+0000","last_change":"2024-05-08T18:29:40.555327+0000","last_active":"2024-05-08T18:29:51.659549+0000","last_peered":"2024-05-08T18:29:51.659549+0000","last_clean":"2024-05-08T18:29:51.659549+0000","last_became_active":"2024-05-08T18:29:40.554594+0000","last_became_peered":"2024-05-08T18:29:40.554594+0000","last_unstale":"2024-05-08T18:29:51.659549+0000","last_undegraded":"2024-05-08T18:29:51.659549+0000","last_fullsized":"2024-05-08T18:29:51.659549+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:19.841114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"26'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.690483+0000","last_change":"2024-05-08T18:29:44.582434+0000","last_active":"2024-05-08T18:29:51.690483+0000","last_peered":"2024-05-08T18:29:51.690483+0000","last_clean":"2024-05-08T18:29:51.690483+0000","last_became_active":"2024-05-08T18:29:44.581699+0000","last_became_peered":"2024-05-08T18:29:44.581699+0000","last_unstale":"2024-05-08T18:29:51.690483+0000","last_undegraded":"2024-05-08T18:29:51.690483+0000","last_fullsized":"2024-05-08T18:29:51.690483+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:19:29.113643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"33'10","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:52.395752+0000","last_change":"2024-05-08T18:29:46.590860+0000","last_active":"2024-05-08T18:29:52.395752+0000","last_peered":"2024-05-08T18:29:52.395752+0000","last_clean":"2024-05-08T18:29:52.395752+0000","last_became_active":"2024-05-08T18:29:46.590087+0000","last_became_peered":"2024-05-08T18:29:46.590087+0000","last_unstale":"2024-05-08T18:29:52.395752+0000","last_undegraded":"2024-05-08T18:29:52.395752+0000","last_fullsized":"2024-05-08T18:29:52.395752+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:19:58.358449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"30'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.692675+0000","last_change":"2024-05-08T18:29:48.635548+0000","last_active":"2024-05-08T18:29:51.692675+0000","last_peered":"2024-05-08T18:29:51.692675+0000","last_clean":"2024-05-08T18:29:51.692675+0000","last_became_active":"2024-05-08T18:29:48.634801+0000","last_became_peered":"2024-05-08T18:29:48.634801+0000","last_unstale":"2024-05-08T18:29:51.692675+0000","last_undegraded":"2024-05-08T18:29:51.692675+0000","last_fullsized":"2024-05-08T18:29:51.692675+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:04:20.128031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.659664+0000","last_change":"2024-05-08T18:29:50.668279+0000","last_active":"2024-05-08T18:29:51.659664+0000","last_peered":"2024-05-08T18:29:51.659664+0000","last_clean":"2024-05-08T18:29:51.659664+0000","last_became_active":"2024-05-08T18:29:50.667536+0000","last_became_peered":"2024-05-08T18:29:50.667536+0000","last_unstale":"2024-05-08T18:29:51.659664+0000","last_undegraded":"2024-05-08T18:29:51.659664+0000","last_fullsized":"2024-05-08T18:29:51.659664+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:12:05.780786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.684931+0000","last_change":"2024-05-08T18:29:42.563807+0000","last_active":"2024-05-08T18:29:51.684931+0000","last_peered":"2024-05-08T18:29:51.684931+0000","last_clean":"2024-05-08T18:29:51.684931+0000","last_became_active":"2024-05-08T18:29:42.563416+0000","last_became_peered":"2024-05-08T18:29:42.563416+0000","last_unstale":"2024-05-08T18:29:51.684931+0000","last_undegraded":"2024-05-08T18:29:51.684931+0000","last_fullsized":"2024-05-08T18:29:51.684931+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:18:10.803989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.665801+0000","last_change":"2024-05-08T18:29:40.548898+0000","last_active":"2024-05-08T18:29:51.665801+0000","last_peered":"2024-05-08T18:29:51.665801+0000","last_clean":"2024-05-08T18:29:51.665801+0000","last_became_active":"2024-05-08T18:29:40.548591+0000","last_became_peered":"2024-05-08T18:29:40.548591+0000","last_unstale":"2024-05-08T18:29:51.665801+0000","last_undegraded":"2024-05-08T18:29:51.665801+0000","last_fullsized":"2024-05-08T18:29:51.665801+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:27:41.414153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.661213+0000","last_change":"2024-05-08T18:29:44.582578+0000","last_active":"2024-05-08T18:29:51.661213+0000","last_peered":"2024-05-08T18:29:51.661213+0000","last_clean":"2024-05-08T18:29:51.661213+0000","last_became_active":"2024-05-08T18:29:44.581832+0000","last_became_peered":"2024-05-08T18:29:44.581832+0000","last_unstale":"2024-05-08T18:29:51.661213+0000","last_undegraded":"2024-05-08T18:29:51.661213+0000","last_fullsized":"2024-05-08T18:29:51.661213+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:52:25.736491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"33'17","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:52.520380+0000","last_change":"2024-05-08T18:29:46.602459+0000","last_active":"2024-05-08T18:29:52.520380+0000","last_peered":"2024-05-08T18:29:52.520380+0000","last_clean":"2024-05-08T18:29:52.520380+0000","last_became_active":"2024-05-08T18:29:46.601740+0000","last_became_peered":"2024-05-08T18:29:46.601740+0000","last_unstale":"2024-05-08T18:29:52.520380+0000","last_undegraded":"2024-05-08T18:29:52.520380+0000","last_fullsized":"2024-05-08T18:29:52.520380+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:58:31.293922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.691378+0000","last_change":"2024-05-08T18:29:48.640046+0000","last_active":"2024-05-08T18:29:51.691378+0000","last_peered":"2024-05-08T18:29:51.691378+0000","last_clean":"2024-05-08T18:29:51.691378+0000","last_became_active":"2024-05-08T18:29:48.639309+0000","last_became_peered":"2024-05-08T18:29:48.639309+0000","last_unstale":"2024-05-08T18:29:51.691378+0000","last_undegraded":"2024-05-08T18:29:51.691378+0000","last_fullsized":"2024-05-08T18:29:51.691378+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:10.533065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.683663+0000","last_change":"2024-05-08T18:29:50.668361+0000","last_active":"2024-05-08T18:29:51.683663+0000","last_peered":"2024-05-08T18:29:51.683663+0000","last_clean":"2024-05-08T18:29:51.683663+0000","last_became_active":"2024-05-08T18:29:50.667636+0000","last_became_peered":"2024-05-08T18:29:50.667636+0000","last_unstale":"2024-05-08T18:29:51.683663+0000","last_undegraded":"2024-05-08T18:29:51.683663+0000","last_fullsized":"2024-05-08T18:29:51.683663+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:58:35.356885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.692973+0000","last_change":"2024-05-08T18:29:42.584098+0000","last_active":"2024-05-08T18:29:51.692973+0000","last_peered":"2024-05-08T18:29:51.692973+0000","last_clean":"2024-05-08T18:29:51.692973+0000","last_became_active":"2024-05-08T18:29:42.583639+0000","last_became_peered":"2024-05-08T18:29:42.583639+0000","last_unstale":"2024-05-08T18:29:51.692973+0000","last_undegraded":"2024-05-08T18:29:51.692973+0000","last_fullsized":"2024-05-08T18:29:51.692973+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:08:15.026467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":134,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.677714+0000","last_change":"2024-05-08T18:29:27.115522+0000","last_active":"2024-05-08T18:29:51.677714+0000","last_peered":"2024-05-08T18:29:51.677714+0000","last_clean":"2024-05-08T18:29:51.677714+0000","last_became_active":"2024-05-08T18:29:27.112960+0000","last_became_peered":"2024-05-08T18:29:27.112960+0000","last_unstale":"2024-05-08T18:29:51.677714+0000","last_undegraded":"2024-05-08T18:29:51.677714+0000","last_fullsized":"2024-05-08T18:29:51.677714+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:26.091102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:26.091102+0000","last_clean_scrub_stamp":"2024-05-08T18:29:26.091102+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:09:50.296961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.689688+0000","last_change":"2024-05-08T18:29:34.496467+0000","last_active":"2024-05-08T18:29:51.689688+0000","last_peered":"2024-05-08T18:29:51.689688+0000","last_clean":"2024-05-08T18:29:51.689688+0000","last_became_active":"2024-05-08T18:29:34.495632+0000","last_became_peered":"2024-05-08T18:29:34.495632+0000","last_unstale":"2024-05-08T18:29:51.689688+0000","last_undegraded":"2024-05-08T18:29:51.689688+0000","last_fullsized":"2024-05-08T18:29:51.689688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:35.917391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.664397+0000","last_change":"2024-05-08T18:29:40.559945+0000","last_active":"2024-05-08T18:29:51.664397+0000","last_peered":"2024-05-08T18:29:51.664397+0000","last_clean":"2024-05-08T18:29:51.664397+0000","last_became_active":"2024-05-08T18:29:40.559723+0000","last_became_peered":"2024-05-08T18:29:40.559723+0000","last_unstale":"2024-05-08T18:29:51.664397+0000","last_undegraded":"2024-05-08T18:29:51.664397+0000","last_fullsized":"2024-05-08T18:29:51.664397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:39:17.879068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.678273+0000","last_change":"2024-05-08T18:29:44.592445+0000","last_active":"2024-05-08T18:29:51.678273+0000","last_peered":"2024-05-08T18:29:51.678273+0000","last_clean":"2024-05-08T18:29:51.678273+0000","last_became_active":"2024-05-08T18:29:44.587855+0000","last_became_peered":"2024-05-08T18:29:44.587855+0000","last_unstale":"2024-05-08T18:29:51.678273+0000","last_undegraded":"2024-05-08T18:29:51.678273+0000","last_fullsized":"2024-05-08T18:29:51.678273+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:06:05.355648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"33'13","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:52.321389+0000","last_change":"2024-05-08T18:29:46.595394+0000","last_active":"2024-05-08T18:29:52.321389+0000","last_peered":"2024-05-08T18:29:52.321389+0000","last_clean":"2024-05-08T18:29:52.321389+0000","last_became_active":"2024-05-08T18:29:46.594573+0000","last_became_peered":"2024-05-08T18:29:46.594573+0000","last_unstale":"2024-05-08T18:29:52.321389+0000","last_undegraded":"2024-05-08T18:29:52.321389+0000","last_fullsized":"2024-05-08T18:29:52.321389+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:47:11.360684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.700698+0000","last_change":"2024-05-08T18:29:48.632178+0000","last_active":"2024-05-08T18:29:51.700698+0000","last_peered":"2024-05-08T18:29:51.700698+0000","last_clean":"2024-05-08T18:29:51.700698+0000","last_became_active":"2024-05-08T18:29:48.631481+0000","last_became_peered":"2024-05-08T18:29:48.631481+0000","last_unstale":"2024-05-08T18:29:51.700698+0000","last_undegraded":"2024-05-08T18:29:51.700698+0000","last_fullsized":"2024-05-08T18:29:51.700698+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:34.806539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.690891+0000","last_change":"2024-05-08T18:29:50.675319+0000","last_active":"2024-05-08T18:29:51.690891+0000","last_peered":"2024-05-08T18:29:51.690891+0000","last_clean":"2024-05-08T18:29:51.690891+0000","last_became_active":"2024-05-08T18:29:50.674526+0000","last_became_peered":"2024-05-08T18:29:50.674526+0000","last_unstale":"2024-05-08T18:29:51.690891+0000","last_undegraded":"2024-05-08T18:29:51.690891+0000","last_fullsized":"2024-05-08T18:29:51.690891+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:59:06.404586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.701152+0000","last_change":"2024-05-08T18:29:42.568584+0000","last_active":"2024-05-08T18:29:51.701152+0000","last_peered":"2024-05-08T18:29:51.701152+0000","last_clean":"2024-05-08T18:29:51.701152+0000","last_became_active":"2024-05-08T18:29:42.568244+0000","last_became_peered":"2024-05-08T18:29:42.568244+0000","last_unstale":"2024-05-08T18:29:51.701152+0000","last_undegraded":"2024-05-08T18:29:51.701152+0000","last_fullsized":"2024-05-08T18:29:51.701152+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:20.397730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.677423+0000","last_change":"2024-05-08T18:29:34.497654+0000","last_active":"2024-05-08T18:29:51.677423+0000","last_peered":"2024-05-08T18:29:51.677423+0000","last_clean":"2024-05-08T18:29:51.677423+0000","last_became_active":"2024-05-08T18:29:34.495812+0000","last_became_peered":"2024-05-08T18:29:34.495812+0000","last_unstale":"2024-05-08T18:29:51.677423+0000","last_undegraded":"2024-05-08T18:29:51.677423+0000","last_fullsized":"2024-05-08T18:29:51.677423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:37:02.202613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.698554+0000","last_change":"2024-05-08T18:29:40.560653+0000","last_active":"2024-05-08T18:29:51.698554+0000","last_peered":"2024-05-08T18:29:51.698554+0000","last_clean":"2024-05-08T18:29:51.698554+0000","last_became_active":"2024-05-08T18:29:40.560296+0000","last_became_peered":"2024-05-08T18:29:40.560296+0000","last_unstale":"2024-05-08T18:29:51.698554+0000","last_undegraded":"2024-05-08T18:29:51.698554+0000","last_fullsized":"2024-05-08T18:29:51.698554+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:52.462279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.691667+0000","last_change":"2024-05-08T18:29:44.594681+0000","last_active":"2024-05-08T18:29:51.691667+0000","last_peered":"2024-05-08T18:29:51.691667+0000","last_clean":"2024-05-08T18:29:51.691667+0000","last_became_active":"2024-05-08T18:29:44.593917+0000","last_became_peered":"2024-05-08T18:29:44.593917+0000","last_unstale":"2024-05-08T18:29:51.691667+0000","last_undegraded":"2024-05-08T18:29:51.691667+0000","last_fullsized":"2024-05-08T18:29:51.691667+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:59:00.335437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"33'23","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:52.512202+0000","last_change":"2024-05-08T18:29:46.599932+0000","last_active":"2024-05-08T18:29:52.512202+0000","last_peered":"2024-05-08T18:29:52.512202+0000","last_clean":"2024-05-08T18:29:52.512202+0000","last_became_active":"2024-05-08T18:29:46.594789+0000","last_became_peered":"2024-05-08T18:29:46.594789+0000","last_unstale":"2024-05-08T18:29:52.512202+0000","last_undegraded":"2024-05-08T18:29:52.512202+0000","last_fullsized":"2024-05-08T18:29:52.512202+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:04:18.099848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":42,"num_read_kb":27,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.678827+0000","last_change":"2024-05-08T18:29:48.634661+0000","last_active":"2024-05-08T18:29:51.678827+0000","last_peered":"2024-05-08T18:29:51.678827+0000","last_clean":"2024-05-08T18:29:51.678827+0000","last_became_active":"2024-05-08T18:29:48.634044+0000","last_became_peered":"2024-05-08T18:29:48.634044+0000","last_unstale":"2024-05-08T18:29:51.678827+0000","last_undegraded":"2024-05-08T18:29:51.678827+0000","last_fullsized":"2024-05-08T18:29:51.678827+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:01:46.238076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.683381+0000","last_change":"2024-05-08T18:29:50.676536+0000","last_active":"2024-05-08T18:29:51.683381+0000","last_peered":"2024-05-08T18:29:51.683381+0000","last_clean":"2024-05-08T18:29:51.683381+0000","last_became_active":"2024-05-08T18:29:50.675770+0000","last_became_peered":"2024-05-08T18:29:50.675770+0000","last_unstale":"2024-05-08T18:29:51.683381+0000","last_undegraded":"2024-05-08T18:29:51.683381+0000","last_fullsized":"2024-05-08T18:29:51.683381+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:28.003482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.685094+0000","last_change":"2024-05-08T18:29:42.575253+0000","last_active":"2024-05-08T18:29:51.685094+0000","last_peered":"2024-05-08T18:29:51.685094+0000","last_clean":"2024-05-08T18:29:51.685094+0000","last_became_active":"2024-05-08T18:29:42.573621+0000","last_became_peered":"2024-05-08T18:29:42.573621+0000","last_unstale":"2024-05-08T18:29:51.685094+0000","last_undegraded":"2024-05-08T18:29:51.685094+0000","last_fullsized":"2024-05-08T18:29:51.685094+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:59.243324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.662571+0000","last_change":"2024-05-08T18:29:34.491071+0000","last_active":"2024-05-08T18:29:51.662571+0000","last_peered":"2024-05-08T18:29:51.662571+0000","last_clean":"2024-05-08T18:29:51.662571+0000","last_became_active":"2024-05-08T18:29:34.490717+0000","last_became_peered":"2024-05-08T18:29:34.490717+0000","last_unstale":"2024-05-08T18:29:51.662571+0000","last_undegraded":"2024-05-08T18:29:51.662571+0000","last_fullsized":"2024-05-08T18:29:51.662571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:55.793312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.683160+0000","last_change":"2024-05-08T18:29:40.530634+0000","last_active":"2024-05-08T18:29:51.683160+0000","last_peered":"2024-05-08T18:29:51.683160+0000","last_clean":"2024-05-08T18:29:51.683160+0000","last_became_active":"2024-05-08T18:29:40.529804+0000","last_became_peered":"2024-05-08T18:29:40.529804+0000","last_unstale":"2024-05-08T18:29:51.683160+0000","last_undegraded":"2024-05-08T18:29:51.683160+0000","last_fullsized":"2024-05-08T18:29:51.683160+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:59:25.840149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"26'1","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.665195+0000","last_change":"2024-05-08T18:29:44.584678+0000","last_active":"2024-05-08T18:29:51.665195+0000","last_peered":"2024-05-08T18:29:51.665195+0000","last_clean":"2024-05-08T18:29:51.665195+0000","last_became_active":"2024-05-08T18:29:44.584227+0000","last_became_peered":"2024-05-08T18:29:44.584227+0000","last_unstale":"2024-05-08T18:29:51.665195+0000","last_undegraded":"2024-05-08T18:29:51.665195+0000","last_fullsized":"2024-05-08T18:29:51.665195+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:04:01.281207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'15","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:52.515763+0000","last_change":"2024-05-08T18:29:46.608720+0000","last_active":"2024-05-08T18:29:52.515763+0000","last_peered":"2024-05-08T18:29:52.515763+0000","last_clean":"2024-05-08T18:29:52.515763+0000","last_became_active":"2024-05-08T18:29:46.607989+0000","last_became_peered":"2024-05-08T18:29:46.607989+0000","last_unstale":"2024-05-08T18:29:52.515763+0000","last_undegraded":"2024-05-08T18:29:52.515763+0000","last_fullsized":"2024-05-08T18:29:52.515763+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:58:31.293922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.698888+0000","last_change":"2024-05-08T18:29:48.625269+0000","last_active":"2024-05-08T18:29:51.698888+0000","last_peered":"2024-05-08T18:29:51.698888+0000","last_clean":"2024-05-08T18:29:51.698888+0000","last_became_active":"2024-05-08T18:29:48.624545+0000","last_became_peered":"2024-05-08T18:29:48.624545+0000","last_unstale":"2024-05-08T18:29:51.698888+0000","last_undegraded":"2024-05-08T18:29:51.698888+0000","last_fullsized":"2024-05-08T18:29:51.698888+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:16:42.799734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.667917+0000","last_change":"2024-05-08T18:29:50.688851+0000","last_active":"2024-05-08T18:29:51.667917+0000","last_peered":"2024-05-08T18:29:51.667917+0000","last_clean":"2024-05-08T18:29:51.667917+0000","last_became_active":"2024-05-08T18:29:50.687978+0000","last_became_peered":"2024-05-08T18:29:50.687978+0000","last_unstale":"2024-05-08T18:29:51.667917+0000","last_undegraded":"2024-05-08T18:29:51.667917+0000","last_fullsized":"2024-05-08T18:29:51.667917+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:28:29.836446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.684435+0000","last_change":"2024-05-08T18:29:42.574606+0000","last_active":"2024-05-08T18:29:51.684435+0000","last_peered":"2024-05-08T18:29:51.684435+0000","last_clean":"2024-05-08T18:29:51.684435+0000","last_became_active":"2024-05-08T18:29:42.573656+0000","last_became_peered":"2024-05-08T18:29:42.573656+0000","last_unstale":"2024-05-08T18:29:51.684435+0000","last_undegraded":"2024-05-08T18:29:51.684435+0000","last_fullsized":"2024-05-08T18:29:51.684435+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:54:16.539832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.688776+0000","last_change":"2024-05-08T18:29:34.496942+0000","last_active":"2024-05-08T18:29:51.688776+0000","last_peered":"2024-05-08T18:29:51.688776+0000","last_clean":"2024-05-08T18:29:51.688776+0000","last_became_active":"2024-05-08T18:29:34.495882+0000","last_became_peered":"2024-05-08T18:29:34.495882+0000","last_unstale":"2024-05-08T18:29:51.688776+0000","last_undegraded":"2024-05-08T18:29:51.688776+0000","last_fullsized":"2024-05-08T18:29:51.688776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:55.793312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.660494+0000","last_change":"2024-05-08T18:29:40.554353+0000","last_active":"2024-05-08T18:29:51.660494+0000","last_peered":"2024-05-08T18:29:51.660494+0000","last_clean":"2024-05-08T18:29:51.660494+0000","last_became_active":"2024-05-08T18:29:40.553527+0000","last_became_peered":"2024-05-08T18:29:40.553527+0000","last_unstale":"2024-05-08T18:29:51.660494+0000","last_undegraded":"2024-05-08T18:29:51.660494+0000","last_fullsized":"2024-05-08T18:29:51.660494+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:03:42.148647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.699793+0000","last_change":"2024-05-08T18:29:44.597411+0000","last_active":"2024-05-08T18:29:51.699793+0000","last_peered":"2024-05-08T18:29:51.699793+0000","last_clean":"2024-05-08T18:29:51.699793+0000","last_became_active":"2024-05-08T18:29:44.596678+0000","last_became_peered":"2024-05-08T18:29:44.596678+0000","last_unstale":"2024-05-08T18:29:51.699793+0000","last_undegraded":"2024-05-08T18:29:51.699793+0000","last_fullsized":"2024-05-08T18:29:51.699793+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:37:23.674968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'12","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:52.360421+0000","last_change":"2024-05-08T18:29:46.607040+0000","last_active":"2024-05-08T18:29:52.360421+0000","last_peered":"2024-05-08T18:29:52.360421+0000","last_clean":"2024-05-08T18:29:52.360421+0000","last_became_active":"2024-05-08T18:29:46.606367+0000","last_became_peered":"2024-05-08T18:29:46.606367+0000","last_unstale":"2024-05-08T18:29:52.360421+0000","last_undegraded":"2024-05-08T18:29:52.360421+0000","last_fullsized":"2024-05-08T18:29:52.360421+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:59:26.650126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.693344+0000","last_change":"2024-05-08T18:29:48.632665+0000","last_active":"2024-05-08T18:29:51.693344+0000","last_peered":"2024-05-08T18:29:51.693344+0000","last_clean":"2024-05-08T18:29:51.693344+0000","last_became_active":"2024-05-08T18:29:48.631874+0000","last_became_peered":"2024-05-08T18:29:48.631874+0000","last_unstale":"2024-05-08T18:29:51.693344+0000","last_undegraded":"2024-05-08T18:29:51.693344+0000","last_fullsized":"2024-05-08T18:29:51.693344+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:06:09.390017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.687003+0000","last_change":"2024-05-08T18:29:50.683443+0000","last_active":"2024-05-08T18:29:51.687003+0000","last_peered":"2024-05-08T18:29:51.687003+0000","last_clean":"2024-05-08T18:29:51.687003+0000","last_became_active":"2024-05-08T18:29:50.682634+0000","last_became_peered":"2024-05-08T18:29:50.682634+0000","last_unstale":"2024-05-08T18:29:51.687003+0000","last_undegraded":"2024-05-08T18:29:51.687003+0000","last_fullsized":"2024-05-08T18:29:51.687003+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:10:38.951662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.683744+0000","last_change":"2024-05-08T18:29:42.574593+0000","last_active":"2024-05-08T18:29:51.683744+0000","last_peered":"2024-05-08T18:29:51.683744+0000","last_clean":"2024-05-08T18:29:51.683744+0000","last_became_active":"2024-05-08T18:29:42.574288+0000","last_became_peered":"2024-05-08T18:29:42.574288+0000","last_unstale":"2024-05-08T18:29:51.683744+0000","last_undegraded":"2024-05-08T18:29:51.683744+0000","last_fullsized":"2024-05-08T18:29:51.683744+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:58.320701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.690535+0000","last_change":"2024-05-08T18:29:40.556697+0000","last_active":"2024-05-08T18:29:51.690535+0000","last_peered":"2024-05-08T18:29:51.690535+0000","last_clean":"2024-05-08T18:29:51.690535+0000","last_became_active":"2024-05-08T18:29:40.555965+0000","last_became_peered":"2024-05-08T18:29:40.555965+0000","last_unstale":"2024-05-08T18:29:51.690535+0000","last_undegraded":"2024-05-08T18:29:51.690535+0000","last_fullsized":"2024-05-08T18:29:51.690535+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:36:14.096907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.685015+0000","last_change":"2024-05-08T18:29:34.606393+0000","last_active":"2024-05-08T18:29:51.685015+0000","last_peered":"2024-05-08T18:29:51.685015+0000","last_clean":"2024-05-08T18:29:51.685015+0000","last_became_active":"2024-05-08T18:29:34.605574+0000","last_became_peered":"2024-05-08T18:29:34.605574+0000","last_unstale":"2024-05-08T18:29:51.685015+0000","last_undegraded":"2024-05-08T18:29:51.685015+0000","last_fullsized":"2024-05-08T18:29:51.685015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:55.793312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.699174+0000","last_change":"2024-05-08T18:29:44.595127+0000","last_active":"2024-05-08T18:29:51.699174+0000","last_peered":"2024-05-08T18:29:51.699174+0000","last_clean":"2024-05-08T18:29:51.699174+0000","last_became_active":"2024-05-08T18:29:44.594642+0000","last_became_peered":"2024-05-08T18:29:44.594642+0000","last_unstale":"2024-05-08T18:29:51.699174+0000","last_undegraded":"2024-05-08T18:29:51.699174+0000","last_fullsized":"2024-05-08T18:29:51.699174+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:04:49.020450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"33'18","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:52.449141+0000","last_change":"2024-05-08T18:29:46.602279+0000","last_active":"2024-05-08T18:29:52.449141+0000","last_peered":"2024-05-08T18:29:52.449141+0000","last_clean":"2024-05-08T18:29:52.449141+0000","last_became_active":"2024-05-08T18:29:46.599707+0000","last_became_peered":"2024-05-08T18:29:46.599707+0000","last_unstale":"2024-05-08T18:29:52.449141+0000","last_undegraded":"2024-05-08T18:29:52.449141+0000","last_fullsized":"2024-05-08T18:29:52.449141+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:54:48.654215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.658543+0000","last_change":"2024-05-08T18:29:48.639458+0000","last_active":"2024-05-08T18:29:51.658543+0000","last_peered":"2024-05-08T18:29:51.658543+0000","last_clean":"2024-05-08T18:29:51.658543+0000","last_became_active":"2024-05-08T18:29:48.638709+0000","last_became_peered":"2024-05-08T18:29:48.638709+0000","last_unstale":"2024-05-08T18:29:51.658543+0000","last_undegraded":"2024-05-08T18:29:51.658543+0000","last_fullsized":"2024-05-08T18:29:51.658543+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:19:58.182291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.700112+0000","last_change":"2024-05-08T18:29:50.681077+0000","last_active":"2024-05-08T18:29:51.700112+0000","last_peered":"2024-05-08T18:29:51.700112+0000","last_clean":"2024-05-08T18:29:51.700112+0000","last_became_active":"2024-05-08T18:29:50.675766+0000","last_became_peered":"2024-05-08T18:29:50.675766+0000","last_unstale":"2024-05-08T18:29:51.700112+0000","last_undegraded":"2024-05-08T18:29:51.700112+0000","last_fullsized":"2024-05-08T18:29:51.700112+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:09:29.641515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.699923+0000","last_change":"2024-05-08T18:29:42.571265+0000","last_active":"2024-05-08T18:29:51.699923+0000","last_peered":"2024-05-08T18:29:51.699923+0000","last_clean":"2024-05-08T18:29:51.699923+0000","last_became_active":"2024-05-08T18:29:42.570645+0000","last_became_peered":"2024-05-08T18:29:42.570645+0000","last_unstale":"2024-05-08T18:29:51.699923+0000","last_undegraded":"2024-05-08T18:29:51.699923+0000","last_fullsized":"2024-05-08T18:29:51.699923+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:30:29.452640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.685257+0000","last_change":"2024-05-08T18:29:40.531079+0000","last_active":"2024-05-08T18:29:51.685257+0000","last_peered":"2024-05-08T18:29:51.685257+0000","last_clean":"2024-05-08T18:29:51.685257+0000","last_became_active":"2024-05-08T18:29:40.530256+0000","last_became_peered":"2024-05-08T18:29:40.530256+0000","last_unstale":"2024-05-08T18:29:51.685257+0000","last_undegraded":"2024-05-08T18:29:51.685257+0000","last_fullsized":"2024-05-08T18:29:51.685257+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:09:42.581976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.679739+0000","last_change":"2024-05-08T18:29:34.603292+0000","last_active":"2024-05-08T18:29:51.679739+0000","last_peered":"2024-05-08T18:29:51.679739+0000","last_clean":"2024-05-08T18:29:51.679739+0000","last_became_active":"2024-05-08T18:29:34.602547+0000","last_became_peered":"2024-05-08T18:29:34.602547+0000","last_unstale":"2024-05-08T18:29:51.679739+0000","last_undegraded":"2024-05-08T18:29:51.679739+0000","last_fullsized":"2024-05-08T18:29:51.679739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:24:55.555475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.692088+0000","last_change":"2024-05-08T18:29:44.593275+0000","last_active":"2024-05-08T18:29:51.692088+0000","last_peered":"2024-05-08T18:29:51.692088+0000","last_clean":"2024-05-08T18:29:51.692088+0000","last_became_active":"2024-05-08T18:29:44.591870+0000","last_became_peered":"2024-05-08T18:29:44.591870+0000","last_unstale":"2024-05-08T18:29:51.692088+0000","last_undegraded":"2024-05-08T18:29:51.692088+0000","last_fullsized":"2024-05-08T18:29:51.692088+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:35.176971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"33'14","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:52.546955+0000","last_change":"2024-05-08T18:29:46.603499+0000","last_active":"2024-05-08T18:29:52.546955+0000","last_peered":"2024-05-08T18:29:52.546955+0000","last_clean":"2024-05-08T18:29:52.546955+0000","last_became_active":"2024-05-08T18:29:46.602920+0000","last_became_peered":"2024-05-08T18:29:46.602920+0000","last_unstale":"2024-05-08T18:29:52.546955+0000","last_undegraded":"2024-05-08T18:29:52.546955+0000","last_fullsized":"2024-05-08T18:29:52.546955+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:08.504882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"30'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.687940+0000","last_change":"2024-05-08T18:29:48.634915+0000","last_active":"2024-05-08T18:29:51.687940+0000","last_peered":"2024-05-08T18:29:51.687940+0000","last_clean":"2024-05-08T18:29:51.687940+0000","last_became_active":"2024-05-08T18:29:48.634280+0000","last_became_peered":"2024-05-08T18:29:48.634280+0000","last_unstale":"2024-05-08T18:29:51.687940+0000","last_undegraded":"2024-05-08T18:29:51.687940+0000","last_fullsized":"2024-05-08T18:29:51.687940+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:19:58.182291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.669019+0000","last_change":"2024-05-08T18:29:50.688742+0000","last_active":"2024-05-08T18:29:51.669019+0000","last_peered":"2024-05-08T18:29:51.669019+0000","last_clean":"2024-05-08T18:29:51.669019+0000","last_became_active":"2024-05-08T18:29:50.687135+0000","last_became_peered":"2024-05-08T18:29:50.687135+0000","last_unstale":"2024-05-08T18:29:51.669019+0000","last_undegraded":"2024-05-08T18:29:51.669019+0000","last_fullsized":"2024-05-08T18:29:51.669019+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:12:49.040807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.663656+0000","last_change":"2024-05-08T18:29:42.576864+0000","last_active":"2024-05-08T18:29:51.663656+0000","last_peered":"2024-05-08T18:29:51.663656+0000","last_clean":"2024-05-08T18:29:51.663656+0000","last_became_active":"2024-05-08T18:29:42.576392+0000","last_became_peered":"2024-05-08T18:29:42.576392+0000","last_unstale":"2024-05-08T18:29:51.663656+0000","last_undegraded":"2024-05-08T18:29:51.663656+0000","last_fullsized":"2024-05-08T18:29:51.663656+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:23.397435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.668340+0000","last_change":"2024-05-08T18:29:40.565872+0000","last_active":"2024-05-08T18:29:51.668340+0000","last_peered":"2024-05-08T18:29:51.668340+0000","last_clean":"2024-05-08T18:29:51.668340+0000","last_became_active":"2024-05-08T18:29:40.565655+0000","last_became_peered":"2024-05-08T18:29:40.565655+0000","last_unstale":"2024-05-08T18:29:51.668340+0000","last_undegraded":"2024-05-08T18:29:51.668340+0000","last_fullsized":"2024-05-08T18:29:51.668340+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:16:16.521258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.685010+0000","last_change":"2024-05-08T18:29:34.501273+0000","last_active":"2024-05-08T18:29:51.685010+0000","last_peered":"2024-05-08T18:29:51.685010+0000","last_clean":"2024-05-08T18:29:51.685010+0000","last_became_active":"2024-05-08T18:29:34.500933+0000","last_became_peered":"2024-05-08T18:29:34.500933+0000","last_unstale":"2024-05-08T18:29:51.685010+0000","last_undegraded":"2024-05-08T18:29:51.685010+0000","last_fullsized":"2024-05-08T18:29:51.685010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:35.917391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.658826+0000","last_change":"2024-05-08T18:29:44.576227+0000","last_active":"2024-05-08T18:29:51.658826+0000","last_peered":"2024-05-08T18:29:51.658826+0000","last_clean":"2024-05-08T18:29:51.658826+0000","last_became_active":"2024-05-08T18:29:44.575454+0000","last_became_peered":"2024-05-08T18:29:44.575454+0000","last_unstale":"2024-05-08T18:29:51.658826+0000","last_undegraded":"2024-05-08T18:29:51.658826+0000","last_fullsized":"2024-05-08T18:29:51.658826+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:06:05.355648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"33'10","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:52.498326+0000","last_change":"2024-05-08T18:29:46.609633+0000","last_active":"2024-05-08T18:29:52.498326+0000","last_peered":"2024-05-08T18:29:52.498326+0000","last_clean":"2024-05-08T18:29:52.498326+0000","last_became_active":"2024-05-08T18:29:46.603455+0000","last_became_peered":"2024-05-08T18:29:46.603455+0000","last_unstale":"2024-05-08T18:29:52.498326+0000","last_undegraded":"2024-05-08T18:29:52.498326+0000","last_fullsized":"2024-05-08T18:29:52.498326+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:07:54.654205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"30'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.668494+0000","last_change":"2024-05-08T18:29:48.637898+0000","last_active":"2024-05-08T18:29:51.668494+0000","last_peered":"2024-05-08T18:29:51.668494+0000","last_clean":"2024-05-08T18:29:51.668494+0000","last_became_active":"2024-05-08T18:29:48.637070+0000","last_became_peered":"2024-05-08T18:29:48.637070+0000","last_unstale":"2024-05-08T18:29:51.668494+0000","last_undegraded":"2024-05-08T18:29:51.668494+0000","last_fullsized":"2024-05-08T18:29:51.668494+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:03:46.392864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.699377+0000","last_change":"2024-05-08T18:29:50.691526+0000","last_active":"2024-05-08T18:29:51.699377+0000","last_peered":"2024-05-08T18:29:51.699377+0000","last_clean":"2024-05-08T18:29:51.699377+0000","last_became_active":"2024-05-08T18:29:50.690767+0000","last_became_peered":"2024-05-08T18:29:50.690767+0000","last_unstale":"2024-05-08T18:29:51.699377+0000","last_undegraded":"2024-05-08T18:29:51.699377+0000","last_fullsized":"2024-05-08T18:29:51.699377+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:32:29.972139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.659175+0000","last_change":"2024-05-08T18:29:42.562006+0000","last_active":"2024-05-08T18:29:51.659175+0000","last_peered":"2024-05-08T18:29:51.659175+0000","last_clean":"2024-05-08T18:29:51.659175+0000","last_became_active":"2024-05-08T18:29:42.560861+0000","last_became_peered":"2024-05-08T18:29:42.560861+0000","last_unstale":"2024-05-08T18:29:51.659175+0000","last_undegraded":"2024-05-08T18:29:51.659175+0000","last_fullsized":"2024-05-08T18:29:51.659175+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:36.890277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.701441+0000","last_change":"2024-05-08T18:29:40.550529+0000","last_active":"2024-05-08T18:29:51.701441+0000","last_peered":"2024-05-08T18:29:51.701441+0000","last_clean":"2024-05-08T18:29:51.701441+0000","last_became_active":"2024-05-08T18:29:40.550241+0000","last_became_peered":"2024-05-08T18:29:40.550241+0000","last_unstale":"2024-05-08T18:29:51.701441+0000","last_undegraded":"2024-05-08T18:29:51.701441+0000","last_fullsized":"2024-05-08T18:29:51.701441+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:48.294532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.693677+0000","last_change":"2024-05-08T18:29:34.493537+0000","last_active":"2024-05-08T18:29:51.693677+0000","last_peered":"2024-05-08T18:29:51.693677+0000","last_clean":"2024-05-08T18:29:51.693677+0000","last_became_active":"2024-05-08T18:29:34.492891+0000","last_became_peered":"2024-05-08T18:29:34.492891+0000","last_unstale":"2024-05-08T18:29:51.693677+0000","last_undegraded":"2024-05-08T18:29:51.693677+0000","last_fullsized":"2024-05-08T18:29:51.693677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:09:07.992256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.663400+0000","last_change":"2024-05-08T18:29:44.590102+0000","last_active":"2024-05-08T18:29:51.663400+0000","last_peered":"2024-05-08T18:29:51.663400+0000","last_clean":"2024-05-08T18:29:51.663400+0000","last_became_active":"2024-05-08T18:29:44.589471+0000","last_became_peered":"2024-05-08T18:29:44.589471+0000","last_unstale":"2024-05-08T18:29:51.663400+0000","last_undegraded":"2024-05-08T18:29:51.663400+0000","last_fullsized":"2024-05-08T18:29:51.663400+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:14:04.085401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"33'19","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:52.477657+0000","last_change":"2024-05-08T18:29:46.606967+0000","last_active":"2024-05-08T18:29:52.477657+0000","last_peered":"2024-05-08T18:29:52.477657+0000","last_clean":"2024-05-08T18:29:52.477657+0000","last_became_active":"2024-05-08T18:29:46.605693+0000","last_became_peered":"2024-05-08T18:29:46.605693+0000","last_unstale":"2024-05-08T18:29:52.477657+0000","last_undegraded":"2024-05-08T18:29:52.477657+0000","last_fullsized":"2024-05-08T18:29:52.477657+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:24:13.568294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.663761+0000","last_change":"2024-05-08T18:29:48.634271+0000","last_active":"2024-05-08T18:29:51.663761+0000","last_peered":"2024-05-08T18:29:51.663761+0000","last_clean":"2024-05-08T18:29:51.663761+0000","last_became_active":"2024-05-08T18:29:48.633607+0000","last_became_peered":"2024-05-08T18:29:48.633607+0000","last_unstale":"2024-05-08T18:29:51.663761+0000","last_undegraded":"2024-05-08T18:29:51.663761+0000","last_fullsized":"2024-05-08T18:29:51.663761+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:34.806539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.689384+0000","last_change":"2024-05-08T18:29:50.685494+0000","last_active":"2024-05-08T18:29:51.689384+0000","last_peered":"2024-05-08T18:29:51.689384+0000","last_clean":"2024-05-08T18:29:51.689384+0000","last_became_active":"2024-05-08T18:29:50.684818+0000","last_became_peered":"2024-05-08T18:29:50.684818+0000","last_unstale":"2024-05-08T18:29:51.689384+0000","last_undegraded":"2024-05-08T18:29:51.689384+0000","last_fullsized":"2024-05-08T18:29:51.689384+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:22.220842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.700596+0000","last_change":"2024-05-08T18:29:50.682937+0000","last_active":"2024-05-08T18:29:51.700596+0000","last_peered":"2024-05-08T18:29:51.700596+0000","last_clean":"2024-05-08T18:29:51.700596+0000","last_became_active":"2024-05-08T18:29:50.681771+0000","last_became_peered":"2024-05-08T18:29:50.681771+0000","last_unstale":"2024-05-08T18:29:51.700596+0000","last_undegraded":"2024-05-08T18:29:51.700596+0000","last_fullsized":"2024-05-08T18:29:51.700596+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:28:29.836446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.659830+0000","last_change":"2024-05-08T18:29:42.575909+0000","last_active":"2024-05-08T18:29:51.659830+0000","last_peered":"2024-05-08T18:29:51.659830+0000","last_clean":"2024-05-08T18:29:51.659830+0000","last_became_active":"2024-05-08T18:29:42.574877+0000","last_became_peered":"2024-05-08T18:29:42.574877+0000","last_unstale":"2024-05-08T18:29:51.659830+0000","last_undegraded":"2024-05-08T18:29:51.659830+0000","last_fullsized":"2024-05-08T18:29:51.659830+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:33.139089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.659791+0000","last_change":"2024-05-08T18:29:40.566496+0000","last_active":"2024-05-08T18:29:51.659791+0000","last_peered":"2024-05-08T18:29:51.659791+0000","last_clean":"2024-05-08T18:29:51.659791+0000","last_became_active":"2024-05-08T18:29:40.565874+0000","last_became_peered":"2024-05-08T18:29:40.565874+0000","last_unstale":"2024-05-08T18:29:51.659791+0000","last_undegraded":"2024-05-08T18:29:51.659791+0000","last_fullsized":"2024-05-08T18:29:51.659791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:07.239963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.684116+0000","last_change":"2024-05-08T18:29:44.595410+0000","last_active":"2024-05-08T18:29:51.684116+0000","last_peered":"2024-05-08T18:29:51.684116+0000","last_clean":"2024-05-08T18:29:51.684116+0000","last_became_active":"2024-05-08T18:29:44.594286+0000","last_became_peered":"2024-05-08T18:29:44.594286+0000","last_unstale":"2024-05-08T18:29:51.684116+0000","last_undegraded":"2024-05-08T18:29:51.684116+0000","last_fullsized":"2024-05-08T18:29:51.684116+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:38.928160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"33'11","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:52.554306+0000","last_change":"2024-05-08T18:29:46.591009+0000","last_active":"2024-05-08T18:29:52.554306+0000","last_peered":"2024-05-08T18:29:52.554306+0000","last_clean":"2024-05-08T18:29:52.554306+0000","last_became_active":"2024-05-08T18:29:46.588810+0000","last_became_peered":"2024-05-08T18:29:46.588810+0000","last_unstale":"2024-05-08T18:29:52.554306+0000","last_undegraded":"2024-05-08T18:29:52.554306+0000","last_fullsized":"2024-05-08T18:29:52.554306+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:34:45.745300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.663048+0000","last_change":"2024-05-08T18:29:48.634986+0000","last_active":"2024-05-08T18:29:51.663048+0000","last_peered":"2024-05-08T18:29:51.663048+0000","last_clean":"2024-05-08T18:29:51.663048+0000","last_became_active":"2024-05-08T18:29:48.633866+0000","last_became_peered":"2024-05-08T18:29:48.633866+0000","last_unstale":"2024-05-08T18:29:51.663048+0000","last_undegraded":"2024-05-08T18:29:51.663048+0000","last_fullsized":"2024-05-08T18:29:51.663048+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:46.539830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.667267+0000","last_change":"2024-05-08T18:29:50.693408+0000","last_active":"2024-05-08T18:29:51.667267+0000","last_peered":"2024-05-08T18:29:51.667267+0000","last_clean":"2024-05-08T18:29:51.667267+0000","last_became_active":"2024-05-08T18:29:50.692687+0000","last_became_peered":"2024-05-08T18:29:50.692687+0000","last_unstale":"2024-05-08T18:29:51.667267+0000","last_undegraded":"2024-05-08T18:29:51.667267+0000","last_fullsized":"2024-05-08T18:29:51.667267+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:22.834262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.683667+0000","last_change":"2024-05-08T18:29:42.581368+0000","last_active":"2024-05-08T18:29:51.683667+0000","last_peered":"2024-05-08T18:29:51.683667+0000","last_clean":"2024-05-08T18:29:51.683667+0000","last_became_active":"2024-05-08T18:29:42.580887+0000","last_became_peered":"2024-05-08T18:29:42.580887+0000","last_unstale":"2024-05-08T18:29:51.683667+0000","last_undegraded":"2024-05-08T18:29:51.683667+0000","last_fullsized":"2024-05-08T18:29:51.683667+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:08:15.026467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.679480+0000","last_change":"2024-05-08T18:29:40.572770+0000","last_active":"2024-05-08T18:29:51.679480+0000","last_peered":"2024-05-08T18:29:51.679480+0000","last_clean":"2024-05-08T18:29:51.679480+0000","last_became_active":"2024-05-08T18:29:40.572079+0000","last_became_peered":"2024-05-08T18:29:40.572079+0000","last_unstale":"2024-05-08T18:29:51.679480+0000","last_undegraded":"2024-05-08T18:29:51.679480+0000","last_fullsized":"2024-05-08T18:29:51.679480+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:05.929806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.666581+0000","last_change":"2024-05-08T18:29:44.581323+0000","last_active":"2024-05-08T18:29:51.666581+0000","last_peered":"2024-05-08T18:29:51.666581+0000","last_clean":"2024-05-08T18:29:51.666581+0000","last_became_active":"2024-05-08T18:29:44.580805+0000","last_became_peered":"2024-05-08T18:29:44.580805+0000","last_unstale":"2024-05-08T18:29:51.666581+0000","last_undegraded":"2024-05-08T18:29:51.666581+0000","last_fullsized":"2024-05-08T18:29:51.666581+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:35:25.591140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'4","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:52.015333+0000","last_change":"2024-05-08T18:29:46.602495+0000","last_active":"2024-05-08T18:29:52.015333+0000","last_peered":"2024-05-08T18:29:52.015333+0000","last_clean":"2024-05-08T18:29:52.015333+0000","last_became_active":"2024-05-08T18:29:46.599789+0000","last_became_peered":"2024-05-08T18:29:46.599789+0000","last_unstale":"2024-05-08T18:29:52.015333+0000","last_undegraded":"2024-05-08T18:29:52.015333+0000","last_fullsized":"2024-05-08T18:29:52.015333+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:18:16.375808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.677776+0000","last_change":"2024-05-08T18:29:48.642994+0000","last_active":"2024-05-08T18:29:51.677776+0000","last_peered":"2024-05-08T18:29:51.677776+0000","last_clean":"2024-05-08T18:29:51.677776+0000","last_became_active":"2024-05-08T18:29:48.642056+0000","last_became_peered":"2024-05-08T18:29:48.642056+0000","last_unstale":"2024-05-08T18:29:51.677776+0000","last_undegraded":"2024-05-08T18:29:51.677776+0000","last_fullsized":"2024-05-08T18:29:51.677776+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:47:54.034851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.699927+0000","last_change":"2024-05-08T18:29:50.672513+0000","last_active":"2024-05-08T18:29:51.699927+0000","last_peered":"2024-05-08T18:29:51.699927+0000","last_clean":"2024-05-08T18:29:51.699927+0000","last_became_active":"2024-05-08T18:29:50.671781+0000","last_became_peered":"2024-05-08T18:29:50.671781+0000","last_unstale":"2024-05-08T18:29:51.699927+0000","last_undegraded":"2024-05-08T18:29:51.699927+0000","last_fullsized":"2024-05-08T18:29:51.699927+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:45:34.171402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.664319+0000","last_change":"2024-05-08T18:29:42.576843+0000","last_active":"2024-05-08T18:29:51.664319+0000","last_peered":"2024-05-08T18:29:51.664319+0000","last_clean":"2024-05-08T18:29:51.664319+0000","last_became_active":"2024-05-08T18:29:42.576379+0000","last_became_peered":"2024-05-08T18:29:42.576379+0000","last_unstale":"2024-05-08T18:29:51.664319+0000","last_undegraded":"2024-05-08T18:29:51.664319+0000","last_fullsized":"2024-05-08T18:29:51.664319+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:20.471010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.690634+0000","last_change":"2024-05-08T18:29:40.542997+0000","last_active":"2024-05-08T18:29:51.690634+0000","last_peered":"2024-05-08T18:29:51.690634+0000","last_clean":"2024-05-08T18:29:51.690634+0000","last_became_active":"2024-05-08T18:29:40.542239+0000","last_became_peered":"2024-05-08T18:29:40.542239+0000","last_unstale":"2024-05-08T18:29:51.690634+0000","last_undegraded":"2024-05-08T18:29:51.690634+0000","last_fullsized":"2024-05-08T18:29:51.690634+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:14:43.555504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.676958+0000","last_change":"2024-05-08T18:29:44.594178+0000","last_active":"2024-05-08T18:29:51.676958+0000","last_peered":"2024-05-08T18:29:51.676958+0000","last_clean":"2024-05-08T18:29:51.676958+0000","last_became_active":"2024-05-08T18:29:44.592476+0000","last_became_peered":"2024-05-08T18:29:44.592476+0000","last_unstale":"2024-05-08T18:29:51.676958+0000","last_undegraded":"2024-05-08T18:29:51.676958+0000","last_fullsized":"2024-05-08T18:29:51.676958+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:04:16.093662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"33'11","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:52.462061+0000","last_change":"2024-05-08T18:29:46.597288+0000","last_active":"2024-05-08T18:29:52.462061+0000","last_peered":"2024-05-08T18:29:52.462061+0000","last_clean":"2024-05-08T18:29:52.462061+0000","last_became_active":"2024-05-08T18:29:46.596452+0000","last_became_peered":"2024-05-08T18:29:46.596452+0000","last_unstale":"2024-05-08T18:29:52.462061+0000","last_undegraded":"2024-05-08T18:29:52.462061+0000","last_fullsized":"2024-05-08T18:29:52.462061+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:32:43.245753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.691949+0000","last_change":"2024-05-08T18:29:48.635436+0000","last_active":"2024-05-08T18:29:51.691949+0000","last_peered":"2024-05-08T18:29:51.691949+0000","last_clean":"2024-05-08T18:29:51.691949+0000","last_became_active":"2024-05-08T18:29:48.634704+0000","last_became_peered":"2024-05-08T18:29:48.634704+0000","last_unstale":"2024-05-08T18:29:51.691949+0000","last_undegraded":"2024-05-08T18:29:51.691949+0000","last_fullsized":"2024-05-08T18:29:51.691949+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:55:52.238481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.689046+0000","last_change":"2024-05-08T18:29:50.687974+0000","last_active":"2024-05-08T18:29:51.689046+0000","last_peered":"2024-05-08T18:29:51.689046+0000","last_clean":"2024-05-08T18:29:51.689046+0000","last_became_active":"2024-05-08T18:29:50.687045+0000","last_became_peered":"2024-05-08T18:29:50.687045+0000","last_unstale":"2024-05-08T18:29:51.689046+0000","last_undegraded":"2024-05-08T18:29:51.689046+0000","last_fullsized":"2024-05-08T18:29:51.689046+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:55:01.894779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.663855+0000","last_change":"2024-05-08T18:29:42.563779+0000","last_active":"2024-05-08T18:29:51.663855+0000","last_peered":"2024-05-08T18:29:51.663855+0000","last_clean":"2024-05-08T18:29:51.663855+0000","last_became_active":"2024-05-08T18:29:42.562522+0000","last_became_peered":"2024-05-08T18:29:42.562522+0000","last_unstale":"2024-05-08T18:29:51.663855+0000","last_undegraded":"2024-05-08T18:29:51.663855+0000","last_fullsized":"2024-05-08T18:29:51.663855+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:35:23.016110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.701373+0000","last_change":"2024-05-08T18:29:40.541112+0000","last_active":"2024-05-08T18:29:51.701373+0000","last_peered":"2024-05-08T18:29:51.701373+0000","last_clean":"2024-05-08T18:29:51.701373+0000","last_became_active":"2024-05-08T18:29:40.540835+0000","last_became_peered":"2024-05-08T18:29:40.540835+0000","last_unstale":"2024-05-08T18:29:51.701373+0000","last_undegraded":"2024-05-08T18:29:51.701373+0000","last_fullsized":"2024-05-08T18:29:51.701373+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:43:14.995191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.691753+0000","last_change":"2024-05-08T18:29:44.592033+0000","last_active":"2024-05-08T18:29:51.691753+0000","last_peered":"2024-05-08T18:29:51.691753+0000","last_clean":"2024-05-08T18:29:51.691753+0000","last_became_active":"2024-05-08T18:29:44.590454+0000","last_became_peered":"2024-05-08T18:29:44.590454+0000","last_unstale":"2024-05-08T18:29:51.691753+0000","last_undegraded":"2024-05-08T18:29:51.691753+0000","last_fullsized":"2024-05-08T18:29:51.691753+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:11:03.740365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"33'9","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:52.236160+0000","last_change":"2024-05-08T18:29:46.607002+0000","last_active":"2024-05-08T18:29:52.236160+0000","last_peered":"2024-05-08T18:29:52.236160+0000","last_clean":"2024-05-08T18:29:52.236160+0000","last_became_active":"2024-05-08T18:29:46.606172+0000","last_became_peered":"2024-05-08T18:29:46.606172+0000","last_unstale":"2024-05-08T18:29:52.236160+0000","last_undegraded":"2024-05-08T18:29:52.236160+0000","last_fullsized":"2024-05-08T18:29:52.236160+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:37:35.850414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.698549+0000","last_change":"2024-05-08T18:29:48.632948+0000","last_active":"2024-05-08T18:29:51.698549+0000","last_peered":"2024-05-08T18:29:51.698549+0000","last_clean":"2024-05-08T18:29:51.698549+0000","last_became_active":"2024-05-08T18:29:48.631219+0000","last_became_peered":"2024-05-08T18:29:48.631219+0000","last_unstale":"2024-05-08T18:29:51.698549+0000","last_undegraded":"2024-05-08T18:29:51.698549+0000","last_fullsized":"2024-05-08T18:29:51.698549+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:19:01.454355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.693579+0000","last_change":"2024-05-08T18:29:42.570180+0000","last_active":"2024-05-08T18:29:51.693579+0000","last_peered":"2024-05-08T18:29:51.693579+0000","last_clean":"2024-05-08T18:29:51.693579+0000","last_became_active":"2024-05-08T18:29:42.569425+0000","last_became_peered":"2024-05-08T18:29:42.569425+0000","last_unstale":"2024-05-08T18:29:51.693579+0000","last_undegraded":"2024-05-08T18:29:51.693579+0000","last_fullsized":"2024-05-08T18:29:51.693579+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:35.037465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.665688+0000","last_change":"2024-05-08T18:29:40.547711+0000","last_active":"2024-05-08T18:29:51.665688+0000","last_peered":"2024-05-08T18:29:51.665688+0000","last_clean":"2024-05-08T18:29:51.665688+0000","last_became_active":"2024-05-08T18:29:40.547479+0000","last_became_peered":"2024-05-08T18:29:40.547479+0000","last_unstale":"2024-05-08T18:29:51.665688+0000","last_undegraded":"2024-05-08T18:29:51.665688+0000","last_fullsized":"2024-05-08T18:29:51.665688+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:12:40.901620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.700828+0000","last_change":"2024-05-08T18:29:44.591547+0000","last_active":"2024-05-08T18:29:51.700828+0000","last_peered":"2024-05-08T18:29:51.700828+0000","last_clean":"2024-05-08T18:29:51.700828+0000","last_became_active":"2024-05-08T18:29:44.590498+0000","last_became_peered":"2024-05-08T18:29:44.590498+0000","last_unstale":"2024-05-08T18:29:51.700828+0000","last_undegraded":"2024-05-08T18:29:51.700828+0000","last_fullsized":"2024-05-08T18:29:51.700828+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:14:04.085401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"33'12","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:52.582399+0000","last_change":"2024-05-08T18:29:46.600437+0000","last_active":"2024-05-08T18:29:52.582399+0000","last_peered":"2024-05-08T18:29:52.582399+0000","last_clean":"2024-05-08T18:29:52.582399+0000","last_became_active":"2024-05-08T18:29:46.594672+0000","last_became_peered":"2024-05-08T18:29:46.594672+0000","last_unstale":"2024-05-08T18:29:52.582399+0000","last_undegraded":"2024-05-08T18:29:52.582399+0000","last_fullsized":"2024-05-08T18:29:52.582399+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:35:53.294312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.689315+0000","last_change":"2024-05-08T18:29:48.639840+0000","last_active":"2024-05-08T18:29:51.689315+0000","last_peered":"2024-05-08T18:29:51.689315+0000","last_clean":"2024-05-08T18:29:51.689315+0000","last_became_active":"2024-05-08T18:29:48.639120+0000","last_became_peered":"2024-05-08T18:29:48.639120+0000","last_unstale":"2024-05-08T18:29:51.689315+0000","last_undegraded":"2024-05-08T18:29:51.689315+0000","last_fullsized":"2024-05-08T18:29:51.689315+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:13:50.865474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.663655+0000","last_change":"2024-05-08T18:29:50.684843+0000","last_active":"2024-05-08T18:29:51.663655+0000","last_peered":"2024-05-08T18:29:51.663655+0000","last_clean":"2024-05-08T18:29:51.663655+0000","last_became_active":"2024-05-08T18:29:50.684119+0000","last_became_peered":"2024-05-08T18:29:50.684119+0000","last_unstale":"2024-05-08T18:29:51.663655+0000","last_undegraded":"2024-05-08T18:29:51.663655+0000","last_fullsized":"2024-05-08T18:29:51.663655+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:09:29.641515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.701135+0000","last_change":"2024-05-08T18:29:42.575763+0000","last_active":"2024-05-08T18:29:51.701135+0000","last_peered":"2024-05-08T18:29:51.701135+0000","last_clean":"2024-05-08T18:29:51.701135+0000","last_became_active":"2024-05-08T18:29:42.575450+0000","last_became_peered":"2024-05-08T18:29:42.575450+0000","last_unstale":"2024-05-08T18:29:51.701135+0000","last_undegraded":"2024-05-08T18:29:51.701135+0000","last_fullsized":"2024-05-08T18:29:51.701135+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:20.471010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.684269+0000","last_change":"2024-05-08T18:29:40.546101+0000","last_active":"2024-05-08T18:29:51.684269+0000","last_peered":"2024-05-08T18:29:51.684269+0000","last_clean":"2024-05-08T18:29:51.684269+0000","last_became_active":"2024-05-08T18:29:40.545814+0000","last_became_peered":"2024-05-08T18:29:40.545814+0000","last_unstale":"2024-05-08T18:29:51.684269+0000","last_undegraded":"2024-05-08T18:29:51.684269+0000","last_fullsized":"2024-05-08T18:29:51.684269+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:22.579629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.693391+0000","last_change":"2024-05-08T18:29:44.591310+0000","last_active":"2024-05-08T18:29:51.693391+0000","last_peered":"2024-05-08T18:29:51.693391+0000","last_clean":"2024-05-08T18:29:51.693391+0000","last_became_active":"2024-05-08T18:29:44.590394+0000","last_became_peered":"2024-05-08T18:29:44.590394+0000","last_unstale":"2024-05-08T18:29:51.693391+0000","last_undegraded":"2024-05-08T18:29:51.693391+0000","last_fullsized":"2024-05-08T18:29:51.693391+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:02:28.348982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"33'15","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:52.364274+0000","last_change":"2024-05-08T18:29:46.605887+0000","last_active":"2024-05-08T18:29:52.364274+0000","last_peered":"2024-05-08T18:29:52.364274+0000","last_clean":"2024-05-08T18:29:52.364274+0000","last_became_active":"2024-05-08T18:29:46.604917+0000","last_became_peered":"2024-05-08T18:29:46.604917+0000","last_unstale":"2024-05-08T18:29:52.364274+0000","last_undegraded":"2024-05-08T18:29:52.364274+0000","last_fullsized":"2024-05-08T18:29:52.364274+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:22:36.338527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.685147+0000","last_change":"2024-05-08T18:29:48.644420+0000","last_active":"2024-05-08T18:29:51.685147+0000","last_peered":"2024-05-08T18:29:51.685147+0000","last_clean":"2024-05-08T18:29:51.685147+0000","last_became_active":"2024-05-08T18:29:48.643493+0000","last_became_peered":"2024-05-08T18:29:48.643493+0000","last_unstale":"2024-05-08T18:29:51.685147+0000","last_undegraded":"2024-05-08T18:29:51.685147+0000","last_fullsized":"2024-05-08T18:29:51.685147+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:19:33.148012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.691654+0000","last_change":"2024-05-08T18:29:50.687485+0000","last_active":"2024-05-08T18:29:51.691654+0000","last_peered":"2024-05-08T18:29:51.691654+0000","last_clean":"2024-05-08T18:29:51.691654+0000","last_became_active":"2024-05-08T18:29:50.686750+0000","last_became_peered":"2024-05-08T18:29:50.686750+0000","last_unstale":"2024-05-08T18:29:51.691654+0000","last_undegraded":"2024-05-08T18:29:51.691654+0000","last_fullsized":"2024-05-08T18:29:51.691654+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:41.914164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.667159+0000","last_change":"2024-05-08T18:29:42.566571+0000","last_active":"2024-05-08T18:29:51.667159+0000","last_peered":"2024-05-08T18:29:51.667159+0000","last_clean":"2024-05-08T18:29:51.667159+0000","last_became_active":"2024-05-08T18:29:42.563695+0000","last_became_peered":"2024-05-08T18:29:42.563695+0000","last_unstale":"2024-05-08T18:29:51.667159+0000","last_undegraded":"2024-05-08T18:29:51.667159+0000","last_fullsized":"2024-05-08T18:29:51.667159+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:46.887628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.660300+0000","last_change":"2024-05-08T18:29:40.545512+0000","last_active":"2024-05-08T18:29:51.660300+0000","last_peered":"2024-05-08T18:29:51.660300+0000","last_clean":"2024-05-08T18:29:51.660300+0000","last_became_active":"2024-05-08T18:29:40.544216+0000","last_became_peered":"2024-05-08T18:29:40.544216+0000","last_unstale":"2024-05-08T18:29:51.660300+0000","last_undegraded":"2024-05-08T18:29:51.660300+0000","last_fullsized":"2024-05-08T18:29:51.660300+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:37:08.242362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.661019+0000","last_change":"2024-05-08T18:29:44.576107+0000","last_active":"2024-05-08T18:29:51.661019+0000","last_peered":"2024-05-08T18:29:51.661019+0000","last_clean":"2024-05-08T18:29:51.661019+0000","last_became_active":"2024-05-08T18:29:44.575344+0000","last_became_peered":"2024-05-08T18:29:44.575344+0000","last_unstale":"2024-05-08T18:29:51.661019+0000","last_undegraded":"2024-05-08T18:29:51.661019+0000","last_fullsized":"2024-05-08T18:29:51.661019+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:19.731003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"33'11","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:52.560499+0000","last_change":"2024-05-08T18:29:46.584785+0000","last_active":"2024-05-08T18:29:52.560499+0000","last_peered":"2024-05-08T18:29:52.560499+0000","last_clean":"2024-05-08T18:29:52.560499+0000","last_became_active":"2024-05-08T18:29:46.583390+0000","last_became_peered":"2024-05-08T18:29:46.583390+0000","last_unstale":"2024-05-08T18:29:52.560499+0000","last_undegraded":"2024-05-08T18:29:52.560499+0000","last_fullsized":"2024-05-08T18:29:52.560499+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:27:01.747339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.684171+0000","last_change":"2024-05-08T18:29:48.643558+0000","last_active":"2024-05-08T18:29:51.684171+0000","last_peered":"2024-05-08T18:29:51.684171+0000","last_clean":"2024-05-08T18:29:51.684171+0000","last_became_active":"2024-05-08T18:29:48.642773+0000","last_became_peered":"2024-05-08T18:29:48.642773+0000","last_unstale":"2024-05-08T18:29:51.684171+0000","last_undegraded":"2024-05-08T18:29:51.684171+0000","last_fullsized":"2024-05-08T18:29:51.684171+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:59:04.369806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.687638+0000","last_change":"2024-05-08T18:29:50.674796+0000","last_active":"2024-05-08T18:29:51.687638+0000","last_peered":"2024-05-08T18:29:51.687638+0000","last_clean":"2024-05-08T18:29:51.687638+0000","last_became_active":"2024-05-08T18:29:50.674057+0000","last_became_peered":"2024-05-08T18:29:50.674057+0000","last_unstale":"2024-05-08T18:29:51.687638+0000","last_undegraded":"2024-05-08T18:29:51.687638+0000","last_fullsized":"2024-05-08T18:29:51.687638+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:34:14.488295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.665122+0000","last_change":"2024-05-08T18:29:42.577642+0000","last_active":"2024-05-08T18:29:51.665122+0000","last_peered":"2024-05-08T18:29:51.665122+0000","last_clean":"2024-05-08T18:29:51.665122+0000","last_became_active":"2024-05-08T18:29:42.577275+0000","last_became_peered":"2024-05-08T18:29:42.577275+0000","last_unstale":"2024-05-08T18:29:51.665122+0000","last_undegraded":"2024-05-08T18:29:51.665122+0000","last_fullsized":"2024-05-08T18:29:51.665122+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:51:45.155037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.698805+0000","last_change":"2024-05-08T18:29:40.562873+0000","last_active":"2024-05-08T18:29:51.698805+0000","last_peered":"2024-05-08T18:29:51.698805+0000","last_clean":"2024-05-08T18:29:51.698805+0000","last_became_active":"2024-05-08T18:29:40.562594+0000","last_became_peered":"2024-05-08T18:29:40.562594+0000","last_unstale":"2024-05-08T18:29:51.698805+0000","last_undegraded":"2024-05-08T18:29:51.698805+0000","last_fullsized":"2024-05-08T18:29:51.698805+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:16:16.521258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.685433+0000","last_change":"2024-05-08T18:29:44.594152+0000","last_active":"2024-05-08T18:29:51.685433+0000","last_peered":"2024-05-08T18:29:51.685433+0000","last_clean":"2024-05-08T18:29:51.685433+0000","last_became_active":"2024-05-08T18:29:44.593398+0000","last_became_peered":"2024-05-08T18:29:44.593398+0000","last_unstale":"2024-05-08T18:29:51.685433+0000","last_undegraded":"2024-05-08T18:29:51.685433+0000","last_fullsized":"2024-05-08T18:29:51.685433+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:11.825480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"33'10","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:52.536162+0000","last_change":"2024-05-08T18:29:46.602137+0000","last_active":"2024-05-08T18:29:52.536162+0000","last_peered":"2024-05-08T18:29:52.536162+0000","last_clean":"2024-05-08T18:29:52.536162+0000","last_became_active":"2024-05-08T18:29:46.601402+0000","last_became_peered":"2024-05-08T18:29:46.601402+0000","last_unstale":"2024-05-08T18:29:52.536162+0000","last_undegraded":"2024-05-08T18:29:52.536162+0000","last_fullsized":"2024-05-08T18:29:52.536162+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:23.940519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"30'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.692948+0000","last_change":"2024-05-08T18:29:48.635696+0000","last_active":"2024-05-08T18:29:51.692948+0000","last_peered":"2024-05-08T18:29:51.692948+0000","last_clean":"2024-05-08T18:29:51.692948+0000","last_became_active":"2024-05-08T18:29:48.634859+0000","last_became_peered":"2024-05-08T18:29:48.634859+0000","last_unstale":"2024-05-08T18:29:51.692948+0000","last_undegraded":"2024-05-08T18:29:51.692948+0000","last_fullsized":"2024-05-08T18:29:51.692948+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:35:55.322495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.677021+0000","last_change":"2024-05-08T18:29:50.679757+0000","last_active":"2024-05-08T18:29:51.677021+0000","last_peered":"2024-05-08T18:29:51.677021+0000","last_clean":"2024-05-08T18:29:51.677021+0000","last_became_active":"2024-05-08T18:29:50.679011+0000","last_became_peered":"2024-05-08T18:29:50.679011+0000","last_unstale":"2024-05-08T18:29:51.677021+0000","last_undegraded":"2024-05-08T18:29:51.677021+0000","last_fullsized":"2024-05-08T18:29:51.677021+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:34:14.488295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.659577+0000","last_change":"2024-05-08T18:29:42.560354+0000","last_active":"2024-05-08T18:29:51.659577+0000","last_peered":"2024-05-08T18:29:51.659577+0000","last_clean":"2024-05-08T18:29:51.659577+0000","last_became_active":"2024-05-08T18:29:42.559647+0000","last_became_peered":"2024-05-08T18:29:42.559647+0000","last_unstale":"2024-05-08T18:29:51.659577+0000","last_undegraded":"2024-05-08T18:29:51.659577+0000","last_fullsized":"2024-05-08T18:29:51.659577+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:18:10.803989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.689747+0000","last_change":"2024-05-08T18:29:40.557683+0000","last_active":"2024-05-08T18:29:51.689747+0000","last_peered":"2024-05-08T18:29:51.689747+0000","last_clean":"2024-05-08T18:29:51.689747+0000","last_became_active":"2024-05-08T18:29:40.556254+0000","last_became_peered":"2024-05-08T18:29:40.556254+0000","last_unstale":"2024-05-08T18:29:51.689747+0000","last_undegraded":"2024-05-08T18:29:51.689747+0000","last_fullsized":"2024-05-08T18:29:51.689747+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:51:43.135322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.677671+0000","last_change":"2024-05-08T18:29:44.594068+0000","last_active":"2024-05-08T18:29:51.677671+0000","last_peered":"2024-05-08T18:29:51.677671+0000","last_clean":"2024-05-08T18:29:51.677671+0000","last_became_active":"2024-05-08T18:29:44.593322+0000","last_became_peered":"2024-05-08T18:29:44.593322+0000","last_unstale":"2024-05-08T18:29:51.677671+0000","last_undegraded":"2024-05-08T18:29:51.677671+0000","last_fullsized":"2024-05-08T18:29:51.677671+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:19.731003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"33'15","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:52.572003+0000","last_change":"2024-05-08T18:29:46.604700+0000","last_active":"2024-05-08T18:29:52.572003+0000","last_peered":"2024-05-08T18:29:52.572003+0000","last_clean":"2024-05-08T18:29:52.572003+0000","last_became_active":"2024-05-08T18:29:46.603885+0000","last_became_peered":"2024-05-08T18:29:46.603885+0000","last_unstale":"2024-05-08T18:29:52.572003+0000","last_undegraded":"2024-05-08T18:29:52.572003+0000","last_fullsized":"2024-05-08T18:29:52.572003+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:22:36.338527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.697759+0000","last_change":"2024-05-08T18:29:48.640814+0000","last_active":"2024-05-08T18:29:51.697759+0000","last_peered":"2024-05-08T18:29:51.697759+0000","last_clean":"2024-05-08T18:29:51.697759+0000","last_became_active":"2024-05-08T18:29:48.640046+0000","last_became_peered":"2024-05-08T18:29:48.640046+0000","last_unstale":"2024-05-08T18:29:51.697759+0000","last_undegraded":"2024-05-08T18:29:51.697759+0000","last_fullsized":"2024-05-08T18:29:51.697759+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:53:21.219706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.679673+0000","last_change":"2024-05-08T18:29:50.692688+0000","last_active":"2024-05-08T18:29:51.679673+0000","last_peered":"2024-05-08T18:29:51.679673+0000","last_clean":"2024-05-08T18:29:51.679673+0000","last_became_active":"2024-05-08T18:29:50.692123+0000","last_became_peered":"2024-05-08T18:29:50.692123+0000","last_unstale":"2024-05-08T18:29:51.679673+0000","last_undegraded":"2024-05-08T18:29:51.679673+0000","last_fullsized":"2024-05-08T18:29:51.679673+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:38.318890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.659950+0000","last_change":"2024-05-08T18:29:42.558336+0000","last_active":"2024-05-08T18:29:51.659950+0000","last_peered":"2024-05-08T18:29:51.659950+0000","last_clean":"2024-05-08T18:29:51.659950+0000","last_became_active":"2024-05-08T18:29:42.557570+0000","last_became_peered":"2024-05-08T18:29:42.557570+0000","last_unstale":"2024-05-08T18:29:51.659950+0000","last_undegraded":"2024-05-08T18:29:51.659950+0000","last_fullsized":"2024-05-08T18:29:51.659950+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:54:16.539832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.690281+0000","last_change":"2024-05-08T18:29:40.537090+0000","last_active":"2024-05-08T18:29:51.690281+0000","last_peered":"2024-05-08T18:29:51.690281+0000","last_clean":"2024-05-08T18:29:51.690281+0000","last_became_active":"2024-05-08T18:29:40.536188+0000","last_became_peered":"2024-05-08T18:29:40.536188+0000","last_unstale":"2024-05-08T18:29:51.690281+0000","last_undegraded":"2024-05-08T18:29:51.690281+0000","last_fullsized":"2024-05-08T18:29:51.690281+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:22:48.880581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.688881+0000","last_change":"2024-05-08T18:29:44.578901+0000","last_active":"2024-05-08T18:29:51.688881+0000","last_peered":"2024-05-08T18:29:51.688881+0000","last_clean":"2024-05-08T18:29:51.688881+0000","last_became_active":"2024-05-08T18:29:44.578171+0000","last_became_peered":"2024-05-08T18:29:44.578171+0000","last_unstale":"2024-05-08T18:29:51.688881+0000","last_undegraded":"2024-05-08T18:29:51.688881+0000","last_fullsized":"2024-05-08T18:29:51.688881+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:19.731003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"33'9","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.971657+0000","last_change":"2024-05-08T18:29:46.604539+0000","last_active":"2024-05-08T18:29:51.971657+0000","last_peered":"2024-05-08T18:29:51.971657+0000","last_clean":"2024-05-08T18:29:51.971657+0000","last_became_active":"2024-05-08T18:29:46.603728+0000","last_became_peered":"2024-05-08T18:29:46.603728+0000","last_unstale":"2024-05-08T18:29:51.971657+0000","last_undegraded":"2024-05-08T18:29:51.971657+0000","last_fullsized":"2024-05-08T18:29:51.971657+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:12:41.226788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.691293+0000","last_change":"2024-05-08T18:29:48.635813+0000","last_active":"2024-05-08T18:29:51.691293+0000","last_peered":"2024-05-08T18:29:51.691293+0000","last_clean":"2024-05-08T18:29:51.691293+0000","last_became_active":"2024-05-08T18:29:48.634664+0000","last_became_peered":"2024-05-08T18:29:48.634664+0000","last_unstale":"2024-05-08T18:29:51.691293+0000","last_undegraded":"2024-05-08T18:29:51.691293+0000","last_fullsized":"2024-05-08T18:29:51.691293+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:27:23.427365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.668159+0000","last_change":"2024-05-08T18:29:50.687517+0000","last_active":"2024-05-08T18:29:51.668159+0000","last_peered":"2024-05-08T18:29:51.668159+0000","last_clean":"2024-05-08T18:29:51.668159+0000","last_became_active":"2024-05-08T18:29:50.686662+0000","last_became_peered":"2024-05-08T18:29:50.686662+0000","last_unstale":"2024-05-08T18:29:51.668159+0000","last_undegraded":"2024-05-08T18:29:51.668159+0000","last_fullsized":"2024-05-08T18:29:51.668159+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:58:00.455559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.664674+0000","last_change":"2024-05-08T18:29:42.558848+0000","last_active":"2024-05-08T18:29:51.664674+0000","last_peered":"2024-05-08T18:29:51.664674+0000","last_clean":"2024-05-08T18:29:51.664674+0000","last_became_active":"2024-05-08T18:29:42.558390+0000","last_became_peered":"2024-05-08T18:29:42.558390+0000","last_unstale":"2024-05-08T18:29:51.664674+0000","last_undegraded":"2024-05-08T18:29:51.664674+0000","last_fullsized":"2024-05-08T18:29:51.664674+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:55:30.468069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.668785+0000","last_change":"2024-05-08T18:29:40.567772+0000","last_active":"2024-05-08T18:29:51.668785+0000","last_peered":"2024-05-08T18:29:51.668785+0000","last_clean":"2024-05-08T18:29:51.668785+0000","last_became_active":"2024-05-08T18:29:40.567482+0000","last_became_peered":"2024-05-08T18:29:40.567482+0000","last_unstale":"2024-05-08T18:29:51.668785+0000","last_undegraded":"2024-05-08T18:29:51.668785+0000","last_fullsized":"2024-05-08T18:29:51.668785+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:36:37.796095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.658329+0000","last_change":"2024-05-08T18:29:44.596876+0000","last_active":"2024-05-08T18:29:51.658329+0000","last_peered":"2024-05-08T18:29:51.658329+0000","last_clean":"2024-05-08T18:29:51.658329+0000","last_became_active":"2024-05-08T18:29:44.595712+0000","last_became_peered":"2024-05-08T18:29:44.595712+0000","last_unstale":"2024-05-08T18:29:51.658329+0000","last_undegraded":"2024-05-08T18:29:51.658329+0000","last_fullsized":"2024-05-08T18:29:51.658329+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:35:51.288126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"33'5","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:52.194840+0000","last_change":"2024-05-08T18:29:46.598637+0000","last_active":"2024-05-08T18:29:52.194840+0000","last_peered":"2024-05-08T18:29:52.194840+0000","last_clean":"2024-05-08T18:29:52.194840+0000","last_became_active":"2024-05-08T18:29:46.597394+0000","last_became_peered":"2024-05-08T18:29:46.597394+0000","last_unstale":"2024-05-08T18:29:52.194840+0000","last_undegraded":"2024-05-08T18:29:52.194840+0000","last_fullsized":"2024-05-08T18:29:52.194840+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:52:22.540814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.658900+0000","last_change":"2024-05-08T18:29:48.642251+0000","last_active":"2024-05-08T18:29:51.658900+0000","last_peered":"2024-05-08T18:29:51.658900+0000","last_clean":"2024-05-08T18:29:51.658900+0000","last_became_active":"2024-05-08T18:29:48.641666+0000","last_became_peered":"2024-05-08T18:29:48.641666+0000","last_unstale":"2024-05-08T18:29:51.658900+0000","last_undegraded":"2024-05-08T18:29:51.658900+0000","last_fullsized":"2024-05-08T18:29:51.658900+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:13:50.865474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.679200+0000","last_change":"2024-05-08T18:29:50.685668+0000","last_active":"2024-05-08T18:29:51.679200+0000","last_peered":"2024-05-08T18:29:51.679200+0000","last_clean":"2024-05-08T18:29:51.679200+0000","last_became_active":"2024-05-08T18:29:50.684958+0000","last_became_peered":"2024-05-08T18:29:50.684958+0000","last_unstale":"2024-05-08T18:29:51.679200+0000","last_undegraded":"2024-05-08T18:29:51.679200+0000","last_fullsized":"2024-05-08T18:29:51.679200+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:55:01.894779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.658929+0000","last_change":"2024-05-08T18:29:42.562063+0000","last_active":"2024-05-08T18:29:51.658929+0000","last_peered":"2024-05-08T18:29:51.658929+0000","last_clean":"2024-05-08T18:29:51.658929+0000","last_became_active":"2024-05-08T18:29:42.558871+0000","last_became_peered":"2024-05-08T18:29:42.558871+0000","last_unstale":"2024-05-08T18:29:51.658929+0000","last_undegraded":"2024-05-08T18:29:51.658929+0000","last_fullsized":"2024-05-08T18:29:51.658929+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:59.243324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.701156+0000","last_change":"2024-05-08T18:29:40.541070+0000","last_active":"2024-05-08T18:29:51.701156+0000","last_peered":"2024-05-08T18:29:51.701156+0000","last_clean":"2024-05-08T18:29:51.701156+0000","last_became_active":"2024-05-08T18:29:40.540767+0000","last_became_peered":"2024-05-08T18:29:40.540767+0000","last_unstale":"2024-05-08T18:29:51.701156+0000","last_undegraded":"2024-05-08T18:29:51.701156+0000","last_fullsized":"2024-05-08T18:29:51.701156+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:09:39.835826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"26'1","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.683200+0000","last_change":"2024-05-08T18:29:44.592737+0000","last_active":"2024-05-08T18:29:51.683200+0000","last_peered":"2024-05-08T18:29:51.683200+0000","last_clean":"2024-05-08T18:29:51.683200+0000","last_became_active":"2024-05-08T18:29:44.592243+0000","last_became_peered":"2024-05-08T18:29:44.592243+0000","last_unstale":"2024-05-08T18:29:51.683200+0000","last_undegraded":"2024-05-08T18:29:51.683200+0000","last_fullsized":"2024-05-08T18:29:51.683200+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:59.744050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"33'9","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:52.256050+0000","last_change":"2024-05-08T18:29:46.610835+0000","last_active":"2024-05-08T18:29:52.256050+0000","last_peered":"2024-05-08T18:29:52.256050+0000","last_clean":"2024-05-08T18:29:52.256050+0000","last_became_active":"2024-05-08T18:29:46.609903+0000","last_became_peered":"2024-05-08T18:29:46.609903+0000","last_unstale":"2024-05-08T18:29:52.256050+0000","last_undegraded":"2024-05-08T18:29:52.256050+0000","last_fullsized":"2024-05-08T18:29:52.256050+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:37:35.850414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.698582+0000","last_change":"2024-05-08T18:29:48.629822+0000","last_active":"2024-05-08T18:29:51.698582+0000","last_peered":"2024-05-08T18:29:51.698582+0000","last_clean":"2024-05-08T18:29:51.698582+0000","last_became_active":"2024-05-08T18:29:48.629204+0000","last_became_peered":"2024-05-08T18:29:48.629204+0000","last_unstale":"2024-05-08T18:29:51.698582+0000","last_undegraded":"2024-05-08T18:29:51.698582+0000","last_fullsized":"2024-05-08T18:29:51.698582+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:04.571608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.661296+0000","last_change":"2024-05-08T18:29:50.668101+0000","last_active":"2024-05-08T18:29:51.661296+0000","last_peered":"2024-05-08T18:29:51.661296+0000","last_clean":"2024-05-08T18:29:51.661296+0000","last_became_active":"2024-05-08T18:29:50.667357+0000","last_became_peered":"2024-05-08T18:29:50.667357+0000","last_unstale":"2024-05-08T18:29:51.661296+0000","last_undegraded":"2024-05-08T18:29:51.661296+0000","last_fullsized":"2024-05-08T18:29:51.661296+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:55:01.894779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.684828+0000","last_change":"2024-05-08T18:29:42.581366+0000","last_active":"2024-05-08T18:29:51.684828+0000","last_peered":"2024-05-08T18:29:51.684828+0000","last_clean":"2024-05-08T18:29:51.684828+0000","last_became_active":"2024-05-08T18:29:42.580988+0000","last_became_peered":"2024-05-08T18:29:42.580988+0000","last_unstale":"2024-05-08T18:29:51.684828+0000","last_undegraded":"2024-05-08T18:29:51.684828+0000","last_fullsized":"2024-05-08T18:29:51.684828+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:42.005809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.690950+0000","last_change":"2024-05-08T18:29:40.562025+0000","last_active":"2024-05-08T18:29:51.690950+0000","last_peered":"2024-05-08T18:29:51.690950+0000","last_clean":"2024-05-08T18:29:51.690950+0000","last_became_active":"2024-05-08T18:29:40.561277+0000","last_became_peered":"2024-05-08T18:29:40.561277+0000","last_unstale":"2024-05-08T18:29:51.690950+0000","last_undegraded":"2024-05-08T18:29:51.690950+0000","last_fullsized":"2024-05-08T18:29:51.690950+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:59:25.840149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.684728+0000","last_change":"2024-05-08T18:29:42.573832+0000","last_active":"2024-05-08T18:29:51.684728+0000","last_peered":"2024-05-08T18:29:51.684728+0000","last_clean":"2024-05-08T18:29:51.684728+0000","last_became_active":"2024-05-08T18:29:42.573502+0000","last_became_peered":"2024-05-08T18:29:42.573502+0000","last_unstale":"2024-05-08T18:29:51.684728+0000","last_undegraded":"2024-05-08T18:29:51.684728+0000","last_fullsized":"2024-05-08T18:29:51.684728+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:35.037465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.661888+0000","last_change":"2024-05-08T18:29:40.533094+0000","last_active":"2024-05-08T18:29:51.661888+0000","last_peered":"2024-05-08T18:29:51.661888+0000","last_clean":"2024-05-08T18:29:51.661888+0000","last_became_active":"2024-05-08T18:29:40.532246+0000","last_became_peered":"2024-05-08T18:29:40.532246+0000","last_unstale":"2024-05-08T18:29:51.661888+0000","last_undegraded":"2024-05-08T18:29:51.661888+0000","last_fullsized":"2024-05-08T18:29:51.661888+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:37:08.242362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.690748+0000","last_change":"2024-05-08T18:29:42.565298+0000","last_active":"2024-05-08T18:29:51.690748+0000","last_peered":"2024-05-08T18:29:51.690748+0000","last_clean":"2024-05-08T18:29:51.690748+0000","last_became_active":"2024-05-08T18:29:42.564542+0000","last_became_peered":"2024-05-08T18:29:42.564542+0000","last_unstale":"2024-05-08T18:29:51.690748+0000","last_undegraded":"2024-05-08T18:29:51.690748+0000","last_fullsized":"2024-05-08T18:29:51.690748+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:57.706167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.688543+0000","last_change":"2024-05-08T18:29:40.556958+0000","last_active":"2024-05-08T18:29:51.688543+0000","last_peered":"2024-05-08T18:29:51.688543+0000","last_clean":"2024-05-08T18:29:51.688543+0000","last_became_active":"2024-05-08T18:29:40.556091+0000","last_became_peered":"2024-05-08T18:29:40.556091+0000","last_unstale":"2024-05-08T18:29:51.688543+0000","last_undegraded":"2024-05-08T18:29:51.688543+0000","last_fullsized":"2024-05-08T18:29:51.688543+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:39.986094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.684744+0000","last_change":"2024-05-08T18:29:42.574619+0000","last_active":"2024-05-08T18:29:51.684744+0000","last_peered":"2024-05-08T18:29:51.684744+0000","last_clean":"2024-05-08T18:29:51.684744+0000","last_became_active":"2024-05-08T18:29:42.573178+0000","last_became_peered":"2024-05-08T18:29:42.573178+0000","last_unstale":"2024-05-08T18:29:51.684744+0000","last_undegraded":"2024-05-08T18:29:51.684744+0000","last_fullsized":"2024-05-08T18:29:51.684744+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:33.139089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.699153+0000","last_change":"2024-05-08T18:29:40.544338+0000","last_active":"2024-05-08T18:29:51.699153+0000","last_peered":"2024-05-08T18:29:51.699153+0000","last_clean":"2024-05-08T18:29:51.699153+0000","last_became_active":"2024-05-08T18:29:40.544107+0000","last_became_peered":"2024-05-08T18:29:40.544107+0000","last_unstale":"2024-05-08T18:29:51.699153+0000","last_undegraded":"2024-05-08T18:29:51.699153+0000","last_fullsized":"2024-05-08T18:29:51.699153+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:54.200883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.667002+0000","last_change":"2024-05-08T18:29:42.576979+0000","last_active":"2024-05-08T18:29:51.667002+0000","last_peered":"2024-05-08T18:29:51.667002+0000","last_clean":"2024-05-08T18:29:51.667002+0000","last_became_active":"2024-05-08T18:29:42.576395+0000","last_became_peered":"2024-05-08T18:29:42.576395+0000","last_unstale":"2024-05-08T18:29:51.667002+0000","last_undegraded":"2024-05-08T18:29:51.667002+0000","last_fullsized":"2024-05-08T18:29:51.667002+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:53:03.097704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.668355+0000","last_change":"2024-05-08T18:29:40.558142+0000","last_active":"2024-05-08T18:29:51.668355+0000","last_peered":"2024-05-08T18:29:51.668355+0000","last_clean":"2024-05-08T18:29:51.668355+0000","last_became_active":"2024-05-08T18:29:40.557874+0000","last_became_peered":"2024-05-08T18:29:40.557874+0000","last_unstale":"2024-05-08T18:29:51.668355+0000","last_undegraded":"2024-05-08T18:29:51.668355+0000","last_fullsized":"2024-05-08T18:29:51.668355+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:54.200883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.661040+0000","last_change":"2024-05-08T18:29:42.558324+0000","last_active":"2024-05-08T18:29:51.661040+0000","last_peered":"2024-05-08T18:29:51.661040+0000","last_clean":"2024-05-08T18:29:51.661040+0000","last_became_active":"2024-05-08T18:29:42.556774+0000","last_became_peered":"2024-05-08T18:29:42.556774+0000","last_unstale":"2024-05-08T18:29:51.661040+0000","last_undegraded":"2024-05-08T18:29:51.661040+0000","last_fullsized":"2024-05-08T18:29:51.661040+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:02:26.311100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.685803+0000","last_change":"2024-05-08T18:29:40.545648+0000","last_active":"2024-05-08T18:29:51.685803+0000","last_peered":"2024-05-08T18:29:51.685803+0000","last_clean":"2024-05-08T18:29:51.685803+0000","last_became_active":"2024-05-08T18:29:40.545382+0000","last_became_peered":"2024-05-08T18:29:40.545382+0000","last_unstale":"2024-05-08T18:29:51.685803+0000","last_undegraded":"2024-05-08T18:29:51.685803+0000","last_fullsized":"2024-05-08T18:29:51.685803+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:17:47.828990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.664068+0000","last_change":"2024-05-08T18:29:42.562772+0000","last_active":"2024-05-08T18:29:51.664068+0000","last_peered":"2024-05-08T18:29:51.664068+0000","last_clean":"2024-05-08T18:29:51.664068+0000","last_became_active":"2024-05-08T18:29:42.562420+0000","last_became_peered":"2024-05-08T18:29:42.562420+0000","last_unstale":"2024-05-08T18:29:51.664068+0000","last_undegraded":"2024-05-08T18:29:51.664068+0000","last_fullsized":"2024-05-08T18:29:51.664068+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:30:29.452640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.693183+0000","last_change":"2024-05-08T18:29:40.562024+0000","last_active":"2024-05-08T18:29:51.693183+0000","last_peered":"2024-05-08T18:29:51.693183+0000","last_clean":"2024-05-08T18:29:51.693183+0000","last_became_active":"2024-05-08T18:29:40.561326+0000","last_became_peered":"2024-05-08T18:29:40.561326+0000","last_unstale":"2024-05-08T18:29:51.693183+0000","last_undegraded":"2024-05-08T18:29:51.693183+0000","last_fullsized":"2024-05-08T18:29:51.693183+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:21:38.354933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.690860+0000","last_change":"2024-05-08T18:29:42.561419+0000","last_active":"2024-05-08T18:29:51.690860+0000","last_peered":"2024-05-08T18:29:51.690860+0000","last_clean":"2024-05-08T18:29:51.690860+0000","last_became_active":"2024-05-08T18:29:42.560520+0000","last_became_peered":"2024-05-08T18:29:42.560520+0000","last_unstale":"2024-05-08T18:29:51.690860+0000","last_undegraded":"2024-05-08T18:29:51.690860+0000","last_fullsized":"2024-05-08T18:29:51.690860+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:07.949520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.668806+0000","last_change":"2024-05-08T18:29:40.554884+0000","last_active":"2024-05-08T18:29:51.668806+0000","last_peered":"2024-05-08T18:29:51.668806+0000","last_clean":"2024-05-08T18:29:51.668806+0000","last_became_active":"2024-05-08T18:29:40.554603+0000","last_became_peered":"2024-05-08T18:29:40.554603+0000","last_unstale":"2024-05-08T18:29:51.668806+0000","last_undegraded":"2024-05-08T18:29:51.668806+0000","last_fullsized":"2024-05-08T18:29:51.668806+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:09:39.835826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.701114+0000","last_change":"2024-05-08T18:29:42.574689+0000","last_active":"2024-05-08T18:29:51.701114+0000","last_peered":"2024-05-08T18:29:51.701114+0000","last_clean":"2024-05-08T18:29:51.701114+0000","last_became_active":"2024-05-08T18:29:42.573947+0000","last_became_peered":"2024-05-08T18:29:42.573947+0000","last_unstale":"2024-05-08T18:29:51.701114+0000","last_undegraded":"2024-05-08T18:29:51.701114+0000","last_fullsized":"2024-05-08T18:29:51.701114+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:57:14.869860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.688629+0000","last_change":"2024-05-08T18:29:40.554005+0000","last_active":"2024-05-08T18:29:51.688629+0000","last_peered":"2024-05-08T18:29:51.688629+0000","last_clean":"2024-05-08T18:29:51.688629+0000","last_became_active":"2024-05-08T18:29:40.553356+0000","last_became_peered":"2024-05-08T18:29:40.553356+0000","last_unstale":"2024-05-08T18:29:51.688629+0000","last_undegraded":"2024-05-08T18:29:51.688629+0000","last_fullsized":"2024-05-08T18:29:51.688629+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:08:13.006752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.661404+0000","last_change":"2024-05-08T18:29:42.566487+0000","last_active":"2024-05-08T18:29:51.661404+0000","last_peered":"2024-05-08T18:29:51.661404+0000","last_clean":"2024-05-08T18:29:51.661404+0000","last_became_active":"2024-05-08T18:29:42.565760+0000","last_became_peered":"2024-05-08T18:29:42.565760+0000","last_unstale":"2024-05-08T18:29:51.661404+0000","last_undegraded":"2024-05-08T18:29:51.661404+0000","last_fullsized":"2024-05-08T18:29:51.661404+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:57.706167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.664896+0000","last_change":"2024-05-08T18:29:40.552543+0000","last_active":"2024-05-08T18:29:51.664896+0000","last_peered":"2024-05-08T18:29:51.664896+0000","last_clean":"2024-05-08T18:29:51.664896+0000","last_became_active":"2024-05-08T18:29:40.552307+0000","last_became_peered":"2024-05-08T18:29:40.552307+0000","last_unstale":"2024-05-08T18:29:51.664896+0000","last_undegraded":"2024-05-08T18:29:51.664896+0000","last_fullsized":"2024-05-08T18:29:51.664896+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:48.294532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.664730+0000","last_change":"2024-05-08T18:29:42.561658+0000","last_active":"2024-05-08T18:29:51.664730+0000","last_peered":"2024-05-08T18:29:51.664730+0000","last_clean":"2024-05-08T18:29:51.664730+0000","last_became_active":"2024-05-08T18:29:42.561171+0000","last_became_peered":"2024-05-08T18:29:42.561171+0000","last_unstale":"2024-05-08T18:29:51.664730+0000","last_undegraded":"2024-05-08T18:29:51.664730+0000","last_fullsized":"2024-05-08T18:29:51.664730+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:15.966061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.688335+0000","last_change":"2024-05-08T18:29:40.543041+0000","last_active":"2024-05-08T18:29:51.688335+0000","last_peered":"2024-05-08T18:29:51.688335+0000","last_clean":"2024-05-08T18:29:51.688335+0000","last_became_active":"2024-05-08T18:29:40.542398+0000","last_became_peered":"2024-05-08T18:29:40.542398+0000","last_unstale":"2024-05-08T18:29:51.688335+0000","last_undegraded":"2024-05-08T18:29:51.688335+0000","last_fullsized":"2024-05-08T18:29:51.688335+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:33.017750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.660711+0000","last_change":"2024-05-08T18:29:42.579690+0000","last_active":"2024-05-08T18:29:51.660711+0000","last_peered":"2024-05-08T18:29:51.660711+0000","last_clean":"2024-05-08T18:29:51.660711+0000","last_became_active":"2024-05-08T18:29:42.578981+0000","last_became_peered":"2024-05-08T18:29:42.578981+0000","last_unstale":"2024-05-08T18:29:51.660711+0000","last_undegraded":"2024-05-08T18:29:51.660711+0000","last_fullsized":"2024-05-08T18:29:51.660711+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:36:03.084561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.699458+0000","last_change":"2024-05-08T18:29:40.548499+0000","last_active":"2024-05-08T18:29:51.699458+0000","last_peered":"2024-05-08T18:29:51.699458+0000","last_clean":"2024-05-08T18:29:51.699458+0000","last_became_active":"2024-05-08T18:29:40.548177+0000","last_became_peered":"2024-05-08T18:29:40.548177+0000","last_unstale":"2024-05-08T18:29:51.699458+0000","last_undegraded":"2024-05-08T18:29:51.699458+0000","last_fullsized":"2024-05-08T18:29:51.699458+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:27:41.414153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.678185+0000","last_change":"2024-05-08T18:29:42.575892+0000","last_active":"2024-05-08T18:29:51.678185+0000","last_peered":"2024-05-08T18:29:51.678185+0000","last_clean":"2024-05-08T18:29:51.678185+0000","last_became_active":"2024-05-08T18:29:42.573384+0000","last_became_peered":"2024-05-08T18:29:42.573384+0000","last_unstale":"2024-05-08T18:29:51.678185+0000","last_undegraded":"2024-05-08T18:29:51.678185+0000","last_fullsized":"2024-05-08T18:29:51.678185+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:55.055481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.692302+0000","last_change":"2024-05-08T18:29:40.565068+0000","last_active":"2024-05-08T18:29:51.692302+0000","last_peered":"2024-05-08T18:29:51.692302+0000","last_clean":"2024-05-08T18:29:51.692302+0000","last_became_active":"2024-05-08T18:29:40.563231+0000","last_became_peered":"2024-05-08T18:29:40.563231+0000","last_unstale":"2024-05-08T18:29:51.692302+0000","last_undegraded":"2024-05-08T18:29:51.692302+0000","last_fullsized":"2024-05-08T18:29:51.692302+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:17:47.828990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.698486+0000","last_change":"2024-05-08T18:29:42.564338+0000","last_active":"2024-05-08T18:29:51.698486+0000","last_peered":"2024-05-08T18:29:51.698486+0000","last_clean":"2024-05-08T18:29:51.698486+0000","last_became_active":"2024-05-08T18:29:42.563822+0000","last_became_peered":"2024-05-08T18:29:42.563822+0000","last_unstale":"2024-05-08T18:29:51.698486+0000","last_undegraded":"2024-05-08T18:29:51.698486+0000","last_fullsized":"2024-05-08T18:29:51.698486+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:23.397435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.679731+0000","last_change":"2024-05-08T18:29:40.573333+0000","last_active":"2024-05-08T18:29:51.679731+0000","last_peered":"2024-05-08T18:29:51.679731+0000","last_clean":"2024-05-08T18:29:51.679731+0000","last_became_active":"2024-05-08T18:29:40.571195+0000","last_became_peered":"2024-05-08T18:29:40.571195+0000","last_unstale":"2024-05-08T18:29:51.679731+0000","last_undegraded":"2024-05-08T18:29:51.679731+0000","last_fullsized":"2024-05-08T18:29:51.679731+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:33.017750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.663784+0000","last_change":"2024-05-08T18:29:42.563085+0000","last_active":"2024-05-08T18:29:51.663784+0000","last_peered":"2024-05-08T18:29:51.663784+0000","last_clean":"2024-05-08T18:29:51.663784+0000","last_became_active":"2024-05-08T18:29:42.560419+0000","last_became_peered":"2024-05-08T18:29:42.560419+0000","last_unstale":"2024-05-08T18:29:51.663784+0000","last_undegraded":"2024-05-08T18:29:51.663784+0000","last_fullsized":"2024-05-08T18:29:51.663784+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:20.397730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.665785+0000","last_change":"2024-05-08T18:29:40.568890+0000","last_active":"2024-05-08T18:29:51.665785+0000","last_peered":"2024-05-08T18:29:51.665785+0000","last_clean":"2024-05-08T18:29:51.665785+0000","last_became_active":"2024-05-08T18:29:40.568584+0000","last_became_peered":"2024-05-08T18:29:40.568584+0000","last_unstale":"2024-05-08T18:29:51.665785+0000","last_undegraded":"2024-05-08T18:29:51.665785+0000","last_fullsized":"2024-05-08T18:29:51.665785+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:25:01.595224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.677213+0000","last_change":"2024-05-08T18:29:42.574277+0000","last_active":"2024-05-08T18:29:51.677213+0000","last_peered":"2024-05-08T18:29:51.677213+0000","last_clean":"2024-05-08T18:29:51.677213+0000","last_became_active":"2024-05-08T18:29:42.573563+0000","last_became_peered":"2024-05-08T18:29:42.573563+0000","last_unstale":"2024-05-08T18:29:51.677213+0000","last_undegraded":"2024-05-08T18:29:51.677213+0000","last_fullsized":"2024-05-08T18:29:51.677213+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:57.706167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.692029+0000","last_change":"2024-05-08T18:29:40.562058+0000","last_active":"2024-05-08T18:29:51.692029+0000","last_peered":"2024-05-08T18:29:51.692029+0000","last_clean":"2024-05-08T18:29:51.692029+0000","last_became_active":"2024-05-08T18:29:40.561360+0000","last_became_peered":"2024-05-08T18:29:40.561360+0000","last_unstale":"2024-05-08T18:29:51.692029+0000","last_undegraded":"2024-05-08T18:29:51.692029+0000","last_fullsized":"2024-05-08T18:29:51.692029+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:05.929806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.688414+0000","last_change":"2024-05-08T18:29:40.538728+0000","last_active":"2024-05-08T18:29:51.688414+0000","last_peered":"2024-05-08T18:29:51.688414+0000","last_clean":"2024-05-08T18:29:51.688414+0000","last_became_active":"2024-05-08T18:29:40.537925+0000","last_became_peered":"2024-05-08T18:29:40.537925+0000","last_unstale":"2024-05-08T18:29:51.688414+0000","last_undegraded":"2024-05-08T18:29:51.688414+0000","last_fullsized":"2024-05-08T18:29:51.688414+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:28.426657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.700915+0000","last_change":"2024-05-08T18:29:42.574941+0000","last_active":"2024-05-08T18:29:51.700915+0000","last_peered":"2024-05-08T18:29:51.700915+0000","last_clean":"2024-05-08T18:29:51.700915+0000","last_became_active":"2024-05-08T18:29:42.574351+0000","last_became_peered":"2024-05-08T18:29:42.574351+0000","last_unstale":"2024-05-08T18:29:51.700915+0000","last_undegraded":"2024-05-08T18:29:51.700915+0000","last_fullsized":"2024-05-08T18:29:51.700915+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:21.935293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.684116+0000","last_change":"2024-05-08T18:29:40.543714+0000","last_active":"2024-05-08T18:29:51.684116+0000","last_peered":"2024-05-08T18:29:51.684116+0000","last_clean":"2024-05-08T18:29:51.684116+0000","last_became_active":"2024-05-08T18:29:40.542965+0000","last_became_peered":"2024-05-08T18:29:40.542965+0000","last_unstale":"2024-05-08T18:29:51.684116+0000","last_undegraded":"2024-05-08T18:29:51.684116+0000","last_fullsized":"2024-05-08T18:29:51.684116+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:12:59.146887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-08T18:29:51.690372+0000","last_change":"2024-05-08T18:29:42.560007+0000","last_active":"2024-05-08T18:29:51.690372+0000","last_peered":"2024-05-08T18:29:51.690372+0000","last_clean":"2024-05-08T18:29:51.690372+0000","last_became_active":"2024-05-08T18:29:42.559028+0000","last_became_peered":"2024-05-08T18:29:42.559028+0000","last_unstale":"2024-05-08T18:29:51.690372+0000","last_undegraded":"2024-05-08T18:29:51.690372+0000","last_fullsized":"2024-05-08T18:29:51.690372+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:36:03.084561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":178,"num_object_clones":0,"num_object_copies":356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":178,"num_whiteouts":0,"num_read":688,"num_read_kb":447,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":387,"ondisk_log_size":387,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509451,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32156,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339684,"statfs":{"total":96636764160,"available":96603836416,"internally_reserved":0,"allocated":1003520,"data_stored":751197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509451,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":385024,"data_stored":160169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509449,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31596,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340244,"statfs":{"total":96636764160,"available":96604409856,"internally_reserved":0,"allocated":430080,"data_stored":160997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509449,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":372736,"data_stored":159667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542154,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":401408,"data_stored":160565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542154,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":380928,"data_stored":161160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542152,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":160419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542154,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27984,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343856,"statfs":{"total":96636764160,"available":96608108544,"internally_reserved":0,"allocated":991232,"data_stored":752032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T18:29:58.961 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-08T18:29:58.961 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-05-08T18:29:59.285 INFO:teuthology.orchestra.run.smithi097.stdout:epoch 33 2024-05-08T18:29:59.285 INFO:teuthology.orchestra.run.smithi097.stdout:fsid f135278e-f589-4ad6-a830-fa767ff99171 2024-05-08T18:29:59.285 INFO:teuthology.orchestra.run.smithi097.stdout:created 2024-05-08T18:29:14.813384+0000 2024-05-08T18:29:59.285 INFO:teuthology.orchestra.run.smithi097.stdout:modified 2024-05-08T18:29:51.649448+0000 2024-05-08T18:29:59.285 INFO:teuthology.orchestra.run.smithi097.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-05-08T18:29:59.285 INFO:teuthology.orchestra.run.smithi097.stdout:crush_version 5 2024-05-08T18:29:59.285 INFO:teuthology.orchestra.run.smithi097.stdout:full_ratio 0.95 2024-05-08T18:29:59.285 INFO:teuthology.orchestra.run.smithi097.stdout:backfillfull_ratio 0.9 2024-05-08T18:29:59.285 INFO:teuthology.orchestra.run.smithi097.stdout:nearfull_ratio 0.85 2024-05-08T18:29:59.285 INFO:teuthology.orchestra.run.smithi097.stdout:require_min_compat_client luminous 2024-05-08T18:29:59.285 INFO:teuthology.orchestra.run.smithi097.stdout:min_compat_client jewel 2024-05-08T18:29:59.286 INFO:teuthology.orchestra.run.smithi097.stdout:require_osd_release squid 2024-05-08T18:29:59.286 INFO:teuthology.orchestra.run.smithi097.stdout:stretch_mode_enabled false 2024-05-08T18:29:59.286 INFO:teuthology.orchestra.run.smithi097.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 17 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 8.00 2024-05-08T18:29:59.286 INFO:teuthology.orchestra.run.smithi097.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 20 flags hashpspool stripe_width 0 application rbd read_balance_score 1.99 2024-05-08T18:29:59.286 INFO:teuthology.orchestra.run.smithi097.stdout:pool 3 'default.rgw.buckets.data' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 23 flags hashpspool stripe_width 0 application rgw read_balance_score 1.50 2024-05-08T18:29:59.286 INFO:teuthology.orchestra.run.smithi097.stdout:pool 4 'default.rgw.buckets.index' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 25 flags hashpspool stripe_width 0 application rgw read_balance_score 2.00 2024-05-08T18:29:59.286 INFO:teuthology.orchestra.run.smithi097.stdout:pool 5 '.rgw.root' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 27 flags hashpspool stripe_width 0 application rgw read_balance_score 1.25 2024-05-08T18:29:59.286 INFO:teuthology.orchestra.run.smithi097.stdout:pool 6 'default.rgw.log' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 29 flags hashpspool stripe_width 0 application rgw read_balance_score 1.75 2024-05-08T18:29:59.286 INFO:teuthology.orchestra.run.smithi097.stdout:pool 7 'default.rgw.control' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 31 flags hashpspool stripe_width 0 application rgw read_balance_score 1.75 2024-05-08T18:29:59.286 INFO:teuthology.orchestra.run.smithi097.stdout:pool 8 'default.rgw.meta' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 33 flags hashpspool stripe_width 0 pg_autoscale_bias 4 application rgw read_balance_score 1.50 2024-05-08T18:29:59.286 INFO:teuthology.orchestra.run.smithi097.stdout:max_osd 8 2024-05-08T18:29:59.286 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0 up in weight 1 up_from 14 up_thru 31 down_at 0 last_clean_interval [0,0) [v2:172.21.15.97:6800/2064534873,v1:172.21.15.97:6801/2064534873] [v2:172.21.15.97:6802/2064534873,v1:172.21.15.97:6803/2064534873] exists,up f135796c-f80c-43a8-889d-e0927bcc3d0a 2024-05-08T18:29:59.287 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1 up in weight 1 up_from 14 up_thru 31 down_at 0 last_clean_interval [0,0) [v2:172.21.15.97:6813/34364184,v1:172.21.15.97:6815/34364184] [v2:172.21.15.97:6818/34364184,v1:172.21.15.97:6819/34364184] exists,up b91d895a-2b40-45c1-b355-52dba17032cb 2024-05-08T18:29:59.287 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2 up in weight 1 up_from 14 up_thru 29 down_at 0 last_clean_interval [0,0) [v2:172.21.15.97:6808/3004545111,v1:172.21.15.97:6809/3004545111] [v2:172.21.15.97:6810/3004545111,v1:172.21.15.97:6811/3004545111] exists,up 35f12106-8d9a-4dcb-a8bc-38e08c81bd5e 2024-05-08T18:29:59.287 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3 up in weight 1 up_from 14 up_thru 31 down_at 0 last_clean_interval [0,0) [v2:172.21.15.97:6824/1855786157,v1:172.21.15.97:6825/1855786157] [v2:172.21.15.97:6826/1855786157,v1:172.21.15.97:6827/1855786157] exists,up cd78d341-ec40-457e-a713-555b03bc9f16 2024-05-08T18:29:59.287 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4 up in weight 1 up_from 15 up_thru 31 down_at 0 last_clean_interval [0,0) [v2:172.21.15.151:6808/1246653692,v1:172.21.15.151:6810/1246653692] [v2:172.21.15.151:6812/1246653692,v1:172.21.15.151:6814/1246653692] exists,up 469d890e-5e0c-41cd-ac5b-ef987b70abd0 2024-05-08T18:29:59.287 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5 up in weight 1 up_from 15 up_thru 31 down_at 0 last_clean_interval [0,0) [v2:172.21.15.151:6809/4257184226,v1:172.21.15.151:6811/4257184226] [v2:172.21.15.151:6813/4257184226,v1:172.21.15.151:6815/4257184226] exists,up dcb25c08-802c-4140-a3d2-929960319860 2024-05-08T18:29:59.287 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6 up in weight 1 up_from 15 up_thru 31 down_at 0 last_clean_interval [0,0) [v2:172.21.15.151:6800/974202886,v1:172.21.15.151:6801/974202886] [v2:172.21.15.151:6802/974202886,v1:172.21.15.151:6803/974202886] exists,up 598ab572-7049-4600-9e91-1792360421d2 2024-05-08T18:29:59.287 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7 up in weight 1 up_from 15 up_thru 31 down_at 0 last_clean_interval [0,0) [v2:172.21.15.151:6824/2584927373,v1:172.21.15.151:6825/2584927373] [v2:172.21.15.151:6826/2584927373,v1:172.21.15.151:6827/2584927373] exists,up c21805e0-4945-4efe-8e65-68bb92d30b69 2024-05-08T18:29:59.301 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 14 up_thru 31 down_at 0 last_clean_interval [0,0) [v2:172.21.15.97:6800/2064534873,v1:172.21.15.97:6801/2064534873] [v2:172.21.15.97:6802/2064534873,v1:172.21.15.97:6803/2064534873] exists,up f135796c-f80c-43a8-889d-e0927bcc3d0a', 'osd.1 up in weight 1 up_from 14 up_thru 31 down_at 0 last_clean_interval [0,0) [v2:172.21.15.97:6813/34364184,v1:172.21.15.97:6815/34364184] [v2:172.21.15.97:6818/34364184,v1:172.21.15.97:6819/34364184] exists,up b91d895a-2b40-45c1-b355-52dba17032cb', 'osd.2 up in weight 1 up_from 14 up_thru 29 down_at 0 last_clean_interval [0,0) [v2:172.21.15.97:6808/3004545111,v1:172.21.15.97:6809/3004545111] [v2:172.21.15.97:6810/3004545111,v1:172.21.15.97:6811/3004545111] exists,up 35f12106-8d9a-4dcb-a8bc-38e08c81bd5e', 'osd.3 up in weight 1 up_from 14 up_thru 31 down_at 0 last_clean_interval [0,0) [v2:172.21.15.97:6824/1855786157,v1:172.21.15.97:6825/1855786157] [v2:172.21.15.97:6826/1855786157,v1:172.21.15.97:6827/1855786157] exists,up cd78d341-ec40-457e-a713-555b03bc9f16', 'osd.4 up in weight 1 up_from 15 up_thru 31 down_at 0 last_clean_interval [0,0) [v2:172.21.15.151:6808/1246653692,v1:172.21.15.151:6810/1246653692] [v2:172.21.15.151:6812/1246653692,v1:172.21.15.151:6814/1246653692] exists,up 469d890e-5e0c-41cd-ac5b-ef987b70abd0', 'osd.5 up in weight 1 up_from 15 up_thru 31 down_at 0 last_clean_interval [0,0) [v2:172.21.15.151:6809/4257184226,v1:172.21.15.151:6811/4257184226] [v2:172.21.15.151:6813/4257184226,v1:172.21.15.151:6815/4257184226] exists,up dcb25c08-802c-4140-a3d2-929960319860', 'osd.6 up in weight 1 up_from 15 up_thru 31 down_at 0 last_clean_interval [0,0) [v2:172.21.15.151:6800/974202886,v1:172.21.15.151:6801/974202886] [v2:172.21.15.151:6802/974202886,v1:172.21.15.151:6803/974202886] exists,up 598ab572-7049-4600-9e91-1792360421d2', 'osd.7 up in weight 1 up_from 15 up_thru 31 down_at 0 last_clean_interval [0,0) [v2:172.21.15.151:6824/2584927373,v1:172.21.15.151:6825/2584927373] [v2:172.21.15.151:6826/2584927373,v1:172.21.15.151:6827/2584927373] exists,up c21805e0-4945-4efe-8e65-68bb92d30b69'] 2024-05-08T18:29:59.302 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-05-08T18:29:59.419 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:29:59.419 INFO:teuthology.orchestra.run.smithi097.stdout: "name": "mon.a", 2024-05-08T18:29:59.419 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster": "ceph", 2024-05-08T18:29:59.419 INFO:teuthology.orchestra.run.smithi097.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-05-08T18:29:59.419 INFO:teuthology.orchestra.run.smithi097.stdout: "admin_socket_mode": "", 2024-05-08T18:29:59.419 INFO:teuthology.orchestra.run.smithi097.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-05-08T18:29:59.420 INFO:teuthology.orchestra.run.smithi097.stdout: "auth_client_required": "cephx, none", 2024-05-08T18:29:59.420 INFO:teuthology.orchestra.run.smithi097.stdout: "auth_cluster_required": "cephx", 2024-05-08T18:29:59.420 INFO:teuthology.orchestra.run.smithi097.stdout: "auth_debug": "true", 2024-05-08T18:29:59.420 INFO:teuthology.orchestra.run.smithi097.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-05-08T18:29:59.420 INFO:teuthology.orchestra.run.smithi097.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-05-08T18:29:59.420 INFO:teuthology.orchestra.run.smithi097.stdout: "auth_service_required": "cephx", 2024-05-08T18:29:59.420 INFO:teuthology.orchestra.run.smithi097.stdout: "auth_service_ticket_ttl": "240.000000", 2024-05-08T18:29:59.420 INFO:teuthology.orchestra.run.smithi097.stdout: "auth_supported": "cephx", 2024-05-08T18:29:59.420 INFO:teuthology.orchestra.run.smithi097.stdout: "bdev_aio": "true", 2024-05-08T18:29:59.420 INFO:teuthology.orchestra.run.smithi097.stdout: "bdev_aio_max_queue_depth": "1024", 2024-05-08T18:29:59.420 INFO:teuthology.orchestra.run.smithi097.stdout: "bdev_aio_poll_ms": "250", 2024-05-08T18:29:59.420 INFO:teuthology.orchestra.run.smithi097.stdout: "bdev_aio_reap_max": "16", 2024-05-08T18:29:59.420 INFO:teuthology.orchestra.run.smithi097.stdout: "bdev_async_discard_threads": "0", 2024-05-08T18:29:59.421 INFO:teuthology.orchestra.run.smithi097.stdout: "bdev_block_size": "4096", 2024-05-08T18:29:59.421 INFO:teuthology.orchestra.run.smithi097.stdout: "bdev_debug_aio": "false", 2024-05-08T18:29:59.421 INFO:teuthology.orchestra.run.smithi097.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-05-08T18:29:59.421 INFO:teuthology.orchestra.run.smithi097.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-05-08T18:29:59.421 INFO:teuthology.orchestra.run.smithi097.stdout: "bdev_debug_inflight_ios": "false", 2024-05-08T18:29:59.421 INFO:teuthology.orchestra.run.smithi097.stdout: "bdev_enable_discard": "false", 2024-05-08T18:29:59.421 INFO:teuthology.orchestra.run.smithi097.stdout: "bdev_flock_retry": "3", 2024-05-08T18:29:59.421 INFO:teuthology.orchestra.run.smithi097.stdout: "bdev_flock_retry_interval": "0.100000", 2024-05-08T18:29:59.421 INFO:teuthology.orchestra.run.smithi097.stdout: "bdev_inject_crash": "0", 2024-05-08T18:29:59.421 INFO:teuthology.orchestra.run.smithi097.stdout: "bdev_inject_crash_flush_delay": "2", 2024-05-08T18:29:59.421 INFO:teuthology.orchestra.run.smithi097.stdout: "bdev_ioring": "false", 2024-05-08T18:29:59.421 INFO:teuthology.orchestra.run.smithi097.stdout: "bdev_ioring_hipri": "false", 2024-05-08T18:29:59.421 INFO:teuthology.orchestra.run.smithi097.stdout: "bdev_ioring_sqthread_poll": "false", 2024-05-08T18:29:59.421 INFO:teuthology.orchestra.run.smithi097.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-05-08T18:29:59.422 INFO:teuthology.orchestra.run.smithi097.stdout: "bdev_read_buffer_alignment": "4096", 2024-05-08T18:29:59.422 INFO:teuthology.orchestra.run.smithi097.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-05-08T18:29:59.422 INFO:teuthology.orchestra.run.smithi097.stdout: "bdev_type": "", 2024-05-08T18:29:59.422 INFO:teuthology.orchestra.run.smithi097.stdout: "bluefs_alloc_size": "1048576", 2024-05-08T18:29:59.422 INFO:teuthology.orchestra.run.smithi097.stdout: "bluefs_allocator": "hybrid", 2024-05-08T18:29:59.422 INFO:teuthology.orchestra.run.smithi097.stdout: "bluefs_buffered_io": "true", 2024-05-08T18:29:59.422 INFO:teuthology.orchestra.run.smithi097.stdout: "bluefs_check_for_zeros": "false", 2024-05-08T18:29:59.422 INFO:teuthology.orchestra.run.smithi097.stdout: "bluefs_check_volume_selector_often": "false", 2024-05-08T18:29:59.422 INFO:teuthology.orchestra.run.smithi097.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-05-08T18:29:59.422 INFO:teuthology.orchestra.run.smithi097.stdout: "bluefs_compact_log_sync": "false", 2024-05-08T18:29:59.422 INFO:teuthology.orchestra.run.smithi097.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-05-08T18:29:59.422 INFO:teuthology.orchestra.run.smithi097.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-05-08T18:29:59.423 INFO:teuthology.orchestra.run.smithi097.stdout: "bluefs_log_compact_min_size": "16777216", 2024-05-08T18:29:59.423 INFO:teuthology.orchestra.run.smithi097.stdout: "bluefs_log_replay_check_allocations": "true", 2024-05-08T18:29:59.423 INFO:teuthology.orchestra.run.smithi097.stdout: "bluefs_max_log_runway": "4194304", 2024-05-08T18:29:59.423 INFO:teuthology.orchestra.run.smithi097.stdout: "bluefs_max_prefetch": "1048576", 2024-05-08T18:29:59.423 INFO:teuthology.orchestra.run.smithi097.stdout: "bluefs_min_flush_size": "524288", 2024-05-08T18:29:59.423 INFO:teuthology.orchestra.run.smithi097.stdout: "bluefs_min_log_runway": "1048576", 2024-05-08T18:29:59.423 INFO:teuthology.orchestra.run.smithi097.stdout: "bluefs_replay_recovery": "false", 2024-05-08T18:29:59.423 INFO:teuthology.orchestra.run.smithi097.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-05-08T18:29:59.423 INFO:teuthology.orchestra.run.smithi097.stdout: "bluefs_shared_alloc_size": "65536", 2024-05-08T18:29:59.423 INFO:teuthology.orchestra.run.smithi097.stdout: "bluefs_sync_write": "false", 2024-05-08T18:29:59.423 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-05-08T18:29:59.423 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-05-08T18:29:59.423 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-05-08T18:29:59.424 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_allocation_from_file": "true", 2024-05-08T18:29:59.424 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_allocator": "hybrid", 2024-05-08T18:29:59.424 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-05-08T18:29:59.424 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-05-08T18:29:59.424 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-05-08T18:29:59.424 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-05-08T18:29:59.424 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-05-08T18:29:59.424 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-05-08T18:29:59.424 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_blobid_prealloc": "10240", 2024-05-08T18:29:59.424 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_block_create": "true", 2024-05-08T18:29:59.424 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_block_db_create": "false", 2024-05-08T18:29:59.424 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_block_db_path": "", 2024-05-08T18:29:59.424 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_block_db_size": "0", 2024-05-08T18:29:59.425 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_block_path": "", 2024-05-08T18:29:59.425 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_block_preallocate_file": "false", 2024-05-08T18:29:59.425 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_block_size": "107374182400", 2024-05-08T18:29:59.425 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_block_wal_create": "false", 2024-05-08T18:29:59.425 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_block_wal_path": "", 2024-05-08T18:29:59.425 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_block_wal_size": "100663296", 2024-05-08T18:29:59.425 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_bluefs": "true", 2024-05-08T18:29:59.425 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-05-08T18:29:59.425 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_bluefs_env_mirror": "false", 2024-05-08T18:29:59.425 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-05-08T18:29:59.425 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-05-08T18:29:59.425 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-05-08T18:29:59.425 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-05-08T18:29:59.425 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-05-08T18:29:59.426 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-05-08T18:29:59.426 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_cache_autotune": "true", 2024-05-08T18:29:59.426 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-05-08T18:29:59.426 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-05-08T18:29:59.426 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-05-08T18:29:59.426 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-05-08T18:29:59.426 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_cache_size": "0", 2024-05-08T18:29:59.426 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-05-08T18:29:59.426 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-05-08T18:29:59.426 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-05-08T18:29:59.426 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-05-08T18:29:59.426 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_cache_type": "2q", 2024-05-08T18:29:59.426 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-05-08T18:29:59.427 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_clone_cow": "true", 2024-05-08T18:29:59.427 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_compression_algorithm": "snappy", 2024-05-08T18:29:59.427 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_compression_max_blob_size": "0", 2024-05-08T18:29:59.427 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-05-08T18:29:59.427 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-05-08T18:29:59.427 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_compression_min_blob_size": "0", 2024-05-08T18:29:59.427 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-05-08T18:29:59.427 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-05-08T18:29:59.427 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_compression_mode": "none", 2024-05-08T18:29:59.427 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-05-08T18:29:59.427 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_csum_type": "crc32c", 2024-05-08T18:29:59.427 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_debug_enforce_min_alloc_size": "0", 2024-05-08T18:29:59.427 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_debug_enforce_settings": "default", 2024-05-08T18:29:59.427 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_debug_freelist": "false", 2024-05-08T18:29:59.428 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_debug_fsck_abort": "false", 2024-05-08T18:29:59.428 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-05-08T18:29:59.428 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-05-08T18:29:59.428 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_debug_inject_read_err": "false", 2024-05-08T18:29:59.428 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_debug_legacy_omap": "false", 2024-05-08T18:29:59.428 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-05-08T18:29:59.428 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-05-08T18:29:59.428 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-05-08T18:29:59.428 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-05-08T18:29:59.428 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_debug_prefill": "0.000000", 2024-05-08T18:29:59.428 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-05-08T18:29:59.428 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-05-08T18:29:59.428 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-05-08T18:29:59.428 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_debug_small_allocations": "0", 2024-05-08T18:29:59.429 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-05-08T18:29:59.429 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_default_buffered_read": "true", 2024-05-08T18:29:59.429 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_default_buffered_write": "false", 2024-05-08T18:29:59.429 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_deferred_batch_ops": "0", 2024-05-08T18:29:59.429 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-05-08T18:29:59.429 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-05-08T18:29:59.429 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_elastic_shared_blobs": "true", 2024-05-08T18:29:59.429 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-05-08T18:29:59.429 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-05-08T18:29:59.429 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-05-08T18:29:59.429 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-05-08T18:29:59.429 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-05-08T18:29:59.429 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_fail_eio": "false", 2024-05-08T18:29:59.430 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-05-08T18:29:59.430 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-05-08T18:29:59.430 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-05-08T18:29:59.430 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-05-08T18:29:59.430 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_fsck_on_mkfs": "true", 2024-05-08T18:29:59.430 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-05-08T18:29:59.430 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_fsck_on_mount": "false", 2024-05-08T18:29:59.430 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-05-08T18:29:59.430 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_fsck_on_umount": "false", 2024-05-08T18:29:59.430 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-05-08T18:29:59.430 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-05-08T18:29:59.430 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-05-08T18:29:59.431 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-05-08T18:29:59.431 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-05-08T18:29:59.431 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-05-08T18:29:59.431 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-05-08T18:29:59.431 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-05-08T18:29:59.431 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_ignore_data_csum": "false", 2024-05-08T18:29:59.431 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-05-08T18:29:59.431 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_kvbackend": "rocksdb", 2024-05-08T18:29:59.431 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-05-08T18:29:59.431 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-05-08T18:29:59.431 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_log_op_age": "5.000000", 2024-05-08T18:29:59.431 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_max_alloc_size": "0", 2024-05-08T18:29:59.431 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_max_blob_size": "0", 2024-05-08T18:29:59.431 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-05-08T18:29:59.432 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-05-08T18:29:59.432 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_max_defer_interval": "3.000000", 2024-05-08T18:29:59.432 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_max_deferred_txc": "32", 2024-05-08T18:29:59.432 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_min_alloc_size": "0", 2024-05-08T18:29:59.432 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-05-08T18:29:59.432 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-05-08T18:29:59.432 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_nid_prealloc": "1024", 2024-05-08T18:29:59.432 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_prefer_deferred_size": "0", 2024-05-08T18:29:59.432 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-05-08T18:29:59.432 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-05-08T18:29:59.432 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_qfsck_on_mount": "true", 2024-05-08T18:29:59.432 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_retry_disk_reads": "3", 2024-05-08T18:29:59.432 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_rocksdb_cf": "true", 2024-05-08T18:29:59.432 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-05-08T18:29:59.433 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-05-08T18:29:59.433 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_rocksdb_options_annex": "", 2024-05-08T18:29:59.433 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_spdk_coremask": "0x1", 2024-05-08T18:29:59.433 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_spdk_io_sleep": "5", 2024-05-08T18:29:59.433 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_spdk_max_io_completion": "0", 2024-05-08T18:29:59.433 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_spdk_mem": "512", 2024-05-08T18:29:59.433 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_sync_submit_transaction": "false", 2024-05-08T18:29:59.433 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_throttle_bytes": "67108864", 2024-05-08T18:29:59.433 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_throttle_cost_per_io": "0", 2024-05-08T18:29:59.433 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-05-08T18:29:59.433 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-05-08T18:29:59.433 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-05-08T18:29:59.434 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-05-08T18:29:59.434 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_tracing": "false", 2024-05-08T18:29:59.434 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-05-08T18:29:59.434 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-05-08T18:29:59.434 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_volume_selection_reserved": "0", 2024-05-08T18:29:59.434 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-05-08T18:29:59.434 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-05-08T18:29:59.434 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-05-08T18:29:59.434 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-05-08T18:29:59.434 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-05-08T18:29:59.434 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-05-08T18:29:59.434 INFO:teuthology.orchestra.run.smithi097.stdout: "bluestore_zero_block_detection": "false", 2024-05-08T18:29:59.434 INFO:teuthology.orchestra.run.smithi097.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-05-08T18:29:59.435 INFO:teuthology.orchestra.run.smithi097.stdout: "cephfs_mirror_action_update_interval": "2", 2024-05-08T18:29:59.435 INFO:teuthology.orchestra.run.smithi097.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-05-08T18:29:59.435 INFO:teuthology.orchestra.run.smithi097.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-05-08T18:29:59.435 INFO:teuthology.orchestra.run.smithi097.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-05-08T18:29:59.435 INFO:teuthology.orchestra.run.smithi097.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-05-08T18:29:59.435 INFO:teuthology.orchestra.run.smithi097.stdout: "cephfs_mirror_mount_timeout": "10", 2024-05-08T18:29:59.435 INFO:teuthology.orchestra.run.smithi097.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-05-08T18:29:59.435 INFO:teuthology.orchestra.run.smithi097.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-05-08T18:29:59.435 INFO:teuthology.orchestra.run.smithi097.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-05-08T18:29:59.435 INFO:teuthology.orchestra.run.smithi097.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-05-08T18:29:59.435 INFO:teuthology.orchestra.run.smithi097.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-05-08T18:29:59.435 INFO:teuthology.orchestra.run.smithi097.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-05-08T18:29:59.435 INFO:teuthology.orchestra.run.smithi097.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-05-08T18:29:59.435 INFO:teuthology.orchestra.run.smithi097.stdout: "cephx_cluster_require_signatures": "false", 2024-05-08T18:29:59.436 INFO:teuthology.orchestra.run.smithi097.stdout: "cephx_cluster_require_version": "2", 2024-05-08T18:29:59.436 INFO:teuthology.orchestra.run.smithi097.stdout: "cephx_require_signatures": "false", 2024-05-08T18:29:59.436 INFO:teuthology.orchestra.run.smithi097.stdout: "cephx_require_version": "2", 2024-05-08T18:29:59.436 INFO:teuthology.orchestra.run.smithi097.stdout: "cephx_service_require_signatures": "false", 2024-05-08T18:29:59.436 INFO:teuthology.orchestra.run.smithi097.stdout: "cephx_service_require_version": "2", 2024-05-08T18:29:59.436 INFO:teuthology.orchestra.run.smithi097.stdout: "cephx_sign_messages": "true", 2024-05-08T18:29:59.436 INFO:teuthology.orchestra.run.smithi097.stdout: "chdir": "", 2024-05-08T18:29:59.436 INFO:teuthology.orchestra.run.smithi097.stdout: "client_acl_type": "", 2024-05-08T18:29:59.436 INFO:teuthology.orchestra.run.smithi097.stdout: "client_asio_thread_count": "2", 2024-05-08T18:29:59.436 INFO:teuthology.orchestra.run.smithi097.stdout: "client_cache_mid": "0.750000", 2024-05-08T18:29:59.436 INFO:teuthology.orchestra.run.smithi097.stdout: "client_cache_size": "16384", 2024-05-08T18:29:59.436 INFO:teuthology.orchestra.run.smithi097.stdout: "client_caps_release_delay": "5", 2024-05-08T18:29:59.436 INFO:teuthology.orchestra.run.smithi097.stdout: "client_check_pool_perm": "true", 2024-05-08T18:29:59.436 INFO:teuthology.orchestra.run.smithi097.stdout: "client_collect_and_send_global_metrics": "false", 2024-05-08T18:29:59.437 INFO:teuthology.orchestra.run.smithi097.stdout: "client_debug_force_sync_read": "false", 2024-05-08T18:29:59.437 INFO:teuthology.orchestra.run.smithi097.stdout: "client_debug_getattr_caps": "false", 2024-05-08T18:29:59.437 INFO:teuthology.orchestra.run.smithi097.stdout: "client_debug_inject_tick_delay": "0", 2024-05-08T18:29:59.437 INFO:teuthology.orchestra.run.smithi097.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-05-08T18:29:59.437 INFO:teuthology.orchestra.run.smithi097.stdout: "client_die_on_failed_remount": "false", 2024-05-08T18:29:59.437 INFO:teuthology.orchestra.run.smithi097.stdout: "client_dirsize_rbytes": "true", 2024-05-08T18:29:59.437 INFO:teuthology.orchestra.run.smithi097.stdout: "client_force_lazyio": "false", 2024-05-08T18:29:59.437 INFO:teuthology.orchestra.run.smithi097.stdout: "client_fs": "", 2024-05-08T18:29:59.437 INFO:teuthology.orchestra.run.smithi097.stdout: "client_inject_fixed_oldest_tid": "false", 2024-05-08T18:29:59.437 INFO:teuthology.orchestra.run.smithi097.stdout: "client_inject_release_failure": "false", 2024-05-08T18:29:59.437 INFO:teuthology.orchestra.run.smithi097.stdout: "client_max_inline_size": "4096", 2024-05-08T18:29:59.437 INFO:teuthology.orchestra.run.smithi097.stdout: "client_max_retries_on_remount_failure": "5", 2024-05-08T18:29:59.437 INFO:teuthology.orchestra.run.smithi097.stdout: "client_mds_namespace": "", 2024-05-08T18:29:59.438 INFO:teuthology.orchestra.run.smithi097.stdout: "client_metadata": "", 2024-05-08T18:29:59.438 INFO:teuthology.orchestra.run.smithi097.stdout: "client_mount_gid": "-1", 2024-05-08T18:29:59.438 INFO:teuthology.orchestra.run.smithi097.stdout: "client_mount_timeout": "300", 2024-05-08T18:29:59.438 INFO:teuthology.orchestra.run.smithi097.stdout: "client_mount_uid": "-1", 2024-05-08T18:29:59.438 INFO:teuthology.orchestra.run.smithi097.stdout: "client_mountpoint": "/", 2024-05-08T18:29:59.438 INFO:teuthology.orchestra.run.smithi097.stdout: "client_notify_timeout": "10", 2024-05-08T18:29:59.438 INFO:teuthology.orchestra.run.smithi097.stdout: "client_oc": "true", 2024-05-08T18:29:59.438 INFO:teuthology.orchestra.run.smithi097.stdout: "client_oc_max_dirty": "104857600", 2024-05-08T18:29:59.438 INFO:teuthology.orchestra.run.smithi097.stdout: "client_oc_max_dirty_age": "5.000000", 2024-05-08T18:29:59.438 INFO:teuthology.orchestra.run.smithi097.stdout: "client_oc_max_objects": "1000", 2024-05-08T18:29:59.438 INFO:teuthology.orchestra.run.smithi097.stdout: "client_oc_size": "209715200", 2024-05-08T18:29:59.438 INFO:teuthology.orchestra.run.smithi097.stdout: "client_oc_target_dirty": "8388608", 2024-05-08T18:29:59.438 INFO:teuthology.orchestra.run.smithi097.stdout: "client_permissions": "true", 2024-05-08T18:29:59.438 INFO:teuthology.orchestra.run.smithi097.stdout: "client_quota": "true", 2024-05-08T18:29:59.439 INFO:teuthology.orchestra.run.smithi097.stdout: "client_quota_df": "true", 2024-05-08T18:29:59.439 INFO:teuthology.orchestra.run.smithi097.stdout: "client_readahead_max_bytes": "0", 2024-05-08T18:29:59.439 INFO:teuthology.orchestra.run.smithi097.stdout: "client_readahead_max_periods": "4", 2024-05-08T18:29:59.439 INFO:teuthology.orchestra.run.smithi097.stdout: "client_readahead_min": "131072", 2024-05-08T18:29:59.439 INFO:teuthology.orchestra.run.smithi097.stdout: "client_reconnect_stale": "false", 2024-05-08T18:29:59.439 INFO:teuthology.orchestra.run.smithi097.stdout: "client_shutdown_timeout": "30", 2024-05-08T18:29:59.439 INFO:teuthology.orchestra.run.smithi097.stdout: "client_snapdir": ".snap", 2024-05-08T18:29:59.439 INFO:teuthology.orchestra.run.smithi097.stdout: "client_tick_interval": "1", 2024-05-08T18:29:59.439 INFO:teuthology.orchestra.run.smithi097.stdout: "client_trace": "", 2024-05-08T18:29:59.439 INFO:teuthology.orchestra.run.smithi097.stdout: "client_try_dentry_invalidate": "false", 2024-05-08T18:29:59.439 INFO:teuthology.orchestra.run.smithi097.stdout: "client_use_faked_inos": "false", 2024-05-08T18:29:59.439 INFO:teuthology.orchestra.run.smithi097.stdout: "client_use_random_mds": "false", 2024-05-08T18:29:59.439 INFO:teuthology.orchestra.run.smithi097.stdout: "clog_to_graylog": "false", 2024-05-08T18:29:59.439 INFO:teuthology.orchestra.run.smithi097.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-05-08T18:29:59.440 INFO:teuthology.orchestra.run.smithi097.stdout: "clog_to_graylog_port": "12201", 2024-05-08T18:29:59.440 INFO:teuthology.orchestra.run.smithi097.stdout: "clog_to_monitors": "default=true", 2024-05-08T18:29:59.440 INFO:teuthology.orchestra.run.smithi097.stdout: "clog_to_syslog": "false", 2024-05-08T18:29:59.440 INFO:teuthology.orchestra.run.smithi097.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-05-08T18:29:59.440 INFO:teuthology.orchestra.run.smithi097.stdout: "clog_to_syslog_level": "info", 2024-05-08T18:29:59.440 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "-", 2024-05-08T18:29:59.440 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_network": "", 2024-05-08T18:29:59.440 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_network_interface": "", 2024-05-08T18:29:59.440 INFO:teuthology.orchestra.run.smithi097.stdout: "compressor_zlib_isal": "false", 2024-05-08T18:29:59.440 INFO:teuthology.orchestra.run.smithi097.stdout: "compressor_zlib_level": "5", 2024-05-08T18:29:59.440 INFO:teuthology.orchestra.run.smithi097.stdout: "compressor_zlib_winsize": "-15", 2024-05-08T18:29:59.440 INFO:teuthology.orchestra.run.smithi097.stdout: "compressor_zstd_level": "1", 2024-05-08T18:29:59.440 INFO:teuthology.orchestra.run.smithi097.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-05-08T18:29:59.440 INFO:teuthology.orchestra.run.smithi097.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-05-08T18:29:59.441 INFO:teuthology.orchestra.run.smithi097.stdout: "crimson_alien_op_num_threads": "6", 2024-05-08T18:29:59.441 INFO:teuthology.orchestra.run.smithi097.stdout: "crimson_alien_thread_cpu_cores": "", 2024-05-08T18:29:59.441 INFO:teuthology.orchestra.run.smithi097.stdout: "crimson_osd_obc_lru_size": "512", 2024-05-08T18:29:59.441 INFO:teuthology.orchestra.run.smithi097.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-05-08T18:29:59.441 INFO:teuthology.orchestra.run.smithi097.stdout: "crimson_osd_stat_interval": "0", 2024-05-08T18:29:59.441 INFO:teuthology.orchestra.run.smithi097.stdout: "crimson_seastar_cpu_cores": "", 2024-05-08T18:29:59.441 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_location": "", 2024-05-08T18:29:59.441 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_location_hook": "", 2024-05-08T18:29:59.441 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_location_hook_timeout": "10", 2024-05-08T18:29:59.441 INFO:teuthology.orchestra.run.smithi097.stdout: "daemonize": "false", 2024-05-08T18:29:59.441 INFO:teuthology.orchestra.run.smithi097.stdout: "daos_pool": "tank", 2024-05-08T18:29:59.441 INFO:teuthology.orchestra.run.smithi097.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-05-08T18:29:59.441 INFO:teuthology.orchestra.run.smithi097.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-05-08T18:29:59.441 INFO:teuthology.orchestra.run.smithi097.stdout: "dbstore_db_name_prefix": "dbstore", 2024-05-08T18:29:59.442 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_alienstore": "0/5", 2024-05-08T18:29:59.442 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_allow_any_pool_priority": "false", 2024-05-08T18:29:59.442 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_asok": "1/5", 2024-05-08T18:29:59.442 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_asok_assert_abort": "false", 2024-05-08T18:29:59.442 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_asserts_on_shutdown": "true", 2024-05-08T18:29:59.442 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_auth": "20/20", 2024-05-08T18:29:59.442 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_bdev": "1/3", 2024-05-08T18:29:59.442 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_bluefs": "1/5", 2024-05-08T18:29:59.442 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_bluestore": "1/5", 2024-05-08T18:29:59.442 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_buffer": "0/1", 2024-05-08T18:29:59.442 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_ceph_dedup": "0/5", 2024-05-08T18:29:59.442 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_ceph_exporter": "1/5", 2024-05-08T18:29:59.442 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_cephfs_mirror": "0/5", 2024-05-08T18:29:59.442 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_cephsqlite": "0/5", 2024-05-08T18:29:59.443 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_client": "0/5", 2024-05-08T18:29:59.443 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_compressor": "1/5", 2024-05-08T18:29:59.443 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_context": "0/1", 2024-05-08T18:29:59.443 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_crimson_interrupt": "0/5", 2024-05-08T18:29:59.443 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_crush": "1/1", 2024-05-08T18:29:59.443 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_crypto": "1/5", 2024-05-08T18:29:59.443 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_cyanstore": "0/5", 2024-05-08T18:29:59.443 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_deliberately_leak_memory": "false", 2024-05-08T18:29:59.443 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_disable_randomized_ping": "false", 2024-05-08T18:29:59.443 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_dpdk": "1/5", 2024-05-08T18:29:59.443 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_eventtrace": "1/5", 2024-05-08T18:29:59.443 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_filer": "0/1", 2024-05-08T18:29:59.443 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_filestore": "1/3", 2024-05-08T18:29:59.444 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_finisher": "1/1", 2024-05-08T18:29:59.444 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_fuse": "1/5", 2024-05-08T18:29:59.444 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_heartbeat_testing_span": "0", 2024-05-08T18:29:59.444 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_heartbeatmap": "1/5", 2024-05-08T18:29:59.444 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_immutable_obj_cache": "0/5", 2024-05-08T18:29:59.444 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_javaclient": "1/5", 2024-05-08T18:29:59.444 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_journal": "1/3", 2024-05-08T18:29:59.444 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_journaler": "0/5", 2024-05-08T18:29:59.444 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_kstore": "1/5", 2024-05-08T18:29:59.444 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_lockdep": "0/1", 2024-05-08T18:29:59.444 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_mclock": "1/5", 2024-05-08T18:29:59.444 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_mds": "1/5", 2024-05-08T18:29:59.444 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_mds_balancer": "1/5", 2024-05-08T18:29:59.444 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_mds_locker": "1/5", 2024-05-08T18:29:59.445 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_mds_log": "1/5", 2024-05-08T18:29:59.445 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_mds_log_expire": "1/5", 2024-05-08T18:29:59.445 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_mds_migrator": "1/5", 2024-05-08T18:29:59.445 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_mds_quiesce": "3/5", 2024-05-08T18:29:59.445 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_memstore": "1/5", 2024-05-08T18:29:59.445 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_mgr": "2/5", 2024-05-08T18:29:59.445 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_mgrc": "1/5", 2024-05-08T18:29:59.445 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_mon": "20/20", 2024-05-08T18:29:59.445 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_monc": "0/10", 2024-05-08T18:29:59.445 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_ms": "1/1", 2024-05-08T18:29:59.445 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_none": "0/5", 2024-05-08T18:29:59.445 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_objclass": "0/5", 2024-05-08T18:29:59.445 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_objectcacher": "0/5", 2024-05-08T18:29:59.445 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_objecter": "0/1", 2024-05-08T18:29:59.446 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_optracker": "0/5", 2024-05-08T18:29:59.446 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_osd": "1/5", 2024-05-08T18:29:59.446 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_paxos": "20/20", 2024-05-08T18:29:59.446 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_perfcounter": "1/5", 2024-05-08T18:29:59.446 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_prioritycache": "1/5", 2024-05-08T18:29:59.446 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_rados": "0/5", 2024-05-08T18:29:59.446 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_rbd": "0/5", 2024-05-08T18:29:59.446 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_rbd_mirror": "0/5", 2024-05-08T18:29:59.446 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_rbd_pwl": "0/5", 2024-05-08T18:29:59.446 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_rbd_replay": "0/5", 2024-05-08T18:29:59.446 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_refs": "0/0", 2024-05-08T18:29:59.446 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_reserver": "1/1", 2024-05-08T18:29:59.447 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_rgw": "1/5", 2024-05-08T18:29:59.447 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_rgw_access": "1/5", 2024-05-08T18:29:59.447 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_rgw_datacache": "1/5", 2024-05-08T18:29:59.447 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_rgw_dbstore": "1/5", 2024-05-08T18:29:59.447 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_rgw_flight": "1/5", 2024-05-08T18:29:59.447 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_rgw_lifecycle": "1/5", 2024-05-08T18:29:59.447 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_rgw_notification": "1/5", 2024-05-08T18:29:59.447 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_rgw_sync": "1/5", 2024-05-08T18:29:59.447 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_rocksdb": "4/5", 2024-05-08T18:29:59.447 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_seastore": "0/5", 2024-05-08T18:29:59.447 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_seastore_backref": "0/5", 2024-05-08T18:29:59.447 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_seastore_cache": "0/5", 2024-05-08T18:29:59.447 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_seastore_cleaner": "0/5", 2024-05-08T18:29:59.448 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_seastore_device": "0/5", 2024-05-08T18:29:59.448 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_seastore_epm": "0/5", 2024-05-08T18:29:59.448 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-05-08T18:29:59.448 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_seastore_journal": "0/5", 2024-05-08T18:29:59.448 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_seastore_lba": "0/5", 2024-05-08T18:29:59.448 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_seastore_odata": "0/5", 2024-05-08T18:29:59.448 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_seastore_omap": "0/5", 2024-05-08T18:29:59.448 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_seastore_onode": "0/5", 2024-05-08T18:29:59.448 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_seastore_t": "0/5", 2024-05-08T18:29:59.448 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_seastore_tm": "0/5", 2024-05-08T18:29:59.448 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_striper": "0/1", 2024-05-08T18:29:59.448 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_test": "0/5", 2024-05-08T18:29:59.449 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_throttle": "1/1", 2024-05-08T18:29:59.449 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_timer": "0/1", 2024-05-08T18:29:59.449 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_tp": "0/5", 2024-05-08T18:29:59.449 INFO:teuthology.orchestra.run.smithi097.stdout: "debug_trace": "1/5", 2024-05-08T18:29:59.449 INFO:teuthology.orchestra.run.smithi097.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-05-08T18:29:59.449 INFO:teuthology.orchestra.run.smithi097.stdout: "device_failure_prediction_mode": "none", 2024-05-08T18:29:59.449 INFO:teuthology.orchestra.run.smithi097.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-05-08T18:29:59.449 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_dir": "/usr/lib/ceph/erasure-code", 2024-05-08T18:29:59.449 INFO:teuthology.orchestra.run.smithi097.stdout: "err_to_graylog": "false", 2024-05-08T18:29:59.449 INFO:teuthology.orchestra.run.smithi097.stdout: "err_to_journald": "false", 2024-05-08T18:29:59.449 INFO:teuthology.orchestra.run.smithi097.stdout: "err_to_stderr": "true", 2024-05-08T18:29:59.449 INFO:teuthology.orchestra.run.smithi097.stdout: "err_to_syslog": "false", 2024-05-08T18:29:59.449 INFO:teuthology.orchestra.run.smithi097.stdout: "event_tracing": "false", 2024-05-08T18:29:59.450 INFO:teuthology.orchestra.run.smithi097.stdout: "exporter_addr": "0.0.0.0", 2024-05-08T18:29:59.450 INFO:teuthology.orchestra.run.smithi097.stdout: "exporter_http_port": "9926", 2024-05-08T18:29:59.450 INFO:teuthology.orchestra.run.smithi097.stdout: "exporter_prio_limit": "5", 2024-05-08T18:29:59.450 INFO:teuthology.orchestra.run.smithi097.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-05-08T18:29:59.450 INFO:teuthology.orchestra.run.smithi097.stdout: "exporter_sort_metrics": "true", 2024-05-08T18:29:59.450 INFO:teuthology.orchestra.run.smithi097.stdout: "exporter_stats_period": "5", 2024-05-08T18:29:59.450 INFO:teuthology.orchestra.run.smithi097.stdout: "fake_statfs_for_testing": "0", 2024-05-08T18:29:59.450 INFO:teuthology.orchestra.run.smithi097.stdout: "fatal_signal_handlers": "true", 2024-05-08T18:29:59.450 INFO:teuthology.orchestra.run.smithi097.stdout: "filer_max_purge_ops": "10", 2024-05-08T18:29:59.450 INFO:teuthology.orchestra.run.smithi097.stdout: "filer_max_truncate_ops": "128", 2024-05-08T18:29:59.450 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_apply_finisher_threads": "1", 2024-05-08T18:29:59.450 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_blackhole": "false", 2024-05-08T18:29:59.450 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_btrfs_clone_range": "true", 2024-05-08T18:29:59.451 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_btrfs_snap": "true", 2024-05-08T18:29:59.451 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_caller_concurrency": "10", 2024-05-08T18:29:59.451 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_collect_device_partition_information": "true", 2024-05-08T18:29:59.451 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_commit_timeout": "600.000000", 2024-05-08T18:29:59.451 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_debug_inject_read_err": "false", 2024-05-08T18:29:59.451 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_debug_omap_check": "false", 2024-05-08T18:29:59.451 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_debug_verify_split": "false", 2024-05-08T18:29:59.451 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_dump_file": "", 2024-05-08T18:29:59.451 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-05-08T18:29:59.451 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-05-08T18:29:59.451 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_fadvise": "true", 2024-05-08T18:29:59.451 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_fail_eio": "true", 2024-05-08T18:29:59.451 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_fd_cache_shards": "16", 2024-05-08T18:29:59.452 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_fd_cache_size": "128", 2024-05-08T18:29:59.452 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_fiemap": "false", 2024-05-08T18:29:59.452 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_fiemap_threshold": "4096", 2024-05-08T18:29:59.452 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-05-08T18:29:59.452 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_index_retry_probability": "0.000000", 2024-05-08T18:29:59.452 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_inject_stall": "0", 2024-05-08T18:29:59.452 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_journal_parallel": "false", 2024-05-08T18:29:59.452 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_journal_trailing": "false", 2024-05-08T18:29:59.452 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_journal_writeahead": "false", 2024-05-08T18:29:59.452 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_kill_at": "0", 2024-05-08T18:29:59.452 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-05-08T18:29:59.452 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_max_inline_xattr_size": "0", 2024-05-08T18:29:59.452 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-05-08T18:29:59.453 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-05-08T18:29:59.453 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-05-08T18:29:59.453 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_max_inline_xattrs": "0", 2024-05-08T18:29:59.453 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-05-08T18:29:59.453 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_max_inline_xattrs_other": "2", 2024-05-08T18:29:59.453 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-05-08T18:29:59.453 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_max_sync_interval": "5.000000", 2024-05-08T18:29:59.453 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_max_xattr_value_size": "0", 2024-05-08T18:29:59.453 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-05-08T18:29:59.453 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-05-08T18:29:59.453 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-05-08T18:29:59.453 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_merge_threshold": "-10", 2024-05-08T18:29:59.453 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_min_sync_interval": "0.010000", 2024-05-08T18:29:59.454 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_odsync_write": "false", 2024-05-08T18:29:59.454 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_omap_backend": "rocksdb", 2024-05-08T18:29:59.454 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_omap_backend_path": "", 2024-05-08T18:29:59.454 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_omap_header_cache_size": "1024", 2024-05-08T18:29:59.454 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_ondisk_finisher_threads": "1", 2024-05-08T18:29:59.454 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-05-08T18:29:59.454 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_op_thread_timeout": "60", 2024-05-08T18:29:59.454 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_op_threads": "2", 2024-05-08T18:29:59.454 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_punch_hole": "false", 2024-05-08T18:29:59.455 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-05-08T18:29:59.455 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-05-08T18:29:59.455 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-05-08T18:29:59.455 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-05-08T18:29:59.455 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-05-08T18:29:59.455 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_queue_max_bytes": "104857600", 2024-05-08T18:29:59.455 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-05-08T18:29:59.455 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-05-08T18:29:59.455 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-05-08T18:29:59.455 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_queue_max_ops": "50", 2024-05-08T18:29:59.455 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-05-08T18:29:59.455 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_seek_data_hole": "false", 2024-05-08T18:29:59.455 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_sloppy_crc": "false", 2024-05-08T18:29:59.456 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-05-08T18:29:59.456 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_splice": "false", 2024-05-08T18:29:59.456 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_split_multiple": "2", 2024-05-08T18:29:59.456 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_split_rand_factor": "20", 2024-05-08T18:29:59.456 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_update_to": "1000", 2024-05-08T18:29:59.456 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-05-08T18:29:59.456 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-05-08T18:29:59.456 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-05-08T18:29:59.456 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-05-08T18:29:59.456 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-05-08T18:29:59.456 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-05-08T18:29:59.456 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_wbthrottle_enable": "true", 2024-05-08T18:29:59.456 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-05-08T18:29:59.456 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-05-08T18:29:59.457 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-05-08T18:29:59.457 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-05-08T18:29:59.457 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-05-08T18:29:59.457 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-05-08T18:29:59.457 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_xfs_extsize": "false", 2024-05-08T18:29:59.457 INFO:teuthology.orchestra.run.smithi097.stdout: "filestore_zfs_snap": "false", 2024-05-08T18:29:59.457 INFO:teuthology.orchestra.run.smithi097.stdout: "fio_dir": "/tmp/fio", 2024-05-08T18:29:59.457 INFO:teuthology.orchestra.run.smithi097.stdout: "fsid": "f135278e-f589-4ad6-a830-fa767ff99171", 2024-05-08T18:29:59.457 INFO:teuthology.orchestra.run.smithi097.stdout: "fuse_allow_other": "true", 2024-05-08T18:29:59.457 INFO:teuthology.orchestra.run.smithi097.stdout: "fuse_atomic_o_trunc": "true", 2024-05-08T18:29:59.457 INFO:teuthology.orchestra.run.smithi097.stdout: "fuse_big_writes": "true", 2024-05-08T18:29:59.457 INFO:teuthology.orchestra.run.smithi097.stdout: "fuse_debug": "false", 2024-05-08T18:29:59.458 INFO:teuthology.orchestra.run.smithi097.stdout: "fuse_default_permissions": "false", 2024-05-08T18:29:59.458 INFO:teuthology.orchestra.run.smithi097.stdout: "fuse_disable_pagecache": "false", 2024-05-08T18:29:59.458 INFO:teuthology.orchestra.run.smithi097.stdout: "fuse_max_write": "0", 2024-05-08T18:29:59.458 INFO:teuthology.orchestra.run.smithi097.stdout: "fuse_multithreaded": "true", 2024-05-08T18:29:59.458 INFO:teuthology.orchestra.run.smithi097.stdout: "fuse_require_active_mds": "true", 2024-05-08T18:29:59.458 INFO:teuthology.orchestra.run.smithi097.stdout: "fuse_set_user_groups": "true", 2024-05-08T18:29:59.458 INFO:teuthology.orchestra.run.smithi097.stdout: "fuse_splice_move": "true", 2024-05-08T18:29:59.458 INFO:teuthology.orchestra.run.smithi097.stdout: "fuse_splice_read": "true", 2024-05-08T18:29:59.458 INFO:teuthology.orchestra.run.smithi097.stdout: "fuse_splice_write": "true", 2024-05-08T18:29:59.458 INFO:teuthology.orchestra.run.smithi097.stdout: "fuse_syncfs_on_mksnap": "true", 2024-05-08T18:29:59.458 INFO:teuthology.orchestra.run.smithi097.stdout: "fuse_use_invalidate_cb": "true", 2024-05-08T18:29:59.458 INFO:teuthology.orchestra.run.smithi097.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-05-08T18:29:59.458 INFO:teuthology.orchestra.run.smithi097.stdout: "gss_target_name": "ceph", 2024-05-08T18:29:59.459 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_file": "", 2024-05-08T18:29:59.459 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_inject_failure": "0", 2024-05-08T18:29:59.459 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_interval": "5", 2024-05-08T18:29:59.459 INFO:teuthology.orchestra.run.smithi097.stdout: "host": "smithi097", 2024-05-08T18:29:59.459 INFO:teuthology.orchestra.run.smithi097.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-05-08T18:29:59.459 INFO:teuthology.orchestra.run.smithi097.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-05-08T18:29:59.459 INFO:teuthology.orchestra.run.smithi097.stdout: "immutable_object_cache_max_size": "1073741824", 2024-05-08T18:29:59.459 INFO:teuthology.orchestra.run.smithi097.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-05-08T18:29:59.459 INFO:teuthology.orchestra.run.smithi097.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-05-08T18:29:59.459 INFO:teuthology.orchestra.run.smithi097.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-05-08T18:29:59.459 INFO:teuthology.orchestra.run.smithi097.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-05-08T18:29:59.459 INFO:teuthology.orchestra.run.smithi097.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-05-08T18:29:59.459 INFO:teuthology.orchestra.run.smithi097.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-05-08T18:29:59.460 INFO:teuthology.orchestra.run.smithi097.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-05-08T18:29:59.460 INFO:teuthology.orchestra.run.smithi097.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-05-08T18:29:59.460 INFO:teuthology.orchestra.run.smithi097.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-05-08T18:29:59.460 INFO:teuthology.orchestra.run.smithi097.stdout: "immutable_object_cache_watermark": "0.900000", 2024-05-08T18:29:59.460 INFO:teuthology.orchestra.run.smithi097.stdout: "inject_early_sigterm": "false", 2024-05-08T18:29:59.460 INFO:teuthology.orchestra.run.smithi097.stdout: "jaeger_agent_port": "6799", 2024-05-08T18:29:59.460 INFO:teuthology.orchestra.run.smithi097.stdout: "jaeger_tracing_enable": "false", 2024-05-08T18:29:59.460 INFO:teuthology.orchestra.run.smithi097.stdout: "journal_aio": "true", 2024-05-08T18:29:59.460 INFO:teuthology.orchestra.run.smithi097.stdout: "journal_align_min_size": "65536", 2024-05-08T18:29:59.460 INFO:teuthology.orchestra.run.smithi097.stdout: "journal_block_align": "true", 2024-05-08T18:29:59.460 INFO:teuthology.orchestra.run.smithi097.stdout: "journal_block_size": "4096", 2024-05-08T18:29:59.460 INFO:teuthology.orchestra.run.smithi097.stdout: "journal_dio": "true", 2024-05-08T18:29:59.460 INFO:teuthology.orchestra.run.smithi097.stdout: "journal_discard": "false", 2024-05-08T18:29:59.460 INFO:teuthology.orchestra.run.smithi097.stdout: "journal_force_aio": "false", 2024-05-08T18:29:59.461 INFO:teuthology.orchestra.run.smithi097.stdout: "journal_ignore_corruption": "false", 2024-05-08T18:29:59.461 INFO:teuthology.orchestra.run.smithi097.stdout: "journal_max_write_bytes": "10485760", 2024-05-08T18:29:59.461 INFO:teuthology.orchestra.run.smithi097.stdout: "journal_max_write_entries": "100", 2024-05-08T18:29:59.461 INFO:teuthology.orchestra.run.smithi097.stdout: "journal_replay_from": "0", 2024-05-08T18:29:59.461 INFO:teuthology.orchestra.run.smithi097.stdout: "journal_throttle_high_multiple": "0.000000", 2024-05-08T18:29:59.461 INFO:teuthology.orchestra.run.smithi097.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-05-08T18:29:59.461 INFO:teuthology.orchestra.run.smithi097.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-05-08T18:29:59.461 INFO:teuthology.orchestra.run.smithi097.stdout: "journal_throttle_max_multiple": "0.000000", 2024-05-08T18:29:59.461 INFO:teuthology.orchestra.run.smithi097.stdout: "journal_write_header_frequency": "0", 2024-05-08T18:29:59.461 INFO:teuthology.orchestra.run.smithi097.stdout: "journal_zero_on_create": "false", 2024-05-08T18:29:59.461 INFO:teuthology.orchestra.run.smithi097.stdout: "journaler_prefetch_periods": "10", 2024-05-08T18:29:59.461 INFO:teuthology.orchestra.run.smithi097.stdout: "journaler_prezero_periods": "5", 2024-05-08T18:29:59.461 INFO:teuthology.orchestra.run.smithi097.stdout: "journaler_write_head_interval": "15", 2024-05-08T18:29:59.462 INFO:teuthology.orchestra.run.smithi097.stdout: "key": "", 2024-05-08T18:29:59.462 INFO:teuthology.orchestra.run.smithi097.stdout: "keyfile": "", 2024-05-08T18:29:59.462 INFO:teuthology.orchestra.run.smithi097.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-05-08T18:29:59.462 INFO:teuthology.orchestra.run.smithi097.stdout: "kstore_backend": "rocksdb", 2024-05-08T18:29:59.462 INFO:teuthology.orchestra.run.smithi097.stdout: "kstore_default_stripe_size": "65536", 2024-05-08T18:29:59.462 INFO:teuthology.orchestra.run.smithi097.stdout: "kstore_fsck_on_mount": "false", 2024-05-08T18:29:59.462 INFO:teuthology.orchestra.run.smithi097.stdout: "kstore_fsck_on_mount_deep": "true", 2024-05-08T18:29:59.462 INFO:teuthology.orchestra.run.smithi097.stdout: "kstore_max_bytes": "67108864", 2024-05-08T18:29:59.462 INFO:teuthology.orchestra.run.smithi097.stdout: "kstore_max_ops": "512", 2024-05-08T18:29:59.462 INFO:teuthology.orchestra.run.smithi097.stdout: "kstore_nid_prealloc": "1024", 2024-05-08T18:29:59.462 INFO:teuthology.orchestra.run.smithi097.stdout: "kstore_onode_map_size": "1024", 2024-05-08T18:29:59.462 INFO:teuthology.orchestra.run.smithi097.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-05-08T18:29:59.462 INFO:teuthology.orchestra.run.smithi097.stdout: "kstore_sync_submit_transaction": "false", 2024-05-08T18:29:59.463 INFO:teuthology.orchestra.run.smithi097.stdout: "kstore_sync_transaction": "false", 2024-05-08T18:29:59.463 INFO:teuthology.orchestra.run.smithi097.stdout: "librados_thread_count": "2", 2024-05-08T18:29:59.463 INFO:teuthology.orchestra.run.smithi097.stdout: "lockdep": "false", 2024-05-08T18:29:59.463 INFO:teuthology.orchestra.run.smithi097.stdout: "lockdep_force_backtrace": "false", 2024-05-08T18:29:59.463 INFO:teuthology.orchestra.run.smithi097.stdout: "log_coarse_timestamps": "true", 2024-05-08T18:29:59.463 INFO:teuthology.orchestra.run.smithi097.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-05-08T18:29:59.463 INFO:teuthology.orchestra.run.smithi097.stdout: "log_flush_on_exit": "false", 2024-05-08T18:29:59.463 INFO:teuthology.orchestra.run.smithi097.stdout: "log_graylog_host": "127.0.0.1", 2024-05-08T18:29:59.463 INFO:teuthology.orchestra.run.smithi097.stdout: "log_graylog_port": "12201", 2024-05-08T18:29:59.463 INFO:teuthology.orchestra.run.smithi097.stdout: "log_max_new": "1000", 2024-05-08T18:29:59.463 INFO:teuthology.orchestra.run.smithi097.stdout: "log_max_recent": "10000", 2024-05-08T18:29:59.463 INFO:teuthology.orchestra.run.smithi097.stdout: "log_stderr_prefix": "", 2024-05-08T18:29:59.463 INFO:teuthology.orchestra.run.smithi097.stdout: "log_stop_at_utilization": "0.970000", 2024-05-08T18:29:59.463 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_file": "true", 2024-05-08T18:29:59.464 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_graylog": "false", 2024-05-08T18:29:59.464 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_journald": "false", 2024-05-08T18:29:59.464 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_stderr": "false", 2024-05-08T18:29:59.464 INFO:teuthology.orchestra.run.smithi097.stdout: "log_to_syslog": "false", 2024-05-08T18:29:59.464 INFO:teuthology.orchestra.run.smithi097.stdout: "max_rotating_auth_attempts": "10", 2024-05-08T18:29:59.464 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-05-08T18:29:59.464 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_action_on_write_error": "1", 2024-05-08T18:29:59.464 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_alternate_name_max": "8192", 2024-05-08T18:29:59.464 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_asio_thread_count": "2", 2024-05-08T18:29:59.464 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_bal_export_pin": "true", 2024-05-08T18:29:59.464 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_bal_fragment_dirs": "true", 2024-05-08T18:29:59.464 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-05-08T18:29:59.464 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_bal_fragment_interval": "5", 2024-05-08T18:29:59.464 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_bal_fragment_size_max": "100000", 2024-05-08T18:29:59.465 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_bal_idle_threshold": "0.000000", 2024-05-08T18:29:59.465 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_bal_interval": "10", 2024-05-08T18:29:59.465 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_bal_max": "-1", 2024-05-08T18:29:59.465 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_bal_max_until": "-1", 2024-05-08T18:29:59.465 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_bal_merge_size": "50", 2024-05-08T18:29:59.465 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_bal_midchunk": "0.300000", 2024-05-08T18:29:59.465 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_bal_min_rebalance": "0.100000", 2024-05-08T18:29:59.465 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_bal_min_start": "0.200000", 2024-05-08T18:29:59.465 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_bal_minchunk": "0.001000", 2024-05-08T18:29:59.465 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_bal_mode": "0", 2024-05-08T18:29:59.465 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_bal_need_max": "1.200000", 2024-05-08T18:29:59.465 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_bal_need_min": "0.800000", 2024-05-08T18:29:59.465 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_bal_overload_epochs": "2", 2024-05-08T18:29:59.465 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-05-08T18:29:59.466 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_bal_sample_interval": "3.000000", 2024-05-08T18:29:59.466 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_bal_split_bits": "3", 2024-05-08T18:29:59.466 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_bal_split_rd": "25000.000000", 2024-05-08T18:29:59.466 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_bal_split_size": "10000", 2024-05-08T18:29:59.466 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_bal_split_wr": "10000.000000", 2024-05-08T18:29:59.466 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_bal_target_decay": "10.000000", 2024-05-08T18:29:59.466 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-05-08T18:29:59.466 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_beacon_grace": "15.000000", 2024-05-08T18:29:59.466 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_beacon_interval": "4.000000", 2024-05-08T18:29:59.466 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_beacon_mon_down_grace": "60", 2024-05-08T18:29:59.466 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_cache_memory_limit": "4294967296", 2024-05-08T18:29:59.466 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_cache_mid": "0.700000", 2024-05-08T18:29:59.466 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_cache_quiesce_decay_rate": "1.000000", 2024-05-08T18:29:59.467 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_cache_quiesce_delay": "0", 2024-05-08T18:29:59.467 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_cache_quiesce_sleep": "200", 2024-05-08T18:29:59.467 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_cache_quiesce_splitauth": "true", 2024-05-08T18:29:59.467 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_cache_quiesce_threshold": "524288", 2024-05-08T18:29:59.467 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_cache_release_free_interval": "10", 2024-05-08T18:29:59.467 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_cache_reservation": "0.050000", 2024-05-08T18:29:59.467 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-05-08T18:29:59.467 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_cache_trim_interval": "1", 2024-05-08T18:29:59.467 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_cache_trim_threshold": "262144", 2024-05-08T18:29:59.467 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-05-08T18:29:59.467 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-05-08T18:29:59.467 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_client_delegate_inos_pct": "50", 2024-05-08T18:29:59.467 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_client_prealloc_inos": "1000", 2024-05-08T18:29:59.467 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-05-08T18:29:59.467 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_connect_bootstrapping": "false", 2024-05-08T18:29:59.468 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_damage_table_max_entries": "10000", 2024-05-08T18:29:59.468 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-05-08T18:29:59.468 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_debug_auth_pins": "false", 2024-05-08T18:29:59.468 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_debug_frag": "false", 2024-05-08T18:29:59.468 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_debug_scatterstat": "false", 2024-05-08T18:29:59.468 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_debug_subtrees": "false", 2024-05-08T18:29:59.468 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_decay_halflife": "5.000000", 2024-05-08T18:29:59.468 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_default_dir_hash": "2", 2024-05-08T18:29:59.468 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_defer_session_stale": "true", 2024-05-08T18:29:59.468 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_deny_all_reconnect": "false", 2024-05-08T18:29:59.468 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_dir_keys_per_op": "16384", 2024-05-08T18:29:59.468 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_dir_max_commit_size": "10", 2024-05-08T18:29:59.468 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_dir_max_entries": "0", 2024-05-08T18:29:59.468 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_dir_prefetch": "true", 2024-05-08T18:29:59.469 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_dirstat_min_interval": "1.000000", 2024-05-08T18:29:59.469 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_dump_cache_after_rejoin": "false", 2024-05-08T18:29:59.469 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_dump_cache_on_map": "false", 2024-05-08T18:29:59.469 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_dump_cache_threshold_file": "0", 2024-05-08T18:29:59.469 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-05-08T18:29:59.469 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_early_reply": "true", 2024-05-08T18:29:59.469 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_enable_op_tracker": "true", 2024-05-08T18:29:59.469 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_enforce_unique_name": "true", 2024-05-08T18:29:59.469 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_export_ephemeral_distributed": "true", 2024-05-08T18:29:59.469 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-05-08T18:29:59.469 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_export_ephemeral_random": "true", 2024-05-08T18:29:59.469 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-05-08T18:29:59.469 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-05-08T18:29:59.469 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_forward_all_requests_to_auth": "false", 2024-05-08T18:29:59.470 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-05-08T18:29:59.470 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-05-08T18:29:59.470 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-05-08T18:29:59.470 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-05-08T18:29:59.470 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_health_cache_threshold": "1.500000", 2024-05-08T18:29:59.470 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_health_summarize_threshold": "10", 2024-05-08T18:29:59.470 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_heartbeat_grace": "15.000000", 2024-05-08T18:29:59.470 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_heartbeat_reset_grace": "1000", 2024-05-08T18:29:59.470 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_inject_health_dummy": "false", 2024-05-08T18:29:59.470 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-05-08T18:29:59.470 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_inject_migrator_session_race": "false", 2024-05-08T18:29:59.470 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-05-08T18:29:59.470 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-05-08T18:29:59.471 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-05-08T18:29:59.471 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_join_fs": "", 2024-05-08T18:29:59.471 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_journal_format": "1", 2024-05-08T18:29:59.471 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_kill_after_journal_logs_flushed": "false", 2024-05-08T18:29:59.471 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_kill_create_at": "0", 2024-05-08T18:29:59.471 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_kill_export_at": "0", 2024-05-08T18:29:59.471 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_kill_import_at": "0", 2024-05-08T18:29:59.471 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_kill_journal_at": "0", 2024-05-08T18:29:59.471 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_kill_journal_expire_at": "0", 2024-05-08T18:29:59.471 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_kill_journal_replay_at": "0", 2024-05-08T18:29:59.471 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_kill_link_at": "0", 2024-05-08T18:29:59.471 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_kill_mdstable_at": "0", 2024-05-08T18:29:59.471 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_kill_openc_at": "0", 2024-05-08T18:29:59.472 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_kill_rename_at": "0", 2024-05-08T18:29:59.472 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_kill_shutdown_at": "0", 2024-05-08T18:29:59.472 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_log_event_large_threshold": "524288", 2024-05-08T18:29:59.472 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_log_events_per_segment": "1024", 2024-05-08T18:29:59.472 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_log_major_segment_event_ratio": "12", 2024-05-08T18:29:59.472 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_log_max_events": "-1", 2024-05-08T18:29:59.472 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_log_max_segments": "128", 2024-05-08T18:29:59.472 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_log_pause": "false", 2024-05-08T18:29:59.472 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_log_segment_size": "0", 2024-05-08T18:29:59.472 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_log_skip_corrupt_events": "false", 2024-05-08T18:29:59.472 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_log_skip_unbounded_events": "false", 2024-05-08T18:29:59.473 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_log_trim_decay_rate": "1.000000", 2024-05-08T18:29:59.473 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_log_trim_threshold": "128", 2024-05-08T18:29:59.473 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_log_trim_upkeep_interval": "1000", 2024-05-08T18:29:59.473 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_log_warn_factor": "2.000000", 2024-05-08T18:29:59.473 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_max_caps_per_client": "1048576", 2024-05-08T18:29:59.473 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_max_completed_flushes": "100000", 2024-05-08T18:29:59.473 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_max_completed_requests": "100000", 2024-05-08T18:29:59.473 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_max_export_size": "20971520", 2024-05-08T18:29:59.473 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_max_file_recover": "32", 2024-05-08T18:29:59.473 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_max_purge_files": "64", 2024-05-08T18:29:59.473 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_max_purge_ops": "8192", 2024-05-08T18:29:59.473 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-05-08T18:29:59.473 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-05-08T18:29:59.474 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_max_snaps_per_dir": "100", 2024-05-08T18:29:59.474 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_metrics_update_interval": "2", 2024-05-08T18:29:59.474 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_min_caps_per_client": "100", 2024-05-08T18:29:59.474 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_min_caps_working_set": "10000", 2024-05-08T18:29:59.474 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-05-08T18:29:59.474 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_numa_node": "-1", 2024-05-08T18:29:59.474 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-05-08T18:29:59.474 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_op_complaint_time": "30.000000", 2024-05-08T18:29:59.474 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_op_history_duration": "600", 2024-05-08T18:29:59.474 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_op_history_size": "20", 2024-05-08T18:29:59.474 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_op_history_slow_op_size": "20", 2024-05-08T18:29:59.474 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_op_history_slow_op_threshold": "10", 2024-05-08T18:29:59.474 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_op_log_threshold": "5", 2024-05-08T18:29:59.475 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_ping_grace": "15", 2024-05-08T18:29:59.475 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_ping_interval": "5", 2024-05-08T18:29:59.475 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-05-08T18:29:59.475 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-05-08T18:29:59.475 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_recall_max_caps": "30000", 2024-05-08T18:29:59.475 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-05-08T18:29:59.475 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_recall_max_decay_threshold": "131072", 2024-05-08T18:29:59.475 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-05-08T18:29:59.475 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_recall_warning_threshold": "262144", 2024-05-08T18:29:59.475 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_reconnect_timeout": "45.000000", 2024-05-08T18:29:59.475 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_replay_interval": "1.000000", 2024-05-08T18:29:59.475 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-05-08T18:29:59.475 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-05-08T18:29:59.475 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_root_ino_gid": "0", 2024-05-08T18:29:59.475 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_root_ino_uid": "0", 2024-05-08T18:29:59.476 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-05-08T18:29:59.476 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_server_dispatch_client_request_delay": "0", 2024-05-08T18:29:59.476 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_server_dispatch_killpoint_random": "0.000000", 2024-05-08T18:29:59.476 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_session_blocklist_on_evict": "true", 2024-05-08T18:29:59.476 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_session_blocklist_on_timeout": "true", 2024-05-08T18:29:59.476 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-05-08T18:29:59.476 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-05-08T18:29:59.476 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-05-08T18:29:59.476 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-05-08T18:29:59.476 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-05-08T18:29:59.476 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_session_metadata_threshold": "16777216", 2024-05-08T18:29:59.476 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-05-08T18:29:59.477 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_shutdown_check": "0", 2024-05-08T18:29:59.477 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_skip_ino": "0", 2024-05-08T18:29:59.477 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_sleep_rank_change": "0.000000", 2024-05-08T18:29:59.477 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_snap_max_uid": "4294967294", 2024-05-08T18:29:59.477 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_snap_min_uid": "0", 2024-05-08T18:29:59.477 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_snap_rstat": "false", 2024-05-08T18:29:59.477 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_standby_replay_damaged": "false", 2024-05-08T18:29:59.477 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_symlink_recovery": "true", 2024-05-08T18:29:59.477 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_task_status_update_interval": "2.000000", 2024-05-08T18:29:59.477 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_thrash_exports": "0", 2024-05-08T18:29:59.477 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_thrash_fragments": "0", 2024-05-08T18:29:59.477 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_tick_interval": "5.000000", 2024-05-08T18:29:59.477 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_valgrind_exit": "false", 2024-05-08T18:29:59.477 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_verify_backtrace": "1", 2024-05-08T18:29:59.478 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_verify_scatter": "false", 2024-05-08T18:29:59.478 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_wipe_ino_prealloc": "false", 2024-05-08T18:29:59.478 INFO:teuthology.orchestra.run.smithi097.stdout: "mds_wipe_sessions": "false", 2024-05-08T18:29:59.478 INFO:teuthology.orchestra.run.smithi097.stdout: "mempool_debug": "false", 2024-05-08T18:29:59.478 INFO:teuthology.orchestra.run.smithi097.stdout: "memstore_debug_omit_block_device_write": "false", 2024-05-08T18:29:59.478 INFO:teuthology.orchestra.run.smithi097.stdout: "memstore_device_bytes": "1073741824", 2024-05-08T18:29:59.478 INFO:teuthology.orchestra.run.smithi097.stdout: "memstore_page_set": "false", 2024-05-08T18:29:59.478 INFO:teuthology.orchestra.run.smithi097.stdout: "memstore_page_size": "65536", 2024-05-08T18:29:59.478 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr_client_bytes": "134217728", 2024-05-08T18:29:59.478 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr_client_messages": "512", 2024-05-08T18:29:59.478 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-05-08T18:29:59.478 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr_connect_retry_interval": "1.000000", 2024-05-08T18:29:59.478 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-05-08T18:29:59.479 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-05-08T18:29:59.479 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr_disabled_modules": "", 2024-05-08T18:29:59.479 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr_enable_op_tracker": "true", 2024-05-08T18:29:59.479 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-05-08T18:29:59.479 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr_max_pg_creating": "1024", 2024-05-08T18:29:59.479 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr_max_pg_num_change": "128", 2024-05-08T18:29:59.479 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr_mds_bytes": "134217728", 2024-05-08T18:29:59.479 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr_mds_messages": "128", 2024-05-08T18:29:59.479 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-05-08T18:29:59.479 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr_mon_bytes": "134217728", 2024-05-08T18:29:59.479 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr_mon_messages": "128", 2024-05-08T18:29:59.479 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr_num_op_tracker_shard": "32", 2024-05-08T18:29:59.479 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr_op_complaint_time": "30.000000", 2024-05-08T18:29:59.479 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr_op_history_duration": "600", 2024-05-08T18:29:59.480 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr_op_history_size": "20", 2024-05-08T18:29:59.480 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr_op_history_slow_op_size": "20", 2024-05-08T18:29:59.480 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr_op_history_slow_op_threshold": "10.000000", 2024-05-08T18:29:59.480 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr_op_log_threshold": "5", 2024-05-08T18:29:59.480 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr_osd_bytes": "536870912", 2024-05-08T18:29:59.480 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr_osd_messages": "8192", 2024-05-08T18:29:59.480 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr_pool": "true", 2024-05-08T18:29:59.480 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr_service_beacon_grace": "60.000000", 2024-05-08T18:29:59.480 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr_standby_modules": "true", 2024-05-08T18:29:59.480 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr_stats_period": "5", 2024-05-08T18:29:59.480 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr_stats_threshold": "5", 2024-05-08T18:29:59.480 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr_tick_period": "2", 2024-05-08T18:29:59.480 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-05-08T18:29:59.481 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_accept_timeout_factor": "2.000000", 2024-05-08T18:29:59.481 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_allow_pool_delete": "true", 2024-05-08T18:29:59.481 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_allow_pool_size_one": "true", 2024-05-08T18:29:59.481 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_auth_validate_all_caps": "true", 2024-05-08T18:29:59.481 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-05-08T18:29:59.481 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-05-08T18:29:59.481 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_client_bytes": "104857600", 2024-05-08T18:29:59.481 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_client_directed_command_retry": "2", 2024-05-08T18:29:59.481 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_client_hunt_interval": "3.000000", 2024-05-08T18:29:59.481 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-05-08T18:29:59.481 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-05-08T18:29:59.481 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-05-08T18:29:59.481 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_client_hunt_parallel": "3", 2024-05-08T18:29:59.482 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_client_log_interval": "1.000000", 2024-05-08T18:29:59.482 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-05-08T18:29:59.482 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_client_ping_interval": "10.000000", 2024-05-08T18:29:59.482 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_client_ping_timeout": "30.000000", 2024-05-08T18:29:59.482 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_client_target_rank": "-1", 2024-05-08T18:29:59.482 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_clock_drift_allowed": "1.000000", 2024-05-08T18:29:59.482 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-05-08T18:29:59.482 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-05-08T18:29:59.482 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_cluster_log_level": "debug", 2024-05-08T18:29:59.482 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_cluster_log_to_file": "true", 2024-05-08T18:29:59.482 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_cluster_log_to_graylog": "false", 2024-05-08T18:29:59.482 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-05-08T18:29:59.482 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-05-08T18:29:59.483 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_cluster_log_to_journald": "false", 2024-05-08T18:29:59.483 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_cluster_log_to_stderr": "false", 2024-05-08T18:29:59.483 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-05-08T18:29:59.483 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-05-08T18:29:59.483 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_compact_on_bootstrap": "false", 2024-05-08T18:29:59.483 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_compact_on_start": "false", 2024-05-08T18:29:59.483 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_compact_on_trim": "true", 2024-05-08T18:29:59.483 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_con_tracker_persist_interval": "10", 2024-05-08T18:29:59.483 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_con_tracker_score_halflife": "43200", 2024-05-08T18:29:59.483 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_config_key_max_entry_size": "65536", 2024-05-08T18:29:59.483 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_cpu_threads": "4", 2024-05-08T18:29:59.483 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_crush_min_required_version": "hammer", 2024-05-08T18:29:59.483 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_daemon_bytes": "419430400", 2024-05-08T18:29:59.483 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-05-08T18:29:59.484 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_data_avail_crit": "5", 2024-05-08T18:29:59.484 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_data_avail_warn": "5", 2024-05-08T18:29:59.484 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_data_size_warn": "16106127360", 2024-05-08T18:29:59.484 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_debug_block_osdmap_trim": "false", 2024-05-08T18:29:59.484 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-05-08T18:29:59.484 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_debug_dump_json": "false", 2024-05-08T18:29:59.484 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-05-08T18:29:59.484 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_debug_dump_transactions": "false", 2024-05-08T18:29:59.484 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_debug_extra_checks": "false", 2024-05-08T18:29:59.484 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-05-08T18:29:59.484 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-05-08T18:29:59.484 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_debug_no_require_reef": "false", 2024-05-08T18:29:59.485 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_debug_no_require_squid": "false", 2024-05-08T18:29:59.485 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-05-08T18:29:59.485 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_delta_reset_interval": "10.000000", 2024-05-08T18:29:59.485 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_dns_srv_name": "ceph-mon", 2024-05-08T18:29:59.485 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_down_mkfs_grace": "120", 2024-05-08T18:29:59.485 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_down_uptime_grace": "60", 2024-05-08T18:29:59.485 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_election_default_strategy": "1", 2024-05-08T18:29:59.485 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_election_timeout": "5.000000", 2024-05-08T18:29:59.485 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-05-08T18:29:59.485 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_elector_ping_divisor": "2", 2024-05-08T18:29:59.485 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_elector_ping_timeout": "2.000000", 2024-05-08T18:29:59.485 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_enable_op_tracker": "true", 2024-05-08T18:29:59.485 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_fake_pool_delete": "false", 2024-05-08T18:29:59.486 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_force_quorum_join": "false", 2024-05-08T18:29:59.486 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_globalid_prealloc": "10000", 2024-05-08T18:29:59.486 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_health_detail_to_clog": "false", 2024-05-08T18:29:59.486 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_health_log_update_period": "5", 2024-05-08T18:29:59.486 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_health_max_detail": "50", 2024-05-08T18:29:59.486 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_health_to_clog": "true", 2024-05-08T18:29:59.486 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_health_to_clog_interval": "600", 2024-05-08T18:29:59.486 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-05-08T18:29:59.486 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_host": "172.21.15.97,[v2:172.21.15.97:3301,v1:172.21.15.97:6790],172.21.15.151", 2024-05-08T18:29:59.486 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_host_override": "", 2024-05-08T18:29:59.486 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_initial_members": "", 2024-05-08T18:29:59.486 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-05-08T18:29:59.486 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-05-08T18:29:59.487 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-05-08T18:29:59.487 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-05-08T18:29:59.487 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_keyvaluedb": "rocksdb", 2024-05-08T18:29:59.487 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_lease": "5.000000", 2024-05-08T18:29:59.487 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-05-08T18:29:59.487 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-05-08T18:29:59.487 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_log_full_interval": "50", 2024-05-08T18:29:59.487 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_log_max": "10000", 2024-05-08T18:29:59.487 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_log_max_summary": "50", 2024-05-08T18:29:59.487 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_max_log_entries_per_event": "4096", 2024-05-08T18:29:59.487 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_max_log_epochs": "500", 2024-05-08T18:29:59.487 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_max_mdsmap_epochs": "500", 2024-05-08T18:29:59.487 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_max_mgrmap_epochs": "500", 2024-05-08T18:29:59.488 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_max_osd": "10000", 2024-05-08T18:29:59.488 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_max_pg_per_osd": "10000", 2024-05-08T18:29:59.488 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_max_pool_pg_num": "65536", 2024-05-08T18:29:59.488 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-05-08T18:29:59.488 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-05-08T18:29:59.488 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_mds_force_trim_to": "0", 2024-05-08T18:29:59.488 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_mds_skip_sanity": "false", 2024-05-08T18:29:59.488 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_memory_autotune": "true", 2024-05-08T18:29:59.488 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_memory_target": "2147483648", 2024-05-08T18:29:59.488 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_mgr_beacon_grace": "30", 2024-05-08T18:29:59.488 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-05-08T18:29:59.488 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_mgr_digest_period": "5", 2024-05-08T18:29:59.488 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_mgr_inactive_grace": "60", 2024-05-08T18:29:59.488 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_mgr_mkfs_grace": "240", 2024-05-08T18:29:59.489 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-05-08T18:29:59.489 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_min_osdmap_epochs": "500", 2024-05-08T18:29:59.489 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_op_complaint_time": "30", 2024-05-08T18:29:59.489 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_op_history_duration": "600", 2024-05-08T18:29:59.489 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_op_history_size": "20", 2024-05-08T18:29:59.489 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_op_history_slow_op_size": "20", 2024-05-08T18:29:59.489 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_op_history_slow_op_threshold": "10", 2024-05-08T18:29:59.489 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_op_log_threshold": "5", 2024-05-08T18:29:59.489 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-05-08T18:29:59.489 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-05-08T18:29:59.489 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-05-08T18:29:59.489 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_osd_auto_mark_in": "false", 2024-05-08T18:29:59.489 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_osd_auto_mark_new_in": "true", 2024-05-08T18:29:59.490 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-05-08T18:29:59.490 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-05-08T18:29:59.490 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_osd_cache_size": "500", 2024-05-08T18:29:59.490 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_osd_cache_size_min": "134217728", 2024-05-08T18:29:59.490 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_osd_crush_smoke_test": "true", 2024-05-08T18:29:59.490 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_osd_destroyed_out_interval": "600", 2024-05-08T18:29:59.490 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_osd_down_out_interval": "600", 2024-05-08T18:29:59.490 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-05-08T18:29:59.490 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-05-08T18:29:59.490 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_osd_force_trim_to": "0", 2024-05-08T18:29:59.490 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_osd_full_ratio": "0.950000", 2024-05-08T18:29:59.490 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-05-08T18:29:59.490 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_osd_laggy_halflife": "3600", 2024-05-08T18:29:59.491 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_osd_laggy_max_interval": "300", 2024-05-08T18:29:59.491 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_osd_laggy_weight": "0.300000", 2024-05-08T18:29:59.491 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-05-08T18:29:59.491 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_osd_max_initial_pgs": "1024", 2024-05-08T18:29:59.491 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_osd_min_down_reporters": "2", 2024-05-08T18:29:59.491 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-05-08T18:29:59.491 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-05-08T18:29:59.491 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-05-08T18:29:59.491 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_osd_prime_pg_temp": "true", 2024-05-08T18:29:59.491 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-05-08T18:29:59.491 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-05-08T18:29:59.491 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_osd_report_timeout": "900", 2024-05-08T18:29:59.491 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-05-08T18:29:59.492 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-05-08T18:29:59.492 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_osd_warn_num_repaired": "10", 2024-05-08T18:29:59.492 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_osd_warn_op_age": "32.000000", 2024-05-08T18:29:59.492 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-05-08T18:29:59.492 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_osdmap_full_prune_interval": "10", 2024-05-08T18:29:59.492 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_osdmap_full_prune_min": "10000", 2024-05-08T18:29:59.492 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_osdmap_full_prune_txsize": "100", 2024-05-08T18:29:59.492 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-05-08T18:29:59.492 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_pg_stuck_threshold": "60", 2024-05-08T18:29:59.492 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-05-08T18:29:59.492 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_pg_warn_min_objects": "10000", 2024-05-08T18:29:59.492 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_pg_warn_min_per_osd": "0", 2024-05-08T18:29:59.492 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-05-08T18:29:59.492 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_pool_quota_crit_threshold": "0", 2024-05-08T18:29:59.493 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_pool_quota_warn_threshold": "0", 2024-05-08T18:29:59.493 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_probe_timeout": "2.000000", 2024-05-08T18:29:59.493 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_reweight_max_change": "0.050000", 2024-05-08T18:29:59.493 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_reweight_max_osds": "4", 2024-05-08T18:29:59.493 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-05-08T18:29:59.493 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-05-08T18:29:59.493 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-05-08T18:29:59.493 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-05-08T18:29:59.493 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-05-08T18:29:59.493 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_scrub_interval": "86400", 2024-05-08T18:29:59.493 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_scrub_max_keys": "100", 2024-05-08T18:29:59.493 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_scrub_timeout": "300", 2024-05-08T18:29:59.493 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_session_timeout": "300", 2024-05-08T18:29:59.494 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_smart_report_timeout": "5", 2024-05-08T18:29:59.494 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_stat_smooth_intervals": "6", 2024-05-08T18:29:59.494 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-05-08T18:29:59.494 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_stretch_pool_min_size": "2", 2024-05-08T18:29:59.494 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_stretch_pool_size": "4", 2024-05-08T18:29:59.494 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-05-08T18:29:59.494 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_subscribe_interval": "86400.000000", 2024-05-08T18:29:59.494 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_sync_debug": "false", 2024-05-08T18:29:59.494 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_sync_max_payload_keys": "2000", 2024-05-08T18:29:59.494 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_sync_max_payload_size": "1048576", 2024-05-08T18:29:59.494 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_sync_provider_kill_at": "0", 2024-05-08T18:29:59.494 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_sync_requester_kill_at": "0", 2024-05-08T18:29:59.494 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_sync_timeout": "60.000000", 2024-05-08T18:29:59.495 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_target_pg_per_osd": "100", 2024-05-08T18:29:59.495 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_tick_interval": "5", 2024-05-08T18:29:59.495 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_timecheck_interval": "300.000000", 2024-05-08T18:29:59.495 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-05-08T18:29:59.495 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_use_min_delay_socket": "false", 2024-05-08T18:29:59.495 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_warn_older_version_delay": "604800", 2024-05-08T18:29:59.495 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-05-08T18:29:59.495 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-05-08T18:29:59.495 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-05-08T18:29:59.495 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_warn_on_filestore_osds": "false", 2024-05-08T18:29:59.495 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-05-08T18:29:59.495 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-05-08T18:29:59.495 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-05-08T18:29:59.496 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_warn_on_misplaced": "false", 2024-05-08T18:29:59.496 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-05-08T18:29:59.496 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_warn_on_older_version": "true", 2024-05-08T18:29:59.496 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-05-08T18:29:59.496 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_warn_on_pool_no_app": "true", 2024-05-08T18:29:59.496 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-05-08T18:29:59.496 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-05-08T18:29:59.496 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-05-08T18:29:59.496 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-05-08T18:29:59.496 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_warn_on_too_few_osds": "false", 2024-05-08T18:29:59.496 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-05-08T18:29:59.496 INFO:teuthology.orchestra.run.smithi097.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-05-08T18:29:59.496 INFO:teuthology.orchestra.run.smithi097.stdout: "monmap": "", 2024-05-08T18:29:59.496 INFO:teuthology.orchestra.run.smithi097.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-05-08T18:29:59.497 INFO:teuthology.orchestra.run.smithi097.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-05-08T18:29:59.497 INFO:teuthology.orchestra.run.smithi097.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-05-08T18:29:59.497 INFO:teuthology.orchestra.run.smithi097.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-05-08T18:29:59.497 INFO:teuthology.orchestra.run.smithi097.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-05-08T18:29:59.497 INFO:teuthology.orchestra.run.smithi097.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-05-08T18:29:59.497 INFO:teuthology.orchestra.run.smithi097.stdout: "motr_tracing_enabled": "false", 2024-05-08T18:29:59.497 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_async_op_threads": "3", 2024-05-08T18:29:59.497 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_async_rdma_buffer_size": "131072", 2024-05-08T18:29:59.497 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_async_rdma_cm": "false", 2024-05-08T18:29:59.497 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_async_rdma_device_name": "", 2024-05-08T18:29:59.497 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_async_rdma_dscp": "96", 2024-05-08T18:29:59.497 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-05-08T18:29:59.497 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_async_rdma_gid_idx": "0", 2024-05-08T18:29:59.498 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_async_rdma_local_gid": "", 2024-05-08T18:29:59.498 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_async_rdma_polling_us": "1000", 2024-05-08T18:29:59.498 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_async_rdma_port_num": "1", 2024-05-08T18:29:59.498 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-05-08T18:29:59.498 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-05-08T18:29:59.498 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_async_rdma_roce_ver": "1", 2024-05-08T18:29:59.498 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_async_rdma_send_buffers": "1024", 2024-05-08T18:29:59.498 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_async_rdma_sl": "3", 2024-05-08T18:29:59.498 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_async_rdma_support_srq": "true", 2024-05-08T18:29:59.498 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_async_rdma_type": "ib", 2024-05-08T18:29:59.498 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_async_reap_threshold": "5", 2024-05-08T18:29:59.498 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_bind_before_connect": "false", 2024-05-08T18:29:59.499 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_bind_ipv4": "true", 2024-05-08T18:29:59.499 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_bind_ipv6": "false", 2024-05-08T18:29:59.499 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_bind_msgr1": "true", 2024-05-08T18:29:59.499 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_bind_msgr2": "true", 2024-05-08T18:29:59.499 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_bind_port_max": "7568", 2024-05-08T18:29:59.499 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_bind_port_min": "6800", 2024-05-08T18:29:59.499 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_bind_prefer_ipv4": "false", 2024-05-08T18:29:59.499 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_bind_retry_count": "3", 2024-05-08T18:29:59.499 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_bind_retry_delay": "5", 2024-05-08T18:29:59.499 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_blackhole_client": "false", 2024-05-08T18:29:59.499 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_blackhole_mds": "false", 2024-05-08T18:29:59.499 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_blackhole_mgr": "false", 2024-05-08T18:29:59.499 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_blackhole_mon": "false", 2024-05-08T18:29:59.500 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_blackhole_osd": "false", 2024-05-08T18:29:59.500 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_client_mode": "crc secure", 2024-05-08T18:29:59.500 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_cluster_mode": "crc secure", 2024-05-08T18:29:59.500 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_cluster_type": "", 2024-05-08T18:29:59.500 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_compress_secure": "false", 2024-05-08T18:29:59.500 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_connection_idle_timeout": "900", 2024-05-08T18:29:59.500 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_connection_ready_timeout": "10", 2024-05-08T18:29:59.500 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_crc_data": "true", 2024-05-08T18:29:59.500 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_crc_header": "true", 2024-05-08T18:29:59.500 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_die_on_bad_msg": "false", 2024-05-08T18:29:59.500 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_die_on_bug": "true", 2024-05-08T18:29:59.500 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_die_on_old_message": "true", 2024-05-08T18:29:59.500 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_die_on_skipped_message": "false", 2024-05-08T18:29:59.501 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_die_on_unhandled_msg": "false", 2024-05-08T18:29:59.501 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-05-08T18:29:59.501 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_dpdk_coremask": "0xF", 2024-05-08T18:29:59.501 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-05-08T18:29:59.501 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_dpdk_devs_allowlist": "", 2024-05-08T18:29:59.501 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_dpdk_enable_tso": "true", 2024-05-08T18:29:59.501 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-05-08T18:29:59.501 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-05-08T18:29:59.501 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_dpdk_hugepages": "", 2024-05-08T18:29:59.501 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_dpdk_hw_flow_control": "true", 2024-05-08T18:29:59.501 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-05-08T18:29:59.501 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_dpdk_lro": "true", 2024-05-08T18:29:59.501 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_dpdk_memory_channel": "4", 2024-05-08T18:29:59.501 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-05-08T18:29:59.502 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_dpdk_pmd": "", 2024-05-08T18:29:59.502 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_dpdk_port_id": "0", 2024-05-08T18:29:59.502 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-05-08T18:29:59.502 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_dump_corrupt_message_level": "1", 2024-05-08T18:29:59.502 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_dump_on_send": "false", 2024-05-08T18:29:59.502 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_initial_backoff": "0.200000", 2024-05-08T18:29:59.502 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_inject_delay_max": "1.000000", 2024-05-08T18:29:59.502 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_inject_delay_probability": "0.000000", 2024-05-08T18:29:59.502 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_inject_delay_type": "", 2024-05-08T18:29:59.502 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_inject_internal_delays": "0.000000", 2024-05-08T18:29:59.502 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_inject_network_congestion": "0", 2024-05-08T18:29:59.502 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_inject_socket_failures": "0", 2024-05-08T18:29:59.502 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_learn_addr_from_peer": "true", 2024-05-08T18:29:59.502 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_max_accept_failures": "4", 2024-05-08T18:29:59.503 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_max_backoff": "15.000000", 2024-05-08T18:29:59.503 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_mon_client_mode": "secure crc", 2024-05-08T18:29:59.503 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_mon_cluster_mode": "secure crc", 2024-05-08T18:29:59.503 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_mon_service_mode": "secure crc", 2024-05-08T18:29:59.503 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_osd_compress_min_size": "1024", 2024-05-08T18:29:59.503 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_osd_compress_mode": "none", 2024-05-08T18:29:59.503 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_osd_compression_algorithm": "snappy", 2024-05-08T18:29:59.503 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-05-08T18:29:59.503 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_pq_min_cost": "65536", 2024-05-08T18:29:59.503 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_public_type": "", 2024-05-08T18:29:59.503 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_service_mode": "crc secure", 2024-05-08T18:29:59.503 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_tcp_listen_backlog": "512", 2024-05-08T18:29:59.503 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_tcp_nodelay": "true", 2024-05-08T18:29:59.504 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-05-08T18:29:59.504 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_tcp_rcvbuf": "0", 2024-05-08T18:29:59.504 INFO:teuthology.orchestra.run.smithi097.stdout: "ms_type": "async+posix", 2024-05-08T18:29:59.504 INFO:teuthology.orchestra.run.smithi097.stdout: "no_config_file": "false", 2024-05-08T18:29:59.504 INFO:teuthology.orchestra.run.smithi097.stdout: "objecter_completion_locks_per_session": "32", 2024-05-08T18:29:59.504 INFO:teuthology.orchestra.run.smithi097.stdout: "objecter_debug_inject_relock_delay": "false", 2024-05-08T18:29:59.504 INFO:teuthology.orchestra.run.smithi097.stdout: "objecter_inflight_op_bytes": "104857600", 2024-05-08T18:29:59.504 INFO:teuthology.orchestra.run.smithi097.stdout: "objecter_inflight_ops": "1024", 2024-05-08T18:29:59.504 INFO:teuthology.orchestra.run.smithi097.stdout: "objecter_inject_no_watch_ping": "false", 2024-05-08T18:29:59.504 INFO:teuthology.orchestra.run.smithi097.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-05-08T18:29:59.504 INFO:teuthology.orchestra.run.smithi097.stdout: "objecter_tick_interval": "5.000000", 2024-05-08T18:29:59.504 INFO:teuthology.orchestra.run.smithi097.stdout: "objecter_timeout": "10.000000", 2024-05-08T18:29:59.504 INFO:teuthology.orchestra.run.smithi097.stdout: "objectstore_blackhole": "false", 2024-05-08T18:29:59.505 INFO:teuthology.orchestra.run.smithi097.stdout: "objectstore_debug_throw_on_failed_txc": "false", 2024-05-08T18:29:59.505 INFO:teuthology.orchestra.run.smithi097.stdout: "openssl_engine_opts": "", 2024-05-08T18:29:59.505 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_agent_delay_time": "5.000000", 2024-05-08T18:29:59.505 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_agent_hist_halflife": "1000", 2024-05-08T18:29:59.505 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_agent_max_low_ops": "2", 2024-05-08T18:29:59.505 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_agent_max_ops": "4", 2024-05-08T18:29:59.505 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-05-08T18:29:59.505 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_agent_quantize_effort": "0.100000", 2024-05-08T18:29:59.505 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_agent_slop": "0.020000", 2024-05-08T18:29:59.505 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-05-08T18:29:59.505 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_allow_recovery_below_min_size": "true", 2024-05-08T18:29:59.505 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_asio_thread_count": "2", 2024-05-08T18:29:59.505 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_async_recovery_min_cost": "100", 2024-05-08T18:29:59.505 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_auto_mark_unfound_lost": "false", 2024-05-08T18:29:59.506 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_backfill_retry_interval": "30.000000", 2024-05-08T18:29:59.506 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_backfill_scan_max": "512", 2024-05-08T18:29:59.506 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_backfill_scan_min": "64", 2024-05-08T18:29:59.506 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_backoff_on_degraded": "false", 2024-05-08T18:29:59.506 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_backoff_on_peering": "false", 2024-05-08T18:29:59.506 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_backoff_on_unfound": "true", 2024-05-08T18:29:59.506 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_beacon_report_interval": "300", 2024-05-08T18:29:59.506 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_bench_duration": "30", 2024-05-08T18:29:59.506 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-05-08T18:29:59.506 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_bench_max_block_size": "67108864", 2024-05-08T18:29:59.506 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_bench_small_size_max_iops": "100", 2024-05-08T18:29:59.506 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_blkin_trace_all": "false", 2024-05-08T18:29:59.506 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_blocked_scrub_grace_period": "120", 2024-05-08T18:29:59.507 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-05-08T18:29:59.507 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-05-08T18:29:59.507 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-05-08T18:29:59.507 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_check_for_log_corruption": "false", 2024-05-08T18:29:59.507 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-05-08T18:29:59.507 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-05-08T18:29:59.507 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_class_dir": "/usr/lib/rados-classes", 2024-05-08T18:29:59.507 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-05-08T18:29:59.507 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_class_update_on_start": "true", 2024-05-08T18:29:59.507 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_client_message_cap": "256", 2024-05-08T18:29:59.507 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_client_message_size_cap": "524288000", 2024-05-08T18:29:59.507 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_client_op_priority": "63", 2024-05-08T18:29:59.507 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_client_watch_timeout": "30", 2024-05-08T18:29:59.508 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_command_max_records": "256", 2024-05-08T18:29:59.508 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_compact_on_start": "false", 2024-05-08T18:29:59.508 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-05-08T18:29:59.508 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_crush_chooseleaf_type": "0", 2024-05-08T18:29:59.508 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_crush_initial_weight": "-1.000000", 2024-05-08T18:29:59.508 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_crush_update_on_start": "true", 2024-05-08T18:29:59.508 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_crush_update_weight_set": "true", 2024-05-08T18:29:59.508 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-05-08T18:29:59.508 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-05-08T18:29:59.508 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-05-08T18:29:59.508 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_debug_drop_ping_duration": "0", 2024-05-08T18:29:59.508 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-05-08T18:29:59.508 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_debug_feed_pullee": "-1", 2024-05-08T18:29:59.508 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-05-08T18:29:59.509 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-05-08T18:29:59.509 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-05-08T18:29:59.509 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_debug_misdirected_ops": "false", 2024-05-08T18:29:59.509 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_debug_no_acting_change": "false", 2024-05-08T18:29:59.509 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_debug_no_purge_strays": "false", 2024-05-08T18:29:59.509 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_debug_op_order": "false", 2024-05-08T18:29:59.509 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_debug_pg_log_writeout": "false", 2024-05-08T18:29:59.509 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_debug_pretend_recovery_active": "false", 2024-05-08T18:29:59.509 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-05-08T18:29:59.509 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-05-08T18:29:59.509 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_debug_shutdown": "false", 2024-05-08T18:29:59.509 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-05-08T18:29:59.509 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-05-08T18:29:59.510 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_debug_trim_objects": "false", 2024-05-08T18:29:59.510 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_debug_verify_cached_snaps": "false", 2024-05-08T18:29:59.510 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_debug_verify_missing_on_start": "false", 2024-05-08T18:29:59.510 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_debug_verify_snaps": "false", 2024-05-08T18:29:59.510 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-05-08T18:29:59.510 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-05-08T18:29:59.510 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_deep_scrub_keys": "1024", 2024-05-08T18:29:59.510 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-05-08T18:29:59.510 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-05-08T18:29:59.510 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-05-08T18:29:59.510 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_deep_scrub_stride": "524288", 2024-05-08T18:29:59.510 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-05-08T18:29:59.511 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_default_data_pool_replay_window": "5", 2024-05-08T18:29:59.511 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_default_notify_timeout": "30", 2024-05-08T18:29:59.511 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_delete_sleep": "0.000000", 2024-05-08T18:29:59.511 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-05-08T18:29:59.511 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-05-08T18:29:59.511 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-05-08T18:29:59.511 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_discard_disconnected_ops": "true", 2024-05-08T18:29:59.511 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_enable_op_tracker": "true", 2024-05-08T18:29:59.511 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-05-08T18:29:59.511 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_extblkdev_plugins": "vdo", 2024-05-08T18:29:59.511 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-05-08T18:29:59.511 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-05-08T18:29:59.511 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_fast_info": "true", 2024-05-08T18:29:59.512 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_fast_shutdown": "true", 2024-05-08T18:29:59.512 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-05-08T18:29:59.512 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_fast_shutdown_timeout": "15", 2024-05-08T18:29:59.512 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-05-08T18:29:59.512 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-05-08T18:29:59.512 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-05-08T18:29:59.512 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_function_tracing": "false", 2024-05-08T18:29:59.512 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_heartbeat_grace": "20", 2024-05-08T18:29:59.512 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_heartbeat_interval": "6", 2024-05-08T18:29:59.512 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-05-08T18:29:59.512 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_heartbeat_min_peers": "10", 2024-05-08T18:29:59.512 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_heartbeat_min_size": "2000", 2024-05-08T18:29:59.512 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_heartbeat_stale": "600", 2024-05-08T18:29:59.512 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-05-08T18:29:59.513 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_hit_set_max_size": "100000", 2024-05-08T18:29:59.513 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_hit_set_min_size": "1000", 2024-05-08T18:29:59.513 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-05-08T18:29:59.513 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-05-08T18:29:59.513 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-05-08T18:29:59.513 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-05-08T18:29:59.513 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-05-08T18:29:59.513 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_journal_flush_on_shutdown": "true", 2024-05-08T18:29:59.513 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_journal_size": "5120", 2024-05-08T18:29:59.513 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_kill_backfill_at": "0", 2024-05-08T18:29:59.513 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_loop_before_reset_tphandle": "64", 2024-05-08T18:29:59.513 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_map_cache_size": "50", 2024-05-08T18:29:59.513 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_map_dedup": "true", 2024-05-08T18:29:59.513 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_map_message_max": "40", 2024-05-08T18:29:59.514 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_map_message_max_bytes": "10485760", 2024-05-08T18:29:59.514 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_map_share_max_epochs": "40", 2024-05-08T18:29:59.514 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_max_attr_name_len": "100", 2024-05-08T18:29:59.514 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_max_attr_size": "0", 2024-05-08T18:29:59.514 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_max_backfills": "1", 2024-05-08T18:29:59.514 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_max_markdown_count": "5", 2024-05-08T18:29:59.514 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_max_markdown_period": "600", 2024-05-08T18:29:59.514 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_max_object_name_len": "2048", 2024-05-08T18:29:59.514 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_max_object_namespace_len": "256", 2024-05-08T18:29:59.514 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_max_object_size": "134217728", 2024-05-08T18:29:59.514 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-05-08T18:29:59.514 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_max_omap_entries_per_request": "1024", 2024-05-08T18:29:59.515 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_max_pg_blocked_by": "16", 2024-05-08T18:29:59.515 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_max_pg_log_entries": "10000", 2024-05-08T18:29:59.515 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-05-08T18:29:59.515 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_max_pgls": "1024", 2024-05-08T18:29:59.515 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_max_push_cost": "8388608", 2024-05-08T18:29:59.515 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_max_push_objects": "10", 2024-05-08T18:29:59.515 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_max_scrubs": "3", 2024-05-08T18:29:59.515 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-05-08T18:29:59.515 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_max_trimming_pgs": "2", 2024-05-08T18:29:59.515 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_max_write_op_reply_len": "64", 2024-05-08T18:29:59.515 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_max_write_size": "90", 2024-05-08T18:29:59.515 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-05-08T18:29:59.515 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-05-08T18:29:59.515 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-05-08T18:29:59.516 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-05-08T18:29:59.516 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-05-08T18:29:59.516 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-05-08T18:29:59.516 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-05-08T18:29:59.516 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_mclock_override_recovery_settings": "false", 2024-05-08T18:29:59.516 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_mclock_profile": "balanced", 2024-05-08T18:29:59.516 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-05-08T18:29:59.516 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-05-08T18:29:59.516 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-05-08T18:29:59.516 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-05-08T18:29:59.516 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-05-08T18:29:59.516 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-05-08T18:29:59.516 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-05-08T18:29:59.516 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-05-08T18:29:59.517 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-05-08T18:29:59.517 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-05-08T18:29:59.517 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_mclock_skip_benchmark": "false", 2024-05-08T18:29:59.517 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_memory_base": "805306368", 2024-05-08T18:29:59.517 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_memory_cache_min": "134217728", 2024-05-08T18:29:59.517 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-05-08T18:29:59.517 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-05-08T18:29:59.517 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_memory_target": "4294967296", 2024-05-08T18:29:59.517 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_memory_target_autotune": "false", 2024-05-08T18:29:59.517 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-05-08T18:29:59.517 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_min_pg_log_entries": "250", 2024-05-08T18:29:59.517 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_min_recovery_priority": "0", 2024-05-08T18:29:59.517 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_mon_heartbeat_interval": "30", 2024-05-08T18:29:59.518 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-05-08T18:29:59.518 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_mon_report_interval": "5", 2024-05-08T18:29:59.518 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_mon_report_max_in_flight": "2", 2024-05-08T18:29:59.518 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-05-08T18:29:59.518 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_num_cache_shards": "32", 2024-05-08T18:29:59.518 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_num_op_tracker_shard": "32", 2024-05-08T18:29:59.518 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_numa_auto_affinity": "true", 2024-05-08T18:29:59.518 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_numa_node": "-1", 2024-05-08T18:29:59.518 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_numa_prefer_iface": "true", 2024-05-08T18:29:59.518 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-05-08T18:29:59.518 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_objecter_finishers": "1", 2024-05-08T18:29:59.519 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_objectstore": "bluestore", 2024-05-08T18:29:59.519 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_objectstore_fuse": "false", 2024-05-08T18:29:59.519 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_objectstore_tracing": "false", 2024-05-08T18:29:59.519 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_op_complaint_time": "30.000000", 2024-05-08T18:29:59.519 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_op_history_duration": "600", 2024-05-08T18:29:59.519 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_op_history_size": "20", 2024-05-08T18:29:59.519 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_op_history_slow_op_size": "20", 2024-05-08T18:29:59.519 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-05-08T18:29:59.519 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_op_log_threshold": "5", 2024-05-08T18:29:59.519 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_op_num_shards": "0", 2024-05-08T18:29:59.519 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_op_num_shards_hdd": "5", 2024-05-08T18:29:59.519 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_op_num_shards_ssd": "8", 2024-05-08T18:29:59.519 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_op_num_threads_per_shard": "0", 2024-05-08T18:29:59.519 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-05-08T18:29:59.519 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-05-08T18:29:59.520 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-05-08T18:29:59.520 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_op_pq_min_cost": "65536", 2024-05-08T18:29:59.520 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_op_queue": "mclock_scheduler", 2024-05-08T18:29:59.520 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_op_queue_cut_off": "high", 2024-05-08T18:29:59.520 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_op_thread_suicide_timeout": "150", 2024-05-08T18:29:59.520 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_op_thread_timeout": "15", 2024-05-08T18:29:59.520 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_open_classes_on_start": "true", 2024-05-08T18:29:59.520 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_os_flags": "0", 2024-05-08T18:29:59.520 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_peering_op_priority": "255", 2024-05-08T18:29:59.520 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_pg_delete_cost": "1048576", 2024-05-08T18:29:59.520 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_pg_delete_priority": "5", 2024-05-08T18:29:59.520 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-05-08T18:29:59.520 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-05-08T18:29:59.520 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_pg_log_dups_tracked": "3000", 2024-05-08T18:29:59.521 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_pg_log_trim_max": "10000", 2024-05-08T18:29:59.521 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_pg_log_trim_min": "100", 2024-05-08T18:29:59.521 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-05-08T18:29:59.521 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_pg_object_context_cache_count": "64", 2024-05-08T18:29:59.521 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_pg_stat_report_interval_max_epochs": "500", 2024-05-08T18:29:59.521 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_pg_stat_report_interval_max_seconds": "5", 2024-05-08T18:29:59.521 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-05-08T18:29:59.521 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-05-08T18:29:59.521 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-05-08T18:29:59.521 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-05-08T18:29:59.521 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-05-08T18:29:59.521 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-05-08T18:29:59.521 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_pool_default_crimson": "false", 2024-05-08T18:29:59.522 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_pool_default_crush_rule": "-1", 2024-05-08T18:29:59.522 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_pool_default_ec_fast_read": "false", 2024-05-08T18:29:59.522 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-05-08T18:29:59.522 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_pool_default_flag_bulk": "false", 2024-05-08T18:29:59.522 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-05-08T18:29:59.522 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_pool_default_flag_nodelete": "false", 2024-05-08T18:29:59.522 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-05-08T18:29:59.522 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-05-08T18:29:59.522 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_pool_default_flags": "0", 2024-05-08T18:29:59.522 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-05-08T18:29:59.522 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_pool_default_min_size": "0", 2024-05-08T18:29:59.522 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-05-08T18:29:59.523 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_pool_default_pg_num": "32", 2024-05-08T18:29:59.523 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_pool_default_pgp_num": "0", 2024-05-08T18:29:59.523 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-05-08T18:29:59.523 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_pool_default_read_ratio": "70", 2024-05-08T18:29:59.523 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_pool_default_size": "2", 2024-05-08T18:29:59.523 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_pool_default_type": "replicated", 2024-05-08T18:29:59.523 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-05-08T18:29:59.523 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_pool_use_gmt_hitset": "true", 2024-05-08T18:29:59.523 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_push_per_object_cost": "1000", 2024-05-08T18:29:59.523 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_read_ec_check_for_errors": "false", 2024-05-08T18:29:59.523 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_recover_clone_overlap": "true", 2024-05-08T18:29:59.523 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_recover_clone_overlap_limit": "10", 2024-05-08T18:29:59.523 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_recovery_cost": "20971520", 2024-05-08T18:29:59.523 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_recovery_delay_start": "0.000000", 2024-05-08T18:29:59.524 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_recovery_max_active": "0", 2024-05-08T18:29:59.524 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_recovery_max_active_hdd": "3", 2024-05-08T18:29:59.524 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_recovery_max_active_ssd": "10", 2024-05-08T18:29:59.524 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_recovery_max_chunk": "8388608", 2024-05-08T18:29:59.524 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-05-08T18:29:59.524 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_recovery_max_single_start": "1", 2024-05-08T18:29:59.524 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_recovery_op_priority": "3", 2024-05-08T18:29:59.524 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_recovery_op_warn_multiple": "16", 2024-05-08T18:29:59.524 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_recovery_priority": "5", 2024-05-08T18:29:59.524 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_recovery_retry_interval": "30.000000", 2024-05-08T18:29:59.524 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_recovery_sleep": "0.000000", 2024-05-08T18:29:59.524 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-05-08T18:29:59.524 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-05-08T18:29:59.525 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-05-08T18:29:59.525 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_repair_during_recovery": "false", 2024-05-08T18:29:59.525 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_requested_scrub_priority": "120", 2024-05-08T18:29:59.525 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-05-08T18:29:59.525 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_rollback_to_cluster_snap": "", 2024-05-08T18:29:59.525 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_scrub_auto_repair": "false", 2024-05-08T18:29:59.525 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-05-08T18:29:59.525 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-05-08T18:29:59.525 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_scrub_begin_hour": "0", 2024-05-08T18:29:59.525 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_scrub_begin_week_day": "0", 2024-05-08T18:29:59.525 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_scrub_chunk_max": "25", 2024-05-08T18:29:59.525 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_scrub_chunk_min": "5", 2024-05-08T18:29:59.525 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_scrub_cost": "52428800", 2024-05-08T18:29:59.526 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_scrub_disable_reservation_queuing": "false", 2024-05-08T18:29:59.526 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_scrub_during_recovery": "false", 2024-05-08T18:29:59.526 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_scrub_end_hour": "0", 2024-05-08T18:29:59.526 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_scrub_end_week_day": "0", 2024-05-08T18:29:59.526 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_scrub_event_cost": "4096", 2024-05-08T18:29:59.526 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-05-08T18:29:59.526 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-05-08T18:29:59.526 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_scrub_invalid_stats": "true", 2024-05-08T18:29:59.526 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_scrub_load_threshold": "0.500000", 2024-05-08T18:29:59.526 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_scrub_max_interval": "604800.000000", 2024-05-08T18:29:59.526 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_scrub_max_preemptions": "5", 2024-05-08T18:29:59.526 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_scrub_min_interval": "86400.000000", 2024-05-08T18:29:59.526 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_scrub_priority": "5", 2024-05-08T18:29:59.527 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_scrub_reservation_timeout": "300000", 2024-05-08T18:29:59.527 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_scrub_sleep": "0.000000", 2024-05-08T18:29:59.527 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-05-08T18:29:59.527 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-05-08T18:29:59.527 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_shutdown_pgref_assert": "false", 2024-05-08T18:29:59.527 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_skip_check_past_interval_bounds": "false", 2024-05-08T18:29:59.527 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_skip_data_digest": "false", 2024-05-08T18:29:59.527 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_smart_report_timeout": "5", 2024-05-08T18:29:59.527 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_snap_trim_cost": "1048576", 2024-05-08T18:29:59.527 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_snap_trim_priority": "5", 2024-05-08T18:29:59.527 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_snap_trim_sleep": "0.000000", 2024-05-08T18:29:59.528 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-05-08T18:29:59.528 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-05-08T18:29:59.528 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-05-08T18:29:59.528 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-05-08T18:29:59.528 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_stats_update_period_scrubbing": "15", 2024-05-08T18:29:59.528 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-05-08T18:29:59.528 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_target_transaction_size": "30", 2024-05-08T18:29:59.528 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-05-08T18:29:59.528 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-05-08T18:29:59.528 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-05-08T18:29:59.528 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-05-08T18:29:59.528 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-05-08T18:29:59.528 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-05-08T18:29:59.529 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-05-08T18:29:59.529 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_tier_default_cache_mode": "writeback", 2024-05-08T18:29:59.529 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-05-08T18:29:59.529 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-05-08T18:29:59.529 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_tracing": "false", 2024-05-08T18:29:59.529 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_use_stale_snap": "false", 2024-05-08T18:29:59.529 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-05-08T18:29:59.529 INFO:teuthology.orchestra.run.smithi097.stdout: "osdc_blkin_trace_all": "false", 2024-05-08T18:29:59.529 INFO:teuthology.orchestra.run.smithi097.stdout: "paxos_kill_at": "0", 2024-05-08T18:29:59.529 INFO:teuthology.orchestra.run.smithi097.stdout: "paxos_max_join_drift": "10", 2024-05-08T18:29:59.529 INFO:teuthology.orchestra.run.smithi097.stdout: "paxos_min": "500", 2024-05-08T18:29:59.529 INFO:teuthology.orchestra.run.smithi097.stdout: "paxos_min_wait": "0.050000", 2024-05-08T18:29:59.530 INFO:teuthology.orchestra.run.smithi097.stdout: "paxos_propose_interval": "1.000000", 2024-05-08T18:29:59.530 INFO:teuthology.orchestra.run.smithi097.stdout: "paxos_service_trim_max": "500", 2024-05-08T18:29:59.530 INFO:teuthology.orchestra.run.smithi097.stdout: "paxos_service_trim_max_multiplier": "20", 2024-05-08T18:29:59.530 INFO:teuthology.orchestra.run.smithi097.stdout: "paxos_service_trim_min": "250", 2024-05-08T18:29:59.530 INFO:teuthology.orchestra.run.smithi097.stdout: "paxos_stash_full_interval": "25", 2024-05-08T18:29:59.530 INFO:teuthology.orchestra.run.smithi097.stdout: "paxos_trim_max": "500", 2024-05-08T18:29:59.530 INFO:teuthology.orchestra.run.smithi097.stdout: "paxos_trim_min": "250", 2024-05-08T18:29:59.530 INFO:teuthology.orchestra.run.smithi097.stdout: "perf": "true", 2024-05-08T18:29:59.530 INFO:teuthology.orchestra.run.smithi097.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-05-08T18:29:59.530 INFO:teuthology.orchestra.run.smithi097.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-05-08T18:29:59.530 INFO:teuthology.orchestra.run.smithi097.stdout: "plugin_dir": "/usr/lib/ceph", 2024-05-08T18:29:59.530 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "-", 2024-05-08T18:29:59.531 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrv": "", 2024-05-08T18:29:59.531 INFO:teuthology.orchestra.run.smithi097.stdout: "public_bind_addr": "-", 2024-05-08T18:29:59.531 INFO:teuthology.orchestra.run.smithi097.stdout: "public_network": "", 2024-05-08T18:29:59.531 INFO:teuthology.orchestra.run.smithi097.stdout: "public_network_interface": "", 2024-05-08T18:29:59.531 INFO:teuthology.orchestra.run.smithi097.stdout: "qat_compressor_enabled": "false", 2024-05-08T18:29:59.531 INFO:teuthology.orchestra.run.smithi097.stdout: "qat_compressor_session_max_number": "256", 2024-05-08T18:29:59.531 INFO:teuthology.orchestra.run.smithi097.stdout: "rados_mon_op_timeout": "0", 2024-05-08T18:29:59.531 INFO:teuthology.orchestra.run.smithi097.stdout: "rados_osd_op_timeout": "0", 2024-05-08T18:29:59.531 INFO:teuthology.orchestra.run.smithi097.stdout: "rados_tracing": "false", 2024-05-08T18:29:59.531 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_atime_update_interval": "60", 2024-05-08T18:29:59.531 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-05-08T18:29:59.531 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_balance_parent_reads": "false", 2024-05-08T18:29:59.531 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_balance_snap_reads": "false", 2024-05-08T18:29:59.532 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_blkin_trace_all": "false", 2024-05-08T18:29:59.532 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_blocklist_expire_seconds": "0", 2024-05-08T18:29:59.532 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_blocklist_on_break_lock": "true", 2024-05-08T18:29:59.532 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_cache": "true", 2024-05-08T18:29:59.532 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_cache_block_writes_upfront": "false", 2024-05-08T18:29:59.532 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_cache_max_dirty": "25165824", 2024-05-08T18:29:59.532 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-05-08T18:29:59.532 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_cache_max_dirty_object": "0", 2024-05-08T18:29:59.532 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_cache_policy": "writearound", 2024-05-08T18:29:59.532 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_cache_size": "33554432", 2024-05-08T18:29:59.532 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_cache_target_dirty": "16777216", 2024-05-08T18:29:59.532 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-05-08T18:29:59.532 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_clone_copy_on_read": "false", 2024-05-08T18:29:59.532 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_compression_hint": "none", 2024-05-08T18:29:59.533 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_concurrent_management_ops": "10", 2024-05-08T18:29:59.533 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-05-08T18:29:59.533 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_default_clone_format": "auto", 2024-05-08T18:29:59.533 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_default_data_pool": "", 2024-05-08T18:29:59.533 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_default_features": "61", 2024-05-08T18:29:59.533 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_default_format": "2", 2024-05-08T18:29:59.533 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_default_map_options": "", 2024-05-08T18:29:59.533 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_default_order": "22", 2024-05-08T18:29:59.533 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_default_pool": "rbd", 2024-05-08T18:29:59.533 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-05-08T18:29:59.533 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_default_stripe_count": "0", 2024-05-08T18:29:59.533 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_default_stripe_unit": "0", 2024-05-08T18:29:59.533 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_disable_zero_copy_writes": "true", 2024-05-08T18:29:59.534 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_discard_granularity_bytes": "65536", 2024-05-08T18:29:59.534 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-05-08T18:29:59.534 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_enable_alloc_hint": "true", 2024-05-08T18:29:59.534 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-05-08T18:29:59.534 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_io_scheduler": "simple", 2024-05-08T18:29:59.534 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-05-08T18:29:59.534 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_journal_commit_age": "5.000000", 2024-05-08T18:29:59.534 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-05-08T18:29:59.534 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-05-08T18:29:59.534 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-05-08T18:29:59.534 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-05-08T18:29:59.534 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_journal_object_flush_interval": "0", 2024-05-08T18:29:59.535 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-05-08T18:29:59.535 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-05-08T18:29:59.535 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_journal_order": "24", 2024-05-08T18:29:59.535 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_journal_pool": "", 2024-05-08T18:29:59.535 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_journal_splay_width": "4", 2024-05-08T18:29:59.535 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_localize_parent_reads": "false", 2024-05-08T18:29:59.535 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_localize_snap_reads": "false", 2024-05-08T18:29:59.535 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-05-08T18:29:59.535 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-05-08T18:29:59.535 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-05-08T18:29:59.535 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-05-08T18:29:59.535 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-05-08T18:29:59.535 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-05-08T18:29:59.535 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_mirror_image_policy_type": "simple", 2024-05-08T18:29:59.536 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-05-08T18:29:59.536 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-05-08T18:29:59.536 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-05-08T18:29:59.536 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-05-08T18:29:59.536 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-05-08T18:29:59.536 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-05-08T18:29:59.536 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-05-08T18:29:59.536 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_mirror_memory_autotune": "true", 2024-05-08T18:29:59.536 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_mirror_memory_base": "805306368", 2024-05-08T18:29:59.536 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-05-08T18:29:59.536 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-05-08T18:29:59.536 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-05-08T18:29:59.536 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-05-08T18:29:59.536 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_mirror_memory_target": "4294967296", 2024-05-08T18:29:59.537 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-05-08T18:29:59.537 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-05-08T18:29:59.537 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-05-08T18:29:59.537 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_mirroring_delete_delay": "0", 2024-05-08T18:29:59.537 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-05-08T18:29:59.537 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_mirroring_replay_delay": "0", 2024-05-08T18:29:59.537 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-05-08T18:29:59.537 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-05-08T18:29:59.537 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_move_to_trash_on_remove": "false", 2024-05-08T18:29:59.537 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-05-08T18:29:59.537 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_mtime_update_interval": "60", 2024-05-08T18:29:59.538 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_non_blocking_aio": "true", 2024-05-08T18:29:59.538 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_op_thread_timeout": "60", 2024-05-08T18:29:59.538 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_op_threads": "1", 2024-05-08T18:29:59.538 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_parent_cache_enabled": "false", 2024-05-08T18:29:59.538 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_persistent_cache_mode": "disabled", 2024-05-08T18:29:59.538 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_persistent_cache_path": "/tmp", 2024-05-08T18:29:59.538 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_persistent_cache_size": "1073741824", 2024-05-08T18:29:59.538 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_plugins": "", 2024-05-08T18:29:59.538 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_qos_bps_burst": "0", 2024-05-08T18:29:59.538 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-05-08T18:29:59.538 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_qos_bps_limit": "0", 2024-05-08T18:29:59.538 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_qos_exclude_ops": "0", 2024-05-08T18:29:59.538 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_qos_iops_burst": "0", 2024-05-08T18:29:59.539 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-05-08T18:29:59.539 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_qos_iops_limit": "0", 2024-05-08T18:29:59.539 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_qos_read_bps_burst": "0", 2024-05-08T18:29:59.539 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-05-08T18:29:59.539 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_qos_read_bps_limit": "0", 2024-05-08T18:29:59.539 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_qos_read_iops_burst": "0", 2024-05-08T18:29:59.539 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-05-08T18:29:59.539 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_qos_read_iops_limit": "0", 2024-05-08T18:29:59.539 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_qos_schedule_tick_min": "50", 2024-05-08T18:29:59.539 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_qos_write_bps_burst": "0", 2024-05-08T18:29:59.539 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-05-08T18:29:59.539 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_qos_write_bps_limit": "0", 2024-05-08T18:29:59.539 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_qos_write_iops_burst": "0", 2024-05-08T18:29:59.539 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-05-08T18:29:59.539 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_qos_write_iops_limit": "0", 2024-05-08T18:29:59.540 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_quiesce_notification_attempts": "10", 2024-05-08T18:29:59.540 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_read_from_replica_policy": "default", 2024-05-08T18:29:59.540 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-05-08T18:29:59.540 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_readahead_max_bytes": "524288", 2024-05-08T18:29:59.540 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_readahead_trigger_requests": "10", 2024-05-08T18:29:59.540 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_request_timed_out_seconds": "30", 2024-05-08T18:29:59.540 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_skip_partial_discard": "true", 2024-05-08T18:29:59.540 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-05-08T18:29:59.540 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_tracing": "false", 2024-05-08T18:29:59.540 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_validate_names": "true", 2024-05-08T18:29:59.540 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd_validate_pool": "true", 2024-05-08T18:29:59.540 INFO:teuthology.orchestra.run.smithi097.stdout: "restapi_base_url": "", 2024-05-08T18:29:59.540 INFO:teuthology.orchestra.run.smithi097.stdout: "restapi_log_level": "", 2024-05-08T18:29:59.541 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_account_default_quota_max_objects": "-1", 2024-05-08T18:29:59.541 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_account_default_quota_max_size": "-1", 2024-05-08T18:29:59.541 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_acl_grants_max_num": "100", 2024-05-08T18:29:59.541 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_admin_entry": "admin", 2024-05-08T18:29:59.541 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-05-08T18:29:59.541 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_backend_store": "rados", 2024-05-08T18:29:59.541 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_barbican_url": "", 2024-05-08T18:29:59.541 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_beast_enable_async": "true", 2024-05-08T18:29:59.541 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_bucket_counters_cache": "false", 2024-05-08T18:29:59.541 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_bucket_counters_cache_size": "10000", 2024-05-08T18:29:59.541 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-05-08T18:29:59.541 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-05-08T18:29:59.541 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_bucket_index_max_aio": "128", 2024-05-08T18:29:59.542 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-05-08T18:29:59.542 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-05-08T18:29:59.542 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_bucket_quota_ttl": "600", 2024-05-08T18:29:59.542 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-05-08T18:29:59.542 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_cache_enabled": "true", 2024-05-08T18:29:59.542 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_cache_expiry_interval": "900", 2024-05-08T18:29:59.542 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_cache_lru_size": "25000", 2024-05-08T18:29:59.542 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_config_store": "rados", 2024-05-08T18:29:59.542 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_content_length_compat": "false", 2024-05-08T18:29:59.542 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_copy_obj_progress": "true", 2024-05-08T18:29:59.542 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-05-08T18:29:59.542 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_cors_rules_max_num": "100", 2024-05-08T18:29:59.542 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_cross_domain_policy": "", 2024-05-08T18:29:59.543 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_crypt_default_encryption_key": "", 2024-05-08T18:29:59.543 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_crypt_kmip_addr": "", 2024-05-08T18:29:59.543 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_crypt_kmip_ca_path": "", 2024-05-08T18:29:59.543 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_crypt_kmip_client_cert": "", 2024-05-08T18:29:59.543 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_crypt_kmip_client_key": "", 2024-05-08T18:29:59.543 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-05-08T18:29:59.543 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_crypt_kmip_password": "", 2024-05-08T18:29:59.543 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-05-08T18:29:59.543 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_crypt_kmip_username": "", 2024-05-08T18:29:59.543 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_crypt_require_ssl": "true", 2024-05-08T18:29:59.543 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-05-08T18:29:59.543 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-05-08T18:29:59.543 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-05-08T18:29:59.544 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-05-08T18:29:59.544 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-05-08T18:29:59.544 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-05-08T18:29:59.544 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-05-08T18:29:59.544 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-05-08T18:29:59.544 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-05-08T18:29:59.544 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-05-08T18:29:59.544 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-05-08T18:29:59.544 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-05-08T18:29:59.544 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-05-08T18:29:59.544 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-05-08T18:29:59.544 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_crypt_suppress_logs": "true", 2024-05-08T18:29:59.544 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_crypt_vault_addr": "", 2024-05-08T18:29:59.544 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_crypt_vault_auth": "token", 2024-05-08T18:29:59.545 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_crypt_vault_namespace": "", 2024-05-08T18:29:59.545 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_crypt_vault_prefix": "", 2024-05-08T18:29:59.545 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-05-08T18:29:59.545 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-05-08T18:29:59.545 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-05-08T18:29:59.545 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-05-08T18:29:59.545 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_crypt_vault_token_file": "", 2024-05-08T18:29:59.545 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-05-08T18:29:59.545 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_curl_buffersize": "524288", 2024-05-08T18:29:59.545 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_curl_low_speed_limit": "1024", 2024-05-08T18:29:59.545 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_curl_low_speed_time": "300", 2024-05-08T18:29:59.545 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_curl_tcp_keepalive": "0", 2024-05-08T18:29:59.545 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-05-08T18:29:59.546 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-05-08T18:29:59.546 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-05-08T18:29:59.546 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-05-08T18:29:59.546 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-05-08T18:29:59.546 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_d3n_l1_fadvise": "4", 2024-05-08T18:29:59.546 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-05-08T18:29:59.546 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-05-08T18:29:59.546 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-05-08T18:29:59.546 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_d4n_host": "127.0.0.1", 2024-05-08T18:29:59.546 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_d4n_l1_datacache_persistent_path": "/tmp/rgw_d4n_datacache/", 2024-05-08T18:29:59.546 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_d4n_l1_datacache_size": "1073741824", 2024-05-08T18:29:59.546 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_d4n_l1_evict_cache_on_start": "true", 2024-05-08T18:29:59.546 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_d4n_l1_fadvise": "4", 2024-05-08T18:29:59.546 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_d4n_libaio_aio_num": "64", 2024-05-08T18:29:59.547 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_d4n_libaio_aio_threads": "20", 2024-05-08T18:29:59.547 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_d4n_port": "6379", 2024-05-08T18:29:59.547 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-05-08T18:29:59.547 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_data_log_changes_size": "1000", 2024-05-08T18:29:59.547 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_data_log_num_shards": "128", 2024-05-08T18:29:59.547 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-05-08T18:29:59.547 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_data_log_window": "30", 2024-05-08T18:29:59.547 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_data_notify_interval_msec": "0", 2024-05-08T18:29:59.547 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_data_sync_poll_interval": "20", 2024-05-08T18:29:59.547 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_data_sync_spawn_window": "20", 2024-05-08T18:29:59.547 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_debug_inject_latency_bi_unlink": "0", 2024-05-08T18:29:59.547 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-05-08T18:29:59.547 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-05-08T18:29:59.548 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_default_data_log_backing": "fifo", 2024-05-08T18:29:59.548 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-05-08T18:29:59.548 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_default_region_info_oid": "default.region", 2024-05-08T18:29:59.548 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-05-08T18:29:59.548 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-05-08T18:29:59.548 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_defer_to_bucket_acls": "", 2024-05-08T18:29:59.548 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-05-08T18:29:59.548 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-05-08T18:29:59.548 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-05-08T18:29:59.548 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-05-08T18:29:59.548 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-05-08T18:29:59.548 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-05-08T18:29:59.548 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-05-08T18:29:59.548 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-05-08T18:29:59.549 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_dmclock_data_res": "500.000000", 2024-05-08T18:29:59.549 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-05-08T18:29:59.549 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-05-08T18:29:59.549 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-05-08T18:29:59.549 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-05-08T18:29:59.549 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_dns_name": "", 2024-05-08T18:29:59.549 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_dns_s3website_name": "", 2024-05-08T18:29:59.549 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_dynamic_resharding": "true", 2024-05-08T18:29:59.549 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-05-08T18:29:59.549 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_enable_gc_threads": "true", 2024-05-08T18:29:59.549 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_enable_lc_threads": "true", 2024-05-08T18:29:59.549 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_enable_mdsearch": "true", 2024-05-08T18:29:59.549 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_enable_ops_log": "false", 2024-05-08T18:29:59.549 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_enable_quota_threads": "true", 2024-05-08T18:29:59.550 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_enable_static_website": "false", 2024-05-08T18:29:59.550 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_enable_usage_log": "false", 2024-05-08T18:29:59.550 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_enforce_swift_acls": "true", 2024-05-08T18:29:59.550 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_exit_timeout_secs": "120", 2024-05-08T18:29:59.550 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_expose_bucket": "false", 2024-05-08T18:29:59.550 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_extended_http_attrs": "", 2024-05-08T18:29:59.550 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_filter": "none", 2024-05-08T18:29:59.550 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-05-08T18:29:59.550 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_frontends": "beast port=7480", 2024-05-08T18:29:59.550 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_gc_max_concurrent_io": "10", 2024-05-08T18:29:59.550 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_gc_max_deferred": "50", 2024-05-08T18:29:59.550 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-05-08T18:29:59.550 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_gc_max_objs": "32", 2024-05-08T18:29:59.551 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_gc_max_queue_size": "134213632", 2024-05-08T18:29:59.551 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_gc_max_trim_chunk": "16", 2024-05-08T18:29:59.551 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_gc_obj_min_wait": "7200", 2024-05-08T18:29:59.551 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_gc_processor_max_time": "3600", 2024-05-08T18:29:59.551 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_gc_processor_period": "3600", 2024-05-08T18:29:59.551 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-05-08T18:29:59.551 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_get_obj_window_size": "16777216", 2024-05-08T18:29:59.551 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_healthcheck_disabling_path": "", 2024-05-08T18:29:59.551 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_ignore_get_invalid_range": "false", 2024-05-08T18:29:59.551 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_init_timeout": "300", 2024-05-08T18:29:59.551 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-05-08T18:29:59.551 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-05-08T18:29:59.551 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_kafka_connection_idle": "300", 2024-05-08T18:29:59.551 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_kafka_message_timeout": "5000", 2024-05-08T18:29:59.552 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_kafka_sleep_timeout": "10", 2024-05-08T18:29:59.552 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-05-08T18:29:59.552 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_keystone_accepted_reader_roles": "", 2024-05-08T18:29:59.552 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-05-08T18:29:59.552 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_keystone_admin_domain": "", 2024-05-08T18:29:59.552 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_keystone_admin_password": "", 2024-05-08T18:29:59.552 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_keystone_admin_password_path": "", 2024-05-08T18:29:59.552 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_keystone_admin_project": "", 2024-05-08T18:29:59.552 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_keystone_admin_tenant": "", 2024-05-08T18:29:59.552 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_keystone_admin_token": "", 2024-05-08T18:29:59.552 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_keystone_admin_token_path": "", 2024-05-08T18:29:59.552 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_keystone_admin_user": "", 2024-05-08T18:29:59.552 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_keystone_api_version": "2", 2024-05-08T18:29:59.553 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_keystone_barbican_domain": "", 2024-05-08T18:29:59.553 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_keystone_barbican_password": "", 2024-05-08T18:29:59.553 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_keystone_barbican_project": "", 2024-05-08T18:29:59.553 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_keystone_barbican_tenant": "", 2024-05-08T18:29:59.553 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_keystone_barbican_user": "", 2024-05-08T18:29:59.553 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-05-08T18:29:59.553 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_keystone_implicit_tenants": "false", 2024-05-08T18:29:59.553 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-05-08T18:29:59.553 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_keystone_service_token_enabled": "false", 2024-05-08T18:29:59.553 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_keystone_token_cache_size": "10000", 2024-05-08T18:29:59.553 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_keystone_url": "", 2024-05-08T18:29:59.553 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_keystone_verify_ssl": "true", 2024-05-08T18:29:59.553 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_lc_debug_interval": "-1", 2024-05-08T18:29:59.554 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_lc_lock_max_time": "90", 2024-05-08T18:29:59.554 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_lc_max_objs": "32", 2024-05-08T18:29:59.554 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_lc_max_rules": "1000", 2024-05-08T18:29:59.554 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_lc_max_worker": "3", 2024-05-08T18:29:59.554 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_lc_max_wp_worker": "3", 2024-05-08T18:29:59.554 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_lc_thread_delay": "0", 2024-05-08T18:29:59.554 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-05-08T18:29:59.554 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_ldap_dnattr": "uid", 2024-05-08T18:29:59.554 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-05-08T18:29:59.554 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_ldap_searchfilter": "", 2024-05-08T18:29:59.554 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-05-08T18:29:59.554 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_ldap_uri": "", 2024-05-08T18:29:59.554 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_lfuda_sync_frequency": "60", 2024-05-08T18:29:59.554 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-05-08T18:29:59.555 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-05-08T18:29:59.555 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-05-08T18:29:59.555 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_local_cache_address": "127.0.0.1:6379", 2024-05-08T18:29:59.555 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_log_http_headers": "", 2024-05-08T18:29:59.555 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_log_nonexistent_bucket": "false", 2024-05-08T18:29:59.555 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-05-08T18:29:59.555 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_log_object_name_utc": "false", 2024-05-08T18:29:59.555 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_lua_max_memory_per_state": "128000", 2024-05-08T18:29:59.555 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_luarocks_location": "/tmp/rgw_luarocks/mon.a", 2024-05-08T18:29:59.555 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_max_attr_name_len": "0", 2024-05-08T18:29:59.555 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_max_attr_size": "0", 2024-05-08T18:29:59.555 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_max_attrs_num_in_req": "0", 2024-05-08T18:29:59.555 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_max_chunk_size": "4194304", 2024-05-08T18:29:59.556 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_max_concurrent_requests": "1024", 2024-05-08T18:29:59.556 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-05-08T18:29:59.556 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_max_dynamic_shards": "1999", 2024-05-08T18:29:59.556 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_max_listing_results": "1000", 2024-05-08T18:29:59.556 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_max_notify_retries": "10", 2024-05-08T18:29:59.556 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_max_objs_per_shard": "100000", 2024-05-08T18:29:59.556 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_max_put_param_size": "1048576", 2024-05-08T18:29:59.556 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_max_put_size": "5368709120", 2024-05-08T18:29:59.556 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_max_slo_entries": "1000", 2024-05-08T18:29:59.556 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_md_log_max_shards": "64", 2024-05-08T18:29:59.556 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_md_notify_interval_msec": "200", 2024-05-08T18:29:59.556 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_meta_sync_poll_interval": "20", 2024-05-08T18:29:59.556 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_meta_sync_spawn_window": "20", 2024-05-08T18:29:59.556 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-05-08T18:29:59.557 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_mp_lock_max_time": "600", 2024-05-08T18:29:59.557 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-05-08T18:29:59.557 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_multipart_min_part_size": "5242880", 2024-05-08T18:29:59.557 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-05-08T18:29:59.557 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-05-08T18:29:59.557 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_nfs_fhcache_size": "2017", 2024-05-08T18:29:59.557 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-05-08T18:29:59.557 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-05-08T18:29:59.557 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_nfs_lru_lanes": "5", 2024-05-08T18:29:59.557 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_nfs_max_gc": "300", 2024-05-08T18:29:59.557 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-05-08T18:29:59.557 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_nfs_run_gc_threads": "false", 2024-05-08T18:29:59.557 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_nfs_run_lc_threads": "false", 2024-05-08T18:29:59.557 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_nfs_run_quota_threads": "false", 2024-05-08T18:29:59.558 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_nfs_run_sync_thread": "false", 2024-05-08T18:29:59.558 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-05-08T18:29:59.558 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-05-08T18:29:59.558 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_num_async_rados_threads": "32", 2024-05-08T18:29:59.558 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_num_control_oids": "8", 2024-05-08T18:29:59.558 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_numa_node": "-1", 2024-05-08T18:29:59.558 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_obj_stripe_size": "4194304", 2024-05-08T18:29:59.558 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-05-08T18:29:59.558 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_objexp_chunk_size": "100", 2024-05-08T18:29:59.558 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_objexp_gc_interval": "600", 2024-05-08T18:29:59.558 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_objexp_hints_num_shards": "127", 2024-05-08T18:29:59.558 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-05-08T18:29:59.558 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-05-08T18:29:59.558 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_op_thread_timeout": "600", 2024-05-08T18:29:59.559 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_op_tracing": "false", 2024-05-08T18:29:59.559 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_opa_token": "", 2024-05-08T18:29:59.559 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_opa_url": "", 2024-05-08T18:29:59.559 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_opa_verify_ssl": "true", 2024-05-08T18:29:59.559 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-05-08T18:29:59.559 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-05-08T18:29:59.559 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_ops_log_rados": "false", 2024-05-08T18:29:59.559 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_ops_log_socket_path": "", 2024-05-08T18:29:59.559 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-05-08T18:29:59.559 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-05-08T18:29:59.559 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-05-08T18:29:59.560 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_period_push_interval": "2.000000", 2024-05-08T18:29:59.560 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_period_push_interval_max": "30.000000", 2024-05-08T18:29:59.560 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_period_root_pool": ".rgw.root", 2024-05-08T18:29:59.560 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-05-08T18:29:59.560 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_posix_base_path": "/tmp/rgw_posix_driver", 2024-05-08T18:29:59.560 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_posix_cache_lanes": "3", 2024-05-08T18:29:59.560 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_posix_cache_lmdb_count": "3", 2024-05-08T18:29:59.560 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_posix_cache_max_buckets": "100", 2024-05-08T18:29:59.560 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_posix_cache_partitions": "3", 2024-05-08T18:29:59.560 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_posix_database_root": "/var/lib/ceph/radosgw", 2024-05-08T18:29:59.560 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_print_continue": "true", 2024-05-08T18:29:59.561 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_print_prohibited_content_length": "false", 2024-05-08T18:29:59.561 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-05-08T18:29:59.561 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-05-08T18:29:59.561 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-05-08T18:29:59.561 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-05-08T18:29:59.561 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_rados_tracing": "false", 2024-05-08T18:29:59.561 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_realm": "", 2024-05-08T18:29:59.561 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_realm_id": "", 2024-05-08T18:29:59.561 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-05-08T18:29:59.561 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_region": "", 2024-05-08T18:29:59.561 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_region_root_pool": ".rgw.root", 2024-05-08T18:29:59.561 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_relaxed_region_enforcement": "false", 2024-05-08T18:29:59.561 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-05-08T18:29:59.562 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-05-08T18:29:59.562 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_request_uri": "", 2024-05-08T18:29:59.562 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_reshard_batch_size": "64", 2024-05-08T18:29:59.562 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-05-08T18:29:59.562 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_reshard_max_aio": "128", 2024-05-08T18:29:59.562 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_reshard_num_logs": "16", 2024-05-08T18:29:59.562 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_reshard_thread_interval": "600", 2024-05-08T18:29:59.562 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_resolve_cname": "false", 2024-05-08T18:29:59.562 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_rest_getusage_op_compat": "false", 2024-05-08T18:29:59.562 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_run_sync_thread": "true", 2024-05-08T18:29:59.562 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_s3_auth_disable_signature_url": "false", 2024-05-08T18:29:59.562 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-05-08T18:29:59.562 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_s3_auth_use_keystone": "false", 2024-05-08T18:29:59.563 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_s3_auth_use_ldap": "false", 2024-05-08T18:29:59.563 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_s3_auth_use_rados": "true", 2024-05-08T18:29:59.563 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_s3_auth_use_sts": "false", 2024-05-08T18:29:59.563 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-05-08T18:29:59.563 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_s3_success_create_obj_status": "0", 2024-05-08T18:29:59.563 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-05-08T18:29:59.563 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_scheduler_type": "throttler", 2024-05-08T18:29:59.563 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_script_uri": "", 2024-05-08T18:29:59.563 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_service_provider_name": "", 2024-05-08T18:29:59.563 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-05-08T18:29:59.563 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_sts_client_id": "", 2024-05-08T18:29:59.563 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_sts_client_secret": "", 2024-05-08T18:29:59.563 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_sts_entry": "sts", 2024-05-08T18:29:59.563 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_sts_key": "sts", 2024-05-08T18:29:59.564 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_sts_max_session_duration": "43200", 2024-05-08T18:29:59.564 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_sts_min_session_duration": "900", 2024-05-08T18:29:59.564 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_sts_token_introspection_url": "", 2024-05-08T18:29:59.564 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_swift_account_in_url": "false", 2024-05-08T18:29:59.564 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_swift_auth_entry": "auth", 2024-05-08T18:29:59.564 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_swift_auth_url": "", 2024-05-08T18:29:59.564 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_swift_custom_header": "", 2024-05-08T18:29:59.564 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_swift_enforce_content_length": "false", 2024-05-08T18:29:59.564 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_swift_need_stats": "true", 2024-05-08T18:29:59.564 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_swift_tenant_name": "", 2024-05-08T18:29:59.564 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_swift_token_expiration": "86400", 2024-05-08T18:29:59.564 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_swift_url": "", 2024-05-08T18:29:59.565 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_swift_url_prefix": "swift", 2024-05-08T18:29:59.565 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_swift_versioning_enabled": "false", 2024-05-08T18:29:59.565 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-05-08T18:29:59.565 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-05-08T18:29:59.565 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_sync_lease_period": "120", 2024-05-08T18:29:59.565 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-05-08T18:29:59.565 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_sync_log_trim_interval": "1200", 2024-05-08T18:29:59.565 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-05-08T18:29:59.565 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-05-08T18:29:59.565 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-05-08T18:29:59.565 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_sync_obj_etag_verify": "false", 2024-05-08T18:29:59.565 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_sync_trace_history_size": "4096", 2024-05-08T18:29:59.565 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-05-08T18:29:59.565 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-05-08T18:29:59.566 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_thread_pool_size": "512", 2024-05-08T18:29:59.566 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_topic_persistency_max_retries": "0", 2024-05-08T18:29:59.566 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_topic_persistency_sleep_duration": "0", 2024-05-08T18:29:59.566 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_topic_persistency_time_to_live": "0", 2024-05-08T18:29:59.566 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_topic_require_publish_policy": "false", 2024-05-08T18:29:59.566 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_torrent_comment": "", 2024-05-08T18:29:59.566 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_torrent_createby": "", 2024-05-08T18:29:59.566 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_torrent_encoding": "", 2024-05-08T18:29:59.566 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_torrent_flag": "false", 2024-05-08T18:29:59.566 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_torrent_max_size": "5368709120", 2024-05-08T18:29:59.566 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_torrent_origin": "", 2024-05-08T18:29:59.566 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_torrent_sha_unit": "524288", 2024-05-08T18:29:59.567 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_torrent_tracker": "", 2024-05-08T18:29:59.567 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_trust_forwarded_https": "false", 2024-05-08T18:29:59.567 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-05-08T18:29:59.567 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_usage_log_tick_interval": "30", 2024-05-08T18:29:59.567 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_usage_max_shards": "32", 2024-05-08T18:29:59.567 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_usage_max_user_shards": "1", 2024-05-08T18:29:59.567 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_use_opa_authz": "false", 2024-05-08T18:29:59.567 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_user_counters_cache": "false", 2024-05-08T18:29:59.567 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_user_counters_cache_size": "10000", 2024-05-08T18:29:59.567 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-05-08T18:29:59.567 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_user_default_quota_max_size": "-1", 2024-05-08T18:29:59.567 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_user_max_buckets": "1000", 2024-05-08T18:29:59.567 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_user_policies_max_num": "100", 2024-05-08T18:29:59.567 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-05-08T18:29:59.568 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-05-08T18:29:59.568 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_user_quota_sync_interval": "86400", 2024-05-08T18:29:59.568 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-05-08T18:29:59.568 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_user_unique_email": "true", 2024-05-08T18:29:59.568 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_verify_ssl": "true", 2024-05-08T18:29:59.568 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_website_routing_rules_max_num": "50", 2024-05-08T18:29:59.568 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_zone": "", 2024-05-08T18:29:59.568 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_zone_id": "", 2024-05-08T18:29:59.568 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-05-08T18:29:59.568 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_zonegroup": "", 2024-05-08T18:29:59.568 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_zonegroup_id": "", 2024-05-08T18:29:59.568 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-05-08T18:29:59.568 INFO:teuthology.orchestra.run.smithi097.stdout: "rgwlc_auto_session_clear": "true", 2024-05-08T18:29:59.568 INFO:teuthology.orchestra.run.smithi097.stdout: "rgwlc_skip_bucket_step": "false", 2024-05-08T18:29:59.569 INFO:teuthology.orchestra.run.smithi097.stdout: "rocksdb_block_size": "4096", 2024-05-08T18:29:59.569 INFO:teuthology.orchestra.run.smithi097.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-05-08T18:29:59.569 INFO:teuthology.orchestra.run.smithi097.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-05-08T18:29:59.569 INFO:teuthology.orchestra.run.smithi097.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-05-08T18:29:59.569 INFO:teuthology.orchestra.run.smithi097.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-05-08T18:29:59.569 INFO:teuthology.orchestra.run.smithi097.stdout: "rocksdb_cache_shard_bits": "4", 2024-05-08T18:29:59.569 INFO:teuthology.orchestra.run.smithi097.stdout: "rocksdb_cache_size": "536870912", 2024-05-08T18:29:59.569 INFO:teuthology.orchestra.run.smithi097.stdout: "rocksdb_cache_type": "binned_lru", 2024-05-08T18:29:59.569 INFO:teuthology.orchestra.run.smithi097.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-05-08T18:29:59.569 INFO:teuthology.orchestra.run.smithi097.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-05-08T18:29:59.569 INFO:teuthology.orchestra.run.smithi097.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-05-08T18:29:59.569 INFO:teuthology.orchestra.run.smithi097.stdout: "rocksdb_collect_compaction_stats": "false", 2024-05-08T18:29:59.569 INFO:teuthology.orchestra.run.smithi097.stdout: "rocksdb_collect_extended_stats": "false", 2024-05-08T18:29:59.570 INFO:teuthology.orchestra.run.smithi097.stdout: "rocksdb_collect_memory_stats": "false", 2024-05-08T18:29:59.570 INFO:teuthology.orchestra.run.smithi097.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-05-08T18:29:59.570 INFO:teuthology.orchestra.run.smithi097.stdout: "rocksdb_index_type": "binary_search", 2024-05-08T18:29:59.570 INFO:teuthology.orchestra.run.smithi097.stdout: "rocksdb_log_to_ceph_log": "true", 2024-05-08T18:29:59.570 INFO:teuthology.orchestra.run.smithi097.stdout: "rocksdb_metadata_block_size": "4096", 2024-05-08T18:29:59.570 INFO:teuthology.orchestra.run.smithi097.stdout: "rocksdb_partition_filters": "false", 2024-05-08T18:29:59.570 INFO:teuthology.orchestra.run.smithi097.stdout: "rocksdb_perf": "false", 2024-05-08T18:29:59.570 INFO:teuthology.orchestra.run.smithi097.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-05-08T18:29:59.570 INFO:teuthology.orchestra.run.smithi097.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-05-08T18:29:59.570 INFO:teuthology.orchestra.run.smithi097.stdout: "rotating_keys_renewal_timeout": "10", 2024-05-08T18:29:59.570 INFO:teuthology.orchestra.run.smithi097.stdout: "run_dir": "/var/run/ceph", 2024-05-08T18:29:59.570 INFO:teuthology.orchestra.run.smithi097.stdout: "seastore_block_create": "true", 2024-05-08T18:29:59.570 INFO:teuthology.orchestra.run.smithi097.stdout: "seastore_cache_lru_size": "67108864", 2024-05-08T18:29:59.571 INFO:teuthology.orchestra.run.smithi097.stdout: "seastore_cbjournal_size": "5368709120", 2024-05-08T18:29:59.571 INFO:teuthology.orchestra.run.smithi097.stdout: "seastore_data_delta_based_overwrite": "0", 2024-05-08T18:29:59.571 INFO:teuthology.orchestra.run.smithi097.stdout: "seastore_default_max_object_size": "16777216", 2024-05-08T18:29:59.571 INFO:teuthology.orchestra.run.smithi097.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-05-08T18:29:59.571 INFO:teuthology.orchestra.run.smithi097.stdout: "seastore_device_size": "53687091200", 2024-05-08T18:29:59.571 INFO:teuthology.orchestra.run.smithi097.stdout: "seastore_full_integrity_check": "false", 2024-05-08T18:29:59.571 INFO:teuthology.orchestra.run.smithi097.stdout: "seastore_journal_batch_capacity": "16", 2024-05-08T18:29:59.571 INFO:teuthology.orchestra.run.smithi097.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-05-08T18:29:59.571 INFO:teuthology.orchestra.run.smithi097.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-05-08T18:29:59.571 INFO:teuthology.orchestra.run.smithi097.stdout: "seastore_journal_iodepth_limit": "5", 2024-05-08T18:29:59.571 INFO:teuthology.orchestra.run.smithi097.stdout: "seastore_main_device_type": "SSD", 2024-05-08T18:29:59.571 INFO:teuthology.orchestra.run.smithi097.stdout: "seastore_max_concurrent_transactions": "8", 2024-05-08T18:29:59.571 INFO:teuthology.orchestra.run.smithi097.stdout: "seastore_max_data_allocation_size": "32768", 2024-05-08T18:29:59.571 INFO:teuthology.orchestra.run.smithi097.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-05-08T18:29:59.572 INFO:teuthology.orchestra.run.smithi097.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-05-08T18:29:59.572 INFO:teuthology.orchestra.run.smithi097.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-05-08T18:29:59.572 INFO:teuthology.orchestra.run.smithi097.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-05-08T18:29:59.572 INFO:teuthology.orchestra.run.smithi097.stdout: "seastore_segment_size": "67108864", 2024-05-08T18:29:59.572 INFO:teuthology.orchestra.run.smithi097.stdout: "set_keepcaps": "false", 2024-05-08T18:29:59.572 INFO:teuthology.orchestra.run.smithi097.stdout: "setgroup": "", 2024-05-08T18:29:59.572 INFO:teuthology.orchestra.run.smithi097.stdout: "setuser": "", 2024-05-08T18:29:59.572 INFO:teuthology.orchestra.run.smithi097.stdout: "setuser_match_path": "", 2024-05-08T18:29:59.572 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_misplaced_ratio": "0.050000", 2024-05-08T18:29:59.572 INFO:teuthology.orchestra.run.smithi097.stdout: "thp": "false", 2024-05-08T18:29:59.572 INFO:teuthology.orchestra.run.smithi097.stdout: "threadpool_default_timeout": "60", 2024-05-08T18:29:59.572 INFO:teuthology.orchestra.run.smithi097.stdout: "threadpool_empty_queue_max_wait": "2", 2024-05-08T18:29:59.572 INFO:teuthology.orchestra.run.smithi097.stdout: "throttler_perf_counter": "true" 2024-05-08T18:29:59.572 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:29:59.574 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-05-08T18:29:59.718 INFO:teuthology.orchestra.run.smithi097.stdout:mon.a: {} 2024-05-08T18:29:59.718 INFO:teuthology.orchestra.run.smithi097.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-05-08T18:29:59.730 INFO:teuthology.orchestra.run.smithi097.stdout:mon.b: {} 2024-05-08T18:29:59.731 INFO:teuthology.orchestra.run.smithi097.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-05-08T18:29:59.740 INFO:teuthology.orchestra.run.smithi097.stdout:mon.c: {} 2024-05-08T18:29:59.740 INFO:teuthology.orchestra.run.smithi097.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-05-08T18:29:59.755 DEBUG:teuthology.orchestra.run.smithi097:> type ceph-objectstore-tool 2024-05-08T18:29:59.759 INFO:teuthology.orchestra.run.smithi097.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-05-08T18:29:59.760 DEBUG:teuthology.orchestra.run.smithi151:> type ceph-objectstore-tool 2024-05-08T18:29:59.765 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-05-08T18:29:59.765 INFO:teuthology.run_tasks:Running task workunit... 2024-05-08T18:29:59.778 INFO:tasks.workunit:Pulling workunits from ref 27d371685027569bcfa4efc661d3d3186f3a1776 2024-05-08T18:29:59.778 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-05-08T18:29:59.779 DEBUG:teuthology.orchestra.run.smithi097:> stat -- /home/ubuntu/cephtest/mnt.0 2024-05-08T18:29:59.779 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-05-08T18:29:59.779 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-05-08T18:29:59.779 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-05-08T18:29:59.780 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-05-08T18:29:59.780 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-05-08T18:29:59.780 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-08T18:29:59.780 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-05-08T18:29:59.781 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-08T18:29:59.781 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-05-08T18:29:59.781 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-08T18:29:59.809 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T18:29:59.809 INFO:teuthology.orchestra.run.smithi097.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-05-08T18:29:59.810 DEBUG:teuthology.orchestra.run.smithi097:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-05-08T18:29:59.810 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:29:59.808+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:29:59.857 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-05-08T18:29:59.857 DEBUG:teuthology.orchestra.run.smithi097:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-05-08T18:29:59.882 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:29:59.880+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:29:59.907 INFO:tasks.workunit:timeout=3h 2024-05-08T18:29:59.907 INFO:tasks.workunit:cleanup=True 2024-05-08T18:29:59.908 DEBUG:teuthology.orchestra.run.smithi097:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 27d371685027569bcfa4efc661d3d3186f3a1776 2024-05-08T18:29:59.923 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:29:59.924 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:29:59.924 INFO:teuthology.orchestra.run.smithi097.stdout: "num_ops": 0 2024-05-08T18:29:59.924 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:29:59.928 INFO:tasks.workunit.client.0.smithi097.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-05-08T18:29:59.946 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-08T18:29:59.947 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2024-05-08T18:29:59.947 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:29:59.978 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2024-05-08T18:29:59.978 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:29:59.983 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:29:59.980+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:30:00.009 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2024-05-08T18:30:00.010 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:30:00.033 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2024-05-08T18:30:00.033 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:30:00.052 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2024-05-08T18:30:00.053 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:30:00.083 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:30:00.084+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:30:00.086 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2024-05-08T18:30:00.086 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:30:00.101 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:00.101 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:00.114 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-08T18:30:00.118 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2024-05-08T18:30:00.119 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:30:00.151 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2024-05-08T18:30:00.151 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:30:00.208 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:30:00.211+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:30:00.233 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:00.233 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:00.245 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-08T18:30:00.285 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:30:00.284+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:30:00.386 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:30:00.384+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:30:00.430 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:00.430 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:00.441 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-08T18:30:00.487 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:30:00.491+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:30:00.550 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:00.550 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:00.562 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-08T18:30:00.608 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:30:00.611+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:30:00.692 INFO:teuthology.orchestra.run.smithi097.stderr:reweighted osd.0 to 1 (10000) 2024-05-08T18:30:00.693 INFO:teuthology.orchestra.run.smithi097.stderr:noscrub is set 2024-05-08T18:30:00.693 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:30:00.695+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:30:00.713 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-05-08T18:30:00.732 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:00.733 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:00.746 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-08T18:30:00.792 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:30:00.795+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:30:00.893 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:30:00.892+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:30:00.909 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:00.909 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:00.922 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-08T18:30:00.994 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:30:00.996+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:30:01.035 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:01.035 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:01.049 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-08T18:30:01.096 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:30:01.099+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:30:01.162 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:01.163 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:01.176 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-08T18:30:01.196 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:30:01.196+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:30:01.296 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:30:01.299+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:30:01.342 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:01.342 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:01.356 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-08T18:30:01.397 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:30:01.396+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:30:01.498 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:30:01.499+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:30:01.524 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:01.524 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:01.538 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-08T18:30:01.600 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:30:01.600+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:30:01.688 INFO:teuthology.orchestra.run.smithi097.stderr:reweighted osd.1 to 1 (10000) 2024-05-08T18:30:01.700 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:30:01.703+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:30:01.708 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:01.709 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:01.712 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-05-08T18:30:01.724 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-08T18:30:01.816 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:30:01.819+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:30:01.858 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:01.858 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:01.871 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-08T18:30:01.902 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:30:01.903+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:30:01.993 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:01.993 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:02.003 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:30:02.000+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:30:02.007 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-08T18:30:02.104 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:30:02.104+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:30:02.167 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-08T18:30:02.173 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:02.173 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:02.186 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-08T18:30:02.212 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:30:02.215+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:30:02.306 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:30:02.304+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:30:02.313 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2024-05-08T18:30:02.313 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:30:02.328 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2024-05-08T18:30:02.329 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:30:02.344 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2024-05-08T18:30:02.344 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:30:02.351 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:02.351 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:02.359 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2024-05-08T18:30:02.359 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:30:02.365 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-08T18:30:02.376 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2024-05-08T18:30:02.377 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:30:02.393 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2024-05-08T18:30:02.393 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:30:02.408 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:30:02.408+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:30:02.412 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2024-05-08T18:30:02.412 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:30:02.432 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2024-05-08T18:30:02.432 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:30:02.508 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:30:02.511+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:30:02.534 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:30:02.535 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:30:02.535 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2024-05-08T18:30:02.535 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2024-05-08T18:30:02.535 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:30:02.548 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-08T18:30:02.609 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:30:02.611+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:30:02.675 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:30:02.676 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2024-05-08T18:30:02.676 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2024-05-08T18:30:02.676 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-05-08T18:30:02.676 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.676 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4479.0:37 5.f 5:f43b6ece:::zone_names.default:head [create,call version.set in=10b,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-05-08T18:30:02.676 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:44.627414+0000", 2024-05-08T18:30:02.676 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 18.048446324, 2024-05-08T18:30:02.676 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029966429999999998, 2024-05-08T18:30:02.676 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:02.676 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:02.676 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:02.677 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:02.677 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4479", 2024-05-08T18:30:02.677 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3577501689", 2024-05-08T18:30:02.677 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 37 2024-05-08T18:30:02.677 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.677 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:02.677 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.677 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:02.677 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.627414+0000", 2024-05-08T18:30:02.677 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:02.677 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.677 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.677 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:02.678 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.627414+0000", 2024-05-08T18:30:02.678 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:02.678 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.678 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.678 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:02.678 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.627416+0000", 2024-05-08T18:30:02.678 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9580000000000001e-06 2024-05-08T18:30:02.678 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.678 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.678 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:02.678 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.627427+0000", 2024-05-08T18:30:02.678 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1657e-05 2024-05-08T18:30:02.678 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.679 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.679 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:02.679 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.627454+0000", 2024-05-08T18:30:02.679 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6619e-05 2024-05-08T18:30:02.679 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.679 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.679 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:02.679 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.627474+0000", 2024-05-08T18:30:02.679 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9612000000000001e-05 2024-05-08T18:30:02.679 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.679 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.679 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:02.679 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.627647+0000", 2024-05-08T18:30:02.679 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017374999999999999 2024-05-08T18:30:02.680 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.680 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.680 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:02.680 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.627861+0000", 2024-05-08T18:30:02.680 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000213358 2024-05-08T18:30:02.680 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.680 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.680 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:02.680 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.628153+0000", 2024-05-08T18:30:02.680 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029198899999999999 2024-05-08T18:30:02.680 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.680 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.680 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:02.681 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.629544+0000", 2024-05-08T18:30:02.681 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0013916390000000001 2024-05-08T18:30:02.681 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.681 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.681 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:02.681 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.630221+0000", 2024-05-08T18:30:02.681 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00067613500000000002 2024-05-08T18:30:02.681 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.681 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.681 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:02.681 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.630321+0000", 2024-05-08T18:30:02.681 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000100126 2024-05-08T18:30:02.681 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.681 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.682 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:02.682 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.630411+0000", 2024-05-08T18:30:02.682 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.9800000000000001e-05 2024-05-08T18:30:02.682 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:02.682 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:02.682 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:02.682 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.682 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.682 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4479.0:41 5.f 5:f4c53578:::zonegroups_names.default:head [create,call version.set in=10b,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-05-08T18:30:02.682 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:44.637466+0000", 2024-05-08T18:30:02.682 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 18.038394364999998, 2024-05-08T18:30:02.682 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0030003949999999999, 2024-05-08T18:30:02.682 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:02.683 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:02.683 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:02.683 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:02.683 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4479", 2024-05-08T18:30:02.683 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3577501689", 2024-05-08T18:30:02.683 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 41 2024-05-08T18:30:02.683 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.683 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:02.683 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.683 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:02.683 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.637466+0000", 2024-05-08T18:30:02.683 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:02.683 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.683 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.684 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:02.684 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.637466+0000", 2024-05-08T18:30:02.684 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:02.684 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.684 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.684 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:02.684 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.637468+0000", 2024-05-08T18:30:02.684 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2800000000000002e-06 2024-05-08T18:30:02.684 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.684 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.684 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:02.684 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.637479+0000", 2024-05-08T18:30:02.684 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0674e-05 2024-05-08T18:30:02.684 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.685 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.685 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:02.685 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.637508+0000", 2024-05-08T18:30:02.685 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8921999999999999e-05 2024-05-08T18:30:02.685 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.685 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.685 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:02.685 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.637522+0000", 2024-05-08T18:30:02.685 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3923e-05 2024-05-08T18:30:02.685 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.685 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.685 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:02.685 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.637647+0000", 2024-05-08T18:30:02.685 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000124905 2024-05-08T18:30:02.686 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.686 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.686 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:02.686 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.637852+0000", 2024-05-08T18:30:02.686 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000205081 2024-05-08T18:30:02.686 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.686 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.686 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:02.686 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.638101+0000", 2024-05-08T18:30:02.686 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000248953 2024-05-08T18:30:02.686 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.686 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.686 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:02.686 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.639345+0000", 2024-05-08T18:30:02.686 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001244754 2024-05-08T18:30:02.687 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.687 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.687 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:02.687 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.640197+0000", 2024-05-08T18:30:02.687 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000851614 2024-05-08T18:30:02.687 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.687 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.687 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:02.687 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.640353+0000", 2024-05-08T18:30:02.687 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015631600000000001 2024-05-08T18:30:02.687 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.687 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.687 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:02.687 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.640466+0000", 2024-05-08T18:30:02.688 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000112973 2024-05-08T18:30:02.688 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:02.688 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:02.688 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:02.688 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.688 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.688 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:30:02.688 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.664338+0000", 2024-05-08T18:30:02.688 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 11.011522554000001, 2024-05-08T18:30:02.688 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039355429999999997, 2024-05-08T18:30:02.688 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:02.688 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:02.688 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:02.689 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:02.689 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:02.689 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:02.689 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 205 2024-05-08T18:30:02.689 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.689 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:02.689 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.689 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:02.689 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.664338+0000", 2024-05-08T18:30:02.689 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:02.689 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.689 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.689 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:02.689 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.664338+0000", 2024-05-08T18:30:02.689 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:02.690 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.690 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.690 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:02.690 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.664341+0000", 2024-05-08T18:30:02.690 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2399999999999999e-06 2024-05-08T18:30:02.690 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.690 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.690 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:02.690 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.664355+0000", 2024-05-08T18:30:02.690 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.453e-05 2024-05-08T18:30:02.690 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.690 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.691 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:02.691 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.664392+0000", 2024-05-08T18:30:02.691 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7033000000000003e-05 2024-05-08T18:30:02.691 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.691 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.691 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:02.691 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.664419+0000", 2024-05-08T18:30:02.691 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6086000000000001e-05 2024-05-08T18:30:02.691 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.691 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.691 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:02.691 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.664586+0000", 2024-05-08T18:30:02.691 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016752299999999999 2024-05-08T18:30:02.691 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.692 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.692 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:02.692 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.664831+0000", 2024-05-08T18:30:02.692 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00024510800000000001 2024-05-08T18:30:02.692 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.692 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.692 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:02.692 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.665420+0000", 2024-05-08T18:30:02.692 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00058862499999999996 2024-05-08T18:30:02.692 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.692 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.692 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:02.692 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.667096+0000", 2024-05-08T18:30:02.692 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0016765199999999999 2024-05-08T18:30:02.693 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.693 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.693 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:02.693 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.668109+0000", 2024-05-08T18:30:02.693 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001012829 2024-05-08T18:30:02.693 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.693 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.693 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:02.693 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.668200+0000", 2024-05-08T18:30:02.693 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1186000000000004e-05 2024-05-08T18:30:02.693 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.693 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.693 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:02.693 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.668273+0000", 2024-05-08T18:30:02.694 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.2862999999999997e-05 2024-05-08T18:30:02.694 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:02.694 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:02.694 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:02.694 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.694 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.694 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:02.694 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.732858+0000", 2024-05-08T18:30:02.694 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 10.943002205999999, 2024-05-08T18:30:02.694 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0033301939999999999, 2024-05-08T18:30:02.694 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:02.694 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:02.694 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:02.695 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:02.695 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:02.695 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:02.695 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 220 2024-05-08T18:30:02.695 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.695 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:02.695 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.695 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:02.695 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.732858+0000", 2024-05-08T18:30:02.695 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:02.695 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.695 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.695 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:02.695 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.732858+0000", 2024-05-08T18:30:02.696 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:02.696 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.696 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.696 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:02.696 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.732861+0000", 2024-05-08T18:30:02.696 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.9129999999999999e-06 2024-05-08T18:30:02.696 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.696 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.696 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:02.696 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.732874+0000", 2024-05-08T18:30:02.696 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3349999999999999e-05 2024-05-08T18:30:02.696 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.696 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.696 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:02.696 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.732900+0000", 2024-05-08T18:30:02.697 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6186999999999998e-05 2024-05-08T18:30:02.697 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.697 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.697 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:02.697 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.732916+0000", 2024-05-08T18:30:02.697 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5648999999999999e-05 2024-05-08T18:30:02.697 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.697 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.697 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:02.697 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.733097+0000", 2024-05-08T18:30:02.697 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00018121599999999999 2024-05-08T18:30:02.697 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.697 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.697 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:02.698 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.733299+0000", 2024-05-08T18:30:02.698 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020179799999999999 2024-05-08T18:30:02.698 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.698 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.698 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:02.698 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.733694+0000", 2024-05-08T18:30:02.698 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00039455000000000002 2024-05-08T18:30:02.698 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.698 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.698 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:02.698 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.735124+0000", 2024-05-08T18:30:02.698 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001430239 2024-05-08T18:30:02.698 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.698 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.699 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:02.699 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.736037+0000", 2024-05-08T18:30:02.699 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00091359999999999998 2024-05-08T18:30:02.699 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.699 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.699 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:02.699 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.736122+0000", 2024-05-08T18:30:02.699 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4313000000000004e-05 2024-05-08T18:30:02.699 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.699 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.699 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:02.699 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.736188+0000", 2024-05-08T18:30:02.699 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6378999999999996e-05 2024-05-08T18:30:02.699 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:02.700 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:02.700 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:02.700 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.700 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.700 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:223 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:02.700 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.743358+0000", 2024-05-08T18:30:02.700 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 10.932501994000001, 2024-05-08T18:30:02.700 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003279718, 2024-05-08T18:30:02.700 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:02.700 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:02.700 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:02.700 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:02.700 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:02.700 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:02.700 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 223 2024-05-08T18:30:02.701 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.701 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:02.701 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.701 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:02.701 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.743358+0000", 2024-05-08T18:30:02.701 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:02.701 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.701 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.701 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:02.701 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.743358+0000", 2024-05-08T18:30:02.701 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:02.701 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.701 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.701 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:02.702 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.743361+0000", 2024-05-08T18:30:02.702 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3269999999999999e-06 2024-05-08T18:30:02.702 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.702 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.702 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:02.702 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.743372+0000", 2024-05-08T18:30:02.702 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1202999999999999e-05 2024-05-08T18:30:02.702 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.702 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.702 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:02.702 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.743402+0000", 2024-05-08T18:30:02.702 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0580000000000002e-05 2024-05-08T18:30:02.702 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.702 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.703 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:02.703 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.743417+0000", 2024-05-08T18:30:02.703 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5067e-05 2024-05-08T18:30:02.703 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.703 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.703 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:02.703 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.743529+0000", 2024-05-08T18:30:02.703 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011130599999999999 2024-05-08T18:30:02.703 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.703 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.703 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:02.703 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.743744+0000", 2024-05-08T18:30:02.703 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000215324 2024-05-08T18:30:02.703 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.704 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.704 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:02.704 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.744137+0000", 2024-05-08T18:30:02.704 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00039347699999999999 2024-05-08T18:30:02.704 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.704 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.704 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:02.704 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.745510+0000", 2024-05-08T18:30:02.704 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001372063 2024-05-08T18:30:02.704 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.704 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.704 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:02.704 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.746486+0000", 2024-05-08T18:30:02.704 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00097615600000000005 2024-05-08T18:30:02.705 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.705 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.705 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:02.705 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.746574+0000", 2024-05-08T18:30:02.705 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8598999999999997e-05 2024-05-08T18:30:02.705 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.705 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.705 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:02.705 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.746638+0000", 2024-05-08T18:30:02.705 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3615999999999995e-05 2024-05-08T18:30:02.705 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:02.705 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:02.705 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:02.705 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.706 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.706 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:225 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:02.706 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.750971+0000", 2024-05-08T18:30:02.706 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 10.924889409, 2024-05-08T18:30:02.706 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0033719510000000002, 2024-05-08T18:30:02.706 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:02.706 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:02.706 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:02.706 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:02.706 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:02.706 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:02.706 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 225 2024-05-08T18:30:02.706 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.706 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:02.707 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.707 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:02.707 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.750971+0000", 2024-05-08T18:30:02.707 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:02.707 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.707 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.707 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:02.707 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.750971+0000", 2024-05-08T18:30:02.707 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:02.707 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.707 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.707 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:02.707 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.750973+0000", 2024-05-08T18:30:02.707 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.243e-06 2024-05-08T18:30:02.708 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.708 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.708 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:02.708 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.751001+0000", 2024-05-08T18:30:02.708 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8082999999999999e-05 2024-05-08T18:30:02.708 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.708 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.708 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:02.708 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.751029+0000", 2024-05-08T18:30:02.708 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.792e-05 2024-05-08T18:30:02.708 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.708 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.708 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:02.708 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.751051+0000", 2024-05-08T18:30:02.709 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2166000000000001e-05 2024-05-08T18:30:02.709 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.709 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.709 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:02.709 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.751239+0000", 2024-05-08T18:30:02.709 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000187362 2024-05-08T18:30:02.709 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.709 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.709 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:02.709 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.751462+0000", 2024-05-08T18:30:02.709 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000223482 2024-05-08T18:30:02.709 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.709 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.709 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:02.710 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.751893+0000", 2024-05-08T18:30:02.710 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00043102 2024-05-08T18:30:02.710 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.710 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.710 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:02.710 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.753297+0000", 2024-05-08T18:30:02.710 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001403619 2024-05-08T18:30:02.710 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.710 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.710 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:02.710 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.754186+0000", 2024-05-08T18:30:02.710 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00088948399999999996 2024-05-08T18:30:02.710 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.711 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.711 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:02.711 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.754280+0000", 2024-05-08T18:30:02.711 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.3838999999999994e-05 2024-05-08T18:30:02.711 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.711 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.711 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:02.711 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.754343+0000", 2024-05-08T18:30:02.711 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2732999999999997e-05 2024-05-08T18:30:02.711 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:02.711 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:02.711 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:02.711 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.711 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.712 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:226 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:02.712 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.754700+0000", 2024-05-08T18:30:02.712 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 10.921159854000001, 2024-05-08T18:30:02.712 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032180080000000001, 2024-05-08T18:30:02.712 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:02.712 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:02.712 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:02.712 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:02.712 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:02.712 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:02.712 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 226 2024-05-08T18:30:02.712 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.712 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:02.712 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.713 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:02.713 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.754700+0000", 2024-05-08T18:30:02.713 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:02.713 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.713 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.713 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:02.713 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.754700+0000", 2024-05-08T18:30:02.713 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:02.713 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.713 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.713 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:02.713 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.754702+0000", 2024-05-08T18:30:02.713 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.86e-06 2024-05-08T18:30:02.713 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.714 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.714 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:02.714 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.754711+0000", 2024-05-08T18:30:02.714 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.0399999999999998e-06 2024-05-08T18:30:02.714 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.714 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.714 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:02.714 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.754735+0000", 2024-05-08T18:30:02.714 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3496e-05 2024-05-08T18:30:02.714 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.714 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.714 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:02.714 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.754753+0000", 2024-05-08T18:30:02.714 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8406e-05 2024-05-08T18:30:02.715 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.715 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.715 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:02.715 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.754941+0000", 2024-05-08T18:30:02.715 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00018746600000000001 2024-05-08T18:30:02.715 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.715 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.715 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:02.715 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.755164+0000", 2024-05-08T18:30:02.715 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022307800000000001 2024-05-08T18:30:02.715 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.715 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.715 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:02.715 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.755552+0000", 2024-05-08T18:30:02.716 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00038834999999999998 2024-05-08T18:30:02.716 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.716 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.716 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:02.716 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.757079+0000", 2024-05-08T18:30:02.716 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001527055 2024-05-08T18:30:02.716 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.716 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.716 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:02.716 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.757769+0000", 2024-05-08T18:30:02.716 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00068953199999999997 2024-05-08T18:30:02.716 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.716 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.717 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:02.717 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.757848+0000", 2024-05-08T18:30:02.717 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9342e-05 2024-05-08T18:30:02.717 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.717 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.717 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:02.717 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.757918+0000", 2024-05-08T18:30:02.717 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0382999999999993e-05 2024-05-08T18:30:02.717 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:02.717 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:02.717 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:02.717 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.717 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.718 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:234 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:02.718 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.783973+0000", 2024-05-08T18:30:02.718 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 10.89188749, 2024-05-08T18:30:02.718 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003359374, 2024-05-08T18:30:02.718 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:02.718 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:02.718 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:02.718 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:02.718 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:02.718 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:02.718 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 234 2024-05-08T18:30:02.718 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.718 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:02.719 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.719 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:02.719 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.783973+0000", 2024-05-08T18:30:02.719 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:02.719 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.719 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.719 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:02.719 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.783973+0000", 2024-05-08T18:30:02.719 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:02.719 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.719 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.719 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:02.719 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.783975+0000", 2024-05-08T18:30:02.719 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2970000000000002e-06 2024-05-08T18:30:02.720 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.720 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.720 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:02.720 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.783986+0000", 2024-05-08T18:30:02.720 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0726e-05 2024-05-08T18:30:02.720 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.720 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.720 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:02.720 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.784016+0000", 2024-05-08T18:30:02.720 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0459000000000001e-05 2024-05-08T18:30:02.720 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.720 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.720 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:02.720 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.784032+0000", 2024-05-08T18:30:02.721 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5316999999999999e-05 2024-05-08T18:30:02.721 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.721 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.721 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:02.721 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.784155+0000", 2024-05-08T18:30:02.721 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012393199999999999 2024-05-08T18:30:02.721 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.721 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.721 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:02.721 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.784377+0000", 2024-05-08T18:30:02.721 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000221179 2024-05-08T18:30:02.721 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.721 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.722 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:02.722 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.784794+0000", 2024-05-08T18:30:02.722 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00041709599999999999 2024-05-08T18:30:02.722 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.722 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.722 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:02.722 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.786199+0000", 2024-05-08T18:30:02.722 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001405346 2024-05-08T18:30:02.722 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.722 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.722 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:02.722 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.787171+0000", 2024-05-08T18:30:02.722 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00097187 2024-05-08T18:30:02.722 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.723 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.723 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:02.723 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.787265+0000", 2024-05-08T18:30:02.723 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4055000000000007e-05 2024-05-08T18:30:02.723 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.723 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.723 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:02.723 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.787332+0000", 2024-05-08T18:30:02.723 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7096999999999998e-05 2024-05-08T18:30:02.723 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:02.723 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:02.723 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:02.723 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.723 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.724 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:425 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:02.724 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.847197+0000", 2024-05-08T18:30:02.724 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 10.828662825, 2024-05-08T18:30:02.724 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003317646, 2024-05-08T18:30:02.724 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:02.724 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:02.724 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:02.724 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:02.724 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:02.724 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:02.724 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 425 2024-05-08T18:30:02.724 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.724 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:02.724 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.725 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:02.725 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.847197+0000", 2024-05-08T18:30:02.725 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:02.725 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.725 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.725 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:02.725 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.847197+0000", 2024-05-08T18:30:02.725 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:02.725 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.725 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.725 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:02.725 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.847200+0000", 2024-05-08T18:30:02.725 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1629999999999999e-06 2024-05-08T18:30:02.726 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.726 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.726 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:02.726 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.847210+0000", 2024-05-08T18:30:02.726 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0180000000000001e-05 2024-05-08T18:30:02.726 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.726 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.726 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:02.726 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.847234+0000", 2024-05-08T18:30:02.726 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3879999999999998e-05 2024-05-08T18:30:02.726 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.726 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.726 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:02.726 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.847247+0000", 2024-05-08T18:30:02.727 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3263e-05 2024-05-08T18:30:02.727 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.727 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.727 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:02.727 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.847356+0000", 2024-05-08T18:30:02.727 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000108906 2024-05-08T18:30:02.727 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.727 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.727 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:02.727 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.847647+0000", 2024-05-08T18:30:02.727 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029143799999999998 2024-05-08T18:30:02.727 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.727 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.727 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:02.728 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.848062+0000", 2024-05-08T18:30:02.728 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000415227 2024-05-08T18:30:02.728 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.728 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.728 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:02.728 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.849591+0000", 2024-05-08T18:30:02.728 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0015288980000000001 2024-05-08T18:30:02.728 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.728 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.728 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:02.728 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.850244+0000", 2024-05-08T18:30:02.728 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000652336 2024-05-08T18:30:02.728 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.728 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.728 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:02.729 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.850418+0000", 2024-05-08T18:30:02.729 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000174284 2024-05-08T18:30:02.729 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.729 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.729 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:02.729 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.850515+0000", 2024-05-08T18:30:02.729 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7071000000000006e-05 2024-05-08T18:30:02.729 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:02.729 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:02.729 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:02.729 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.729 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.729 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:433 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:02.729 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.851403+0000", 2024-05-08T18:30:02.729 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 10.824457044000001, 2024-05-08T18:30:02.730 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032407109999999999, 2024-05-08T18:30:02.730 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:02.730 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:02.730 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:02.730 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:02.730 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:02.730 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:02.730 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 433 2024-05-08T18:30:02.730 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.730 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:02.730 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.730 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:02.730 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.851403+0000", 2024-05-08T18:30:02.730 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:02.731 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.731 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.731 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:02.731 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.851403+0000", 2024-05-08T18:30:02.731 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:02.731 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.731 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.731 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:02.731 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.851405+0000", 2024-05-08T18:30:02.731 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.463e-06 2024-05-08T18:30:02.731 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.731 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.731 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:02.731 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.851411+0000", 2024-05-08T18:30:02.732 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2369999999999997e-06 2024-05-08T18:30:02.732 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.732 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.732 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:02.732 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.851428+0000", 2024-05-08T18:30:02.732 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.696e-05 2024-05-08T18:30:02.732 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.732 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.732 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:02.732 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.851446+0000", 2024-05-08T18:30:02.732 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7706e-05 2024-05-08T18:30:02.732 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.732 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.732 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:02.733 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.851552+0000", 2024-05-08T18:30:02.733 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000106236 2024-05-08T18:30:02.733 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.733 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.733 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:02.733 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.851746+0000", 2024-05-08T18:30:02.733 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000194093 2024-05-08T18:30:02.733 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.733 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.733 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:02.733 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.852148+0000", 2024-05-08T18:30:02.733 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00040243100000000002 2024-05-08T18:30:02.733 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.733 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.734 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:02.734 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.854255+0000", 2024-05-08T18:30:02.734 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002107135 2024-05-08T18:30:02.734 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.734 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.734 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:02.734 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.854326+0000", 2024-05-08T18:30:02.734 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0902999999999995e-05 2024-05-08T18:30:02.734 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.734 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.734 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:02.734 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.854568+0000", 2024-05-08T18:30:02.734 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00024141500000000001 2024-05-08T18:30:02.734 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.735 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.735 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:02.735 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.854644+0000", 2024-05-08T18:30:02.735 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6131999999999995e-05 2024-05-08T18:30:02.735 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:02.735 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:02.735 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:02.735 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.735 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.735 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:436 6.a 6:55b0279d:reshard::reshard.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:02.735 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.852129+0000", 2024-05-08T18:30:02.735 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 10.823731236, 2024-05-08T18:30:02.735 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0053015019999999996, 2024-05-08T18:30:02.735 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:02.736 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:02.736 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:02.736 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:02.736 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:02.736 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:02.736 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 436 2024-05-08T18:30:02.736 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.736 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:02.736 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.736 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:02.736 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.852129+0000", 2024-05-08T18:30:02.736 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:02.736 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.736 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.736 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:02.737 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.852129+0000", 2024-05-08T18:30:02.737 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:02.737 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.737 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.737 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:02.737 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.852130+0000", 2024-05-08T18:30:02.737 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.353e-06 2024-05-08T18:30:02.737 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.737 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.737 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:02.737 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.852137+0000", 2024-05-08T18:30:02.737 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6900000000000003e-06 2024-05-08T18:30:02.737 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.738 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.738 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:02.738 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.852156+0000", 2024-05-08T18:30:02.738 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9143e-05 2024-05-08T18:30:02.738 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.738 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.738 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:02.738 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.852169+0000", 2024-05-08T18:30:02.738 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.308e-05 2024-05-08T18:30:02.738 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.738 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.738 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:02.738 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.852700+0000", 2024-05-08T18:30:02.738 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00053086599999999996 2024-05-08T18:30:02.739 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.739 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.739 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:02.739 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.853030+0000", 2024-05-08T18:30:02.739 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00033040100000000002 2024-05-08T18:30:02.739 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.739 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.739 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:02.739 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.853514+0000", 2024-05-08T18:30:02.739 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000483969 2024-05-08T18:30:02.739 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.739 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.739 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:02.739 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.856337+0000", 2024-05-08T18:30:02.739 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0028227349999999998 2024-05-08T18:30:02.740 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.740 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.740 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:02.740 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.857285+0000", 2024-05-08T18:30:02.740 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00094820600000000005 2024-05-08T18:30:02.740 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.740 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.740 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:02.740 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.857366+0000", 2024-05-08T18:30:02.740 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.0889000000000004e-05 2024-05-08T18:30:02.740 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.740 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.740 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:02.740 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.857430+0000", 2024-05-08T18:30:02.741 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4170000000000004e-05 2024-05-08T18:30:02.741 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:02.741 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:02.741 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:02.741 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.741 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.741 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:478 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:02.741 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.876745+0000", 2024-05-08T18:30:02.741 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 10.799114700000001, 2024-05-08T18:30:02.741 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0046303550000000001, 2024-05-08T18:30:02.741 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:02.741 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:02.741 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:02.741 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:02.741 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:02.742 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:02.742 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 478 2024-05-08T18:30:02.742 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.742 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:02.742 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.742 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:02.742 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.876745+0000", 2024-05-08T18:30:02.742 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:02.742 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.742 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.742 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:02.742 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.876745+0000", 2024-05-08T18:30:02.742 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:02.742 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.743 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.743 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:02.743 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.876748+0000", 2024-05-08T18:30:02.743 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2819999999999999e-06 2024-05-08T18:30:02.743 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.743 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.743 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:02.743 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.876758+0000", 2024-05-08T18:30:02.743 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0485e-05 2024-05-08T18:30:02.743 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.743 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.743 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:02.743 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.876788+0000", 2024-05-08T18:30:02.743 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.9879e-05 2024-05-08T18:30:02.743 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.744 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.744 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:02.744 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.876805+0000", 2024-05-08T18:30:02.744 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.643e-05 2024-05-08T18:30:02.744 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.744 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.744 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:02.744 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.876917+0000", 2024-05-08T18:30:02.744 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000112377 2024-05-08T18:30:02.744 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.744 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.744 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:02.744 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877094+0000", 2024-05-08T18:30:02.744 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000177131 2024-05-08T18:30:02.745 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.745 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.745 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:02.745 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877441+0000", 2024-05-08T18:30:02.745 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00034716100000000002 2024-05-08T18:30:02.745 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.745 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.745 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:02.745 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.878479+0000", 2024-05-08T18:30:02.745 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010378729999999999 2024-05-08T18:30:02.745 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.745 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.745 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:02.745 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.881252+0000", 2024-05-08T18:30:02.746 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0027728710000000001 2024-05-08T18:30:02.746 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.746 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.746 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:02.746 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.881322+0000", 2024-05-08T18:30:02.746 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0394000000000004e-05 2024-05-08T18:30:02.746 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.746 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.746 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:02.746 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.881376+0000", 2024-05-08T18:30:02.746 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3471999999999999e-05 2024-05-08T18:30:02.746 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:02.746 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:02.746 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:02.747 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.747 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.747 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:479 6.d 6:b3052b9f:reshard::reshard.0000000013:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:02.747 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.877922+0000", 2024-05-08T18:30:02.747 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 10.797938602, 2024-05-08T18:30:02.747 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0030756400000000001, 2024-05-08T18:30:02.747 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:02.747 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:02.747 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:02.747 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:02.747 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:02.747 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:02.747 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 479 2024-05-08T18:30:02.747 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.748 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:02.748 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.748 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:02.748 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877922+0000", 2024-05-08T18:30:02.748 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:02.748 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.748 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.748 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:02.748 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877922+0000", 2024-05-08T18:30:02.748 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:02.748 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.748 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.748 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:02.748 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877923+0000", 2024-05-08T18:30:02.749 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8670000000000001e-06 2024-05-08T18:30:02.749 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.749 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.749 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:02.749 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877933+0000", 2024-05-08T18:30:02.749 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.0860000000000008e-06 2024-05-08T18:30:02.749 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.749 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.749 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:02.749 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877970+0000", 2024-05-08T18:30:02.749 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7762999999999997e-05 2024-05-08T18:30:02.749 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.749 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.749 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:02.750 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877997+0000", 2024-05-08T18:30:02.750 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6883e-05 2024-05-08T18:30:02.750 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.750 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.750 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:02.750 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.878108+0000", 2024-05-08T18:30:02.750 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000110797 2024-05-08T18:30:02.750 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.750 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.750 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:02.750 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.878403+0000", 2024-05-08T18:30:02.750 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029509799999999999 2024-05-08T18:30:02.750 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.750 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.751 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:02.751 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.878744+0000", 2024-05-08T18:30:02.751 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00034075899999999999 2024-05-08T18:30:02.751 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.751 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.751 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:02.751 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.879800+0000", 2024-05-08T18:30:02.751 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010564420000000001 2024-05-08T18:30:02.751 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.751 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.751 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:02.751 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.880740+0000", 2024-05-08T18:30:02.751 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000940167 2024-05-08T18:30:02.751 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.751 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.752 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:02.752 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.880880+0000", 2024-05-08T18:30:02.752 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000139796 2024-05-08T18:30:02.752 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.752 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.752 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:02.752 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.880997+0000", 2024-05-08T18:30:02.752 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000116982 2024-05-08T18:30:02.752 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:02.752 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:02.752 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:02.752 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.752 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.752 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:766 6.19 6:9edc23b1:::obj_delete_at_hint.0000000063:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:02.753 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.158937+0000", 2024-05-08T18:30:02.753 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 10.516922710999999, 2024-05-08T18:30:02.753 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0030448300000000001, 2024-05-08T18:30:02.753 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:02.753 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:02.753 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:02.753 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:02.753 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:02.753 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:02.753 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 766 2024-05-08T18:30:02.753 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.753 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:02.753 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.753 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:02.753 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.158937+0000", 2024-05-08T18:30:02.754 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:02.754 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.754 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.754 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:02.754 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.158937+0000", 2024-05-08T18:30:02.754 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:02.754 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.754 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.754 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:02.754 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.158940+0000", 2024-05-08T18:30:02.754 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6170000000000001e-06 2024-05-08T18:30:02.754 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.754 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.755 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:02.755 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.158952+0000", 2024-05-08T18:30:02.755 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1559000000000001e-05 2024-05-08T18:30:02.755 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.755 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.755 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:02.755 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.158982+0000", 2024-05-08T18:30:02.755 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0406999999999999e-05 2024-05-08T18:30:02.755 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.755 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.755 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:02.755 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.159000+0000", 2024-05-08T18:30:02.755 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8e-05 2024-05-08T18:30:02.755 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.756 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.756 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:02.756 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.159090+0000", 2024-05-08T18:30:02.756 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.0124999999999995e-05 2024-05-08T18:30:02.756 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.756 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.756 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:02.756 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.159296+0000", 2024-05-08T18:30:02.756 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000205663 2024-05-08T18:30:02.756 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.756 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.756 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:02.756 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.159600+0000", 2024-05-08T18:30:02.756 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00030387699999999998 2024-05-08T18:30:02.756 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.757 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.757 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:02.757 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.160694+0000", 2024-05-08T18:30:02.757 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001094228 2024-05-08T18:30:02.757 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.757 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.757 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:02.757 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.161818+0000", 2024-05-08T18:30:02.757 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001124388 2024-05-08T18:30:02.757 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.757 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.757 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:02.757 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.161908+0000", 2024-05-08T18:30:02.757 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.9629000000000005e-05 2024-05-08T18:30:02.758 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.758 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.758 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:02.758 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.161982+0000", 2024-05-08T18:30:02.758 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4337000000000003e-05 2024-05-08T18:30:02.758 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:02.758 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:02.758 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:02.758 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.758 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.758 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:820 6.a 6:50a39311:::obj_delete_at_hint.0000000081:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:02.758 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.281842+0000", 2024-05-08T18:30:02.758 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 10.39401831, 2024-05-08T18:30:02.758 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0030574130000000001, 2024-05-08T18:30:02.759 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:02.759 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:02.759 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:02.759 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:02.759 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:02.759 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:02.759 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 820 2024-05-08T18:30:02.759 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.759 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:02.759 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.759 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:02.759 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.281842+0000", 2024-05-08T18:30:02.759 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:02.759 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.760 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.760 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:02.760 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.281842+0000", 2024-05-08T18:30:02.760 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:02.760 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.760 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.760 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:02.760 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.281845+0000", 2024-05-08T18:30:02.760 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8439999999999998e-06 2024-05-08T18:30:02.760 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.760 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.760 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:02.760 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.281856+0000", 2024-05-08T18:30:02.760 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.148e-05 2024-05-08T18:30:02.761 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.761 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.761 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:02.761 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.281887+0000", 2024-05-08T18:30:02.761 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1239999999999999e-05 2024-05-08T18:30:02.761 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.761 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.761 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:02.761 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.281903+0000", 2024-05-08T18:30:02.761 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5223e-05 2024-05-08T18:30:02.761 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.761 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.761 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:02.761 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.282084+0000", 2024-05-08T18:30:02.761 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00018167500000000001 2024-05-08T18:30:02.762 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.762 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.762 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:02.762 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.282301+0000", 2024-05-08T18:30:02.762 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00021651099999999999 2024-05-08T18:30:02.762 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.762 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.762 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:02.762 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.282634+0000", 2024-05-08T18:30:02.762 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000332758 2024-05-08T18:30:02.762 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.762 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.762 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:02.762 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.283836+0000", 2024-05-08T18:30:02.763 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001202397 2024-05-08T18:30:02.763 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.763 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.763 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:02.763 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.284750+0000", 2024-05-08T18:30:02.763 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00091438999999999995 2024-05-08T18:30:02.763 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.763 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.763 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:02.763 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.284836+0000", 2024-05-08T18:30:02.763 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.5855999999999999e-05 2024-05-08T18:30:02.763 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.763 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.763 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:02.764 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.284899+0000", 2024-05-08T18:30:02.764 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3039000000000004e-05 2024-05-08T18:30:02.764 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:02.764 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:02.764 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:02.764 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.764 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.764 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:835 6.7 6:e09767b9:::obj_delete_at_hint.0000000086:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:02.764 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.317765+0000", 2024-05-08T18:30:02.764 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 10.358095421, 2024-05-08T18:30:02.764 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029952809999999998, 2024-05-08T18:30:02.764 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:02.764 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:02.764 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:02.764 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:02.765 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:02.765 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:02.765 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 835 2024-05-08T18:30:02.765 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.765 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:02.765 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.765 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:02.765 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.317765+0000", 2024-05-08T18:30:02.765 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:02.765 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.765 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.765 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:02.765 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.317765+0000", 2024-05-08T18:30:02.765 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:02.766 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.766 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.766 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:02.766 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.317767+0000", 2024-05-08T18:30:02.766 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.057e-06 2024-05-08T18:30:02.766 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.766 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.766 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:02.766 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.317780+0000", 2024-05-08T18:30:02.766 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.36e-05 2024-05-08T18:30:02.766 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.766 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.766 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:02.766 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.317810+0000", 2024-05-08T18:30:02.766 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.9989999999999999e-05 2024-05-08T18:30:02.767 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.767 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.767 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:02.767 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.317832+0000", 2024-05-08T18:30:02.767 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1650000000000001e-05 2024-05-08T18:30:02.767 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.767 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.767 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:02.767 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.317954+0000", 2024-05-08T18:30:02.767 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000121465 2024-05-08T18:30:02.767 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.767 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.768 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:02.768 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.318189+0000", 2024-05-08T18:30:02.768 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000235818 2024-05-08T18:30:02.768 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.768 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.768 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:02.768 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.318532+0000", 2024-05-08T18:30:02.768 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00034245100000000002 2024-05-08T18:30:02.768 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.768 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.768 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:02.768 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.319625+0000", 2024-05-08T18:30:02.768 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010931280000000001 2024-05-08T18:30:02.768 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.768 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.769 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:02.769 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.320612+0000", 2024-05-08T18:30:02.769 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00098682299999999995 2024-05-08T18:30:02.769 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.769 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.769 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:02.769 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.320698+0000", 2024-05-08T18:30:02.769 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.5813e-05 2024-05-08T18:30:02.769 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.769 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.769 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:02.769 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.320760+0000", 2024-05-08T18:30:02.769 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2485999999999998e-05 2024-05-08T18:30:02.769 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:02.769 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:02.770 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:02.770 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.770 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.770 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:922 6.d 6:b6c174be:::obj_delete_at_hint.0000000115:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:02.770 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.516256+0000", 2024-05-08T18:30:02.770 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 10.159604469, 2024-05-08T18:30:02.770 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032949839999999999, 2024-05-08T18:30:02.770 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:02.770 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:02.770 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:02.770 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:02.770 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:02.770 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:02.770 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 922 2024-05-08T18:30:02.771 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.771 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:02.771 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.771 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:02.771 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.516256+0000", 2024-05-08T18:30:02.771 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:02.771 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.771 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.771 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:02.771 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.516256+0000", 2024-05-08T18:30:02.771 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:02.771 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.771 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.771 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:02.771 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.516258+0000", 2024-05-08T18:30:02.772 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.4399999999999999e-06 2024-05-08T18:30:02.772 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.772 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.772 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:02.772 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.516269+0000", 2024-05-08T18:30:02.772 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0797e-05 2024-05-08T18:30:02.772 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.772 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.772 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:02.772 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.516299+0000", 2024-05-08T18:30:02.772 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0213e-05 2024-05-08T18:30:02.772 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.772 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.772 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:02.773 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.516314+0000", 2024-05-08T18:30:02.773 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4600000000000001e-05 2024-05-08T18:30:02.773 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.773 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.773 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:02.773 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.516424+0000", 2024-05-08T18:30:02.773 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000110376 2024-05-08T18:30:02.773 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.773 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.773 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:02.773 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.516635+0000", 2024-05-08T18:30:02.773 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000210628 2024-05-08T18:30:02.773 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.773 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.774 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:02.774 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.516947+0000", 2024-05-08T18:30:02.774 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00031246699999999997 2024-05-08T18:30:02.774 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.774 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.774 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:02.774 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.517949+0000", 2024-05-08T18:30:02.774 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010017400000000001 2024-05-08T18:30:02.774 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.774 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.774 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:02.774 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.519389+0000", 2024-05-08T18:30:02.774 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001439655 2024-05-08T18:30:02.775 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.775 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.775 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:02.775 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.519475+0000", 2024-05-08T18:30:02.775 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.6485999999999998e-05 2024-05-08T18:30:02.775 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.775 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.775 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:02.775 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.519551+0000", 2024-05-08T18:30:02.775 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5581999999999996e-05 2024-05-08T18:30:02.775 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:02.775 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:02.775 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:02.776 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.776 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.776 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:940 6.a 6:517698f6:::obj_delete_at_hint.0000000121:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:02.776 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.560553+0000", 2024-05-08T18:30:02.776 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 10.115307620999999, 2024-05-08T18:30:02.776 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0030017569999999999, 2024-05-08T18:30:02.776 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:02.776 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:02.776 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:02.776 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:02.776 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:02.776 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:02.776 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 940 2024-05-08T18:30:02.777 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.777 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:02.777 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.777 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:02.777 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.560553+0000", 2024-05-08T18:30:02.777 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:02.777 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.777 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.777 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:02.777 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.560553+0000", 2024-05-08T18:30:02.777 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:02.777 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.777 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.777 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:02.778 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.560555+0000", 2024-05-08T18:30:02.778 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.39e-06 2024-05-08T18:30:02.778 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.778 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.778 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:02.778 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.560566+0000", 2024-05-08T18:30:02.778 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1484000000000001e-05 2024-05-08T18:30:02.778 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.778 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.778 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:02.778 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.560596+0000", 2024-05-08T18:30:02.778 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0001999999999998e-05 2024-05-08T18:30:02.778 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.778 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.779 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:02.779 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.560612+0000", 2024-05-08T18:30:02.779 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5690000000000001e-05 2024-05-08T18:30:02.779 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.779 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.779 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:02.779 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.560747+0000", 2024-05-08T18:30:02.779 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013494900000000001 2024-05-08T18:30:02.779 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.779 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.779 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:02.779 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.560961+0000", 2024-05-08T18:30:02.780 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000214305 2024-05-08T18:30:02.780 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.780 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.780 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:02.780 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.561281+0000", 2024-05-08T18:30:02.780 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00031933800000000001 2024-05-08T18:30:02.780 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.780 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.780 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:02.780 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.562399+0000", 2024-05-08T18:30:02.780 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0011180280000000001 2024-05-08T18:30:02.780 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.780 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.780 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:02.780 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.563407+0000", 2024-05-08T18:30:02.781 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010080519999999999 2024-05-08T18:30:02.781 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.781 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.781 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:02.781 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.563489+0000", 2024-05-08T18:30:02.781 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1725999999999996e-05 2024-05-08T18:30:02.781 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.781 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.781 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:02.781 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.563554+0000", 2024-05-08T18:30:02.781 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5792999999999998e-05 2024-05-08T18:30:02.781 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:02.781 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:02.782 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:02.782 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.782 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.782 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:943 6.19 6:9f21944d:::obj_delete_at_hint.0000000122:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:02.782 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.567777+0000", 2024-05-08T18:30:02.782 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 10.10808273, 2024-05-08T18:30:02.782 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0033921939999999999, 2024-05-08T18:30:02.782 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:02.782 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:02.782 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:02.782 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:02.782 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:02.782 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:02.782 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 943 2024-05-08T18:30:02.783 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.783 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:02.783 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.783 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:02.783 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.567777+0000", 2024-05-08T18:30:02.783 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:02.783 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.783 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.783 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:02.783 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.567777+0000", 2024-05-08T18:30:02.783 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:02.783 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.783 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.783 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:02.784 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.567779+0000", 2024-05-08T18:30:02.784 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8330000000000001e-06 2024-05-08T18:30:02.784 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.784 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.784 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:02.784 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.567788+0000", 2024-05-08T18:30:02.784 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4999999999999999e-06 2024-05-08T18:30:02.784 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.784 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.784 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:02.784 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.567812+0000", 2024-05-08T18:30:02.784 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.4207e-05 2024-05-08T18:30:02.784 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.784 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.785 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:02.785 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.567836+0000", 2024-05-08T18:30:02.785 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.4196e-05 2024-05-08T18:30:02.785 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.785 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.785 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:02.785 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.567954+0000", 2024-05-08T18:30:02.785 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011794300000000001 2024-05-08T18:30:02.785 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.785 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.785 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:02.785 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.568170+0000", 2024-05-08T18:30:02.785 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00021626100000000001 2024-05-08T18:30:02.785 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.786 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.786 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:02.786 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.568485+0000", 2024-05-08T18:30:02.786 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00031442800000000001 2024-05-08T18:30:02.786 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.786 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.786 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:02.786 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.569555+0000", 2024-05-08T18:30:02.786 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010698750000000001 2024-05-08T18:30:02.786 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.786 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.786 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:02.786 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.570899+0000", 2024-05-08T18:30:02.787 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0013446700000000001 2024-05-08T18:30:02.787 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.787 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.787 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:02.787 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.571058+0000", 2024-05-08T18:30:02.787 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015871900000000001 2024-05-08T18:30:02.787 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.787 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.787 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:02.787 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.571170+0000", 2024-05-08T18:30:02.787 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000111562 2024-05-08T18:30:02.787 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:02.787 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:02.787 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:02.788 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.788 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.788 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:952 6.a 6:541d369a:::obj_delete_at_hint.0000000125:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:02.788 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.588764+0000", 2024-05-08T18:30:02.788 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 10.087095699000001, 2024-05-08T18:30:02.788 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003183399, 2024-05-08T18:30:02.788 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:02.788 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:02.788 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:02.788 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:02.788 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:02.788 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:02.788 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 952 2024-05-08T18:30:02.789 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.789 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:02.789 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.789 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:02.789 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.588764+0000", 2024-05-08T18:30:02.789 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:02.789 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.789 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.789 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:02.789 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.588764+0000", 2024-05-08T18:30:02.789 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:02.789 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.789 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.789 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:02.789 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.588767+0000", 2024-05-08T18:30:02.790 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.39e-06 2024-05-08T18:30:02.790 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.790 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.790 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:02.790 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.588778+0000", 2024-05-08T18:30:02.790 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1304000000000001e-05 2024-05-08T18:30:02.790 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.790 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.790 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:02.790 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.588810+0000", 2024-05-08T18:30:02.790 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1726000000000001e-05 2024-05-08T18:30:02.790 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.791 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.791 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:02.791 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.588834+0000", 2024-05-08T18:30:02.791 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3845999999999998e-05 2024-05-08T18:30:02.791 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.791 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.791 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:02.791 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.588987+0000", 2024-05-08T18:30:02.791 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015300200000000001 2024-05-08T18:30:02.791 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.791 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.791 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:02.791 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.589197+0000", 2024-05-08T18:30:02.791 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020992299999999999 2024-05-08T18:30:02.792 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.792 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.792 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:02.792 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.589536+0000", 2024-05-08T18:30:02.792 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00033939300000000001 2024-05-08T18:30:02.792 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.792 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.792 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:02.792 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.590827+0000", 2024-05-08T18:30:02.792 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0012906 2024-05-08T18:30:02.792 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.792 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.792 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:02.792 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.591757+0000", 2024-05-08T18:30:02.793 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00093020699999999995 2024-05-08T18:30:02.793 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.793 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.793 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:02.793 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.591881+0000", 2024-05-08T18:30:02.793 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012406900000000001 2024-05-08T18:30:02.793 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:02.793 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:02.793 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:02.793 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.591948+0000", 2024-05-08T18:30:02.793 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6939000000000004e-05 2024-05-08T18:30:02.793 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:02.793 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:02.794 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:02.794 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:02.794 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:02.794 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:30:02.794 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-08T18:30:02.796 INFO:teuthology.orchestra.run.smithi097.stderr:reweighted osd.2 to 1 (10000) 2024-05-08T18:30:02.797 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-08T18:30:02.797 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:30:02.796+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:30:02.797 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-05-08T18:30:02.896 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:30:02.899+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:30:02.976 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:30:02.976 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:30:02.976 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 0 2024-05-08T18:30:02.976 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:30:02.990 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-08T18:30:03.040 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:30:03.040+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:30:03.099 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:30:03.096+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:30:03.113 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:30:03.113 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:30:03.113 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2024-05-08T18:30:03.113 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2024-05-08T18:30:03.113 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:30:03.127 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-08T18:30:03.199 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:30:03.199+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:30:03.295 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:30:03.295 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2024-05-08T18:30:03.295 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2024-05-08T18:30:03.295 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-05-08T18:30:03.295 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.295 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:30:03.295 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:48.647802+0000", 2024-05-08T18:30:03.295 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 14.644697166, 2024-05-08T18:30:03.296 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0027254660000000002, 2024-05-08T18:30:03.296 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:03.296 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:03.296 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:03.296 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:03.296 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:03.296 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:03.296 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 46 2024-05-08T18:30:03.296 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.296 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:03.296 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.296 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:03.297 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.647802+0000", 2024-05-08T18:30:03.297 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:03.297 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.297 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.297 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:03.297 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.647802+0000", 2024-05-08T18:30:03.297 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:03.297 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.297 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.297 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:03.297 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.647805+0000", 2024-05-08T18:30:03.298 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8940000000000002e-06 2024-05-08T18:30:03.298 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.298 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.298 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:03.298 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.647816+0000", 2024-05-08T18:30:03.298 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0998999999999999e-05 2024-05-08T18:30:03.298 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.298 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.298 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:03.298 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.647846+0000", 2024-05-08T18:30:03.298 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.027e-05 2024-05-08T18:30:03.299 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.299 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.299 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:03.299 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.647865+0000", 2024-05-08T18:30:03.299 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.808e-05 2024-05-08T18:30:03.299 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.299 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.299 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:03.299 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.647994+0000", 2024-05-08T18:30:03.299 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012923899999999999 2024-05-08T18:30:03.299 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.299 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.300 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:03.300 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.648289+0000", 2024-05-08T18:30:03.300 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029495999999999998 2024-05-08T18:30:03.300 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.300 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.300 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:03.300 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.648576+0000", 2024-05-08T18:30:03.300 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00028707599999999999 2024-05-08T18:30:03.300 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.300 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.300 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:03.300 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.649703+0000", 2024-05-08T18:30:03.301 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001126658 2024-05-08T18:30:03.301 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.301 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.301 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:03.301 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.650337+0000", 2024-05-08T18:30:03.301 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00063405500000000001 2024-05-08T18:30:03.301 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.301 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.301 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:03.301 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.650451+0000", 2024-05-08T18:30:03.301 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011476600000000001 2024-05-08T18:30:03.302 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.302 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.302 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:03.302 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.650528+0000", 2024-05-08T18:30:03.302 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6469000000000003e-05 2024-05-08T18:30:03.302 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:03.302 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:03.303 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:03.303 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.303 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.303 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94069412627456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:30:03.303 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:48.650773+0000", 2024-05-08T18:30:03.303 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 14.641726628000001, 2024-05-08T18:30:03.303 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0024358209999999999, 2024-05-08T18:30:03.303 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:03.303 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:03.303 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:03.303 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:03.303 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:03.303 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:03.303 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 47 2024-05-08T18:30:03.304 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.304 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:03.304 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.304 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:03.304 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.650773+0000", 2024-05-08T18:30:03.304 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:03.304 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.304 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.304 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:03.304 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.650773+0000", 2024-05-08T18:30:03.304 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:03.304 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.304 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.305 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:03.305 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.650775+0000", 2024-05-08T18:30:03.305 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.4030000000000001e-06 2024-05-08T18:30:03.305 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.305 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.305 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:03.305 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.650785+0000", 2024-05-08T18:30:03.305 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0027000000000001e-05 2024-05-08T18:30:03.305 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.305 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.305 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:03.305 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.650814+0000", 2024-05-08T18:30:03.305 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8350000000000001e-05 2024-05-08T18:30:03.305 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.306 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.306 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:03.306 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.650848+0000", 2024-05-08T18:30:03.306 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4566000000000001e-05 2024-05-08T18:30:03.306 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.306 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.306 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:03.306 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.650963+0000", 2024-05-08T18:30:03.306 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011506300000000001 2024-05-08T18:30:03.306 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.306 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.306 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:03.306 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.651153+0000", 2024-05-08T18:30:03.307 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000189812 2024-05-08T18:30:03.307 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.307 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.307 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:03.307 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.651493+0000", 2024-05-08T18:30:03.307 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000339616 2024-05-08T18:30:03.307 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.307 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.307 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:03.307 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.652662+0000", 2024-05-08T18:30:03.307 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0011695410000000001 2024-05-08T18:30:03.307 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.307 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.307 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:03.308 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.652998+0000", 2024-05-08T18:30:03.308 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000335788 2024-05-08T18:30:03.308 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.308 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.308 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:03.308 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.653076+0000", 2024-05-08T18:30:03.308 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8120000000000004e-05 2024-05-08T18:30:03.308 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.308 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.308 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:03.308 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.653209+0000", 2024-05-08T18:30:03.308 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000132535 2024-05-08T18:30:03.308 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:03.309 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:03.309 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:03.309 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.309 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.309 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:30:03.309 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:48.659528+0000", 2024-05-08T18:30:03.309 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 14.632971413, 2024-05-08T18:30:03.309 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0025123260000000001, 2024-05-08T18:30:03.309 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:03.309 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:03.309 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:03.309 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:03.309 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:03.310 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:03.310 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 54 2024-05-08T18:30:03.310 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.310 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:03.310 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.310 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:03.310 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.659528+0000", 2024-05-08T18:30:03.310 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:03.310 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.310 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.310 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:03.310 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.659528+0000", 2024-05-08T18:30:03.310 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:03.310 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.311 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.311 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:03.311 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.659530+0000", 2024-05-08T18:30:03.311 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9429999999999999e-06 2024-05-08T18:30:03.311 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.311 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.311 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:03.311 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.659540+0000", 2024-05-08T18:30:03.311 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0147e-05 2024-05-08T18:30:03.311 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.311 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.311 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:03.311 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.659569+0000", 2024-05-08T18:30:03.311 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.923e-05 2024-05-08T18:30:03.312 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.312 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.312 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:03.312 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.659584+0000", 2024-05-08T18:30:03.312 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4996e-05 2024-05-08T18:30:03.312 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.312 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.312 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:03.312 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.659716+0000", 2024-05-08T18:30:03.312 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000131457 2024-05-08T18:30:03.312 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.312 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.312 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:03.312 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.659895+0000", 2024-05-08T18:30:03.313 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017940400000000001 2024-05-08T18:30:03.313 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.313 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.313 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:03.313 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.660092+0000", 2024-05-08T18:30:03.313 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000197002 2024-05-08T18:30:03.313 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.313 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.313 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:03.313 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.661227+0000", 2024-05-08T18:30:03.313 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0011346150000000001 2024-05-08T18:30:03.313 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.313 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.313 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:03.314 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.661907+0000", 2024-05-08T18:30:03.314 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00068008800000000002 2024-05-08T18:30:03.314 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.314 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.314 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:03.314 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.661978+0000", 2024-05-08T18:30:03.314 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1538999999999994e-05 2024-05-08T18:30:03.314 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.314 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.314 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:03.314 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.662040+0000", 2024-05-08T18:30:03.314 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1904999999999998e-05 2024-05-08T18:30:03.314 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:03.314 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:03.315 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:03.315 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.315 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.315 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94069412622848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:30:03.315 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:48.662241+0000", 2024-05-08T18:30:03.315 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 14.630258087, 2024-05-08T18:30:03.315 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029022259999999999, 2024-05-08T18:30:03.315 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:03.315 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:03.315 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:03.315 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:03.315 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:03.315 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:03.315 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 55 2024-05-08T18:30:03.316 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.316 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:03.316 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.316 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:03.316 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.662241+0000", 2024-05-08T18:30:03.316 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:03.316 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.316 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.316 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:03.316 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.662241+0000", 2024-05-08T18:30:03.316 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:03.316 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.316 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.316 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:03.317 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.662243+0000", 2024-05-08T18:30:03.317 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.716e-06 2024-05-08T18:30:03.317 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.317 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.317 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:03.317 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.662267+0000", 2024-05-08T18:30:03.317 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3949999999999999e-05 2024-05-08T18:30:03.317 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.317 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.317 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:03.317 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.662293+0000", 2024-05-08T18:30:03.317 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6376e-05 2024-05-08T18:30:03.317 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.317 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.317 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:03.318 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.662310+0000", 2024-05-08T18:30:03.318 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6520000000000001e-05 2024-05-08T18:30:03.318 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.318 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.318 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:03.318 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.662412+0000", 2024-05-08T18:30:03.318 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010228700000000001 2024-05-08T18:30:03.318 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.318 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.318 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:03.318 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.662514+0000", 2024-05-08T18:30:03.318 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0001019 2024-05-08T18:30:03.318 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.319 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.319 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:03.319 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.662714+0000", 2024-05-08T18:30:03.319 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020008100000000001 2024-05-08T18:30:03.319 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.319 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.319 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:03.319 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.663711+0000", 2024-05-08T18:30:03.319 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00099629899999999997 2024-05-08T18:30:03.319 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.319 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.319 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:03.319 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.664976+0000", 2024-05-08T18:30:03.319 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0012652679999999999 2024-05-08T18:30:03.320 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.320 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.320 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:03.320 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.665047+0000", 2024-05-08T18:30:03.320 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1277000000000002e-05 2024-05-08T18:30:03.320 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.320 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.320 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:03.320 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.665144+0000", 2024-05-08T18:30:03.320 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6552000000000007e-05 2024-05-08T18:30:03.320 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:03.320 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:03.320 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:03.321 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.321 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.321 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:209 6.3 e33/27 6:c60da066:gc::gc.4:head v 33'1, mlcod=0'0)", 2024-05-08T18:30:03.321 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.686317+0000", 2024-05-08T18:30:03.321 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 11.606182083, 2024-05-08T18:30:03.321 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032126889999999999, 2024-05-08T18:30:03.321 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:03.321 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:03.321 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:03.321 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:03.321 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.321 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:03.321 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.686317+0000", 2024-05-08T18:30:03.322 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:03.322 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.322 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.322 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:03.322 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.686317+0000", 2024-05-08T18:30:03.322 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:03.322 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.322 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.322 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:03.322 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.686318+0000", 2024-05-08T18:30:03.322 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5400000000000001e-07 2024-05-08T18:30:03.322 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.322 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.322 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:03.323 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.686326+0000", 2024-05-08T18:30:03.323 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3000000000000002e-06 2024-05-08T18:30:03.323 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.323 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.323 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:03.323 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.686358+0000", 2024-05-08T18:30:03.323 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1702999999999998e-05 2024-05-08T18:30:03.323 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.323 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.323 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:03.323 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.686374+0000", 2024-05-08T18:30:03.324 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6266e-05 2024-05-08T18:30:03.324 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.324 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.324 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:03.324 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.686530+0000", 2024-05-08T18:30:03.324 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015583599999999999 2024-05-08T18:30:03.324 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.324 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.324 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:03.324 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.686573+0000", 2024-05-08T18:30:03.324 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3248999999999999e-05 2024-05-08T18:30:03.324 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.324 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.324 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:03.325 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.689412+0000", 2024-05-08T18:30:03.325 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0028385720000000001 2024-05-08T18:30:03.325 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.325 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.325 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:03.325 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.689530+0000", 2024-05-08T18:30:03.325 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000118109 2024-05-08T18:30:03.325 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:03.325 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:03.325 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:03.325 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.325 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.325 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:217 6.15 e33/27 6:ab569f81:gc::gc.12:head v 33'1, mlcod=0'0)", 2024-05-08T18:30:03.325 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.722458+0000", 2024-05-08T18:30:03.326 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 11.570041542, 2024-05-08T18:30:03.326 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001760604, 2024-05-08T18:30:03.326 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:03.326 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:03.326 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:03.326 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:03.326 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.326 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:03.326 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.722458+0000", 2024-05-08T18:30:03.326 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:03.326 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.326 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.326 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:03.326 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.722458+0000", 2024-05-08T18:30:03.327 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:03.327 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.327 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.327 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:03.327 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.722460+0000", 2024-05-08T18:30:03.327 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.677e-06 2024-05-08T18:30:03.327 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.327 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.327 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:03.327 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.722471+0000", 2024-05-08T18:30:03.327 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0956e-05 2024-05-08T18:30:03.327 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.327 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.327 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:03.328 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.722496+0000", 2024-05-08T18:30:03.328 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5490000000000002e-05 2024-05-08T18:30:03.328 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.328 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.328 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:03.328 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.722511+0000", 2024-05-08T18:30:03.328 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4687e-05 2024-05-08T18:30:03.328 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.328 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.328 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:03.328 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.722609+0000", 2024-05-08T18:30:03.328 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8152000000000005e-05 2024-05-08T18:30:03.328 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.328 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.329 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:03.329 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.722638+0000", 2024-05-08T18:30:03.329 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.934e-05 2024-05-08T18:30:03.329 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.329 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.329 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:03.329 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.724127+0000", 2024-05-08T18:30:03.329 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001488622 2024-05-08T18:30:03.329 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.329 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.329 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:03.329 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.724219+0000", 2024-05-08T18:30:03.329 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1680000000000003e-05 2024-05-08T18:30:03.330 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:03.330 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:03.330 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:03.330 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.330 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.330 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:231 6.1f e33/27 6:fde4dd55:gc::gc.26:head v 33'1, mlcod=0'0)", 2024-05-08T18:30:03.330 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.773905+0000", 2024-05-08T18:30:03.330 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 11.518594002, 2024-05-08T18:30:03.330 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002018681, 2024-05-08T18:30:03.330 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:03.330 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:03.331 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:03.331 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:03.332 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.332 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:03.332 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.773905+0000", 2024-05-08T18:30:03.332 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:03.332 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.332 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.332 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:03.332 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.773905+0000", 2024-05-08T18:30:03.332 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:03.333 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.333 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.333 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:03.333 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.773906+0000", 2024-05-08T18:30:03.333 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2300000000000001e-07 2024-05-08T18:30:03.333 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.334 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.334 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:03.334 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.773913+0000", 2024-05-08T18:30:03.334 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8399999999999997e-06 2024-05-08T18:30:03.334 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.334 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.334 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:03.334 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.773938+0000", 2024-05-08T18:30:03.335 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.4977000000000002e-05 2024-05-08T18:30:03.335 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.335 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.335 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:03.335 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.773970+0000", 2024-05-08T18:30:03.335 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1673e-05 2024-05-08T18:30:03.335 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.335 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.335 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:03.335 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.774112+0000", 2024-05-08T18:30:03.335 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014273899999999999 2024-05-08T18:30:03.335 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.336 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.336 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:03.336 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.774167+0000", 2024-05-08T18:30:03.336 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4762000000000002e-05 2024-05-08T18:30:03.336 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.336 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.336 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:03.336 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.775832+0000", 2024-05-08T18:30:03.336 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0016648539999999999 2024-05-08T18:30:03.336 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.336 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.336 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:03.337 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.775924+0000", 2024-05-08T18:30:03.337 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2312999999999995e-05 2024-05-08T18:30:03.337 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:03.337 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:03.337 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:03.337 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.337 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.337 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:328 6.15 e33/27 6:ab569f81:gc::gc.12:head v 33'3, mlcod=33'1)", 2024-05-08T18:30:03.337 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.811368+0000", 2024-05-08T18:30:03.337 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 11.481131501, 2024-05-08T18:30:03.337 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0019828110000000001, 2024-05-08T18:30:03.338 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:03.338 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:03.338 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:03.338 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:03.338 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.338 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:03.339 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.811368+0000", 2024-05-08T18:30:03.339 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:03.339 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.339 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.339 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:03.339 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.811368+0000", 2024-05-08T18:30:03.339 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:03.339 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.339 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.339 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:03.339 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.811370+0000", 2024-05-08T18:30:03.339 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.883e-06 2024-05-08T18:30:03.339 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.340 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.340 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:03.340 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.811385+0000", 2024-05-08T18:30:03.340 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5489999999999999e-05 2024-05-08T18:30:03.340 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.340 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.340 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:03.340 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.811422+0000", 2024-05-08T18:30:03.340 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7023000000000001e-05 2024-05-08T18:30:03.340 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.340 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.340 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:03.341 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.811443+0000", 2024-05-08T18:30:03.341 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0194e-05 2024-05-08T18:30:03.341 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.341 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.341 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:03.341 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.811582+0000", 2024-05-08T18:30:03.341 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000139068 2024-05-08T18:30:03.341 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.341 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.342 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:03.342 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.811646+0000", 2024-05-08T18:30:03.342 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4113000000000001e-05 2024-05-08T18:30:03.342 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.342 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.342 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:03.342 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.813243+0000", 2024-05-08T18:30:03.342 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0015969249999999999 2024-05-08T18:30:03.342 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.342 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.342 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:03.343 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.813351+0000", 2024-05-08T18:30:03.343 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000108115 2024-05-08T18:30:03.343 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:03.343 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:03.343 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:03.343 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.343 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.343 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:341 6.1 e33/27 6:856b9b26:reshard::reshard.0000000002:head v 33'2, mlcod=0'0)", 2024-05-08T18:30:03.343 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.813091+0000", 2024-05-08T18:30:03.343 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 11.479408233999999, 2024-05-08T18:30:03.343 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0021783459999999998, 2024-05-08T18:30:03.343 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:03.343 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:03.343 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:03.344 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:03.344 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.344 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:03.344 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.813091+0000", 2024-05-08T18:30:03.344 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:03.344 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.344 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.344 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:03.344 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.813091+0000", 2024-05-08T18:30:03.344 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:03.345 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.345 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.345 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:03.345 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.813093+0000", 2024-05-08T18:30:03.345 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.813e-06 2024-05-08T18:30:03.345 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.345 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.345 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:03.345 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.813107+0000", 2024-05-08T18:30:03.345 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3730000000000001e-05 2024-05-08T18:30:03.345 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.345 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.345 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:03.345 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.813177+0000", 2024-05-08T18:30:03.346 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9801999999999993e-05 2024-05-08T18:30:03.346 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.346 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.346 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:03.346 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.813198+0000", 2024-05-08T18:30:03.346 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1347000000000001e-05 2024-05-08T18:30:03.346 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.346 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.346 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:03.346 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.813321+0000", 2024-05-08T18:30:03.346 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000123192 2024-05-08T18:30:03.346 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.347 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.347 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:03.347 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.813373+0000", 2024-05-08T18:30:03.347 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2046999999999998e-05 2024-05-08T18:30:03.347 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.347 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.347 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:03.347 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.815181+0000", 2024-05-08T18:30:03.347 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001807562 2024-05-08T18:30:03.347 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.347 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.347 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:03.347 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.815270+0000", 2024-05-08T18:30:03.348 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8852999999999998e-05 2024-05-08T18:30:03.348 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:03.348 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:03.348 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:03.348 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.348 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.348 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:404 6.3 e33/27 6:c623b173:gc::gc.16:head v 33'6, mlcod=33'4)", 2024-05-08T18:30:03.348 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.837510+0000", 2024-05-08T18:30:03.348 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 11.454989922999999, 2024-05-08T18:30:03.348 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0023724549999999999, 2024-05-08T18:30:03.348 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:03.349 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:03.349 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:03.349 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:03.349 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.349 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:03.349 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.837510+0000", 2024-05-08T18:30:03.349 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:03.349 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.349 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.349 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:03.350 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.837510+0000", 2024-05-08T18:30:03.350 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:03.350 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.350 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.350 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:03.350 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.837511+0000", 2024-05-08T18:30:03.350 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.863e-06 2024-05-08T18:30:03.350 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.350 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.351 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:03.351 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.837526+0000", 2024-05-08T18:30:03.351 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4756999999999999e-05 2024-05-08T18:30:03.351 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.351 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.351 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:03.351 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.837564+0000", 2024-05-08T18:30:03.351 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7645999999999998e-05 2024-05-08T18:30:03.351 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.351 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.352 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:03.352 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.837584+0000", 2024-05-08T18:30:03.352 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9763999999999999e-05 2024-05-08T18:30:03.352 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.352 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.352 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:03.353 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.837724+0000", 2024-05-08T18:30:03.353 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014080200000000001 2024-05-08T18:30:03.353 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.353 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.353 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:03.353 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.837776+0000", 2024-05-08T18:30:03.353 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1279000000000002e-05 2024-05-08T18:30:03.353 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.353 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.353 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:03.353 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.839770+0000", 2024-05-08T18:30:03.353 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001994048 2024-05-08T18:30:03.353 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.354 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.354 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:03.354 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.839882+0000", 2024-05-08T18:30:03.354 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000112296 2024-05-08T18:30:03.354 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:03.354 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:03.354 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:03.354 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.354 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.354 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:414 6.c e33/27 6:338eb7e9:::obj_delete_at_hint.0000000008:head v 33'3, mlcod=33'1)", 2024-05-08T18:30:03.354 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.841401+0000", 2024-05-08T18:30:03.354 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 11.451098773, 2024-05-08T18:30:03.355 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001916865, 2024-05-08T18:30:03.355 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:03.355 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:03.355 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:03.355 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:03.355 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.355 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:03.355 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.841401+0000", 2024-05-08T18:30:03.355 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:03.355 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.355 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.355 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:03.356 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.841401+0000", 2024-05-08T18:30:03.356 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:03.356 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.356 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.356 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:03.356 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.841402+0000", 2024-05-08T18:30:03.356 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6899999999999999e-06 2024-05-08T18:30:03.356 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.356 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.356 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:03.356 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.841414+0000", 2024-05-08T18:30:03.356 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.183e-05 2024-05-08T18:30:03.356 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.357 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.357 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:03.357 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.841435+0000", 2024-05-08T18:30:03.357 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0876000000000001e-05 2024-05-08T18:30:03.357 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.357 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.357 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:03.357 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.841451+0000", 2024-05-08T18:30:03.357 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5784e-05 2024-05-08T18:30:03.357 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.357 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.357 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:03.358 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.841597+0000", 2024-05-08T18:30:03.358 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014639899999999999 2024-05-08T18:30:03.358 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.358 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.358 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:03.358 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.841656+0000", 2024-05-08T18:30:03.358 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8485e-05 2024-05-08T18:30:03.359 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.359 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.359 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:03.359 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.843235+0000", 2024-05-08T18:30:03.359 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0015787920000000001 2024-05-08T18:30:03.359 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.359 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.359 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:03.359 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.843318+0000", 2024-05-08T18:30:03.359 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3009000000000004e-05 2024-05-08T18:30:03.360 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:03.360 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:03.360 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:03.360 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.360 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.360 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:422 6.c e33/27 6:338eb7e9:::obj_delete_at_hint.0000000008:head v 33'4, mlcod=33'2)", 2024-05-08T18:30:03.360 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.844520+0000", 2024-05-08T18:30:03.360 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 11.447979627, 2024-05-08T18:30:03.360 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002269929, 2024-05-08T18:30:03.360 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:03.361 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:03.361 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:03.361 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:03.361 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.361 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:03.361 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.844520+0000", 2024-05-08T18:30:03.361 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:03.361 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.361 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.361 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:03.361 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.844520+0000", 2024-05-08T18:30:03.361 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:03.362 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.362 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.362 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:03.362 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.844522+0000", 2024-05-08T18:30:03.362 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.643e-06 2024-05-08T18:30:03.362 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.362 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.362 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:03.363 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.844577+0000", 2024-05-08T18:30:03.363 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5976000000000001e-05 2024-05-08T18:30:03.363 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.363 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.363 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:03.363 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.844613+0000", 2024-05-08T18:30:03.363 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5339999999999997e-05 2024-05-08T18:30:03.363 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.363 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.364 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:03.364 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.844638+0000", 2024-05-08T18:30:03.364 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5165999999999999e-05 2024-05-08T18:30:03.364 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.364 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.364 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:03.364 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.844795+0000", 2024-05-08T18:30:03.364 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015660899999999999 2024-05-08T18:30:03.364 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.364 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.364 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:03.365 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.844841+0000", 2024-05-08T18:30:03.365 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6279999999999997e-05 2024-05-08T18:30:03.365 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.365 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.365 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:03.365 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.846707+0000", 2024-05-08T18:30:03.365 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0018657249999999999 2024-05-08T18:30:03.365 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.365 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.365 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:03.365 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.846790+0000", 2024-05-08T18:30:03.365 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3189999999999995e-05 2024-05-08T18:30:03.365 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:03.366 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:03.366 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:03.366 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.366 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.366 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:425 6.a e33/27 6:50d64734:::obj_delete_at_hint.0000000009:head v 33'2, mlcod=0'0)", 2024-05-08T18:30:03.366 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.848220+0000", 2024-05-08T18:30:03.366 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 11.444279508999999, 2024-05-08T18:30:03.366 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0017145109999999999, 2024-05-08T18:30:03.366 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:03.366 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:03.366 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:03.366 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:03.367 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.367 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:03.367 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.848220+0000", 2024-05-08T18:30:03.367 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:03.367 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.367 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.367 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:03.367 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.848220+0000", 2024-05-08T18:30:03.367 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:03.368 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.368 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.368 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:03.368 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.848222+0000", 2024-05-08T18:30:03.368 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9630000000000001e-06 2024-05-08T18:30:03.368 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.368 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.368 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:03.368 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.848254+0000", 2024-05-08T18:30:03.369 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2047e-05 2024-05-08T18:30:03.369 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.369 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.369 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:03.369 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.848273+0000", 2024-05-08T18:30:03.369 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9493000000000001e-05 2024-05-08T18:30:03.369 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.369 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.369 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:03.369 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.848286+0000", 2024-05-08T18:30:03.369 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2490000000000001e-05 2024-05-08T18:30:03.370 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.370 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.370 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:03.370 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.848414+0000", 2024-05-08T18:30:03.370 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000127785 2024-05-08T18:30:03.370 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.370 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.370 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:03.370 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.848448+0000", 2024-05-08T18:30:03.370 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4233999999999998e-05 2024-05-08T18:30:03.370 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.371 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.371 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:03.371 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.849855+0000", 2024-05-08T18:30:03.371 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001407482 2024-05-08T18:30:03.371 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.371 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.371 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:03.371 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.849934+0000", 2024-05-08T18:30:03.371 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9017000000000006e-05 2024-05-08T18:30:03.371 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:03.371 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:03.371 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:03.372 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.372 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.372 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:436 6.a e33/27 6:55b0279d:reshard::reshard.0000000009:head v 33'4, mlcod=33'1)", 2024-05-08T18:30:03.372 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.853725+0000", 2024-05-08T18:30:03.372 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 11.438773992, 2024-05-08T18:30:03.372 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032824949999999999, 2024-05-08T18:30:03.372 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:03.372 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:03.372 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:03.372 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:03.373 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.373 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:03.373 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.853725+0000", 2024-05-08T18:30:03.373 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:03.373 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.373 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.373 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:03.373 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.853725+0000", 2024-05-08T18:30:03.373 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:03.373 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.373 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.374 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:03.374 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.853727+0000", 2024-05-08T18:30:03.374 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6899999999999999e-06 2024-05-08T18:30:03.374 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.374 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.374 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:03.374 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.853742+0000", 2024-05-08T18:30:03.374 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.517e-05 2024-05-08T18:30:03.374 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.374 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.375 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:03.375 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.853778+0000", 2024-05-08T18:30:03.375 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5173999999999999e-05 2024-05-08T18:30:03.375 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.375 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.375 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:03.375 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.853791+0000", 2024-05-08T18:30:03.375 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.345e-05 2024-05-08T18:30:03.375 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.375 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.376 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:03.376 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.853912+0000", 2024-05-08T18:30:03.376 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012149199999999999 2024-05-08T18:30:03.376 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.376 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.376 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:03.376 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.853960+0000", 2024-05-08T18:30:03.376 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7262999999999998e-05 2024-05-08T18:30:03.376 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.376 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.376 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:03.376 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.856896+0000", 2024-05-08T18:30:03.377 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029363700000000002 2024-05-08T18:30:03.377 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.377 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.377 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:03.377 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.857008+0000", 2024-05-08T18:30:03.377 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011188600000000001 2024-05-08T18:30:03.377 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:03.377 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:03.377 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:03.377 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.377 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.377 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:457 6.1 e33/27 6:80b6fe23:reshard::reshard.0000000011:head v 33'3, mlcod=33'1)", 2024-05-08T18:30:03.377 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.865322+0000", 2024-05-08T18:30:03.378 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 11.427177347000001, 2024-05-08T18:30:03.378 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001750756, 2024-05-08T18:30:03.378 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:03.378 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:03.378 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:03.378 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:03.378 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.378 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:03.378 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.865322+0000", 2024-05-08T18:30:03.378 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:03.378 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.379 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.379 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:03.379 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.865322+0000", 2024-05-08T18:30:03.379 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:03.379 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.379 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.379 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:03.379 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.865325+0000", 2024-05-08T18:30:03.379 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5660000000000001e-06 2024-05-08T18:30:03.379 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.379 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.379 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:03.379 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.865339+0000", 2024-05-08T18:30:03.379 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.412e-05 2024-05-08T18:30:03.380 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.380 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.380 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:03.380 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.865366+0000", 2024-05-08T18:30:03.380 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7453e-05 2024-05-08T18:30:03.380 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.380 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.380 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:03.380 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.865383+0000", 2024-05-08T18:30:03.381 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.683e-05 2024-05-08T18:30:03.381 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.381 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.381 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:03.381 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.865514+0000", 2024-05-08T18:30:03.381 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000131369 2024-05-08T18:30:03.381 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.381 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.381 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:03.381 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.865583+0000", 2024-05-08T18:30:03.382 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8526000000000001e-05 2024-05-08T18:30:03.382 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.382 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.382 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:03.382 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.866974+0000", 2024-05-08T18:30:03.382 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001391193 2024-05-08T18:30:03.382 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.382 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.382 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:03.382 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.867073+0000", 2024-05-08T18:30:03.382 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8698999999999998e-05 2024-05-08T18:30:03.383 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:03.383 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:03.383 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:03.383 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.383 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.383 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:478 6.a e33/27 6:5127e642:gc::gc.21:head v 33'6, mlcod=33'4)", 2024-05-08T18:30:03.383 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.877617+0000", 2024-05-08T18:30:03.384 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 11.414882234, 2024-05-08T18:30:03.384 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0033938589999999999, 2024-05-08T18:30:03.384 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:03.384 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:03.384 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:03.384 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:03.385 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.385 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:03.385 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877617+0000", 2024-05-08T18:30:03.385 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:03.385 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.385 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.386 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:03.386 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877617+0000", 2024-05-08T18:30:03.386 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:03.386 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.386 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.387 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:03.387 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877619+0000", 2024-05-08T18:30:03.387 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.902e-06 2024-05-08T18:30:03.387 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.387 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.387 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:03.387 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877633+0000", 2024-05-08T18:30:03.387 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4143e-05 2024-05-08T18:30:03.387 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.388 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.388 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:03.388 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877667+0000", 2024-05-08T18:30:03.388 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3516999999999998e-05 2024-05-08T18:30:03.388 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.388 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.388 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:03.388 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877685+0000", 2024-05-08T18:30:03.389 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7931000000000002e-05 2024-05-08T18:30:03.389 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.389 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.389 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:03.389 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877842+0000", 2024-05-08T18:30:03.389 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015742800000000001 2024-05-08T18:30:03.389 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.389 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.389 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:03.389 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877890+0000", 2024-05-08T18:30:03.389 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7654000000000001e-05 2024-05-08T18:30:03.389 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.390 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.390 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:03.390 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.880908+0000", 2024-05-08T18:30:03.390 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0030181219999999998 2024-05-08T18:30:03.390 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.390 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.390 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:03.390 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.881011+0000", 2024-05-08T18:30:03.391 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000103162 2024-05-08T18:30:03.391 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:03.391 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:03.391 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:03.391 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.391 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.391 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:535 6.1f e33/27 6:fde4dd55:gc::gc.26:head v 33'2, mlcod=0'0)", 2024-05-08T18:30:03.391 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.909602+0000", 2024-05-08T18:30:03.391 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 11.382897788999999, 2024-05-08T18:30:03.392 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0023004039999999998, 2024-05-08T18:30:03.392 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:03.392 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:03.392 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:03.392 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:03.392 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.392 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:03.392 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.909602+0000", 2024-05-08T18:30:03.392 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:03.392 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.393 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.393 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:03.393 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.909602+0000", 2024-05-08T18:30:03.393 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:03.393 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.394 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.394 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:03.394 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.909604+0000", 2024-05-08T18:30:03.394 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8360000000000001e-06 2024-05-08T18:30:03.394 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.395 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.395 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:03.395 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.909615+0000", 2024-05-08T18:30:03.395 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1596999999999999e-05 2024-05-08T18:30:03.395 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.395 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.395 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:03.395 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.909643+0000", 2024-05-08T18:30:03.395 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7457000000000002e-05 2024-05-08T18:30:03.395 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.396 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.396 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:03.396 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.909662+0000", 2024-05-08T18:30:03.396 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9052999999999999e-05 2024-05-08T18:30:03.396 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.396 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.396 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:03.397 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.909758+0000", 2024-05-08T18:30:03.397 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6372000000000005e-05 2024-05-08T18:30:03.397 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.397 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.397 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:03.397 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.909780+0000", 2024-05-08T18:30:03.397 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1719999999999999e-05 2024-05-08T18:30:03.397 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.397 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.397 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:03.398 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.911830+0000", 2024-05-08T18:30:03.398 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002050072 2024-05-08T18:30:03.398 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.398 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.398 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:03.399 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.911902+0000", 2024-05-08T18:30:03.399 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.2297000000000003e-05 2024-05-08T18:30:03.399 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:03.399 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:03.399 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:03.400 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.400 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.400 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:541 6.1f e33/27 6:fde4dd55:gc::gc.26:head v 33'3, mlcod=33'1)", 2024-05-08T18:30:03.400 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.913684+0000", 2024-05-08T18:30:03.400 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 11.378815741, 2024-05-08T18:30:03.400 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0036425770000000001, 2024-05-08T18:30:03.400 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:03.400 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:03.400 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:03.400 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:03.401 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.401 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:03.401 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.913684+0000", 2024-05-08T18:30:03.401 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:03.401 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.401 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.401 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:03.401 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.913684+0000", 2024-05-08T18:30:03.401 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:03.401 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.402 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.402 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:03.402 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.913685+0000", 2024-05-08T18:30:03.402 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5859999999999999e-06 2024-05-08T18:30:03.402 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.403 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.403 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:03.403 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.913696+0000", 2024-05-08T18:30:03.403 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1080000000000001e-05 2024-05-08T18:30:03.403 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.403 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.404 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:03.404 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.913720+0000", 2024-05-08T18:30:03.404 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3614000000000001e-05 2024-05-08T18:30:03.404 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.404 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.404 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:03.404 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.913740+0000", 2024-05-08T18:30:03.404 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9836000000000001e-05 2024-05-08T18:30:03.404 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.404 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.405 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:03.405 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.913901+0000", 2024-05-08T18:30:03.405 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000161039 2024-05-08T18:30:03.405 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.405 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.405 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:03.405 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.913935+0000", 2024-05-08T18:30:03.406 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4353000000000001e-05 2024-05-08T18:30:03.406 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.406 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.406 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:03.406 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.917225+0000", 2024-05-08T18:30:03.406 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032897669999999999 2024-05-08T18:30:03.406 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.406 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.407 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:03.407 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.917326+0000", 2024-05-08T18:30:03.407 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000101302 2024-05-08T18:30:03.407 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:03.407 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:03.408 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:03.408 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.408 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.408 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:543 6.15 e33/27 6:ae95b544:::obj_delete_at_hint.0000000020:head v 33'5, mlcod=33'3)", 2024-05-08T18:30:03.408 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.916649+0000", 2024-05-08T18:30:03.408 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 11.375850187999999, 2024-05-08T18:30:03.409 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003362739, 2024-05-08T18:30:03.409 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:03.409 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:03.409 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:03.409 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:03.409 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.409 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:03.409 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.916649+0000", 2024-05-08T18:30:03.409 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:03.410 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.410 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.410 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:03.410 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.916649+0000", 2024-05-08T18:30:03.410 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:03.410 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.410 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.410 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:03.411 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.916651+0000", 2024-05-08T18:30:03.411 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7269999999999999e-06 2024-05-08T18:30:03.411 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.411 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.411 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:03.411 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.916663+0000", 2024-05-08T18:30:03.412 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2183e-05 2024-05-08T18:30:03.412 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.412 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.412 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:03.412 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.916691+0000", 2024-05-08T18:30:03.412 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7864e-05 2024-05-08T18:30:03.413 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.413 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.413 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:03.413 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.916710+0000", 2024-05-08T18:30:03.413 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.912e-05 2024-05-08T18:30:03.413 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.413 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.413 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:03.413 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.916851+0000", 2024-05-08T18:30:03.414 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000141163 2024-05-08T18:30:03.414 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.414 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.414 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:03.414 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.916909+0000", 2024-05-08T18:30:03.414 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.7686000000000003e-05 2024-05-08T18:30:03.414 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.415 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.415 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:03.415 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.919900+0000", 2024-05-08T18:30:03.415 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029909540000000001 2024-05-08T18:30:03.415 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.415 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.415 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:03.415 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.920012+0000", 2024-05-08T18:30:03.416 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000112042 2024-05-08T18:30:03.416 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:03.416 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:03.416 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:03.416 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.416 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.417 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:695 6.3 e33/27 6:c31f41d7:gc::gc.10:head v 33'12, mlcod=33'10)", 2024-05-08T18:30:03.417 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.017806+0000", 2024-05-08T18:30:03.417 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 11.274693903999999, 2024-05-08T18:30:03.417 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001718373, 2024-05-08T18:30:03.417 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:03.417 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:03.418 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:03.418 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:03.418 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.418 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:03.418 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.017806+0000", 2024-05-08T18:30:03.418 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:03.418 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.419 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.419 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:03.419 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.017806+0000", 2024-05-08T18:30:03.419 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:03.419 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.419 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.419 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:03.419 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.017807+0000", 2024-05-08T18:30:03.419 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8199999999999999e-06 2024-05-08T18:30:03.420 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.420 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.420 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:03.420 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.017818+0000", 2024-05-08T18:30:03.420 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0519999999999999e-05 2024-05-08T18:30:03.421 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.421 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.421 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:03.421 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.017846+0000", 2024-05-08T18:30:03.421 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7729000000000002e-05 2024-05-08T18:30:03.421 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.422 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.422 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:03.422 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.017859+0000", 2024-05-08T18:30:03.422 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3337e-05 2024-05-08T18:30:03.422 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.422 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.422 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:03.423 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.017990+0000", 2024-05-08T18:30:03.423 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013146499999999999 2024-05-08T18:30:03.423 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.423 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.423 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:03.423 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.018039+0000", 2024-05-08T18:30:03.424 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8816999999999997e-05 2024-05-08T18:30:03.424 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.424 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.424 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:03.424 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.019397+0000", 2024-05-08T18:30:03.424 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0013575359999999999 2024-05-08T18:30:03.424 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.424 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.425 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:03.425 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.019524+0000", 2024-05-08T18:30:03.425 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012714900000000001 2024-05-08T18:30:03.425 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:03.425 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:03.425 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:03.426 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:03.426 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:03.426 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:30:03.428 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-08T18:30:03.428 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:30:03.428+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:30:03.529 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:30:03.531+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:30:03.602 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:30:03.602 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:30:03.602 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 0 2024-05-08T18:30:03.602 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:30:03.616 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-08T18:30:03.660 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:30:03.660+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:30:03.705 INFO:teuthology.orchestra.run.smithi097.stderr:nodeep-scrub is set 2024-05-08T18:30:03.713 INFO:teuthology.orchestra.run.smithi097.stderr:reweighted osd.3 to 1 (10000) 2024-05-08T18:30:03.731 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:30:03.731+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:30:03.736 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:30:03.737 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:30:03.737 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2024-05-08T18:30:03.737 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2024-05-08T18:30:03.737 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:30:03.738 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-05-08T18:30:03.751 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-08T18:30:03.831 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:30:03.831+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:30:03.922 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:30:03.922 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2024-05-08T18:30:03.922 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2024-05-08T18:30:03.922 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-05-08T18:30:03.923 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.923 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:24 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [write 262144~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:03.923 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.154193+0000", 2024-05-08T18:30:03.923 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 36.766052664999997, 2024-05-08T18:30:03.923 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0085494309999999997, 2024-05-08T18:30:03.923 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:03.923 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:03.923 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:03.923 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:03.923 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:03.923 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:03.923 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 24 2024-05-08T18:30:03.923 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.924 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:03.924 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.924 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:03.924 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154193+0000", 2024-05-08T18:30:03.924 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:03.924 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.924 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.924 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:03.924 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154193+0000", 2024-05-08T18:30:03.924 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:03.924 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.924 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.924 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:03.924 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154194+0000", 2024-05-08T18:30:03.925 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.44e-06 2024-05-08T18:30:03.925 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.925 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.925 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:03.925 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154394+0000", 2024-05-08T18:30:03.925 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00019972499999999999 2024-05-08T18:30:03.925 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.925 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.925 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:03.925 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154417+0000", 2024-05-08T18:30:03.925 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2713000000000001e-05 2024-05-08T18:30:03.925 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.925 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.925 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:03.926 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154437+0000", 2024-05-08T18:30:03.926 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0027e-05 2024-05-08T18:30:03.926 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.926 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.926 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:03.926 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.158438+0000", 2024-05-08T18:30:03.926 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0040011459999999997 2024-05-08T18:30:03.926 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.926 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.926 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:03.926 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.158567+0000", 2024-05-08T18:30:03.926 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012923899999999999 2024-05-08T18:30:03.926 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.927 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.927 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:03.927 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.158787+0000", 2024-05-08T18:30:03.927 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000219581 2024-05-08T18:30:03.927 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.927 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.927 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:03.927 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.162013+0000", 2024-05-08T18:30:03.927 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032261759999999999 2024-05-08T18:30:03.927 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.927 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.927 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:03.927 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.162568+0000", 2024-05-08T18:30:03.927 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00055576900000000001 2024-05-08T18:30:03.928 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.928 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.928 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:03.928 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.162644+0000", 2024-05-08T18:30:03.928 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5516e-05 2024-05-08T18:30:03.928 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.928 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.928 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:03.928 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.162742+0000", 2024-05-08T18:30:03.928 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8098999999999997e-05 2024-05-08T18:30:03.928 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:03.928 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:03.928 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:03.928 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.929 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.929 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:25 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:03.929 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.154495+0000", 2024-05-08T18:30:03.929 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 36.765750371000003, 2024-05-08T18:30:03.929 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010784396999999999, 2024-05-08T18:30:03.929 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:03.929 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:03.929 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:03.929 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:03.929 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:03.929 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:03.929 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 25 2024-05-08T18:30:03.929 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.929 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:03.930 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.930 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:03.930 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154495+0000", 2024-05-08T18:30:03.930 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:03.930 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.930 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.930 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:03.930 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154495+0000", 2024-05-08T18:30:03.930 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:03.930 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.930 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.930 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:03.930 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154496+0000", 2024-05-08T18:30:03.930 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.454e-06 2024-05-08T18:30:03.931 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.931 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.931 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:03.931 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154509+0000", 2024-05-08T18:30:03.931 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2496e-05 2024-05-08T18:30:03.931 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.931 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.931 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:03.931 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154531+0000", 2024-05-08T18:30:03.931 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1987000000000001e-05 2024-05-08T18:30:03.931 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.931 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.931 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:03.931 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154547+0000", 2024-05-08T18:30:03.932 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.577e-05 2024-05-08T18:30:03.932 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.932 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.932 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:03.932 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.160949+0000", 2024-05-08T18:30:03.932 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.006401917 2024-05-08T18:30:03.932 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.932 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.932 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:03.932 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.161102+0000", 2024-05-08T18:30:03.932 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000153826 2024-05-08T18:30:03.932 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.932 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.932 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:03.933 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.161332+0000", 2024-05-08T18:30:03.933 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022918099999999999 2024-05-08T18:30:03.933 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.933 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.933 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:03.933 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.163838+0000", 2024-05-08T18:30:03.933 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0025064079999999999 2024-05-08T18:30:03.933 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.933 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.933 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:03.933 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.165121+0000", 2024-05-08T18:30:03.933 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0012825200000000001 2024-05-08T18:30:03.933 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.933 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.933 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:03.934 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.165212+0000", 2024-05-08T18:30:03.934 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1121999999999999e-05 2024-05-08T18:30:03.934 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.934 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.934 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:03.934 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.165279+0000", 2024-05-08T18:30:03.934 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7716e-05 2024-05-08T18:30:03.934 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:03.934 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:03.934 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:03.934 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.934 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.934 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:41 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:03.935 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247174+0000", 2024-05-08T18:30:03.935 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 36.673071389, 2024-05-08T18:30:03.935 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010013393000000001, 2024-05-08T18:30:03.935 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:03.935 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:03.935 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:03.935 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:03.935 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:03.935 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:03.935 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 41 2024-05-08T18:30:03.935 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.935 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:03.935 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.935 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:03.935 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247174+0000", 2024-05-08T18:30:03.936 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:03.936 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.936 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.936 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:03.936 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247174+0000", 2024-05-08T18:30:03.936 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:03.936 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.936 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.936 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:03.936 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247175+0000", 2024-05-08T18:30:03.936 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.9999999999999995e-07 2024-05-08T18:30:03.936 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.936 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.937 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:03.937 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247277+0000", 2024-05-08T18:30:03.937 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010243600000000001 2024-05-08T18:30:03.937 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.937 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.937 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:03.937 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247291+0000", 2024-05-08T18:30:03.937 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4076999999999999e-05 2024-05-08T18:30:03.937 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.937 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.937 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:03.937 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247301+0000", 2024-05-08T18:30:03.937 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0010000000000001e-05 2024-05-08T18:30:03.938 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.938 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.938 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:03.938 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.249555+0000", 2024-05-08T18:30:03.938 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0022539050000000001 2024-05-08T18:30:03.938 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.938 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.938 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:03.938 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.249700+0000", 2024-05-08T18:30:03.938 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014484599999999999 2024-05-08T18:30:03.939 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.939 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.939 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:03.939 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.249929+0000", 2024-05-08T18:30:03.939 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022904499999999999 2024-05-08T18:30:03.939 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.939 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.939 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:03.939 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.253695+0000", 2024-05-08T18:30:03.939 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0037656640000000002 2024-05-08T18:30:03.939 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.939 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.939 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:03.940 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.256970+0000", 2024-05-08T18:30:03.940 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003274608 2024-05-08T18:30:03.940 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.940 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.940 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:03.940 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.257052+0000", 2024-05-08T18:30:03.940 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2223000000000002e-05 2024-05-08T18:30:03.940 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.940 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.940 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:03.940 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.257187+0000", 2024-05-08T18:30:03.940 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013557900000000001 2024-05-08T18:30:03.940 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:03.940 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:03.941 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:03.941 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.941 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.941 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:42 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:03.941 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247321+0000", 2024-05-08T18:30:03.941 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 36.672924070000001, 2024-05-08T18:30:03.941 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013168572, 2024-05-08T18:30:03.941 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:03.941 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:03.941 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:03.941 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:03.941 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:03.941 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:03.941 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 42 2024-05-08T18:30:03.942 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.942 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:03.942 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.942 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:03.942 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247321+0000", 2024-05-08T18:30:03.942 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:03.942 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.942 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.942 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:03.942 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247321+0000", 2024-05-08T18:30:03.942 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:03.942 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.942 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.943 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:03.943 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247323+0000", 2024-05-08T18:30:03.943 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.24e-06 2024-05-08T18:30:03.943 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.943 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.943 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:03.943 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247329+0000", 2024-05-08T18:30:03.943 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1530000000000002e-06 2024-05-08T18:30:03.943 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.943 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.943 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:03.943 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247339+0000", 2024-05-08T18:30:03.943 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0387000000000001e-05 2024-05-08T18:30:03.943 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.944 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.944 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:03.944 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247347+0000", 2024-05-08T18:30:03.944 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9829999999999996e-06 2024-05-08T18:30:03.944 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.944 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.944 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:03.944 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.251488+0000", 2024-05-08T18:30:03.944 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0041412849999999998 2024-05-08T18:30:03.944 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.944 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.944 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:03.945 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.251672+0000", 2024-05-08T18:30:03.945 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00018354499999999999 2024-05-08T18:30:03.945 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.945 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.945 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:03.945 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.251949+0000", 2024-05-08T18:30:03.945 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00027695399999999999 2024-05-08T18:30:03.945 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.945 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.945 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:03.945 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.253810+0000", 2024-05-08T18:30:03.945 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001860806 2024-05-08T18:30:03.946 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.946 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.946 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:03.946 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260244+0000", 2024-05-08T18:30:03.946 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0064347939999999998 2024-05-08T18:30:03.946 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.946 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.946 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:03.946 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260376+0000", 2024-05-08T18:30:03.946 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000131829 2024-05-08T18:30:03.946 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.946 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.946 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:03.946 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260490+0000", 2024-05-08T18:30:03.947 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000113596 2024-05-08T18:30:03.947 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:03.947 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:03.947 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:03.947 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.947 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.947 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:43 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:03.947 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247367+0000", 2024-05-08T18:30:03.947 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 36.672878157, 2024-05-08T18:30:03.947 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013449025999999999, 2024-05-08T18:30:03.947 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:03.947 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:03.947 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:03.947 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:03.947 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:03.948 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:03.948 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 43 2024-05-08T18:30:03.948 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.948 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:03.948 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.948 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:03.948 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247367+0000", 2024-05-08T18:30:03.948 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:03.948 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.948 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.948 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:03.948 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247367+0000", 2024-05-08T18:30:03.948 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:03.948 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.949 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.949 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:03.949 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247368+0000", 2024-05-08T18:30:03.949 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1999999999999999e-07 2024-05-08T18:30:03.949 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.949 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.949 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:03.949 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247374+0000", 2024-05-08T18:30:03.949 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.19e-06 2024-05-08T18:30:03.949 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.949 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.949 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:03.949 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247384+0000", 2024-05-08T18:30:03.949 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0173000000000001e-05 2024-05-08T18:30:03.949 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.950 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.950 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:03.950 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247392+0000", 2024-05-08T18:30:03.950 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1869999999999997e-06 2024-05-08T18:30:03.950 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.950 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.950 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:03.950 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.252515+0000", 2024-05-08T18:30:03.950 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0051221399999999999 2024-05-08T18:30:03.950 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.950 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.950 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:03.950 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.252641+0000", 2024-05-08T18:30:03.951 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012609200000000001 2024-05-08T18:30:03.951 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.951 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.951 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:03.951 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.252842+0000", 2024-05-08T18:30:03.951 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000201619 2024-05-08T18:30:03.951 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.951 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.951 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:03.951 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.256828+0000", 2024-05-08T18:30:03.951 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039853989999999997 2024-05-08T18:30:03.951 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.951 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.951 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:03.951 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260515+0000", 2024-05-08T18:30:03.952 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0036875419999999998 2024-05-08T18:30:03.952 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.952 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.952 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:03.952 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260718+0000", 2024-05-08T18:30:03.952 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020229499999999999 2024-05-08T18:30:03.952 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.952 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.952 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:03.952 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260816+0000", 2024-05-08T18:30:03.952 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8669e-05 2024-05-08T18:30:03.952 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:03.952 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:03.952 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:03.953 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.953 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.953 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:03.953 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247466+0000", 2024-05-08T18:30:03.953 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 36.672779571, 2024-05-08T18:30:03.953 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013491806, 2024-05-08T18:30:03.953 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:03.953 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:03.953 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:03.953 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:03.953 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:03.953 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:03.953 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 44 2024-05-08T18:30:03.954 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.954 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:03.954 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.954 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:03.954 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247466+0000", 2024-05-08T18:30:03.954 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:03.954 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.954 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.954 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:03.954 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247466+0000", 2024-05-08T18:30:03.954 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:03.954 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.954 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.954 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:03.955 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247467+0000", 2024-05-08T18:30:03.955 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.263e-06 2024-05-08T18:30:03.955 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.955 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.955 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:03.955 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247585+0000", 2024-05-08T18:30:03.955 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011756600000000001 2024-05-08T18:30:03.955 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.955 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.955 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:03.955 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247598+0000", 2024-05-08T18:30:03.955 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3766e-05 2024-05-08T18:30:03.955 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.955 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.956 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:03.956 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247609+0000", 2024-05-08T18:30:03.956 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0604e-05 2024-05-08T18:30:03.956 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.956 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.956 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:03.956 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.253890+0000", 2024-05-08T18:30:03.956 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0062810440000000004 2024-05-08T18:30:03.956 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.956 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.956 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:03.956 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.254068+0000", 2024-05-08T18:30:03.956 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017848199999999999 2024-05-08T18:30:03.956 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.957 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.957 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:03.957 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.254488+0000", 2024-05-08T18:30:03.957 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00041965399999999999 2024-05-08T18:30:03.957 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.957 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.957 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:03.957 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.256949+0000", 2024-05-08T18:30:03.957 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002461254 2024-05-08T18:30:03.957 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.957 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.957 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:03.957 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260832+0000", 2024-05-08T18:30:03.957 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0038830539999999999 2024-05-08T18:30:03.958 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.958 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.958 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:03.958 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260906+0000", 2024-05-08T18:30:03.958 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3455999999999996e-05 2024-05-08T18:30:03.958 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.958 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.958 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:03.958 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260958+0000", 2024-05-08T18:30:03.958 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1663000000000003e-05 2024-05-08T18:30:03.958 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:03.958 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:03.958 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:03.958 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.959 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.959 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:03.959 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247630+0000", 2024-05-08T18:30:03.959 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 36.672615166, 2024-05-08T18:30:03.959 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013478753, 2024-05-08T18:30:03.959 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:03.959 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:03.959 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:03.959 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:03.959 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:03.959 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:03.959 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 45 2024-05-08T18:30:03.959 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.959 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:03.960 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.960 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:03.960 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247630+0000", 2024-05-08T18:30:03.960 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:03.960 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.960 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.960 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:03.960 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247630+0000", 2024-05-08T18:30:03.960 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:03.960 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.960 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.960 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:03.960 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247631+0000", 2024-05-08T18:30:03.960 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7399999999999991e-07 2024-05-08T18:30:03.960 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.961 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.961 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:03.961 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247637+0000", 2024-05-08T18:30:03.961 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.93e-06 2024-05-08T18:30:03.961 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.961 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.961 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:03.961 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247647+0000", 2024-05-08T18:30:03.961 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7459999999999995e-06 2024-05-08T18:30:03.961 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.961 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.961 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:03.961 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247654+0000", 2024-05-08T18:30:03.961 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4039999999999998e-06 2024-05-08T18:30:03.962 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.962 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.962 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:03.962 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.255829+0000", 2024-05-08T18:30:03.962 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0081749059999999991 2024-05-08T18:30:03.962 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.962 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.962 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:03.962 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.255979+0000", 2024-05-08T18:30:03.962 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015027899999999999 2024-05-08T18:30:03.962 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.962 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.962 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:03.962 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.256185+0000", 2024-05-08T18:30:03.963 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020583900000000001 2024-05-08T18:30:03.963 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.963 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.963 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:03.963 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260097+0000", 2024-05-08T18:30:03.963 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039121929999999996 2024-05-08T18:30:03.963 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.963 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.963 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:03.963 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260973+0000", 2024-05-08T18:30:03.963 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00087591999999999998 2024-05-08T18:30:03.963 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.963 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.964 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:03.964 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261056+0000", 2024-05-08T18:30:03.964 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3104999999999998e-05 2024-05-08T18:30:03.964 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.964 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.964 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:03.964 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261109+0000", 2024-05-08T18:30:03.964 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2457000000000003e-05 2024-05-08T18:30:03.964 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:03.964 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:03.964 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:03.964 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.964 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.964 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:03.965 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247667+0000", 2024-05-08T18:30:03.965 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 36.672577885999999, 2024-05-08T18:30:03.965 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013569098999999999, 2024-05-08T18:30:03.965 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:03.965 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:03.965 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:03.965 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:03.965 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:03.965 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:03.965 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 46 2024-05-08T18:30:03.965 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.965 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:03.965 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.965 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:03.965 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247667+0000", 2024-05-08T18:30:03.966 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:03.966 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.966 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.966 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:03.966 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247667+0000", 2024-05-08T18:30:03.966 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:03.966 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.966 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.966 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:03.966 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247668+0000", 2024-05-08T18:30:03.966 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7999999999999995e-07 2024-05-08T18:30:03.966 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.967 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.967 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:03.967 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247674+0000", 2024-05-08T18:30:03.967 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4369999999999998e-06 2024-05-08T18:30:03.967 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.967 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.967 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:03.967 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247683+0000", 2024-05-08T18:30:03.967 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4360000000000008e-06 2024-05-08T18:30:03.967 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.967 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.967 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:03.967 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247690+0000", 2024-05-08T18:30:03.967 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.43e-06 2024-05-08T18:30:03.968 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.968 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.968 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:03.968 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.257358+0000", 2024-05-08T18:30:03.968 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0096676890000000001 2024-05-08T18:30:03.968 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.968 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.968 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:03.968 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.257626+0000", 2024-05-08T18:30:03.968 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00026819099999999998 2024-05-08T18:30:03.968 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.968 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.968 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:03.968 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.258041+0000", 2024-05-08T18:30:03.968 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00041438400000000001 2024-05-08T18:30:03.969 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.969 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.969 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:03.969 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260224+0000", 2024-05-08T18:30:03.969 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0021830700000000001 2024-05-08T18:30:03.969 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.969 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.969 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:03.969 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261127+0000", 2024-05-08T18:30:03.969 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00090292300000000003 2024-05-08T18:30:03.969 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.969 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.969 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:03.969 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261191+0000", 2024-05-08T18:30:03.970 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4342000000000002e-05 2024-05-08T18:30:03.970 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.970 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.970 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:03.970 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261237+0000", 2024-05-08T18:30:03.970 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.5516999999999998e-05 2024-05-08T18:30:03.970 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:03.970 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:03.970 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:03.970 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.970 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.970 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:03.970 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247703+0000", 2024-05-08T18:30:03.971 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 36.672542403000001, 2024-05-08T18:30:03.971 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015020204000000001, 2024-05-08T18:30:03.971 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:03.971 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:03.971 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:03.971 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:03.971 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:03.971 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:03.971 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 47 2024-05-08T18:30:03.971 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.971 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:03.971 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.971 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:03.971 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247703+0000", 2024-05-08T18:30:03.972 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:03.972 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.972 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.972 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:03.972 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247703+0000", 2024-05-08T18:30:03.972 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:03.972 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.972 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.972 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:03.972 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247704+0000", 2024-05-08T18:30:03.972 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8299999999999996e-07 2024-05-08T18:30:03.972 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.972 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.972 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:03.973 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247877+0000", 2024-05-08T18:30:03.973 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000172979 2024-05-08T18:30:03.973 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.973 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.973 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:03.973 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247894+0000", 2024-05-08T18:30:03.973 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6912999999999999e-05 2024-05-08T18:30:03.973 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.973 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.973 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:03.973 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247903+0000", 2024-05-08T18:30:03.973 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1770000000000004e-06 2024-05-08T18:30:03.973 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.973 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.974 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:03.974 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.258767+0000", 2024-05-08T18:30:03.974 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010864409 2024-05-08T18:30:03.974 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.974 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.974 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:03.974 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.258898+0000", 2024-05-08T18:30:03.974 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000131199 2024-05-08T18:30:03.974 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.974 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.974 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:03.974 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.259117+0000", 2024-05-08T18:30:03.974 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000218889 2024-05-08T18:30:03.974 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.975 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.975 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:03.975 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.262372+0000", 2024-05-08T18:30:03.975 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032545679999999998 2024-05-08T18:30:03.975 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.975 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.975 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:03.975 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.262432+0000", 2024-05-08T18:30:03.975 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9913e-05 2024-05-08T18:30:03.975 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.975 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.975 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:03.975 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.262585+0000", 2024-05-08T18:30:03.975 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015361800000000001 2024-05-08T18:30:03.975 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.976 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.976 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:03.976 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.262723+0000", 2024-05-08T18:30:03.976 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000137856 2024-05-08T18:30:03.976 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:03.976 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:03.976 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:03.976 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.976 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.976 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:03.976 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247927+0000", 2024-05-08T18:30:03.976 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 36.672318365000002, 2024-05-08T18:30:03.976 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018387718000000001, 2024-05-08T18:30:03.976 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:03.976 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:03.977 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:03.977 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:03.977 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:03.977 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:03.977 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 48 2024-05-08T18:30:03.977 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.977 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:03.977 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.977 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:03.977 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247927+0000", 2024-05-08T18:30:03.977 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:03.977 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.977 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.977 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:03.978 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247927+0000", 2024-05-08T18:30:03.978 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:03.978 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.978 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.978 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:03.978 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247928+0000", 2024-05-08T18:30:03.978 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8400000000000003e-07 2024-05-08T18:30:03.978 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.978 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.978 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:03.978 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247935+0000", 2024-05-08T18:30:03.978 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1230000000000002e-06 2024-05-08T18:30:03.978 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.978 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.979 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:03.979 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247945+0000", 2024-05-08T18:30:03.979 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0346000000000001e-05 2024-05-08T18:30:03.979 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.979 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.979 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:03.979 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247953+0000", 2024-05-08T18:30:03.979 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8040000000000002e-06 2024-05-08T18:30:03.979 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.979 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.979 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:03.979 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261292+0000", 2024-05-08T18:30:03.979 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013339337 2024-05-08T18:30:03.979 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.980 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.980 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:03.980 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261424+0000", 2024-05-08T18:30:03.980 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013201900000000001 2024-05-08T18:30:03.980 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.980 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.980 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:03.980 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261628+0000", 2024-05-08T18:30:03.980 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020327499999999999 2024-05-08T18:30:03.980 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.980 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.980 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:03.980 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.263849+0000", 2024-05-08T18:30:03.980 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0022209759999999999 2024-05-08T18:30:03.981 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.981 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.981 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:03.981 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266167+0000", 2024-05-08T18:30:03.981 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002317979 2024-05-08T18:30:03.981 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.981 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.981 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:03.981 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266249+0000", 2024-05-08T18:30:03.981 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1996000000000006e-05 2024-05-08T18:30:03.981 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.981 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.981 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:03.981 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266315+0000", 2024-05-08T18:30:03.982 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5979e-05 2024-05-08T18:30:03.982 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:03.982 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:03.982 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:03.982 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.982 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.982 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:03.982 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247966+0000", 2024-05-08T18:30:03.982 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 36.672279432000003, 2024-05-08T18:30:03.982 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0194153, 2024-05-08T18:30:03.982 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:03.982 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:03.982 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:03.982 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:03.983 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:03.983 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:03.983 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 49 2024-05-08T18:30:03.983 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.983 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:03.983 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.983 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:03.983 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247966+0000", 2024-05-08T18:30:03.983 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:03.983 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.983 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.983 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:03.983 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247966+0000", 2024-05-08T18:30:03.983 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:03.984 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.984 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.984 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:03.984 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247967+0000", 2024-05-08T18:30:03.984 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0299999999999998e-07 2024-05-08T18:30:03.984 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.984 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.984 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:03.984 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247972+0000", 2024-05-08T18:30:03.984 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3600000000000004e-06 2024-05-08T18:30:03.984 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.984 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.984 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:03.984 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247981+0000", 2024-05-08T18:30:03.985 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.234e-06 2024-05-08T18:30:03.985 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.985 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.985 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:03.985 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247989+0000", 2024-05-08T18:30:03.985 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5159999999999997e-06 2024-05-08T18:30:03.985 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.985 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.985 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:03.985 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.262816+0000", 2024-05-08T18:30:03.985 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.014827399999999999 2024-05-08T18:30:03.985 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.985 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.985 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:03.986 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.262948+0000", 2024-05-08T18:30:03.986 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013166799999999999 2024-05-08T18:30:03.986 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.986 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.986 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:03.986 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.263153+0000", 2024-05-08T18:30:03.986 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000205272 2024-05-08T18:30:03.986 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.986 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.986 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:03.986 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266144+0000", 2024-05-08T18:30:03.986 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029912300000000001 2024-05-08T18:30:03.986 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.986 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.987 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:03.987 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.267226+0000", 2024-05-08T18:30:03.987 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010820580000000001 2024-05-08T18:30:03.987 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.987 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.987 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:03.987 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.267315+0000", 2024-05-08T18:30:03.987 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8793000000000002e-05 2024-05-08T18:30:03.987 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.987 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.987 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:03.987 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.267381+0000", 2024-05-08T18:30:03.987 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6066000000000001e-05 2024-05-08T18:30:03.987 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:03.988 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:03.988 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:03.988 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.988 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.988 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:03.988 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.248003+0000", 2024-05-08T18:30:03.988 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 36.672242132000001, 2024-05-08T18:30:03.988 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.020859638999999999, 2024-05-08T18:30:03.988 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:03.988 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:03.988 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:03.988 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:03.988 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:03.988 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:03.988 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 50 2024-05-08T18:30:03.989 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.989 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:03.989 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.989 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:03.989 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248003+0000", 2024-05-08T18:30:03.989 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:03.989 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.989 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.989 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:03.989 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248003+0000", 2024-05-08T18:30:03.989 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:03.989 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.989 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.989 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:03.990 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248004+0000", 2024-05-08T18:30:03.990 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5300000000000003e-07 2024-05-08T18:30:03.990 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.990 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.990 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:03.990 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248139+0000", 2024-05-08T18:30:03.990 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000135193 2024-05-08T18:30:03.990 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.990 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.990 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:03.990 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248151+0000", 2024-05-08T18:30:03.990 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.19e-05 2024-05-08T18:30:03.990 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.990 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.991 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:03.991 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248161+0000", 2024-05-08T18:30:03.991 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4599999999999992e-06 2024-05-08T18:30:03.991 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.991 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.991 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:03.991 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.263961+0000", 2024-05-08T18:30:03.991 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015800844000000001 2024-05-08T18:30:03.991 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.991 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.991 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:03.991 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.264091+0000", 2024-05-08T18:30:03.991 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012952300000000001 2024-05-08T18:30:03.991 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.992 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.992 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:03.992 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.264306+0000", 2024-05-08T18:30:03.992 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000215541 2024-05-08T18:30:03.992 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.992 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.992 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:03.992 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.267205+0000", 2024-05-08T18:30:03.992 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0028989910000000001 2024-05-08T18:30:03.992 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.992 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.992 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:03.992 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.268631+0000", 2024-05-08T18:30:03.992 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0014257320000000001 2024-05-08T18:30:03.993 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.993 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.993 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:03.993 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.268781+0000", 2024-05-08T18:30:03.993 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000149939 2024-05-08T18:30:03.993 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.993 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.993 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:03.993 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.268863+0000", 2024-05-08T18:30:03.993 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1762999999999996e-05 2024-05-08T18:30:03.993 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:03.993 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:03.993 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:03.994 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.994 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.994 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:03.994 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.248201+0000", 2024-05-08T18:30:03.994 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 36.672044376999999, 2024-05-08T18:30:03.994 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.022909783, 2024-05-08T18:30:03.994 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:03.994 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:03.994 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:03.994 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:03.994 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:03.994 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:03.994 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 51 2024-05-08T18:30:03.994 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.995 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:03.995 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.995 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:03.995 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248201+0000", 2024-05-08T18:30:03.995 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:03.995 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.995 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.995 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:03.995 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248201+0000", 2024-05-08T18:30:03.995 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:03.995 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.995 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.995 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:03.995 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248202+0000", 2024-05-08T18:30:03.996 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2999999999999999e-07 2024-05-08T18:30:03.996 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.996 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.996 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:03.996 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248209+0000", 2024-05-08T18:30:03.996 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5769999999999996e-06 2024-05-08T18:30:03.996 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.996 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.996 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:03.996 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248221+0000", 2024-05-08T18:30:03.996 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1165999999999999e-05 2024-05-08T18:30:03.996 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.996 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.997 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:03.997 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248229+0000", 2024-05-08T18:30:03.997 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1529999999999997e-06 2024-05-08T18:30:03.997 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.997 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.997 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:03.997 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.265146+0000", 2024-05-08T18:30:03.997 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016917492999999999 2024-05-08T18:30:03.997 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.997 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.997 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:03.997 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.265282+0000", 2024-05-08T18:30:03.997 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013597199999999999 2024-05-08T18:30:03.997 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.998 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.998 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:03.998 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.265488+0000", 2024-05-08T18:30:03.998 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000206212 2024-05-08T18:30:03.998 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.998 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.998 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:03.998 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.268442+0000", 2024-05-08T18:30:03.998 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002953841 2024-05-08T18:30:03.998 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.998 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.998 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:03.999 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.270951+0000", 2024-05-08T18:30:03.999 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0025085670000000002 2024-05-08T18:30:03.999 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.999 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.999 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:03.999 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.271042+0000", 2024-05-08T18:30:03.999 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1485999999999998e-05 2024-05-08T18:30:03.999 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:03.999 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:03.999 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:03.999 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.271111+0000", 2024-05-08T18:30:03.999 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8386000000000006e-05 2024-05-08T18:30:03.999 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:03.999 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:03.999 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:04.000 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.000 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.000 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:04.000 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.248244+0000", 2024-05-08T18:30:04.000 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 36.672001821000002, 2024-05-08T18:30:04.000 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.023010806000000002, 2024-05-08T18:30:04.000 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:04.000 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:04.000 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:04.000 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:04.000 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:04.000 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:04.000 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 52 2024-05-08T18:30:04.001 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.001 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:04.001 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.001 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:04.001 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248244+0000", 2024-05-08T18:30:04.001 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:04.001 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.001 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.001 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:04.001 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248244+0000", 2024-05-08T18:30:04.001 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:04.001 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.001 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.001 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:04.002 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248244+0000", 2024-05-08T18:30:04.002 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0999999999999998e-07 2024-05-08T18:30:04.002 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.002 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.002 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:04.002 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248251+0000", 2024-05-08T18:30:04.002 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9639999999999997e-06 2024-05-08T18:30:04.002 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.002 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.002 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:04.002 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248266+0000", 2024-05-08T18:30:04.002 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4996e-05 2024-05-08T18:30:04.002 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.003 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.003 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:04.003 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248274+0000", 2024-05-08T18:30:04.003 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8299999999999996e-06 2024-05-08T18:30:04.003 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.003 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.003 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:04.003 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266367+0000", 2024-05-08T18:30:04.003 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018092607 2024-05-08T18:30:04.003 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.003 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.004 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:04.004 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266532+0000", 2024-05-08T18:30:04.004 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016569600000000001 2024-05-08T18:30:04.004 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.004 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.004 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:04.004 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266729+0000", 2024-05-08T18:30:04.004 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00019630099999999999 2024-05-08T18:30:04.004 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.004 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.004 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:04.004 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.268574+0000", 2024-05-08T18:30:04.004 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0018452329999999999 2024-05-08T18:30:04.004 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.005 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.005 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:04.005 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.271128+0000", 2024-05-08T18:30:04.005 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00255369 2024-05-08T18:30:04.005 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.005 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.005 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:04.005 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.271199+0000", 2024-05-08T18:30:04.005 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1712999999999996e-05 2024-05-08T18:30:04.005 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.005 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.005 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:04.005 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.271254+0000", 2024-05-08T18:30:04.005 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5065999999999998e-05 2024-05-08T18:30:04.006 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:04.006 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:04.006 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:04.006 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.006 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.006 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:04.006 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.486052+0000", 2024-05-08T18:30:04.006 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 36.434193377, 2024-05-08T18:30:04.006 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0098898389999999992, 2024-05-08T18:30:04.006 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:04.006 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:04.006 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:04.007 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:04.007 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:04.007 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:04.007 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 72 2024-05-08T18:30:04.007 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.007 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:04.007 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.007 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:04.007 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486052+0000", 2024-05-08T18:30:04.007 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:04.007 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.007 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.007 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:04.007 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486052+0000", 2024-05-08T18:30:04.007 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:04.008 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.008 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.008 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:04.008 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486053+0000", 2024-05-08T18:30:04.008 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1200000000000001e-07 2024-05-08T18:30:04.008 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.008 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.008 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:04.008 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486188+0000", 2024-05-08T18:30:04.008 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013526200000000001 2024-05-08T18:30:04.008 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.008 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.008 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:04.009 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486205+0000", 2024-05-08T18:30:04.009 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6742e-05 2024-05-08T18:30:04.009 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.009 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.009 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:04.009 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486215+0000", 2024-05-08T18:30:04.009 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8290000000000003e-06 2024-05-08T18:30:04.009 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.009 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.009 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:04.009 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.491930+0000", 2024-05-08T18:30:04.009 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0057153660000000004 2024-05-08T18:30:04.009 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.009 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.010 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:04.010 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.491995+0000", 2024-05-08T18:30:04.010 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5289000000000005e-05 2024-05-08T18:30:04.010 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.010 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.010 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:04.010 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.492096+0000", 2024-05-08T18:30:04.010 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010101400000000001 2024-05-08T18:30:04.010 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.010 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.010 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:04.010 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.494152+0000", 2024-05-08T18:30:04.010 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0020560740000000002 2024-05-08T18:30:04.010 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.011 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.011 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:04.011 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.495860+0000", 2024-05-08T18:30:04.011 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0017076159999999999 2024-05-08T18:30:04.011 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.011 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.011 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:04.011 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.495903+0000", 2024-05-08T18:30:04.011 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3009000000000001e-05 2024-05-08T18:30:04.011 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.011 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.011 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:04.011 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.495942+0000", 2024-05-08T18:30:04.012 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8726000000000002e-05 2024-05-08T18:30:04.012 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:04.012 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:04.012 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:04.012 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.012 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.012 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:04.012 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.486234+0000", 2024-05-08T18:30:04.012 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 36.434011308999999, 2024-05-08T18:30:04.012 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0099742340000000002, 2024-05-08T18:30:04.012 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:04.012 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:04.012 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:04.012 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:04.013 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:04.013 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:04.013 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 73 2024-05-08T18:30:04.013 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.013 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:04.013 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.013 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:04.013 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486234+0000", 2024-05-08T18:30:04.013 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:04.013 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.013 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.013 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:04.013 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486234+0000", 2024-05-08T18:30:04.013 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:04.014 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.014 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.014 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:04.014 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486235+0000", 2024-05-08T18:30:04.014 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.108e-06 2024-05-08T18:30:04.014 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.014 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.014 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:04.014 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486241+0000", 2024-05-08T18:30:04.014 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4e-06 2024-05-08T18:30:04.014 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.014 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.014 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:04.015 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486251+0000", 2024-05-08T18:30:04.015 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0209e-05 2024-05-08T18:30:04.015 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.015 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.015 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:04.015 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486260+0000", 2024-05-08T18:30:04.015 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2709999999999998e-06 2024-05-08T18:30:04.015 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.015 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.015 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:04.015 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.493294+0000", 2024-05-08T18:30:04.015 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0070341070000000004 2024-05-08T18:30:04.015 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.015 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.016 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:04.016 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.493370+0000", 2024-05-08T18:30:04.016 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5846999999999994e-05 2024-05-08T18:30:04.016 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.016 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.016 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:04.016 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.493479+0000", 2024-05-08T18:30:04.016 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010905500000000001 2024-05-08T18:30:04.016 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.016 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.016 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:04.016 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.495950+0000", 2024-05-08T18:30:04.016 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0024709749999999998 2024-05-08T18:30:04.016 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.016 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.017 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:04.017 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496023+0000", 2024-05-08T18:30:04.017 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3071999999999994e-05 2024-05-08T18:30:04.017 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.017 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.017 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:04.017 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496091+0000", 2024-05-08T18:30:04.017 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7646999999999998e-05 2024-05-08T18:30:04.017 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.017 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.017 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:04.017 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496208+0000", 2024-05-08T18:30:04.017 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000117543 2024-05-08T18:30:04.017 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:04.018 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:04.018 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:04.018 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.018 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.018 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:04.018 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.486276+0000", 2024-05-08T18:30:04.018 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 36.433968984000003, 2024-05-08T18:30:04.018 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010822577, 2024-05-08T18:30:04.018 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:04.018 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:04.018 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:04.018 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:04.018 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:04.019 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:04.019 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 74 2024-05-08T18:30:04.019 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.019 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:04.019 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.019 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:04.019 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486276+0000", 2024-05-08T18:30:04.019 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:04.019 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.019 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.019 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:04.019 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486276+0000", 2024-05-08T18:30:04.019 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:04.019 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.020 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.020 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:04.020 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486277+0000", 2024-05-08T18:30:04.020 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1699999999999997e-07 2024-05-08T18:30:04.020 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.020 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.020 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:04.020 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486282+0000", 2024-05-08T18:30:04.020 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0429999999999998e-06 2024-05-08T18:30:04.020 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.020 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.020 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:04.020 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486294+0000", 2024-05-08T18:30:04.020 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1717e-05 2024-05-08T18:30:04.020 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.021 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.021 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:04.021 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486303+0000", 2024-05-08T18:30:04.021 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.3999999999999998e-06 2024-05-08T18:30:04.021 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.021 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.021 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:04.021 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.494424+0000", 2024-05-08T18:30:04.021 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0081205960000000008 2024-05-08T18:30:04.021 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.021 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.021 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:04.021 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.494539+0000", 2024-05-08T18:30:04.021 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000115661 2024-05-08T18:30:04.022 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.022 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.022 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:04.022 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.494704+0000", 2024-05-08T18:30:04.022 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016422999999999999 2024-05-08T18:30:04.022 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.022 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.022 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:04.022 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496800+0000", 2024-05-08T18:30:04.022 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002096508 2024-05-08T18:30:04.022 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.022 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.022 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:04.022 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496889+0000", 2024-05-08T18:30:04.023 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8349000000000004e-05 2024-05-08T18:30:04.023 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.023 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.023 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:04.023 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496983+0000", 2024-05-08T18:30:04.023 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4882000000000004e-05 2024-05-08T18:30:04.023 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.023 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.023 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:04.023 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.497099+0000", 2024-05-08T18:30:04.023 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000115474 2024-05-08T18:30:04.023 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:04.023 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:04.023 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:04.024 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.024 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.024 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:04.024 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.486324+0000", 2024-05-08T18:30:04.024 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 36.433920964000002, 2024-05-08T18:30:04.024 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010949207000000001, 2024-05-08T18:30:04.024 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:04.024 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:04.024 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:04.024 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:04.024 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:04.024 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:04.024 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 75 2024-05-08T18:30:04.024 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.025 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:04.025 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.025 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:04.025 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486324+0000", 2024-05-08T18:30:04.025 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:04.025 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.025 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.025 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:04.025 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486324+0000", 2024-05-08T18:30:04.025 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:04.025 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.025 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.025 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:04.025 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486325+0000", 2024-05-08T18:30:04.025 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6200000000000006e-07 2024-05-08T18:30:04.026 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.026 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.026 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:04.026 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486439+0000", 2024-05-08T18:30:04.026 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000113391 2024-05-08T18:30:04.026 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.026 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.026 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:04.026 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486455+0000", 2024-05-08T18:30:04.026 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5823000000000001e-05 2024-05-08T18:30:04.026 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.026 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.026 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:04.027 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486465+0000", 2024-05-08T18:30:04.027 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0879999999999999e-05 2024-05-08T18:30:04.027 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.027 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.027 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:04.027 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.495149+0000", 2024-05-08T18:30:04.027 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0086833589999999999 2024-05-08T18:30:04.027 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.027 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.027 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:04.027 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.495213+0000", 2024-05-08T18:30:04.027 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4176000000000004e-05 2024-05-08T18:30:04.027 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.027 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.027 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:04.028 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.495350+0000", 2024-05-08T18:30:04.028 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013709099999999999 2024-05-08T18:30:04.028 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.028 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.028 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:04.028 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496809+0000", 2024-05-08T18:30:04.028 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001458953 2024-05-08T18:30:04.028 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.028 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.028 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:04.028 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.497199+0000", 2024-05-08T18:30:04.028 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00039045200000000001 2024-05-08T18:30:04.028 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.028 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.029 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:04.029 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.497241+0000", 2024-05-08T18:30:04.029 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1378999999999998e-05 2024-05-08T18:30:04.029 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.029 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.029 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:04.029 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.497274+0000", 2024-05-08T18:30:04.029 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2740999999999997e-05 2024-05-08T18:30:04.029 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:04.029 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:04.029 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:04.029 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.029 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.029 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:04.029 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.486483+0000", 2024-05-08T18:30:04.030 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 36.433762788999999, 2024-05-08T18:30:04.030 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011783448, 2024-05-08T18:30:04.030 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:04.030 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:04.030 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:04.030 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:04.030 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:04.030 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:04.030 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 76 2024-05-08T18:30:04.030 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.030 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:04.030 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.030 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:04.030 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486483+0000", 2024-05-08T18:30:04.031 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:04.031 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.031 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.031 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:04.031 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486483+0000", 2024-05-08T18:30:04.031 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:04.031 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.031 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.031 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:04.031 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486483+0000", 2024-05-08T18:30:04.031 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6599999999999995e-07 2024-05-08T18:30:04.031 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.031 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.031 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:04.032 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486491+0000", 2024-05-08T18:30:04.032 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.2520000000000002e-06 2024-05-08T18:30:04.032 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.032 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.032 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:04.032 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486500+0000", 2024-05-08T18:30:04.032 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4420000000000004e-06 2024-05-08T18:30:04.032 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.032 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.032 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:04.032 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486507+0000", 2024-05-08T18:30:04.032 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3549999999999999e-06 2024-05-08T18:30:04.032 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.032 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.032 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:04.033 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496319+0000", 2024-05-08T18:30:04.033 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0098120529999999994 2024-05-08T18:30:04.033 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.033 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.033 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:04.033 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496391+0000", 2024-05-08T18:30:04.033 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1433000000000005e-05 2024-05-08T18:30:04.033 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.033 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.033 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:04.033 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496508+0000", 2024-05-08T18:30:04.033 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000116778 2024-05-08T18:30:04.033 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.033 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.034 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:04.034 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.497284+0000", 2024-05-08T18:30:04.034 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00077609100000000002 2024-05-08T18:30:04.034 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.034 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.034 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:04.034 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.498204+0000", 2024-05-08T18:30:04.034 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00092027299999999999 2024-05-08T18:30:04.034 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.034 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.034 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:04.034 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.498240+0000", 2024-05-08T18:30:04.034 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5979999999999998e-05 2024-05-08T18:30:04.034 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.035 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.035 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:04.035 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.498266+0000", 2024-05-08T18:30:04.035 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6024999999999999e-05 2024-05-08T18:30:04.035 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:04.035 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:04.035 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:04.035 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.035 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.035 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:94 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:04.035 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.842580+0000", 2024-05-08T18:30:04.035 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 36.077665488000001, 2024-05-08T18:30:04.035 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0085315870000000002, 2024-05-08T18:30:04.035 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:04.035 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:04.036 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:04.036 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:04.036 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:04.036 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:04.036 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 94 2024-05-08T18:30:04.036 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.036 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:04.036 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.036 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:04.036 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.842580+0000", 2024-05-08T18:30:04.036 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:04.036 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.036 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.036 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:04.037 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.842580+0000", 2024-05-08T18:30:04.037 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:04.037 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.037 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.037 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:04.037 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.842581+0000", 2024-05-08T18:30:04.037 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.11e-06 2024-05-08T18:30:04.037 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.037 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.037 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:04.037 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.842587+0000", 2024-05-08T18:30:04.037 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2899999999999999e-06 2024-05-08T18:30:04.037 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.037 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.038 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:04.038 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.842597+0000", 2024-05-08T18:30:04.038 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.007e-05 2024-05-08T18:30:04.038 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.038 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.038 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:04.038 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.842605+0000", 2024-05-08T18:30:04.038 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1270000000000003e-06 2024-05-08T18:30:04.038 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.038 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.038 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:04.038 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.848358+0000", 2024-05-08T18:30:04.038 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0057525140000000002 2024-05-08T18:30:04.038 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.039 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.039 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:04.039 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.848481+0000", 2024-05-08T18:30:04.039 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000123239 2024-05-08T18:30:04.039 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.039 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.039 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:04.039 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.848695+0000", 2024-05-08T18:30:04.039 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000213387 2024-05-08T18:30:04.039 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.039 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.039 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:04.039 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.849781+0000", 2024-05-08T18:30:04.039 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010868 2024-05-08T18:30:04.039 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.040 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.040 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:04.040 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.850990+0000", 2024-05-08T18:30:04.040 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0012084769999999999 2024-05-08T18:30:04.040 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.040 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.040 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:04.040 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.851059+0000", 2024-05-08T18:30:04.040 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9130999999999999e-05 2024-05-08T18:30:04.040 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:04.040 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:04.040 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:04.040 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.851111+0000", 2024-05-08T18:30:04.040 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2441999999999997e-05 2024-05-08T18:30:04.041 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:04.041 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:04.041 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:04.041 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:04.041 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:04.041 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:30:04.042 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-08T18:30:04.043 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:30:04.043+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:30:04.143 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:30:04.144+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:30:04.168 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:30:04.168 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:30:04.169 INFO:teuthology.orchestra.run.smithi097.stdout: "num_ops": 0 2024-05-08T18:30:04.169 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:30:04.182 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-08T18:30:04.244 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:30:04.243+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:30:04.304 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:30:04.304 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:30:04.304 INFO:teuthology.orchestra.run.smithi097.stdout: "complaint_time": 30, 2024-05-08T18:30:04.304 INFO:teuthology.orchestra.run.smithi097.stdout: "num_blocked_ops": 0 2024-05-08T18:30:04.304 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:30:04.319 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-08T18:30:04.345 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:30:04.344+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:30:04.446 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:30:04.444+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:30:04.448 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-08T18:30:04.486 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:30:04.486 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2024-05-08T18:30:04.486 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2024-05-08T18:30:04.486 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-05-08T18:30:04.486 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.486 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4206.0:24 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'14, mlcod=16'9)", 2024-05-08T18:30:04.486 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:27.162224+0000", 2024-05-08T18:30:04.486 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 37.326887307, 2024-05-08T18:30:04.486 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032712890000000001, 2024-05-08T18:30:04.486 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:04.486 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:04.487 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:04.487 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:04.487 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.487 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:04.487 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162224+0000", 2024-05-08T18:30:04.487 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:04.487 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.487 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.487 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:04.487 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162224+0000", 2024-05-08T18:30:04.487 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:04.487 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.487 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.488 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:04.488 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162225+0000", 2024-05-08T18:30:04.488 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4899999999999999e-06 2024-05-08T18:30:04.488 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.488 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.488 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:04.488 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162306+0000", 2024-05-08T18:30:04.488 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.0589999999999999e-05 2024-05-08T18:30:04.488 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.488 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.488 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:04.488 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162332+0000", 2024-05-08T18:30:04.488 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5658999999999999e-05 2024-05-08T18:30:04.489 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.489 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.489 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:04.489 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162345+0000", 2024-05-08T18:30:04.489 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3512999999999999e-05 2024-05-08T18:30:04.489 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.489 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.489 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:04.489 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162465+0000", 2024-05-08T18:30:04.489 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000119577 2024-05-08T18:30:04.489 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.489 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.489 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:04.489 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162513+0000", 2024-05-08T18:30:04.490 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8773999999999998e-05 2024-05-08T18:30:04.490 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.490 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.490 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:04.490 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.165405+0000", 2024-05-08T18:30:04.490 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028919200000000001 2024-05-08T18:30:04.490 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.490 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.490 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:04.490 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.165495+0000", 2024-05-08T18:30:04.490 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9765999999999994e-05 2024-05-08T18:30:04.490 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:04.490 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:04.491 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:04.491 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.491 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.491 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4206.0:25 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'15, mlcod=16'10)", 2024-05-08T18:30:04.491 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:27.164793+0000", 2024-05-08T18:30:04.491 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 37.324318179000002, 2024-05-08T18:30:04.491 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032285249999999999, 2024-05-08T18:30:04.491 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:04.491 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:04.491 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:04.491 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:04.491 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.491 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:04.492 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164793+0000", 2024-05-08T18:30:04.492 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:04.492 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.492 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.492 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:04.492 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164793+0000", 2024-05-08T18:30:04.492 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:04.492 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.492 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.492 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:04.492 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164795+0000", 2024-05-08T18:30:04.492 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0999999999999998e-06 2024-05-08T18:30:04.492 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.492 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.493 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:04.493 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164811+0000", 2024-05-08T18:30:04.493 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5722999999999998e-05 2024-05-08T18:30:04.493 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.493 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.493 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:04.493 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164841+0000", 2024-05-08T18:30:04.493 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0355999999999999e-05 2024-05-08T18:30:04.493 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.493 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.493 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:04.493 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164861+0000", 2024-05-08T18:30:04.493 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9533000000000001e-05 2024-05-08T18:30:04.493 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.494 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.494 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:04.494 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164984+0000", 2024-05-08T18:30:04.494 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000123146 2024-05-08T18:30:04.494 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.494 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.494 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:04.494 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.165024+0000", 2024-05-08T18:30:04.494 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9690000000000001e-05 2024-05-08T18:30:04.494 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.494 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.494 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:04.494 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.167935+0000", 2024-05-08T18:30:04.495 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0029113300000000002 2024-05-08T18:30:04.495 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.495 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.495 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:04.495 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.168021+0000", 2024-05-08T18:30:04.495 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6646999999999999e-05 2024-05-08T18:30:04.495 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:04.495 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:04.495 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:04.495 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.495 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.495 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:30:04.496 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:48.674737+0000", 2024-05-08T18:30:04.496 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 15.814374260999999, 2024-05-08T18:30:04.496 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0035019780000000002, 2024-05-08T18:30:04.496 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:04.496 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:04.496 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:04.496 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:04.496 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:04.496 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:04.496 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 60 2024-05-08T18:30:04.496 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.496 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:04.496 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.496 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:04.496 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674737+0000", 2024-05-08T18:30:04.497 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:04.497 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.497 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.497 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:04.497 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674737+0000", 2024-05-08T18:30:04.497 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:04.497 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.497 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.497 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:04.497 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674740+0000", 2024-05-08T18:30:04.497 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.36e-06 2024-05-08T18:30:04.497 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.497 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.497 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:04.498 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674753+0000", 2024-05-08T18:30:04.498 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3151e-05 2024-05-08T18:30:04.498 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.498 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.498 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:04.498 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674789+0000", 2024-05-08T18:30:04.498 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5929000000000001e-05 2024-05-08T18:30:04.498 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.498 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.498 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:04.498 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674813+0000", 2024-05-08T18:30:04.498 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3325000000000001e-05 2024-05-08T18:30:04.498 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.498 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.499 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:04.499 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674981+0000", 2024-05-08T18:30:04.499 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016879899999999999 2024-05-08T18:30:04.499 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.499 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.499 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:04.499 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.675304+0000", 2024-05-08T18:30:04.499 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00032214400000000001 2024-05-08T18:30:04.499 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.499 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.499 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:04.499 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.675639+0000", 2024-05-08T18:30:04.499 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00033494699999999999 2024-05-08T18:30:04.500 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.500 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.500 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:04.500 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.676901+0000", 2024-05-08T18:30:04.500 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001262167 2024-05-08T18:30:04.500 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.500 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.500 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:04.500 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678078+0000", 2024-05-08T18:30:04.500 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001177588 2024-05-08T18:30:04.500 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.500 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.500 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:04.501 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678171+0000", 2024-05-08T18:30:04.501 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.2331999999999996e-05 2024-05-08T18:30:04.501 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.501 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.501 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:04.501 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678239+0000", 2024-05-08T18:30:04.501 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8236000000000002e-05 2024-05-08T18:30:04.501 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:04.501 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:04.501 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:04.501 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.501 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.501 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:61 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94069412632064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:30:04.502 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:48.678410+0000", 2024-05-08T18:30:04.502 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 15.810700869, 2024-05-08T18:30:04.502 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0026001800000000001, 2024-05-08T18:30:04.502 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:04.502 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:04.502 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:04.502 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:04.502 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:04.502 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:04.502 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 61 2024-05-08T18:30:04.502 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.503 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:04.503 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.503 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:04.503 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678410+0000", 2024-05-08T18:30:04.503 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:04.503 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.503 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.503 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:04.503 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678410+0000", 2024-05-08T18:30:04.503 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:04.503 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.504 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.504 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:04.504 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678413+0000", 2024-05-08T18:30:04.504 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.34e-06 2024-05-08T18:30:04.504 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.504 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.504 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:04.504 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678421+0000", 2024-05-08T18:30:04.504 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6910000000000003e-06 2024-05-08T18:30:04.504 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.504 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.504 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:04.504 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678447+0000", 2024-05-08T18:30:04.504 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6010999999999999e-05 2024-05-08T18:30:04.505 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.505 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.505 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:04.505 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678461+0000", 2024-05-08T18:30:04.505 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3900000000000001e-05 2024-05-08T18:30:04.505 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.505 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.505 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:04.505 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678560+0000", 2024-05-08T18:30:04.505 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.8834999999999998e-05 2024-05-08T18:30:04.505 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.506 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.506 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:04.506 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678704+0000", 2024-05-08T18:30:04.506 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000143769 2024-05-08T18:30:04.506 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.506 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.506 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:04.506 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678942+0000", 2024-05-08T18:30:04.506 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023861800000000001 2024-05-08T18:30:04.506 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.506 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.506 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:04.506 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.680269+0000", 2024-05-08T18:30:04.506 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001326484 2024-05-08T18:30:04.507 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.507 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.507 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:04.507 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.680823+0000", 2024-05-08T18:30:04.507 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00055455900000000004 2024-05-08T18:30:04.507 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.507 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.507 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:04.507 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.680908+0000", 2024-05-08T18:30:04.507 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.4073999999999995e-05 2024-05-08T18:30:04.507 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.507 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.507 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:04.507 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.681010+0000", 2024-05-08T18:30:04.508 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010289900000000001 2024-05-08T18:30:04.508 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:04.508 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:04.508 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:04.508 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.508 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.508 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:30:04.508 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.671896+0000", 2024-05-08T18:30:04.508 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 12.817214984, 2024-05-08T18:30:04.508 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032352349999999999, 2024-05-08T18:30:04.508 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:04.508 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:04.508 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:04.509 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:04.509 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:04.509 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:04.509 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 206 2024-05-08T18:30:04.509 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.509 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:04.509 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.509 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:04.509 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671896+0000", 2024-05-08T18:30:04.509 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:04.509 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.509 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.510 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:04.510 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671896+0000", 2024-05-08T18:30:04.510 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:04.510 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.510 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.510 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:04.510 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671901+0000", 2024-05-08T18:30:04.510 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.763e-06 2024-05-08T18:30:04.510 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.510 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.510 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:04.510 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671920+0000", 2024-05-08T18:30:04.510 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9403e-05 2024-05-08T18:30:04.511 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.511 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.511 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:04.511 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671969+0000", 2024-05-08T18:30:04.511 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8343000000000001e-05 2024-05-08T18:30:04.511 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.511 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.511 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:04.511 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671996+0000", 2024-05-08T18:30:04.511 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7307000000000001e-05 2024-05-08T18:30:04.511 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.511 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.511 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:04.511 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.672149+0000", 2024-05-08T18:30:04.512 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015336500000000001 2024-05-08T18:30:04.512 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.512 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.512 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:04.512 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.672393+0000", 2024-05-08T18:30:04.512 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024380800000000001 2024-05-08T18:30:04.512 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.512 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.512 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:04.512 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.672838+0000", 2024-05-08T18:30:04.512 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00044472700000000001 2024-05-08T18:30:04.512 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.512 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.513 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:04.513 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.674218+0000", 2024-05-08T18:30:04.513 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001380243 2024-05-08T18:30:04.513 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.513 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.513 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:04.513 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.674963+0000", 2024-05-08T18:30:04.513 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00074534999999999998 2024-05-08T18:30:04.513 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.513 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.513 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:04.513 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675057+0000", 2024-05-08T18:30:04.513 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.3633000000000003e-05 2024-05-08T18:30:04.513 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.513 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.514 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:04.514 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675131+0000", 2024-05-08T18:30:04.514 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.4293000000000002e-05 2024-05-08T18:30:04.514 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:04.514 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:04.514 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:04.514 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.514 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.514 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:04.514 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.694194+0000", 2024-05-08T18:30:04.514 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 12.794917586, 2024-05-08T18:30:04.514 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0087385129999999998, 2024-05-08T18:30:04.514 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:04.515 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:04.515 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:04.515 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:04.515 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:04.515 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:04.515 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 210 2024-05-08T18:30:04.515 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.515 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:04.515 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.515 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:04.515 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694194+0000", 2024-05-08T18:30:04.515 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:04.516 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.516 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.516 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:04.516 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694194+0000", 2024-05-08T18:30:04.516 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:04.516 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.516 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.516 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:04.516 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694196+0000", 2024-05-08T18:30:04.516 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6299999999999998e-06 2024-05-08T18:30:04.516 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.516 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.516 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:04.517 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694208+0000", 2024-05-08T18:30:04.517 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.187e-05 2024-05-08T18:30:04.517 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.517 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.517 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:04.517 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694240+0000", 2024-05-08T18:30:04.517 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1673e-05 2024-05-08T18:30:04.517 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.517 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.517 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:04.517 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694255+0000", 2024-05-08T18:30:04.517 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5573000000000002e-05 2024-05-08T18:30:04.518 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.518 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.518 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:04.518 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694394+0000", 2024-05-08T18:30:04.518 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000138536 2024-05-08T18:30:04.518 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.518 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.518 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-05-08T18:30:04.518 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694405+0000", 2024-05-08T18:30:04.518 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0883000000000001e-05 2024-05-08T18:30:04.518 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.518 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.519 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:04.519 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.699491+0000", 2024-05-08T18:30:04.519 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0050861939999999996 2024-05-08T18:30:04.519 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.519 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.519 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:04.519 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.699829+0000", 2024-05-08T18:30:04.519 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000338191 2024-05-08T18:30:04.519 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.519 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.519 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:30:04.519 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.700504+0000", 2024-05-08T18:30:04.520 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000674481 2024-05-08T18:30:04.520 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.520 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.520 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:04.520 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.702152+0000", 2024-05-08T18:30:04.520 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0016487450000000001 2024-05-08T18:30:04.520 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.520 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.520 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:04.520 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.702792+0000", 2024-05-08T18:30:04.520 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00063962800000000005 2024-05-08T18:30:04.520 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.520 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.520 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:04.521 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.702874+0000", 2024-05-08T18:30:04.521 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.2091999999999999e-05 2024-05-08T18:30:04.521 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.521 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.521 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:04.521 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.702932+0000", 2024-05-08T18:30:04.521 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8016999999999997e-05 2024-05-08T18:30:04.521 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:04.521 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:04.521 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:04.521 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.521 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.521 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:04.521 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.728239+0000", 2024-05-08T18:30:04.522 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 12.760871724999999, 2024-05-08T18:30:04.522 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0035376119999999999, 2024-05-08T18:30:04.522 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:04.522 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:04.522 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:04.522 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:04.522 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:04.522 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:04.522 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 218 2024-05-08T18:30:04.522 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.522 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:04.522 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.522 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:04.523 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728239+0000", 2024-05-08T18:30:04.523 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:04.523 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.523 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.523 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:04.523 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728239+0000", 2024-05-08T18:30:04.523 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:04.523 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.523 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.523 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:04.523 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728242+0000", 2024-05-08T18:30:04.523 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0130000000000002e-06 2024-05-08T18:30:04.523 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.524 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.524 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:04.524 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728254+0000", 2024-05-08T18:30:04.524 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.172e-05 2024-05-08T18:30:04.524 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.524 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.524 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:04.524 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728285+0000", 2024-05-08T18:30:04.524 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0703000000000001e-05 2024-05-08T18:30:04.524 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.524 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.524 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:04.524 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728301+0000", 2024-05-08T18:30:04.525 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5656999999999999e-05 2024-05-08T18:30:04.525 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.525 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.525 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:04.525 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728460+0000", 2024-05-08T18:30:04.525 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015934200000000001 2024-05-08T18:30:04.525 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.525 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.525 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:04.525 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728803+0000", 2024-05-08T18:30:04.525 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00034267400000000001 2024-05-08T18:30:04.525 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.525 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.525 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:04.526 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.729485+0000", 2024-05-08T18:30:04.526 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00068206799999999998 2024-05-08T18:30:04.526 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.526 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.526 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:04.526 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731218+0000", 2024-05-08T18:30:04.526 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0017332630000000001 2024-05-08T18:30:04.526 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.526 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.526 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:04.527 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731615+0000", 2024-05-08T18:30:04.527 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00039671699999999999 2024-05-08T18:30:04.527 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.527 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.527 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:04.527 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731709+0000", 2024-05-08T18:30:04.527 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.4740000000000004e-05 2024-05-08T18:30:04.527 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.527 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.527 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:04.527 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731777+0000", 2024-05-08T18:30:04.527 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7714999999999998e-05 2024-05-08T18:30:04.528 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:04.528 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:04.528 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:04.528 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.528 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.528 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:04.528 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.743331+0000", 2024-05-08T18:30:04.528 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 12.745779742, 2024-05-08T18:30:04.528 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031193229999999998, 2024-05-08T18:30:04.528 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:04.528 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:04.528 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:04.528 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:04.528 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:04.529 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:04.529 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 222 2024-05-08T18:30:04.529 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.529 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:04.529 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.529 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:04.529 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743331+0000", 2024-05-08T18:30:04.529 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:04.529 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.529 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.529 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:04.529 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743331+0000", 2024-05-08T18:30:04.529 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:04.530 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.530 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.530 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:04.530 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743334+0000", 2024-05-08T18:30:04.530 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2900000000000001e-06 2024-05-08T18:30:04.530 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.530 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.530 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:04.530 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743345+0000", 2024-05-08T18:30:04.530 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0947e-05 2024-05-08T18:30:04.530 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.530 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.530 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:04.531 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743375+0000", 2024-05-08T18:30:04.531 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0298999999999999e-05 2024-05-08T18:30:04.531 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.531 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.531 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:04.531 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743390+0000", 2024-05-08T18:30:04.531 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4606999999999999e-05 2024-05-08T18:30:04.531 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.531 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.531 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:04.531 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743524+0000", 2024-05-08T18:30:04.531 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000134105 2024-05-08T18:30:04.531 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.531 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.531 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:04.532 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743738+0000", 2024-05-08T18:30:04.532 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000214222 2024-05-08T18:30:04.532 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.532 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.532 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:30:04.532 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.744159+0000", 2024-05-08T18:30:04.532 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00042102300000000002 2024-05-08T18:30:04.532 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.532 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.532 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:04.532 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.745399+0000", 2024-05-08T18:30:04.532 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012400309999999999 2024-05-08T18:30:04.532 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.533 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.533 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:04.533 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.746296+0000", 2024-05-08T18:30:04.533 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00089682 2024-05-08T18:30:04.533 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.533 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.533 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:04.533 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.746385+0000", 2024-05-08T18:30:04.533 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9289000000000005e-05 2024-05-08T18:30:04.533 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.533 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.533 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:04.533 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.746451+0000", 2024-05-08T18:30:04.534 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5690000000000003e-05 2024-05-08T18:30:04.534 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:04.534 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:04.534 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:04.534 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.534 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.534 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:04.534 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.772338+0000", 2024-05-08T18:30:04.534 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 12.716773542, 2024-05-08T18:30:04.534 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0035084059999999999, 2024-05-08T18:30:04.534 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:04.534 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:04.534 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:04.535 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:04.535 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:04.535 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:04.535 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 230 2024-05-08T18:30:04.535 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.535 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:04.535 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.535 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:04.535 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772338+0000", 2024-05-08T18:30:04.535 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:04.535 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.535 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.535 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:04.535 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772338+0000", 2024-05-08T18:30:04.536 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:04.536 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.536 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.536 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:04.536 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772340+0000", 2024-05-08T18:30:04.536 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3460000000000001e-06 2024-05-08T18:30:04.536 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.536 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.536 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:04.536 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772352+0000", 2024-05-08T18:30:04.536 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2284e-05 2024-05-08T18:30:04.536 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.537 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.537 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:04.537 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772382+0000", 2024-05-08T18:30:04.537 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0083e-05 2024-05-08T18:30:04.537 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.537 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.537 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:04.537 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772397+0000", 2024-05-08T18:30:04.537 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4963000000000001e-05 2024-05-08T18:30:04.537 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.537 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.537 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:04.537 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772508+0000", 2024-05-08T18:30:04.537 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000110402 2024-05-08T18:30:04.538 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.538 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.538 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:04.538 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772742+0000", 2024-05-08T18:30:04.538 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023428899999999999 2024-05-08T18:30:04.538 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.538 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.538 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:30:04.538 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.773183+0000", 2024-05-08T18:30:04.538 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00044107899999999998 2024-05-08T18:30:04.538 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.539 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.539 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:04.539 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.774488+0000", 2024-05-08T18:30:04.539 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0013053940000000001 2024-05-08T18:30:04.539 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.539 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.539 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:04.539 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.775689+0000", 2024-05-08T18:30:04.539 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012004699999999999 2024-05-08T18:30:04.539 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.539 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.539 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:04.539 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.775777+0000", 2024-05-08T18:30:04.540 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8483e-05 2024-05-08T18:30:04.540 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.540 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.540 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:04.540 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.775846+0000", 2024-05-08T18:30:04.540 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8613000000000002e-05 2024-05-08T18:30:04.540 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:04.540 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:04.540 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:04.540 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.540 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.540 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:04.540 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.790921+0000", 2024-05-08T18:30:04.540 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 12.698190196000001, 2024-05-08T18:30:04.541 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003116869, 2024-05-08T18:30:04.541 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:04.541 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:04.541 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:04.541 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:04.541 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:04.541 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:04.541 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 235 2024-05-08T18:30:04.541 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.541 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:04.541 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.541 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:04.541 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790921+0000", 2024-05-08T18:30:04.542 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:04.542 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.542 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.542 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:04.542 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790921+0000", 2024-05-08T18:30:04.542 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:04.542 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.542 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.542 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:04.542 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790923+0000", 2024-05-08T18:30:04.542 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3199999999999998e-06 2024-05-08T18:30:04.542 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.542 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.542 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:04.543 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790934+0000", 2024-05-08T18:30:04.543 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.117e-05 2024-05-08T18:30:04.543 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.543 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.543 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:04.543 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790965+0000", 2024-05-08T18:30:04.543 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0392999999999999e-05 2024-05-08T18:30:04.543 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.543 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.543 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:04.543 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790981+0000", 2024-05-08T18:30:04.543 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5699999999999999e-05 2024-05-08T18:30:04.543 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.544 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.544 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:04.544 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.791093+0000", 2024-05-08T18:30:04.544 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000112062 2024-05-08T18:30:04.544 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.544 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.544 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:04.544 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.791324+0000", 2024-05-08T18:30:04.544 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023142200000000001 2024-05-08T18:30:04.544 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.544 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.544 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:04.544 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.791761+0000", 2024-05-08T18:30:04.544 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00043669999999999999 2024-05-08T18:30:04.545 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.545 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.545 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:04.545 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.792996+0000", 2024-05-08T18:30:04.545 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001235713 2024-05-08T18:30:04.545 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.545 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.545 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:04.545 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.793850+0000", 2024-05-08T18:30:04.545 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00085392400000000005 2024-05-08T18:30:04.545 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.545 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.545 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:04.545 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.793971+0000", 2024-05-08T18:30:04.546 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000120516 2024-05-08T18:30:04.546 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.546 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.546 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:04.546 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794038+0000", 2024-05-08T18:30:04.546 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6948999999999999e-05 2024-05-08T18:30:04.546 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:04.546 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:04.546 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:04.546 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.546 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.546 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:349 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:04.546 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.817315+0000", 2024-05-08T18:30:04.547 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 12.671796325000001, 2024-05-08T18:30:04.547 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0036888580000000002, 2024-05-08T18:30:04.547 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:04.547 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:04.547 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:04.547 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:04.547 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:04.547 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:04.547 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 349 2024-05-08T18:30:04.547 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.547 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:04.547 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.547 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:04.548 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817315+0000", 2024-05-08T18:30:04.548 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:04.548 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.548 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.548 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:04.548 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817315+0000", 2024-05-08T18:30:04.548 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:04.548 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.548 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.548 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:04.548 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817316+0000", 2024-05-08T18:30:04.548 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3370000000000001e-06 2024-05-08T18:30:04.549 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.549 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.549 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:04.549 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817323+0000", 2024-05-08T18:30:04.549 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.4300000000000003e-06 2024-05-08T18:30:04.549 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.549 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.549 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:04.549 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817337+0000", 2024-05-08T18:30:04.549 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4025999999999999e-05 2024-05-08T18:30:04.549 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.549 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.549 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:04.549 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817345+0000", 2024-05-08T18:30:04.550 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5669999999999995e-06 2024-05-08T18:30:04.550 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.550 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.550 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:04.550 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817407+0000", 2024-05-08T18:30:04.550 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1882000000000001e-05 2024-05-08T18:30:04.550 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.550 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.550 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:04.550 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817508+0000", 2024-05-08T18:30:04.550 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000100585 2024-05-08T18:30:04.550 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.551 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.551 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:04.551 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817673+0000", 2024-05-08T18:30:04.551 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000165802 2024-05-08T18:30:04.551 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.551 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.551 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:04.551 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.818715+0000", 2024-05-08T18:30:04.551 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0010417720000000001 2024-05-08T18:30:04.551 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.551 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.551 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:04.551 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.820892+0000", 2024-05-08T18:30:04.551 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0021771859999999998 2024-05-08T18:30:04.552 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.552 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.552 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:04.552 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.820950+0000", 2024-05-08T18:30:04.552 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7636000000000002e-05 2024-05-08T18:30:04.552 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.552 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.552 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:04.552 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.821004+0000", 2024-05-08T18:30:04.552 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3634999999999997e-05 2024-05-08T18:30:04.552 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:04.552 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:04.552 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:04.552 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.553 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.553 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:406 6.16 6:6dc3b799:reshard::reshard.0000000006:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:04.553 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.840465+0000", 2024-05-08T18:30:04.553 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 12.648646159, 2024-05-08T18:30:04.553 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003613032, 2024-05-08T18:30:04.553 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:04.553 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:04.553 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:04.553 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:04.553 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:04.553 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:04.553 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 406 2024-05-08T18:30:04.553 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.553 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:04.554 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.554 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:04.554 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840465+0000", 2024-05-08T18:30:04.554 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:04.554 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.554 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.554 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:04.554 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840465+0000", 2024-05-08T18:30:04.554 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:04.554 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.554 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.554 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:04.554 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840466+0000", 2024-05-08T18:30:04.554 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7499999999999999e-07 2024-05-08T18:30:04.555 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.555 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.555 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:04.555 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840471+0000", 2024-05-08T18:30:04.555 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9699999999999998e-06 2024-05-08T18:30:04.555 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.555 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.555 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:04.555 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840484+0000", 2024-05-08T18:30:04.555 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2717999999999999e-05 2024-05-08T18:30:04.555 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.555 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.555 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:04.556 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840490+0000", 2024-05-08T18:30:04.556 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.472e-06 2024-05-08T18:30:04.556 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.556 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.556 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:04.556 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840536+0000", 2024-05-08T18:30:04.556 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6409000000000002e-05 2024-05-08T18:30:04.556 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.556 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.556 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:04.556 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840591+0000", 2024-05-08T18:30:04.556 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4911000000000003e-05 2024-05-08T18:30:04.556 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.557 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.557 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:30:04.557 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840745+0000", 2024-05-08T18:30:04.557 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015394900000000001 2024-05-08T18:30:04.557 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.557 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.557 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:04.557 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.841269+0000", 2024-05-08T18:30:04.557 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00052347299999999999 2024-05-08T18:30:04.557 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.557 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.557 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:04.557 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.843997+0000", 2024-05-08T18:30:04.558 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0027285080000000001 2024-05-08T18:30:04.558 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.558 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.558 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:04.558 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844033+0000", 2024-05-08T18:30:04.558 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6038000000000003e-05 2024-05-08T18:30:04.558 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.558 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.558 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:04.558 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844078+0000", 2024-05-08T18:30:04.558 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4709000000000002e-05 2024-05-08T18:30:04.558 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:04.558 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:04.559 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:04.559 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.559 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.559 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:413 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:04.559 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.844187+0000", 2024-05-08T18:30:04.559 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 12.644924582, 2024-05-08T18:30:04.559 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0024835069999999998, 2024-05-08T18:30:04.559 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:04.559 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:04.559 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:04.559 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:04.559 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:04.559 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:04.560 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 413 2024-05-08T18:30:04.560 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.560 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:04.560 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.560 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:04.560 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844187+0000", 2024-05-08T18:30:04.560 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:04.560 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.560 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.560 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:04.560 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844187+0000", 2024-05-08T18:30:04.560 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:04.560 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.560 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.560 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:04.561 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844187+0000", 2024-05-08T18:30:04.561 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9999999999999996e-07 2024-05-08T18:30:04.561 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.561 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.561 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:04.561 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844192+0000", 2024-05-08T18:30:04.561 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7899999999999999e-06 2024-05-08T18:30:04.561 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.561 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.561 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:04.561 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844203+0000", 2024-05-08T18:30:04.561 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1002000000000001e-05 2024-05-08T18:30:04.562 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.562 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.562 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:04.562 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844209+0000", 2024-05-08T18:30:04.562 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6570000000000002e-06 2024-05-08T18:30:04.562 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.562 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.562 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:04.562 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844270+0000", 2024-05-08T18:30:04.562 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0810999999999998e-05 2024-05-08T18:30:04.562 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.562 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.562 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:04.563 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844419+0000", 2024-05-08T18:30:04.563 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000149097 2024-05-08T18:30:04.563 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.563 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.563 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:30:04.563 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844611+0000", 2024-05-08T18:30:04.563 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00019247900000000001 2024-05-08T18:30:04.563 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.563 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.563 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:04.563 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.845287+0000", 2024-05-08T18:30:04.563 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00067526000000000001 2024-05-08T18:30:04.563 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.564 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.564 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:04.564 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.846609+0000", 2024-05-08T18:30:04.564 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001322124 2024-05-08T18:30:04.564 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.564 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.564 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:04.564 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.846642+0000", 2024-05-08T18:30:04.564 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3654e-05 2024-05-08T18:30:04.564 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.564 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.565 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:04.565 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.846670+0000", 2024-05-08T18:30:04.565 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7733e-05 2024-05-08T18:30:04.565 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:04.565 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:04.565 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:04.565 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.565 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.565 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:420 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:04.565 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.847096+0000", 2024-05-08T18:30:04.565 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 12.642015288, 2024-05-08T18:30:04.565 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0026261589999999999, 2024-05-08T18:30:04.565 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:04.566 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:04.566 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:04.566 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:04.566 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:04.566 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:04.566 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 420 2024-05-08T18:30:04.566 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.566 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:04.566 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.566 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:04.566 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847096+0000", 2024-05-08T18:30:04.566 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:04.567 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.567 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.567 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:04.567 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847096+0000", 2024-05-08T18:30:04.567 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:04.567 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.567 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.567 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:04.567 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847097+0000", 2024-05-08T18:30:04.567 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.5499999999999996e-07 2024-05-08T18:30:04.567 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.567 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.567 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:04.568 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847103+0000", 2024-05-08T18:30:04.568 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8969999999999996e-06 2024-05-08T18:30:04.568 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.568 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.568 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:04.568 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847114+0000", 2024-05-08T18:30:04.568 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1549000000000001e-05 2024-05-08T18:30:04.568 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.568 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.568 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:04.568 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847120+0000", 2024-05-08T18:30:04.568 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5509999999999999e-06 2024-05-08T18:30:04.568 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.569 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.569 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:04.569 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847166+0000", 2024-05-08T18:30:04.569 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6683e-05 2024-05-08T18:30:04.569 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.569 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.569 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:04.569 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847213+0000", 2024-05-08T18:30:04.569 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6659000000000002e-05 2024-05-08T18:30:04.569 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.569 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.570 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:30:04.570 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847315+0000", 2024-05-08T18:30:04.570 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000102336 2024-05-08T18:30:04.570 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.570 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.570 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:04.570 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847840+0000", 2024-05-08T18:30:04.570 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00052475000000000004 2024-05-08T18:30:04.570 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.570 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.570 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:04.570 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.849660+0000", 2024-05-08T18:30:04.570 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001819563 2024-05-08T18:30:04.571 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.571 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.571 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:04.571 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.849695+0000", 2024-05-08T18:30:04.571 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4761000000000001e-05 2024-05-08T18:30:04.571 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.571 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.571 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:04.571 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.849722+0000", 2024-05-08T18:30:04.571 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7455000000000001e-05 2024-05-08T18:30:04.571 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:04.571 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:04.571 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:04.571 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.571 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.572 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:532 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:04.572 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.908603+0000", 2024-05-08T18:30:04.572 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 12.580507738, 2024-05-08T18:30:04.572 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0038838950000000001, 2024-05-08T18:30:04.572 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:04.572 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:04.572 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:04.572 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:04.572 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:04.572 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:04.572 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 532 2024-05-08T18:30:04.572 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.572 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:04.573 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.573 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:04.573 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908603+0000", 2024-05-08T18:30:04.573 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:04.573 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.573 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.573 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:04.573 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908603+0000", 2024-05-08T18:30:04.573 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:04.573 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.573 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.573 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:04.574 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908605+0000", 2024-05-08T18:30:04.574 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1179999999999999e-06 2024-05-08T18:30:04.574 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.574 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.574 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:04.574 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908608+0000", 2024-05-08T18:30:04.574 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7419999999999999e-06 2024-05-08T18:30:04.574 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.574 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.574 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:04.574 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908618+0000", 2024-05-08T18:30:04.574 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.6889999999999999e-06 2024-05-08T18:30:04.574 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.574 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.575 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:04.575 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908625+0000", 2024-05-08T18:30:04.575 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1300000000000003e-06 2024-05-08T18:30:04.575 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.575 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.575 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:04.575 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908669+0000", 2024-05-08T18:30:04.575 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3832000000000003e-05 2024-05-08T18:30:04.575 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.575 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.575 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:04.575 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908724+0000", 2024-05-08T18:30:04.575 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5222000000000001e-05 2024-05-08T18:30:04.575 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.575 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.576 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:30:04.576 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908854+0000", 2024-05-08T18:30:04.576 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012953500000000001 2024-05-08T18:30:04.576 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.576 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.576 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:04.576 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.909511+0000", 2024-05-08T18:30:04.576 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00065768399999999996 2024-05-08T18:30:04.576 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.576 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.576 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:04.576 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912426+0000", 2024-05-08T18:30:04.577 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0029146599999999999 2024-05-08T18:30:04.577 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.577 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.577 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:04.577 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912461+0000", 2024-05-08T18:30:04.577 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4934999999999997e-05 2024-05-08T18:30:04.577 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.577 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.577 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:04.577 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912487+0000", 2024-05-08T18:30:04.577 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6347999999999999e-05 2024-05-08T18:30:04.577 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:04.577 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:04.577 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:04.578 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.578 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.578 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:534 6.9 6:9268b73e:::obj_delete_at_hint.0000000019:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:04.578 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.910153+0000", 2024-05-08T18:30:04.578 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 12.578958281, 2024-05-08T18:30:04.578 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0051089680000000002, 2024-05-08T18:30:04.578 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:04.578 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:04.578 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:04.578 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:04.578 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:04.578 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:04.579 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 534 2024-05-08T18:30:04.579 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.579 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:04.579 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.579 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:04.579 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910153+0000", 2024-05-08T18:30:04.579 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:04.579 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.579 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.579 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:04.579 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910153+0000", 2024-05-08T18:30:04.579 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:04.579 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.579 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.580 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:04.580 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910154+0000", 2024-05-08T18:30:04.580 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1039999999999999e-06 2024-05-08T18:30:04.580 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.580 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.580 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:04.580 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910158+0000", 2024-05-08T18:30:04.580 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7400000000000002e-06 2024-05-08T18:30:04.580 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.580 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.580 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:04.580 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910167+0000", 2024-05-08T18:30:04.580 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8880000000000003e-06 2024-05-08T18:30:04.581 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.581 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.581 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:04.581 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910173+0000", 2024-05-08T18:30:04.581 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.844e-06 2024-05-08T18:30:04.581 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.581 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.581 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:04.581 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910220+0000", 2024-05-08T18:30:04.581 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6582000000000002e-05 2024-05-08T18:30:04.581 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.581 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.581 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:04.581 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910287+0000", 2024-05-08T18:30:04.582 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7271e-05 2024-05-08T18:30:04.582 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.582 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.582 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:30:04.582 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910402+0000", 2024-05-08T18:30:04.582 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115127 2024-05-08T18:30:04.582 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.582 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.582 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:04.582 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910881+0000", 2024-05-08T18:30:04.583 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000479025 2024-05-08T18:30:04.583 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.583 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.583 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:04.583 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.915206+0000", 2024-05-08T18:30:04.583 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.004324357 2024-05-08T18:30:04.583 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.583 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.583 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:04.583 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.915237+0000", 2024-05-08T18:30:04.583 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1590000000000001e-05 2024-05-08T18:30:04.583 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.583 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.583 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:04.584 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.915262+0000", 2024-05-08T18:30:04.584 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.444e-05 2024-05-08T18:30:04.584 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:04.584 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:04.584 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:04.584 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.584 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.584 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:583 6.0 6:03bbb29a:::obj_delete_at_hint.0000000026:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:04.584 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.947199+0000", 2024-05-08T18:30:04.584 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 12.541912084, 2024-05-08T18:30:04.584 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0025081510000000001, 2024-05-08T18:30:04.584 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:04.585 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:04.585 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:04.585 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:04.585 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:04.585 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:04.585 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 583 2024-05-08T18:30:04.585 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.585 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:04.585 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.585 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:04.585 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947199+0000", 2024-05-08T18:30:04.585 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:04.585 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.585 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.586 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:04.586 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947199+0000", 2024-05-08T18:30:04.586 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:04.586 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.586 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.586 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:04.586 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947200+0000", 2024-05-08T18:30:04.586 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3799999999999997e-07 2024-05-08T18:30:04.586 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.586 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.586 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:04.586 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947207+0000", 2024-05-08T18:30:04.586 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2030000000000003e-06 2024-05-08T18:30:04.587 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.587 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.587 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:04.587 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947217+0000", 2024-05-08T18:30:04.587 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0138e-05 2024-05-08T18:30:04.587 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.587 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.587 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:04.587 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947224+0000", 2024-05-08T18:30:04.587 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5289999999999997e-06 2024-05-08T18:30:04.587 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.587 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.587 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:04.588 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.948039+0000", 2024-05-08T18:30:04.588 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00081500599999999996 2024-05-08T18:30:04.588 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.588 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.588 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:04.588 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.948230+0000", 2024-05-08T18:30:04.588 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000191838 2024-05-08T18:30:04.588 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.588 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.588 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:04.588 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.948606+0000", 2024-05-08T18:30:04.588 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00037547900000000001 2024-05-08T18:30:04.588 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.589 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.589 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:04.589 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.949406+0000", 2024-05-08T18:30:04.589 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000799674 2024-05-08T18:30:04.589 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.589 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.589 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:04.589 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.949630+0000", 2024-05-08T18:30:04.589 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00022474699999999999 2024-05-08T18:30:04.589 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.589 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.589 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:04.589 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.949664+0000", 2024-05-08T18:30:04.590 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3535999999999999e-05 2024-05-08T18:30:04.590 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.590 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.590 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:04.590 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.949707+0000", 2024-05-08T18:30:04.590 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3362999999999998e-05 2024-05-08T18:30:04.590 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:04.590 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:04.590 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:04.590 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.590 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.590 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:686 6.10 6:0d0f4ce5:::obj_delete_at_hint.0000000040:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:04.590 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.012623+0000", 2024-05-08T18:30:04.590 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 12.476487895, 2024-05-08T18:30:04.591 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0024696330000000002, 2024-05-08T18:30:04.591 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:04.591 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:04.591 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:04.591 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:04.591 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:04.591 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:04.591 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 686 2024-05-08T18:30:04.591 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.591 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:04.591 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.591 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:04.591 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.012623+0000", 2024-05-08T18:30:04.592 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:04.592 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.592 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.592 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:04.592 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.012623+0000", 2024-05-08T18:30:04.592 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:04.592 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.592 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.592 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:04.592 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.012624+0000", 2024-05-08T18:30:04.592 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1480000000000001e-06 2024-05-08T18:30:04.592 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.592 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.592 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:04.593 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.012631+0000", 2024-05-08T18:30:04.593 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1700000000000002e-06 2024-05-08T18:30:04.593 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.593 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.593 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:04.593 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.012647+0000", 2024-05-08T18:30:04.593 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6133999999999998e-05 2024-05-08T18:30:04.593 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.593 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.593 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:04.593 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.012655+0000", 2024-05-08T18:30:04.593 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7199999999999995e-06 2024-05-08T18:30:04.593 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.593 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.594 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:04.594 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.012715+0000", 2024-05-08T18:30:04.594 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9475999999999998e-05 2024-05-08T18:30:04.594 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.594 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.594 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:04.594 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.012805+0000", 2024-05-08T18:30:04.594 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9840999999999996e-05 2024-05-08T18:30:04.594 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.594 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.594 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:04.594 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.012930+0000", 2024-05-08T18:30:04.594 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012537099999999999 2024-05-08T18:30:04.594 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.595 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.595 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:04.595 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.013584+0000", 2024-05-08T18:30:04.595 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00065356500000000005 2024-05-08T18:30:04.595 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.595 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.595 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:04.595 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.014956+0000", 2024-05-08T18:30:04.595 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001372535 2024-05-08T18:30:04.595 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.595 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.595 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:04.595 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.015017+0000", 2024-05-08T18:30:04.596 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0590000000000001e-05 2024-05-08T18:30:04.596 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.596 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.596 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:04.596 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.015093+0000", 2024-05-08T18:30:04.596 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6082999999999996e-05 2024-05-08T18:30:04.596 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:04.596 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:04.596 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:04.596 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.596 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.596 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:04.596 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.263796+0000", 2024-05-08T18:30:04.597 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 12.225314815999999, 2024-05-08T18:30:04.597 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0027788019999999999, 2024-05-08T18:30:04.597 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:04.597 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:04.597 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:04.597 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:04.597 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:04.597 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:04.597 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 811 2024-05-08T18:30:04.597 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.597 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:04.597 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.597 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:04.597 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263796+0000", 2024-05-08T18:30:04.598 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:04.598 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.598 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.598 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:04.598 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263796+0000", 2024-05-08T18:30:04.598 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:04.598 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.598 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.598 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:04.598 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263799+0000", 2024-05-08T18:30:04.598 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5569999999999998e-06 2024-05-08T18:30:04.598 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.598 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.599 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:04.599 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263812+0000", 2024-05-08T18:30:04.599 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3145999999999999e-05 2024-05-08T18:30:04.599 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.599 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.599 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:04.599 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263842+0000", 2024-05-08T18:30:04.599 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0193e-05 2024-05-08T18:30:04.599 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.599 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.599 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:04.599 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263860+0000", 2024-05-08T18:30:04.599 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7880000000000002e-05 2024-05-08T18:30:04.600 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.600 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.600 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:04.600 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263979+0000", 2024-05-08T18:30:04.600 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011919899999999999 2024-05-08T18:30:04.600 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.600 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.600 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:04.600 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.264222+0000", 2024-05-08T18:30:04.600 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024290800000000001 2024-05-08T18:30:04.600 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.600 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.600 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:04.600 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.264545+0000", 2024-05-08T18:30:04.601 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00032300200000000002 2024-05-08T18:30:04.601 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.601 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.601 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:04.601 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.265682+0000", 2024-05-08T18:30:04.601 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001136464 2024-05-08T18:30:04.601 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.601 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.601 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:04.601 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.266397+0000", 2024-05-08T18:30:04.601 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00071512799999999999 2024-05-08T18:30:04.601 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.601 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.602 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:04.602 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.266504+0000", 2024-05-08T18:30:04.602 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000107019 2024-05-08T18:30:04.602 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.602 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.602 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:04.602 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.266575+0000", 2024-05-08T18:30:04.602 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1305999999999998e-05 2024-05-08T18:30:04.602 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:04.602 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:04.602 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:04.602 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.602 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.603 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:04.603 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.445706+0000", 2024-05-08T18:30:04.603 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 12.043405099999999, 2024-05-08T18:30:04.603 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0026820630000000002, 2024-05-08T18:30:04.603 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:04.603 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:04.603 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:04.603 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:04.603 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:04.603 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:04.603 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 889 2024-05-08T18:30:04.603 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.603 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:04.604 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.604 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:04.604 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445706+0000", 2024-05-08T18:30:04.604 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:04.604 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.604 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.604 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:04.604 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445706+0000", 2024-05-08T18:30:04.604 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:04.604 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.604 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.604 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:04.604 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445709+0000", 2024-05-08T18:30:04.605 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0299999999999998e-06 2024-05-08T18:30:04.605 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.605 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.605 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:04.605 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445721+0000", 2024-05-08T18:30:04.605 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2366e-05 2024-05-08T18:30:04.605 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.605 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.605 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:04.605 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445752+0000", 2024-05-08T18:30:04.605 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0287e-05 2024-05-08T18:30:04.605 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.606 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.606 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:04.606 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445773+0000", 2024-05-08T18:30:04.606 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1367000000000001e-05 2024-05-08T18:30:04.606 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.606 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.606 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:04.606 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445892+0000", 2024-05-08T18:30:04.606 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000119311 2024-05-08T18:30:04.606 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.606 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.606 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:04.607 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.446158+0000", 2024-05-08T18:30:04.607 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000265441 2024-05-08T18:30:04.607 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.607 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.607 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:04.607 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.446465+0000", 2024-05-08T18:30:04.607 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00030754300000000002 2024-05-08T18:30:04.607 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.607 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.607 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:04.607 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.447511+0000", 2024-05-08T18:30:04.607 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001045975 2024-05-08T18:30:04.607 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.608 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.608 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:04.608 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.448171+0000", 2024-05-08T18:30:04.608 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00065971200000000002 2024-05-08T18:30:04.608 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.608 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.608 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:04.608 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.448273+0000", 2024-05-08T18:30:04.608 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000101592 2024-05-08T18:30:04.608 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:04.608 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:04.608 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:04.608 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.448388+0000", 2024-05-08T18:30:04.608 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115439 2024-05-08T18:30:04.609 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:04.609 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:04.609 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:04.609 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:04.609 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:04.609 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:30:04.611 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-08T18:30:04.611 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2024-05-08T18:30:04.611 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:30:04.612 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:30:04.608+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:30:04.616 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2024-05-08T18:30:04.617 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:30:04.634 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2024-05-08T18:30:04.634 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:30:04.651 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2024-05-08T18:30:04.652 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:30:04.672 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2024-05-08T18:30:04.672 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:30:04.693 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2024-05-08T18:30:04.693 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:30:04.712 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:30:04.712+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:30:04.714 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2024-05-08T18:30:04.715 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:30:04.731 INFO:teuthology.orchestra.run.smithi097.stderr:reweighted osd.4 to 1 (10000) 2024-05-08T18:30:04.741 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2024-05-08T18:30:04.741 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:30:04.743 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:04.743 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:04.762 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-05-08T18:30:04.766 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-08T18:30:04.852 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:30:04.855+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:30:04.913 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:30:04.912+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:30:04.923 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:04.924 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:04.939 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-08T18:30:05.024 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:30:05.027+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:30:05.095 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:05.095 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:05.109 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-08T18:30:05.115 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:30:05.112+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:30:05.215 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:30:05.215+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:30:05.275 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:05.275 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:05.289 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-08T18:30:05.316 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:30:05.316+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:30:05.418 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:30:05.418+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:30:05.457 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:05.458 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:05.472 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-08T18:30:05.518 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:30:05.516+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:30:05.619 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:30:05.616+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:30:05.640 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:05.640 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:05.654 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-08T18:30:05.720 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:30:05.718+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:30:05.732 INFO:teuthology.orchestra.run.smithi097.stderr:reweighted osd.5 to 1 (10000) 2024-05-08T18:30:05.736 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-08T18:30:05.763 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-05-08T18:30:05.783 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:05.783 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:05.802 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-08T18:30:05.848 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:30:05.850+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:30:05.922 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:30:05.920+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:30:05.979 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:05.979 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:05.993 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-08T18:30:06.023 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:30:06.020+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:30:06.111 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:06.111 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:06.124 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:30:06.122+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:30:06.125 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-08T18:30:06.225 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:30:06.224+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:30:06.257 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:06.258 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:06.272 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-08T18:30:06.360 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:30:06.360+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:30:06.426 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:30:06.424+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:30:06.433 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:06.433 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:06.448 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-08T18:30:06.527 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:30:06.526+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:30:06.618 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:06.619 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:06.628 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:30:06.630+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:30:06.632 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-08T18:30:06.730 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:30:06.728+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:30:06.754 INFO:teuthology.orchestra.run.smithi097.stderr:reweighted osd.6 to 1 (10000) 2024-05-08T18:30:06.763 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-08T18:30:06.763 INFO:teuthology.orchestra.run.smithi097.stderr:noscrub is unset 2024-05-08T18:30:06.765 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:06.765 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:06.779 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-08T18:30:06.782 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-05-08T18:30:06.833 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:30:06.834+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:30:06.903 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2024-05-08T18:30:06.903 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:30:06.920 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2024-05-08T18:30:06.920 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:30:06.930 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:30:06.930+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:30:06.937 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2024-05-08T18:30:06.937 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:30:06.953 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:06.953 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:06.958 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2024-05-08T18:30:06.958 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:30:06.967 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-08T18:30:06.976 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2024-05-08T18:30:06.977 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:30:06.994 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2024-05-08T18:30:06.994 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:30:07.012 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2024-05-08T18:30:07.012 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:30:07.029 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2024-05-08T18:30:07.029 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:30:07.032 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:30:07.032+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:30:07.095 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:30:07.095 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2024-05-08T18:30:07.095 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2024-05-08T18:30:07.095 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-05-08T18:30:07.095 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.095 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4479.0:37 5.f 5:f43b6ece:::zone_names.default:head [create,call version.set in=10b,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-05-08T18:30:07.096 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:44.627414+0000", 2024-05-08T18:30:07.096 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 22.465705887999999, 2024-05-08T18:30:07.096 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029966429999999998, 2024-05-08T18:30:07.096 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:07.096 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:07.096 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:07.096 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:07.096 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4479", 2024-05-08T18:30:07.096 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3577501689", 2024-05-08T18:30:07.096 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 37 2024-05-08T18:30:07.096 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.096 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:07.096 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.096 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:07.097 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.627414+0000", 2024-05-08T18:30:07.097 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:07.097 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.097 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.097 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:07.097 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.627414+0000", 2024-05-08T18:30:07.097 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:07.097 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.097 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.097 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:07.097 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.627416+0000", 2024-05-08T18:30:07.097 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9580000000000001e-06 2024-05-08T18:30:07.097 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.098 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.098 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:07.098 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.627427+0000", 2024-05-08T18:30:07.098 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1657e-05 2024-05-08T18:30:07.098 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.098 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.098 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:07.098 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.627454+0000", 2024-05-08T18:30:07.098 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6619e-05 2024-05-08T18:30:07.098 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.098 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.098 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:07.098 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.627474+0000", 2024-05-08T18:30:07.099 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9612000000000001e-05 2024-05-08T18:30:07.099 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.099 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.099 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:07.099 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.627647+0000", 2024-05-08T18:30:07.099 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017374999999999999 2024-05-08T18:30:07.099 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.099 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.099 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:07.099 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.627861+0000", 2024-05-08T18:30:07.099 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000213358 2024-05-08T18:30:07.100 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.100 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.100 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:07.100 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.628153+0000", 2024-05-08T18:30:07.100 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029198899999999999 2024-05-08T18:30:07.100 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.100 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.100 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:07.100 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.629544+0000", 2024-05-08T18:30:07.100 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0013916390000000001 2024-05-08T18:30:07.100 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.101 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.101 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:07.101 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.630221+0000", 2024-05-08T18:30:07.101 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00067613500000000002 2024-05-08T18:30:07.101 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.101 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.101 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:07.101 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.630321+0000", 2024-05-08T18:30:07.101 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000100126 2024-05-08T18:30:07.101 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.101 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.101 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:07.101 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.630411+0000", 2024-05-08T18:30:07.102 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.9800000000000001e-05 2024-05-08T18:30:07.102 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:07.102 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:07.102 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:07.102 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.102 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.102 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4479.0:41 5.f 5:f4c53578:::zonegroups_names.default:head [create,call version.set in=10b,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-05-08T18:30:07.102 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:44.637466+0000", 2024-05-08T18:30:07.102 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 22.455653929, 2024-05-08T18:30:07.102 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0030003949999999999, 2024-05-08T18:30:07.102 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:07.102 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:07.103 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:07.103 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:07.103 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4479", 2024-05-08T18:30:07.103 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3577501689", 2024-05-08T18:30:07.103 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 41 2024-05-08T18:30:07.103 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.103 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:07.103 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.103 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:07.103 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.637466+0000", 2024-05-08T18:30:07.103 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:07.103 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.103 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.103 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:07.104 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.637466+0000", 2024-05-08T18:30:07.104 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:07.104 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.104 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.104 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:07.104 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.637468+0000", 2024-05-08T18:30:07.104 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2800000000000002e-06 2024-05-08T18:30:07.104 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.104 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.104 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:07.104 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.637479+0000", 2024-05-08T18:30:07.104 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0674e-05 2024-05-08T18:30:07.104 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.105 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.105 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:07.105 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.637508+0000", 2024-05-08T18:30:07.105 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8921999999999999e-05 2024-05-08T18:30:07.105 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.105 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.105 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:07.105 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.637522+0000", 2024-05-08T18:30:07.105 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3923e-05 2024-05-08T18:30:07.105 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.105 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.105 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:07.105 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.637647+0000", 2024-05-08T18:30:07.105 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000124905 2024-05-08T18:30:07.106 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.106 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.106 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:07.106 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.637852+0000", 2024-05-08T18:30:07.106 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000205081 2024-05-08T18:30:07.106 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.106 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.106 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:07.106 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.638101+0000", 2024-05-08T18:30:07.106 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000248953 2024-05-08T18:30:07.106 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.106 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.106 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:07.107 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.639345+0000", 2024-05-08T18:30:07.107 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001244754 2024-05-08T18:30:07.107 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.107 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.107 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:07.107 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.640197+0000", 2024-05-08T18:30:07.107 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000851614 2024-05-08T18:30:07.107 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.107 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.107 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:07.107 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.640353+0000", 2024-05-08T18:30:07.107 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015631600000000001 2024-05-08T18:30:07.107 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.107 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.108 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:07.108 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.640466+0000", 2024-05-08T18:30:07.108 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000112973 2024-05-08T18:30:07.108 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:07.108 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:07.108 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:07.108 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.108 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.108 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:30:07.108 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.664338+0000", 2024-05-08T18:30:07.108 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 15.428782118000001, 2024-05-08T18:30:07.108 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039355429999999997, 2024-05-08T18:30:07.108 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:07.109 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:07.109 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:07.109 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:07.109 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:07.109 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:07.109 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 205 2024-05-08T18:30:07.109 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.109 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:07.109 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.109 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:07.110 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.664338+0000", 2024-05-08T18:30:07.110 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:07.110 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.110 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.110 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:07.110 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.664338+0000", 2024-05-08T18:30:07.110 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:07.110 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.110 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.110 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:07.110 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.664341+0000", 2024-05-08T18:30:07.110 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2399999999999999e-06 2024-05-08T18:30:07.111 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.111 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.111 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:07.111 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.664355+0000", 2024-05-08T18:30:07.111 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.453e-05 2024-05-08T18:30:07.111 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.111 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.111 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:07.111 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.664392+0000", 2024-05-08T18:30:07.111 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7033000000000003e-05 2024-05-08T18:30:07.111 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.111 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.111 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:07.112 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.664419+0000", 2024-05-08T18:30:07.112 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6086000000000001e-05 2024-05-08T18:30:07.112 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.112 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.112 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:07.112 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.664586+0000", 2024-05-08T18:30:07.112 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016752299999999999 2024-05-08T18:30:07.112 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.112 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.112 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:07.112 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.664831+0000", 2024-05-08T18:30:07.112 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00024510800000000001 2024-05-08T18:30:07.113 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.113 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.113 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:07.113 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.665420+0000", 2024-05-08T18:30:07.113 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00058862499999999996 2024-05-08T18:30:07.113 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.113 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.113 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:07.113 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.667096+0000", 2024-05-08T18:30:07.113 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0016765199999999999 2024-05-08T18:30:07.113 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.113 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.113 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:07.114 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.668109+0000", 2024-05-08T18:30:07.114 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001012829 2024-05-08T18:30:07.114 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.114 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.114 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:07.114 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.668200+0000", 2024-05-08T18:30:07.114 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1186000000000004e-05 2024-05-08T18:30:07.114 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.114 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.114 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:07.114 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.668273+0000", 2024-05-08T18:30:07.114 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.2862999999999997e-05 2024-05-08T18:30:07.114 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:07.115 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:07.115 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:07.115 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.115 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.115 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:07.115 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.732858+0000", 2024-05-08T18:30:07.115 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 15.360261769999999, 2024-05-08T18:30:07.115 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0033301939999999999, 2024-05-08T18:30:07.115 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:07.115 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:07.115 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:07.115 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:07.115 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:07.116 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:07.116 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 220 2024-05-08T18:30:07.116 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.116 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:07.116 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.116 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:07.116 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.732858+0000", 2024-05-08T18:30:07.116 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:07.116 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.116 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.116 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:07.116 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.732858+0000", 2024-05-08T18:30:07.116 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:07.117 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.117 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.117 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:07.117 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.732861+0000", 2024-05-08T18:30:07.117 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.9129999999999999e-06 2024-05-08T18:30:07.117 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.117 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.117 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:07.117 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.732874+0000", 2024-05-08T18:30:07.117 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3349999999999999e-05 2024-05-08T18:30:07.117 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.117 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.117 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:07.117 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.732900+0000", 2024-05-08T18:30:07.118 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6186999999999998e-05 2024-05-08T18:30:07.118 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.118 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.118 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:07.118 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.732916+0000", 2024-05-08T18:30:07.118 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5648999999999999e-05 2024-05-08T18:30:07.118 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.118 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.118 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:07.118 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.733097+0000", 2024-05-08T18:30:07.118 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00018121599999999999 2024-05-08T18:30:07.118 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.118 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.119 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:07.119 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.733299+0000", 2024-05-08T18:30:07.119 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020179799999999999 2024-05-08T18:30:07.119 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.119 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.119 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:07.119 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.733694+0000", 2024-05-08T18:30:07.119 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00039455000000000002 2024-05-08T18:30:07.119 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.119 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.119 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:07.119 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.735124+0000", 2024-05-08T18:30:07.119 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001430239 2024-05-08T18:30:07.119 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.120 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.120 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:07.120 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.736037+0000", 2024-05-08T18:30:07.120 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00091359999999999998 2024-05-08T18:30:07.120 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.120 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.120 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:07.120 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.736122+0000", 2024-05-08T18:30:07.120 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4313000000000004e-05 2024-05-08T18:30:07.120 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.120 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.120 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:07.120 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.736188+0000", 2024-05-08T18:30:07.121 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6378999999999996e-05 2024-05-08T18:30:07.121 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:07.121 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:07.121 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:07.121 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.121 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.121 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:223 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:07.121 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.743358+0000", 2024-05-08T18:30:07.121 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 15.349761558000001, 2024-05-08T18:30:07.121 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003279718, 2024-05-08T18:30:07.121 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:07.121 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:07.121 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:07.121 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:07.122 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:07.122 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:07.122 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 223 2024-05-08T18:30:07.122 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.122 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:07.122 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.122 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:07.122 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.743358+0000", 2024-05-08T18:30:07.122 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:07.122 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.122 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.122 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:07.122 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.743358+0000", 2024-05-08T18:30:07.123 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:07.123 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.123 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.123 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:07.123 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.743361+0000", 2024-05-08T18:30:07.123 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3269999999999999e-06 2024-05-08T18:30:07.123 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.123 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.123 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:07.123 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.743372+0000", 2024-05-08T18:30:07.123 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1202999999999999e-05 2024-05-08T18:30:07.123 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.123 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.123 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:07.124 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.743402+0000", 2024-05-08T18:30:07.124 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0580000000000002e-05 2024-05-08T18:30:07.124 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.124 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.124 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:07.124 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.743417+0000", 2024-05-08T18:30:07.124 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5067e-05 2024-05-08T18:30:07.124 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.124 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.124 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:07.124 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.743529+0000", 2024-05-08T18:30:07.124 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011130599999999999 2024-05-08T18:30:07.124 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.125 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.125 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:07.125 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.743744+0000", 2024-05-08T18:30:07.125 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000215324 2024-05-08T18:30:07.125 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.125 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.125 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:07.125 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.744137+0000", 2024-05-08T18:30:07.125 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00039347699999999999 2024-05-08T18:30:07.125 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.125 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.125 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:07.125 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.745510+0000", 2024-05-08T18:30:07.126 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001372063 2024-05-08T18:30:07.126 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.126 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.126 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:07.126 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.746486+0000", 2024-05-08T18:30:07.126 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00097615600000000005 2024-05-08T18:30:07.126 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.126 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.126 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:07.126 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.746574+0000", 2024-05-08T18:30:07.126 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8598999999999997e-05 2024-05-08T18:30:07.126 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.127 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.127 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:07.127 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.746638+0000", 2024-05-08T18:30:07.127 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3615999999999995e-05 2024-05-08T18:30:07.127 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:07.127 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:07.127 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:07.127 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.127 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.127 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:225 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:07.127 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.750971+0000", 2024-05-08T18:30:07.127 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 15.342148973, 2024-05-08T18:30:07.127 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0033719510000000002, 2024-05-08T18:30:07.128 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:07.128 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:07.128 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:07.128 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:07.128 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:07.128 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:07.128 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 225 2024-05-08T18:30:07.128 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.128 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:07.128 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.128 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:07.128 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.750971+0000", 2024-05-08T18:30:07.128 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:07.129 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.129 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.129 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:07.129 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.750971+0000", 2024-05-08T18:30:07.129 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:07.129 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.129 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.129 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:07.129 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.750973+0000", 2024-05-08T18:30:07.129 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.243e-06 2024-05-08T18:30:07.129 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.129 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.129 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:07.129 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.751001+0000", 2024-05-08T18:30:07.130 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8082999999999999e-05 2024-05-08T18:30:07.130 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.130 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.130 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:07.130 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.751029+0000", 2024-05-08T18:30:07.130 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.792e-05 2024-05-08T18:30:07.130 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.130 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.130 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:07.130 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.751051+0000", 2024-05-08T18:30:07.130 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2166000000000001e-05 2024-05-08T18:30:07.130 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.131 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.131 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:07.131 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.751239+0000", 2024-05-08T18:30:07.131 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000187362 2024-05-08T18:30:07.131 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.131 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.131 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:07.131 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.751462+0000", 2024-05-08T18:30:07.131 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000223482 2024-05-08T18:30:07.131 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.131 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.131 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:07.131 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.751893+0000", 2024-05-08T18:30:07.131 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00043102 2024-05-08T18:30:07.132 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.132 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.132 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:07.132 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.753297+0000", 2024-05-08T18:30:07.132 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001403619 2024-05-08T18:30:07.132 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.132 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.132 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:07.132 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.754186+0000", 2024-05-08T18:30:07.132 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00088948399999999996 2024-05-08T18:30:07.132 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.132 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.132 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:07.132 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.754280+0000", 2024-05-08T18:30:07.133 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.3838999999999994e-05 2024-05-08T18:30:07.133 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.133 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.133 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:07.133 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.754343+0000", 2024-05-08T18:30:07.133 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2732999999999997e-05 2024-05-08T18:30:07.133 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:07.133 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:07.133 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:07.133 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.133 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.133 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:226 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:07.133 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.754700+0000", 2024-05-08T18:30:07.133 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 15.338419418000001, 2024-05-08T18:30:07.134 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032180080000000001, 2024-05-08T18:30:07.134 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:07.134 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:07.134 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:07.134 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:07.134 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:07.134 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:07.134 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 226 2024-05-08T18:30:07.134 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.134 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:07.134 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.134 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:07.135 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.754700+0000", 2024-05-08T18:30:07.135 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:07.135 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.135 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.135 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:07.135 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.754700+0000", 2024-05-08T18:30:07.135 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:07.135 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.135 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.135 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:07.135 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.754702+0000", 2024-05-08T18:30:07.135 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.86e-06 2024-05-08T18:30:07.135 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.135 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.136 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:07.136 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.754711+0000", 2024-05-08T18:30:07.136 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.0399999999999998e-06 2024-05-08T18:30:07.136 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.136 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.136 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:07.136 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.754735+0000", 2024-05-08T18:30:07.136 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3496e-05 2024-05-08T18:30:07.136 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.136 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.136 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:07.136 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.754753+0000", 2024-05-08T18:30:07.136 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8406e-05 2024-05-08T18:30:07.136 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.137 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.137 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:07.137 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.754941+0000", 2024-05-08T18:30:07.137 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00018746600000000001 2024-05-08T18:30:07.137 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.137 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.137 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:07.137 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.755164+0000", 2024-05-08T18:30:07.137 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022307800000000001 2024-05-08T18:30:07.137 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.137 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.137 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:07.137 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.755552+0000", 2024-05-08T18:30:07.138 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00038834999999999998 2024-05-08T18:30:07.138 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.138 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.138 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:07.138 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.757079+0000", 2024-05-08T18:30:07.138 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001527055 2024-05-08T18:30:07.138 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.138 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.138 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:07.138 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.757769+0000", 2024-05-08T18:30:07.138 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00068953199999999997 2024-05-08T18:30:07.138 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.138 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.139 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:07.139 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.757848+0000", 2024-05-08T18:30:07.139 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9342e-05 2024-05-08T18:30:07.139 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.139 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.139 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:07.139 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.757918+0000", 2024-05-08T18:30:07.139 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0382999999999993e-05 2024-05-08T18:30:07.139 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:07.139 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:07.139 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:07.139 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.139 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.140 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:234 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:07.140 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.783973+0000", 2024-05-08T18:30:07.140 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 15.309147054, 2024-05-08T18:30:07.140 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003359374, 2024-05-08T18:30:07.140 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:07.140 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:07.140 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:07.140 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:07.140 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:07.140 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:07.140 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 234 2024-05-08T18:30:07.140 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.140 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:07.141 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.141 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:07.141 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.783973+0000", 2024-05-08T18:30:07.141 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:07.141 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.141 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.141 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:07.141 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.783973+0000", 2024-05-08T18:30:07.141 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:07.141 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.141 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.141 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:07.141 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.783975+0000", 2024-05-08T18:30:07.142 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2970000000000002e-06 2024-05-08T18:30:07.142 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.142 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.142 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:07.142 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.783986+0000", 2024-05-08T18:30:07.142 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0726e-05 2024-05-08T18:30:07.142 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.142 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.142 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:07.142 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.784016+0000", 2024-05-08T18:30:07.142 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0459000000000001e-05 2024-05-08T18:30:07.142 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.142 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.143 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:07.143 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.784032+0000", 2024-05-08T18:30:07.143 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5316999999999999e-05 2024-05-08T18:30:07.143 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.143 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.143 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:07.143 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.784155+0000", 2024-05-08T18:30:07.143 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012393199999999999 2024-05-08T18:30:07.143 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.143 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.143 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:07.143 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.784377+0000", 2024-05-08T18:30:07.143 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000221179 2024-05-08T18:30:07.144 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.144 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.144 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:07.144 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.784794+0000", 2024-05-08T18:30:07.144 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00041709599999999999 2024-05-08T18:30:07.144 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.144 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.144 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:07.144 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.786199+0000", 2024-05-08T18:30:07.144 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001405346 2024-05-08T18:30:07.144 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.144 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.144 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:07.145 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.787171+0000", 2024-05-08T18:30:07.145 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00097187 2024-05-08T18:30:07.145 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.145 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.145 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:07.145 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.787265+0000", 2024-05-08T18:30:07.145 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4055000000000007e-05 2024-05-08T18:30:07.145 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.145 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.145 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:07.146 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.787332+0000", 2024-05-08T18:30:07.146 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7096999999999998e-05 2024-05-08T18:30:07.146 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:07.146 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:07.146 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:07.146 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.146 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.146 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:425 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:07.146 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.847197+0000", 2024-05-08T18:30:07.146 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 15.245922389, 2024-05-08T18:30:07.146 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003317646, 2024-05-08T18:30:07.146 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:07.147 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:07.147 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:07.147 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:07.147 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:07.147 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:07.147 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 425 2024-05-08T18:30:07.147 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.147 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:07.147 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.147 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:07.147 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.847197+0000", 2024-05-08T18:30:07.147 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:07.147 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.148 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.148 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:07.148 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.847197+0000", 2024-05-08T18:30:07.148 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:07.148 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.148 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.148 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:07.148 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.847200+0000", 2024-05-08T18:30:07.148 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1629999999999999e-06 2024-05-08T18:30:07.148 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.148 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.148 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:07.148 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.847210+0000", 2024-05-08T18:30:07.149 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0180000000000001e-05 2024-05-08T18:30:07.149 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.149 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.149 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:07.149 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.847234+0000", 2024-05-08T18:30:07.149 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3879999999999998e-05 2024-05-08T18:30:07.149 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.149 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.149 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:07.149 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.847247+0000", 2024-05-08T18:30:07.149 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3263e-05 2024-05-08T18:30:07.149 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.149 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.150 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:07.150 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.847356+0000", 2024-05-08T18:30:07.150 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000108906 2024-05-08T18:30:07.150 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.150 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.150 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:07.150 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.847647+0000", 2024-05-08T18:30:07.150 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029143799999999998 2024-05-08T18:30:07.150 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.150 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.150 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:07.150 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.848062+0000", 2024-05-08T18:30:07.150 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000415227 2024-05-08T18:30:07.151 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.151 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.151 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:07.151 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.849591+0000", 2024-05-08T18:30:07.151 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0015288980000000001 2024-05-08T18:30:07.151 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.151 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.151 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:07.151 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.850244+0000", 2024-05-08T18:30:07.151 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000652336 2024-05-08T18:30:07.151 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.151 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.151 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:07.151 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.850418+0000", 2024-05-08T18:30:07.152 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000174284 2024-05-08T18:30:07.152 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.152 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.152 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:07.152 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.850515+0000", 2024-05-08T18:30:07.152 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7071000000000006e-05 2024-05-08T18:30:07.152 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:07.152 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:07.152 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:07.152 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.152 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.152 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:433 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:07.153 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.851403+0000", 2024-05-08T18:30:07.153 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 15.241716608000001, 2024-05-08T18:30:07.153 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032407109999999999, 2024-05-08T18:30:07.153 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:07.153 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:07.153 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:07.153 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:07.153 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:07.153 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:07.153 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 433 2024-05-08T18:30:07.153 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.153 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:07.153 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.153 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:07.154 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.851403+0000", 2024-05-08T18:30:07.154 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:07.154 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.154 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.154 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:07.154 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.851403+0000", 2024-05-08T18:30:07.154 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:07.154 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.154 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.154 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:07.154 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.851405+0000", 2024-05-08T18:30:07.154 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.463e-06 2024-05-08T18:30:07.154 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.155 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.155 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:07.155 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.851411+0000", 2024-05-08T18:30:07.155 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2369999999999997e-06 2024-05-08T18:30:07.155 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.155 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.155 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:07.155 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.851428+0000", 2024-05-08T18:30:07.155 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.696e-05 2024-05-08T18:30:07.155 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.155 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.155 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:07.155 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.851446+0000", 2024-05-08T18:30:07.156 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7706e-05 2024-05-08T18:30:07.156 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.156 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.156 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:07.156 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.851552+0000", 2024-05-08T18:30:07.156 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000106236 2024-05-08T18:30:07.156 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.156 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.156 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:07.156 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.851746+0000", 2024-05-08T18:30:07.156 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000194093 2024-05-08T18:30:07.156 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.156 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.157 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:07.157 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.852148+0000", 2024-05-08T18:30:07.157 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00040243100000000002 2024-05-08T18:30:07.157 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.157 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.157 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:07.157 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.854255+0000", 2024-05-08T18:30:07.157 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002107135 2024-05-08T18:30:07.157 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.157 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.157 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:07.157 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.854326+0000", 2024-05-08T18:30:07.157 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0902999999999995e-05 2024-05-08T18:30:07.158 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.158 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.158 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:07.158 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.854568+0000", 2024-05-08T18:30:07.158 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00024141500000000001 2024-05-08T18:30:07.158 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.158 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.158 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:07.158 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.854644+0000", 2024-05-08T18:30:07.158 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6131999999999995e-05 2024-05-08T18:30:07.158 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:07.158 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:07.159 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:07.159 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.159 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.159 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:436 6.a 6:55b0279d:reshard::reshard.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:07.159 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.852129+0000", 2024-05-08T18:30:07.159 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 15.240990800000001, 2024-05-08T18:30:07.159 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0053015019999999996, 2024-05-08T18:30:07.159 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:07.159 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:07.159 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:07.159 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:07.159 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:07.159 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:07.160 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 436 2024-05-08T18:30:07.160 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.160 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:07.160 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.160 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:07.160 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.852129+0000", 2024-05-08T18:30:07.160 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:07.160 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.160 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.160 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:07.160 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.852129+0000", 2024-05-08T18:30:07.160 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:07.160 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.161 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.161 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:07.161 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.852130+0000", 2024-05-08T18:30:07.161 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.353e-06 2024-05-08T18:30:07.161 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.161 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.161 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:07.161 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.852137+0000", 2024-05-08T18:30:07.161 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6900000000000003e-06 2024-05-08T18:30:07.161 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.161 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.161 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:07.161 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.852156+0000", 2024-05-08T18:30:07.162 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9143e-05 2024-05-08T18:30:07.162 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.162 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.162 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:07.162 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.852169+0000", 2024-05-08T18:30:07.162 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.308e-05 2024-05-08T18:30:07.162 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.162 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.162 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:07.162 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.852700+0000", 2024-05-08T18:30:07.162 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00053086599999999996 2024-05-08T18:30:07.162 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.162 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.163 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:07.163 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.853030+0000", 2024-05-08T18:30:07.163 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00033040100000000002 2024-05-08T18:30:07.163 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.163 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.163 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:07.163 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.853514+0000", 2024-05-08T18:30:07.163 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000483969 2024-05-08T18:30:07.163 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.163 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.163 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:07.163 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.856337+0000", 2024-05-08T18:30:07.163 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0028227349999999998 2024-05-08T18:30:07.163 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.164 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.164 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:07.164 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.857285+0000", 2024-05-08T18:30:07.164 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00094820600000000005 2024-05-08T18:30:07.164 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.164 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.164 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:07.164 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.857366+0000", 2024-05-08T18:30:07.164 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.0889000000000004e-05 2024-05-08T18:30:07.164 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.164 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.164 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:07.164 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.857430+0000", 2024-05-08T18:30:07.165 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4170000000000004e-05 2024-05-08T18:30:07.165 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:07.165 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:07.165 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:07.165 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.165 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.165 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:478 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:07.165 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.876745+0000", 2024-05-08T18:30:07.165 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 15.216374264000001, 2024-05-08T18:30:07.165 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0046303550000000001, 2024-05-08T18:30:07.165 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:07.165 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:07.165 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:07.166 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:07.166 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:07.166 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:07.166 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 478 2024-05-08T18:30:07.166 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.166 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:07.166 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.166 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:07.166 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.876745+0000", 2024-05-08T18:30:07.166 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:07.166 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.166 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.166 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:07.167 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.876745+0000", 2024-05-08T18:30:07.167 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:07.167 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.167 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.167 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:07.167 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.876748+0000", 2024-05-08T18:30:07.167 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2819999999999999e-06 2024-05-08T18:30:07.167 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.167 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.167 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:07.167 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.876758+0000", 2024-05-08T18:30:07.167 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0485e-05 2024-05-08T18:30:07.167 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.168 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.168 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:07.168 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.876788+0000", 2024-05-08T18:30:07.168 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.9879e-05 2024-05-08T18:30:07.168 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.168 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.168 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:07.168 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.876805+0000", 2024-05-08T18:30:07.168 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.643e-05 2024-05-08T18:30:07.168 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.168 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.168 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:07.168 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.876917+0000", 2024-05-08T18:30:07.169 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000112377 2024-05-08T18:30:07.169 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.169 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.169 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:07.169 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877094+0000", 2024-05-08T18:30:07.169 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000177131 2024-05-08T18:30:07.169 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.169 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.169 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:07.169 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877441+0000", 2024-05-08T18:30:07.169 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00034716100000000002 2024-05-08T18:30:07.169 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.169 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.169 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:07.170 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.878479+0000", 2024-05-08T18:30:07.170 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010378729999999999 2024-05-08T18:30:07.170 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.170 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.170 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:07.170 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.881252+0000", 2024-05-08T18:30:07.170 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0027728710000000001 2024-05-08T18:30:07.170 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.170 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.170 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:07.170 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.881322+0000", 2024-05-08T18:30:07.170 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0394000000000004e-05 2024-05-08T18:30:07.170 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.171 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.171 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:07.171 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.881376+0000", 2024-05-08T18:30:07.171 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3471999999999999e-05 2024-05-08T18:30:07.171 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:07.171 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:07.171 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:07.171 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.171 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.171 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:479 6.d 6:b3052b9f:reshard::reshard.0000000013:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:07.171 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.877922+0000", 2024-05-08T18:30:07.171 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 15.215198166, 2024-05-08T18:30:07.171 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0030756400000000001, 2024-05-08T18:30:07.172 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:07.172 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:07.172 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:07.172 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:07.172 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:07.172 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:07.172 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 479 2024-05-08T18:30:07.172 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.172 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:07.172 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.172 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:07.172 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877922+0000", 2024-05-08T18:30:07.172 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:07.173 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.173 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.173 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:07.173 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877922+0000", 2024-05-08T18:30:07.173 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:07.173 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.173 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.173 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:07.173 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877923+0000", 2024-05-08T18:30:07.173 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8670000000000001e-06 2024-05-08T18:30:07.173 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.173 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.173 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:07.173 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877933+0000", 2024-05-08T18:30:07.174 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.0860000000000008e-06 2024-05-08T18:30:07.174 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.174 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.174 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:07.174 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877970+0000", 2024-05-08T18:30:07.174 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7762999999999997e-05 2024-05-08T18:30:07.174 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.174 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.174 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:07.174 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877997+0000", 2024-05-08T18:30:07.174 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6883e-05 2024-05-08T18:30:07.174 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.174 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.175 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:07.175 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.878108+0000", 2024-05-08T18:30:07.175 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000110797 2024-05-08T18:30:07.175 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.175 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.175 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:07.175 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.878403+0000", 2024-05-08T18:30:07.175 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029509799999999999 2024-05-08T18:30:07.175 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.175 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.175 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:07.175 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.878744+0000", 2024-05-08T18:30:07.175 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00034075899999999999 2024-05-08T18:30:07.175 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.176 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.176 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:07.176 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.879800+0000", 2024-05-08T18:30:07.176 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010564420000000001 2024-05-08T18:30:07.176 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.176 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.176 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:07.176 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.880740+0000", 2024-05-08T18:30:07.176 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000940167 2024-05-08T18:30:07.176 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.176 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.176 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:07.176 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.880880+0000", 2024-05-08T18:30:07.177 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000139796 2024-05-08T18:30:07.177 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.177 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.177 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:07.177 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.880997+0000", 2024-05-08T18:30:07.177 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000116982 2024-05-08T18:30:07.177 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:07.177 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:07.177 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:07.177 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.177 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.177 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:766 6.19 6:9edc23b1:::obj_delete_at_hint.0000000063:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:07.177 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.158937+0000", 2024-05-08T18:30:07.177 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 14.934182275, 2024-05-08T18:30:07.178 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0030448300000000001, 2024-05-08T18:30:07.178 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:07.178 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:07.178 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:07.178 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:07.178 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:07.178 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:07.178 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 766 2024-05-08T18:30:07.178 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.178 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:07.178 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.178 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:07.178 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.158937+0000", 2024-05-08T18:30:07.179 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:07.179 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.179 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.179 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:07.179 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.158937+0000", 2024-05-08T18:30:07.179 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:07.179 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.179 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.179 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:07.179 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.158940+0000", 2024-05-08T18:30:07.179 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6170000000000001e-06 2024-05-08T18:30:07.179 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.179 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.179 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:07.180 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.158952+0000", 2024-05-08T18:30:07.180 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1559000000000001e-05 2024-05-08T18:30:07.180 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.180 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.180 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:07.180 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.158982+0000", 2024-05-08T18:30:07.180 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0406999999999999e-05 2024-05-08T18:30:07.180 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.180 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.180 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:07.180 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.159000+0000", 2024-05-08T18:30:07.180 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8e-05 2024-05-08T18:30:07.180 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.180 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.181 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:07.181 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.159090+0000", 2024-05-08T18:30:07.181 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.0124999999999995e-05 2024-05-08T18:30:07.181 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.181 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.181 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:07.181 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.159296+0000", 2024-05-08T18:30:07.181 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000205663 2024-05-08T18:30:07.181 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.181 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.181 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:07.181 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.159600+0000", 2024-05-08T18:30:07.181 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00030387699999999998 2024-05-08T18:30:07.181 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.182 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.182 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:07.182 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.160694+0000", 2024-05-08T18:30:07.182 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001094228 2024-05-08T18:30:07.182 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.182 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.182 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:07.182 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.161818+0000", 2024-05-08T18:30:07.182 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001124388 2024-05-08T18:30:07.185 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.185 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.186 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:07.186 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.161908+0000", 2024-05-08T18:30:07.186 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.9629000000000005e-05 2024-05-08T18:30:07.186 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.186 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.186 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:07.186 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.161982+0000", 2024-05-08T18:30:07.186 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4337000000000003e-05 2024-05-08T18:30:07.186 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:07.186 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:07.186 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:07.186 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.186 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.187 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:820 6.a 6:50a39311:::obj_delete_at_hint.0000000081:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:07.187 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.281842+0000", 2024-05-08T18:30:07.187 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 14.811277874, 2024-05-08T18:30:07.187 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0030574130000000001, 2024-05-08T18:30:07.187 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:07.187 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:07.187 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:07.187 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:07.187 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:07.187 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:07.187 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 820 2024-05-08T18:30:07.187 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.187 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:07.188 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.188 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:07.188 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.281842+0000", 2024-05-08T18:30:07.188 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:07.188 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.188 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.188 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:07.188 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.281842+0000", 2024-05-08T18:30:07.188 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:07.188 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.188 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.188 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:07.188 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.281845+0000", 2024-05-08T18:30:07.188 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8439999999999998e-06 2024-05-08T18:30:07.189 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.189 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.189 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:07.189 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.281856+0000", 2024-05-08T18:30:07.189 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.148e-05 2024-05-08T18:30:07.189 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.189 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.189 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:07.189 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.281887+0000", 2024-05-08T18:30:07.189 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1239999999999999e-05 2024-05-08T18:30:07.189 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.189 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.189 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:07.190 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.281903+0000", 2024-05-08T18:30:07.190 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5223e-05 2024-05-08T18:30:07.190 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.190 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.190 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:07.190 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.282084+0000", 2024-05-08T18:30:07.190 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00018167500000000001 2024-05-08T18:30:07.190 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.190 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.190 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:07.190 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.282301+0000", 2024-05-08T18:30:07.190 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00021651099999999999 2024-05-08T18:30:07.190 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.191 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.191 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:07.191 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.282634+0000", 2024-05-08T18:30:07.191 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000332758 2024-05-08T18:30:07.191 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.191 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.191 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:07.191 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.283836+0000", 2024-05-08T18:30:07.191 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001202397 2024-05-08T18:30:07.191 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.191 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.191 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:07.191 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.284750+0000", 2024-05-08T18:30:07.191 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00091438999999999995 2024-05-08T18:30:07.192 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.192 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.192 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:07.192 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.284836+0000", 2024-05-08T18:30:07.192 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.5855999999999999e-05 2024-05-08T18:30:07.192 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.192 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.192 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:07.192 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.284899+0000", 2024-05-08T18:30:07.192 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3039000000000004e-05 2024-05-08T18:30:07.192 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:07.192 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:07.192 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:07.192 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.193 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.193 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:835 6.7 6:e09767b9:::obj_delete_at_hint.0000000086:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:07.193 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.317765+0000", 2024-05-08T18:30:07.193 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 14.775354985, 2024-05-08T18:30:07.193 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029952809999999998, 2024-05-08T18:30:07.193 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:07.193 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:07.193 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:07.193 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:07.193 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:07.193 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:07.193 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 835 2024-05-08T18:30:07.193 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.193 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:07.193 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.194 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:07.194 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.317765+0000", 2024-05-08T18:30:07.194 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:07.194 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.194 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.194 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:07.194 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.317765+0000", 2024-05-08T18:30:07.194 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:07.194 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.194 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.194 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:07.194 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.317767+0000", 2024-05-08T18:30:07.194 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.057e-06 2024-05-08T18:30:07.195 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.195 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.195 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:07.195 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.317780+0000", 2024-05-08T18:30:07.195 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.36e-05 2024-05-08T18:30:07.195 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.195 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.195 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:07.195 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.317810+0000", 2024-05-08T18:30:07.195 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.9989999999999999e-05 2024-05-08T18:30:07.195 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.195 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.195 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:07.195 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.317832+0000", 2024-05-08T18:30:07.195 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1650000000000001e-05 2024-05-08T18:30:07.196 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.196 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.196 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:07.196 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.317954+0000", 2024-05-08T18:30:07.196 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000121465 2024-05-08T18:30:07.196 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.196 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.196 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:07.196 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.318189+0000", 2024-05-08T18:30:07.196 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000235818 2024-05-08T18:30:07.196 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.196 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.196 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:07.196 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.318532+0000", 2024-05-08T18:30:07.197 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00034245100000000002 2024-05-08T18:30:07.197 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.197 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.197 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:07.197 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.319625+0000", 2024-05-08T18:30:07.197 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010931280000000001 2024-05-08T18:30:07.197 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.197 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.197 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:07.197 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.320612+0000", 2024-05-08T18:30:07.197 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00098682299999999995 2024-05-08T18:30:07.197 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.197 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.197 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:07.198 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.320698+0000", 2024-05-08T18:30:07.198 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.5813e-05 2024-05-08T18:30:07.198 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.198 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.198 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:07.198 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.320760+0000", 2024-05-08T18:30:07.198 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2485999999999998e-05 2024-05-08T18:30:07.198 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:07.198 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:07.198 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:07.198 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.198 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.198 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:922 6.d 6:b6c174be:::obj_delete_at_hint.0000000115:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:07.199 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.516256+0000", 2024-05-08T18:30:07.199 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 14.576864033, 2024-05-08T18:30:07.199 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032949839999999999, 2024-05-08T18:30:07.199 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:07.199 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:07.199 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:07.199 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:07.199 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:07.199 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:07.199 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 922 2024-05-08T18:30:07.199 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.199 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:07.199 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.199 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:07.200 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.516256+0000", 2024-05-08T18:30:07.200 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:07.200 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.200 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.200 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:07.200 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.516256+0000", 2024-05-08T18:30:07.200 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:07.200 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.200 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.200 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:07.200 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.516258+0000", 2024-05-08T18:30:07.200 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.4399999999999999e-06 2024-05-08T18:30:07.201 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.201 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.201 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:07.201 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.516269+0000", 2024-05-08T18:30:07.201 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0797e-05 2024-05-08T18:30:07.201 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.201 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.201 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:07.201 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.516299+0000", 2024-05-08T18:30:07.201 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0213e-05 2024-05-08T18:30:07.201 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.201 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.201 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:07.201 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.516314+0000", 2024-05-08T18:30:07.202 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4600000000000001e-05 2024-05-08T18:30:07.202 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.202 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.202 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:07.202 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.516424+0000", 2024-05-08T18:30:07.202 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000110376 2024-05-08T18:30:07.202 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.202 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.202 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:07.202 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.516635+0000", 2024-05-08T18:30:07.202 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000210628 2024-05-08T18:30:07.202 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.202 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.203 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:07.203 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.516947+0000", 2024-05-08T18:30:07.203 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00031246699999999997 2024-05-08T18:30:07.203 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.203 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.203 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:07.203 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.517949+0000", 2024-05-08T18:30:07.203 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010017400000000001 2024-05-08T18:30:07.203 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.203 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.203 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:07.203 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.519389+0000", 2024-05-08T18:30:07.203 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001439655 2024-05-08T18:30:07.203 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.204 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.204 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:07.204 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.519475+0000", 2024-05-08T18:30:07.204 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.6485999999999998e-05 2024-05-08T18:30:07.204 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.204 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.204 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:07.204 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.519551+0000", 2024-05-08T18:30:07.204 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5581999999999996e-05 2024-05-08T18:30:07.204 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:07.204 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:07.204 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:07.204 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.205 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.205 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:940 6.a 6:517698f6:::obj_delete_at_hint.0000000121:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:07.205 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.560553+0000", 2024-05-08T18:30:07.205 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 14.532567185, 2024-05-08T18:30:07.205 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0030017569999999999, 2024-05-08T18:30:07.205 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:07.205 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:07.205 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:07.205 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:07.205 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:07.205 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:07.205 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 940 2024-05-08T18:30:07.205 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.205 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:07.206 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.206 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:07.206 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.560553+0000", 2024-05-08T18:30:07.206 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:07.206 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.206 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.206 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:07.206 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.560553+0000", 2024-05-08T18:30:07.206 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:07.206 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.206 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.206 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:07.206 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.560555+0000", 2024-05-08T18:30:07.207 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.39e-06 2024-05-08T18:30:07.207 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.207 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.207 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:07.207 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.560566+0000", 2024-05-08T18:30:07.207 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1484000000000001e-05 2024-05-08T18:30:07.207 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.207 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.207 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:07.207 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.560596+0000", 2024-05-08T18:30:07.207 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0001999999999998e-05 2024-05-08T18:30:07.207 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.207 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.207 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:07.208 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.560612+0000", 2024-05-08T18:30:07.208 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5690000000000001e-05 2024-05-08T18:30:07.208 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.208 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.208 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:07.208 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.560747+0000", 2024-05-08T18:30:07.208 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013494900000000001 2024-05-08T18:30:07.208 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.208 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.208 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:07.208 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.560961+0000", 2024-05-08T18:30:07.208 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000214305 2024-05-08T18:30:07.208 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.208 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.209 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:07.209 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.561281+0000", 2024-05-08T18:30:07.209 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00031933800000000001 2024-05-08T18:30:07.209 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.209 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.209 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:07.209 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.562399+0000", 2024-05-08T18:30:07.209 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0011180280000000001 2024-05-08T18:30:07.209 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.209 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.209 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:07.209 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.563407+0000", 2024-05-08T18:30:07.209 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010080519999999999 2024-05-08T18:30:07.209 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.210 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.210 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:07.210 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.563489+0000", 2024-05-08T18:30:07.210 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1725999999999996e-05 2024-05-08T18:30:07.210 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.210 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.210 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:07.210 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.563554+0000", 2024-05-08T18:30:07.210 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5792999999999998e-05 2024-05-08T18:30:07.210 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:07.210 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:07.210 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:07.210 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.210 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.211 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:943 6.19 6:9f21944d:::obj_delete_at_hint.0000000122:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:07.211 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.567777+0000", 2024-05-08T18:30:07.211 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 14.525342294, 2024-05-08T18:30:07.211 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0033921939999999999, 2024-05-08T18:30:07.211 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:07.211 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:07.211 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:07.211 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:07.211 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:07.211 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:07.211 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 943 2024-05-08T18:30:07.211 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.211 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:07.211 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.212 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:07.212 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.567777+0000", 2024-05-08T18:30:07.212 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:07.212 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.212 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.212 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:07.212 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.567777+0000", 2024-05-08T18:30:07.212 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:07.212 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.212 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.212 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:07.212 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.567779+0000", 2024-05-08T18:30:07.212 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8330000000000001e-06 2024-05-08T18:30:07.212 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.213 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.213 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:07.213 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.567788+0000", 2024-05-08T18:30:07.213 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4999999999999999e-06 2024-05-08T18:30:07.213 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.213 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.213 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:07.213 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.567812+0000", 2024-05-08T18:30:07.213 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.4207e-05 2024-05-08T18:30:07.213 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.213 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.213 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:07.213 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.567836+0000", 2024-05-08T18:30:07.213 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.4196e-05 2024-05-08T18:30:07.214 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.214 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.214 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:07.214 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.567954+0000", 2024-05-08T18:30:07.214 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011794300000000001 2024-05-08T18:30:07.214 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.214 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.214 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:07.214 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.568170+0000", 2024-05-08T18:30:07.214 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00021626100000000001 2024-05-08T18:30:07.214 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.214 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.215 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:07.215 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.568485+0000", 2024-05-08T18:30:07.215 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00031442800000000001 2024-05-08T18:30:07.215 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.215 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.215 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:07.215 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.569555+0000", 2024-05-08T18:30:07.215 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010698750000000001 2024-05-08T18:30:07.215 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.215 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.215 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:07.215 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.570899+0000", 2024-05-08T18:30:07.215 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0013446700000000001 2024-05-08T18:30:07.215 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.216 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.216 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:07.216 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.571058+0000", 2024-05-08T18:30:07.216 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015871900000000001 2024-05-08T18:30:07.216 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.216 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.216 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:07.216 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.571170+0000", 2024-05-08T18:30:07.216 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000111562 2024-05-08T18:30:07.216 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:07.216 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:07.216 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:07.216 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.216 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.217 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:952 6.a 6:541d369a:::obj_delete_at_hint.0000000125:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:07.217 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.588764+0000", 2024-05-08T18:30:07.217 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 14.504355263000001, 2024-05-08T18:30:07.217 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003183399, 2024-05-08T18:30:07.217 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:07.217 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:07.217 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:07.217 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:07.217 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:07.217 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:07.217 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 952 2024-05-08T18:30:07.217 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.218 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:07.218 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.218 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:07.218 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.588764+0000", 2024-05-08T18:30:07.218 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:07.218 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.218 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.218 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:07.218 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.588764+0000", 2024-05-08T18:30:07.218 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:07.218 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.218 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.218 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:07.219 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.588767+0000", 2024-05-08T18:30:07.219 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.39e-06 2024-05-08T18:30:07.219 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.219 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.219 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:07.219 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.588778+0000", 2024-05-08T18:30:07.219 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1304000000000001e-05 2024-05-08T18:30:07.219 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.219 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.219 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:07.219 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.588810+0000", 2024-05-08T18:30:07.219 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1726000000000001e-05 2024-05-08T18:30:07.219 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.219 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.220 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:07.220 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.588834+0000", 2024-05-08T18:30:07.220 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3845999999999998e-05 2024-05-08T18:30:07.220 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.220 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.220 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:07.220 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.588987+0000", 2024-05-08T18:30:07.220 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015300200000000001 2024-05-08T18:30:07.220 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.220 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.220 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:07.220 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.589197+0000", 2024-05-08T18:30:07.220 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020992299999999999 2024-05-08T18:30:07.220 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.221 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.221 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:07.221 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.589536+0000", 2024-05-08T18:30:07.221 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00033939300000000001 2024-05-08T18:30:07.221 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.221 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.221 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:07.221 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.590827+0000", 2024-05-08T18:30:07.221 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0012906 2024-05-08T18:30:07.221 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.221 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.221 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:07.221 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.591757+0000", 2024-05-08T18:30:07.221 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00093020699999999995 2024-05-08T18:30:07.222 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.222 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.222 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:07.222 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.591881+0000", 2024-05-08T18:30:07.222 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012406900000000001 2024-05-08T18:30:07.222 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.222 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.222 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:07.222 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.591948+0000", 2024-05-08T18:30:07.222 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6939000000000004e-05 2024-05-08T18:30:07.222 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:07.222 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:07.222 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:07.223 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:07.223 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:07.223 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:30:07.225 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-08T18:30:07.225 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:30:07.224+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:30:07.327 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:30:07.326+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:30:07.396 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:30:07.397 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:30:07.397 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 0 2024-05-08T18:30:07.397 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:30:07.411 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-08T18:30:07.427 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:30:07.426+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:30:07.528 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:30:07.528+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:30:07.532 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:30:07.533 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:30:07.533 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2024-05-08T18:30:07.533 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2024-05-08T18:30:07.533 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:30:07.547 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-08T18:30:07.640 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:30:07.640+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:30:07.720 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:30:07.720 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2024-05-08T18:30:07.720 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2024-05-08T18:30:07.720 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-05-08T18:30:07.720 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.721 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:30:07.721 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:48.647802+0000", 2024-05-08T18:30:07.721 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 19.071776202999999, 2024-05-08T18:30:07.721 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0027254660000000002, 2024-05-08T18:30:07.721 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:07.721 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:07.721 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:07.721 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:07.721 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:07.721 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:07.721 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 46 2024-05-08T18:30:07.721 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.721 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:07.722 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.722 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:07.722 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.647802+0000", 2024-05-08T18:30:07.722 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:07.722 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.722 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.722 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:07.722 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.647802+0000", 2024-05-08T18:30:07.722 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:07.722 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.722 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.722 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:07.723 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.647805+0000", 2024-05-08T18:30:07.723 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8940000000000002e-06 2024-05-08T18:30:07.723 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.723 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.723 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:07.723 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.647816+0000", 2024-05-08T18:30:07.723 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0998999999999999e-05 2024-05-08T18:30:07.723 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.723 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.723 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:07.723 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.647846+0000", 2024-05-08T18:30:07.723 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.027e-05 2024-05-08T18:30:07.723 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.724 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.724 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:07.724 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.647865+0000", 2024-05-08T18:30:07.724 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.808e-05 2024-05-08T18:30:07.724 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.724 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.724 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:07.724 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.647994+0000", 2024-05-08T18:30:07.724 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012923899999999999 2024-05-08T18:30:07.724 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.724 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.724 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:07.724 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.648289+0000", 2024-05-08T18:30:07.725 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029495999999999998 2024-05-08T18:30:07.725 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.725 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.725 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:07.725 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.648576+0000", 2024-05-08T18:30:07.725 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00028707599999999999 2024-05-08T18:30:07.725 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.725 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.725 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:07.725 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.649703+0000", 2024-05-08T18:30:07.725 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001126658 2024-05-08T18:30:07.725 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.726 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.726 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:07.726 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.650337+0000", 2024-05-08T18:30:07.726 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00063405500000000001 2024-05-08T18:30:07.726 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.726 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.726 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:07.726 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.650451+0000", 2024-05-08T18:30:07.726 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011476600000000001 2024-05-08T18:30:07.726 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.726 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.726 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:07.727 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.650528+0000", 2024-05-08T18:30:07.727 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6469000000000003e-05 2024-05-08T18:30:07.727 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:07.727 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:07.727 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:07.727 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.727 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.727 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94069412627456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:30:07.727 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:48.650773+0000", 2024-05-08T18:30:07.727 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 19.068805664999999, 2024-05-08T18:30:07.727 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0024358209999999999, 2024-05-08T18:30:07.727 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:07.727 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:07.728 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:07.728 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:07.728 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:07.728 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:07.728 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 47 2024-05-08T18:30:07.728 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.728 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:07.728 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.728 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:07.728 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.650773+0000", 2024-05-08T18:30:07.728 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:07.728 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.728 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.729 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:07.729 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.650773+0000", 2024-05-08T18:30:07.729 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:07.729 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.729 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.729 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:07.729 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.650775+0000", 2024-05-08T18:30:07.729 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.4030000000000001e-06 2024-05-08T18:30:07.729 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.729 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.729 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:07.729 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.650785+0000", 2024-05-08T18:30:07.729 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0027000000000001e-05 2024-05-08T18:30:07.729 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.730 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.730 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:07.730 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.650814+0000", 2024-05-08T18:30:07.730 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8350000000000001e-05 2024-05-08T18:30:07.730 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.730 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.730 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:07.730 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.650848+0000", 2024-05-08T18:30:07.730 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4566000000000001e-05 2024-05-08T18:30:07.730 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.730 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.730 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:07.731 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.650963+0000", 2024-05-08T18:30:07.731 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011506300000000001 2024-05-08T18:30:07.731 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.731 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.731 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:07.731 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.651153+0000", 2024-05-08T18:30:07.731 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000189812 2024-05-08T18:30:07.731 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.731 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.731 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:07.731 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.651493+0000", 2024-05-08T18:30:07.731 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000339616 2024-05-08T18:30:07.731 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.732 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.732 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:07.732 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.652662+0000", 2024-05-08T18:30:07.732 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0011695410000000001 2024-05-08T18:30:07.732 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.732 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.732 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:07.732 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.652998+0000", 2024-05-08T18:30:07.732 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000335788 2024-05-08T18:30:07.732 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.732 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.733 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:07.733 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.653076+0000", 2024-05-08T18:30:07.733 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8120000000000004e-05 2024-05-08T18:30:07.733 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.733 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.733 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:07.733 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.653209+0000", 2024-05-08T18:30:07.733 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000132535 2024-05-08T18:30:07.733 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:07.733 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:07.733 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:07.733 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.733 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.734 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:30:07.734 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:48.659528+0000", 2024-05-08T18:30:07.734 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 19.060050449999999, 2024-05-08T18:30:07.734 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0025123260000000001, 2024-05-08T18:30:07.734 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:07.734 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:07.734 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:07.734 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:07.734 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:07.734 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:07.734 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 54 2024-05-08T18:30:07.735 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.735 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:07.735 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.735 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:07.735 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.659528+0000", 2024-05-08T18:30:07.735 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:07.735 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.735 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.735 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:07.735 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.659528+0000", 2024-05-08T18:30:07.735 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:07.735 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.735 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.736 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:07.736 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.659530+0000", 2024-05-08T18:30:07.736 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9429999999999999e-06 2024-05-08T18:30:07.736 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.736 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.736 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:07.736 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.659540+0000", 2024-05-08T18:30:07.736 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0147e-05 2024-05-08T18:30:07.736 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.736 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.736 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:07.736 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.659569+0000", 2024-05-08T18:30:07.736 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.923e-05 2024-05-08T18:30:07.737 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.737 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.737 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:07.737 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.659584+0000", 2024-05-08T18:30:07.737 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4996e-05 2024-05-08T18:30:07.737 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.737 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.737 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:07.737 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.659716+0000", 2024-05-08T18:30:07.737 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000131457 2024-05-08T18:30:07.737 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.737 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.737 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:07.738 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.659895+0000", 2024-05-08T18:30:07.738 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017940400000000001 2024-05-08T18:30:07.738 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.738 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.738 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:07.738 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.660092+0000", 2024-05-08T18:30:07.738 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000197002 2024-05-08T18:30:07.738 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.738 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.738 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:07.738 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.661227+0000", 2024-05-08T18:30:07.738 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0011346150000000001 2024-05-08T18:30:07.739 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.739 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.739 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:07.739 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.661907+0000", 2024-05-08T18:30:07.739 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00068008800000000002 2024-05-08T18:30:07.739 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.739 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.739 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:07.739 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.661978+0000", 2024-05-08T18:30:07.739 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1538999999999994e-05 2024-05-08T18:30:07.739 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.739 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.739 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:07.739 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.662040+0000", 2024-05-08T18:30:07.740 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1904999999999998e-05 2024-05-08T18:30:07.740 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:07.740 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:07.740 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:07.740 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.740 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.740 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94069412622848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:30:07.740 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:48.662241+0000", 2024-05-08T18:30:07.740 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 19.057337124, 2024-05-08T18:30:07.740 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029022259999999999, 2024-05-08T18:30:07.740 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:07.741 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:07.741 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:07.741 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:07.741 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:07.741 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:07.741 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 55 2024-05-08T18:30:07.741 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.741 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:07.741 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.741 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:07.741 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.662241+0000", 2024-05-08T18:30:07.741 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:07.741 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.742 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.742 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:07.742 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.662241+0000", 2024-05-08T18:30:07.742 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:07.742 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.742 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.742 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:07.742 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.662243+0000", 2024-05-08T18:30:07.742 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.716e-06 2024-05-08T18:30:07.742 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.742 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.742 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:07.742 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.662267+0000", 2024-05-08T18:30:07.743 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3949999999999999e-05 2024-05-08T18:30:07.743 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.743 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.743 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:07.743 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.662293+0000", 2024-05-08T18:30:07.743 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6376e-05 2024-05-08T18:30:07.743 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.743 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.743 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:07.743 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.662310+0000", 2024-05-08T18:30:07.743 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6520000000000001e-05 2024-05-08T18:30:07.743 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.743 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.744 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:07.744 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.662412+0000", 2024-05-08T18:30:07.744 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010228700000000001 2024-05-08T18:30:07.744 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.744 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.744 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:07.744 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.662514+0000", 2024-05-08T18:30:07.744 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0001019 2024-05-08T18:30:07.744 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.744 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.744 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:07.744 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.662714+0000", 2024-05-08T18:30:07.745 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020008100000000001 2024-05-08T18:30:07.745 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.745 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.745 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:07.745 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.663711+0000", 2024-05-08T18:30:07.745 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00099629899999999997 2024-05-08T18:30:07.745 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.745 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.746 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:07.746 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.664976+0000", 2024-05-08T18:30:07.746 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0012652679999999999 2024-05-08T18:30:07.746 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.746 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.746 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:07.746 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.665047+0000", 2024-05-08T18:30:07.746 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1277000000000002e-05 2024-05-08T18:30:07.746 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.746 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.746 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:07.746 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.665144+0000", 2024-05-08T18:30:07.747 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6552000000000007e-05 2024-05-08T18:30:07.747 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:07.747 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:07.747 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:07.747 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.747 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.747 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:209 6.3 e33/27 6:c60da066:gc::gc.4:head v 33'1, mlcod=0'0)", 2024-05-08T18:30:07.747 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.686317+0000", 2024-05-08T18:30:07.747 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 16.033261119999999, 2024-05-08T18:30:07.747 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032126889999999999, 2024-05-08T18:30:07.747 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:07.747 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:07.747 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:07.747 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:07.748 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.748 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:07.748 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.686317+0000", 2024-05-08T18:30:07.748 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:07.748 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.748 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.748 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:07.748 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.686317+0000", 2024-05-08T18:30:07.748 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:07.748 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.748 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.749 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:07.749 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.686318+0000", 2024-05-08T18:30:07.749 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5400000000000001e-07 2024-05-08T18:30:07.749 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.749 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.749 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:07.749 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.686326+0000", 2024-05-08T18:30:07.749 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3000000000000002e-06 2024-05-08T18:30:07.749 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.749 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.749 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:07.749 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.686358+0000", 2024-05-08T18:30:07.749 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1702999999999998e-05 2024-05-08T18:30:07.749 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.750 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.750 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:07.750 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.686374+0000", 2024-05-08T18:30:07.750 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6266e-05 2024-05-08T18:30:07.750 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.750 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.750 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:07.750 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.686530+0000", 2024-05-08T18:30:07.750 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015583599999999999 2024-05-08T18:30:07.750 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.750 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.751 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:07.751 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.686573+0000", 2024-05-08T18:30:07.751 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3248999999999999e-05 2024-05-08T18:30:07.751 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.751 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.751 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:07.751 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.689412+0000", 2024-05-08T18:30:07.751 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0028385720000000001 2024-05-08T18:30:07.751 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.751 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.751 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:07.751 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.689530+0000", 2024-05-08T18:30:07.751 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000118109 2024-05-08T18:30:07.752 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:07.752 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:07.752 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:07.752 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.752 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.752 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:217 6.15 e33/27 6:ab569f81:gc::gc.12:head v 33'1, mlcod=0'0)", 2024-05-08T18:30:07.752 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.722458+0000", 2024-05-08T18:30:07.752 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 15.997120579000001, 2024-05-08T18:30:07.752 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001760604, 2024-05-08T18:30:07.752 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:07.752 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:07.752 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:07.752 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:07.753 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.753 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:07.753 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.722458+0000", 2024-05-08T18:30:07.753 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:07.753 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.753 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.753 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:07.753 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.722458+0000", 2024-05-08T18:30:07.753 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:07.753 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.753 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.753 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:07.753 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.722460+0000", 2024-05-08T18:30:07.753 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.677e-06 2024-05-08T18:30:07.754 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.754 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.754 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:07.754 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.722471+0000", 2024-05-08T18:30:07.754 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0956e-05 2024-05-08T18:30:07.754 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.754 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.754 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:07.754 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.722496+0000", 2024-05-08T18:30:07.754 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5490000000000002e-05 2024-05-08T18:30:07.754 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.754 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.755 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:07.755 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.722511+0000", 2024-05-08T18:30:07.755 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4687e-05 2024-05-08T18:30:07.755 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.755 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.755 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:07.755 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.722609+0000", 2024-05-08T18:30:07.755 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8152000000000005e-05 2024-05-08T18:30:07.755 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.755 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.755 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:07.755 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.722638+0000", 2024-05-08T18:30:07.755 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.934e-05 2024-05-08T18:30:07.755 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.756 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.756 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:07.756 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.724127+0000", 2024-05-08T18:30:07.756 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001488622 2024-05-08T18:30:07.756 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.756 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.756 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:07.756 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.724219+0000", 2024-05-08T18:30:07.756 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1680000000000003e-05 2024-05-08T18:30:07.756 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:07.756 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:07.756 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:07.756 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.756 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.757 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:231 6.1f e33/27 6:fde4dd55:gc::gc.26:head v 33'1, mlcod=0'0)", 2024-05-08T18:30:07.757 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.773905+0000", 2024-05-08T18:30:07.757 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 15.945673039000001, 2024-05-08T18:30:07.757 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002018681, 2024-05-08T18:30:07.757 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:07.757 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:07.757 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:07.757 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:07.757 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.757 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:07.757 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.773905+0000", 2024-05-08T18:30:07.757 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:07.757 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.757 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.758 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:07.758 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.773905+0000", 2024-05-08T18:30:07.758 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:07.758 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.758 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.758 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:07.758 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.773906+0000", 2024-05-08T18:30:07.758 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2300000000000001e-07 2024-05-08T18:30:07.758 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.758 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.758 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:07.758 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.773913+0000", 2024-05-08T18:30:07.758 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8399999999999997e-06 2024-05-08T18:30:07.759 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.759 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.759 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:07.759 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.773938+0000", 2024-05-08T18:30:07.759 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.4977000000000002e-05 2024-05-08T18:30:07.759 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.759 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.759 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:07.759 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.773970+0000", 2024-05-08T18:30:07.759 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1673e-05 2024-05-08T18:30:07.759 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.759 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.759 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:07.759 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.774112+0000", 2024-05-08T18:30:07.760 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014273899999999999 2024-05-08T18:30:07.760 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.760 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.760 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:07.760 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.774167+0000", 2024-05-08T18:30:07.760 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4762000000000002e-05 2024-05-08T18:30:07.760 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.760 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.760 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:07.760 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.775832+0000", 2024-05-08T18:30:07.760 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0016648539999999999 2024-05-08T18:30:07.760 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.760 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.760 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:07.761 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.775924+0000", 2024-05-08T18:30:07.761 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2312999999999995e-05 2024-05-08T18:30:07.761 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:07.761 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:07.761 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:07.761 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.761 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.761 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:328 6.15 e33/27 6:ab569f81:gc::gc.12:head v 33'3, mlcod=33'1)", 2024-05-08T18:30:07.761 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.811368+0000", 2024-05-08T18:30:07.761 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 15.908210538000001, 2024-05-08T18:30:07.761 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0019828110000000001, 2024-05-08T18:30:07.761 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:07.761 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:07.761 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:07.762 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:07.762 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.762 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:07.762 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.811368+0000", 2024-05-08T18:30:07.762 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:07.762 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.762 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.762 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:07.762 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.811368+0000", 2024-05-08T18:30:07.762 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:07.762 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.762 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.762 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:07.763 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.811370+0000", 2024-05-08T18:30:07.763 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.883e-06 2024-05-08T18:30:07.763 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.763 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.763 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:07.763 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.811385+0000", 2024-05-08T18:30:07.763 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5489999999999999e-05 2024-05-08T18:30:07.763 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.763 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.763 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:07.763 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.811422+0000", 2024-05-08T18:30:07.763 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7023000000000001e-05 2024-05-08T18:30:07.763 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.764 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.764 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:07.764 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.811443+0000", 2024-05-08T18:30:07.764 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0194e-05 2024-05-08T18:30:07.764 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.764 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.764 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:07.764 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.811582+0000", 2024-05-08T18:30:07.764 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000139068 2024-05-08T18:30:07.764 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.764 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.764 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:07.764 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.811646+0000", 2024-05-08T18:30:07.764 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4113000000000001e-05 2024-05-08T18:30:07.765 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.765 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.765 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:07.765 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.813243+0000", 2024-05-08T18:30:07.765 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0015969249999999999 2024-05-08T18:30:07.765 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.765 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.765 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:07.765 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.813351+0000", 2024-05-08T18:30:07.765 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000108115 2024-05-08T18:30:07.765 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:07.765 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:07.765 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:07.765 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.766 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.766 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:341 6.1 e33/27 6:856b9b26:reshard::reshard.0000000002:head v 33'2, mlcod=0'0)", 2024-05-08T18:30:07.766 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.813091+0000", 2024-05-08T18:30:07.766 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 15.906487271, 2024-05-08T18:30:07.766 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0021783459999999998, 2024-05-08T18:30:07.766 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:07.766 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:07.766 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:07.766 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:07.766 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.766 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:07.766 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.813091+0000", 2024-05-08T18:30:07.766 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:07.767 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.767 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.767 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:07.767 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.813091+0000", 2024-05-08T18:30:07.767 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:07.767 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.767 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.767 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:07.767 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.813093+0000", 2024-05-08T18:30:07.767 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.813e-06 2024-05-08T18:30:07.767 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.767 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.768 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:07.768 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.813107+0000", 2024-05-08T18:30:07.768 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3730000000000001e-05 2024-05-08T18:30:07.768 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.768 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.768 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:07.768 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.813177+0000", 2024-05-08T18:30:07.768 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9801999999999993e-05 2024-05-08T18:30:07.768 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.768 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.768 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:07.768 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.813198+0000", 2024-05-08T18:30:07.769 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1347000000000001e-05 2024-05-08T18:30:07.769 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.769 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.769 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:07.769 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.813321+0000", 2024-05-08T18:30:07.769 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000123192 2024-05-08T18:30:07.769 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.769 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.769 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:07.769 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.813373+0000", 2024-05-08T18:30:07.769 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2046999999999998e-05 2024-05-08T18:30:07.769 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.769 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.769 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:07.770 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.815181+0000", 2024-05-08T18:30:07.770 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001807562 2024-05-08T18:30:07.770 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.770 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.770 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:07.770 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.815270+0000", 2024-05-08T18:30:07.770 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8852999999999998e-05 2024-05-08T18:30:07.770 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:07.770 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:07.770 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:07.771 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.771 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.771 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:404 6.3 e33/27 6:c623b173:gc::gc.16:head v 33'6, mlcod=33'4)", 2024-05-08T18:30:07.771 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.837510+0000", 2024-05-08T18:30:07.771 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 15.88206896, 2024-05-08T18:30:07.771 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0023724549999999999, 2024-05-08T18:30:07.771 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:07.771 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:07.771 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:07.771 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:07.771 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.771 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:07.771 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.837510+0000", 2024-05-08T18:30:07.771 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:07.772 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.772 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.772 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:07.772 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.837510+0000", 2024-05-08T18:30:07.772 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:07.772 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.772 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.772 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:07.772 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.837511+0000", 2024-05-08T18:30:07.772 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.863e-06 2024-05-08T18:30:07.772 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.772 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.772 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:07.773 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.837526+0000", 2024-05-08T18:30:07.773 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4756999999999999e-05 2024-05-08T18:30:07.773 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.773 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.773 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:07.773 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.837564+0000", 2024-05-08T18:30:07.773 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7645999999999998e-05 2024-05-08T18:30:07.773 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.773 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.773 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:07.773 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.837584+0000", 2024-05-08T18:30:07.773 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9763999999999999e-05 2024-05-08T18:30:07.773 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.773 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.774 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:07.774 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.837724+0000", 2024-05-08T18:30:07.774 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014080200000000001 2024-05-08T18:30:07.774 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.774 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.774 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:07.774 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.837776+0000", 2024-05-08T18:30:07.774 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1279000000000002e-05 2024-05-08T18:30:07.774 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.774 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.774 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:07.774 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.839770+0000", 2024-05-08T18:30:07.774 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001994048 2024-05-08T18:30:07.775 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.775 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.775 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:07.775 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.839882+0000", 2024-05-08T18:30:07.775 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000112296 2024-05-08T18:30:07.775 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:07.775 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:07.775 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:07.775 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.775 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.775 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:414 6.c e33/27 6:338eb7e9:::obj_delete_at_hint.0000000008:head v 33'3, mlcod=33'1)", 2024-05-08T18:30:07.776 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.841401+0000", 2024-05-08T18:30:07.776 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 15.87817781, 2024-05-08T18:30:07.776 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001916865, 2024-05-08T18:30:07.776 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:07.776 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:07.776 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:07.776 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:07.776 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.776 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:07.776 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.841401+0000", 2024-05-08T18:30:07.776 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:07.776 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.776 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.777 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:07.777 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.841401+0000", 2024-05-08T18:30:07.777 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:07.777 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.777 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.777 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:07.777 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.841402+0000", 2024-05-08T18:30:07.777 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6899999999999999e-06 2024-05-08T18:30:07.777 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.777 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.777 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:07.777 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.841414+0000", 2024-05-08T18:30:07.777 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.183e-05 2024-05-08T18:30:07.777 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.778 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.778 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:07.778 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.841435+0000", 2024-05-08T18:30:07.778 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0876000000000001e-05 2024-05-08T18:30:07.778 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.778 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.778 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:07.778 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.841451+0000", 2024-05-08T18:30:07.778 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5784e-05 2024-05-08T18:30:07.778 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.778 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.778 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:07.778 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.841597+0000", 2024-05-08T18:30:07.779 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014639899999999999 2024-05-08T18:30:07.779 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.779 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.779 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:07.779 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.841656+0000", 2024-05-08T18:30:07.779 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8485e-05 2024-05-08T18:30:07.779 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.779 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.779 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:07.779 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.843235+0000", 2024-05-08T18:30:07.779 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0015787920000000001 2024-05-08T18:30:07.779 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.779 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.780 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:07.780 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.843318+0000", 2024-05-08T18:30:07.780 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3009000000000004e-05 2024-05-08T18:30:07.780 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:07.780 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:07.780 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:07.780 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.780 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.780 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:422 6.c e33/27 6:338eb7e9:::obj_delete_at_hint.0000000008:head v 33'4, mlcod=33'2)", 2024-05-08T18:30:07.780 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.844520+0000", 2024-05-08T18:30:07.780 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 15.875058664000001, 2024-05-08T18:30:07.781 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002269929, 2024-05-08T18:30:07.781 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:07.781 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:07.781 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:07.781 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:07.781 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.781 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:07.781 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.844520+0000", 2024-05-08T18:30:07.781 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:07.781 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.781 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.781 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:07.781 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.844520+0000", 2024-05-08T18:30:07.781 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:07.782 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.782 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.782 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:07.782 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.844522+0000", 2024-05-08T18:30:07.782 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.643e-06 2024-05-08T18:30:07.782 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.782 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.782 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:07.782 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.844577+0000", 2024-05-08T18:30:07.782 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5976000000000001e-05 2024-05-08T18:30:07.782 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.782 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.782 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:07.783 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.844613+0000", 2024-05-08T18:30:07.783 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5339999999999997e-05 2024-05-08T18:30:07.783 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.783 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.783 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:07.783 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.844638+0000", 2024-05-08T18:30:07.783 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5165999999999999e-05 2024-05-08T18:30:07.783 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.783 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.783 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:07.783 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.844795+0000", 2024-05-08T18:30:07.783 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015660899999999999 2024-05-08T18:30:07.783 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.784 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.784 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:07.784 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.844841+0000", 2024-05-08T18:30:07.784 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6279999999999997e-05 2024-05-08T18:30:07.784 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.784 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.784 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:07.784 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.846707+0000", 2024-05-08T18:30:07.784 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0018657249999999999 2024-05-08T18:30:07.784 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.784 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.784 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:07.784 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.846790+0000", 2024-05-08T18:30:07.785 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3189999999999995e-05 2024-05-08T18:30:07.785 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:07.785 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:07.785 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:07.785 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.785 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.785 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:425 6.a e33/27 6:50d64734:::obj_delete_at_hint.0000000009:head v 33'2, mlcod=0'0)", 2024-05-08T18:30:07.785 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.848220+0000", 2024-05-08T18:30:07.785 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 15.871358546, 2024-05-08T18:30:07.785 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0017145109999999999, 2024-05-08T18:30:07.785 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:07.785 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:07.785 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:07.786 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:07.786 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.786 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:07.786 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.848220+0000", 2024-05-08T18:30:07.786 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:07.786 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.786 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.786 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:07.786 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.848220+0000", 2024-05-08T18:30:07.786 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:07.786 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.786 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.786 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:07.786 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.848222+0000", 2024-05-08T18:30:07.787 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9630000000000001e-06 2024-05-08T18:30:07.787 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.787 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.787 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:07.787 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.848254+0000", 2024-05-08T18:30:07.787 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2047e-05 2024-05-08T18:30:07.787 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.787 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.787 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:07.787 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.848273+0000", 2024-05-08T18:30:07.787 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9493000000000001e-05 2024-05-08T18:30:07.787 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.787 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.787 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:07.788 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.848286+0000", 2024-05-08T18:30:07.788 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2490000000000001e-05 2024-05-08T18:30:07.788 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.788 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.788 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:07.788 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.848414+0000", 2024-05-08T18:30:07.788 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000127785 2024-05-08T18:30:07.788 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.788 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.788 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:07.788 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.848448+0000", 2024-05-08T18:30:07.788 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4233999999999998e-05 2024-05-08T18:30:07.788 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.789 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.789 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:07.789 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.849855+0000", 2024-05-08T18:30:07.789 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001407482 2024-05-08T18:30:07.789 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.789 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.789 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:07.789 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.849934+0000", 2024-05-08T18:30:07.789 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9017000000000006e-05 2024-05-08T18:30:07.789 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:07.789 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:07.789 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:07.789 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.790 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.790 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:436 6.a e33/27 6:55b0279d:reshard::reshard.0000000009:head v 33'4, mlcod=33'1)", 2024-05-08T18:30:07.790 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.853725+0000", 2024-05-08T18:30:07.790 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 15.865853029, 2024-05-08T18:30:07.790 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032824949999999999, 2024-05-08T18:30:07.790 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:07.790 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:07.790 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:07.790 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:07.790 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.790 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:07.790 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.853725+0000", 2024-05-08T18:30:07.790 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:07.791 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.791 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.791 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:07.791 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.853725+0000", 2024-05-08T18:30:07.791 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:07.791 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.791 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.791 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:07.791 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.853727+0000", 2024-05-08T18:30:07.791 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6899999999999999e-06 2024-05-08T18:30:07.791 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.791 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.791 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:07.791 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.853742+0000", 2024-05-08T18:30:07.792 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.517e-05 2024-05-08T18:30:07.792 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.792 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.792 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:07.792 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.853778+0000", 2024-05-08T18:30:07.792 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5173999999999999e-05 2024-05-08T18:30:07.792 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.792 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.792 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:07.792 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.853791+0000", 2024-05-08T18:30:07.792 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.345e-05 2024-05-08T18:30:07.792 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.792 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.793 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:07.793 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.853912+0000", 2024-05-08T18:30:07.793 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012149199999999999 2024-05-08T18:30:07.793 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.793 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.793 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:07.793 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.853960+0000", 2024-05-08T18:30:07.793 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7262999999999998e-05 2024-05-08T18:30:07.793 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.793 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.793 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:07.793 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.856896+0000", 2024-05-08T18:30:07.793 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029363700000000002 2024-05-08T18:30:07.793 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.794 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.794 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:07.794 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.857008+0000", 2024-05-08T18:30:07.794 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011188600000000001 2024-05-08T18:30:07.794 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:07.794 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:07.794 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:07.794 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.794 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.798 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:457 6.1 e33/27 6:80b6fe23:reshard::reshard.0000000011:head v 33'3, mlcod=33'1)", 2024-05-08T18:30:07.798 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.865322+0000", 2024-05-08T18:30:07.798 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 15.854256383999999, 2024-05-08T18:30:07.798 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001750756, 2024-05-08T18:30:07.798 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:07.798 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:07.798 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:07.798 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:07.798 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.798 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:07.798 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.865322+0000", 2024-05-08T18:30:07.798 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:07.799 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.799 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.799 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:07.799 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.865322+0000", 2024-05-08T18:30:07.799 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:07.799 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.799 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.799 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:07.799 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.865325+0000", 2024-05-08T18:30:07.799 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5660000000000001e-06 2024-05-08T18:30:07.799 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.799 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.799 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:07.800 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.865339+0000", 2024-05-08T18:30:07.800 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.412e-05 2024-05-08T18:30:07.800 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.800 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.800 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:07.800 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.865366+0000", 2024-05-08T18:30:07.800 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7453e-05 2024-05-08T18:30:07.800 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.800 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.800 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:07.800 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.865383+0000", 2024-05-08T18:30:07.800 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.683e-05 2024-05-08T18:30:07.800 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.801 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.801 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:07.801 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.865514+0000", 2024-05-08T18:30:07.801 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000131369 2024-05-08T18:30:07.801 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.801 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.801 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:07.801 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.865583+0000", 2024-05-08T18:30:07.801 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8526000000000001e-05 2024-05-08T18:30:07.801 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.801 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.801 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:07.801 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.866974+0000", 2024-05-08T18:30:07.802 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001391193 2024-05-08T18:30:07.802 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.802 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.802 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:07.802 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.867073+0000", 2024-05-08T18:30:07.802 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8698999999999998e-05 2024-05-08T18:30:07.802 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:07.802 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:07.802 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:07.802 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.802 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.802 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:478 6.a e33/27 6:5127e642:gc::gc.21:head v 33'6, mlcod=33'4)", 2024-05-08T18:30:07.802 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.877617+0000", 2024-05-08T18:30:07.803 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 15.841961271000001, 2024-05-08T18:30:07.803 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0033938589999999999, 2024-05-08T18:30:07.803 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:07.803 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:07.803 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:07.803 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:07.803 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.803 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:07.803 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877617+0000", 2024-05-08T18:30:07.803 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:07.803 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.803 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.803 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:07.803 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877617+0000", 2024-05-08T18:30:07.804 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:07.804 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.804 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.804 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:07.804 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877619+0000", 2024-05-08T18:30:07.804 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.902e-06 2024-05-08T18:30:07.804 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.804 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.804 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:07.804 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877633+0000", 2024-05-08T18:30:07.804 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4143e-05 2024-05-08T18:30:07.804 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.804 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.805 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:07.805 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877667+0000", 2024-05-08T18:30:07.805 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3516999999999998e-05 2024-05-08T18:30:07.805 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.805 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.805 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:07.805 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877685+0000", 2024-05-08T18:30:07.805 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7931000000000002e-05 2024-05-08T18:30:07.805 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.805 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.805 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:07.805 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877842+0000", 2024-05-08T18:30:07.805 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015742800000000001 2024-05-08T18:30:07.806 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.806 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.806 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:07.806 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877890+0000", 2024-05-08T18:30:07.806 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7654000000000001e-05 2024-05-08T18:30:07.806 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.806 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.806 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:07.806 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.880908+0000", 2024-05-08T18:30:07.806 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0030181219999999998 2024-05-08T18:30:07.806 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.807 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.807 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:07.807 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.881011+0000", 2024-05-08T18:30:07.807 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000103162 2024-05-08T18:30:07.807 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:07.807 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:07.807 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:07.807 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.807 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.807 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:535 6.1f e33/27 6:fde4dd55:gc::gc.26:head v 33'2, mlcod=0'0)", 2024-05-08T18:30:07.807 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.909602+0000", 2024-05-08T18:30:07.807 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 15.809976826, 2024-05-08T18:30:07.807 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0023004039999999998, 2024-05-08T18:30:07.808 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:07.808 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:07.808 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:07.808 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:07.808 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.808 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:07.808 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.909602+0000", 2024-05-08T18:30:07.808 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:07.808 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.808 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.808 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:07.808 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.909602+0000", 2024-05-08T18:30:07.808 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:07.808 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.809 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.809 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:07.809 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.909604+0000", 2024-05-08T18:30:07.809 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8360000000000001e-06 2024-05-08T18:30:07.809 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.809 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.809 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:07.809 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.909615+0000", 2024-05-08T18:30:07.809 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1596999999999999e-05 2024-05-08T18:30:07.809 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.809 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.809 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:07.809 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.909643+0000", 2024-05-08T18:30:07.810 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7457000000000002e-05 2024-05-08T18:30:07.810 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.810 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.810 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:07.810 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.909662+0000", 2024-05-08T18:30:07.810 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9052999999999999e-05 2024-05-08T18:30:07.810 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.810 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.810 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:07.810 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.909758+0000", 2024-05-08T18:30:07.810 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6372000000000005e-05 2024-05-08T18:30:07.810 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.811 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.811 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:07.811 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.909780+0000", 2024-05-08T18:30:07.811 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1719999999999999e-05 2024-05-08T18:30:07.811 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.811 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.811 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:07.811 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.911830+0000", 2024-05-08T18:30:07.811 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002050072 2024-05-08T18:30:07.811 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.811 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.812 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:07.812 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.911902+0000", 2024-05-08T18:30:07.812 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.2297000000000003e-05 2024-05-08T18:30:07.812 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:07.812 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:07.812 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:07.812 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.812 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.812 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:541 6.1f e33/27 6:fde4dd55:gc::gc.26:head v 33'3, mlcod=33'1)", 2024-05-08T18:30:07.812 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.913684+0000", 2024-05-08T18:30:07.812 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 15.805894778000001, 2024-05-08T18:30:07.812 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0036425770000000001, 2024-05-08T18:30:07.812 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:07.813 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:07.813 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:07.813 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:07.813 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.813 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:07.813 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.913684+0000", 2024-05-08T18:30:07.813 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:07.813 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.813 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.813 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:07.813 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.913684+0000", 2024-05-08T18:30:07.813 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:07.813 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.814 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.814 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:07.814 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.913685+0000", 2024-05-08T18:30:07.814 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5859999999999999e-06 2024-05-08T18:30:07.814 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.814 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.814 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:07.814 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.913696+0000", 2024-05-08T18:30:07.814 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1080000000000001e-05 2024-05-08T18:30:07.814 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.814 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.814 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:07.814 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.913720+0000", 2024-05-08T18:30:07.815 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3614000000000001e-05 2024-05-08T18:30:07.815 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.815 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.815 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:07.815 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.913740+0000", 2024-05-08T18:30:07.815 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9836000000000001e-05 2024-05-08T18:30:07.815 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.815 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.815 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:07.815 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.913901+0000", 2024-05-08T18:30:07.815 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000161039 2024-05-08T18:30:07.815 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.815 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.815 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:07.816 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.913935+0000", 2024-05-08T18:30:07.816 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4353000000000001e-05 2024-05-08T18:30:07.816 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.816 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.816 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:07.816 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.917225+0000", 2024-05-08T18:30:07.816 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032897669999999999 2024-05-08T18:30:07.816 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.816 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.816 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:07.816 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.917326+0000", 2024-05-08T18:30:07.816 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000101302 2024-05-08T18:30:07.816 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:07.816 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:07.817 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:07.817 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.817 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.817 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:543 6.15 e33/27 6:ae95b544:::obj_delete_at_hint.0000000020:head v 33'5, mlcod=33'3)", 2024-05-08T18:30:07.817 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.916649+0000", 2024-05-08T18:30:07.817 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 15.802929225, 2024-05-08T18:30:07.817 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003362739, 2024-05-08T18:30:07.817 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:07.817 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:07.817 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:07.817 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:07.817 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.817 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:07.818 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.916649+0000", 2024-05-08T18:30:07.818 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:07.818 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.818 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.818 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:07.818 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.916649+0000", 2024-05-08T18:30:07.818 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:07.818 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.818 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.818 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:07.818 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.916651+0000", 2024-05-08T18:30:07.818 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7269999999999999e-06 2024-05-08T18:30:07.819 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.819 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.819 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:07.819 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.916663+0000", 2024-05-08T18:30:07.819 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2183e-05 2024-05-08T18:30:07.819 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.819 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.819 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:07.819 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.916691+0000", 2024-05-08T18:30:07.819 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7864e-05 2024-05-08T18:30:07.819 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.819 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.819 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:07.819 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.916710+0000", 2024-05-08T18:30:07.820 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.912e-05 2024-05-08T18:30:07.820 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.820 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.820 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:07.820 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.916851+0000", 2024-05-08T18:30:07.820 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000141163 2024-05-08T18:30:07.820 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.820 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.820 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:07.820 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.916909+0000", 2024-05-08T18:30:07.820 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.7686000000000003e-05 2024-05-08T18:30:07.820 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.820 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.821 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:07.821 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.919900+0000", 2024-05-08T18:30:07.821 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029909540000000001 2024-05-08T18:30:07.821 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.821 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.821 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:07.821 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.920012+0000", 2024-05-08T18:30:07.821 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000112042 2024-05-08T18:30:07.821 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:07.821 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:07.821 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:07.821 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.821 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.821 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:695 6.3 e33/27 6:c31f41d7:gc::gc.10:head v 33'12, mlcod=33'10)", 2024-05-08T18:30:07.822 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.017806+0000", 2024-05-08T18:30:07.822 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 15.701772941, 2024-05-08T18:30:07.822 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001718373, 2024-05-08T18:30:07.822 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:07.822 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:07.822 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:07.822 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:07.822 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.822 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:07.822 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.017806+0000", 2024-05-08T18:30:07.822 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:07.822 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.823 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.823 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:07.823 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.017806+0000", 2024-05-08T18:30:07.823 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:07.823 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.823 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.823 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:07.823 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.017807+0000", 2024-05-08T18:30:07.823 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8199999999999999e-06 2024-05-08T18:30:07.823 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.823 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.823 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:07.823 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.017818+0000", 2024-05-08T18:30:07.823 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0519999999999999e-05 2024-05-08T18:30:07.823 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.824 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.824 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:07.824 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.017846+0000", 2024-05-08T18:30:07.824 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7729000000000002e-05 2024-05-08T18:30:07.824 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.824 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.824 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:07.824 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.017859+0000", 2024-05-08T18:30:07.824 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3337e-05 2024-05-08T18:30:07.824 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.824 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.824 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:07.824 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.017990+0000", 2024-05-08T18:30:07.824 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013146499999999999 2024-05-08T18:30:07.825 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.825 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.825 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:07.825 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.018039+0000", 2024-05-08T18:30:07.825 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8816999999999997e-05 2024-05-08T18:30:07.825 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.825 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.825 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:07.825 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.019397+0000", 2024-05-08T18:30:07.825 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0013575359999999999 2024-05-08T18:30:07.825 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:07.825 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:07.825 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:07.825 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.019524+0000", 2024-05-08T18:30:07.826 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012714900000000001 2024-05-08T18:30:07.826 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:07.826 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:07.826 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:07.826 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:07.826 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:07.826 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:30:07.828 INFO:teuthology.orchestra.run.smithi097.stderr:reweighted osd.7 to 1 (10000) 2024-05-08T18:30:07.828 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-08T18:30:07.829 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:30:07.828+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:30:07.829 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-05-08T18:30:07.829 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T18:30:07.929 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:30:07.930+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:30:08.002 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:30:08.002 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:30:08.003 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 0 2024-05-08T18:30:08.003 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:30:08.016 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-08T18:30:08.060 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:30:08.060+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:30:08.131 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:30:08.130+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:30:08.138 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:30:08.138 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:30:08.138 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2024-05-08T18:30:08.138 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2024-05-08T18:30:08.138 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:30:08.152 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-08T18:30:08.213 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-05-08T18:30:08.218 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2024-05-08T18:30:08.231 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2024-05-08T18:30:07.768635+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595683,"num_objects":194,"num_object_clones":0,"num_object_copies":388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":194,"num_whiteouts":0,"num_read":758,"num_read_kb":506,"num_write":528,"num_write_kb":1668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":481,"ondisk_log_size":481,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":229252,"kb_used_data":4732,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754745468,"statfs":{"total":773094113280,"available":772859359232,"internally_reserved":0,"allocated":4845568,"data_stored":2764244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":229756465},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.052769"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.800331+0000","last_change":"2024-05-08T18:29:40.574221+0000","last_active":"2024-05-08T18:30:05.800331+0000","last_peered":"2024-05-08T18:30:05.800331+0000","last_clean":"2024-05-08T18:30:05.800331+0000","last_became_active":"2024-05-08T18:29:40.573543+0000","last_became_peered":"2024-05-08T18:29:40.573543+0000","last_unstale":"2024-05-08T18:30:05.800331+0000","last_undegraded":"2024-05-08T18:30:05.800331+0000","last_fullsized":"2024-05-08T18:30:05.800331+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:57.223609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.793104+0000","last_change":"2024-05-08T18:29:42.563773+0000","last_active":"2024-05-08T18:30:05.793104+0000","last_peered":"2024-05-08T18:30:05.793104+0000","last_clean":"2024-05-08T18:30:05.793104+0000","last_became_active":"2024-05-08T18:29:42.561201+0000","last_became_peered":"2024-05-08T18:29:42.561201+0000","last_unstale":"2024-05-08T18:30:05.793104+0000","last_undegraded":"2024-05-08T18:30:05.793104+0000","last_fullsized":"2024-05-08T18:30:05.793104+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:55.055481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.243159+0000","last_change":"2024-05-08T18:29:40.549299+0000","last_active":"2024-05-08T18:30:05.243159+0000","last_peered":"2024-05-08T18:30:05.243159+0000","last_clean":"2024-05-08T18:30:05.243159+0000","last_became_active":"2024-05-08T18:29:40.548930+0000","last_became_peered":"2024-05-08T18:29:40.548930+0000","last_unstale":"2024-05-08T18:30:05.243159+0000","last_undegraded":"2024-05-08T18:30:05.243159+0000","last_fullsized":"2024-05-08T18:30:05.243159+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:06:36.198647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.796950+0000","last_change":"2024-05-08T18:29:42.572074+0000","last_active":"2024-05-08T18:30:05.796950+0000","last_peered":"2024-05-08T18:30:05.796950+0000","last_clean":"2024-05-08T18:30:05.796950+0000","last_became_active":"2024-05-08T18:29:42.571344+0000","last_became_peered":"2024-05-08T18:29:42.571344+0000","last_unstale":"2024-05-08T18:30:05.796950+0000","last_undegraded":"2024-05-08T18:30:05.796950+0000","last_fullsized":"2024-05-08T18:30:05.796950+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:36.890277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.122580+0000","last_change":"2024-05-08T18:29:40.539048+0000","last_active":"2024-05-08T18:30:04.122580+0000","last_peered":"2024-05-08T18:30:04.122580+0000","last_clean":"2024-05-08T18:30:04.122580+0000","last_became_active":"2024-05-08T18:29:40.538458+0000","last_became_peered":"2024-05-08T18:29:40.538458+0000","last_unstale":"2024-05-08T18:30:04.122580+0000","last_undegraded":"2024-05-08T18:30:04.122580+0000","last_fullsized":"2024-05-08T18:30:04.122580+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:36:37.796095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.796865+0000","last_change":"2024-05-08T18:29:42.569718+0000","last_active":"2024-05-08T18:30:05.796865+0000","last_peered":"2024-05-08T18:30:05.796865+0000","last_clean":"2024-05-08T18:30:05.796865+0000","last_became_active":"2024-05-08T18:29:42.569026+0000","last_became_peered":"2024-05-08T18:29:42.569026+0000","last_unstale":"2024-05-08T18:30:05.796865+0000","last_undegraded":"2024-05-08T18:30:05.796865+0000","last_fullsized":"2024-05-08T18:30:05.796865+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:42.045615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.794465+0000","last_change":"2024-05-08T18:29:40.557700+0000","last_active":"2024-05-08T18:30:05.794465+0000","last_peered":"2024-05-08T18:30:05.794465+0000","last_clean":"2024-05-08T18:30:05.794465+0000","last_became_active":"2024-05-08T18:29:40.556884+0000","last_became_peered":"2024-05-08T18:29:40.556884+0000","last_unstale":"2024-05-08T18:30:05.794465+0000","last_undegraded":"2024-05-08T18:30:05.794465+0000","last_fullsized":"2024-05-08T18:30:05.794465+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:21:38.354933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.123066+0000","last_change":"2024-05-08T18:29:42.566448+0000","last_active":"2024-05-08T18:30:04.123066+0000","last_peered":"2024-05-08T18:30:04.123066+0000","last_clean":"2024-05-08T18:30:04.123066+0000","last_became_active":"2024-05-08T18:29:42.566058+0000","last_became_peered":"2024-05-08T18:29:42.566058+0000","last_unstale":"2024-05-08T18:30:04.123066+0000","last_undegraded":"2024-05-08T18:30:04.123066+0000","last_fullsized":"2024-05-08T18:30:04.123066+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:53:03.097704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.798456+0000","last_change":"2024-05-08T18:29:40.571195+0000","last_active":"2024-05-08T18:30:05.798456+0000","last_peered":"2024-05-08T18:30:05.798456+0000","last_clean":"2024-05-08T18:30:05.798456+0000","last_became_active":"2024-05-08T18:29:40.570467+0000","last_became_peered":"2024-05-08T18:29:40.570467+0000","last_unstale":"2024-05-08T18:30:05.798456+0000","last_undegraded":"2024-05-08T18:30:05.798456+0000","last_fullsized":"2024-05-08T18:30:05.798456+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:39.986094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.740527+0000","last_change":"2024-05-08T18:29:42.566506+0000","last_active":"2024-05-08T18:30:05.740527+0000","last_peered":"2024-05-08T18:30:05.740527+0000","last_clean":"2024-05-08T18:30:05.740527+0000","last_became_active":"2024-05-08T18:29:42.565740+0000","last_became_peered":"2024-05-08T18:29:42.565740+0000","last_unstale":"2024-05-08T18:30:05.740527+0000","last_undegraded":"2024-05-08T18:30:05.740527+0000","last_fullsized":"2024-05-08T18:30:05.740527+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:58.320701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.793882+0000","last_change":"2024-05-08T18:29:40.538314+0000","last_active":"2024-05-08T18:30:05.793882+0000","last_peered":"2024-05-08T18:30:05.793882+0000","last_clean":"2024-05-08T18:30:05.793882+0000","last_became_active":"2024-05-08T18:29:40.537458+0000","last_became_peered":"2024-05-08T18:29:40.537458+0000","last_unstale":"2024-05-08T18:30:05.793882+0000","last_undegraded":"2024-05-08T18:30:05.793882+0000","last_fullsized":"2024-05-08T18:30:05.793882+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:56.300986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.797979+0000","last_change":"2024-05-08T18:29:42.570054+0000","last_active":"2024-05-08T18:30:05.797979+0000","last_peered":"2024-05-08T18:30:05.797979+0000","last_clean":"2024-05-08T18:30:05.797979+0000","last_became_active":"2024-05-08T18:29:42.569255+0000","last_became_peered":"2024-05-08T18:29:42.569255+0000","last_unstale":"2024-05-08T18:30:05.797979+0000","last_undegraded":"2024-05-08T18:30:05.797979+0000","last_fullsized":"2024-05-08T18:30:05.797979+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:11:01.702482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.797212+0000","last_change":"2024-05-08T18:29:40.559212+0000","last_active":"2024-05-08T18:30:05.797212+0000","last_peered":"2024-05-08T18:30:05.797212+0000","last_clean":"2024-05-08T18:30:05.797212+0000","last_became_active":"2024-05-08T18:29:40.558501+0000","last_became_peered":"2024-05-08T18:29:40.558501+0000","last_unstale":"2024-05-08T18:30:05.797212+0000","last_undegraded":"2024-05-08T18:30:05.797212+0000","last_fullsized":"2024-05-08T18:30:05.797212+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:36:14.096907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.798553+0000","last_change":"2024-05-08T18:29:42.562084+0000","last_active":"2024-05-08T18:30:05.798553+0000","last_peered":"2024-05-08T18:30:05.798553+0000","last_clean":"2024-05-08T18:30:05.798553+0000","last_became_active":"2024-05-08T18:29:42.560699+0000","last_became_peered":"2024-05-08T18:29:42.560699+0000","last_unstale":"2024-05-08T18:30:05.798553+0000","last_undegraded":"2024-05-08T18:30:05.798553+0000","last_fullsized":"2024-05-08T18:30:05.798553+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:09.787597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.731147+0000","last_change":"2024-05-08T18:29:40.564339+0000","last_active":"2024-05-08T18:30:04.731147+0000","last_peered":"2024-05-08T18:30:04.731147+0000","last_clean":"2024-05-08T18:30:04.731147+0000","last_became_active":"2024-05-08T18:29:40.564038+0000","last_became_peered":"2024-05-08T18:29:40.564038+0000","last_unstale":"2024-05-08T18:30:04.731147+0000","last_undegraded":"2024-05-08T18:30:04.731147+0000","last_fullsized":"2024-05-08T18:30:04.731147+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:40:23.287885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.734382+0000","last_change":"2024-05-08T18:29:42.570253+0000","last_active":"2024-05-08T18:30:04.734382+0000","last_peered":"2024-05-08T18:30:04.734382+0000","last_clean":"2024-05-08T18:30:04.734382+0000","last_became_active":"2024-05-08T18:29:42.569917+0000","last_became_peered":"2024-05-08T18:29:42.569917+0000","last_unstale":"2024-05-08T18:30:04.734382+0000","last_undegraded":"2024-05-08T18:30:04.734382+0000","last_fullsized":"2024-05-08T18:30:04.734382+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:14:45.575219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.795404+0000","last_change":"2024-05-08T18:29:42.568116+0000","last_active":"2024-05-08T18:30:05.795404+0000","last_peered":"2024-05-08T18:30:05.795404+0000","last_clean":"2024-05-08T18:30:05.795404+0000","last_became_active":"2024-05-08T18:29:42.567399+0000","last_became_peered":"2024-05-08T18:29:42.567399+0000","last_unstale":"2024-05-08T18:30:05.795404+0000","last_undegraded":"2024-05-08T18:30:05.795404+0000","last_fullsized":"2024-05-08T18:30:05.795404+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:35.037465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.800554+0000","last_change":"2024-05-08T18:29:40.571982+0000","last_active":"2024-05-08T18:30:05.800554+0000","last_peered":"2024-05-08T18:30:05.800554+0000","last_clean":"2024-05-08T18:30:05.800554+0000","last_became_active":"2024-05-08T18:29:40.570600+0000","last_became_peered":"2024-05-08T18:29:40.570600+0000","last_unstale":"2024-05-08T18:30:05.800554+0000","last_undegraded":"2024-05-08T18:30:05.800554+0000","last_fullsized":"2024-05-08T18:30:05.800554+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:54:14.520118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.797084+0000","last_change":"2024-05-08T18:29:42.578449+0000","last_active":"2024-05-08T18:30:05.797084+0000","last_peered":"2024-05-08T18:30:05.797084+0000","last_clean":"2024-05-08T18:30:05.797084+0000","last_became_active":"2024-05-08T18:29:42.577789+0000","last_became_peered":"2024-05-08T18:29:42.577789+0000","last_unstale":"2024-05-08T18:30:05.797084+0000","last_undegraded":"2024-05-08T18:30:05.797084+0000","last_fullsized":"2024-05-08T18:30:05.797084+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:09.787597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.741599+0000","last_change":"2024-05-08T18:29:40.570618+0000","last_active":"2024-05-08T18:30:05.741599+0000","last_peered":"2024-05-08T18:30:05.741599+0000","last_clean":"2024-05-08T18:30:05.741599+0000","last_became_active":"2024-05-08T18:29:40.569519+0000","last_became_peered":"2024-05-08T18:29:40.569519+0000","last_unstale":"2024-05-08T18:30:05.741599+0000","last_undegraded":"2024-05-08T18:30:05.741599+0000","last_fullsized":"2024-05-08T18:30:05.741599+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:09:42.581976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.794115+0000","last_change":"2024-05-08T18:29:42.563056+0000","last_active":"2024-05-08T18:30:05.794115+0000","last_peered":"2024-05-08T18:30:05.794115+0000","last_clean":"2024-05-08T18:30:05.794115+0000","last_became_active":"2024-05-08T18:29:42.562296+0000","last_became_peered":"2024-05-08T18:29:42.562296+0000","last_unstale":"2024-05-08T18:30:05.794115+0000","last_undegraded":"2024-05-08T18:30:05.794115+0000","last_fullsized":"2024-05-08T18:30:05.794115+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:36.890277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.741577+0000","last_change":"2024-05-08T18:29:40.564353+0000","last_active":"2024-05-08T18:30:05.741577+0000","last_peered":"2024-05-08T18:30:05.741577+0000","last_clean":"2024-05-08T18:30:05.741577+0000","last_became_active":"2024-05-08T18:29:40.563516+0000","last_became_peered":"2024-05-08T18:29:40.563516+0000","last_unstale":"2024-05-08T18:30:05.741577+0000","last_undegraded":"2024-05-08T18:30:05.741577+0000","last_fullsized":"2024-05-08T18:30:05.741577+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:06:36.198647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.731987+0000","last_change":"2024-05-08T18:29:42.567006+0000","last_active":"2024-05-08T18:30:04.731987+0000","last_peered":"2024-05-08T18:30:04.731987+0000","last_clean":"2024-05-08T18:30:04.731987+0000","last_became_active":"2024-05-08T18:29:42.566256+0000","last_became_peered":"2024-05-08T18:29:42.566256+0000","last_unstale":"2024-05-08T18:30:04.731987+0000","last_undegraded":"2024-05-08T18:30:04.731987+0000","last_fullsized":"2024-05-08T18:30:04.731987+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:09:44.601690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.797327+0000","last_change":"2024-05-08T18:29:40.573212+0000","last_active":"2024-05-08T18:30:05.797327+0000","last_peered":"2024-05-08T18:30:05.797327+0000","last_clean":"2024-05-08T18:30:05.797327+0000","last_became_active":"2024-05-08T18:29:40.572250+0000","last_became_peered":"2024-05-08T18:29:40.572250+0000","last_unstale":"2024-05-08T18:30:05.797327+0000","last_undegraded":"2024-05-08T18:30:05.797327+0000","last_fullsized":"2024-05-08T18:30:05.797327+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:25:01.595224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.732771+0000","last_change":"2024-05-08T18:29:42.570847+0000","last_active":"2024-05-08T18:30:04.732771+0000","last_peered":"2024-05-08T18:30:04.732771+0000","last_clean":"2024-05-08T18:30:04.732771+0000","last_became_active":"2024-05-08T18:29:42.570435+0000","last_became_peered":"2024-05-08T18:29:42.570435+0000","last_unstale":"2024-05-08T18:30:04.732771+0000","last_undegraded":"2024-05-08T18:30:04.732771+0000","last_fullsized":"2024-05-08T18:30:04.732771+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:21:40.374647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.731812+0000","last_change":"2024-05-08T18:29:40.566815+0000","last_active":"2024-05-08T18:30:04.731812+0000","last_peered":"2024-05-08T18:30:04.731812+0000","last_clean":"2024-05-08T18:30:04.731812+0000","last_became_active":"2024-05-08T18:29:40.566531+0000","last_became_peered":"2024-05-08T18:29:40.566531+0000","last_unstale":"2024-05-08T18:30:04.731812+0000","last_undegraded":"2024-05-08T18:30:04.731812+0000","last_fullsized":"2024-05-08T18:30:04.731812+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:52.462279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.798515+0000","last_change":"2024-05-08T18:29:42.554846+0000","last_active":"2024-05-08T18:30:05.798515+0000","last_peered":"2024-05-08T18:30:05.798515+0000","last_clean":"2024-05-08T18:30:05.798515+0000","last_became_active":"2024-05-08T18:29:42.554115+0000","last_became_peered":"2024-05-08T18:29:42.554115+0000","last_unstale":"2024-05-08T18:30:05.798515+0000","last_undegraded":"2024-05-08T18:30:05.798515+0000","last_fullsized":"2024-05-08T18:30:05.798515+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:22:14.793035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.123617+0000","last_change":"2024-05-08T18:29:40.547776+0000","last_active":"2024-05-08T18:30:04.123617+0000","last_peered":"2024-05-08T18:30:04.123617+0000","last_clean":"2024-05-08T18:30:04.123617+0000","last_became_active":"2024-05-08T18:29:40.547384+0000","last_became_peered":"2024-05-08T18:29:40.547384+0000","last_unstale":"2024-05-08T18:30:04.123617+0000","last_undegraded":"2024-05-08T18:30:04.123617+0000","last_fullsized":"2024-05-08T18:30:04.123617+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:14:26.628603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.793771+0000","last_change":"2024-05-08T18:29:50.685390+0000","last_active":"2024-05-08T18:30:05.793771+0000","last_peered":"2024-05-08T18:30:05.793771+0000","last_clean":"2024-05-08T18:30:05.793771+0000","last_became_active":"2024-05-08T18:29:50.684644+0000","last_became_peered":"2024-05-08T18:29:50.684644+0000","last_unstale":"2024-05-08T18:30:05.793771+0000","last_undegraded":"2024-05-08T18:30:05.793771+0000","last_fullsized":"2024-05-08T18:30:05.793771+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:10:38.951662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.733149+0000","last_change":"2024-05-08T18:29:42.573805+0000","last_active":"2024-05-08T18:30:04.733149+0000","last_peered":"2024-05-08T18:30:04.733149+0000","last_clean":"2024-05-08T18:30:04.733149+0000","last_became_active":"2024-05-08T18:29:42.573296+0000","last_became_peered":"2024-05-08T18:29:42.573296+0000","last_unstale":"2024-05-08T18:30:04.733149+0000","last_undegraded":"2024-05-08T18:30:04.733149+0000","last_fullsized":"2024-05-08T18:30:04.733149+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:21.935293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.798820+0000","last_change":"2024-05-08T18:29:40.570733+0000","last_active":"2024-05-08T18:30:05.798820+0000","last_peered":"2024-05-08T18:30:05.798820+0000","last_clean":"2024-05-08T18:30:05.798820+0000","last_became_active":"2024-05-08T18:29:40.569711+0000","last_became_peered":"2024-05-08T18:29:40.569711+0000","last_unstale":"2024-05-08T18:30:05.798820+0000","last_undegraded":"2024-05-08T18:30:05.798820+0000","last_fullsized":"2024-05-08T18:30:05.798820+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:18:08.784274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.795823+0000","last_change":"2024-05-08T18:29:44.594185+0000","last_active":"2024-05-08T18:30:05.795823+0000","last_peered":"2024-05-08T18:30:05.795823+0000","last_clean":"2024-05-08T18:30:05.795823+0000","last_became_active":"2024-05-08T18:29:44.593442+0000","last_became_peered":"2024-05-08T18:29:44.593442+0000","last_unstale":"2024-05-08T18:30:05.795823+0000","last_undegraded":"2024-05-08T18:30:05.795823+0000","last_fullsized":"2024-05-08T18:30:05.795823+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:52:25.736491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"33'9","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.122746+0000","last_change":"2024-05-08T18:29:46.594652+0000","last_active":"2024-05-08T18:30:04.122746+0000","last_peered":"2024-05-08T18:30:04.122746+0000","last_clean":"2024-05-08T18:30:04.122746+0000","last_became_active":"2024-05-08T18:29:46.593656+0000","last_became_peered":"2024-05-08T18:29:46.593656+0000","last_unstale":"2024-05-08T18:30:04.122746+0000","last_undegraded":"2024-05-08T18:30:04.122746+0000","last_fullsized":"2024-05-08T18:30:04.122746+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:50:27.608888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":28,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.799814+0000","last_change":"2024-05-08T18:29:48.639834+0000","last_active":"2024-05-08T18:30:05.799814+0000","last_peered":"2024-05-08T18:30:05.799814+0000","last_clean":"2024-05-08T18:30:05.799814+0000","last_became_active":"2024-05-08T18:29:48.639122+0000","last_became_peered":"2024-05-08T18:29:48.639122+0000","last_unstale":"2024-05-08T18:30:05.799814+0000","last_undegraded":"2024-05-08T18:30:05.799814+0000","last_fullsized":"2024-05-08T18:30:05.799814+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:14:22.304773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.793143+0000","last_change":"2024-05-08T18:29:50.672303+0000","last_active":"2024-05-08T18:30:05.793143+0000","last_peered":"2024-05-08T18:30:05.793143+0000","last_clean":"2024-05-08T18:30:05.793143+0000","last_became_active":"2024-05-08T18:29:50.671513+0000","last_became_peered":"2024-05-08T18:29:50.671513+0000","last_unstale":"2024-05-08T18:30:05.793143+0000","last_undegraded":"2024-05-08T18:30:05.793143+0000","last_fullsized":"2024-05-08T18:30:05.793143+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:12:05.780786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.796438+0000","last_change":"2024-05-08T18:29:42.565462+0000","last_active":"2024-05-08T18:30:05.796438+0000","last_peered":"2024-05-08T18:30:05.796438+0000","last_clean":"2024-05-08T18:30:05.796438+0000","last_became_active":"2024-05-08T18:29:42.564741+0000","last_became_peered":"2024-05-08T18:29:42.564741+0000","last_unstale":"2024-05-08T18:30:05.796438+0000","last_undegraded":"2024-05-08T18:30:05.796438+0000","last_fullsized":"2024-05-08T18:30:05.796438+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:25:56.129785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.123858+0000","last_change":"2024-05-08T18:29:40.564796+0000","last_active":"2024-05-08T18:30:04.123858+0000","last_peered":"2024-05-08T18:30:04.123858+0000","last_clean":"2024-05-08T18:30:04.123858+0000","last_became_active":"2024-05-08T18:29:40.564401+0000","last_became_peered":"2024-05-08T18:29:40.564401+0000","last_unstale":"2024-05-08T18:30:04.123858+0000","last_undegraded":"2024-05-08T18:30:04.123858+0000","last_fullsized":"2024-05-08T18:30:04.123858+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:19:11.492397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.733013+0000","last_change":"2024-05-08T18:29:44.587689+0000","last_active":"2024-05-08T18:30:04.733013+0000","last_peered":"2024-05-08T18:30:04.733013+0000","last_clean":"2024-05-08T18:30:04.733013+0000","last_became_active":"2024-05-08T18:29:44.586975+0000","last_became_peered":"2024-05-08T18:29:44.586975+0000","last_unstale":"2024-05-08T18:30:04.733013+0000","last_undegraded":"2024-05-08T18:30:04.733013+0000","last_fullsized":"2024-05-08T18:30:04.733013+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:04:49.020450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"33'6","reported_seq":41,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.798250+0000","last_change":"2024-05-08T18:29:46.600906+0000","last_active":"2024-05-08T18:30:05.798250+0000","last_peered":"2024-05-08T18:30:05.798250+0000","last_clean":"2024-05-08T18:30:05.798250+0000","last_became_active":"2024-05-08T18:29:46.599894+0000","last_became_peered":"2024-05-08T18:29:46.599894+0000","last_unstale":"2024-05-08T18:30:05.798250+0000","last_undegraded":"2024-05-08T18:30:05.798250+0000","last_fullsized":"2024-05-08T18:30:05.798250+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:24:13.568294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":28,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.797923+0000","last_change":"2024-05-08T18:29:48.614324+0000","last_active":"2024-05-08T18:30:05.797923+0000","last_peered":"2024-05-08T18:30:05.797923+0000","last_clean":"2024-05-08T18:30:05.797923+0000","last_became_active":"2024-05-08T18:29:48.613591+0000","last_became_peered":"2024-05-08T18:29:48.613591+0000","last_unstale":"2024-05-08T18:30:05.797923+0000","last_undegraded":"2024-05-08T18:30:05.797923+0000","last_fullsized":"2024-05-08T18:30:05.797923+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:47:54.034851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.122904+0000","last_change":"2024-05-08T18:29:50.684773+0000","last_active":"2024-05-08T18:30:04.122904+0000","last_peered":"2024-05-08T18:30:04.122904+0000","last_clean":"2024-05-08T18:30:04.122904+0000","last_became_active":"2024-05-08T18:29:50.683931+0000","last_became_peered":"2024-05-08T18:29:50.683931+0000","last_unstale":"2024-05-08T18:30:04.122904+0000","last_undegraded":"2024-05-08T18:30:04.122904+0000","last_fullsized":"2024-05-08T18:30:04.122904+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:17:10.582636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.123733+0000","last_change":"2024-05-08T18:29:42.574437+0000","last_active":"2024-05-08T18:30:04.123733+0000","last_peered":"2024-05-08T18:30:04.123733+0000","last_clean":"2024-05-08T18:30:04.123733+0000","last_became_active":"2024-05-08T18:29:42.574146+0000","last_became_peered":"2024-05-08T18:29:42.574146+0000","last_unstale":"2024-05-08T18:30:04.123733+0000","last_undegraded":"2024-05-08T18:30:04.123733+0000","last_fullsized":"2024-05-08T18:30:04.123733+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:55:30.468069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.797438+0000","last_change":"2024-05-08T18:29:40.559677+0000","last_active":"2024-05-08T18:30:05.797438+0000","last_peered":"2024-05-08T18:30:05.797438+0000","last_clean":"2024-05-08T18:30:05.797438+0000","last_became_active":"2024-05-08T18:29:40.558819+0000","last_became_peered":"2024-05-08T18:29:40.558819+0000","last_unstale":"2024-05-08T18:30:05.797438+0000","last_undegraded":"2024-05-08T18:30:05.797438+0000","last_fullsized":"2024-05-08T18:30:05.797438+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:28.426657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.734369+0000","last_change":"2024-05-08T18:29:44.596801+0000","last_active":"2024-05-08T18:30:04.734369+0000","last_peered":"2024-05-08T18:30:04.734369+0000","last_clean":"2024-05-08T18:30:04.734369+0000","last_became_active":"2024-05-08T18:29:44.596111+0000","last_became_peered":"2024-05-08T18:29:44.596111+0000","last_unstale":"2024-05-08T18:30:04.734369+0000","last_undegraded":"2024-05-08T18:30:04.734369+0000","last_fullsized":"2024-05-08T18:30:04.734369+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:04.423266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"33'10","reported_seq":45,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.732544+0000","last_change":"2024-05-08T18:29:46.608330+0000","last_active":"2024-05-08T18:30:04.732544+0000","last_peered":"2024-05-08T18:30:04.732544+0000","last_clean":"2024-05-08T18:30:04.732544+0000","last_became_active":"2024-05-08T18:29:46.607580+0000","last_became_peered":"2024-05-08T18:29:46.607580+0000","last_unstale":"2024-05-08T18:30:04.732544+0000","last_undegraded":"2024-05-08T18:30:04.732544+0000","last_fullsized":"2024-05-08T18:30:04.732544+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:22:18.837103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"30'2","reported_seq":34,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.799196+0000","last_change":"2024-05-08T18:29:48.642718+0000","last_active":"2024-05-08T18:30:05.799196+0000","last_peered":"2024-05-08T18:30:05.799196+0000","last_clean":"2024-05-08T18:30:05.799196+0000","last_became_active":"2024-05-08T18:29:48.641950+0000","last_became_peered":"2024-05-08T18:29:48.641950+0000","last_unstale":"2024-05-08T18:30:05.799196+0000","last_undegraded":"2024-05-08T18:30:05.799196+0000","last_fullsized":"2024-05-08T18:30:05.799196+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:00:11.720096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.796417+0000","last_change":"2024-05-08T18:29:50.660378+0000","last_active":"2024-05-08T18:30:05.796417+0000","last_peered":"2024-05-08T18:30:05.796417+0000","last_clean":"2024-05-08T18:30:05.796417+0000","last_became_active":"2024-05-08T18:29:50.659649+0000","last_became_peered":"2024-05-08T18:29:50.659649+0000","last_unstale":"2024-05-08T18:30:05.796417+0000","last_undegraded":"2024-05-08T18:30:05.796417+0000","last_fullsized":"2024-05-08T18:30:05.796417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:34:14.488295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.733883+0000","last_change":"2024-05-08T18:29:42.577267+0000","last_active":"2024-05-08T18:30:04.733883+0000","last_peered":"2024-05-08T18:30:04.733883+0000","last_clean":"2024-05-08T18:30:04.733883+0000","last_became_active":"2024-05-08T18:29:42.576740+0000","last_became_peered":"2024-05-08T18:29:42.576740+0000","last_unstale":"2024-05-08T18:30:04.733883+0000","last_undegraded":"2024-05-08T18:30:04.733883+0000","last_fullsized":"2024-05-08T18:30:04.733883+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:57:14.869860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.739876+0000","last_change":"2024-05-08T18:29:40.547524+0000","last_active":"2024-05-08T18:30:05.739876+0000","last_peered":"2024-05-08T18:30:05.739876+0000","last_clean":"2024-05-08T18:30:05.739876+0000","last_became_active":"2024-05-08T18:29:40.545749+0000","last_became_peered":"2024-05-08T18:29:40.545749+0000","last_unstale":"2024-05-08T18:30:05.739876+0000","last_undegraded":"2024-05-08T18:30:05.739876+0000","last_fullsized":"2024-05-08T18:30:05.739876+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:12:59.146887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.798307+0000","last_change":"2024-05-08T18:29:44.579839+0000","last_active":"2024-05-08T18:30:05.798307+0000","last_peered":"2024-05-08T18:30:05.798307+0000","last_clean":"2024-05-08T18:30:05.798307+0000","last_became_active":"2024-05-08T18:29:44.578142+0000","last_became_peered":"2024-05-08T18:29:44.578142+0000","last_unstale":"2024-05-08T18:30:05.798307+0000","last_undegraded":"2024-05-08T18:30:05.798307+0000","last_fullsized":"2024-05-08T18:30:05.798307+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:51:09.413191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"33'9","reported_seq":48,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.799507+0000","last_change":"2024-05-08T18:29:46.607288+0000","last_active":"2024-05-08T18:30:05.799507+0000","last_peered":"2024-05-08T18:30:05.799507+0000","last_clean":"2024-05-08T18:30:05.799507+0000","last_became_active":"2024-05-08T18:29:46.605154+0000","last_became_peered":"2024-05-08T18:29:46.605154+0000","last_unstale":"2024-05-08T18:30:05.799507+0000","last_undegraded":"2024-05-08T18:30:05.799507+0000","last_fullsized":"2024-05-08T18:30:05.799507+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:23.940519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"30'2","reported_seq":32,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.732675+0000","last_change":"2024-05-08T18:29:48.634956+0000","last_active":"2024-05-08T18:30:04.732675+0000","last_peered":"2024-05-08T18:30:04.732675+0000","last_clean":"2024-05-08T18:30:04.732675+0000","last_became_active":"2024-05-08T18:29:48.633858+0000","last_became_peered":"2024-05-08T18:29:48.633858+0000","last_unstale":"2024-05-08T18:30:04.732675+0000","last_undegraded":"2024-05-08T18:30:04.732675+0000","last_fullsized":"2024-05-08T18:30:04.732675+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:50:48.169666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.793404+0000","last_change":"2024-05-08T18:29:42.567744+0000","last_active":"2024-05-08T18:30:05.793404+0000","last_peered":"2024-05-08T18:30:05.793404+0000","last_clean":"2024-05-08T18:30:05.793404+0000","last_became_active":"2024-05-08T18:29:42.566974+0000","last_became_peered":"2024-05-08T18:29:42.566974+0000","last_unstale":"2024-05-08T18:30:05.793404+0000","last_undegraded":"2024-05-08T18:30:05.793404+0000","last_fullsized":"2024-05-08T18:30:05.793404+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:42.045615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.800771+0000","last_change":"2024-05-08T18:29:40.572499+0000","last_active":"2024-05-08T18:30:05.800771+0000","last_peered":"2024-05-08T18:30:05.800771+0000","last_clean":"2024-05-08T18:30:05.800771+0000","last_became_active":"2024-05-08T18:29:40.571322+0000","last_became_peered":"2024-05-08T18:29:40.571322+0000","last_unstale":"2024-05-08T18:30:05.800771+0000","last_undegraded":"2024-05-08T18:30:05.800771+0000","last_fullsized":"2024-05-08T18:30:05.800771+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:31.119374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.796375+0000","last_change":"2024-05-08T18:29:44.597045+0000","last_active":"2024-05-08T18:30:05.796375+0000","last_peered":"2024-05-08T18:30:05.796375+0000","last_clean":"2024-05-08T18:30:05.796375+0000","last_became_active":"2024-05-08T18:29:44.596282+0000","last_became_peered":"2024-05-08T18:29:44.596282+0000","last_unstale":"2024-05-08T18:30:05.796375+0000","last_undegraded":"2024-05-08T18:30:05.796375+0000","last_fullsized":"2024-05-08T18:30:05.796375+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:35:51.288126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"33'19","reported_seq":63,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.793317+0000","last_change":"2024-05-08T18:29:46.590633+0000","last_active":"2024-05-08T18:30:05.793317+0000","last_peered":"2024-05-08T18:30:05.793317+0000","last_clean":"2024-05-08T18:30:05.793317+0000","last_became_active":"2024-05-08T18:29:46.589600+0000","last_became_peered":"2024-05-08T18:29:46.589600+0000","last_unstale":"2024-05-08T18:30:05.793317+0000","last_undegraded":"2024-05-08T18:30:05.793317+0000","last_fullsized":"2024-05-08T18:30:05.793317+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:23.940519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":26,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.242381+0000","last_change":"2024-05-08T18:29:48.630758+0000","last_active":"2024-05-08T18:30:05.242381+0000","last_peered":"2024-05-08T18:30:05.242381+0000","last_clean":"2024-05-08T18:30:05.242381+0000","last_became_active":"2024-05-08T18:29:48.630017+0000","last_became_peered":"2024-05-08T18:29:48.630017+0000","last_unstale":"2024-05-08T18:30:05.242381+0000","last_undegraded":"2024-05-08T18:30:05.242381+0000","last_fullsized":"2024-05-08T18:30:05.242381+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:39.879384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.793939+0000","last_change":"2024-05-08T18:29:50.672682+0000","last_active":"2024-05-08T18:30:05.793939+0000","last_peered":"2024-05-08T18:30:05.793939+0000","last_clean":"2024-05-08T18:30:05.793939+0000","last_became_active":"2024-05-08T18:29:50.671923+0000","last_became_peered":"2024-05-08T18:29:50.671923+0000","last_unstale":"2024-05-08T18:30:05.793939+0000","last_undegraded":"2024-05-08T18:30:05.793939+0000","last_fullsized":"2024-05-08T18:30:05.793939+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:38.318890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.795522+0000","last_change":"2024-05-08T18:29:42.554289+0000","last_active":"2024-05-08T18:30:05.795522+0000","last_peered":"2024-05-08T18:30:05.795522+0000","last_clean":"2024-05-08T18:30:05.795522+0000","last_became_active":"2024-05-08T18:29:42.553574+0000","last_became_peered":"2024-05-08T18:29:42.553574+0000","last_unstale":"2024-05-08T18:30:05.795522+0000","last_undegraded":"2024-05-08T18:30:05.795522+0000","last_fullsized":"2024-05-08T18:30:05.795522+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:42.005809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.800256+0000","last_change":"2024-05-08T18:29:40.570169+0000","last_active":"2024-05-08T18:30:05.800256+0000","last_peered":"2024-05-08T18:30:05.800256+0000","last_clean":"2024-05-08T18:30:05.800256+0000","last_became_active":"2024-05-08T18:29:40.569542+0000","last_became_peered":"2024-05-08T18:29:40.569542+0000","last_unstale":"2024-05-08T18:30:05.800256+0000","last_undegraded":"2024-05-08T18:30:05.800256+0000","last_fullsized":"2024-05-08T18:30:05.800256+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:08:13.006752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"26'1","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.731439+0000","last_change":"2024-05-08T18:29:44.579659+0000","last_active":"2024-05-08T18:30:04.731439+0000","last_peered":"2024-05-08T18:30:04.731439+0000","last_clean":"2024-05-08T18:30:04.731439+0000","last_became_active":"2024-05-08T18:29:44.579152+0000","last_became_peered":"2024-05-08T18:29:44.579152+0000","last_unstale":"2024-05-08T18:30:04.731439+0000","last_undegraded":"2024-05-08T18:30:04.731439+0000","last_fullsized":"2024-05-08T18:30:04.731439+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:15:00.358583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"33'9","reported_seq":46,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.732290+0000","last_change":"2024-05-08T18:29:46.600224+0000","last_active":"2024-05-08T18:30:04.732290+0000","last_peered":"2024-05-08T18:30:04.732290+0000","last_clean":"2024-05-08T18:30:04.732290+0000","last_became_active":"2024-05-08T18:29:46.599464+0000","last_became_peered":"2024-05-08T18:29:46.599464+0000","last_unstale":"2024-05-08T18:30:04.732290+0000","last_undegraded":"2024-05-08T18:30:04.732290+0000","last_fullsized":"2024-05-08T18:30:04.732290+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:26:40.238188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":26,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.730442+0000","last_change":"2024-05-08T18:29:48.637939+0000","last_active":"2024-05-08T18:30:04.730442+0000","last_peered":"2024-05-08T18:30:04.730442+0000","last_clean":"2024-05-08T18:30:04.730442+0000","last_became_active":"2024-05-08T18:29:48.637231+0000","last_became_peered":"2024-05-08T18:29:48.637231+0000","last_unstale":"2024-05-08T18:30:04.730442+0000","last_undegraded":"2024-05-08T18:30:04.730442+0000","last_fullsized":"2024-05-08T18:30:04.730442+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:04.571608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.740227+0000","last_change":"2024-05-08T18:29:50.681831+0000","last_active":"2024-05-08T18:30:05.740227+0000","last_peered":"2024-05-08T18:30:05.740227+0000","last_clean":"2024-05-08T18:30:05.740227+0000","last_became_active":"2024-05-08T18:29:50.681287+0000","last_became_peered":"2024-05-08T18:29:50.681287+0000","last_unstale":"2024-05-08T18:30:05.740227+0000","last_undegraded":"2024-05-08T18:30:05.740227+0000","last_fullsized":"2024-05-08T18:30:05.740227+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:30:24.111488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.740675+0000","last_change":"2024-05-08T18:29:42.562975+0000","last_active":"2024-05-08T18:30:05.740675+0000","last_peered":"2024-05-08T18:30:05.740675+0000","last_clean":"2024-05-08T18:30:05.740675+0000","last_became_active":"2024-05-08T18:29:42.562267+0000","last_became_peered":"2024-05-08T18:29:42.562267+0000","last_unstale":"2024-05-08T18:30:05.740675+0000","last_undegraded":"2024-05-08T18:30:05.740675+0000","last_fullsized":"2024-05-08T18:30:05.740675+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:30.446371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.800583+0000","last_change":"2024-05-08T18:29:40.570736+0000","last_active":"2024-05-08T18:30:05.800583+0000","last_peered":"2024-05-08T18:30:05.800583+0000","last_clean":"2024-05-08T18:30:05.800583+0000","last_became_active":"2024-05-08T18:29:40.569626+0000","last_became_peered":"2024-05-08T18:29:40.569626+0000","last_unstale":"2024-05-08T18:30:05.800583+0000","last_undegraded":"2024-05-08T18:30:05.800583+0000","last_fullsized":"2024-05-08T18:30:05.800583+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:56.300986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"26'1","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.732288+0000","last_change":"2024-05-08T18:29:44.581748+0000","last_active":"2024-05-08T18:30:04.732288+0000","last_peered":"2024-05-08T18:30:04.732288+0000","last_clean":"2024-05-08T18:30:04.732288+0000","last_became_active":"2024-05-08T18:29:44.581067+0000","last_became_peered":"2024-05-08T18:29:44.581067+0000","last_unstale":"2024-05-08T18:30:04.732288+0000","last_undegraded":"2024-05-08T18:30:04.732288+0000","last_fullsized":"2024-05-08T18:30:04.732288+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:44.043691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"33'15","reported_seq":57,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.795340+0000","last_change":"2024-05-08T18:29:46.605887+0000","last_active":"2024-05-08T18:30:05.795340+0000","last_peered":"2024-05-08T18:30:05.795340+0000","last_clean":"2024-05-08T18:30:05.795340+0000","last_became_active":"2024-05-08T18:29:46.604966+0000","last_became_peered":"2024-05-08T18:29:46.604966+0000","last_unstale":"2024-05-08T18:30:05.795340+0000","last_undegraded":"2024-05-08T18:30:05.795340+0000","last_fullsized":"2024-05-08T18:30:05.795340+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:07:54.654205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"30'2","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.122184+0000","last_change":"2024-05-08T18:29:48.638657+0000","last_active":"2024-05-08T18:30:04.122184+0000","last_peered":"2024-05-08T18:30:04.122184+0000","last_clean":"2024-05-08T18:30:04.122184+0000","last_became_active":"2024-05-08T18:29:48.637758+0000","last_became_peered":"2024-05-08T18:29:48.637758+0000","last_unstale":"2024-05-08T18:30:04.122184+0000","last_undegraded":"2024-05-08T18:30:04.122184+0000","last_fullsized":"2024-05-08T18:30:04.122184+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:45:24.153991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.122798+0000","last_change":"2024-05-08T18:29:50.684501+0000","last_active":"2024-05-08T18:30:04.122798+0000","last_peered":"2024-05-08T18:30:04.122798+0000","last_clean":"2024-05-08T18:30:04.122798+0000","last_became_active":"2024-05-08T18:29:50.683738+0000","last_became_peered":"2024-05-08T18:29:50.683738+0000","last_unstale":"2024-05-08T18:30:04.122798+0000","last_undegraded":"2024-05-08T18:30:04.122798+0000","last_fullsized":"2024-05-08T18:30:04.122798+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:22.834262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.123784+0000","last_change":"2024-05-08T18:29:42.569401+0000","last_active":"2024-05-08T18:30:04.123784+0000","last_peered":"2024-05-08T18:30:04.123784+0000","last_clean":"2024-05-08T18:30:04.123784+0000","last_became_active":"2024-05-08T18:29:42.568659+0000","last_became_peered":"2024-05-08T18:29:42.568659+0000","last_unstale":"2024-05-08T18:30:04.123784+0000","last_undegraded":"2024-05-08T18:30:04.123784+0000","last_fullsized":"2024-05-08T18:30:04.123784+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:35:23.016110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.794856+0000","last_change":"2024-05-08T18:29:40.557076+0000","last_active":"2024-05-08T18:30:05.794856+0000","last_peered":"2024-05-08T18:30:05.794856+0000","last_clean":"2024-05-08T18:30:05.794856+0000","last_became_active":"2024-05-08T18:29:40.555805+0000","last_became_peered":"2024-05-08T18:29:40.555805+0000","last_unstale":"2024-05-08T18:30:05.794856+0000","last_undegraded":"2024-05-08T18:30:05.794856+0000","last_fullsized":"2024-05-08T18:30:05.794856+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:13.946346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.731658+0000","last_change":"2024-05-08T18:29:44.573892+0000","last_active":"2024-05-08T18:30:04.731658+0000","last_peered":"2024-05-08T18:30:04.731658+0000","last_clean":"2024-05-08T18:30:04.731658+0000","last_became_active":"2024-05-08T18:29:44.573308+0000","last_became_peered":"2024-05-08T18:29:44.573308+0000","last_unstale":"2024-05-08T18:30:04.731658+0000","last_undegraded":"2024-05-08T18:30:04.731658+0000","last_fullsized":"2024-05-08T18:30:04.731658+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:37.075348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"33'12","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.122517+0000","last_change":"2024-05-08T18:29:46.595585+0000","last_active":"2024-05-08T18:30:04.122517+0000","last_peered":"2024-05-08T18:30:04.122517+0000","last_clean":"2024-05-08T18:30:04.122517+0000","last_became_active":"2024-05-08T18:29:46.594930+0000","last_became_peered":"2024-05-08T18:29:46.594930+0000","last_unstale":"2024-05-08T18:30:04.122517+0000","last_undegraded":"2024-05-08T18:30:04.122517+0000","last_fullsized":"2024-05-08T18:30:04.122517+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:11.768269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":26,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.731000+0000","last_change":"2024-05-08T18:29:48.638137+0000","last_active":"2024-05-08T18:30:04.731000+0000","last_peered":"2024-05-08T18:30:04.731000+0000","last_clean":"2024-05-08T18:30:04.731000+0000","last_became_active":"2024-05-08T18:29:48.637370+0000","last_became_peered":"2024-05-08T18:29:48.637370+0000","last_unstale":"2024-05-08T18:30:04.731000+0000","last_undegraded":"2024-05-08T18:30:04.731000+0000","last_fullsized":"2024-05-08T18:30:04.731000+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:15.859849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":22,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.242694+0000","last_change":"2024-05-08T18:29:50.688760+0000","last_active":"2024-05-08T18:30:05.242694+0000","last_peered":"2024-05-08T18:30:05.242694+0000","last_clean":"2024-05-08T18:30:05.242694+0000","last_became_active":"2024-05-08T18:29:50.687960+0000","last_became_peered":"2024-05-08T18:29:50.687960+0000","last_unstale":"2024-05-08T18:30:05.242694+0000","last_undegraded":"2024-05-08T18:30:05.242694+0000","last_fullsized":"2024-05-08T18:30:05.242694+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:21:19.624895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.798302+0000","last_change":"2024-05-08T18:29:42.557850+0000","last_active":"2024-05-08T18:30:05.798302+0000","last_peered":"2024-05-08T18:30:05.798302+0000","last_clean":"2024-05-08T18:30:05.798302+0000","last_became_active":"2024-05-08T18:29:42.557119+0000","last_became_peered":"2024-05-08T18:29:42.557119+0000","last_unstale":"2024-05-08T18:30:05.798302+0000","last_undegraded":"2024-05-08T18:30:05.798302+0000","last_fullsized":"2024-05-08T18:30:05.798302+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:25:56.129785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.731516+0000","last_change":"2024-05-08T18:29:40.544530+0000","last_active":"2024-05-08T18:30:04.731516+0000","last_peered":"2024-05-08T18:30:04.731516+0000","last_clean":"2024-05-08T18:30:04.731516+0000","last_became_active":"2024-05-08T18:29:40.544215+0000","last_became_peered":"2024-05-08T18:29:40.544215+0000","last_unstale":"2024-05-08T18:30:04.731516+0000","last_undegraded":"2024-05-08T18:30:04.731516+0000","last_fullsized":"2024-05-08T18:30:04.731516+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:14:26.628603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.733050+0000","last_change":"2024-05-08T18:29:44.588227+0000","last_active":"2024-05-08T18:30:04.733050+0000","last_peered":"2024-05-08T18:30:04.733050+0000","last_clean":"2024-05-08T18:30:04.733050+0000","last_became_active":"2024-05-08T18:29:44.587822+0000","last_became_peered":"2024-05-08T18:29:44.587822+0000","last_unstale":"2024-05-08T18:30:04.733050+0000","last_undegraded":"2024-05-08T18:30:04.733050+0000","last_fullsized":"2024-05-08T18:30:04.733050+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:18:12.841872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"33'11","reported_seq":51,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.798191+0000","last_change":"2024-05-08T18:29:46.603563+0000","last_active":"2024-05-08T18:30:05.798191+0000","last_peered":"2024-05-08T18:30:05.798191+0000","last_clean":"2024-05-08T18:30:05.798191+0000","last_became_active":"2024-05-08T18:29:46.602801+0000","last_became_peered":"2024-05-08T18:29:46.602801+0000","last_unstale":"2024-05-08T18:30:05.798191+0000","last_undegraded":"2024-05-08T18:30:05.798191+0000","last_fullsized":"2024-05-08T18:30:05.798191+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:22:36.338527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.123352+0000","last_change":"2024-05-08T18:29:48.642806+0000","last_active":"2024-05-08T18:30:04.123352+0000","last_peered":"2024-05-08T18:30:04.123352+0000","last_clean":"2024-05-08T18:30:04.123352+0000","last_became_active":"2024-05-08T18:29:48.641813+0000","last_became_peered":"2024-05-08T18:29:48.641813+0000","last_unstale":"2024-05-08T18:30:04.123352+0000","last_undegraded":"2024-05-08T18:30:04.123352+0000","last_fullsized":"2024-05-08T18:30:04.123352+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:50:48.169666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":22,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.730541+0000","last_change":"2024-05-08T18:29:50.689819+0000","last_active":"2024-05-08T18:30:04.730541+0000","last_peered":"2024-05-08T18:30:04.730541+0000","last_clean":"2024-05-08T18:30:04.730541+0000","last_became_active":"2024-05-08T18:29:50.686739+0000","last_became_peered":"2024-05-08T18:29:50.686739+0000","last_unstale":"2024-05-08T18:30:04.730541+0000","last_undegraded":"2024-05-08T18:30:04.730541+0000","last_fullsized":"2024-05-08T18:30:04.730541+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:45:34.171402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.798705+0000","last_change":"2024-05-08T18:29:42.552388+0000","last_active":"2024-05-08T18:30:05.798705+0000","last_peered":"2024-05-08T18:30:05.798705+0000","last_clean":"2024-05-08T18:30:05.798705+0000","last_became_active":"2024-05-08T18:29:42.551647+0000","last_became_peered":"2024-05-08T18:29:42.551647+0000","last_unstale":"2024-05-08T18:30:05.798705+0000","last_undegraded":"2024-05-08T18:30:05.798705+0000","last_fullsized":"2024-05-08T18:30:05.798705+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:55.055481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.740817+0000","last_change":"2024-05-08T18:29:40.562946+0000","last_active":"2024-05-08T18:30:05.740817+0000","last_peered":"2024-05-08T18:30:05.740817+0000","last_clean":"2024-05-08T18:30:05.740817+0000","last_became_active":"2024-05-08T18:29:40.550942+0000","last_became_peered":"2024-05-08T18:29:40.550942+0000","last_unstale":"2024-05-08T18:30:05.740817+0000","last_undegraded":"2024-05-08T18:30:05.740817+0000","last_fullsized":"2024-05-08T18:30:05.740817+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:22.579629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.242663+0000","last_change":"2024-05-08T18:29:44.593681+0000","last_active":"2024-05-08T18:30:05.242663+0000","last_peered":"2024-05-08T18:30:05.242663+0000","last_clean":"2024-05-08T18:30:05.242663+0000","last_became_active":"2024-05-08T18:29:44.593242+0000","last_became_peered":"2024-05-08T18:29:44.593242+0000","last_unstale":"2024-05-08T18:30:05.242663+0000","last_undegraded":"2024-05-08T18:30:05.242663+0000","last_fullsized":"2024-05-08T18:30:05.242663+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:57.093364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"33'15","reported_seq":55,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.734191+0000","last_change":"2024-05-08T18:29:46.589514+0000","last_active":"2024-05-08T18:30:04.734191+0000","last_peered":"2024-05-08T18:30:04.734191+0000","last_clean":"2024-05-08T18:30:04.734191+0000","last_became_active":"2024-05-08T18:29:46.588784+0000","last_became_peered":"2024-05-08T18:29:46.588784+0000","last_unstale":"2024-05-08T18:30:04.734191+0000","last_undegraded":"2024-05-08T18:30:04.734191+0000","last_fullsized":"2024-05-08T18:30:04.734191+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:02:30.355168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"30'2","reported_seq":32,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.733808+0000","last_change":"2024-05-08T18:29:48.631007+0000","last_active":"2024-05-08T18:30:04.733808+0000","last_peered":"2024-05-08T18:30:04.733808+0000","last_clean":"2024-05-08T18:30:04.733808+0000","last_became_active":"2024-05-08T18:29:48.630229+0000","last_became_peered":"2024-05-08T18:29:48.630229+0000","last_unstale":"2024-05-08T18:30:04.733808+0000","last_undegraded":"2024-05-08T18:30:04.733808+0000","last_fullsized":"2024-05-08T18:30:04.733808+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:44:03.778419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":22,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.243521+0000","last_change":"2024-05-08T18:29:50.675105+0000","last_active":"2024-05-08T18:30:05.243521+0000","last_peered":"2024-05-08T18:30:05.243521+0000","last_clean":"2024-05-08T18:30:05.243521+0000","last_became_active":"2024-05-08T18:29:50.674292+0000","last_became_peered":"2024-05-08T18:29:50.674292+0000","last_unstale":"2024-05-08T18:30:05.243521+0000","last_undegraded":"2024-05-08T18:30:05.243521+0000","last_fullsized":"2024-05-08T18:30:05.243521+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:47:15.423647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.801623+0000","last_change":"2024-05-08T18:29:42.579707+0000","last_active":"2024-05-08T18:30:05.801623+0000","last_peered":"2024-05-08T18:30:05.801623+0000","last_clean":"2024-05-08T18:30:05.801623+0000","last_became_active":"2024-05-08T18:29:42.579059+0000","last_became_peered":"2024-05-08T18:29:42.579059+0000","last_unstale":"2024-05-08T18:30:05.801623+0000","last_undegraded":"2024-05-08T18:30:05.801623+0000","last_fullsized":"2024-05-08T18:30:05.801623+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:09.787597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.796085+0000","last_change":"2024-05-08T18:29:40.555327+0000","last_active":"2024-05-08T18:30:05.796085+0000","last_peered":"2024-05-08T18:30:05.796085+0000","last_clean":"2024-05-08T18:30:05.796085+0000","last_became_active":"2024-05-08T18:29:40.554594+0000","last_became_peered":"2024-05-08T18:29:40.554594+0000","last_unstale":"2024-05-08T18:30:05.796085+0000","last_undegraded":"2024-05-08T18:30:05.796085+0000","last_fullsized":"2024-05-08T18:30:05.796085+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:19.841114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"26'2","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.799554+0000","last_change":"2024-05-08T18:29:44.582434+0000","last_active":"2024-05-08T18:30:05.799554+0000","last_peered":"2024-05-08T18:30:05.799554+0000","last_clean":"2024-05-08T18:30:05.799554+0000","last_became_active":"2024-05-08T18:29:44.581699+0000","last_became_peered":"2024-05-08T18:29:44.581699+0000","last_unstale":"2024-05-08T18:30:05.799554+0000","last_undegraded":"2024-05-08T18:30:05.799554+0000","last_fullsized":"2024-05-08T18:30:05.799554+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:19:29.113643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"33'10","reported_seq":45,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.732778+0000","last_change":"2024-05-08T18:29:46.590860+0000","last_active":"2024-05-08T18:30:04.732778+0000","last_peered":"2024-05-08T18:30:04.732778+0000","last_clean":"2024-05-08T18:30:04.732778+0000","last_became_active":"2024-05-08T18:29:46.590087+0000","last_became_peered":"2024-05-08T18:29:46.590087+0000","last_unstale":"2024-05-08T18:30:04.732778+0000","last_undegraded":"2024-05-08T18:30:04.732778+0000","last_fullsized":"2024-05-08T18:30:04.732778+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:19:58.358449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"30'2","reported_seq":34,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.741020+0000","last_change":"2024-05-08T18:29:48.635548+0000","last_active":"2024-05-08T18:30:05.741020+0000","last_peered":"2024-05-08T18:30:05.741020+0000","last_clean":"2024-05-08T18:30:05.741020+0000","last_became_active":"2024-05-08T18:29:48.634801+0000","last_became_peered":"2024-05-08T18:29:48.634801+0000","last_unstale":"2024-05-08T18:30:05.741020+0000","last_undegraded":"2024-05-08T18:30:05.741020+0000","last_fullsized":"2024-05-08T18:30:05.741020+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:04:20.128031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.796666+0000","last_change":"2024-05-08T18:29:50.668279+0000","last_active":"2024-05-08T18:30:05.796666+0000","last_peered":"2024-05-08T18:30:05.796666+0000","last_clean":"2024-05-08T18:30:05.796666+0000","last_became_active":"2024-05-08T18:29:50.667536+0000","last_became_peered":"2024-05-08T18:29:50.667536+0000","last_unstale":"2024-05-08T18:30:05.796666+0000","last_undegraded":"2024-05-08T18:30:05.796666+0000","last_fullsized":"2024-05-08T18:30:05.796666+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:12:05.780786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.243017+0000","last_change":"2024-05-08T18:29:42.563807+0000","last_active":"2024-05-08T18:30:05.243017+0000","last_peered":"2024-05-08T18:30:05.243017+0000","last_clean":"2024-05-08T18:30:05.243017+0000","last_became_active":"2024-05-08T18:29:42.563416+0000","last_became_peered":"2024-05-08T18:29:42.563416+0000","last_unstale":"2024-05-08T18:30:05.243017+0000","last_undegraded":"2024-05-08T18:30:05.243017+0000","last_fullsized":"2024-05-08T18:30:05.243017+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:18:10.803989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.731317+0000","last_change":"2024-05-08T18:29:40.548898+0000","last_active":"2024-05-08T18:30:04.731317+0000","last_peered":"2024-05-08T18:30:04.731317+0000","last_clean":"2024-05-08T18:30:04.731317+0000","last_became_active":"2024-05-08T18:29:40.548591+0000","last_became_peered":"2024-05-08T18:29:40.548591+0000","last_unstale":"2024-05-08T18:30:04.731317+0000","last_undegraded":"2024-05-08T18:30:04.731317+0000","last_fullsized":"2024-05-08T18:30:04.731317+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:27:41.414153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.798714+0000","last_change":"2024-05-08T18:29:44.582578+0000","last_active":"2024-05-08T18:30:05.798714+0000","last_peered":"2024-05-08T18:30:05.798714+0000","last_clean":"2024-05-08T18:30:05.798714+0000","last_became_active":"2024-05-08T18:29:44.581832+0000","last_became_peered":"2024-05-08T18:29:44.581832+0000","last_unstale":"2024-05-08T18:30:05.798714+0000","last_undegraded":"2024-05-08T18:30:05.798714+0000","last_fullsized":"2024-05-08T18:30:05.798714+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:52:25.736491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"33'17","reported_seq":60,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.795827+0000","last_change":"2024-05-08T18:29:46.602459+0000","last_active":"2024-05-08T18:30:05.795827+0000","last_peered":"2024-05-08T18:30:05.795827+0000","last_clean":"2024-05-08T18:30:05.795827+0000","last_became_active":"2024-05-08T18:29:46.601740+0000","last_became_peered":"2024-05-08T18:29:46.601740+0000","last_unstale":"2024-05-08T18:30:05.795827+0000","last_undegraded":"2024-05-08T18:30:05.795827+0000","last_fullsized":"2024-05-08T18:30:05.795827+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:58:31.293922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":28,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.740202+0000","last_change":"2024-05-08T18:29:48.640046+0000","last_active":"2024-05-08T18:30:05.740202+0000","last_peered":"2024-05-08T18:30:05.740202+0000","last_clean":"2024-05-08T18:30:05.740202+0000","last_became_active":"2024-05-08T18:29:48.639309+0000","last_became_peered":"2024-05-08T18:29:48.639309+0000","last_unstale":"2024-05-08T18:30:05.740202+0000","last_undegraded":"2024-05-08T18:30:05.740202+0000","last_fullsized":"2024-05-08T18:30:05.740202+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:10.533065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":22,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.242277+0000","last_change":"2024-05-08T18:29:50.668361+0000","last_active":"2024-05-08T18:30:05.242277+0000","last_peered":"2024-05-08T18:30:05.242277+0000","last_clean":"2024-05-08T18:30:05.242277+0000","last_became_active":"2024-05-08T18:29:50.667636+0000","last_became_peered":"2024-05-08T18:29:50.667636+0000","last_unstale":"2024-05-08T18:30:05.242277+0000","last_undegraded":"2024-05-08T18:30:05.242277+0000","last_fullsized":"2024-05-08T18:30:05.242277+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:58:35.356885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.741298+0000","last_change":"2024-05-08T18:29:42.584098+0000","last_active":"2024-05-08T18:30:05.741298+0000","last_peered":"2024-05-08T18:30:05.741298+0000","last_clean":"2024-05-08T18:30:05.741298+0000","last_became_active":"2024-05-08T18:29:42.583639+0000","last_became_peered":"2024-05-08T18:29:42.583639+0000","last_unstale":"2024-05-08T18:30:05.741298+0000","last_undegraded":"2024-05-08T18:30:05.741298+0000","last_fullsized":"2024-05-08T18:30:05.741298+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:08:15.026467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":146,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.795590+0000","last_change":"2024-05-08T18:29:27.115522+0000","last_active":"2024-05-08T18:30:05.795590+0000","last_peered":"2024-05-08T18:30:05.795590+0000","last_clean":"2024-05-08T18:30:05.795590+0000","last_became_active":"2024-05-08T18:29:27.112960+0000","last_became_peered":"2024-05-08T18:29:27.112960+0000","last_unstale":"2024-05-08T18:30:05.795590+0000","last_undegraded":"2024-05-08T18:30:05.795590+0000","last_fullsized":"2024-05-08T18:30:05.795590+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:26.091102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:26.091102+0000","last_clean_scrub_stamp":"2024-05-08T18:29:26.091102+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:09:50.296961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":50,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.794685+0000","last_change":"2024-05-08T18:29:34.496467+0000","last_active":"2024-05-08T18:30:05.794685+0000","last_peered":"2024-05-08T18:30:05.794685+0000","last_clean":"2024-05-08T18:30:05.794685+0000","last_became_active":"2024-05-08T18:29:34.495632+0000","last_became_peered":"2024-05-08T18:29:34.495632+0000","last_unstale":"2024-05-08T18:30:05.794685+0000","last_undegraded":"2024-05-08T18:30:05.794685+0000","last_fullsized":"2024-05-08T18:30:05.794685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:35.917391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.731383+0000","last_change":"2024-05-08T18:29:40.559945+0000","last_active":"2024-05-08T18:30:04.731383+0000","last_peered":"2024-05-08T18:30:04.731383+0000","last_clean":"2024-05-08T18:30:04.731383+0000","last_became_active":"2024-05-08T18:29:40.559723+0000","last_became_peered":"2024-05-08T18:29:40.559723+0000","last_unstale":"2024-05-08T18:30:04.731383+0000","last_undegraded":"2024-05-08T18:30:04.731383+0000","last_fullsized":"2024-05-08T18:30:04.731383+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:39:17.879068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.798251+0000","last_change":"2024-05-08T18:29:44.592445+0000","last_active":"2024-05-08T18:30:05.798251+0000","last_peered":"2024-05-08T18:30:05.798251+0000","last_clean":"2024-05-08T18:30:05.798251+0000","last_became_active":"2024-05-08T18:29:44.587855+0000","last_became_peered":"2024-05-08T18:29:44.587855+0000","last_unstale":"2024-05-08T18:30:05.798251+0000","last_undegraded":"2024-05-08T18:30:05.798251+0000","last_fullsized":"2024-05-08T18:30:05.798251+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:06:05.355648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"33'13","reported_seq":59,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.800087+0000","last_change":"2024-05-08T18:29:46.595394+0000","last_active":"2024-05-08T18:30:05.800087+0000","last_peered":"2024-05-08T18:30:05.800087+0000","last_clean":"2024-05-08T18:30:05.800087+0000","last_became_active":"2024-05-08T18:29:46.594573+0000","last_became_peered":"2024-05-08T18:29:46.594573+0000","last_unstale":"2024-05-08T18:30:05.800087+0000","last_undegraded":"2024-05-08T18:30:05.800087+0000","last_fullsized":"2024-05-08T18:30:05.800087+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:47:11.360684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.122841+0000","last_change":"2024-05-08T18:29:48.632178+0000","last_active":"2024-05-08T18:30:04.122841+0000","last_peered":"2024-05-08T18:30:04.122841+0000","last_clean":"2024-05-08T18:30:04.122841+0000","last_became_active":"2024-05-08T18:29:48.631481+0000","last_became_peered":"2024-05-08T18:29:48.631481+0000","last_unstale":"2024-05-08T18:30:04.122841+0000","last_undegraded":"2024-05-08T18:30:04.122841+0000","last_fullsized":"2024-05-08T18:30:04.122841+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:34.806539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.739442+0000","last_change":"2024-05-08T18:29:50.675319+0000","last_active":"2024-05-08T18:30:05.739442+0000","last_peered":"2024-05-08T18:30:05.739442+0000","last_clean":"2024-05-08T18:30:05.739442+0000","last_became_active":"2024-05-08T18:29:50.674526+0000","last_became_peered":"2024-05-08T18:29:50.674526+0000","last_unstale":"2024-05-08T18:30:05.739442+0000","last_undegraded":"2024-05-08T18:30:05.739442+0000","last_fullsized":"2024-05-08T18:30:05.739442+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:59:06.404586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.123594+0000","last_change":"2024-05-08T18:29:42.568584+0000","last_active":"2024-05-08T18:30:04.123594+0000","last_peered":"2024-05-08T18:30:04.123594+0000","last_clean":"2024-05-08T18:30:04.123594+0000","last_became_active":"2024-05-08T18:29:42.568244+0000","last_became_peered":"2024-05-08T18:29:42.568244+0000","last_unstale":"2024-05-08T18:30:04.123594+0000","last_undegraded":"2024-05-08T18:30:04.123594+0000","last_fullsized":"2024-05-08T18:30:04.123594+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:20.397730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":50,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.795111+0000","last_change":"2024-05-08T18:29:34.497654+0000","last_active":"2024-05-08T18:30:05.795111+0000","last_peered":"2024-05-08T18:30:05.795111+0000","last_clean":"2024-05-08T18:30:05.795111+0000","last_became_active":"2024-05-08T18:29:34.495812+0000","last_became_peered":"2024-05-08T18:29:34.495812+0000","last_unstale":"2024-05-08T18:30:05.795111+0000","last_undegraded":"2024-05-08T18:30:05.795111+0000","last_fullsized":"2024-05-08T18:30:05.795111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:37:02.202613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.122722+0000","last_change":"2024-05-08T18:29:40.560653+0000","last_active":"2024-05-08T18:30:04.122722+0000","last_peered":"2024-05-08T18:30:04.122722+0000","last_clean":"2024-05-08T18:30:04.122722+0000","last_became_active":"2024-05-08T18:29:40.560296+0000","last_became_peered":"2024-05-08T18:29:40.560296+0000","last_unstale":"2024-05-08T18:30:04.122722+0000","last_undegraded":"2024-05-08T18:30:04.122722+0000","last_fullsized":"2024-05-08T18:30:04.122722+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:52.462279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.800728+0000","last_change":"2024-05-08T18:29:44.594681+0000","last_active":"2024-05-08T18:30:05.800728+0000","last_peered":"2024-05-08T18:30:05.800728+0000","last_clean":"2024-05-08T18:30:05.800728+0000","last_became_active":"2024-05-08T18:29:44.593917+0000","last_became_peered":"2024-05-08T18:29:44.593917+0000","last_unstale":"2024-05-08T18:30:05.800728+0000","last_undegraded":"2024-05-08T18:30:05.800728+0000","last_fullsized":"2024-05-08T18:30:05.800728+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:59:00.335437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"33'23","reported_seq":75,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.242532+0000","last_change":"2024-05-08T18:29:46.599932+0000","last_active":"2024-05-08T18:30:05.242532+0000","last_peered":"2024-05-08T18:30:05.242532+0000","last_clean":"2024-05-08T18:30:05.242532+0000","last_became_active":"2024-05-08T18:29:46.594789+0000","last_became_peered":"2024-05-08T18:29:46.594789+0000","last_unstale":"2024-05-08T18:30:05.242532+0000","last_undegraded":"2024-05-08T18:30:05.242532+0000","last_fullsized":"2024-05-08T18:30:05.242532+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:04:18.099848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":42,"num_read_kb":27,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":28,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.799272+0000","last_change":"2024-05-08T18:29:48.634661+0000","last_active":"2024-05-08T18:30:05.799272+0000","last_peered":"2024-05-08T18:30:05.799272+0000","last_clean":"2024-05-08T18:30:05.799272+0000","last_became_active":"2024-05-08T18:29:48.634044+0000","last_became_peered":"2024-05-08T18:29:48.634044+0000","last_unstale":"2024-05-08T18:30:05.799272+0000","last_undegraded":"2024-05-08T18:30:05.799272+0000","last_fullsized":"2024-05-08T18:30:05.799272+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:01:46.238076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":22,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.242116+0000","last_change":"2024-05-08T18:29:50.676536+0000","last_active":"2024-05-08T18:30:05.242116+0000","last_peered":"2024-05-08T18:30:05.242116+0000","last_clean":"2024-05-08T18:30:05.242116+0000","last_became_active":"2024-05-08T18:29:50.675770+0000","last_became_peered":"2024-05-08T18:29:50.675770+0000","last_unstale":"2024-05-08T18:30:05.242116+0000","last_undegraded":"2024-05-08T18:30:05.242116+0000","last_fullsized":"2024-05-08T18:30:05.242116+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:28.003482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.243250+0000","last_change":"2024-05-08T18:29:42.575253+0000","last_active":"2024-05-08T18:30:05.243250+0000","last_peered":"2024-05-08T18:30:05.243250+0000","last_clean":"2024-05-08T18:30:05.243250+0000","last_became_active":"2024-05-08T18:29:42.573621+0000","last_became_peered":"2024-05-08T18:29:42.573621+0000","last_unstale":"2024-05-08T18:30:05.243250+0000","last_undegraded":"2024-05-08T18:30:05.243250+0000","last_fullsized":"2024-05-08T18:30:05.243250+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:59.243324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":48,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.731253+0000","last_change":"2024-05-08T18:29:34.491071+0000","last_active":"2024-05-08T18:30:04.731253+0000","last_peered":"2024-05-08T18:30:04.731253+0000","last_clean":"2024-05-08T18:30:04.731253+0000","last_became_active":"2024-05-08T18:29:34.490717+0000","last_became_peered":"2024-05-08T18:29:34.490717+0000","last_unstale":"2024-05-08T18:30:04.731253+0000","last_undegraded":"2024-05-08T18:30:04.731253+0000","last_fullsized":"2024-05-08T18:30:04.731253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:55.793312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.242547+0000","last_change":"2024-05-08T18:29:40.530634+0000","last_active":"2024-05-08T18:30:05.242547+0000","last_peered":"2024-05-08T18:30:05.242547+0000","last_clean":"2024-05-08T18:30:05.242547+0000","last_became_active":"2024-05-08T18:29:40.529804+0000","last_became_peered":"2024-05-08T18:29:40.529804+0000","last_unstale":"2024-05-08T18:30:05.242547+0000","last_undegraded":"2024-05-08T18:30:05.242547+0000","last_fullsized":"2024-05-08T18:30:05.242547+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:59:25.840149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"26'1","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.734010+0000","last_change":"2024-05-08T18:29:44.584678+0000","last_active":"2024-05-08T18:30:04.734010+0000","last_peered":"2024-05-08T18:30:04.734010+0000","last_clean":"2024-05-08T18:30:04.734010+0000","last_became_active":"2024-05-08T18:29:44.584227+0000","last_became_peered":"2024-05-08T18:29:44.584227+0000","last_unstale":"2024-05-08T18:30:04.734010+0000","last_undegraded":"2024-05-08T18:30:04.734010+0000","last_fullsized":"2024-05-08T18:30:04.734010+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:04:01.281207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'15","reported_seq":57,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.799794+0000","last_change":"2024-05-08T18:29:46.608720+0000","last_active":"2024-05-08T18:30:05.799794+0000","last_peered":"2024-05-08T18:30:05.799794+0000","last_clean":"2024-05-08T18:30:05.799794+0000","last_became_active":"2024-05-08T18:29:46.607989+0000","last_became_peered":"2024-05-08T18:29:46.607989+0000","last_unstale":"2024-05-08T18:30:05.799794+0000","last_undegraded":"2024-05-08T18:30:05.799794+0000","last_fullsized":"2024-05-08T18:30:05.799794+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:58:31.293922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.122901+0000","last_change":"2024-05-08T18:29:48.625269+0000","last_active":"2024-05-08T18:30:04.122901+0000","last_peered":"2024-05-08T18:30:04.122901+0000","last_clean":"2024-05-08T18:30:04.122901+0000","last_became_active":"2024-05-08T18:29:48.624545+0000","last_became_peered":"2024-05-08T18:29:48.624545+0000","last_unstale":"2024-05-08T18:30:04.122901+0000","last_undegraded":"2024-05-08T18:30:04.122901+0000","last_fullsized":"2024-05-08T18:30:04.122901+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:16:42.799734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":22,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.732025+0000","last_change":"2024-05-08T18:29:50.688851+0000","last_active":"2024-05-08T18:30:04.732025+0000","last_peered":"2024-05-08T18:30:04.732025+0000","last_clean":"2024-05-08T18:30:04.732025+0000","last_became_active":"2024-05-08T18:29:50.687978+0000","last_became_peered":"2024-05-08T18:29:50.687978+0000","last_unstale":"2024-05-08T18:30:04.732025+0000","last_undegraded":"2024-05-08T18:30:04.732025+0000","last_fullsized":"2024-05-08T18:30:04.732025+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:28:29.836446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.242919+0000","last_change":"2024-05-08T18:29:42.574606+0000","last_active":"2024-05-08T18:30:05.242919+0000","last_peered":"2024-05-08T18:30:05.242919+0000","last_clean":"2024-05-08T18:30:05.242919+0000","last_became_active":"2024-05-08T18:29:42.573656+0000","last_became_peered":"2024-05-08T18:29:42.573656+0000","last_unstale":"2024-05-08T18:30:05.242919+0000","last_undegraded":"2024-05-08T18:30:05.242919+0000","last_fullsized":"2024-05-08T18:30:05.242919+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:54:16.539832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":50,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.794557+0000","last_change":"2024-05-08T18:29:34.496942+0000","last_active":"2024-05-08T18:30:05.794557+0000","last_peered":"2024-05-08T18:30:05.794557+0000","last_clean":"2024-05-08T18:30:05.794557+0000","last_became_active":"2024-05-08T18:29:34.495882+0000","last_became_peered":"2024-05-08T18:29:34.495882+0000","last_unstale":"2024-05-08T18:30:05.794557+0000","last_undegraded":"2024-05-08T18:30:05.794557+0000","last_fullsized":"2024-05-08T18:30:05.794557+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:55.793312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.797761+0000","last_change":"2024-05-08T18:29:40.554353+0000","last_active":"2024-05-08T18:30:05.797761+0000","last_peered":"2024-05-08T18:30:05.797761+0000","last_clean":"2024-05-08T18:30:05.797761+0000","last_became_active":"2024-05-08T18:29:40.553527+0000","last_became_peered":"2024-05-08T18:29:40.553527+0000","last_unstale":"2024-05-08T18:30:05.797761+0000","last_undegraded":"2024-05-08T18:30:05.797761+0000","last_fullsized":"2024-05-08T18:30:05.797761+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:03:42.148647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":32,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.122438+0000","last_change":"2024-05-08T18:29:44.597411+0000","last_active":"2024-05-08T18:30:04.122438+0000","last_peered":"2024-05-08T18:30:04.122438+0000","last_clean":"2024-05-08T18:30:04.122438+0000","last_became_active":"2024-05-08T18:29:44.596678+0000","last_became_peered":"2024-05-08T18:29:44.596678+0000","last_unstale":"2024-05-08T18:30:04.122438+0000","last_undegraded":"2024-05-08T18:30:04.122438+0000","last_fullsized":"2024-05-08T18:30:04.122438+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:37:23.674968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'12","reported_seq":48,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.733581+0000","last_change":"2024-05-08T18:29:46.607040+0000","last_active":"2024-05-08T18:30:04.733581+0000","last_peered":"2024-05-08T18:30:04.733581+0000","last_clean":"2024-05-08T18:30:04.733581+0000","last_became_active":"2024-05-08T18:29:46.606367+0000","last_became_peered":"2024-05-08T18:29:46.606367+0000","last_unstale":"2024-05-08T18:30:04.733581+0000","last_undegraded":"2024-05-08T18:30:04.733581+0000","last_fullsized":"2024-05-08T18:30:04.733581+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:59:26.650126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":28,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.741591+0000","last_change":"2024-05-08T18:29:48.632665+0000","last_active":"2024-05-08T18:30:05.741591+0000","last_peered":"2024-05-08T18:30:05.741591+0000","last_clean":"2024-05-08T18:30:05.741591+0000","last_became_active":"2024-05-08T18:29:48.631874+0000","last_became_peered":"2024-05-08T18:29:48.631874+0000","last_unstale":"2024-05-08T18:30:05.741591+0000","last_undegraded":"2024-05-08T18:30:05.741591+0000","last_fullsized":"2024-05-08T18:30:05.741591+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:06:09.390017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.792785+0000","last_change":"2024-05-08T18:29:50.683443+0000","last_active":"2024-05-08T18:30:05.792785+0000","last_peered":"2024-05-08T18:30:05.792785+0000","last_clean":"2024-05-08T18:30:05.792785+0000","last_became_active":"2024-05-08T18:29:50.682634+0000","last_became_peered":"2024-05-08T18:29:50.682634+0000","last_unstale":"2024-05-08T18:30:05.792785+0000","last_undegraded":"2024-05-08T18:30:05.792785+0000","last_fullsized":"2024-05-08T18:30:05.792785+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:10:38.951662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.243042+0000","last_change":"2024-05-08T18:29:42.574593+0000","last_active":"2024-05-08T18:30:05.243042+0000","last_peered":"2024-05-08T18:30:05.243042+0000","last_clean":"2024-05-08T18:30:05.243042+0000","last_became_active":"2024-05-08T18:29:42.574288+0000","last_became_peered":"2024-05-08T18:29:42.574288+0000","last_unstale":"2024-05-08T18:30:05.243042+0000","last_undegraded":"2024-05-08T18:30:05.243042+0000","last_fullsized":"2024-05-08T18:30:05.243042+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:58.320701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.796680+0000","last_change":"2024-05-08T18:29:40.556697+0000","last_active":"2024-05-08T18:30:05.796680+0000","last_peered":"2024-05-08T18:30:05.796680+0000","last_clean":"2024-05-08T18:30:05.796680+0000","last_became_active":"2024-05-08T18:29:40.555965+0000","last_became_peered":"2024-05-08T18:29:40.555965+0000","last_unstale":"2024-05-08T18:30:05.796680+0000","last_undegraded":"2024-05-08T18:30:05.796680+0000","last_fullsized":"2024-05-08T18:30:05.796680+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:36:14.096907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":48,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.243261+0000","last_change":"2024-05-08T18:29:34.606393+0000","last_active":"2024-05-08T18:30:05.243261+0000","last_peered":"2024-05-08T18:30:05.243261+0000","last_clean":"2024-05-08T18:30:05.243261+0000","last_became_active":"2024-05-08T18:29:34.605574+0000","last_became_peered":"2024-05-08T18:29:34.605574+0000","last_unstale":"2024-05-08T18:30:05.243261+0000","last_undegraded":"2024-05-08T18:30:05.243261+0000","last_fullsized":"2024-05-08T18:30:05.243261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:55.793312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":32,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.123260+0000","last_change":"2024-05-08T18:29:44.595127+0000","last_active":"2024-05-08T18:30:04.123260+0000","last_peered":"2024-05-08T18:30:04.123260+0000","last_clean":"2024-05-08T18:30:04.123260+0000","last_became_active":"2024-05-08T18:29:44.594642+0000","last_became_peered":"2024-05-08T18:29:44.594642+0000","last_unstale":"2024-05-08T18:30:04.123260+0000","last_undegraded":"2024-05-08T18:30:04.123260+0000","last_fullsized":"2024-05-08T18:30:04.123260+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:04:49.020450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"33'18","reported_seq":60,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.122286+0000","last_change":"2024-05-08T18:29:46.602279+0000","last_active":"2024-05-08T18:30:04.122286+0000","last_peered":"2024-05-08T18:30:04.122286+0000","last_clean":"2024-05-08T18:30:04.122286+0000","last_became_active":"2024-05-08T18:29:46.599707+0000","last_became_peered":"2024-05-08T18:29:46.599707+0000","last_unstale":"2024-05-08T18:30:04.122286+0000","last_undegraded":"2024-05-08T18:30:04.122286+0000","last_fullsized":"2024-05-08T18:30:04.122286+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:54:48.654215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":28,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.794968+0000","last_change":"2024-05-08T18:29:48.639458+0000","last_active":"2024-05-08T18:30:05.794968+0000","last_peered":"2024-05-08T18:30:05.794968+0000","last_clean":"2024-05-08T18:30:05.794968+0000","last_became_active":"2024-05-08T18:29:48.638709+0000","last_became_peered":"2024-05-08T18:29:48.638709+0000","last_unstale":"2024-05-08T18:30:05.794968+0000","last_undegraded":"2024-05-08T18:30:05.794968+0000","last_fullsized":"2024-05-08T18:30:05.794968+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:19:58.182291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.122633+0000","last_change":"2024-05-08T18:29:50.681077+0000","last_active":"2024-05-08T18:30:04.122633+0000","last_peered":"2024-05-08T18:30:04.122633+0000","last_clean":"2024-05-08T18:30:04.122633+0000","last_became_active":"2024-05-08T18:29:50.675766+0000","last_became_peered":"2024-05-08T18:29:50.675766+0000","last_unstale":"2024-05-08T18:30:04.122633+0000","last_undegraded":"2024-05-08T18:30:04.122633+0000","last_fullsized":"2024-05-08T18:30:04.122633+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:09:29.641515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.123745+0000","last_change":"2024-05-08T18:29:42.571265+0000","last_active":"2024-05-08T18:30:04.123745+0000","last_peered":"2024-05-08T18:30:04.123745+0000","last_clean":"2024-05-08T18:30:04.123745+0000","last_became_active":"2024-05-08T18:29:42.570645+0000","last_became_peered":"2024-05-08T18:29:42.570645+0000","last_unstale":"2024-05-08T18:30:04.123745+0000","last_undegraded":"2024-05-08T18:30:04.123745+0000","last_fullsized":"2024-05-08T18:30:04.123745+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:30:29.452640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.243039+0000","last_change":"2024-05-08T18:29:40.531079+0000","last_active":"2024-05-08T18:30:05.243039+0000","last_peered":"2024-05-08T18:30:05.243039+0000","last_clean":"2024-05-08T18:30:05.243039+0000","last_became_active":"2024-05-08T18:29:40.530256+0000","last_became_peered":"2024-05-08T18:29:40.530256+0000","last_unstale":"2024-05-08T18:30:05.243039+0000","last_undegraded":"2024-05-08T18:30:05.243039+0000","last_fullsized":"2024-05-08T18:30:05.243039+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:09:42.581976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":50,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.801190+0000","last_change":"2024-05-08T18:29:34.603292+0000","last_active":"2024-05-08T18:30:05.801190+0000","last_peered":"2024-05-08T18:30:05.801190+0000","last_clean":"2024-05-08T18:30:05.801190+0000","last_became_active":"2024-05-08T18:29:34.602547+0000","last_became_peered":"2024-05-08T18:29:34.602547+0000","last_unstale":"2024-05-08T18:30:05.801190+0000","last_undegraded":"2024-05-08T18:30:05.801190+0000","last_fullsized":"2024-05-08T18:30:05.801190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:24:55.555475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.740348+0000","last_change":"2024-05-08T18:29:44.593275+0000","last_active":"2024-05-08T18:30:05.740348+0000","last_peered":"2024-05-08T18:30:05.740348+0000","last_clean":"2024-05-08T18:30:05.740348+0000","last_became_active":"2024-05-08T18:29:44.591870+0000","last_became_peered":"2024-05-08T18:29:44.591870+0000","last_unstale":"2024-05-08T18:30:05.740348+0000","last_undegraded":"2024-05-08T18:30:05.740348+0000","last_fullsized":"2024-05-08T18:30:05.740348+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:35.176971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"33'14","reported_seq":51,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.242071+0000","last_change":"2024-05-08T18:29:46.603499+0000","last_active":"2024-05-08T18:30:05.242071+0000","last_peered":"2024-05-08T18:30:05.242071+0000","last_clean":"2024-05-08T18:30:05.242071+0000","last_became_active":"2024-05-08T18:29:46.602920+0000","last_became_peered":"2024-05-08T18:29:46.602920+0000","last_unstale":"2024-05-08T18:30:05.242071+0000","last_undegraded":"2024-05-08T18:30:05.242071+0000","last_fullsized":"2024-05-08T18:30:05.242071+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:08.504882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"30'2","reported_seq":34,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.793157+0000","last_change":"2024-05-08T18:29:48.634915+0000","last_active":"2024-05-08T18:30:05.793157+0000","last_peered":"2024-05-08T18:30:05.793157+0000","last_clean":"2024-05-08T18:30:05.793157+0000","last_became_active":"2024-05-08T18:29:48.634280+0000","last_became_peered":"2024-05-08T18:29:48.634280+0000","last_unstale":"2024-05-08T18:30:05.793157+0000","last_undegraded":"2024-05-08T18:30:05.793157+0000","last_fullsized":"2024-05-08T18:30:05.793157+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:19:58.182291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":22,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.734128+0000","last_change":"2024-05-08T18:29:50.688742+0000","last_active":"2024-05-08T18:30:04.734128+0000","last_peered":"2024-05-08T18:30:04.734128+0000","last_clean":"2024-05-08T18:30:04.734128+0000","last_became_active":"2024-05-08T18:29:50.687135+0000","last_became_peered":"2024-05-08T18:29:50.687135+0000","last_unstale":"2024-05-08T18:30:04.734128+0000","last_undegraded":"2024-05-08T18:30:04.734128+0000","last_fullsized":"2024-05-08T18:30:04.734128+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:12:49.040807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.730919+0000","last_change":"2024-05-08T18:29:42.576864+0000","last_active":"2024-05-08T18:30:04.730919+0000","last_peered":"2024-05-08T18:30:04.730919+0000","last_clean":"2024-05-08T18:30:04.730919+0000","last_became_active":"2024-05-08T18:29:42.576392+0000","last_became_peered":"2024-05-08T18:29:42.576392+0000","last_unstale":"2024-05-08T18:30:04.730919+0000","last_undegraded":"2024-05-08T18:30:04.730919+0000","last_fullsized":"2024-05-08T18:30:04.730919+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:23.397435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.732422+0000","last_change":"2024-05-08T18:29:40.565872+0000","last_active":"2024-05-08T18:30:04.732422+0000","last_peered":"2024-05-08T18:30:04.732422+0000","last_clean":"2024-05-08T18:30:04.732422+0000","last_became_active":"2024-05-08T18:29:40.565655+0000","last_became_peered":"2024-05-08T18:29:40.565655+0000","last_unstale":"2024-05-08T18:30:04.732422+0000","last_undegraded":"2024-05-08T18:30:04.732422+0000","last_fullsized":"2024-05-08T18:30:04.732422+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:16:16.521258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":48,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.243285+0000","last_change":"2024-05-08T18:29:34.501273+0000","last_active":"2024-05-08T18:30:05.243285+0000","last_peered":"2024-05-08T18:30:05.243285+0000","last_clean":"2024-05-08T18:30:05.243285+0000","last_became_active":"2024-05-08T18:29:34.500933+0000","last_became_peered":"2024-05-08T18:29:34.500933+0000","last_unstale":"2024-05-08T18:30:05.243285+0000","last_undegraded":"2024-05-08T18:30:05.243285+0000","last_fullsized":"2024-05-08T18:30:05.243285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:35.917391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.795508+0000","last_change":"2024-05-08T18:29:44.576227+0000","last_active":"2024-05-08T18:30:05.795508+0000","last_peered":"2024-05-08T18:30:05.795508+0000","last_clean":"2024-05-08T18:30:05.795508+0000","last_became_active":"2024-05-08T18:29:44.575454+0000","last_became_peered":"2024-05-08T18:29:44.575454+0000","last_unstale":"2024-05-08T18:30:05.795508+0000","last_undegraded":"2024-05-08T18:30:05.795508+0000","last_fullsized":"2024-05-08T18:30:05.795508+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:06:05.355648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"33'10","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.797096+0000","last_change":"2024-05-08T18:29:46.609633+0000","last_active":"2024-05-08T18:30:05.797096+0000","last_peered":"2024-05-08T18:30:05.797096+0000","last_clean":"2024-05-08T18:30:05.797096+0000","last_became_active":"2024-05-08T18:29:46.603455+0000","last_became_peered":"2024-05-08T18:29:46.603455+0000","last_unstale":"2024-05-08T18:30:05.797096+0000","last_undegraded":"2024-05-08T18:30:05.797096+0000","last_fullsized":"2024-05-08T18:30:05.797096+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:07:54.654205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"30'2","reported_seq":32,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.732603+0000","last_change":"2024-05-08T18:29:48.637898+0000","last_active":"2024-05-08T18:30:04.732603+0000","last_peered":"2024-05-08T18:30:04.732603+0000","last_clean":"2024-05-08T18:30:04.732603+0000","last_became_active":"2024-05-08T18:29:48.637070+0000","last_became_peered":"2024-05-08T18:29:48.637070+0000","last_unstale":"2024-05-08T18:30:04.732603+0000","last_undegraded":"2024-05-08T18:30:04.732603+0000","last_fullsized":"2024-05-08T18:30:04.732603+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:03:46.392864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.122989+0000","last_change":"2024-05-08T18:29:50.691526+0000","last_active":"2024-05-08T18:30:04.122989+0000","last_peered":"2024-05-08T18:30:04.122989+0000","last_clean":"2024-05-08T18:30:04.122989+0000","last_became_active":"2024-05-08T18:29:50.690767+0000","last_became_peered":"2024-05-08T18:29:50.690767+0000","last_unstale":"2024-05-08T18:30:04.122989+0000","last_undegraded":"2024-05-08T18:30:04.122989+0000","last_fullsized":"2024-05-08T18:30:04.122989+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:32:29.972139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.795769+0000","last_change":"2024-05-08T18:29:42.562006+0000","last_active":"2024-05-08T18:30:05.795769+0000","last_peered":"2024-05-08T18:30:05.795769+0000","last_clean":"2024-05-08T18:30:05.795769+0000","last_became_active":"2024-05-08T18:29:42.560861+0000","last_became_peered":"2024-05-08T18:29:42.560861+0000","last_unstale":"2024-05-08T18:30:05.795769+0000","last_undegraded":"2024-05-08T18:30:05.795769+0000","last_fullsized":"2024-05-08T18:30:05.795769+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:36.890277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.123968+0000","last_change":"2024-05-08T18:29:40.550529+0000","last_active":"2024-05-08T18:30:04.123968+0000","last_peered":"2024-05-08T18:30:04.123968+0000","last_clean":"2024-05-08T18:30:04.123968+0000","last_became_active":"2024-05-08T18:29:40.550241+0000","last_became_peered":"2024-05-08T18:29:40.550241+0000","last_unstale":"2024-05-08T18:30:04.123968+0000","last_undegraded":"2024-05-08T18:30:04.123968+0000","last_fullsized":"2024-05-08T18:30:04.123968+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:48.294532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":50,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.741918+0000","last_change":"2024-05-08T18:29:34.493537+0000","last_active":"2024-05-08T18:30:05.741918+0000","last_peered":"2024-05-08T18:30:05.741918+0000","last_clean":"2024-05-08T18:30:05.741918+0000","last_became_active":"2024-05-08T18:29:34.492891+0000","last_became_peered":"2024-05-08T18:29:34.492891+0000","last_unstale":"2024-05-08T18:30:05.741918+0000","last_undegraded":"2024-05-08T18:30:05.741918+0000","last_fullsized":"2024-05-08T18:30:05.741918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:09:07.992256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.730780+0000","last_change":"2024-05-08T18:29:44.590102+0000","last_active":"2024-05-08T18:30:04.730780+0000","last_peered":"2024-05-08T18:30:04.730780+0000","last_clean":"2024-05-08T18:30:04.730780+0000","last_became_active":"2024-05-08T18:29:44.589471+0000","last_became_peered":"2024-05-08T18:29:44.589471+0000","last_unstale":"2024-05-08T18:30:04.730780+0000","last_undegraded":"2024-05-08T18:30:04.730780+0000","last_fullsized":"2024-05-08T18:30:04.730780+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:14:04.085401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"33'19","reported_seq":68,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.797549+0000","last_change":"2024-05-08T18:29:46.606967+0000","last_active":"2024-05-08T18:30:05.797549+0000","last_peered":"2024-05-08T18:30:05.797549+0000","last_clean":"2024-05-08T18:30:05.797549+0000","last_became_active":"2024-05-08T18:29:46.605693+0000","last_became_peered":"2024-05-08T18:29:46.605693+0000","last_unstale":"2024-05-08T18:30:05.797549+0000","last_undegraded":"2024-05-08T18:30:05.797549+0000","last_fullsized":"2024-05-08T18:30:05.797549+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:24:13.568294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":26,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.730695+0000","last_change":"2024-05-08T18:29:48.634271+0000","last_active":"2024-05-08T18:30:04.730695+0000","last_peered":"2024-05-08T18:30:04.730695+0000","last_clean":"2024-05-08T18:30:04.730695+0000","last_became_active":"2024-05-08T18:29:48.633607+0000","last_became_peered":"2024-05-08T18:29:48.633607+0000","last_unstale":"2024-05-08T18:30:04.730695+0000","last_undegraded":"2024-05-08T18:30:04.730695+0000","last_fullsized":"2024-05-08T18:30:04.730695+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:34.806539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.793825+0000","last_change":"2024-05-08T18:29:50.685494+0000","last_active":"2024-05-08T18:30:05.793825+0000","last_peered":"2024-05-08T18:30:05.793825+0000","last_clean":"2024-05-08T18:30:05.793825+0000","last_became_active":"2024-05-08T18:29:50.684818+0000","last_became_peered":"2024-05-08T18:29:50.684818+0000","last_unstale":"2024-05-08T18:30:05.793825+0000","last_undegraded":"2024-05-08T18:30:05.793825+0000","last_fullsized":"2024-05-08T18:30:05.793825+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:22.220842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.123213+0000","last_change":"2024-05-08T18:29:50.682937+0000","last_active":"2024-05-08T18:30:04.123213+0000","last_peered":"2024-05-08T18:30:04.123213+0000","last_clean":"2024-05-08T18:30:04.123213+0000","last_became_active":"2024-05-08T18:29:50.681771+0000","last_became_peered":"2024-05-08T18:29:50.681771+0000","last_unstale":"2024-05-08T18:30:04.123213+0000","last_undegraded":"2024-05-08T18:30:04.123213+0000","last_fullsized":"2024-05-08T18:30:04.123213+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:28:29.836446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.797115+0000","last_change":"2024-05-08T18:29:42.575909+0000","last_active":"2024-05-08T18:30:05.797115+0000","last_peered":"2024-05-08T18:30:05.797115+0000","last_clean":"2024-05-08T18:30:05.797115+0000","last_became_active":"2024-05-08T18:29:42.574877+0000","last_became_peered":"2024-05-08T18:29:42.574877+0000","last_unstale":"2024-05-08T18:30:05.797115+0000","last_undegraded":"2024-05-08T18:30:05.797115+0000","last_fullsized":"2024-05-08T18:30:05.797115+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:33.139089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.797027+0000","last_change":"2024-05-08T18:29:40.566496+0000","last_active":"2024-05-08T18:30:05.797027+0000","last_peered":"2024-05-08T18:30:05.797027+0000","last_clean":"2024-05-08T18:30:05.797027+0000","last_became_active":"2024-05-08T18:29:40.565874+0000","last_became_peered":"2024-05-08T18:29:40.565874+0000","last_unstale":"2024-05-08T18:30:05.797027+0000","last_undegraded":"2024-05-08T18:30:05.797027+0000","last_fullsized":"2024-05-08T18:30:05.797027+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:07.239963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.243370+0000","last_change":"2024-05-08T18:29:44.595410+0000","last_active":"2024-05-08T18:30:05.243370+0000","last_peered":"2024-05-08T18:30:05.243370+0000","last_clean":"2024-05-08T18:30:05.243370+0000","last_became_active":"2024-05-08T18:29:44.594286+0000","last_became_peered":"2024-05-08T18:29:44.594286+0000","last_unstale":"2024-05-08T18:30:05.243370+0000","last_undegraded":"2024-05-08T18:30:05.243370+0000","last_fullsized":"2024-05-08T18:30:05.243370+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:38.928160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"33'11","reported_seq":49,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.731558+0000","last_change":"2024-05-08T18:29:46.591009+0000","last_active":"2024-05-08T18:30:04.731558+0000","last_peered":"2024-05-08T18:30:04.731558+0000","last_clean":"2024-05-08T18:30:04.731558+0000","last_became_active":"2024-05-08T18:29:46.588810+0000","last_became_peered":"2024-05-08T18:29:46.588810+0000","last_unstale":"2024-05-08T18:30:04.731558+0000","last_undegraded":"2024-05-08T18:30:04.731558+0000","last_fullsized":"2024-05-08T18:30:04.731558+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:34:45.745300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":26,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.730646+0000","last_change":"2024-05-08T18:29:48.634986+0000","last_active":"2024-05-08T18:30:04.730646+0000","last_peered":"2024-05-08T18:30:04.730646+0000","last_clean":"2024-05-08T18:30:04.730646+0000","last_became_active":"2024-05-08T18:29:48.633866+0000","last_became_peered":"2024-05-08T18:29:48.633866+0000","last_unstale":"2024-05-08T18:30:04.730646+0000","last_undegraded":"2024-05-08T18:30:04.730646+0000","last_fullsized":"2024-05-08T18:30:04.730646+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:46.539830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":22,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.733108+0000","last_change":"2024-05-08T18:29:50.693408+0000","last_active":"2024-05-08T18:30:04.733108+0000","last_peered":"2024-05-08T18:30:04.733108+0000","last_clean":"2024-05-08T18:30:04.733108+0000","last_became_active":"2024-05-08T18:29:50.692687+0000","last_became_peered":"2024-05-08T18:29:50.692687+0000","last_unstale":"2024-05-08T18:30:04.733108+0000","last_undegraded":"2024-05-08T18:30:04.733108+0000","last_fullsized":"2024-05-08T18:30:04.733108+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:22.834262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.242547+0000","last_change":"2024-05-08T18:29:42.581368+0000","last_active":"2024-05-08T18:30:05.242547+0000","last_peered":"2024-05-08T18:30:05.242547+0000","last_clean":"2024-05-08T18:30:05.242547+0000","last_became_active":"2024-05-08T18:29:42.580887+0000","last_became_peered":"2024-05-08T18:29:42.580887+0000","last_unstale":"2024-05-08T18:30:05.242547+0000","last_undegraded":"2024-05-08T18:30:05.242547+0000","last_fullsized":"2024-05-08T18:30:05.242547+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:08:15.026467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.800348+0000","last_change":"2024-05-08T18:29:40.572770+0000","last_active":"2024-05-08T18:30:05.800348+0000","last_peered":"2024-05-08T18:30:05.800348+0000","last_clean":"2024-05-08T18:30:05.800348+0000","last_became_active":"2024-05-08T18:29:40.572079+0000","last_became_peered":"2024-05-08T18:29:40.572079+0000","last_unstale":"2024-05-08T18:30:05.800348+0000","last_undegraded":"2024-05-08T18:30:05.800348+0000","last_fullsized":"2024-05-08T18:30:05.800348+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:05.929806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.731916+0000","last_change":"2024-05-08T18:29:44.581323+0000","last_active":"2024-05-08T18:30:04.731916+0000","last_peered":"2024-05-08T18:30:04.731916+0000","last_clean":"2024-05-08T18:30:04.731916+0000","last_became_active":"2024-05-08T18:29:44.580805+0000","last_became_peered":"2024-05-08T18:29:44.580805+0000","last_unstale":"2024-05-08T18:30:04.731916+0000","last_undegraded":"2024-05-08T18:30:04.731916+0000","last_fullsized":"2024-05-08T18:30:04.731916+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:35:25.591140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'4","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.122152+0000","last_change":"2024-05-08T18:29:46.602495+0000","last_active":"2024-05-08T18:30:04.122152+0000","last_peered":"2024-05-08T18:30:04.122152+0000","last_clean":"2024-05-08T18:30:04.122152+0000","last_became_active":"2024-05-08T18:29:46.599789+0000","last_became_peered":"2024-05-08T18:29:46.599789+0000","last_unstale":"2024-05-08T18:30:04.122152+0000","last_undegraded":"2024-05-08T18:30:04.122152+0000","last_fullsized":"2024-05-08T18:30:04.122152+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:18:16.375808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":28,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.796777+0000","last_change":"2024-05-08T18:29:48.642994+0000","last_active":"2024-05-08T18:30:05.796777+0000","last_peered":"2024-05-08T18:30:05.796777+0000","last_clean":"2024-05-08T18:30:05.796777+0000","last_became_active":"2024-05-08T18:29:48.642056+0000","last_became_peered":"2024-05-08T18:29:48.642056+0000","last_unstale":"2024-05-08T18:30:05.796777+0000","last_undegraded":"2024-05-08T18:30:05.796777+0000","last_fullsized":"2024-05-08T18:30:05.796777+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:47:54.034851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.122328+0000","last_change":"2024-05-08T18:29:50.672513+0000","last_active":"2024-05-08T18:30:04.122328+0000","last_peered":"2024-05-08T18:30:04.122328+0000","last_clean":"2024-05-08T18:30:04.122328+0000","last_became_active":"2024-05-08T18:29:50.671781+0000","last_became_peered":"2024-05-08T18:29:50.671781+0000","last_unstale":"2024-05-08T18:30:04.122328+0000","last_undegraded":"2024-05-08T18:30:04.122328+0000","last_fullsized":"2024-05-08T18:30:04.122328+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:45:34.171402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.731925+0000","last_change":"2024-05-08T18:29:42.576843+0000","last_active":"2024-05-08T18:30:04.731925+0000","last_peered":"2024-05-08T18:30:04.731925+0000","last_clean":"2024-05-08T18:30:04.731925+0000","last_became_active":"2024-05-08T18:29:42.576379+0000","last_became_peered":"2024-05-08T18:29:42.576379+0000","last_unstale":"2024-05-08T18:30:04.731925+0000","last_undegraded":"2024-05-08T18:30:04.731925+0000","last_fullsized":"2024-05-08T18:30:04.731925+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:20.471010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.799155+0000","last_change":"2024-05-08T18:29:40.542997+0000","last_active":"2024-05-08T18:30:05.799155+0000","last_peered":"2024-05-08T18:30:05.799155+0000","last_clean":"2024-05-08T18:30:05.799155+0000","last_became_active":"2024-05-08T18:29:40.542239+0000","last_became_peered":"2024-05-08T18:29:40.542239+0000","last_unstale":"2024-05-08T18:30:05.799155+0000","last_undegraded":"2024-05-08T18:30:05.799155+0000","last_fullsized":"2024-05-08T18:30:05.799155+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:14:43.555504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.794372+0000","last_change":"2024-05-08T18:29:44.594178+0000","last_active":"2024-05-08T18:30:05.794372+0000","last_peered":"2024-05-08T18:30:05.794372+0000","last_clean":"2024-05-08T18:30:05.794372+0000","last_became_active":"2024-05-08T18:29:44.592476+0000","last_became_peered":"2024-05-08T18:29:44.592476+0000","last_unstale":"2024-05-08T18:30:05.794372+0000","last_undegraded":"2024-05-08T18:30:05.794372+0000","last_fullsized":"2024-05-08T18:30:05.794372+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:04:16.093662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"33'11","reported_seq":49,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.731706+0000","last_change":"2024-05-08T18:29:46.597288+0000","last_active":"2024-05-08T18:30:04.731706+0000","last_peered":"2024-05-08T18:30:04.731706+0000","last_clean":"2024-05-08T18:30:04.731706+0000","last_became_active":"2024-05-08T18:29:46.596452+0000","last_became_peered":"2024-05-08T18:29:46.596452+0000","last_unstale":"2024-05-08T18:30:04.731706+0000","last_undegraded":"2024-05-08T18:30:04.731706+0000","last_fullsized":"2024-05-08T18:30:04.731706+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:32:43.245753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":28,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.740238+0000","last_change":"2024-05-08T18:29:48.635436+0000","last_active":"2024-05-08T18:30:05.740238+0000","last_peered":"2024-05-08T18:30:05.740238+0000","last_clean":"2024-05-08T18:30:05.740238+0000","last_became_active":"2024-05-08T18:29:48.634704+0000","last_became_peered":"2024-05-08T18:29:48.634704+0000","last_unstale":"2024-05-08T18:30:05.740238+0000","last_undegraded":"2024-05-08T18:30:05.740238+0000","last_fullsized":"2024-05-08T18:30:05.740238+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:55:52.238481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.793929+0000","last_change":"2024-05-08T18:29:50.687974+0000","last_active":"2024-05-08T18:30:05.793929+0000","last_peered":"2024-05-08T18:30:05.793929+0000","last_clean":"2024-05-08T18:30:05.793929+0000","last_became_active":"2024-05-08T18:29:50.687045+0000","last_became_peered":"2024-05-08T18:29:50.687045+0000","last_unstale":"2024-05-08T18:30:05.793929+0000","last_undegraded":"2024-05-08T18:30:05.793929+0000","last_fullsized":"2024-05-08T18:30:05.793929+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:55:01.894779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.731060+0000","last_change":"2024-05-08T18:29:42.563779+0000","last_active":"2024-05-08T18:30:04.731060+0000","last_peered":"2024-05-08T18:30:04.731060+0000","last_clean":"2024-05-08T18:30:04.731060+0000","last_became_active":"2024-05-08T18:29:42.562522+0000","last_became_peered":"2024-05-08T18:29:42.562522+0000","last_unstale":"2024-05-08T18:30:04.731060+0000","last_undegraded":"2024-05-08T18:30:04.731060+0000","last_fullsized":"2024-05-08T18:30:04.731060+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:35:23.016110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.124436+0000","last_change":"2024-05-08T18:29:40.541112+0000","last_active":"2024-05-08T18:30:04.124436+0000","last_peered":"2024-05-08T18:30:04.124436+0000","last_clean":"2024-05-08T18:30:04.124436+0000","last_became_active":"2024-05-08T18:29:40.540835+0000","last_became_peered":"2024-05-08T18:29:40.540835+0000","last_unstale":"2024-05-08T18:30:04.124436+0000","last_undegraded":"2024-05-08T18:30:04.124436+0000","last_fullsized":"2024-05-08T18:30:04.124436+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:43:14.995191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.740008+0000","last_change":"2024-05-08T18:29:44.592033+0000","last_active":"2024-05-08T18:30:05.740008+0000","last_peered":"2024-05-08T18:30:05.740008+0000","last_clean":"2024-05-08T18:30:05.740008+0000","last_became_active":"2024-05-08T18:29:44.590454+0000","last_became_peered":"2024-05-08T18:29:44.590454+0000","last_unstale":"2024-05-08T18:30:05.740008+0000","last_undegraded":"2024-05-08T18:30:05.740008+0000","last_fullsized":"2024-05-08T18:30:05.740008+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:11:03.740365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"33'9","reported_seq":48,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.797015+0000","last_change":"2024-05-08T18:29:46.607002+0000","last_active":"2024-05-08T18:30:05.797015+0000","last_peered":"2024-05-08T18:30:05.797015+0000","last_clean":"2024-05-08T18:30:05.797015+0000","last_became_active":"2024-05-08T18:29:46.606172+0000","last_became_peered":"2024-05-08T18:29:46.606172+0000","last_unstale":"2024-05-08T18:30:05.797015+0000","last_undegraded":"2024-05-08T18:30:05.797015+0000","last_fullsized":"2024-05-08T18:30:05.797015+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:37:35.850414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.122473+0000","last_change":"2024-05-08T18:29:48.632948+0000","last_active":"2024-05-08T18:30:04.122473+0000","last_peered":"2024-05-08T18:30:04.122473+0000","last_clean":"2024-05-08T18:30:04.122473+0000","last_became_active":"2024-05-08T18:29:48.631219+0000","last_became_peered":"2024-05-08T18:29:48.631219+0000","last_unstale":"2024-05-08T18:30:04.122473+0000","last_undegraded":"2024-05-08T18:30:04.122473+0000","last_fullsized":"2024-05-08T18:30:04.122473+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:19:01.454355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.741838+0000","last_change":"2024-05-08T18:29:42.570180+0000","last_active":"2024-05-08T18:30:05.741838+0000","last_peered":"2024-05-08T18:30:05.741838+0000","last_clean":"2024-05-08T18:30:05.741838+0000","last_became_active":"2024-05-08T18:29:42.569425+0000","last_became_peered":"2024-05-08T18:29:42.569425+0000","last_unstale":"2024-05-08T18:30:05.741838+0000","last_undegraded":"2024-05-08T18:30:05.741838+0000","last_fullsized":"2024-05-08T18:30:05.741838+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:35.037465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.731234+0000","last_change":"2024-05-08T18:29:40.547711+0000","last_active":"2024-05-08T18:30:04.731234+0000","last_peered":"2024-05-08T18:30:04.731234+0000","last_clean":"2024-05-08T18:30:04.731234+0000","last_became_active":"2024-05-08T18:29:40.547479+0000","last_became_peered":"2024-05-08T18:29:40.547479+0000","last_unstale":"2024-05-08T18:30:04.731234+0000","last_undegraded":"2024-05-08T18:30:04.731234+0000","last_fullsized":"2024-05-08T18:30:04.731234+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:12:40.901620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":32,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.122916+0000","last_change":"2024-05-08T18:29:44.591547+0000","last_active":"2024-05-08T18:30:04.122916+0000","last_peered":"2024-05-08T18:30:04.122916+0000","last_clean":"2024-05-08T18:30:04.122916+0000","last_became_active":"2024-05-08T18:29:44.590498+0000","last_became_peered":"2024-05-08T18:29:44.590498+0000","last_unstale":"2024-05-08T18:30:04.122916+0000","last_undegraded":"2024-05-08T18:30:04.122916+0000","last_fullsized":"2024-05-08T18:30:04.122916+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:14:04.085401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"33'12","reported_seq":53,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.242629+0000","last_change":"2024-05-08T18:29:46.600437+0000","last_active":"2024-05-08T18:30:05.242629+0000","last_peered":"2024-05-08T18:30:05.242629+0000","last_clean":"2024-05-08T18:30:05.242629+0000","last_became_active":"2024-05-08T18:29:46.594672+0000","last_became_peered":"2024-05-08T18:29:46.594672+0000","last_unstale":"2024-05-08T18:30:05.242629+0000","last_undegraded":"2024-05-08T18:30:05.242629+0000","last_fullsized":"2024-05-08T18:30:05.242629+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:35:53.294312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":28,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.794222+0000","last_change":"2024-05-08T18:29:48.639840+0000","last_active":"2024-05-08T18:30:05.794222+0000","last_peered":"2024-05-08T18:30:05.794222+0000","last_clean":"2024-05-08T18:30:05.794222+0000","last_became_active":"2024-05-08T18:29:48.639120+0000","last_became_peered":"2024-05-08T18:29:48.639120+0000","last_unstale":"2024-05-08T18:30:05.794222+0000","last_undegraded":"2024-05-08T18:30:05.794222+0000","last_fullsized":"2024-05-08T18:30:05.794222+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:13:50.865474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":22,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.731425+0000","last_change":"2024-05-08T18:29:50.684843+0000","last_active":"2024-05-08T18:30:04.731425+0000","last_peered":"2024-05-08T18:30:04.731425+0000","last_clean":"2024-05-08T18:30:04.731425+0000","last_became_active":"2024-05-08T18:29:50.684119+0000","last_became_peered":"2024-05-08T18:29:50.684119+0000","last_unstale":"2024-05-08T18:30:04.731425+0000","last_undegraded":"2024-05-08T18:30:04.731425+0000","last_fullsized":"2024-05-08T18:30:04.731425+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:09:29.641515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.123508+0000","last_change":"2024-05-08T18:29:42.575763+0000","last_active":"2024-05-08T18:30:04.123508+0000","last_peered":"2024-05-08T18:30:04.123508+0000","last_clean":"2024-05-08T18:30:04.123508+0000","last_became_active":"2024-05-08T18:29:42.575450+0000","last_became_peered":"2024-05-08T18:29:42.575450+0000","last_unstale":"2024-05-08T18:30:04.123508+0000","last_undegraded":"2024-05-08T18:30:04.123508+0000","last_fullsized":"2024-05-08T18:30:04.123508+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:20.471010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.243714+0000","last_change":"2024-05-08T18:29:40.546101+0000","last_active":"2024-05-08T18:30:05.243714+0000","last_peered":"2024-05-08T18:30:05.243714+0000","last_clean":"2024-05-08T18:30:05.243714+0000","last_became_active":"2024-05-08T18:29:40.545814+0000","last_became_peered":"2024-05-08T18:29:40.545814+0000","last_unstale":"2024-05-08T18:30:05.243714+0000","last_undegraded":"2024-05-08T18:30:05.243714+0000","last_fullsized":"2024-05-08T18:30:05.243714+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:22.579629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.741645+0000","last_change":"2024-05-08T18:29:44.591310+0000","last_active":"2024-05-08T18:30:05.741645+0000","last_peered":"2024-05-08T18:30:05.741645+0000","last_clean":"2024-05-08T18:30:05.741645+0000","last_became_active":"2024-05-08T18:29:44.590394+0000","last_became_peered":"2024-05-08T18:29:44.590394+0000","last_unstale":"2024-05-08T18:30:05.741645+0000","last_undegraded":"2024-05-08T18:30:05.741645+0000","last_fullsized":"2024-05-08T18:30:05.741645+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:02:28.348982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"33'15","reported_seq":57,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.797869+0000","last_change":"2024-05-08T18:29:46.605887+0000","last_active":"2024-05-08T18:30:05.797869+0000","last_peered":"2024-05-08T18:30:05.797869+0000","last_clean":"2024-05-08T18:30:05.797869+0000","last_became_active":"2024-05-08T18:29:46.604917+0000","last_became_peered":"2024-05-08T18:29:46.604917+0000","last_unstale":"2024-05-08T18:30:05.797869+0000","last_undegraded":"2024-05-08T18:30:05.797869+0000","last_fullsized":"2024-05-08T18:30:05.797869+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:22:36.338527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":26,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.243226+0000","last_change":"2024-05-08T18:29:48.644420+0000","last_active":"2024-05-08T18:30:05.243226+0000","last_peered":"2024-05-08T18:30:05.243226+0000","last_clean":"2024-05-08T18:30:05.243226+0000","last_became_active":"2024-05-08T18:29:48.643493+0000","last_became_peered":"2024-05-08T18:29:48.643493+0000","last_unstale":"2024-05-08T18:30:05.243226+0000","last_undegraded":"2024-05-08T18:30:05.243226+0000","last_fullsized":"2024-05-08T18:30:05.243226+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:19:33.148012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.739976+0000","last_change":"2024-05-08T18:29:50.687485+0000","last_active":"2024-05-08T18:30:05.739976+0000","last_peered":"2024-05-08T18:30:05.739976+0000","last_clean":"2024-05-08T18:30:05.739976+0000","last_became_active":"2024-05-08T18:29:50.686750+0000","last_became_peered":"2024-05-08T18:29:50.686750+0000","last_unstale":"2024-05-08T18:30:05.739976+0000","last_undegraded":"2024-05-08T18:30:05.739976+0000","last_fullsized":"2024-05-08T18:30:05.739976+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:41.914164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.732706+0000","last_change":"2024-05-08T18:29:42.566571+0000","last_active":"2024-05-08T18:30:04.732706+0000","last_peered":"2024-05-08T18:30:04.732706+0000","last_clean":"2024-05-08T18:30:04.732706+0000","last_became_active":"2024-05-08T18:29:42.563695+0000","last_became_peered":"2024-05-08T18:29:42.563695+0000","last_unstale":"2024-05-08T18:30:04.732706+0000","last_undegraded":"2024-05-08T18:30:04.732706+0000","last_fullsized":"2024-05-08T18:30:04.732706+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:46.887628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.798037+0000","last_change":"2024-05-08T18:29:40.545512+0000","last_active":"2024-05-08T18:30:05.798037+0000","last_peered":"2024-05-08T18:30:05.798037+0000","last_clean":"2024-05-08T18:30:05.798037+0000","last_became_active":"2024-05-08T18:29:40.544216+0000","last_became_peered":"2024-05-08T18:29:40.544216+0000","last_unstale":"2024-05-08T18:30:05.798037+0000","last_undegraded":"2024-05-08T18:30:05.798037+0000","last_fullsized":"2024-05-08T18:30:05.798037+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:37:08.242362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.798955+0000","last_change":"2024-05-08T18:29:44.576107+0000","last_active":"2024-05-08T18:30:05.798955+0000","last_peered":"2024-05-08T18:30:05.798955+0000","last_clean":"2024-05-08T18:30:05.798955+0000","last_became_active":"2024-05-08T18:29:44.575344+0000","last_became_peered":"2024-05-08T18:29:44.575344+0000","last_unstale":"2024-05-08T18:30:05.798955+0000","last_undegraded":"2024-05-08T18:30:05.798955+0000","last_fullsized":"2024-05-08T18:30:05.798955+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:19.731003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"33'11","reported_seq":49,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.734275+0000","last_change":"2024-05-08T18:29:46.584785+0000","last_active":"2024-05-08T18:30:04.734275+0000","last_peered":"2024-05-08T18:30:04.734275+0000","last_clean":"2024-05-08T18:30:04.734275+0000","last_became_active":"2024-05-08T18:29:46.583390+0000","last_became_peered":"2024-05-08T18:29:46.583390+0000","last_unstale":"2024-05-08T18:30:04.734275+0000","last_undegraded":"2024-05-08T18:30:04.734275+0000","last_fullsized":"2024-05-08T18:30:04.734275+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:27:01.747339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":26,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.242578+0000","last_change":"2024-05-08T18:29:48.643558+0000","last_active":"2024-05-08T18:30:05.242578+0000","last_peered":"2024-05-08T18:30:05.242578+0000","last_clean":"2024-05-08T18:30:05.242578+0000","last_became_active":"2024-05-08T18:29:48.642773+0000","last_became_peered":"2024-05-08T18:29:48.642773+0000","last_unstale":"2024-05-08T18:30:05.242578+0000","last_undegraded":"2024-05-08T18:30:05.242578+0000","last_fullsized":"2024-05-08T18:30:05.242578+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:59:04.369806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.793389+0000","last_change":"2024-05-08T18:29:50.674796+0000","last_active":"2024-05-08T18:30:05.793389+0000","last_peered":"2024-05-08T18:30:05.793389+0000","last_clean":"2024-05-08T18:30:05.793389+0000","last_became_active":"2024-05-08T18:29:50.674057+0000","last_became_peered":"2024-05-08T18:29:50.674057+0000","last_unstale":"2024-05-08T18:30:05.793389+0000","last_undegraded":"2024-05-08T18:30:05.793389+0000","last_fullsized":"2024-05-08T18:30:05.793389+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:34:14.488295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.732871+0000","last_change":"2024-05-08T18:29:42.577642+0000","last_active":"2024-05-08T18:30:04.732871+0000","last_peered":"2024-05-08T18:30:04.732871+0000","last_clean":"2024-05-08T18:30:04.732871+0000","last_became_active":"2024-05-08T18:29:42.577275+0000","last_became_peered":"2024-05-08T18:29:42.577275+0000","last_unstale":"2024-05-08T18:30:04.732871+0000","last_undegraded":"2024-05-08T18:30:04.732871+0000","last_fullsized":"2024-05-08T18:30:04.732871+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:51:45.155037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.123055+0000","last_change":"2024-05-08T18:29:40.562873+0000","last_active":"2024-05-08T18:30:04.123055+0000","last_peered":"2024-05-08T18:30:04.123055+0000","last_clean":"2024-05-08T18:30:04.123055+0000","last_became_active":"2024-05-08T18:29:40.562594+0000","last_became_peered":"2024-05-08T18:29:40.562594+0000","last_unstale":"2024-05-08T18:30:04.123055+0000","last_undegraded":"2024-05-08T18:30:04.123055+0000","last_fullsized":"2024-05-08T18:30:04.123055+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:16:16.521258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.243664+0000","last_change":"2024-05-08T18:29:44.594152+0000","last_active":"2024-05-08T18:30:05.243664+0000","last_peered":"2024-05-08T18:30:05.243664+0000","last_clean":"2024-05-08T18:30:05.243664+0000","last_became_active":"2024-05-08T18:29:44.593398+0000","last_became_peered":"2024-05-08T18:29:44.593398+0000","last_unstale":"2024-05-08T18:30:05.243664+0000","last_undegraded":"2024-05-08T18:30:05.243664+0000","last_fullsized":"2024-05-08T18:30:05.243664+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:11.825480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"33'10","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.798464+0000","last_change":"2024-05-08T18:29:46.602137+0000","last_active":"2024-05-08T18:30:05.798464+0000","last_peered":"2024-05-08T18:30:05.798464+0000","last_clean":"2024-05-08T18:30:05.798464+0000","last_became_active":"2024-05-08T18:29:46.601402+0000","last_became_peered":"2024-05-08T18:29:46.601402+0000","last_unstale":"2024-05-08T18:30:05.798464+0000","last_undegraded":"2024-05-08T18:30:05.798464+0000","last_fullsized":"2024-05-08T18:30:05.798464+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:23.940519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"30'2","reported_seq":34,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.741407+0000","last_change":"2024-05-08T18:29:48.635696+0000","last_active":"2024-05-08T18:30:05.741407+0000","last_peered":"2024-05-08T18:30:05.741407+0000","last_clean":"2024-05-08T18:30:05.741407+0000","last_became_active":"2024-05-08T18:29:48.634859+0000","last_became_peered":"2024-05-08T18:29:48.634859+0000","last_unstale":"2024-05-08T18:30:05.741407+0000","last_undegraded":"2024-05-08T18:30:05.741407+0000","last_fullsized":"2024-05-08T18:30:05.741407+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:35:55.322495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.794101+0000","last_change":"2024-05-08T18:29:50.679757+0000","last_active":"2024-05-08T18:30:05.794101+0000","last_peered":"2024-05-08T18:30:05.794101+0000","last_clean":"2024-05-08T18:30:05.794101+0000","last_became_active":"2024-05-08T18:29:50.679011+0000","last_became_peered":"2024-05-08T18:29:50.679011+0000","last_unstale":"2024-05-08T18:30:05.794101+0000","last_undegraded":"2024-05-08T18:30:05.794101+0000","last_fullsized":"2024-05-08T18:30:05.794101+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:34:14.488295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.796876+0000","last_change":"2024-05-08T18:29:42.560354+0000","last_active":"2024-05-08T18:30:05.796876+0000","last_peered":"2024-05-08T18:30:05.796876+0000","last_clean":"2024-05-08T18:30:05.796876+0000","last_became_active":"2024-05-08T18:29:42.559647+0000","last_became_peered":"2024-05-08T18:29:42.559647+0000","last_unstale":"2024-05-08T18:30:05.796876+0000","last_undegraded":"2024-05-08T18:30:05.796876+0000","last_fullsized":"2024-05-08T18:30:05.796876+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:18:10.803989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.794664+0000","last_change":"2024-05-08T18:29:40.557683+0000","last_active":"2024-05-08T18:30:05.794664+0000","last_peered":"2024-05-08T18:30:05.794664+0000","last_clean":"2024-05-08T18:30:05.794664+0000","last_became_active":"2024-05-08T18:29:40.556254+0000","last_became_peered":"2024-05-08T18:29:40.556254+0000","last_unstale":"2024-05-08T18:30:05.794664+0000","last_undegraded":"2024-05-08T18:30:05.794664+0000","last_fullsized":"2024-05-08T18:30:05.794664+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:51:43.135322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.796528+0000","last_change":"2024-05-08T18:29:44.594068+0000","last_active":"2024-05-08T18:30:05.796528+0000","last_peered":"2024-05-08T18:30:05.796528+0000","last_clean":"2024-05-08T18:30:05.796528+0000","last_became_active":"2024-05-08T18:29:44.593322+0000","last_became_peered":"2024-05-08T18:29:44.593322+0000","last_unstale":"2024-05-08T18:30:05.796528+0000","last_undegraded":"2024-05-08T18:30:05.796528+0000","last_fullsized":"2024-05-08T18:30:05.796528+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:19.731003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"33'15","reported_seq":57,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.795047+0000","last_change":"2024-05-08T18:29:46.604700+0000","last_active":"2024-05-08T18:30:05.795047+0000","last_peered":"2024-05-08T18:30:05.795047+0000","last_clean":"2024-05-08T18:30:05.795047+0000","last_became_active":"2024-05-08T18:29:46.603885+0000","last_became_peered":"2024-05-08T18:29:46.603885+0000","last_unstale":"2024-05-08T18:30:05.795047+0000","last_undegraded":"2024-05-08T18:30:05.795047+0000","last_fullsized":"2024-05-08T18:30:05.795047+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:22:36.338527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.121926+0000","last_change":"2024-05-08T18:29:48.640814+0000","last_active":"2024-05-08T18:30:04.121926+0000","last_peered":"2024-05-08T18:30:04.121926+0000","last_clean":"2024-05-08T18:30:04.121926+0000","last_became_active":"2024-05-08T18:29:48.640046+0000","last_became_peered":"2024-05-08T18:29:48.640046+0000","last_unstale":"2024-05-08T18:30:04.121926+0000","last_undegraded":"2024-05-08T18:30:04.121926+0000","last_fullsized":"2024-05-08T18:30:04.121926+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:53:21.219706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.800999+0000","last_change":"2024-05-08T18:29:50.692688+0000","last_active":"2024-05-08T18:30:05.800999+0000","last_peered":"2024-05-08T18:30:05.800999+0000","last_clean":"2024-05-08T18:30:05.800999+0000","last_became_active":"2024-05-08T18:29:50.692123+0000","last_became_peered":"2024-05-08T18:29:50.692123+0000","last_unstale":"2024-05-08T18:30:05.800999+0000","last_undegraded":"2024-05-08T18:30:05.800999+0000","last_fullsized":"2024-05-08T18:30:05.800999+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:38.318890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.797342+0000","last_change":"2024-05-08T18:29:42.558336+0000","last_active":"2024-05-08T18:30:05.797342+0000","last_peered":"2024-05-08T18:30:05.797342+0000","last_clean":"2024-05-08T18:30:05.797342+0000","last_became_active":"2024-05-08T18:29:42.557570+0000","last_became_peered":"2024-05-08T18:29:42.557570+0000","last_unstale":"2024-05-08T18:30:05.797342+0000","last_undegraded":"2024-05-08T18:30:05.797342+0000","last_fullsized":"2024-05-08T18:30:05.797342+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:54:16.539832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.796493+0000","last_change":"2024-05-08T18:29:40.537090+0000","last_active":"2024-05-08T18:30:05.796493+0000","last_peered":"2024-05-08T18:30:05.796493+0000","last_clean":"2024-05-08T18:30:05.796493+0000","last_became_active":"2024-05-08T18:29:40.536188+0000","last_became_peered":"2024-05-08T18:29:40.536188+0000","last_unstale":"2024-05-08T18:30:05.796493+0000","last_undegraded":"2024-05-08T18:30:05.796493+0000","last_fullsized":"2024-05-08T18:30:05.796493+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:22:48.880581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.794281+0000","last_change":"2024-05-08T18:29:44.578901+0000","last_active":"2024-05-08T18:30:05.794281+0000","last_peered":"2024-05-08T18:30:05.794281+0000","last_clean":"2024-05-08T18:30:05.794281+0000","last_became_active":"2024-05-08T18:29:44.578171+0000","last_became_peered":"2024-05-08T18:29:44.578171+0000","last_unstale":"2024-05-08T18:30:05.794281+0000","last_undegraded":"2024-05-08T18:30:05.794281+0000","last_fullsized":"2024-05-08T18:30:05.794281+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:19.731003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"33'9","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.121981+0000","last_change":"2024-05-08T18:29:46.604539+0000","last_active":"2024-05-08T18:30:04.121981+0000","last_peered":"2024-05-08T18:30:04.121981+0000","last_clean":"2024-05-08T18:30:04.121981+0000","last_became_active":"2024-05-08T18:29:46.603728+0000","last_became_peered":"2024-05-08T18:29:46.603728+0000","last_unstale":"2024-05-08T18:30:04.121981+0000","last_undegraded":"2024-05-08T18:30:04.121981+0000","last_fullsized":"2024-05-08T18:30:04.121981+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:12:41.226788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":28,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.739746+0000","last_change":"2024-05-08T18:29:48.635813+0000","last_active":"2024-05-08T18:30:05.739746+0000","last_peered":"2024-05-08T18:30:05.739746+0000","last_clean":"2024-05-08T18:30:05.739746+0000","last_became_active":"2024-05-08T18:29:48.634664+0000","last_became_peered":"2024-05-08T18:29:48.634664+0000","last_unstale":"2024-05-08T18:30:05.739746+0000","last_undegraded":"2024-05-08T18:30:05.739746+0000","last_fullsized":"2024-05-08T18:30:05.739746+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:27:23.427365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":22,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.733344+0000","last_change":"2024-05-08T18:29:50.687517+0000","last_active":"2024-05-08T18:30:04.733344+0000","last_peered":"2024-05-08T18:30:04.733344+0000","last_clean":"2024-05-08T18:30:04.733344+0000","last_became_active":"2024-05-08T18:29:50.686662+0000","last_became_peered":"2024-05-08T18:29:50.686662+0000","last_unstale":"2024-05-08T18:30:04.733344+0000","last_undegraded":"2024-05-08T18:30:04.733344+0000","last_fullsized":"2024-05-08T18:30:04.733344+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:58:00.455559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.732068+0000","last_change":"2024-05-08T18:29:42.558848+0000","last_active":"2024-05-08T18:30:04.732068+0000","last_peered":"2024-05-08T18:30:04.732068+0000","last_clean":"2024-05-08T18:30:04.732068+0000","last_became_active":"2024-05-08T18:29:42.558390+0000","last_became_peered":"2024-05-08T18:29:42.558390+0000","last_unstale":"2024-05-08T18:30:04.732068+0000","last_undegraded":"2024-05-08T18:30:04.732068+0000","last_fullsized":"2024-05-08T18:30:04.732068+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:55:30.468069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.733713+0000","last_change":"2024-05-08T18:29:40.567772+0000","last_active":"2024-05-08T18:30:04.733713+0000","last_peered":"2024-05-08T18:30:04.733713+0000","last_clean":"2024-05-08T18:30:04.733713+0000","last_became_active":"2024-05-08T18:29:40.567482+0000","last_became_peered":"2024-05-08T18:29:40.567482+0000","last_unstale":"2024-05-08T18:30:04.733713+0000","last_undegraded":"2024-05-08T18:30:04.733713+0000","last_fullsized":"2024-05-08T18:30:04.733713+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:36:37.796095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.794911+0000","last_change":"2024-05-08T18:29:44.596876+0000","last_active":"2024-05-08T18:30:05.794911+0000","last_peered":"2024-05-08T18:30:05.794911+0000","last_clean":"2024-05-08T18:30:05.794911+0000","last_became_active":"2024-05-08T18:29:44.595712+0000","last_became_peered":"2024-05-08T18:29:44.595712+0000","last_unstale":"2024-05-08T18:30:05.794911+0000","last_undegraded":"2024-05-08T18:30:05.794911+0000","last_fullsized":"2024-05-08T18:30:05.794911+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:35:51.288126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"33'5","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.732551+0000","last_change":"2024-05-08T18:29:46.598637+0000","last_active":"2024-05-08T18:30:04.732551+0000","last_peered":"2024-05-08T18:30:04.732551+0000","last_clean":"2024-05-08T18:30:04.732551+0000","last_became_active":"2024-05-08T18:29:46.597394+0000","last_became_peered":"2024-05-08T18:29:46.597394+0000","last_unstale":"2024-05-08T18:30:04.732551+0000","last_undegraded":"2024-05-08T18:30:04.732551+0000","last_fullsized":"2024-05-08T18:30:04.732551+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:52:22.540814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":28,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.794946+0000","last_change":"2024-05-08T18:29:48.642251+0000","last_active":"2024-05-08T18:30:05.794946+0000","last_peered":"2024-05-08T18:30:05.794946+0000","last_clean":"2024-05-08T18:30:05.794946+0000","last_became_active":"2024-05-08T18:29:48.641666+0000","last_became_peered":"2024-05-08T18:29:48.641666+0000","last_unstale":"2024-05-08T18:30:05.794946+0000","last_undegraded":"2024-05-08T18:30:05.794946+0000","last_fullsized":"2024-05-08T18:30:05.794946+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:13:50.865474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.799512+0000","last_change":"2024-05-08T18:29:50.685668+0000","last_active":"2024-05-08T18:30:05.799512+0000","last_peered":"2024-05-08T18:30:05.799512+0000","last_clean":"2024-05-08T18:30:05.799512+0000","last_became_active":"2024-05-08T18:29:50.684958+0000","last_became_peered":"2024-05-08T18:29:50.684958+0000","last_unstale":"2024-05-08T18:30:05.799512+0000","last_undegraded":"2024-05-08T18:30:05.799512+0000","last_fullsized":"2024-05-08T18:30:05.799512+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:55:01.894779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.795528+0000","last_change":"2024-05-08T18:29:42.562063+0000","last_active":"2024-05-08T18:30:05.795528+0000","last_peered":"2024-05-08T18:30:05.795528+0000","last_clean":"2024-05-08T18:30:05.795528+0000","last_became_active":"2024-05-08T18:29:42.558871+0000","last_became_peered":"2024-05-08T18:29:42.558871+0000","last_unstale":"2024-05-08T18:30:05.795528+0000","last_undegraded":"2024-05-08T18:30:05.795528+0000","last_fullsized":"2024-05-08T18:30:05.795528+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:59.243324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.124357+0000","last_change":"2024-05-08T18:29:40.541070+0000","last_active":"2024-05-08T18:30:04.124357+0000","last_peered":"2024-05-08T18:30:04.124357+0000","last_clean":"2024-05-08T18:30:04.124357+0000","last_became_active":"2024-05-08T18:29:40.540767+0000","last_became_peered":"2024-05-08T18:29:40.540767+0000","last_unstale":"2024-05-08T18:30:04.124357+0000","last_undegraded":"2024-05-08T18:30:04.124357+0000","last_fullsized":"2024-05-08T18:30:04.124357+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:09:39.835826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"26'1","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.242236+0000","last_change":"2024-05-08T18:29:44.592737+0000","last_active":"2024-05-08T18:30:05.242236+0000","last_peered":"2024-05-08T18:30:05.242236+0000","last_clean":"2024-05-08T18:30:05.242236+0000","last_became_active":"2024-05-08T18:29:44.592243+0000","last_became_peered":"2024-05-08T18:29:44.592243+0000","last_unstale":"2024-05-08T18:30:05.242236+0000","last_undegraded":"2024-05-08T18:30:05.242236+0000","last_fullsized":"2024-05-08T18:30:05.242236+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:59.744050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"33'9","reported_seq":48,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.796411+0000","last_change":"2024-05-08T18:29:46.610835+0000","last_active":"2024-05-08T18:30:05.796411+0000","last_peered":"2024-05-08T18:30:05.796411+0000","last_clean":"2024-05-08T18:30:05.796411+0000","last_became_active":"2024-05-08T18:29:46.609903+0000","last_became_peered":"2024-05-08T18:29:46.609903+0000","last_unstale":"2024-05-08T18:30:05.796411+0000","last_undegraded":"2024-05-08T18:30:05.796411+0000","last_fullsized":"2024-05-08T18:30:05.796411+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:37:35.850414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.122381+0000","last_change":"2024-05-08T18:29:48.629822+0000","last_active":"2024-05-08T18:30:04.122381+0000","last_peered":"2024-05-08T18:30:04.122381+0000","last_clean":"2024-05-08T18:30:04.122381+0000","last_became_active":"2024-05-08T18:29:48.629204+0000","last_became_peered":"2024-05-08T18:29:48.629204+0000","last_unstale":"2024-05-08T18:30:04.122381+0000","last_undegraded":"2024-05-08T18:30:04.122381+0000","last_fullsized":"2024-05-08T18:30:04.122381+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:04.571608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.801593+0000","last_change":"2024-05-08T18:29:50.668101+0000","last_active":"2024-05-08T18:30:05.801593+0000","last_peered":"2024-05-08T18:30:05.801593+0000","last_clean":"2024-05-08T18:30:05.801593+0000","last_became_active":"2024-05-08T18:29:50.667357+0000","last_became_peered":"2024-05-08T18:29:50.667357+0000","last_unstale":"2024-05-08T18:30:05.801593+0000","last_undegraded":"2024-05-08T18:30:05.801593+0000","last_fullsized":"2024-05-08T18:30:05.801593+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:55:01.894779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.243340+0000","last_change":"2024-05-08T18:29:42.581366+0000","last_active":"2024-05-08T18:30:05.243340+0000","last_peered":"2024-05-08T18:30:05.243340+0000","last_clean":"2024-05-08T18:30:05.243340+0000","last_became_active":"2024-05-08T18:29:42.580988+0000","last_became_peered":"2024-05-08T18:29:42.580988+0000","last_unstale":"2024-05-08T18:30:05.243340+0000","last_undegraded":"2024-05-08T18:30:05.243340+0000","last_fullsized":"2024-05-08T18:30:05.243340+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:42.005809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.739675+0000","last_change":"2024-05-08T18:29:40.562025+0000","last_active":"2024-05-08T18:30:05.739675+0000","last_peered":"2024-05-08T18:30:05.739675+0000","last_clean":"2024-05-08T18:30:05.739675+0000","last_became_active":"2024-05-08T18:29:40.561277+0000","last_became_peered":"2024-05-08T18:29:40.561277+0000","last_unstale":"2024-05-08T18:30:05.739675+0000","last_undegraded":"2024-05-08T18:30:05.739675+0000","last_fullsized":"2024-05-08T18:30:05.739675+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:59:25.840149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.243028+0000","last_change":"2024-05-08T18:29:42.573832+0000","last_active":"2024-05-08T18:30:05.243028+0000","last_peered":"2024-05-08T18:30:05.243028+0000","last_clean":"2024-05-08T18:30:05.243028+0000","last_became_active":"2024-05-08T18:29:42.573502+0000","last_became_peered":"2024-05-08T18:29:42.573502+0000","last_unstale":"2024-05-08T18:30:05.243028+0000","last_undegraded":"2024-05-08T18:30:05.243028+0000","last_fullsized":"2024-05-08T18:30:05.243028+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:35.037465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.731068+0000","last_change":"2024-05-08T18:29:40.533094+0000","last_active":"2024-05-08T18:30:04.731068+0000","last_peered":"2024-05-08T18:30:04.731068+0000","last_clean":"2024-05-08T18:30:04.731068+0000","last_became_active":"2024-05-08T18:29:40.532246+0000","last_became_peered":"2024-05-08T18:29:40.532246+0000","last_unstale":"2024-05-08T18:30:04.731068+0000","last_undegraded":"2024-05-08T18:30:04.731068+0000","last_fullsized":"2024-05-08T18:30:04.731068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:37:08.242362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.796108+0000","last_change":"2024-05-08T18:29:42.565298+0000","last_active":"2024-05-08T18:30:05.796108+0000","last_peered":"2024-05-08T18:30:05.796108+0000","last_clean":"2024-05-08T18:30:05.796108+0000","last_became_active":"2024-05-08T18:29:42.564542+0000","last_became_peered":"2024-05-08T18:29:42.564542+0000","last_unstale":"2024-05-08T18:30:05.796108+0000","last_undegraded":"2024-05-08T18:30:05.796108+0000","last_fullsized":"2024-05-08T18:30:05.796108+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:57.706167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.794372+0000","last_change":"2024-05-08T18:29:40.556958+0000","last_active":"2024-05-08T18:30:05.794372+0000","last_peered":"2024-05-08T18:30:05.794372+0000","last_clean":"2024-05-08T18:30:05.794372+0000","last_became_active":"2024-05-08T18:29:40.556091+0000","last_became_peered":"2024-05-08T18:29:40.556091+0000","last_unstale":"2024-05-08T18:30:05.794372+0000","last_undegraded":"2024-05-08T18:30:05.794372+0000","last_fullsized":"2024-05-08T18:30:05.794372+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:39.986094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.243154+0000","last_change":"2024-05-08T18:29:42.574619+0000","last_active":"2024-05-08T18:30:05.243154+0000","last_peered":"2024-05-08T18:30:05.243154+0000","last_clean":"2024-05-08T18:30:05.243154+0000","last_became_active":"2024-05-08T18:29:42.573178+0000","last_became_peered":"2024-05-08T18:29:42.573178+0000","last_unstale":"2024-05-08T18:30:05.243154+0000","last_undegraded":"2024-05-08T18:30:05.243154+0000","last_fullsized":"2024-05-08T18:30:05.243154+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:33.139089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.123248+0000","last_change":"2024-05-08T18:29:40.544338+0000","last_active":"2024-05-08T18:30:04.123248+0000","last_peered":"2024-05-08T18:30:04.123248+0000","last_clean":"2024-05-08T18:30:04.123248+0000","last_became_active":"2024-05-08T18:29:40.544107+0000","last_became_peered":"2024-05-08T18:29:40.544107+0000","last_unstale":"2024-05-08T18:30:04.123248+0000","last_undegraded":"2024-05-08T18:30:04.123248+0000","last_fullsized":"2024-05-08T18:30:04.123248+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:54.200883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.732198+0000","last_change":"2024-05-08T18:29:42.576979+0000","last_active":"2024-05-08T18:30:04.732198+0000","last_peered":"2024-05-08T18:30:04.732198+0000","last_clean":"2024-05-08T18:30:04.732198+0000","last_became_active":"2024-05-08T18:29:42.576395+0000","last_became_peered":"2024-05-08T18:29:42.576395+0000","last_unstale":"2024-05-08T18:30:04.732198+0000","last_undegraded":"2024-05-08T18:30:04.732198+0000","last_fullsized":"2024-05-08T18:30:04.732198+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:53:03.097704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.733387+0000","last_change":"2024-05-08T18:29:40.558142+0000","last_active":"2024-05-08T18:30:04.733387+0000","last_peered":"2024-05-08T18:30:04.733387+0000","last_clean":"2024-05-08T18:30:04.733387+0000","last_became_active":"2024-05-08T18:29:40.557874+0000","last_became_peered":"2024-05-08T18:29:40.557874+0000","last_unstale":"2024-05-08T18:30:04.733387+0000","last_undegraded":"2024-05-08T18:30:04.733387+0000","last_fullsized":"2024-05-08T18:30:04.733387+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:54.200883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.797733+0000","last_change":"2024-05-08T18:29:42.558324+0000","last_active":"2024-05-08T18:30:05.797733+0000","last_peered":"2024-05-08T18:30:05.797733+0000","last_clean":"2024-05-08T18:30:05.797733+0000","last_became_active":"2024-05-08T18:29:42.556774+0000","last_became_peered":"2024-05-08T18:29:42.556774+0000","last_unstale":"2024-05-08T18:30:05.797733+0000","last_undegraded":"2024-05-08T18:30:05.797733+0000","last_fullsized":"2024-05-08T18:30:05.797733+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:02:26.311100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.243939+0000","last_change":"2024-05-08T18:29:40.545648+0000","last_active":"2024-05-08T18:30:05.243939+0000","last_peered":"2024-05-08T18:30:05.243939+0000","last_clean":"2024-05-08T18:30:05.243939+0000","last_became_active":"2024-05-08T18:29:40.545382+0000","last_became_peered":"2024-05-08T18:29:40.545382+0000","last_unstale":"2024-05-08T18:30:05.243939+0000","last_undegraded":"2024-05-08T18:30:05.243939+0000","last_fullsized":"2024-05-08T18:30:05.243939+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:17:47.828990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.731844+0000","last_change":"2024-05-08T18:29:42.562772+0000","last_active":"2024-05-08T18:30:04.731844+0000","last_peered":"2024-05-08T18:30:04.731844+0000","last_clean":"2024-05-08T18:30:04.731844+0000","last_became_active":"2024-05-08T18:29:42.562420+0000","last_became_peered":"2024-05-08T18:29:42.562420+0000","last_unstale":"2024-05-08T18:30:04.731844+0000","last_undegraded":"2024-05-08T18:30:04.731844+0000","last_fullsized":"2024-05-08T18:30:04.731844+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:30:29.452640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.741811+0000","last_change":"2024-05-08T18:29:40.562024+0000","last_active":"2024-05-08T18:30:05.741811+0000","last_peered":"2024-05-08T18:30:05.741811+0000","last_clean":"2024-05-08T18:30:05.741811+0000","last_became_active":"2024-05-08T18:29:40.561326+0000","last_became_peered":"2024-05-08T18:29:40.561326+0000","last_unstale":"2024-05-08T18:30:05.741811+0000","last_undegraded":"2024-05-08T18:30:05.741811+0000","last_fullsized":"2024-05-08T18:30:05.741811+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:21:38.354933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.739594+0000","last_change":"2024-05-08T18:29:42.561419+0000","last_active":"2024-05-08T18:30:05.739594+0000","last_peered":"2024-05-08T18:30:05.739594+0000","last_clean":"2024-05-08T18:30:05.739594+0000","last_became_active":"2024-05-08T18:29:42.560520+0000","last_became_peered":"2024-05-08T18:29:42.560520+0000","last_unstale":"2024-05-08T18:30:05.739594+0000","last_undegraded":"2024-05-08T18:30:05.739594+0000","last_fullsized":"2024-05-08T18:30:05.739594+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:07.949520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.734040+0000","last_change":"2024-05-08T18:29:40.554884+0000","last_active":"2024-05-08T18:30:04.734040+0000","last_peered":"2024-05-08T18:30:04.734040+0000","last_clean":"2024-05-08T18:30:04.734040+0000","last_became_active":"2024-05-08T18:29:40.554603+0000","last_became_peered":"2024-05-08T18:29:40.554603+0000","last_unstale":"2024-05-08T18:30:04.734040+0000","last_undegraded":"2024-05-08T18:30:04.734040+0000","last_fullsized":"2024-05-08T18:30:04.734040+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:09:39.835826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.124270+0000","last_change":"2024-05-08T18:29:42.574689+0000","last_active":"2024-05-08T18:30:04.124270+0000","last_peered":"2024-05-08T18:30:04.124270+0000","last_clean":"2024-05-08T18:30:04.124270+0000","last_became_active":"2024-05-08T18:29:42.573947+0000","last_became_peered":"2024-05-08T18:29:42.573947+0000","last_unstale":"2024-05-08T18:30:04.124270+0000","last_undegraded":"2024-05-08T18:30:04.124270+0000","last_fullsized":"2024-05-08T18:30:04.124270+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:57:14.869860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.793640+0000","last_change":"2024-05-08T18:29:40.554005+0000","last_active":"2024-05-08T18:30:05.793640+0000","last_peered":"2024-05-08T18:30:05.793640+0000","last_clean":"2024-05-08T18:30:05.793640+0000","last_became_active":"2024-05-08T18:29:40.553356+0000","last_became_peered":"2024-05-08T18:29:40.553356+0000","last_unstale":"2024-05-08T18:30:05.793640+0000","last_undegraded":"2024-05-08T18:30:05.793640+0000","last_fullsized":"2024-05-08T18:30:05.793640+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:08:13.006752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.798935+0000","last_change":"2024-05-08T18:29:42.566487+0000","last_active":"2024-05-08T18:30:05.798935+0000","last_peered":"2024-05-08T18:30:05.798935+0000","last_clean":"2024-05-08T18:30:05.798935+0000","last_became_active":"2024-05-08T18:29:42.565760+0000","last_became_peered":"2024-05-08T18:29:42.565760+0000","last_unstale":"2024-05-08T18:30:05.798935+0000","last_undegraded":"2024-05-08T18:30:05.798935+0000","last_fullsized":"2024-05-08T18:30:05.798935+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:57.706167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.732161+0000","last_change":"2024-05-08T18:29:40.552543+0000","last_active":"2024-05-08T18:30:04.732161+0000","last_peered":"2024-05-08T18:30:04.732161+0000","last_clean":"2024-05-08T18:30:04.732161+0000","last_became_active":"2024-05-08T18:29:40.552307+0000","last_became_peered":"2024-05-08T18:29:40.552307+0000","last_unstale":"2024-05-08T18:30:04.732161+0000","last_undegraded":"2024-05-08T18:30:04.732161+0000","last_fullsized":"2024-05-08T18:30:04.732161+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:48.294532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.733272+0000","last_change":"2024-05-08T18:29:42.561658+0000","last_active":"2024-05-08T18:30:04.733272+0000","last_peered":"2024-05-08T18:30:04.733272+0000","last_clean":"2024-05-08T18:30:04.733272+0000","last_became_active":"2024-05-08T18:29:42.561171+0000","last_became_peered":"2024-05-08T18:29:42.561171+0000","last_unstale":"2024-05-08T18:30:04.733272+0000","last_undegraded":"2024-05-08T18:30:04.733272+0000","last_fullsized":"2024-05-08T18:30:04.733272+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:15.966061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.794282+0000","last_change":"2024-05-08T18:29:40.543041+0000","last_active":"2024-05-08T18:30:05.794282+0000","last_peered":"2024-05-08T18:30:05.794282+0000","last_clean":"2024-05-08T18:30:05.794282+0000","last_became_active":"2024-05-08T18:29:40.542398+0000","last_became_peered":"2024-05-08T18:29:40.542398+0000","last_unstale":"2024-05-08T18:30:05.794282+0000","last_undegraded":"2024-05-08T18:30:05.794282+0000","last_fullsized":"2024-05-08T18:30:05.794282+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:33.017750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.798563+0000","last_change":"2024-05-08T18:29:42.579690+0000","last_active":"2024-05-08T18:30:05.798563+0000","last_peered":"2024-05-08T18:30:05.798563+0000","last_clean":"2024-05-08T18:30:05.798563+0000","last_became_active":"2024-05-08T18:29:42.578981+0000","last_became_peered":"2024-05-08T18:29:42.578981+0000","last_unstale":"2024-05-08T18:30:05.798563+0000","last_undegraded":"2024-05-08T18:30:05.798563+0000","last_fullsized":"2024-05-08T18:30:05.798563+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:36:03.084561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.123447+0000","last_change":"2024-05-08T18:29:40.548499+0000","last_active":"2024-05-08T18:30:04.123447+0000","last_peered":"2024-05-08T18:30:04.123447+0000","last_clean":"2024-05-08T18:30:04.123447+0000","last_became_active":"2024-05-08T18:29:40.548177+0000","last_became_peered":"2024-05-08T18:29:40.548177+0000","last_unstale":"2024-05-08T18:30:04.123447+0000","last_undegraded":"2024-05-08T18:30:04.123447+0000","last_fullsized":"2024-05-08T18:30:04.123447+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:27:41.414153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.798084+0000","last_change":"2024-05-08T18:29:42.575892+0000","last_active":"2024-05-08T18:30:05.798084+0000","last_peered":"2024-05-08T18:30:05.798084+0000","last_clean":"2024-05-08T18:30:05.798084+0000","last_became_active":"2024-05-08T18:29:42.573384+0000","last_became_peered":"2024-05-08T18:29:42.573384+0000","last_unstale":"2024-05-08T18:30:05.798084+0000","last_undegraded":"2024-05-08T18:30:05.798084+0000","last_fullsized":"2024-05-08T18:30:05.798084+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:55.055481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.740795+0000","last_change":"2024-05-08T18:29:40.565068+0000","last_active":"2024-05-08T18:30:05.740795+0000","last_peered":"2024-05-08T18:30:05.740795+0000","last_clean":"2024-05-08T18:30:05.740795+0000","last_became_active":"2024-05-08T18:29:40.563231+0000","last_became_peered":"2024-05-08T18:29:40.563231+0000","last_unstale":"2024-05-08T18:30:05.740795+0000","last_undegraded":"2024-05-08T18:30:05.740795+0000","last_fullsized":"2024-05-08T18:30:05.740795+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:17:47.828990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.122650+0000","last_change":"2024-05-08T18:29:42.564338+0000","last_active":"2024-05-08T18:30:04.122650+0000","last_peered":"2024-05-08T18:30:04.122650+0000","last_clean":"2024-05-08T18:30:04.122650+0000","last_became_active":"2024-05-08T18:29:42.563822+0000","last_became_peered":"2024-05-08T18:29:42.563822+0000","last_unstale":"2024-05-08T18:30:04.122650+0000","last_undegraded":"2024-05-08T18:30:04.122650+0000","last_fullsized":"2024-05-08T18:30:04.122650+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:23.397435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.800954+0000","last_change":"2024-05-08T18:29:40.573333+0000","last_active":"2024-05-08T18:30:05.800954+0000","last_peered":"2024-05-08T18:30:05.800954+0000","last_clean":"2024-05-08T18:30:05.800954+0000","last_became_active":"2024-05-08T18:29:40.571195+0000","last_became_peered":"2024-05-08T18:29:40.571195+0000","last_unstale":"2024-05-08T18:30:05.800954+0000","last_undegraded":"2024-05-08T18:30:05.800954+0000","last_fullsized":"2024-05-08T18:30:05.800954+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:33.017750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.731757+0000","last_change":"2024-05-08T18:29:42.563085+0000","last_active":"2024-05-08T18:30:04.731757+0000","last_peered":"2024-05-08T18:30:04.731757+0000","last_clean":"2024-05-08T18:30:04.731757+0000","last_became_active":"2024-05-08T18:29:42.560419+0000","last_became_peered":"2024-05-08T18:29:42.560419+0000","last_unstale":"2024-05-08T18:30:04.731757+0000","last_undegraded":"2024-05-08T18:30:04.731757+0000","last_fullsized":"2024-05-08T18:30:04.731757+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:20.397730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.734227+0000","last_change":"2024-05-08T18:29:40.568890+0000","last_active":"2024-05-08T18:30:04.734227+0000","last_peered":"2024-05-08T18:30:04.734227+0000","last_clean":"2024-05-08T18:30:04.734227+0000","last_became_active":"2024-05-08T18:29:40.568584+0000","last_became_peered":"2024-05-08T18:29:40.568584+0000","last_unstale":"2024-05-08T18:30:04.734227+0000","last_undegraded":"2024-05-08T18:30:04.734227+0000","last_fullsized":"2024-05-08T18:30:04.734227+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:25:01.595224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.794760+0000","last_change":"2024-05-08T18:29:42.574277+0000","last_active":"2024-05-08T18:30:05.794760+0000","last_peered":"2024-05-08T18:30:05.794760+0000","last_clean":"2024-05-08T18:30:05.794760+0000","last_became_active":"2024-05-08T18:29:42.573563+0000","last_became_peered":"2024-05-08T18:29:42.573563+0000","last_unstale":"2024-05-08T18:30:05.794760+0000","last_undegraded":"2024-05-08T18:30:05.794760+0000","last_fullsized":"2024-05-08T18:30:05.794760+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:57.706167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.801084+0000","last_change":"2024-05-08T18:29:40.562058+0000","last_active":"2024-05-08T18:30:05.801084+0000","last_peered":"2024-05-08T18:30:05.801084+0000","last_clean":"2024-05-08T18:30:05.801084+0000","last_became_active":"2024-05-08T18:29:40.561360+0000","last_became_peered":"2024-05-08T18:29:40.561360+0000","last_unstale":"2024-05-08T18:30:05.801084+0000","last_undegraded":"2024-05-08T18:30:05.801084+0000","last_fullsized":"2024-05-08T18:30:05.801084+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:05.929806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.793480+0000","last_change":"2024-05-08T18:29:40.538728+0000","last_active":"2024-05-08T18:30:05.793480+0000","last_peered":"2024-05-08T18:30:05.793480+0000","last_clean":"2024-05-08T18:30:05.793480+0000","last_became_active":"2024-05-08T18:29:40.537925+0000","last_became_peered":"2024-05-08T18:29:40.537925+0000","last_unstale":"2024-05-08T18:30:05.793480+0000","last_undegraded":"2024-05-08T18:30:05.793480+0000","last_fullsized":"2024-05-08T18:30:05.793480+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:28.426657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.124189+0000","last_change":"2024-05-08T18:29:42.574941+0000","last_active":"2024-05-08T18:30:04.124189+0000","last_peered":"2024-05-08T18:30:04.124189+0000","last_clean":"2024-05-08T18:30:04.124189+0000","last_became_active":"2024-05-08T18:29:42.574351+0000","last_became_peered":"2024-05-08T18:29:42.574351+0000","last_unstale":"2024-05-08T18:30:04.124189+0000","last_undegraded":"2024-05-08T18:30:04.124189+0000","last_fullsized":"2024-05-08T18:30:04.124189+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:21.935293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.243697+0000","last_change":"2024-05-08T18:29:40.543714+0000","last_active":"2024-05-08T18:30:05.243697+0000","last_peered":"2024-05-08T18:30:05.243697+0000","last_clean":"2024-05-08T18:30:05.243697+0000","last_became_active":"2024-05-08T18:29:40.542965+0000","last_became_peered":"2024-05-08T18:29:40.542965+0000","last_unstale":"2024-05-08T18:30:05.243697+0000","last_undegraded":"2024-05-08T18:30:05.243697+0000","last_fullsized":"2024-05-08T18:30:05.243697+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:12:59.146887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.798897+0000","last_change":"2024-05-08T18:29:42.560007+0000","last_active":"2024-05-08T18:30:05.798897+0000","last_peered":"2024-05-08T18:30:05.798897+0000","last_clean":"2024-05-08T18:30:05.798897+0000","last_became_active":"2024-05-08T18:29:42.559028+0000","last_became_peered":"2024-05-08T18:29:42.559028+0000","last_unstale":"2024-05-08T18:30:05.798897+0000","last_undegraded":"2024-05-08T18:30:05.798897+0000","last_fullsized":"2024-05-08T18:30:05.798897+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:36:03.084561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":178,"num_object_clones":0,"num_object_copies":356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":178,"num_whiteouts":0,"num_read":688,"num_read_kb":447,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":387,"ondisk_log_size":387,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509453,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32240,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339600,"statfs":{"total":96636764160,"available":96603750400,"internally_reserved":0,"allocated":1077248,"data_stored":797049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509453,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":458752,"data_stored":206021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509451,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31648,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340192,"statfs":{"total":96636764160,"available":96604356608,"internally_reserved":0,"allocated":479232,"data_stored":191565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509451,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":446464,"data_stored":205519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542156,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":462848,"data_stored":198775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542156,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":191728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542154,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":450560,"data_stored":190987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542156,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28044,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343796,"statfs":{"total":96636764160,"available":96608047104,"internally_reserved":0,"allocated":1040384,"data_stored":782600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T18:30:08.243 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T18:30:08.248 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:30:08.248+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:30:08.332 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:30:08.330+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:30:08.348 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:30:08.348 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2024-05-08T18:30:08.348 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2024-05-08T18:30:08.348 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-05-08T18:30:08.348 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.349 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:24 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [write 262144~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:08.349 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.154193+0000", 2024-05-08T18:30:08.349 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 41.192116798999997, 2024-05-08T18:30:08.349 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0085494309999999997, 2024-05-08T18:30:08.349 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:08.349 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:08.349 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:08.350 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:08.350 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:08.350 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:08.350 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 24 2024-05-08T18:30:08.350 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.350 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:08.350 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.350 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:08.350 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154193+0000", 2024-05-08T18:30:08.350 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:08.350 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.350 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.351 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:08.351 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154193+0000", 2024-05-08T18:30:08.351 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:08.351 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.351 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.351 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:08.351 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154194+0000", 2024-05-08T18:30:08.351 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.44e-06 2024-05-08T18:30:08.351 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.351 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.351 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:08.351 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154394+0000", 2024-05-08T18:30:08.352 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00019972499999999999 2024-05-08T18:30:08.352 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.352 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.352 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:08.352 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154417+0000", 2024-05-08T18:30:08.352 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2713000000000001e-05 2024-05-08T18:30:08.352 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.352 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.352 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:08.352 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154437+0000", 2024-05-08T18:30:08.352 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0027e-05 2024-05-08T18:30:08.352 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.352 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.353 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:08.353 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.158438+0000", 2024-05-08T18:30:08.353 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0040011459999999997 2024-05-08T18:30:08.353 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.353 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.353 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:08.353 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.158567+0000", 2024-05-08T18:30:08.353 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012923899999999999 2024-05-08T18:30:08.353 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.353 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.353 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:08.353 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.158787+0000", 2024-05-08T18:30:08.353 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000219581 2024-05-08T18:30:08.354 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.354 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.354 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:08.354 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.162013+0000", 2024-05-08T18:30:08.354 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032261759999999999 2024-05-08T18:30:08.354 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.354 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.354 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:08.354 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.162568+0000", 2024-05-08T18:30:08.354 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00055576900000000001 2024-05-08T18:30:08.354 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.354 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.355 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:08.355 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.162644+0000", 2024-05-08T18:30:08.355 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5516e-05 2024-05-08T18:30:08.355 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.355 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.355 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:08.355 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.162742+0000", 2024-05-08T18:30:08.355 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8098999999999997e-05 2024-05-08T18:30:08.355 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:08.355 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:08.355 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:08.355 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.355 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.356 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:25 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:08.356 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.154495+0000", 2024-05-08T18:30:08.356 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 41.191814505000004, 2024-05-08T18:30:08.356 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010784396999999999, 2024-05-08T18:30:08.356 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:08.356 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:08.356 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:08.356 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:08.356 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:08.356 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:08.356 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 25 2024-05-08T18:30:08.356 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.357 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:08.357 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.357 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:08.357 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154495+0000", 2024-05-08T18:30:08.357 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:08.357 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.357 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.357 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:08.357 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154495+0000", 2024-05-08T18:30:08.357 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:08.357 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.357 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.357 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:08.358 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154496+0000", 2024-05-08T18:30:08.358 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.454e-06 2024-05-08T18:30:08.358 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.358 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.358 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:08.358 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154509+0000", 2024-05-08T18:30:08.358 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2496e-05 2024-05-08T18:30:08.358 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.358 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.358 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:08.358 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154531+0000", 2024-05-08T18:30:08.358 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1987000000000001e-05 2024-05-08T18:30:08.358 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.359 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.359 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:08.359 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154547+0000", 2024-05-08T18:30:08.359 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.577e-05 2024-05-08T18:30:08.359 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.359 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.359 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:08.359 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.160949+0000", 2024-05-08T18:30:08.359 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.006401917 2024-05-08T18:30:08.359 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.359 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.359 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:08.359 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.161102+0000", 2024-05-08T18:30:08.360 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000153826 2024-05-08T18:30:08.360 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.360 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.360 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:08.360 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.161332+0000", 2024-05-08T18:30:08.360 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022918099999999999 2024-05-08T18:30:08.360 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.360 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.360 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:08.360 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.163838+0000", 2024-05-08T18:30:08.360 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0025064079999999999 2024-05-08T18:30:08.360 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.360 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.361 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:08.361 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.165121+0000", 2024-05-08T18:30:08.361 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0012825200000000001 2024-05-08T18:30:08.361 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.361 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.361 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:08.361 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.165212+0000", 2024-05-08T18:30:08.361 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1121999999999999e-05 2024-05-08T18:30:08.361 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.361 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.361 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:08.361 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.165279+0000", 2024-05-08T18:30:08.361 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7716e-05 2024-05-08T18:30:08.362 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:08.362 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:08.362 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:08.362 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.362 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.362 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:41 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:08.362 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247174+0000", 2024-05-08T18:30:08.362 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 41.099135523000001, 2024-05-08T18:30:08.362 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010013393000000001, 2024-05-08T18:30:08.362 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:08.362 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:08.362 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:08.363 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:08.363 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:08.363 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:08.363 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 41 2024-05-08T18:30:08.363 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.363 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:08.363 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.363 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:08.363 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247174+0000", 2024-05-08T18:30:08.363 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:08.363 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.363 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.363 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:08.364 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247174+0000", 2024-05-08T18:30:08.364 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:08.364 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.364 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.364 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:08.364 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247175+0000", 2024-05-08T18:30:08.364 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.9999999999999995e-07 2024-05-08T18:30:08.364 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.364 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.364 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:08.364 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247277+0000", 2024-05-08T18:30:08.364 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010243600000000001 2024-05-08T18:30:08.364 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.364 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.365 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:08.365 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247291+0000", 2024-05-08T18:30:08.365 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4076999999999999e-05 2024-05-08T18:30:08.365 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.365 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.365 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:08.365 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247301+0000", 2024-05-08T18:30:08.365 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0010000000000001e-05 2024-05-08T18:30:08.365 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.365 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.365 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:08.365 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.249555+0000", 2024-05-08T18:30:08.365 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0022539050000000001 2024-05-08T18:30:08.365 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.366 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.366 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:08.366 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.249700+0000", 2024-05-08T18:30:08.366 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014484599999999999 2024-05-08T18:30:08.366 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.366 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.366 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:08.366 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.249929+0000", 2024-05-08T18:30:08.366 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022904499999999999 2024-05-08T18:30:08.366 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.366 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.366 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:08.366 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.253695+0000", 2024-05-08T18:30:08.367 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0037656640000000002 2024-05-08T18:30:08.367 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.367 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.367 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:08.367 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.256970+0000", 2024-05-08T18:30:08.367 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003274608 2024-05-08T18:30:08.367 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.367 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.367 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:08.367 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.257052+0000", 2024-05-08T18:30:08.367 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2223000000000002e-05 2024-05-08T18:30:08.367 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.367 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.368 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:08.368 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.257187+0000", 2024-05-08T18:30:08.368 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013557900000000001 2024-05-08T18:30:08.368 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:08.368 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:08.368 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:08.368 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.368 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.368 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:42 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:08.368 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247321+0000", 2024-05-08T18:30:08.368 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 41.098988204000001, 2024-05-08T18:30:08.368 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013168572, 2024-05-08T18:30:08.368 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:08.369 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:08.369 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:08.369 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:08.369 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:08.369 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:08.369 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 42 2024-05-08T18:30:08.369 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.369 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:08.369 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.369 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:08.369 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247321+0000", 2024-05-08T18:30:08.369 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:08.369 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.369 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.370 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:08.370 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247321+0000", 2024-05-08T18:30:08.370 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:08.370 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.370 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.370 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:08.370 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247323+0000", 2024-05-08T18:30:08.370 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.24e-06 2024-05-08T18:30:08.370 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.370 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.370 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:08.370 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247329+0000", 2024-05-08T18:30:08.370 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1530000000000002e-06 2024-05-08T18:30:08.371 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.371 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.371 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:08.371 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247339+0000", 2024-05-08T18:30:08.371 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0387000000000001e-05 2024-05-08T18:30:08.371 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.371 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.371 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:08.371 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247347+0000", 2024-05-08T18:30:08.371 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9829999999999996e-06 2024-05-08T18:30:08.371 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.371 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.371 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:08.371 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.251488+0000", 2024-05-08T18:30:08.372 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0041412849999999998 2024-05-08T18:30:08.372 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.372 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.372 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:08.372 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.251672+0000", 2024-05-08T18:30:08.372 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00018354499999999999 2024-05-08T18:30:08.372 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.372 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.372 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:08.372 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.251949+0000", 2024-05-08T18:30:08.372 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00027695399999999999 2024-05-08T18:30:08.372 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.372 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.372 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:08.373 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.253810+0000", 2024-05-08T18:30:08.373 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001860806 2024-05-08T18:30:08.373 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.373 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.373 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:08.373 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260244+0000", 2024-05-08T18:30:08.373 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0064347939999999998 2024-05-08T18:30:08.373 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.373 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.373 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:08.373 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260376+0000", 2024-05-08T18:30:08.373 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000131829 2024-05-08T18:30:08.373 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.374 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.374 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:08.374 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260490+0000", 2024-05-08T18:30:08.374 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000113596 2024-05-08T18:30:08.374 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:08.374 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:08.374 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:08.374 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.374 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.374 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:43 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:08.374 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247367+0000", 2024-05-08T18:30:08.374 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 41.098942291, 2024-05-08T18:30:08.374 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013449025999999999, 2024-05-08T18:30:08.375 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:08.375 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:08.375 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:08.375 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:08.375 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:08.375 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:08.375 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 43 2024-05-08T18:30:08.375 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.375 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:08.375 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.375 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:08.375 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247367+0000", 2024-05-08T18:30:08.375 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:08.375 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.376 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.376 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:08.376 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247367+0000", 2024-05-08T18:30:08.376 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:08.376 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.376 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.376 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:08.376 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247368+0000", 2024-05-08T18:30:08.376 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1999999999999999e-07 2024-05-08T18:30:08.376 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.376 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.376 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:08.376 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247374+0000", 2024-05-08T18:30:08.376 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.19e-06 2024-05-08T18:30:08.377 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.377 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.377 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:08.377 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247384+0000", 2024-05-08T18:30:08.377 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0173000000000001e-05 2024-05-08T18:30:08.377 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.377 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.377 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:08.377 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247392+0000", 2024-05-08T18:30:08.377 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1869999999999997e-06 2024-05-08T18:30:08.377 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.377 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.377 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:08.378 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.252515+0000", 2024-05-08T18:30:08.378 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0051221399999999999 2024-05-08T18:30:08.378 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.378 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.378 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:08.378 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.252641+0000", 2024-05-08T18:30:08.378 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012609200000000001 2024-05-08T18:30:08.378 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.378 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.378 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:08.378 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.252842+0000", 2024-05-08T18:30:08.378 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000201619 2024-05-08T18:30:08.378 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.379 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.379 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:08.379 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.256828+0000", 2024-05-08T18:30:08.379 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039853989999999997 2024-05-08T18:30:08.379 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.379 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.379 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:08.379 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260515+0000", 2024-05-08T18:30:08.379 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0036875419999999998 2024-05-08T18:30:08.379 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.379 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.379 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:08.379 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260718+0000", 2024-05-08T18:30:08.380 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020229499999999999 2024-05-08T18:30:08.380 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.380 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.380 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:08.380 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260816+0000", 2024-05-08T18:30:08.380 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8669e-05 2024-05-08T18:30:08.380 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:08.380 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:08.380 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:08.380 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.380 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.380 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:08.380 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247466+0000", 2024-05-08T18:30:08.381 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 41.098843705, 2024-05-08T18:30:08.381 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013491806, 2024-05-08T18:30:08.381 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:08.381 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:08.381 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:08.381 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:08.381 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:08.381 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:08.381 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 44 2024-05-08T18:30:08.381 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.381 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:08.381 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.381 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:08.382 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247466+0000", 2024-05-08T18:30:08.382 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:08.382 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.382 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.382 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:08.382 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247466+0000", 2024-05-08T18:30:08.382 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:08.382 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.382 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.382 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:08.382 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247467+0000", 2024-05-08T18:30:08.382 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.263e-06 2024-05-08T18:30:08.382 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.383 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.383 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:08.383 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247585+0000", 2024-05-08T18:30:08.383 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011756600000000001 2024-05-08T18:30:08.383 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.383 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.383 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:08.383 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247598+0000", 2024-05-08T18:30:08.383 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3766e-05 2024-05-08T18:30:08.383 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.383 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.383 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:08.383 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247609+0000", 2024-05-08T18:30:08.384 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0604e-05 2024-05-08T18:30:08.384 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.384 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.384 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:08.384 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.253890+0000", 2024-05-08T18:30:08.384 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0062810440000000004 2024-05-08T18:30:08.384 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.384 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.384 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:08.384 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.254068+0000", 2024-05-08T18:30:08.384 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017848199999999999 2024-05-08T18:30:08.384 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.384 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.385 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:08.385 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.254488+0000", 2024-05-08T18:30:08.385 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00041965399999999999 2024-05-08T18:30:08.385 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.385 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.385 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:08.385 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.256949+0000", 2024-05-08T18:30:08.385 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002461254 2024-05-08T18:30:08.385 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.385 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.385 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:08.385 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260832+0000", 2024-05-08T18:30:08.385 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0038830539999999999 2024-05-08T18:30:08.386 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.386 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.386 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:08.386 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260906+0000", 2024-05-08T18:30:08.386 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3455999999999996e-05 2024-05-08T18:30:08.386 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.386 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.386 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:08.386 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260958+0000", 2024-05-08T18:30:08.386 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1663000000000003e-05 2024-05-08T18:30:08.386 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:08.386 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:08.386 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:08.386 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.387 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.387 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:08.387 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247630+0000", 2024-05-08T18:30:08.387 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 41.098679300000001, 2024-05-08T18:30:08.387 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013478753, 2024-05-08T18:30:08.387 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:08.387 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:08.387 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:08.387 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:08.387 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:08.387 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:08.387 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 45 2024-05-08T18:30:08.387 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.387 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:08.388 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.388 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:08.388 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247630+0000", 2024-05-08T18:30:08.388 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:08.388 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.388 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.388 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:08.388 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247630+0000", 2024-05-08T18:30:08.388 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:08.388 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.388 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.388 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:08.388 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247631+0000", 2024-05-08T18:30:08.388 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7399999999999991e-07 2024-05-08T18:30:08.388 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.389 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.389 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:08.389 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247637+0000", 2024-05-08T18:30:08.389 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.93e-06 2024-05-08T18:30:08.389 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.389 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.389 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:08.389 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247647+0000", 2024-05-08T18:30:08.389 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7459999999999995e-06 2024-05-08T18:30:08.389 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.389 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.389 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:08.390 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247654+0000", 2024-05-08T18:30:08.390 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4039999999999998e-06 2024-05-08T18:30:08.390 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.390 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.390 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:08.390 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.255829+0000", 2024-05-08T18:30:08.390 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0081749059999999991 2024-05-08T18:30:08.390 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.390 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.390 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:08.390 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.255979+0000", 2024-05-08T18:30:08.390 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015027899999999999 2024-05-08T18:30:08.390 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.391 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.391 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:08.391 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.256185+0000", 2024-05-08T18:30:08.391 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020583900000000001 2024-05-08T18:30:08.391 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.391 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.391 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:08.391 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260097+0000", 2024-05-08T18:30:08.391 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039121929999999996 2024-05-08T18:30:08.391 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.391 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.391 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:08.391 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260973+0000", 2024-05-08T18:30:08.391 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00087591999999999998 2024-05-08T18:30:08.392 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.392 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.392 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:08.392 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261056+0000", 2024-05-08T18:30:08.392 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3104999999999998e-05 2024-05-08T18:30:08.392 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.392 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.392 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:08.392 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261109+0000", 2024-05-08T18:30:08.392 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2457000000000003e-05 2024-05-08T18:30:08.392 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:08.392 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:08.392 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:08.393 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.393 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.393 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:08.393 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247667+0000", 2024-05-08T18:30:08.393 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 41.09864202, 2024-05-08T18:30:08.393 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013569098999999999, 2024-05-08T18:30:08.393 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:08.393 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:08.393 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:08.393 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:08.393 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:08.393 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:08.393 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 46 2024-05-08T18:30:08.394 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.394 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:08.394 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.394 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:08.394 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247667+0000", 2024-05-08T18:30:08.394 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:08.394 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.394 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.394 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:08.394 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247667+0000", 2024-05-08T18:30:08.394 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:08.394 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.394 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.395 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:08.395 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247668+0000", 2024-05-08T18:30:08.395 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7999999999999995e-07 2024-05-08T18:30:08.395 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.395 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.395 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:08.395 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247674+0000", 2024-05-08T18:30:08.395 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4369999999999998e-06 2024-05-08T18:30:08.395 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.395 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.395 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:08.395 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247683+0000", 2024-05-08T18:30:08.395 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4360000000000008e-06 2024-05-08T18:30:08.396 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.396 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.396 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:08.396 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247690+0000", 2024-05-08T18:30:08.396 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.43e-06 2024-05-08T18:30:08.396 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.396 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.396 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:08.396 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.257358+0000", 2024-05-08T18:30:08.396 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0096676890000000001 2024-05-08T18:30:08.396 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.396 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.396 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:08.397 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.257626+0000", 2024-05-08T18:30:08.397 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00026819099999999998 2024-05-08T18:30:08.397 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.397 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.397 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:08.397 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.258041+0000", 2024-05-08T18:30:08.397 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00041438400000000001 2024-05-08T18:30:08.397 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.397 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.397 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:08.397 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260224+0000", 2024-05-08T18:30:08.397 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0021830700000000001 2024-05-08T18:30:08.397 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.398 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.398 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:08.398 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261127+0000", 2024-05-08T18:30:08.398 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00090292300000000003 2024-05-08T18:30:08.398 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.398 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.398 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:08.398 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261191+0000", 2024-05-08T18:30:08.398 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4342000000000002e-05 2024-05-08T18:30:08.398 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.398 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.398 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:08.398 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261237+0000", 2024-05-08T18:30:08.399 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.5516999999999998e-05 2024-05-08T18:30:08.399 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:08.399 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:08.399 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:08.399 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.399 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.399 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:08.399 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247703+0000", 2024-05-08T18:30:08.399 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 41.098606537000002, 2024-05-08T18:30:08.399 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015020204000000001, 2024-05-08T18:30:08.399 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:08.399 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:08.400 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:08.400 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:08.400 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:08.400 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:08.400 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 47 2024-05-08T18:30:08.400 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.400 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:08.400 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.400 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:08.400 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247703+0000", 2024-05-08T18:30:08.400 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:08.400 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.401 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.401 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:08.401 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247703+0000", 2024-05-08T18:30:08.401 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:08.401 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.401 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.401 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:08.401 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247704+0000", 2024-05-08T18:30:08.401 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8299999999999996e-07 2024-05-08T18:30:08.401 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.401 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.401 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:08.401 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247877+0000", 2024-05-08T18:30:08.402 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000172979 2024-05-08T18:30:08.402 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.402 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.402 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:08.402 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247894+0000", 2024-05-08T18:30:08.402 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6912999999999999e-05 2024-05-08T18:30:08.402 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.402 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.402 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:08.402 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247903+0000", 2024-05-08T18:30:08.402 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1770000000000004e-06 2024-05-08T18:30:08.402 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.402 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.403 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:08.403 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.258767+0000", 2024-05-08T18:30:08.403 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010864409 2024-05-08T18:30:08.403 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.403 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.403 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:08.403 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.258898+0000", 2024-05-08T18:30:08.403 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000131199 2024-05-08T18:30:08.403 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.403 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.403 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:08.403 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.259117+0000", 2024-05-08T18:30:08.403 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000218889 2024-05-08T18:30:08.403 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.404 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.404 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:08.404 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.262372+0000", 2024-05-08T18:30:08.404 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032545679999999998 2024-05-08T18:30:08.404 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.404 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.404 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:08.404 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.262432+0000", 2024-05-08T18:30:08.404 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9913e-05 2024-05-08T18:30:08.404 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.404 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.404 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:08.404 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.262585+0000", 2024-05-08T18:30:08.404 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015361800000000001 2024-05-08T18:30:08.405 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.405 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.405 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:08.405 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.262723+0000", 2024-05-08T18:30:08.405 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000137856 2024-05-08T18:30:08.405 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:08.405 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:08.405 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:08.405 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.405 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.405 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:08.405 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247927+0000", 2024-05-08T18:30:08.406 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 41.098382499000003, 2024-05-08T18:30:08.406 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018387718000000001, 2024-05-08T18:30:08.406 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:08.406 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:08.406 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:08.406 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:08.406 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:08.406 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:08.406 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 48 2024-05-08T18:30:08.406 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.406 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:08.406 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.406 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:08.406 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247927+0000", 2024-05-08T18:30:08.407 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:08.407 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.407 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.407 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:08.407 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247927+0000", 2024-05-08T18:30:08.407 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:08.407 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.407 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.407 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:08.407 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247928+0000", 2024-05-08T18:30:08.407 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8400000000000003e-07 2024-05-08T18:30:08.407 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.407 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.408 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:08.408 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247935+0000", 2024-05-08T18:30:08.408 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1230000000000002e-06 2024-05-08T18:30:08.408 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.408 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.408 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:08.408 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247945+0000", 2024-05-08T18:30:08.408 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0346000000000001e-05 2024-05-08T18:30:08.408 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.408 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.408 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:08.408 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247953+0000", 2024-05-08T18:30:08.408 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8040000000000002e-06 2024-05-08T18:30:08.409 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.409 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.409 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:08.409 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261292+0000", 2024-05-08T18:30:08.409 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013339337 2024-05-08T18:30:08.409 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.409 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.409 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:08.409 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261424+0000", 2024-05-08T18:30:08.409 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013201900000000001 2024-05-08T18:30:08.409 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.409 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.409 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:08.410 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261628+0000", 2024-05-08T18:30:08.410 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020327499999999999 2024-05-08T18:30:08.410 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.410 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.410 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:08.410 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.263849+0000", 2024-05-08T18:30:08.410 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0022209759999999999 2024-05-08T18:30:08.410 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.410 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.410 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:08.410 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266167+0000", 2024-05-08T18:30:08.410 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002317979 2024-05-08T18:30:08.410 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.411 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.411 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:08.411 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266249+0000", 2024-05-08T18:30:08.411 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1996000000000006e-05 2024-05-08T18:30:08.411 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.411 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.411 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:08.411 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266315+0000", 2024-05-08T18:30:08.411 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5979e-05 2024-05-08T18:30:08.411 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:08.411 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:08.411 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:08.411 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.411 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.412 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:08.412 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247966+0000", 2024-05-08T18:30:08.412 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 41.098343565999997, 2024-05-08T18:30:08.412 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0194153, 2024-05-08T18:30:08.412 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:08.412 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:08.412 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:08.412 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:08.412 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:08.412 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:08.412 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 49 2024-05-08T18:30:08.412 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.412 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:08.412 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.413 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:08.413 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247966+0000", 2024-05-08T18:30:08.413 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:08.413 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.413 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.413 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:08.413 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247966+0000", 2024-05-08T18:30:08.413 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:08.413 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.413 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.413 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:08.413 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247967+0000", 2024-05-08T18:30:08.413 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0299999999999998e-07 2024-05-08T18:30:08.413 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.414 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.414 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:08.414 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247972+0000", 2024-05-08T18:30:08.414 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3600000000000004e-06 2024-05-08T18:30:08.414 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.414 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.414 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:08.414 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247981+0000", 2024-05-08T18:30:08.414 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.234e-06 2024-05-08T18:30:08.414 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.414 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.414 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:08.414 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247989+0000", 2024-05-08T18:30:08.414 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5159999999999997e-06 2024-05-08T18:30:08.414 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.415 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.415 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:08.415 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.262816+0000", 2024-05-08T18:30:08.415 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.014827399999999999 2024-05-08T18:30:08.415 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.415 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.415 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:08.415 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.262948+0000", 2024-05-08T18:30:08.415 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013166799999999999 2024-05-08T18:30:08.415 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.415 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.415 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:08.415 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.263153+0000", 2024-05-08T18:30:08.415 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000205272 2024-05-08T18:30:08.416 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.416 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.416 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:08.416 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266144+0000", 2024-05-08T18:30:08.416 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029912300000000001 2024-05-08T18:30:08.416 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.416 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.416 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:08.416 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.267226+0000", 2024-05-08T18:30:08.416 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010820580000000001 2024-05-08T18:30:08.416 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.416 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.416 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:08.416 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.267315+0000", 2024-05-08T18:30:08.416 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8793000000000002e-05 2024-05-08T18:30:08.417 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.417 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.417 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:08.417 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.267381+0000", 2024-05-08T18:30:08.417 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6066000000000001e-05 2024-05-08T18:30:08.417 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:08.417 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:08.417 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:08.417 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.417 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.417 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:08.417 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.248003+0000", 2024-05-08T18:30:08.417 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 41.098306266000002, 2024-05-08T18:30:08.418 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.020859638999999999, 2024-05-08T18:30:08.418 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:08.418 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:08.418 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:08.418 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:08.418 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:08.418 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:08.418 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 50 2024-05-08T18:30:08.418 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.418 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:08.418 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.418 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:08.418 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248003+0000", 2024-05-08T18:30:08.419 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:08.419 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.419 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.419 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:08.419 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248003+0000", 2024-05-08T18:30:08.419 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:08.419 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.419 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.419 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:08.419 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248004+0000", 2024-05-08T18:30:08.419 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5300000000000003e-07 2024-05-08T18:30:08.419 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.419 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.419 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:08.420 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248139+0000", 2024-05-08T18:30:08.420 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000135193 2024-05-08T18:30:08.420 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.420 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.420 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:08.420 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248151+0000", 2024-05-08T18:30:08.420 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.19e-05 2024-05-08T18:30:08.420 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.420 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.420 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:08.420 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248161+0000", 2024-05-08T18:30:08.420 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4599999999999992e-06 2024-05-08T18:30:08.420 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.421 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.421 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:08.421 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.263961+0000", 2024-05-08T18:30:08.421 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015800844000000001 2024-05-08T18:30:08.421 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.421 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.421 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:08.421 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.264091+0000", 2024-05-08T18:30:08.421 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012952300000000001 2024-05-08T18:30:08.421 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.421 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.421 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:08.421 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.264306+0000", 2024-05-08T18:30:08.422 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000215541 2024-05-08T18:30:08.422 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.422 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.422 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:08.422 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.267205+0000", 2024-05-08T18:30:08.422 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0028989910000000001 2024-05-08T18:30:08.422 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.422 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.422 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:08.422 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.268631+0000", 2024-05-08T18:30:08.422 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0014257320000000001 2024-05-08T18:30:08.423 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.423 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.423 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:08.423 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.268781+0000", 2024-05-08T18:30:08.423 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000149939 2024-05-08T18:30:08.423 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.423 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.423 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:08.423 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.268863+0000", 2024-05-08T18:30:08.423 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1762999999999996e-05 2024-05-08T18:30:08.423 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:08.423 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:08.423 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:08.424 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.424 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.424 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:08.424 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.248201+0000", 2024-05-08T18:30:08.424 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 41.098108511, 2024-05-08T18:30:08.424 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.022909783, 2024-05-08T18:30:08.424 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:08.424 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:08.424 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:08.424 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:08.424 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:08.424 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:08.424 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 51 2024-05-08T18:30:08.424 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.425 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:08.425 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.425 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:08.425 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248201+0000", 2024-05-08T18:30:08.425 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:08.425 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.425 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.425 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:08.425 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248201+0000", 2024-05-08T18:30:08.425 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:08.425 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.425 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.425 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:08.426 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248202+0000", 2024-05-08T18:30:08.426 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2999999999999999e-07 2024-05-08T18:30:08.426 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.426 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.426 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:08.426 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248209+0000", 2024-05-08T18:30:08.426 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5769999999999996e-06 2024-05-08T18:30:08.426 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.426 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.426 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:08.426 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248221+0000", 2024-05-08T18:30:08.426 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1165999999999999e-05 2024-05-08T18:30:08.426 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.427 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.427 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:08.427 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248229+0000", 2024-05-08T18:30:08.427 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1529999999999997e-06 2024-05-08T18:30:08.427 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.427 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.427 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:08.427 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.265146+0000", 2024-05-08T18:30:08.427 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016917492999999999 2024-05-08T18:30:08.427 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.427 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.427 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:08.427 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.265282+0000", 2024-05-08T18:30:08.427 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013597199999999999 2024-05-08T18:30:08.428 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.428 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.428 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:08.428 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.265488+0000", 2024-05-08T18:30:08.428 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000206212 2024-05-08T18:30:08.428 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.428 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.428 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:08.428 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.268442+0000", 2024-05-08T18:30:08.428 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002953841 2024-05-08T18:30:08.428 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.428 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.428 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:08.428 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.270951+0000", 2024-05-08T18:30:08.429 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0025085670000000002 2024-05-08T18:30:08.429 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.429 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.429 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:08.429 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.271042+0000", 2024-05-08T18:30:08.429 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1485999999999998e-05 2024-05-08T18:30:08.429 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.429 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.429 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:08.429 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.271111+0000", 2024-05-08T18:30:08.429 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8386000000000006e-05 2024-05-08T18:30:08.429 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:08.429 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:08.429 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:08.430 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.430 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.430 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:08.430 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.248244+0000", 2024-05-08T18:30:08.430 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 41.098065955000003, 2024-05-08T18:30:08.430 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.023010806000000002, 2024-05-08T18:30:08.430 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:08.430 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:08.430 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:08.430 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:08.430 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:08.430 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:08.430 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 52 2024-05-08T18:30:08.431 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.431 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:08.431 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.431 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:08.431 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248244+0000", 2024-05-08T18:30:08.431 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:08.431 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.431 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.431 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:08.431 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248244+0000", 2024-05-08T18:30:08.431 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:08.431 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.431 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.432 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:08.432 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248244+0000", 2024-05-08T18:30:08.432 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0999999999999998e-07 2024-05-08T18:30:08.432 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.432 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.432 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:08.432 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248251+0000", 2024-05-08T18:30:08.432 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9639999999999997e-06 2024-05-08T18:30:08.432 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.432 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.432 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:08.432 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248266+0000", 2024-05-08T18:30:08.432 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4996e-05 2024-05-08T18:30:08.432 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.433 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.433 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:08.433 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248274+0000", 2024-05-08T18:30:08.433 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8299999999999996e-06 2024-05-08T18:30:08.433 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.433 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.433 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:08.433 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266367+0000", 2024-05-08T18:30:08.433 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018092607 2024-05-08T18:30:08.433 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.433 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.433 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:08.433 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266532+0000", 2024-05-08T18:30:08.433 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016569600000000001 2024-05-08T18:30:08.434 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.434 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.434 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:08.434 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266729+0000", 2024-05-08T18:30:08.434 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00019630099999999999 2024-05-08T18:30:08.434 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.434 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.434 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:08.434 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.268574+0000", 2024-05-08T18:30:08.434 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0018452329999999999 2024-05-08T18:30:08.434 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.434 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.434 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:08.435 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.271128+0000", 2024-05-08T18:30:08.435 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00255369 2024-05-08T18:30:08.435 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.435 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.435 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:08.435 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.271199+0000", 2024-05-08T18:30:08.435 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1712999999999996e-05 2024-05-08T18:30:08.435 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.435 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.435 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:08.435 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.271254+0000", 2024-05-08T18:30:08.435 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5065999999999998e-05 2024-05-08T18:30:08.435 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:08.436 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:08.436 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:08.436 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.436 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.436 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:08.436 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.486052+0000", 2024-05-08T18:30:08.436 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 40.860257511, 2024-05-08T18:30:08.436 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0098898389999999992, 2024-05-08T18:30:08.436 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:08.436 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:08.436 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:08.436 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:08.436 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:08.436 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:08.437 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 72 2024-05-08T18:30:08.437 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.437 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:08.437 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.437 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:08.437 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486052+0000", 2024-05-08T18:30:08.437 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:08.437 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.437 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.437 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:08.437 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486052+0000", 2024-05-08T18:30:08.437 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:08.437 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.437 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.438 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:08.438 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486053+0000", 2024-05-08T18:30:08.438 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1200000000000001e-07 2024-05-08T18:30:08.438 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.438 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.438 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:08.438 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486188+0000", 2024-05-08T18:30:08.438 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013526200000000001 2024-05-08T18:30:08.438 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.438 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.438 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:08.438 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486205+0000", 2024-05-08T18:30:08.439 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6742e-05 2024-05-08T18:30:08.439 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.439 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.439 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:08.439 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486215+0000", 2024-05-08T18:30:08.439 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8290000000000003e-06 2024-05-08T18:30:08.439 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.439 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.439 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:08.439 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.491930+0000", 2024-05-08T18:30:08.439 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0057153660000000004 2024-05-08T18:30:08.439 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.439 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.439 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:08.440 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.491995+0000", 2024-05-08T18:30:08.440 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5289000000000005e-05 2024-05-08T18:30:08.440 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.440 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.440 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:08.440 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.492096+0000", 2024-05-08T18:30:08.440 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010101400000000001 2024-05-08T18:30:08.440 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.440 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.440 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:08.440 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.494152+0000", 2024-05-08T18:30:08.441 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0020560740000000002 2024-05-08T18:30:08.441 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.441 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.441 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:08.441 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.495860+0000", 2024-05-08T18:30:08.441 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0017076159999999999 2024-05-08T18:30:08.441 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.441 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.441 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:08.441 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.495903+0000", 2024-05-08T18:30:08.441 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3009000000000001e-05 2024-05-08T18:30:08.441 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.441 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.442 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:08.442 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.495942+0000", 2024-05-08T18:30:08.442 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8726000000000002e-05 2024-05-08T18:30:08.442 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:08.442 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:08.442 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:08.442 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.442 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.442 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:08.442 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.486234+0000", 2024-05-08T18:30:08.442 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 40.860075442999999, 2024-05-08T18:30:08.442 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0099742340000000002, 2024-05-08T18:30:08.443 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:08.443 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:08.443 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:08.443 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:08.443 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:08.443 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:08.443 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 73 2024-05-08T18:30:08.443 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.443 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:08.443 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.443 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:08.443 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486234+0000", 2024-05-08T18:30:08.443 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:08.444 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.444 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.444 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:08.444 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486234+0000", 2024-05-08T18:30:08.444 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:08.444 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.444 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.444 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:08.444 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486235+0000", 2024-05-08T18:30:08.444 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.108e-06 2024-05-08T18:30:08.444 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.444 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.444 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:08.445 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486241+0000", 2024-05-08T18:30:08.445 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4e-06 2024-05-08T18:30:08.445 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.445 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.445 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:08.445 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486251+0000", 2024-05-08T18:30:08.445 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0209e-05 2024-05-08T18:30:08.445 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.445 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.445 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:08.445 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486260+0000", 2024-05-08T18:30:08.445 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2709999999999998e-06 2024-05-08T18:30:08.446 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.446 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.446 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:08.446 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.493294+0000", 2024-05-08T18:30:08.446 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0070341070000000004 2024-05-08T18:30:08.446 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.446 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.446 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:08.446 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.493370+0000", 2024-05-08T18:30:08.446 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5846999999999994e-05 2024-05-08T18:30:08.446 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.446 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.446 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:08.447 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.493479+0000", 2024-05-08T18:30:08.447 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010905500000000001 2024-05-08T18:30:08.447 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.447 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.447 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:08.447 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.495950+0000", 2024-05-08T18:30:08.447 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0024709749999999998 2024-05-08T18:30:08.447 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.447 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.447 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:08.447 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496023+0000", 2024-05-08T18:30:08.447 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3071999999999994e-05 2024-05-08T18:30:08.448 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.448 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.448 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:08.448 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496091+0000", 2024-05-08T18:30:08.448 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7646999999999998e-05 2024-05-08T18:30:08.448 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.448 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.448 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:08.448 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496208+0000", 2024-05-08T18:30:08.448 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000117543 2024-05-08T18:30:08.448 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:08.448 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:08.449 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:08.449 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.449 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.449 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:08.449 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.486276+0000", 2024-05-08T18:30:08.449 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 40.860033117999997, 2024-05-08T18:30:08.449 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010822577, 2024-05-08T18:30:08.449 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:08.449 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:08.449 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:08.449 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:08.449 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:08.449 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:08.450 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 74 2024-05-08T18:30:08.450 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.450 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:08.450 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.450 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:08.450 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486276+0000", 2024-05-08T18:30:08.450 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:08.450 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.450 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.450 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:08.450 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486276+0000", 2024-05-08T18:30:08.450 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:08.451 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.451 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.451 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:08.451 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486277+0000", 2024-05-08T18:30:08.451 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1699999999999997e-07 2024-05-08T18:30:08.451 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.451 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.451 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:08.451 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486282+0000", 2024-05-08T18:30:08.451 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0429999999999998e-06 2024-05-08T18:30:08.451 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.452 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.452 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:08.452 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486294+0000", 2024-05-08T18:30:08.452 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1717e-05 2024-05-08T18:30:08.452 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.452 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.452 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:08.452 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486303+0000", 2024-05-08T18:30:08.452 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.3999999999999998e-06 2024-05-08T18:30:08.452 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.452 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.452 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:08.452 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.494424+0000", 2024-05-08T18:30:08.453 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0081205960000000008 2024-05-08T18:30:08.453 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.453 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.453 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:08.453 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.494539+0000", 2024-05-08T18:30:08.453 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000115661 2024-05-08T18:30:08.453 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.453 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.453 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:08.453 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.494704+0000", 2024-05-08T18:30:08.453 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016422999999999999 2024-05-08T18:30:08.453 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.454 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.454 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:08.454 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496800+0000", 2024-05-08T18:30:08.454 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002096508 2024-05-08T18:30:08.454 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.454 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.454 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:08.454 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496889+0000", 2024-05-08T18:30:08.454 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8349000000000004e-05 2024-05-08T18:30:08.455 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.455 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.455 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:08.455 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496983+0000", 2024-05-08T18:30:08.455 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4882000000000004e-05 2024-05-08T18:30:08.455 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.455 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.455 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:08.455 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.497099+0000", 2024-05-08T18:30:08.455 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000115474 2024-05-08T18:30:08.455 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:08.455 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:08.455 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:08.456 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.456 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.456 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:08.456 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.486324+0000", 2024-05-08T18:30:08.456 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 40.859985098000003, 2024-05-08T18:30:08.456 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010949207000000001, 2024-05-08T18:30:08.456 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:08.456 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:08.456 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:08.456 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:08.456 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:08.456 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:08.456 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 75 2024-05-08T18:30:08.456 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.457 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:08.457 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.457 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:08.457 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486324+0000", 2024-05-08T18:30:08.457 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:08.457 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.457 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.457 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:08.457 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486324+0000", 2024-05-08T18:30:08.457 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:08.457 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.457 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.458 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:08.458 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486325+0000", 2024-05-08T18:30:08.458 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6200000000000006e-07 2024-05-08T18:30:08.458 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.458 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.458 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:08.458 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486439+0000", 2024-05-08T18:30:08.458 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000113391 2024-05-08T18:30:08.458 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.458 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.458 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:08.459 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486455+0000", 2024-05-08T18:30:08.459 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5823000000000001e-05 2024-05-08T18:30:08.459 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.459 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.459 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:08.459 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486465+0000", 2024-05-08T18:30:08.459 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0879999999999999e-05 2024-05-08T18:30:08.459 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.459 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.459 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:08.459 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.495149+0000", 2024-05-08T18:30:08.459 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0086833589999999999 2024-05-08T18:30:08.460 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.460 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.460 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:08.460 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.495213+0000", 2024-05-08T18:30:08.460 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4176000000000004e-05 2024-05-08T18:30:08.460 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.460 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.460 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:08.460 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.495350+0000", 2024-05-08T18:30:08.460 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013709099999999999 2024-05-08T18:30:08.460 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.460 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.460 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:08.461 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496809+0000", 2024-05-08T18:30:08.461 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001458953 2024-05-08T18:30:08.461 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.461 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.461 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:08.461 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.497199+0000", 2024-05-08T18:30:08.461 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00039045200000000001 2024-05-08T18:30:08.461 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.461 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.461 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:08.461 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.497241+0000", 2024-05-08T18:30:08.461 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1378999999999998e-05 2024-05-08T18:30:08.461 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.462 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.462 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:08.462 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.497274+0000", 2024-05-08T18:30:08.462 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2740999999999997e-05 2024-05-08T18:30:08.462 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:08.462 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:08.462 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:08.462 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.462 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.462 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:08.462 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.486483+0000", 2024-05-08T18:30:08.462 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 40.859826923, 2024-05-08T18:30:08.462 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011783448, 2024-05-08T18:30:08.463 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:08.463 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:08.463 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:08.463 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:08.463 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:08.463 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:08.463 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 76 2024-05-08T18:30:08.463 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.463 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:08.463 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.463 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:08.463 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486483+0000", 2024-05-08T18:30:08.463 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:08.463 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.464 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.464 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:08.464 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486483+0000", 2024-05-08T18:30:08.464 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:08.464 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.464 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.464 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:08.464 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486483+0000", 2024-05-08T18:30:08.464 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6599999999999995e-07 2024-05-08T18:30:08.464 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.464 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.464 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:08.464 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486491+0000", 2024-05-08T18:30:08.464 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.2520000000000002e-06 2024-05-08T18:30:08.465 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.465 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.465 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:08.465 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486500+0000", 2024-05-08T18:30:08.465 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4420000000000004e-06 2024-05-08T18:30:08.465 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.465 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.465 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:08.465 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486507+0000", 2024-05-08T18:30:08.465 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3549999999999999e-06 2024-05-08T18:30:08.465 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.465 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.465 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:08.465 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496319+0000", 2024-05-08T18:30:08.466 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0098120529999999994 2024-05-08T18:30:08.466 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.466 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.466 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:08.466 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496391+0000", 2024-05-08T18:30:08.466 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1433000000000005e-05 2024-05-08T18:30:08.466 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.466 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.466 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:08.466 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496508+0000", 2024-05-08T18:30:08.466 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000116778 2024-05-08T18:30:08.466 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.466 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.467 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:08.467 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.497284+0000", 2024-05-08T18:30:08.467 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00077609100000000002 2024-05-08T18:30:08.467 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.467 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.467 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:08.467 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.498204+0000", 2024-05-08T18:30:08.467 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00092027299999999999 2024-05-08T18:30:08.467 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.467 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.467 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:08.467 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.498240+0000", 2024-05-08T18:30:08.467 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5979999999999998e-05 2024-05-08T18:30:08.468 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.468 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.468 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:08.468 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.498266+0000", 2024-05-08T18:30:08.468 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6024999999999999e-05 2024-05-08T18:30:08.468 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:08.468 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:08.468 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:08.468 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.468 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.468 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:94 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:08.468 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.842580+0000", 2024-05-08T18:30:08.468 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 40.503729622000002, 2024-05-08T18:30:08.469 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0085315870000000002, 2024-05-08T18:30:08.469 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:08.469 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:08.469 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:08.469 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:08.469 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:08.469 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:08.469 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 94 2024-05-08T18:30:08.469 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.469 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:08.469 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.469 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:08.469 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.842580+0000", 2024-05-08T18:30:08.469 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:08.469 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.470 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.470 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:08.470 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.842580+0000", 2024-05-08T18:30:08.470 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:08.470 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.470 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.470 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:08.470 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.842581+0000", 2024-05-08T18:30:08.470 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.11e-06 2024-05-08T18:30:08.470 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.470 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.470 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:08.470 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.842587+0000", 2024-05-08T18:30:08.471 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2899999999999999e-06 2024-05-08T18:30:08.471 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.471 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.471 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:08.471 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.842597+0000", 2024-05-08T18:30:08.471 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.007e-05 2024-05-08T18:30:08.471 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.471 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.471 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:08.471 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.842605+0000", 2024-05-08T18:30:08.471 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1270000000000003e-06 2024-05-08T18:30:08.471 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.471 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.471 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:08.472 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.848358+0000", 2024-05-08T18:30:08.472 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0057525140000000002 2024-05-08T18:30:08.472 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.472 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.472 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:08.472 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.848481+0000", 2024-05-08T18:30:08.472 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000123239 2024-05-08T18:30:08.472 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.472 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.472 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:08.472 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.848695+0000", 2024-05-08T18:30:08.472 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000213387 2024-05-08T18:30:08.472 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.472 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.473 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:08.473 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.849781+0000", 2024-05-08T18:30:08.473 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010868 2024-05-08T18:30:08.473 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.473 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.473 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:08.473 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.850990+0000", 2024-05-08T18:30:08.473 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0012084769999999999 2024-05-08T18:30:08.473 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.473 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.473 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:08.473 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.851059+0000", 2024-05-08T18:30:08.473 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9130999999999999e-05 2024-05-08T18:30:08.473 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:08.474 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:08.474 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:08.474 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.851111+0000", 2024-05-08T18:30:08.474 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2441999999999997e-05 2024-05-08T18:30:08.474 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:08.474 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:08.474 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:08.474 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:08.474 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:08.474 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:30:08.476 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-08T18:30:08.476 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:30:08.474+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:30:08.577 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:30:08.578+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:30:08.588 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-05-08T18:30:08.594 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2024-05-08T18:30:08.600 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:30:08.600 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:30:08.600 INFO:teuthology.orchestra.run.smithi097.stdout: "num_ops": 0 2024-05-08T18:30:08.600 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:30:08.605 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2024-05-08T18:30:07.768635+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595683,"num_objects":194,"num_object_clones":0,"num_object_copies":388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":194,"num_whiteouts":0,"num_read":758,"num_read_kb":506,"num_write":528,"num_write_kb":1668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":481,"ondisk_log_size":481,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":229252,"kb_used_data":4732,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754745468,"statfs":{"total":773094113280,"available":772859359232,"internally_reserved":0,"allocated":4845568,"data_stored":2764244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":229756465},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.052769"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.800331+0000","last_change":"2024-05-08T18:29:40.574221+0000","last_active":"2024-05-08T18:30:05.800331+0000","last_peered":"2024-05-08T18:30:05.800331+0000","last_clean":"2024-05-08T18:30:05.800331+0000","last_became_active":"2024-05-08T18:29:40.573543+0000","last_became_peered":"2024-05-08T18:29:40.573543+0000","last_unstale":"2024-05-08T18:30:05.800331+0000","last_undegraded":"2024-05-08T18:30:05.800331+0000","last_fullsized":"2024-05-08T18:30:05.800331+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:57.223609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.793104+0000","last_change":"2024-05-08T18:29:42.563773+0000","last_active":"2024-05-08T18:30:05.793104+0000","last_peered":"2024-05-08T18:30:05.793104+0000","last_clean":"2024-05-08T18:30:05.793104+0000","last_became_active":"2024-05-08T18:29:42.561201+0000","last_became_peered":"2024-05-08T18:29:42.561201+0000","last_unstale":"2024-05-08T18:30:05.793104+0000","last_undegraded":"2024-05-08T18:30:05.793104+0000","last_fullsized":"2024-05-08T18:30:05.793104+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:55.055481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.243159+0000","last_change":"2024-05-08T18:29:40.549299+0000","last_active":"2024-05-08T18:30:05.243159+0000","last_peered":"2024-05-08T18:30:05.243159+0000","last_clean":"2024-05-08T18:30:05.243159+0000","last_became_active":"2024-05-08T18:29:40.548930+0000","last_became_peered":"2024-05-08T18:29:40.548930+0000","last_unstale":"2024-05-08T18:30:05.243159+0000","last_undegraded":"2024-05-08T18:30:05.243159+0000","last_fullsized":"2024-05-08T18:30:05.243159+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:06:36.198647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.796950+0000","last_change":"2024-05-08T18:29:42.572074+0000","last_active":"2024-05-08T18:30:05.796950+0000","last_peered":"2024-05-08T18:30:05.796950+0000","last_clean":"2024-05-08T18:30:05.796950+0000","last_became_active":"2024-05-08T18:29:42.571344+0000","last_became_peered":"2024-05-08T18:29:42.571344+0000","last_unstale":"2024-05-08T18:30:05.796950+0000","last_undegraded":"2024-05-08T18:30:05.796950+0000","last_fullsized":"2024-05-08T18:30:05.796950+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:36.890277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.122580+0000","last_change":"2024-05-08T18:29:40.539048+0000","last_active":"2024-05-08T18:30:04.122580+0000","last_peered":"2024-05-08T18:30:04.122580+0000","last_clean":"2024-05-08T18:30:04.122580+0000","last_became_active":"2024-05-08T18:29:40.538458+0000","last_became_peered":"2024-05-08T18:29:40.538458+0000","last_unstale":"2024-05-08T18:30:04.122580+0000","last_undegraded":"2024-05-08T18:30:04.122580+0000","last_fullsized":"2024-05-08T18:30:04.122580+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:36:37.796095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.796865+0000","last_change":"2024-05-08T18:29:42.569718+0000","last_active":"2024-05-08T18:30:05.796865+0000","last_peered":"2024-05-08T18:30:05.796865+0000","last_clean":"2024-05-08T18:30:05.796865+0000","last_became_active":"2024-05-08T18:29:42.569026+0000","last_became_peered":"2024-05-08T18:29:42.569026+0000","last_unstale":"2024-05-08T18:30:05.796865+0000","last_undegraded":"2024-05-08T18:30:05.796865+0000","last_fullsized":"2024-05-08T18:30:05.796865+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:42.045615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.794465+0000","last_change":"2024-05-08T18:29:40.557700+0000","last_active":"2024-05-08T18:30:05.794465+0000","last_peered":"2024-05-08T18:30:05.794465+0000","last_clean":"2024-05-08T18:30:05.794465+0000","last_became_active":"2024-05-08T18:29:40.556884+0000","last_became_peered":"2024-05-08T18:29:40.556884+0000","last_unstale":"2024-05-08T18:30:05.794465+0000","last_undegraded":"2024-05-08T18:30:05.794465+0000","last_fullsized":"2024-05-08T18:30:05.794465+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:21:38.354933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.123066+0000","last_change":"2024-05-08T18:29:42.566448+0000","last_active":"2024-05-08T18:30:04.123066+0000","last_peered":"2024-05-08T18:30:04.123066+0000","last_clean":"2024-05-08T18:30:04.123066+0000","last_became_active":"2024-05-08T18:29:42.566058+0000","last_became_peered":"2024-05-08T18:29:42.566058+0000","last_unstale":"2024-05-08T18:30:04.123066+0000","last_undegraded":"2024-05-08T18:30:04.123066+0000","last_fullsized":"2024-05-08T18:30:04.123066+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:53:03.097704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.798456+0000","last_change":"2024-05-08T18:29:40.571195+0000","last_active":"2024-05-08T18:30:05.798456+0000","last_peered":"2024-05-08T18:30:05.798456+0000","last_clean":"2024-05-08T18:30:05.798456+0000","last_became_active":"2024-05-08T18:29:40.570467+0000","last_became_peered":"2024-05-08T18:29:40.570467+0000","last_unstale":"2024-05-08T18:30:05.798456+0000","last_undegraded":"2024-05-08T18:30:05.798456+0000","last_fullsized":"2024-05-08T18:30:05.798456+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:39.986094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.740527+0000","last_change":"2024-05-08T18:29:42.566506+0000","last_active":"2024-05-08T18:30:05.740527+0000","last_peered":"2024-05-08T18:30:05.740527+0000","last_clean":"2024-05-08T18:30:05.740527+0000","last_became_active":"2024-05-08T18:29:42.565740+0000","last_became_peered":"2024-05-08T18:29:42.565740+0000","last_unstale":"2024-05-08T18:30:05.740527+0000","last_undegraded":"2024-05-08T18:30:05.740527+0000","last_fullsized":"2024-05-08T18:30:05.740527+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:58.320701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.793882+0000","last_change":"2024-05-08T18:29:40.538314+0000","last_active":"2024-05-08T18:30:05.793882+0000","last_peered":"2024-05-08T18:30:05.793882+0000","last_clean":"2024-05-08T18:30:05.793882+0000","last_became_active":"2024-05-08T18:29:40.537458+0000","last_became_peered":"2024-05-08T18:29:40.537458+0000","last_unstale":"2024-05-08T18:30:05.793882+0000","last_undegraded":"2024-05-08T18:30:05.793882+0000","last_fullsized":"2024-05-08T18:30:05.793882+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:56.300986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.797979+0000","last_change":"2024-05-08T18:29:42.570054+0000","last_active":"2024-05-08T18:30:05.797979+0000","last_peered":"2024-05-08T18:30:05.797979+0000","last_clean":"2024-05-08T18:30:05.797979+0000","last_became_active":"2024-05-08T18:29:42.569255+0000","last_became_peered":"2024-05-08T18:29:42.569255+0000","last_unstale":"2024-05-08T18:30:05.797979+0000","last_undegraded":"2024-05-08T18:30:05.797979+0000","last_fullsized":"2024-05-08T18:30:05.797979+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:11:01.702482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.797212+0000","last_change":"2024-05-08T18:29:40.559212+0000","last_active":"2024-05-08T18:30:05.797212+0000","last_peered":"2024-05-08T18:30:05.797212+0000","last_clean":"2024-05-08T18:30:05.797212+0000","last_became_active":"2024-05-08T18:29:40.558501+0000","last_became_peered":"2024-05-08T18:29:40.558501+0000","last_unstale":"2024-05-08T18:30:05.797212+0000","last_undegraded":"2024-05-08T18:30:05.797212+0000","last_fullsized":"2024-05-08T18:30:05.797212+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:36:14.096907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.798553+0000","last_change":"2024-05-08T18:29:42.562084+0000","last_active":"2024-05-08T18:30:05.798553+0000","last_peered":"2024-05-08T18:30:05.798553+0000","last_clean":"2024-05-08T18:30:05.798553+0000","last_became_active":"2024-05-08T18:29:42.560699+0000","last_became_peered":"2024-05-08T18:29:42.560699+0000","last_unstale":"2024-05-08T18:30:05.798553+0000","last_undegraded":"2024-05-08T18:30:05.798553+0000","last_fullsized":"2024-05-08T18:30:05.798553+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:09.787597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.731147+0000","last_change":"2024-05-08T18:29:40.564339+0000","last_active":"2024-05-08T18:30:04.731147+0000","last_peered":"2024-05-08T18:30:04.731147+0000","last_clean":"2024-05-08T18:30:04.731147+0000","last_became_active":"2024-05-08T18:29:40.564038+0000","last_became_peered":"2024-05-08T18:29:40.564038+0000","last_unstale":"2024-05-08T18:30:04.731147+0000","last_undegraded":"2024-05-08T18:30:04.731147+0000","last_fullsized":"2024-05-08T18:30:04.731147+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:40:23.287885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.734382+0000","last_change":"2024-05-08T18:29:42.570253+0000","last_active":"2024-05-08T18:30:04.734382+0000","last_peered":"2024-05-08T18:30:04.734382+0000","last_clean":"2024-05-08T18:30:04.734382+0000","last_became_active":"2024-05-08T18:29:42.569917+0000","last_became_peered":"2024-05-08T18:29:42.569917+0000","last_unstale":"2024-05-08T18:30:04.734382+0000","last_undegraded":"2024-05-08T18:30:04.734382+0000","last_fullsized":"2024-05-08T18:30:04.734382+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:14:45.575219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.795404+0000","last_change":"2024-05-08T18:29:42.568116+0000","last_active":"2024-05-08T18:30:05.795404+0000","last_peered":"2024-05-08T18:30:05.795404+0000","last_clean":"2024-05-08T18:30:05.795404+0000","last_became_active":"2024-05-08T18:29:42.567399+0000","last_became_peered":"2024-05-08T18:29:42.567399+0000","last_unstale":"2024-05-08T18:30:05.795404+0000","last_undegraded":"2024-05-08T18:30:05.795404+0000","last_fullsized":"2024-05-08T18:30:05.795404+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:35.037465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.800554+0000","last_change":"2024-05-08T18:29:40.571982+0000","last_active":"2024-05-08T18:30:05.800554+0000","last_peered":"2024-05-08T18:30:05.800554+0000","last_clean":"2024-05-08T18:30:05.800554+0000","last_became_active":"2024-05-08T18:29:40.570600+0000","last_became_peered":"2024-05-08T18:29:40.570600+0000","last_unstale":"2024-05-08T18:30:05.800554+0000","last_undegraded":"2024-05-08T18:30:05.800554+0000","last_fullsized":"2024-05-08T18:30:05.800554+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:54:14.520118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.797084+0000","last_change":"2024-05-08T18:29:42.578449+0000","last_active":"2024-05-08T18:30:05.797084+0000","last_peered":"2024-05-08T18:30:05.797084+0000","last_clean":"2024-05-08T18:30:05.797084+0000","last_became_active":"2024-05-08T18:29:42.577789+0000","last_became_peered":"2024-05-08T18:29:42.577789+0000","last_unstale":"2024-05-08T18:30:05.797084+0000","last_undegraded":"2024-05-08T18:30:05.797084+0000","last_fullsized":"2024-05-08T18:30:05.797084+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:09.787597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.741599+0000","last_change":"2024-05-08T18:29:40.570618+0000","last_active":"2024-05-08T18:30:05.741599+0000","last_peered":"2024-05-08T18:30:05.741599+0000","last_clean":"2024-05-08T18:30:05.741599+0000","last_became_active":"2024-05-08T18:29:40.569519+0000","last_became_peered":"2024-05-08T18:29:40.569519+0000","last_unstale":"2024-05-08T18:30:05.741599+0000","last_undegraded":"2024-05-08T18:30:05.741599+0000","last_fullsized":"2024-05-08T18:30:05.741599+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:09:42.581976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.794115+0000","last_change":"2024-05-08T18:29:42.563056+0000","last_active":"2024-05-08T18:30:05.794115+0000","last_peered":"2024-05-08T18:30:05.794115+0000","last_clean":"2024-05-08T18:30:05.794115+0000","last_became_active":"2024-05-08T18:29:42.562296+0000","last_became_peered":"2024-05-08T18:29:42.562296+0000","last_unstale":"2024-05-08T18:30:05.794115+0000","last_undegraded":"2024-05-08T18:30:05.794115+0000","last_fullsized":"2024-05-08T18:30:05.794115+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:36.890277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.741577+0000","last_change":"2024-05-08T18:29:40.564353+0000","last_active":"2024-05-08T18:30:05.741577+0000","last_peered":"2024-05-08T18:30:05.741577+0000","last_clean":"2024-05-08T18:30:05.741577+0000","last_became_active":"2024-05-08T18:29:40.563516+0000","last_became_peered":"2024-05-08T18:29:40.563516+0000","last_unstale":"2024-05-08T18:30:05.741577+0000","last_undegraded":"2024-05-08T18:30:05.741577+0000","last_fullsized":"2024-05-08T18:30:05.741577+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:06:36.198647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.731987+0000","last_change":"2024-05-08T18:29:42.567006+0000","last_active":"2024-05-08T18:30:04.731987+0000","last_peered":"2024-05-08T18:30:04.731987+0000","last_clean":"2024-05-08T18:30:04.731987+0000","last_became_active":"2024-05-08T18:29:42.566256+0000","last_became_peered":"2024-05-08T18:29:42.566256+0000","last_unstale":"2024-05-08T18:30:04.731987+0000","last_undegraded":"2024-05-08T18:30:04.731987+0000","last_fullsized":"2024-05-08T18:30:04.731987+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:09:44.601690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.797327+0000","last_change":"2024-05-08T18:29:40.573212+0000","last_active":"2024-05-08T18:30:05.797327+0000","last_peered":"2024-05-08T18:30:05.797327+0000","last_clean":"2024-05-08T18:30:05.797327+0000","last_became_active":"2024-05-08T18:29:40.572250+0000","last_became_peered":"2024-05-08T18:29:40.572250+0000","last_unstale":"2024-05-08T18:30:05.797327+0000","last_undegraded":"2024-05-08T18:30:05.797327+0000","last_fullsized":"2024-05-08T18:30:05.797327+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:25:01.595224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.732771+0000","last_change":"2024-05-08T18:29:42.570847+0000","last_active":"2024-05-08T18:30:04.732771+0000","last_peered":"2024-05-08T18:30:04.732771+0000","last_clean":"2024-05-08T18:30:04.732771+0000","last_became_active":"2024-05-08T18:29:42.570435+0000","last_became_peered":"2024-05-08T18:29:42.570435+0000","last_unstale":"2024-05-08T18:30:04.732771+0000","last_undegraded":"2024-05-08T18:30:04.732771+0000","last_fullsized":"2024-05-08T18:30:04.732771+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:21:40.374647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.731812+0000","last_change":"2024-05-08T18:29:40.566815+0000","last_active":"2024-05-08T18:30:04.731812+0000","last_peered":"2024-05-08T18:30:04.731812+0000","last_clean":"2024-05-08T18:30:04.731812+0000","last_became_active":"2024-05-08T18:29:40.566531+0000","last_became_peered":"2024-05-08T18:29:40.566531+0000","last_unstale":"2024-05-08T18:30:04.731812+0000","last_undegraded":"2024-05-08T18:30:04.731812+0000","last_fullsized":"2024-05-08T18:30:04.731812+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:52.462279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.798515+0000","last_change":"2024-05-08T18:29:42.554846+0000","last_active":"2024-05-08T18:30:05.798515+0000","last_peered":"2024-05-08T18:30:05.798515+0000","last_clean":"2024-05-08T18:30:05.798515+0000","last_became_active":"2024-05-08T18:29:42.554115+0000","last_became_peered":"2024-05-08T18:29:42.554115+0000","last_unstale":"2024-05-08T18:30:05.798515+0000","last_undegraded":"2024-05-08T18:30:05.798515+0000","last_fullsized":"2024-05-08T18:30:05.798515+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:22:14.793035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.123617+0000","last_change":"2024-05-08T18:29:40.547776+0000","last_active":"2024-05-08T18:30:04.123617+0000","last_peered":"2024-05-08T18:30:04.123617+0000","last_clean":"2024-05-08T18:30:04.123617+0000","last_became_active":"2024-05-08T18:29:40.547384+0000","last_became_peered":"2024-05-08T18:29:40.547384+0000","last_unstale":"2024-05-08T18:30:04.123617+0000","last_undegraded":"2024-05-08T18:30:04.123617+0000","last_fullsized":"2024-05-08T18:30:04.123617+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:14:26.628603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.793771+0000","last_change":"2024-05-08T18:29:50.685390+0000","last_active":"2024-05-08T18:30:05.793771+0000","last_peered":"2024-05-08T18:30:05.793771+0000","last_clean":"2024-05-08T18:30:05.793771+0000","last_became_active":"2024-05-08T18:29:50.684644+0000","last_became_peered":"2024-05-08T18:29:50.684644+0000","last_unstale":"2024-05-08T18:30:05.793771+0000","last_undegraded":"2024-05-08T18:30:05.793771+0000","last_fullsized":"2024-05-08T18:30:05.793771+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:10:38.951662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.733149+0000","last_change":"2024-05-08T18:29:42.573805+0000","last_active":"2024-05-08T18:30:04.733149+0000","last_peered":"2024-05-08T18:30:04.733149+0000","last_clean":"2024-05-08T18:30:04.733149+0000","last_became_active":"2024-05-08T18:29:42.573296+0000","last_became_peered":"2024-05-08T18:29:42.573296+0000","last_unstale":"2024-05-08T18:30:04.733149+0000","last_undegraded":"2024-05-08T18:30:04.733149+0000","last_fullsized":"2024-05-08T18:30:04.733149+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:21.935293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.798820+0000","last_change":"2024-05-08T18:29:40.570733+0000","last_active":"2024-05-08T18:30:05.798820+0000","last_peered":"2024-05-08T18:30:05.798820+0000","last_clean":"2024-05-08T18:30:05.798820+0000","last_became_active":"2024-05-08T18:29:40.569711+0000","last_became_peered":"2024-05-08T18:29:40.569711+0000","last_unstale":"2024-05-08T18:30:05.798820+0000","last_undegraded":"2024-05-08T18:30:05.798820+0000","last_fullsized":"2024-05-08T18:30:05.798820+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:18:08.784274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.795823+0000","last_change":"2024-05-08T18:29:44.594185+0000","last_active":"2024-05-08T18:30:05.795823+0000","last_peered":"2024-05-08T18:30:05.795823+0000","last_clean":"2024-05-08T18:30:05.795823+0000","last_became_active":"2024-05-08T18:29:44.593442+0000","last_became_peered":"2024-05-08T18:29:44.593442+0000","last_unstale":"2024-05-08T18:30:05.795823+0000","last_undegraded":"2024-05-08T18:30:05.795823+0000","last_fullsized":"2024-05-08T18:30:05.795823+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:52:25.736491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"33'9","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.122746+0000","last_change":"2024-05-08T18:29:46.594652+0000","last_active":"2024-05-08T18:30:04.122746+0000","last_peered":"2024-05-08T18:30:04.122746+0000","last_clean":"2024-05-08T18:30:04.122746+0000","last_became_active":"2024-05-08T18:29:46.593656+0000","last_became_peered":"2024-05-08T18:29:46.593656+0000","last_unstale":"2024-05-08T18:30:04.122746+0000","last_undegraded":"2024-05-08T18:30:04.122746+0000","last_fullsized":"2024-05-08T18:30:04.122746+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:50:27.608888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":28,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.799814+0000","last_change":"2024-05-08T18:29:48.639834+0000","last_active":"2024-05-08T18:30:05.799814+0000","last_peered":"2024-05-08T18:30:05.799814+0000","last_clean":"2024-05-08T18:30:05.799814+0000","last_became_active":"2024-05-08T18:29:48.639122+0000","last_became_peered":"2024-05-08T18:29:48.639122+0000","last_unstale":"2024-05-08T18:30:05.799814+0000","last_undegraded":"2024-05-08T18:30:05.799814+0000","last_fullsized":"2024-05-08T18:30:05.799814+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:14:22.304773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.793143+0000","last_change":"2024-05-08T18:29:50.672303+0000","last_active":"2024-05-08T18:30:05.793143+0000","last_peered":"2024-05-08T18:30:05.793143+0000","last_clean":"2024-05-08T18:30:05.793143+0000","last_became_active":"2024-05-08T18:29:50.671513+0000","last_became_peered":"2024-05-08T18:29:50.671513+0000","last_unstale":"2024-05-08T18:30:05.793143+0000","last_undegraded":"2024-05-08T18:30:05.793143+0000","last_fullsized":"2024-05-08T18:30:05.793143+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:12:05.780786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.796438+0000","last_change":"2024-05-08T18:29:42.565462+0000","last_active":"2024-05-08T18:30:05.796438+0000","last_peered":"2024-05-08T18:30:05.796438+0000","last_clean":"2024-05-08T18:30:05.796438+0000","last_became_active":"2024-05-08T18:29:42.564741+0000","last_became_peered":"2024-05-08T18:29:42.564741+0000","last_unstale":"2024-05-08T18:30:05.796438+0000","last_undegraded":"2024-05-08T18:30:05.796438+0000","last_fullsized":"2024-05-08T18:30:05.796438+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:25:56.129785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.123858+0000","last_change":"2024-05-08T18:29:40.564796+0000","last_active":"2024-05-08T18:30:04.123858+0000","last_peered":"2024-05-08T18:30:04.123858+0000","last_clean":"2024-05-08T18:30:04.123858+0000","last_became_active":"2024-05-08T18:29:40.564401+0000","last_became_peered":"2024-05-08T18:29:40.564401+0000","last_unstale":"2024-05-08T18:30:04.123858+0000","last_undegraded":"2024-05-08T18:30:04.123858+0000","last_fullsized":"2024-05-08T18:30:04.123858+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:19:11.492397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.733013+0000","last_change":"2024-05-08T18:29:44.587689+0000","last_active":"2024-05-08T18:30:04.733013+0000","last_peered":"2024-05-08T18:30:04.733013+0000","last_clean":"2024-05-08T18:30:04.733013+0000","last_became_active":"2024-05-08T18:29:44.586975+0000","last_became_peered":"2024-05-08T18:29:44.586975+0000","last_unstale":"2024-05-08T18:30:04.733013+0000","last_undegraded":"2024-05-08T18:30:04.733013+0000","last_fullsized":"2024-05-08T18:30:04.733013+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:04:49.020450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"33'6","reported_seq":41,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.798250+0000","last_change":"2024-05-08T18:29:46.600906+0000","last_active":"2024-05-08T18:30:05.798250+0000","last_peered":"2024-05-08T18:30:05.798250+0000","last_clean":"2024-05-08T18:30:05.798250+0000","last_became_active":"2024-05-08T18:29:46.599894+0000","last_became_peered":"2024-05-08T18:29:46.599894+0000","last_unstale":"2024-05-08T18:30:05.798250+0000","last_undegraded":"2024-05-08T18:30:05.798250+0000","last_fullsized":"2024-05-08T18:30:05.798250+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:24:13.568294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":28,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.797923+0000","last_change":"2024-05-08T18:29:48.614324+0000","last_active":"2024-05-08T18:30:05.797923+0000","last_peered":"2024-05-08T18:30:05.797923+0000","last_clean":"2024-05-08T18:30:05.797923+0000","last_became_active":"2024-05-08T18:29:48.613591+0000","last_became_peered":"2024-05-08T18:29:48.613591+0000","last_unstale":"2024-05-08T18:30:05.797923+0000","last_undegraded":"2024-05-08T18:30:05.797923+0000","last_fullsized":"2024-05-08T18:30:05.797923+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:47:54.034851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.122904+0000","last_change":"2024-05-08T18:29:50.684773+0000","last_active":"2024-05-08T18:30:04.122904+0000","last_peered":"2024-05-08T18:30:04.122904+0000","last_clean":"2024-05-08T18:30:04.122904+0000","last_became_active":"2024-05-08T18:29:50.683931+0000","last_became_peered":"2024-05-08T18:29:50.683931+0000","last_unstale":"2024-05-08T18:30:04.122904+0000","last_undegraded":"2024-05-08T18:30:04.122904+0000","last_fullsized":"2024-05-08T18:30:04.122904+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:17:10.582636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.123733+0000","last_change":"2024-05-08T18:29:42.574437+0000","last_active":"2024-05-08T18:30:04.123733+0000","last_peered":"2024-05-08T18:30:04.123733+0000","last_clean":"2024-05-08T18:30:04.123733+0000","last_became_active":"2024-05-08T18:29:42.574146+0000","last_became_peered":"2024-05-08T18:29:42.574146+0000","last_unstale":"2024-05-08T18:30:04.123733+0000","last_undegraded":"2024-05-08T18:30:04.123733+0000","last_fullsized":"2024-05-08T18:30:04.123733+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:55:30.468069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.797438+0000","last_change":"2024-05-08T18:29:40.559677+0000","last_active":"2024-05-08T18:30:05.797438+0000","last_peered":"2024-05-08T18:30:05.797438+0000","last_clean":"2024-05-08T18:30:05.797438+0000","last_became_active":"2024-05-08T18:29:40.558819+0000","last_became_peered":"2024-05-08T18:29:40.558819+0000","last_unstale":"2024-05-08T18:30:05.797438+0000","last_undegraded":"2024-05-08T18:30:05.797438+0000","last_fullsized":"2024-05-08T18:30:05.797438+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:28.426657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.734369+0000","last_change":"2024-05-08T18:29:44.596801+0000","last_active":"2024-05-08T18:30:04.734369+0000","last_peered":"2024-05-08T18:30:04.734369+0000","last_clean":"2024-05-08T18:30:04.734369+0000","last_became_active":"2024-05-08T18:29:44.596111+0000","last_became_peered":"2024-05-08T18:29:44.596111+0000","last_unstale":"2024-05-08T18:30:04.734369+0000","last_undegraded":"2024-05-08T18:30:04.734369+0000","last_fullsized":"2024-05-08T18:30:04.734369+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:04.423266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"33'10","reported_seq":45,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.732544+0000","last_change":"2024-05-08T18:29:46.608330+0000","last_active":"2024-05-08T18:30:04.732544+0000","last_peered":"2024-05-08T18:30:04.732544+0000","last_clean":"2024-05-08T18:30:04.732544+0000","last_became_active":"2024-05-08T18:29:46.607580+0000","last_became_peered":"2024-05-08T18:29:46.607580+0000","last_unstale":"2024-05-08T18:30:04.732544+0000","last_undegraded":"2024-05-08T18:30:04.732544+0000","last_fullsized":"2024-05-08T18:30:04.732544+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:22:18.837103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"30'2","reported_seq":34,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.799196+0000","last_change":"2024-05-08T18:29:48.642718+0000","last_active":"2024-05-08T18:30:05.799196+0000","last_peered":"2024-05-08T18:30:05.799196+0000","last_clean":"2024-05-08T18:30:05.799196+0000","last_became_active":"2024-05-08T18:29:48.641950+0000","last_became_peered":"2024-05-08T18:29:48.641950+0000","last_unstale":"2024-05-08T18:30:05.799196+0000","last_undegraded":"2024-05-08T18:30:05.799196+0000","last_fullsized":"2024-05-08T18:30:05.799196+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:00:11.720096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.796417+0000","last_change":"2024-05-08T18:29:50.660378+0000","last_active":"2024-05-08T18:30:05.796417+0000","last_peered":"2024-05-08T18:30:05.796417+0000","last_clean":"2024-05-08T18:30:05.796417+0000","last_became_active":"2024-05-08T18:29:50.659649+0000","last_became_peered":"2024-05-08T18:29:50.659649+0000","last_unstale":"2024-05-08T18:30:05.796417+0000","last_undegraded":"2024-05-08T18:30:05.796417+0000","last_fullsized":"2024-05-08T18:30:05.796417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:34:14.488295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.733883+0000","last_change":"2024-05-08T18:29:42.577267+0000","last_active":"2024-05-08T18:30:04.733883+0000","last_peered":"2024-05-08T18:30:04.733883+0000","last_clean":"2024-05-08T18:30:04.733883+0000","last_became_active":"2024-05-08T18:29:42.576740+0000","last_became_peered":"2024-05-08T18:29:42.576740+0000","last_unstale":"2024-05-08T18:30:04.733883+0000","last_undegraded":"2024-05-08T18:30:04.733883+0000","last_fullsized":"2024-05-08T18:30:04.733883+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:57:14.869860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.739876+0000","last_change":"2024-05-08T18:29:40.547524+0000","last_active":"2024-05-08T18:30:05.739876+0000","last_peered":"2024-05-08T18:30:05.739876+0000","last_clean":"2024-05-08T18:30:05.739876+0000","last_became_active":"2024-05-08T18:29:40.545749+0000","last_became_peered":"2024-05-08T18:29:40.545749+0000","last_unstale":"2024-05-08T18:30:05.739876+0000","last_undegraded":"2024-05-08T18:30:05.739876+0000","last_fullsized":"2024-05-08T18:30:05.739876+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:12:59.146887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.798307+0000","last_change":"2024-05-08T18:29:44.579839+0000","last_active":"2024-05-08T18:30:05.798307+0000","last_peered":"2024-05-08T18:30:05.798307+0000","last_clean":"2024-05-08T18:30:05.798307+0000","last_became_active":"2024-05-08T18:29:44.578142+0000","last_became_peered":"2024-05-08T18:29:44.578142+0000","last_unstale":"2024-05-08T18:30:05.798307+0000","last_undegraded":"2024-05-08T18:30:05.798307+0000","last_fullsized":"2024-05-08T18:30:05.798307+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:51:09.413191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"33'9","reported_seq":48,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.799507+0000","last_change":"2024-05-08T18:29:46.607288+0000","last_active":"2024-05-08T18:30:05.799507+0000","last_peered":"2024-05-08T18:30:05.799507+0000","last_clean":"2024-05-08T18:30:05.799507+0000","last_became_active":"2024-05-08T18:29:46.605154+0000","last_became_peered":"2024-05-08T18:29:46.605154+0000","last_unstale":"2024-05-08T18:30:05.799507+0000","last_undegraded":"2024-05-08T18:30:05.799507+0000","last_fullsized":"2024-05-08T18:30:05.799507+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:23.940519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"30'2","reported_seq":32,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.732675+0000","last_change":"2024-05-08T18:29:48.634956+0000","last_active":"2024-05-08T18:30:04.732675+0000","last_peered":"2024-05-08T18:30:04.732675+0000","last_clean":"2024-05-08T18:30:04.732675+0000","last_became_active":"2024-05-08T18:29:48.633858+0000","last_became_peered":"2024-05-08T18:29:48.633858+0000","last_unstale":"2024-05-08T18:30:04.732675+0000","last_undegraded":"2024-05-08T18:30:04.732675+0000","last_fullsized":"2024-05-08T18:30:04.732675+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:50:48.169666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.793404+0000","last_change":"2024-05-08T18:29:42.567744+0000","last_active":"2024-05-08T18:30:05.793404+0000","last_peered":"2024-05-08T18:30:05.793404+0000","last_clean":"2024-05-08T18:30:05.793404+0000","last_became_active":"2024-05-08T18:29:42.566974+0000","last_became_peered":"2024-05-08T18:29:42.566974+0000","last_unstale":"2024-05-08T18:30:05.793404+0000","last_undegraded":"2024-05-08T18:30:05.793404+0000","last_fullsized":"2024-05-08T18:30:05.793404+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:42.045615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.800771+0000","last_change":"2024-05-08T18:29:40.572499+0000","last_active":"2024-05-08T18:30:05.800771+0000","last_peered":"2024-05-08T18:30:05.800771+0000","last_clean":"2024-05-08T18:30:05.800771+0000","last_became_active":"2024-05-08T18:29:40.571322+0000","last_became_peered":"2024-05-08T18:29:40.571322+0000","last_unstale":"2024-05-08T18:30:05.800771+0000","last_undegraded":"2024-05-08T18:30:05.800771+0000","last_fullsized":"2024-05-08T18:30:05.800771+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:31.119374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.796375+0000","last_change":"2024-05-08T18:29:44.597045+0000","last_active":"2024-05-08T18:30:05.796375+0000","last_peered":"2024-05-08T18:30:05.796375+0000","last_clean":"2024-05-08T18:30:05.796375+0000","last_became_active":"2024-05-08T18:29:44.596282+0000","last_became_peered":"2024-05-08T18:29:44.596282+0000","last_unstale":"2024-05-08T18:30:05.796375+0000","last_undegraded":"2024-05-08T18:30:05.796375+0000","last_fullsized":"2024-05-08T18:30:05.796375+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:35:51.288126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"33'19","reported_seq":63,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.793317+0000","last_change":"2024-05-08T18:29:46.590633+0000","last_active":"2024-05-08T18:30:05.793317+0000","last_peered":"2024-05-08T18:30:05.793317+0000","last_clean":"2024-05-08T18:30:05.793317+0000","last_became_active":"2024-05-08T18:29:46.589600+0000","last_became_peered":"2024-05-08T18:29:46.589600+0000","last_unstale":"2024-05-08T18:30:05.793317+0000","last_undegraded":"2024-05-08T18:30:05.793317+0000","last_fullsized":"2024-05-08T18:30:05.793317+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:23.940519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":26,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.242381+0000","last_change":"2024-05-08T18:29:48.630758+0000","last_active":"2024-05-08T18:30:05.242381+0000","last_peered":"2024-05-08T18:30:05.242381+0000","last_clean":"2024-05-08T18:30:05.242381+0000","last_became_active":"2024-05-08T18:29:48.630017+0000","last_became_peered":"2024-05-08T18:29:48.630017+0000","last_unstale":"2024-05-08T18:30:05.242381+0000","last_undegraded":"2024-05-08T18:30:05.242381+0000","last_fullsized":"2024-05-08T18:30:05.242381+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:39.879384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.793939+0000","last_change":"2024-05-08T18:29:50.672682+0000","last_active":"2024-05-08T18:30:05.793939+0000","last_peered":"2024-05-08T18:30:05.793939+0000","last_clean":"2024-05-08T18:30:05.793939+0000","last_became_active":"2024-05-08T18:29:50.671923+0000","last_became_peered":"2024-05-08T18:29:50.671923+0000","last_unstale":"2024-05-08T18:30:05.793939+0000","last_undegraded":"2024-05-08T18:30:05.793939+0000","last_fullsized":"2024-05-08T18:30:05.793939+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:38.318890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.795522+0000","last_change":"2024-05-08T18:29:42.554289+0000","last_active":"2024-05-08T18:30:05.795522+0000","last_peered":"2024-05-08T18:30:05.795522+0000","last_clean":"2024-05-08T18:30:05.795522+0000","last_became_active":"2024-05-08T18:29:42.553574+0000","last_became_peered":"2024-05-08T18:29:42.553574+0000","last_unstale":"2024-05-08T18:30:05.795522+0000","last_undegraded":"2024-05-08T18:30:05.795522+0000","last_fullsized":"2024-05-08T18:30:05.795522+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:42.005809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.800256+0000","last_change":"2024-05-08T18:29:40.570169+0000","last_active":"2024-05-08T18:30:05.800256+0000","last_peered":"2024-05-08T18:30:05.800256+0000","last_clean":"2024-05-08T18:30:05.800256+0000","last_became_active":"2024-05-08T18:29:40.569542+0000","last_became_peered":"2024-05-08T18:29:40.569542+0000","last_unstale":"2024-05-08T18:30:05.800256+0000","last_undegraded":"2024-05-08T18:30:05.800256+0000","last_fullsized":"2024-05-08T18:30:05.800256+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:08:13.006752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"26'1","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.731439+0000","last_change":"2024-05-08T18:29:44.579659+0000","last_active":"2024-05-08T18:30:04.731439+0000","last_peered":"2024-05-08T18:30:04.731439+0000","last_clean":"2024-05-08T18:30:04.731439+0000","last_became_active":"2024-05-08T18:29:44.579152+0000","last_became_peered":"2024-05-08T18:29:44.579152+0000","last_unstale":"2024-05-08T18:30:04.731439+0000","last_undegraded":"2024-05-08T18:30:04.731439+0000","last_fullsized":"2024-05-08T18:30:04.731439+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:15:00.358583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"33'9","reported_seq":46,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.732290+0000","last_change":"2024-05-08T18:29:46.600224+0000","last_active":"2024-05-08T18:30:04.732290+0000","last_peered":"2024-05-08T18:30:04.732290+0000","last_clean":"2024-05-08T18:30:04.732290+0000","last_became_active":"2024-05-08T18:29:46.599464+0000","last_became_peered":"2024-05-08T18:29:46.599464+0000","last_unstale":"2024-05-08T18:30:04.732290+0000","last_undegraded":"2024-05-08T18:30:04.732290+0000","last_fullsized":"2024-05-08T18:30:04.732290+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:26:40.238188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":26,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.730442+0000","last_change":"2024-05-08T18:29:48.637939+0000","last_active":"2024-05-08T18:30:04.730442+0000","last_peered":"2024-05-08T18:30:04.730442+0000","last_clean":"2024-05-08T18:30:04.730442+0000","last_became_active":"2024-05-08T18:29:48.637231+0000","last_became_peered":"2024-05-08T18:29:48.637231+0000","last_unstale":"2024-05-08T18:30:04.730442+0000","last_undegraded":"2024-05-08T18:30:04.730442+0000","last_fullsized":"2024-05-08T18:30:04.730442+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:04.571608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.740227+0000","last_change":"2024-05-08T18:29:50.681831+0000","last_active":"2024-05-08T18:30:05.740227+0000","last_peered":"2024-05-08T18:30:05.740227+0000","last_clean":"2024-05-08T18:30:05.740227+0000","last_became_active":"2024-05-08T18:29:50.681287+0000","last_became_peered":"2024-05-08T18:29:50.681287+0000","last_unstale":"2024-05-08T18:30:05.740227+0000","last_undegraded":"2024-05-08T18:30:05.740227+0000","last_fullsized":"2024-05-08T18:30:05.740227+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:30:24.111488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.740675+0000","last_change":"2024-05-08T18:29:42.562975+0000","last_active":"2024-05-08T18:30:05.740675+0000","last_peered":"2024-05-08T18:30:05.740675+0000","last_clean":"2024-05-08T18:30:05.740675+0000","last_became_active":"2024-05-08T18:29:42.562267+0000","last_became_peered":"2024-05-08T18:29:42.562267+0000","last_unstale":"2024-05-08T18:30:05.740675+0000","last_undegraded":"2024-05-08T18:30:05.740675+0000","last_fullsized":"2024-05-08T18:30:05.740675+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:30.446371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.800583+0000","last_change":"2024-05-08T18:29:40.570736+0000","last_active":"2024-05-08T18:30:05.800583+0000","last_peered":"2024-05-08T18:30:05.800583+0000","last_clean":"2024-05-08T18:30:05.800583+0000","last_became_active":"2024-05-08T18:29:40.569626+0000","last_became_peered":"2024-05-08T18:29:40.569626+0000","last_unstale":"2024-05-08T18:30:05.800583+0000","last_undegraded":"2024-05-08T18:30:05.800583+0000","last_fullsized":"2024-05-08T18:30:05.800583+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:56.300986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"26'1","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.732288+0000","last_change":"2024-05-08T18:29:44.581748+0000","last_active":"2024-05-08T18:30:04.732288+0000","last_peered":"2024-05-08T18:30:04.732288+0000","last_clean":"2024-05-08T18:30:04.732288+0000","last_became_active":"2024-05-08T18:29:44.581067+0000","last_became_peered":"2024-05-08T18:29:44.581067+0000","last_unstale":"2024-05-08T18:30:04.732288+0000","last_undegraded":"2024-05-08T18:30:04.732288+0000","last_fullsized":"2024-05-08T18:30:04.732288+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:44.043691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"33'15","reported_seq":57,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.795340+0000","last_change":"2024-05-08T18:29:46.605887+0000","last_active":"2024-05-08T18:30:05.795340+0000","last_peered":"2024-05-08T18:30:05.795340+0000","last_clean":"2024-05-08T18:30:05.795340+0000","last_became_active":"2024-05-08T18:29:46.604966+0000","last_became_peered":"2024-05-08T18:29:46.604966+0000","last_unstale":"2024-05-08T18:30:05.795340+0000","last_undegraded":"2024-05-08T18:30:05.795340+0000","last_fullsized":"2024-05-08T18:30:05.795340+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:07:54.654205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"30'2","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.122184+0000","last_change":"2024-05-08T18:29:48.638657+0000","last_active":"2024-05-08T18:30:04.122184+0000","last_peered":"2024-05-08T18:30:04.122184+0000","last_clean":"2024-05-08T18:30:04.122184+0000","last_became_active":"2024-05-08T18:29:48.637758+0000","last_became_peered":"2024-05-08T18:29:48.637758+0000","last_unstale":"2024-05-08T18:30:04.122184+0000","last_undegraded":"2024-05-08T18:30:04.122184+0000","last_fullsized":"2024-05-08T18:30:04.122184+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:45:24.153991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.122798+0000","last_change":"2024-05-08T18:29:50.684501+0000","last_active":"2024-05-08T18:30:04.122798+0000","last_peered":"2024-05-08T18:30:04.122798+0000","last_clean":"2024-05-08T18:30:04.122798+0000","last_became_active":"2024-05-08T18:29:50.683738+0000","last_became_peered":"2024-05-08T18:29:50.683738+0000","last_unstale":"2024-05-08T18:30:04.122798+0000","last_undegraded":"2024-05-08T18:30:04.122798+0000","last_fullsized":"2024-05-08T18:30:04.122798+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:22.834262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.123784+0000","last_change":"2024-05-08T18:29:42.569401+0000","last_active":"2024-05-08T18:30:04.123784+0000","last_peered":"2024-05-08T18:30:04.123784+0000","last_clean":"2024-05-08T18:30:04.123784+0000","last_became_active":"2024-05-08T18:29:42.568659+0000","last_became_peered":"2024-05-08T18:29:42.568659+0000","last_unstale":"2024-05-08T18:30:04.123784+0000","last_undegraded":"2024-05-08T18:30:04.123784+0000","last_fullsized":"2024-05-08T18:30:04.123784+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:35:23.016110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.794856+0000","last_change":"2024-05-08T18:29:40.557076+0000","last_active":"2024-05-08T18:30:05.794856+0000","last_peered":"2024-05-08T18:30:05.794856+0000","last_clean":"2024-05-08T18:30:05.794856+0000","last_became_active":"2024-05-08T18:29:40.555805+0000","last_became_peered":"2024-05-08T18:29:40.555805+0000","last_unstale":"2024-05-08T18:30:05.794856+0000","last_undegraded":"2024-05-08T18:30:05.794856+0000","last_fullsized":"2024-05-08T18:30:05.794856+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:13.946346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.731658+0000","last_change":"2024-05-08T18:29:44.573892+0000","last_active":"2024-05-08T18:30:04.731658+0000","last_peered":"2024-05-08T18:30:04.731658+0000","last_clean":"2024-05-08T18:30:04.731658+0000","last_became_active":"2024-05-08T18:29:44.573308+0000","last_became_peered":"2024-05-08T18:29:44.573308+0000","last_unstale":"2024-05-08T18:30:04.731658+0000","last_undegraded":"2024-05-08T18:30:04.731658+0000","last_fullsized":"2024-05-08T18:30:04.731658+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:37.075348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"33'12","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.122517+0000","last_change":"2024-05-08T18:29:46.595585+0000","last_active":"2024-05-08T18:30:04.122517+0000","last_peered":"2024-05-08T18:30:04.122517+0000","last_clean":"2024-05-08T18:30:04.122517+0000","last_became_active":"2024-05-08T18:29:46.594930+0000","last_became_peered":"2024-05-08T18:29:46.594930+0000","last_unstale":"2024-05-08T18:30:04.122517+0000","last_undegraded":"2024-05-08T18:30:04.122517+0000","last_fullsized":"2024-05-08T18:30:04.122517+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:11.768269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":26,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.731000+0000","last_change":"2024-05-08T18:29:48.638137+0000","last_active":"2024-05-08T18:30:04.731000+0000","last_peered":"2024-05-08T18:30:04.731000+0000","last_clean":"2024-05-08T18:30:04.731000+0000","last_became_active":"2024-05-08T18:29:48.637370+0000","last_became_peered":"2024-05-08T18:29:48.637370+0000","last_unstale":"2024-05-08T18:30:04.731000+0000","last_undegraded":"2024-05-08T18:30:04.731000+0000","last_fullsized":"2024-05-08T18:30:04.731000+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:15.859849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":22,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.242694+0000","last_change":"2024-05-08T18:29:50.688760+0000","last_active":"2024-05-08T18:30:05.242694+0000","last_peered":"2024-05-08T18:30:05.242694+0000","last_clean":"2024-05-08T18:30:05.242694+0000","last_became_active":"2024-05-08T18:29:50.687960+0000","last_became_peered":"2024-05-08T18:29:50.687960+0000","last_unstale":"2024-05-08T18:30:05.242694+0000","last_undegraded":"2024-05-08T18:30:05.242694+0000","last_fullsized":"2024-05-08T18:30:05.242694+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:21:19.624895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.798302+0000","last_change":"2024-05-08T18:29:42.557850+0000","last_active":"2024-05-08T18:30:05.798302+0000","last_peered":"2024-05-08T18:30:05.798302+0000","last_clean":"2024-05-08T18:30:05.798302+0000","last_became_active":"2024-05-08T18:29:42.557119+0000","last_became_peered":"2024-05-08T18:29:42.557119+0000","last_unstale":"2024-05-08T18:30:05.798302+0000","last_undegraded":"2024-05-08T18:30:05.798302+0000","last_fullsized":"2024-05-08T18:30:05.798302+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:25:56.129785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.731516+0000","last_change":"2024-05-08T18:29:40.544530+0000","last_active":"2024-05-08T18:30:04.731516+0000","last_peered":"2024-05-08T18:30:04.731516+0000","last_clean":"2024-05-08T18:30:04.731516+0000","last_became_active":"2024-05-08T18:29:40.544215+0000","last_became_peered":"2024-05-08T18:29:40.544215+0000","last_unstale":"2024-05-08T18:30:04.731516+0000","last_undegraded":"2024-05-08T18:30:04.731516+0000","last_fullsized":"2024-05-08T18:30:04.731516+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:14:26.628603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.733050+0000","last_change":"2024-05-08T18:29:44.588227+0000","last_active":"2024-05-08T18:30:04.733050+0000","last_peered":"2024-05-08T18:30:04.733050+0000","last_clean":"2024-05-08T18:30:04.733050+0000","last_became_active":"2024-05-08T18:29:44.587822+0000","last_became_peered":"2024-05-08T18:29:44.587822+0000","last_unstale":"2024-05-08T18:30:04.733050+0000","last_undegraded":"2024-05-08T18:30:04.733050+0000","last_fullsized":"2024-05-08T18:30:04.733050+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:18:12.841872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"33'11","reported_seq":51,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.798191+0000","last_change":"2024-05-08T18:29:46.603563+0000","last_active":"2024-05-08T18:30:05.798191+0000","last_peered":"2024-05-08T18:30:05.798191+0000","last_clean":"2024-05-08T18:30:05.798191+0000","last_became_active":"2024-05-08T18:29:46.602801+0000","last_became_peered":"2024-05-08T18:29:46.602801+0000","last_unstale":"2024-05-08T18:30:05.798191+0000","last_undegraded":"2024-05-08T18:30:05.798191+0000","last_fullsized":"2024-05-08T18:30:05.798191+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:22:36.338527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.123352+0000","last_change":"2024-05-08T18:29:48.642806+0000","last_active":"2024-05-08T18:30:04.123352+0000","last_peered":"2024-05-08T18:30:04.123352+0000","last_clean":"2024-05-08T18:30:04.123352+0000","last_became_active":"2024-05-08T18:29:48.641813+0000","last_became_peered":"2024-05-08T18:29:48.641813+0000","last_unstale":"2024-05-08T18:30:04.123352+0000","last_undegraded":"2024-05-08T18:30:04.123352+0000","last_fullsized":"2024-05-08T18:30:04.123352+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:50:48.169666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":22,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.730541+0000","last_change":"2024-05-08T18:29:50.689819+0000","last_active":"2024-05-08T18:30:04.730541+0000","last_peered":"2024-05-08T18:30:04.730541+0000","last_clean":"2024-05-08T18:30:04.730541+0000","last_became_active":"2024-05-08T18:29:50.686739+0000","last_became_peered":"2024-05-08T18:29:50.686739+0000","last_unstale":"2024-05-08T18:30:04.730541+0000","last_undegraded":"2024-05-08T18:30:04.730541+0000","last_fullsized":"2024-05-08T18:30:04.730541+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:45:34.171402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.798705+0000","last_change":"2024-05-08T18:29:42.552388+0000","last_active":"2024-05-08T18:30:05.798705+0000","last_peered":"2024-05-08T18:30:05.798705+0000","last_clean":"2024-05-08T18:30:05.798705+0000","last_became_active":"2024-05-08T18:29:42.551647+0000","last_became_peered":"2024-05-08T18:29:42.551647+0000","last_unstale":"2024-05-08T18:30:05.798705+0000","last_undegraded":"2024-05-08T18:30:05.798705+0000","last_fullsized":"2024-05-08T18:30:05.798705+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:55.055481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.740817+0000","last_change":"2024-05-08T18:29:40.562946+0000","last_active":"2024-05-08T18:30:05.740817+0000","last_peered":"2024-05-08T18:30:05.740817+0000","last_clean":"2024-05-08T18:30:05.740817+0000","last_became_active":"2024-05-08T18:29:40.550942+0000","last_became_peered":"2024-05-08T18:29:40.550942+0000","last_unstale":"2024-05-08T18:30:05.740817+0000","last_undegraded":"2024-05-08T18:30:05.740817+0000","last_fullsized":"2024-05-08T18:30:05.740817+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:22.579629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.242663+0000","last_change":"2024-05-08T18:29:44.593681+0000","last_active":"2024-05-08T18:30:05.242663+0000","last_peered":"2024-05-08T18:30:05.242663+0000","last_clean":"2024-05-08T18:30:05.242663+0000","last_became_active":"2024-05-08T18:29:44.593242+0000","last_became_peered":"2024-05-08T18:29:44.593242+0000","last_unstale":"2024-05-08T18:30:05.242663+0000","last_undegraded":"2024-05-08T18:30:05.242663+0000","last_fullsized":"2024-05-08T18:30:05.242663+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:57.093364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"33'15","reported_seq":55,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.734191+0000","last_change":"2024-05-08T18:29:46.589514+0000","last_active":"2024-05-08T18:30:04.734191+0000","last_peered":"2024-05-08T18:30:04.734191+0000","last_clean":"2024-05-08T18:30:04.734191+0000","last_became_active":"2024-05-08T18:29:46.588784+0000","last_became_peered":"2024-05-08T18:29:46.588784+0000","last_unstale":"2024-05-08T18:30:04.734191+0000","last_undegraded":"2024-05-08T18:30:04.734191+0000","last_fullsized":"2024-05-08T18:30:04.734191+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:02:30.355168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"30'2","reported_seq":32,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.733808+0000","last_change":"2024-05-08T18:29:48.631007+0000","last_active":"2024-05-08T18:30:04.733808+0000","last_peered":"2024-05-08T18:30:04.733808+0000","last_clean":"2024-05-08T18:30:04.733808+0000","last_became_active":"2024-05-08T18:29:48.630229+0000","last_became_peered":"2024-05-08T18:29:48.630229+0000","last_unstale":"2024-05-08T18:30:04.733808+0000","last_undegraded":"2024-05-08T18:30:04.733808+0000","last_fullsized":"2024-05-08T18:30:04.733808+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:44:03.778419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":22,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.243521+0000","last_change":"2024-05-08T18:29:50.675105+0000","last_active":"2024-05-08T18:30:05.243521+0000","last_peered":"2024-05-08T18:30:05.243521+0000","last_clean":"2024-05-08T18:30:05.243521+0000","last_became_active":"2024-05-08T18:29:50.674292+0000","last_became_peered":"2024-05-08T18:29:50.674292+0000","last_unstale":"2024-05-08T18:30:05.243521+0000","last_undegraded":"2024-05-08T18:30:05.243521+0000","last_fullsized":"2024-05-08T18:30:05.243521+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:47:15.423647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.801623+0000","last_change":"2024-05-08T18:29:42.579707+0000","last_active":"2024-05-08T18:30:05.801623+0000","last_peered":"2024-05-08T18:30:05.801623+0000","last_clean":"2024-05-08T18:30:05.801623+0000","last_became_active":"2024-05-08T18:29:42.579059+0000","last_became_peered":"2024-05-08T18:29:42.579059+0000","last_unstale":"2024-05-08T18:30:05.801623+0000","last_undegraded":"2024-05-08T18:30:05.801623+0000","last_fullsized":"2024-05-08T18:30:05.801623+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:09.787597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.796085+0000","last_change":"2024-05-08T18:29:40.555327+0000","last_active":"2024-05-08T18:30:05.796085+0000","last_peered":"2024-05-08T18:30:05.796085+0000","last_clean":"2024-05-08T18:30:05.796085+0000","last_became_active":"2024-05-08T18:29:40.554594+0000","last_became_peered":"2024-05-08T18:29:40.554594+0000","last_unstale":"2024-05-08T18:30:05.796085+0000","last_undegraded":"2024-05-08T18:30:05.796085+0000","last_fullsized":"2024-05-08T18:30:05.796085+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:19.841114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"26'2","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.799554+0000","last_change":"2024-05-08T18:29:44.582434+0000","last_active":"2024-05-08T18:30:05.799554+0000","last_peered":"2024-05-08T18:30:05.799554+0000","last_clean":"2024-05-08T18:30:05.799554+0000","last_became_active":"2024-05-08T18:29:44.581699+0000","last_became_peered":"2024-05-08T18:29:44.581699+0000","last_unstale":"2024-05-08T18:30:05.799554+0000","last_undegraded":"2024-05-08T18:30:05.799554+0000","last_fullsized":"2024-05-08T18:30:05.799554+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:19:29.113643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"33'10","reported_seq":45,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.732778+0000","last_change":"2024-05-08T18:29:46.590860+0000","last_active":"2024-05-08T18:30:04.732778+0000","last_peered":"2024-05-08T18:30:04.732778+0000","last_clean":"2024-05-08T18:30:04.732778+0000","last_became_active":"2024-05-08T18:29:46.590087+0000","last_became_peered":"2024-05-08T18:29:46.590087+0000","last_unstale":"2024-05-08T18:30:04.732778+0000","last_undegraded":"2024-05-08T18:30:04.732778+0000","last_fullsized":"2024-05-08T18:30:04.732778+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:19:58.358449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"30'2","reported_seq":34,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.741020+0000","last_change":"2024-05-08T18:29:48.635548+0000","last_active":"2024-05-08T18:30:05.741020+0000","last_peered":"2024-05-08T18:30:05.741020+0000","last_clean":"2024-05-08T18:30:05.741020+0000","last_became_active":"2024-05-08T18:29:48.634801+0000","last_became_peered":"2024-05-08T18:29:48.634801+0000","last_unstale":"2024-05-08T18:30:05.741020+0000","last_undegraded":"2024-05-08T18:30:05.741020+0000","last_fullsized":"2024-05-08T18:30:05.741020+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:04:20.128031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.796666+0000","last_change":"2024-05-08T18:29:50.668279+0000","last_active":"2024-05-08T18:30:05.796666+0000","last_peered":"2024-05-08T18:30:05.796666+0000","last_clean":"2024-05-08T18:30:05.796666+0000","last_became_active":"2024-05-08T18:29:50.667536+0000","last_became_peered":"2024-05-08T18:29:50.667536+0000","last_unstale":"2024-05-08T18:30:05.796666+0000","last_undegraded":"2024-05-08T18:30:05.796666+0000","last_fullsized":"2024-05-08T18:30:05.796666+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:12:05.780786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.243017+0000","last_change":"2024-05-08T18:29:42.563807+0000","last_active":"2024-05-08T18:30:05.243017+0000","last_peered":"2024-05-08T18:30:05.243017+0000","last_clean":"2024-05-08T18:30:05.243017+0000","last_became_active":"2024-05-08T18:29:42.563416+0000","last_became_peered":"2024-05-08T18:29:42.563416+0000","last_unstale":"2024-05-08T18:30:05.243017+0000","last_undegraded":"2024-05-08T18:30:05.243017+0000","last_fullsized":"2024-05-08T18:30:05.243017+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:18:10.803989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.731317+0000","last_change":"2024-05-08T18:29:40.548898+0000","last_active":"2024-05-08T18:30:04.731317+0000","last_peered":"2024-05-08T18:30:04.731317+0000","last_clean":"2024-05-08T18:30:04.731317+0000","last_became_active":"2024-05-08T18:29:40.548591+0000","last_became_peered":"2024-05-08T18:29:40.548591+0000","last_unstale":"2024-05-08T18:30:04.731317+0000","last_undegraded":"2024-05-08T18:30:04.731317+0000","last_fullsized":"2024-05-08T18:30:04.731317+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:27:41.414153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.798714+0000","last_change":"2024-05-08T18:29:44.582578+0000","last_active":"2024-05-08T18:30:05.798714+0000","last_peered":"2024-05-08T18:30:05.798714+0000","last_clean":"2024-05-08T18:30:05.798714+0000","last_became_active":"2024-05-08T18:29:44.581832+0000","last_became_peered":"2024-05-08T18:29:44.581832+0000","last_unstale":"2024-05-08T18:30:05.798714+0000","last_undegraded":"2024-05-08T18:30:05.798714+0000","last_fullsized":"2024-05-08T18:30:05.798714+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:52:25.736491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"33'17","reported_seq":60,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.795827+0000","last_change":"2024-05-08T18:29:46.602459+0000","last_active":"2024-05-08T18:30:05.795827+0000","last_peered":"2024-05-08T18:30:05.795827+0000","last_clean":"2024-05-08T18:30:05.795827+0000","last_became_active":"2024-05-08T18:29:46.601740+0000","last_became_peered":"2024-05-08T18:29:46.601740+0000","last_unstale":"2024-05-08T18:30:05.795827+0000","last_undegraded":"2024-05-08T18:30:05.795827+0000","last_fullsized":"2024-05-08T18:30:05.795827+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:58:31.293922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":28,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.740202+0000","last_change":"2024-05-08T18:29:48.640046+0000","last_active":"2024-05-08T18:30:05.740202+0000","last_peered":"2024-05-08T18:30:05.740202+0000","last_clean":"2024-05-08T18:30:05.740202+0000","last_became_active":"2024-05-08T18:29:48.639309+0000","last_became_peered":"2024-05-08T18:29:48.639309+0000","last_unstale":"2024-05-08T18:30:05.740202+0000","last_undegraded":"2024-05-08T18:30:05.740202+0000","last_fullsized":"2024-05-08T18:30:05.740202+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:10.533065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":22,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.242277+0000","last_change":"2024-05-08T18:29:50.668361+0000","last_active":"2024-05-08T18:30:05.242277+0000","last_peered":"2024-05-08T18:30:05.242277+0000","last_clean":"2024-05-08T18:30:05.242277+0000","last_became_active":"2024-05-08T18:29:50.667636+0000","last_became_peered":"2024-05-08T18:29:50.667636+0000","last_unstale":"2024-05-08T18:30:05.242277+0000","last_undegraded":"2024-05-08T18:30:05.242277+0000","last_fullsized":"2024-05-08T18:30:05.242277+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:58:35.356885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.741298+0000","last_change":"2024-05-08T18:29:42.584098+0000","last_active":"2024-05-08T18:30:05.741298+0000","last_peered":"2024-05-08T18:30:05.741298+0000","last_clean":"2024-05-08T18:30:05.741298+0000","last_became_active":"2024-05-08T18:29:42.583639+0000","last_became_peered":"2024-05-08T18:29:42.583639+0000","last_unstale":"2024-05-08T18:30:05.741298+0000","last_undegraded":"2024-05-08T18:30:05.741298+0000","last_fullsized":"2024-05-08T18:30:05.741298+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:08:15.026467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":146,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.795590+0000","last_change":"2024-05-08T18:29:27.115522+0000","last_active":"2024-05-08T18:30:05.795590+0000","last_peered":"2024-05-08T18:30:05.795590+0000","last_clean":"2024-05-08T18:30:05.795590+0000","last_became_active":"2024-05-08T18:29:27.112960+0000","last_became_peered":"2024-05-08T18:29:27.112960+0000","last_unstale":"2024-05-08T18:30:05.795590+0000","last_undegraded":"2024-05-08T18:30:05.795590+0000","last_fullsized":"2024-05-08T18:30:05.795590+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:26.091102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:26.091102+0000","last_clean_scrub_stamp":"2024-05-08T18:29:26.091102+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:09:50.296961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":50,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.794685+0000","last_change":"2024-05-08T18:29:34.496467+0000","last_active":"2024-05-08T18:30:05.794685+0000","last_peered":"2024-05-08T18:30:05.794685+0000","last_clean":"2024-05-08T18:30:05.794685+0000","last_became_active":"2024-05-08T18:29:34.495632+0000","last_became_peered":"2024-05-08T18:29:34.495632+0000","last_unstale":"2024-05-08T18:30:05.794685+0000","last_undegraded":"2024-05-08T18:30:05.794685+0000","last_fullsized":"2024-05-08T18:30:05.794685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:35.917391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.731383+0000","last_change":"2024-05-08T18:29:40.559945+0000","last_active":"2024-05-08T18:30:04.731383+0000","last_peered":"2024-05-08T18:30:04.731383+0000","last_clean":"2024-05-08T18:30:04.731383+0000","last_became_active":"2024-05-08T18:29:40.559723+0000","last_became_peered":"2024-05-08T18:29:40.559723+0000","last_unstale":"2024-05-08T18:30:04.731383+0000","last_undegraded":"2024-05-08T18:30:04.731383+0000","last_fullsized":"2024-05-08T18:30:04.731383+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:39:17.879068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.798251+0000","last_change":"2024-05-08T18:29:44.592445+0000","last_active":"2024-05-08T18:30:05.798251+0000","last_peered":"2024-05-08T18:30:05.798251+0000","last_clean":"2024-05-08T18:30:05.798251+0000","last_became_active":"2024-05-08T18:29:44.587855+0000","last_became_peered":"2024-05-08T18:29:44.587855+0000","last_unstale":"2024-05-08T18:30:05.798251+0000","last_undegraded":"2024-05-08T18:30:05.798251+0000","last_fullsized":"2024-05-08T18:30:05.798251+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:06:05.355648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"33'13","reported_seq":59,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.800087+0000","last_change":"2024-05-08T18:29:46.595394+0000","last_active":"2024-05-08T18:30:05.800087+0000","last_peered":"2024-05-08T18:30:05.800087+0000","last_clean":"2024-05-08T18:30:05.800087+0000","last_became_active":"2024-05-08T18:29:46.594573+0000","last_became_peered":"2024-05-08T18:29:46.594573+0000","last_unstale":"2024-05-08T18:30:05.800087+0000","last_undegraded":"2024-05-08T18:30:05.800087+0000","last_fullsized":"2024-05-08T18:30:05.800087+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:47:11.360684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.122841+0000","last_change":"2024-05-08T18:29:48.632178+0000","last_active":"2024-05-08T18:30:04.122841+0000","last_peered":"2024-05-08T18:30:04.122841+0000","last_clean":"2024-05-08T18:30:04.122841+0000","last_became_active":"2024-05-08T18:29:48.631481+0000","last_became_peered":"2024-05-08T18:29:48.631481+0000","last_unstale":"2024-05-08T18:30:04.122841+0000","last_undegraded":"2024-05-08T18:30:04.122841+0000","last_fullsized":"2024-05-08T18:30:04.122841+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:34.806539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.739442+0000","last_change":"2024-05-08T18:29:50.675319+0000","last_active":"2024-05-08T18:30:05.739442+0000","last_peered":"2024-05-08T18:30:05.739442+0000","last_clean":"2024-05-08T18:30:05.739442+0000","last_became_active":"2024-05-08T18:29:50.674526+0000","last_became_peered":"2024-05-08T18:29:50.674526+0000","last_unstale":"2024-05-08T18:30:05.739442+0000","last_undegraded":"2024-05-08T18:30:05.739442+0000","last_fullsized":"2024-05-08T18:30:05.739442+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:59:06.404586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.123594+0000","last_change":"2024-05-08T18:29:42.568584+0000","last_active":"2024-05-08T18:30:04.123594+0000","last_peered":"2024-05-08T18:30:04.123594+0000","last_clean":"2024-05-08T18:30:04.123594+0000","last_became_active":"2024-05-08T18:29:42.568244+0000","last_became_peered":"2024-05-08T18:29:42.568244+0000","last_unstale":"2024-05-08T18:30:04.123594+0000","last_undegraded":"2024-05-08T18:30:04.123594+0000","last_fullsized":"2024-05-08T18:30:04.123594+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:20.397730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":50,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.795111+0000","last_change":"2024-05-08T18:29:34.497654+0000","last_active":"2024-05-08T18:30:05.795111+0000","last_peered":"2024-05-08T18:30:05.795111+0000","last_clean":"2024-05-08T18:30:05.795111+0000","last_became_active":"2024-05-08T18:29:34.495812+0000","last_became_peered":"2024-05-08T18:29:34.495812+0000","last_unstale":"2024-05-08T18:30:05.795111+0000","last_undegraded":"2024-05-08T18:30:05.795111+0000","last_fullsized":"2024-05-08T18:30:05.795111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:37:02.202613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.122722+0000","last_change":"2024-05-08T18:29:40.560653+0000","last_active":"2024-05-08T18:30:04.122722+0000","last_peered":"2024-05-08T18:30:04.122722+0000","last_clean":"2024-05-08T18:30:04.122722+0000","last_became_active":"2024-05-08T18:29:40.560296+0000","last_became_peered":"2024-05-08T18:29:40.560296+0000","last_unstale":"2024-05-08T18:30:04.122722+0000","last_undegraded":"2024-05-08T18:30:04.122722+0000","last_fullsized":"2024-05-08T18:30:04.122722+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:52.462279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.800728+0000","last_change":"2024-05-08T18:29:44.594681+0000","last_active":"2024-05-08T18:30:05.800728+0000","last_peered":"2024-05-08T18:30:05.800728+0000","last_clean":"2024-05-08T18:30:05.800728+0000","last_became_active":"2024-05-08T18:29:44.593917+0000","last_became_peered":"2024-05-08T18:29:44.593917+0000","last_unstale":"2024-05-08T18:30:05.800728+0000","last_undegraded":"2024-05-08T18:30:05.800728+0000","last_fullsized":"2024-05-08T18:30:05.800728+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:59:00.335437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"33'23","reported_seq":75,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.242532+0000","last_change":"2024-05-08T18:29:46.599932+0000","last_active":"2024-05-08T18:30:05.242532+0000","last_peered":"2024-05-08T18:30:05.242532+0000","last_clean":"2024-05-08T18:30:05.242532+0000","last_became_active":"2024-05-08T18:29:46.594789+0000","last_became_peered":"2024-05-08T18:29:46.594789+0000","last_unstale":"2024-05-08T18:30:05.242532+0000","last_undegraded":"2024-05-08T18:30:05.242532+0000","last_fullsized":"2024-05-08T18:30:05.242532+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:04:18.099848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":42,"num_read_kb":27,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":28,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.799272+0000","last_change":"2024-05-08T18:29:48.634661+0000","last_active":"2024-05-08T18:30:05.799272+0000","last_peered":"2024-05-08T18:30:05.799272+0000","last_clean":"2024-05-08T18:30:05.799272+0000","last_became_active":"2024-05-08T18:29:48.634044+0000","last_became_peered":"2024-05-08T18:29:48.634044+0000","last_unstale":"2024-05-08T18:30:05.799272+0000","last_undegraded":"2024-05-08T18:30:05.799272+0000","last_fullsized":"2024-05-08T18:30:05.799272+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:01:46.238076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":22,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.242116+0000","last_change":"2024-05-08T18:29:50.676536+0000","last_active":"2024-05-08T18:30:05.242116+0000","last_peered":"2024-05-08T18:30:05.242116+0000","last_clean":"2024-05-08T18:30:05.242116+0000","last_became_active":"2024-05-08T18:29:50.675770+0000","last_became_peered":"2024-05-08T18:29:50.675770+0000","last_unstale":"2024-05-08T18:30:05.242116+0000","last_undegraded":"2024-05-08T18:30:05.242116+0000","last_fullsized":"2024-05-08T18:30:05.242116+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:28.003482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.243250+0000","last_change":"2024-05-08T18:29:42.575253+0000","last_active":"2024-05-08T18:30:05.243250+0000","last_peered":"2024-05-08T18:30:05.243250+0000","last_clean":"2024-05-08T18:30:05.243250+0000","last_became_active":"2024-05-08T18:29:42.573621+0000","last_became_peered":"2024-05-08T18:29:42.573621+0000","last_unstale":"2024-05-08T18:30:05.243250+0000","last_undegraded":"2024-05-08T18:30:05.243250+0000","last_fullsized":"2024-05-08T18:30:05.243250+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:59.243324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":48,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.731253+0000","last_change":"2024-05-08T18:29:34.491071+0000","last_active":"2024-05-08T18:30:04.731253+0000","last_peered":"2024-05-08T18:30:04.731253+0000","last_clean":"2024-05-08T18:30:04.731253+0000","last_became_active":"2024-05-08T18:29:34.490717+0000","last_became_peered":"2024-05-08T18:29:34.490717+0000","last_unstale":"2024-05-08T18:30:04.731253+0000","last_undegraded":"2024-05-08T18:30:04.731253+0000","last_fullsized":"2024-05-08T18:30:04.731253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:55.793312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.242547+0000","last_change":"2024-05-08T18:29:40.530634+0000","last_active":"2024-05-08T18:30:05.242547+0000","last_peered":"2024-05-08T18:30:05.242547+0000","last_clean":"2024-05-08T18:30:05.242547+0000","last_became_active":"2024-05-08T18:29:40.529804+0000","last_became_peered":"2024-05-08T18:29:40.529804+0000","last_unstale":"2024-05-08T18:30:05.242547+0000","last_undegraded":"2024-05-08T18:30:05.242547+0000","last_fullsized":"2024-05-08T18:30:05.242547+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:59:25.840149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"26'1","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.734010+0000","last_change":"2024-05-08T18:29:44.584678+0000","last_active":"2024-05-08T18:30:04.734010+0000","last_peered":"2024-05-08T18:30:04.734010+0000","last_clean":"2024-05-08T18:30:04.734010+0000","last_became_active":"2024-05-08T18:29:44.584227+0000","last_became_peered":"2024-05-08T18:29:44.584227+0000","last_unstale":"2024-05-08T18:30:04.734010+0000","last_undegraded":"2024-05-08T18:30:04.734010+0000","last_fullsized":"2024-05-08T18:30:04.734010+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:04:01.281207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'15","reported_seq":57,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.799794+0000","last_change":"2024-05-08T18:29:46.608720+0000","last_active":"2024-05-08T18:30:05.799794+0000","last_peered":"2024-05-08T18:30:05.799794+0000","last_clean":"2024-05-08T18:30:05.799794+0000","last_became_active":"2024-05-08T18:29:46.607989+0000","last_became_peered":"2024-05-08T18:29:46.607989+0000","last_unstale":"2024-05-08T18:30:05.799794+0000","last_undegraded":"2024-05-08T18:30:05.799794+0000","last_fullsized":"2024-05-08T18:30:05.799794+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:58:31.293922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.122901+0000","last_change":"2024-05-08T18:29:48.625269+0000","last_active":"2024-05-08T18:30:04.122901+0000","last_peered":"2024-05-08T18:30:04.122901+0000","last_clean":"2024-05-08T18:30:04.122901+0000","last_became_active":"2024-05-08T18:29:48.624545+0000","last_became_peered":"2024-05-08T18:29:48.624545+0000","last_unstale":"2024-05-08T18:30:04.122901+0000","last_undegraded":"2024-05-08T18:30:04.122901+0000","last_fullsized":"2024-05-08T18:30:04.122901+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:16:42.799734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":22,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.732025+0000","last_change":"2024-05-08T18:29:50.688851+0000","last_active":"2024-05-08T18:30:04.732025+0000","last_peered":"2024-05-08T18:30:04.732025+0000","last_clean":"2024-05-08T18:30:04.732025+0000","last_became_active":"2024-05-08T18:29:50.687978+0000","last_became_peered":"2024-05-08T18:29:50.687978+0000","last_unstale":"2024-05-08T18:30:04.732025+0000","last_undegraded":"2024-05-08T18:30:04.732025+0000","last_fullsized":"2024-05-08T18:30:04.732025+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:28:29.836446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.242919+0000","last_change":"2024-05-08T18:29:42.574606+0000","last_active":"2024-05-08T18:30:05.242919+0000","last_peered":"2024-05-08T18:30:05.242919+0000","last_clean":"2024-05-08T18:30:05.242919+0000","last_became_active":"2024-05-08T18:29:42.573656+0000","last_became_peered":"2024-05-08T18:29:42.573656+0000","last_unstale":"2024-05-08T18:30:05.242919+0000","last_undegraded":"2024-05-08T18:30:05.242919+0000","last_fullsized":"2024-05-08T18:30:05.242919+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:54:16.539832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":50,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.794557+0000","last_change":"2024-05-08T18:29:34.496942+0000","last_active":"2024-05-08T18:30:05.794557+0000","last_peered":"2024-05-08T18:30:05.794557+0000","last_clean":"2024-05-08T18:30:05.794557+0000","last_became_active":"2024-05-08T18:29:34.495882+0000","last_became_peered":"2024-05-08T18:29:34.495882+0000","last_unstale":"2024-05-08T18:30:05.794557+0000","last_undegraded":"2024-05-08T18:30:05.794557+0000","last_fullsized":"2024-05-08T18:30:05.794557+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:55.793312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.797761+0000","last_change":"2024-05-08T18:29:40.554353+0000","last_active":"2024-05-08T18:30:05.797761+0000","last_peered":"2024-05-08T18:30:05.797761+0000","last_clean":"2024-05-08T18:30:05.797761+0000","last_became_active":"2024-05-08T18:29:40.553527+0000","last_became_peered":"2024-05-08T18:29:40.553527+0000","last_unstale":"2024-05-08T18:30:05.797761+0000","last_undegraded":"2024-05-08T18:30:05.797761+0000","last_fullsized":"2024-05-08T18:30:05.797761+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:03:42.148647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":32,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.122438+0000","last_change":"2024-05-08T18:29:44.597411+0000","last_active":"2024-05-08T18:30:04.122438+0000","last_peered":"2024-05-08T18:30:04.122438+0000","last_clean":"2024-05-08T18:30:04.122438+0000","last_became_active":"2024-05-08T18:29:44.596678+0000","last_became_peered":"2024-05-08T18:29:44.596678+0000","last_unstale":"2024-05-08T18:30:04.122438+0000","last_undegraded":"2024-05-08T18:30:04.122438+0000","last_fullsized":"2024-05-08T18:30:04.122438+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:37:23.674968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'12","reported_seq":48,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.733581+0000","last_change":"2024-05-08T18:29:46.607040+0000","last_active":"2024-05-08T18:30:04.733581+0000","last_peered":"2024-05-08T18:30:04.733581+0000","last_clean":"2024-05-08T18:30:04.733581+0000","last_became_active":"2024-05-08T18:29:46.606367+0000","last_became_peered":"2024-05-08T18:29:46.606367+0000","last_unstale":"2024-05-08T18:30:04.733581+0000","last_undegraded":"2024-05-08T18:30:04.733581+0000","last_fullsized":"2024-05-08T18:30:04.733581+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:59:26.650126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":28,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.741591+0000","last_change":"2024-05-08T18:29:48.632665+0000","last_active":"2024-05-08T18:30:05.741591+0000","last_peered":"2024-05-08T18:30:05.741591+0000","last_clean":"2024-05-08T18:30:05.741591+0000","last_became_active":"2024-05-08T18:29:48.631874+0000","last_became_peered":"2024-05-08T18:29:48.631874+0000","last_unstale":"2024-05-08T18:30:05.741591+0000","last_undegraded":"2024-05-08T18:30:05.741591+0000","last_fullsized":"2024-05-08T18:30:05.741591+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:06:09.390017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.792785+0000","last_change":"2024-05-08T18:29:50.683443+0000","last_active":"2024-05-08T18:30:05.792785+0000","last_peered":"2024-05-08T18:30:05.792785+0000","last_clean":"2024-05-08T18:30:05.792785+0000","last_became_active":"2024-05-08T18:29:50.682634+0000","last_became_peered":"2024-05-08T18:29:50.682634+0000","last_unstale":"2024-05-08T18:30:05.792785+0000","last_undegraded":"2024-05-08T18:30:05.792785+0000","last_fullsized":"2024-05-08T18:30:05.792785+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:10:38.951662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.243042+0000","last_change":"2024-05-08T18:29:42.574593+0000","last_active":"2024-05-08T18:30:05.243042+0000","last_peered":"2024-05-08T18:30:05.243042+0000","last_clean":"2024-05-08T18:30:05.243042+0000","last_became_active":"2024-05-08T18:29:42.574288+0000","last_became_peered":"2024-05-08T18:29:42.574288+0000","last_unstale":"2024-05-08T18:30:05.243042+0000","last_undegraded":"2024-05-08T18:30:05.243042+0000","last_fullsized":"2024-05-08T18:30:05.243042+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:58.320701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.796680+0000","last_change":"2024-05-08T18:29:40.556697+0000","last_active":"2024-05-08T18:30:05.796680+0000","last_peered":"2024-05-08T18:30:05.796680+0000","last_clean":"2024-05-08T18:30:05.796680+0000","last_became_active":"2024-05-08T18:29:40.555965+0000","last_became_peered":"2024-05-08T18:29:40.555965+0000","last_unstale":"2024-05-08T18:30:05.796680+0000","last_undegraded":"2024-05-08T18:30:05.796680+0000","last_fullsized":"2024-05-08T18:30:05.796680+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:36:14.096907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":48,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.243261+0000","last_change":"2024-05-08T18:29:34.606393+0000","last_active":"2024-05-08T18:30:05.243261+0000","last_peered":"2024-05-08T18:30:05.243261+0000","last_clean":"2024-05-08T18:30:05.243261+0000","last_became_active":"2024-05-08T18:29:34.605574+0000","last_became_peered":"2024-05-08T18:29:34.605574+0000","last_unstale":"2024-05-08T18:30:05.243261+0000","last_undegraded":"2024-05-08T18:30:05.243261+0000","last_fullsized":"2024-05-08T18:30:05.243261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:55.793312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":32,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.123260+0000","last_change":"2024-05-08T18:29:44.595127+0000","last_active":"2024-05-08T18:30:04.123260+0000","last_peered":"2024-05-08T18:30:04.123260+0000","last_clean":"2024-05-08T18:30:04.123260+0000","last_became_active":"2024-05-08T18:29:44.594642+0000","last_became_peered":"2024-05-08T18:29:44.594642+0000","last_unstale":"2024-05-08T18:30:04.123260+0000","last_undegraded":"2024-05-08T18:30:04.123260+0000","last_fullsized":"2024-05-08T18:30:04.123260+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:04:49.020450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"33'18","reported_seq":60,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.122286+0000","last_change":"2024-05-08T18:29:46.602279+0000","last_active":"2024-05-08T18:30:04.122286+0000","last_peered":"2024-05-08T18:30:04.122286+0000","last_clean":"2024-05-08T18:30:04.122286+0000","last_became_active":"2024-05-08T18:29:46.599707+0000","last_became_peered":"2024-05-08T18:29:46.599707+0000","last_unstale":"2024-05-08T18:30:04.122286+0000","last_undegraded":"2024-05-08T18:30:04.122286+0000","last_fullsized":"2024-05-08T18:30:04.122286+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:54:48.654215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":28,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.794968+0000","last_change":"2024-05-08T18:29:48.639458+0000","last_active":"2024-05-08T18:30:05.794968+0000","last_peered":"2024-05-08T18:30:05.794968+0000","last_clean":"2024-05-08T18:30:05.794968+0000","last_became_active":"2024-05-08T18:29:48.638709+0000","last_became_peered":"2024-05-08T18:29:48.638709+0000","last_unstale":"2024-05-08T18:30:05.794968+0000","last_undegraded":"2024-05-08T18:30:05.794968+0000","last_fullsized":"2024-05-08T18:30:05.794968+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:19:58.182291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.122633+0000","last_change":"2024-05-08T18:29:50.681077+0000","last_active":"2024-05-08T18:30:04.122633+0000","last_peered":"2024-05-08T18:30:04.122633+0000","last_clean":"2024-05-08T18:30:04.122633+0000","last_became_active":"2024-05-08T18:29:50.675766+0000","last_became_peered":"2024-05-08T18:29:50.675766+0000","last_unstale":"2024-05-08T18:30:04.122633+0000","last_undegraded":"2024-05-08T18:30:04.122633+0000","last_fullsized":"2024-05-08T18:30:04.122633+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:09:29.641515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.123745+0000","last_change":"2024-05-08T18:29:42.571265+0000","last_active":"2024-05-08T18:30:04.123745+0000","last_peered":"2024-05-08T18:30:04.123745+0000","last_clean":"2024-05-08T18:30:04.123745+0000","last_became_active":"2024-05-08T18:29:42.570645+0000","last_became_peered":"2024-05-08T18:29:42.570645+0000","last_unstale":"2024-05-08T18:30:04.123745+0000","last_undegraded":"2024-05-08T18:30:04.123745+0000","last_fullsized":"2024-05-08T18:30:04.123745+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:30:29.452640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.243039+0000","last_change":"2024-05-08T18:29:40.531079+0000","last_active":"2024-05-08T18:30:05.243039+0000","last_peered":"2024-05-08T18:30:05.243039+0000","last_clean":"2024-05-08T18:30:05.243039+0000","last_became_active":"2024-05-08T18:29:40.530256+0000","last_became_peered":"2024-05-08T18:29:40.530256+0000","last_unstale":"2024-05-08T18:30:05.243039+0000","last_undegraded":"2024-05-08T18:30:05.243039+0000","last_fullsized":"2024-05-08T18:30:05.243039+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:09:42.581976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":50,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.801190+0000","last_change":"2024-05-08T18:29:34.603292+0000","last_active":"2024-05-08T18:30:05.801190+0000","last_peered":"2024-05-08T18:30:05.801190+0000","last_clean":"2024-05-08T18:30:05.801190+0000","last_became_active":"2024-05-08T18:29:34.602547+0000","last_became_peered":"2024-05-08T18:29:34.602547+0000","last_unstale":"2024-05-08T18:30:05.801190+0000","last_undegraded":"2024-05-08T18:30:05.801190+0000","last_fullsized":"2024-05-08T18:30:05.801190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:24:55.555475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.740348+0000","last_change":"2024-05-08T18:29:44.593275+0000","last_active":"2024-05-08T18:30:05.740348+0000","last_peered":"2024-05-08T18:30:05.740348+0000","last_clean":"2024-05-08T18:30:05.740348+0000","last_became_active":"2024-05-08T18:29:44.591870+0000","last_became_peered":"2024-05-08T18:29:44.591870+0000","last_unstale":"2024-05-08T18:30:05.740348+0000","last_undegraded":"2024-05-08T18:30:05.740348+0000","last_fullsized":"2024-05-08T18:30:05.740348+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:35.176971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"33'14","reported_seq":51,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.242071+0000","last_change":"2024-05-08T18:29:46.603499+0000","last_active":"2024-05-08T18:30:05.242071+0000","last_peered":"2024-05-08T18:30:05.242071+0000","last_clean":"2024-05-08T18:30:05.242071+0000","last_became_active":"2024-05-08T18:29:46.602920+0000","last_became_peered":"2024-05-08T18:29:46.602920+0000","last_unstale":"2024-05-08T18:30:05.242071+0000","last_undegraded":"2024-05-08T18:30:05.242071+0000","last_fullsized":"2024-05-08T18:30:05.242071+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:08.504882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"30'2","reported_seq":34,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.793157+0000","last_change":"2024-05-08T18:29:48.634915+0000","last_active":"2024-05-08T18:30:05.793157+0000","last_peered":"2024-05-08T18:30:05.793157+0000","last_clean":"2024-05-08T18:30:05.793157+0000","last_became_active":"2024-05-08T18:29:48.634280+0000","last_became_peered":"2024-05-08T18:29:48.634280+0000","last_unstale":"2024-05-08T18:30:05.793157+0000","last_undegraded":"2024-05-08T18:30:05.793157+0000","last_fullsized":"2024-05-08T18:30:05.793157+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:19:58.182291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":22,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.734128+0000","last_change":"2024-05-08T18:29:50.688742+0000","last_active":"2024-05-08T18:30:04.734128+0000","last_peered":"2024-05-08T18:30:04.734128+0000","last_clean":"2024-05-08T18:30:04.734128+0000","last_became_active":"2024-05-08T18:29:50.687135+0000","last_became_peered":"2024-05-08T18:29:50.687135+0000","last_unstale":"2024-05-08T18:30:04.734128+0000","last_undegraded":"2024-05-08T18:30:04.734128+0000","last_fullsized":"2024-05-08T18:30:04.734128+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:12:49.040807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.730919+0000","last_change":"2024-05-08T18:29:42.576864+0000","last_active":"2024-05-08T18:30:04.730919+0000","last_peered":"2024-05-08T18:30:04.730919+0000","last_clean":"2024-05-08T18:30:04.730919+0000","last_became_active":"2024-05-08T18:29:42.576392+0000","last_became_peered":"2024-05-08T18:29:42.576392+0000","last_unstale":"2024-05-08T18:30:04.730919+0000","last_undegraded":"2024-05-08T18:30:04.730919+0000","last_fullsized":"2024-05-08T18:30:04.730919+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:23.397435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.732422+0000","last_change":"2024-05-08T18:29:40.565872+0000","last_active":"2024-05-08T18:30:04.732422+0000","last_peered":"2024-05-08T18:30:04.732422+0000","last_clean":"2024-05-08T18:30:04.732422+0000","last_became_active":"2024-05-08T18:29:40.565655+0000","last_became_peered":"2024-05-08T18:29:40.565655+0000","last_unstale":"2024-05-08T18:30:04.732422+0000","last_undegraded":"2024-05-08T18:30:04.732422+0000","last_fullsized":"2024-05-08T18:30:04.732422+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:16:16.521258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":48,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.243285+0000","last_change":"2024-05-08T18:29:34.501273+0000","last_active":"2024-05-08T18:30:05.243285+0000","last_peered":"2024-05-08T18:30:05.243285+0000","last_clean":"2024-05-08T18:30:05.243285+0000","last_became_active":"2024-05-08T18:29:34.500933+0000","last_became_peered":"2024-05-08T18:29:34.500933+0000","last_unstale":"2024-05-08T18:30:05.243285+0000","last_undegraded":"2024-05-08T18:30:05.243285+0000","last_fullsized":"2024-05-08T18:30:05.243285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:35.917391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.795508+0000","last_change":"2024-05-08T18:29:44.576227+0000","last_active":"2024-05-08T18:30:05.795508+0000","last_peered":"2024-05-08T18:30:05.795508+0000","last_clean":"2024-05-08T18:30:05.795508+0000","last_became_active":"2024-05-08T18:29:44.575454+0000","last_became_peered":"2024-05-08T18:29:44.575454+0000","last_unstale":"2024-05-08T18:30:05.795508+0000","last_undegraded":"2024-05-08T18:30:05.795508+0000","last_fullsized":"2024-05-08T18:30:05.795508+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:06:05.355648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"33'10","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.797096+0000","last_change":"2024-05-08T18:29:46.609633+0000","last_active":"2024-05-08T18:30:05.797096+0000","last_peered":"2024-05-08T18:30:05.797096+0000","last_clean":"2024-05-08T18:30:05.797096+0000","last_became_active":"2024-05-08T18:29:46.603455+0000","last_became_peered":"2024-05-08T18:29:46.603455+0000","last_unstale":"2024-05-08T18:30:05.797096+0000","last_undegraded":"2024-05-08T18:30:05.797096+0000","last_fullsized":"2024-05-08T18:30:05.797096+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:07:54.654205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"30'2","reported_seq":32,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.732603+0000","last_change":"2024-05-08T18:29:48.637898+0000","last_active":"2024-05-08T18:30:04.732603+0000","last_peered":"2024-05-08T18:30:04.732603+0000","last_clean":"2024-05-08T18:30:04.732603+0000","last_became_active":"2024-05-08T18:29:48.637070+0000","last_became_peered":"2024-05-08T18:29:48.637070+0000","last_unstale":"2024-05-08T18:30:04.732603+0000","last_undegraded":"2024-05-08T18:30:04.732603+0000","last_fullsized":"2024-05-08T18:30:04.732603+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:03:46.392864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.122989+0000","last_change":"2024-05-08T18:29:50.691526+0000","last_active":"2024-05-08T18:30:04.122989+0000","last_peered":"2024-05-08T18:30:04.122989+0000","last_clean":"2024-05-08T18:30:04.122989+0000","last_became_active":"2024-05-08T18:29:50.690767+0000","last_became_peered":"2024-05-08T18:29:50.690767+0000","last_unstale":"2024-05-08T18:30:04.122989+0000","last_undegraded":"2024-05-08T18:30:04.122989+0000","last_fullsized":"2024-05-08T18:30:04.122989+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:32:29.972139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.795769+0000","last_change":"2024-05-08T18:29:42.562006+0000","last_active":"2024-05-08T18:30:05.795769+0000","last_peered":"2024-05-08T18:30:05.795769+0000","last_clean":"2024-05-08T18:30:05.795769+0000","last_became_active":"2024-05-08T18:29:42.560861+0000","last_became_peered":"2024-05-08T18:29:42.560861+0000","last_unstale":"2024-05-08T18:30:05.795769+0000","last_undegraded":"2024-05-08T18:30:05.795769+0000","last_fullsized":"2024-05-08T18:30:05.795769+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:36.890277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.123968+0000","last_change":"2024-05-08T18:29:40.550529+0000","last_active":"2024-05-08T18:30:04.123968+0000","last_peered":"2024-05-08T18:30:04.123968+0000","last_clean":"2024-05-08T18:30:04.123968+0000","last_became_active":"2024-05-08T18:29:40.550241+0000","last_became_peered":"2024-05-08T18:29:40.550241+0000","last_unstale":"2024-05-08T18:30:04.123968+0000","last_undegraded":"2024-05-08T18:30:04.123968+0000","last_fullsized":"2024-05-08T18:30:04.123968+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:48.294532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":50,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.741918+0000","last_change":"2024-05-08T18:29:34.493537+0000","last_active":"2024-05-08T18:30:05.741918+0000","last_peered":"2024-05-08T18:30:05.741918+0000","last_clean":"2024-05-08T18:30:05.741918+0000","last_became_active":"2024-05-08T18:29:34.492891+0000","last_became_peered":"2024-05-08T18:29:34.492891+0000","last_unstale":"2024-05-08T18:30:05.741918+0000","last_undegraded":"2024-05-08T18:30:05.741918+0000","last_fullsized":"2024-05-08T18:30:05.741918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:09:07.992256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.730780+0000","last_change":"2024-05-08T18:29:44.590102+0000","last_active":"2024-05-08T18:30:04.730780+0000","last_peered":"2024-05-08T18:30:04.730780+0000","last_clean":"2024-05-08T18:30:04.730780+0000","last_became_active":"2024-05-08T18:29:44.589471+0000","last_became_peered":"2024-05-08T18:29:44.589471+0000","last_unstale":"2024-05-08T18:30:04.730780+0000","last_undegraded":"2024-05-08T18:30:04.730780+0000","last_fullsized":"2024-05-08T18:30:04.730780+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:14:04.085401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"33'19","reported_seq":68,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.797549+0000","last_change":"2024-05-08T18:29:46.606967+0000","last_active":"2024-05-08T18:30:05.797549+0000","last_peered":"2024-05-08T18:30:05.797549+0000","last_clean":"2024-05-08T18:30:05.797549+0000","last_became_active":"2024-05-08T18:29:46.605693+0000","last_became_peered":"2024-05-08T18:29:46.605693+0000","last_unstale":"2024-05-08T18:30:05.797549+0000","last_undegraded":"2024-05-08T18:30:05.797549+0000","last_fullsized":"2024-05-08T18:30:05.797549+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:24:13.568294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":26,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.730695+0000","last_change":"2024-05-08T18:29:48.634271+0000","last_active":"2024-05-08T18:30:04.730695+0000","last_peered":"2024-05-08T18:30:04.730695+0000","last_clean":"2024-05-08T18:30:04.730695+0000","last_became_active":"2024-05-08T18:29:48.633607+0000","last_became_peered":"2024-05-08T18:29:48.633607+0000","last_unstale":"2024-05-08T18:30:04.730695+0000","last_undegraded":"2024-05-08T18:30:04.730695+0000","last_fullsized":"2024-05-08T18:30:04.730695+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:34.806539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.793825+0000","last_change":"2024-05-08T18:29:50.685494+0000","last_active":"2024-05-08T18:30:05.793825+0000","last_peered":"2024-05-08T18:30:05.793825+0000","last_clean":"2024-05-08T18:30:05.793825+0000","last_became_active":"2024-05-08T18:29:50.684818+0000","last_became_peered":"2024-05-08T18:29:50.684818+0000","last_unstale":"2024-05-08T18:30:05.793825+0000","last_undegraded":"2024-05-08T18:30:05.793825+0000","last_fullsized":"2024-05-08T18:30:05.793825+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:22.220842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.123213+0000","last_change":"2024-05-08T18:29:50.682937+0000","last_active":"2024-05-08T18:30:04.123213+0000","last_peered":"2024-05-08T18:30:04.123213+0000","last_clean":"2024-05-08T18:30:04.123213+0000","last_became_active":"2024-05-08T18:29:50.681771+0000","last_became_peered":"2024-05-08T18:29:50.681771+0000","last_unstale":"2024-05-08T18:30:04.123213+0000","last_undegraded":"2024-05-08T18:30:04.123213+0000","last_fullsized":"2024-05-08T18:30:04.123213+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:28:29.836446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.797115+0000","last_change":"2024-05-08T18:29:42.575909+0000","last_active":"2024-05-08T18:30:05.797115+0000","last_peered":"2024-05-08T18:30:05.797115+0000","last_clean":"2024-05-08T18:30:05.797115+0000","last_became_active":"2024-05-08T18:29:42.574877+0000","last_became_peered":"2024-05-08T18:29:42.574877+0000","last_unstale":"2024-05-08T18:30:05.797115+0000","last_undegraded":"2024-05-08T18:30:05.797115+0000","last_fullsized":"2024-05-08T18:30:05.797115+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:33.139089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.797027+0000","last_change":"2024-05-08T18:29:40.566496+0000","last_active":"2024-05-08T18:30:05.797027+0000","last_peered":"2024-05-08T18:30:05.797027+0000","last_clean":"2024-05-08T18:30:05.797027+0000","last_became_active":"2024-05-08T18:29:40.565874+0000","last_became_peered":"2024-05-08T18:29:40.565874+0000","last_unstale":"2024-05-08T18:30:05.797027+0000","last_undegraded":"2024-05-08T18:30:05.797027+0000","last_fullsized":"2024-05-08T18:30:05.797027+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:07.239963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.243370+0000","last_change":"2024-05-08T18:29:44.595410+0000","last_active":"2024-05-08T18:30:05.243370+0000","last_peered":"2024-05-08T18:30:05.243370+0000","last_clean":"2024-05-08T18:30:05.243370+0000","last_became_active":"2024-05-08T18:29:44.594286+0000","last_became_peered":"2024-05-08T18:29:44.594286+0000","last_unstale":"2024-05-08T18:30:05.243370+0000","last_undegraded":"2024-05-08T18:30:05.243370+0000","last_fullsized":"2024-05-08T18:30:05.243370+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:38.928160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"33'11","reported_seq":49,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.731558+0000","last_change":"2024-05-08T18:29:46.591009+0000","last_active":"2024-05-08T18:30:04.731558+0000","last_peered":"2024-05-08T18:30:04.731558+0000","last_clean":"2024-05-08T18:30:04.731558+0000","last_became_active":"2024-05-08T18:29:46.588810+0000","last_became_peered":"2024-05-08T18:29:46.588810+0000","last_unstale":"2024-05-08T18:30:04.731558+0000","last_undegraded":"2024-05-08T18:30:04.731558+0000","last_fullsized":"2024-05-08T18:30:04.731558+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:34:45.745300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":26,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.730646+0000","last_change":"2024-05-08T18:29:48.634986+0000","last_active":"2024-05-08T18:30:04.730646+0000","last_peered":"2024-05-08T18:30:04.730646+0000","last_clean":"2024-05-08T18:30:04.730646+0000","last_became_active":"2024-05-08T18:29:48.633866+0000","last_became_peered":"2024-05-08T18:29:48.633866+0000","last_unstale":"2024-05-08T18:30:04.730646+0000","last_undegraded":"2024-05-08T18:30:04.730646+0000","last_fullsized":"2024-05-08T18:30:04.730646+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:46.539830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":22,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.733108+0000","last_change":"2024-05-08T18:29:50.693408+0000","last_active":"2024-05-08T18:30:04.733108+0000","last_peered":"2024-05-08T18:30:04.733108+0000","last_clean":"2024-05-08T18:30:04.733108+0000","last_became_active":"2024-05-08T18:29:50.692687+0000","last_became_peered":"2024-05-08T18:29:50.692687+0000","last_unstale":"2024-05-08T18:30:04.733108+0000","last_undegraded":"2024-05-08T18:30:04.733108+0000","last_fullsized":"2024-05-08T18:30:04.733108+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:22.834262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.242547+0000","last_change":"2024-05-08T18:29:42.581368+0000","last_active":"2024-05-08T18:30:05.242547+0000","last_peered":"2024-05-08T18:30:05.242547+0000","last_clean":"2024-05-08T18:30:05.242547+0000","last_became_active":"2024-05-08T18:29:42.580887+0000","last_became_peered":"2024-05-08T18:29:42.580887+0000","last_unstale":"2024-05-08T18:30:05.242547+0000","last_undegraded":"2024-05-08T18:30:05.242547+0000","last_fullsized":"2024-05-08T18:30:05.242547+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:08:15.026467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.800348+0000","last_change":"2024-05-08T18:29:40.572770+0000","last_active":"2024-05-08T18:30:05.800348+0000","last_peered":"2024-05-08T18:30:05.800348+0000","last_clean":"2024-05-08T18:30:05.800348+0000","last_became_active":"2024-05-08T18:29:40.572079+0000","last_became_peered":"2024-05-08T18:29:40.572079+0000","last_unstale":"2024-05-08T18:30:05.800348+0000","last_undegraded":"2024-05-08T18:30:05.800348+0000","last_fullsized":"2024-05-08T18:30:05.800348+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:05.929806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.731916+0000","last_change":"2024-05-08T18:29:44.581323+0000","last_active":"2024-05-08T18:30:04.731916+0000","last_peered":"2024-05-08T18:30:04.731916+0000","last_clean":"2024-05-08T18:30:04.731916+0000","last_became_active":"2024-05-08T18:29:44.580805+0000","last_became_peered":"2024-05-08T18:29:44.580805+0000","last_unstale":"2024-05-08T18:30:04.731916+0000","last_undegraded":"2024-05-08T18:30:04.731916+0000","last_fullsized":"2024-05-08T18:30:04.731916+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:35:25.591140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'4","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.122152+0000","last_change":"2024-05-08T18:29:46.602495+0000","last_active":"2024-05-08T18:30:04.122152+0000","last_peered":"2024-05-08T18:30:04.122152+0000","last_clean":"2024-05-08T18:30:04.122152+0000","last_became_active":"2024-05-08T18:29:46.599789+0000","last_became_peered":"2024-05-08T18:29:46.599789+0000","last_unstale":"2024-05-08T18:30:04.122152+0000","last_undegraded":"2024-05-08T18:30:04.122152+0000","last_fullsized":"2024-05-08T18:30:04.122152+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:18:16.375808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":28,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.796777+0000","last_change":"2024-05-08T18:29:48.642994+0000","last_active":"2024-05-08T18:30:05.796777+0000","last_peered":"2024-05-08T18:30:05.796777+0000","last_clean":"2024-05-08T18:30:05.796777+0000","last_became_active":"2024-05-08T18:29:48.642056+0000","last_became_peered":"2024-05-08T18:29:48.642056+0000","last_unstale":"2024-05-08T18:30:05.796777+0000","last_undegraded":"2024-05-08T18:30:05.796777+0000","last_fullsized":"2024-05-08T18:30:05.796777+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:47:54.034851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.122328+0000","last_change":"2024-05-08T18:29:50.672513+0000","last_active":"2024-05-08T18:30:04.122328+0000","last_peered":"2024-05-08T18:30:04.122328+0000","last_clean":"2024-05-08T18:30:04.122328+0000","last_became_active":"2024-05-08T18:29:50.671781+0000","last_became_peered":"2024-05-08T18:29:50.671781+0000","last_unstale":"2024-05-08T18:30:04.122328+0000","last_undegraded":"2024-05-08T18:30:04.122328+0000","last_fullsized":"2024-05-08T18:30:04.122328+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:45:34.171402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.731925+0000","last_change":"2024-05-08T18:29:42.576843+0000","last_active":"2024-05-08T18:30:04.731925+0000","last_peered":"2024-05-08T18:30:04.731925+0000","last_clean":"2024-05-08T18:30:04.731925+0000","last_became_active":"2024-05-08T18:29:42.576379+0000","last_became_peered":"2024-05-08T18:29:42.576379+0000","last_unstale":"2024-05-08T18:30:04.731925+0000","last_undegraded":"2024-05-08T18:30:04.731925+0000","last_fullsized":"2024-05-08T18:30:04.731925+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:20.471010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.799155+0000","last_change":"2024-05-08T18:29:40.542997+0000","last_active":"2024-05-08T18:30:05.799155+0000","last_peered":"2024-05-08T18:30:05.799155+0000","last_clean":"2024-05-08T18:30:05.799155+0000","last_became_active":"2024-05-08T18:29:40.542239+0000","last_became_peered":"2024-05-08T18:29:40.542239+0000","last_unstale":"2024-05-08T18:30:05.799155+0000","last_undegraded":"2024-05-08T18:30:05.799155+0000","last_fullsized":"2024-05-08T18:30:05.799155+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:14:43.555504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.794372+0000","last_change":"2024-05-08T18:29:44.594178+0000","last_active":"2024-05-08T18:30:05.794372+0000","last_peered":"2024-05-08T18:30:05.794372+0000","last_clean":"2024-05-08T18:30:05.794372+0000","last_became_active":"2024-05-08T18:29:44.592476+0000","last_became_peered":"2024-05-08T18:29:44.592476+0000","last_unstale":"2024-05-08T18:30:05.794372+0000","last_undegraded":"2024-05-08T18:30:05.794372+0000","last_fullsized":"2024-05-08T18:30:05.794372+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:04:16.093662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"33'11","reported_seq":49,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.731706+0000","last_change":"2024-05-08T18:29:46.597288+0000","last_active":"2024-05-08T18:30:04.731706+0000","last_peered":"2024-05-08T18:30:04.731706+0000","last_clean":"2024-05-08T18:30:04.731706+0000","last_became_active":"2024-05-08T18:29:46.596452+0000","last_became_peered":"2024-05-08T18:29:46.596452+0000","last_unstale":"2024-05-08T18:30:04.731706+0000","last_undegraded":"2024-05-08T18:30:04.731706+0000","last_fullsized":"2024-05-08T18:30:04.731706+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:32:43.245753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":28,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.740238+0000","last_change":"2024-05-08T18:29:48.635436+0000","last_active":"2024-05-08T18:30:05.740238+0000","last_peered":"2024-05-08T18:30:05.740238+0000","last_clean":"2024-05-08T18:30:05.740238+0000","last_became_active":"2024-05-08T18:29:48.634704+0000","last_became_peered":"2024-05-08T18:29:48.634704+0000","last_unstale":"2024-05-08T18:30:05.740238+0000","last_undegraded":"2024-05-08T18:30:05.740238+0000","last_fullsized":"2024-05-08T18:30:05.740238+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:55:52.238481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.793929+0000","last_change":"2024-05-08T18:29:50.687974+0000","last_active":"2024-05-08T18:30:05.793929+0000","last_peered":"2024-05-08T18:30:05.793929+0000","last_clean":"2024-05-08T18:30:05.793929+0000","last_became_active":"2024-05-08T18:29:50.687045+0000","last_became_peered":"2024-05-08T18:29:50.687045+0000","last_unstale":"2024-05-08T18:30:05.793929+0000","last_undegraded":"2024-05-08T18:30:05.793929+0000","last_fullsized":"2024-05-08T18:30:05.793929+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:55:01.894779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.731060+0000","last_change":"2024-05-08T18:29:42.563779+0000","last_active":"2024-05-08T18:30:04.731060+0000","last_peered":"2024-05-08T18:30:04.731060+0000","last_clean":"2024-05-08T18:30:04.731060+0000","last_became_active":"2024-05-08T18:29:42.562522+0000","last_became_peered":"2024-05-08T18:29:42.562522+0000","last_unstale":"2024-05-08T18:30:04.731060+0000","last_undegraded":"2024-05-08T18:30:04.731060+0000","last_fullsized":"2024-05-08T18:30:04.731060+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:35:23.016110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.124436+0000","last_change":"2024-05-08T18:29:40.541112+0000","last_active":"2024-05-08T18:30:04.124436+0000","last_peered":"2024-05-08T18:30:04.124436+0000","last_clean":"2024-05-08T18:30:04.124436+0000","last_became_active":"2024-05-08T18:29:40.540835+0000","last_became_peered":"2024-05-08T18:29:40.540835+0000","last_unstale":"2024-05-08T18:30:04.124436+0000","last_undegraded":"2024-05-08T18:30:04.124436+0000","last_fullsized":"2024-05-08T18:30:04.124436+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:43:14.995191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.740008+0000","last_change":"2024-05-08T18:29:44.592033+0000","last_active":"2024-05-08T18:30:05.740008+0000","last_peered":"2024-05-08T18:30:05.740008+0000","last_clean":"2024-05-08T18:30:05.740008+0000","last_became_active":"2024-05-08T18:29:44.590454+0000","last_became_peered":"2024-05-08T18:29:44.590454+0000","last_unstale":"2024-05-08T18:30:05.740008+0000","last_undegraded":"2024-05-08T18:30:05.740008+0000","last_fullsized":"2024-05-08T18:30:05.740008+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:11:03.740365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"33'9","reported_seq":48,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.797015+0000","last_change":"2024-05-08T18:29:46.607002+0000","last_active":"2024-05-08T18:30:05.797015+0000","last_peered":"2024-05-08T18:30:05.797015+0000","last_clean":"2024-05-08T18:30:05.797015+0000","last_became_active":"2024-05-08T18:29:46.606172+0000","last_became_peered":"2024-05-08T18:29:46.606172+0000","last_unstale":"2024-05-08T18:30:05.797015+0000","last_undegraded":"2024-05-08T18:30:05.797015+0000","last_fullsized":"2024-05-08T18:30:05.797015+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:37:35.850414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.122473+0000","last_change":"2024-05-08T18:29:48.632948+0000","last_active":"2024-05-08T18:30:04.122473+0000","last_peered":"2024-05-08T18:30:04.122473+0000","last_clean":"2024-05-08T18:30:04.122473+0000","last_became_active":"2024-05-08T18:29:48.631219+0000","last_became_peered":"2024-05-08T18:29:48.631219+0000","last_unstale":"2024-05-08T18:30:04.122473+0000","last_undegraded":"2024-05-08T18:30:04.122473+0000","last_fullsized":"2024-05-08T18:30:04.122473+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:19:01.454355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.741838+0000","last_change":"2024-05-08T18:29:42.570180+0000","last_active":"2024-05-08T18:30:05.741838+0000","last_peered":"2024-05-08T18:30:05.741838+0000","last_clean":"2024-05-08T18:30:05.741838+0000","last_became_active":"2024-05-08T18:29:42.569425+0000","last_became_peered":"2024-05-08T18:29:42.569425+0000","last_unstale":"2024-05-08T18:30:05.741838+0000","last_undegraded":"2024-05-08T18:30:05.741838+0000","last_fullsized":"2024-05-08T18:30:05.741838+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:35.037465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.731234+0000","last_change":"2024-05-08T18:29:40.547711+0000","last_active":"2024-05-08T18:30:04.731234+0000","last_peered":"2024-05-08T18:30:04.731234+0000","last_clean":"2024-05-08T18:30:04.731234+0000","last_became_active":"2024-05-08T18:29:40.547479+0000","last_became_peered":"2024-05-08T18:29:40.547479+0000","last_unstale":"2024-05-08T18:30:04.731234+0000","last_undegraded":"2024-05-08T18:30:04.731234+0000","last_fullsized":"2024-05-08T18:30:04.731234+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:12:40.901620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":32,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.122916+0000","last_change":"2024-05-08T18:29:44.591547+0000","last_active":"2024-05-08T18:30:04.122916+0000","last_peered":"2024-05-08T18:30:04.122916+0000","last_clean":"2024-05-08T18:30:04.122916+0000","last_became_active":"2024-05-08T18:29:44.590498+0000","last_became_peered":"2024-05-08T18:29:44.590498+0000","last_unstale":"2024-05-08T18:30:04.122916+0000","last_undegraded":"2024-05-08T18:30:04.122916+0000","last_fullsized":"2024-05-08T18:30:04.122916+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:14:04.085401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"33'12","reported_seq":53,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.242629+0000","last_change":"2024-05-08T18:29:46.600437+0000","last_active":"2024-05-08T18:30:05.242629+0000","last_peered":"2024-05-08T18:30:05.242629+0000","last_clean":"2024-05-08T18:30:05.242629+0000","last_became_active":"2024-05-08T18:29:46.594672+0000","last_became_peered":"2024-05-08T18:29:46.594672+0000","last_unstale":"2024-05-08T18:30:05.242629+0000","last_undegraded":"2024-05-08T18:30:05.242629+0000","last_fullsized":"2024-05-08T18:30:05.242629+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:35:53.294312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":28,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.794222+0000","last_change":"2024-05-08T18:29:48.639840+0000","last_active":"2024-05-08T18:30:05.794222+0000","last_peered":"2024-05-08T18:30:05.794222+0000","last_clean":"2024-05-08T18:30:05.794222+0000","last_became_active":"2024-05-08T18:29:48.639120+0000","last_became_peered":"2024-05-08T18:29:48.639120+0000","last_unstale":"2024-05-08T18:30:05.794222+0000","last_undegraded":"2024-05-08T18:30:05.794222+0000","last_fullsized":"2024-05-08T18:30:05.794222+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:13:50.865474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":22,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.731425+0000","last_change":"2024-05-08T18:29:50.684843+0000","last_active":"2024-05-08T18:30:04.731425+0000","last_peered":"2024-05-08T18:30:04.731425+0000","last_clean":"2024-05-08T18:30:04.731425+0000","last_became_active":"2024-05-08T18:29:50.684119+0000","last_became_peered":"2024-05-08T18:29:50.684119+0000","last_unstale":"2024-05-08T18:30:04.731425+0000","last_undegraded":"2024-05-08T18:30:04.731425+0000","last_fullsized":"2024-05-08T18:30:04.731425+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:09:29.641515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.123508+0000","last_change":"2024-05-08T18:29:42.575763+0000","last_active":"2024-05-08T18:30:04.123508+0000","last_peered":"2024-05-08T18:30:04.123508+0000","last_clean":"2024-05-08T18:30:04.123508+0000","last_became_active":"2024-05-08T18:29:42.575450+0000","last_became_peered":"2024-05-08T18:29:42.575450+0000","last_unstale":"2024-05-08T18:30:04.123508+0000","last_undegraded":"2024-05-08T18:30:04.123508+0000","last_fullsized":"2024-05-08T18:30:04.123508+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:20.471010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.243714+0000","last_change":"2024-05-08T18:29:40.546101+0000","last_active":"2024-05-08T18:30:05.243714+0000","last_peered":"2024-05-08T18:30:05.243714+0000","last_clean":"2024-05-08T18:30:05.243714+0000","last_became_active":"2024-05-08T18:29:40.545814+0000","last_became_peered":"2024-05-08T18:29:40.545814+0000","last_unstale":"2024-05-08T18:30:05.243714+0000","last_undegraded":"2024-05-08T18:30:05.243714+0000","last_fullsized":"2024-05-08T18:30:05.243714+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:22.579629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.741645+0000","last_change":"2024-05-08T18:29:44.591310+0000","last_active":"2024-05-08T18:30:05.741645+0000","last_peered":"2024-05-08T18:30:05.741645+0000","last_clean":"2024-05-08T18:30:05.741645+0000","last_became_active":"2024-05-08T18:29:44.590394+0000","last_became_peered":"2024-05-08T18:29:44.590394+0000","last_unstale":"2024-05-08T18:30:05.741645+0000","last_undegraded":"2024-05-08T18:30:05.741645+0000","last_fullsized":"2024-05-08T18:30:05.741645+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:02:28.348982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"33'15","reported_seq":57,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.797869+0000","last_change":"2024-05-08T18:29:46.605887+0000","last_active":"2024-05-08T18:30:05.797869+0000","last_peered":"2024-05-08T18:30:05.797869+0000","last_clean":"2024-05-08T18:30:05.797869+0000","last_became_active":"2024-05-08T18:29:46.604917+0000","last_became_peered":"2024-05-08T18:29:46.604917+0000","last_unstale":"2024-05-08T18:30:05.797869+0000","last_undegraded":"2024-05-08T18:30:05.797869+0000","last_fullsized":"2024-05-08T18:30:05.797869+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:22:36.338527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":26,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.243226+0000","last_change":"2024-05-08T18:29:48.644420+0000","last_active":"2024-05-08T18:30:05.243226+0000","last_peered":"2024-05-08T18:30:05.243226+0000","last_clean":"2024-05-08T18:30:05.243226+0000","last_became_active":"2024-05-08T18:29:48.643493+0000","last_became_peered":"2024-05-08T18:29:48.643493+0000","last_unstale":"2024-05-08T18:30:05.243226+0000","last_undegraded":"2024-05-08T18:30:05.243226+0000","last_fullsized":"2024-05-08T18:30:05.243226+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:19:33.148012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.739976+0000","last_change":"2024-05-08T18:29:50.687485+0000","last_active":"2024-05-08T18:30:05.739976+0000","last_peered":"2024-05-08T18:30:05.739976+0000","last_clean":"2024-05-08T18:30:05.739976+0000","last_became_active":"2024-05-08T18:29:50.686750+0000","last_became_peered":"2024-05-08T18:29:50.686750+0000","last_unstale":"2024-05-08T18:30:05.739976+0000","last_undegraded":"2024-05-08T18:30:05.739976+0000","last_fullsized":"2024-05-08T18:30:05.739976+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:41.914164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.732706+0000","last_change":"2024-05-08T18:29:42.566571+0000","last_active":"2024-05-08T18:30:04.732706+0000","last_peered":"2024-05-08T18:30:04.732706+0000","last_clean":"2024-05-08T18:30:04.732706+0000","last_became_active":"2024-05-08T18:29:42.563695+0000","last_became_peered":"2024-05-08T18:29:42.563695+0000","last_unstale":"2024-05-08T18:30:04.732706+0000","last_undegraded":"2024-05-08T18:30:04.732706+0000","last_fullsized":"2024-05-08T18:30:04.732706+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:46.887628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.798037+0000","last_change":"2024-05-08T18:29:40.545512+0000","last_active":"2024-05-08T18:30:05.798037+0000","last_peered":"2024-05-08T18:30:05.798037+0000","last_clean":"2024-05-08T18:30:05.798037+0000","last_became_active":"2024-05-08T18:29:40.544216+0000","last_became_peered":"2024-05-08T18:29:40.544216+0000","last_unstale":"2024-05-08T18:30:05.798037+0000","last_undegraded":"2024-05-08T18:30:05.798037+0000","last_fullsized":"2024-05-08T18:30:05.798037+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:37:08.242362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.798955+0000","last_change":"2024-05-08T18:29:44.576107+0000","last_active":"2024-05-08T18:30:05.798955+0000","last_peered":"2024-05-08T18:30:05.798955+0000","last_clean":"2024-05-08T18:30:05.798955+0000","last_became_active":"2024-05-08T18:29:44.575344+0000","last_became_peered":"2024-05-08T18:29:44.575344+0000","last_unstale":"2024-05-08T18:30:05.798955+0000","last_undegraded":"2024-05-08T18:30:05.798955+0000","last_fullsized":"2024-05-08T18:30:05.798955+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:19.731003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"33'11","reported_seq":49,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.734275+0000","last_change":"2024-05-08T18:29:46.584785+0000","last_active":"2024-05-08T18:30:04.734275+0000","last_peered":"2024-05-08T18:30:04.734275+0000","last_clean":"2024-05-08T18:30:04.734275+0000","last_became_active":"2024-05-08T18:29:46.583390+0000","last_became_peered":"2024-05-08T18:29:46.583390+0000","last_unstale":"2024-05-08T18:30:04.734275+0000","last_undegraded":"2024-05-08T18:30:04.734275+0000","last_fullsized":"2024-05-08T18:30:04.734275+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:27:01.747339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":26,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.242578+0000","last_change":"2024-05-08T18:29:48.643558+0000","last_active":"2024-05-08T18:30:05.242578+0000","last_peered":"2024-05-08T18:30:05.242578+0000","last_clean":"2024-05-08T18:30:05.242578+0000","last_became_active":"2024-05-08T18:29:48.642773+0000","last_became_peered":"2024-05-08T18:29:48.642773+0000","last_unstale":"2024-05-08T18:30:05.242578+0000","last_undegraded":"2024-05-08T18:30:05.242578+0000","last_fullsized":"2024-05-08T18:30:05.242578+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:59:04.369806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.793389+0000","last_change":"2024-05-08T18:29:50.674796+0000","last_active":"2024-05-08T18:30:05.793389+0000","last_peered":"2024-05-08T18:30:05.793389+0000","last_clean":"2024-05-08T18:30:05.793389+0000","last_became_active":"2024-05-08T18:29:50.674057+0000","last_became_peered":"2024-05-08T18:29:50.674057+0000","last_unstale":"2024-05-08T18:30:05.793389+0000","last_undegraded":"2024-05-08T18:30:05.793389+0000","last_fullsized":"2024-05-08T18:30:05.793389+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:34:14.488295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.732871+0000","last_change":"2024-05-08T18:29:42.577642+0000","last_active":"2024-05-08T18:30:04.732871+0000","last_peered":"2024-05-08T18:30:04.732871+0000","last_clean":"2024-05-08T18:30:04.732871+0000","last_became_active":"2024-05-08T18:29:42.577275+0000","last_became_peered":"2024-05-08T18:29:42.577275+0000","last_unstale":"2024-05-08T18:30:04.732871+0000","last_undegraded":"2024-05-08T18:30:04.732871+0000","last_fullsized":"2024-05-08T18:30:04.732871+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:51:45.155037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.123055+0000","last_change":"2024-05-08T18:29:40.562873+0000","last_active":"2024-05-08T18:30:04.123055+0000","last_peered":"2024-05-08T18:30:04.123055+0000","last_clean":"2024-05-08T18:30:04.123055+0000","last_became_active":"2024-05-08T18:29:40.562594+0000","last_became_peered":"2024-05-08T18:29:40.562594+0000","last_unstale":"2024-05-08T18:30:04.123055+0000","last_undegraded":"2024-05-08T18:30:04.123055+0000","last_fullsized":"2024-05-08T18:30:04.123055+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:16:16.521258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.243664+0000","last_change":"2024-05-08T18:29:44.594152+0000","last_active":"2024-05-08T18:30:05.243664+0000","last_peered":"2024-05-08T18:30:05.243664+0000","last_clean":"2024-05-08T18:30:05.243664+0000","last_became_active":"2024-05-08T18:29:44.593398+0000","last_became_peered":"2024-05-08T18:29:44.593398+0000","last_unstale":"2024-05-08T18:30:05.243664+0000","last_undegraded":"2024-05-08T18:30:05.243664+0000","last_fullsized":"2024-05-08T18:30:05.243664+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:11.825480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"33'10","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.798464+0000","last_change":"2024-05-08T18:29:46.602137+0000","last_active":"2024-05-08T18:30:05.798464+0000","last_peered":"2024-05-08T18:30:05.798464+0000","last_clean":"2024-05-08T18:30:05.798464+0000","last_became_active":"2024-05-08T18:29:46.601402+0000","last_became_peered":"2024-05-08T18:29:46.601402+0000","last_unstale":"2024-05-08T18:30:05.798464+0000","last_undegraded":"2024-05-08T18:30:05.798464+0000","last_fullsized":"2024-05-08T18:30:05.798464+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:23.940519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"30'2","reported_seq":34,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.741407+0000","last_change":"2024-05-08T18:29:48.635696+0000","last_active":"2024-05-08T18:30:05.741407+0000","last_peered":"2024-05-08T18:30:05.741407+0000","last_clean":"2024-05-08T18:30:05.741407+0000","last_became_active":"2024-05-08T18:29:48.634859+0000","last_became_peered":"2024-05-08T18:29:48.634859+0000","last_unstale":"2024-05-08T18:30:05.741407+0000","last_undegraded":"2024-05-08T18:30:05.741407+0000","last_fullsized":"2024-05-08T18:30:05.741407+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:35:55.322495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.794101+0000","last_change":"2024-05-08T18:29:50.679757+0000","last_active":"2024-05-08T18:30:05.794101+0000","last_peered":"2024-05-08T18:30:05.794101+0000","last_clean":"2024-05-08T18:30:05.794101+0000","last_became_active":"2024-05-08T18:29:50.679011+0000","last_became_peered":"2024-05-08T18:29:50.679011+0000","last_unstale":"2024-05-08T18:30:05.794101+0000","last_undegraded":"2024-05-08T18:30:05.794101+0000","last_fullsized":"2024-05-08T18:30:05.794101+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:34:14.488295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.796876+0000","last_change":"2024-05-08T18:29:42.560354+0000","last_active":"2024-05-08T18:30:05.796876+0000","last_peered":"2024-05-08T18:30:05.796876+0000","last_clean":"2024-05-08T18:30:05.796876+0000","last_became_active":"2024-05-08T18:29:42.559647+0000","last_became_peered":"2024-05-08T18:29:42.559647+0000","last_unstale":"2024-05-08T18:30:05.796876+0000","last_undegraded":"2024-05-08T18:30:05.796876+0000","last_fullsized":"2024-05-08T18:30:05.796876+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:18:10.803989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.794664+0000","last_change":"2024-05-08T18:29:40.557683+0000","last_active":"2024-05-08T18:30:05.794664+0000","last_peered":"2024-05-08T18:30:05.794664+0000","last_clean":"2024-05-08T18:30:05.794664+0000","last_became_active":"2024-05-08T18:29:40.556254+0000","last_became_peered":"2024-05-08T18:29:40.556254+0000","last_unstale":"2024-05-08T18:30:05.794664+0000","last_undegraded":"2024-05-08T18:30:05.794664+0000","last_fullsized":"2024-05-08T18:30:05.794664+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:51:43.135322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.796528+0000","last_change":"2024-05-08T18:29:44.594068+0000","last_active":"2024-05-08T18:30:05.796528+0000","last_peered":"2024-05-08T18:30:05.796528+0000","last_clean":"2024-05-08T18:30:05.796528+0000","last_became_active":"2024-05-08T18:29:44.593322+0000","last_became_peered":"2024-05-08T18:29:44.593322+0000","last_unstale":"2024-05-08T18:30:05.796528+0000","last_undegraded":"2024-05-08T18:30:05.796528+0000","last_fullsized":"2024-05-08T18:30:05.796528+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:19.731003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"33'15","reported_seq":57,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.795047+0000","last_change":"2024-05-08T18:29:46.604700+0000","last_active":"2024-05-08T18:30:05.795047+0000","last_peered":"2024-05-08T18:30:05.795047+0000","last_clean":"2024-05-08T18:30:05.795047+0000","last_became_active":"2024-05-08T18:29:46.603885+0000","last_became_peered":"2024-05-08T18:29:46.603885+0000","last_unstale":"2024-05-08T18:30:05.795047+0000","last_undegraded":"2024-05-08T18:30:05.795047+0000","last_fullsized":"2024-05-08T18:30:05.795047+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:22:36.338527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.121926+0000","last_change":"2024-05-08T18:29:48.640814+0000","last_active":"2024-05-08T18:30:04.121926+0000","last_peered":"2024-05-08T18:30:04.121926+0000","last_clean":"2024-05-08T18:30:04.121926+0000","last_became_active":"2024-05-08T18:29:48.640046+0000","last_became_peered":"2024-05-08T18:29:48.640046+0000","last_unstale":"2024-05-08T18:30:04.121926+0000","last_undegraded":"2024-05-08T18:30:04.121926+0000","last_fullsized":"2024-05-08T18:30:04.121926+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:53:21.219706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.800999+0000","last_change":"2024-05-08T18:29:50.692688+0000","last_active":"2024-05-08T18:30:05.800999+0000","last_peered":"2024-05-08T18:30:05.800999+0000","last_clean":"2024-05-08T18:30:05.800999+0000","last_became_active":"2024-05-08T18:29:50.692123+0000","last_became_peered":"2024-05-08T18:29:50.692123+0000","last_unstale":"2024-05-08T18:30:05.800999+0000","last_undegraded":"2024-05-08T18:30:05.800999+0000","last_fullsized":"2024-05-08T18:30:05.800999+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:38.318890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.797342+0000","last_change":"2024-05-08T18:29:42.558336+0000","last_active":"2024-05-08T18:30:05.797342+0000","last_peered":"2024-05-08T18:30:05.797342+0000","last_clean":"2024-05-08T18:30:05.797342+0000","last_became_active":"2024-05-08T18:29:42.557570+0000","last_became_peered":"2024-05-08T18:29:42.557570+0000","last_unstale":"2024-05-08T18:30:05.797342+0000","last_undegraded":"2024-05-08T18:30:05.797342+0000","last_fullsized":"2024-05-08T18:30:05.797342+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:54:16.539832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.796493+0000","last_change":"2024-05-08T18:29:40.537090+0000","last_active":"2024-05-08T18:30:05.796493+0000","last_peered":"2024-05-08T18:30:05.796493+0000","last_clean":"2024-05-08T18:30:05.796493+0000","last_became_active":"2024-05-08T18:29:40.536188+0000","last_became_peered":"2024-05-08T18:29:40.536188+0000","last_unstale":"2024-05-08T18:30:05.796493+0000","last_undegraded":"2024-05-08T18:30:05.796493+0000","last_fullsized":"2024-05-08T18:30:05.796493+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:22:48.880581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.794281+0000","last_change":"2024-05-08T18:29:44.578901+0000","last_active":"2024-05-08T18:30:05.794281+0000","last_peered":"2024-05-08T18:30:05.794281+0000","last_clean":"2024-05-08T18:30:05.794281+0000","last_became_active":"2024-05-08T18:29:44.578171+0000","last_became_peered":"2024-05-08T18:29:44.578171+0000","last_unstale":"2024-05-08T18:30:05.794281+0000","last_undegraded":"2024-05-08T18:30:05.794281+0000","last_fullsized":"2024-05-08T18:30:05.794281+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:19.731003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"33'9","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.121981+0000","last_change":"2024-05-08T18:29:46.604539+0000","last_active":"2024-05-08T18:30:04.121981+0000","last_peered":"2024-05-08T18:30:04.121981+0000","last_clean":"2024-05-08T18:30:04.121981+0000","last_became_active":"2024-05-08T18:29:46.603728+0000","last_became_peered":"2024-05-08T18:29:46.603728+0000","last_unstale":"2024-05-08T18:30:04.121981+0000","last_undegraded":"2024-05-08T18:30:04.121981+0000","last_fullsized":"2024-05-08T18:30:04.121981+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:12:41.226788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":28,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.739746+0000","last_change":"2024-05-08T18:29:48.635813+0000","last_active":"2024-05-08T18:30:05.739746+0000","last_peered":"2024-05-08T18:30:05.739746+0000","last_clean":"2024-05-08T18:30:05.739746+0000","last_became_active":"2024-05-08T18:29:48.634664+0000","last_became_peered":"2024-05-08T18:29:48.634664+0000","last_unstale":"2024-05-08T18:30:05.739746+0000","last_undegraded":"2024-05-08T18:30:05.739746+0000","last_fullsized":"2024-05-08T18:30:05.739746+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:27:23.427365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":22,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.733344+0000","last_change":"2024-05-08T18:29:50.687517+0000","last_active":"2024-05-08T18:30:04.733344+0000","last_peered":"2024-05-08T18:30:04.733344+0000","last_clean":"2024-05-08T18:30:04.733344+0000","last_became_active":"2024-05-08T18:29:50.686662+0000","last_became_peered":"2024-05-08T18:29:50.686662+0000","last_unstale":"2024-05-08T18:30:04.733344+0000","last_undegraded":"2024-05-08T18:30:04.733344+0000","last_fullsized":"2024-05-08T18:30:04.733344+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:58:00.455559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.732068+0000","last_change":"2024-05-08T18:29:42.558848+0000","last_active":"2024-05-08T18:30:04.732068+0000","last_peered":"2024-05-08T18:30:04.732068+0000","last_clean":"2024-05-08T18:30:04.732068+0000","last_became_active":"2024-05-08T18:29:42.558390+0000","last_became_peered":"2024-05-08T18:29:42.558390+0000","last_unstale":"2024-05-08T18:30:04.732068+0000","last_undegraded":"2024-05-08T18:30:04.732068+0000","last_fullsized":"2024-05-08T18:30:04.732068+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:55:30.468069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.733713+0000","last_change":"2024-05-08T18:29:40.567772+0000","last_active":"2024-05-08T18:30:04.733713+0000","last_peered":"2024-05-08T18:30:04.733713+0000","last_clean":"2024-05-08T18:30:04.733713+0000","last_became_active":"2024-05-08T18:29:40.567482+0000","last_became_peered":"2024-05-08T18:29:40.567482+0000","last_unstale":"2024-05-08T18:30:04.733713+0000","last_undegraded":"2024-05-08T18:30:04.733713+0000","last_fullsized":"2024-05-08T18:30:04.733713+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:36:37.796095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.794911+0000","last_change":"2024-05-08T18:29:44.596876+0000","last_active":"2024-05-08T18:30:05.794911+0000","last_peered":"2024-05-08T18:30:05.794911+0000","last_clean":"2024-05-08T18:30:05.794911+0000","last_became_active":"2024-05-08T18:29:44.595712+0000","last_became_peered":"2024-05-08T18:29:44.595712+0000","last_unstale":"2024-05-08T18:30:05.794911+0000","last_undegraded":"2024-05-08T18:30:05.794911+0000","last_fullsized":"2024-05-08T18:30:05.794911+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:35:51.288126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"33'5","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.732551+0000","last_change":"2024-05-08T18:29:46.598637+0000","last_active":"2024-05-08T18:30:04.732551+0000","last_peered":"2024-05-08T18:30:04.732551+0000","last_clean":"2024-05-08T18:30:04.732551+0000","last_became_active":"2024-05-08T18:29:46.597394+0000","last_became_peered":"2024-05-08T18:29:46.597394+0000","last_unstale":"2024-05-08T18:30:04.732551+0000","last_undegraded":"2024-05-08T18:30:04.732551+0000","last_fullsized":"2024-05-08T18:30:04.732551+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:52:22.540814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":28,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.794946+0000","last_change":"2024-05-08T18:29:48.642251+0000","last_active":"2024-05-08T18:30:05.794946+0000","last_peered":"2024-05-08T18:30:05.794946+0000","last_clean":"2024-05-08T18:30:05.794946+0000","last_became_active":"2024-05-08T18:29:48.641666+0000","last_became_peered":"2024-05-08T18:29:48.641666+0000","last_unstale":"2024-05-08T18:30:05.794946+0000","last_undegraded":"2024-05-08T18:30:05.794946+0000","last_fullsized":"2024-05-08T18:30:05.794946+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:13:50.865474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.799512+0000","last_change":"2024-05-08T18:29:50.685668+0000","last_active":"2024-05-08T18:30:05.799512+0000","last_peered":"2024-05-08T18:30:05.799512+0000","last_clean":"2024-05-08T18:30:05.799512+0000","last_became_active":"2024-05-08T18:29:50.684958+0000","last_became_peered":"2024-05-08T18:29:50.684958+0000","last_unstale":"2024-05-08T18:30:05.799512+0000","last_undegraded":"2024-05-08T18:30:05.799512+0000","last_fullsized":"2024-05-08T18:30:05.799512+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:55:01.894779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.795528+0000","last_change":"2024-05-08T18:29:42.562063+0000","last_active":"2024-05-08T18:30:05.795528+0000","last_peered":"2024-05-08T18:30:05.795528+0000","last_clean":"2024-05-08T18:30:05.795528+0000","last_became_active":"2024-05-08T18:29:42.558871+0000","last_became_peered":"2024-05-08T18:29:42.558871+0000","last_unstale":"2024-05-08T18:30:05.795528+0000","last_undegraded":"2024-05-08T18:30:05.795528+0000","last_fullsized":"2024-05-08T18:30:05.795528+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:59.243324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.124357+0000","last_change":"2024-05-08T18:29:40.541070+0000","last_active":"2024-05-08T18:30:04.124357+0000","last_peered":"2024-05-08T18:30:04.124357+0000","last_clean":"2024-05-08T18:30:04.124357+0000","last_became_active":"2024-05-08T18:29:40.540767+0000","last_became_peered":"2024-05-08T18:29:40.540767+0000","last_unstale":"2024-05-08T18:30:04.124357+0000","last_undegraded":"2024-05-08T18:30:04.124357+0000","last_fullsized":"2024-05-08T18:30:04.124357+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:09:39.835826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"26'1","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.242236+0000","last_change":"2024-05-08T18:29:44.592737+0000","last_active":"2024-05-08T18:30:05.242236+0000","last_peered":"2024-05-08T18:30:05.242236+0000","last_clean":"2024-05-08T18:30:05.242236+0000","last_became_active":"2024-05-08T18:29:44.592243+0000","last_became_peered":"2024-05-08T18:29:44.592243+0000","last_unstale":"2024-05-08T18:30:05.242236+0000","last_undegraded":"2024-05-08T18:30:05.242236+0000","last_fullsized":"2024-05-08T18:30:05.242236+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:59.744050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"33'9","reported_seq":48,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.796411+0000","last_change":"2024-05-08T18:29:46.610835+0000","last_active":"2024-05-08T18:30:05.796411+0000","last_peered":"2024-05-08T18:30:05.796411+0000","last_clean":"2024-05-08T18:30:05.796411+0000","last_became_active":"2024-05-08T18:29:46.609903+0000","last_became_peered":"2024-05-08T18:29:46.609903+0000","last_unstale":"2024-05-08T18:30:05.796411+0000","last_undegraded":"2024-05-08T18:30:05.796411+0000","last_fullsized":"2024-05-08T18:30:05.796411+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:37:35.850414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.122381+0000","last_change":"2024-05-08T18:29:48.629822+0000","last_active":"2024-05-08T18:30:04.122381+0000","last_peered":"2024-05-08T18:30:04.122381+0000","last_clean":"2024-05-08T18:30:04.122381+0000","last_became_active":"2024-05-08T18:29:48.629204+0000","last_became_peered":"2024-05-08T18:29:48.629204+0000","last_unstale":"2024-05-08T18:30:04.122381+0000","last_undegraded":"2024-05-08T18:30:04.122381+0000","last_fullsized":"2024-05-08T18:30:04.122381+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:04.571608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.801593+0000","last_change":"2024-05-08T18:29:50.668101+0000","last_active":"2024-05-08T18:30:05.801593+0000","last_peered":"2024-05-08T18:30:05.801593+0000","last_clean":"2024-05-08T18:30:05.801593+0000","last_became_active":"2024-05-08T18:29:50.667357+0000","last_became_peered":"2024-05-08T18:29:50.667357+0000","last_unstale":"2024-05-08T18:30:05.801593+0000","last_undegraded":"2024-05-08T18:30:05.801593+0000","last_fullsized":"2024-05-08T18:30:05.801593+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:55:01.894779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.243340+0000","last_change":"2024-05-08T18:29:42.581366+0000","last_active":"2024-05-08T18:30:05.243340+0000","last_peered":"2024-05-08T18:30:05.243340+0000","last_clean":"2024-05-08T18:30:05.243340+0000","last_became_active":"2024-05-08T18:29:42.580988+0000","last_became_peered":"2024-05-08T18:29:42.580988+0000","last_unstale":"2024-05-08T18:30:05.243340+0000","last_undegraded":"2024-05-08T18:30:05.243340+0000","last_fullsized":"2024-05-08T18:30:05.243340+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:42.005809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.739675+0000","last_change":"2024-05-08T18:29:40.562025+0000","last_active":"2024-05-08T18:30:05.739675+0000","last_peered":"2024-05-08T18:30:05.739675+0000","last_clean":"2024-05-08T18:30:05.739675+0000","last_became_active":"2024-05-08T18:29:40.561277+0000","last_became_peered":"2024-05-08T18:29:40.561277+0000","last_unstale":"2024-05-08T18:30:05.739675+0000","last_undegraded":"2024-05-08T18:30:05.739675+0000","last_fullsized":"2024-05-08T18:30:05.739675+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:59:25.840149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.243028+0000","last_change":"2024-05-08T18:29:42.573832+0000","last_active":"2024-05-08T18:30:05.243028+0000","last_peered":"2024-05-08T18:30:05.243028+0000","last_clean":"2024-05-08T18:30:05.243028+0000","last_became_active":"2024-05-08T18:29:42.573502+0000","last_became_peered":"2024-05-08T18:29:42.573502+0000","last_unstale":"2024-05-08T18:30:05.243028+0000","last_undegraded":"2024-05-08T18:30:05.243028+0000","last_fullsized":"2024-05-08T18:30:05.243028+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:35.037465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.731068+0000","last_change":"2024-05-08T18:29:40.533094+0000","last_active":"2024-05-08T18:30:04.731068+0000","last_peered":"2024-05-08T18:30:04.731068+0000","last_clean":"2024-05-08T18:30:04.731068+0000","last_became_active":"2024-05-08T18:29:40.532246+0000","last_became_peered":"2024-05-08T18:29:40.532246+0000","last_unstale":"2024-05-08T18:30:04.731068+0000","last_undegraded":"2024-05-08T18:30:04.731068+0000","last_fullsized":"2024-05-08T18:30:04.731068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:37:08.242362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.796108+0000","last_change":"2024-05-08T18:29:42.565298+0000","last_active":"2024-05-08T18:30:05.796108+0000","last_peered":"2024-05-08T18:30:05.796108+0000","last_clean":"2024-05-08T18:30:05.796108+0000","last_became_active":"2024-05-08T18:29:42.564542+0000","last_became_peered":"2024-05-08T18:29:42.564542+0000","last_unstale":"2024-05-08T18:30:05.796108+0000","last_undegraded":"2024-05-08T18:30:05.796108+0000","last_fullsized":"2024-05-08T18:30:05.796108+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:57.706167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.794372+0000","last_change":"2024-05-08T18:29:40.556958+0000","last_active":"2024-05-08T18:30:05.794372+0000","last_peered":"2024-05-08T18:30:05.794372+0000","last_clean":"2024-05-08T18:30:05.794372+0000","last_became_active":"2024-05-08T18:29:40.556091+0000","last_became_peered":"2024-05-08T18:29:40.556091+0000","last_unstale":"2024-05-08T18:30:05.794372+0000","last_undegraded":"2024-05-08T18:30:05.794372+0000","last_fullsized":"2024-05-08T18:30:05.794372+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:39.986094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.243154+0000","last_change":"2024-05-08T18:29:42.574619+0000","last_active":"2024-05-08T18:30:05.243154+0000","last_peered":"2024-05-08T18:30:05.243154+0000","last_clean":"2024-05-08T18:30:05.243154+0000","last_became_active":"2024-05-08T18:29:42.573178+0000","last_became_peered":"2024-05-08T18:29:42.573178+0000","last_unstale":"2024-05-08T18:30:05.243154+0000","last_undegraded":"2024-05-08T18:30:05.243154+0000","last_fullsized":"2024-05-08T18:30:05.243154+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:33.139089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.123248+0000","last_change":"2024-05-08T18:29:40.544338+0000","last_active":"2024-05-08T18:30:04.123248+0000","last_peered":"2024-05-08T18:30:04.123248+0000","last_clean":"2024-05-08T18:30:04.123248+0000","last_became_active":"2024-05-08T18:29:40.544107+0000","last_became_peered":"2024-05-08T18:29:40.544107+0000","last_unstale":"2024-05-08T18:30:04.123248+0000","last_undegraded":"2024-05-08T18:30:04.123248+0000","last_fullsized":"2024-05-08T18:30:04.123248+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:54.200883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.732198+0000","last_change":"2024-05-08T18:29:42.576979+0000","last_active":"2024-05-08T18:30:04.732198+0000","last_peered":"2024-05-08T18:30:04.732198+0000","last_clean":"2024-05-08T18:30:04.732198+0000","last_became_active":"2024-05-08T18:29:42.576395+0000","last_became_peered":"2024-05-08T18:29:42.576395+0000","last_unstale":"2024-05-08T18:30:04.732198+0000","last_undegraded":"2024-05-08T18:30:04.732198+0000","last_fullsized":"2024-05-08T18:30:04.732198+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:53:03.097704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.733387+0000","last_change":"2024-05-08T18:29:40.558142+0000","last_active":"2024-05-08T18:30:04.733387+0000","last_peered":"2024-05-08T18:30:04.733387+0000","last_clean":"2024-05-08T18:30:04.733387+0000","last_became_active":"2024-05-08T18:29:40.557874+0000","last_became_peered":"2024-05-08T18:29:40.557874+0000","last_unstale":"2024-05-08T18:30:04.733387+0000","last_undegraded":"2024-05-08T18:30:04.733387+0000","last_fullsized":"2024-05-08T18:30:04.733387+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:54.200883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.797733+0000","last_change":"2024-05-08T18:29:42.558324+0000","last_active":"2024-05-08T18:30:05.797733+0000","last_peered":"2024-05-08T18:30:05.797733+0000","last_clean":"2024-05-08T18:30:05.797733+0000","last_became_active":"2024-05-08T18:29:42.556774+0000","last_became_peered":"2024-05-08T18:29:42.556774+0000","last_unstale":"2024-05-08T18:30:05.797733+0000","last_undegraded":"2024-05-08T18:30:05.797733+0000","last_fullsized":"2024-05-08T18:30:05.797733+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:02:26.311100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.243939+0000","last_change":"2024-05-08T18:29:40.545648+0000","last_active":"2024-05-08T18:30:05.243939+0000","last_peered":"2024-05-08T18:30:05.243939+0000","last_clean":"2024-05-08T18:30:05.243939+0000","last_became_active":"2024-05-08T18:29:40.545382+0000","last_became_peered":"2024-05-08T18:29:40.545382+0000","last_unstale":"2024-05-08T18:30:05.243939+0000","last_undegraded":"2024-05-08T18:30:05.243939+0000","last_fullsized":"2024-05-08T18:30:05.243939+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:17:47.828990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.731844+0000","last_change":"2024-05-08T18:29:42.562772+0000","last_active":"2024-05-08T18:30:04.731844+0000","last_peered":"2024-05-08T18:30:04.731844+0000","last_clean":"2024-05-08T18:30:04.731844+0000","last_became_active":"2024-05-08T18:29:42.562420+0000","last_became_peered":"2024-05-08T18:29:42.562420+0000","last_unstale":"2024-05-08T18:30:04.731844+0000","last_undegraded":"2024-05-08T18:30:04.731844+0000","last_fullsized":"2024-05-08T18:30:04.731844+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:30:29.452640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.741811+0000","last_change":"2024-05-08T18:29:40.562024+0000","last_active":"2024-05-08T18:30:05.741811+0000","last_peered":"2024-05-08T18:30:05.741811+0000","last_clean":"2024-05-08T18:30:05.741811+0000","last_became_active":"2024-05-08T18:29:40.561326+0000","last_became_peered":"2024-05-08T18:29:40.561326+0000","last_unstale":"2024-05-08T18:30:05.741811+0000","last_undegraded":"2024-05-08T18:30:05.741811+0000","last_fullsized":"2024-05-08T18:30:05.741811+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:21:38.354933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.739594+0000","last_change":"2024-05-08T18:29:42.561419+0000","last_active":"2024-05-08T18:30:05.739594+0000","last_peered":"2024-05-08T18:30:05.739594+0000","last_clean":"2024-05-08T18:30:05.739594+0000","last_became_active":"2024-05-08T18:29:42.560520+0000","last_became_peered":"2024-05-08T18:29:42.560520+0000","last_unstale":"2024-05-08T18:30:05.739594+0000","last_undegraded":"2024-05-08T18:30:05.739594+0000","last_fullsized":"2024-05-08T18:30:05.739594+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:07.949520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.734040+0000","last_change":"2024-05-08T18:29:40.554884+0000","last_active":"2024-05-08T18:30:04.734040+0000","last_peered":"2024-05-08T18:30:04.734040+0000","last_clean":"2024-05-08T18:30:04.734040+0000","last_became_active":"2024-05-08T18:29:40.554603+0000","last_became_peered":"2024-05-08T18:29:40.554603+0000","last_unstale":"2024-05-08T18:30:04.734040+0000","last_undegraded":"2024-05-08T18:30:04.734040+0000","last_fullsized":"2024-05-08T18:30:04.734040+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:09:39.835826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.124270+0000","last_change":"2024-05-08T18:29:42.574689+0000","last_active":"2024-05-08T18:30:04.124270+0000","last_peered":"2024-05-08T18:30:04.124270+0000","last_clean":"2024-05-08T18:30:04.124270+0000","last_became_active":"2024-05-08T18:29:42.573947+0000","last_became_peered":"2024-05-08T18:29:42.573947+0000","last_unstale":"2024-05-08T18:30:04.124270+0000","last_undegraded":"2024-05-08T18:30:04.124270+0000","last_fullsized":"2024-05-08T18:30:04.124270+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:57:14.869860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.793640+0000","last_change":"2024-05-08T18:29:40.554005+0000","last_active":"2024-05-08T18:30:05.793640+0000","last_peered":"2024-05-08T18:30:05.793640+0000","last_clean":"2024-05-08T18:30:05.793640+0000","last_became_active":"2024-05-08T18:29:40.553356+0000","last_became_peered":"2024-05-08T18:29:40.553356+0000","last_unstale":"2024-05-08T18:30:05.793640+0000","last_undegraded":"2024-05-08T18:30:05.793640+0000","last_fullsized":"2024-05-08T18:30:05.793640+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:08:13.006752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.798935+0000","last_change":"2024-05-08T18:29:42.566487+0000","last_active":"2024-05-08T18:30:05.798935+0000","last_peered":"2024-05-08T18:30:05.798935+0000","last_clean":"2024-05-08T18:30:05.798935+0000","last_became_active":"2024-05-08T18:29:42.565760+0000","last_became_peered":"2024-05-08T18:29:42.565760+0000","last_unstale":"2024-05-08T18:30:05.798935+0000","last_undegraded":"2024-05-08T18:30:05.798935+0000","last_fullsized":"2024-05-08T18:30:05.798935+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:57.706167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.732161+0000","last_change":"2024-05-08T18:29:40.552543+0000","last_active":"2024-05-08T18:30:04.732161+0000","last_peered":"2024-05-08T18:30:04.732161+0000","last_clean":"2024-05-08T18:30:04.732161+0000","last_became_active":"2024-05-08T18:29:40.552307+0000","last_became_peered":"2024-05-08T18:29:40.552307+0000","last_unstale":"2024-05-08T18:30:04.732161+0000","last_undegraded":"2024-05-08T18:30:04.732161+0000","last_fullsized":"2024-05-08T18:30:04.732161+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:48.294532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.733272+0000","last_change":"2024-05-08T18:29:42.561658+0000","last_active":"2024-05-08T18:30:04.733272+0000","last_peered":"2024-05-08T18:30:04.733272+0000","last_clean":"2024-05-08T18:30:04.733272+0000","last_became_active":"2024-05-08T18:29:42.561171+0000","last_became_peered":"2024-05-08T18:29:42.561171+0000","last_unstale":"2024-05-08T18:30:04.733272+0000","last_undegraded":"2024-05-08T18:30:04.733272+0000","last_fullsized":"2024-05-08T18:30:04.733272+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:15.966061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.794282+0000","last_change":"2024-05-08T18:29:40.543041+0000","last_active":"2024-05-08T18:30:05.794282+0000","last_peered":"2024-05-08T18:30:05.794282+0000","last_clean":"2024-05-08T18:30:05.794282+0000","last_became_active":"2024-05-08T18:29:40.542398+0000","last_became_peered":"2024-05-08T18:29:40.542398+0000","last_unstale":"2024-05-08T18:30:05.794282+0000","last_undegraded":"2024-05-08T18:30:05.794282+0000","last_fullsized":"2024-05-08T18:30:05.794282+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:33.017750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.798563+0000","last_change":"2024-05-08T18:29:42.579690+0000","last_active":"2024-05-08T18:30:05.798563+0000","last_peered":"2024-05-08T18:30:05.798563+0000","last_clean":"2024-05-08T18:30:05.798563+0000","last_became_active":"2024-05-08T18:29:42.578981+0000","last_became_peered":"2024-05-08T18:29:42.578981+0000","last_unstale":"2024-05-08T18:30:05.798563+0000","last_undegraded":"2024-05-08T18:30:05.798563+0000","last_fullsized":"2024-05-08T18:30:05.798563+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:36:03.084561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.123447+0000","last_change":"2024-05-08T18:29:40.548499+0000","last_active":"2024-05-08T18:30:04.123447+0000","last_peered":"2024-05-08T18:30:04.123447+0000","last_clean":"2024-05-08T18:30:04.123447+0000","last_became_active":"2024-05-08T18:29:40.548177+0000","last_became_peered":"2024-05-08T18:29:40.548177+0000","last_unstale":"2024-05-08T18:30:04.123447+0000","last_undegraded":"2024-05-08T18:30:04.123447+0000","last_fullsized":"2024-05-08T18:30:04.123447+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:27:41.414153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.798084+0000","last_change":"2024-05-08T18:29:42.575892+0000","last_active":"2024-05-08T18:30:05.798084+0000","last_peered":"2024-05-08T18:30:05.798084+0000","last_clean":"2024-05-08T18:30:05.798084+0000","last_became_active":"2024-05-08T18:29:42.573384+0000","last_became_peered":"2024-05-08T18:29:42.573384+0000","last_unstale":"2024-05-08T18:30:05.798084+0000","last_undegraded":"2024-05-08T18:30:05.798084+0000","last_fullsized":"2024-05-08T18:30:05.798084+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:55.055481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.740795+0000","last_change":"2024-05-08T18:29:40.565068+0000","last_active":"2024-05-08T18:30:05.740795+0000","last_peered":"2024-05-08T18:30:05.740795+0000","last_clean":"2024-05-08T18:30:05.740795+0000","last_became_active":"2024-05-08T18:29:40.563231+0000","last_became_peered":"2024-05-08T18:29:40.563231+0000","last_unstale":"2024-05-08T18:30:05.740795+0000","last_undegraded":"2024-05-08T18:30:05.740795+0000","last_fullsized":"2024-05-08T18:30:05.740795+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:17:47.828990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.122650+0000","last_change":"2024-05-08T18:29:42.564338+0000","last_active":"2024-05-08T18:30:04.122650+0000","last_peered":"2024-05-08T18:30:04.122650+0000","last_clean":"2024-05-08T18:30:04.122650+0000","last_became_active":"2024-05-08T18:29:42.563822+0000","last_became_peered":"2024-05-08T18:29:42.563822+0000","last_unstale":"2024-05-08T18:30:04.122650+0000","last_undegraded":"2024-05-08T18:30:04.122650+0000","last_fullsized":"2024-05-08T18:30:04.122650+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:23.397435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.800954+0000","last_change":"2024-05-08T18:29:40.573333+0000","last_active":"2024-05-08T18:30:05.800954+0000","last_peered":"2024-05-08T18:30:05.800954+0000","last_clean":"2024-05-08T18:30:05.800954+0000","last_became_active":"2024-05-08T18:29:40.571195+0000","last_became_peered":"2024-05-08T18:29:40.571195+0000","last_unstale":"2024-05-08T18:30:05.800954+0000","last_undegraded":"2024-05-08T18:30:05.800954+0000","last_fullsized":"2024-05-08T18:30:05.800954+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:33.017750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.731757+0000","last_change":"2024-05-08T18:29:42.563085+0000","last_active":"2024-05-08T18:30:04.731757+0000","last_peered":"2024-05-08T18:30:04.731757+0000","last_clean":"2024-05-08T18:30:04.731757+0000","last_became_active":"2024-05-08T18:29:42.560419+0000","last_became_peered":"2024-05-08T18:29:42.560419+0000","last_unstale":"2024-05-08T18:30:04.731757+0000","last_undegraded":"2024-05-08T18:30:04.731757+0000","last_fullsized":"2024-05-08T18:30:04.731757+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:20.397730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.734227+0000","last_change":"2024-05-08T18:29:40.568890+0000","last_active":"2024-05-08T18:30:04.734227+0000","last_peered":"2024-05-08T18:30:04.734227+0000","last_clean":"2024-05-08T18:30:04.734227+0000","last_became_active":"2024-05-08T18:29:40.568584+0000","last_became_peered":"2024-05-08T18:29:40.568584+0000","last_unstale":"2024-05-08T18:30:04.734227+0000","last_undegraded":"2024-05-08T18:30:04.734227+0000","last_fullsized":"2024-05-08T18:30:04.734227+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:25:01.595224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.794760+0000","last_change":"2024-05-08T18:29:42.574277+0000","last_active":"2024-05-08T18:30:05.794760+0000","last_peered":"2024-05-08T18:30:05.794760+0000","last_clean":"2024-05-08T18:30:05.794760+0000","last_became_active":"2024-05-08T18:29:42.573563+0000","last_became_peered":"2024-05-08T18:29:42.573563+0000","last_unstale":"2024-05-08T18:30:05.794760+0000","last_undegraded":"2024-05-08T18:30:05.794760+0000","last_fullsized":"2024-05-08T18:30:05.794760+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:57.706167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.801084+0000","last_change":"2024-05-08T18:29:40.562058+0000","last_active":"2024-05-08T18:30:05.801084+0000","last_peered":"2024-05-08T18:30:05.801084+0000","last_clean":"2024-05-08T18:30:05.801084+0000","last_became_active":"2024-05-08T18:29:40.561360+0000","last_became_peered":"2024-05-08T18:29:40.561360+0000","last_unstale":"2024-05-08T18:30:05.801084+0000","last_undegraded":"2024-05-08T18:30:05.801084+0000","last_fullsized":"2024-05-08T18:30:05.801084+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:05.929806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.793480+0000","last_change":"2024-05-08T18:29:40.538728+0000","last_active":"2024-05-08T18:30:05.793480+0000","last_peered":"2024-05-08T18:30:05.793480+0000","last_clean":"2024-05-08T18:30:05.793480+0000","last_became_active":"2024-05-08T18:29:40.537925+0000","last_became_peered":"2024-05-08T18:29:40.537925+0000","last_unstale":"2024-05-08T18:30:05.793480+0000","last_undegraded":"2024-05-08T18:30:05.793480+0000","last_fullsized":"2024-05-08T18:30:05.793480+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:28.426657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-08T18:30:04.124189+0000","last_change":"2024-05-08T18:29:42.574941+0000","last_active":"2024-05-08T18:30:04.124189+0000","last_peered":"2024-05-08T18:30:04.124189+0000","last_clean":"2024-05-08T18:30:04.124189+0000","last_became_active":"2024-05-08T18:29:42.574351+0000","last_became_peered":"2024-05-08T18:29:42.574351+0000","last_unstale":"2024-05-08T18:30:04.124189+0000","last_undegraded":"2024-05-08T18:30:04.124189+0000","last_fullsized":"2024-05-08T18:30:04.124189+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:21.935293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.243697+0000","last_change":"2024-05-08T18:29:40.543714+0000","last_active":"2024-05-08T18:30:05.243697+0000","last_peered":"2024-05-08T18:30:05.243697+0000","last_clean":"2024-05-08T18:30:05.243697+0000","last_became_active":"2024-05-08T18:29:40.542965+0000","last_became_peered":"2024-05-08T18:29:40.542965+0000","last_unstale":"2024-05-08T18:30:05.243697+0000","last_undegraded":"2024-05-08T18:30:05.243697+0000","last_fullsized":"2024-05-08T18:30:05.243697+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:12:59.146887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-08T18:30:05.798897+0000","last_change":"2024-05-08T18:29:42.560007+0000","last_active":"2024-05-08T18:30:05.798897+0000","last_peered":"2024-05-08T18:30:05.798897+0000","last_clean":"2024-05-08T18:30:05.798897+0000","last_became_active":"2024-05-08T18:29:42.559028+0000","last_became_peered":"2024-05-08T18:29:42.559028+0000","last_unstale":"2024-05-08T18:30:05.798897+0000","last_undegraded":"2024-05-08T18:30:05.798897+0000","last_fullsized":"2024-05-08T18:30:05.798897+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:36:03.084561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":178,"num_object_clones":0,"num_object_copies":356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":178,"num_whiteouts":0,"num_read":688,"num_read_kb":447,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":387,"ondisk_log_size":387,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509453,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32240,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339600,"statfs":{"total":96636764160,"available":96603750400,"internally_reserved":0,"allocated":1077248,"data_stored":797049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509453,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":458752,"data_stored":206021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509451,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31648,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340192,"statfs":{"total":96636764160,"available":96604356608,"internally_reserved":0,"allocated":479232,"data_stored":191565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509451,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":446464,"data_stored":205519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542156,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":462848,"data_stored":198775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542156,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":191728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542154,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":450560,"data_stored":190987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542156,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28044,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343796,"statfs":{"total":96636764160,"available":96608047104,"internally_reserved":0,"allocated":1040384,"data_stored":782600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T18:30:08.615 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-05-08T18:30:08.615 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-05-08T18:30:08.615 INFO:tasks.thrashosds.thrasher:reset_purged_snaps_last 2024-05-08T18:30:08.616 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 reset_purged_snaps_last 2024-05-08T18:30:08.617 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-08T18:30:08.678 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:30:08.676+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:30:08.776 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:30:08.776 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:30:08.776 INFO:teuthology.orchestra.run.smithi097.stdout: "complaint_time": 30, 2024-05-08T18:30:08.776 INFO:teuthology.orchestra.run.smithi097.stdout: "num_blocked_ops": 0 2024-05-08T18:30:08.776 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:30:08.779 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:30:08.778+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:30:08.788 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-08T18:30:08.791 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-08T18:30:08.816 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 reset_purged_snaps_last 2024-05-08T18:30:08.879 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:30:08.880+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:30:08.981 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:30:08.980+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:30:08.981 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:30:08.981 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2024-05-08T18:30:08.981 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2024-05-08T18:30:08.981 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-05-08T18:30:08.981 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:08.982 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4206.0:24 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'14, mlcod=16'9)", 2024-05-08T18:30:08.982 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:27.162224+0000", 2024-05-08T18:30:08.982 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 41.821521631000003, 2024-05-08T18:30:08.982 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032712890000000001, 2024-05-08T18:30:08.982 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:08.982 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:08.982 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:08.982 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:08.982 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:08.982 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:08.982 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162224+0000", 2024-05-08T18:30:08.982 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:08.983 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:08.983 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:08.983 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:08.983 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162224+0000", 2024-05-08T18:30:08.983 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:08.983 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:08.983 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:08.983 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:08.983 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162225+0000", 2024-05-08T18:30:08.983 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4899999999999999e-06 2024-05-08T18:30:08.983 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:08.984 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:08.984 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:08.984 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162306+0000", 2024-05-08T18:30:08.984 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.0589999999999999e-05 2024-05-08T18:30:08.984 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:08.984 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:08.984 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:08.984 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162332+0000", 2024-05-08T18:30:08.984 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5658999999999999e-05 2024-05-08T18:30:08.984 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:08.984 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:08.984 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:08.984 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162345+0000", 2024-05-08T18:30:08.985 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3512999999999999e-05 2024-05-08T18:30:08.985 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:08.985 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:08.985 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:08.985 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162465+0000", 2024-05-08T18:30:08.985 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000119577 2024-05-08T18:30:08.985 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:08.985 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:08.985 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:08.985 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162513+0000", 2024-05-08T18:30:08.985 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8773999999999998e-05 2024-05-08T18:30:08.985 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:08.985 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:08.985 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:08.986 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.165405+0000", 2024-05-08T18:30:08.986 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028919200000000001 2024-05-08T18:30:08.986 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:08.986 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:08.986 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:08.986 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.165495+0000", 2024-05-08T18:30:08.986 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9765999999999994e-05 2024-05-08T18:30:08.986 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:08.986 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:08.986 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:08.986 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:08.986 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:08.986 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4206.0:25 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'15, mlcod=16'10)", 2024-05-08T18:30:08.987 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:27.164793+0000", 2024-05-08T18:30:08.987 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 41.818952502999998, 2024-05-08T18:30:08.987 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032285249999999999, 2024-05-08T18:30:08.987 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:08.987 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:08.987 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:08.987 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:08.987 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:08.987 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:08.987 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164793+0000", 2024-05-08T18:30:08.987 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:08.987 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:08.987 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:08.988 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:08.988 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164793+0000", 2024-05-08T18:30:08.988 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:08.988 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:08.988 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:08.988 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:08.988 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164795+0000", 2024-05-08T18:30:08.988 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0999999999999998e-06 2024-05-08T18:30:08.988 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:08.988 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:08.988 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:08.988 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164811+0000", 2024-05-08T18:30:08.988 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5722999999999998e-05 2024-05-08T18:30:08.988 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:08.989 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:08.989 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:08.989 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164841+0000", 2024-05-08T18:30:08.989 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0355999999999999e-05 2024-05-08T18:30:08.989 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:08.989 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:08.989 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:08.989 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164861+0000", 2024-05-08T18:30:08.989 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9533000000000001e-05 2024-05-08T18:30:08.989 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:08.989 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:08.989 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:08.989 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164984+0000", 2024-05-08T18:30:08.989 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000123146 2024-05-08T18:30:08.989 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:08.990 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:08.990 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:08.990 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.165024+0000", 2024-05-08T18:30:08.990 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9690000000000001e-05 2024-05-08T18:30:08.990 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:08.990 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:08.990 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:08.990 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.167935+0000", 2024-05-08T18:30:08.990 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0029113300000000002 2024-05-08T18:30:08.990 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:08.990 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:08.990 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:08.990 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.168021+0000", 2024-05-08T18:30:08.991 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6646999999999999e-05 2024-05-08T18:30:08.991 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:08.991 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:08.991 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:08.991 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:08.991 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:08.991 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:30:08.991 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:48.674737+0000", 2024-05-08T18:30:08.991 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 20.309008585000001, 2024-05-08T18:30:08.991 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0035019780000000002, 2024-05-08T18:30:08.991 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:08.991 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:08.991 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:08.992 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:08.992 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:08.992 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:08.992 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 60 2024-05-08T18:30:08.992 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:08.992 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:08.992 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:08.992 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:08.992 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674737+0000", 2024-05-08T18:30:08.992 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:08.992 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:08.992 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:08.992 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:08.992 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674737+0000", 2024-05-08T18:30:08.993 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:08.993 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:08.993 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:08.993 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:08.993 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674740+0000", 2024-05-08T18:30:08.993 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.36e-06 2024-05-08T18:30:08.993 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:08.993 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:08.993 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:08.993 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674753+0000", 2024-05-08T18:30:08.993 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3151e-05 2024-05-08T18:30:08.993 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:08.993 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:08.993 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:08.994 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674789+0000", 2024-05-08T18:30:08.994 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5929000000000001e-05 2024-05-08T18:30:08.994 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:08.994 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:08.994 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:08.994 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674813+0000", 2024-05-08T18:30:08.994 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3325000000000001e-05 2024-05-08T18:30:08.994 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:08.994 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:08.994 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:08.994 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674981+0000", 2024-05-08T18:30:08.994 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016879899999999999 2024-05-08T18:30:08.994 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:08.994 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:08.995 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:08.995 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.675304+0000", 2024-05-08T18:30:08.995 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00032214400000000001 2024-05-08T18:30:08.995 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:08.995 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:08.995 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:08.995 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.675639+0000", 2024-05-08T18:30:08.995 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00033494699999999999 2024-05-08T18:30:08.995 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:08.995 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:08.995 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:08.995 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.676901+0000", 2024-05-08T18:30:08.995 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001262167 2024-05-08T18:30:08.995 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:08.996 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:08.996 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:08.996 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678078+0000", 2024-05-08T18:30:08.996 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001177588 2024-05-08T18:30:08.996 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:08.996 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:08.996 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:08.996 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678171+0000", 2024-05-08T18:30:08.996 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.2331999999999996e-05 2024-05-08T18:30:08.996 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:08.996 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:08.996 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:08.996 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678239+0000", 2024-05-08T18:30:08.997 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8236000000000002e-05 2024-05-08T18:30:08.997 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:08.997 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:08.997 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:08.997 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:08.997 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:08.997 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:61 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94069412632064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:30:08.997 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:48.678410+0000", 2024-05-08T18:30:08.997 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 20.305335193000001, 2024-05-08T18:30:08.997 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0026001800000000001, 2024-05-08T18:30:08.997 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:08.997 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:08.997 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:08.998 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:08.998 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:08.998 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:08.998 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 61 2024-05-08T18:30:08.998 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:08.998 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:08.998 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:08.998 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:08.998 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678410+0000", 2024-05-08T18:30:08.998 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:08.998 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:08.998 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:08.998 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:08.999 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678410+0000", 2024-05-08T18:30:08.999 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:08.999 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:08.999 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:08.999 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:08.999 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678413+0000", 2024-05-08T18:30:08.999 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.34e-06 2024-05-08T18:30:08.999 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:08.999 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:08.999 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:08.999 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678421+0000", 2024-05-08T18:30:08.999 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6910000000000003e-06 2024-05-08T18:30:08.999 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:08.999 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.000 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:09.000 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678447+0000", 2024-05-08T18:30:09.000 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6010999999999999e-05 2024-05-08T18:30:09.000 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.000 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.000 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:09.000 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678461+0000", 2024-05-08T18:30:09.000 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3900000000000001e-05 2024-05-08T18:30:09.000 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.000 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.000 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:09.000 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678560+0000", 2024-05-08T18:30:09.000 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.8834999999999998e-05 2024-05-08T18:30:09.001 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.001 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.001 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:09.001 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678704+0000", 2024-05-08T18:30:09.001 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000143769 2024-05-08T18:30:09.001 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.001 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.001 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:09.001 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678942+0000", 2024-05-08T18:30:09.001 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023861800000000001 2024-05-08T18:30:09.001 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.001 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.001 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:09.002 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.680269+0000", 2024-05-08T18:30:09.002 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001326484 2024-05-08T18:30:09.002 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.002 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.002 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:09.002 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.680823+0000", 2024-05-08T18:30:09.002 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00055455900000000004 2024-05-08T18:30:09.002 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.002 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.002 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:09.002 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.680908+0000", 2024-05-08T18:30:09.002 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.4073999999999995e-05 2024-05-08T18:30:09.002 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.002 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.003 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:09.003 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.681010+0000", 2024-05-08T18:30:09.003 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010289900000000001 2024-05-08T18:30:09.003 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:09.003 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:09.003 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:09.003 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.003 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.003 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:30:09.003 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.671896+0000", 2024-05-08T18:30:09.003 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 17.311849307999999, 2024-05-08T18:30:09.003 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032352349999999999, 2024-05-08T18:30:09.003 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:09.004 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:09.004 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:09.004 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:09.004 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:09.004 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:09.004 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 206 2024-05-08T18:30:09.004 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.004 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:09.004 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.004 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:09.004 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671896+0000", 2024-05-08T18:30:09.004 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:09.004 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.005 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.005 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:09.005 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671896+0000", 2024-05-08T18:30:09.005 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:09.005 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.005 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.005 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:09.005 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671901+0000", 2024-05-08T18:30:09.005 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.763e-06 2024-05-08T18:30:09.005 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.005 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.005 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:09.005 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671920+0000", 2024-05-08T18:30:09.006 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9403e-05 2024-05-08T18:30:09.006 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.006 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.006 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:09.006 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671969+0000", 2024-05-08T18:30:09.006 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8343000000000001e-05 2024-05-08T18:30:09.006 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.006 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.006 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:09.006 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671996+0000", 2024-05-08T18:30:09.006 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7307000000000001e-05 2024-05-08T18:30:09.006 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.006 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.007 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:09.007 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.672149+0000", 2024-05-08T18:30:09.007 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015336500000000001 2024-05-08T18:30:09.007 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.007 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.007 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:09.007 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.672393+0000", 2024-05-08T18:30:09.007 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024380800000000001 2024-05-08T18:30:09.007 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.007 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.007 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:09.007 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.672838+0000", 2024-05-08T18:30:09.007 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00044472700000000001 2024-05-08T18:30:09.007 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.008 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.008 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:09.008 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.674218+0000", 2024-05-08T18:30:09.008 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001380243 2024-05-08T18:30:09.008 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.008 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.008 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:09.008 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.674963+0000", 2024-05-08T18:30:09.008 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00074534999999999998 2024-05-08T18:30:09.008 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.008 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.008 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:09.009 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675057+0000", 2024-05-08T18:30:09.009 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.3633000000000003e-05 2024-05-08T18:30:09.009 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.009 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.009 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:09.009 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675131+0000", 2024-05-08T18:30:09.009 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.4293000000000002e-05 2024-05-08T18:30:09.009 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:09.009 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:09.009 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:09.009 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.009 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.009 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:09.010 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.694194+0000", 2024-05-08T18:30:09.010 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 17.28955191, 2024-05-08T18:30:09.010 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0087385129999999998, 2024-05-08T18:30:09.010 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:09.010 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:09.010 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:09.010 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:09.010 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:09.010 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:09.010 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 210 2024-05-08T18:30:09.010 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.010 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:09.010 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.011 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:09.011 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694194+0000", 2024-05-08T18:30:09.011 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:09.011 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.011 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.011 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:09.011 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694194+0000", 2024-05-08T18:30:09.011 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:09.011 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.011 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.011 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:09.011 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694196+0000", 2024-05-08T18:30:09.012 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6299999999999998e-06 2024-05-08T18:30:09.012 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.012 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.012 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:09.012 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694208+0000", 2024-05-08T18:30:09.012 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.187e-05 2024-05-08T18:30:09.012 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.012 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.012 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:09.012 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694240+0000", 2024-05-08T18:30:09.012 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1673e-05 2024-05-08T18:30:09.012 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.012 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.012 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:09.013 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694255+0000", 2024-05-08T18:30:09.013 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5573000000000002e-05 2024-05-08T18:30:09.013 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.013 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.013 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:09.013 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694394+0000", 2024-05-08T18:30:09.013 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000138536 2024-05-08T18:30:09.013 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.013 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.013 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-05-08T18:30:09.013 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694405+0000", 2024-05-08T18:30:09.013 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0883000000000001e-05 2024-05-08T18:30:09.013 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.014 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.014 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:09.014 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.699491+0000", 2024-05-08T18:30:09.014 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0050861939999999996 2024-05-08T18:30:09.014 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.014 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.014 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:09.014 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.699829+0000", 2024-05-08T18:30:09.014 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000338191 2024-05-08T18:30:09.014 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.014 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.014 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:30:09.014 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.700504+0000", 2024-05-08T18:30:09.015 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000674481 2024-05-08T18:30:09.015 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.015 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.015 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:09.015 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.702152+0000", 2024-05-08T18:30:09.015 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0016487450000000001 2024-05-08T18:30:09.015 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.015 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.015 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:09.015 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.702792+0000", 2024-05-08T18:30:09.015 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00063962800000000005 2024-05-08T18:30:09.015 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.015 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.016 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:09.016 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.702874+0000", 2024-05-08T18:30:09.016 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.2091999999999999e-05 2024-05-08T18:30:09.016 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.016 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.016 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:09.016 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.702932+0000", 2024-05-08T18:30:09.016 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8016999999999997e-05 2024-05-08T18:30:09.016 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:09.016 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:09.016 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:09.016 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.016 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.017 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:09.017 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.728239+0000", 2024-05-08T18:30:09.017 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 17.255506049000001, 2024-05-08T18:30:09.017 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0035376119999999999, 2024-05-08T18:30:09.017 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:09.017 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:09.017 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:09.017 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:09.017 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:09.017 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:09.017 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 218 2024-05-08T18:30:09.017 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.017 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:09.018 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.018 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:09.018 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728239+0000", 2024-05-08T18:30:09.018 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:09.018 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.018 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.018 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:09.018 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728239+0000", 2024-05-08T18:30:09.018 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:09.018 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.018 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.018 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:09.018 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728242+0000", 2024-05-08T18:30:09.018 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0130000000000002e-06 2024-05-08T18:30:09.019 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.019 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.019 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:09.019 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728254+0000", 2024-05-08T18:30:09.019 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.172e-05 2024-05-08T18:30:09.019 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.019 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.019 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:09.019 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728285+0000", 2024-05-08T18:30:09.019 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0703000000000001e-05 2024-05-08T18:30:09.019 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.020 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.020 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:09.020 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728301+0000", 2024-05-08T18:30:09.020 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5656999999999999e-05 2024-05-08T18:30:09.020 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.020 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.020 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:09.020 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728460+0000", 2024-05-08T18:30:09.020 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015934200000000001 2024-05-08T18:30:09.020 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.020 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.020 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:09.020 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728803+0000", 2024-05-08T18:30:09.020 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00034267400000000001 2024-05-08T18:30:09.021 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.021 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.021 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:09.021 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.729485+0000", 2024-05-08T18:30:09.021 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00068206799999999998 2024-05-08T18:30:09.021 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.021 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.021 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:09.021 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731218+0000", 2024-05-08T18:30:09.021 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0017332630000000001 2024-05-08T18:30:09.021 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.021 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.021 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:09.021 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731615+0000", 2024-05-08T18:30:09.022 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00039671699999999999 2024-05-08T18:30:09.022 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.022 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.022 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:09.022 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731709+0000", 2024-05-08T18:30:09.022 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.4740000000000004e-05 2024-05-08T18:30:09.022 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.022 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.022 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:09.022 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731777+0000", 2024-05-08T18:30:09.022 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7714999999999998e-05 2024-05-08T18:30:09.022 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:09.023 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:09.023 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:09.023 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.023 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.023 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:09.023 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.743331+0000", 2024-05-08T18:30:09.023 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 17.240414066, 2024-05-08T18:30:09.023 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031193229999999998, 2024-05-08T18:30:09.023 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:09.023 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:09.023 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:09.023 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:09.023 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:09.023 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:09.024 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 222 2024-05-08T18:30:09.024 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.024 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:09.024 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.024 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:09.024 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743331+0000", 2024-05-08T18:30:09.024 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:09.024 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.024 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.024 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:09.024 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743331+0000", 2024-05-08T18:30:09.024 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:09.024 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.025 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.025 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:09.025 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743334+0000", 2024-05-08T18:30:09.025 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2900000000000001e-06 2024-05-08T18:30:09.025 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.025 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.025 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:09.025 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743345+0000", 2024-05-08T18:30:09.025 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0947e-05 2024-05-08T18:30:09.025 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.025 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.025 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:09.025 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743375+0000", 2024-05-08T18:30:09.025 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0298999999999999e-05 2024-05-08T18:30:09.026 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.026 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.026 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:09.026 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743390+0000", 2024-05-08T18:30:09.026 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4606999999999999e-05 2024-05-08T18:30:09.026 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.026 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.026 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:09.026 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743524+0000", 2024-05-08T18:30:09.026 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000134105 2024-05-08T18:30:09.026 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.026 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.027 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:09.027 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743738+0000", 2024-05-08T18:30:09.027 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000214222 2024-05-08T18:30:09.027 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.027 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.027 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:30:09.027 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.744159+0000", 2024-05-08T18:30:09.027 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00042102300000000002 2024-05-08T18:30:09.027 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.027 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.027 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:09.027 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.745399+0000", 2024-05-08T18:30:09.027 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012400309999999999 2024-05-08T18:30:09.027 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.028 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.028 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:09.028 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.746296+0000", 2024-05-08T18:30:09.028 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00089682 2024-05-08T18:30:09.028 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.028 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.028 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:09.028 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.746385+0000", 2024-05-08T18:30:09.028 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9289000000000005e-05 2024-05-08T18:30:09.028 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.028 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.028 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:09.028 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.746451+0000", 2024-05-08T18:30:09.028 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5690000000000003e-05 2024-05-08T18:30:09.029 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:09.029 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:09.029 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:09.029 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.029 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.029 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:09.029 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.772338+0000", 2024-05-08T18:30:09.029 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 17.211407865999998, 2024-05-08T18:30:09.029 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0035084059999999999, 2024-05-08T18:30:09.029 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:09.029 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:09.029 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:09.029 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:09.030 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:09.030 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:09.030 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 230 2024-05-08T18:30:09.030 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.030 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:09.030 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.030 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:09.030 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772338+0000", 2024-05-08T18:30:09.030 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:09.030 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.030 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.030 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:09.030 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772338+0000", 2024-05-08T18:30:09.030 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:09.031 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.031 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.031 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:09.031 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772340+0000", 2024-05-08T18:30:09.031 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3460000000000001e-06 2024-05-08T18:30:09.031 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.031 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.031 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:09.031 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772352+0000", 2024-05-08T18:30:09.031 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2284e-05 2024-05-08T18:30:09.031 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.031 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.031 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:09.031 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772382+0000", 2024-05-08T18:30:09.032 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0083e-05 2024-05-08T18:30:09.032 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.032 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.032 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:09.032 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772397+0000", 2024-05-08T18:30:09.032 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4963000000000001e-05 2024-05-08T18:30:09.032 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.032 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.032 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:09.032 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772508+0000", 2024-05-08T18:30:09.032 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000110402 2024-05-08T18:30:09.032 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.032 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.032 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:09.033 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772742+0000", 2024-05-08T18:30:09.033 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023428899999999999 2024-05-08T18:30:09.033 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.033 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.033 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:30:09.033 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.773183+0000", 2024-05-08T18:30:09.033 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00044107899999999998 2024-05-08T18:30:09.033 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.033 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.033 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:09.033 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.774488+0000", 2024-05-08T18:30:09.033 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0013053940000000001 2024-05-08T18:30:09.033 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.033 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.034 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:09.034 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.775689+0000", 2024-05-08T18:30:09.034 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012004699999999999 2024-05-08T18:30:09.034 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.034 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.034 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:09.034 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.775777+0000", 2024-05-08T18:30:09.034 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8483e-05 2024-05-08T18:30:09.034 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.034 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.034 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:09.034 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.775846+0000", 2024-05-08T18:30:09.034 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8613000000000002e-05 2024-05-08T18:30:09.035 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:09.035 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:09.035 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:09.035 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.035 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.035 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:09.035 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.790921+0000", 2024-05-08T18:30:09.035 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 17.192824519999999, 2024-05-08T18:30:09.035 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003116869, 2024-05-08T18:30:09.035 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:09.035 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:09.035 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:09.035 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:09.035 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:09.036 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:09.036 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 235 2024-05-08T18:30:09.036 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.036 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:09.036 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.036 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:09.036 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790921+0000", 2024-05-08T18:30:09.036 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:09.036 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.036 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.036 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:09.036 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790921+0000", 2024-05-08T18:30:09.036 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:09.037 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.037 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.037 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:09.037 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790923+0000", 2024-05-08T18:30:09.037 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3199999999999998e-06 2024-05-08T18:30:09.037 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.037 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.037 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:09.037 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790934+0000", 2024-05-08T18:30:09.037 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.117e-05 2024-05-08T18:30:09.037 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.037 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.037 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:09.037 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790965+0000", 2024-05-08T18:30:09.037 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0392999999999999e-05 2024-05-08T18:30:09.038 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.038 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.038 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:09.038 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790981+0000", 2024-05-08T18:30:09.038 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5699999999999999e-05 2024-05-08T18:30:09.038 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.038 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.038 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:09.038 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.791093+0000", 2024-05-08T18:30:09.038 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000112062 2024-05-08T18:30:09.038 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.038 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.038 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:09.039 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.791324+0000", 2024-05-08T18:30:09.039 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023142200000000001 2024-05-08T18:30:09.039 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.039 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.039 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:09.039 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.791761+0000", 2024-05-08T18:30:09.039 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00043669999999999999 2024-05-08T18:30:09.039 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.039 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.039 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:09.039 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.792996+0000", 2024-05-08T18:30:09.039 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001235713 2024-05-08T18:30:09.039 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.039 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.040 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:09.040 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.793850+0000", 2024-05-08T18:30:09.040 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00085392400000000005 2024-05-08T18:30:09.040 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.040 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.040 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:09.040 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.793971+0000", 2024-05-08T18:30:09.040 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000120516 2024-05-08T18:30:09.040 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.040 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.040 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:09.040 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794038+0000", 2024-05-08T18:30:09.040 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6948999999999999e-05 2024-05-08T18:30:09.040 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:09.041 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:09.041 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:09.041 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.041 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.041 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:349 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:09.041 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.817315+0000", 2024-05-08T18:30:09.041 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 17.166430648999999, 2024-05-08T18:30:09.041 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0036888580000000002, 2024-05-08T18:30:09.041 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:09.041 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:09.041 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:09.041 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:09.041 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:09.041 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:09.042 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 349 2024-05-08T18:30:09.042 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.042 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:09.042 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.042 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:09.042 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817315+0000", 2024-05-08T18:30:09.042 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:09.042 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.042 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.042 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:09.042 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817315+0000", 2024-05-08T18:30:09.042 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:09.042 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.042 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.043 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:09.043 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817316+0000", 2024-05-08T18:30:09.043 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3370000000000001e-06 2024-05-08T18:30:09.043 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.043 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.043 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:09.043 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817323+0000", 2024-05-08T18:30:09.043 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.4300000000000003e-06 2024-05-08T18:30:09.043 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.043 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.043 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:09.043 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817337+0000", 2024-05-08T18:30:09.043 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4025999999999999e-05 2024-05-08T18:30:09.044 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.044 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.044 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:09.044 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817345+0000", 2024-05-08T18:30:09.044 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5669999999999995e-06 2024-05-08T18:30:09.044 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.044 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.044 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:09.044 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817407+0000", 2024-05-08T18:30:09.044 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1882000000000001e-05 2024-05-08T18:30:09.044 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.044 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.044 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:09.045 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817508+0000", 2024-05-08T18:30:09.045 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000100585 2024-05-08T18:30:09.045 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.045 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.045 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:09.045 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817673+0000", 2024-05-08T18:30:09.045 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000165802 2024-05-08T18:30:09.045 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.045 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.045 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:09.045 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.818715+0000", 2024-05-08T18:30:09.045 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0010417720000000001 2024-05-08T18:30:09.045 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.045 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.046 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:09.046 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.820892+0000", 2024-05-08T18:30:09.046 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0021771859999999998 2024-05-08T18:30:09.046 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.046 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.046 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:09.046 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.820950+0000", 2024-05-08T18:30:09.046 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7636000000000002e-05 2024-05-08T18:30:09.046 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.046 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.046 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:09.046 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.821004+0000", 2024-05-08T18:30:09.046 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3634999999999997e-05 2024-05-08T18:30:09.046 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:09.047 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:09.047 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:09.047 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.047 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.047 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:406 6.16 6:6dc3b799:reshard::reshard.0000000006:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:09.047 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.840465+0000", 2024-05-08T18:30:09.047 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 17.143280483000002, 2024-05-08T18:30:09.047 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003613032, 2024-05-08T18:30:09.047 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:09.047 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:09.047 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:09.047 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:09.047 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:09.047 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:09.048 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 406 2024-05-08T18:30:09.048 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.048 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:09.048 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.048 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:09.048 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840465+0000", 2024-05-08T18:30:09.048 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:09.048 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.048 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.048 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:09.048 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840465+0000", 2024-05-08T18:30:09.048 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:09.048 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.048 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.049 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:09.049 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840466+0000", 2024-05-08T18:30:09.049 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7499999999999999e-07 2024-05-08T18:30:09.049 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.049 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.049 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:09.049 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840471+0000", 2024-05-08T18:30:09.049 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9699999999999998e-06 2024-05-08T18:30:09.049 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.049 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.049 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:09.049 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840484+0000", 2024-05-08T18:30:09.049 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2717999999999999e-05 2024-05-08T18:30:09.050 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.050 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.050 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:09.050 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840490+0000", 2024-05-08T18:30:09.050 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.472e-06 2024-05-08T18:30:09.050 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.050 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.050 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:09.050 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840536+0000", 2024-05-08T18:30:09.050 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6409000000000002e-05 2024-05-08T18:30:09.050 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.050 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.050 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:09.051 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840591+0000", 2024-05-08T18:30:09.051 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4911000000000003e-05 2024-05-08T18:30:09.051 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.051 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.051 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:30:09.051 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840745+0000", 2024-05-08T18:30:09.051 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015394900000000001 2024-05-08T18:30:09.051 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.051 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.051 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:09.051 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.841269+0000", 2024-05-08T18:30:09.051 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00052347299999999999 2024-05-08T18:30:09.051 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.051 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.052 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:09.052 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.843997+0000", 2024-05-08T18:30:09.052 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0027285080000000001 2024-05-08T18:30:09.052 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.052 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.052 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:09.052 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844033+0000", 2024-05-08T18:30:09.052 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6038000000000003e-05 2024-05-08T18:30:09.052 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.052 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.052 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:09.052 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844078+0000", 2024-05-08T18:30:09.052 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4709000000000002e-05 2024-05-08T18:30:09.052 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:09.053 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:09.053 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:09.053 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.053 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.053 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:413 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:09.053 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.844187+0000", 2024-05-08T18:30:09.053 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 17.139558906000001, 2024-05-08T18:30:09.053 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0024835069999999998, 2024-05-08T18:30:09.053 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:09.053 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:09.053 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:09.053 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:09.054 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:09.054 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:09.054 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 413 2024-05-08T18:30:09.054 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.054 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:09.054 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.054 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:09.054 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844187+0000", 2024-05-08T18:30:09.054 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:09.054 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.054 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.054 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:09.054 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844187+0000", 2024-05-08T18:30:09.054 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:09.055 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.055 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.055 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:09.055 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844187+0000", 2024-05-08T18:30:09.055 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9999999999999996e-07 2024-05-08T18:30:09.055 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.055 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.055 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:09.055 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844192+0000", 2024-05-08T18:30:09.055 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7899999999999999e-06 2024-05-08T18:30:09.055 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.055 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.055 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:09.055 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844203+0000", 2024-05-08T18:30:09.056 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1002000000000001e-05 2024-05-08T18:30:09.056 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.056 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.056 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:09.056 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844209+0000", 2024-05-08T18:30:09.056 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6570000000000002e-06 2024-05-08T18:30:09.056 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.056 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.056 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:09.056 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844270+0000", 2024-05-08T18:30:09.056 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0810999999999998e-05 2024-05-08T18:30:09.056 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.056 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.057 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:09.057 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844419+0000", 2024-05-08T18:30:09.057 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000149097 2024-05-08T18:30:09.057 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.057 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.057 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:30:09.057 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844611+0000", 2024-05-08T18:30:09.057 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00019247900000000001 2024-05-08T18:30:09.057 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.057 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.057 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:09.057 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.845287+0000", 2024-05-08T18:30:09.057 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00067526000000000001 2024-05-08T18:30:09.057 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.058 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.058 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:09.058 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.846609+0000", 2024-05-08T18:30:09.058 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001322124 2024-05-08T18:30:09.058 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.058 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.058 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:09.058 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.846642+0000", 2024-05-08T18:30:09.058 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3654e-05 2024-05-08T18:30:09.058 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.058 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.058 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:09.058 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.846670+0000", 2024-05-08T18:30:09.059 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7733e-05 2024-05-08T18:30:09.059 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:09.059 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:09.059 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:09.059 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.059 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.059 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:420 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:09.059 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.847096+0000", 2024-05-08T18:30:09.059 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 17.136649611999999, 2024-05-08T18:30:09.059 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0026261589999999999, 2024-05-08T18:30:09.059 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:09.059 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:09.059 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:09.059 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:09.060 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:09.060 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:09.060 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 420 2024-05-08T18:30:09.060 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.060 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:09.060 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.060 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:09.060 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847096+0000", 2024-05-08T18:30:09.060 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:09.060 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.060 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.060 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:09.060 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847096+0000", 2024-05-08T18:30:09.061 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:09.061 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.061 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.061 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:09.061 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847097+0000", 2024-05-08T18:30:09.061 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.5499999999999996e-07 2024-05-08T18:30:09.061 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.061 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.061 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:09.061 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847103+0000", 2024-05-08T18:30:09.061 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8969999999999996e-06 2024-05-08T18:30:09.061 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.061 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.062 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:09.062 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847114+0000", 2024-05-08T18:30:09.062 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1549000000000001e-05 2024-05-08T18:30:09.062 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.062 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.062 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:09.062 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847120+0000", 2024-05-08T18:30:09.062 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5509999999999999e-06 2024-05-08T18:30:09.062 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.062 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.062 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:09.062 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847166+0000", 2024-05-08T18:30:09.062 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6683e-05 2024-05-08T18:30:09.063 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.063 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.063 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:09.063 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847213+0000", 2024-05-08T18:30:09.063 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6659000000000002e-05 2024-05-08T18:30:09.063 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.063 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.063 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:30:09.063 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847315+0000", 2024-05-08T18:30:09.063 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000102336 2024-05-08T18:30:09.063 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.063 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.063 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:09.063 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847840+0000", 2024-05-08T18:30:09.064 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00052475000000000004 2024-05-08T18:30:09.064 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.064 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.064 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:09.064 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.849660+0000", 2024-05-08T18:30:09.064 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001819563 2024-05-08T18:30:09.064 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.064 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.064 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:09.064 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.849695+0000", 2024-05-08T18:30:09.064 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4761000000000001e-05 2024-05-08T18:30:09.064 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.064 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.064 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:09.065 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.849722+0000", 2024-05-08T18:30:09.065 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7455000000000001e-05 2024-05-08T18:30:09.065 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:09.065 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:09.065 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:09.065 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.065 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.065 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:532 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:09.065 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.908603+0000", 2024-05-08T18:30:09.065 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 17.075142062000001, 2024-05-08T18:30:09.065 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0038838950000000001, 2024-05-08T18:30:09.065 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:09.065 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:09.065 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:09.066 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:09.066 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:09.066 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:09.066 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 532 2024-05-08T18:30:09.066 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.066 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:09.066 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.066 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:09.066 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908603+0000", 2024-05-08T18:30:09.066 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:09.066 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.066 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.066 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:09.067 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908603+0000", 2024-05-08T18:30:09.067 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:09.067 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.067 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.067 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:09.067 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908605+0000", 2024-05-08T18:30:09.067 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1179999999999999e-06 2024-05-08T18:30:09.067 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.067 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.067 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:09.067 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908608+0000", 2024-05-08T18:30:09.067 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7419999999999999e-06 2024-05-08T18:30:09.068 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.068 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.068 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:09.068 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908618+0000", 2024-05-08T18:30:09.068 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.6889999999999999e-06 2024-05-08T18:30:09.068 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.068 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.068 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:09.068 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908625+0000", 2024-05-08T18:30:09.068 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1300000000000003e-06 2024-05-08T18:30:09.068 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.068 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.068 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:09.068 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908669+0000", 2024-05-08T18:30:09.069 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3832000000000003e-05 2024-05-08T18:30:09.069 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.069 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.069 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:09.069 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908724+0000", 2024-05-08T18:30:09.069 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5222000000000001e-05 2024-05-08T18:30:09.069 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.069 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.069 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:30:09.069 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908854+0000", 2024-05-08T18:30:09.069 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012953500000000001 2024-05-08T18:30:09.069 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.069 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.069 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:09.070 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.909511+0000", 2024-05-08T18:30:09.070 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00065768399999999996 2024-05-08T18:30:09.070 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.070 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.070 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:09.070 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912426+0000", 2024-05-08T18:30:09.070 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0029146599999999999 2024-05-08T18:30:09.070 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.070 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.070 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:09.070 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912461+0000", 2024-05-08T18:30:09.070 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4934999999999997e-05 2024-05-08T18:30:09.070 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.071 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.071 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:09.071 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912487+0000", 2024-05-08T18:30:09.071 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6347999999999999e-05 2024-05-08T18:30:09.071 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:09.071 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:09.071 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:09.071 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.071 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.071 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:534 6.9 6:9268b73e:::obj_delete_at_hint.0000000019:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:09.071 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.910153+0000", 2024-05-08T18:30:09.071 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 17.073592605000002, 2024-05-08T18:30:09.071 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0051089680000000002, 2024-05-08T18:30:09.071 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:09.072 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:09.072 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:09.072 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:09.072 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:09.072 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:09.072 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 534 2024-05-08T18:30:09.072 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.072 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:09.072 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.072 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:09.072 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910153+0000", 2024-05-08T18:30:09.072 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:09.072 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.072 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.073 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:09.073 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910153+0000", 2024-05-08T18:30:09.073 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:09.073 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.073 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.073 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:09.073 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910154+0000", 2024-05-08T18:30:09.073 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1039999999999999e-06 2024-05-08T18:30:09.073 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.073 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.073 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:09.073 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910158+0000", 2024-05-08T18:30:09.073 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7400000000000002e-06 2024-05-08T18:30:09.073 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.074 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.074 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:09.074 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910167+0000", 2024-05-08T18:30:09.074 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8880000000000003e-06 2024-05-08T18:30:09.074 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.074 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.074 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:09.074 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910173+0000", 2024-05-08T18:30:09.074 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.844e-06 2024-05-08T18:30:09.074 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.074 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.074 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:09.074 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910220+0000", 2024-05-08T18:30:09.075 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6582000000000002e-05 2024-05-08T18:30:09.075 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.075 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.075 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:09.075 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910287+0000", 2024-05-08T18:30:09.075 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7271e-05 2024-05-08T18:30:09.075 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.075 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.075 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:30:09.075 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910402+0000", 2024-05-08T18:30:09.075 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115127 2024-05-08T18:30:09.075 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.075 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.075 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:09.076 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910881+0000", 2024-05-08T18:30:09.076 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000479025 2024-05-08T18:30:09.076 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.076 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.076 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:09.076 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.915206+0000", 2024-05-08T18:30:09.076 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.004324357 2024-05-08T18:30:09.076 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.076 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.076 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:09.076 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.915237+0000", 2024-05-08T18:30:09.076 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1590000000000001e-05 2024-05-08T18:30:09.076 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.076 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.077 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:09.077 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.915262+0000", 2024-05-08T18:30:09.077 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.444e-05 2024-05-08T18:30:09.077 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:09.077 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:09.077 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:09.077 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.077 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.077 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:583 6.0 6:03bbb29a:::obj_delete_at_hint.0000000026:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:09.077 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.947199+0000", 2024-05-08T18:30:09.077 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 17.036546408, 2024-05-08T18:30:09.077 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0025081510000000001, 2024-05-08T18:30:09.077 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:09.077 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:09.078 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:09.078 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:09.078 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:09.078 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:09.078 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 583 2024-05-08T18:30:09.078 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.078 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:09.078 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.078 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:09.078 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947199+0000", 2024-05-08T18:30:09.078 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:09.078 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.078 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.079 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:09.079 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947199+0000", 2024-05-08T18:30:09.079 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:09.079 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.079 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.079 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:09.079 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947200+0000", 2024-05-08T18:30:09.079 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3799999999999997e-07 2024-05-08T18:30:09.079 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.079 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.079 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:09.079 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947207+0000", 2024-05-08T18:30:09.079 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2030000000000003e-06 2024-05-08T18:30:09.079 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.080 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.080 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:09.080 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947217+0000", 2024-05-08T18:30:09.080 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0138e-05 2024-05-08T18:30:09.080 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.080 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.080 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:09.080 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947224+0000", 2024-05-08T18:30:09.080 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5289999999999997e-06 2024-05-08T18:30:09.080 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.080 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.080 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:09.080 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.948039+0000", 2024-05-08T18:30:09.080 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00081500599999999996 2024-05-08T18:30:09.081 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.081 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.081 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:09.081 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.948230+0000", 2024-05-08T18:30:09.081 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000191838 2024-05-08T18:30:09.081 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.081 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.081 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:09.081 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.948606+0000", 2024-05-08T18:30:09.081 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00037547900000000001 2024-05-08T18:30:09.081 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.081 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.081 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:09.081 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.949406+0000", 2024-05-08T18:30:09.082 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000799674 2024-05-08T18:30:09.082 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.082 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.082 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:09.082 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.949630+0000", 2024-05-08T18:30:09.082 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00022474699999999999 2024-05-08T18:30:09.082 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.082 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.082 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:09.082 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.949664+0000", 2024-05-08T18:30:09.082 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3535999999999999e-05 2024-05-08T18:30:09.082 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.082 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.082 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:09.083 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.949707+0000", 2024-05-08T18:30:09.083 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3362999999999998e-05 2024-05-08T18:30:09.083 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:09.083 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:09.083 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:09.083 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.083 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.083 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:686 6.10 6:0d0f4ce5:::obj_delete_at_hint.0000000040:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:09.083 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.012623+0000", 2024-05-08T18:30:09.083 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 16.971122219000002, 2024-05-08T18:30:09.083 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0024696330000000002, 2024-05-08T18:30:09.083 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:09.084 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:09.084 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:09.084 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:09.084 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:09.084 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:09.084 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 686 2024-05-08T18:30:09.084 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.084 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:09.084 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.084 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:09.084 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.012623+0000", 2024-05-08T18:30:09.084 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:09.084 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.084 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.085 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:09.085 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.012623+0000", 2024-05-08T18:30:09.085 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:09.085 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.085 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.085 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:09.085 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.012624+0000", 2024-05-08T18:30:09.085 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1480000000000001e-06 2024-05-08T18:30:09.085 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.085 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.085 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:09.085 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.012631+0000", 2024-05-08T18:30:09.085 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1700000000000002e-06 2024-05-08T18:30:09.085 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.085 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.086 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:09.086 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.012647+0000", 2024-05-08T18:30:09.086 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6133999999999998e-05 2024-05-08T18:30:09.086 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.086 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.086 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:09.086 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.012655+0000", 2024-05-08T18:30:09.086 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7199999999999995e-06 2024-05-08T18:30:09.086 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.086 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.086 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:09.086 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.012715+0000", 2024-05-08T18:30:09.086 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9475999999999998e-05 2024-05-08T18:30:09.087 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.087 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.087 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:09.087 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.012805+0000", 2024-05-08T18:30:09.087 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9840999999999996e-05 2024-05-08T18:30:09.087 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.087 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.087 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:09.087 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.012930+0000", 2024-05-08T18:30:09.087 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012537099999999999 2024-05-08T18:30:09.087 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.087 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.087 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:09.088 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.013584+0000", 2024-05-08T18:30:09.088 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00065356500000000005 2024-05-08T18:30:09.088 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.088 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.088 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:09.088 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.014956+0000", 2024-05-08T18:30:09.088 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001372535 2024-05-08T18:30:09.088 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.088 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.088 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:09.088 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.015017+0000", 2024-05-08T18:30:09.088 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0590000000000001e-05 2024-05-08T18:30:09.088 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.088 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.089 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:09.089 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.015093+0000", 2024-05-08T18:30:09.089 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6082999999999996e-05 2024-05-08T18:30:09.089 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:09.089 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:09.089 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:09.089 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.089 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.089 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:09.089 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.263796+0000", 2024-05-08T18:30:09.089 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 16.719949140000001, 2024-05-08T18:30:09.089 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0027788019999999999, 2024-05-08T18:30:09.089 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:09.090 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:09.090 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:09.090 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:09.090 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:09.090 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:09.090 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 811 2024-05-08T18:30:09.090 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.090 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:09.090 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.090 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:09.090 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263796+0000", 2024-05-08T18:30:09.090 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:09.090 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.091 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.091 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:09.091 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263796+0000", 2024-05-08T18:30:09.091 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:09.091 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.091 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.091 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:09.091 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263799+0000", 2024-05-08T18:30:09.091 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5569999999999998e-06 2024-05-08T18:30:09.091 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.091 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.091 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:09.091 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263812+0000", 2024-05-08T18:30:09.091 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3145999999999999e-05 2024-05-08T18:30:09.092 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.092 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.092 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:09.092 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263842+0000", 2024-05-08T18:30:09.092 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0193e-05 2024-05-08T18:30:09.092 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.092 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.092 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:09.092 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263860+0000", 2024-05-08T18:30:09.092 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7880000000000002e-05 2024-05-08T18:30:09.092 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.092 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.092 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:09.093 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263979+0000", 2024-05-08T18:30:09.093 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011919899999999999 2024-05-08T18:30:09.093 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.093 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.093 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:09.093 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.264222+0000", 2024-05-08T18:30:09.093 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024290800000000001 2024-05-08T18:30:09.093 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.093 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.093 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:09.093 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.264545+0000", 2024-05-08T18:30:09.093 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00032300200000000002 2024-05-08T18:30:09.093 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.093 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.094 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:09.094 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.265682+0000", 2024-05-08T18:30:09.094 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001136464 2024-05-08T18:30:09.094 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.094 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.094 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:09.094 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.266397+0000", 2024-05-08T18:30:09.094 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00071512799999999999 2024-05-08T18:30:09.094 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.094 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.094 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:09.094 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.266504+0000", 2024-05-08T18:30:09.094 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000107019 2024-05-08T18:30:09.095 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.095 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.095 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:09.095 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.266575+0000", 2024-05-08T18:30:09.095 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1305999999999998e-05 2024-05-08T18:30:09.095 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:09.095 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:09.095 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:09.095 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.095 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.095 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:09.095 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.445706+0000", 2024-05-08T18:30:09.095 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 16.538039424000001, 2024-05-08T18:30:09.096 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0026820630000000002, 2024-05-08T18:30:09.096 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:09.096 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:09.096 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:09.096 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:09.096 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:09.096 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:09.096 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 889 2024-05-08T18:30:09.096 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.096 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:09.096 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.096 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:09.096 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445706+0000", 2024-05-08T18:30:09.097 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:09.097 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.097 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.097 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:09.097 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445706+0000", 2024-05-08T18:30:09.097 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:09.097 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.097 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.097 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:09.097 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445709+0000", 2024-05-08T18:30:09.097 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0299999999999998e-06 2024-05-08T18:30:09.097 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.097 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.097 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:09.098 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445721+0000", 2024-05-08T18:30:09.098 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2366e-05 2024-05-08T18:30:09.098 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.098 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.098 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:09.098 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445752+0000", 2024-05-08T18:30:09.098 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0287e-05 2024-05-08T18:30:09.098 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.098 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.098 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:09.098 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445773+0000", 2024-05-08T18:30:09.098 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1367000000000001e-05 2024-05-08T18:30:09.098 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.098 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.099 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:09.099 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445892+0000", 2024-05-08T18:30:09.099 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000119311 2024-05-08T18:30:09.099 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.099 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.099 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:09.099 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.446158+0000", 2024-05-08T18:30:09.099 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000265441 2024-05-08T18:30:09.099 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.099 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.099 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:09.099 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.446465+0000", 2024-05-08T18:30:09.099 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00030754300000000002 2024-05-08T18:30:09.099 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.100 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.100 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:09.100 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.447511+0000", 2024-05-08T18:30:09.100 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001045975 2024-05-08T18:30:09.100 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.100 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.100 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:09.100 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.448171+0000", 2024-05-08T18:30:09.100 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00065971200000000002 2024-05-08T18:30:09.100 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.100 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.100 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:09.101 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.448273+0000", 2024-05-08T18:30:09.101 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000101592 2024-05-08T18:30:09.101 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:09.101 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:09.101 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:09.101 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.448388+0000", 2024-05-08T18:30:09.101 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115439 2024-05-08T18:30:09.101 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:09.101 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:09.101 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:09.101 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:09.101 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:09.101 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:30:09.102 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-08T18:30:09.103 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-08T18:30:09.105 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 reset_purged_snaps_last 2024-05-08T18:30:09.105 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:30:09.104+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:30:09.204 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:30:09.202+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:30:09.264 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:30:09.264 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:30:09.264 INFO:teuthology.orchestra.run.smithi097.stdout: "num_ops": 0 2024-05-08T18:30:09.264 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:30:09.279 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-08T18:30:09.293 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2024-05-08T18:30:09.294 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:30:09.323 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2024-05-08T18:30:09.324 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:30:09.324 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:30:09.322+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:30:09.325 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 reset_purged_snaps_last 2024-05-08T18:30:09.340 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2024-05-08T18:30:09.340 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:30:09.356 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2024-05-08T18:30:09.357 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:30:09.377 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2024-05-08T18:30:09.377 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:30:09.398 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2024-05-08T18:30:09.398 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:30:09.405 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:30:09.406+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:30:09.405 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:09.406 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:09.419 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-08T18:30:09.420 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2024-05-08T18:30:09.420 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:30:09.442 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2024-05-08T18:30:09.443 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:30:09.488 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 reset_purged_snaps_last 2024-05-08T18:30:09.529 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:30:09.530+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:30:09.551 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:09.551 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:09.564 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-08T18:30:09.613 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:30:09.614+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:30:09.675 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 reset_purged_snaps_last 2024-05-08T18:30:09.721 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:30:09.722+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:30:09.734 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:09.734 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:09.748 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-08T18:30:09.772 INFO:teuthology.orchestra.run.smithi097.stderr:nodeep-scrub is unset 2024-05-08T18:30:09.833 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:30:09.834+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:30:09.834 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 reset_purged_snaps_last 2024-05-08T18:30:09.881 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:09.881 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:09.895 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-08T18:30:09.910 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:30:09.908+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:30:10.010 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:30:10.010+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:30:10.026 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 reset_purged_snaps_last 2024-05-08T18:30:10.059 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:10.059 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:10.073 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-08T18:30:10.112 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:30:10.112+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:30:10.213 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:30:10.212+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:30:10.230 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:10.230 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:10.243 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-08T18:30:10.314 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:30:10.312+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:30:10.397 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:10.397 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:10.411 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-08T18:30:10.415 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:30:10.412+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:30:10.516 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:30:10.516+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:30:10.529 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:10.529 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:10.543 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-08T18:30:10.616 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:30:10.614+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:30:10.677 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:10.677 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:10.691 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-08T18:30:10.717 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:30:10.718+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:30:10.815 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:10.815 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:10.818 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:30:10.818+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:30:10.829 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-08T18:30:10.918 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:30:10.918+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:30:10.946 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:10.947 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:10.961 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-08T18:30:11.020 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:30:11.018+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:30:11.083 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:11.083 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:11.097 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-08T18:30:11.121 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:30:11.122+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:30:11.218 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:11.218 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:11.221 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:30:11.220+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:30:11.232 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-08T18:30:11.324 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:30:11.324+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:30:11.397 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:11.397 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:11.411 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-08T18:30:11.452 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:30:11.452+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:30:11.459 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-08T18:30:11.524 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:30:11.524+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:30:11.577 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:11.577 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:11.591 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-08T18:30:11.613 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2024-05-08T18:30:11.613 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:30:11.625 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:30:11.626+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:30:11.629 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2024-05-08T18:30:11.629 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:30:11.644 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2024-05-08T18:30:11.644 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:30:11.662 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2024-05-08T18:30:11.662 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:30:11.678 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2024-05-08T18:30:11.678 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:30:11.695 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2024-05-08T18:30:11.695 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:30:11.713 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2024-05-08T18:30:11.713 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:30:11.726 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:30:11.726+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:30:11.732 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2024-05-08T18:30:11.732 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:30:11.758 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:30:11.759 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:30:11.759 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2024-05-08T18:30:11.759 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2024-05-08T18:30:11.759 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:30:11.773 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-08T18:30:11.792 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-08T18:30:11.837 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:30:11.838+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:30:11.896 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:30:11.896 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2024-05-08T18:30:11.896 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2024-05-08T18:30:11.896 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-05-08T18:30:11.897 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.897 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:30:11.897 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:48.647802+0000", 2024-05-08T18:30:11.897 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 23.245742323000002, 2024-05-08T18:30:11.897 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0027254660000000002, 2024-05-08T18:30:11.897 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:11.897 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:11.897 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:11.897 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:11.897 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:11.897 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:11.897 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 46 2024-05-08T18:30:11.897 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.898 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:11.898 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.898 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:11.898 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.647802+0000", 2024-05-08T18:30:11.898 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:11.898 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.898 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.898 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:11.899 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.647802+0000", 2024-05-08T18:30:11.899 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:11.899 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.899 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.899 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:11.900 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.647805+0000", 2024-05-08T18:30:11.900 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8940000000000002e-06 2024-05-08T18:30:11.900 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.900 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.900 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:11.900 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.647816+0000", 2024-05-08T18:30:11.901 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0998999999999999e-05 2024-05-08T18:30:11.901 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.901 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.901 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:11.901 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.647846+0000", 2024-05-08T18:30:11.901 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.027e-05 2024-05-08T18:30:11.901 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.902 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.902 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:11.902 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.647865+0000", 2024-05-08T18:30:11.902 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.808e-05 2024-05-08T18:30:11.902 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.902 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.902 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:11.902 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.647994+0000", 2024-05-08T18:30:11.903 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012923899999999999 2024-05-08T18:30:11.903 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.903 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.903 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:11.903 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.648289+0000", 2024-05-08T18:30:11.904 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029495999999999998 2024-05-08T18:30:11.904 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.904 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.904 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:11.904 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.648576+0000", 2024-05-08T18:30:11.904 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00028707599999999999 2024-05-08T18:30:11.905 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.905 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.905 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:11.905 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.649703+0000", 2024-05-08T18:30:11.905 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001126658 2024-05-08T18:30:11.905 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.905 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.905 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:11.905 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.650337+0000", 2024-05-08T18:30:11.905 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00063405500000000001 2024-05-08T18:30:11.905 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.906 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.906 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:11.906 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.650451+0000", 2024-05-08T18:30:11.906 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011476600000000001 2024-05-08T18:30:11.906 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.906 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.906 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:11.906 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.650528+0000", 2024-05-08T18:30:11.907 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6469000000000003e-05 2024-05-08T18:30:11.907 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:11.907 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:11.907 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:11.907 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.907 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.908 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94069412627456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:30:11.908 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:48.650773+0000", 2024-05-08T18:30:11.908 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 23.242771784999999, 2024-05-08T18:30:11.908 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0024358209999999999, 2024-05-08T18:30:11.908 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:11.909 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:11.909 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:11.909 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:11.909 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:11.909 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:11.909 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 47 2024-05-08T18:30:11.909 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.909 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:11.909 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.909 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:11.909 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.650773+0000", 2024-05-08T18:30:11.909 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:11.910 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.910 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.910 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:11.910 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.650773+0000", 2024-05-08T18:30:11.910 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:11.910 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.910 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.911 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:11.911 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.650775+0000", 2024-05-08T18:30:11.911 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.4030000000000001e-06 2024-05-08T18:30:11.911 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.911 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.911 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:11.911 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.650785+0000", 2024-05-08T18:30:11.911 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0027000000000001e-05 2024-05-08T18:30:11.911 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.912 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.912 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:11.912 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.650814+0000", 2024-05-08T18:30:11.912 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8350000000000001e-05 2024-05-08T18:30:11.912 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.912 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.913 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:11.913 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.650848+0000", 2024-05-08T18:30:11.913 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4566000000000001e-05 2024-05-08T18:30:11.913 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.913 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.914 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:11.914 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.650963+0000", 2024-05-08T18:30:11.914 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011506300000000001 2024-05-08T18:30:11.914 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.914 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.914 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:11.914 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.651153+0000", 2024-05-08T18:30:11.914 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000189812 2024-05-08T18:30:11.914 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.914 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.915 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:11.915 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.651493+0000", 2024-05-08T18:30:11.915 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000339616 2024-05-08T18:30:11.915 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.915 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.915 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:11.915 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.652662+0000", 2024-05-08T18:30:11.916 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0011695410000000001 2024-05-08T18:30:11.916 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.916 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.916 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:11.916 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.652998+0000", 2024-05-08T18:30:11.916 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000335788 2024-05-08T18:30:11.916 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.916 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.916 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:11.917 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.653076+0000", 2024-05-08T18:30:11.917 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8120000000000004e-05 2024-05-08T18:30:11.917 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.917 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.917 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:11.918 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.653209+0000", 2024-05-08T18:30:11.918 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000132535 2024-05-08T18:30:11.918 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:11.918 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:11.918 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:11.918 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.919 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.919 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:30:11.919 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:48.659528+0000", 2024-05-08T18:30:11.919 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 23.234016570000001, 2024-05-08T18:30:11.919 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0025123260000000001, 2024-05-08T18:30:11.919 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:11.919 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:11.919 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:11.919 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:11.919 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:11.919 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:11.920 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 54 2024-05-08T18:30:11.920 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.920 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:11.920 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.920 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:11.920 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.659528+0000", 2024-05-08T18:30:11.920 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:11.920 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.920 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.920 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:11.921 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.659528+0000", 2024-05-08T18:30:11.921 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:11.921 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.921 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.921 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:11.922 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.659530+0000", 2024-05-08T18:30:11.922 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9429999999999999e-06 2024-05-08T18:30:11.922 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.922 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.922 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:11.922 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.659540+0000", 2024-05-08T18:30:11.923 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0147e-05 2024-05-08T18:30:11.923 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.923 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.923 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:11.923 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.659569+0000", 2024-05-08T18:30:11.923 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.923e-05 2024-05-08T18:30:11.923 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.923 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.924 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:11.924 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.659584+0000", 2024-05-08T18:30:11.924 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4996e-05 2024-05-08T18:30:11.924 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.924 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.924 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:11.924 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.659716+0000", 2024-05-08T18:30:11.924 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000131457 2024-05-08T18:30:11.924 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.924 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.925 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:11.925 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.659895+0000", 2024-05-08T18:30:11.925 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017940400000000001 2024-05-08T18:30:11.925 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.925 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.925 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:11.925 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.660092+0000", 2024-05-08T18:30:11.925 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000197002 2024-05-08T18:30:11.925 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.925 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.925 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:11.926 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.661227+0000", 2024-05-08T18:30:11.926 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0011346150000000001 2024-05-08T18:30:11.926 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.926 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.926 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:11.926 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.661907+0000", 2024-05-08T18:30:11.926 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00068008800000000002 2024-05-08T18:30:11.926 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.926 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.926 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:11.927 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.661978+0000", 2024-05-08T18:30:11.927 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1538999999999994e-05 2024-05-08T18:30:11.927 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.927 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.927 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:11.927 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.662040+0000", 2024-05-08T18:30:11.927 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1904999999999998e-05 2024-05-08T18:30:11.927 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:11.927 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:11.927 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:11.928 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.928 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.928 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94069412622848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:30:11.928 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:48.662241+0000", 2024-05-08T18:30:11.928 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 23.231303243999999, 2024-05-08T18:30:11.928 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029022259999999999, 2024-05-08T18:30:11.928 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:11.928 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:11.928 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:11.928 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:11.928 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:11.928 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:11.928 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 55 2024-05-08T18:30:11.929 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.929 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:11.929 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.929 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:11.929 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.662241+0000", 2024-05-08T18:30:11.929 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:11.929 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.929 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.929 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:11.929 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.662241+0000", 2024-05-08T18:30:11.929 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:11.929 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.929 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.930 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:11.930 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.662243+0000", 2024-05-08T18:30:11.930 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.716e-06 2024-05-08T18:30:11.930 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.930 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.930 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:11.930 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.662267+0000", 2024-05-08T18:30:11.930 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3949999999999999e-05 2024-05-08T18:30:11.930 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.930 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.930 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:11.930 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.662293+0000", 2024-05-08T18:30:11.931 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6376e-05 2024-05-08T18:30:11.931 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.931 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.931 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:11.931 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.662310+0000", 2024-05-08T18:30:11.931 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6520000000000001e-05 2024-05-08T18:30:11.931 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.931 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.931 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:11.931 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.662412+0000", 2024-05-08T18:30:11.931 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010228700000000001 2024-05-08T18:30:11.931 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.931 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.932 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:11.932 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.662514+0000", 2024-05-08T18:30:11.932 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0001019 2024-05-08T18:30:11.932 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.932 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.932 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:11.932 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.662714+0000", 2024-05-08T18:30:11.932 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020008100000000001 2024-05-08T18:30:11.932 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.932 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.932 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:11.932 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.663711+0000", 2024-05-08T18:30:11.932 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00099629899999999997 2024-05-08T18:30:11.932 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.933 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.933 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:11.933 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.664976+0000", 2024-05-08T18:30:11.933 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0012652679999999999 2024-05-08T18:30:11.933 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.933 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.933 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:11.933 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.665047+0000", 2024-05-08T18:30:11.933 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1277000000000002e-05 2024-05-08T18:30:11.933 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.933 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.933 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:11.933 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.665144+0000", 2024-05-08T18:30:11.933 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6552000000000007e-05 2024-05-08T18:30:11.933 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:11.934 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:11.934 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:11.934 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.934 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.934 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:209 6.3 e33/27 6:c60da066:gc::gc.4:head v 33'1, mlcod=0'0)", 2024-05-08T18:30:11.934 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.686317+0000", 2024-05-08T18:30:11.934 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 20.207227240000002, 2024-05-08T18:30:11.934 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032126889999999999, 2024-05-08T18:30:11.934 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:11.934 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:11.934 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:11.934 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:11.935 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.935 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:11.935 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.686317+0000", 2024-05-08T18:30:11.935 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:11.935 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.935 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.935 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:11.935 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.686317+0000", 2024-05-08T18:30:11.935 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:11.935 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.935 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.935 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:11.935 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.686318+0000", 2024-05-08T18:30:11.936 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5400000000000001e-07 2024-05-08T18:30:11.936 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.936 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.936 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:11.936 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.686326+0000", 2024-05-08T18:30:11.936 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3000000000000002e-06 2024-05-08T18:30:11.936 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.936 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.936 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:11.936 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.686358+0000", 2024-05-08T18:30:11.936 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1702999999999998e-05 2024-05-08T18:30:11.936 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.936 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.936 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:11.936 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.686374+0000", 2024-05-08T18:30:11.937 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6266e-05 2024-05-08T18:30:11.937 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.937 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.937 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:11.937 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.686530+0000", 2024-05-08T18:30:11.937 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015583599999999999 2024-05-08T18:30:11.937 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.937 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.937 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:11.937 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.686573+0000", 2024-05-08T18:30:11.937 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3248999999999999e-05 2024-05-08T18:30:11.937 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.937 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.938 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:11.938 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.689412+0000", 2024-05-08T18:30:11.938 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0028385720000000001 2024-05-08T18:30:11.938 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.938 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.938 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:11.938 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.689530+0000", 2024-05-08T18:30:11.939 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000118109 2024-05-08T18:30:11.939 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:11.939 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:11.939 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:11.939 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.939 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.939 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:217 6.15 e33/27 6:ab569f81:gc::gc.12:head v 33'1, mlcod=0'0)", 2024-05-08T18:30:11.939 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.722458+0000", 2024-05-08T18:30:11.940 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 20.171086699, 2024-05-08T18:30:11.940 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001760604, 2024-05-08T18:30:11.940 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:11.940 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:11.940 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:11.940 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:11.940 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.941 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:11.941 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.722458+0000", 2024-05-08T18:30:11.941 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:11.941 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.941 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.941 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:11.941 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.722458+0000", 2024-05-08T18:30:11.941 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:11.942 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.942 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.942 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:11.942 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.722460+0000", 2024-05-08T18:30:11.942 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.677e-06 2024-05-08T18:30:11.942 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.942 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.942 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:11.943 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.722471+0000", 2024-05-08T18:30:11.943 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0956e-05 2024-05-08T18:30:11.943 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.943 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.943 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:11.944 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.722496+0000", 2024-05-08T18:30:11.944 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5490000000000002e-05 2024-05-08T18:30:11.944 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.944 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.944 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:11.944 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.722511+0000", 2024-05-08T18:30:11.944 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4687e-05 2024-05-08T18:30:11.944 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.945 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.945 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:11.945 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.722609+0000", 2024-05-08T18:30:11.945 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8152000000000005e-05 2024-05-08T18:30:11.945 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.945 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.945 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:11.945 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.722638+0000", 2024-05-08T18:30:11.946 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.934e-05 2024-05-08T18:30:11.946 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.946 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.946 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:11.946 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.724127+0000", 2024-05-08T18:30:11.946 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001488622 2024-05-08T18:30:11.946 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.947 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.947 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:11.947 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.724219+0000", 2024-05-08T18:30:11.947 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1680000000000003e-05 2024-05-08T18:30:11.947 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:11.947 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:11.947 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:11.947 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.948 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.948 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:231 6.1f e33/27 6:fde4dd55:gc::gc.26:head v 33'1, mlcod=0'0)", 2024-05-08T18:30:11.948 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.773905+0000", 2024-05-08T18:30:11.948 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 20.119639158999998, 2024-05-08T18:30:11.948 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002018681, 2024-05-08T18:30:11.948 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:11.948 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:11.948 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:11.949 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:11.949 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.949 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:11.949 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.773905+0000", 2024-05-08T18:30:11.949 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:11.949 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.949 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.949 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:11.949 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.773905+0000", 2024-05-08T18:30:11.950 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:11.950 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.950 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.950 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:11.950 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.773906+0000", 2024-05-08T18:30:11.950 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2300000000000001e-07 2024-05-08T18:30:11.950 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.950 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.951 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:11.951 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.773913+0000", 2024-05-08T18:30:11.951 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8399999999999997e-06 2024-05-08T18:30:11.951 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.951 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.951 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:11.951 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.773938+0000", 2024-05-08T18:30:11.952 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.4977000000000002e-05 2024-05-08T18:30:11.952 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.952 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.952 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:11.952 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.773970+0000", 2024-05-08T18:30:11.952 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1673e-05 2024-05-08T18:30:11.952 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.952 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.952 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:11.952 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.774112+0000", 2024-05-08T18:30:11.952 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014273899999999999 2024-05-08T18:30:11.952 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.953 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.953 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:11.953 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.774167+0000", 2024-05-08T18:30:11.953 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4762000000000002e-05 2024-05-08T18:30:11.953 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.953 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.953 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:11.953 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.775832+0000", 2024-05-08T18:30:11.953 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0016648539999999999 2024-05-08T18:30:11.953 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.953 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.954 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:11.954 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.775924+0000", 2024-05-08T18:30:11.954 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2312999999999995e-05 2024-05-08T18:30:11.954 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:11.954 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:11.954 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:11.954 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.954 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.954 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:328 6.15 e33/27 6:ab569f81:gc::gc.12:head v 33'3, mlcod=33'1)", 2024-05-08T18:30:11.954 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.811368+0000", 2024-05-08T18:30:11.955 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 20.082176658000002, 2024-05-08T18:30:11.955 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0019828110000000001, 2024-05-08T18:30:11.955 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:11.955 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:11.955 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:11.955 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:11.955 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.955 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:11.955 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.811368+0000", 2024-05-08T18:30:11.955 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:11.955 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.955 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.955 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:11.956 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.811368+0000", 2024-05-08T18:30:11.956 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:11.956 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.956 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.956 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:11.956 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.811370+0000", 2024-05-08T18:30:11.956 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.883e-06 2024-05-08T18:30:11.956 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.956 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.956 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:11.956 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.811385+0000", 2024-05-08T18:30:11.957 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5489999999999999e-05 2024-05-08T18:30:11.957 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.957 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.957 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:11.957 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.811422+0000", 2024-05-08T18:30:11.957 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7023000000000001e-05 2024-05-08T18:30:11.957 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.957 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.957 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:11.957 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.811443+0000", 2024-05-08T18:30:11.957 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0194e-05 2024-05-08T18:30:11.957 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.957 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.957 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:11.958 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.811582+0000", 2024-05-08T18:30:11.958 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000139068 2024-05-08T18:30:11.958 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.958 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.958 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:11.958 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.811646+0000", 2024-05-08T18:30:11.958 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4113000000000001e-05 2024-05-08T18:30:11.958 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.958 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.958 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:11.958 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.813243+0000", 2024-05-08T18:30:11.958 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0015969249999999999 2024-05-08T18:30:11.959 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.959 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.959 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:11.959 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.813351+0000", 2024-05-08T18:30:11.959 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000108115 2024-05-08T18:30:11.959 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:11.959 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:11.959 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:11.959 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.959 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.959 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:341 6.1 e33/27 6:856b9b26:reshard::reshard.0000000002:head v 33'2, mlcod=0'0)", 2024-05-08T18:30:11.959 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.813091+0000", 2024-05-08T18:30:11.959 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 20.080453390999999, 2024-05-08T18:30:11.959 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0021783459999999998, 2024-05-08T18:30:11.960 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:11.960 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:11.960 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:11.960 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:11.960 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.960 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:11.960 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.813091+0000", 2024-05-08T18:30:11.960 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:11.960 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.960 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.960 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:11.960 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.813091+0000", 2024-05-08T18:30:11.960 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:11.961 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.961 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.961 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:11.961 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.813093+0000", 2024-05-08T18:30:11.961 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.813e-06 2024-05-08T18:30:11.961 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.961 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.961 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:11.961 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.813107+0000", 2024-05-08T18:30:11.961 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3730000000000001e-05 2024-05-08T18:30:11.961 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.961 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.961 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:11.962 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.813177+0000", 2024-05-08T18:30:11.962 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9801999999999993e-05 2024-05-08T18:30:11.962 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.962 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.962 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:11.962 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.813198+0000", 2024-05-08T18:30:11.962 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1347000000000001e-05 2024-05-08T18:30:11.962 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.962 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.962 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:11.962 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.813321+0000", 2024-05-08T18:30:11.962 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000123192 2024-05-08T18:30:11.962 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.963 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.963 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:11.963 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.813373+0000", 2024-05-08T18:30:11.963 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2046999999999998e-05 2024-05-08T18:30:11.963 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.963 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.963 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:11.963 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.815181+0000", 2024-05-08T18:30:11.963 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001807562 2024-05-08T18:30:11.963 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.963 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.963 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:11.963 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.815270+0000", 2024-05-08T18:30:11.964 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8852999999999998e-05 2024-05-08T18:30:11.964 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:11.964 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:11.964 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:11.964 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.964 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.964 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:404 6.3 e33/27 6:c623b173:gc::gc.16:head v 33'6, mlcod=33'4)", 2024-05-08T18:30:11.964 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.837510+0000", 2024-05-08T18:30:11.964 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 20.056035080000001, 2024-05-08T18:30:11.964 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0023724549999999999, 2024-05-08T18:30:11.964 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:11.964 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:11.964 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:11.964 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:11.965 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.965 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:11.965 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.837510+0000", 2024-05-08T18:30:11.965 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:11.965 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.965 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.965 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:11.965 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.837510+0000", 2024-05-08T18:30:11.965 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:11.965 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.965 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.965 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:11.965 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.837511+0000", 2024-05-08T18:30:11.966 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.863e-06 2024-05-08T18:30:11.966 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.966 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.966 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:11.966 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.837526+0000", 2024-05-08T18:30:11.966 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4756999999999999e-05 2024-05-08T18:30:11.966 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.966 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.966 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:11.966 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.837564+0000", 2024-05-08T18:30:11.966 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7645999999999998e-05 2024-05-08T18:30:11.966 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.966 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.967 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:11.967 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.837584+0000", 2024-05-08T18:30:11.967 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9763999999999999e-05 2024-05-08T18:30:11.967 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.967 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.967 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:11.967 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.837724+0000", 2024-05-08T18:30:11.967 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014080200000000001 2024-05-08T18:30:11.967 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.967 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.967 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:11.967 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.837776+0000", 2024-05-08T18:30:11.968 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1279000000000002e-05 2024-05-08T18:30:11.968 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.968 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.968 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:11.968 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.839770+0000", 2024-05-08T18:30:11.968 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001994048 2024-05-08T18:30:11.968 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.968 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.968 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:11.968 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.839882+0000", 2024-05-08T18:30:11.968 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000112296 2024-05-08T18:30:11.968 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:11.969 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:11.969 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:11.969 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.969 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.969 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:414 6.c e33/27 6:338eb7e9:::obj_delete_at_hint.0000000008:head v 33'3, mlcod=33'1)", 2024-05-08T18:30:11.969 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.841401+0000", 2024-05-08T18:30:11.969 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 20.05214393, 2024-05-08T18:30:11.969 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001916865, 2024-05-08T18:30:11.969 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:11.970 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:11.970 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:11.970 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:11.970 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.970 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:11.970 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.841401+0000", 2024-05-08T18:30:11.970 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:11.970 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.970 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.970 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:11.970 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.841401+0000", 2024-05-08T18:30:11.970 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:11.970 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.971 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.971 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:11.971 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.841402+0000", 2024-05-08T18:30:11.971 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6899999999999999e-06 2024-05-08T18:30:11.971 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.971 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.971 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:11.971 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.841414+0000", 2024-05-08T18:30:11.971 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.183e-05 2024-05-08T18:30:11.971 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.971 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.971 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:11.971 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.841435+0000", 2024-05-08T18:30:11.972 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0876000000000001e-05 2024-05-08T18:30:11.972 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.972 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.972 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:11.972 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.841451+0000", 2024-05-08T18:30:11.972 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5784e-05 2024-05-08T18:30:11.972 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.972 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.972 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:11.972 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.841597+0000", 2024-05-08T18:30:11.972 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014639899999999999 2024-05-08T18:30:11.972 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.972 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.973 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:11.973 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.841656+0000", 2024-05-08T18:30:11.973 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8485e-05 2024-05-08T18:30:11.973 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.973 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.973 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:11.973 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.843235+0000", 2024-05-08T18:30:11.973 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0015787920000000001 2024-05-08T18:30:11.973 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.973 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.973 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:11.973 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.843318+0000", 2024-05-08T18:30:11.973 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3009000000000004e-05 2024-05-08T18:30:11.974 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:11.974 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:11.974 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:11.974 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.974 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.974 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:422 6.c e33/27 6:338eb7e9:::obj_delete_at_hint.0000000008:head v 33'4, mlcod=33'2)", 2024-05-08T18:30:11.974 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.844520+0000", 2024-05-08T18:30:11.974 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 20.049024784, 2024-05-08T18:30:11.974 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002269929, 2024-05-08T18:30:11.974 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:11.974 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:11.974 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:11.974 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:11.975 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.975 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:11.975 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.844520+0000", 2024-05-08T18:30:11.975 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:11.975 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.975 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.975 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:11.975 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.844520+0000", 2024-05-08T18:30:11.975 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:11.975 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.975 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.975 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:11.975 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.844522+0000", 2024-05-08T18:30:11.975 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.643e-06 2024-05-08T18:30:11.976 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.976 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.976 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:11.976 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.844577+0000", 2024-05-08T18:30:11.976 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5976000000000001e-05 2024-05-08T18:30:11.976 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.976 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.976 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:11.976 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.844613+0000", 2024-05-08T18:30:11.976 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5339999999999997e-05 2024-05-08T18:30:11.976 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.976 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.976 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:11.977 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.844638+0000", 2024-05-08T18:30:11.977 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5165999999999999e-05 2024-05-08T18:30:11.977 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.977 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.977 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:11.977 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.844795+0000", 2024-05-08T18:30:11.977 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015660899999999999 2024-05-08T18:30:11.977 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.977 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.977 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:11.977 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.844841+0000", 2024-05-08T18:30:11.977 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6279999999999997e-05 2024-05-08T18:30:11.977 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.977 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.978 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:11.978 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.846707+0000", 2024-05-08T18:30:11.978 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0018657249999999999 2024-05-08T18:30:11.978 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.978 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.978 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:11.978 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.846790+0000", 2024-05-08T18:30:11.978 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3189999999999995e-05 2024-05-08T18:30:11.978 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:11.978 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:11.978 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:11.978 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.978 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.979 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:425 6.a e33/27 6:50d64734:::obj_delete_at_hint.0000000009:head v 33'2, mlcod=0'0)", 2024-05-08T18:30:11.979 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.848220+0000", 2024-05-08T18:30:11.979 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 20.045324665999999, 2024-05-08T18:30:11.979 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0017145109999999999, 2024-05-08T18:30:11.979 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:11.979 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:11.979 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:11.979 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:11.979 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.979 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:11.980 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.848220+0000", 2024-05-08T18:30:11.980 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:11.980 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.980 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.980 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:11.980 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.848220+0000", 2024-05-08T18:30:11.980 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:11.980 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.980 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.980 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:11.981 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.848222+0000", 2024-05-08T18:30:11.981 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9630000000000001e-06 2024-05-08T18:30:11.981 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.981 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.981 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:11.981 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.848254+0000", 2024-05-08T18:30:11.981 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2047e-05 2024-05-08T18:30:11.981 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.981 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.981 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:11.982 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.848273+0000", 2024-05-08T18:30:11.982 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9493000000000001e-05 2024-05-08T18:30:11.982 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.982 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.982 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:11.982 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.848286+0000", 2024-05-08T18:30:11.982 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2490000000000001e-05 2024-05-08T18:30:11.982 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.982 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.982 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:11.983 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.848414+0000", 2024-05-08T18:30:11.983 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000127785 2024-05-08T18:30:11.983 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.983 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.983 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:11.983 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.848448+0000", 2024-05-08T18:30:11.984 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4233999999999998e-05 2024-05-08T18:30:11.984 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.984 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.984 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:11.984 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.849855+0000", 2024-05-08T18:30:11.984 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001407482 2024-05-08T18:30:11.984 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.985 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.985 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:11.985 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.849934+0000", 2024-05-08T18:30:11.985 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9017000000000006e-05 2024-05-08T18:30:11.985 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:11.985 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:11.986 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:11.986 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.986 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.986 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:436 6.a e33/27 6:55b0279d:reshard::reshard.0000000009:head v 33'4, mlcod=33'1)", 2024-05-08T18:30:11.986 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.853725+0000", 2024-05-08T18:30:11.987 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 20.039819148999999, 2024-05-08T18:30:11.987 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032824949999999999, 2024-05-08T18:30:11.987 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:11.987 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:11.987 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:11.987 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:11.988 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.988 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:11.988 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.853725+0000", 2024-05-08T18:30:11.988 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:11.988 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.988 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.989 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:11.989 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.853725+0000", 2024-05-08T18:30:11.989 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:11.989 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.989 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.989 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:11.990 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.853727+0000", 2024-05-08T18:30:11.990 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6899999999999999e-06 2024-05-08T18:30:11.990 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.990 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.990 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:11.991 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.853742+0000", 2024-05-08T18:30:11.991 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.517e-05 2024-05-08T18:30:11.991 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.991 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.991 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:11.991 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.853778+0000", 2024-05-08T18:30:11.992 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5173999999999999e-05 2024-05-08T18:30:11.992 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.992 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.992 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:11.992 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.853791+0000", 2024-05-08T18:30:11.993 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.345e-05 2024-05-08T18:30:11.993 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.993 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.993 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:11.993 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.853912+0000", 2024-05-08T18:30:11.993 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012149199999999999 2024-05-08T18:30:11.993 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.993 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.994 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:11.994 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.853960+0000", 2024-05-08T18:30:11.994 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7262999999999998e-05 2024-05-08T18:30:11.994 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.994 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.994 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:11.995 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.856896+0000", 2024-05-08T18:30:11.995 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029363700000000002 2024-05-08T18:30:11.995 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.995 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.995 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:11.996 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.857008+0000", 2024-05-08T18:30:11.996 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011188600000000001 2024-05-08T18:30:11.996 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:11.996 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:11.996 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:11.996 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.997 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.997 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:457 6.1 e33/27 6:80b6fe23:reshard::reshard.0000000011:head v 33'3, mlcod=33'1)", 2024-05-08T18:30:11.997 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.865322+0000", 2024-05-08T18:30:11.997 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 20.028222503999999, 2024-05-08T18:30:11.997 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001750756, 2024-05-08T18:30:11.997 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:11.998 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:11.998 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:11.998 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:11.998 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.998 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:11.998 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.865322+0000", 2024-05-08T18:30:11.999 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:11.999 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:11.999 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:11.999 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:11.999 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.865322+0000", 2024-05-08T18:30:11.999 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:12.000 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.000 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.000 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:12.000 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.865325+0000", 2024-05-08T18:30:12.000 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5660000000000001e-06 2024-05-08T18:30:12.000 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.001 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.001 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:12.001 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.865339+0000", 2024-05-08T18:30:12.001 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.412e-05 2024-05-08T18:30:12.001 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.001 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.002 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:12.002 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.865366+0000", 2024-05-08T18:30:12.002 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7453e-05 2024-05-08T18:30:12.002 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.002 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.003 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:12.003 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.865383+0000", 2024-05-08T18:30:12.003 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.683e-05 2024-05-08T18:30:12.003 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.003 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.003 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:12.004 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.865514+0000", 2024-05-08T18:30:12.004 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000131369 2024-05-08T18:30:12.004 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.004 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.004 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:12.005 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.865583+0000", 2024-05-08T18:30:12.005 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8526000000000001e-05 2024-05-08T18:30:12.005 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.005 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.005 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:12.005 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.866974+0000", 2024-05-08T18:30:12.006 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001391193 2024-05-08T18:30:12.006 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.006 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.006 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:12.006 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.867073+0000", 2024-05-08T18:30:12.006 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8698999999999998e-05 2024-05-08T18:30:12.007 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:12.007 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:12.007 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:12.007 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.007 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.007 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:478 6.a e33/27 6:5127e642:gc::gc.21:head v 33'6, mlcod=33'4)", 2024-05-08T18:30:12.007 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.877617+0000", 2024-05-08T18:30:12.007 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 20.015927391000002, 2024-05-08T18:30:12.008 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0033938589999999999, 2024-05-08T18:30:12.008 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:12.008 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:12.008 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:12.008 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:12.008 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.008 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:12.008 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877617+0000", 2024-05-08T18:30:12.009 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:12.009 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.009 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.009 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:12.009 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877617+0000", 2024-05-08T18:30:12.009 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:12.009 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.009 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.010 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:12.010 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877619+0000", 2024-05-08T18:30:12.010 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.902e-06 2024-05-08T18:30:12.010 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.010 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.010 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:12.011 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877633+0000", 2024-05-08T18:30:12.011 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4143e-05 2024-05-08T18:30:12.011 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.011 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.011 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:12.011 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877667+0000", 2024-05-08T18:30:12.011 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3516999999999998e-05 2024-05-08T18:30:12.011 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.011 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.011 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:12.011 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877685+0000", 2024-05-08T18:30:12.011 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7931000000000002e-05 2024-05-08T18:30:12.012 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.012 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.012 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:12.012 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877842+0000", 2024-05-08T18:30:12.012 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015742800000000001 2024-05-08T18:30:12.012 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.012 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.012 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:12.012 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877890+0000", 2024-05-08T18:30:12.012 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7654000000000001e-05 2024-05-08T18:30:12.012 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.012 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.012 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:12.012 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.880908+0000", 2024-05-08T18:30:12.013 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0030181219999999998 2024-05-08T18:30:12.013 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.013 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.013 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:12.013 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.881011+0000", 2024-05-08T18:30:12.013 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000103162 2024-05-08T18:30:12.013 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:12.013 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:12.013 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:12.013 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.013 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.014 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:535 6.1f e33/27 6:fde4dd55:gc::gc.26:head v 33'2, mlcod=0'0)", 2024-05-08T18:30:12.014 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.909602+0000", 2024-05-08T18:30:12.014 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 19.983942945999999, 2024-05-08T18:30:12.014 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0023004039999999998, 2024-05-08T18:30:12.014 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:12.014 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:12.014 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:12.014 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:12.014 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.014 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:12.014 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.909602+0000", 2024-05-08T18:30:12.014 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:12.015 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.015 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.015 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:12.015 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.909602+0000", 2024-05-08T18:30:12.015 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:12.015 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.015 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.015 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:12.015 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.909604+0000", 2024-05-08T18:30:12.015 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8360000000000001e-06 2024-05-08T18:30:12.015 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.015 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.015 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:12.016 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.909615+0000", 2024-05-08T18:30:12.016 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1596999999999999e-05 2024-05-08T18:30:12.016 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.016 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.016 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:12.016 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.909643+0000", 2024-05-08T18:30:12.016 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7457000000000002e-05 2024-05-08T18:30:12.016 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.017 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.017 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:12.017 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.909662+0000", 2024-05-08T18:30:12.017 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9052999999999999e-05 2024-05-08T18:30:12.017 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.017 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.017 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:12.017 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.909758+0000", 2024-05-08T18:30:12.017 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6372000000000005e-05 2024-05-08T18:30:12.017 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.017 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.017 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:12.017 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.909780+0000", 2024-05-08T18:30:12.017 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1719999999999999e-05 2024-05-08T18:30:12.018 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.018 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.018 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:12.018 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.911830+0000", 2024-05-08T18:30:12.018 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002050072 2024-05-08T18:30:12.018 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.018 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.018 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:12.018 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.911902+0000", 2024-05-08T18:30:12.018 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.2297000000000003e-05 2024-05-08T18:30:12.018 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:12.018 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:12.018 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:12.019 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.019 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.019 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:541 6.1f e33/27 6:fde4dd55:gc::gc.26:head v 33'3, mlcod=33'1)", 2024-05-08T18:30:12.019 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.913684+0000", 2024-05-08T18:30:12.019 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 19.979860897999998, 2024-05-08T18:30:12.019 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0036425770000000001, 2024-05-08T18:30:12.019 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:12.019 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:12.019 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:12.019 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:12.019 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.019 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:12.019 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.913684+0000", 2024-05-08T18:30:12.019 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:12.020 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.020 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.020 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:12.020 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.913684+0000", 2024-05-08T18:30:12.020 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:12.020 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.020 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.020 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:12.020 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.913685+0000", 2024-05-08T18:30:12.020 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5859999999999999e-06 2024-05-08T18:30:12.020 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.020 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.020 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:12.020 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.913696+0000", 2024-05-08T18:30:12.021 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1080000000000001e-05 2024-05-08T18:30:12.021 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.021 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.021 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:12.021 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.913720+0000", 2024-05-08T18:30:12.021 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3614000000000001e-05 2024-05-08T18:30:12.021 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.021 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.021 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:12.021 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.913740+0000", 2024-05-08T18:30:12.022 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9836000000000001e-05 2024-05-08T18:30:12.022 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.022 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.022 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:12.022 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.913901+0000", 2024-05-08T18:30:12.022 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000161039 2024-05-08T18:30:12.022 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.023 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.023 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:12.023 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.913935+0000", 2024-05-08T18:30:12.023 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4353000000000001e-05 2024-05-08T18:30:12.023 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.023 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.023 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:12.023 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.917225+0000", 2024-05-08T18:30:12.023 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032897669999999999 2024-05-08T18:30:12.023 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.023 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.023 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:12.023 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.917326+0000", 2024-05-08T18:30:12.024 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000101302 2024-05-08T18:30:12.024 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:12.024 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:12.024 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:12.024 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.024 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.024 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:543 6.15 e33/27 6:ae95b544:::obj_delete_at_hint.0000000020:head v 33'5, mlcod=33'3)", 2024-05-08T18:30:12.024 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.916649+0000", 2024-05-08T18:30:12.024 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 19.976895344999999, 2024-05-08T18:30:12.024 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003362739, 2024-05-08T18:30:12.024 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:12.024 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:12.024 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:12.024 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:12.025 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.025 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:12.025 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.916649+0000", 2024-05-08T18:30:12.025 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:12.025 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.025 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.025 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:12.025 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.916649+0000", 2024-05-08T18:30:12.025 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:12.025 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.025 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.025 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:12.025 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.916651+0000", 2024-05-08T18:30:12.026 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7269999999999999e-06 2024-05-08T18:30:12.026 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.026 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.026 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:12.026 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.916663+0000", 2024-05-08T18:30:12.026 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2183e-05 2024-05-08T18:30:12.026 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.026 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.026 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:12.026 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.916691+0000", 2024-05-08T18:30:12.026 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7864e-05 2024-05-08T18:30:12.026 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.026 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.027 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:12.027 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.916710+0000", 2024-05-08T18:30:12.027 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.912e-05 2024-05-08T18:30:12.027 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.027 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.027 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:12.027 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.916851+0000", 2024-05-08T18:30:12.027 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000141163 2024-05-08T18:30:12.027 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.027 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.027 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:12.028 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.916909+0000", 2024-05-08T18:30:12.028 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.7686000000000003e-05 2024-05-08T18:30:12.028 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.028 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.028 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:12.028 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.919900+0000", 2024-05-08T18:30:12.028 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029909540000000001 2024-05-08T18:30:12.028 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.028 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.028 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:12.028 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.920012+0000", 2024-05-08T18:30:12.028 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000112042 2024-05-08T18:30:12.028 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:12.028 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:12.029 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:12.029 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.029 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.029 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:695 6.3 e33/27 6:c31f41d7:gc::gc.10:head v 33'12, mlcod=33'10)", 2024-05-08T18:30:12.029 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.017806+0000", 2024-05-08T18:30:12.029 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 19.875739061000001, 2024-05-08T18:30:12.029 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001718373, 2024-05-08T18:30:12.029 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:12.029 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:12.029 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:12.029 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:12.029 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.030 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:12.030 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.017806+0000", 2024-05-08T18:30:12.030 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:12.030 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.030 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.030 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:12.030 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.017806+0000", 2024-05-08T18:30:12.030 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:12.030 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.030 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.031 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:12.031 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.017807+0000", 2024-05-08T18:30:12.031 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8199999999999999e-06 2024-05-08T18:30:12.031 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.031 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.031 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:12.031 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.017818+0000", 2024-05-08T18:30:12.031 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0519999999999999e-05 2024-05-08T18:30:12.031 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.032 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.032 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:12.032 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.017846+0000", 2024-05-08T18:30:12.032 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7729000000000002e-05 2024-05-08T18:30:12.032 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.032 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.032 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:12.032 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.017859+0000", 2024-05-08T18:30:12.032 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3337e-05 2024-05-08T18:30:12.032 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.033 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.033 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:12.033 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.017990+0000", 2024-05-08T18:30:12.033 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013146499999999999 2024-05-08T18:30:12.033 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.033 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.033 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:12.033 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.018039+0000", 2024-05-08T18:30:12.033 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8816999999999997e-05 2024-05-08T18:30:12.033 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.033 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.033 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:12.033 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.019397+0000", 2024-05-08T18:30:12.034 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0013575359999999999 2024-05-08T18:30:12.034 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.034 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.034 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:12.034 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.019524+0000", 2024-05-08T18:30:12.034 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012714900000000001 2024-05-08T18:30:12.034 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:12.034 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:12.034 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:12.034 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:12.034 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:12.034 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:30:12.036 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-08T18:30:12.037 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:30:12.034+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:30:12.137 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:30:12.136+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:30:12.165 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:30:12.165 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:30:12.165 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 0 2024-05-08T18:30:12.165 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:30:12.179 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-08T18:30:12.238 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:30:12.242+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:30:12.339 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:30:12.342+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:30:12.343 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:30:12.343 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:30:12.344 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2024-05-08T18:30:12.344 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2024-05-08T18:30:12.344 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:30:12.357 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-08T18:30:12.439 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:30:12.436+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:30:12.475 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:30:12.476 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2024-05-08T18:30:12.476 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2024-05-08T18:30:12.476 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-05-08T18:30:12.476 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.476 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:24 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [write 262144~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:12.476 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.154193+0000", 2024-05-08T18:30:12.476 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 45.321305996, 2024-05-08T18:30:12.476 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0085494309999999997, 2024-05-08T18:30:12.476 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:12.476 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:12.476 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:12.476 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:12.476 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:12.476 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:12.477 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 24 2024-05-08T18:30:12.477 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.477 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:12.477 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.477 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:12.477 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154193+0000", 2024-05-08T18:30:12.477 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:12.477 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.477 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.477 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:12.477 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154193+0000", 2024-05-08T18:30:12.477 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:12.478 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.478 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.478 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:12.478 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154194+0000", 2024-05-08T18:30:12.478 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.44e-06 2024-05-08T18:30:12.478 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.478 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.478 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:12.478 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154394+0000", 2024-05-08T18:30:12.478 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00019972499999999999 2024-05-08T18:30:12.478 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.478 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.478 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:12.479 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154417+0000", 2024-05-08T18:30:12.479 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2713000000000001e-05 2024-05-08T18:30:12.479 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.479 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.479 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:12.479 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154437+0000", 2024-05-08T18:30:12.479 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0027e-05 2024-05-08T18:30:12.479 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.479 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.479 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:12.479 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.158438+0000", 2024-05-08T18:30:12.479 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0040011459999999997 2024-05-08T18:30:12.479 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.480 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.480 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:12.480 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.158567+0000", 2024-05-08T18:30:12.480 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012923899999999999 2024-05-08T18:30:12.480 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.480 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.480 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:12.480 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.158787+0000", 2024-05-08T18:30:12.480 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000219581 2024-05-08T18:30:12.480 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.480 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.480 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:12.480 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.162013+0000", 2024-05-08T18:30:12.481 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032261759999999999 2024-05-08T18:30:12.481 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.481 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.481 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:12.481 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.162568+0000", 2024-05-08T18:30:12.481 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00055576900000000001 2024-05-08T18:30:12.481 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.481 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.481 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:12.481 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.162644+0000", 2024-05-08T18:30:12.481 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5516e-05 2024-05-08T18:30:12.481 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.481 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.481 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:12.482 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.162742+0000", 2024-05-08T18:30:12.482 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8098999999999997e-05 2024-05-08T18:30:12.482 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:12.482 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:12.482 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:12.482 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.482 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.482 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:25 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:12.482 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.154495+0000", 2024-05-08T18:30:12.482 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 45.321003701999999, 2024-05-08T18:30:12.482 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010784396999999999, 2024-05-08T18:30:12.482 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:12.483 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:12.483 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:12.483 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:12.483 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:12.483 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:12.483 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 25 2024-05-08T18:30:12.483 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.483 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:12.483 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.483 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:12.483 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154495+0000", 2024-05-08T18:30:12.483 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:12.483 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.483 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.484 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:12.484 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154495+0000", 2024-05-08T18:30:12.484 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:12.484 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.484 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.484 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:12.484 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154496+0000", 2024-05-08T18:30:12.484 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.454e-06 2024-05-08T18:30:12.484 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.484 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.484 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:12.484 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154509+0000", 2024-05-08T18:30:12.484 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2496e-05 2024-05-08T18:30:12.484 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.485 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.485 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:12.485 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154531+0000", 2024-05-08T18:30:12.485 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1987000000000001e-05 2024-05-08T18:30:12.485 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.485 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.485 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:12.485 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154547+0000", 2024-05-08T18:30:12.485 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.577e-05 2024-05-08T18:30:12.485 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.485 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.485 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:12.485 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.160949+0000", 2024-05-08T18:30:12.486 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.006401917 2024-05-08T18:30:12.486 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.486 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.486 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:12.486 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.161102+0000", 2024-05-08T18:30:12.486 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000153826 2024-05-08T18:30:12.486 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.486 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.486 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:12.486 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.161332+0000", 2024-05-08T18:30:12.486 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022918099999999999 2024-05-08T18:30:12.486 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.486 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.487 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:12.487 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.163838+0000", 2024-05-08T18:30:12.487 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0025064079999999999 2024-05-08T18:30:12.487 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.487 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.487 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:12.487 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.165121+0000", 2024-05-08T18:30:12.487 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0012825200000000001 2024-05-08T18:30:12.487 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.487 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.487 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:12.487 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.165212+0000", 2024-05-08T18:30:12.487 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1121999999999999e-05 2024-05-08T18:30:12.487 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.488 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.488 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:12.488 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.165279+0000", 2024-05-08T18:30:12.488 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7716e-05 2024-05-08T18:30:12.488 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:12.488 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:12.488 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:12.488 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.488 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.488 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:41 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:12.488 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247174+0000", 2024-05-08T18:30:12.488 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 45.228324720000003, 2024-05-08T18:30:12.489 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010013393000000001, 2024-05-08T18:30:12.489 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:12.489 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:12.489 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:12.489 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:12.489 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:12.489 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:12.489 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 41 2024-05-08T18:30:12.489 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.489 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:12.489 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.489 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:12.489 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247174+0000", 2024-05-08T18:30:12.490 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:12.490 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.490 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.490 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:12.490 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247174+0000", 2024-05-08T18:30:12.490 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:12.490 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.490 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.490 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:12.490 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247175+0000", 2024-05-08T18:30:12.490 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.9999999999999995e-07 2024-05-08T18:30:12.490 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.490 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.491 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:12.491 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247277+0000", 2024-05-08T18:30:12.491 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010243600000000001 2024-05-08T18:30:12.491 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.491 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.491 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:12.491 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247291+0000", 2024-05-08T18:30:12.491 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4076999999999999e-05 2024-05-08T18:30:12.491 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.491 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.491 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:12.491 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247301+0000", 2024-05-08T18:30:12.491 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0010000000000001e-05 2024-05-08T18:30:12.492 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.492 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.492 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:12.492 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.249555+0000", 2024-05-08T18:30:12.492 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0022539050000000001 2024-05-08T18:30:12.492 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.492 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.492 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:12.492 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.249700+0000", 2024-05-08T18:30:12.492 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014484599999999999 2024-05-08T18:30:12.492 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.492 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.492 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:12.493 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.249929+0000", 2024-05-08T18:30:12.493 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022904499999999999 2024-05-08T18:30:12.493 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.493 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.493 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:12.493 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.253695+0000", 2024-05-08T18:30:12.493 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0037656640000000002 2024-05-08T18:30:12.493 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.493 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.493 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:12.493 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.256970+0000", 2024-05-08T18:30:12.493 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003274608 2024-05-08T18:30:12.493 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.493 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.494 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:12.494 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.257052+0000", 2024-05-08T18:30:12.494 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2223000000000002e-05 2024-05-08T18:30:12.494 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.494 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.494 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:12.494 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.257187+0000", 2024-05-08T18:30:12.494 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013557900000000001 2024-05-08T18:30:12.494 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:12.494 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:12.494 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:12.494 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.495 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.495 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:42 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:12.495 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247321+0000", 2024-05-08T18:30:12.495 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 45.228177401000003, 2024-05-08T18:30:12.495 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013168572, 2024-05-08T18:30:12.495 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:12.495 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:12.495 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:12.495 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:12.495 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:12.495 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:12.495 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 42 2024-05-08T18:30:12.495 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.496 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:12.496 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.496 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:12.496 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247321+0000", 2024-05-08T18:30:12.496 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:12.496 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.496 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.496 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:12.496 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247321+0000", 2024-05-08T18:30:12.496 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:12.496 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.496 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.496 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:12.497 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247323+0000", 2024-05-08T18:30:12.497 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.24e-06 2024-05-08T18:30:12.497 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.497 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.497 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:12.497 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247329+0000", 2024-05-08T18:30:12.497 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1530000000000002e-06 2024-05-08T18:30:12.497 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.497 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.497 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:12.497 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247339+0000", 2024-05-08T18:30:12.497 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0387000000000001e-05 2024-05-08T18:30:12.497 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.497 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.498 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:12.498 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247347+0000", 2024-05-08T18:30:12.498 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9829999999999996e-06 2024-05-08T18:30:12.498 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.498 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.498 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:12.498 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.251488+0000", 2024-05-08T18:30:12.498 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0041412849999999998 2024-05-08T18:30:12.498 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.498 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.498 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:12.498 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.251672+0000", 2024-05-08T18:30:12.499 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00018354499999999999 2024-05-08T18:30:12.499 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.499 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.499 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:12.499 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.251949+0000", 2024-05-08T18:30:12.499 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00027695399999999999 2024-05-08T18:30:12.499 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.499 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.499 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:12.499 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.253810+0000", 2024-05-08T18:30:12.499 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001860806 2024-05-08T18:30:12.499 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.499 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.500 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:12.500 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260244+0000", 2024-05-08T18:30:12.500 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0064347939999999998 2024-05-08T18:30:12.500 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.500 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.500 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:12.500 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260376+0000", 2024-05-08T18:30:12.500 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000131829 2024-05-08T18:30:12.500 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.500 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.500 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:12.500 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260490+0000", 2024-05-08T18:30:12.500 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000113596 2024-05-08T18:30:12.500 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:12.501 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:12.501 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:12.501 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.501 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.501 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:43 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:12.501 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247367+0000", 2024-05-08T18:30:12.501 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 45.228131488000002, 2024-05-08T18:30:12.501 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013449025999999999, 2024-05-08T18:30:12.501 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:12.501 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:12.501 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:12.501 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:12.501 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:12.501 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:12.502 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 43 2024-05-08T18:30:12.502 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.502 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:12.502 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.502 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:12.502 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247367+0000", 2024-05-08T18:30:12.502 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:12.502 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.502 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.502 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:12.502 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247367+0000", 2024-05-08T18:30:12.502 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:12.502 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.503 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.503 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:12.503 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247368+0000", 2024-05-08T18:30:12.503 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1999999999999999e-07 2024-05-08T18:30:12.503 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.503 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.503 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:12.503 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247374+0000", 2024-05-08T18:30:12.503 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.19e-06 2024-05-08T18:30:12.503 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.503 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.503 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:12.503 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247384+0000", 2024-05-08T18:30:12.503 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0173000000000001e-05 2024-05-08T18:30:12.504 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.504 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.504 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:12.504 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247392+0000", 2024-05-08T18:30:12.504 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1869999999999997e-06 2024-05-08T18:30:12.504 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.504 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.504 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:12.504 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.252515+0000", 2024-05-08T18:30:12.504 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0051221399999999999 2024-05-08T18:30:12.504 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.504 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.504 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:12.504 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.252641+0000", 2024-05-08T18:30:12.505 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012609200000000001 2024-05-08T18:30:12.505 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.505 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.505 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:12.505 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.252842+0000", 2024-05-08T18:30:12.505 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000201619 2024-05-08T18:30:12.505 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.505 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.505 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:12.505 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.256828+0000", 2024-05-08T18:30:12.505 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039853989999999997 2024-05-08T18:30:12.505 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.505 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.506 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:12.506 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260515+0000", 2024-05-08T18:30:12.506 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0036875419999999998 2024-05-08T18:30:12.506 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.506 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.506 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:12.506 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260718+0000", 2024-05-08T18:30:12.506 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020229499999999999 2024-05-08T18:30:12.506 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.509 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.510 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:12.510 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260816+0000", 2024-05-08T18:30:12.510 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8669e-05 2024-05-08T18:30:12.510 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:12.510 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:12.510 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:12.510 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.510 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.510 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:12.510 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247466+0000", 2024-05-08T18:30:12.510 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 45.228032902000002, 2024-05-08T18:30:12.510 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013491806, 2024-05-08T18:30:12.511 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:12.511 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:12.511 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:12.511 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:12.511 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:12.511 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:12.511 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 44 2024-05-08T18:30:12.511 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.511 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:12.511 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.511 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:12.511 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247466+0000", 2024-05-08T18:30:12.511 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:12.511 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.512 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.512 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:12.512 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247466+0000", 2024-05-08T18:30:12.512 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:12.512 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.512 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.512 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:12.512 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247467+0000", 2024-05-08T18:30:12.512 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.263e-06 2024-05-08T18:30:12.512 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.512 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.512 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:12.513 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247585+0000", 2024-05-08T18:30:12.513 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011756600000000001 2024-05-08T18:30:12.513 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.513 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.513 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:12.513 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247598+0000", 2024-05-08T18:30:12.513 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3766e-05 2024-05-08T18:30:12.513 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.513 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.513 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:12.513 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247609+0000", 2024-05-08T18:30:12.513 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0604e-05 2024-05-08T18:30:12.513 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.513 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.514 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:12.514 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.253890+0000", 2024-05-08T18:30:12.514 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0062810440000000004 2024-05-08T18:30:12.514 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.514 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.514 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:12.514 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.254068+0000", 2024-05-08T18:30:12.514 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017848199999999999 2024-05-08T18:30:12.514 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.514 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.514 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:12.514 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.254488+0000", 2024-05-08T18:30:12.514 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00041965399999999999 2024-05-08T18:30:12.515 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.515 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.515 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:12.515 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.256949+0000", 2024-05-08T18:30:12.515 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002461254 2024-05-08T18:30:12.515 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.515 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.515 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:12.515 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260832+0000", 2024-05-08T18:30:12.515 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0038830539999999999 2024-05-08T18:30:12.515 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.515 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.515 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:12.515 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260906+0000", 2024-05-08T18:30:12.516 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3455999999999996e-05 2024-05-08T18:30:12.516 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.516 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.516 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:12.516 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260958+0000", 2024-05-08T18:30:12.516 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1663000000000003e-05 2024-05-08T18:30:12.516 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:12.516 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:12.516 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:12.516 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.516 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.516 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:12.516 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247630+0000", 2024-05-08T18:30:12.517 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 45.227868497000003, 2024-05-08T18:30:12.517 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013478753, 2024-05-08T18:30:12.517 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:12.517 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:12.517 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:12.517 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:12.517 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:12.518 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:12.518 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 45 2024-05-08T18:30:12.518 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.518 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:12.518 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.518 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:12.518 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247630+0000", 2024-05-08T18:30:12.518 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:12.518 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.518 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.518 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:12.518 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247630+0000", 2024-05-08T18:30:12.518 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:12.518 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.519 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.519 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:12.519 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247631+0000", 2024-05-08T18:30:12.519 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7399999999999991e-07 2024-05-08T18:30:12.519 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.519 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.519 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:12.519 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247637+0000", 2024-05-08T18:30:12.519 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.93e-06 2024-05-08T18:30:12.519 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.519 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.519 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:12.519 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247647+0000", 2024-05-08T18:30:12.519 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7459999999999995e-06 2024-05-08T18:30:12.520 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.520 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.520 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:12.520 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247654+0000", 2024-05-08T18:30:12.520 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4039999999999998e-06 2024-05-08T18:30:12.520 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.520 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.520 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:12.520 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.255829+0000", 2024-05-08T18:30:12.520 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0081749059999999991 2024-05-08T18:30:12.520 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.520 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.520 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:12.520 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.255979+0000", 2024-05-08T18:30:12.521 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015027899999999999 2024-05-08T18:30:12.521 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.521 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.521 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:12.521 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.256185+0000", 2024-05-08T18:30:12.521 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020583900000000001 2024-05-08T18:30:12.521 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.521 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.521 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:12.521 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260097+0000", 2024-05-08T18:30:12.521 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039121929999999996 2024-05-08T18:30:12.521 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.521 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.521 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:12.522 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260973+0000", 2024-05-08T18:30:12.522 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00087591999999999998 2024-05-08T18:30:12.522 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.522 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.522 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:12.522 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261056+0000", 2024-05-08T18:30:12.522 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3104999999999998e-05 2024-05-08T18:30:12.522 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.522 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.522 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:12.522 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261109+0000", 2024-05-08T18:30:12.522 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2457000000000003e-05 2024-05-08T18:30:12.523 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:12.523 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:12.523 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:12.523 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.523 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.523 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:12.523 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247667+0000", 2024-05-08T18:30:12.523 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 45.227831217000002, 2024-05-08T18:30:12.523 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013569098999999999, 2024-05-08T18:30:12.523 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:12.523 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:12.523 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:12.523 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:12.523 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:12.524 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:12.524 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 46 2024-05-08T18:30:12.524 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.524 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:12.524 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.524 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:12.524 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247667+0000", 2024-05-08T18:30:12.524 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:12.524 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.524 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.524 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:12.524 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247667+0000", 2024-05-08T18:30:12.524 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:12.525 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.525 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.525 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:12.525 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247668+0000", 2024-05-08T18:30:12.525 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7999999999999995e-07 2024-05-08T18:30:12.525 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.525 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.525 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:12.525 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247674+0000", 2024-05-08T18:30:12.525 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4369999999999998e-06 2024-05-08T18:30:12.525 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.525 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.525 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:12.525 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247683+0000", 2024-05-08T18:30:12.526 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4360000000000008e-06 2024-05-08T18:30:12.526 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.526 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.526 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:12.526 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247690+0000", 2024-05-08T18:30:12.526 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.43e-06 2024-05-08T18:30:12.526 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.526 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.526 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:12.526 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.257358+0000", 2024-05-08T18:30:12.526 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0096676890000000001 2024-05-08T18:30:12.526 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.526 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.527 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:12.527 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.257626+0000", 2024-05-08T18:30:12.527 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00026819099999999998 2024-05-08T18:30:12.527 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.527 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.527 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:12.527 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.258041+0000", 2024-05-08T18:30:12.527 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00041438400000000001 2024-05-08T18:30:12.527 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.527 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.527 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:12.527 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260224+0000", 2024-05-08T18:30:12.527 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0021830700000000001 2024-05-08T18:30:12.527 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.528 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.528 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:12.528 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261127+0000", 2024-05-08T18:30:12.528 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00090292300000000003 2024-05-08T18:30:12.528 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.528 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.528 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:12.528 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261191+0000", 2024-05-08T18:30:12.528 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4342000000000002e-05 2024-05-08T18:30:12.528 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.528 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.528 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:12.528 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261237+0000", 2024-05-08T18:30:12.528 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.5516999999999998e-05 2024-05-08T18:30:12.529 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:12.529 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:12.529 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:12.529 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.529 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.529 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:12.529 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247703+0000", 2024-05-08T18:30:12.529 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 45.227795733999997, 2024-05-08T18:30:12.529 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015020204000000001, 2024-05-08T18:30:12.529 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:12.529 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:12.529 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:12.529 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:12.529 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:12.530 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:12.530 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 47 2024-05-08T18:30:12.530 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.530 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:12.530 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.530 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:12.530 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247703+0000", 2024-05-08T18:30:12.530 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:12.530 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.530 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.530 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:12.530 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247703+0000", 2024-05-08T18:30:12.530 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:12.531 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.531 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.531 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:12.531 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247704+0000", 2024-05-08T18:30:12.531 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8299999999999996e-07 2024-05-08T18:30:12.531 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.531 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.531 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:12.532 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247877+0000", 2024-05-08T18:30:12.532 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000172979 2024-05-08T18:30:12.532 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.532 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.532 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:12.532 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247894+0000", 2024-05-08T18:30:12.532 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6912999999999999e-05 2024-05-08T18:30:12.532 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.532 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.532 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:12.532 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247903+0000", 2024-05-08T18:30:12.533 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1770000000000004e-06 2024-05-08T18:30:12.533 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.533 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.533 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:12.533 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.258767+0000", 2024-05-08T18:30:12.533 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010864409 2024-05-08T18:30:12.533 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.533 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.533 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:12.533 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.258898+0000", 2024-05-08T18:30:12.533 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000131199 2024-05-08T18:30:12.533 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.533 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.534 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:12.534 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.259117+0000", 2024-05-08T18:30:12.534 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000218889 2024-05-08T18:30:12.534 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.534 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.534 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:12.534 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.262372+0000", 2024-05-08T18:30:12.534 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032545679999999998 2024-05-08T18:30:12.534 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.534 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.534 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:12.535 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.262432+0000", 2024-05-08T18:30:12.535 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9913e-05 2024-05-08T18:30:12.535 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.535 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.535 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:12.535 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.262585+0000", 2024-05-08T18:30:12.535 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015361800000000001 2024-05-08T18:30:12.535 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.535 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.535 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:12.535 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.262723+0000", 2024-05-08T18:30:12.535 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000137856 2024-05-08T18:30:12.536 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:12.536 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:12.536 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:12.536 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.536 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.536 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:12.536 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247927+0000", 2024-05-08T18:30:12.536 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 45.227571695999998, 2024-05-08T18:30:12.536 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018387718000000001, 2024-05-08T18:30:12.536 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:12.536 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:12.536 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:12.537 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:12.537 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:12.537 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:12.537 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 48 2024-05-08T18:30:12.537 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.537 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:12.537 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.537 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:12.537 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247927+0000", 2024-05-08T18:30:12.537 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:12.537 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.537 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.538 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:12.538 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247927+0000", 2024-05-08T18:30:12.538 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:12.538 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.538 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.538 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:12.538 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247928+0000", 2024-05-08T18:30:12.538 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8400000000000003e-07 2024-05-08T18:30:12.538 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.538 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.539 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:12.539 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247935+0000", 2024-05-08T18:30:12.539 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1230000000000002e-06 2024-05-08T18:30:12.539 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.539 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.539 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:12.539 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247945+0000", 2024-05-08T18:30:12.539 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0346000000000001e-05 2024-05-08T18:30:12.539 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.539 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.539 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:12.539 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247953+0000", 2024-05-08T18:30:12.540 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8040000000000002e-06 2024-05-08T18:30:12.540 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.540 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.540 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:12.540 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261292+0000", 2024-05-08T18:30:12.540 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013339337 2024-05-08T18:30:12.540 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.540 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.540 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:12.540 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261424+0000", 2024-05-08T18:30:12.540 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013201900000000001 2024-05-08T18:30:12.540 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.541 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.541 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:12.541 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261628+0000", 2024-05-08T18:30:12.541 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020327499999999999 2024-05-08T18:30:12.541 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.541 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.541 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:12.541 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.263849+0000", 2024-05-08T18:30:12.541 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0022209759999999999 2024-05-08T18:30:12.541 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.541 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.542 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:12.542 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266167+0000", 2024-05-08T18:30:12.542 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002317979 2024-05-08T18:30:12.542 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.542 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.542 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:12.542 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266249+0000", 2024-05-08T18:30:12.542 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1996000000000006e-05 2024-05-08T18:30:12.542 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.542 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.542 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:12.543 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266315+0000", 2024-05-08T18:30:12.543 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5979e-05 2024-05-08T18:30:12.543 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:12.543 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:12.543 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:12.543 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.543 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.543 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:12.543 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247966+0000", 2024-05-08T18:30:12.543 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 45.227532762999999, 2024-05-08T18:30:12.543 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0194153, 2024-05-08T18:30:12.543 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:12.544 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:12.544 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:12.544 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:12.544 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:12.544 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:12.544 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 49 2024-05-08T18:30:12.544 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.544 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:12.544 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.544 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:12.544 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247966+0000", 2024-05-08T18:30:12.544 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:12.544 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.545 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.545 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:12.545 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247966+0000", 2024-05-08T18:30:12.545 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:12.545 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.545 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.545 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:12.545 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247967+0000", 2024-05-08T18:30:12.545 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0299999999999998e-07 2024-05-08T18:30:12.545 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.545 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.546 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:12.546 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247972+0000", 2024-05-08T18:30:12.546 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3600000000000004e-06 2024-05-08T18:30:12.546 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.546 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.546 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:12.546 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247981+0000", 2024-05-08T18:30:12.546 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.234e-06 2024-05-08T18:30:12.546 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.546 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.546 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:12.547 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247989+0000", 2024-05-08T18:30:12.547 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5159999999999997e-06 2024-05-08T18:30:12.547 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.547 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.547 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:12.547 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.262816+0000", 2024-05-08T18:30:12.547 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.014827399999999999 2024-05-08T18:30:12.547 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.547 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.547 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:12.547 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.262948+0000", 2024-05-08T18:30:12.547 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013166799999999999 2024-05-08T18:30:12.548 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.548 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.548 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:12.548 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.263153+0000", 2024-05-08T18:30:12.548 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000205272 2024-05-08T18:30:12.548 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.548 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.548 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:12.548 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266144+0000", 2024-05-08T18:30:12.548 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029912300000000001 2024-05-08T18:30:12.548 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.549 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.549 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:12.549 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.267226+0000", 2024-05-08T18:30:12.549 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010820580000000001 2024-05-08T18:30:12.549 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.549 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.549 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:12.549 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.267315+0000", 2024-05-08T18:30:12.549 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8793000000000002e-05 2024-05-08T18:30:12.549 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.549 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.549 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:12.549 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.267381+0000", 2024-05-08T18:30:12.550 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6066000000000001e-05 2024-05-08T18:30:12.550 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:12.550 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:12.550 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:12.550 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.550 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.550 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:12.550 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.248003+0000", 2024-05-08T18:30:12.550 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 45.227495462999997, 2024-05-08T18:30:12.550 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.020859638999999999, 2024-05-08T18:30:12.550 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:12.551 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:12.551 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:12.551 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:12.551 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:12.551 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:12.551 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 50 2024-05-08T18:30:12.551 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.551 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:12.551 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.551 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:12.551 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248003+0000", 2024-05-08T18:30:12.552 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:12.552 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.552 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.552 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:12.552 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248003+0000", 2024-05-08T18:30:12.552 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:12.552 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.552 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.552 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:12.552 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248004+0000", 2024-05-08T18:30:12.552 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5300000000000003e-07 2024-05-08T18:30:12.552 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.553 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.553 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:12.553 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248139+0000", 2024-05-08T18:30:12.553 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000135193 2024-05-08T18:30:12.553 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.553 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.553 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:12.553 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248151+0000", 2024-05-08T18:30:12.553 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.19e-05 2024-05-08T18:30:12.553 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.553 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.553 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:12.554 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248161+0000", 2024-05-08T18:30:12.554 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4599999999999992e-06 2024-05-08T18:30:12.554 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.554 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.554 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:12.554 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.263961+0000", 2024-05-08T18:30:12.554 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015800844000000001 2024-05-08T18:30:12.554 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.554 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.554 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:12.555 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.264091+0000", 2024-05-08T18:30:12.555 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012952300000000001 2024-05-08T18:30:12.555 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.555 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.555 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:12.555 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.264306+0000", 2024-05-08T18:30:12.555 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000215541 2024-05-08T18:30:12.555 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.555 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.555 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:12.555 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.267205+0000", 2024-05-08T18:30:12.556 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0028989910000000001 2024-05-08T18:30:12.556 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.556 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.556 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:12.556 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.268631+0000", 2024-05-08T18:30:12.556 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0014257320000000001 2024-05-08T18:30:12.556 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.556 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.556 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:12.556 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.268781+0000", 2024-05-08T18:30:12.556 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000149939 2024-05-08T18:30:12.557 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.557 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.557 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:12.557 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.268863+0000", 2024-05-08T18:30:12.557 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1762999999999996e-05 2024-05-08T18:30:12.557 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:12.557 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:12.557 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:12.557 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.557 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.557 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:12.557 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.248201+0000", 2024-05-08T18:30:12.558 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 45.227297708000002, 2024-05-08T18:30:12.558 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.022909783, 2024-05-08T18:30:12.558 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:12.558 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:12.558 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:12.558 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:12.558 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:12.558 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:12.558 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 51 2024-05-08T18:30:12.558 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.559 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:12.559 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.559 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:12.559 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248201+0000", 2024-05-08T18:30:12.559 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:12.559 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.559 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.559 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:12.559 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248201+0000", 2024-05-08T18:30:12.559 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:12.559 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.559 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.560 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:12.560 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248202+0000", 2024-05-08T18:30:12.560 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2999999999999999e-07 2024-05-08T18:30:12.560 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.560 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.560 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:12.560 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248209+0000", 2024-05-08T18:30:12.560 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5769999999999996e-06 2024-05-08T18:30:12.560 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.560 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.560 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:12.560 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248221+0000", 2024-05-08T18:30:12.561 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1165999999999999e-05 2024-05-08T18:30:12.561 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.561 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.561 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:12.561 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248229+0000", 2024-05-08T18:30:12.561 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1529999999999997e-06 2024-05-08T18:30:12.561 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.561 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.561 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:12.561 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.265146+0000", 2024-05-08T18:30:12.561 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016917492999999999 2024-05-08T18:30:12.561 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.562 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.562 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:12.562 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.265282+0000", 2024-05-08T18:30:12.562 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013597199999999999 2024-05-08T18:30:12.562 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.562 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.562 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:12.562 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.265488+0000", 2024-05-08T18:30:12.562 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000206212 2024-05-08T18:30:12.562 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.562 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.563 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:12.563 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.268442+0000", 2024-05-08T18:30:12.563 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002953841 2024-05-08T18:30:12.563 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.563 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.563 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:12.563 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.270951+0000", 2024-05-08T18:30:12.563 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0025085670000000002 2024-05-08T18:30:12.563 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.563 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.563 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:12.563 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.271042+0000", 2024-05-08T18:30:12.563 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1485999999999998e-05 2024-05-08T18:30:12.564 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.564 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.564 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:12.564 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.271111+0000", 2024-05-08T18:30:12.564 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8386000000000006e-05 2024-05-08T18:30:12.564 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:12.564 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:12.564 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:12.564 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.564 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.564 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:12.565 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.248244+0000", 2024-05-08T18:30:12.565 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 45.227255151999998, 2024-05-08T18:30:12.565 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.023010806000000002, 2024-05-08T18:30:12.565 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:12.565 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:12.565 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:12.565 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:12.565 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:12.565 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:12.565 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 52 2024-05-08T18:30:12.565 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.565 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:12.566 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.566 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:12.566 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248244+0000", 2024-05-08T18:30:12.566 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:12.566 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.566 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.566 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:12.566 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248244+0000", 2024-05-08T18:30:12.566 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:12.566 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.566 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.567 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:12.567 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248244+0000", 2024-05-08T18:30:12.567 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0999999999999998e-07 2024-05-08T18:30:12.567 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.567 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.567 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:12.567 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248251+0000", 2024-05-08T18:30:12.567 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9639999999999997e-06 2024-05-08T18:30:12.567 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.567 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.567 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:12.567 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248266+0000", 2024-05-08T18:30:12.568 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4996e-05 2024-05-08T18:30:12.568 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.568 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.568 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:12.568 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248274+0000", 2024-05-08T18:30:12.568 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8299999999999996e-06 2024-05-08T18:30:12.568 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.568 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.568 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:12.568 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266367+0000", 2024-05-08T18:30:12.568 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018092607 2024-05-08T18:30:12.568 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.569 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.569 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:12.569 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266532+0000", 2024-05-08T18:30:12.569 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016569600000000001 2024-05-08T18:30:12.569 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.569 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.569 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:12.569 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266729+0000", 2024-05-08T18:30:12.569 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00019630099999999999 2024-05-08T18:30:12.569 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.569 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.569 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:12.570 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.268574+0000", 2024-05-08T18:30:12.570 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0018452329999999999 2024-05-08T18:30:12.570 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.570 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.570 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:12.570 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.271128+0000", 2024-05-08T18:30:12.570 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00255369 2024-05-08T18:30:12.570 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.570 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.570 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:12.570 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.271199+0000", 2024-05-08T18:30:12.570 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1712999999999996e-05 2024-05-08T18:30:12.571 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.571 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.571 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:12.571 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.271254+0000", 2024-05-08T18:30:12.571 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5065999999999998e-05 2024-05-08T18:30:12.571 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:12.571 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:12.571 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:12.571 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.571 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.571 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:12.572 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.486052+0000", 2024-05-08T18:30:12.572 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 44.989446708000003, 2024-05-08T18:30:12.572 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0098898389999999992, 2024-05-08T18:30:12.572 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:12.572 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:12.572 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:12.572 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:12.572 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:12.572 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:12.572 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 72 2024-05-08T18:30:12.572 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.572 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:12.573 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.573 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:12.573 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486052+0000", 2024-05-08T18:30:12.573 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:12.573 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.573 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.573 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:12.573 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486052+0000", 2024-05-08T18:30:12.573 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:12.573 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.573 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.573 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:12.574 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486053+0000", 2024-05-08T18:30:12.574 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1200000000000001e-07 2024-05-08T18:30:12.574 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.574 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.574 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:12.574 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486188+0000", 2024-05-08T18:30:12.574 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013526200000000001 2024-05-08T18:30:12.574 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.574 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.574 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:12.574 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486205+0000", 2024-05-08T18:30:12.575 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6742e-05 2024-05-08T18:30:12.575 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.575 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.575 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:12.575 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486215+0000", 2024-05-08T18:30:12.575 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8290000000000003e-06 2024-05-08T18:30:12.575 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.575 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.575 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:12.575 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.491930+0000", 2024-05-08T18:30:12.575 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0057153660000000004 2024-05-08T18:30:12.575 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.575 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.576 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:12.576 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.491995+0000", 2024-05-08T18:30:12.576 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5289000000000005e-05 2024-05-08T18:30:12.576 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.576 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.576 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:12.576 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.492096+0000", 2024-05-08T18:30:12.576 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010101400000000001 2024-05-08T18:30:12.576 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.576 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.576 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:12.576 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.494152+0000", 2024-05-08T18:30:12.576 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0020560740000000002 2024-05-08T18:30:12.577 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.577 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.577 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:12.577 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.495860+0000", 2024-05-08T18:30:12.577 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0017076159999999999 2024-05-08T18:30:12.577 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.577 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.577 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:12.577 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.495903+0000", 2024-05-08T18:30:12.577 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3009000000000001e-05 2024-05-08T18:30:12.577 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.577 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.578 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:12.578 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.495942+0000", 2024-05-08T18:30:12.578 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8726000000000002e-05 2024-05-08T18:30:12.578 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:12.578 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:12.578 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:12.578 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.578 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.578 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:12.578 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.486234+0000", 2024-05-08T18:30:12.578 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 44.989264640000002, 2024-05-08T18:30:12.578 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0099742340000000002, 2024-05-08T18:30:12.579 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:12.579 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:12.579 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:12.579 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:12.579 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:12.579 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:12.579 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 73 2024-05-08T18:30:12.579 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.579 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:12.579 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.579 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:12.579 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486234+0000", 2024-05-08T18:30:12.579 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:12.580 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.580 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.580 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:12.580 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486234+0000", 2024-05-08T18:30:12.580 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:12.580 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.580 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.580 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:12.580 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486235+0000", 2024-05-08T18:30:12.580 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.108e-06 2024-05-08T18:30:12.580 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.581 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.581 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:12.581 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486241+0000", 2024-05-08T18:30:12.581 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4e-06 2024-05-08T18:30:12.581 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.581 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.581 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:12.581 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486251+0000", 2024-05-08T18:30:12.581 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0209e-05 2024-05-08T18:30:12.581 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.581 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.581 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:12.582 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486260+0000", 2024-05-08T18:30:12.582 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2709999999999998e-06 2024-05-08T18:30:12.582 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.582 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.582 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:12.582 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.493294+0000", 2024-05-08T18:30:12.582 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0070341070000000004 2024-05-08T18:30:12.582 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.582 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.582 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:12.582 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.493370+0000", 2024-05-08T18:30:12.583 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5846999999999994e-05 2024-05-08T18:30:12.583 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.583 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.583 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:12.583 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.493479+0000", 2024-05-08T18:30:12.583 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010905500000000001 2024-05-08T18:30:12.583 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.583 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.583 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:12.583 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.495950+0000", 2024-05-08T18:30:12.583 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0024709749999999998 2024-05-08T18:30:12.583 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.584 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.584 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:12.584 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496023+0000", 2024-05-08T18:30:12.584 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3071999999999994e-05 2024-05-08T18:30:12.584 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.584 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.584 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:12.584 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496091+0000", 2024-05-08T18:30:12.584 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7646999999999998e-05 2024-05-08T18:30:12.584 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.584 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.584 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:12.585 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496208+0000", 2024-05-08T18:30:12.585 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000117543 2024-05-08T18:30:12.585 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:12.585 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:12.585 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:12.585 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.585 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.585 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:12.585 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.486276+0000", 2024-05-08T18:30:12.585 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 44.989222314999999, 2024-05-08T18:30:12.585 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010822577, 2024-05-08T18:30:12.585 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:12.586 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:12.586 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:12.586 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:12.586 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:12.586 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:12.586 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 74 2024-05-08T18:30:12.586 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.586 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:12.586 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.586 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:12.586 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486276+0000", 2024-05-08T18:30:12.587 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:12.587 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.587 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.587 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:12.587 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486276+0000", 2024-05-08T18:30:12.587 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:12.587 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.587 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.587 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:12.587 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486277+0000", 2024-05-08T18:30:12.587 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1699999999999997e-07 2024-05-08T18:30:12.587 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.588 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.588 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:12.588 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486282+0000", 2024-05-08T18:30:12.588 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0429999999999998e-06 2024-05-08T18:30:12.588 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.588 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.588 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:12.588 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486294+0000", 2024-05-08T18:30:12.588 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1717e-05 2024-05-08T18:30:12.588 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.588 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.588 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:12.589 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486303+0000", 2024-05-08T18:30:12.589 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.3999999999999998e-06 2024-05-08T18:30:12.589 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.589 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.589 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:12.589 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.494424+0000", 2024-05-08T18:30:12.589 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0081205960000000008 2024-05-08T18:30:12.589 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.589 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.589 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:12.589 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.494539+0000", 2024-05-08T18:30:12.590 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000115661 2024-05-08T18:30:12.590 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.590 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.590 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:12.590 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.494704+0000", 2024-05-08T18:30:12.590 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016422999999999999 2024-05-08T18:30:12.590 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.590 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.590 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:12.590 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496800+0000", 2024-05-08T18:30:12.590 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002096508 2024-05-08T18:30:12.591 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.591 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.591 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:12.591 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496889+0000", 2024-05-08T18:30:12.591 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8349000000000004e-05 2024-05-08T18:30:12.591 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.591 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.591 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:12.591 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496983+0000", 2024-05-08T18:30:12.591 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4882000000000004e-05 2024-05-08T18:30:12.591 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.591 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.592 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:12.592 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.497099+0000", 2024-05-08T18:30:12.592 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000115474 2024-05-08T18:30:12.592 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:12.592 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:12.592 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:12.592 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.592 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.592 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:12.592 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.486324+0000", 2024-05-08T18:30:12.592 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 44.989174294999998, 2024-05-08T18:30:12.593 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010949207000000001, 2024-05-08T18:30:12.593 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:12.593 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:12.593 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:12.593 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:12.593 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:12.593 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:12.593 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 75 2024-05-08T18:30:12.593 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.593 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:12.593 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.593 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:12.594 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486324+0000", 2024-05-08T18:30:12.594 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:12.594 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.594 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.594 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:12.594 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486324+0000", 2024-05-08T18:30:12.594 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:12.594 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.594 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.594 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:12.594 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486325+0000", 2024-05-08T18:30:12.594 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6200000000000006e-07 2024-05-08T18:30:12.595 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.595 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.595 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:12.595 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486439+0000", 2024-05-08T18:30:12.595 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000113391 2024-05-08T18:30:12.595 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.595 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.595 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:12.595 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486455+0000", 2024-05-08T18:30:12.595 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5823000000000001e-05 2024-05-08T18:30:12.595 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.595 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.596 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:12.596 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486465+0000", 2024-05-08T18:30:12.596 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0879999999999999e-05 2024-05-08T18:30:12.596 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.596 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.596 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:12.596 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.495149+0000", 2024-05-08T18:30:12.596 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0086833589999999999 2024-05-08T18:30:12.596 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.596 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.596 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:12.597 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.495213+0000", 2024-05-08T18:30:12.597 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4176000000000004e-05 2024-05-08T18:30:12.597 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.597 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.597 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:12.597 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.495350+0000", 2024-05-08T18:30:12.597 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013709099999999999 2024-05-08T18:30:12.597 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.597 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.597 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:12.597 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496809+0000", 2024-05-08T18:30:12.597 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001458953 2024-05-08T18:30:12.598 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.598 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.598 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:12.598 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.497199+0000", 2024-05-08T18:30:12.598 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00039045200000000001 2024-05-08T18:30:12.598 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.598 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.598 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:12.598 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.497241+0000", 2024-05-08T18:30:12.598 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1378999999999998e-05 2024-05-08T18:30:12.599 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.599 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.599 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:12.599 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.497274+0000", 2024-05-08T18:30:12.599 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2740999999999997e-05 2024-05-08T18:30:12.599 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:12.599 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:12.599 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:12.599 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.599 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.599 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:12.599 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.486483+0000", 2024-05-08T18:30:12.600 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 44.989016120000002, 2024-05-08T18:30:12.600 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011783448, 2024-05-08T18:30:12.600 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:12.600 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:12.600 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:12.600 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:12.600 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:12.600 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:12.600 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 76 2024-05-08T18:30:12.600 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.600 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:12.600 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.601 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:12.601 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486483+0000", 2024-05-08T18:30:12.601 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:12.601 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.601 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.601 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:12.601 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486483+0000", 2024-05-08T18:30:12.601 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:12.601 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.601 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.601 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:12.602 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486483+0000", 2024-05-08T18:30:12.602 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6599999999999995e-07 2024-05-08T18:30:12.602 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.602 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.602 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:12.602 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486491+0000", 2024-05-08T18:30:12.602 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.2520000000000002e-06 2024-05-08T18:30:12.602 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.602 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.602 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:12.602 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486500+0000", 2024-05-08T18:30:12.602 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4420000000000004e-06 2024-05-08T18:30:12.603 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.603 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.603 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:12.603 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486507+0000", 2024-05-08T18:30:12.603 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3549999999999999e-06 2024-05-08T18:30:12.603 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.603 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.603 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:12.603 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496319+0000", 2024-05-08T18:30:12.603 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0098120529999999994 2024-05-08T18:30:12.603 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.603 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.604 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:12.604 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496391+0000", 2024-05-08T18:30:12.604 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1433000000000005e-05 2024-05-08T18:30:12.604 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.604 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.604 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:12.604 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496508+0000", 2024-05-08T18:30:12.604 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000116778 2024-05-08T18:30:12.604 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.604 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.604 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:12.605 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.497284+0000", 2024-05-08T18:30:12.605 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00077609100000000002 2024-05-08T18:30:12.605 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.605 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.605 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:12.605 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.498204+0000", 2024-05-08T18:30:12.605 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00092027299999999999 2024-05-08T18:30:12.605 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.605 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.605 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:12.605 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.498240+0000", 2024-05-08T18:30:12.605 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5979999999999998e-05 2024-05-08T18:30:12.606 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.606 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.606 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:12.606 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.498266+0000", 2024-05-08T18:30:12.606 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6024999999999999e-05 2024-05-08T18:30:12.606 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:12.606 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:12.606 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:12.606 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.606 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.606 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:94 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:12.606 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.842580+0000", 2024-05-08T18:30:12.607 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 44.632918818999997, 2024-05-08T18:30:12.607 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0085315870000000002, 2024-05-08T18:30:12.607 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:12.607 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:12.607 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:12.607 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:12.607 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:12.607 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:12.607 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 94 2024-05-08T18:30:12.607 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.607 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:12.607 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.608 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:12.608 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.842580+0000", 2024-05-08T18:30:12.608 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:12.608 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.608 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.608 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:12.608 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.842580+0000", 2024-05-08T18:30:12.608 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:12.608 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.608 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.608 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:12.608 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.842581+0000", 2024-05-08T18:30:12.609 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.11e-06 2024-05-08T18:30:12.609 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.609 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.609 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:12.609 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.842587+0000", 2024-05-08T18:30:12.609 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2899999999999999e-06 2024-05-08T18:30:12.609 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.609 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.609 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:12.609 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.842597+0000", 2024-05-08T18:30:12.609 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.007e-05 2024-05-08T18:30:12.609 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.610 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.610 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:12.610 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.842605+0000", 2024-05-08T18:30:12.610 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1270000000000003e-06 2024-05-08T18:30:12.610 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.610 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.610 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:12.610 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.848358+0000", 2024-05-08T18:30:12.610 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0057525140000000002 2024-05-08T18:30:12.610 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.610 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.610 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:12.611 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.848481+0000", 2024-05-08T18:30:12.611 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000123239 2024-05-08T18:30:12.611 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.611 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.611 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:12.611 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.848695+0000", 2024-05-08T18:30:12.611 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000213387 2024-05-08T18:30:12.611 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.611 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.611 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:12.611 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.849781+0000", 2024-05-08T18:30:12.612 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010868 2024-05-08T18:30:12.612 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.612 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.612 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:12.612 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.850990+0000", 2024-05-08T18:30:12.612 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0012084769999999999 2024-05-08T18:30:12.612 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.612 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.612 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:12.612 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.851059+0000", 2024-05-08T18:30:12.612 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9130999999999999e-05 2024-05-08T18:30:12.612 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:12.613 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:12.613 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:12.613 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.851111+0000", 2024-05-08T18:30:12.613 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2441999999999997e-05 2024-05-08T18:30:12.613 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:12.613 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:12.613 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:12.613 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:12.613 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:12.613 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:30:12.615 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-08T18:30:12.616 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:30:12.614+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:30:12.716 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:30:12.716+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:30:12.748 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:30:12.748 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:30:12.748 INFO:teuthology.orchestra.run.smithi097.stdout: "num_ops": 0 2024-05-08T18:30:12.748 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:30:12.762 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-08T18:30:12.782 INFO:teuthology.orchestra.run.smithi097.stderr:noscrub is set 2024-05-08T18:30:12.817 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:30:12.816+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:30:12.889 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:30:12.889 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:30:12.889 INFO:teuthology.orchestra.run.smithi097.stdout: "complaint_time": 30, 2024-05-08T18:30:12.889 INFO:teuthology.orchestra.run.smithi097.stdout: "num_blocked_ops": 0 2024-05-08T18:30:12.889 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:30:12.903 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-08T18:30:12.919 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:30:12.916+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:30:13.019 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:30:13.018+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:30:13.029 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:30:13.030 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2024-05-08T18:30:13.030 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2024-05-08T18:30:13.030 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-05-08T18:30:13.030 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.030 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4206.0:24 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'14, mlcod=16'9)", 2024-05-08T18:30:13.031 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:27.162224+0000", 2024-05-08T18:30:13.031 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 45.868001081000003, 2024-05-08T18:30:13.031 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032712890000000001, 2024-05-08T18:30:13.031 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:13.031 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:13.031 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:13.031 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:13.031 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.032 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:13.032 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162224+0000", 2024-05-08T18:30:13.032 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:13.032 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.032 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.032 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:13.032 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162224+0000", 2024-05-08T18:30:13.032 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:13.032 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.032 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.032 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:13.033 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162225+0000", 2024-05-08T18:30:13.033 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4899999999999999e-06 2024-05-08T18:30:13.033 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.033 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.033 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:13.033 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162306+0000", 2024-05-08T18:30:13.033 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.0589999999999999e-05 2024-05-08T18:30:13.033 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.033 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.033 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:13.033 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162332+0000", 2024-05-08T18:30:13.033 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5658999999999999e-05 2024-05-08T18:30:13.034 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.034 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.034 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:13.034 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162345+0000", 2024-05-08T18:30:13.034 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3512999999999999e-05 2024-05-08T18:30:13.034 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.034 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.034 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:13.034 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162465+0000", 2024-05-08T18:30:13.034 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000119577 2024-05-08T18:30:13.034 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.034 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.034 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:13.035 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162513+0000", 2024-05-08T18:30:13.035 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8773999999999998e-05 2024-05-08T18:30:13.035 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.035 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.035 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:13.035 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.165405+0000", 2024-05-08T18:30:13.035 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028919200000000001 2024-05-08T18:30:13.035 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.035 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.035 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:13.035 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.165495+0000", 2024-05-08T18:30:13.035 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9765999999999994e-05 2024-05-08T18:30:13.036 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:13.036 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:13.036 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:13.036 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.036 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.036 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4206.0:25 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'15, mlcod=16'10)", 2024-05-08T18:30:13.036 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:27.164793+0000", 2024-05-08T18:30:13.036 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 45.865431952999998, 2024-05-08T18:30:13.036 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032285249999999999, 2024-05-08T18:30:13.036 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:13.036 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:13.037 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:13.037 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:13.037 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.037 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:13.037 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164793+0000", 2024-05-08T18:30:13.037 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:13.037 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.037 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.037 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:13.037 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164793+0000", 2024-05-08T18:30:13.037 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:13.037 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.037 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.037 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:13.038 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164795+0000", 2024-05-08T18:30:13.038 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0999999999999998e-06 2024-05-08T18:30:13.038 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.038 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.038 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:13.038 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164811+0000", 2024-05-08T18:30:13.038 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5722999999999998e-05 2024-05-08T18:30:13.038 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.038 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.038 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:13.038 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164841+0000", 2024-05-08T18:30:13.038 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0355999999999999e-05 2024-05-08T18:30:13.038 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.039 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.039 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:13.039 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164861+0000", 2024-05-08T18:30:13.039 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9533000000000001e-05 2024-05-08T18:30:13.039 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.039 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.039 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:13.039 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164984+0000", 2024-05-08T18:30:13.039 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000123146 2024-05-08T18:30:13.039 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.039 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.040 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:13.040 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.165024+0000", 2024-05-08T18:30:13.040 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9690000000000001e-05 2024-05-08T18:30:13.040 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.040 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.040 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:13.040 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.167935+0000", 2024-05-08T18:30:13.040 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0029113300000000002 2024-05-08T18:30:13.040 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.040 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.040 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:13.040 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.168021+0000", 2024-05-08T18:30:13.041 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6646999999999999e-05 2024-05-08T18:30:13.041 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:13.041 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:13.041 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:13.041 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.041 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.041 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:30:13.041 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:48.674737+0000", 2024-05-08T18:30:13.041 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 24.355488035, 2024-05-08T18:30:13.041 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0035019780000000002, 2024-05-08T18:30:13.041 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:13.042 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:13.042 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:13.042 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:13.042 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:13.042 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:13.043 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 60 2024-05-08T18:30:13.043 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.043 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:13.043 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.043 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:13.043 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674737+0000", 2024-05-08T18:30:13.044 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:13.044 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.044 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.044 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:13.044 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674737+0000", 2024-05-08T18:30:13.044 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:13.045 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.045 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.045 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:13.045 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674740+0000", 2024-05-08T18:30:13.045 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.36e-06 2024-05-08T18:30:13.045 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.046 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.046 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:13.046 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674753+0000", 2024-05-08T18:30:13.046 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3151e-05 2024-05-08T18:30:13.046 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.047 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.047 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:13.047 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674789+0000", 2024-05-08T18:30:13.047 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5929000000000001e-05 2024-05-08T18:30:13.047 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.048 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.048 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:13.048 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674813+0000", 2024-05-08T18:30:13.048 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3325000000000001e-05 2024-05-08T18:30:13.048 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.048 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.049 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:13.049 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674981+0000", 2024-05-08T18:30:13.049 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016879899999999999 2024-05-08T18:30:13.049 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.049 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.049 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:13.050 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.675304+0000", 2024-05-08T18:30:13.050 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00032214400000000001 2024-05-08T18:30:13.050 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.050 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.050 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:13.050 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.675639+0000", 2024-05-08T18:30:13.051 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00033494699999999999 2024-05-08T18:30:13.051 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.051 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.051 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:13.051 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.676901+0000", 2024-05-08T18:30:13.051 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001262167 2024-05-08T18:30:13.051 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.052 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.052 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:13.052 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678078+0000", 2024-05-08T18:30:13.052 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001177588 2024-05-08T18:30:13.052 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.052 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.053 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:13.053 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678171+0000", 2024-05-08T18:30:13.053 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.2331999999999996e-05 2024-05-08T18:30:13.053 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.053 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.053 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:13.054 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678239+0000", 2024-05-08T18:30:13.054 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8236000000000002e-05 2024-05-08T18:30:13.054 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:13.054 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:13.054 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:13.054 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.054 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.055 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:61 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94069412632064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:30:13.055 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:48.678410+0000", 2024-05-08T18:30:13.055 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 24.351814643000001, 2024-05-08T18:30:13.055 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0026001800000000001, 2024-05-08T18:30:13.055 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:13.056 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:13.056 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:13.056 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:13.056 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:13.056 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:13.056 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 61 2024-05-08T18:30:13.056 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.057 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:13.057 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.057 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:13.057 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678410+0000", 2024-05-08T18:30:13.057 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:13.057 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.057 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.058 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:13.058 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678410+0000", 2024-05-08T18:30:13.058 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:13.058 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.058 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.058 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:13.058 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678413+0000", 2024-05-08T18:30:13.059 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.34e-06 2024-05-08T18:30:13.059 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.059 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.059 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:13.059 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678421+0000", 2024-05-08T18:30:13.059 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6910000000000003e-06 2024-05-08T18:30:13.059 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.060 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.060 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:13.060 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678447+0000", 2024-05-08T18:30:13.060 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6010999999999999e-05 2024-05-08T18:30:13.060 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.060 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.061 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:13.061 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678461+0000", 2024-05-08T18:30:13.061 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3900000000000001e-05 2024-05-08T18:30:13.061 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.061 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.061 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:13.061 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678560+0000", 2024-05-08T18:30:13.062 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.8834999999999998e-05 2024-05-08T18:30:13.062 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.062 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.062 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:13.062 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678704+0000", 2024-05-08T18:30:13.063 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000143769 2024-05-08T18:30:13.063 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.063 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.063 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:13.063 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678942+0000", 2024-05-08T18:30:13.063 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023861800000000001 2024-05-08T18:30:13.064 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.064 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.064 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:13.064 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.680269+0000", 2024-05-08T18:30:13.064 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001326484 2024-05-08T18:30:13.065 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.065 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.065 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:13.065 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.680823+0000", 2024-05-08T18:30:13.065 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00055455900000000004 2024-05-08T18:30:13.065 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.065 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.066 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:13.066 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.680908+0000", 2024-05-08T18:30:13.066 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.4073999999999995e-05 2024-05-08T18:30:13.066 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.066 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.066 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:13.066 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.681010+0000", 2024-05-08T18:30:13.066 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010289900000000001 2024-05-08T18:30:13.067 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:13.067 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:13.067 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:13.067 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.067 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.067 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:30:13.067 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.671896+0000", 2024-05-08T18:30:13.068 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 21.358328757999999, 2024-05-08T18:30:13.068 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032352349999999999, 2024-05-08T18:30:13.068 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:13.068 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:13.068 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:13.068 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:13.068 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:13.068 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:13.069 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 206 2024-05-08T18:30:13.069 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.069 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:13.069 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.069 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:13.069 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671896+0000", 2024-05-08T18:30:13.070 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:13.070 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.070 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.070 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:13.070 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671896+0000", 2024-05-08T18:30:13.070 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:13.071 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.071 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.071 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:13.071 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671901+0000", 2024-05-08T18:30:13.071 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.763e-06 2024-05-08T18:30:13.071 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.071 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.072 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:13.072 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671920+0000", 2024-05-08T18:30:13.072 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9403e-05 2024-05-08T18:30:13.072 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.072 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.073 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:13.073 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671969+0000", 2024-05-08T18:30:13.073 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8343000000000001e-05 2024-05-08T18:30:13.073 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.073 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.073 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:13.074 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671996+0000", 2024-05-08T18:30:13.074 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7307000000000001e-05 2024-05-08T18:30:13.074 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.074 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.074 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:13.074 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.672149+0000", 2024-05-08T18:30:13.074 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015336500000000001 2024-05-08T18:30:13.074 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.075 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.075 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:13.075 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.672393+0000", 2024-05-08T18:30:13.075 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024380800000000001 2024-05-08T18:30:13.075 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.075 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.075 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:13.075 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.672838+0000", 2024-05-08T18:30:13.075 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00044472700000000001 2024-05-08T18:30:13.075 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.075 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.075 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:13.075 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.674218+0000", 2024-05-08T18:30:13.076 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001380243 2024-05-08T18:30:13.076 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.076 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.076 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:13.076 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.674963+0000", 2024-05-08T18:30:13.076 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00074534999999999998 2024-05-08T18:30:13.076 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.076 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.076 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:13.076 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675057+0000", 2024-05-08T18:30:13.076 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.3633000000000003e-05 2024-05-08T18:30:13.076 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.076 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.076 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:13.077 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675131+0000", 2024-05-08T18:30:13.077 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.4293000000000002e-05 2024-05-08T18:30:13.077 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:13.077 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:13.077 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:13.077 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.077 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.077 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:13.077 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.694194+0000", 2024-05-08T18:30:13.077 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 21.33603136, 2024-05-08T18:30:13.078 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0087385129999999998, 2024-05-08T18:30:13.078 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:13.078 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:13.078 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:13.078 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:13.078 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:13.078 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:13.079 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 210 2024-05-08T18:30:13.079 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.079 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:13.079 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.079 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:13.079 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694194+0000", 2024-05-08T18:30:13.079 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:13.079 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.079 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.079 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:13.079 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694194+0000", 2024-05-08T18:30:13.080 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:13.080 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.080 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.080 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:13.080 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694196+0000", 2024-05-08T18:30:13.080 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6299999999999998e-06 2024-05-08T18:30:13.080 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.081 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.081 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:13.081 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694208+0000", 2024-05-08T18:30:13.081 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.187e-05 2024-05-08T18:30:13.081 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.081 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.081 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:13.081 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694240+0000", 2024-05-08T18:30:13.081 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1673e-05 2024-05-08T18:30:13.081 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.081 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.082 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:13.082 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694255+0000", 2024-05-08T18:30:13.082 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5573000000000002e-05 2024-05-08T18:30:13.082 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.082 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.082 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:13.082 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694394+0000", 2024-05-08T18:30:13.082 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000138536 2024-05-08T18:30:13.082 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.082 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.082 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-05-08T18:30:13.083 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694405+0000", 2024-05-08T18:30:13.083 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0883000000000001e-05 2024-05-08T18:30:13.083 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.083 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.083 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:13.083 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.699491+0000", 2024-05-08T18:30:13.083 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0050861939999999996 2024-05-08T18:30:13.083 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.083 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.083 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:13.083 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.699829+0000", 2024-05-08T18:30:13.083 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000338191 2024-05-08T18:30:13.084 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.084 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.084 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:30:13.084 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.700504+0000", 2024-05-08T18:30:13.084 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000674481 2024-05-08T18:30:13.084 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.084 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.084 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:13.084 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.702152+0000", 2024-05-08T18:30:13.084 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0016487450000000001 2024-05-08T18:30:13.084 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.085 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.085 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:13.085 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.702792+0000", 2024-05-08T18:30:13.085 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00063962800000000005 2024-05-08T18:30:13.085 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.085 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.085 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:13.086 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.702874+0000", 2024-05-08T18:30:13.086 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.2091999999999999e-05 2024-05-08T18:30:13.086 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.086 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.086 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:13.086 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.702932+0000", 2024-05-08T18:30:13.086 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8016999999999997e-05 2024-05-08T18:30:13.086 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:13.087 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:13.088 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:13.088 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.088 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.088 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:13.088 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.728239+0000", 2024-05-08T18:30:13.088 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 21.301985499000001, 2024-05-08T18:30:13.088 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0035376119999999999, 2024-05-08T18:30:13.089 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:13.089 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:13.089 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:13.089 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:13.089 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:13.089 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:13.089 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 218 2024-05-08T18:30:13.089 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.089 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:13.089 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.090 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:13.090 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728239+0000", 2024-05-08T18:30:13.090 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:13.090 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.090 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.090 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:13.090 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728239+0000", 2024-05-08T18:30:13.090 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:13.090 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.090 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.090 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:13.090 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728242+0000", 2024-05-08T18:30:13.090 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0130000000000002e-06 2024-05-08T18:30:13.090 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.091 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.091 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:13.091 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728254+0000", 2024-05-08T18:30:13.091 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.172e-05 2024-05-08T18:30:13.091 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.091 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.091 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:13.091 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728285+0000", 2024-05-08T18:30:13.091 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0703000000000001e-05 2024-05-08T18:30:13.091 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.091 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.091 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:13.091 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728301+0000", 2024-05-08T18:30:13.091 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5656999999999999e-05 2024-05-08T18:30:13.091 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.092 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.092 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:13.092 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728460+0000", 2024-05-08T18:30:13.092 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015934200000000001 2024-05-08T18:30:13.092 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.092 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.092 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:13.092 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728803+0000", 2024-05-08T18:30:13.092 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00034267400000000001 2024-05-08T18:30:13.092 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.092 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.092 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:13.092 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.729485+0000", 2024-05-08T18:30:13.092 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00068206799999999998 2024-05-08T18:30:13.093 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.093 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.093 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:13.093 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731218+0000", 2024-05-08T18:30:13.093 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0017332630000000001 2024-05-08T18:30:13.093 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.093 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.093 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:13.093 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731615+0000", 2024-05-08T18:30:13.093 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00039671699999999999 2024-05-08T18:30:13.093 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.093 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.093 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:13.093 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731709+0000", 2024-05-08T18:30:13.093 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.4740000000000004e-05 2024-05-08T18:30:13.094 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.094 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.094 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:13.094 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731777+0000", 2024-05-08T18:30:13.094 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7714999999999998e-05 2024-05-08T18:30:13.094 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:13.094 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:13.094 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:13.094 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.094 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.094 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:13.094 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.743331+0000", 2024-05-08T18:30:13.094 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 21.286893515999999, 2024-05-08T18:30:13.094 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031193229999999998, 2024-05-08T18:30:13.095 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:13.095 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:13.095 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:13.095 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:13.095 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:13.095 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:13.095 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 222 2024-05-08T18:30:13.095 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.095 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:13.095 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.095 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:13.095 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743331+0000", 2024-05-08T18:30:13.095 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:13.095 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.095 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.096 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:13.096 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743331+0000", 2024-05-08T18:30:13.096 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:13.096 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.096 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.096 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:13.096 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743334+0000", 2024-05-08T18:30:13.096 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2900000000000001e-06 2024-05-08T18:30:13.096 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.096 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.096 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:13.096 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743345+0000", 2024-05-08T18:30:13.096 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0947e-05 2024-05-08T18:30:13.096 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.097 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.097 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:13.097 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743375+0000", 2024-05-08T18:30:13.097 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0298999999999999e-05 2024-05-08T18:30:13.097 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.097 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.097 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:13.097 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743390+0000", 2024-05-08T18:30:13.097 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4606999999999999e-05 2024-05-08T18:30:13.097 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.097 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.097 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:13.097 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743524+0000", 2024-05-08T18:30:13.097 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000134105 2024-05-08T18:30:13.098 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.098 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.098 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:13.098 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743738+0000", 2024-05-08T18:30:13.098 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000214222 2024-05-08T18:30:13.098 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.098 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.098 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:30:13.098 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.744159+0000", 2024-05-08T18:30:13.098 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00042102300000000002 2024-05-08T18:30:13.098 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.098 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.098 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:13.098 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.745399+0000", 2024-05-08T18:30:13.099 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012400309999999999 2024-05-08T18:30:13.099 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.099 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.099 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:13.099 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.746296+0000", 2024-05-08T18:30:13.099 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00089682 2024-05-08T18:30:13.099 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.099 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.099 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:13.099 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.746385+0000", 2024-05-08T18:30:13.099 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9289000000000005e-05 2024-05-08T18:30:13.099 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.099 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.099 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:13.100 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.746451+0000", 2024-05-08T18:30:13.100 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5690000000000003e-05 2024-05-08T18:30:13.100 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:13.100 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:13.100 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:13.100 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.100 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.100 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:13.100 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.772338+0000", 2024-05-08T18:30:13.100 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 21.257887316000001, 2024-05-08T18:30:13.100 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0035084059999999999, 2024-05-08T18:30:13.100 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:13.100 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:13.100 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:13.101 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:13.101 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:13.101 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:13.101 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 230 2024-05-08T18:30:13.101 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.101 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:13.101 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.101 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:13.101 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772338+0000", 2024-05-08T18:30:13.101 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:13.101 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.101 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.101 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:13.101 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772338+0000", 2024-05-08T18:30:13.101 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:13.102 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.102 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.102 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:13.102 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772340+0000", 2024-05-08T18:30:13.102 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3460000000000001e-06 2024-05-08T18:30:13.102 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.102 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.102 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:13.102 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772352+0000", 2024-05-08T18:30:13.102 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2284e-05 2024-05-08T18:30:13.102 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.102 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.102 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:13.102 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772382+0000", 2024-05-08T18:30:13.102 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0083e-05 2024-05-08T18:30:13.103 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.103 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.103 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:13.103 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772397+0000", 2024-05-08T18:30:13.103 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4963000000000001e-05 2024-05-08T18:30:13.103 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.103 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.103 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:13.103 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772508+0000", 2024-05-08T18:30:13.103 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000110402 2024-05-08T18:30:13.103 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.103 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.103 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:13.103 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772742+0000", 2024-05-08T18:30:13.103 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023428899999999999 2024-05-08T18:30:13.104 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.104 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.104 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:30:13.104 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.773183+0000", 2024-05-08T18:30:13.104 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00044107899999999998 2024-05-08T18:30:13.104 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.104 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.104 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:13.104 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.774488+0000", 2024-05-08T18:30:13.104 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0013053940000000001 2024-05-08T18:30:13.104 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.104 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.104 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:13.104 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.775689+0000", 2024-05-08T18:30:13.105 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012004699999999999 2024-05-08T18:30:13.105 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.105 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.105 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:13.105 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.775777+0000", 2024-05-08T18:30:13.105 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8483e-05 2024-05-08T18:30:13.105 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.105 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.105 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:13.105 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.775846+0000", 2024-05-08T18:30:13.105 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8613000000000002e-05 2024-05-08T18:30:13.105 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:13.105 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:13.105 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:13.105 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.106 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.106 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:13.106 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.790921+0000", 2024-05-08T18:30:13.106 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 21.239303970000002, 2024-05-08T18:30:13.106 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003116869, 2024-05-08T18:30:13.106 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:13.106 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:13.106 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:13.106 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:13.106 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:13.106 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:13.106 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 235 2024-05-08T18:30:13.106 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.106 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:13.107 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.107 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:13.107 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790921+0000", 2024-05-08T18:30:13.107 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:13.107 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.107 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.107 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:13.107 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790921+0000", 2024-05-08T18:30:13.107 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:13.107 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.107 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.107 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:13.107 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790923+0000", 2024-05-08T18:30:13.107 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3199999999999998e-06 2024-05-08T18:30:13.108 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.108 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.108 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:13.108 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790934+0000", 2024-05-08T18:30:13.108 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.117e-05 2024-05-08T18:30:13.108 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.108 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.108 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:13.108 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790965+0000", 2024-05-08T18:30:13.108 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0392999999999999e-05 2024-05-08T18:30:13.108 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.109 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.109 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:13.109 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790981+0000", 2024-05-08T18:30:13.109 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5699999999999999e-05 2024-05-08T18:30:13.109 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.109 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.109 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:13.109 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.791093+0000", 2024-05-08T18:30:13.109 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000112062 2024-05-08T18:30:13.109 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.109 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.109 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:13.109 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.791324+0000", 2024-05-08T18:30:13.110 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023142200000000001 2024-05-08T18:30:13.110 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.110 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.110 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:13.110 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.791761+0000", 2024-05-08T18:30:13.110 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00043669999999999999 2024-05-08T18:30:13.110 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.110 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.110 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:13.110 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.792996+0000", 2024-05-08T18:30:13.110 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001235713 2024-05-08T18:30:13.110 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.110 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.111 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:13.111 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.793850+0000", 2024-05-08T18:30:13.111 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00085392400000000005 2024-05-08T18:30:13.111 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.111 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.111 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:13.111 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.793971+0000", 2024-05-08T18:30:13.111 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000120516 2024-05-08T18:30:13.111 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.111 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.111 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:13.111 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794038+0000", 2024-05-08T18:30:13.111 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6948999999999999e-05 2024-05-08T18:30:13.111 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:13.111 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:13.112 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:13.112 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.112 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.112 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:349 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:13.112 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.817315+0000", 2024-05-08T18:30:13.112 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 21.212910098999998, 2024-05-08T18:30:13.112 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0036888580000000002, 2024-05-08T18:30:13.112 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:13.112 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:13.112 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:13.112 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:13.112 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:13.112 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:13.112 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 349 2024-05-08T18:30:13.113 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.113 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:13.113 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.113 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:13.113 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817315+0000", 2024-05-08T18:30:13.113 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:13.113 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.113 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.113 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:13.113 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817315+0000", 2024-05-08T18:30:13.113 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:13.113 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.113 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.113 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:13.113 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817316+0000", 2024-05-08T18:30:13.114 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3370000000000001e-06 2024-05-08T18:30:13.114 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.114 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.114 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:13.114 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817323+0000", 2024-05-08T18:30:13.114 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.4300000000000003e-06 2024-05-08T18:30:13.114 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.114 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.114 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:13.114 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817337+0000", 2024-05-08T18:30:13.114 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4025999999999999e-05 2024-05-08T18:30:13.114 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.114 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.115 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:13.115 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817345+0000", 2024-05-08T18:30:13.115 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5669999999999995e-06 2024-05-08T18:30:13.115 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.115 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.115 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:13.115 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817407+0000", 2024-05-08T18:30:13.115 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1882000000000001e-05 2024-05-08T18:30:13.115 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.115 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.115 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:13.115 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817508+0000", 2024-05-08T18:30:13.115 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000100585 2024-05-08T18:30:13.115 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.115 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.116 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:13.116 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817673+0000", 2024-05-08T18:30:13.116 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000165802 2024-05-08T18:30:13.116 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.116 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.116 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:13.116 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.818715+0000", 2024-05-08T18:30:13.116 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0010417720000000001 2024-05-08T18:30:13.116 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.116 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.116 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:13.116 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.820892+0000", 2024-05-08T18:30:13.116 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0021771859999999998 2024-05-08T18:30:13.116 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.116 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.117 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:13.117 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.820950+0000", 2024-05-08T18:30:13.117 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7636000000000002e-05 2024-05-08T18:30:13.117 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.117 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.117 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:13.117 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.821004+0000", 2024-05-08T18:30:13.117 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3634999999999997e-05 2024-05-08T18:30:13.117 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:13.117 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:13.117 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:13.117 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.117 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.117 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:406 6.16 6:6dc3b799:reshard::reshard.0000000006:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:13.118 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.840465+0000", 2024-05-08T18:30:13.118 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 21.189759933000001, 2024-05-08T18:30:13.118 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003613032, 2024-05-08T18:30:13.118 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:13.118 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:13.118 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:13.118 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:13.118 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:13.118 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:13.118 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 406 2024-05-08T18:30:13.118 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.118 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:13.118 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.118 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:13.118 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840465+0000", 2024-05-08T18:30:13.119 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:13.119 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.119 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.119 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:13.119 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840465+0000", 2024-05-08T18:30:13.119 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:13.119 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.119 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.119 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:13.119 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840466+0000", 2024-05-08T18:30:13.119 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7499999999999999e-07 2024-05-08T18:30:13.119 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.119 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.120 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:13.120 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840471+0000", 2024-05-08T18:30:13.120 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9699999999999998e-06 2024-05-08T18:30:13.120 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.120 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.120 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:13.120 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840484+0000", 2024-05-08T18:30:13.120 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2717999999999999e-05 2024-05-08T18:30:13.120 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.120 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.120 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:13.120 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840490+0000", 2024-05-08T18:30:13.120 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.472e-06 2024-05-08T18:30:13.120 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.120 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.121 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:13.121 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840536+0000", 2024-05-08T18:30:13.121 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6409000000000002e-05 2024-05-08T18:30:13.121 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.121 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.121 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:13.121 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840591+0000", 2024-05-08T18:30:13.121 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4911000000000003e-05 2024-05-08T18:30:13.121 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.121 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.121 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:30:13.121 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840745+0000", 2024-05-08T18:30:13.121 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015394900000000001 2024-05-08T18:30:13.121 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.121 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.122 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:13.122 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.841269+0000", 2024-05-08T18:30:13.122 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00052347299999999999 2024-05-08T18:30:13.122 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.122 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.122 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:13.122 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.843997+0000", 2024-05-08T18:30:13.122 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0027285080000000001 2024-05-08T18:30:13.126 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.126 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.126 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:13.126 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844033+0000", 2024-05-08T18:30:13.126 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6038000000000003e-05 2024-05-08T18:30:13.126 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.126 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.126 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:13.126 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844078+0000", 2024-05-08T18:30:13.126 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4709000000000002e-05 2024-05-08T18:30:13.127 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:13.127 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:13.127 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:13.127 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.127 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.127 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:413 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:13.127 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.844187+0000", 2024-05-08T18:30:13.127 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 21.186038356000001, 2024-05-08T18:30:13.127 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0024835069999999998, 2024-05-08T18:30:13.127 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:13.127 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:13.127 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:13.127 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:13.127 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:13.128 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:13.128 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 413 2024-05-08T18:30:13.128 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.128 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:13.128 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.128 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:13.128 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844187+0000", 2024-05-08T18:30:13.128 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:13.128 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.128 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.128 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:13.128 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844187+0000", 2024-05-08T18:30:13.128 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:13.128 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.129 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.129 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:13.129 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844187+0000", 2024-05-08T18:30:13.129 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9999999999999996e-07 2024-05-08T18:30:13.129 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.129 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.129 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:13.129 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844192+0000", 2024-05-08T18:30:13.129 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7899999999999999e-06 2024-05-08T18:30:13.129 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.129 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.129 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:13.129 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844203+0000", 2024-05-08T18:30:13.130 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1002000000000001e-05 2024-05-08T18:30:13.130 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.130 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.130 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:13.130 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844209+0000", 2024-05-08T18:30:13.130 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6570000000000002e-06 2024-05-08T18:30:13.130 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.130 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.130 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:13.130 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844270+0000", 2024-05-08T18:30:13.130 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0810999999999998e-05 2024-05-08T18:30:13.130 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.130 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.130 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:13.131 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844419+0000", 2024-05-08T18:30:13.131 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000149097 2024-05-08T18:30:13.131 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.131 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.131 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:30:13.131 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844611+0000", 2024-05-08T18:30:13.131 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00019247900000000001 2024-05-08T18:30:13.131 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.131 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.131 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:13.131 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.845287+0000", 2024-05-08T18:30:13.131 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00067526000000000001 2024-05-08T18:30:13.131 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.131 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.132 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:13.132 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.846609+0000", 2024-05-08T18:30:13.132 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001322124 2024-05-08T18:30:13.132 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.132 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.132 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:13.132 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.846642+0000", 2024-05-08T18:30:13.132 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3654e-05 2024-05-08T18:30:13.132 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.132 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.132 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:13.132 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.846670+0000", 2024-05-08T18:30:13.132 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7733e-05 2024-05-08T18:30:13.132 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:13.133 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:13.133 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:13.133 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.133 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.133 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:420 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:13.133 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.847096+0000", 2024-05-08T18:30:13.133 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 21.183129061999999, 2024-05-08T18:30:13.133 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0026261589999999999, 2024-05-08T18:30:13.133 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:13.133 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:13.133 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:13.133 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:13.133 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:13.133 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:13.134 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 420 2024-05-08T18:30:13.134 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.134 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:13.134 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.134 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:13.134 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847096+0000", 2024-05-08T18:30:13.134 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:13.134 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.134 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.134 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:13.134 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847096+0000", 2024-05-08T18:30:13.134 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:13.134 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.134 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.135 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:13.135 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847097+0000", 2024-05-08T18:30:13.135 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.5499999999999996e-07 2024-05-08T18:30:13.135 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.135 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.135 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:13.135 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847103+0000", 2024-05-08T18:30:13.135 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8969999999999996e-06 2024-05-08T18:30:13.135 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.135 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.135 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:13.135 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847114+0000", 2024-05-08T18:30:13.135 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1549000000000001e-05 2024-05-08T18:30:13.135 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.136 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.136 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:13.136 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847120+0000", 2024-05-08T18:30:13.136 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5509999999999999e-06 2024-05-08T18:30:13.136 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.136 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.136 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:13.136 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847166+0000", 2024-05-08T18:30:13.136 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6683e-05 2024-05-08T18:30:13.136 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.136 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.136 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:13.136 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847213+0000", 2024-05-08T18:30:13.136 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6659000000000002e-05 2024-05-08T18:30:13.137 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.137 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.137 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:30:13.137 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847315+0000", 2024-05-08T18:30:13.137 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000102336 2024-05-08T18:30:13.137 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.137 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.137 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:13.137 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847840+0000", 2024-05-08T18:30:13.137 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00052475000000000004 2024-05-08T18:30:13.137 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.137 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.137 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:13.137 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.849660+0000", 2024-05-08T18:30:13.137 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001819563 2024-05-08T18:30:13.138 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.138 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.138 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:13.138 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.849695+0000", 2024-05-08T18:30:13.138 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4761000000000001e-05 2024-05-08T18:30:13.138 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.138 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.138 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:13.138 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.849722+0000", 2024-05-08T18:30:13.138 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7455000000000001e-05 2024-05-08T18:30:13.138 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:13.138 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:13.138 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:13.138 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.139 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.139 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:532 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:13.139 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.908603+0000", 2024-05-08T18:30:13.139 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 21.121621512000001, 2024-05-08T18:30:13.139 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0038838950000000001, 2024-05-08T18:30:13.139 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:13.139 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:13.139 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:13.139 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:13.139 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:13.139 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:13.139 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 532 2024-05-08T18:30:13.139 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.139 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:13.139 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.140 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:13.140 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908603+0000", 2024-05-08T18:30:13.140 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:13.140 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.140 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.140 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:13.140 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908603+0000", 2024-05-08T18:30:13.140 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:13.140 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.140 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.140 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:13.140 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908605+0000", 2024-05-08T18:30:13.140 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1179999999999999e-06 2024-05-08T18:30:13.140 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.141 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.141 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:13.141 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908608+0000", 2024-05-08T18:30:13.141 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7419999999999999e-06 2024-05-08T18:30:13.141 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.141 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.141 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:13.141 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908618+0000", 2024-05-08T18:30:13.141 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.6889999999999999e-06 2024-05-08T18:30:13.141 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.141 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.141 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:13.141 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908625+0000", 2024-05-08T18:30:13.141 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1300000000000003e-06 2024-05-08T18:30:13.141 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.142 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.142 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:13.142 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908669+0000", 2024-05-08T18:30:13.142 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3832000000000003e-05 2024-05-08T18:30:13.142 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.142 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.142 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:13.142 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908724+0000", 2024-05-08T18:30:13.142 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5222000000000001e-05 2024-05-08T18:30:13.142 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.142 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.142 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:30:13.142 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908854+0000", 2024-05-08T18:30:13.142 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012953500000000001 2024-05-08T18:30:13.143 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.143 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.143 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:13.143 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.909511+0000", 2024-05-08T18:30:13.143 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00065768399999999996 2024-05-08T18:30:13.143 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.143 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.143 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:13.143 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912426+0000", 2024-05-08T18:30:13.143 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0029146599999999999 2024-05-08T18:30:13.143 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.143 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.143 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:13.144 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912461+0000", 2024-05-08T18:30:13.144 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4934999999999997e-05 2024-05-08T18:30:13.144 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.144 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.144 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:13.144 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912487+0000", 2024-05-08T18:30:13.144 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6347999999999999e-05 2024-05-08T18:30:13.144 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:13.144 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:13.144 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:13.144 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.144 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.144 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:534 6.9 6:9268b73e:::obj_delete_at_hint.0000000019:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:13.144 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.910153+0000", 2024-05-08T18:30:13.145 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 21.120072055000001, 2024-05-08T18:30:13.145 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0051089680000000002, 2024-05-08T18:30:13.145 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:13.145 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:13.145 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:13.145 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:13.145 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:13.145 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:13.145 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 534 2024-05-08T18:30:13.145 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.145 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:13.145 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.145 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:13.146 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910153+0000", 2024-05-08T18:30:13.146 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:13.146 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.146 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.146 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:13.146 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910153+0000", 2024-05-08T18:30:13.146 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:13.146 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.146 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.146 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:13.146 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910154+0000", 2024-05-08T18:30:13.146 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1039999999999999e-06 2024-05-08T18:30:13.146 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.147 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.147 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:13.147 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910158+0000", 2024-05-08T18:30:13.147 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7400000000000002e-06 2024-05-08T18:30:13.147 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.147 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.147 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:13.147 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910167+0000", 2024-05-08T18:30:13.147 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8880000000000003e-06 2024-05-08T18:30:13.147 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.147 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.147 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:13.148 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910173+0000", 2024-05-08T18:30:13.148 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.844e-06 2024-05-08T18:30:13.148 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.148 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.148 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:13.148 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910220+0000", 2024-05-08T18:30:13.148 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6582000000000002e-05 2024-05-08T18:30:13.148 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.148 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.148 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:13.148 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910287+0000", 2024-05-08T18:30:13.148 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7271e-05 2024-05-08T18:30:13.148 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.149 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.149 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:30:13.149 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910402+0000", 2024-05-08T18:30:13.149 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115127 2024-05-08T18:30:13.149 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.149 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.149 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:13.149 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910881+0000", 2024-05-08T18:30:13.149 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000479025 2024-05-08T18:30:13.149 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.149 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.149 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:13.149 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.915206+0000", 2024-05-08T18:30:13.149 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.004324357 2024-05-08T18:30:13.149 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.150 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.150 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:13.150 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.915237+0000", 2024-05-08T18:30:13.150 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1590000000000001e-05 2024-05-08T18:30:13.150 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.150 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.150 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:13.150 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.915262+0000", 2024-05-08T18:30:13.150 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.444e-05 2024-05-08T18:30:13.150 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:13.150 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:13.150 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:13.150 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.151 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.151 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:583 6.0 6:03bbb29a:::obj_delete_at_hint.0000000026:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:13.151 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.947199+0000", 2024-05-08T18:30:13.151 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 21.083025857999999, 2024-05-08T18:30:13.151 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0025081510000000001, 2024-05-08T18:30:13.151 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:13.151 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:13.151 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:13.151 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:13.151 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:13.151 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:13.151 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 583 2024-05-08T18:30:13.151 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.151 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:13.151 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.152 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:13.152 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947199+0000", 2024-05-08T18:30:13.152 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:13.152 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.152 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.152 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:13.152 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947199+0000", 2024-05-08T18:30:13.152 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:13.152 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.152 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.152 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:13.152 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947200+0000", 2024-05-08T18:30:13.152 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3799999999999997e-07 2024-05-08T18:30:13.153 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.153 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.153 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:13.153 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947207+0000", 2024-05-08T18:30:13.153 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2030000000000003e-06 2024-05-08T18:30:13.153 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.153 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.153 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:13.153 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947217+0000", 2024-05-08T18:30:13.153 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0138e-05 2024-05-08T18:30:13.153 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.153 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.153 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:13.153 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947224+0000", 2024-05-08T18:30:13.153 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5289999999999997e-06 2024-05-08T18:30:13.154 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.154 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.154 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:13.154 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.948039+0000", 2024-05-08T18:30:13.154 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00081500599999999996 2024-05-08T18:30:13.154 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.154 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.154 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:13.154 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.948230+0000", 2024-05-08T18:30:13.154 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000191838 2024-05-08T18:30:13.154 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.154 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.154 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:13.155 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.948606+0000", 2024-05-08T18:30:13.155 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00037547900000000001 2024-05-08T18:30:13.155 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.155 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.155 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:13.155 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.949406+0000", 2024-05-08T18:30:13.155 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000799674 2024-05-08T18:30:13.155 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.155 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.155 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:13.155 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.949630+0000", 2024-05-08T18:30:13.155 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00022474699999999999 2024-05-08T18:30:13.155 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.156 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.156 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:13.156 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.949664+0000", 2024-05-08T18:30:13.156 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3535999999999999e-05 2024-05-08T18:30:13.156 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.156 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.156 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:13.156 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.949707+0000", 2024-05-08T18:30:13.156 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3362999999999998e-05 2024-05-08T18:30:13.156 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:13.156 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:13.156 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:13.156 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.156 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.157 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:686 6.10 6:0d0f4ce5:::obj_delete_at_hint.0000000040:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:13.157 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.012623+0000", 2024-05-08T18:30:13.157 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 21.017601669000001, 2024-05-08T18:30:13.157 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0024696330000000002, 2024-05-08T18:30:13.157 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:13.157 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:13.157 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:13.157 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:13.157 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:13.157 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:13.157 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 686 2024-05-08T18:30:13.157 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.157 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:13.157 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.158 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:13.158 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.012623+0000", 2024-05-08T18:30:13.158 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:13.158 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.158 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.158 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:13.158 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.012623+0000", 2024-05-08T18:30:13.158 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:13.158 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.158 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.158 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:13.158 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.012624+0000", 2024-05-08T18:30:13.158 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1480000000000001e-06 2024-05-08T18:30:13.159 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.159 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.159 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:13.159 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.012631+0000", 2024-05-08T18:30:13.159 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1700000000000002e-06 2024-05-08T18:30:13.159 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.159 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.159 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:13.159 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.012647+0000", 2024-05-08T18:30:13.159 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6133999999999998e-05 2024-05-08T18:30:13.159 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.159 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.159 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:13.159 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.012655+0000", 2024-05-08T18:30:13.160 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7199999999999995e-06 2024-05-08T18:30:13.160 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.160 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.160 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:13.160 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.012715+0000", 2024-05-08T18:30:13.160 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9475999999999998e-05 2024-05-08T18:30:13.160 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.160 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.160 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:13.160 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.012805+0000", 2024-05-08T18:30:13.160 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9840999999999996e-05 2024-05-08T18:30:13.160 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.160 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.160 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:13.161 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.012930+0000", 2024-05-08T18:30:13.161 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012537099999999999 2024-05-08T18:30:13.161 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.161 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.161 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:13.161 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.013584+0000", 2024-05-08T18:30:13.161 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00065356500000000005 2024-05-08T18:30:13.161 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.161 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.161 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:13.161 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.014956+0000", 2024-05-08T18:30:13.161 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001372535 2024-05-08T18:30:13.161 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.162 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.162 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:13.162 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.015017+0000", 2024-05-08T18:30:13.162 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0590000000000001e-05 2024-05-08T18:30:13.162 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.162 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.162 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:13.162 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.015093+0000", 2024-05-08T18:30:13.162 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6082999999999996e-05 2024-05-08T18:30:13.162 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:13.162 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:13.162 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:13.162 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.163 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.163 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:13.163 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.263796+0000", 2024-05-08T18:30:13.163 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 20.76642859, 2024-05-08T18:30:13.163 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0027788019999999999, 2024-05-08T18:30:13.163 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:13.163 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:13.163 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:13.163 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:13.163 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:13.163 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:13.163 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 811 2024-05-08T18:30:13.163 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.163 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:13.163 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.164 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:13.164 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263796+0000", 2024-05-08T18:30:13.164 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:13.164 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.164 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.164 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:13.164 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263796+0000", 2024-05-08T18:30:13.164 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:13.164 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.164 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.164 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:13.164 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263799+0000", 2024-05-08T18:30:13.164 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5569999999999998e-06 2024-05-08T18:30:13.164 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.165 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.165 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:13.165 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263812+0000", 2024-05-08T18:30:13.165 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3145999999999999e-05 2024-05-08T18:30:13.165 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.165 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.165 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:13.165 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263842+0000", 2024-05-08T18:30:13.165 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0193e-05 2024-05-08T18:30:13.165 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.165 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.165 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:13.165 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263860+0000", 2024-05-08T18:30:13.165 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7880000000000002e-05 2024-05-08T18:30:13.165 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.166 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.166 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:13.166 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263979+0000", 2024-05-08T18:30:13.166 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011919899999999999 2024-05-08T18:30:13.166 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.166 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.166 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:13.166 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.264222+0000", 2024-05-08T18:30:13.166 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024290800000000001 2024-05-08T18:30:13.166 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.167 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.167 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:13.167 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.264545+0000", 2024-05-08T18:30:13.167 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00032300200000000002 2024-05-08T18:30:13.167 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.167 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.167 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:13.167 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.265682+0000", 2024-05-08T18:30:13.167 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001136464 2024-05-08T18:30:13.167 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.167 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.167 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:13.167 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.266397+0000", 2024-05-08T18:30:13.167 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00071512799999999999 2024-05-08T18:30:13.168 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.168 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.168 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:13.168 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.266504+0000", 2024-05-08T18:30:13.168 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000107019 2024-05-08T18:30:13.168 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.168 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.168 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:13.168 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.266575+0000", 2024-05-08T18:30:13.168 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1305999999999998e-05 2024-05-08T18:30:13.168 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:13.169 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:13.169 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:13.169 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.169 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.169 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:13.169 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.445706+0000", 2024-05-08T18:30:13.169 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 20.584518874, 2024-05-08T18:30:13.169 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0026820630000000002, 2024-05-08T18:30:13.169 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:13.169 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:13.169 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:13.169 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:13.169 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:13.169 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:13.170 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 889 2024-05-08T18:30:13.170 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.170 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:13.170 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.170 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:13.170 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445706+0000", 2024-05-08T18:30:13.170 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:13.170 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.170 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.170 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:13.170 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445706+0000", 2024-05-08T18:30:13.170 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:13.170 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.170 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.171 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:13.171 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445709+0000", 2024-05-08T18:30:13.171 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0299999999999998e-06 2024-05-08T18:30:13.171 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.171 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.171 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:13.171 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445721+0000", 2024-05-08T18:30:13.171 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2366e-05 2024-05-08T18:30:13.171 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.171 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.171 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:13.171 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445752+0000", 2024-05-08T18:30:13.171 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0287e-05 2024-05-08T18:30:13.171 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.171 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.172 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:13.172 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445773+0000", 2024-05-08T18:30:13.172 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1367000000000001e-05 2024-05-08T18:30:13.172 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.172 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.172 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:13.172 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445892+0000", 2024-05-08T18:30:13.172 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000119311 2024-05-08T18:30:13.172 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.172 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.172 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:13.172 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.446158+0000", 2024-05-08T18:30:13.172 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000265441 2024-05-08T18:30:13.172 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.173 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.173 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:13.173 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.446465+0000", 2024-05-08T18:30:13.173 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00030754300000000002 2024-05-08T18:30:13.173 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.173 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.173 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:13.173 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.447511+0000", 2024-05-08T18:30:13.173 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001045975 2024-05-08T18:30:13.173 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.173 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.173 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:13.173 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.448171+0000", 2024-05-08T18:30:13.173 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00065971200000000002 2024-05-08T18:30:13.173 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.174 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.174 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:13.174 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.448273+0000", 2024-05-08T18:30:13.174 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000101592 2024-05-08T18:30:13.174 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.174 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.174 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:13.174 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.448388+0000", 2024-05-08T18:30:13.174 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115439 2024-05-08T18:30:13.174 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:13.174 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:13.174 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:13.174 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:13.174 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:13.175 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:30:13.176 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-08T18:30:13.177 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:30:13.178+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:30:13.277 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:30:13.278+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:30:13.349 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:30:13.349 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:30:13.350 INFO:teuthology.orchestra.run.smithi097.stdout: "num_ops": 0 2024-05-08T18:30:13.350 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:30:13.363 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-08T18:30:13.378 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:30:13.380+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:30:13.479 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:30:13.478+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:30:13.524 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:30:13.525 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:30:13.525 INFO:teuthology.orchestra.run.smithi097.stdout: "complaint_time": 30, 2024-05-08T18:30:13.525 INFO:teuthology.orchestra.run.smithi097.stdout: "num_blocked_ops": 0 2024-05-08T18:30:13.525 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:30:13.539 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-08T18:30:13.580 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:30:13.580+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:30:13.681 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:30:13.680+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:30:13.709 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:30:13.709 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2024-05-08T18:30:13.709 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2024-05-08T18:30:13.709 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-05-08T18:30:13.709 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.709 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4479.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-05-08T18:30:13.709 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:44.576320+0000", 2024-05-08T18:30:13.710 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 29.132559476000001, 2024-05-08T18:30:13.710 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019751892, 2024-05-08T18:30:13.710 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:13.710 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:13.710 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "reached pg", 2024-05-08T18:30:13.710 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:13.710 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4479", 2024-05-08T18:30:13.710 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3577501689", 2024-05-08T18:30:13.710 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 2 2024-05-08T18:30:13.710 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.710 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:13.710 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.710 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:13.710 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576320+0000", 2024-05-08T18:30:13.711 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:13.711 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.711 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.711 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:13.711 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576320+0000", 2024-05-08T18:30:13.711 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:13.711 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.711 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.711 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:13.711 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576323+0000", 2024-05-08T18:30:13.711 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.813e-06 2024-05-08T18:30:13.711 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.712 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.712 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:13.712 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576335+0000", 2024-05-08T18:30:13.712 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2330000000000001e-05 2024-05-08T18:30:13.712 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.712 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.712 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:13.712 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576367+0000", 2024-05-08T18:30:13.712 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2036999999999998e-05 2024-05-08T18:30:13.712 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.712 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.712 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:13.712 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576394+0000", 2024-05-08T18:30:13.713 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6529e-05 2024-05-08T18:30:13.713 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.713 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.713 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:13.713 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576550+0000", 2024-05-08T18:30:13.713 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000156718 2024-05-08T18:30:13.713 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.713 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.713 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-05-08T18:30:13.713 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576560+0000", 2024-05-08T18:30:13.713 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0040999999999999e-05 2024-05-08T18:30:13.713 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.713 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.714 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:13.714 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.587240+0000", 2024-05-08T18:30:13.714 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010679266999999999 2024-05-08T18:30:13.714 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.714 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.714 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2024-05-08T18:30:13.714 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.587266+0000", 2024-05-08T18:30:13.714 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6642e-05 2024-05-08T18:30:13.714 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.714 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.714 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:13.714 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.595882+0000", 2024-05-08T18:30:13.715 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0086159600000000006 2024-05-08T18:30:13.715 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.715 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.715 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:13.715 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.596072+0000", 2024-05-08T18:30:13.715 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000189555 2024-05-08T18:30:13.715 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:13.715 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:13.715 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:13.715 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.715 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.715 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:30:13.716 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:48.766182+0000", 2024-05-08T18:30:13.716 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 24.942697449000001, 2024-05-08T18:30:13.716 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031881209999999999, 2024-05-08T18:30:13.716 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:13.716 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:13.716 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:13.716 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:13.716 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:13.716 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:13.716 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 193 2024-05-08T18:30:13.716 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.716 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:13.717 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.717 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:13.717 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766182+0000", 2024-05-08T18:30:13.717 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:13.717 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.717 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.717 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:13.717 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766182+0000", 2024-05-08T18:30:13.717 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:13.717 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.717 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.717 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:13.717 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766184+0000", 2024-05-08T18:30:13.718 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4159999999999998e-06 2024-05-08T18:30:13.718 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.718 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.718 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:13.718 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766196+0000", 2024-05-08T18:30:13.718 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1814000000000001e-05 2024-05-08T18:30:13.718 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.718 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.718 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:13.718 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766227+0000", 2024-05-08T18:30:13.718 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0676000000000002e-05 2024-05-08T18:30:13.718 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.719 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.719 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:13.719 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766242+0000", 2024-05-08T18:30:13.719 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5497000000000001e-05 2024-05-08T18:30:13.719 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.719 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.719 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:13.719 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766354+0000", 2024-05-08T18:30:13.719 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000111579 2024-05-08T18:30:13.719 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.719 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.719 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:13.720 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766569+0000", 2024-05-08T18:30:13.720 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000214978 2024-05-08T18:30:13.720 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.720 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.720 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:13.720 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766834+0000", 2024-05-08T18:30:13.720 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00026551500000000002 2024-05-08T18:30:13.720 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.720 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.720 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:13.720 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.768577+0000", 2024-05-08T18:30:13.720 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001742513 2024-05-08T18:30:13.721 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.721 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.721 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:13.721 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.769150+0000", 2024-05-08T18:30:13.721 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00057320500000000003 2024-05-08T18:30:13.721 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.721 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.721 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:13.721 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.769250+0000", 2024-05-08T18:30:13.721 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.9846000000000006e-05 2024-05-08T18:30:13.721 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.721 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.722 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:13.722 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.769370+0000", 2024-05-08T18:30:13.722 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012008200000000001 2024-05-08T18:30:13.722 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:13.722 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:13.722 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:13.722 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.722 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.722 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:13.722 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.679562+0000", 2024-05-08T18:30:13.722 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 22.029317745, 2024-05-08T18:30:13.722 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0086320800000000003, 2024-05-08T18:30:13.723 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:13.723 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:13.723 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:13.723 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:13.723 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:13.723 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:13.723 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 208 2024-05-08T18:30:13.723 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.723 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:13.723 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.723 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:13.723 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679562+0000", 2024-05-08T18:30:13.724 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:13.724 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.724 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.724 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:13.724 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679562+0000", 2024-05-08T18:30:13.724 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:13.724 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.724 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.724 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:13.724 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679565+0000", 2024-05-08T18:30:13.724 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0800000000000002e-06 2024-05-08T18:30:13.724 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.724 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.725 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:13.725 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679578+0000", 2024-05-08T18:30:13.725 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3217000000000001e-05 2024-05-08T18:30:13.725 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.725 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.725 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:13.725 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679610+0000", 2024-05-08T18:30:13.725 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1696000000000003e-05 2024-05-08T18:30:13.725 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.725 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.725 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:13.725 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679625+0000", 2024-05-08T18:30:13.726 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5824e-05 2024-05-08T18:30:13.726 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.726 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.726 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:13.726 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679758+0000", 2024-05-08T18:30:13.726 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013231199999999999 2024-05-08T18:30:13.726 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.726 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.726 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-05-08T18:30:13.726 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679770+0000", 2024-05-08T18:30:13.726 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1800000000000001e-05 2024-05-08T18:30:13.726 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.727 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.727 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:13.727 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.685241+0000", 2024-05-08T18:30:13.728 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0054710169999999999 2024-05-08T18:30:13.728 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.728 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.728 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:13.728 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.685444+0000", 2024-05-08T18:30:13.728 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000203835 2024-05-08T18:30:13.728 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.728 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.728 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:13.728 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.685842+0000", 2024-05-08T18:30:13.728 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00039773 2024-05-08T18:30:13.729 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.729 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.729 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:13.729 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.687232+0000", 2024-05-08T18:30:13.729 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00139011 2024-05-08T18:30:13.729 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.729 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.729 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:13.729 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.688049+0000", 2024-05-08T18:30:13.729 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00081667000000000003 2024-05-08T18:30:13.730 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.730 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.730 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:13.730 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.688135+0000", 2024-05-08T18:30:13.730 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6299999999999997e-05 2024-05-08T18:30:13.730 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.730 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.730 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:13.730 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.688194+0000", 2024-05-08T18:30:13.730 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8489000000000002e-05 2024-05-08T18:30:13.734 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:13.734 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:13.734 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:13.734 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.734 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.735 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:13.735 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.707114+0000", 2024-05-08T18:30:13.735 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 22.001765730999999, 2024-05-08T18:30:13.735 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031802990000000001, 2024-05-08T18:30:13.735 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:13.735 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:13.735 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:13.735 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:13.735 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:13.735 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:13.735 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 212 2024-05-08T18:30:13.735 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.735 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:13.735 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.736 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:13.736 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707114+0000", 2024-05-08T18:30:13.736 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:13.736 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.736 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.736 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:13.736 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707114+0000", 2024-05-08T18:30:13.736 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:13.736 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.736 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.736 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:13.736 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707117+0000", 2024-05-08T18:30:13.736 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8629999999999999e-06 2024-05-08T18:30:13.736 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.737 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.737 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:13.737 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707129+0000", 2024-05-08T18:30:13.737 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2150000000000001e-05 2024-05-08T18:30:13.737 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.737 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.737 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:13.737 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707158+0000", 2024-05-08T18:30:13.737 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9513999999999999e-05 2024-05-08T18:30:13.737 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.737 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.737 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:13.737 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707173+0000", 2024-05-08T18:30:13.737 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5136e-05 2024-05-08T18:30:13.738 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.738 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.738 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:13.738 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707309+0000", 2024-05-08T18:30:13.738 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000135609 2024-05-08T18:30:13.738 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.738 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.738 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:13.738 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707523+0000", 2024-05-08T18:30:13.738 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021362200000000001 2024-05-08T18:30:13.738 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.738 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.738 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:13.738 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707918+0000", 2024-05-08T18:30:13.739 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00039556299999999998 2024-05-08T18:30:13.739 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.739 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.739 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:13.739 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.709166+0000", 2024-05-08T18:30:13.739 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012476410000000001 2024-05-08T18:30:13.739 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.739 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.739 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:13.739 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.710145+0000", 2024-05-08T18:30:13.739 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00097909899999999998 2024-05-08T18:30:13.739 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.739 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.740 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:13.740 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.710231+0000", 2024-05-08T18:30:13.740 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5625999999999996e-05 2024-05-08T18:30:13.740 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.740 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.740 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:13.740 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.710294+0000", 2024-05-08T18:30:13.740 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3476e-05 2024-05-08T18:30:13.740 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:13.740 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:13.740 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:13.740 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.740 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.740 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:13.741 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.731985+0000", 2024-05-08T18:30:13.741 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 21.976894506000001, 2024-05-08T18:30:13.741 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0039250600000000002, 2024-05-08T18:30:13.741 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:13.741 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:13.741 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:13.741 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:13.741 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:13.741 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:13.742 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 219 2024-05-08T18:30:13.742 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.742 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:13.742 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.742 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:13.742 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731985+0000", 2024-05-08T18:30:13.742 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:13.742 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.742 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.742 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:13.742 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731985+0000", 2024-05-08T18:30:13.742 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:13.742 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.743 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.743 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:13.743 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731988+0000", 2024-05-08T18:30:13.743 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6599999999999999e-06 2024-05-08T18:30:13.743 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.743 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.743 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:13.743 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.732017+0000", 2024-05-08T18:30:13.743 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9692999999999998e-05 2024-05-08T18:30:13.743 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.743 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.743 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:13.743 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.732048+0000", 2024-05-08T18:30:13.743 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1066999999999999e-05 2024-05-08T18:30:13.743 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.744 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.744 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:13.744 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.732064+0000", 2024-05-08T18:30:13.744 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5786000000000001e-05 2024-05-08T18:30:13.744 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.744 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.744 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:13.744 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.732213+0000", 2024-05-08T18:30:13.744 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014895899999999999 2024-05-08T18:30:13.744 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.744 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.744 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:13.745 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.732572+0000", 2024-05-08T18:30:13.745 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000358904 2024-05-08T18:30:13.745 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.745 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.745 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:13.745 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.733349+0000", 2024-05-08T18:30:13.745 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00077657699999999997 2024-05-08T18:30:13.745 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.745 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.745 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:13.745 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.734899+0000", 2024-05-08T18:30:13.745 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001550652 2024-05-08T18:30:13.745 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.745 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.745 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:13.746 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.735641+0000", 2024-05-08T18:30:13.746 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00074222000000000003 2024-05-08T18:30:13.746 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.746 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.746 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:13.746 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.735801+0000", 2024-05-08T18:30:13.746 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015913599999999999 2024-05-08T18:30:13.746 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.746 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.746 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:13.746 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.735910+0000", 2024-05-08T18:30:13.746 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000109406 2024-05-08T18:30:13.746 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:13.747 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:13.747 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:13.747 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.747 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.747 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:13.747 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.750251+0000", 2024-05-08T18:30:13.747 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 21.958628573999999, 2024-05-08T18:30:13.747 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0038408600000000002, 2024-05-08T18:30:13.747 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:13.747 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:13.747 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:13.747 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:13.747 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:13.747 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:13.748 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 224 2024-05-08T18:30:13.748 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.748 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:13.748 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.748 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:13.748 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750251+0000", 2024-05-08T18:30:13.748 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:13.748 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.748 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.748 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:13.748 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750251+0000", 2024-05-08T18:30:13.748 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:13.748 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.749 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.749 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:13.749 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750253+0000", 2024-05-08T18:30:13.749 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2129999999999998e-06 2024-05-08T18:30:13.749 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.749 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.749 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:13.749 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750265+0000", 2024-05-08T18:30:13.749 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1484000000000001e-05 2024-05-08T18:30:13.749 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.749 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.749 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:13.749 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750293+0000", 2024-05-08T18:30:13.749 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8673000000000001e-05 2024-05-08T18:30:13.749 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.750 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.750 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:13.750 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750308+0000", 2024-05-08T18:30:13.750 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4620000000000001e-05 2024-05-08T18:30:13.750 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.750 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.750 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:13.750 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750459+0000", 2024-05-08T18:30:13.750 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000151619 2024-05-08T18:30:13.750 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.750 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.750 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:13.750 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750822+0000", 2024-05-08T18:30:13.750 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000362467 2024-05-08T18:30:13.751 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.751 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.751 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:13.751 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.751591+0000", 2024-05-08T18:30:13.751 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00076934699999999998 2024-05-08T18:30:13.751 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.751 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.751 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:13.751 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.753042+0000", 2024-05-08T18:30:13.751 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001450652 2024-05-08T18:30:13.751 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.751 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.751 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:13.751 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.753792+0000", 2024-05-08T18:30:13.752 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00075045500000000002 2024-05-08T18:30:13.752 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.752 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.752 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:13.752 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.753977+0000", 2024-05-08T18:30:13.752 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000184511 2024-05-08T18:30:13.752 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.752 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.752 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:13.752 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.754092+0000", 2024-05-08T18:30:13.752 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000114819 2024-05-08T18:30:13.752 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:13.752 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:13.752 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:13.753 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.753 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.753 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:13.753 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.783902+0000", 2024-05-08T18:30:13.753 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 21.924977843000001, 2024-05-08T18:30:13.753 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003120046, 2024-05-08T18:30:13.753 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:13.753 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:13.753 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:13.753 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:13.753 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:13.753 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:13.753 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 233 2024-05-08T18:30:13.753 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.754 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:13.754 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.754 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:13.754 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.783902+0000", 2024-05-08T18:30:13.754 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:13.754 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.754 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.754 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:13.754 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.783902+0000", 2024-05-08T18:30:13.754 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:13.754 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.754 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.754 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:13.754 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.783904+0000", 2024-05-08T18:30:13.755 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5229999999999998e-06 2024-05-08T18:30:13.755 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.755 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.755 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:13.755 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.783916+0000", 2024-05-08T18:30:13.755 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1513e-05 2024-05-08T18:30:13.755 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.755 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.755 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:13.755 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.783947+0000", 2024-05-08T18:30:13.755 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1353000000000003e-05 2024-05-08T18:30:13.755 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.755 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.755 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:13.756 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.783964+0000", 2024-05-08T18:30:13.756 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6643e-05 2024-05-08T18:30:13.756 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.756 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.756 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:13.756 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.784110+0000", 2024-05-08T18:30:13.756 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014627299999999999 2024-05-08T18:30:13.756 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.756 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.756 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:13.756 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.784329+0000", 2024-05-08T18:30:13.756 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021892099999999999 2024-05-08T18:30:13.756 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.756 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.756 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:13.757 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.784752+0000", 2024-05-08T18:30:13.757 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00042336700000000001 2024-05-08T18:30:13.757 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.757 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.757 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:13.757 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.786093+0000", 2024-05-08T18:30:13.757 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00134107 2024-05-08T18:30:13.757 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.757 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.757 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:13.757 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.786863+0000", 2024-05-08T18:30:13.757 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00076949099999999997 2024-05-08T18:30:13.757 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.757 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.758 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:13.758 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.786955+0000", 2024-05-08T18:30:13.758 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.2478999999999993e-05 2024-05-08T18:30:13.758 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.758 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.758 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:13.758 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.787022+0000", 2024-05-08T18:30:13.758 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6413000000000003e-05 2024-05-08T18:30:13.758 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:13.758 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:13.758 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:13.758 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.758 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.759 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:341 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:13.759 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.816045+0000", 2024-05-08T18:30:13.759 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 21.892834506, 2024-05-08T18:30:13.759 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002875154, 2024-05-08T18:30:13.759 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:13.759 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:13.759 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:13.759 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:13.759 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:13.759 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:13.759 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 341 2024-05-08T18:30:13.759 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.759 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:13.759 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.760 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:13.760 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816045+0000", 2024-05-08T18:30:13.760 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:13.760 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.760 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.760 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:13.760 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816045+0000", 2024-05-08T18:30:13.760 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:13.760 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.760 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.760 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:13.760 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816046+0000", 2024-05-08T18:30:13.760 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9199999999999999e-07 2024-05-08T18:30:13.760 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.761 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.761 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:13.761 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816050+0000", 2024-05-08T18:30:13.761 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0260000000000001e-06 2024-05-08T18:30:13.761 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.761 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.761 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:13.761 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816060+0000", 2024-05-08T18:30:13.761 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0297e-05 2024-05-08T18:30:13.761 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.761 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.761 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:13.761 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816065+0000", 2024-05-08T18:30:13.762 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.237e-06 2024-05-08T18:30:13.762 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.762 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.762 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:13.762 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816122+0000", 2024-05-08T18:30:13.762 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6168000000000002e-05 2024-05-08T18:30:13.762 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.762 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.762 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:13.762 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816198+0000", 2024-05-08T18:30:13.762 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6511e-05 2024-05-08T18:30:13.762 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.762 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.763 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:13.763 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816305+0000", 2024-05-08T18:30:13.763 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000106487 2024-05-08T18:30:13.763 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.763 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.763 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:13.763 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816886+0000", 2024-05-08T18:30:13.763 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00058187199999999999 2024-05-08T18:30:13.763 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.763 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.763 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:13.763 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.818821+0000", 2024-05-08T18:30:13.763 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001934362 2024-05-08T18:30:13.763 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.763 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.764 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:13.764 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.818880+0000", 2024-05-08T18:30:13.764 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9210999999999999e-05 2024-05-08T18:30:13.764 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.764 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.764 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:13.764 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.818920+0000", 2024-05-08T18:30:13.764 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0091e-05 2024-05-08T18:30:13.764 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:13.764 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:13.764 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:13.764 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.764 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.764 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:13.765 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.086431+0000", 2024-05-08T18:30:13.765 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 21.622448685999998, 2024-05-08T18:30:13.765 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028335959999999999, 2024-05-08T18:30:13.765 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:13.765 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:13.765 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:13.765 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:13.765 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:13.765 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:13.765 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 733 2024-05-08T18:30:13.765 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.765 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:13.765 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.765 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:13.766 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086431+0000", 2024-05-08T18:30:13.766 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:13.766 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.766 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.766 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:13.766 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086431+0000", 2024-05-08T18:30:13.766 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:13.766 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.766 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.766 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:13.766 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086433+0000", 2024-05-08T18:30:13.766 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8899999999999999e-06 2024-05-08T18:30:13.766 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.766 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.767 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:13.767 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086441+0000", 2024-05-08T18:30:13.767 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.3100000000000001e-06 2024-05-08T18:30:13.767 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.767 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.767 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:13.767 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086460+0000", 2024-05-08T18:30:13.767 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8703999999999999e-05 2024-05-08T18:30:13.767 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.767 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.767 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:13.767 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086471+0000", 2024-05-08T18:30:13.767 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1324e-05 2024-05-08T18:30:13.768 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.768 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.768 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:13.768 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086590+0000", 2024-05-08T18:30:13.768 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000118625 2024-05-08T18:30:13.768 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.768 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.768 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:13.768 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086817+0000", 2024-05-08T18:30:13.768 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000226958 2024-05-08T18:30:13.768 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.768 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.768 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:13.768 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.087131+0000", 2024-05-08T18:30:13.768 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00031478799999999998 2024-05-08T18:30:13.769 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.769 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.769 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:13.769 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.088025+0000", 2024-05-08T18:30:13.769 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00089402999999999998 2024-05-08T18:30:13.769 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.769 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.769 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:13.769 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.089123+0000", 2024-05-08T18:30:13.769 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001097598 2024-05-08T18:30:13.769 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.769 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.769 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:13.769 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.089200+0000", 2024-05-08T18:30:13.770 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7333e-05 2024-05-08T18:30:13.770 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.770 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.770 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:13.770 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.089264+0000", 2024-05-08T18:30:13.770 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.4035999999999995e-05 2024-05-08T18:30:13.770 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:13.770 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:13.770 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:13.770 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.770 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.770 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:751 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:13.770 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.125611+0000", 2024-05-08T18:30:13.770 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 21.583267994, 2024-05-08T18:30:13.771 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032716749999999999, 2024-05-08T18:30:13.771 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:13.771 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:13.771 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:13.771 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:13.771 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:13.771 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:13.771 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 751 2024-05-08T18:30:13.771 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.771 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:13.771 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.771 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:13.771 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125611+0000", 2024-05-08T18:30:13.771 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:13.772 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.772 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.772 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:13.772 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125611+0000", 2024-05-08T18:30:13.772 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:13.772 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.772 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.772 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:13.772 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125614+0000", 2024-05-08T18:30:13.772 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.12e-06 2024-05-08T18:30:13.772 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.772 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.772 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:13.772 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125624+0000", 2024-05-08T18:30:13.773 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0492999999999999e-05 2024-05-08T18:30:13.773 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.773 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.773 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:13.773 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125650+0000", 2024-05-08T18:30:13.773 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5907000000000001e-05 2024-05-08T18:30:13.773 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.773 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.773 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:13.773 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125667+0000", 2024-05-08T18:30:13.773 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.694e-05 2024-05-08T18:30:13.773 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.773 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.773 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:13.774 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125801+0000", 2024-05-08T18:30:13.774 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000134482 2024-05-08T18:30:13.774 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.774 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.774 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:13.774 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.126174+0000", 2024-05-08T18:30:13.774 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00037294999999999999 2024-05-08T18:30:13.774 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.774 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.774 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:13.774 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.126750+0000", 2024-05-08T18:30:13.774 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00057538900000000004 2024-05-08T18:30:13.775 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.775 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.775 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:13.775 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.127997+0000", 2024-05-08T18:30:13.775 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001247761 2024-05-08T18:30:13.775 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.775 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.775 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:13.775 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.128731+0000", 2024-05-08T18:30:13.775 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00073338099999999996 2024-05-08T18:30:13.775 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.775 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.775 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:13.775 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.128817+0000", 2024-05-08T18:30:13.776 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5993000000000002e-05 2024-05-08T18:30:13.776 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.776 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.776 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:13.776 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.128883+0000", 2024-05-08T18:30:13.776 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6259000000000004e-05 2024-05-08T18:30:13.776 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:13.776 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:13.776 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:13.776 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.776 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.776 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:753 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:13.776 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.129809+0000", 2024-05-08T18:30:13.777 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 21.579070456, 2024-05-08T18:30:13.777 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0033775440000000001, 2024-05-08T18:30:13.777 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:13.777 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:13.777 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:13.777 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:13.777 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:13.777 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:13.777 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 753 2024-05-08T18:30:13.777 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.777 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:13.777 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.777 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:13.777 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129809+0000", 2024-05-08T18:30:13.778 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:13.778 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.778 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.778 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:13.778 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129809+0000", 2024-05-08T18:30:13.778 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:13.778 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.778 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.778 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:13.778 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129811+0000", 2024-05-08T18:30:13.778 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1730000000000002e-06 2024-05-08T18:30:13.778 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.778 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.778 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:13.779 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129822+0000", 2024-05-08T18:30:13.779 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0583e-05 2024-05-08T18:30:13.779 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.779 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.779 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:13.779 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129852+0000", 2024-05-08T18:30:13.779 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0744000000000002e-05 2024-05-08T18:30:13.779 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.779 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.779 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:13.779 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129870+0000", 2024-05-08T18:30:13.779 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7955999999999999e-05 2024-05-08T18:30:13.779 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.779 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.780 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:13.780 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.130018+0000", 2024-05-08T18:30:13.780 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014747600000000001 2024-05-08T18:30:13.780 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.780 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.780 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:13.780 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.130259+0000", 2024-05-08T18:30:13.780 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024079099999999999 2024-05-08T18:30:13.780 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.780 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.780 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:13.780 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.130734+0000", 2024-05-08T18:30:13.780 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00047562 2024-05-08T18:30:13.780 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.780 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.781 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:13.781 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.131997+0000", 2024-05-08T18:30:13.781 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012626429999999999 2024-05-08T18:30:13.781 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.781 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.781 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:13.781 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.132923+0000", 2024-05-08T18:30:13.781 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00092627599999999997 2024-05-08T18:30:13.781 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.781 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.781 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:13.781 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.133076+0000", 2024-05-08T18:30:13.781 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000152989 2024-05-08T18:30:13.781 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.782 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.782 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:13.782 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.133187+0000", 2024-05-08T18:30:13.782 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000110293 2024-05-08T18:30:13.782 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:13.782 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:13.782 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:13.782 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.782 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.782 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:13.782 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.228247+0000", 2024-05-08T18:30:13.782 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 21.480632845999999, 2024-05-08T18:30:13.782 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032753449999999998, 2024-05-08T18:30:13.783 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:13.783 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:13.783 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:13.783 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:13.783 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:13.783 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:13.783 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 796 2024-05-08T18:30:13.783 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.783 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:13.783 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.783 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:13.783 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228247+0000", 2024-05-08T18:30:13.783 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:13.783 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.784 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.784 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:13.784 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228247+0000", 2024-05-08T18:30:13.784 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:13.784 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.784 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.784 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:13.784 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228249+0000", 2024-05-08T18:30:13.784 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3800000000000001e-06 2024-05-08T18:30:13.784 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.784 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.784 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:13.784 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228260+0000", 2024-05-08T18:30:13.784 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1496e-05 2024-05-08T18:30:13.785 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.785 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.785 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:13.785 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228292+0000", 2024-05-08T18:30:13.785 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1294000000000002e-05 2024-05-08T18:30:13.785 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.785 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.785 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:13.785 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228306+0000", 2024-05-08T18:30:13.785 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4606e-05 2024-05-08T18:30:13.785 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.785 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.785 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:13.786 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228443+0000", 2024-05-08T18:30:13.786 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013672599999999999 2024-05-08T18:30:13.786 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.786 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.786 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:13.786 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228813+0000", 2024-05-08T18:30:13.786 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00036987000000000001 2024-05-08T18:30:13.786 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.786 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.786 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:13.786 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.229365+0000", 2024-05-08T18:30:13.786 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00055210600000000002 2024-05-08T18:30:13.786 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.787 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.787 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:13.787 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.230800+0000", 2024-05-08T18:30:13.787 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001435006 2024-05-08T18:30:13.787 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.787 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.787 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:13.787 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.231369+0000", 2024-05-08T18:30:13.787 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00056848499999999998 2024-05-08T18:30:13.787 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.787 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.787 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:13.787 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.231455+0000", 2024-05-08T18:30:13.787 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6905999999999998e-05 2024-05-08T18:30:13.788 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.788 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.788 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:13.788 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.231522+0000", 2024-05-08T18:30:13.788 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6470000000000006e-05 2024-05-08T18:30:13.788 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:13.788 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:13.788 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:13.788 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.788 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.788 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:798 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:13.788 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.232573+0000", 2024-05-08T18:30:13.788 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 21.476306739000002, 2024-05-08T18:30:13.789 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0030406690000000002, 2024-05-08T18:30:13.789 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:13.789 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:13.789 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:13.789 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:13.789 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:13.789 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:13.789 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 798 2024-05-08T18:30:13.789 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.789 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:13.789 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.789 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:13.789 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232573+0000", 2024-05-08T18:30:13.789 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:13.790 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.790 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.790 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:13.790 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232573+0000", 2024-05-08T18:30:13.790 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:13.790 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.790 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.790 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:13.790 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232574+0000", 2024-05-08T18:30:13.790 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.446e-06 2024-05-08T18:30:13.790 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.790 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.790 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:13.790 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232581+0000", 2024-05-08T18:30:13.791 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.0670000000000003e-06 2024-05-08T18:30:13.791 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.791 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.791 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:13.791 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232600+0000", 2024-05-08T18:30:13.791 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8822999999999999e-05 2024-05-08T18:30:13.791 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.791 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.791 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:13.791 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232611+0000", 2024-05-08T18:30:13.791 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1233000000000001e-05 2024-05-08T18:30:13.791 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.791 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.791 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:13.792 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232731+0000", 2024-05-08T18:30:13.792 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000120189 2024-05-08T18:30:13.792 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.792 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.792 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:13.792 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232963+0000", 2024-05-08T18:30:13.792 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023111900000000001 2024-05-08T18:30:13.792 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.792 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.792 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:13.792 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.233441+0000", 2024-05-08T18:30:13.792 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00047866899999999998 2024-05-08T18:30:13.792 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.792 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.793 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:13.793 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.234542+0000", 2024-05-08T18:30:13.793 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001101245 2024-05-08T18:30:13.793 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.793 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.793 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:13.793 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.235349+0000", 2024-05-08T18:30:13.793 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000806567 2024-05-08T18:30:13.793 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.793 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.793 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:13.793 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.235498+0000", 2024-05-08T18:30:13.793 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014907200000000001 2024-05-08T18:30:13.793 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.794 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.794 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:13.794 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.235613+0000", 2024-05-08T18:30:13.794 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115239 2024-05-08T18:30:13.794 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:13.794 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:13.794 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:13.794 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.794 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.794 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:13.794 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.248596+0000", 2024-05-08T18:30:13.794 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 21.460282932999998, 2024-05-08T18:30:13.794 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002919984, 2024-05-08T18:30:13.794 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:13.795 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:13.795 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:13.795 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:13.795 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:13.795 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:13.795 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 805 2024-05-08T18:30:13.795 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.795 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:13.795 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.795 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:13.795 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248596+0000", 2024-05-08T18:30:13.795 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:13.795 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.795 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.796 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:13.796 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248596+0000", 2024-05-08T18:30:13.796 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:13.796 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.796 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.796 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:13.796 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248599+0000", 2024-05-08T18:30:13.796 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3630000000000001e-06 2024-05-08T18:30:13.796 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.796 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.796 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:13.796 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248610+0000", 2024-05-08T18:30:13.796 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1267000000000001e-05 2024-05-08T18:30:13.796 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.797 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.797 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:13.797 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248641+0000", 2024-05-08T18:30:13.797 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1309999999999997e-05 2024-05-08T18:30:13.797 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.797 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.797 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:13.797 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248656+0000", 2024-05-08T18:30:13.797 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4449e-05 2024-05-08T18:30:13.797 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.797 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.797 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:13.797 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248781+0000", 2024-05-08T18:30:13.797 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012500900000000001 2024-05-08T18:30:13.797 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.798 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.798 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:13.798 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.249001+0000", 2024-05-08T18:30:13.798 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021963500000000001 2024-05-08T18:30:13.798 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.798 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.798 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:13.798 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.249341+0000", 2024-05-08T18:30:13.798 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00034004100000000002 2024-05-08T18:30:13.798 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.798 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.798 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:13.798 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.250473+0000", 2024-05-08T18:30:13.798 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0011324180000000001 2024-05-08T18:30:13.799 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.799 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.799 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:13.799 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.251230+0000", 2024-05-08T18:30:13.799 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00075751400000000004 2024-05-08T18:30:13.799 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.799 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.799 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:13.799 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.251394+0000", 2024-05-08T18:30:13.799 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016379200000000001 2024-05-08T18:30:13.799 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.799 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.799 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:13.800 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.251516+0000", 2024-05-08T18:30:13.800 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012218600000000001 2024-05-08T18:30:13.800 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:13.800 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:13.800 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:13.800 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.800 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.800 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:13.800 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.313184+0000", 2024-05-08T18:30:13.800 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 21.395695258, 2024-05-08T18:30:13.800 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003040016, 2024-05-08T18:30:13.800 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:13.800 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:13.800 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:13.801 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:13.801 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:13.801 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:13.801 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 832 2024-05-08T18:30:13.801 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.801 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:13.801 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.801 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:13.801 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313184+0000", 2024-05-08T18:30:13.801 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:13.801 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.801 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.801 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:13.802 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313184+0000", 2024-05-08T18:30:13.802 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:13.802 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.802 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.802 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:13.802 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313187+0000", 2024-05-08T18:30:13.802 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5100000000000001e-06 2024-05-08T18:30:13.802 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.802 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.802 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:13.802 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313199+0000", 2024-05-08T18:30:13.802 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.201e-05 2024-05-08T18:30:13.802 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.802 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.803 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:13.803 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313229+0000", 2024-05-08T18:30:13.803 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9839e-05 2024-05-08T18:30:13.803 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.803 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.803 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:13.803 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313243+0000", 2024-05-08T18:30:13.803 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4727e-05 2024-05-08T18:30:13.803 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.803 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.803 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:13.803 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313358+0000", 2024-05-08T18:30:13.803 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115016 2024-05-08T18:30:13.804 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.804 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.804 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:13.804 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313577+0000", 2024-05-08T18:30:13.804 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021897799999999999 2024-05-08T18:30:13.804 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.804 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.804 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:13.804 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313889+0000", 2024-05-08T18:30:13.804 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00031210400000000001 2024-05-08T18:30:13.804 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.804 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.804 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:13.804 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.315229+0000", 2024-05-08T18:30:13.805 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001339963 2024-05-08T18:30:13.805 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.805 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.805 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:13.805 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.315938+0000", 2024-05-08T18:30:13.805 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00070853400000000003 2024-05-08T18:30:13.805 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.805 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.805 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:13.805 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.316111+0000", 2024-05-08T18:30:13.805 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000173396 2024-05-08T18:30:13.805 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.805 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.805 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:13.805 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.316224+0000", 2024-05-08T18:30:13.806 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000112939 2024-05-08T18:30:13.806 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:13.806 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:13.806 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:13.806 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.806 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.806 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:834 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:13.806 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.317499+0000", 2024-05-08T18:30:13.806 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 21.391380459000001, 2024-05-08T18:30:13.806 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0033281109999999999, 2024-05-08T18:30:13.806 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:13.806 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:13.806 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:13.807 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:13.807 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:13.807 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:13.807 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 834 2024-05-08T18:30:13.807 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.807 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:13.807 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.807 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:13.807 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317499+0000", 2024-05-08T18:30:13.807 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:13.807 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.807 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.807 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:13.807 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317499+0000", 2024-05-08T18:30:13.808 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:13.808 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.808 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.808 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:13.808 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317501+0000", 2024-05-08T18:30:13.808 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9400000000000001e-06 2024-05-08T18:30:13.808 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.808 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.808 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:13.808 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317511+0000", 2024-05-08T18:30:13.808 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0297e-05 2024-05-08T18:30:13.808 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.808 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.808 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:13.809 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317532+0000", 2024-05-08T18:30:13.809 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1013e-05 2024-05-08T18:30:13.809 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.809 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.809 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:13.809 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317543+0000", 2024-05-08T18:30:13.809 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0757000000000001e-05 2024-05-08T18:30:13.809 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.809 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.809 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:13.809 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317658+0000", 2024-05-08T18:30:13.809 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115129 2024-05-08T18:30:13.809 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.809 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.809 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:13.810 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317887+0000", 2024-05-08T18:30:13.810 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00022880099999999999 2024-05-08T18:30:13.810 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.810 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.810 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:13.810 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.318378+0000", 2024-05-08T18:30:13.810 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00049129000000000002 2024-05-08T18:30:13.810 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.810 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.810 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:13.810 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.319597+0000", 2024-05-08T18:30:13.810 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012188469999999999 2024-05-08T18:30:13.810 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.811 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.811 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:13.811 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.320566+0000", 2024-05-08T18:30:13.811 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00096881599999999995 2024-05-08T18:30:13.811 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.811 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.811 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:13.811 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.320713+0000", 2024-05-08T18:30:13.811 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014691500000000001 2024-05-08T18:30:13.811 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.811 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.811 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:13.811 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.320827+0000", 2024-05-08T18:30:13.811 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000114306 2024-05-08T18:30:13.812 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:13.812 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:13.812 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:13.812 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.812 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.812 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:13.812 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.505569+0000", 2024-05-08T18:30:13.812 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 21.203310005999999, 2024-05-08T18:30:13.812 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028584309999999998, 2024-05-08T18:30:13.812 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:13.812 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:13.812 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:13.812 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:13.812 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:13.813 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:13.813 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 916 2024-05-08T18:30:13.813 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.813 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:13.813 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.813 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:13.813 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505569+0000", 2024-05-08T18:30:13.813 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:13.813 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.813 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.813 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:13.813 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505569+0000", 2024-05-08T18:30:13.813 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:13.813 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.814 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.814 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:13.814 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505572+0000", 2024-05-08T18:30:13.814 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3659999999999999e-06 2024-05-08T18:30:13.814 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.814 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.814 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:13.814 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505583+0000", 2024-05-08T18:30:13.814 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1574e-05 2024-05-08T18:30:13.814 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.814 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.814 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:13.814 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505614+0000", 2024-05-08T18:30:13.815 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0670000000000003e-05 2024-05-08T18:30:13.815 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.815 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.815 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:13.815 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505629+0000", 2024-05-08T18:30:13.815 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5063e-05 2024-05-08T18:30:13.815 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.815 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.815 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:13.815 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505754+0000", 2024-05-08T18:30:13.815 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012508899999999999 2024-05-08T18:30:13.815 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.815 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.815 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:13.816 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505988+0000", 2024-05-08T18:30:13.816 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023334699999999999 2024-05-08T18:30:13.816 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.816 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.816 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:13.816 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.506299+0000", 2024-05-08T18:30:13.816 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000311811 2024-05-08T18:30:13.816 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.816 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.816 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:13.816 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.507489+0000", 2024-05-08T18:30:13.816 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0011899510000000001 2024-05-08T18:30:13.816 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.816 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.817 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:13.817 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.508141+0000", 2024-05-08T18:30:13.817 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00065180200000000005 2024-05-08T18:30:13.817 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.817 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.817 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:13.817 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.508306+0000", 2024-05-08T18:30:13.817 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016450199999999999 2024-05-08T18:30:13.817 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.817 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.817 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:13.817 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.508428+0000", 2024-05-08T18:30:13.817 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000122256 2024-05-08T18:30:13.818 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:13.818 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:13.818 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:13.818 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.818 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.818 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:918 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:13.818 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.509337+0000", 2024-05-08T18:30:13.818 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 21.199541939, 2024-05-08T18:30:13.818 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002971787, 2024-05-08T18:30:13.818 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:13.818 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:13.818 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:13.818 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:13.818 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:13.819 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:13.819 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 918 2024-05-08T18:30:13.819 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.819 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:13.819 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.819 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:13.819 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509337+0000", 2024-05-08T18:30:13.819 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:13.819 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.819 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.819 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:13.819 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509337+0000", 2024-05-08T18:30:13.819 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:13.819 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.820 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.820 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:13.820 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509340+0000", 2024-05-08T18:30:13.820 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2570000000000002e-06 2024-05-08T18:30:13.820 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.820 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.820 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:13.820 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509351+0000", 2024-05-08T18:30:13.820 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0933e-05 2024-05-08T18:30:13.820 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.820 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.820 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:13.820 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509382+0000", 2024-05-08T18:30:13.821 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1198999999999997e-05 2024-05-08T18:30:13.821 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.821 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.821 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:13.821 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509400+0000", 2024-05-08T18:30:13.821 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8236999999999998e-05 2024-05-08T18:30:13.821 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.821 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.821 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:13.821 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509529+0000", 2024-05-08T18:30:13.821 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012905600000000001 2024-05-08T18:30:13.821 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.821 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.821 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:13.821 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509777+0000", 2024-05-08T18:30:13.822 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024786799999999999 2024-05-08T18:30:13.822 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.822 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.822 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:13.822 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.510284+0000", 2024-05-08T18:30:13.822 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000506796 2024-05-08T18:30:13.822 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.822 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.822 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:13.822 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.511453+0000", 2024-05-08T18:30:13.822 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001169575 2024-05-08T18:30:13.822 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.822 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.823 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:13.823 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.512051+0000", 2024-05-08T18:30:13.823 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00059743100000000005 2024-05-08T18:30:13.823 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.823 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.823 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:13.823 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.512199+0000", 2024-05-08T18:30:13.823 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000148486 2024-05-08T18:30:13.823 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.823 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.823 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:13.823 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.512309+0000", 2024-05-08T18:30:13.823 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000109949 2024-05-08T18:30:13.823 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:13.824 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:13.824 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:13.824 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.824 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.824 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:931 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:13.824 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.543277+0000", 2024-05-08T18:30:13.824 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 21.165602784000001, 2024-05-08T18:30:13.824 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028250710000000002, 2024-05-08T18:30:13.824 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:13.824 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:13.824 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:13.824 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:13.824 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:13.824 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:13.825 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 931 2024-05-08T18:30:13.825 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.825 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:13.825 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.825 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:13.825 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543277+0000", 2024-05-08T18:30:13.825 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:13.825 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.825 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.825 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:13.825 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543277+0000", 2024-05-08T18:30:13.825 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:13.825 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.825 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.826 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:13.826 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543279+0000", 2024-05-08T18:30:13.826 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.373e-06 2024-05-08T18:30:13.826 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.826 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.826 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:13.826 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543291+0000", 2024-05-08T18:30:13.826 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1517e-05 2024-05-08T18:30:13.826 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.826 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.826 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:13.826 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543323+0000", 2024-05-08T18:30:13.826 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2292000000000002e-05 2024-05-08T18:30:13.826 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.827 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.827 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:13.827 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543340+0000", 2024-05-08T18:30:13.827 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.749e-05 2024-05-08T18:30:13.827 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.827 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.827 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:13.827 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543462+0000", 2024-05-08T18:30:13.827 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000121413 2024-05-08T18:30:13.827 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.827 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.827 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:13.827 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543681+0000", 2024-05-08T18:30:13.827 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021974200000000001 2024-05-08T18:30:13.828 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.828 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.828 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:13.828 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.544004+0000", 2024-05-08T18:30:13.828 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00032268900000000003 2024-05-08T18:30:13.828 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.828 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.828 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:13.828 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.545158+0000", 2024-05-08T18:30:13.828 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0011540190000000001 2024-05-08T18:30:13.828 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.828 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.828 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:13.828 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.545970+0000", 2024-05-08T18:30:13.829 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00081224300000000004 2024-05-08T18:30:13.829 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.829 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.829 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:13.829 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.546043+0000", 2024-05-08T18:30:13.829 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.3067999999999999e-05 2024-05-08T18:30:13.829 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.829 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.829 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:13.829 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.546102+0000", 2024-05-08T18:30:13.829 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8224999999999999e-05 2024-05-08T18:30:13.829 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:13.829 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:13.829 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:13.829 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.830 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.830 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:13.830 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.578568+0000", 2024-05-08T18:30:13.830 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 21.130311877, 2024-05-08T18:30:13.830 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0030345839999999999, 2024-05-08T18:30:13.830 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:13.830 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:13.830 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:13.830 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:13.830 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:13.830 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:13.830 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 946 2024-05-08T18:30:13.830 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.831 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:13.831 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.831 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:13.831 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578568+0000", 2024-05-08T18:30:13.831 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:13.831 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.831 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.831 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:13.831 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578568+0000", 2024-05-08T18:30:13.831 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:13.831 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.831 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.831 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:13.831 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578570+0000", 2024-05-08T18:30:13.831 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3700000000000002e-06 2024-05-08T18:30:13.832 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.832 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.832 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:13.832 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578582+0000", 2024-05-08T18:30:13.832 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1627000000000001e-05 2024-05-08T18:30:13.832 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.832 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.832 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:13.832 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578612+0000", 2024-05-08T18:30:13.832 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0103e-05 2024-05-08T18:30:13.832 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.832 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.832 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:13.832 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578627+0000", 2024-05-08T18:30:13.833 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4949999999999999e-05 2024-05-08T18:30:13.833 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.833 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.833 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:13.833 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578750+0000", 2024-05-08T18:30:13.833 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012309899999999999 2024-05-08T18:30:13.833 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.833 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.833 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:13.833 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.579042+0000", 2024-05-08T18:30:13.833 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00029212500000000001 2024-05-08T18:30:13.833 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.833 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.833 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:13.834 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.579557+0000", 2024-05-08T18:30:13.834 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00051536900000000001 2024-05-08T18:30:13.834 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.834 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.834 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:13.834 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.580698+0000", 2024-05-08T18:30:13.834 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001140774 2024-05-08T18:30:13.834 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.834 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.834 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:13.834 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.581367+0000", 2024-05-08T18:30:13.834 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00066884799999999999 2024-05-08T18:30:13.834 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.835 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.835 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:13.835 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.581489+0000", 2024-05-08T18:30:13.835 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012265600000000001 2024-05-08T18:30:13.835 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:13.835 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:13.835 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:13.835 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.581602+0000", 2024-05-08T18:30:13.835 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000112663 2024-05-08T18:30:13.835 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:13.835 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:13.835 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:13.836 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:13.836 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:13.836 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:30:13.836 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-08T18:30:13.838 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-08T18:30:13.838 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:30:13.836+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:30:13.939 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:30:13.938+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:30:14.012 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:30:14.013 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:30:14.013 INFO:teuthology.orchestra.run.smithi097.stdout: "num_ops": 0 2024-05-08T18:30:14.013 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:30:14.028 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-08T18:30:14.037 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2024-05-08T18:30:14.038 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:30:14.040 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:30:14.040+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:30:14.054 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2024-05-08T18:30:14.054 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:30:14.071 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2024-05-08T18:30:14.071 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:30:14.087 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2024-05-08T18:30:14.088 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:30:14.109 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2024-05-08T18:30:14.109 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:30:14.129 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2024-05-08T18:30:14.129 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:30:14.143 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:30:14.140+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:30:14.150 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2024-05-08T18:30:14.150 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:30:14.151 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:14.151 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:14.166 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-08T18:30:14.171 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2024-05-08T18:30:14.171 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:30:14.244 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:30:14.244+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:30:14.277 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:14.278 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:14.291 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-08T18:30:14.348 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:30:14.346+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:30:14.410 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:14.410 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:14.424 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-08T18:30:14.465 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:30:14.466+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:30:14.550 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:30:14.550+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:30:14.590 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:14.590 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:14.604 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-08T18:30:14.651 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:30:14.648+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:30:14.752 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:30:14.752+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:30:14.765 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:14.765 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:14.779 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-08T18:30:14.808 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-08T18:30:14.853 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:30:14.854+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:30:14.919 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:14.919 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:14.933 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-08T18:30:14.954 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:30:14.954+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:30:15.055 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:15.055 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:15.055 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:30:15.052+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:30:15.069 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-08T18:30:15.156 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:30:15.156+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:30:15.237 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:15.237 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:15.251 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-08T18:30:15.257 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:30:15.257+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:30:15.358 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:30:15.356+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:30:15.419 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:15.420 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:15.434 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-08T18:30:15.476 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:30:15.476+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:30:15.560 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:30:15.557+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:30:15.602 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:15.602 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:15.616 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-08T18:30:15.661 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:30:15.661+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:30:15.735 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:15.735 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:15.750 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-08T18:30:15.796 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:30:15.796+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:30:15.797 INFO:teuthology.orchestra.run.smithi097.stderr:nodeep-scrub is set 2024-05-08T18:30:15.869 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:30:15.869+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:30:15.870 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:15.870 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:15.885 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-08T18:30:15.972 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:30:15.972+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:30:16.054 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:16.055 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:16.064 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:30:16.064+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:30:16.070 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-08T18:30:16.165 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:30:16.169+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:30:16.191 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-08T18:30:16.235 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:16.236 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:16.250 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-08T18:30:16.296 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:30:16.296+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:30:16.345 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2024-05-08T18:30:16.345 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:30:16.362 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2024-05-08T18:30:16.363 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:30:16.367 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:30:16.369+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:30:16.368 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:16.368 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:16.379 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2024-05-08T18:30:16.379 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:30:16.382 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-08T18:30:16.395 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2024-05-08T18:30:16.396 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:30:16.416 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2024-05-08T18:30:16.416 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:30:16.434 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2024-05-08T18:30:16.434 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:30:16.453 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2024-05-08T18:30:16.453 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:30:16.472 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2024-05-08T18:30:16.472 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:30:16.472 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:30:16.472+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:30:16.548 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:30:16.548 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:30:16.548 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2024-05-08T18:30:16.548 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2024-05-08T18:30:16.549 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:30:16.562 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-08T18:30:16.604 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:30:16.604+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:30:16.670 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:30:16.668+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:30:16.724 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:30:16.724 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2024-05-08T18:30:16.724 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2024-05-08T18:30:16.724 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-05-08T18:30:16.724 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.724 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:24 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [write 262144~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:16.724 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.154193+0000", 2024-05-08T18:30:16.724 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 49.569490117999997, 2024-05-08T18:30:16.724 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0085494309999999997, 2024-05-08T18:30:16.724 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:16.724 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:16.724 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:16.725 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:16.725 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:16.725 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:16.725 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 24 2024-05-08T18:30:16.725 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.725 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:16.725 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.725 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:16.725 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154193+0000", 2024-05-08T18:30:16.725 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:16.725 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.725 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.725 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:16.726 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154193+0000", 2024-05-08T18:30:16.726 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:16.726 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.726 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.726 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:16.726 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154194+0000", 2024-05-08T18:30:16.726 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.44e-06 2024-05-08T18:30:16.726 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.726 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.726 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:16.726 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154394+0000", 2024-05-08T18:30:16.726 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00019972499999999999 2024-05-08T18:30:16.726 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.727 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.727 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:16.727 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154417+0000", 2024-05-08T18:30:16.727 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2713000000000001e-05 2024-05-08T18:30:16.727 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.727 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.727 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:16.727 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154437+0000", 2024-05-08T18:30:16.727 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0027e-05 2024-05-08T18:30:16.727 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.727 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.727 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:16.727 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.158438+0000", 2024-05-08T18:30:16.727 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0040011459999999997 2024-05-08T18:30:16.728 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.728 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.728 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:16.728 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.158567+0000", 2024-05-08T18:30:16.728 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012923899999999999 2024-05-08T18:30:16.728 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.728 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.728 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:16.728 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.158787+0000", 2024-05-08T18:30:16.728 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000219581 2024-05-08T18:30:16.728 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.728 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.728 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:16.728 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.162013+0000", 2024-05-08T18:30:16.729 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032261759999999999 2024-05-08T18:30:16.729 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.729 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.729 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:16.729 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.162568+0000", 2024-05-08T18:30:16.729 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00055576900000000001 2024-05-08T18:30:16.729 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.729 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.729 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:16.729 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.162644+0000", 2024-05-08T18:30:16.729 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5516e-05 2024-05-08T18:30:16.729 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.729 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.729 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:16.730 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.162742+0000", 2024-05-08T18:30:16.730 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8098999999999997e-05 2024-05-08T18:30:16.730 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:16.730 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:16.730 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:16.730 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.730 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.730 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:25 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:16.730 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.154495+0000", 2024-05-08T18:30:16.731 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 49.569187823999997, 2024-05-08T18:30:16.731 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010784396999999999, 2024-05-08T18:30:16.731 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:16.731 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:16.731 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:16.731 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:16.731 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:16.731 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:16.731 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 25 2024-05-08T18:30:16.731 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.731 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:16.732 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.732 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:16.732 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154495+0000", 2024-05-08T18:30:16.732 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:16.732 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.732 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.732 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:16.732 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154495+0000", 2024-05-08T18:30:16.732 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:16.732 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.732 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.732 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:16.732 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154496+0000", 2024-05-08T18:30:16.732 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.454e-06 2024-05-08T18:30:16.733 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.733 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.733 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:16.733 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154509+0000", 2024-05-08T18:30:16.733 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2496e-05 2024-05-08T18:30:16.733 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.733 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.733 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:16.733 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154531+0000", 2024-05-08T18:30:16.733 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1987000000000001e-05 2024-05-08T18:30:16.733 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.733 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.733 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:16.733 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154547+0000", 2024-05-08T18:30:16.734 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.577e-05 2024-05-08T18:30:16.734 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.734 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.734 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:16.734 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.160949+0000", 2024-05-08T18:30:16.734 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.006401917 2024-05-08T18:30:16.734 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.734 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.734 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:16.734 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.161102+0000", 2024-05-08T18:30:16.734 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000153826 2024-05-08T18:30:16.734 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.734 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.734 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:16.735 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.161332+0000", 2024-05-08T18:30:16.735 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022918099999999999 2024-05-08T18:30:16.735 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.735 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.735 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:16.735 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.163838+0000", 2024-05-08T18:30:16.735 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0025064079999999999 2024-05-08T18:30:16.735 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.735 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.735 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:16.735 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.165121+0000", 2024-05-08T18:30:16.735 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0012825200000000001 2024-05-08T18:30:16.735 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.735 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.736 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:16.736 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.165212+0000", 2024-05-08T18:30:16.736 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1121999999999999e-05 2024-05-08T18:30:16.736 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.736 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.736 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:16.736 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.165279+0000", 2024-05-08T18:30:16.736 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7716e-05 2024-05-08T18:30:16.736 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:16.736 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:16.736 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:16.736 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.736 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.736 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:41 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:16.736 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247174+0000", 2024-05-08T18:30:16.737 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 49.476508842000001, 2024-05-08T18:30:16.737 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010013393000000001, 2024-05-08T18:30:16.737 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:16.737 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:16.737 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:16.737 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:16.737 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:16.737 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:16.737 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 41 2024-05-08T18:30:16.737 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.737 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:16.737 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.737 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:16.737 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247174+0000", 2024-05-08T18:30:16.738 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:16.738 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.738 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.738 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:16.738 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247174+0000", 2024-05-08T18:30:16.738 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:16.738 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.738 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.738 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:16.738 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247175+0000", 2024-05-08T18:30:16.738 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.9999999999999995e-07 2024-05-08T18:30:16.738 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.738 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.739 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:16.739 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247277+0000", 2024-05-08T18:30:16.739 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010243600000000001 2024-05-08T18:30:16.739 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.739 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.739 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:16.739 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247291+0000", 2024-05-08T18:30:16.739 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4076999999999999e-05 2024-05-08T18:30:16.739 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.739 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.739 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:16.739 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247301+0000", 2024-05-08T18:30:16.739 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0010000000000001e-05 2024-05-08T18:30:16.739 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.740 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.740 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:16.740 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.249555+0000", 2024-05-08T18:30:16.740 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0022539050000000001 2024-05-08T18:30:16.740 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.740 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.740 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:16.740 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.249700+0000", 2024-05-08T18:30:16.740 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014484599999999999 2024-05-08T18:30:16.740 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.740 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.740 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:16.740 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.249929+0000", 2024-05-08T18:30:16.740 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022904499999999999 2024-05-08T18:30:16.740 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.741 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.741 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:16.741 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.253695+0000", 2024-05-08T18:30:16.741 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0037656640000000002 2024-05-08T18:30:16.741 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.741 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.741 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:16.741 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.256970+0000", 2024-05-08T18:30:16.741 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003274608 2024-05-08T18:30:16.741 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.741 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.741 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:16.741 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.257052+0000", 2024-05-08T18:30:16.741 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2223000000000002e-05 2024-05-08T18:30:16.742 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.742 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.742 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:16.742 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.257187+0000", 2024-05-08T18:30:16.742 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013557900000000001 2024-05-08T18:30:16.742 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:16.742 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:16.742 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:16.742 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.742 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.742 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:42 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:16.742 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247321+0000", 2024-05-08T18:30:16.742 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 49.476361523000001, 2024-05-08T18:30:16.743 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013168572, 2024-05-08T18:30:16.743 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:16.743 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:16.743 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:16.743 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:16.743 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:16.743 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:16.743 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 42 2024-05-08T18:30:16.743 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.743 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:16.743 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.743 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:16.743 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247321+0000", 2024-05-08T18:30:16.743 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:16.743 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.744 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.744 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:16.744 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247321+0000", 2024-05-08T18:30:16.744 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:16.744 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.744 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.744 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:16.744 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247323+0000", 2024-05-08T18:30:16.744 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.24e-06 2024-05-08T18:30:16.744 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.744 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.744 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:16.744 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247329+0000", 2024-05-08T18:30:16.744 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1530000000000002e-06 2024-05-08T18:30:16.744 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.745 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.745 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:16.745 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247339+0000", 2024-05-08T18:30:16.745 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0387000000000001e-05 2024-05-08T18:30:16.745 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.745 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.745 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:16.745 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247347+0000", 2024-05-08T18:30:16.745 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9829999999999996e-06 2024-05-08T18:30:16.745 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.745 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.745 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:16.745 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.251488+0000", 2024-05-08T18:30:16.745 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0041412849999999998 2024-05-08T18:30:16.746 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.746 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.746 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:16.746 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.251672+0000", 2024-05-08T18:30:16.746 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00018354499999999999 2024-05-08T18:30:16.746 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.746 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.746 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:16.746 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.251949+0000", 2024-05-08T18:30:16.746 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00027695399999999999 2024-05-08T18:30:16.746 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.746 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.746 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:16.746 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.253810+0000", 2024-05-08T18:30:16.746 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001860806 2024-05-08T18:30:16.747 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.747 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.747 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:16.747 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260244+0000", 2024-05-08T18:30:16.747 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0064347939999999998 2024-05-08T18:30:16.747 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.747 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.747 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:16.747 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260376+0000", 2024-05-08T18:30:16.747 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000131829 2024-05-08T18:30:16.747 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.747 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.747 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:16.747 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260490+0000", 2024-05-08T18:30:16.748 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000113596 2024-05-08T18:30:16.748 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:16.748 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:16.748 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:16.748 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.748 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.748 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:43 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:16.748 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247367+0000", 2024-05-08T18:30:16.748 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 49.47631561, 2024-05-08T18:30:16.748 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013449025999999999, 2024-05-08T18:30:16.748 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:16.748 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:16.748 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:16.748 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:16.748 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:16.749 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:16.749 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 43 2024-05-08T18:30:16.749 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.749 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:16.749 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.749 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:16.749 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247367+0000", 2024-05-08T18:30:16.749 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:16.749 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.749 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.749 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:16.749 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247367+0000", 2024-05-08T18:30:16.749 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:16.749 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.749 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.750 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:16.750 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247368+0000", 2024-05-08T18:30:16.750 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1999999999999999e-07 2024-05-08T18:30:16.750 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.750 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.750 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:16.750 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247374+0000", 2024-05-08T18:30:16.750 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.19e-06 2024-05-08T18:30:16.750 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.750 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.750 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:16.750 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247384+0000", 2024-05-08T18:30:16.750 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0173000000000001e-05 2024-05-08T18:30:16.750 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.751 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.751 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:16.751 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247392+0000", 2024-05-08T18:30:16.751 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1869999999999997e-06 2024-05-08T18:30:16.751 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.751 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.751 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:16.751 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.252515+0000", 2024-05-08T18:30:16.751 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0051221399999999999 2024-05-08T18:30:16.751 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.751 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.751 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:16.751 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.252641+0000", 2024-05-08T18:30:16.751 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012609200000000001 2024-05-08T18:30:16.752 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.752 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.752 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:16.752 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.252842+0000", 2024-05-08T18:30:16.752 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000201619 2024-05-08T18:30:16.752 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.752 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.752 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:16.752 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.256828+0000", 2024-05-08T18:30:16.752 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039853989999999997 2024-05-08T18:30:16.752 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.752 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.752 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:16.752 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260515+0000", 2024-05-08T18:30:16.753 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0036875419999999998 2024-05-08T18:30:16.753 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.753 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.753 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:16.753 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260718+0000", 2024-05-08T18:30:16.753 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020229499999999999 2024-05-08T18:30:16.753 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.753 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.753 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:16.753 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260816+0000", 2024-05-08T18:30:16.753 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8669e-05 2024-05-08T18:30:16.753 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:16.753 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:16.753 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:16.754 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.754 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.754 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:16.754 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247466+0000", 2024-05-08T18:30:16.754 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 49.476217024, 2024-05-08T18:30:16.754 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013491806, 2024-05-08T18:30:16.754 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:16.754 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:16.754 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:16.754 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:16.755 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:16.755 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:16.755 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 44 2024-05-08T18:30:16.755 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.755 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:16.755 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.755 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:16.755 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247466+0000", 2024-05-08T18:30:16.755 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:16.755 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.755 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.755 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:16.755 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247466+0000", 2024-05-08T18:30:16.755 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:16.756 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.756 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.756 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:16.756 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247467+0000", 2024-05-08T18:30:16.756 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.263e-06 2024-05-08T18:30:16.756 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.756 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.756 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:16.756 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247585+0000", 2024-05-08T18:30:16.756 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011756600000000001 2024-05-08T18:30:16.756 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.756 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.756 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:16.756 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247598+0000", 2024-05-08T18:30:16.756 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3766e-05 2024-05-08T18:30:16.757 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.757 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.757 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:16.757 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247609+0000", 2024-05-08T18:30:16.757 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0604e-05 2024-05-08T18:30:16.757 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.757 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.757 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:16.757 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.253890+0000", 2024-05-08T18:30:16.757 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0062810440000000004 2024-05-08T18:30:16.757 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.757 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.757 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:16.757 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.254068+0000", 2024-05-08T18:30:16.758 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017848199999999999 2024-05-08T18:30:16.758 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.758 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.758 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:16.758 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.254488+0000", 2024-05-08T18:30:16.758 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00041965399999999999 2024-05-08T18:30:16.758 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.758 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.758 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:16.758 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.256949+0000", 2024-05-08T18:30:16.758 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002461254 2024-05-08T18:30:16.758 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.758 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.758 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:16.758 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260832+0000", 2024-05-08T18:30:16.759 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0038830539999999999 2024-05-08T18:30:16.759 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.759 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.759 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:16.759 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260906+0000", 2024-05-08T18:30:16.759 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3455999999999996e-05 2024-05-08T18:30:16.759 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.759 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.759 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:16.759 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260958+0000", 2024-05-08T18:30:16.759 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1663000000000003e-05 2024-05-08T18:30:16.759 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:16.759 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:16.759 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:16.759 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.760 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.760 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:16.760 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247630+0000", 2024-05-08T18:30:16.760 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 49.476052619000001, 2024-05-08T18:30:16.760 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013478753, 2024-05-08T18:30:16.760 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:16.760 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:16.760 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:16.760 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:16.760 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:16.760 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:16.760 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 45 2024-05-08T18:30:16.760 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.760 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:16.760 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.761 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:16.761 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247630+0000", 2024-05-08T18:30:16.761 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:16.761 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.761 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.761 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:16.761 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247630+0000", 2024-05-08T18:30:16.761 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:16.761 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.761 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.761 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:16.761 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247631+0000", 2024-05-08T18:30:16.761 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7399999999999991e-07 2024-05-08T18:30:16.761 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.761 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.762 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:16.762 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247637+0000", 2024-05-08T18:30:16.762 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.93e-06 2024-05-08T18:30:16.762 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.762 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.762 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:16.762 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247647+0000", 2024-05-08T18:30:16.762 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7459999999999995e-06 2024-05-08T18:30:16.762 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.763 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.763 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:16.763 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247654+0000", 2024-05-08T18:30:16.763 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4039999999999998e-06 2024-05-08T18:30:16.763 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.763 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.763 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:16.763 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.255829+0000", 2024-05-08T18:30:16.763 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0081749059999999991 2024-05-08T18:30:16.763 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.763 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.763 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:16.763 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.255979+0000", 2024-05-08T18:30:16.764 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015027899999999999 2024-05-08T18:30:16.764 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.764 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.764 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:16.764 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.256185+0000", 2024-05-08T18:30:16.764 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020583900000000001 2024-05-08T18:30:16.764 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.764 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.764 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:16.764 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260097+0000", 2024-05-08T18:30:16.764 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039121929999999996 2024-05-08T18:30:16.764 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.764 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.765 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:16.765 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260973+0000", 2024-05-08T18:30:16.765 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00087591999999999998 2024-05-08T18:30:16.765 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.765 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.765 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:16.765 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261056+0000", 2024-05-08T18:30:16.765 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3104999999999998e-05 2024-05-08T18:30:16.765 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.765 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.765 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:16.765 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261109+0000", 2024-05-08T18:30:16.765 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2457000000000003e-05 2024-05-08T18:30:16.765 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:16.766 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:16.766 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:16.766 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.766 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.766 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:16.766 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247667+0000", 2024-05-08T18:30:16.766 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 49.476015339, 2024-05-08T18:30:16.766 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013569098999999999, 2024-05-08T18:30:16.766 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:16.766 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:16.766 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:16.766 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:16.766 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:16.766 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:16.767 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 46 2024-05-08T18:30:16.767 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.767 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:16.767 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.767 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:16.767 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247667+0000", 2024-05-08T18:30:16.767 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:16.767 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.767 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.767 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:16.767 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247667+0000", 2024-05-08T18:30:16.767 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:16.767 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.767 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.768 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:16.768 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247668+0000", 2024-05-08T18:30:16.768 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7999999999999995e-07 2024-05-08T18:30:16.768 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.768 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.768 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:16.768 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247674+0000", 2024-05-08T18:30:16.768 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4369999999999998e-06 2024-05-08T18:30:16.768 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.768 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.768 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:16.768 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247683+0000", 2024-05-08T18:30:16.768 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4360000000000008e-06 2024-05-08T18:30:16.768 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.768 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.769 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:16.769 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247690+0000", 2024-05-08T18:30:16.769 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.43e-06 2024-05-08T18:30:16.769 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.769 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.769 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:16.769 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.257358+0000", 2024-05-08T18:30:16.769 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0096676890000000001 2024-05-08T18:30:16.769 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.769 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.769 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:16.769 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.257626+0000", 2024-05-08T18:30:16.769 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00026819099999999998 2024-05-08T18:30:16.769 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.770 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.770 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:16.770 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.258041+0000", 2024-05-08T18:30:16.770 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00041438400000000001 2024-05-08T18:30:16.770 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.770 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.770 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:16.770 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260224+0000", 2024-05-08T18:30:16.770 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0021830700000000001 2024-05-08T18:30:16.770 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.770 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.770 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:16.770 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261127+0000", 2024-05-08T18:30:16.770 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00090292300000000003 2024-05-08T18:30:16.771 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.771 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.771 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:16.771 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261191+0000", 2024-05-08T18:30:16.771 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4342000000000002e-05 2024-05-08T18:30:16.771 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.771 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.771 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:16.771 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261237+0000", 2024-05-08T18:30:16.771 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.5516999999999998e-05 2024-05-08T18:30:16.771 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:16.771 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:16.771 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:16.771 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.771 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.772 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:16.772 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247703+0000", 2024-05-08T18:30:16.772 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 49.475979856000002, 2024-05-08T18:30:16.772 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015020204000000001, 2024-05-08T18:30:16.772 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:16.772 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:16.772 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:16.772 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:16.772 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:16.772 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:16.772 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 47 2024-05-08T18:30:16.772 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.772 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:16.772 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.772 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:16.773 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247703+0000", 2024-05-08T18:30:16.773 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:16.773 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.773 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.773 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:16.773 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247703+0000", 2024-05-08T18:30:16.773 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:16.773 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.773 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.773 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:16.773 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247704+0000", 2024-05-08T18:30:16.773 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8299999999999996e-07 2024-05-08T18:30:16.773 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.773 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.773 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:16.774 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247877+0000", 2024-05-08T18:30:16.774 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000172979 2024-05-08T18:30:16.774 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.774 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.774 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:16.774 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247894+0000", 2024-05-08T18:30:16.774 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6912999999999999e-05 2024-05-08T18:30:16.774 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.774 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.774 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:16.774 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247903+0000", 2024-05-08T18:30:16.774 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1770000000000004e-06 2024-05-08T18:30:16.774 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.774 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.775 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:16.775 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.258767+0000", 2024-05-08T18:30:16.775 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010864409 2024-05-08T18:30:16.775 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.775 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.775 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:16.775 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.258898+0000", 2024-05-08T18:30:16.775 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000131199 2024-05-08T18:30:16.775 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.775 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.775 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:16.775 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.259117+0000", 2024-05-08T18:30:16.775 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000218889 2024-05-08T18:30:16.775 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.775 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.776 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:16.776 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.262372+0000", 2024-05-08T18:30:16.776 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032545679999999998 2024-05-08T18:30:16.776 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.776 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.776 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:16.776 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.262432+0000", 2024-05-08T18:30:16.776 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9913e-05 2024-05-08T18:30:16.776 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.776 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.776 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:16.776 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.262585+0000", 2024-05-08T18:30:16.776 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015361800000000001 2024-05-08T18:30:16.776 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.776 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.777 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:16.777 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.262723+0000", 2024-05-08T18:30:16.777 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000137856 2024-05-08T18:30:16.777 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:16.777 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:16.777 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:16.777 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.777 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.777 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:16.777 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247927+0000", 2024-05-08T18:30:16.777 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 49.475755818000003, 2024-05-08T18:30:16.777 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018387718000000001, 2024-05-08T18:30:16.777 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:16.777 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:16.778 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:16.778 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:16.778 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:16.778 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:16.778 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 48 2024-05-08T18:30:16.778 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.778 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:16.778 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.778 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:16.778 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247927+0000", 2024-05-08T18:30:16.778 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:16.778 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.778 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.778 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:16.778 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247927+0000", 2024-05-08T18:30:16.779 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:16.779 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.779 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.779 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:16.779 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247928+0000", 2024-05-08T18:30:16.779 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8400000000000003e-07 2024-05-08T18:30:16.779 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.779 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.779 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:16.779 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247935+0000", 2024-05-08T18:30:16.779 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1230000000000002e-06 2024-05-08T18:30:16.779 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.779 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.779 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:16.780 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247945+0000", 2024-05-08T18:30:16.780 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0346000000000001e-05 2024-05-08T18:30:16.780 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.780 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.780 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:16.780 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247953+0000", 2024-05-08T18:30:16.780 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8040000000000002e-06 2024-05-08T18:30:16.780 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.780 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.780 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:16.780 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261292+0000", 2024-05-08T18:30:16.780 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013339337 2024-05-08T18:30:16.780 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.780 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.781 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:16.781 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261424+0000", 2024-05-08T18:30:16.781 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013201900000000001 2024-05-08T18:30:16.781 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.781 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.781 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:16.781 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261628+0000", 2024-05-08T18:30:16.781 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020327499999999999 2024-05-08T18:30:16.781 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.781 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.781 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:16.781 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.263849+0000", 2024-05-08T18:30:16.781 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0022209759999999999 2024-05-08T18:30:16.781 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.781 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.782 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:16.782 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266167+0000", 2024-05-08T18:30:16.782 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002317979 2024-05-08T18:30:16.782 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.782 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.782 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:16.782 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266249+0000", 2024-05-08T18:30:16.782 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1996000000000006e-05 2024-05-08T18:30:16.782 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.782 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.782 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:16.782 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266315+0000", 2024-05-08T18:30:16.782 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5979e-05 2024-05-08T18:30:16.782 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:16.783 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:16.783 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:16.783 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.783 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.783 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:16.783 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247966+0000", 2024-05-08T18:30:16.783 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 49.475716884999997, 2024-05-08T18:30:16.783 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0194153, 2024-05-08T18:30:16.783 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:16.783 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:16.783 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:16.783 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:16.783 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:16.783 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:16.784 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 49 2024-05-08T18:30:16.784 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.784 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:16.784 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.784 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:16.784 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247966+0000", 2024-05-08T18:30:16.784 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:16.784 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.784 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.784 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:16.784 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247966+0000", 2024-05-08T18:30:16.784 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:16.784 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.784 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.784 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:16.785 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247967+0000", 2024-05-08T18:30:16.785 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0299999999999998e-07 2024-05-08T18:30:16.785 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.785 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.785 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:16.785 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247972+0000", 2024-05-08T18:30:16.785 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3600000000000004e-06 2024-05-08T18:30:16.785 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.785 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.785 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:16.785 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247981+0000", 2024-05-08T18:30:16.785 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.234e-06 2024-05-08T18:30:16.785 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.785 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.786 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:16.786 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247989+0000", 2024-05-08T18:30:16.786 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5159999999999997e-06 2024-05-08T18:30:16.786 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.786 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.786 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:16.786 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.262816+0000", 2024-05-08T18:30:16.786 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.014827399999999999 2024-05-08T18:30:16.786 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.786 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.786 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:16.786 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.262948+0000", 2024-05-08T18:30:16.786 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013166799999999999 2024-05-08T18:30:16.786 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.787 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.787 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:16.787 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.263153+0000", 2024-05-08T18:30:16.787 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000205272 2024-05-08T18:30:16.787 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.787 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.787 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:16.787 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266144+0000", 2024-05-08T18:30:16.787 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029912300000000001 2024-05-08T18:30:16.787 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.787 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.787 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:16.787 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.267226+0000", 2024-05-08T18:30:16.787 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010820580000000001 2024-05-08T18:30:16.787 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.788 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.788 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:16.788 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.267315+0000", 2024-05-08T18:30:16.788 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8793000000000002e-05 2024-05-08T18:30:16.788 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.788 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.788 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:16.788 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.267381+0000", 2024-05-08T18:30:16.788 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6066000000000001e-05 2024-05-08T18:30:16.788 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:16.788 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:16.788 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:16.788 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.788 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.788 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:16.789 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.248003+0000", 2024-05-08T18:30:16.789 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 49.475679585000002, 2024-05-08T18:30:16.789 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.020859638999999999, 2024-05-08T18:30:16.789 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:16.789 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:16.789 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:16.789 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:16.789 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:16.789 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:16.789 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 50 2024-05-08T18:30:16.789 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.789 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:16.789 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.789 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:16.790 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248003+0000", 2024-05-08T18:30:16.790 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:16.790 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.790 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.790 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:16.790 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248003+0000", 2024-05-08T18:30:16.790 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:16.790 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.790 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.790 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:16.790 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248004+0000", 2024-05-08T18:30:16.790 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5300000000000003e-07 2024-05-08T18:30:16.790 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.791 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.791 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:16.791 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248139+0000", 2024-05-08T18:30:16.791 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000135193 2024-05-08T18:30:16.791 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.791 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.791 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:16.791 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248151+0000", 2024-05-08T18:30:16.791 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.19e-05 2024-05-08T18:30:16.791 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.791 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.791 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:16.791 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248161+0000", 2024-05-08T18:30:16.791 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4599999999999992e-06 2024-05-08T18:30:16.792 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.792 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.792 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:16.792 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.263961+0000", 2024-05-08T18:30:16.792 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015800844000000001 2024-05-08T18:30:16.792 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.792 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.792 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:16.792 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.264091+0000", 2024-05-08T18:30:16.792 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012952300000000001 2024-05-08T18:30:16.792 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.792 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.792 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:16.792 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.264306+0000", 2024-05-08T18:30:16.793 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000215541 2024-05-08T18:30:16.793 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.793 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.793 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:16.793 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.267205+0000", 2024-05-08T18:30:16.793 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0028989910000000001 2024-05-08T18:30:16.793 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.793 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.793 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:16.793 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.268631+0000", 2024-05-08T18:30:16.793 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0014257320000000001 2024-05-08T18:30:16.793 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.793 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.793 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:16.793 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.268781+0000", 2024-05-08T18:30:16.794 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000149939 2024-05-08T18:30:16.794 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.794 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.794 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:16.794 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.268863+0000", 2024-05-08T18:30:16.794 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1762999999999996e-05 2024-05-08T18:30:16.794 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:16.794 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:16.794 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:16.794 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.794 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.794 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:16.794 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.248201+0000", 2024-05-08T18:30:16.795 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 49.47548183, 2024-05-08T18:30:16.795 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.022909783, 2024-05-08T18:30:16.795 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:16.795 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:16.795 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:16.795 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:16.795 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:16.795 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:16.795 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 51 2024-05-08T18:30:16.795 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.795 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:16.795 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.795 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:16.795 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248201+0000", 2024-05-08T18:30:16.796 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:16.796 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.796 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.796 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:16.796 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248201+0000", 2024-05-08T18:30:16.796 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:16.796 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.796 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.796 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:16.796 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248202+0000", 2024-05-08T18:30:16.796 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2999999999999999e-07 2024-05-08T18:30:16.796 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.796 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.796 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:16.796 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248209+0000", 2024-05-08T18:30:16.797 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5769999999999996e-06 2024-05-08T18:30:16.797 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.797 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.797 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:16.797 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248221+0000", 2024-05-08T18:30:16.797 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1165999999999999e-05 2024-05-08T18:30:16.797 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.797 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.797 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:16.797 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248229+0000", 2024-05-08T18:30:16.797 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1529999999999997e-06 2024-05-08T18:30:16.797 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.797 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.797 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:16.798 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.265146+0000", 2024-05-08T18:30:16.798 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016917492999999999 2024-05-08T18:30:16.798 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.798 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.798 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:16.798 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.265282+0000", 2024-05-08T18:30:16.798 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013597199999999999 2024-05-08T18:30:16.798 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.798 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.798 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:16.798 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.265488+0000", 2024-05-08T18:30:16.798 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000206212 2024-05-08T18:30:16.798 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.798 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.799 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:16.799 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.268442+0000", 2024-05-08T18:30:16.799 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002953841 2024-05-08T18:30:16.799 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.799 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.799 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:16.799 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.270951+0000", 2024-05-08T18:30:16.799 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0025085670000000002 2024-05-08T18:30:16.799 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.799 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.799 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:16.799 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.271042+0000", 2024-05-08T18:30:16.799 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1485999999999998e-05 2024-05-08T18:30:16.799 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.799 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.800 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:16.800 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.271111+0000", 2024-05-08T18:30:16.800 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8386000000000006e-05 2024-05-08T18:30:16.800 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:16.800 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:16.800 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:16.800 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.800 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.800 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:16.800 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.248244+0000", 2024-05-08T18:30:16.800 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 49.475439274000003, 2024-05-08T18:30:16.800 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.023010806000000002, 2024-05-08T18:30:16.800 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:16.800 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:16.801 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:16.801 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:16.801 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:16.801 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:16.801 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 52 2024-05-08T18:30:16.801 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.801 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:16.801 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.801 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:16.801 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248244+0000", 2024-05-08T18:30:16.801 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:16.801 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.801 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.801 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:16.801 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248244+0000", 2024-05-08T18:30:16.802 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:16.802 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.802 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.802 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:16.802 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248244+0000", 2024-05-08T18:30:16.802 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0999999999999998e-07 2024-05-08T18:30:16.802 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.802 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.802 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:16.802 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248251+0000", 2024-05-08T18:30:16.802 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9639999999999997e-06 2024-05-08T18:30:16.802 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.802 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.803 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:16.803 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248266+0000", 2024-05-08T18:30:16.803 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4996e-05 2024-05-08T18:30:16.803 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.803 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.803 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:16.803 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248274+0000", 2024-05-08T18:30:16.803 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8299999999999996e-06 2024-05-08T18:30:16.803 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.803 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.803 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:16.803 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266367+0000", 2024-05-08T18:30:16.803 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018092607 2024-05-08T18:30:16.803 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.803 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.804 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:16.804 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266532+0000", 2024-05-08T18:30:16.804 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016569600000000001 2024-05-08T18:30:16.804 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.804 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.804 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:16.804 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266729+0000", 2024-05-08T18:30:16.804 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00019630099999999999 2024-05-08T18:30:16.804 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.804 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.804 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:16.804 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.268574+0000", 2024-05-08T18:30:16.804 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0018452329999999999 2024-05-08T18:30:16.804 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.804 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.805 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:16.805 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.271128+0000", 2024-05-08T18:30:16.805 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00255369 2024-05-08T18:30:16.805 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.805 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.805 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:16.805 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.271199+0000", 2024-05-08T18:30:16.805 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1712999999999996e-05 2024-05-08T18:30:16.805 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.805 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.805 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:16.805 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.271254+0000", 2024-05-08T18:30:16.805 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5065999999999998e-05 2024-05-08T18:30:16.806 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:16.806 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:16.806 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:16.806 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.806 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.806 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:16.806 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.486052+0000", 2024-05-08T18:30:16.806 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 49.237630830000001, 2024-05-08T18:30:16.806 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0098898389999999992, 2024-05-08T18:30:16.806 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:16.806 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:16.806 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:16.806 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:16.806 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:16.807 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:16.807 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 72 2024-05-08T18:30:16.807 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.807 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:16.807 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.807 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:16.807 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486052+0000", 2024-05-08T18:30:16.807 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:16.807 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.807 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.807 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:16.807 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486052+0000", 2024-05-08T18:30:16.807 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:16.807 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.807 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.808 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:16.808 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486053+0000", 2024-05-08T18:30:16.808 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1200000000000001e-07 2024-05-08T18:30:16.808 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.808 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.808 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:16.808 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486188+0000", 2024-05-08T18:30:16.808 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013526200000000001 2024-05-08T18:30:16.808 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.808 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.808 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:16.808 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486205+0000", 2024-05-08T18:30:16.808 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6742e-05 2024-05-08T18:30:16.809 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.809 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.809 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:16.809 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486215+0000", 2024-05-08T18:30:16.809 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8290000000000003e-06 2024-05-08T18:30:16.809 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.809 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.809 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:16.809 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.491930+0000", 2024-05-08T18:30:16.809 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0057153660000000004 2024-05-08T18:30:16.809 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.809 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.809 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:16.809 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.491995+0000", 2024-05-08T18:30:16.810 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5289000000000005e-05 2024-05-08T18:30:16.810 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.810 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.810 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:16.810 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.492096+0000", 2024-05-08T18:30:16.810 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010101400000000001 2024-05-08T18:30:16.810 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.810 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.810 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:16.810 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.494152+0000", 2024-05-08T18:30:16.810 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0020560740000000002 2024-05-08T18:30:16.810 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.810 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.810 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:16.811 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.495860+0000", 2024-05-08T18:30:16.811 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0017076159999999999 2024-05-08T18:30:16.811 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.811 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.811 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:16.811 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.495903+0000", 2024-05-08T18:30:16.811 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3009000000000001e-05 2024-05-08T18:30:16.811 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.811 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.811 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:16.811 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.495942+0000", 2024-05-08T18:30:16.811 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8726000000000002e-05 2024-05-08T18:30:16.811 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:16.811 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:16.812 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:16.812 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.812 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.812 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:16.812 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.486234+0000", 2024-05-08T18:30:16.812 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 49.237448762, 2024-05-08T18:30:16.812 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0099742340000000002, 2024-05-08T18:30:16.812 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:16.812 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:16.812 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:16.812 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:16.812 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:16.812 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:16.812 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 73 2024-05-08T18:30:16.812 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.813 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:16.813 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.813 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:16.813 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486234+0000", 2024-05-08T18:30:16.813 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:16.813 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.813 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.813 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:16.813 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486234+0000", 2024-05-08T18:30:16.813 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:16.813 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.813 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.813 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:16.813 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486235+0000", 2024-05-08T18:30:16.814 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.108e-06 2024-05-08T18:30:16.814 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.814 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.814 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:16.814 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486241+0000", 2024-05-08T18:30:16.814 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4e-06 2024-05-08T18:30:16.814 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.814 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.814 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:16.814 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486251+0000", 2024-05-08T18:30:16.814 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0209e-05 2024-05-08T18:30:16.814 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.814 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.814 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:16.815 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486260+0000", 2024-05-08T18:30:16.815 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2709999999999998e-06 2024-05-08T18:30:16.815 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.815 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.815 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:16.815 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.493294+0000", 2024-05-08T18:30:16.815 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0070341070000000004 2024-05-08T18:30:16.815 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.815 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.815 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:16.815 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.493370+0000", 2024-05-08T18:30:16.815 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5846999999999994e-05 2024-05-08T18:30:16.815 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.815 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.815 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:16.816 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.493479+0000", 2024-05-08T18:30:16.816 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010905500000000001 2024-05-08T18:30:16.816 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.816 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.816 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:16.816 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.495950+0000", 2024-05-08T18:30:16.816 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0024709749999999998 2024-05-08T18:30:16.816 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.816 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.816 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:16.816 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496023+0000", 2024-05-08T18:30:16.816 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3071999999999994e-05 2024-05-08T18:30:16.816 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.816 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.817 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:16.817 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496091+0000", 2024-05-08T18:30:16.817 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7646999999999998e-05 2024-05-08T18:30:16.817 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.817 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.817 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:16.817 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496208+0000", 2024-05-08T18:30:16.817 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000117543 2024-05-08T18:30:16.817 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:16.817 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:16.817 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:16.817 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.817 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.817 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:16.818 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.486276+0000", 2024-05-08T18:30:16.818 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 49.237406436999997, 2024-05-08T18:30:16.818 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010822577, 2024-05-08T18:30:16.818 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:16.818 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:16.818 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:16.818 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:16.818 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:16.818 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:16.818 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 74 2024-05-08T18:30:16.818 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.818 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:16.818 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.818 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:16.819 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486276+0000", 2024-05-08T18:30:16.819 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:16.819 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.819 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.819 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:16.819 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486276+0000", 2024-05-08T18:30:16.819 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:16.819 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.819 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.819 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:16.819 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486277+0000", 2024-05-08T18:30:16.819 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1699999999999997e-07 2024-05-08T18:30:16.819 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.819 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.820 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:16.820 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486282+0000", 2024-05-08T18:30:16.820 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0429999999999998e-06 2024-05-08T18:30:16.820 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.820 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.820 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:16.820 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486294+0000", 2024-05-08T18:30:16.820 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1717e-05 2024-05-08T18:30:16.820 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.820 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.820 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:16.820 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486303+0000", 2024-05-08T18:30:16.820 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.3999999999999998e-06 2024-05-08T18:30:16.820 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.821 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.821 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:16.821 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.494424+0000", 2024-05-08T18:30:16.821 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0081205960000000008 2024-05-08T18:30:16.821 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.821 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.821 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:16.821 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.494539+0000", 2024-05-08T18:30:16.821 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000115661 2024-05-08T18:30:16.821 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.821 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.821 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:16.821 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.494704+0000", 2024-05-08T18:30:16.821 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016422999999999999 2024-05-08T18:30:16.822 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.822 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.822 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:16.822 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496800+0000", 2024-05-08T18:30:16.822 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002096508 2024-05-08T18:30:16.822 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.822 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.822 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:16.822 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496889+0000", 2024-05-08T18:30:16.822 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8349000000000004e-05 2024-05-08T18:30:16.822 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.822 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.822 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:16.822 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496983+0000", 2024-05-08T18:30:16.823 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4882000000000004e-05 2024-05-08T18:30:16.823 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.823 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.823 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:16.823 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.497099+0000", 2024-05-08T18:30:16.823 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000115474 2024-05-08T18:30:16.823 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:16.823 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:16.823 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:16.823 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.823 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.823 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:16.823 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.486324+0000", 2024-05-08T18:30:16.823 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 49.237358417000003, 2024-05-08T18:30:16.824 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010949207000000001, 2024-05-08T18:30:16.824 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:16.824 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:16.824 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:16.824 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:16.824 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:16.824 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:16.824 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 75 2024-05-08T18:30:16.824 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.824 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:16.824 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.824 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:16.824 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486324+0000", 2024-05-08T18:30:16.824 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:16.825 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.825 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.825 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:16.825 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486324+0000", 2024-05-08T18:30:16.825 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:16.825 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.825 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.825 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:16.825 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486325+0000", 2024-05-08T18:30:16.825 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6200000000000006e-07 2024-05-08T18:30:16.825 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.825 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.825 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:16.825 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486439+0000", 2024-05-08T18:30:16.825 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000113391 2024-05-08T18:30:16.826 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.826 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.826 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:16.826 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486455+0000", 2024-05-08T18:30:16.826 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5823000000000001e-05 2024-05-08T18:30:16.826 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.826 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.826 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:16.826 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486465+0000", 2024-05-08T18:30:16.826 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0879999999999999e-05 2024-05-08T18:30:16.826 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.826 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.826 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:16.826 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.495149+0000", 2024-05-08T18:30:16.827 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0086833589999999999 2024-05-08T18:30:16.827 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.827 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.827 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:16.827 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.495213+0000", 2024-05-08T18:30:16.827 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4176000000000004e-05 2024-05-08T18:30:16.827 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.827 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.827 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:16.827 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.495350+0000", 2024-05-08T18:30:16.827 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013709099999999999 2024-05-08T18:30:16.827 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.827 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.827 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:16.827 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496809+0000", 2024-05-08T18:30:16.828 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001458953 2024-05-08T18:30:16.828 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.828 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.828 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:16.828 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.497199+0000", 2024-05-08T18:30:16.828 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00039045200000000001 2024-05-08T18:30:16.828 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.828 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.828 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:16.828 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.497241+0000", 2024-05-08T18:30:16.828 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1378999999999998e-05 2024-05-08T18:30:16.828 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.828 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.828 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:16.829 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.497274+0000", 2024-05-08T18:30:16.829 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2740999999999997e-05 2024-05-08T18:30:16.829 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:16.829 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:16.829 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:16.829 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.829 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.829 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:16.829 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.486483+0000", 2024-05-08T18:30:16.829 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 49.237200242, 2024-05-08T18:30:16.829 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011783448, 2024-05-08T18:30:16.829 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:16.829 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:16.829 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:16.829 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:16.830 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:16.830 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:16.830 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 76 2024-05-08T18:30:16.830 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.830 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:16.830 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.830 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:16.830 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486483+0000", 2024-05-08T18:30:16.830 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:16.830 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.830 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.830 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:16.830 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486483+0000", 2024-05-08T18:30:16.831 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:16.831 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.831 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.831 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:16.831 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486483+0000", 2024-05-08T18:30:16.831 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6599999999999995e-07 2024-05-08T18:30:16.831 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.831 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.831 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:16.831 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486491+0000", 2024-05-08T18:30:16.831 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.2520000000000002e-06 2024-05-08T18:30:16.831 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.831 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.831 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:16.832 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486500+0000", 2024-05-08T18:30:16.832 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4420000000000004e-06 2024-05-08T18:30:16.832 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.832 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.832 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:16.832 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486507+0000", 2024-05-08T18:30:16.832 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3549999999999999e-06 2024-05-08T18:30:16.832 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.832 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.832 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:16.832 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496319+0000", 2024-05-08T18:30:16.832 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0098120529999999994 2024-05-08T18:30:16.832 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.832 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.833 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:16.833 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496391+0000", 2024-05-08T18:30:16.833 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1433000000000005e-05 2024-05-08T18:30:16.833 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.833 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.833 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:16.833 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496508+0000", 2024-05-08T18:30:16.833 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000116778 2024-05-08T18:30:16.833 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.833 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.833 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:16.833 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.497284+0000", 2024-05-08T18:30:16.833 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00077609100000000002 2024-05-08T18:30:16.833 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.834 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.834 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:16.834 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.498204+0000", 2024-05-08T18:30:16.834 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00092027299999999999 2024-05-08T18:30:16.834 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.834 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.834 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:16.834 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.498240+0000", 2024-05-08T18:30:16.834 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5979999999999998e-05 2024-05-08T18:30:16.834 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.834 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.834 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:16.834 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.498266+0000", 2024-05-08T18:30:16.835 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6024999999999999e-05 2024-05-08T18:30:16.835 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:16.835 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:16.835 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:16.835 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.835 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.835 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:94 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:16.835 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.842580+0000", 2024-05-08T18:30:16.835 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 48.881102941000002, 2024-05-08T18:30:16.835 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0085315870000000002, 2024-05-08T18:30:16.835 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:16.835 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:16.835 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:16.835 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:16.836 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:16.836 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:16.836 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 94 2024-05-08T18:30:16.836 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.836 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:16.836 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.836 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:16.836 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.842580+0000", 2024-05-08T18:30:16.836 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:16.836 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.836 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.836 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:16.836 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.842580+0000", 2024-05-08T18:30:16.836 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:16.836 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.837 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.837 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:16.837 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.842581+0000", 2024-05-08T18:30:16.837 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.11e-06 2024-05-08T18:30:16.837 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.837 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.837 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:16.837 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.842587+0000", 2024-05-08T18:30:16.837 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2899999999999999e-06 2024-05-08T18:30:16.837 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.837 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.837 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:16.837 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.842597+0000", 2024-05-08T18:30:16.837 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.007e-05 2024-05-08T18:30:16.837 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.838 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.838 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:16.838 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.842605+0000", 2024-05-08T18:30:16.838 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1270000000000003e-06 2024-05-08T18:30:16.838 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.838 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.838 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:16.838 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.848358+0000", 2024-05-08T18:30:16.838 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0057525140000000002 2024-05-08T18:30:16.838 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.838 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.838 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:16.838 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.848481+0000", 2024-05-08T18:30:16.839 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000123239 2024-05-08T18:30:16.839 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.839 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.839 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:16.839 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.848695+0000", 2024-05-08T18:30:16.839 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000213387 2024-05-08T18:30:16.839 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.839 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.839 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:16.839 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.849781+0000", 2024-05-08T18:30:16.839 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010868 2024-05-08T18:30:16.839 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.839 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.839 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:16.839 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.850990+0000", 2024-05-08T18:30:16.840 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0012084769999999999 2024-05-08T18:30:16.840 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.840 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.840 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:16.840 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.851059+0000", 2024-05-08T18:30:16.840 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9130999999999999e-05 2024-05-08T18:30:16.840 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:16.840 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:16.840 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:16.840 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.851111+0000", 2024-05-08T18:30:16.840 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2441999999999997e-05 2024-05-08T18:30:16.840 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:16.840 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:16.840 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:16.841 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:16.841 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:16.841 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:30:16.842 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-08T18:30:16.843 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:30:16.845+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:30:16.943 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:30:16.945+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:30:16.977 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:30:16.977 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:30:16.977 INFO:teuthology.orchestra.run.smithi097.stdout: "num_ops": 0 2024-05-08T18:30:16.977 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:30:16.991 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-08T18:30:17.045 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:30:17.044+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:30:17.145 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:30:17.144+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:30:17.159 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:30:17.159 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:30:17.159 INFO:teuthology.orchestra.run.smithi097.stdout: "complaint_time": 30, 2024-05-08T18:30:17.159 INFO:teuthology.orchestra.run.smithi097.stdout: "num_blocked_ops": 0 2024-05-08T18:30:17.159 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:30:17.173 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-08T18:30:17.247 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:30:17.249+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:30:17.295 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:30:17.296 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2024-05-08T18:30:17.296 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2024-05-08T18:30:17.296 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-05-08T18:30:17.296 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.296 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4206.0:24 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'14, mlcod=16'9)", 2024-05-08T18:30:17.296 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:27.162224+0000", 2024-05-08T18:30:17.296 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 50.134079006999997, 2024-05-08T18:30:17.296 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032712890000000001, 2024-05-08T18:30:17.296 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:17.296 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:17.296 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:17.297 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:17.297 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.297 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:17.297 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162224+0000", 2024-05-08T18:30:17.297 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:17.297 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.297 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.297 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:17.297 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162224+0000", 2024-05-08T18:30:17.297 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:17.297 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.297 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.297 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:17.297 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162225+0000", 2024-05-08T18:30:17.298 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4899999999999999e-06 2024-05-08T18:30:17.298 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.298 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.298 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:17.298 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162306+0000", 2024-05-08T18:30:17.298 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.0589999999999999e-05 2024-05-08T18:30:17.298 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.298 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.298 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:17.298 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162332+0000", 2024-05-08T18:30:17.298 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5658999999999999e-05 2024-05-08T18:30:17.298 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.298 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.299 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:17.299 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162345+0000", 2024-05-08T18:30:17.299 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3512999999999999e-05 2024-05-08T18:30:17.299 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.299 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.299 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:17.299 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162465+0000", 2024-05-08T18:30:17.299 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000119577 2024-05-08T18:30:17.299 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.299 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.299 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:17.299 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162513+0000", 2024-05-08T18:30:17.299 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8773999999999998e-05 2024-05-08T18:30:17.300 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.300 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.300 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:17.300 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.165405+0000", 2024-05-08T18:30:17.300 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028919200000000001 2024-05-08T18:30:17.300 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.300 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.300 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:17.300 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.165495+0000", 2024-05-08T18:30:17.300 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9765999999999994e-05 2024-05-08T18:30:17.300 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:17.300 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:17.300 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:17.300 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.301 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.301 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4206.0:25 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'15, mlcod=16'10)", 2024-05-08T18:30:17.301 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:27.164793+0000", 2024-05-08T18:30:17.301 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 50.131509878999999, 2024-05-08T18:30:17.301 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032285249999999999, 2024-05-08T18:30:17.301 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:17.301 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:17.301 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:17.301 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:17.301 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.301 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:17.301 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164793+0000", 2024-05-08T18:30:17.301 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:17.301 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.302 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.302 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:17.302 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164793+0000", 2024-05-08T18:30:17.302 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:17.302 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.302 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.302 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:17.302 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164795+0000", 2024-05-08T18:30:17.302 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0999999999999998e-06 2024-05-08T18:30:17.302 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.302 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.302 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:17.302 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164811+0000", 2024-05-08T18:30:17.303 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5722999999999998e-05 2024-05-08T18:30:17.303 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.303 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.303 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:17.303 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164841+0000", 2024-05-08T18:30:17.303 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0355999999999999e-05 2024-05-08T18:30:17.303 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.303 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.303 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:17.303 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164861+0000", 2024-05-08T18:30:17.303 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9533000000000001e-05 2024-05-08T18:30:17.303 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.303 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.303 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:17.303 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164984+0000", 2024-05-08T18:30:17.304 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000123146 2024-05-08T18:30:17.304 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.304 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.304 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:17.304 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.165024+0000", 2024-05-08T18:30:17.304 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9690000000000001e-05 2024-05-08T18:30:17.304 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.304 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.304 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:17.304 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.167935+0000", 2024-05-08T18:30:17.304 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0029113300000000002 2024-05-08T18:30:17.304 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.304 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.304 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:17.305 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.168021+0000", 2024-05-08T18:30:17.305 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6646999999999999e-05 2024-05-08T18:30:17.305 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:17.305 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:17.305 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:17.305 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.305 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.305 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:30:17.305 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:48.674737+0000", 2024-05-08T18:30:17.305 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 28.621565961000002, 2024-05-08T18:30:17.305 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0035019780000000002, 2024-05-08T18:30:17.305 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:17.305 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:17.305 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:17.306 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:17.306 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:17.306 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:17.306 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 60 2024-05-08T18:30:17.306 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.306 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:17.306 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.306 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:17.306 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674737+0000", 2024-05-08T18:30:17.306 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:17.306 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.306 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.306 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:17.306 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674737+0000", 2024-05-08T18:30:17.306 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:17.307 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.307 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.307 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:17.307 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674740+0000", 2024-05-08T18:30:17.307 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.36e-06 2024-05-08T18:30:17.307 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.307 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.307 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:17.307 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674753+0000", 2024-05-08T18:30:17.307 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3151e-05 2024-05-08T18:30:17.307 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.307 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.307 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:17.307 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674789+0000", 2024-05-08T18:30:17.308 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5929000000000001e-05 2024-05-08T18:30:17.308 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.308 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.308 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:17.308 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674813+0000", 2024-05-08T18:30:17.308 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3325000000000001e-05 2024-05-08T18:30:17.308 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.308 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.308 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:17.308 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674981+0000", 2024-05-08T18:30:17.308 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016879899999999999 2024-05-08T18:30:17.308 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.308 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.308 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:17.309 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.675304+0000", 2024-05-08T18:30:17.309 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00032214400000000001 2024-05-08T18:30:17.309 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.309 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.309 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:17.309 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.675639+0000", 2024-05-08T18:30:17.309 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00033494699999999999 2024-05-08T18:30:17.309 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.309 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.309 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:17.309 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.676901+0000", 2024-05-08T18:30:17.309 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001262167 2024-05-08T18:30:17.309 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.309 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.309 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:17.310 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678078+0000", 2024-05-08T18:30:17.310 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001177588 2024-05-08T18:30:17.310 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.310 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.310 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:17.310 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678171+0000", 2024-05-08T18:30:17.310 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.2331999999999996e-05 2024-05-08T18:30:17.310 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.310 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.310 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:17.310 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678239+0000", 2024-05-08T18:30:17.310 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8236000000000002e-05 2024-05-08T18:30:17.310 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:17.311 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:17.311 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:17.311 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.311 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.311 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:61 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94069412632064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:30:17.311 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:48.678410+0000", 2024-05-08T18:30:17.311 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 28.617892568999999, 2024-05-08T18:30:17.311 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0026001800000000001, 2024-05-08T18:30:17.311 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:17.311 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:17.311 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:17.311 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:17.311 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:17.312 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:17.312 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 61 2024-05-08T18:30:17.312 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.312 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:17.312 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.312 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:17.312 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678410+0000", 2024-05-08T18:30:17.312 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:17.312 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.312 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.312 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:17.312 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678410+0000", 2024-05-08T18:30:17.312 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:17.313 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.313 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.313 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:17.313 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678413+0000", 2024-05-08T18:30:17.313 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.34e-06 2024-05-08T18:30:17.313 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.313 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.313 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:17.313 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678421+0000", 2024-05-08T18:30:17.313 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6910000000000003e-06 2024-05-08T18:30:17.313 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.313 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.313 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:17.313 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678447+0000", 2024-05-08T18:30:17.314 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6010999999999999e-05 2024-05-08T18:30:17.314 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.314 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.314 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:17.314 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678461+0000", 2024-05-08T18:30:17.314 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3900000000000001e-05 2024-05-08T18:30:17.314 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.314 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.314 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:17.314 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678560+0000", 2024-05-08T18:30:17.314 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.8834999999999998e-05 2024-05-08T18:30:17.314 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.314 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.314 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:17.314 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678704+0000", 2024-05-08T18:30:17.315 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000143769 2024-05-08T18:30:17.315 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.315 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.315 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:17.315 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678942+0000", 2024-05-08T18:30:17.315 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023861800000000001 2024-05-08T18:30:17.315 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.315 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.315 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:17.315 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.680269+0000", 2024-05-08T18:30:17.315 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001326484 2024-05-08T18:30:17.315 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.315 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.315 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:17.316 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.680823+0000", 2024-05-08T18:30:17.316 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00055455900000000004 2024-05-08T18:30:17.316 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.316 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.316 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:17.316 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.680908+0000", 2024-05-08T18:30:17.316 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.4073999999999995e-05 2024-05-08T18:30:17.316 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.316 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.316 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:17.316 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.681010+0000", 2024-05-08T18:30:17.316 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010289900000000001 2024-05-08T18:30:17.316 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:17.316 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:17.317 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:17.317 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.317 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.317 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:30:17.317 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.671896+0000", 2024-05-08T18:30:17.317 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 25.624406684, 2024-05-08T18:30:17.317 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032352349999999999, 2024-05-08T18:30:17.317 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:17.317 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:17.317 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:17.317 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:17.317 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:17.317 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:17.317 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 206 2024-05-08T18:30:17.318 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.318 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:17.318 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.318 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:17.318 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671896+0000", 2024-05-08T18:30:17.318 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:17.318 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.318 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.318 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:17.318 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671896+0000", 2024-05-08T18:30:17.318 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:17.318 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.318 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.318 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:17.319 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671901+0000", 2024-05-08T18:30:17.319 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.763e-06 2024-05-08T18:30:17.319 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.319 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.319 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:17.319 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671920+0000", 2024-05-08T18:30:17.319 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9403e-05 2024-05-08T18:30:17.319 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.319 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.319 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:17.319 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671969+0000", 2024-05-08T18:30:17.319 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8343000000000001e-05 2024-05-08T18:30:17.319 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.319 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.320 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:17.320 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671996+0000", 2024-05-08T18:30:17.320 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7307000000000001e-05 2024-05-08T18:30:17.320 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.320 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.320 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:17.320 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.672149+0000", 2024-05-08T18:30:17.320 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015336500000000001 2024-05-08T18:30:17.320 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.320 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.320 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:17.320 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.672393+0000", 2024-05-08T18:30:17.320 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024380800000000001 2024-05-08T18:30:17.320 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.321 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.321 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:17.321 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.672838+0000", 2024-05-08T18:30:17.321 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00044472700000000001 2024-05-08T18:30:17.321 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.321 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.321 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:17.321 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.674218+0000", 2024-05-08T18:30:17.321 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001380243 2024-05-08T18:30:17.321 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.321 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.321 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:17.321 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.674963+0000", 2024-05-08T18:30:17.321 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00074534999999999998 2024-05-08T18:30:17.321 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.322 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.322 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:17.322 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675057+0000", 2024-05-08T18:30:17.322 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.3633000000000003e-05 2024-05-08T18:30:17.322 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.322 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.322 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:17.322 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675131+0000", 2024-05-08T18:30:17.322 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.4293000000000002e-05 2024-05-08T18:30:17.322 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:17.322 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:17.322 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:17.322 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.322 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.323 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:17.323 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.694194+0000", 2024-05-08T18:30:17.323 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 25.602109286000001, 2024-05-08T18:30:17.323 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0087385129999999998, 2024-05-08T18:30:17.323 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:17.323 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:17.323 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:17.323 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:17.323 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:17.323 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:17.323 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 210 2024-05-08T18:30:17.323 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.324 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:17.324 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.324 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:17.324 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694194+0000", 2024-05-08T18:30:17.324 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:17.324 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.324 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.324 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:17.324 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694194+0000", 2024-05-08T18:30:17.324 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:17.324 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.324 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.324 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:17.324 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694196+0000", 2024-05-08T18:30:17.324 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6299999999999998e-06 2024-05-08T18:30:17.325 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.325 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.325 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:17.325 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694208+0000", 2024-05-08T18:30:17.325 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.187e-05 2024-05-08T18:30:17.325 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.325 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.325 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:17.325 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694240+0000", 2024-05-08T18:30:17.325 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1673e-05 2024-05-08T18:30:17.325 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.325 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.325 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:17.326 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694255+0000", 2024-05-08T18:30:17.326 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5573000000000002e-05 2024-05-08T18:30:17.326 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.326 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.326 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:17.326 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694394+0000", 2024-05-08T18:30:17.326 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000138536 2024-05-08T18:30:17.326 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.326 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.326 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-05-08T18:30:17.326 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694405+0000", 2024-05-08T18:30:17.326 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0883000000000001e-05 2024-05-08T18:30:17.326 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.327 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.327 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:17.327 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.699491+0000", 2024-05-08T18:30:17.327 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0050861939999999996 2024-05-08T18:30:17.327 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.327 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.327 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:17.327 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.699829+0000", 2024-05-08T18:30:17.327 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000338191 2024-05-08T18:30:17.327 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.327 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.327 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:30:17.327 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.700504+0000", 2024-05-08T18:30:17.327 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000674481 2024-05-08T18:30:17.328 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.328 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.328 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:17.328 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.702152+0000", 2024-05-08T18:30:17.328 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0016487450000000001 2024-05-08T18:30:17.328 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.328 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.328 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:17.328 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.702792+0000", 2024-05-08T18:30:17.328 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00063962800000000005 2024-05-08T18:30:17.328 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.328 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.328 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:17.329 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.702874+0000", 2024-05-08T18:30:17.329 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.2091999999999999e-05 2024-05-08T18:30:17.329 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.329 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.329 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:17.329 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.702932+0000", 2024-05-08T18:30:17.329 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8016999999999997e-05 2024-05-08T18:30:17.329 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:17.329 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:17.329 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:17.329 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.329 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.329 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:17.330 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.728239+0000", 2024-05-08T18:30:17.330 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 25.568063424999998, 2024-05-08T18:30:17.330 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0035376119999999999, 2024-05-08T18:30:17.330 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:17.330 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:17.330 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:17.330 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:17.330 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:17.330 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:17.330 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 218 2024-05-08T18:30:17.330 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.330 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:17.330 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.330 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:17.331 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728239+0000", 2024-05-08T18:30:17.331 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:17.331 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.331 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.331 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:17.331 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728239+0000", 2024-05-08T18:30:17.331 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:17.331 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.331 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.331 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:17.331 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728242+0000", 2024-05-08T18:30:17.331 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0130000000000002e-06 2024-05-08T18:30:17.331 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.331 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.332 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:17.332 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728254+0000", 2024-05-08T18:30:17.332 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.172e-05 2024-05-08T18:30:17.332 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.332 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.332 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:17.332 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728285+0000", 2024-05-08T18:30:17.332 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0703000000000001e-05 2024-05-08T18:30:17.332 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.332 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.332 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:17.332 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728301+0000", 2024-05-08T18:30:17.332 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5656999999999999e-05 2024-05-08T18:30:17.332 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.333 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.333 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:17.333 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728460+0000", 2024-05-08T18:30:17.333 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015934200000000001 2024-05-08T18:30:17.333 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.333 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.333 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:17.333 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728803+0000", 2024-05-08T18:30:17.333 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00034267400000000001 2024-05-08T18:30:17.333 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.333 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.333 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:17.333 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.729485+0000", 2024-05-08T18:30:17.334 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00068206799999999998 2024-05-08T18:30:17.334 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.334 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.334 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:17.334 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731218+0000", 2024-05-08T18:30:17.334 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0017332630000000001 2024-05-08T18:30:17.334 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.334 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.334 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:17.334 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731615+0000", 2024-05-08T18:30:17.334 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00039671699999999999 2024-05-08T18:30:17.334 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.334 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.334 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:17.335 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731709+0000", 2024-05-08T18:30:17.335 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.4740000000000004e-05 2024-05-08T18:30:17.335 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.335 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.335 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:17.335 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731777+0000", 2024-05-08T18:30:17.335 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7714999999999998e-05 2024-05-08T18:30:17.335 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:17.335 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:17.335 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:17.335 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.335 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.335 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:17.335 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.743331+0000", 2024-05-08T18:30:17.335 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 25.552971442, 2024-05-08T18:30:17.336 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031193229999999998, 2024-05-08T18:30:17.336 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:17.336 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:17.336 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:17.336 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:17.336 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:17.336 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:17.336 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 222 2024-05-08T18:30:17.336 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.336 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:17.336 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.336 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:17.336 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743331+0000", 2024-05-08T18:30:17.336 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:17.337 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.337 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.337 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:17.337 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743331+0000", 2024-05-08T18:30:17.337 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:17.337 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.337 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.337 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:17.337 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743334+0000", 2024-05-08T18:30:17.337 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2900000000000001e-06 2024-05-08T18:30:17.337 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.337 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.337 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:17.338 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743345+0000", 2024-05-08T18:30:17.338 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0947e-05 2024-05-08T18:30:17.338 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.338 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.338 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:17.338 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743375+0000", 2024-05-08T18:30:17.338 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0298999999999999e-05 2024-05-08T18:30:17.338 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.338 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.338 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:17.338 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743390+0000", 2024-05-08T18:30:17.338 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4606999999999999e-05 2024-05-08T18:30:17.338 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.339 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.339 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:17.339 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743524+0000", 2024-05-08T18:30:17.339 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000134105 2024-05-08T18:30:17.339 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.339 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.339 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:17.339 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743738+0000", 2024-05-08T18:30:17.339 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000214222 2024-05-08T18:30:17.339 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.339 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.339 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:30:17.339 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.744159+0000", 2024-05-08T18:30:17.339 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00042102300000000002 2024-05-08T18:30:17.340 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.340 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.340 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:17.340 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.745399+0000", 2024-05-08T18:30:17.340 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012400309999999999 2024-05-08T18:30:17.340 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.340 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.340 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:17.340 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.746296+0000", 2024-05-08T18:30:17.340 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00089682 2024-05-08T18:30:17.340 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.340 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.340 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:17.340 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.746385+0000", 2024-05-08T18:30:17.341 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9289000000000005e-05 2024-05-08T18:30:17.341 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.341 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.341 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:17.341 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.746451+0000", 2024-05-08T18:30:17.341 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5690000000000003e-05 2024-05-08T18:30:17.341 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:17.341 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:17.341 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:17.341 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.341 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.341 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:17.341 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.772338+0000", 2024-05-08T18:30:17.341 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 25.523965241999999, 2024-05-08T18:30:17.342 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0035084059999999999, 2024-05-08T18:30:17.342 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:17.342 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:17.342 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:17.342 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:17.342 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:17.342 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:17.342 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 230 2024-05-08T18:30:17.342 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.342 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:17.342 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.342 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:17.342 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772338+0000", 2024-05-08T18:30:17.342 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:17.343 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.343 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.343 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:17.343 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772338+0000", 2024-05-08T18:30:17.343 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:17.343 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.343 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.343 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:17.343 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772340+0000", 2024-05-08T18:30:17.343 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3460000000000001e-06 2024-05-08T18:30:17.343 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.343 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.343 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:17.343 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772352+0000", 2024-05-08T18:30:17.343 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2284e-05 2024-05-08T18:30:17.344 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.344 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.344 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:17.344 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772382+0000", 2024-05-08T18:30:17.344 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0083e-05 2024-05-08T18:30:17.344 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.344 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.344 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:17.344 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772397+0000", 2024-05-08T18:30:17.344 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4963000000000001e-05 2024-05-08T18:30:17.344 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.344 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.344 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:17.344 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772508+0000", 2024-05-08T18:30:17.345 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000110402 2024-05-08T18:30:17.345 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.345 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.345 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:17.345 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772742+0000", 2024-05-08T18:30:17.345 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023428899999999999 2024-05-08T18:30:17.345 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.345 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.345 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:30:17.345 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.773183+0000", 2024-05-08T18:30:17.345 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00044107899999999998 2024-05-08T18:30:17.345 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.345 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.345 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:17.346 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.774488+0000", 2024-05-08T18:30:17.346 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0013053940000000001 2024-05-08T18:30:17.346 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.346 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.346 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:17.346 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.775689+0000", 2024-05-08T18:30:17.346 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012004699999999999 2024-05-08T18:30:17.346 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.346 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.346 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:17.346 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.775777+0000", 2024-05-08T18:30:17.346 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8483e-05 2024-05-08T18:30:17.346 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.346 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.347 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:17.347 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.775846+0000", 2024-05-08T18:30:17.347 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8613000000000002e-05 2024-05-08T18:30:17.347 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:17.347 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:17.347 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:17.347 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.347 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.347 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:17.347 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.790921+0000", 2024-05-08T18:30:17.347 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 25.505381895999999, 2024-05-08T18:30:17.347 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003116869, 2024-05-08T18:30:17.347 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:17.347 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:17.348 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:17.348 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:17.348 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:17.348 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:17.348 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 235 2024-05-08T18:30:17.348 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.348 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:17.348 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.348 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:17.348 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790921+0000", 2024-05-08T18:30:17.348 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:17.348 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.348 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.348 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:17.349 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790921+0000", 2024-05-08T18:30:17.349 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:17.349 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.349 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.349 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:17.349 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790923+0000", 2024-05-08T18:30:17.349 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3199999999999998e-06 2024-05-08T18:30:17.349 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.349 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.349 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:17.349 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790934+0000", 2024-05-08T18:30:17.349 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.117e-05 2024-05-08T18:30:17.349 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.349 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.350 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:17.350 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790965+0000", 2024-05-08T18:30:17.350 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0392999999999999e-05 2024-05-08T18:30:17.350 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.350 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.350 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:17.350 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790981+0000", 2024-05-08T18:30:17.350 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5699999999999999e-05 2024-05-08T18:30:17.350 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.350 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.350 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:17.350 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.791093+0000", 2024-05-08T18:30:17.350 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000112062 2024-05-08T18:30:17.351 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.351 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.351 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:17.351 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.791324+0000", 2024-05-08T18:30:17.351 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023142200000000001 2024-05-08T18:30:17.351 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.351 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.351 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:17.351 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.791761+0000", 2024-05-08T18:30:17.351 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00043669999999999999 2024-05-08T18:30:17.351 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.351 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.351 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:17.352 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.792996+0000", 2024-05-08T18:30:17.352 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001235713 2024-05-08T18:30:17.352 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.352 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.352 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:17.352 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.793850+0000", 2024-05-08T18:30:17.352 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00085392400000000005 2024-05-08T18:30:17.352 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.352 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.352 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:17.352 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.793971+0000", 2024-05-08T18:30:17.352 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000120516 2024-05-08T18:30:17.352 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.352 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.353 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:17.353 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794038+0000", 2024-05-08T18:30:17.353 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6948999999999999e-05 2024-05-08T18:30:17.353 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:17.353 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:17.353 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:17.353 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.353 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.353 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:349 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:17.353 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.817315+0000", 2024-05-08T18:30:17.353 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 25.478988025, 2024-05-08T18:30:17.353 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0036888580000000002, 2024-05-08T18:30:17.353 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:17.354 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:17.354 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:17.354 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:17.354 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:17.354 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:17.354 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 349 2024-05-08T18:30:17.354 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.354 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:17.354 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.354 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:17.354 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817315+0000", 2024-05-08T18:30:17.354 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:17.354 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.355 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.355 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:17.355 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817315+0000", 2024-05-08T18:30:17.355 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:17.355 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.355 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.355 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:17.355 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817316+0000", 2024-05-08T18:30:17.355 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3370000000000001e-06 2024-05-08T18:30:17.355 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.355 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.355 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:17.355 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817323+0000", 2024-05-08T18:30:17.356 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.4300000000000003e-06 2024-05-08T18:30:17.356 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.356 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.356 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:17.356 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817337+0000", 2024-05-08T18:30:17.356 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4025999999999999e-05 2024-05-08T18:30:17.356 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.356 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.356 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:17.356 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817345+0000", 2024-05-08T18:30:17.356 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5669999999999995e-06 2024-05-08T18:30:17.356 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.356 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.356 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:17.357 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817407+0000", 2024-05-08T18:30:17.357 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1882000000000001e-05 2024-05-08T18:30:17.357 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.357 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.357 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:17.357 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817508+0000", 2024-05-08T18:30:17.357 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000100585 2024-05-08T18:30:17.357 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.357 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.357 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:17.357 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817673+0000", 2024-05-08T18:30:17.357 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000165802 2024-05-08T18:30:17.357 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.357 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.358 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:17.358 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.818715+0000", 2024-05-08T18:30:17.358 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0010417720000000001 2024-05-08T18:30:17.358 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.358 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.358 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:17.358 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.820892+0000", 2024-05-08T18:30:17.358 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0021771859999999998 2024-05-08T18:30:17.358 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.358 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.358 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:17.358 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.820950+0000", 2024-05-08T18:30:17.358 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7636000000000002e-05 2024-05-08T18:30:17.359 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.359 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.359 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:17.359 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.821004+0000", 2024-05-08T18:30:17.359 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3634999999999997e-05 2024-05-08T18:30:17.359 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:17.359 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:17.359 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:17.359 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.359 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.359 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:406 6.16 6:6dc3b799:reshard::reshard.0000000006:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:17.359 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.840465+0000", 2024-05-08T18:30:17.359 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 25.455837858999999, 2024-05-08T18:30:17.359 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003613032, 2024-05-08T18:30:17.360 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:17.360 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:17.360 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:17.360 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:17.360 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:17.360 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:17.360 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 406 2024-05-08T18:30:17.360 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.360 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:17.360 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.360 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:17.360 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840465+0000", 2024-05-08T18:30:17.360 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:17.360 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.361 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.361 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:17.361 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840465+0000", 2024-05-08T18:30:17.361 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:17.361 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.361 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.361 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:17.361 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840466+0000", 2024-05-08T18:30:17.361 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7499999999999999e-07 2024-05-08T18:30:17.361 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.361 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.361 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:17.361 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840471+0000", 2024-05-08T18:30:17.361 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9699999999999998e-06 2024-05-08T18:30:17.361 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.361 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.362 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:17.362 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840484+0000", 2024-05-08T18:30:17.362 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2717999999999999e-05 2024-05-08T18:30:17.362 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.362 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.362 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:17.362 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840490+0000", 2024-05-08T18:30:17.362 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.472e-06 2024-05-08T18:30:17.362 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.362 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.362 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:17.362 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840536+0000", 2024-05-08T18:30:17.362 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6409000000000002e-05 2024-05-08T18:30:17.363 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.363 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.363 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:17.363 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840591+0000", 2024-05-08T18:30:17.363 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4911000000000003e-05 2024-05-08T18:30:17.363 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.363 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.363 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:30:17.363 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840745+0000", 2024-05-08T18:30:17.363 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015394900000000001 2024-05-08T18:30:17.363 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.363 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.363 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:17.363 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.841269+0000", 2024-05-08T18:30:17.364 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00052347299999999999 2024-05-08T18:30:17.364 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.364 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.364 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:17.364 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.843997+0000", 2024-05-08T18:30:17.364 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0027285080000000001 2024-05-08T18:30:17.364 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.364 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.364 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:17.364 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844033+0000", 2024-05-08T18:30:17.364 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6038000000000003e-05 2024-05-08T18:30:17.364 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.364 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.364 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:17.365 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844078+0000", 2024-05-08T18:30:17.365 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4709000000000002e-05 2024-05-08T18:30:17.365 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:17.365 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:17.365 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:17.365 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.365 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.365 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:413 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:17.365 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.844187+0000", 2024-05-08T18:30:17.365 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 25.452116281999999, 2024-05-08T18:30:17.365 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0024835069999999998, 2024-05-08T18:30:17.365 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:17.365 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:17.366 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:17.366 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:17.366 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:17.366 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:17.366 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 413 2024-05-08T18:30:17.366 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.366 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:17.366 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.366 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:17.366 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844187+0000", 2024-05-08T18:30:17.366 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:17.366 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.366 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.366 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:17.367 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844187+0000", 2024-05-08T18:30:17.367 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:17.367 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.367 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.367 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:17.367 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844187+0000", 2024-05-08T18:30:17.367 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9999999999999996e-07 2024-05-08T18:30:17.367 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.367 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.367 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:17.367 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844192+0000", 2024-05-08T18:30:17.367 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7899999999999999e-06 2024-05-08T18:30:17.367 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.368 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.368 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:17.368 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844203+0000", 2024-05-08T18:30:17.368 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1002000000000001e-05 2024-05-08T18:30:17.368 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.368 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.368 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:17.368 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844209+0000", 2024-05-08T18:30:17.368 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6570000000000002e-06 2024-05-08T18:30:17.368 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.368 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.368 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:17.368 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844270+0000", 2024-05-08T18:30:17.369 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0810999999999998e-05 2024-05-08T18:30:17.369 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.369 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.369 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:17.369 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844419+0000", 2024-05-08T18:30:17.369 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000149097 2024-05-08T18:30:17.369 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.369 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.369 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:30:17.369 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844611+0000", 2024-05-08T18:30:17.369 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00019247900000000001 2024-05-08T18:30:17.369 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.369 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.370 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:17.370 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.845287+0000", 2024-05-08T18:30:17.370 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00067526000000000001 2024-05-08T18:30:17.370 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.370 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.370 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:17.370 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.846609+0000", 2024-05-08T18:30:17.370 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001322124 2024-05-08T18:30:17.370 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.370 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.370 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:17.370 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.846642+0000", 2024-05-08T18:30:17.371 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3654e-05 2024-05-08T18:30:17.371 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.371 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.371 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:17.371 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.846670+0000", 2024-05-08T18:30:17.371 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7733e-05 2024-05-08T18:30:17.371 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:17.371 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:17.371 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:17.371 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.371 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.371 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:420 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:17.371 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.847096+0000", 2024-05-08T18:30:17.371 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 25.449206988, 2024-05-08T18:30:17.371 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0026261589999999999, 2024-05-08T18:30:17.372 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:17.372 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:17.372 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:17.372 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:17.372 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:17.372 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:17.372 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 420 2024-05-08T18:30:17.372 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.372 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:17.372 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.372 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:17.372 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847096+0000", 2024-05-08T18:30:17.372 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:17.373 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.373 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.373 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:17.373 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847096+0000", 2024-05-08T18:30:17.373 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:17.373 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.373 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.373 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:17.373 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847097+0000", 2024-05-08T18:30:17.373 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.5499999999999996e-07 2024-05-08T18:30:17.373 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.373 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.373 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:17.373 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847103+0000", 2024-05-08T18:30:17.374 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8969999999999996e-06 2024-05-08T18:30:17.374 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.374 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.374 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:17.374 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847114+0000", 2024-05-08T18:30:17.374 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1549000000000001e-05 2024-05-08T18:30:17.374 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.374 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.374 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:17.374 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847120+0000", 2024-05-08T18:30:17.374 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5509999999999999e-06 2024-05-08T18:30:17.374 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.375 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.375 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:17.375 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847166+0000", 2024-05-08T18:30:17.375 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6683e-05 2024-05-08T18:30:17.375 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.375 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.375 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:17.375 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847213+0000", 2024-05-08T18:30:17.375 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6659000000000002e-05 2024-05-08T18:30:17.375 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.375 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.375 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:30:17.375 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847315+0000", 2024-05-08T18:30:17.375 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000102336 2024-05-08T18:30:17.376 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.376 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.376 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:17.376 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847840+0000", 2024-05-08T18:30:17.376 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00052475000000000004 2024-05-08T18:30:17.376 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.376 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.376 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:17.376 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.849660+0000", 2024-05-08T18:30:17.376 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001819563 2024-05-08T18:30:17.376 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.376 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.376 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:17.376 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.849695+0000", 2024-05-08T18:30:17.377 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4761000000000001e-05 2024-05-08T18:30:17.377 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.377 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.377 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:17.377 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.849722+0000", 2024-05-08T18:30:17.377 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7455000000000001e-05 2024-05-08T18:30:17.377 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:17.377 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:17.377 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:17.377 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.377 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.377 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:532 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:17.377 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.908603+0000", 2024-05-08T18:30:17.377 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 25.387699437999999, 2024-05-08T18:30:17.378 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0038838950000000001, 2024-05-08T18:30:17.378 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:17.378 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:17.378 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:17.378 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:17.378 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:17.378 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:17.378 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 532 2024-05-08T18:30:17.378 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.378 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:17.378 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.378 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:17.378 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908603+0000", 2024-05-08T18:30:17.379 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:17.379 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.379 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.379 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:17.379 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908603+0000", 2024-05-08T18:30:17.379 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:17.379 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.379 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.379 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:17.379 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908605+0000", 2024-05-08T18:30:17.379 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1179999999999999e-06 2024-05-08T18:30:17.379 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.379 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.379 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:17.380 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908608+0000", 2024-05-08T18:30:17.380 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7419999999999999e-06 2024-05-08T18:30:17.380 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.380 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.380 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:17.380 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908618+0000", 2024-05-08T18:30:17.380 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.6889999999999999e-06 2024-05-08T18:30:17.380 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.380 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.380 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:17.380 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908625+0000", 2024-05-08T18:30:17.380 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1300000000000003e-06 2024-05-08T18:30:17.380 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.380 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.381 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:17.381 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908669+0000", 2024-05-08T18:30:17.381 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3832000000000003e-05 2024-05-08T18:30:17.381 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.381 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.381 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:17.381 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908724+0000", 2024-05-08T18:30:17.381 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5222000000000001e-05 2024-05-08T18:30:17.381 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.381 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.381 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:30:17.381 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908854+0000", 2024-05-08T18:30:17.381 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012953500000000001 2024-05-08T18:30:17.381 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.382 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.382 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:17.382 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.909511+0000", 2024-05-08T18:30:17.382 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00065768399999999996 2024-05-08T18:30:17.382 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.382 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.382 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:17.382 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912426+0000", 2024-05-08T18:30:17.382 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0029146599999999999 2024-05-08T18:30:17.382 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.382 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.382 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:17.382 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912461+0000", 2024-05-08T18:30:17.383 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4934999999999997e-05 2024-05-08T18:30:17.383 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.383 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.383 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:17.383 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912487+0000", 2024-05-08T18:30:17.383 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6347999999999999e-05 2024-05-08T18:30:17.383 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:17.383 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:17.383 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:17.383 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.383 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.383 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:534 6.9 6:9268b73e:::obj_delete_at_hint.0000000019:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:17.383 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.910153+0000", 2024-05-08T18:30:17.383 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 25.386149980999999, 2024-05-08T18:30:17.384 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0051089680000000002, 2024-05-08T18:30:17.384 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:17.384 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:17.384 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:17.384 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:17.384 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:17.384 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:17.384 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 534 2024-05-08T18:30:17.384 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.384 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:17.384 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.384 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:17.384 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910153+0000", 2024-05-08T18:30:17.384 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:17.385 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.385 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.385 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:17.385 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910153+0000", 2024-05-08T18:30:17.385 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:17.385 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.385 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.385 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:17.385 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910154+0000", 2024-05-08T18:30:17.385 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1039999999999999e-06 2024-05-08T18:30:17.385 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.385 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.385 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:17.385 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910158+0000", 2024-05-08T18:30:17.386 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7400000000000002e-06 2024-05-08T18:30:17.386 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.386 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.386 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:17.386 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910167+0000", 2024-05-08T18:30:17.386 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8880000000000003e-06 2024-05-08T18:30:17.386 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.386 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.386 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:17.386 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910173+0000", 2024-05-08T18:30:17.386 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.844e-06 2024-05-08T18:30:17.386 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.387 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.387 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:17.387 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910220+0000", 2024-05-08T18:30:17.387 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6582000000000002e-05 2024-05-08T18:30:17.387 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.387 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.387 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:17.387 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910287+0000", 2024-05-08T18:30:17.387 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7271e-05 2024-05-08T18:30:17.387 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.387 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.387 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:30:17.387 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910402+0000", 2024-05-08T18:30:17.387 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115127 2024-05-08T18:30:17.388 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.388 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.388 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:17.388 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910881+0000", 2024-05-08T18:30:17.388 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000479025 2024-05-08T18:30:17.388 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.388 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.388 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:17.388 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.915206+0000", 2024-05-08T18:30:17.388 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.004324357 2024-05-08T18:30:17.388 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.389 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.389 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:17.389 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.915237+0000", 2024-05-08T18:30:17.389 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1590000000000001e-05 2024-05-08T18:30:17.389 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.389 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.389 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:17.389 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.915262+0000", 2024-05-08T18:30:17.389 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.444e-05 2024-05-08T18:30:17.389 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:17.389 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:17.389 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:17.389 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.389 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.389 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:583 6.0 6:03bbb29a:::obj_delete_at_hint.0000000026:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:17.390 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.947199+0000", 2024-05-08T18:30:17.390 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 25.349103784, 2024-05-08T18:30:17.390 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0025081510000000001, 2024-05-08T18:30:17.390 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:17.390 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:17.390 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:17.390 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:17.390 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:17.390 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:17.390 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 583 2024-05-08T18:30:17.390 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.390 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:17.390 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.390 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:17.391 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947199+0000", 2024-05-08T18:30:17.391 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:17.391 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.391 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.391 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:17.391 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947199+0000", 2024-05-08T18:30:17.391 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:17.391 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.391 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.391 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:17.391 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947200+0000", 2024-05-08T18:30:17.391 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3799999999999997e-07 2024-05-08T18:30:17.391 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.391 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.392 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:17.392 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947207+0000", 2024-05-08T18:30:17.392 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2030000000000003e-06 2024-05-08T18:30:17.392 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.392 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.392 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:17.392 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947217+0000", 2024-05-08T18:30:17.392 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0138e-05 2024-05-08T18:30:17.392 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.392 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.392 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:17.392 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947224+0000", 2024-05-08T18:30:17.392 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5289999999999997e-06 2024-05-08T18:30:17.392 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.392 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.393 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:17.393 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.948039+0000", 2024-05-08T18:30:17.393 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00081500599999999996 2024-05-08T18:30:17.393 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.393 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.393 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:17.393 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.948230+0000", 2024-05-08T18:30:17.393 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000191838 2024-05-08T18:30:17.393 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.393 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.393 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:17.393 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.948606+0000", 2024-05-08T18:30:17.393 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00037547900000000001 2024-05-08T18:30:17.393 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.394 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.394 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:17.394 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.949406+0000", 2024-05-08T18:30:17.394 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000799674 2024-05-08T18:30:17.394 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.394 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.394 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:17.394 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.949630+0000", 2024-05-08T18:30:17.394 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00022474699999999999 2024-05-08T18:30:17.394 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.394 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.394 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:17.394 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.949664+0000", 2024-05-08T18:30:17.394 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3535999999999999e-05 2024-05-08T18:30:17.395 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.395 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.395 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:17.395 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.949707+0000", 2024-05-08T18:30:17.395 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3362999999999998e-05 2024-05-08T18:30:17.395 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:17.395 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:17.395 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:17.395 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.395 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.395 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:686 6.10 6:0d0f4ce5:::obj_delete_at_hint.0000000040:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:17.395 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.012623+0000", 2024-05-08T18:30:17.395 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 25.283679594999999, 2024-05-08T18:30:17.395 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0024696330000000002, 2024-05-08T18:30:17.396 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:17.396 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:17.396 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:17.396 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:17.396 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:17.396 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:17.396 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 686 2024-05-08T18:30:17.396 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.396 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:17.396 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.396 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:17.396 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.012623+0000", 2024-05-08T18:30:17.396 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:17.396 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.397 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.397 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:17.397 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.012623+0000", 2024-05-08T18:30:17.397 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:17.397 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.397 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.397 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:17.397 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.012624+0000", 2024-05-08T18:30:17.397 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1480000000000001e-06 2024-05-08T18:30:17.397 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.397 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.397 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:17.397 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.012631+0000", 2024-05-08T18:30:17.397 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1700000000000002e-06 2024-05-08T18:30:17.398 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.398 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.398 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:17.398 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.012647+0000", 2024-05-08T18:30:17.398 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6133999999999998e-05 2024-05-08T18:30:17.398 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.398 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.398 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:17.398 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.012655+0000", 2024-05-08T18:30:17.398 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7199999999999995e-06 2024-05-08T18:30:17.398 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.398 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.398 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:17.398 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.012715+0000", 2024-05-08T18:30:17.398 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9475999999999998e-05 2024-05-08T18:30:17.399 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.399 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.399 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:17.399 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.012805+0000", 2024-05-08T18:30:17.399 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9840999999999996e-05 2024-05-08T18:30:17.399 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.399 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.399 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:17.399 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.012930+0000", 2024-05-08T18:30:17.399 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012537099999999999 2024-05-08T18:30:17.399 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.399 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.399 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:17.399 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.013584+0000", 2024-05-08T18:30:17.400 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00065356500000000005 2024-05-08T18:30:17.400 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.400 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.400 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:17.400 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.014956+0000", 2024-05-08T18:30:17.400 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001372535 2024-05-08T18:30:17.400 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.400 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.400 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:17.400 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.015017+0000", 2024-05-08T18:30:17.400 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0590000000000001e-05 2024-05-08T18:30:17.400 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.400 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.400 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:17.401 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.015093+0000", 2024-05-08T18:30:17.401 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6082999999999996e-05 2024-05-08T18:30:17.401 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:17.401 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:17.401 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:17.401 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.401 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.401 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:17.401 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.263796+0000", 2024-05-08T18:30:17.401 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 25.032506516000002, 2024-05-08T18:30:17.401 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0027788019999999999, 2024-05-08T18:30:17.401 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:17.401 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:17.401 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:17.402 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:17.402 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:17.402 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:17.402 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 811 2024-05-08T18:30:17.402 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.402 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:17.402 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.402 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:17.402 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263796+0000", 2024-05-08T18:30:17.402 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:17.402 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.402 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.402 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:17.402 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263796+0000", 2024-05-08T18:30:17.403 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:17.403 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.403 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.403 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:17.403 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263799+0000", 2024-05-08T18:30:17.403 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5569999999999998e-06 2024-05-08T18:30:17.403 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.403 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.403 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:17.403 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263812+0000", 2024-05-08T18:30:17.403 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3145999999999999e-05 2024-05-08T18:30:17.403 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.403 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.405 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:17.405 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263842+0000", 2024-05-08T18:30:17.405 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0193e-05 2024-05-08T18:30:17.405 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.405 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.405 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:17.405 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263860+0000", 2024-05-08T18:30:17.405 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7880000000000002e-05 2024-05-08T18:30:17.405 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.405 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.406 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:17.406 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263979+0000", 2024-05-08T18:30:17.406 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011919899999999999 2024-05-08T18:30:17.406 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.406 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.406 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:17.406 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.264222+0000", 2024-05-08T18:30:17.406 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024290800000000001 2024-05-08T18:30:17.406 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.406 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.406 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:17.406 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.264545+0000", 2024-05-08T18:30:17.406 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00032300200000000002 2024-05-08T18:30:17.406 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.407 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.407 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:17.407 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.265682+0000", 2024-05-08T18:30:17.407 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001136464 2024-05-08T18:30:17.407 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.407 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.407 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:17.407 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.266397+0000", 2024-05-08T18:30:17.407 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00071512799999999999 2024-05-08T18:30:17.407 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.407 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.407 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:17.407 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.266504+0000", 2024-05-08T18:30:17.407 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000107019 2024-05-08T18:30:17.408 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.408 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.408 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:17.408 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.266575+0000", 2024-05-08T18:30:17.408 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1305999999999998e-05 2024-05-08T18:30:17.408 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:17.408 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:17.408 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:17.408 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.408 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.408 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:17.408 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.445706+0000", 2024-05-08T18:30:17.408 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 24.850596800000002, 2024-05-08T18:30:17.408 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0026820630000000002, 2024-05-08T18:30:17.409 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:17.409 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:17.409 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:17.409 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:17.409 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:17.409 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:17.409 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 889 2024-05-08T18:30:17.409 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.409 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:17.409 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.409 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:17.409 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445706+0000", 2024-05-08T18:30:17.409 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:17.409 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.409 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.410 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:17.410 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445706+0000", 2024-05-08T18:30:17.410 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:17.410 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.410 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.410 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:17.410 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445709+0000", 2024-05-08T18:30:17.410 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0299999999999998e-06 2024-05-08T18:30:17.410 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.410 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.410 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:17.410 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445721+0000", 2024-05-08T18:30:17.410 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2366e-05 2024-05-08T18:30:17.410 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.411 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.411 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:17.411 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445752+0000", 2024-05-08T18:30:17.411 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0287e-05 2024-05-08T18:30:17.411 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.411 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.411 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:17.411 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445773+0000", 2024-05-08T18:30:17.411 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1367000000000001e-05 2024-05-08T18:30:17.411 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.411 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.411 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:17.411 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445892+0000", 2024-05-08T18:30:17.411 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000119311 2024-05-08T18:30:17.412 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.412 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.412 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:17.412 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.446158+0000", 2024-05-08T18:30:17.412 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000265441 2024-05-08T18:30:17.412 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.412 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.412 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:17.412 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.446465+0000", 2024-05-08T18:30:17.412 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00030754300000000002 2024-05-08T18:30:17.412 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.412 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.412 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:17.412 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.447511+0000", 2024-05-08T18:30:17.412 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001045975 2024-05-08T18:30:17.413 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.413 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.413 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:17.413 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.448171+0000", 2024-05-08T18:30:17.413 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00065971200000000002 2024-05-08T18:30:17.413 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.413 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.413 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:17.413 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.448273+0000", 2024-05-08T18:30:17.413 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000101592 2024-05-08T18:30:17.413 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.413 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.413 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:17.413 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.448388+0000", 2024-05-08T18:30:17.413 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115439 2024-05-08T18:30:17.414 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:17.414 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:17.414 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:17.414 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:17.414 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:17.414 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:30:17.415 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-08T18:30:17.416 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:30:17.417+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:30:17.516 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:30:17.516+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:30:17.585 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:30:17.585 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:30:17.585 INFO:teuthology.orchestra.run.smithi097.stdout: "num_ops": 0 2024-05-08T18:30:17.586 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:30:17.599 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-08T18:30:17.649 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:30:17.653+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:30:17.716 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:30:17.716 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:30:17.716 INFO:teuthology.orchestra.run.smithi097.stdout: "complaint_time": 30, 2024-05-08T18:30:17.717 INFO:teuthology.orchestra.run.smithi097.stdout: "num_blocked_ops": 0 2024-05-08T18:30:17.717 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:30:17.718 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:30:17.716+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:30:17.732 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-08T18:30:17.821 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:30:17.825+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:30:17.826 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-08T18:30:17.902 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:30:17.902 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2024-05-08T18:30:17.902 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2024-05-08T18:30:17.903 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-05-08T18:30:17.903 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.903 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4479.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-05-08T18:30:17.903 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:44.576320+0000", 2024-05-08T18:30:17.903 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 33.328217264999999, 2024-05-08T18:30:17.903 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019751892, 2024-05-08T18:30:17.903 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:17.903 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:17.903 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "reached pg", 2024-05-08T18:30:17.903 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:17.903 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4479", 2024-05-08T18:30:17.903 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3577501689", 2024-05-08T18:30:17.903 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 2 2024-05-08T18:30:17.903 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.904 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:17.904 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.904 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:17.904 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576320+0000", 2024-05-08T18:30:17.904 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:17.904 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.904 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.904 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:17.904 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576320+0000", 2024-05-08T18:30:17.904 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:17.904 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.904 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.905 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:17.905 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576323+0000", 2024-05-08T18:30:17.905 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.813e-06 2024-05-08T18:30:17.905 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.905 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.905 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:17.905 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576335+0000", 2024-05-08T18:30:17.905 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2330000000000001e-05 2024-05-08T18:30:17.905 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.905 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.905 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:17.905 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576367+0000", 2024-05-08T18:30:17.905 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2036999999999998e-05 2024-05-08T18:30:17.906 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.906 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.906 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:17.906 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576394+0000", 2024-05-08T18:30:17.906 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6529e-05 2024-05-08T18:30:17.906 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.906 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.906 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:17.906 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576550+0000", 2024-05-08T18:30:17.906 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000156718 2024-05-08T18:30:17.906 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.906 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.906 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-05-08T18:30:17.907 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576560+0000", 2024-05-08T18:30:17.907 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0040999999999999e-05 2024-05-08T18:30:17.907 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.907 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.907 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:17.907 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.587240+0000", 2024-05-08T18:30:17.907 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010679266999999999 2024-05-08T18:30:17.907 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.907 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.907 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2024-05-08T18:30:17.907 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.587266+0000", 2024-05-08T18:30:17.907 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6642e-05 2024-05-08T18:30:17.907 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.907 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.908 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:17.908 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.595882+0000", 2024-05-08T18:30:17.908 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0086159600000000006 2024-05-08T18:30:17.908 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.908 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.908 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:17.908 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.596072+0000", 2024-05-08T18:30:17.908 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000189555 2024-05-08T18:30:17.908 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:17.908 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:17.908 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:17.908 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.908 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.908 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:30:17.909 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:48.766182+0000", 2024-05-08T18:30:17.909 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 29.138355237999999, 2024-05-08T18:30:17.909 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031881209999999999, 2024-05-08T18:30:17.909 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:17.909 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:17.909 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:17.909 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:17.909 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:17.909 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:17.909 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 193 2024-05-08T18:30:17.909 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.909 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:17.910 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.910 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:17.910 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766182+0000", 2024-05-08T18:30:17.910 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:17.910 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.910 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.910 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:17.910 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766182+0000", 2024-05-08T18:30:17.910 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:17.910 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.911 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.911 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:17.911 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766184+0000", 2024-05-08T18:30:17.911 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4159999999999998e-06 2024-05-08T18:30:17.911 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.911 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.911 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:17.911 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766196+0000", 2024-05-08T18:30:17.911 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1814000000000001e-05 2024-05-08T18:30:17.911 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.911 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.911 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:17.911 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766227+0000", 2024-05-08T18:30:17.912 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0676000000000002e-05 2024-05-08T18:30:17.912 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.912 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.912 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:17.912 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766242+0000", 2024-05-08T18:30:17.912 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5497000000000001e-05 2024-05-08T18:30:17.912 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.912 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.912 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:17.912 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766354+0000", 2024-05-08T18:30:17.912 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000111579 2024-05-08T18:30:17.912 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.912 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.912 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:17.913 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766569+0000", 2024-05-08T18:30:17.913 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000214978 2024-05-08T18:30:17.913 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.913 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.913 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:17.913 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766834+0000", 2024-05-08T18:30:17.913 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00026551500000000002 2024-05-08T18:30:17.913 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.913 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.913 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:17.913 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.768577+0000", 2024-05-08T18:30:17.914 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001742513 2024-05-08T18:30:17.914 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.914 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.914 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:17.914 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.769150+0000", 2024-05-08T18:30:17.914 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00057320500000000003 2024-05-08T18:30:17.914 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.914 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.914 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:17.914 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.769250+0000", 2024-05-08T18:30:17.914 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.9846000000000006e-05 2024-05-08T18:30:17.914 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.914 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.915 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:17.915 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.769370+0000", 2024-05-08T18:30:17.915 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012008200000000001 2024-05-08T18:30:17.915 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:17.915 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:17.915 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:17.915 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.915 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.915 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:17.915 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.679562+0000", 2024-05-08T18:30:17.915 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 26.224975533999999, 2024-05-08T18:30:17.915 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0086320800000000003, 2024-05-08T18:30:17.915 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:17.915 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:17.916 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:17.916 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:17.916 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:17.916 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:17.916 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 208 2024-05-08T18:30:17.916 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.916 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:17.916 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.916 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:17.916 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679562+0000", 2024-05-08T18:30:17.916 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:17.916 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.916 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.917 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:17.917 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679562+0000", 2024-05-08T18:30:17.917 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:17.917 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.917 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.917 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:17.917 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679565+0000", 2024-05-08T18:30:17.917 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0800000000000002e-06 2024-05-08T18:30:17.917 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.917 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.917 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:17.918 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679578+0000", 2024-05-08T18:30:17.918 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3217000000000001e-05 2024-05-08T18:30:17.918 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.918 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.918 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:17.918 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679610+0000", 2024-05-08T18:30:17.918 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1696000000000003e-05 2024-05-08T18:30:17.918 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.918 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.918 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:17.918 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679625+0000", 2024-05-08T18:30:17.918 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5824e-05 2024-05-08T18:30:17.918 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.919 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.919 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:17.919 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679758+0000", 2024-05-08T18:30:17.919 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013231199999999999 2024-05-08T18:30:17.919 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.919 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.919 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-05-08T18:30:17.919 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679770+0000", 2024-05-08T18:30:17.919 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1800000000000001e-05 2024-05-08T18:30:17.919 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.919 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.919 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:17.919 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.685241+0000", 2024-05-08T18:30:17.920 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0054710169999999999 2024-05-08T18:30:17.920 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.920 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.920 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:17.920 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.685444+0000", 2024-05-08T18:30:17.920 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000203835 2024-05-08T18:30:17.920 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.920 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.920 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:17.920 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.685842+0000", 2024-05-08T18:30:17.920 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00039773 2024-05-08T18:30:17.920 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.921 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.921 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:17.921 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.687232+0000", 2024-05-08T18:30:17.921 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00139011 2024-05-08T18:30:17.921 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.921 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.921 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:17.921 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.688049+0000", 2024-05-08T18:30:17.921 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00081667000000000003 2024-05-08T18:30:17.921 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.921 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.921 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:17.922 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.688135+0000", 2024-05-08T18:30:17.922 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6299999999999997e-05 2024-05-08T18:30:17.922 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.922 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.922 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:17.922 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.688194+0000", 2024-05-08T18:30:17.922 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8489000000000002e-05 2024-05-08T18:30:17.922 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:17.922 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:17.922 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:17.922 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.922 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.922 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:17.923 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.707114+0000", 2024-05-08T18:30:17.923 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 26.197423520000001, 2024-05-08T18:30:17.923 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031802990000000001, 2024-05-08T18:30:17.923 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:17.923 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:17.923 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:17.923 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:17.923 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:17.923 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:17.923 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 212 2024-05-08T18:30:17.923 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.923 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:17.923 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.923 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:17.924 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707114+0000", 2024-05-08T18:30:17.924 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:17.924 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.924 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.924 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:17.924 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707114+0000", 2024-05-08T18:30:17.924 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:17.924 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.924 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.924 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:17.924 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707117+0000", 2024-05-08T18:30:17.924 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8629999999999999e-06 2024-05-08T18:30:17.924 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.924 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.925 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:17.925 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707129+0000", 2024-05-08T18:30:17.925 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2150000000000001e-05 2024-05-08T18:30:17.925 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.925 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.925 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:17.925 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707158+0000", 2024-05-08T18:30:17.925 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9513999999999999e-05 2024-05-08T18:30:17.925 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.925 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.925 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:17.925 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707173+0000", 2024-05-08T18:30:17.925 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5136e-05 2024-05-08T18:30:17.925 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.926 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.926 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:17.926 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707309+0000", 2024-05-08T18:30:17.926 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000135609 2024-05-08T18:30:17.926 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.926 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.926 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:17.926 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707523+0000", 2024-05-08T18:30:17.926 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021362200000000001 2024-05-08T18:30:17.926 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.926 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.926 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:17.927 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707918+0000", 2024-05-08T18:30:17.927 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00039556299999999998 2024-05-08T18:30:17.927 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.927 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.927 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:17.927 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.709166+0000", 2024-05-08T18:30:17.927 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012476410000000001 2024-05-08T18:30:17.927 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.927 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.927 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:17.927 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.710145+0000", 2024-05-08T18:30:17.927 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00097909899999999998 2024-05-08T18:30:17.927 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.928 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.928 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:17.928 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.710231+0000", 2024-05-08T18:30:17.928 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5625999999999996e-05 2024-05-08T18:30:17.928 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.928 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.928 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:17.928 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.710294+0000", 2024-05-08T18:30:17.928 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3476e-05 2024-05-08T18:30:17.928 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:17.928 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:17.928 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:17.929 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.929 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.929 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:17.929 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.731985+0000", 2024-05-08T18:30:17.929 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 26.172552294999999, 2024-05-08T18:30:17.929 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0039250600000000002, 2024-05-08T18:30:17.929 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:17.929 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:17.929 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:17.929 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:17.929 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:17.929 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:17.929 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 219 2024-05-08T18:30:17.929 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.930 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:17.930 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.930 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:17.930 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731985+0000", 2024-05-08T18:30:17.930 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:17.930 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.930 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.930 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:17.930 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731985+0000", 2024-05-08T18:30:17.930 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:17.930 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.931 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.931 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:17.931 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731988+0000", 2024-05-08T18:30:17.931 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6599999999999999e-06 2024-05-08T18:30:17.931 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.931 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.931 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:17.931 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.732017+0000", 2024-05-08T18:30:17.931 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9692999999999998e-05 2024-05-08T18:30:17.931 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.931 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.931 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:17.931 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.732048+0000", 2024-05-08T18:30:17.931 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1066999999999999e-05 2024-05-08T18:30:17.932 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.932 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.932 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:17.932 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.732064+0000", 2024-05-08T18:30:17.932 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5786000000000001e-05 2024-05-08T18:30:17.932 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.932 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.932 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:17.932 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.732213+0000", 2024-05-08T18:30:17.932 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014895899999999999 2024-05-08T18:30:17.932 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.932 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.932 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:17.932 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.732572+0000", 2024-05-08T18:30:17.933 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000358904 2024-05-08T18:30:17.933 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.933 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.933 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:17.933 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.733349+0000", 2024-05-08T18:30:17.933 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00077657699999999997 2024-05-08T18:30:17.933 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.933 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.933 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:17.933 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.734899+0000", 2024-05-08T18:30:17.933 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001550652 2024-05-08T18:30:17.933 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.934 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.934 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:17.934 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.735641+0000", 2024-05-08T18:30:17.934 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00074222000000000003 2024-05-08T18:30:17.934 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.934 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.934 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:17.934 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.735801+0000", 2024-05-08T18:30:17.934 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015913599999999999 2024-05-08T18:30:17.934 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.934 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.934 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:17.934 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.735910+0000", 2024-05-08T18:30:17.935 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000109406 2024-05-08T18:30:17.935 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:17.935 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:17.935 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:17.935 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.935 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.935 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:17.935 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.750251+0000", 2024-05-08T18:30:17.935 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 26.154286363000001, 2024-05-08T18:30:17.935 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0038408600000000002, 2024-05-08T18:30:17.935 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:17.935 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:17.935 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:17.936 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:17.936 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:17.936 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:17.936 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 224 2024-05-08T18:30:17.936 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.936 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:17.936 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.936 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:17.936 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750251+0000", 2024-05-08T18:30:17.936 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:17.936 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.936 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.936 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:17.936 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750251+0000", 2024-05-08T18:30:17.937 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:17.937 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.937 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.937 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:17.937 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750253+0000", 2024-05-08T18:30:17.937 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2129999999999998e-06 2024-05-08T18:30:17.937 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.937 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.937 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:17.937 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750265+0000", 2024-05-08T18:30:17.937 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1484000000000001e-05 2024-05-08T18:30:17.937 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.937 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.938 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:17.938 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750293+0000", 2024-05-08T18:30:17.938 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8673000000000001e-05 2024-05-08T18:30:17.938 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.938 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.938 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:17.938 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750308+0000", 2024-05-08T18:30:17.938 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4620000000000001e-05 2024-05-08T18:30:17.938 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.938 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.938 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:17.938 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750459+0000", 2024-05-08T18:30:17.939 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000151619 2024-05-08T18:30:17.939 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.939 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.939 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:17.939 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750822+0000", 2024-05-08T18:30:17.939 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000362467 2024-05-08T18:30:17.939 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.939 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.939 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:17.939 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.751591+0000", 2024-05-08T18:30:17.939 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00076934699999999998 2024-05-08T18:30:17.939 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.939 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.939 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:17.940 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.753042+0000", 2024-05-08T18:30:17.940 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001450652 2024-05-08T18:30:17.940 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.940 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.940 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:17.940 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.753792+0000", 2024-05-08T18:30:17.940 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00075045500000000002 2024-05-08T18:30:17.940 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.940 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.940 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:17.940 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.753977+0000", 2024-05-08T18:30:17.940 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000184511 2024-05-08T18:30:17.941 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.941 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.941 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:17.941 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.754092+0000", 2024-05-08T18:30:17.941 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000114819 2024-05-08T18:30:17.941 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:17.941 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:17.941 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:17.941 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.941 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.941 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:17.941 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.783902+0000", 2024-05-08T18:30:17.942 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 26.120635631999999, 2024-05-08T18:30:17.942 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003120046, 2024-05-08T18:30:17.942 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:17.942 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:17.942 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:17.942 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:17.942 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:17.942 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:17.942 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 233 2024-05-08T18:30:17.942 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.942 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:17.942 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.942 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:17.943 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.783902+0000", 2024-05-08T18:30:17.943 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:17.943 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.943 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.943 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:17.943 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.783902+0000", 2024-05-08T18:30:17.943 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:17.943 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.943 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.943 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:17.943 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.783904+0000", 2024-05-08T18:30:17.943 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5229999999999998e-06 2024-05-08T18:30:17.943 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.943 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.944 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:17.944 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.783916+0000", 2024-05-08T18:30:17.944 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1513e-05 2024-05-08T18:30:17.944 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.944 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.944 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:17.944 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.783947+0000", 2024-05-08T18:30:17.944 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1353000000000003e-05 2024-05-08T18:30:17.944 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.944 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.944 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:17.944 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.783964+0000", 2024-05-08T18:30:17.945 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6643e-05 2024-05-08T18:30:17.945 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.945 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.945 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:17.945 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.784110+0000", 2024-05-08T18:30:17.945 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014627299999999999 2024-05-08T18:30:17.945 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.945 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.945 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:17.945 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.784329+0000", 2024-05-08T18:30:17.945 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021892099999999999 2024-05-08T18:30:17.945 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.945 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.945 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:17.945 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.784752+0000", 2024-05-08T18:30:17.946 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00042336700000000001 2024-05-08T18:30:17.946 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.946 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.946 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:17.946 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.786093+0000", 2024-05-08T18:30:17.946 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00134107 2024-05-08T18:30:17.946 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.946 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.946 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:17.946 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.786863+0000", 2024-05-08T18:30:17.946 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00076949099999999997 2024-05-08T18:30:17.946 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.947 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.947 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:17.947 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.786955+0000", 2024-05-08T18:30:17.947 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.2478999999999993e-05 2024-05-08T18:30:17.947 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.947 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.947 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:17.947 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.787022+0000", 2024-05-08T18:30:17.947 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6413000000000003e-05 2024-05-08T18:30:17.947 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:17.947 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:17.947 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:17.947 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.947 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.948 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:341 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:17.948 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.816045+0000", 2024-05-08T18:30:17.948 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 26.088492295000002, 2024-05-08T18:30:17.948 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002875154, 2024-05-08T18:30:17.948 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:17.948 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:17.948 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:17.948 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:17.948 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:17.948 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:17.948 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 341 2024-05-08T18:30:17.948 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.948 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:17.949 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.949 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:17.949 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816045+0000", 2024-05-08T18:30:17.949 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:17.949 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.949 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.949 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:17.949 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816045+0000", 2024-05-08T18:30:17.949 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:17.949 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.949 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.949 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:17.949 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816046+0000", 2024-05-08T18:30:17.949 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9199999999999999e-07 2024-05-08T18:30:17.950 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.950 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.950 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:17.950 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816050+0000", 2024-05-08T18:30:17.950 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0260000000000001e-06 2024-05-08T18:30:17.950 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.950 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.950 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:17.950 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816060+0000", 2024-05-08T18:30:17.950 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0297e-05 2024-05-08T18:30:17.950 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.950 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.950 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:17.951 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816065+0000", 2024-05-08T18:30:17.951 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.237e-06 2024-05-08T18:30:17.951 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.951 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.951 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:17.951 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816122+0000", 2024-05-08T18:30:17.951 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6168000000000002e-05 2024-05-08T18:30:17.951 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.951 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.951 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:17.951 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816198+0000", 2024-05-08T18:30:17.951 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6511e-05 2024-05-08T18:30:17.951 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.952 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.952 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:17.952 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816305+0000", 2024-05-08T18:30:17.952 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000106487 2024-05-08T18:30:17.952 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.952 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.952 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:17.952 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816886+0000", 2024-05-08T18:30:17.952 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00058187199999999999 2024-05-08T18:30:17.952 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.952 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.952 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:17.953 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.818821+0000", 2024-05-08T18:30:17.953 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001934362 2024-05-08T18:30:17.953 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.953 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.953 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:17.953 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.818880+0000", 2024-05-08T18:30:17.953 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9210999999999999e-05 2024-05-08T18:30:17.953 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.953 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.953 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:17.953 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.818920+0000", 2024-05-08T18:30:17.953 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0091e-05 2024-05-08T18:30:17.953 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:17.954 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:17.954 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:17.954 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.954 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.954 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:17.954 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.086431+0000", 2024-05-08T18:30:17.954 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 25.818106475, 2024-05-08T18:30:17.954 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028335959999999999, 2024-05-08T18:30:17.954 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:17.954 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:17.954 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:17.954 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:17.954 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:17.954 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:17.955 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 733 2024-05-08T18:30:17.955 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.955 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:17.955 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.955 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:17.955 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086431+0000", 2024-05-08T18:30:17.955 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:17.955 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.955 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.955 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:17.955 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086431+0000", 2024-05-08T18:30:17.955 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:17.955 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.956 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.956 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:17.956 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086433+0000", 2024-05-08T18:30:17.956 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8899999999999999e-06 2024-05-08T18:30:17.956 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.956 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.956 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:17.956 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086441+0000", 2024-05-08T18:30:17.956 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.3100000000000001e-06 2024-05-08T18:30:17.956 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.956 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.956 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:17.956 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086460+0000", 2024-05-08T18:30:17.957 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8703999999999999e-05 2024-05-08T18:30:17.957 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.957 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.957 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:17.957 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086471+0000", 2024-05-08T18:30:17.957 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1324e-05 2024-05-08T18:30:17.957 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.957 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.957 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:17.957 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086590+0000", 2024-05-08T18:30:17.957 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000118625 2024-05-08T18:30:17.957 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.957 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.957 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:17.958 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086817+0000", 2024-05-08T18:30:17.958 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000226958 2024-05-08T18:30:17.958 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.958 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.958 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:17.958 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.087131+0000", 2024-05-08T18:30:17.958 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00031478799999999998 2024-05-08T18:30:17.958 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.958 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.958 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:17.958 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.088025+0000", 2024-05-08T18:30:17.958 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00089402999999999998 2024-05-08T18:30:17.958 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.959 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.959 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:17.959 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.089123+0000", 2024-05-08T18:30:17.959 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001097598 2024-05-08T18:30:17.959 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.959 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.959 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:17.959 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.089200+0000", 2024-05-08T18:30:17.959 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7333e-05 2024-05-08T18:30:17.959 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.959 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.959 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:17.959 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.089264+0000", 2024-05-08T18:30:17.959 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.4035999999999995e-05 2024-05-08T18:30:17.959 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:17.960 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:17.960 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:17.960 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.960 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.960 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:751 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:17.960 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.125611+0000", 2024-05-08T18:30:17.960 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 25.778925782999998, 2024-05-08T18:30:17.960 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032716749999999999, 2024-05-08T18:30:17.960 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:17.960 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:17.960 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:17.960 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:17.960 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:17.960 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:17.961 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 751 2024-05-08T18:30:17.961 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.961 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:17.961 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.961 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:17.961 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125611+0000", 2024-05-08T18:30:17.961 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:17.961 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.961 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.961 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:17.961 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125611+0000", 2024-05-08T18:30:17.961 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:17.961 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.961 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.962 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:17.962 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125614+0000", 2024-05-08T18:30:17.962 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.12e-06 2024-05-08T18:30:17.962 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.962 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.962 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:17.962 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125624+0000", 2024-05-08T18:30:17.962 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0492999999999999e-05 2024-05-08T18:30:17.962 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.962 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.962 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:17.962 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125650+0000", 2024-05-08T18:30:17.963 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5907000000000001e-05 2024-05-08T18:30:17.963 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.963 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.963 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:17.963 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125667+0000", 2024-05-08T18:30:17.963 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.694e-05 2024-05-08T18:30:17.963 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.963 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.963 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:17.963 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125801+0000", 2024-05-08T18:30:17.963 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000134482 2024-05-08T18:30:17.963 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.963 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.964 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:17.964 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.126174+0000", 2024-05-08T18:30:17.964 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00037294999999999999 2024-05-08T18:30:17.964 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.964 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.964 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:17.964 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.126750+0000", 2024-05-08T18:30:17.964 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00057538900000000004 2024-05-08T18:30:17.964 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.964 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.964 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:17.964 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.127997+0000", 2024-05-08T18:30:17.964 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001247761 2024-05-08T18:30:17.964 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.965 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.965 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:17.965 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.128731+0000", 2024-05-08T18:30:17.965 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00073338099999999996 2024-05-08T18:30:17.965 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.965 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.965 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:17.965 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.128817+0000", 2024-05-08T18:30:17.965 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5993000000000002e-05 2024-05-08T18:30:17.965 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.965 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.965 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:17.965 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.128883+0000", 2024-05-08T18:30:17.965 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6259000000000004e-05 2024-05-08T18:30:17.966 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:17.966 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:17.966 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:17.966 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.966 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.966 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:753 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:17.966 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.129809+0000", 2024-05-08T18:30:17.966 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 25.774728244999999, 2024-05-08T18:30:17.966 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0033775440000000001, 2024-05-08T18:30:17.966 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:17.966 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:17.966 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:17.966 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:17.966 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:17.967 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:17.967 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 753 2024-05-08T18:30:17.967 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.967 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:17.967 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.967 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:17.967 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129809+0000", 2024-05-08T18:30:17.967 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:17.967 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.967 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.967 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:17.967 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129809+0000", 2024-05-08T18:30:17.967 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:17.967 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.968 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.968 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:17.968 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129811+0000", 2024-05-08T18:30:17.968 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1730000000000002e-06 2024-05-08T18:30:17.968 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.968 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.968 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:17.968 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129822+0000", 2024-05-08T18:30:17.968 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0583e-05 2024-05-08T18:30:17.968 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.968 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.968 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:17.968 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129852+0000", 2024-05-08T18:30:17.969 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0744000000000002e-05 2024-05-08T18:30:17.969 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.969 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.969 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:17.969 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129870+0000", 2024-05-08T18:30:17.969 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7955999999999999e-05 2024-05-08T18:30:17.969 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.969 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.969 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:17.969 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.130018+0000", 2024-05-08T18:30:17.969 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014747600000000001 2024-05-08T18:30:17.969 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.969 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.970 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:17.970 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.130259+0000", 2024-05-08T18:30:17.970 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024079099999999999 2024-05-08T18:30:17.970 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.970 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.970 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:17.970 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.130734+0000", 2024-05-08T18:30:17.970 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00047562 2024-05-08T18:30:17.970 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.970 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.970 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:17.970 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.131997+0000", 2024-05-08T18:30:17.970 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012626429999999999 2024-05-08T18:30:17.971 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.971 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.971 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:17.971 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.132923+0000", 2024-05-08T18:30:17.971 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00092627599999999997 2024-05-08T18:30:17.971 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.971 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.971 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:17.971 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.133076+0000", 2024-05-08T18:30:17.971 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000152989 2024-05-08T18:30:17.971 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.971 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.972 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:17.972 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.133187+0000", 2024-05-08T18:30:17.972 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000110293 2024-05-08T18:30:17.972 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:17.972 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:17.972 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:17.972 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.972 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.972 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:17.972 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.228247+0000", 2024-05-08T18:30:17.972 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 25.676290635000001, 2024-05-08T18:30:17.972 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032753449999999998, 2024-05-08T18:30:17.972 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:17.972 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:17.973 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:17.973 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:17.973 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:17.973 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:17.973 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 796 2024-05-08T18:30:17.973 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.973 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:17.973 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.973 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:17.973 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228247+0000", 2024-05-08T18:30:17.973 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:17.973 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.973 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.974 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:17.974 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228247+0000", 2024-05-08T18:30:17.974 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:17.974 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.974 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.974 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:17.974 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228249+0000", 2024-05-08T18:30:17.974 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3800000000000001e-06 2024-05-08T18:30:17.974 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.974 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.974 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:17.974 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228260+0000", 2024-05-08T18:30:17.974 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1496e-05 2024-05-08T18:30:17.974 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.975 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.975 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:17.975 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228292+0000", 2024-05-08T18:30:17.975 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1294000000000002e-05 2024-05-08T18:30:17.975 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.975 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.975 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:17.975 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228306+0000", 2024-05-08T18:30:17.975 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4606e-05 2024-05-08T18:30:17.975 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.975 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.976 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:17.976 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228443+0000", 2024-05-08T18:30:17.976 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013672599999999999 2024-05-08T18:30:17.976 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.976 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.976 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:17.976 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228813+0000", 2024-05-08T18:30:17.976 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00036987000000000001 2024-05-08T18:30:17.976 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.976 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.976 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:17.976 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.229365+0000", 2024-05-08T18:30:17.976 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00055210600000000002 2024-05-08T18:30:17.976 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.977 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.977 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:17.977 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.230800+0000", 2024-05-08T18:30:17.977 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001435006 2024-05-08T18:30:17.977 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.977 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.977 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:17.977 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.231369+0000", 2024-05-08T18:30:17.977 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00056848499999999998 2024-05-08T18:30:17.977 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.977 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.977 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:17.977 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.231455+0000", 2024-05-08T18:30:17.977 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6905999999999998e-05 2024-05-08T18:30:17.978 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.978 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.978 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:17.978 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.231522+0000", 2024-05-08T18:30:17.978 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6470000000000006e-05 2024-05-08T18:30:17.978 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:17.978 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:17.978 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:17.978 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.978 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.978 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:798 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:17.978 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.232573+0000", 2024-05-08T18:30:17.979 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 25.671964528, 2024-05-08T18:30:17.979 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0030406690000000002, 2024-05-08T18:30:17.979 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:17.979 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:17.979 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:17.979 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:17.979 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:17.979 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:17.979 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 798 2024-05-08T18:30:17.979 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.979 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:17.979 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.979 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:17.979 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232573+0000", 2024-05-08T18:30:17.980 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:17.980 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.980 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.980 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:17.980 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232573+0000", 2024-05-08T18:30:17.980 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:17.980 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.980 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.980 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:17.980 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232574+0000", 2024-05-08T18:30:17.980 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.446e-06 2024-05-08T18:30:17.980 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.980 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.981 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:17.981 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232581+0000", 2024-05-08T18:30:17.981 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.0670000000000003e-06 2024-05-08T18:30:17.981 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.981 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.981 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:17.981 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232600+0000", 2024-05-08T18:30:17.981 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8822999999999999e-05 2024-05-08T18:30:17.981 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.981 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.981 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:17.981 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232611+0000", 2024-05-08T18:30:17.981 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1233000000000001e-05 2024-05-08T18:30:17.981 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.982 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.982 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:17.982 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232731+0000", 2024-05-08T18:30:17.982 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000120189 2024-05-08T18:30:17.982 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.982 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.982 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:17.982 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232963+0000", 2024-05-08T18:30:17.982 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023111900000000001 2024-05-08T18:30:17.982 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.982 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.982 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:17.982 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.233441+0000", 2024-05-08T18:30:17.983 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00047866899999999998 2024-05-08T18:30:17.983 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.983 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.983 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:17.983 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.234542+0000", 2024-05-08T18:30:17.983 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001101245 2024-05-08T18:30:17.983 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.983 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.983 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:17.983 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.235349+0000", 2024-05-08T18:30:17.983 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000806567 2024-05-08T18:30:17.983 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.983 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.983 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:17.983 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.235498+0000", 2024-05-08T18:30:17.984 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014907200000000001 2024-05-08T18:30:17.984 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.984 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.984 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:17.984 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.235613+0000", 2024-05-08T18:30:17.984 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115239 2024-05-08T18:30:17.984 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:17.984 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:17.984 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:17.984 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.984 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.984 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:17.984 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.248596+0000", 2024-05-08T18:30:17.984 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 25.655940722, 2024-05-08T18:30:17.985 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002919984, 2024-05-08T18:30:17.985 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:17.985 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:17.985 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:17.985 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:17.985 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:17.985 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:17.985 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 805 2024-05-08T18:30:17.985 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.985 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:17.985 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.985 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:17.985 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248596+0000", 2024-05-08T18:30:17.985 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:17.986 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.986 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.986 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:17.986 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248596+0000", 2024-05-08T18:30:17.986 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:17.986 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.986 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.986 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:17.986 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248599+0000", 2024-05-08T18:30:17.986 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3630000000000001e-06 2024-05-08T18:30:17.986 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.986 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.987 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:17.987 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248610+0000", 2024-05-08T18:30:17.987 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1267000000000001e-05 2024-05-08T18:30:17.987 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.987 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.987 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:17.987 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248641+0000", 2024-05-08T18:30:17.987 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1309999999999997e-05 2024-05-08T18:30:17.987 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.987 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.987 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:17.987 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248656+0000", 2024-05-08T18:30:17.987 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4449e-05 2024-05-08T18:30:17.987 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.988 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.988 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:17.988 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248781+0000", 2024-05-08T18:30:17.988 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012500900000000001 2024-05-08T18:30:17.988 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.988 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.988 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:17.988 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.249001+0000", 2024-05-08T18:30:17.988 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021963500000000001 2024-05-08T18:30:17.988 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.988 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.988 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:17.988 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.249341+0000", 2024-05-08T18:30:17.988 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00034004100000000002 2024-05-08T18:30:17.989 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.989 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.989 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:17.989 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.250473+0000", 2024-05-08T18:30:17.989 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0011324180000000001 2024-05-08T18:30:17.989 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.989 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.989 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:17.989 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.251230+0000", 2024-05-08T18:30:17.989 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00075751400000000004 2024-05-08T18:30:17.989 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.989 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.989 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:17.990 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.251394+0000", 2024-05-08T18:30:17.990 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016379200000000001 2024-05-08T18:30:17.990 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.990 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.990 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:17.990 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.251516+0000", 2024-05-08T18:30:17.990 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012218600000000001 2024-05-08T18:30:17.990 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:17.990 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:17.990 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:17.990 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.990 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.990 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:17.991 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.313184+0000", 2024-05-08T18:30:17.991 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 25.591353046999998, 2024-05-08T18:30:17.991 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003040016, 2024-05-08T18:30:17.991 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:17.991 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:17.991 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:17.991 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:17.991 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:17.991 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:17.991 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 832 2024-05-08T18:30:17.991 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.991 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:17.991 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.991 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:17.992 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313184+0000", 2024-05-08T18:30:17.992 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:17.992 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.992 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.992 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:17.992 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313184+0000", 2024-05-08T18:30:17.992 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:17.992 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.992 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.992 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:17.992 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313187+0000", 2024-05-08T18:30:17.992 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5100000000000001e-06 2024-05-08T18:30:17.993 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.993 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.993 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:17.993 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313199+0000", 2024-05-08T18:30:17.993 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.201e-05 2024-05-08T18:30:17.993 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.993 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.993 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:17.993 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313229+0000", 2024-05-08T18:30:17.993 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9839e-05 2024-05-08T18:30:17.993 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.993 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.993 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:17.994 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313243+0000", 2024-05-08T18:30:17.994 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4727e-05 2024-05-08T18:30:17.994 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.994 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.994 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:17.994 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313358+0000", 2024-05-08T18:30:17.994 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115016 2024-05-08T18:30:17.994 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.994 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.994 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:17.994 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313577+0000", 2024-05-08T18:30:17.994 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021897799999999999 2024-05-08T18:30:17.994 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.994 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.995 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:17.995 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313889+0000", 2024-05-08T18:30:17.995 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00031210400000000001 2024-05-08T18:30:17.995 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.995 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.995 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:17.995 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.315229+0000", 2024-05-08T18:30:17.995 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001339963 2024-05-08T18:30:17.995 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.995 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.995 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:17.995 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.315938+0000", 2024-05-08T18:30:17.996 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00070853400000000003 2024-05-08T18:30:17.996 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.996 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.996 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:17.996 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.316111+0000", 2024-05-08T18:30:17.996 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000173396 2024-05-08T18:30:17.996 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.996 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.996 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:17.996 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.316224+0000", 2024-05-08T18:30:17.996 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000112939 2024-05-08T18:30:17.996 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:17.996 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:17.997 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:17.997 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.997 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.997 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:834 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:17.997 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.317499+0000", 2024-05-08T18:30:17.997 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 25.587038247999999, 2024-05-08T18:30:17.997 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0033281109999999999, 2024-05-08T18:30:17.997 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:17.997 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:17.997 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:17.997 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:17.997 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:17.998 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:17.998 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 834 2024-05-08T18:30:17.998 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.998 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:17.998 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.998 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:17.998 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317499+0000", 2024-05-08T18:30:17.998 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:17.998 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.998 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.998 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:17.998 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317499+0000", 2024-05-08T18:30:17.998 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:17.998 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.999 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.999 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:17.999 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317501+0000", 2024-05-08T18:30:17.999 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9400000000000001e-06 2024-05-08T18:30:17.999 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.999 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.999 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:17.999 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317511+0000", 2024-05-08T18:30:17.999 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0297e-05 2024-05-08T18:30:17.999 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:17.999 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:17.999 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:18.000 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317532+0000", 2024-05-08T18:30:18.000 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1013e-05 2024-05-08T18:30:18.000 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.000 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.000 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:18.000 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317543+0000", 2024-05-08T18:30:18.000 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0757000000000001e-05 2024-05-08T18:30:18.000 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.000 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.000 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:18.000 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317658+0000", 2024-05-08T18:30:18.000 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115129 2024-05-08T18:30:18.000 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.000 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.001 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:18.001 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317887+0000", 2024-05-08T18:30:18.001 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00022880099999999999 2024-05-08T18:30:18.001 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.001 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.001 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:18.001 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.318378+0000", 2024-05-08T18:30:18.001 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00049129000000000002 2024-05-08T18:30:18.001 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.001 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.001 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:18.001 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.319597+0000", 2024-05-08T18:30:18.001 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012188469999999999 2024-05-08T18:30:18.001 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.002 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.002 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:18.002 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.320566+0000", 2024-05-08T18:30:18.002 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00096881599999999995 2024-05-08T18:30:18.002 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.002 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.002 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:18.002 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.320713+0000", 2024-05-08T18:30:18.002 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014691500000000001 2024-05-08T18:30:18.002 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.002 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.002 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:18.002 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.320827+0000", 2024-05-08T18:30:18.003 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000114306 2024-05-08T18:30:18.003 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:18.003 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:18.003 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:18.003 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.003 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.003 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:18.003 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.505569+0000", 2024-05-08T18:30:18.003 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 25.398967795000001, 2024-05-08T18:30:18.003 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028584309999999998, 2024-05-08T18:30:18.003 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:18.003 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:18.003 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:18.004 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:18.004 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:18.004 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:18.004 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 916 2024-05-08T18:30:18.004 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.004 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:18.004 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.004 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:18.004 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505569+0000", 2024-05-08T18:30:18.004 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:18.004 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.004 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.004 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:18.005 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505569+0000", 2024-05-08T18:30:18.005 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:18.005 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.005 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.005 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:18.005 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505572+0000", 2024-05-08T18:30:18.005 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3659999999999999e-06 2024-05-08T18:30:18.005 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.005 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.005 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:18.005 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505583+0000", 2024-05-08T18:30:18.005 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1574e-05 2024-05-08T18:30:18.005 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.005 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.006 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:18.006 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505614+0000", 2024-05-08T18:30:18.006 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0670000000000003e-05 2024-05-08T18:30:18.006 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.006 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.006 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:18.006 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505629+0000", 2024-05-08T18:30:18.006 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5063e-05 2024-05-08T18:30:18.006 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.006 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.006 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:18.007 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505754+0000", 2024-05-08T18:30:18.007 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012508899999999999 2024-05-08T18:30:18.007 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.007 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.007 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:18.007 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505988+0000", 2024-05-08T18:30:18.007 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023334699999999999 2024-05-08T18:30:18.007 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.007 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.007 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:18.007 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.506299+0000", 2024-05-08T18:30:18.007 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000311811 2024-05-08T18:30:18.007 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.007 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.008 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:18.008 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.507489+0000", 2024-05-08T18:30:18.008 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0011899510000000001 2024-05-08T18:30:18.008 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.008 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.008 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:18.008 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.508141+0000", 2024-05-08T18:30:18.008 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00065180200000000005 2024-05-08T18:30:18.008 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.008 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.008 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:18.008 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.508306+0000", 2024-05-08T18:30:18.008 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016450199999999999 2024-05-08T18:30:18.008 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.009 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.009 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:18.009 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.508428+0000", 2024-05-08T18:30:18.009 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000122256 2024-05-08T18:30:18.009 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:18.009 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:18.009 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:18.009 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.009 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.009 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:918 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:18.009 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.509337+0000", 2024-05-08T18:30:18.009 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 25.395199728000001, 2024-05-08T18:30:18.010 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002971787, 2024-05-08T18:30:18.010 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:18.010 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:18.010 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:18.010 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:18.010 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:18.010 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:18.010 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 918 2024-05-08T18:30:18.010 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.010 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:18.010 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.010 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:18.010 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509337+0000", 2024-05-08T18:30:18.010 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:18.011 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.011 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.011 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:18.011 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509337+0000", 2024-05-08T18:30:18.011 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:18.011 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.011 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.011 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:18.011 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509340+0000", 2024-05-08T18:30:18.011 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2570000000000002e-06 2024-05-08T18:30:18.011 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.011 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.011 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:18.011 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509351+0000", 2024-05-08T18:30:18.012 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0933e-05 2024-05-08T18:30:18.012 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.012 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.012 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:18.012 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509382+0000", 2024-05-08T18:30:18.012 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1198999999999997e-05 2024-05-08T18:30:18.012 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.012 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.012 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:18.012 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509400+0000", 2024-05-08T18:30:18.012 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8236999999999998e-05 2024-05-08T18:30:18.012 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.012 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.012 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:18.013 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509529+0000", 2024-05-08T18:30:18.013 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012905600000000001 2024-05-08T18:30:18.013 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.013 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.013 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:18.013 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509777+0000", 2024-05-08T18:30:18.013 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024786799999999999 2024-05-08T18:30:18.013 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.013 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.013 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:18.013 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.510284+0000", 2024-05-08T18:30:18.013 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000506796 2024-05-08T18:30:18.013 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.014 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.014 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:18.014 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.511453+0000", 2024-05-08T18:30:18.014 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001169575 2024-05-08T18:30:18.014 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.014 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.014 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:18.014 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.512051+0000", 2024-05-08T18:30:18.014 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00059743100000000005 2024-05-08T18:30:18.014 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.014 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.014 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:18.014 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.512199+0000", 2024-05-08T18:30:18.015 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000148486 2024-05-08T18:30:18.015 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.015 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.015 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:18.015 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.512309+0000", 2024-05-08T18:30:18.015 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000109949 2024-05-08T18:30:18.015 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:18.015 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:18.015 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:18.015 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.015 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.015 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:931 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:18.015 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.543277+0000", 2024-05-08T18:30:18.015 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 25.361260572999999, 2024-05-08T18:30:18.016 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028250710000000002, 2024-05-08T18:30:18.016 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:18.016 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:18.016 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:18.016 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:18.016 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:18.016 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:18.016 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 931 2024-05-08T18:30:18.016 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.016 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:18.016 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.016 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:18.016 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543277+0000", 2024-05-08T18:30:18.017 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:18.017 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.017 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.017 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:18.017 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543277+0000", 2024-05-08T18:30:18.017 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:18.017 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.017 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.017 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:18.017 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543279+0000", 2024-05-08T18:30:18.017 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.373e-06 2024-05-08T18:30:18.017 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.017 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.017 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:18.018 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543291+0000", 2024-05-08T18:30:18.018 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1517e-05 2024-05-08T18:30:18.018 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.018 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.018 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:18.018 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543323+0000", 2024-05-08T18:30:18.018 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2292000000000002e-05 2024-05-08T18:30:18.018 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.018 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.018 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:18.018 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543340+0000", 2024-05-08T18:30:18.018 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.749e-05 2024-05-08T18:30:18.018 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.019 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.019 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:18.019 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543462+0000", 2024-05-08T18:30:18.019 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000121413 2024-05-08T18:30:18.019 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.019 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.019 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:18.019 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543681+0000", 2024-05-08T18:30:18.019 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021974200000000001 2024-05-08T18:30:18.019 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.019 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.019 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:18.020 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.544004+0000", 2024-05-08T18:30:18.020 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00032268900000000003 2024-05-08T18:30:18.020 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.020 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.020 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:18.020 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.545158+0000", 2024-05-08T18:30:18.020 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0011540190000000001 2024-05-08T18:30:18.020 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.020 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.020 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:18.020 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.545970+0000", 2024-05-08T18:30:18.020 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00081224300000000004 2024-05-08T18:30:18.020 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.021 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.021 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:18.021 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.546043+0000", 2024-05-08T18:30:18.021 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.3067999999999999e-05 2024-05-08T18:30:18.021 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.021 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.021 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:18.021 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.546102+0000", 2024-05-08T18:30:18.021 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8224999999999999e-05 2024-05-08T18:30:18.021 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:18.021 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:18.021 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:18.021 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.021 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.021 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:18.022 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.578568+0000", 2024-05-08T18:30:18.022 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 25.325969665999999, 2024-05-08T18:30:18.022 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0030345839999999999, 2024-05-08T18:30:18.022 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:18.022 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:18.022 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:18.022 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:18.022 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:18.022 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:18.022 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 946 2024-05-08T18:30:18.022 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.022 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:18.023 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.023 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:18.023 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578568+0000", 2024-05-08T18:30:18.023 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:18.023 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.023 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.023 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:18.023 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578568+0000", 2024-05-08T18:30:18.023 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:18.023 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.023 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.023 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:18.023 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578570+0000", 2024-05-08T18:30:18.023 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3700000000000002e-06 2024-05-08T18:30:18.024 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.024 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.024 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:18.024 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578582+0000", 2024-05-08T18:30:18.024 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1627000000000001e-05 2024-05-08T18:30:18.024 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.024 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.024 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:18.024 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578612+0000", 2024-05-08T18:30:18.024 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0103e-05 2024-05-08T18:30:18.024 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.024 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.024 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:18.024 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578627+0000", 2024-05-08T18:30:18.025 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4949999999999999e-05 2024-05-08T18:30:18.025 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.025 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.025 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:18.025 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578750+0000", 2024-05-08T18:30:18.025 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012309899999999999 2024-05-08T18:30:18.025 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.025 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.025 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:18.025 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.579042+0000", 2024-05-08T18:30:18.025 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00029212500000000001 2024-05-08T18:30:18.025 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.025 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.026 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:18.026 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.579557+0000", 2024-05-08T18:30:18.026 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00051536900000000001 2024-05-08T18:30:18.026 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.026 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.026 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:18.026 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.580698+0000", 2024-05-08T18:30:18.026 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001140774 2024-05-08T18:30:18.026 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.026 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.026 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:18.026 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.581367+0000", 2024-05-08T18:30:18.026 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00066884799999999999 2024-05-08T18:30:18.026 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.027 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.027 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:18.027 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.581489+0000", 2024-05-08T18:30:18.027 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012265600000000001 2024-05-08T18:30:18.027 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.027 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.027 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:18.027 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.581602+0000", 2024-05-08T18:30:18.027 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000112663 2024-05-08T18:30:18.027 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:18.027 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:18.027 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:18.027 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:18.027 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:18.028 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:30:18.029 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-08T18:30:18.030 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:30:18.029+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:30:18.130 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:30:18.128+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:30:18.190 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:30:18.190 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:30:18.190 INFO:teuthology.orchestra.run.smithi097.stdout: "num_ops": 0 2024-05-08T18:30:18.191 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:30:18.204 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-08T18:30:18.249 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:30:18.253+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:30:18.321 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:30:18.321 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:30:18.321 INFO:teuthology.orchestra.run.smithi097.stdout: "complaint_time": 30, 2024-05-08T18:30:18.321 INFO:teuthology.orchestra.run.smithi097.stdout: "num_blocked_ops": 0 2024-05-08T18:30:18.321 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:30:18.331 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:30:18.333+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:30:18.334 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-08T18:30:18.432 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:30:18.432+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:30:18.490 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-08T18:30:18.501 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:30:18.501 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2024-05-08T18:30:18.501 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2024-05-08T18:30:18.501 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-05-08T18:30:18.501 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.501 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4479.0:40 5.b 5:d797044f:::zonegroup_info.ea3b680f-900d-4805-81ec-055811625780:head [create,call version.set in=10b,writefull 0~436] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-05-08T18:30:18.501 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:44.637551+0000", 2024-05-08T18:30:18.502 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 33.865648858999997, 2024-05-08T18:30:18.502 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003054013, 2024-05-08T18:30:18.502 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:18.502 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:18.502 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:18.502 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:18.502 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4479", 2024-05-08T18:30:18.502 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3577501689", 2024-05-08T18:30:18.502 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 40 2024-05-08T18:30:18.502 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.502 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:18.502 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.502 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:18.503 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.637551+0000", 2024-05-08T18:30:18.503 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:18.503 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.503 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.503 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:18.503 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.637551+0000", 2024-05-08T18:30:18.503 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:18.503 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.503 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.503 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:18.503 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.637554+0000", 2024-05-08T18:30:18.503 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6599999999999999e-06 2024-05-08T18:30:18.503 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.504 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.504 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:18.504 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.637576+0000", 2024-05-08T18:30:18.504 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1965999999999999e-05 2024-05-08T18:30:18.504 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.504 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.504 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:18.504 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.637603+0000", 2024-05-08T18:30:18.504 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7257e-05 2024-05-08T18:30:18.504 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.504 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.504 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:18.504 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.637623+0000", 2024-05-08T18:30:18.505 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9570000000000001e-05 2024-05-08T18:30:18.505 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.505 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.505 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:18.505 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.637766+0000", 2024-05-08T18:30:18.505 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000143435 2024-05-08T18:30:18.505 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.505 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.505 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:18.505 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.638167+0000", 2024-05-08T18:30:18.505 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00040082399999999998 2024-05-08T18:30:18.505 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.505 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.505 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:18.506 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.638627+0000", 2024-05-08T18:30:18.506 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00046019300000000002 2024-05-08T18:30:18.506 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.506 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.506 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:18.506 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.640399+0000", 2024-05-08T18:30:18.506 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0017714199999999999 2024-05-08T18:30:18.506 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.506 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.506 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:18.506 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.640447+0000", 2024-05-08T18:30:18.506 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8383000000000001e-05 2024-05-08T18:30:18.506 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.507 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.507 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:18.507 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.640534+0000", 2024-05-08T18:30:18.507 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7078999999999998e-05 2024-05-08T18:30:18.507 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.507 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.507 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:18.507 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.640606+0000", 2024-05-08T18:30:18.507 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1225999999999999e-05 2024-05-08T18:30:18.507 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:18.507 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:18.507 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:18.507 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.507 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.508 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4479.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-05-08T18:30:18.508 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:44.643918+0000", 2024-05-08T18:30:18.508 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 33.859282583999999, 2024-05-08T18:30:18.508 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002986004, 2024-05-08T18:30:18.508 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:18.508 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:18.508 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:18.508 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:18.508 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4479", 2024-05-08T18:30:18.508 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3577501689", 2024-05-08T18:30:18.508 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 42 2024-05-08T18:30:18.508 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.508 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:18.508 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.509 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:18.509 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.643918+0000", 2024-05-08T18:30:18.509 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:18.509 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.509 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.509 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:18.509 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.643918+0000", 2024-05-08T18:30:18.509 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:18.509 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.509 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.509 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:18.509 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.643919+0000", 2024-05-08T18:30:18.509 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4729999999999999e-06 2024-05-08T18:30:18.510 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.510 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.510 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:18.510 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.643927+0000", 2024-05-08T18:30:18.510 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6389999999999992e-06 2024-05-08T18:30:18.510 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.510 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.510 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:18.510 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.643945+0000", 2024-05-08T18:30:18.510 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8195000000000001e-05 2024-05-08T18:30:18.510 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.510 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.510 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:18.511 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.643954+0000", 2024-05-08T18:30:18.511 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5210000000000002e-06 2024-05-08T18:30:18.511 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.511 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.511 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:18.511 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.644123+0000", 2024-05-08T18:30:18.511 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016904999999999999 2024-05-08T18:30:18.511 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.511 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.511 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:18.511 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.644315+0000", 2024-05-08T18:30:18.511 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00019202800000000001 2024-05-08T18:30:18.511 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.512 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.512 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:18.512 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.644505+0000", 2024-05-08T18:30:18.512 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000190552 2024-05-08T18:30:18.512 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.512 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.512 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:18.512 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.645877+0000", 2024-05-08T18:30:18.512 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001371702 2024-05-08T18:30:18.512 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.512 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.512 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:18.512 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.646778+0000", 2024-05-08T18:30:18.512 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00090065700000000002 2024-05-08T18:30:18.513 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.513 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.513 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:18.513 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.646843+0000", 2024-05-08T18:30:18.513 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5504000000000002e-05 2024-05-08T18:30:18.513 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.513 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.513 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:18.513 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.646904+0000", 2024-05-08T18:30:18.513 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0683000000000002e-05 2024-05-08T18:30:18.513 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:18.513 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:18.513 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:18.513 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.513 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.514 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:57 7.3 e30/29 7:c609908c:::notify.5:head v 30'2, mlcod=0'0)", 2024-05-08T18:30:18.514 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:48.669376+0000", 2024-05-08T18:30:18.514 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 29.833824476, 2024-05-08T18:30:18.514 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0041509479999999998, 2024-05-08T18:30:18.514 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:18.514 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:18.514 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:18.514 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:18.514 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.514 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:18.514 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669376+0000", 2024-05-08T18:30:18.514 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:18.514 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.515 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.515 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:18.515 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669376+0000", 2024-05-08T18:30:18.515 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:18.515 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.515 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.515 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:18.515 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669378+0000", 2024-05-08T18:30:18.515 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.79e-06 2024-05-08T18:30:18.515 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.515 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.515 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:18.515 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669393+0000", 2024-05-08T18:30:18.516 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5053e-05 2024-05-08T18:30:18.516 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.516 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.516 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:18.516 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669427+0000", 2024-05-08T18:30:18.516 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4326999999999998e-05 2024-05-08T18:30:18.516 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.516 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.516 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:18.516 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669451+0000", 2024-05-08T18:30:18.516 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3629e-05 2024-05-08T18:30:18.516 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.516 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.517 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:18.517 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669563+0000", 2024-05-08T18:30:18.517 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011251099999999999 2024-05-08T18:30:18.517 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.517 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.517 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:18.517 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669607+0000", 2024-05-08T18:30:18.517 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3877e-05 2024-05-08T18:30:18.517 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.517 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.517 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:18.517 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.673401+0000", 2024-05-08T18:30:18.517 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0037942819999999999 2024-05-08T18:30:18.517 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.517 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.518 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:18.518 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.673527+0000", 2024-05-08T18:30:18.518 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012547900000000001 2024-05-08T18:30:18.518 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:18.518 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:18.518 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:18.518 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.518 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.518 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:58 7.14 e30/29 7:2b04a3e9:::notify.6:head v 30'1, mlcod=0'0)", 2024-05-08T18:30:18.518 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:48.669496+0000", 2024-05-08T18:30:18.518 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 29.833704103999999, 2024-05-08T18:30:18.518 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0046805609999999997, 2024-05-08T18:30:18.518 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:18.519 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:18.519 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:18.519 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:18.519 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.519 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:18.519 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669496+0000", 2024-05-08T18:30:18.519 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:18.519 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.519 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.519 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:18.519 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669496+0000", 2024-05-08T18:30:18.519 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:18.519 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.519 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.520 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:18.520 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669497+0000", 2024-05-08T18:30:18.520 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0100000000000001e-06 2024-05-08T18:30:18.520 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.520 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.520 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:18.520 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669507+0000", 2024-05-08T18:30:18.520 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.7540000000000001e-06 2024-05-08T18:30:18.520 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.520 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.520 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:18.520 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669528+0000", 2024-05-08T18:30:18.520 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.05e-05 2024-05-08T18:30:18.520 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.521 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.521 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:18.521 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669544+0000", 2024-05-08T18:30:18.521 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6716000000000001e-05 2024-05-08T18:30:18.521 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.521 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.521 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:18.521 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669667+0000", 2024-05-08T18:30:18.521 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012275799999999999 2024-05-08T18:30:18.521 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.521 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.521 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:18.521 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669706+0000", 2024-05-08T18:30:18.522 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8764999999999999e-05 2024-05-08T18:30:18.522 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.522 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.522 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:18.522 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674100+0000", 2024-05-08T18:30:18.522 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.004394528 2024-05-08T18:30:18.522 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.522 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.522 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:18.522 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674177+0000", 2024-05-08T18:30:18.522 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6530000000000001e-05 2024-05-08T18:30:18.522 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:18.522 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:18.522 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:18.523 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.523 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.523 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:18.523 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.794231+0000", 2024-05-08T18:30:18.523 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 26.708969712999998, 2024-05-08T18:30:18.523 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031872810000000001, 2024-05-08T18:30:18.523 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:18.523 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:18.523 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:18.523 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:18.523 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:18.523 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:18.523 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 236 2024-05-08T18:30:18.523 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.524 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:18.524 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.524 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:18.524 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794231+0000", 2024-05-08T18:30:18.524 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:18.524 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.524 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.524 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:18.524 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794231+0000", 2024-05-08T18:30:18.524 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:18.524 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.524 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.524 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:18.524 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794234+0000", 2024-05-08T18:30:18.525 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.36e-06 2024-05-08T18:30:18.525 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.525 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.525 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:18.525 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794248+0000", 2024-05-08T18:30:18.525 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4372999999999999e-05 2024-05-08T18:30:18.525 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.525 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.525 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:18.525 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794279+0000", 2024-05-08T18:30:18.525 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1075999999999999e-05 2024-05-08T18:30:18.525 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.525 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.525 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:18.525 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794295+0000", 2024-05-08T18:30:18.526 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5386000000000001e-05 2024-05-08T18:30:18.526 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.526 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.526 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:18.526 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794416+0000", 2024-05-08T18:30:18.526 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012071899999999999 2024-05-08T18:30:18.526 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.526 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.526 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:18.526 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794638+0000", 2024-05-08T18:30:18.526 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00022262599999999999 2024-05-08T18:30:18.526 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.526 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.526 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:18.527 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.795061+0000", 2024-05-08T18:30:18.527 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00042248900000000001 2024-05-08T18:30:18.527 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.527 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.527 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:18.527 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.796477+0000", 2024-05-08T18:30:18.527 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0014162230000000001 2024-05-08T18:30:18.527 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.527 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.527 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:18.527 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.797258+0000", 2024-05-08T18:30:18.527 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00078159400000000004 2024-05-08T18:30:18.527 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.527 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.528 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:18.528 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.797349+0000", 2024-05-08T18:30:18.528 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0462000000000002e-05 2024-05-08T18:30:18.528 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.528 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.528 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:18.528 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.797418+0000", 2024-05-08T18:30:18.528 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8973000000000005e-05 2024-05-08T18:30:18.528 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:18.528 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:18.528 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:18.528 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.528 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.528 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:281 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:18.529 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.806063+0000", 2024-05-08T18:30:18.529 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 26.697137579, 2024-05-08T18:30:18.529 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002923761, 2024-05-08T18:30:18.529 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:18.529 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:18.529 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:18.529 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:18.529 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:18.529 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:18.529 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 281 2024-05-08T18:30:18.529 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.529 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:18.529 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.530 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:18.530 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.806063+0000", 2024-05-08T18:30:18.530 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:18.530 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.530 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.530 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:18.530 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.806063+0000", 2024-05-08T18:30:18.530 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:18.530 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.530 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.530 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:18.530 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.806064+0000", 2024-05-08T18:30:18.530 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.204e-06 2024-05-08T18:30:18.531 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.531 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.531 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:18.531 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.806073+0000", 2024-05-08T18:30:18.531 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5609999999999999e-06 2024-05-08T18:30:18.531 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.531 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.531 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:18.531 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.806089+0000", 2024-05-08T18:30:18.531 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6673000000000001e-05 2024-05-08T18:30:18.531 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.531 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.531 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:18.531 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.806098+0000", 2024-05-08T18:30:18.532 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8899999999999996e-06 2024-05-08T18:30:18.532 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.532 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.532 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:18.532 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.806165+0000", 2024-05-08T18:30:18.532 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6927999999999993e-05 2024-05-08T18:30:18.532 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.532 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.532 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:18.532 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.806298+0000", 2024-05-08T18:30:18.532 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000132886 2024-05-08T18:30:18.532 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.532 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.532 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:18.533 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.806453+0000", 2024-05-08T18:30:18.533 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000155339 2024-05-08T18:30:18.533 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.533 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.533 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:18.533 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.807157+0000", 2024-05-08T18:30:18.533 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00070363900000000004 2024-05-08T18:30:18.533 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.533 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.533 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:18.533 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.808880+0000", 2024-05-08T18:30:18.533 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0017227130000000001 2024-05-08T18:30:18.533 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.533 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.534 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:18.534 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.808938+0000", 2024-05-08T18:30:18.534 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8814999999999998e-05 2024-05-08T18:30:18.534 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.534 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.534 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:18.534 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.808987+0000", 2024-05-08T18:30:18.534 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8112999999999998e-05 2024-05-08T18:30:18.534 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:18.534 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:18.534 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:18.534 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.534 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.535 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:304 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:18.535 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.809645+0000", 2024-05-08T18:30:18.535 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 26.693555741000001, 2024-05-08T18:30:18.535 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031633579999999998, 2024-05-08T18:30:18.535 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:18.535 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:18.535 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:18.535 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:18.535 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:18.535 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:18.535 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 304 2024-05-08T18:30:18.535 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.535 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:18.535 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.536 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:18.536 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809645+0000", 2024-05-08T18:30:18.536 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:18.536 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.536 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.536 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:18.536 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809645+0000", 2024-05-08T18:30:18.536 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:18.536 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.536 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.536 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:18.536 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809646+0000", 2024-05-08T18:30:18.536 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.113e-06 2024-05-08T18:30:18.536 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.536 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.537 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:18.537 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809652+0000", 2024-05-08T18:30:18.537 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1650000000000003e-06 2024-05-08T18:30:18.537 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.537 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.537 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:18.537 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809668+0000", 2024-05-08T18:30:18.537 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6025e-05 2024-05-08T18:30:18.537 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.537 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.537 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:18.537 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809678+0000", 2024-05-08T18:30:18.537 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0456e-05 2024-05-08T18:30:18.537 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.538 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.538 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:18.538 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809745+0000", 2024-05-08T18:30:18.538 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7088000000000005e-05 2024-05-08T18:30:18.538 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.538 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.538 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:18.538 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809803+0000", 2024-05-08T18:30:18.538 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7405999999999999e-05 2024-05-08T18:30:18.538 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.538 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.538 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:18.538 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809951+0000", 2024-05-08T18:30:18.539 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014775500000000001 2024-05-08T18:30:18.539 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.539 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.539 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:18.539 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.810564+0000", 2024-05-08T18:30:18.539 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00061324899999999996 2024-05-08T18:30:18.539 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.539 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.539 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:18.539 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.812744+0000", 2024-05-08T18:30:18.539 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0021804509999999999 2024-05-08T18:30:18.539 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.539 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.539 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:18.539 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.812781+0000", 2024-05-08T18:30:18.540 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6554999999999998e-05 2024-05-08T18:30:18.540 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.540 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.540 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:18.540 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.812808+0000", 2024-05-08T18:30:18.540 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7095000000000001e-05 2024-05-08T18:30:18.540 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:18.540 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:18.540 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:18.540 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.540 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.540 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:18.540 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.105553+0000", 2024-05-08T18:30:18.541 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 26.397647729999999, 2024-05-08T18:30:18.541 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028754850000000001, 2024-05-08T18:30:18.541 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:18.541 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:18.541 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:18.541 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:18.541 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:18.541 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:18.541 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 742 2024-05-08T18:30:18.541 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.541 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:18.541 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.541 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:18.541 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.105553+0000", 2024-05-08T18:30:18.541 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:18.542 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.542 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.542 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:18.542 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.105553+0000", 2024-05-08T18:30:18.542 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:18.542 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.542 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.542 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:18.542 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.105556+0000", 2024-05-08T18:30:18.542 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3100000000000001e-06 2024-05-08T18:30:18.542 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.542 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.542 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:18.543 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.105569+0000", 2024-05-08T18:30:18.543 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2754e-05 2024-05-08T18:30:18.543 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.543 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.543 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:18.543 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.105601+0000", 2024-05-08T18:30:18.543 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2435999999999999e-05 2024-05-08T18:30:18.543 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.543 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.543 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:18.543 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.105616+0000", 2024-05-08T18:30:18.543 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4657e-05 2024-05-08T18:30:18.543 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.543 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.544 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:18.544 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.105804+0000", 2024-05-08T18:30:18.544 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00018861799999999999 2024-05-08T18:30:18.544 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.544 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.544 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:18.544 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.106054+0000", 2024-05-08T18:30:18.544 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024948499999999997 2024-05-08T18:30:18.544 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.544 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.544 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:18.544 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.106390+0000", 2024-05-08T18:30:18.544 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00033640100000000001 2024-05-08T18:30:18.544 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.545 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.545 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:18.545 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.107527+0000", 2024-05-08T18:30:18.545 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001136871 2024-05-08T18:30:18.545 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.545 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.545 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:18.545 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.108265+0000", 2024-05-08T18:30:18.545 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00073753100000000004 2024-05-08T18:30:18.545 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.545 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.545 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:18.545 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.108353+0000", 2024-05-08T18:30:18.545 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8232999999999994e-05 2024-05-08T18:30:18.546 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.546 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.546 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:18.546 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.108428+0000", 2024-05-08T18:30:18.546 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.5189000000000001e-05 2024-05-08T18:30:18.546 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:18.546 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:18.546 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:18.546 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.546 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.546 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:18.546 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.148015+0000", 2024-05-08T18:30:18.547 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 26.355185787, 2024-05-08T18:30:18.547 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032297409999999999, 2024-05-08T18:30:18.547 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:18.547 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:18.547 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:18.547 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:18.547 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:18.547 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:18.547 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 760 2024-05-08T18:30:18.547 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.547 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:18.547 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.547 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:18.547 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.148015+0000", 2024-05-08T18:30:18.548 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:18.548 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.548 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.548 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:18.548 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.148015+0000", 2024-05-08T18:30:18.548 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:18.548 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.548 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.548 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:18.548 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.148017+0000", 2024-05-08T18:30:18.548 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1830000000000001e-06 2024-05-08T18:30:18.548 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.548 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.548 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:18.549 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.148030+0000", 2024-05-08T18:30:18.549 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2893e-05 2024-05-08T18:30:18.549 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.549 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.549 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:18.549 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.148061+0000", 2024-05-08T18:30:18.549 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0953e-05 2024-05-08T18:30:18.549 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.549 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.549 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:18.549 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.148077+0000", 2024-05-08T18:30:18.549 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6554000000000001e-05 2024-05-08T18:30:18.549 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.549 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.550 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:18.550 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.148230+0000", 2024-05-08T18:30:18.550 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015263899999999999 2024-05-08T18:30:18.550 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.550 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.550 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:18.550 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.148592+0000", 2024-05-08T18:30:18.550 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00036219699999999997 2024-05-08T18:30:18.550 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.550 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.550 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:18.550 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.149139+0000", 2024-05-08T18:30:18.550 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00054734599999999999 2024-05-08T18:30:18.550 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.551 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.551 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:18.551 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.150505+0000", 2024-05-08T18:30:18.551 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001365479 2024-05-08T18:30:18.551 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.551 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.551 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:18.551 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.151087+0000", 2024-05-08T18:30:18.551 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00058201200000000002 2024-05-08T18:30:18.551 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.551 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.551 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:18.551 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.151175+0000", 2024-05-08T18:30:18.551 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8199e-05 2024-05-08T18:30:18.552 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.552 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.552 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:18.552 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.151244+0000", 2024-05-08T18:30:18.552 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9286e-05 2024-05-08T18:30:18.552 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:18.552 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:18.552 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:18.552 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.552 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.552 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:18.552 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.277376+0000", 2024-05-08T18:30:18.552 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 26.225823868999999, 2024-05-08T18:30:18.552 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032022190000000001, 2024-05-08T18:30:18.553 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:18.553 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:18.553 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:18.553 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:18.553 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:18.553 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:18.553 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 817 2024-05-08T18:30:18.553 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.553 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:18.553 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.553 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:18.553 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.277376+0000", 2024-05-08T18:30:18.553 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:18.553 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.554 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.554 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:18.554 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.277376+0000", 2024-05-08T18:30:18.554 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:18.554 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.554 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.554 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:18.554 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.277379+0000", 2024-05-08T18:30:18.554 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4430000000000002e-06 2024-05-08T18:30:18.554 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.554 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.554 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:18.554 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.277391+0000", 2024-05-08T18:30:18.554 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1634000000000001e-05 2024-05-08T18:30:18.555 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.555 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.555 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:18.555 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.277421+0000", 2024-05-08T18:30:18.555 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0691999999999997e-05 2024-05-08T18:30:18.555 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.555 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.555 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:18.555 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.277438+0000", 2024-05-08T18:30:18.555 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7102999999999999e-05 2024-05-08T18:30:18.555 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.555 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.555 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:18.555 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.277602+0000", 2024-05-08T18:30:18.556 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016345300000000001 2024-05-08T18:30:18.556 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.556 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.556 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:18.556 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.278019+0000", 2024-05-08T18:30:18.556 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00041724699999999998 2024-05-08T18:30:18.556 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.556 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.556 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:18.556 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.278573+0000", 2024-05-08T18:30:18.556 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00055391900000000005 2024-05-08T18:30:18.556 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.556 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.557 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:18.557 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.279973+0000", 2024-05-08T18:30:18.557 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0013995819999999999 2024-05-08T18:30:18.557 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.557 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.557 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:18.557 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.280422+0000", 2024-05-08T18:30:18.557 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00044940699999999997 2024-05-08T18:30:18.557 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.557 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.557 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:18.557 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.280509+0000", 2024-05-08T18:30:18.557 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7455999999999997e-05 2024-05-08T18:30:18.558 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.558 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.558 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:18.558 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.280579+0000", 2024-05-08T18:30:18.558 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9282999999999994e-05 2024-05-08T18:30:18.558 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:18.558 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:18.558 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:18.558 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.558 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.558 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:18.558 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.281716+0000", 2024-05-08T18:30:18.558 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 26.221484501999999, 2024-05-08T18:30:18.559 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003275881, 2024-05-08T18:30:18.559 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:18.559 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:18.559 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:18.559 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:18.559 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:18.559 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:18.559 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 819 2024-05-08T18:30:18.559 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.559 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:18.559 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.559 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:18.559 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.281716+0000", 2024-05-08T18:30:18.559 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:18.560 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.560 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.560 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:18.560 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.281716+0000", 2024-05-08T18:30:18.560 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:18.560 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.560 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.560 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:18.560 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.281718+0000", 2024-05-08T18:30:18.560 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.863e-06 2024-05-08T18:30:18.560 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.560 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.560 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:18.560 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.281728+0000", 2024-05-08T18:30:18.561 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0550000000000001e-05 2024-05-08T18:30:18.561 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.561 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.561 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:18.561 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.281760+0000", 2024-05-08T18:30:18.561 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2150000000000002e-05 2024-05-08T18:30:18.561 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.561 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.561 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:18.561 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.281776+0000", 2024-05-08T18:30:18.561 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6005999999999999e-05 2024-05-08T18:30:18.561 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.561 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.561 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:18.562 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.281917+0000", 2024-05-08T18:30:18.562 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014070200000000001 2024-05-08T18:30:18.562 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.562 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.562 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:18.562 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.282148+0000", 2024-05-08T18:30:18.562 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023095200000000001 2024-05-08T18:30:18.562 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.562 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.562 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:18.562 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.282641+0000", 2024-05-08T18:30:18.562 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00049337999999999997 2024-05-08T18:30:18.562 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.563 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.563 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:18.563 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.284070+0000", 2024-05-08T18:30:18.563 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0014287950000000001 2024-05-08T18:30:18.563 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.563 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.563 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:18.563 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.284837+0000", 2024-05-08T18:30:18.563 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00076679799999999996 2024-05-08T18:30:18.563 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.563 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.563 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:18.564 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.284925+0000", 2024-05-08T18:30:18.564 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8165999999999996e-05 2024-05-08T18:30:18.564 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.564 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.564 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:18.564 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.284992+0000", 2024-05-08T18:30:18.564 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6519000000000005e-05 2024-05-08T18:30:18.564 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:18.564 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:18.564 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:18.564 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.564 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.564 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:18.564 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.334745+0000", 2024-05-08T18:30:18.565 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 26.168455592000001, 2024-05-08T18:30:18.565 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032404719999999999, 2024-05-08T18:30:18.565 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:18.565 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:18.565 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:18.565 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:18.565 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:18.565 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:18.565 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 841 2024-05-08T18:30:18.565 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.565 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:18.565 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.565 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:18.566 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.334745+0000", 2024-05-08T18:30:18.566 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:18.566 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.566 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.566 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:18.566 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.334745+0000", 2024-05-08T18:30:18.566 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:18.566 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.566 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.566 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:18.566 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.334747+0000", 2024-05-08T18:30:18.566 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.407e-06 2024-05-08T18:30:18.567 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.567 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.567 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:18.567 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.334759+0000", 2024-05-08T18:30:18.567 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1883e-05 2024-05-08T18:30:18.567 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.567 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.567 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:18.567 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.334789+0000", 2024-05-08T18:30:18.567 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9957000000000001e-05 2024-05-08T18:30:18.567 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.567 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.567 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:18.567 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.334804+0000", 2024-05-08T18:30:18.568 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4713e-05 2024-05-08T18:30:18.568 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.568 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.568 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:18.568 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.334951+0000", 2024-05-08T18:30:18.568 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000147675 2024-05-08T18:30:18.568 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.568 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.568 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:18.568 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.335304+0000", 2024-05-08T18:30:18.568 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00035214099999999999 2024-05-08T18:30:18.568 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.569 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.569 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:18.569 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.335859+0000", 2024-05-08T18:30:18.569 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00055546899999999995 2024-05-08T18:30:18.569 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.569 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.569 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:18.569 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.337168+0000", 2024-05-08T18:30:18.569 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0013087299999999999 2024-05-08T18:30:18.569 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.569 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.569 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:18.569 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.337808+0000", 2024-05-08T18:30:18.569 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00064005500000000005 2024-05-08T18:30:18.570 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.570 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.570 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:18.570 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.337894+0000", 2024-05-08T18:30:18.570 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6593000000000003e-05 2024-05-08T18:30:18.570 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.570 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.570 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:18.570 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.337985+0000", 2024-05-08T18:30:18.570 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0848999999999997e-05 2024-05-08T18:30:18.570 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:18.570 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:18.570 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:18.570 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.571 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.571 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:18.571 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.338870+0000", 2024-05-08T18:30:18.571 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 26.164330842999998, 2024-05-08T18:30:18.571 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002862121, 2024-05-08T18:30:18.571 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:18.571 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:18.571 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:18.571 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:18.571 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:18.571 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:18.571 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 843 2024-05-08T18:30:18.571 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.571 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:18.572 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.572 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:18.572 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.338870+0000", 2024-05-08T18:30:18.572 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:18.572 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.572 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.572 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:18.572 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.338870+0000", 2024-05-08T18:30:18.572 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:18.572 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.572 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.572 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:18.572 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.338872+0000", 2024-05-08T18:30:18.572 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3429999999999998e-06 2024-05-08T18:30:18.573 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.573 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.573 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:18.573 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.338883+0000", 2024-05-08T18:30:18.573 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1447000000000001e-05 2024-05-08T18:30:18.573 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.573 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.573 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:18.573 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.338914+0000", 2024-05-08T18:30:18.573 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1052e-05 2024-05-08T18:30:18.573 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.573 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.573 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:18.574 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.338932+0000", 2024-05-08T18:30:18.574 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7604e-05 2024-05-08T18:30:18.574 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.574 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.574 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:18.574 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.339019+0000", 2024-05-08T18:30:18.574 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6982000000000002e-05 2024-05-08T18:30:18.574 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.574 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.574 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:18.574 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.339139+0000", 2024-05-08T18:30:18.574 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011978599999999999 2024-05-08T18:30:18.574 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.575 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.575 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:18.575 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.339415+0000", 2024-05-08T18:30:18.575 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00027644799999999999 2024-05-08T18:30:18.575 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.575 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.575 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:18.575 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.340619+0000", 2024-05-08T18:30:18.575 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012043010000000001 2024-05-08T18:30:18.575 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.575 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.575 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:18.575 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.341454+0000", 2024-05-08T18:30:18.575 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00083464300000000004 2024-05-08T18:30:18.575 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.576 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.576 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:18.576 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.341609+0000", 2024-05-08T18:30:18.576 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000154752 2024-05-08T18:30:18.576 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.576 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.576 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:18.576 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.341732+0000", 2024-05-08T18:30:18.576 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012276299999999999 2024-05-08T18:30:18.576 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:18.577 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:18.577 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:18.577 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.577 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.577 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:18.577 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.349287+0000", 2024-05-08T18:30:18.577 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 26.153913014, 2024-05-08T18:30:18.577 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032683220000000002, 2024-05-08T18:30:18.577 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:18.577 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:18.577 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:18.577 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:18.577 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:18.578 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:18.578 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 847 2024-05-08T18:30:18.578 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.578 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:18.578 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.578 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:18.578 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.349287+0000", 2024-05-08T18:30:18.578 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:18.578 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.578 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.578 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:18.578 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.349287+0000", 2024-05-08T18:30:18.578 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:18.578 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.579 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.579 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:18.579 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.349290+0000", 2024-05-08T18:30:18.579 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3369999999999998e-06 2024-05-08T18:30:18.579 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.579 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.579 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:18.579 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.349318+0000", 2024-05-08T18:30:18.579 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8419999999999999e-05 2024-05-08T18:30:18.579 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.579 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.579 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:18.579 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.349348+0000", 2024-05-08T18:30:18.580 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0260000000000002e-05 2024-05-08T18:30:18.580 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.580 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.580 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:18.580 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.349364+0000", 2024-05-08T18:30:18.580 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5359999999999999e-05 2024-05-08T18:30:18.580 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.580 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.580 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:18.580 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.349511+0000", 2024-05-08T18:30:18.580 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014760199999999999 2024-05-08T18:30:18.580 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.580 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.580 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:18.581 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.349872+0000", 2024-05-08T18:30:18.581 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00036035 2024-05-08T18:30:18.581 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.581 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.581 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:18.581 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.350432+0000", 2024-05-08T18:30:18.581 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00056059600000000001 2024-05-08T18:30:18.581 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.581 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.581 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:18.581 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.351817+0000", 2024-05-08T18:30:18.581 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001385063 2024-05-08T18:30:18.581 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.581 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.582 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:18.582 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.352402+0000", 2024-05-08T18:30:18.582 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00058490500000000004 2024-05-08T18:30:18.582 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.582 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.582 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:18.582 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.352488+0000", 2024-05-08T18:30:18.582 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6032999999999994e-05 2024-05-08T18:30:18.582 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.582 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.582 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:18.582 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.352556+0000", 2024-05-08T18:30:18.582 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7396000000000003e-05 2024-05-08T18:30:18.583 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:18.583 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:18.583 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:18.583 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.583 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.583 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:18.583 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.353786+0000", 2024-05-08T18:30:18.583 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 26.149414179000001, 2024-05-08T18:30:18.583 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0029130850000000002, 2024-05-08T18:30:18.583 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:18.583 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:18.583 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:18.583 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:18.583 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:18.584 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:18.584 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 849 2024-05-08T18:30:18.584 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.584 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:18.584 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.584 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:18.584 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.353786+0000", 2024-05-08T18:30:18.584 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:18.584 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.584 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.584 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:18.585 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.353786+0000", 2024-05-08T18:30:18.585 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:18.585 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.585 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.585 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:18.585 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.353788+0000", 2024-05-08T18:30:18.585 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0370000000000001e-06 2024-05-08T18:30:18.585 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.585 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.585 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:18.585 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.353799+0000", 2024-05-08T18:30:18.585 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0686000000000001e-05 2024-05-08T18:30:18.585 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.586 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.586 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:18.586 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.353832+0000", 2024-05-08T18:30:18.586 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.341e-05 2024-05-08T18:30:18.586 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.586 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.586 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:18.586 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.353851+0000", 2024-05-08T18:30:18.586 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8343999999999999e-05 2024-05-08T18:30:18.586 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.586 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.586 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:18.586 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.353980+0000", 2024-05-08T18:30:18.587 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012914900000000001 2024-05-08T18:30:18.587 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.587 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.587 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:18.587 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.354123+0000", 2024-05-08T18:30:18.587 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000142912 2024-05-08T18:30:18.587 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.587 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.587 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:18.587 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.354393+0000", 2024-05-08T18:30:18.587 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00027009799999999997 2024-05-08T18:30:18.587 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.587 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.587 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:18.588 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.355769+0000", 2024-05-08T18:30:18.588 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001375839 2024-05-08T18:30:18.588 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.588 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.588 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:18.588 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.356421+0000", 2024-05-08T18:30:18.588 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00065227799999999995 2024-05-08T18:30:18.588 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.588 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.588 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:18.588 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.356592+0000", 2024-05-08T18:30:18.588 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000170586 2024-05-08T18:30:18.588 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.589 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.589 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:18.589 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.356699+0000", 2024-05-08T18:30:18.589 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010774599999999999 2024-05-08T18:30:18.589 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:18.589 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:18.589 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:18.589 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.589 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.589 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:18.589 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.402673+0000", 2024-05-08T18:30:18.589 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 26.100527505999999, 2024-05-08T18:30:18.589 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002928295, 2024-05-08T18:30:18.589 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:18.589 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:18.590 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:18.590 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:18.590 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:18.590 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:18.590 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 870 2024-05-08T18:30:18.590 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.590 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:18.590 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.590 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:18.590 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.402673+0000", 2024-05-08T18:30:18.590 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:18.590 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.590 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.591 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:18.591 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.402673+0000", 2024-05-08T18:30:18.591 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:18.591 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.591 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.591 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:18.591 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.402675+0000", 2024-05-08T18:30:18.591 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0030000000000001e-06 2024-05-08T18:30:18.591 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.591 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.591 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:18.591 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.402685+0000", 2024-05-08T18:30:18.591 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0566e-05 2024-05-08T18:30:18.591 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.592 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.592 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:18.592 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.402714+0000", 2024-05-08T18:30:18.592 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8804999999999999e-05 2024-05-08T18:30:18.592 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.592 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.592 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:18.592 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.402731+0000", 2024-05-08T18:30:18.592 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6731e-05 2024-05-08T18:30:18.592 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.592 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.592 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:18.592 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.402863+0000", 2024-05-08T18:30:18.592 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013194199999999999 2024-05-08T18:30:18.593 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.593 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.593 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:18.593 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.403096+0000", 2024-05-08T18:30:18.593 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023309900000000001 2024-05-08T18:30:18.593 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.593 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.593 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:18.593 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.403553+0000", 2024-05-08T18:30:18.593 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00045738700000000002 2024-05-08T18:30:18.593 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.593 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.593 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:18.594 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.404843+0000", 2024-05-08T18:30:18.594 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012894650000000001 2024-05-08T18:30:18.594 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.594 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.594 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:18.594 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.405348+0000", 2024-05-08T18:30:18.594 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00050483600000000004 2024-05-08T18:30:18.594 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.594 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.594 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:18.594 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.405491+0000", 2024-05-08T18:30:18.594 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014349299999999999 2024-05-08T18:30:18.594 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.594 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.595 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:18.595 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.405601+0000", 2024-05-08T18:30:18.595 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000109968 2024-05-08T18:30:18.595 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:18.595 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:18.595 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:18.595 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.595 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.595 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:18.595 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.484247+0000", 2024-05-08T18:30:18.595 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 26.018953306, 2024-05-08T18:30:18.595 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028903679999999999, 2024-05-08T18:30:18.595 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:18.595 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:18.596 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:18.596 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:18.596 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:18.596 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:18.596 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 907 2024-05-08T18:30:18.596 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.596 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:18.596 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.596 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:18.596 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.484247+0000", 2024-05-08T18:30:18.596 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:18.596 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.596 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.597 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:18.597 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.484247+0000", 2024-05-08T18:30:18.597 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:18.597 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.597 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.597 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:18.597 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.484250+0000", 2024-05-08T18:30:18.597 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6900000000000001e-06 2024-05-08T18:30:18.597 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.597 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.597 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:18.597 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.484263+0000", 2024-05-08T18:30:18.598 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2967e-05 2024-05-08T18:30:18.598 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.598 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.598 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:18.598 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.484294+0000", 2024-05-08T18:30:18.598 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1016000000000003e-05 2024-05-08T18:30:18.598 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.598 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.598 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:18.598 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.484309+0000", 2024-05-08T18:30:18.598 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5187e-05 2024-05-08T18:30:18.598 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.598 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.599 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:18.599 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.484467+0000", 2024-05-08T18:30:18.599 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015810499999999999 2024-05-08T18:30:18.599 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.599 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.599 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:18.599 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.484698+0000", 2024-05-08T18:30:18.599 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000230852 2024-05-08T18:30:18.599 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.599 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.599 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:18.599 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.485026+0000", 2024-05-08T18:30:18.599 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00032833 2024-05-08T18:30:18.600 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.600 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.600 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:18.600 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.486177+0000", 2024-05-08T18:30:18.600 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0011504309999999999 2024-05-08T18:30:18.600 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.600 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.600 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:18.600 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.486978+0000", 2024-05-08T18:30:18.600 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000801161 2024-05-08T18:30:18.600 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.600 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.600 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:18.601 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.487068+0000", 2024-05-08T18:30:18.601 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0435999999999999e-05 2024-05-08T18:30:18.601 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.601 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.601 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:18.601 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.487137+0000", 2024-05-08T18:30:18.601 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9193e-05 2024-05-08T18:30:18.601 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:18.601 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:18.601 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:18.601 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.601 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.601 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:18.601 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.585363+0000", 2024-05-08T18:30:18.602 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 25.917837463000001, 2024-05-08T18:30:18.602 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028400080000000002, 2024-05-08T18:30:18.602 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:18.602 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:18.602 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:18.602 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:18.602 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:18.602 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:18.602 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 949 2024-05-08T18:30:18.602 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.602 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:18.602 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.603 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:18.603 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.585363+0000", 2024-05-08T18:30:18.603 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:18.603 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.603 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.603 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:18.603 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.585363+0000", 2024-05-08T18:30:18.603 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:18.603 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.603 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.603 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:18.603 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.585366+0000", 2024-05-08T18:30:18.603 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7099999999999999e-06 2024-05-08T18:30:18.603 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.604 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.604 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:18.604 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.585378+0000", 2024-05-08T18:30:18.604 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1970000000000001e-05 2024-05-08T18:30:18.604 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.604 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.604 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:18.604 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.585408+0000", 2024-05-08T18:30:18.604 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0389999999999999e-05 2024-05-08T18:30:18.604 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.604 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.604 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:18.605 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.585423+0000", 2024-05-08T18:30:18.605 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4929999999999999e-05 2024-05-08T18:30:18.605 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.605 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.605 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:18.605 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.585559+0000", 2024-05-08T18:30:18.605 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013563599999999999 2024-05-08T18:30:18.605 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.605 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.605 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:18.605 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.585780+0000", 2024-05-08T18:30:18.605 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000221828 2024-05-08T18:30:18.605 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.605 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.606 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:18.606 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.586121+0000", 2024-05-08T18:30:18.606 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000340181 2024-05-08T18:30:18.606 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.606 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.606 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:18.606 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.587268+0000", 2024-05-08T18:30:18.606 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001146984 2024-05-08T18:30:18.606 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.606 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.606 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:18.606 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.588047+0000", 2024-05-08T18:30:18.606 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000779877 2024-05-08T18:30:18.607 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.607 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.607 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:18.607 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.588136+0000", 2024-05-08T18:30:18.607 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8483e-05 2024-05-08T18:30:18.607 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.607 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.607 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:18.607 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.588203+0000", 2024-05-08T18:30:18.607 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7019000000000003e-05 2024-05-08T18:30:18.607 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:18.607 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:18.608 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:18.608 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.608 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.608 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:951 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:18.608 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.589044+0000", 2024-05-08T18:30:18.608 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 25.914156040999998, 2024-05-08T18:30:18.608 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002802672, 2024-05-08T18:30:18.608 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:18.608 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:18.608 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:18.608 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:18.608 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:18.608 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:18.609 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 951 2024-05-08T18:30:18.609 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.609 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:18.609 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.609 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:18.609 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.589044+0000", 2024-05-08T18:30:18.609 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:18.609 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.609 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.609 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:18.609 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.589044+0000", 2024-05-08T18:30:18.609 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:18.609 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.610 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.610 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:18.610 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.589046+0000", 2024-05-08T18:30:18.610 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6670000000000001e-06 2024-05-08T18:30:18.610 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.610 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.610 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:18.610 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.589054+0000", 2024-05-08T18:30:18.610 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.2600000000000005e-06 2024-05-08T18:30:18.610 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.610 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.610 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:18.611 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.589076+0000", 2024-05-08T18:30:18.611 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1373e-05 2024-05-08T18:30:18.611 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.611 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.611 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:18.611 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.589088+0000", 2024-05-08T18:30:18.611 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2768999999999999e-05 2024-05-08T18:30:18.611 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.611 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.611 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:18.611 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.589220+0000", 2024-05-08T18:30:18.611 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013146300000000001 2024-05-08T18:30:18.611 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.612 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.612 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:18.612 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.589462+0000", 2024-05-08T18:30:18.612 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024250500000000001 2024-05-08T18:30:18.612 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.612 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.612 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:18.612 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.589956+0000", 2024-05-08T18:30:18.612 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00049331600000000005 2024-05-08T18:30:18.612 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.612 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.612 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:18.612 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.591337+0000", 2024-05-08T18:30:18.612 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0013816290000000001 2024-05-08T18:30:18.613 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.613 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.613 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:18.613 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.591688+0000", 2024-05-08T18:30:18.613 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00035083400000000001 2024-05-08T18:30:18.613 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.613 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.613 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:18.613 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.591780+0000", 2024-05-08T18:30:18.613 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.2312999999999995e-05 2024-05-08T18:30:18.613 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.613 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.613 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:18.614 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.591847+0000", 2024-05-08T18:30:18.614 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6543000000000003e-05 2024-05-08T18:30:18.614 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:18.614 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:18.614 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:18.614 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.614 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.614 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:18.614 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.599312+0000", 2024-05-08T18:30:18.614 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 25.903888577, 2024-05-08T18:30:18.614 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0027928190000000002, 2024-05-08T18:30:18.614 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:18.614 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:18.614 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:18.615 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:18.615 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:18.615 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:18.615 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 955 2024-05-08T18:30:18.615 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.615 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:18.615 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.615 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:18.615 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.599312+0000", 2024-05-08T18:30:18.615 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:18.615 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.615 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.615 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:18.616 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.599312+0000", 2024-05-08T18:30:18.616 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:18.616 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.616 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.616 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:18.616 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.599314+0000", 2024-05-08T18:30:18.616 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.396e-06 2024-05-08T18:30:18.616 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.616 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.616 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:18.616 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.599325+0000", 2024-05-08T18:30:18.616 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1063999999999999e-05 2024-05-08T18:30:18.616 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.617 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.617 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:18.617 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.599354+0000", 2024-05-08T18:30:18.617 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8462999999999998e-05 2024-05-08T18:30:18.617 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.617 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.617 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:18.617 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.599369+0000", 2024-05-08T18:30:18.617 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4963000000000001e-05 2024-05-08T18:30:18.617 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.617 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.617 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:18.617 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.599503+0000", 2024-05-08T18:30:18.617 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013385299999999999 2024-05-08T18:30:18.618 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.618 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.618 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:18.618 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.599744+0000", 2024-05-08T18:30:18.618 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024137400000000001 2024-05-08T18:30:18.618 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.618 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.618 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:18.618 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.600084+0000", 2024-05-08T18:30:18.618 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00033999399999999998 2024-05-08T18:30:18.618 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.618 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.618 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:18.618 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.601319+0000", 2024-05-08T18:30:18.619 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012348140000000001 2024-05-08T18:30:18.619 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.619 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.619 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:18.619 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.601956+0000", 2024-05-08T18:30:18.619 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00063721199999999996 2024-05-08T18:30:18.619 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.619 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.619 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:18.619 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.602038+0000", 2024-05-08T18:30:18.619 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.1705999999999993e-05 2024-05-08T18:30:18.619 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:18.619 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:18.620 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:18.620 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.602105+0000", 2024-05-08T18:30:18.620 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6979999999999999e-05 2024-05-08T18:30:18.620 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:18.620 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:18.620 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:18.620 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:18.620 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:18.620 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:30:18.621 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-08T18:30:18.622 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:30:18.620+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:30:18.632 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2024-05-08T18:30:18.632 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:30:18.649 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2024-05-08T18:30:18.649 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:30:18.665 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2024-05-08T18:30:18.665 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:30:18.696 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2024-05-08T18:30:18.696 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:30:18.718 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2024-05-08T18:30:18.718 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:30:18.722 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:30:18.725+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:30:18.738 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2024-05-08T18:30:18.738 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:30:18.755 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:18.755 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:18.758 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2024-05-08T18:30:18.758 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:30:18.770 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-08T18:30:18.778 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2024-05-08T18:30:18.778 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:30:18.803 INFO:teuthology.orchestra.run.smithi097.stderr:noscrub is unset 2024-05-08T18:30:18.823 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:30:18.820+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:30:18.890 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:18.891 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:18.903 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-08T18:30:18.924 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:30:18.924+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:30:19.018 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:19.018 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:19.025 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:30:19.025+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:30:19.031 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-08T18:30:19.126 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:30:19.129+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:30:19.161 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:19.161 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:19.175 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-08T18:30:19.227 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:30:19.229+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:30:19.298 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:19.298 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:19.312 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-08T18:30:19.356 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:30:19.356+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:30:19.429 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:30:19.429+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:30:19.434 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:19.434 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:19.448 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-08T18:30:19.536 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:30:19.536+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:30:19.612 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:19.612 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:19.628 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-08T18:30:19.632 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:30:19.633+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:30:19.733 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:30:19.733+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:30:19.796 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:19.797 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:19.812 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-08T18:30:19.856 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:30:19.856+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:30:19.935 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:30:19.937+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:30:19.937 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:19.937 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:19.951 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-08T18:30:20.036 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:30:20.037+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:30:20.113 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:20.113 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:20.127 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-08T18:30:20.172 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:30:20.172+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:30:20.238 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:30:20.241+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:30:20.250 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:20.250 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:20.264 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-08T18:30:20.339 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:30:20.341+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:30:20.432 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:20.432 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:20.440 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:30:20.436+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:30:20.447 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-08T18:30:20.540 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:30:20.541+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:30:20.613 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:20.613 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:20.627 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-08T18:30:20.676 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:30:20.676+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:30:20.742 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:30:20.745+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:30:20.747 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:20.747 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:20.761 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-08T18:30:20.795 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-08T18:30:20.827 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-08T18:30:20.848 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:30:20.849+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:30:20.930 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:20.930 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:20.944 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:30:20.940+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:30:20.945 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-08T18:30:20.971 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2024-05-08T18:30:20.972 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:30:20.989 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2024-05-08T18:30:20.989 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:30:21.006 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2024-05-08T18:30:21.006 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:30:21.023 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2024-05-08T18:30:21.024 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:30:21.043 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2024-05-08T18:30:21.044 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:30:21.044 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:30:21.045+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:30:21.064 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:30:21.064 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:30:21.064 INFO:teuthology.orchestra.run.smithi097.stdout: "num_ops": 0 2024-05-08T18:30:21.064 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:30:21.065 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2024-05-08T18:30:21.065 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:30:21.078 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-08T18:30:21.085 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2024-05-08T18:30:21.086 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:30:21.106 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2024-05-08T18:30:21.107 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:30:21.145 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:30:21.144+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:30:21.200 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:30:21.200 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:30:21.200 INFO:teuthology.orchestra.run.smithi097.stdout: "complaint_time": 30, 2024-05-08T18:30:21.200 INFO:teuthology.orchestra.run.smithi097.stdout: "num_blocked_ops": 0 2024-05-08T18:30:21.200 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:30:21.216 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-08T18:30:21.246 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:30:21.244+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:30:21.336 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:30:21.336 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2024-05-08T18:30:21.336 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2024-05-08T18:30:21.337 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-05-08T18:30:21.337 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.337 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4206.0:24 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'14, mlcod=16'9)", 2024-05-08T18:30:21.337 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:27.162224+0000", 2024-05-08T18:30:21.337 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 54.174243476000001, 2024-05-08T18:30:21.337 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032712890000000001, 2024-05-08T18:30:21.337 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:21.337 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:21.337 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:21.337 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:21.338 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.338 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:21.338 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162224+0000", 2024-05-08T18:30:21.338 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:21.338 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.338 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.338 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:21.338 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162224+0000", 2024-05-08T18:30:21.338 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:21.339 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.339 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.339 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:21.339 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162225+0000", 2024-05-08T18:30:21.339 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4899999999999999e-06 2024-05-08T18:30:21.339 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.339 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.339 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:21.339 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162306+0000", 2024-05-08T18:30:21.339 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.0589999999999999e-05 2024-05-08T18:30:21.339 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.340 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.340 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:21.340 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162332+0000", 2024-05-08T18:30:21.340 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5658999999999999e-05 2024-05-08T18:30:21.340 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.340 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.340 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:21.340 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162345+0000", 2024-05-08T18:30:21.340 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3512999999999999e-05 2024-05-08T18:30:21.340 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.340 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.341 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:21.341 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162465+0000", 2024-05-08T18:30:21.341 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000119577 2024-05-08T18:30:21.341 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.341 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.341 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:21.342 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162513+0000", 2024-05-08T18:30:21.342 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8773999999999998e-05 2024-05-08T18:30:21.342 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.342 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.342 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:21.342 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.165405+0000", 2024-05-08T18:30:21.342 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028919200000000001 2024-05-08T18:30:21.342 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.342 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.342 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:21.342 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.165495+0000", 2024-05-08T18:30:21.342 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9765999999999994e-05 2024-05-08T18:30:21.343 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:21.343 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:21.343 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:21.343 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.343 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.343 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4206.0:25 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'15, mlcod=16'10)", 2024-05-08T18:30:21.343 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:27.164793+0000", 2024-05-08T18:30:21.343 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 54.171674348000003, 2024-05-08T18:30:21.343 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032285249999999999, 2024-05-08T18:30:21.343 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:21.343 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:21.343 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:21.343 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:21.344 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.344 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:21.344 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164793+0000", 2024-05-08T18:30:21.344 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:21.344 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.344 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.344 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:21.344 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164793+0000", 2024-05-08T18:30:21.344 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:21.344 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.344 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.344 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:21.344 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164795+0000", 2024-05-08T18:30:21.345 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0999999999999998e-06 2024-05-08T18:30:21.345 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.345 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.345 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:21.345 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164811+0000", 2024-05-08T18:30:21.345 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5722999999999998e-05 2024-05-08T18:30:21.345 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.345 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.345 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:21.345 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164841+0000", 2024-05-08T18:30:21.345 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0355999999999999e-05 2024-05-08T18:30:21.345 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.345 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.346 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:21.346 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164861+0000", 2024-05-08T18:30:21.346 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9533000000000001e-05 2024-05-08T18:30:21.346 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.346 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.346 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:21.346 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164984+0000", 2024-05-08T18:30:21.346 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000123146 2024-05-08T18:30:21.346 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.346 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.346 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:21.346 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.165024+0000", 2024-05-08T18:30:21.346 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9690000000000001e-05 2024-05-08T18:30:21.346 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.347 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.347 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:21.347 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.167935+0000", 2024-05-08T18:30:21.347 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0029113300000000002 2024-05-08T18:30:21.347 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.347 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.347 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:21.347 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.168021+0000", 2024-05-08T18:30:21.347 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6646999999999999e-05 2024-05-08T18:30:21.347 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:21.347 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:21.347 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:21.347 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.348 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.348 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:30:21.348 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:48.674737+0000", 2024-05-08T18:30:21.348 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 32.661730429999999, 2024-05-08T18:30:21.348 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0035019780000000002, 2024-05-08T18:30:21.348 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:21.348 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:21.348 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:21.348 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:21.348 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:21.348 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:21.348 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 60 2024-05-08T18:30:21.348 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.348 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:21.349 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.349 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:21.349 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674737+0000", 2024-05-08T18:30:21.349 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:21.349 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.349 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.349 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:21.349 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674737+0000", 2024-05-08T18:30:21.349 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:21.349 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.349 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.349 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:21.349 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674740+0000", 2024-05-08T18:30:21.350 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.36e-06 2024-05-08T18:30:21.350 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.350 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.350 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:21.350 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674753+0000", 2024-05-08T18:30:21.350 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3151e-05 2024-05-08T18:30:21.350 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.350 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.350 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:21.350 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674789+0000", 2024-05-08T18:30:21.350 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5929000000000001e-05 2024-05-08T18:30:21.350 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.350 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.350 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:21.351 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674813+0000", 2024-05-08T18:30:21.351 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3325000000000001e-05 2024-05-08T18:30:21.351 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.351 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.351 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:21.351 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674981+0000", 2024-05-08T18:30:21.351 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016879899999999999 2024-05-08T18:30:21.351 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.351 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.351 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:21.351 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.675304+0000", 2024-05-08T18:30:21.351 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00032214400000000001 2024-05-08T18:30:21.351 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.352 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.352 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:21.352 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.675639+0000", 2024-05-08T18:30:21.352 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00033494699999999999 2024-05-08T18:30:21.352 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.352 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.352 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:21.352 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.676901+0000", 2024-05-08T18:30:21.352 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001262167 2024-05-08T18:30:21.352 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.352 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.352 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:21.352 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678078+0000", 2024-05-08T18:30:21.352 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001177588 2024-05-08T18:30:21.353 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.353 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.353 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:21.353 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678171+0000", 2024-05-08T18:30:21.353 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.2331999999999996e-05 2024-05-08T18:30:21.353 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.353 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.353 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:21.353 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678239+0000", 2024-05-08T18:30:21.353 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8236000000000002e-05 2024-05-08T18:30:21.353 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:21.353 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:21.353 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:21.354 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.354 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.354 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:61 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94069412632064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:30:21.354 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:48.678410+0000", 2024-05-08T18:30:21.354 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 32.658057038000003, 2024-05-08T18:30:21.354 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0026001800000000001, 2024-05-08T18:30:21.354 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:21.354 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:21.354 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:21.354 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:21.354 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:21.354 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:21.354 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 61 2024-05-08T18:30:21.355 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.355 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:21.355 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.355 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:21.355 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678410+0000", 2024-05-08T18:30:21.355 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:21.355 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.355 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.355 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:21.355 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678410+0000", 2024-05-08T18:30:21.355 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:21.355 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.355 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.355 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:21.356 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678413+0000", 2024-05-08T18:30:21.356 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.34e-06 2024-05-08T18:30:21.356 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.356 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.356 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:21.356 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678421+0000", 2024-05-08T18:30:21.356 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6910000000000003e-06 2024-05-08T18:30:21.356 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.356 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.356 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:21.356 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678447+0000", 2024-05-08T18:30:21.356 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6010999999999999e-05 2024-05-08T18:30:21.356 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.357 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.357 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:21.357 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678461+0000", 2024-05-08T18:30:21.357 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3900000000000001e-05 2024-05-08T18:30:21.357 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.357 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.357 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:21.357 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678560+0000", 2024-05-08T18:30:21.357 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.8834999999999998e-05 2024-05-08T18:30:21.357 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.357 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.357 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:21.357 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678704+0000", 2024-05-08T18:30:21.358 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000143769 2024-05-08T18:30:21.358 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.358 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.358 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:21.358 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678942+0000", 2024-05-08T18:30:21.358 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023861800000000001 2024-05-08T18:30:21.358 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.358 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.358 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:21.358 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.680269+0000", 2024-05-08T18:30:21.358 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001326484 2024-05-08T18:30:21.358 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.358 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.358 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:21.359 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.680823+0000", 2024-05-08T18:30:21.359 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00055455900000000004 2024-05-08T18:30:21.359 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.359 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.359 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:21.359 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.680908+0000", 2024-05-08T18:30:21.359 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.4073999999999995e-05 2024-05-08T18:30:21.359 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.359 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.359 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:21.359 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.681010+0000", 2024-05-08T18:30:21.359 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010289900000000001 2024-05-08T18:30:21.359 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:21.359 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:21.360 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:21.360 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.360 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.360 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:30:21.360 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.671896+0000", 2024-05-08T18:30:21.360 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 29.664571153000001, 2024-05-08T18:30:21.360 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032352349999999999, 2024-05-08T18:30:21.360 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:21.360 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:21.360 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:21.360 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:21.360 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:21.360 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:21.360 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 206 2024-05-08T18:30:21.361 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.361 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:21.361 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.361 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:21.361 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671896+0000", 2024-05-08T18:30:21.361 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:21.361 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.361 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.361 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:21.361 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671896+0000", 2024-05-08T18:30:21.361 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:21.361 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.361 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.362 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:21.362 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671901+0000", 2024-05-08T18:30:21.362 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.763e-06 2024-05-08T18:30:21.362 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.362 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.362 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:21.362 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671920+0000", 2024-05-08T18:30:21.362 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9403e-05 2024-05-08T18:30:21.362 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.362 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.362 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:21.362 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671969+0000", 2024-05-08T18:30:21.362 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8343000000000001e-05 2024-05-08T18:30:21.363 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.363 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.363 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:21.363 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671996+0000", 2024-05-08T18:30:21.363 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7307000000000001e-05 2024-05-08T18:30:21.363 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.363 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.363 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:21.363 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.672149+0000", 2024-05-08T18:30:21.363 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015336500000000001 2024-05-08T18:30:21.363 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.363 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.363 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:21.364 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.672393+0000", 2024-05-08T18:30:21.364 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024380800000000001 2024-05-08T18:30:21.364 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.364 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.364 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:21.364 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.672838+0000", 2024-05-08T18:30:21.364 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00044472700000000001 2024-05-08T18:30:21.364 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.364 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.364 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:21.364 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.674218+0000", 2024-05-08T18:30:21.364 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001380243 2024-05-08T18:30:21.364 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.364 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.365 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:21.365 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.674963+0000", 2024-05-08T18:30:21.365 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00074534999999999998 2024-05-08T18:30:21.365 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.365 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.365 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:21.365 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675057+0000", 2024-05-08T18:30:21.365 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.3633000000000003e-05 2024-05-08T18:30:21.365 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.365 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.365 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:21.365 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675131+0000", 2024-05-08T18:30:21.365 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.4293000000000002e-05 2024-05-08T18:30:21.365 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:21.366 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:21.366 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:21.366 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.366 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.366 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:21.366 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.694194+0000", 2024-05-08T18:30:21.366 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 29.642273755000002, 2024-05-08T18:30:21.366 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0087385129999999998, 2024-05-08T18:30:21.366 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:21.366 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:21.366 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:21.366 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:21.366 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:21.367 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:21.367 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 210 2024-05-08T18:30:21.367 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.367 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:21.367 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.367 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:21.367 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694194+0000", 2024-05-08T18:30:21.367 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:21.367 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.367 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.367 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:21.367 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694194+0000", 2024-05-08T18:30:21.367 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:21.368 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.368 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.368 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:21.368 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694196+0000", 2024-05-08T18:30:21.368 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6299999999999998e-06 2024-05-08T18:30:21.368 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.368 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.368 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:21.368 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694208+0000", 2024-05-08T18:30:21.368 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.187e-05 2024-05-08T18:30:21.368 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.368 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.368 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:21.369 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694240+0000", 2024-05-08T18:30:21.369 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1673e-05 2024-05-08T18:30:21.369 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.369 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.369 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:21.369 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694255+0000", 2024-05-08T18:30:21.369 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5573000000000002e-05 2024-05-08T18:30:21.369 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.369 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.369 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:21.369 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694394+0000", 2024-05-08T18:30:21.369 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000138536 2024-05-08T18:30:21.369 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.370 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.370 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-05-08T18:30:21.370 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694405+0000", 2024-05-08T18:30:21.370 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0883000000000001e-05 2024-05-08T18:30:21.370 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.370 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.370 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:21.370 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.699491+0000", 2024-05-08T18:30:21.370 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0050861939999999996 2024-05-08T18:30:21.370 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.370 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.370 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:21.370 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.699829+0000", 2024-05-08T18:30:21.371 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000338191 2024-05-08T18:30:21.371 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.371 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.371 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:30:21.371 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.700504+0000", 2024-05-08T18:30:21.371 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000674481 2024-05-08T18:30:21.371 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.371 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.371 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:21.371 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.702152+0000", 2024-05-08T18:30:21.371 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0016487450000000001 2024-05-08T18:30:21.371 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.371 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.371 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:21.372 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.702792+0000", 2024-05-08T18:30:21.372 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00063962800000000005 2024-05-08T18:30:21.372 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.372 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.372 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:21.372 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.702874+0000", 2024-05-08T18:30:21.372 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.2091999999999999e-05 2024-05-08T18:30:21.372 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.372 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.372 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:21.372 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.702932+0000", 2024-05-08T18:30:21.372 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8016999999999997e-05 2024-05-08T18:30:21.372 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:21.373 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:21.373 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:21.373 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.373 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.373 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:21.373 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.728239+0000", 2024-05-08T18:30:21.373 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 29.608227893999999, 2024-05-08T18:30:21.373 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0035376119999999999, 2024-05-08T18:30:21.373 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:21.373 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:21.373 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:21.373 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:21.373 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:21.373 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:21.374 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 218 2024-05-08T18:30:21.374 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.374 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:21.374 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.374 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:21.374 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728239+0000", 2024-05-08T18:30:21.374 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:21.374 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.374 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.374 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:21.374 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728239+0000", 2024-05-08T18:30:21.374 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:21.374 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.375 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.375 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:21.375 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728242+0000", 2024-05-08T18:30:21.375 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0130000000000002e-06 2024-05-08T18:30:21.375 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.375 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.375 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:21.375 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728254+0000", 2024-05-08T18:30:21.375 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.172e-05 2024-05-08T18:30:21.375 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.375 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.375 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:21.375 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728285+0000", 2024-05-08T18:30:21.376 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0703000000000001e-05 2024-05-08T18:30:21.376 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.376 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.376 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:21.376 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728301+0000", 2024-05-08T18:30:21.376 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5656999999999999e-05 2024-05-08T18:30:21.376 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.376 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.376 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:21.376 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728460+0000", 2024-05-08T18:30:21.376 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015934200000000001 2024-05-08T18:30:21.376 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.376 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.376 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:21.377 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728803+0000", 2024-05-08T18:30:21.377 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00034267400000000001 2024-05-08T18:30:21.377 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.377 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.377 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:21.377 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.729485+0000", 2024-05-08T18:30:21.377 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00068206799999999998 2024-05-08T18:30:21.377 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.377 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.377 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:21.377 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731218+0000", 2024-05-08T18:30:21.377 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0017332630000000001 2024-05-08T18:30:21.377 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.377 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.378 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:21.378 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731615+0000", 2024-05-08T18:30:21.378 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00039671699999999999 2024-05-08T18:30:21.378 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.378 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.378 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:21.378 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731709+0000", 2024-05-08T18:30:21.378 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.4740000000000004e-05 2024-05-08T18:30:21.378 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.378 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.378 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:21.378 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731777+0000", 2024-05-08T18:30:21.378 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7714999999999998e-05 2024-05-08T18:30:21.379 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:21.379 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:21.379 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:21.379 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.379 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.379 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:21.379 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.743331+0000", 2024-05-08T18:30:21.379 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 29.593135911000001, 2024-05-08T18:30:21.379 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031193229999999998, 2024-05-08T18:30:21.379 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:21.379 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:21.379 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:21.379 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:21.379 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:21.380 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:21.380 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 222 2024-05-08T18:30:21.380 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.380 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:21.380 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.380 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:21.380 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743331+0000", 2024-05-08T18:30:21.380 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:21.380 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.380 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.380 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:21.380 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743331+0000", 2024-05-08T18:30:21.380 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:21.381 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.381 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.381 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:21.381 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743334+0000", 2024-05-08T18:30:21.381 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2900000000000001e-06 2024-05-08T18:30:21.381 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.381 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.381 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:21.381 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743345+0000", 2024-05-08T18:30:21.381 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0947e-05 2024-05-08T18:30:21.381 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.381 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.381 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:21.381 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743375+0000", 2024-05-08T18:30:21.382 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0298999999999999e-05 2024-05-08T18:30:21.382 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.382 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.382 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:21.382 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743390+0000", 2024-05-08T18:30:21.382 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4606999999999999e-05 2024-05-08T18:30:21.382 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.382 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.382 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:21.382 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743524+0000", 2024-05-08T18:30:21.382 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000134105 2024-05-08T18:30:21.382 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.382 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.383 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:21.383 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743738+0000", 2024-05-08T18:30:21.383 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000214222 2024-05-08T18:30:21.383 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.383 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.383 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:30:21.383 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.744159+0000", 2024-05-08T18:30:21.383 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00042102300000000002 2024-05-08T18:30:21.383 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.383 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.383 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:21.383 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.745399+0000", 2024-05-08T18:30:21.383 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012400309999999999 2024-05-08T18:30:21.384 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.384 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.384 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:21.384 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.746296+0000", 2024-05-08T18:30:21.384 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00089682 2024-05-08T18:30:21.384 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.384 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.384 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:21.384 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.746385+0000", 2024-05-08T18:30:21.384 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9289000000000005e-05 2024-05-08T18:30:21.384 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.384 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.384 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:21.384 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.746451+0000", 2024-05-08T18:30:21.385 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5690000000000003e-05 2024-05-08T18:30:21.385 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:21.385 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:21.385 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:21.385 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.385 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.385 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:21.385 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.772338+0000", 2024-05-08T18:30:21.385 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 29.564129711, 2024-05-08T18:30:21.385 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0035084059999999999, 2024-05-08T18:30:21.385 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:21.385 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:21.385 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:21.385 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:21.386 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:21.386 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:21.386 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 230 2024-05-08T18:30:21.386 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.386 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:21.386 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.386 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:21.386 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772338+0000", 2024-05-08T18:30:21.386 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:21.386 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.386 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.386 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:21.386 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772338+0000", 2024-05-08T18:30:21.387 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:21.387 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.387 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.387 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:21.387 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772340+0000", 2024-05-08T18:30:21.387 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3460000000000001e-06 2024-05-08T18:30:21.387 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.387 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.387 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:21.387 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772352+0000", 2024-05-08T18:30:21.387 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2284e-05 2024-05-08T18:30:21.387 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.387 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.387 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:21.388 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772382+0000", 2024-05-08T18:30:21.388 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0083e-05 2024-05-08T18:30:21.388 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.388 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.388 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:21.388 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772397+0000", 2024-05-08T18:30:21.388 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4963000000000001e-05 2024-05-08T18:30:21.388 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.388 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.388 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:21.388 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772508+0000", 2024-05-08T18:30:21.388 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000110402 2024-05-08T18:30:21.388 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.388 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.389 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:21.389 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772742+0000", 2024-05-08T18:30:21.389 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023428899999999999 2024-05-08T18:30:21.389 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.389 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.389 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:30:21.389 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.773183+0000", 2024-05-08T18:30:21.389 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00044107899999999998 2024-05-08T18:30:21.389 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.389 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.389 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:21.389 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.774488+0000", 2024-05-08T18:30:21.389 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0013053940000000001 2024-05-08T18:30:21.389 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.390 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.390 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:21.390 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.775689+0000", 2024-05-08T18:30:21.390 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012004699999999999 2024-05-08T18:30:21.390 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.390 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.390 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:21.390 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.775777+0000", 2024-05-08T18:30:21.390 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8483e-05 2024-05-08T18:30:21.390 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.390 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.390 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:21.390 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.775846+0000", 2024-05-08T18:30:21.391 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8613000000000002e-05 2024-05-08T18:30:21.391 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:21.391 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:21.391 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:21.391 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.391 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.391 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:21.391 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.790921+0000", 2024-05-08T18:30:21.391 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 29.545546365, 2024-05-08T18:30:21.391 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003116869, 2024-05-08T18:30:21.391 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:21.391 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:21.391 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:21.391 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:21.392 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:21.392 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:21.392 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 235 2024-05-08T18:30:21.392 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.392 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:21.392 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.392 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:21.392 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790921+0000", 2024-05-08T18:30:21.392 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:21.392 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.392 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.392 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:21.392 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790921+0000", 2024-05-08T18:30:21.393 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:21.393 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.393 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.393 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:21.393 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790923+0000", 2024-05-08T18:30:21.393 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3199999999999998e-06 2024-05-08T18:30:21.393 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.393 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.393 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:21.393 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790934+0000", 2024-05-08T18:30:21.393 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.117e-05 2024-05-08T18:30:21.393 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.393 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.393 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:21.394 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790965+0000", 2024-05-08T18:30:21.394 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0392999999999999e-05 2024-05-08T18:30:21.394 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.394 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.394 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:21.394 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790981+0000", 2024-05-08T18:30:21.394 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5699999999999999e-05 2024-05-08T18:30:21.394 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.394 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.394 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:21.394 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.791093+0000", 2024-05-08T18:30:21.394 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000112062 2024-05-08T18:30:21.394 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.395 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.395 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:21.395 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.791324+0000", 2024-05-08T18:30:21.395 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023142200000000001 2024-05-08T18:30:21.395 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.395 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.395 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:21.395 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.791761+0000", 2024-05-08T18:30:21.395 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00043669999999999999 2024-05-08T18:30:21.395 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.395 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.395 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:21.395 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.792996+0000", 2024-05-08T18:30:21.395 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001235713 2024-05-08T18:30:21.396 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.396 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.396 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:21.396 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.793850+0000", 2024-05-08T18:30:21.396 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00085392400000000005 2024-05-08T18:30:21.396 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.396 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.396 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:21.396 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.793971+0000", 2024-05-08T18:30:21.396 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000120516 2024-05-08T18:30:21.396 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.396 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.396 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:21.397 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794038+0000", 2024-05-08T18:30:21.397 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6948999999999999e-05 2024-05-08T18:30:21.397 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:21.397 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:21.397 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:21.397 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.397 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.397 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:349 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:21.397 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.817315+0000", 2024-05-08T18:30:21.397 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 29.519152494, 2024-05-08T18:30:21.397 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0036888580000000002, 2024-05-08T18:30:21.397 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:21.397 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:21.398 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:21.398 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:21.398 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:21.398 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:21.398 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 349 2024-05-08T18:30:21.398 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.398 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:21.398 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.398 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:21.398 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817315+0000", 2024-05-08T18:30:21.398 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:21.398 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.398 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.399 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:21.399 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817315+0000", 2024-05-08T18:30:21.399 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:21.399 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.399 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.399 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:21.399 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817316+0000", 2024-05-08T18:30:21.399 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3370000000000001e-06 2024-05-08T18:30:21.399 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.399 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.399 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:21.399 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817323+0000", 2024-05-08T18:30:21.399 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.4300000000000003e-06 2024-05-08T18:30:21.400 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.400 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.400 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:21.400 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817337+0000", 2024-05-08T18:30:21.400 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4025999999999999e-05 2024-05-08T18:30:21.400 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.400 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.400 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:21.400 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817345+0000", 2024-05-08T18:30:21.400 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5669999999999995e-06 2024-05-08T18:30:21.400 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.400 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.400 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:21.400 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817407+0000", 2024-05-08T18:30:21.401 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1882000000000001e-05 2024-05-08T18:30:21.401 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.401 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.401 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:21.401 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817508+0000", 2024-05-08T18:30:21.401 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000100585 2024-05-08T18:30:21.401 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.401 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.401 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:21.401 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817673+0000", 2024-05-08T18:30:21.401 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000165802 2024-05-08T18:30:21.401 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.401 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.401 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:21.402 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.818715+0000", 2024-05-08T18:30:21.402 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0010417720000000001 2024-05-08T18:30:21.402 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.402 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.402 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:21.402 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.820892+0000", 2024-05-08T18:30:21.402 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0021771859999999998 2024-05-08T18:30:21.402 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.402 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.402 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:21.402 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.820950+0000", 2024-05-08T18:30:21.402 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7636000000000002e-05 2024-05-08T18:30:21.402 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.403 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.403 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:21.403 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.821004+0000", 2024-05-08T18:30:21.403 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3634999999999997e-05 2024-05-08T18:30:21.403 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:21.403 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:21.403 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:21.403 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.403 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.403 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:406 6.16 6:6dc3b799:reshard::reshard.0000000006:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:21.403 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.840465+0000", 2024-05-08T18:30:21.403 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 29.496002327999999, 2024-05-08T18:30:21.403 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003613032, 2024-05-08T18:30:21.403 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:21.404 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:21.404 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:21.404 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:21.404 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:21.404 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:21.404 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 406 2024-05-08T18:30:21.404 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.404 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:21.404 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.404 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:21.404 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840465+0000", 2024-05-08T18:30:21.404 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:21.404 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.405 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.405 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:21.405 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840465+0000", 2024-05-08T18:30:21.405 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:21.405 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.405 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.405 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:21.405 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840466+0000", 2024-05-08T18:30:21.405 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7499999999999999e-07 2024-05-08T18:30:21.405 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.405 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.405 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:21.405 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840471+0000", 2024-05-08T18:30:21.405 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9699999999999998e-06 2024-05-08T18:30:21.406 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.406 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.406 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:21.406 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840484+0000", 2024-05-08T18:30:21.406 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2717999999999999e-05 2024-05-08T18:30:21.406 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.406 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.406 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:21.406 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840490+0000", 2024-05-08T18:30:21.406 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.472e-06 2024-05-08T18:30:21.406 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.406 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.406 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:21.407 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840536+0000", 2024-05-08T18:30:21.407 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6409000000000002e-05 2024-05-08T18:30:21.407 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.407 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.407 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:21.407 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840591+0000", 2024-05-08T18:30:21.407 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4911000000000003e-05 2024-05-08T18:30:21.407 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.407 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.407 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:30:21.407 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840745+0000", 2024-05-08T18:30:21.407 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015394900000000001 2024-05-08T18:30:21.407 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.408 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.408 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:21.408 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.841269+0000", 2024-05-08T18:30:21.408 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00052347299999999999 2024-05-08T18:30:21.408 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.408 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.408 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:21.408 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.843997+0000", 2024-05-08T18:30:21.408 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0027285080000000001 2024-05-08T18:30:21.408 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.408 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.408 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:21.408 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844033+0000", 2024-05-08T18:30:21.408 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6038000000000003e-05 2024-05-08T18:30:21.409 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.409 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.409 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:21.409 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844078+0000", 2024-05-08T18:30:21.409 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4709000000000002e-05 2024-05-08T18:30:21.409 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:21.409 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:21.409 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:21.409 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.409 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.409 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:413 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:21.409 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.844187+0000", 2024-05-08T18:30:21.409 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 29.492280750999999, 2024-05-08T18:30:21.410 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0024835069999999998, 2024-05-08T18:30:21.410 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:21.410 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:21.410 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:21.410 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:21.410 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:21.410 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:21.410 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 413 2024-05-08T18:30:21.410 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.410 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:21.410 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.410 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:21.410 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844187+0000", 2024-05-08T18:30:21.410 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:21.411 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.411 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.411 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:21.411 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844187+0000", 2024-05-08T18:30:21.411 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:21.411 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.411 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.411 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:21.411 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844187+0000", 2024-05-08T18:30:21.411 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9999999999999996e-07 2024-05-08T18:30:21.411 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.411 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.412 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:21.412 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844192+0000", 2024-05-08T18:30:21.412 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7899999999999999e-06 2024-05-08T18:30:21.412 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.412 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.412 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:21.412 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844203+0000", 2024-05-08T18:30:21.412 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1002000000000001e-05 2024-05-08T18:30:21.412 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.412 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.412 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:21.412 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844209+0000", 2024-05-08T18:30:21.412 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6570000000000002e-06 2024-05-08T18:30:21.413 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.413 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.413 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:21.413 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844270+0000", 2024-05-08T18:30:21.413 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0810999999999998e-05 2024-05-08T18:30:21.413 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.413 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.413 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:21.413 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844419+0000", 2024-05-08T18:30:21.413 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000149097 2024-05-08T18:30:21.413 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.413 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.413 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:30:21.413 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844611+0000", 2024-05-08T18:30:21.414 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00019247900000000001 2024-05-08T18:30:21.414 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.414 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.414 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:21.414 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.845287+0000", 2024-05-08T18:30:21.414 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00067526000000000001 2024-05-08T18:30:21.414 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.414 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.414 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:21.414 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.846609+0000", 2024-05-08T18:30:21.414 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001322124 2024-05-08T18:30:21.414 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.415 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.415 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:21.415 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.846642+0000", 2024-05-08T18:30:21.415 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3654e-05 2024-05-08T18:30:21.415 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.415 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.415 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:21.415 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.846670+0000", 2024-05-08T18:30:21.415 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7733e-05 2024-05-08T18:30:21.415 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:21.415 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:21.415 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:21.415 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.415 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.416 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:420 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:21.416 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.847096+0000", 2024-05-08T18:30:21.416 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 29.489371457000001, 2024-05-08T18:30:21.416 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0026261589999999999, 2024-05-08T18:30:21.416 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:21.416 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:21.416 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:21.416 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:21.416 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:21.416 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:21.416 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 420 2024-05-08T18:30:21.416 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.416 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:21.416 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.417 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:21.417 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847096+0000", 2024-05-08T18:30:21.417 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:21.417 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.417 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.417 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:21.417 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847096+0000", 2024-05-08T18:30:21.417 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:21.417 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.417 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.418 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:21.418 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847097+0000", 2024-05-08T18:30:21.418 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.5499999999999996e-07 2024-05-08T18:30:21.418 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.418 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.418 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:21.418 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847103+0000", 2024-05-08T18:30:21.418 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8969999999999996e-06 2024-05-08T18:30:21.418 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.418 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.418 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:21.418 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847114+0000", 2024-05-08T18:30:21.418 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1549000000000001e-05 2024-05-08T18:30:21.419 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.419 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.419 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:21.419 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847120+0000", 2024-05-08T18:30:21.419 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5509999999999999e-06 2024-05-08T18:30:21.419 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.419 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.419 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:21.419 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847166+0000", 2024-05-08T18:30:21.419 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6683e-05 2024-05-08T18:30:21.419 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.419 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.419 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:21.419 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847213+0000", 2024-05-08T18:30:21.420 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6659000000000002e-05 2024-05-08T18:30:21.420 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.420 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.420 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:30:21.420 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847315+0000", 2024-05-08T18:30:21.420 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000102336 2024-05-08T18:30:21.420 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.420 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.420 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:21.420 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847840+0000", 2024-05-08T18:30:21.420 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00052475000000000004 2024-05-08T18:30:21.420 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.420 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.420 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:21.420 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.849660+0000", 2024-05-08T18:30:21.420 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001819563 2024-05-08T18:30:21.421 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.421 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.421 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:21.421 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.849695+0000", 2024-05-08T18:30:21.421 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4761000000000001e-05 2024-05-08T18:30:21.421 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.421 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.421 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:21.421 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.849722+0000", 2024-05-08T18:30:21.421 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7455000000000001e-05 2024-05-08T18:30:21.421 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:21.421 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:21.421 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:21.421 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.421 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.422 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:532 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:21.422 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.908603+0000", 2024-05-08T18:30:21.422 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 29.427863906999999, 2024-05-08T18:30:21.422 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0038838950000000001, 2024-05-08T18:30:21.422 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:21.422 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:21.422 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:21.422 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:21.422 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:21.422 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:21.422 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 532 2024-05-08T18:30:21.422 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.423 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:21.423 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.423 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:21.423 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908603+0000", 2024-05-08T18:30:21.423 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:21.423 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.423 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.423 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:21.423 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908603+0000", 2024-05-08T18:30:21.423 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:21.423 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.423 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.423 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:21.424 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908605+0000", 2024-05-08T18:30:21.424 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1179999999999999e-06 2024-05-08T18:30:21.424 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.424 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.424 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:21.424 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908608+0000", 2024-05-08T18:30:21.424 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7419999999999999e-06 2024-05-08T18:30:21.424 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.424 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.424 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:21.424 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908618+0000", 2024-05-08T18:30:21.424 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.6889999999999999e-06 2024-05-08T18:30:21.424 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.425 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.425 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:21.425 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908625+0000", 2024-05-08T18:30:21.425 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1300000000000003e-06 2024-05-08T18:30:21.425 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.425 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.425 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:21.425 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908669+0000", 2024-05-08T18:30:21.425 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3832000000000003e-05 2024-05-08T18:30:21.425 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.425 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.425 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:21.425 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908724+0000", 2024-05-08T18:30:21.425 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5222000000000001e-05 2024-05-08T18:30:21.426 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.426 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.426 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:30:21.426 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908854+0000", 2024-05-08T18:30:21.426 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012953500000000001 2024-05-08T18:30:21.426 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.426 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.426 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:21.426 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.909511+0000", 2024-05-08T18:30:21.426 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00065768399999999996 2024-05-08T18:30:21.426 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.426 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.427 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:21.427 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912426+0000", 2024-05-08T18:30:21.427 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0029146599999999999 2024-05-08T18:30:21.427 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.427 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.427 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:21.427 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912461+0000", 2024-05-08T18:30:21.427 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4934999999999997e-05 2024-05-08T18:30:21.427 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.427 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.427 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:21.427 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912487+0000", 2024-05-08T18:30:21.427 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6347999999999999e-05 2024-05-08T18:30:21.428 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:21.428 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:21.428 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:21.428 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.428 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.428 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:534 6.9 6:9268b73e:::obj_delete_at_hint.0000000019:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:21.428 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.910153+0000", 2024-05-08T18:30:21.428 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 29.42631445, 2024-05-08T18:30:21.428 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0051089680000000002, 2024-05-08T18:30:21.428 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:21.428 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:21.428 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:21.428 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:21.428 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:21.429 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:21.429 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 534 2024-05-08T18:30:21.429 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.429 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:21.429 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.429 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:21.429 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910153+0000", 2024-05-08T18:30:21.429 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:21.429 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.429 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.429 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:21.429 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910153+0000", 2024-05-08T18:30:21.430 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:21.430 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.430 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.430 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:21.430 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910154+0000", 2024-05-08T18:30:21.430 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1039999999999999e-06 2024-05-08T18:30:21.430 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.430 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.430 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:21.430 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910158+0000", 2024-05-08T18:30:21.430 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7400000000000002e-06 2024-05-08T18:30:21.430 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.430 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.431 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:21.431 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910167+0000", 2024-05-08T18:30:21.431 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8880000000000003e-06 2024-05-08T18:30:21.431 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.431 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.431 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:21.431 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910173+0000", 2024-05-08T18:30:21.431 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.844e-06 2024-05-08T18:30:21.431 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.431 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.431 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:21.431 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910220+0000", 2024-05-08T18:30:21.431 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6582000000000002e-05 2024-05-08T18:30:21.432 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.432 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.432 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:21.432 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910287+0000", 2024-05-08T18:30:21.432 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7271e-05 2024-05-08T18:30:21.432 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.432 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.432 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:30:21.432 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910402+0000", 2024-05-08T18:30:21.432 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115127 2024-05-08T18:30:21.432 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.432 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.432 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:21.432 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910881+0000", 2024-05-08T18:30:21.433 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000479025 2024-05-08T18:30:21.433 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.433 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.433 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:21.433 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.915206+0000", 2024-05-08T18:30:21.433 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.004324357 2024-05-08T18:30:21.433 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.433 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.433 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:21.433 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.915237+0000", 2024-05-08T18:30:21.433 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1590000000000001e-05 2024-05-08T18:30:21.433 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.433 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.434 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:21.434 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.915262+0000", 2024-05-08T18:30:21.434 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.444e-05 2024-05-08T18:30:21.434 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:21.434 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:21.434 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:21.434 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.434 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.434 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:583 6.0 6:03bbb29a:::obj_delete_at_hint.0000000026:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:21.434 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.947199+0000", 2024-05-08T18:30:21.434 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 29.389268253000001, 2024-05-08T18:30:21.434 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0025081510000000001, 2024-05-08T18:30:21.434 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:21.434 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:21.435 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:21.435 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:21.435 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:21.435 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:21.435 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 583 2024-05-08T18:30:21.435 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.435 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:21.435 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.435 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:21.435 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947199+0000", 2024-05-08T18:30:21.435 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:21.435 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.435 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.435 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:21.435 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947199+0000", 2024-05-08T18:30:21.436 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:21.436 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.436 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.436 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:21.436 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947200+0000", 2024-05-08T18:30:21.436 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3799999999999997e-07 2024-05-08T18:30:21.436 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.436 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.436 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:21.436 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947207+0000", 2024-05-08T18:30:21.436 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2030000000000003e-06 2024-05-08T18:30:21.436 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.436 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.437 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:21.437 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947217+0000", 2024-05-08T18:30:21.437 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0138e-05 2024-05-08T18:30:21.437 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.437 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.437 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:21.437 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947224+0000", 2024-05-08T18:30:21.437 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5289999999999997e-06 2024-05-08T18:30:21.437 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.437 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.437 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:21.437 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.948039+0000", 2024-05-08T18:30:21.437 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00081500599999999996 2024-05-08T18:30:21.438 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.438 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.438 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:21.438 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.948230+0000", 2024-05-08T18:30:21.438 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000191838 2024-05-08T18:30:21.438 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.438 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.438 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:21.438 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.948606+0000", 2024-05-08T18:30:21.438 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00037547900000000001 2024-05-08T18:30:21.438 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.438 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.438 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:21.439 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.949406+0000", 2024-05-08T18:30:21.439 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000799674 2024-05-08T18:30:21.439 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.439 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.439 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:21.439 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.949630+0000", 2024-05-08T18:30:21.439 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00022474699999999999 2024-05-08T18:30:21.439 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.439 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.439 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:21.439 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.949664+0000", 2024-05-08T18:30:21.439 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3535999999999999e-05 2024-05-08T18:30:21.439 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.439 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.440 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:21.440 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.949707+0000", 2024-05-08T18:30:21.440 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3362999999999998e-05 2024-05-08T18:30:21.440 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:21.440 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:21.440 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:21.440 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.440 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.440 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:686 6.10 6:0d0f4ce5:::obj_delete_at_hint.0000000040:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:21.440 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.012623+0000", 2024-05-08T18:30:21.440 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 29.323844063999999, 2024-05-08T18:30:21.440 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0024696330000000002, 2024-05-08T18:30:21.440 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:21.441 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:21.441 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:21.441 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:21.441 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:21.441 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:21.441 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 686 2024-05-08T18:30:21.441 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.441 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:21.441 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.441 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:21.441 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.012623+0000", 2024-05-08T18:30:21.441 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:21.442 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.442 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.442 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:21.442 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.012623+0000", 2024-05-08T18:30:21.442 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:21.442 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.442 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.442 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:21.442 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.012624+0000", 2024-05-08T18:30:21.442 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1480000000000001e-06 2024-05-08T18:30:21.442 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.442 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.442 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:21.443 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.012631+0000", 2024-05-08T18:30:21.443 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1700000000000002e-06 2024-05-08T18:30:21.443 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.443 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.443 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:21.443 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.012647+0000", 2024-05-08T18:30:21.443 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6133999999999998e-05 2024-05-08T18:30:21.443 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.443 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.443 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:21.443 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.012655+0000", 2024-05-08T18:30:21.443 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7199999999999995e-06 2024-05-08T18:30:21.443 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.443 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.444 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:21.444 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.012715+0000", 2024-05-08T18:30:21.444 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9475999999999998e-05 2024-05-08T18:30:21.444 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.444 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.444 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:21.444 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.012805+0000", 2024-05-08T18:30:21.444 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9840999999999996e-05 2024-05-08T18:30:21.444 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.444 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.444 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:21.444 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.012930+0000", 2024-05-08T18:30:21.444 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012537099999999999 2024-05-08T18:30:21.444 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.445 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.445 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:21.445 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.013584+0000", 2024-05-08T18:30:21.445 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00065356500000000005 2024-05-08T18:30:21.445 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.445 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.445 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:21.445 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.014956+0000", 2024-05-08T18:30:21.445 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001372535 2024-05-08T18:30:21.445 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.445 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.445 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:21.445 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.015017+0000", 2024-05-08T18:30:21.445 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0590000000000001e-05 2024-05-08T18:30:21.445 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.446 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.446 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:21.446 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.015093+0000", 2024-05-08T18:30:21.446 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6082999999999996e-05 2024-05-08T18:30:21.446 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:21.446 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:21.446 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:21.446 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.446 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.446 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:21.446 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.263796+0000", 2024-05-08T18:30:21.446 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 29.072670984999998, 2024-05-08T18:30:21.446 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0027788019999999999, 2024-05-08T18:30:21.446 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:21.447 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:21.447 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:21.447 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:21.447 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:21.447 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:21.447 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 811 2024-05-08T18:30:21.447 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.447 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:21.447 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.447 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:21.447 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263796+0000", 2024-05-08T18:30:21.447 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:21.447 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.447 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.448 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:21.448 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263796+0000", 2024-05-08T18:30:21.448 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:21.448 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.448 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.448 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:21.448 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263799+0000", 2024-05-08T18:30:21.448 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5569999999999998e-06 2024-05-08T18:30:21.448 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.448 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.448 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:21.448 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263812+0000", 2024-05-08T18:30:21.448 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3145999999999999e-05 2024-05-08T18:30:21.448 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.448 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.449 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:21.449 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263842+0000", 2024-05-08T18:30:21.449 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0193e-05 2024-05-08T18:30:21.449 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.449 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.449 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:21.449 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263860+0000", 2024-05-08T18:30:21.449 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7880000000000002e-05 2024-05-08T18:30:21.449 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.449 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.449 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:21.449 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263979+0000", 2024-05-08T18:30:21.449 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011919899999999999 2024-05-08T18:30:21.449 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.450 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.450 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:21.450 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.264222+0000", 2024-05-08T18:30:21.450 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024290800000000001 2024-05-08T18:30:21.450 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.450 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.450 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:21.450 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.264545+0000", 2024-05-08T18:30:21.450 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00032300200000000002 2024-05-08T18:30:21.450 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.450 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.450 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:21.450 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.265682+0000", 2024-05-08T18:30:21.450 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001136464 2024-05-08T18:30:21.451 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.451 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.451 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:21.451 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.266397+0000", 2024-05-08T18:30:21.451 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00071512799999999999 2024-05-08T18:30:21.451 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.451 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.451 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:21.451 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.266504+0000", 2024-05-08T18:30:21.451 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000107019 2024-05-08T18:30:21.451 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.451 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.451 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:21.451 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.266575+0000", 2024-05-08T18:30:21.452 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1305999999999998e-05 2024-05-08T18:30:21.452 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:21.452 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:21.452 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:21.452 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.452 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.452 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:21.452 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.445706+0000", 2024-05-08T18:30:21.452 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 28.890761268999999, 2024-05-08T18:30:21.452 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0026820630000000002, 2024-05-08T18:30:21.452 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:21.452 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:21.452 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:21.452 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:21.453 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:21.453 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:21.453 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 889 2024-05-08T18:30:21.453 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.453 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:21.453 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.453 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:21.453 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445706+0000", 2024-05-08T18:30:21.453 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:21.453 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.453 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.453 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:21.453 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445706+0000", 2024-05-08T18:30:21.453 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:21.454 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.454 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.454 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:21.454 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445709+0000", 2024-05-08T18:30:21.454 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0299999999999998e-06 2024-05-08T18:30:21.454 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.454 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.454 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:21.454 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445721+0000", 2024-05-08T18:30:21.454 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2366e-05 2024-05-08T18:30:21.454 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.454 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.454 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:21.454 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445752+0000", 2024-05-08T18:30:21.454 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0287e-05 2024-05-08T18:30:21.455 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.455 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.455 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:21.455 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445773+0000", 2024-05-08T18:30:21.455 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1367000000000001e-05 2024-05-08T18:30:21.455 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.455 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.455 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:21.455 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445892+0000", 2024-05-08T18:30:21.455 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000119311 2024-05-08T18:30:21.455 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.455 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.455 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:21.455 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.446158+0000", 2024-05-08T18:30:21.456 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000265441 2024-05-08T18:30:21.456 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.456 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.456 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:21.456 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.446465+0000", 2024-05-08T18:30:21.456 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00030754300000000002 2024-05-08T18:30:21.456 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.456 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.456 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:21.456 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.447511+0000", 2024-05-08T18:30:21.456 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001045975 2024-05-08T18:30:21.456 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.456 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.456 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:21.457 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.448171+0000", 2024-05-08T18:30:21.457 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00065971200000000002 2024-05-08T18:30:21.457 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.457 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.457 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:21.457 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.448273+0000", 2024-05-08T18:30:21.457 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000101592 2024-05-08T18:30:21.457 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.457 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.457 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:21.457 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.448388+0000", 2024-05-08T18:30:21.457 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115439 2024-05-08T18:30:21.457 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:21.457 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:21.457 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:21.458 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:21.458 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:21.458 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:30:21.459 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-08T18:30:21.460 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:30:21.459+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:30:21.561 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:30:21.561+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:30:21.586 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:30:21.586 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:30:21.586 INFO:teuthology.orchestra.run.smithi097.stdout: "num_ops": 0 2024-05-08T18:30:21.586 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:30:21.600 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-08T18:30:21.686 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:30:21.689+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:30:21.762 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:30:21.765+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:30:21.765 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:30:21.765 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:30:21.765 INFO:teuthology.orchestra.run.smithi097.stdout: "complaint_time": 30, 2024-05-08T18:30:21.765 INFO:teuthology.orchestra.run.smithi097.stdout: "num_blocked_ops": 0 2024-05-08T18:30:21.765 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:30:21.781 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-08T18:30:21.863 INFO:teuthology.orchestra.run.smithi097.stderr:nodeep-scrub is unset 2024-05-08T18:30:21.864 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:30:21.859+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:30:21.949 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:30:21.950 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2024-05-08T18:30:21.950 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2024-05-08T18:30:21.950 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-05-08T18:30:21.950 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.950 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4479.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-05-08T18:30:21.950 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:44.576320+0000", 2024-05-08T18:30:21.950 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 37.374917179999997, 2024-05-08T18:30:21.950 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019751892, 2024-05-08T18:30:21.950 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:21.950 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:21.950 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "reached pg", 2024-05-08T18:30:21.950 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:21.951 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4479", 2024-05-08T18:30:21.951 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3577501689", 2024-05-08T18:30:21.951 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 2 2024-05-08T18:30:21.951 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.951 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:21.951 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.951 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:21.951 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576320+0000", 2024-05-08T18:30:21.951 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:21.951 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.951 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.951 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:21.951 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576320+0000", 2024-05-08T18:30:21.951 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:21.952 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.952 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.952 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:21.952 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576323+0000", 2024-05-08T18:30:21.952 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.813e-06 2024-05-08T18:30:21.952 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.952 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.952 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:21.952 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576335+0000", 2024-05-08T18:30:21.952 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2330000000000001e-05 2024-05-08T18:30:21.952 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.952 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.952 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:21.952 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576367+0000", 2024-05-08T18:30:21.953 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2036999999999998e-05 2024-05-08T18:30:21.953 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.953 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.953 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:21.953 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576394+0000", 2024-05-08T18:30:21.953 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6529e-05 2024-05-08T18:30:21.953 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.953 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.953 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:21.953 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576550+0000", 2024-05-08T18:30:21.953 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000156718 2024-05-08T18:30:21.953 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.953 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.953 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-05-08T18:30:21.953 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576560+0000", 2024-05-08T18:30:21.954 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0040999999999999e-05 2024-05-08T18:30:21.954 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.954 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.954 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:21.954 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.587240+0000", 2024-05-08T18:30:21.954 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010679266999999999 2024-05-08T18:30:21.954 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.954 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.954 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2024-05-08T18:30:21.954 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.587266+0000", 2024-05-08T18:30:21.954 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6642e-05 2024-05-08T18:30:21.954 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.954 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.955 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:21.955 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.595882+0000", 2024-05-08T18:30:21.955 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0086159600000000006 2024-05-08T18:30:21.955 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.955 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.955 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:21.955 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.596072+0000", 2024-05-08T18:30:21.955 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000189555 2024-05-08T18:30:21.955 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:21.955 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:21.955 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:21.955 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.955 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.955 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:30:21.955 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:48.766182+0000", 2024-05-08T18:30:21.956 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 33.185055153, 2024-05-08T18:30:21.956 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031881209999999999, 2024-05-08T18:30:21.956 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:21.956 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:21.956 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:21.956 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:21.956 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:21.956 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:21.956 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 193 2024-05-08T18:30:21.956 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.956 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:21.956 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.956 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:21.956 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766182+0000", 2024-05-08T18:30:21.956 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:21.957 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.957 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.957 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:21.957 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766182+0000", 2024-05-08T18:30:21.957 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:21.957 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.957 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.957 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:21.957 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766184+0000", 2024-05-08T18:30:21.957 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4159999999999998e-06 2024-05-08T18:30:21.957 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.957 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.957 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:21.957 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766196+0000", 2024-05-08T18:30:21.957 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1814000000000001e-05 2024-05-08T18:30:21.958 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.958 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.958 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:21.958 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766227+0000", 2024-05-08T18:30:21.958 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0676000000000002e-05 2024-05-08T18:30:21.958 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.958 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.958 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:21.958 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766242+0000", 2024-05-08T18:30:21.958 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5497000000000001e-05 2024-05-08T18:30:21.958 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.958 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.958 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:21.958 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766354+0000", 2024-05-08T18:30:21.959 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000111579 2024-05-08T18:30:21.959 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.959 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.959 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:21.959 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766569+0000", 2024-05-08T18:30:21.959 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000214978 2024-05-08T18:30:21.959 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.959 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.959 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:21.959 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766834+0000", 2024-05-08T18:30:21.959 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00026551500000000002 2024-05-08T18:30:21.959 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.959 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.959 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:21.960 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.768577+0000", 2024-05-08T18:30:21.960 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001742513 2024-05-08T18:30:21.960 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.960 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.960 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:21.960 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.769150+0000", 2024-05-08T18:30:21.960 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00057320500000000003 2024-05-08T18:30:21.960 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.960 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.960 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:21.960 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.769250+0000", 2024-05-08T18:30:21.960 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.9846000000000006e-05 2024-05-08T18:30:21.960 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.961 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.961 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:21.961 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.769370+0000", 2024-05-08T18:30:21.961 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012008200000000001 2024-05-08T18:30:21.961 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:21.961 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:21.961 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:21.961 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.961 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.961 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:21.961 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.679562+0000", 2024-05-08T18:30:21.961 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 30.271675449, 2024-05-08T18:30:21.961 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0086320800000000003, 2024-05-08T18:30:21.961 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:21.961 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:21.962 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:21.962 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:21.962 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:21.962 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:21.962 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 208 2024-05-08T18:30:21.962 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.962 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:21.962 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.962 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:21.962 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679562+0000", 2024-05-08T18:30:21.962 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:21.962 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.962 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.963 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:21.963 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679562+0000", 2024-05-08T18:30:21.963 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:21.963 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.963 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.963 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:21.963 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679565+0000", 2024-05-08T18:30:21.963 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0800000000000002e-06 2024-05-08T18:30:21.963 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.963 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.963 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:21.963 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679578+0000", 2024-05-08T18:30:21.963 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3217000000000001e-05 2024-05-08T18:30:21.964 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.964 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.964 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:21.964 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679610+0000", 2024-05-08T18:30:21.964 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1696000000000003e-05 2024-05-08T18:30:21.964 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.964 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.964 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:21.964 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679625+0000", 2024-05-08T18:30:21.964 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5824e-05 2024-05-08T18:30:21.964 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.964 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.964 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:21.964 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679758+0000", 2024-05-08T18:30:21.965 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013231199999999999 2024-05-08T18:30:21.965 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.965 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.965 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-05-08T18:30:21.965 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679770+0000", 2024-05-08T18:30:21.965 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1800000000000001e-05 2024-05-08T18:30:21.965 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.965 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.965 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:21.965 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.685241+0000", 2024-05-08T18:30:21.965 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0054710169999999999 2024-05-08T18:30:21.965 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.965 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.965 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:21.966 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.685444+0000", 2024-05-08T18:30:21.966 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000203835 2024-05-08T18:30:21.966 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.966 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.966 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:21.966 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.685842+0000", 2024-05-08T18:30:21.966 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00039773 2024-05-08T18:30:21.966 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.966 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.966 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:21.966 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.687232+0000", 2024-05-08T18:30:21.966 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00139011 2024-05-08T18:30:21.966 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.966 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.967 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:21.967 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.688049+0000", 2024-05-08T18:30:21.967 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00081667000000000003 2024-05-08T18:30:21.967 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.967 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.967 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:21.967 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.688135+0000", 2024-05-08T18:30:21.967 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6299999999999997e-05 2024-05-08T18:30:21.967 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.967 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.967 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:21.967 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.688194+0000", 2024-05-08T18:30:21.967 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8489000000000002e-05 2024-05-08T18:30:21.967 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:21.967 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:21.968 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:21.968 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.968 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.968 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:21.968 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.707114+0000", 2024-05-08T18:30:21.968 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 30.244123434999999, 2024-05-08T18:30:21.968 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031802990000000001, 2024-05-08T18:30:21.968 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:21.968 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:21.968 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:21.968 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:21.968 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:21.968 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:21.968 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 212 2024-05-08T18:30:21.969 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.969 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:21.969 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.969 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:21.969 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707114+0000", 2024-05-08T18:30:21.969 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:21.969 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.969 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.969 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:21.969 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707114+0000", 2024-05-08T18:30:21.969 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:21.969 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.969 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.969 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:21.970 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707117+0000", 2024-05-08T18:30:21.970 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8629999999999999e-06 2024-05-08T18:30:21.970 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.970 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.970 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:21.970 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707129+0000", 2024-05-08T18:30:21.970 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2150000000000001e-05 2024-05-08T18:30:21.970 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.970 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.970 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:21.970 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707158+0000", 2024-05-08T18:30:21.970 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9513999999999999e-05 2024-05-08T18:30:21.970 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.970 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.970 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:21.971 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707173+0000", 2024-05-08T18:30:21.971 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5136e-05 2024-05-08T18:30:21.971 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.971 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.971 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:21.971 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707309+0000", 2024-05-08T18:30:21.971 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000135609 2024-05-08T18:30:21.971 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.971 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.971 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:21.971 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707523+0000", 2024-05-08T18:30:21.971 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021362200000000001 2024-05-08T18:30:21.971 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.972 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.972 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:21.972 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707918+0000", 2024-05-08T18:30:21.972 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00039556299999999998 2024-05-08T18:30:21.972 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.972 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.972 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:21.972 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.709166+0000", 2024-05-08T18:30:21.972 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012476410000000001 2024-05-08T18:30:21.972 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.972 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.972 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:21.972 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.710145+0000", 2024-05-08T18:30:21.972 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00097909899999999998 2024-05-08T18:30:21.972 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.973 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.973 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:21.973 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.710231+0000", 2024-05-08T18:30:21.973 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5625999999999996e-05 2024-05-08T18:30:21.973 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.973 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.973 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:21.973 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.710294+0000", 2024-05-08T18:30:21.973 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3476e-05 2024-05-08T18:30:21.973 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:21.973 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:21.973 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:21.973 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.973 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.974 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:21.974 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.731985+0000", 2024-05-08T18:30:21.974 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 30.219252210000001, 2024-05-08T18:30:21.974 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0039250600000000002, 2024-05-08T18:30:21.974 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:21.974 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:21.974 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:21.974 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:21.974 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:21.974 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:21.974 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 219 2024-05-08T18:30:21.974 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.974 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:21.974 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.975 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:21.975 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731985+0000", 2024-05-08T18:30:21.975 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:21.975 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.975 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.975 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:21.975 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731985+0000", 2024-05-08T18:30:21.975 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:21.975 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.975 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.975 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:21.975 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731988+0000", 2024-05-08T18:30:21.975 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6599999999999999e-06 2024-05-08T18:30:21.975 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.976 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.976 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:21.976 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.732017+0000", 2024-05-08T18:30:21.976 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9692999999999998e-05 2024-05-08T18:30:21.976 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.976 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.976 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:21.976 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.732048+0000", 2024-05-08T18:30:21.976 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1066999999999999e-05 2024-05-08T18:30:21.976 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.976 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.976 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:21.976 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.732064+0000", 2024-05-08T18:30:21.976 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5786000000000001e-05 2024-05-08T18:30:21.977 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.977 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.977 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:21.977 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.732213+0000", 2024-05-08T18:30:21.977 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014895899999999999 2024-05-08T18:30:21.977 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.977 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.977 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:21.977 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.732572+0000", 2024-05-08T18:30:21.977 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000358904 2024-05-08T18:30:21.977 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.977 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.977 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:21.978 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.733349+0000", 2024-05-08T18:30:21.978 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00077657699999999997 2024-05-08T18:30:21.978 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.978 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.978 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:21.978 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.734899+0000", 2024-05-08T18:30:21.978 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001550652 2024-05-08T18:30:21.978 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.978 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.978 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:21.978 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.735641+0000", 2024-05-08T18:30:21.978 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00074222000000000003 2024-05-08T18:30:21.979 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.979 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.979 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:21.979 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.735801+0000", 2024-05-08T18:30:21.979 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015913599999999999 2024-05-08T18:30:21.979 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.979 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.979 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:21.979 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.735910+0000", 2024-05-08T18:30:21.979 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000109406 2024-05-08T18:30:21.979 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:21.979 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:21.979 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:21.979 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.980 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.980 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:21.980 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.750251+0000", 2024-05-08T18:30:21.980 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 30.200986277999998, 2024-05-08T18:30:21.980 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0038408600000000002, 2024-05-08T18:30:21.980 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:21.980 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:21.980 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:21.980 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:21.980 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:21.980 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:21.980 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 224 2024-05-08T18:30:21.980 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.981 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:21.981 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.981 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:21.981 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750251+0000", 2024-05-08T18:30:21.981 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:21.981 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.981 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.981 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:21.981 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750251+0000", 2024-05-08T18:30:21.981 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:21.981 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.981 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.981 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:21.982 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750253+0000", 2024-05-08T18:30:21.982 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2129999999999998e-06 2024-05-08T18:30:21.982 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.982 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.982 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:21.982 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750265+0000", 2024-05-08T18:30:21.982 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1484000000000001e-05 2024-05-08T18:30:21.982 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.982 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.982 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:21.982 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750293+0000", 2024-05-08T18:30:21.982 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8673000000000001e-05 2024-05-08T18:30:21.982 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.982 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.982 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:21.983 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750308+0000", 2024-05-08T18:30:21.983 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4620000000000001e-05 2024-05-08T18:30:21.983 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.983 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.983 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:21.983 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750459+0000", 2024-05-08T18:30:21.983 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000151619 2024-05-08T18:30:21.983 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.983 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.983 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:21.983 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750822+0000", 2024-05-08T18:30:21.983 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000362467 2024-05-08T18:30:21.983 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.983 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.983 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:21.984 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.751591+0000", 2024-05-08T18:30:21.984 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00076934699999999998 2024-05-08T18:30:21.984 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.984 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.984 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:21.984 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.753042+0000", 2024-05-08T18:30:21.984 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001450652 2024-05-08T18:30:21.984 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.984 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.984 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:21.984 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.753792+0000", 2024-05-08T18:30:21.984 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00075045500000000002 2024-05-08T18:30:21.984 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.984 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.985 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:21.985 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.753977+0000", 2024-05-08T18:30:21.985 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000184511 2024-05-08T18:30:21.985 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.985 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.985 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:21.985 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.754092+0000", 2024-05-08T18:30:21.985 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000114819 2024-05-08T18:30:21.985 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:21.985 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:21.985 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:21.985 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.985 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.985 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:21.986 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.783902+0000", 2024-05-08T18:30:21.986 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 30.167335547, 2024-05-08T18:30:21.986 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003120046, 2024-05-08T18:30:21.986 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:21.986 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:21.986 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:21.986 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:21.986 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:21.986 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:21.986 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 233 2024-05-08T18:30:21.986 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.986 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:21.986 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.986 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:21.987 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.783902+0000", 2024-05-08T18:30:21.987 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:21.987 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.987 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.987 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:21.987 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.783902+0000", 2024-05-08T18:30:21.987 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:21.987 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.987 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.987 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:21.987 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.783904+0000", 2024-05-08T18:30:21.987 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5229999999999998e-06 2024-05-08T18:30:21.987 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.987 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.987 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:21.988 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.783916+0000", 2024-05-08T18:30:21.988 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1513e-05 2024-05-08T18:30:21.988 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.988 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.988 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:21.988 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.783947+0000", 2024-05-08T18:30:21.988 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1353000000000003e-05 2024-05-08T18:30:21.988 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.988 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.988 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:21.988 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.783964+0000", 2024-05-08T18:30:21.988 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6643e-05 2024-05-08T18:30:21.988 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.988 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.988 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:21.989 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.784110+0000", 2024-05-08T18:30:21.989 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014627299999999999 2024-05-08T18:30:21.989 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.989 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.989 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:21.989 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.784329+0000", 2024-05-08T18:30:21.989 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021892099999999999 2024-05-08T18:30:21.989 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.989 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.989 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:21.989 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.784752+0000", 2024-05-08T18:30:21.989 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00042336700000000001 2024-05-08T18:30:21.989 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.989 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.989 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:21.990 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.786093+0000", 2024-05-08T18:30:21.990 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00134107 2024-05-08T18:30:21.990 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.990 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.990 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:21.990 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.786863+0000", 2024-05-08T18:30:21.990 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00076949099999999997 2024-05-08T18:30:21.990 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.990 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.990 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:21.990 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.786955+0000", 2024-05-08T18:30:21.990 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.2478999999999993e-05 2024-05-08T18:30:21.990 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.991 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.991 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:21.991 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.787022+0000", 2024-05-08T18:30:21.991 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6413000000000003e-05 2024-05-08T18:30:21.991 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:21.991 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:21.991 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:21.991 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.991 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.991 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:341 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:21.991 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.816045+0000", 2024-05-08T18:30:21.991 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 30.13519221, 2024-05-08T18:30:21.991 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002875154, 2024-05-08T18:30:21.991 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:21.991 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:21.992 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:21.992 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:21.992 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:21.992 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:21.992 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 341 2024-05-08T18:30:21.992 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.992 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:21.992 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.992 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:21.992 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816045+0000", 2024-05-08T18:30:21.992 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:21.992 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.992 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.992 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:21.993 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816045+0000", 2024-05-08T18:30:21.993 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:21.993 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.993 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.993 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:21.993 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816046+0000", 2024-05-08T18:30:21.993 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9199999999999999e-07 2024-05-08T18:30:21.993 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.993 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.993 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:21.993 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816050+0000", 2024-05-08T18:30:21.993 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0260000000000001e-06 2024-05-08T18:30:21.993 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.993 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.993 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:21.994 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816060+0000", 2024-05-08T18:30:21.994 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0297e-05 2024-05-08T18:30:21.994 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.994 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.994 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:21.994 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816065+0000", 2024-05-08T18:30:21.994 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.237e-06 2024-05-08T18:30:21.994 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.994 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.994 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:21.994 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816122+0000", 2024-05-08T18:30:21.994 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6168000000000002e-05 2024-05-08T18:30:21.994 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.995 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.995 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:21.995 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816198+0000", 2024-05-08T18:30:21.995 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6511e-05 2024-05-08T18:30:21.995 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.995 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.995 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:21.995 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816305+0000", 2024-05-08T18:30:21.995 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000106487 2024-05-08T18:30:21.995 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.995 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.995 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:21.995 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816886+0000", 2024-05-08T18:30:21.995 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00058187199999999999 2024-05-08T18:30:21.995 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.996 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.996 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:21.996 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.818821+0000", 2024-05-08T18:30:21.996 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001934362 2024-05-08T18:30:21.996 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.996 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.996 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:21.996 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.818880+0000", 2024-05-08T18:30:21.996 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9210999999999999e-05 2024-05-08T18:30:21.996 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.996 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.996 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:21.996 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.818920+0000", 2024-05-08T18:30:21.996 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0091e-05 2024-05-08T18:30:21.996 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:21.997 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:21.997 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:21.997 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.997 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.997 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:21.997 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.086431+0000", 2024-05-08T18:30:21.997 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 29.864806389999998, 2024-05-08T18:30:21.997 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028335959999999999, 2024-05-08T18:30:21.997 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:21.997 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:21.997 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:21.997 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:21.997 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:21.997 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:21.998 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 733 2024-05-08T18:30:21.998 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.998 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:21.998 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.998 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:21.998 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086431+0000", 2024-05-08T18:30:21.998 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:21.998 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.998 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.998 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:21.998 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086431+0000", 2024-05-08T18:30:21.998 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:21.998 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.998 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.999 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:21.999 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086433+0000", 2024-05-08T18:30:21.999 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8899999999999999e-06 2024-05-08T18:30:21.999 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.999 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.999 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:21.999 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086441+0000", 2024-05-08T18:30:21.999 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.3100000000000001e-06 2024-05-08T18:30:21.999 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.999 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:21.999 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:21.999 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086460+0000", 2024-05-08T18:30:21.999 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8703999999999999e-05 2024-05-08T18:30:21.999 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:21.999 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.000 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:22.000 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086471+0000", 2024-05-08T18:30:22.000 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1324e-05 2024-05-08T18:30:22.000 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.000 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.000 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:22.000 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086590+0000", 2024-05-08T18:30:22.000 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000118625 2024-05-08T18:30:22.000 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.000 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.000 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:22.000 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086817+0000", 2024-05-08T18:30:22.000 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000226958 2024-05-08T18:30:22.000 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.000 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.001 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:22.001 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.087131+0000", 2024-05-08T18:30:22.001 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00031478799999999998 2024-05-08T18:30:22.001 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.001 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.001 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:22.001 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.088025+0000", 2024-05-08T18:30:22.001 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00089402999999999998 2024-05-08T18:30:22.001 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.001 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.001 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:22.001 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.089123+0000", 2024-05-08T18:30:22.001 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001097598 2024-05-08T18:30:22.002 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.002 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.002 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:22.002 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.089200+0000", 2024-05-08T18:30:22.002 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7333e-05 2024-05-08T18:30:22.002 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.002 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.002 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:22.002 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.089264+0000", 2024-05-08T18:30:22.002 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.4035999999999995e-05 2024-05-08T18:30:22.002 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:22.002 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:22.002 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:22.002 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.002 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.003 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:751 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:22.003 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.125611+0000", 2024-05-08T18:30:22.003 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 29.825625698, 2024-05-08T18:30:22.003 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032716749999999999, 2024-05-08T18:30:22.003 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:22.003 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:22.003 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:22.003 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:22.003 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:22.003 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:22.003 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 751 2024-05-08T18:30:22.003 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.003 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:22.003 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.004 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:22.004 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125611+0000", 2024-05-08T18:30:22.004 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:22.004 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.004 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.004 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:22.004 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125611+0000", 2024-05-08T18:30:22.004 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:22.004 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.004 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.004 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:22.004 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125614+0000", 2024-05-08T18:30:22.004 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.12e-06 2024-05-08T18:30:22.004 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.005 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.005 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:22.005 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125624+0000", 2024-05-08T18:30:22.005 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0492999999999999e-05 2024-05-08T18:30:22.005 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.005 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.005 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:22.005 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125650+0000", 2024-05-08T18:30:22.005 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5907000000000001e-05 2024-05-08T18:30:22.005 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.005 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.005 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:22.005 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125667+0000", 2024-05-08T18:30:22.005 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.694e-05 2024-05-08T18:30:22.005 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.006 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.006 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:22.006 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125801+0000", 2024-05-08T18:30:22.006 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000134482 2024-05-08T18:30:22.006 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.006 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.006 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:22.006 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.126174+0000", 2024-05-08T18:30:22.006 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00037294999999999999 2024-05-08T18:30:22.006 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.006 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.006 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:22.007 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.126750+0000", 2024-05-08T18:30:22.007 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00057538900000000004 2024-05-08T18:30:22.007 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.007 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.007 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:22.007 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.127997+0000", 2024-05-08T18:30:22.007 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001247761 2024-05-08T18:30:22.007 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.007 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.007 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:22.007 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.128731+0000", 2024-05-08T18:30:22.007 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00073338099999999996 2024-05-08T18:30:22.007 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.007 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.007 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:22.008 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.128817+0000", 2024-05-08T18:30:22.008 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5993000000000002e-05 2024-05-08T18:30:22.008 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.008 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.008 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:22.008 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.128883+0000", 2024-05-08T18:30:22.008 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6259000000000004e-05 2024-05-08T18:30:22.008 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:22.008 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:22.008 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:22.008 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.008 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.008 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:753 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:22.008 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.129809+0000", 2024-05-08T18:30:22.009 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 29.82142816, 2024-05-08T18:30:22.009 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0033775440000000001, 2024-05-08T18:30:22.009 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:22.009 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:22.009 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:22.009 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:22.009 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:22.009 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:22.009 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 753 2024-05-08T18:30:22.009 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.009 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:22.009 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.009 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:22.010 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129809+0000", 2024-05-08T18:30:22.010 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:22.010 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.010 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.010 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:22.010 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129809+0000", 2024-05-08T18:30:22.010 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:22.010 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.010 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.010 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:22.010 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129811+0000", 2024-05-08T18:30:22.010 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1730000000000002e-06 2024-05-08T18:30:22.010 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.010 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.011 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:22.011 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129822+0000", 2024-05-08T18:30:22.011 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0583e-05 2024-05-08T18:30:22.011 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.011 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.011 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:22.011 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129852+0000", 2024-05-08T18:30:22.011 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0744000000000002e-05 2024-05-08T18:30:22.011 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.011 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.011 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:22.011 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129870+0000", 2024-05-08T18:30:22.011 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7955999999999999e-05 2024-05-08T18:30:22.011 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.012 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.012 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:22.012 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.130018+0000", 2024-05-08T18:30:22.012 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014747600000000001 2024-05-08T18:30:22.012 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.012 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.012 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:22.012 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.130259+0000", 2024-05-08T18:30:22.012 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024079099999999999 2024-05-08T18:30:22.012 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.012 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.012 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:22.012 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.130734+0000", 2024-05-08T18:30:22.012 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00047562 2024-05-08T18:30:22.013 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.013 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.013 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:22.013 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.131997+0000", 2024-05-08T18:30:22.013 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012626429999999999 2024-05-08T18:30:22.013 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.013 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.013 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:22.013 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.132923+0000", 2024-05-08T18:30:22.013 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00092627599999999997 2024-05-08T18:30:22.013 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.013 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.013 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:22.013 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.133076+0000", 2024-05-08T18:30:22.013 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000152989 2024-05-08T18:30:22.014 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.014 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.014 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:22.014 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.133187+0000", 2024-05-08T18:30:22.014 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000110293 2024-05-08T18:30:22.014 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:22.014 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:22.014 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:22.014 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.014 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.014 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:22.014 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.228247+0000", 2024-05-08T18:30:22.014 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 29.722990549999999, 2024-05-08T18:30:22.015 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032753449999999998, 2024-05-08T18:30:22.015 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:22.015 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:22.015 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:22.015 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:22.015 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:22.015 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:22.015 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 796 2024-05-08T18:30:22.015 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.015 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:22.015 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.015 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:22.015 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228247+0000", 2024-05-08T18:30:22.015 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:22.016 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.016 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.016 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:22.016 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228247+0000", 2024-05-08T18:30:22.016 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:22.016 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.016 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.016 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:22.016 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228249+0000", 2024-05-08T18:30:22.016 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3800000000000001e-06 2024-05-08T18:30:22.016 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.016 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.016 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:22.016 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228260+0000", 2024-05-08T18:30:22.017 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1496e-05 2024-05-08T18:30:22.017 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.017 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.017 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:22.017 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228292+0000", 2024-05-08T18:30:22.017 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1294000000000002e-05 2024-05-08T18:30:22.017 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.017 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.017 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:22.017 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228306+0000", 2024-05-08T18:30:22.017 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4606e-05 2024-05-08T18:30:22.017 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.017 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.017 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:22.018 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228443+0000", 2024-05-08T18:30:22.018 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013672599999999999 2024-05-08T18:30:22.018 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.018 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.018 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:22.018 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228813+0000", 2024-05-08T18:30:22.018 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00036987000000000001 2024-05-08T18:30:22.018 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.018 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.018 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:22.018 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.229365+0000", 2024-05-08T18:30:22.018 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00055210600000000002 2024-05-08T18:30:22.018 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.019 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.019 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:22.019 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.230800+0000", 2024-05-08T18:30:22.019 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001435006 2024-05-08T18:30:22.019 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.019 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.019 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:22.019 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.231369+0000", 2024-05-08T18:30:22.019 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00056848499999999998 2024-05-08T18:30:22.019 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.019 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.019 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:22.019 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.231455+0000", 2024-05-08T18:30:22.019 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6905999999999998e-05 2024-05-08T18:30:22.020 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.020 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.020 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:22.020 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.231522+0000", 2024-05-08T18:30:22.020 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6470000000000006e-05 2024-05-08T18:30:22.020 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:22.020 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:22.020 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:22.020 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.020 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.020 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:798 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:22.020 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.232573+0000", 2024-05-08T18:30:22.020 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 29.718664443000002, 2024-05-08T18:30:22.020 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0030406690000000002, 2024-05-08T18:30:22.021 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:22.021 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:22.021 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:22.021 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:22.021 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:22.021 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:22.021 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 798 2024-05-08T18:30:22.021 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.021 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:22.021 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.021 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:22.021 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232573+0000", 2024-05-08T18:30:22.021 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:22.021 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.022 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.022 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:22.022 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232573+0000", 2024-05-08T18:30:22.022 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:22.022 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.022 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.022 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:22.022 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232574+0000", 2024-05-08T18:30:22.022 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.446e-06 2024-05-08T18:30:22.022 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.022 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.022 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:22.022 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232581+0000", 2024-05-08T18:30:22.022 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.0670000000000003e-06 2024-05-08T18:30:22.023 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.023 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.023 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:22.023 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232600+0000", 2024-05-08T18:30:22.023 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8822999999999999e-05 2024-05-08T18:30:22.023 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.023 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.023 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:22.023 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232611+0000", 2024-05-08T18:30:22.023 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1233000000000001e-05 2024-05-08T18:30:22.023 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.023 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.023 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:22.023 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232731+0000", 2024-05-08T18:30:22.024 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000120189 2024-05-08T18:30:22.024 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.024 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.024 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:22.024 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232963+0000", 2024-05-08T18:30:22.024 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023111900000000001 2024-05-08T18:30:22.024 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.024 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.024 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:22.024 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.233441+0000", 2024-05-08T18:30:22.024 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00047866899999999998 2024-05-08T18:30:22.024 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.024 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.024 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:22.024 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.234542+0000", 2024-05-08T18:30:22.025 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001101245 2024-05-08T18:30:22.025 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.025 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.025 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:22.025 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.235349+0000", 2024-05-08T18:30:22.025 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000806567 2024-05-08T18:30:22.025 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.025 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.025 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:22.025 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.235498+0000", 2024-05-08T18:30:22.025 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014907200000000001 2024-05-08T18:30:22.025 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.025 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.025 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:22.025 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.235613+0000", 2024-05-08T18:30:22.026 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115239 2024-05-08T18:30:22.026 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:22.026 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:22.026 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:22.026 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.026 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.026 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:22.026 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.248596+0000", 2024-05-08T18:30:22.026 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 29.702640637000002, 2024-05-08T18:30:22.026 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002919984, 2024-05-08T18:30:22.026 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:22.026 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:22.026 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:22.026 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:22.027 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:22.027 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:22.027 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 805 2024-05-08T18:30:22.027 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.027 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:22.027 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.027 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:22.027 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248596+0000", 2024-05-08T18:30:22.027 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:22.027 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.027 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.027 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:22.027 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248596+0000", 2024-05-08T18:30:22.027 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:22.027 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.028 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.028 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:22.028 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248599+0000", 2024-05-08T18:30:22.028 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3630000000000001e-06 2024-05-08T18:30:22.028 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.028 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.028 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:22.028 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248610+0000", 2024-05-08T18:30:22.028 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1267000000000001e-05 2024-05-08T18:30:22.028 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.028 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.028 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:22.028 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248641+0000", 2024-05-08T18:30:22.028 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1309999999999997e-05 2024-05-08T18:30:22.029 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.029 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.029 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:22.029 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248656+0000", 2024-05-08T18:30:22.029 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4449e-05 2024-05-08T18:30:22.029 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.029 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.029 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:22.029 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248781+0000", 2024-05-08T18:30:22.029 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012500900000000001 2024-05-08T18:30:22.029 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.029 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.029 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:22.029 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.249001+0000", 2024-05-08T18:30:22.030 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021963500000000001 2024-05-08T18:30:22.030 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.030 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.030 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:22.030 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.249341+0000", 2024-05-08T18:30:22.030 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00034004100000000002 2024-05-08T18:30:22.030 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.030 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.030 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:22.030 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.250473+0000", 2024-05-08T18:30:22.030 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0011324180000000001 2024-05-08T18:30:22.030 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.030 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.030 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:22.031 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.251230+0000", 2024-05-08T18:30:22.031 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00075751400000000004 2024-05-08T18:30:22.031 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.031 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.031 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:22.031 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.251394+0000", 2024-05-08T18:30:22.031 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016379200000000001 2024-05-08T18:30:22.031 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.031 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.031 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:22.031 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.251516+0000", 2024-05-08T18:30:22.031 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012218600000000001 2024-05-08T18:30:22.031 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:22.031 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:22.032 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:22.032 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.032 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.032 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:22.032 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.313184+0000", 2024-05-08T18:30:22.032 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 29.638052962, 2024-05-08T18:30:22.032 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003040016, 2024-05-08T18:30:22.032 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:22.032 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:22.032 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:22.032 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:22.032 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:22.032 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:22.032 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 832 2024-05-08T18:30:22.033 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.033 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:22.033 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.033 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:22.033 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313184+0000", 2024-05-08T18:30:22.033 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:22.033 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.033 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.033 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:22.033 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313184+0000", 2024-05-08T18:30:22.033 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:22.033 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.033 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.033 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:22.034 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313187+0000", 2024-05-08T18:30:22.034 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5100000000000001e-06 2024-05-08T18:30:22.034 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.034 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.034 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:22.034 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313199+0000", 2024-05-08T18:30:22.034 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.201e-05 2024-05-08T18:30:22.034 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.034 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.034 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:22.034 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313229+0000", 2024-05-08T18:30:22.034 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9839e-05 2024-05-08T18:30:22.034 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.035 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.035 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:22.035 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313243+0000", 2024-05-08T18:30:22.035 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4727e-05 2024-05-08T18:30:22.035 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.035 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.035 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:22.035 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313358+0000", 2024-05-08T18:30:22.035 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115016 2024-05-08T18:30:22.035 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.035 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.035 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:22.035 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313577+0000", 2024-05-08T18:30:22.035 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021897799999999999 2024-05-08T18:30:22.035 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.036 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.036 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:22.036 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313889+0000", 2024-05-08T18:30:22.036 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00031210400000000001 2024-05-08T18:30:22.036 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.036 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.036 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:22.036 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.315229+0000", 2024-05-08T18:30:22.036 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001339963 2024-05-08T18:30:22.036 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.036 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.036 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:22.036 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.315938+0000", 2024-05-08T18:30:22.037 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00070853400000000003 2024-05-08T18:30:22.037 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.037 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.037 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:22.037 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.316111+0000", 2024-05-08T18:30:22.037 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000173396 2024-05-08T18:30:22.037 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.037 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.037 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:22.037 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.316224+0000", 2024-05-08T18:30:22.037 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000112939 2024-05-08T18:30:22.037 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:22.037 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:22.037 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:22.038 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.038 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.038 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:834 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:22.038 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.317499+0000", 2024-05-08T18:30:22.038 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 29.633738163, 2024-05-08T18:30:22.038 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0033281109999999999, 2024-05-08T18:30:22.038 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:22.038 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:22.038 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:22.038 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:22.038 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:22.038 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:22.038 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 834 2024-05-08T18:30:22.038 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.039 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:22.039 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.039 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:22.039 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317499+0000", 2024-05-08T18:30:22.039 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:22.039 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.039 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.039 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:22.039 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317499+0000", 2024-05-08T18:30:22.039 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:22.039 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.039 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.039 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:22.040 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317501+0000", 2024-05-08T18:30:22.040 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9400000000000001e-06 2024-05-08T18:30:22.040 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.040 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.040 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:22.040 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317511+0000", 2024-05-08T18:30:22.040 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0297e-05 2024-05-08T18:30:22.040 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.040 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.040 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:22.040 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317532+0000", 2024-05-08T18:30:22.040 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1013e-05 2024-05-08T18:30:22.040 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.040 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.041 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:22.041 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317543+0000", 2024-05-08T18:30:22.041 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0757000000000001e-05 2024-05-08T18:30:22.041 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.041 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.041 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:22.041 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317658+0000", 2024-05-08T18:30:22.041 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115129 2024-05-08T18:30:22.041 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.041 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.041 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:22.041 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317887+0000", 2024-05-08T18:30:22.041 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00022880099999999999 2024-05-08T18:30:22.041 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.042 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.042 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:22.042 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.318378+0000", 2024-05-08T18:30:22.042 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00049129000000000002 2024-05-08T18:30:22.042 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.042 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.042 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:22.042 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.319597+0000", 2024-05-08T18:30:22.042 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012188469999999999 2024-05-08T18:30:22.042 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.042 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.042 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:22.042 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.320566+0000", 2024-05-08T18:30:22.042 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00096881599999999995 2024-05-08T18:30:22.043 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.043 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.043 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:22.043 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.320713+0000", 2024-05-08T18:30:22.043 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014691500000000001 2024-05-08T18:30:22.043 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.043 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.043 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:22.043 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.320827+0000", 2024-05-08T18:30:22.043 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000114306 2024-05-08T18:30:22.043 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:22.043 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:22.043 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:22.044 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.044 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.044 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:22.044 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.505569+0000", 2024-05-08T18:30:22.044 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 29.445667709999999, 2024-05-08T18:30:22.044 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028584309999999998, 2024-05-08T18:30:22.044 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:22.044 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:22.044 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:22.044 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:22.044 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:22.044 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:22.044 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 916 2024-05-08T18:30:22.044 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.045 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:22.045 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.045 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:22.045 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505569+0000", 2024-05-08T18:30:22.045 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:22.045 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.045 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.045 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:22.045 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505569+0000", 2024-05-08T18:30:22.045 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:22.045 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.045 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.045 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:22.045 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505572+0000", 2024-05-08T18:30:22.046 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3659999999999999e-06 2024-05-08T18:30:22.046 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.046 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.046 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:22.046 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505583+0000", 2024-05-08T18:30:22.046 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1574e-05 2024-05-08T18:30:22.046 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.046 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.046 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:22.046 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505614+0000", 2024-05-08T18:30:22.046 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0670000000000003e-05 2024-05-08T18:30:22.046 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.046 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.047 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:22.047 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505629+0000", 2024-05-08T18:30:22.047 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5063e-05 2024-05-08T18:30:22.047 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.047 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.047 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:22.047 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505754+0000", 2024-05-08T18:30:22.047 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012508899999999999 2024-05-08T18:30:22.047 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.047 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.047 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:22.047 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505988+0000", 2024-05-08T18:30:22.047 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023334699999999999 2024-05-08T18:30:22.047 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.048 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.048 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:22.048 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.506299+0000", 2024-05-08T18:30:22.048 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000311811 2024-05-08T18:30:22.048 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.048 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.048 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:22.048 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.507489+0000", 2024-05-08T18:30:22.048 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0011899510000000001 2024-05-08T18:30:22.048 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.048 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.048 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:22.048 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.508141+0000", 2024-05-08T18:30:22.048 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00065180200000000005 2024-05-08T18:30:22.049 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.049 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.049 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:22.049 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.508306+0000", 2024-05-08T18:30:22.049 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016450199999999999 2024-05-08T18:30:22.049 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.049 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.049 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:22.049 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.508428+0000", 2024-05-08T18:30:22.049 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000122256 2024-05-08T18:30:22.049 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:22.049 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:22.049 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:22.049 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.050 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.050 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:918 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:22.050 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.509337+0000", 2024-05-08T18:30:22.050 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 29.441899642999999, 2024-05-08T18:30:22.050 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002971787, 2024-05-08T18:30:22.050 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:22.050 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:22.050 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:22.050 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:22.050 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:22.050 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:22.050 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 918 2024-05-08T18:30:22.050 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.050 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:22.051 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.051 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:22.051 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509337+0000", 2024-05-08T18:30:22.051 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:22.051 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.051 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.051 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:22.051 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509337+0000", 2024-05-08T18:30:22.051 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:22.051 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.051 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.051 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:22.051 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509340+0000", 2024-05-08T18:30:22.051 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2570000000000002e-06 2024-05-08T18:30:22.051 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.052 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.052 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:22.052 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509351+0000", 2024-05-08T18:30:22.052 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0933e-05 2024-05-08T18:30:22.052 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.052 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.052 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:22.052 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509382+0000", 2024-05-08T18:30:22.052 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1198999999999997e-05 2024-05-08T18:30:22.052 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.052 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.052 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:22.052 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509400+0000", 2024-05-08T18:30:22.052 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8236999999999998e-05 2024-05-08T18:30:22.053 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.053 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.053 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:22.053 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509529+0000", 2024-05-08T18:30:22.053 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012905600000000001 2024-05-08T18:30:22.053 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.053 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.053 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:22.053 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509777+0000", 2024-05-08T18:30:22.053 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024786799999999999 2024-05-08T18:30:22.053 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.053 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.053 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:22.053 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.510284+0000", 2024-05-08T18:30:22.054 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000506796 2024-05-08T18:30:22.054 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.054 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.054 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:22.054 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.511453+0000", 2024-05-08T18:30:22.054 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001169575 2024-05-08T18:30:22.054 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.054 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.054 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:22.054 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.512051+0000", 2024-05-08T18:30:22.054 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00059743100000000005 2024-05-08T18:30:22.054 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.054 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.055 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:22.055 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.512199+0000", 2024-05-08T18:30:22.055 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000148486 2024-05-08T18:30:22.055 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.055 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.055 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:22.055 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.512309+0000", 2024-05-08T18:30:22.055 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000109949 2024-05-08T18:30:22.055 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:22.055 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:22.055 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:22.055 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.055 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.056 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:931 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:22.056 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.543277+0000", 2024-05-08T18:30:22.056 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 29.407960488000001, 2024-05-08T18:30:22.056 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028250710000000002, 2024-05-08T18:30:22.056 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:22.056 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:22.056 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:22.056 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:22.056 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:22.056 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:22.056 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 931 2024-05-08T18:30:22.056 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.056 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:22.056 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.057 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:22.057 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543277+0000", 2024-05-08T18:30:22.057 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:22.057 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.057 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.057 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:22.057 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543277+0000", 2024-05-08T18:30:22.057 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:22.057 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.057 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.057 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:22.057 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543279+0000", 2024-05-08T18:30:22.057 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.373e-06 2024-05-08T18:30:22.057 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.057 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.058 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:22.058 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543291+0000", 2024-05-08T18:30:22.058 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1517e-05 2024-05-08T18:30:22.058 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.058 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.058 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:22.058 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543323+0000", 2024-05-08T18:30:22.058 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2292000000000002e-05 2024-05-08T18:30:22.058 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.058 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.058 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:22.058 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543340+0000", 2024-05-08T18:30:22.058 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.749e-05 2024-05-08T18:30:22.059 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.059 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.059 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:22.059 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543462+0000", 2024-05-08T18:30:22.059 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000121413 2024-05-08T18:30:22.059 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.059 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.059 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:22.059 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543681+0000", 2024-05-08T18:30:22.059 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021974200000000001 2024-05-08T18:30:22.059 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.059 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.059 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:22.059 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.544004+0000", 2024-05-08T18:30:22.060 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00032268900000000003 2024-05-08T18:30:22.060 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.060 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.060 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:22.060 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.545158+0000", 2024-05-08T18:30:22.060 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0011540190000000001 2024-05-08T18:30:22.060 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.060 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.060 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:22.060 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.545970+0000", 2024-05-08T18:30:22.060 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00081224300000000004 2024-05-08T18:30:22.060 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.060 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.060 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:22.061 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.546043+0000", 2024-05-08T18:30:22.061 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.3067999999999999e-05 2024-05-08T18:30:22.061 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.061 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.061 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:22.061 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.546102+0000", 2024-05-08T18:30:22.061 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8224999999999999e-05 2024-05-08T18:30:22.061 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:22.061 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:22.061 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:22.061 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.061 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.061 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:22.061 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.578568+0000", 2024-05-08T18:30:22.061 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 29.372669581, 2024-05-08T18:30:22.062 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0030345839999999999, 2024-05-08T18:30:22.062 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:22.062 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:22.062 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:22.062 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:22.062 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:22.062 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:22.062 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 946 2024-05-08T18:30:22.062 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.062 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:22.062 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.062 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:22.062 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578568+0000", 2024-05-08T18:30:22.062 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:22.063 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.063 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.063 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:22.063 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578568+0000", 2024-05-08T18:30:22.063 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:22.063 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.063 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.063 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:22.063 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578570+0000", 2024-05-08T18:30:22.063 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3700000000000002e-06 2024-05-08T18:30:22.063 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.063 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.063 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:22.064 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578582+0000", 2024-05-08T18:30:22.064 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1627000000000001e-05 2024-05-08T18:30:22.064 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.064 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.064 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:22.064 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578612+0000", 2024-05-08T18:30:22.064 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0103e-05 2024-05-08T18:30:22.064 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.064 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.064 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:22.064 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578627+0000", 2024-05-08T18:30:22.064 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4949999999999999e-05 2024-05-08T18:30:22.064 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.064 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.065 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:22.065 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578750+0000", 2024-05-08T18:30:22.065 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012309899999999999 2024-05-08T18:30:22.065 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.065 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.065 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:22.065 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.579042+0000", 2024-05-08T18:30:22.065 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00029212500000000001 2024-05-08T18:30:22.065 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.065 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.065 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:22.065 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.579557+0000", 2024-05-08T18:30:22.065 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00051536900000000001 2024-05-08T18:30:22.065 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.065 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.066 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:22.066 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.580698+0000", 2024-05-08T18:30:22.066 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001140774 2024-05-08T18:30:22.066 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.066 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.066 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:22.066 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.581367+0000", 2024-05-08T18:30:22.066 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00066884799999999999 2024-05-08T18:30:22.066 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.066 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.066 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:22.066 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.581489+0000", 2024-05-08T18:30:22.066 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012265600000000001 2024-05-08T18:30:22.066 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.067 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.067 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:22.067 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.581602+0000", 2024-05-08T18:30:22.067 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000112663 2024-05-08T18:30:22.067 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:22.067 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:22.067 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:22.067 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:22.067 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:22.067 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:30:22.069 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-08T18:30:22.069 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:30:22.067+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:30:22.170 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:30:22.173+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:30:22.196 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:30:22.196 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:30:22.196 INFO:teuthology.orchestra.run.smithi097.stdout: "num_ops": 0 2024-05-08T18:30:22.196 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:30:22.212 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-08T18:30:22.298 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:30:22.301+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:30:22.371 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:30:22.371+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:30:22.377 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:30:22.377 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:30:22.377 INFO:teuthology.orchestra.run.smithi097.stdout: "complaint_time": 30, 2024-05-08T18:30:22.377 INFO:teuthology.orchestra.run.smithi097.stdout: "num_blocked_ops": 0 2024-05-08T18:30:22.377 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:30:22.391 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-08T18:30:22.472 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:30:22.471+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:30:22.564 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:30:22.565 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2024-05-08T18:30:22.565 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2024-05-08T18:30:22.565 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-05-08T18:30:22.565 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.565 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4479.0:40 5.b 5:d797044f:::zonegroup_info.ea3b680f-900d-4805-81ec-055811625780:head [create,call version.set in=10b,writefull 0~436] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-05-08T18:30:22.565 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:44.637551+0000", 2024-05-08T18:30:22.565 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 37.926481107000001, 2024-05-08T18:30:22.565 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003054013, 2024-05-08T18:30:22.565 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:22.565 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:22.565 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:22.565 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:22.565 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4479", 2024-05-08T18:30:22.566 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3577501689", 2024-05-08T18:30:22.566 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 40 2024-05-08T18:30:22.566 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.566 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:22.566 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.566 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:22.566 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.637551+0000", 2024-05-08T18:30:22.566 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:22.566 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.566 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.566 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:22.566 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.637551+0000", 2024-05-08T18:30:22.566 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:22.567 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.567 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.567 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:22.567 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.637554+0000", 2024-05-08T18:30:22.567 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6599999999999999e-06 2024-05-08T18:30:22.567 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.567 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.567 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:22.567 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.637576+0000", 2024-05-08T18:30:22.567 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1965999999999999e-05 2024-05-08T18:30:22.567 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.567 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.567 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:22.567 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.637603+0000", 2024-05-08T18:30:22.568 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7257e-05 2024-05-08T18:30:22.568 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.568 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.568 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:22.568 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.637623+0000", 2024-05-08T18:30:22.568 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9570000000000001e-05 2024-05-08T18:30:22.568 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.568 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.568 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:22.568 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.637766+0000", 2024-05-08T18:30:22.568 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000143435 2024-05-08T18:30:22.568 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.568 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.569 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:22.569 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.638167+0000", 2024-05-08T18:30:22.569 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00040082399999999998 2024-05-08T18:30:22.569 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.569 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.569 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:22.569 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.638627+0000", 2024-05-08T18:30:22.569 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00046019300000000002 2024-05-08T18:30:22.569 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.569 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.569 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:22.569 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.640399+0000", 2024-05-08T18:30:22.569 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0017714199999999999 2024-05-08T18:30:22.570 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.570 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.570 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:22.570 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.640447+0000", 2024-05-08T18:30:22.570 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8383000000000001e-05 2024-05-08T18:30:22.570 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.570 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.570 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:22.570 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.640534+0000", 2024-05-08T18:30:22.570 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7078999999999998e-05 2024-05-08T18:30:22.570 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.570 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.570 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:22.571 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.640606+0000", 2024-05-08T18:30:22.571 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1225999999999999e-05 2024-05-08T18:30:22.571 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:22.571 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:22.571 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:22.571 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.571 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.571 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4479.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-05-08T18:30:22.571 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:44.643918+0000", 2024-05-08T18:30:22.571 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 37.920114832000003, 2024-05-08T18:30:22.571 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002986004, 2024-05-08T18:30:22.571 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:22.571 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:22.571 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:22.572 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:22.572 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4479", 2024-05-08T18:30:22.572 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3577501689", 2024-05-08T18:30:22.572 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 42 2024-05-08T18:30:22.572 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.572 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:22.572 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.572 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:22.572 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.643918+0000", 2024-05-08T18:30:22.572 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:22.572 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.572 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.572 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:22.572 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.643918+0000", 2024-05-08T18:30:22.573 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:22.573 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.573 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.573 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:22.573 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.643919+0000", 2024-05-08T18:30:22.573 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4729999999999999e-06 2024-05-08T18:30:22.573 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.573 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.573 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:22.573 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.643927+0000", 2024-05-08T18:30:22.573 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6389999999999992e-06 2024-05-08T18:30:22.573 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.573 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.573 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:22.573 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.643945+0000", 2024-05-08T18:30:22.574 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8195000000000001e-05 2024-05-08T18:30:22.574 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.574 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.574 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:22.574 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.643954+0000", 2024-05-08T18:30:22.574 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5210000000000002e-06 2024-05-08T18:30:22.574 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.574 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.574 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:22.574 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.644123+0000", 2024-05-08T18:30:22.574 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016904999999999999 2024-05-08T18:30:22.574 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.574 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.574 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:22.575 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.644315+0000", 2024-05-08T18:30:22.575 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00019202800000000001 2024-05-08T18:30:22.575 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.575 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.575 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:22.575 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.644505+0000", 2024-05-08T18:30:22.575 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000190552 2024-05-08T18:30:22.575 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.575 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.575 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:22.575 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.645877+0000", 2024-05-08T18:30:22.575 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001371702 2024-05-08T18:30:22.575 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.575 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.576 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:22.576 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.646778+0000", 2024-05-08T18:30:22.576 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00090065700000000002 2024-05-08T18:30:22.576 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.576 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.576 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:22.576 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.646843+0000", 2024-05-08T18:30:22.576 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5504000000000002e-05 2024-05-08T18:30:22.576 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.576 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.576 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:22.576 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.646904+0000", 2024-05-08T18:30:22.576 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0683000000000002e-05 2024-05-08T18:30:22.576 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:22.576 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:22.577 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:22.577 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.577 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.577 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:57 7.3 e30/29 7:c609908c:::notify.5:head v 30'2, mlcod=0'0)", 2024-05-08T18:30:22.577 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:48.669376+0000", 2024-05-08T18:30:22.577 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 33.894656724000001, 2024-05-08T18:30:22.577 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0041509479999999998, 2024-05-08T18:30:22.577 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:22.577 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:22.577 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:22.577 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:22.577 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.577 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:22.577 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669376+0000", 2024-05-08T18:30:22.578 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:22.578 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.578 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.578 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:22.578 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669376+0000", 2024-05-08T18:30:22.578 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:22.578 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.578 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.578 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:22.578 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669378+0000", 2024-05-08T18:30:22.578 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.79e-06 2024-05-08T18:30:22.578 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.578 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.578 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:22.579 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669393+0000", 2024-05-08T18:30:22.579 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5053e-05 2024-05-08T18:30:22.579 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.579 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.579 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:22.579 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669427+0000", 2024-05-08T18:30:22.579 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4326999999999998e-05 2024-05-08T18:30:22.579 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.579 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.579 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:22.579 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669451+0000", 2024-05-08T18:30:22.580 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3629e-05 2024-05-08T18:30:22.580 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.580 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.580 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:22.580 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669563+0000", 2024-05-08T18:30:22.581 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011251099999999999 2024-05-08T18:30:22.581 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.581 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.581 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:22.581 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669607+0000", 2024-05-08T18:30:22.581 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3877e-05 2024-05-08T18:30:22.581 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.581 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.581 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:22.581 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.673401+0000", 2024-05-08T18:30:22.581 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0037942819999999999 2024-05-08T18:30:22.581 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.581 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.581 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:22.582 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.673527+0000", 2024-05-08T18:30:22.582 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012547900000000001 2024-05-08T18:30:22.582 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:22.582 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:22.582 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:22.582 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.582 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.582 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:58 7.14 e30/29 7:2b04a3e9:::notify.6:head v 30'1, mlcod=0'0)", 2024-05-08T18:30:22.582 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:48.669496+0000", 2024-05-08T18:30:22.582 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 33.894536352000003, 2024-05-08T18:30:22.582 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0046805609999999997, 2024-05-08T18:30:22.582 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:22.582 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:22.583 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:22.583 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:22.583 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.583 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:22.583 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669496+0000", 2024-05-08T18:30:22.583 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:22.583 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.583 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.583 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:22.583 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669496+0000", 2024-05-08T18:30:22.583 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:22.583 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.584 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.584 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:22.584 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669497+0000", 2024-05-08T18:30:22.584 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0100000000000001e-06 2024-05-08T18:30:22.584 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.584 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.584 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:22.584 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669507+0000", 2024-05-08T18:30:22.584 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.7540000000000001e-06 2024-05-08T18:30:22.584 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.584 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.584 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:22.584 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669528+0000", 2024-05-08T18:30:22.585 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.05e-05 2024-05-08T18:30:22.585 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.585 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.585 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:22.585 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669544+0000", 2024-05-08T18:30:22.585 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6716000000000001e-05 2024-05-08T18:30:22.585 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.585 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.585 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:22.585 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669667+0000", 2024-05-08T18:30:22.585 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012275799999999999 2024-05-08T18:30:22.585 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.585 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.585 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:22.586 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669706+0000", 2024-05-08T18:30:22.586 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8764999999999999e-05 2024-05-08T18:30:22.586 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.586 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.586 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:22.586 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674100+0000", 2024-05-08T18:30:22.586 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.004394528 2024-05-08T18:30:22.586 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.586 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.586 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:22.586 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674177+0000", 2024-05-08T18:30:22.586 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6530000000000001e-05 2024-05-08T18:30:22.586 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:22.586 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:22.587 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:22.587 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.587 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.587 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:22.587 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.794231+0000", 2024-05-08T18:30:22.587 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 30.769801960999999, 2024-05-08T18:30:22.587 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031872810000000001, 2024-05-08T18:30:22.587 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:22.587 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:22.587 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:22.587 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:22.587 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:22.587 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:22.587 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 236 2024-05-08T18:30:22.587 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.588 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:22.588 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.588 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:22.588 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794231+0000", 2024-05-08T18:30:22.588 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:22.588 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.588 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.588 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:22.588 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794231+0000", 2024-05-08T18:30:22.588 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:22.588 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.588 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.589 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:22.589 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794234+0000", 2024-05-08T18:30:22.589 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.36e-06 2024-05-08T18:30:22.589 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.589 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.589 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:22.589 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794248+0000", 2024-05-08T18:30:22.589 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4372999999999999e-05 2024-05-08T18:30:22.589 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.589 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.589 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:22.589 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794279+0000", 2024-05-08T18:30:22.589 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1075999999999999e-05 2024-05-08T18:30:22.589 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.590 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.590 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:22.590 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794295+0000", 2024-05-08T18:30:22.590 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5386000000000001e-05 2024-05-08T18:30:22.590 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.590 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.590 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:22.590 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794416+0000", 2024-05-08T18:30:22.590 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012071899999999999 2024-05-08T18:30:22.590 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.590 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.590 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:22.590 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794638+0000", 2024-05-08T18:30:22.591 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00022262599999999999 2024-05-08T18:30:22.591 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.591 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.591 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:22.591 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.795061+0000", 2024-05-08T18:30:22.591 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00042248900000000001 2024-05-08T18:30:22.591 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.591 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.591 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:22.591 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.796477+0000", 2024-05-08T18:30:22.591 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0014162230000000001 2024-05-08T18:30:22.591 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.591 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.591 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:22.592 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.797258+0000", 2024-05-08T18:30:22.592 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00078159400000000004 2024-05-08T18:30:22.592 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.592 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.592 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:22.592 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.797349+0000", 2024-05-08T18:30:22.592 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0462000000000002e-05 2024-05-08T18:30:22.592 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.592 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.592 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:22.592 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.797418+0000", 2024-05-08T18:30:22.592 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8973000000000005e-05 2024-05-08T18:30:22.592 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:22.593 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:22.593 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:22.593 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.593 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.593 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:281 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:22.593 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.806063+0000", 2024-05-08T18:30:22.593 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 30.757969827, 2024-05-08T18:30:22.593 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002923761, 2024-05-08T18:30:22.593 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:22.593 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:22.593 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:22.593 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:22.593 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:22.594 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:22.594 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 281 2024-05-08T18:30:22.594 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.594 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:22.594 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.594 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:22.594 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.806063+0000", 2024-05-08T18:30:22.594 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:22.594 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.594 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.594 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:22.594 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.806063+0000", 2024-05-08T18:30:22.594 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:22.595 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.595 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.595 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:22.595 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.806064+0000", 2024-05-08T18:30:22.595 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.204e-06 2024-05-08T18:30:22.595 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.595 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.595 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:22.595 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.806073+0000", 2024-05-08T18:30:22.595 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5609999999999999e-06 2024-05-08T18:30:22.595 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.595 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.595 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:22.596 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.806089+0000", 2024-05-08T18:30:22.596 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6673000000000001e-05 2024-05-08T18:30:22.596 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.596 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.596 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:22.596 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.806098+0000", 2024-05-08T18:30:22.596 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8899999999999996e-06 2024-05-08T18:30:22.596 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.596 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.596 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:22.596 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.806165+0000", 2024-05-08T18:30:22.596 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6927999999999993e-05 2024-05-08T18:30:22.596 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.596 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.597 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:22.597 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.806298+0000", 2024-05-08T18:30:22.597 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000132886 2024-05-08T18:30:22.597 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.597 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.597 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:22.597 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.806453+0000", 2024-05-08T18:30:22.597 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000155339 2024-05-08T18:30:22.597 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.597 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.597 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:22.597 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.807157+0000", 2024-05-08T18:30:22.597 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00070363900000000004 2024-05-08T18:30:22.597 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.598 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.598 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:22.598 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.808880+0000", 2024-05-08T18:30:22.598 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0017227130000000001 2024-05-08T18:30:22.598 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.598 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.598 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:22.598 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.808938+0000", 2024-05-08T18:30:22.598 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8814999999999998e-05 2024-05-08T18:30:22.598 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.598 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.598 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:22.598 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.808987+0000", 2024-05-08T18:30:22.599 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8112999999999998e-05 2024-05-08T18:30:22.599 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:22.599 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:22.599 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:22.599 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.599 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.599 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:304 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:22.599 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.809645+0000", 2024-05-08T18:30:22.599 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 30.754387989000001, 2024-05-08T18:30:22.599 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031633579999999998, 2024-05-08T18:30:22.599 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:22.599 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:22.600 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:22.600 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:22.600 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:22.600 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:22.600 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 304 2024-05-08T18:30:22.600 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.600 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:22.600 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.600 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:22.600 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809645+0000", 2024-05-08T18:30:22.600 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:22.600 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.600 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.601 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:22.601 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809645+0000", 2024-05-08T18:30:22.601 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:22.601 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.601 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.601 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:22.601 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809646+0000", 2024-05-08T18:30:22.601 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.113e-06 2024-05-08T18:30:22.601 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.601 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.601 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:22.601 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809652+0000", 2024-05-08T18:30:22.601 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1650000000000003e-06 2024-05-08T18:30:22.602 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.602 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.602 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:22.602 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809668+0000", 2024-05-08T18:30:22.602 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6025e-05 2024-05-08T18:30:22.602 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.602 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.602 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:22.602 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809678+0000", 2024-05-08T18:30:22.602 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0456e-05 2024-05-08T18:30:22.602 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.602 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.602 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:22.603 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809745+0000", 2024-05-08T18:30:22.603 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7088000000000005e-05 2024-05-08T18:30:22.603 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.603 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.603 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:22.603 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809803+0000", 2024-05-08T18:30:22.603 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7405999999999999e-05 2024-05-08T18:30:22.603 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.603 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.603 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:22.603 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809951+0000", 2024-05-08T18:30:22.603 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014775500000000001 2024-05-08T18:30:22.603 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.603 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.604 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:22.604 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.810564+0000", 2024-05-08T18:30:22.604 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00061324899999999996 2024-05-08T18:30:22.604 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.604 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.604 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:22.604 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.812744+0000", 2024-05-08T18:30:22.604 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0021804509999999999 2024-05-08T18:30:22.604 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.604 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.604 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:22.604 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.812781+0000", 2024-05-08T18:30:22.605 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6554999999999998e-05 2024-05-08T18:30:22.605 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.605 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.605 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:22.605 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.812808+0000", 2024-05-08T18:30:22.605 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7095000000000001e-05 2024-05-08T18:30:22.605 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:22.605 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:22.605 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:22.605 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.605 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.605 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:22.605 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.105553+0000", 2024-05-08T18:30:22.606 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 30.458479978, 2024-05-08T18:30:22.606 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028754850000000001, 2024-05-08T18:30:22.606 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:22.606 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:22.606 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:22.606 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:22.606 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:22.606 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:22.606 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 742 2024-05-08T18:30:22.606 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.606 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:22.606 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.607 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:22.607 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.105553+0000", 2024-05-08T18:30:22.607 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:22.607 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.607 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.607 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:22.607 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.105553+0000", 2024-05-08T18:30:22.607 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:22.607 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.607 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.607 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:22.607 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.105556+0000", 2024-05-08T18:30:22.607 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3100000000000001e-06 2024-05-08T18:30:22.608 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.608 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.608 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:22.608 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.105569+0000", 2024-05-08T18:30:22.608 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2754e-05 2024-05-08T18:30:22.608 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.608 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.608 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:22.608 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.105601+0000", 2024-05-08T18:30:22.608 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2435999999999999e-05 2024-05-08T18:30:22.608 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.608 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.609 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:22.609 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.105616+0000", 2024-05-08T18:30:22.609 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4657e-05 2024-05-08T18:30:22.609 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.609 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.609 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:22.609 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.105804+0000", 2024-05-08T18:30:22.609 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00018861799999999999 2024-05-08T18:30:22.609 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.609 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.609 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:22.609 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.106054+0000", 2024-05-08T18:30:22.609 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024948499999999997 2024-05-08T18:30:22.609 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.610 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.610 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:22.610 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.106390+0000", 2024-05-08T18:30:22.610 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00033640100000000001 2024-05-08T18:30:22.610 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.610 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.610 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:22.610 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.107527+0000", 2024-05-08T18:30:22.610 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001136871 2024-05-08T18:30:22.610 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.610 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.610 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:22.610 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.108265+0000", 2024-05-08T18:30:22.611 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00073753100000000004 2024-05-08T18:30:22.611 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.611 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.611 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:22.611 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.108353+0000", 2024-05-08T18:30:22.611 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8232999999999994e-05 2024-05-08T18:30:22.611 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.611 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.611 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:22.611 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.108428+0000", 2024-05-08T18:30:22.611 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.5189000000000001e-05 2024-05-08T18:30:22.611 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:22.611 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:22.612 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:22.612 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.612 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.612 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:22.612 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.148015+0000", 2024-05-08T18:30:22.612 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 30.416018035, 2024-05-08T18:30:22.612 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032297409999999999, 2024-05-08T18:30:22.612 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:22.612 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:22.612 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:22.612 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:22.612 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:22.612 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:22.613 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 760 2024-05-08T18:30:22.613 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.613 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:22.613 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.613 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:22.613 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.148015+0000", 2024-05-08T18:30:22.613 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:22.613 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.613 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.613 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:22.613 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.148015+0000", 2024-05-08T18:30:22.613 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:22.613 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.613 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.614 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:22.614 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.148017+0000", 2024-05-08T18:30:22.614 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1830000000000001e-06 2024-05-08T18:30:22.614 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.614 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.614 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:22.614 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.148030+0000", 2024-05-08T18:30:22.614 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2893e-05 2024-05-08T18:30:22.614 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.614 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.614 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:22.614 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.148061+0000", 2024-05-08T18:30:22.614 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0953e-05 2024-05-08T18:30:22.615 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.615 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.615 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:22.615 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.148077+0000", 2024-05-08T18:30:22.615 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6554000000000001e-05 2024-05-08T18:30:22.615 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.615 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.615 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:22.615 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.148230+0000", 2024-05-08T18:30:22.615 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015263899999999999 2024-05-08T18:30:22.615 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.615 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.615 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:22.615 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.148592+0000", 2024-05-08T18:30:22.616 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00036219699999999997 2024-05-08T18:30:22.616 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.616 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.616 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:22.616 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.149139+0000", 2024-05-08T18:30:22.616 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00054734599999999999 2024-05-08T18:30:22.616 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.616 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.616 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:22.616 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.150505+0000", 2024-05-08T18:30:22.616 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001365479 2024-05-08T18:30:22.616 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.616 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.617 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:22.617 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.151087+0000", 2024-05-08T18:30:22.617 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00058201200000000002 2024-05-08T18:30:22.617 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.617 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.617 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:22.617 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.151175+0000", 2024-05-08T18:30:22.617 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8199e-05 2024-05-08T18:30:22.617 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.617 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.617 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:22.617 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.151244+0000", 2024-05-08T18:30:22.617 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9286e-05 2024-05-08T18:30:22.617 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:22.618 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:22.618 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:22.618 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.618 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.618 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:22.618 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.277376+0000", 2024-05-08T18:30:22.618 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 30.286656117, 2024-05-08T18:30:22.618 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032022190000000001, 2024-05-08T18:30:22.618 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:22.618 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:22.618 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:22.618 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:22.618 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:22.619 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:22.619 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 817 2024-05-08T18:30:22.619 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.619 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:22.619 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.619 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:22.619 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.277376+0000", 2024-05-08T18:30:22.619 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:22.619 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.619 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.619 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:22.619 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.277376+0000", 2024-05-08T18:30:22.619 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:22.619 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.620 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.620 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:22.620 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.277379+0000", 2024-05-08T18:30:22.620 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4430000000000002e-06 2024-05-08T18:30:22.620 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.620 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.620 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:22.620 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.277391+0000", 2024-05-08T18:30:22.620 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1634000000000001e-05 2024-05-08T18:30:22.620 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.620 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.620 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:22.620 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.277421+0000", 2024-05-08T18:30:22.620 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0691999999999997e-05 2024-05-08T18:30:22.620 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.621 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.621 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:22.621 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.277438+0000", 2024-05-08T18:30:22.621 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7102999999999999e-05 2024-05-08T18:30:22.621 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.621 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.621 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:22.621 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.277602+0000", 2024-05-08T18:30:22.621 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016345300000000001 2024-05-08T18:30:22.621 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.621 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.621 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:22.621 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.278019+0000", 2024-05-08T18:30:22.622 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00041724699999999998 2024-05-08T18:30:22.622 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.622 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.622 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:22.622 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.278573+0000", 2024-05-08T18:30:22.622 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00055391900000000005 2024-05-08T18:30:22.622 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.622 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.622 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:22.622 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.279973+0000", 2024-05-08T18:30:22.622 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0013995819999999999 2024-05-08T18:30:22.622 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.622 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.622 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:22.623 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.280422+0000", 2024-05-08T18:30:22.623 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00044940699999999997 2024-05-08T18:30:22.623 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.623 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.623 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:22.623 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.280509+0000", 2024-05-08T18:30:22.623 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7455999999999997e-05 2024-05-08T18:30:22.623 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.623 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.623 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:22.623 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.280579+0000", 2024-05-08T18:30:22.623 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9282999999999994e-05 2024-05-08T18:30:22.623 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:22.623 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:22.624 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:22.624 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.624 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.624 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:22.624 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.281716+0000", 2024-05-08T18:30:22.624 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 30.28231675, 2024-05-08T18:30:22.624 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003275881, 2024-05-08T18:30:22.624 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:22.624 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:22.624 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:22.624 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:22.624 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:22.624 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:22.625 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 819 2024-05-08T18:30:22.625 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.625 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:22.625 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.625 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:22.625 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.281716+0000", 2024-05-08T18:30:22.625 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:22.625 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.625 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.625 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:22.625 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.281716+0000", 2024-05-08T18:30:22.625 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:22.626 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.626 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.626 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:22.626 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.281718+0000", 2024-05-08T18:30:22.626 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.863e-06 2024-05-08T18:30:22.626 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.626 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.626 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:22.626 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.281728+0000", 2024-05-08T18:30:22.626 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0550000000000001e-05 2024-05-08T18:30:22.626 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.626 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.626 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:22.627 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.281760+0000", 2024-05-08T18:30:22.627 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2150000000000002e-05 2024-05-08T18:30:22.627 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.627 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.627 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:22.627 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.281776+0000", 2024-05-08T18:30:22.627 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6005999999999999e-05 2024-05-08T18:30:22.627 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.627 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.627 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:22.627 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.281917+0000", 2024-05-08T18:30:22.627 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014070200000000001 2024-05-08T18:30:22.627 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.628 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.628 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:22.628 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.282148+0000", 2024-05-08T18:30:22.628 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023095200000000001 2024-05-08T18:30:22.628 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.628 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.628 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:22.628 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.282641+0000", 2024-05-08T18:30:22.628 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00049337999999999997 2024-05-08T18:30:22.628 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.628 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.628 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:22.629 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.284070+0000", 2024-05-08T18:30:22.629 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0014287950000000001 2024-05-08T18:30:22.629 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.629 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.629 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:22.629 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.284837+0000", 2024-05-08T18:30:22.629 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00076679799999999996 2024-05-08T18:30:22.629 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.629 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.629 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:22.629 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.284925+0000", 2024-05-08T18:30:22.630 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8165999999999996e-05 2024-05-08T18:30:22.630 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.630 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.630 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:22.630 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.284992+0000", 2024-05-08T18:30:22.630 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6519000000000005e-05 2024-05-08T18:30:22.630 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:22.630 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:22.630 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:22.630 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.630 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.631 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:22.631 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.334745+0000", 2024-05-08T18:30:22.631 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 30.229287840000001, 2024-05-08T18:30:22.631 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032404719999999999, 2024-05-08T18:30:22.631 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:22.631 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:22.631 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:22.631 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:22.631 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:22.631 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:22.631 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 841 2024-05-08T18:30:22.631 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.631 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:22.632 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.632 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:22.632 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.334745+0000", 2024-05-08T18:30:22.632 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:22.632 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.632 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.632 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:22.632 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.334745+0000", 2024-05-08T18:30:22.632 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:22.632 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.632 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.632 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:22.633 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.334747+0000", 2024-05-08T18:30:22.633 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.407e-06 2024-05-08T18:30:22.633 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.633 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.633 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:22.633 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.334759+0000", 2024-05-08T18:30:22.633 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1883e-05 2024-05-08T18:30:22.633 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.633 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.633 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:22.633 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.334789+0000", 2024-05-08T18:30:22.633 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9957000000000001e-05 2024-05-08T18:30:22.634 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.634 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.634 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:22.634 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.334804+0000", 2024-05-08T18:30:22.634 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4713e-05 2024-05-08T18:30:22.634 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.634 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.634 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:22.634 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.334951+0000", 2024-05-08T18:30:22.634 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000147675 2024-05-08T18:30:22.634 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.634 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.635 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:22.635 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.335304+0000", 2024-05-08T18:30:22.635 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00035214099999999999 2024-05-08T18:30:22.635 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.635 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.635 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:22.635 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.335859+0000", 2024-05-08T18:30:22.635 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00055546899999999995 2024-05-08T18:30:22.635 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.635 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.635 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:22.635 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.337168+0000", 2024-05-08T18:30:22.635 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0013087299999999999 2024-05-08T18:30:22.635 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.636 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.636 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:22.636 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.337808+0000", 2024-05-08T18:30:22.636 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00064005500000000005 2024-05-08T18:30:22.636 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.636 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.636 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:22.636 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.337894+0000", 2024-05-08T18:30:22.636 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6593000000000003e-05 2024-05-08T18:30:22.636 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.636 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.636 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:22.636 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.337985+0000", 2024-05-08T18:30:22.637 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0848999999999997e-05 2024-05-08T18:30:22.637 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:22.637 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:22.637 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:22.637 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.637 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.637 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:22.637 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.338870+0000", 2024-05-08T18:30:22.637 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 30.225163090999999, 2024-05-08T18:30:22.637 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002862121, 2024-05-08T18:30:22.637 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:22.637 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:22.637 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:22.638 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:22.638 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:22.638 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:22.638 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 843 2024-05-08T18:30:22.638 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.638 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:22.638 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.638 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:22.638 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.338870+0000", 2024-05-08T18:30:22.638 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:22.638 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.638 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.638 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:22.639 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.338870+0000", 2024-05-08T18:30:22.639 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:22.639 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.639 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.639 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:22.639 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.338872+0000", 2024-05-08T18:30:22.639 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3429999999999998e-06 2024-05-08T18:30:22.639 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.639 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.639 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:22.639 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.338883+0000", 2024-05-08T18:30:22.639 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1447000000000001e-05 2024-05-08T18:30:22.639 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.639 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.639 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:22.640 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.338914+0000", 2024-05-08T18:30:22.640 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1052e-05 2024-05-08T18:30:22.640 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.640 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.640 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:22.640 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.338932+0000", 2024-05-08T18:30:22.640 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7604e-05 2024-05-08T18:30:22.640 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.640 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.640 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:22.640 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.339019+0000", 2024-05-08T18:30:22.640 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6982000000000002e-05 2024-05-08T18:30:22.640 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.641 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.641 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:22.641 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.339139+0000", 2024-05-08T18:30:22.641 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011978599999999999 2024-05-08T18:30:22.641 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.641 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.641 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:22.641 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.339415+0000", 2024-05-08T18:30:22.641 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00027644799999999999 2024-05-08T18:30:22.641 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.641 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.641 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:22.642 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.340619+0000", 2024-05-08T18:30:22.642 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012043010000000001 2024-05-08T18:30:22.642 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.642 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.642 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:22.642 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.341454+0000", 2024-05-08T18:30:22.642 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00083464300000000004 2024-05-08T18:30:22.642 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.642 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.642 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:22.642 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.341609+0000", 2024-05-08T18:30:22.642 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000154752 2024-05-08T18:30:22.642 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.643 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.643 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:22.643 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.341732+0000", 2024-05-08T18:30:22.643 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012276299999999999 2024-05-08T18:30:22.643 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:22.643 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:22.643 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:22.643 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.643 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.643 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:22.643 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.349287+0000", 2024-05-08T18:30:22.643 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 30.214745262000001, 2024-05-08T18:30:22.643 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032683220000000002, 2024-05-08T18:30:22.643 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:22.644 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:22.644 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:22.644 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:22.644 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:22.644 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:22.644 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 847 2024-05-08T18:30:22.644 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.644 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:22.644 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.644 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:22.644 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.349287+0000", 2024-05-08T18:30:22.644 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:22.644 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.645 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.645 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:22.645 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.349287+0000", 2024-05-08T18:30:22.645 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:22.645 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.645 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.645 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:22.645 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.349290+0000", 2024-05-08T18:30:22.645 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3369999999999998e-06 2024-05-08T18:30:22.645 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.645 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.645 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:22.645 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.349318+0000", 2024-05-08T18:30:22.646 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8419999999999999e-05 2024-05-08T18:30:22.646 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.646 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.646 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:22.646 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.349348+0000", 2024-05-08T18:30:22.646 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0260000000000002e-05 2024-05-08T18:30:22.646 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.646 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.646 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:22.646 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.349364+0000", 2024-05-08T18:30:22.646 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5359999999999999e-05 2024-05-08T18:30:22.646 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.646 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.647 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:22.647 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.349511+0000", 2024-05-08T18:30:22.647 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014760199999999999 2024-05-08T18:30:22.647 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.647 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.647 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:22.647 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.349872+0000", 2024-05-08T18:30:22.647 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00036035 2024-05-08T18:30:22.647 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.647 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.647 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:22.647 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.350432+0000", 2024-05-08T18:30:22.647 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00056059600000000001 2024-05-08T18:30:22.648 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.648 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.648 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:22.648 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.351817+0000", 2024-05-08T18:30:22.648 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001385063 2024-05-08T18:30:22.648 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.648 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.648 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:22.648 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.352402+0000", 2024-05-08T18:30:22.648 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00058490500000000004 2024-05-08T18:30:22.648 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.648 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.648 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:22.648 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.352488+0000", 2024-05-08T18:30:22.649 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6032999999999994e-05 2024-05-08T18:30:22.649 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.649 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.649 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:22.649 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.352556+0000", 2024-05-08T18:30:22.649 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7396000000000003e-05 2024-05-08T18:30:22.649 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:22.649 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:22.649 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:22.649 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.649 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.649 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:22.649 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.353786+0000", 2024-05-08T18:30:22.649 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 30.210246427000001, 2024-05-08T18:30:22.650 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0029130850000000002, 2024-05-08T18:30:22.650 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:22.650 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:22.650 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:22.650 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:22.650 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:22.650 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:22.650 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 849 2024-05-08T18:30:22.650 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.650 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:22.650 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.650 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:22.650 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.353786+0000", 2024-05-08T18:30:22.651 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:22.651 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.651 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.651 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:22.651 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.353786+0000", 2024-05-08T18:30:22.651 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:22.651 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.651 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.651 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:22.651 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.353788+0000", 2024-05-08T18:30:22.651 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0370000000000001e-06 2024-05-08T18:30:22.651 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.651 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.652 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:22.652 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.353799+0000", 2024-05-08T18:30:22.652 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0686000000000001e-05 2024-05-08T18:30:22.652 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.652 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.652 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:22.652 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.353832+0000", 2024-05-08T18:30:22.652 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.341e-05 2024-05-08T18:30:22.652 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.652 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.652 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:22.652 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.353851+0000", 2024-05-08T18:30:22.652 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8343999999999999e-05 2024-05-08T18:30:22.653 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.653 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.653 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:22.653 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.353980+0000", 2024-05-08T18:30:22.653 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012914900000000001 2024-05-08T18:30:22.653 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.653 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.653 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:22.653 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.354123+0000", 2024-05-08T18:30:22.653 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000142912 2024-05-08T18:30:22.653 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.653 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.653 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:22.653 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.354393+0000", 2024-05-08T18:30:22.654 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00027009799999999997 2024-05-08T18:30:22.654 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.654 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.654 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:22.654 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.355769+0000", 2024-05-08T18:30:22.654 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001375839 2024-05-08T18:30:22.654 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.654 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.654 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:22.654 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.356421+0000", 2024-05-08T18:30:22.654 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00065227799999999995 2024-05-08T18:30:22.654 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.655 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.655 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:22.655 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.356592+0000", 2024-05-08T18:30:22.655 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000170586 2024-05-08T18:30:22.655 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.655 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.655 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:22.655 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.356699+0000", 2024-05-08T18:30:22.655 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010774599999999999 2024-05-08T18:30:22.655 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:22.655 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:22.655 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:22.655 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.655 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.656 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:22.656 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.402673+0000", 2024-05-08T18:30:22.656 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 30.161359753999999, 2024-05-08T18:30:22.656 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002928295, 2024-05-08T18:30:22.656 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:22.656 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:22.656 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:22.656 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:22.656 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:22.656 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:22.656 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 870 2024-05-08T18:30:22.656 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.656 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:22.656 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.657 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:22.657 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.402673+0000", 2024-05-08T18:30:22.657 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:22.657 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.657 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.657 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:22.657 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.402673+0000", 2024-05-08T18:30:22.657 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:22.657 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.657 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.657 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:22.657 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.402675+0000", 2024-05-08T18:30:22.657 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0030000000000001e-06 2024-05-08T18:30:22.658 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.658 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.658 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:22.658 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.402685+0000", 2024-05-08T18:30:22.658 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0566e-05 2024-05-08T18:30:22.658 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.658 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.658 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:22.658 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.402714+0000", 2024-05-08T18:30:22.658 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8804999999999999e-05 2024-05-08T18:30:22.658 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.658 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.658 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:22.659 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.402731+0000", 2024-05-08T18:30:22.659 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6731e-05 2024-05-08T18:30:22.659 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.659 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.659 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:22.659 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.402863+0000", 2024-05-08T18:30:22.659 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013194199999999999 2024-05-08T18:30:22.659 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.659 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.659 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:22.659 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.403096+0000", 2024-05-08T18:30:22.659 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023309900000000001 2024-05-08T18:30:22.659 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.659 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.660 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:22.660 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.403553+0000", 2024-05-08T18:30:22.660 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00045738700000000002 2024-05-08T18:30:22.660 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.660 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.660 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:22.660 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.404843+0000", 2024-05-08T18:30:22.660 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012894650000000001 2024-05-08T18:30:22.660 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.660 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.660 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:22.660 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.405348+0000", 2024-05-08T18:30:22.660 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00050483600000000004 2024-05-08T18:30:22.661 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.661 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.661 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:22.661 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.405491+0000", 2024-05-08T18:30:22.661 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014349299999999999 2024-05-08T18:30:22.661 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.661 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.661 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:22.661 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.405601+0000", 2024-05-08T18:30:22.661 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000109968 2024-05-08T18:30:22.661 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:22.661 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:22.661 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:22.661 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.662 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.662 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:22.662 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.484247+0000", 2024-05-08T18:30:22.662 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 30.079785554000001, 2024-05-08T18:30:22.662 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028903679999999999, 2024-05-08T18:30:22.662 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:22.662 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:22.662 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:22.662 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:22.662 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:22.662 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:22.662 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 907 2024-05-08T18:30:22.662 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.662 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:22.663 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.663 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:22.663 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.484247+0000", 2024-05-08T18:30:22.663 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:22.663 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.663 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.663 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:22.663 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.484247+0000", 2024-05-08T18:30:22.663 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:22.663 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.663 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.663 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:22.663 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.484250+0000", 2024-05-08T18:30:22.663 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6900000000000001e-06 2024-05-08T18:30:22.664 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.664 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.664 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:22.664 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.484263+0000", 2024-05-08T18:30:22.664 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2967e-05 2024-05-08T18:30:22.664 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.664 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.664 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:22.664 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.484294+0000", 2024-05-08T18:30:22.664 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1016000000000003e-05 2024-05-08T18:30:22.664 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.664 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.664 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:22.664 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.484309+0000", 2024-05-08T18:30:22.665 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5187e-05 2024-05-08T18:30:22.665 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.665 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.665 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:22.665 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.484467+0000", 2024-05-08T18:30:22.665 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015810499999999999 2024-05-08T18:30:22.665 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.665 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.665 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:22.665 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.484698+0000", 2024-05-08T18:30:22.665 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000230852 2024-05-08T18:30:22.665 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.665 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.665 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:22.666 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.485026+0000", 2024-05-08T18:30:22.666 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00032833 2024-05-08T18:30:22.666 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.666 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.666 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:22.666 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.486177+0000", 2024-05-08T18:30:22.666 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0011504309999999999 2024-05-08T18:30:22.666 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.666 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.666 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:22.666 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.486978+0000", 2024-05-08T18:30:22.666 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000801161 2024-05-08T18:30:22.666 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.667 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.667 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:22.667 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.487068+0000", 2024-05-08T18:30:22.667 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0435999999999999e-05 2024-05-08T18:30:22.667 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.667 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.667 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:22.667 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.487137+0000", 2024-05-08T18:30:22.667 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9193e-05 2024-05-08T18:30:22.667 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:22.667 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:22.667 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:22.667 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.667 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.667 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:22.668 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.585363+0000", 2024-05-08T18:30:22.668 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 29.978669710999998, 2024-05-08T18:30:22.668 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028400080000000002, 2024-05-08T18:30:22.668 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:22.668 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:22.668 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:22.668 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:22.668 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:22.668 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:22.668 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 949 2024-05-08T18:30:22.668 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.668 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:22.668 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.668 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:22.669 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.585363+0000", 2024-05-08T18:30:22.669 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:22.669 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.669 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.669 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:22.669 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.585363+0000", 2024-05-08T18:30:22.669 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:22.669 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.669 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.669 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:22.669 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.585366+0000", 2024-05-08T18:30:22.669 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7099999999999999e-06 2024-05-08T18:30:22.669 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.670 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.670 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:22.670 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.585378+0000", 2024-05-08T18:30:22.670 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1970000000000001e-05 2024-05-08T18:30:22.670 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.670 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.670 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:22.670 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.585408+0000", 2024-05-08T18:30:22.670 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0389999999999999e-05 2024-05-08T18:30:22.670 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.670 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.670 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:22.671 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.585423+0000", 2024-05-08T18:30:22.671 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4929999999999999e-05 2024-05-08T18:30:22.671 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.671 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.671 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:22.671 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.585559+0000", 2024-05-08T18:30:22.671 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013563599999999999 2024-05-08T18:30:22.671 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.671 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.671 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:22.671 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.585780+0000", 2024-05-08T18:30:22.671 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000221828 2024-05-08T18:30:22.671 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.672 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.672 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:22.672 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.586121+0000", 2024-05-08T18:30:22.672 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000340181 2024-05-08T18:30:22.672 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.672 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.672 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:22.672 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.587268+0000", 2024-05-08T18:30:22.672 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001146984 2024-05-08T18:30:22.672 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.672 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.672 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:22.673 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.588047+0000", 2024-05-08T18:30:22.673 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000779877 2024-05-08T18:30:22.673 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.673 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.673 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:22.673 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.588136+0000", 2024-05-08T18:30:22.673 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8483e-05 2024-05-08T18:30:22.673 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.673 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.673 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:22.673 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.588203+0000", 2024-05-08T18:30:22.674 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7019000000000003e-05 2024-05-08T18:30:22.674 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:22.674 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:22.674 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:22.674 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.674 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.674 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:951 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:22.674 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.589044+0000", 2024-05-08T18:30:22.674 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 29.974988288999999, 2024-05-08T18:30:22.674 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002802672, 2024-05-08T18:30:22.674 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:22.674 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:22.675 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:22.675 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:22.675 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:22.675 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:22.675 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 951 2024-05-08T18:30:22.675 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.675 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:22.675 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.675 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:22.675 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.589044+0000", 2024-05-08T18:30:22.675 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:22.675 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.675 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.676 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:22.676 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.589044+0000", 2024-05-08T18:30:22.676 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:22.676 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.676 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.676 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:22.676 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.589046+0000", 2024-05-08T18:30:22.676 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6670000000000001e-06 2024-05-08T18:30:22.676 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.676 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.676 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:22.676 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.589054+0000", 2024-05-08T18:30:22.676 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.2600000000000005e-06 2024-05-08T18:30:22.677 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.677 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.677 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:22.677 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.589076+0000", 2024-05-08T18:30:22.677 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1373e-05 2024-05-08T18:30:22.677 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.677 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.677 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:22.677 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.589088+0000", 2024-05-08T18:30:22.677 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2768999999999999e-05 2024-05-08T18:30:22.677 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.677 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.677 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:22.678 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.589220+0000", 2024-05-08T18:30:22.678 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013146300000000001 2024-05-08T18:30:22.678 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.678 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.678 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:22.678 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.589462+0000", 2024-05-08T18:30:22.678 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024250500000000001 2024-05-08T18:30:22.678 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.678 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.678 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:22.678 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.589956+0000", 2024-05-08T18:30:22.678 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00049331600000000005 2024-05-08T18:30:22.678 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.678 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.679 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:22.679 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.591337+0000", 2024-05-08T18:30:22.679 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0013816290000000001 2024-05-08T18:30:22.679 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.679 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.679 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:22.679 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.591688+0000", 2024-05-08T18:30:22.679 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00035083400000000001 2024-05-08T18:30:22.679 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.679 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.679 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:22.679 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.591780+0000", 2024-05-08T18:30:22.679 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.2312999999999995e-05 2024-05-08T18:30:22.679 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.680 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.680 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:22.680 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.591847+0000", 2024-05-08T18:30:22.680 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6543000000000003e-05 2024-05-08T18:30:22.680 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:22.680 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:22.680 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:22.680 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.680 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.680 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:22.680 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.599312+0000", 2024-05-08T18:30:22.680 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 29.964720825000001, 2024-05-08T18:30:22.680 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0027928190000000002, 2024-05-08T18:30:22.681 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:22.681 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:22.681 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:22.681 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:22.681 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:22.681 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:22.681 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 955 2024-05-08T18:30:22.681 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.681 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:22.681 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.681 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:22.682 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.599312+0000", 2024-05-08T18:30:22.682 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:22.682 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.682 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.682 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:22.682 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.599312+0000", 2024-05-08T18:30:22.682 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:22.682 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.682 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.682 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:22.682 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.599314+0000", 2024-05-08T18:30:22.682 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.396e-06 2024-05-08T18:30:22.682 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.683 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.683 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:22.683 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.599325+0000", 2024-05-08T18:30:22.683 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1063999999999999e-05 2024-05-08T18:30:22.683 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.683 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.683 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:22.683 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.599354+0000", 2024-05-08T18:30:22.683 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8462999999999998e-05 2024-05-08T18:30:22.683 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.683 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.683 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:22.683 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.599369+0000", 2024-05-08T18:30:22.684 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4963000000000001e-05 2024-05-08T18:30:22.684 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.684 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.684 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:22.684 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.599503+0000", 2024-05-08T18:30:22.684 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013385299999999999 2024-05-08T18:30:22.684 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.684 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.684 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:22.684 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.599744+0000", 2024-05-08T18:30:22.684 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024137400000000001 2024-05-08T18:30:22.684 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.685 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.685 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:22.685 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.600084+0000", 2024-05-08T18:30:22.685 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00033999399999999998 2024-05-08T18:30:22.685 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.685 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.685 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:22.685 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.601319+0000", 2024-05-08T18:30:22.685 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012348140000000001 2024-05-08T18:30:22.685 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.685 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.685 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:22.685 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.601956+0000", 2024-05-08T18:30:22.686 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00063721199999999996 2024-05-08T18:30:22.686 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.686 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.686 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:22.686 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.602038+0000", 2024-05-08T18:30:22.686 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.1705999999999993e-05 2024-05-08T18:30:22.686 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:22.686 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:22.686 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:22.686 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.602105+0000", 2024-05-08T18:30:22.686 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6979999999999999e-05 2024-05-08T18:30:22.686 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:22.686 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:22.687 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:22.687 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:22.687 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:22.687 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:30:22.689 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-08T18:30:22.689 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:30:22.689+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:30:22.790 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:30:22.787+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:30:22.853 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:30:22.853 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:30:22.853 INFO:teuthology.orchestra.run.smithi097.stdout: "num_ops": 0 2024-05-08T18:30:22.854 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:30:22.868 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-08T18:30:22.891 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:30:22.887+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:30:22.989 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:30:22.990 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:30:22.990 INFO:teuthology.orchestra.run.smithi097.stdout: "complaint_time": 30, 2024-05-08T18:30:22.990 INFO:teuthology.orchestra.run.smithi097.stdout: "num_blocked_ops": 0 2024-05-08T18:30:22.990 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:30:22.991 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:30:22.987+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:30:23.004 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-08T18:30:23.092 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:30:23.093+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:30:23.126 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-08T18:30:23.132 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:30:23.132 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2024-05-08T18:30:23.132 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2024-05-08T18:30:23.132 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-05-08T18:30:23.132 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.132 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:57 7.3 7:c609908c:::notify.5:head [watch watch cookie 94069412621696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:30:23.133 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:48.668590+0000", 2024-05-08T18:30:23.133 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 34.463481717999997, 2024-05-08T18:30:23.133 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0054375830000000002, 2024-05-08T18:30:23.133 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:23.133 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:23.133 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:23.133 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:23.133 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:23.133 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:23.133 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 57 2024-05-08T18:30:23.133 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.133 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:23.133 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.134 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:23.134 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668590+0000", 2024-05-08T18:30:23.134 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:23.134 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.134 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.134 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:23.134 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668590+0000", 2024-05-08T18:30:23.134 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:23.134 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.134 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.134 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:23.134 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668592+0000", 2024-05-08T18:30:23.134 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0930000000000001e-06 2024-05-08T18:30:23.135 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.135 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.135 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:23.135 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668619+0000", 2024-05-08T18:30:23.135 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7396999999999999e-05 2024-05-08T18:30:23.135 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.135 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.135 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:23.135 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668650+0000", 2024-05-08T18:30:23.135 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0620000000000002e-05 2024-05-08T18:30:23.135 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.135 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.135 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:23.136 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668672+0000", 2024-05-08T18:30:23.136 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2093e-05 2024-05-08T18:30:23.136 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.136 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.136 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:23.136 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668782+0000", 2024-05-08T18:30:23.136 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011010600000000001 2024-05-08T18:30:23.136 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.136 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.136 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:23.136 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668934+0000", 2024-05-08T18:30:23.136 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000152268 2024-05-08T18:30:23.136 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.137 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.137 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-05-08T18:30:23.137 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669177+0000", 2024-05-08T18:30:23.137 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024286500000000001 2024-05-08T18:30:23.137 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.137 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.137 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:23.137 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.670404+0000", 2024-05-08T18:30:23.137 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001226932 2024-05-08T18:30:23.137 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.137 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.137 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:23.137 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.673822+0000", 2024-05-08T18:30:23.138 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003417776 2024-05-08T18:30:23.138 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.138 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.138 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:23.138 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.673924+0000", 2024-05-08T18:30:23.138 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000102379 2024-05-08T18:30:23.138 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.138 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.138 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:23.138 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674027+0000", 2024-05-08T18:30:23.138 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010305400000000001 2024-05-08T18:30:23.138 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:23.139 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:23.139 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:23.139 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.139 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.139 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:58 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:30:23.139 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:48.668750+0000", 2024-05-08T18:30:23.139 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 34.463321292000003, 2024-05-08T18:30:23.139 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0057687559999999999, 2024-05-08T18:30:23.139 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:23.139 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:23.139 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:23.139 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:23.139 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:23.139 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:23.140 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 58 2024-05-08T18:30:23.140 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.141 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:23.141 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.141 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:23.141 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668750+0000", 2024-05-08T18:30:23.141 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:23.142 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.142 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.142 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:23.142 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668750+0000", 2024-05-08T18:30:23.142 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:23.142 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.142 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.142 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:23.142 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668752+0000", 2024-05-08T18:30:23.142 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.64e-06 2024-05-08T18:30:23.142 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.142 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.143 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:23.143 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668760+0000", 2024-05-08T18:30:23.143 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5529999999999993e-06 2024-05-08T18:30:23.143 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.143 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.143 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:23.143 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668787+0000", 2024-05-08T18:30:23.143 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6475999999999999e-05 2024-05-08T18:30:23.143 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.143 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.143 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:23.143 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668804+0000", 2024-05-08T18:30:23.143 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7163000000000002e-05 2024-05-08T18:30:23.143 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.143 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.144 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:23.144 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668906+0000", 2024-05-08T18:30:23.144 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010241 2024-05-08T18:30:23.144 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.144 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.144 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:23.144 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669068+0000", 2024-05-08T18:30:23.144 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016144400000000001 2024-05-08T18:30:23.144 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.144 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.144 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-05-08T18:30:23.144 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669226+0000", 2024-05-08T18:30:23.144 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000158639 2024-05-08T18:30:23.145 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.145 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.145 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:23.145 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.670439+0000", 2024-05-08T18:30:23.145 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012124480000000001 2024-05-08T18:30:23.145 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.145 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.145 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:23.145 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674406+0000", 2024-05-08T18:30:23.145 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0039675259999999999 2024-05-08T18:30:23.145 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.145 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.145 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:23.145 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674469+0000", 2024-05-08T18:30:23.146 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.2903000000000004e-05 2024-05-08T18:30:23.146 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.146 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.146 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:23.146 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674519+0000", 2024-05-08T18:30:23.146 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9554e-05 2024-05-08T18:30:23.146 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:23.146 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:23.146 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:23.146 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.146 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.146 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:30:23.146 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.675404+0000", 2024-05-08T18:30:23.147 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 31.456667521, 2024-05-08T18:30:23.147 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003903147, 2024-05-08T18:30:23.147 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:23.147 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:23.147 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:23.147 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:23.147 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:23.147 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:23.147 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 207 2024-05-08T18:30:23.147 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.147 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:23.147 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.147 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:23.147 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675404+0000", 2024-05-08T18:30:23.148 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:23.148 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.148 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.148 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:23.148 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675404+0000", 2024-05-08T18:30:23.148 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:23.148 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.148 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.148 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:23.148 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675407+0000", 2024-05-08T18:30:23.148 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1729999999999999e-06 2024-05-08T18:30:23.148 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.148 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.148 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:23.149 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675422+0000", 2024-05-08T18:30:23.149 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.485e-05 2024-05-08T18:30:23.149 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.149 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.149 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:23.149 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675454+0000", 2024-05-08T18:30:23.149 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1656000000000003e-05 2024-05-08T18:30:23.149 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.149 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.149 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:23.149 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675470+0000", 2024-05-08T18:30:23.149 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.626e-05 2024-05-08T18:30:23.150 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.150 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.150 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:23.150 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675683+0000", 2024-05-08T18:30:23.150 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021312600000000001 2024-05-08T18:30:23.150 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.150 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.150 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:23.150 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675972+0000", 2024-05-08T18:30:23.150 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00028885100000000002 2024-05-08T18:30:23.150 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.150 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.151 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:30:23.151 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.676369+0000", 2024-05-08T18:30:23.151 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000397227 2024-05-08T18:30:23.151 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.151 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.151 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:23.151 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.677780+0000", 2024-05-08T18:30:23.151 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001411186 2024-05-08T18:30:23.151 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.151 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.151 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:23.151 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679153+0000", 2024-05-08T18:30:23.151 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0013725720000000001 2024-05-08T18:30:23.151 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.151 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.152 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:23.152 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679240+0000", 2024-05-08T18:30:23.152 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7412999999999998e-05 2024-05-08T18:30:23.152 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.152 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.152 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:23.152 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679307+0000", 2024-05-08T18:30:23.152 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6833000000000002e-05 2024-05-08T18:30:23.152 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:23.152 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:23.152 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:23.152 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.152 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.152 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:23.153 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.721317+0000", 2024-05-08T18:30:23.153 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 31.410754775000001, 2024-05-08T18:30:23.153 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032842140000000001, 2024-05-08T18:30:23.153 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:23.153 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:23.153 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:23.153 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:23.153 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:23.153 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:23.153 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 216 2024-05-08T18:30:23.153 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.153 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:23.153 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.154 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:23.154 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.721317+0000", 2024-05-08T18:30:23.154 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:23.154 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.154 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.154 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:23.154 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.721317+0000", 2024-05-08T18:30:23.154 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:23.154 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.154 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.154 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:23.154 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.721320+0000", 2024-05-08T18:30:23.154 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.303e-06 2024-05-08T18:30:23.155 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.155 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.155 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:23.155 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.721335+0000", 2024-05-08T18:30:23.155 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4543e-05 2024-05-08T18:30:23.155 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.155 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.155 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:23.155 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.721370+0000", 2024-05-08T18:30:23.155 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5336000000000002e-05 2024-05-08T18:30:23.155 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.155 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.155 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:23.155 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.721393+0000", 2024-05-08T18:30:23.156 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2710000000000001e-05 2024-05-08T18:30:23.156 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.156 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.156 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:23.156 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.721592+0000", 2024-05-08T18:30:23.156 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00019917900000000001 2024-05-08T18:30:23.156 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.156 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.156 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:23.156 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.721815+0000", 2024-05-08T18:30:23.156 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000223742 2024-05-08T18:30:23.156 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.156 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.157 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:23.157 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.722268+0000", 2024-05-08T18:30:23.157 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00045295900000000001 2024-05-08T18:30:23.157 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.157 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.157 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:23.157 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.723878+0000", 2024-05-08T18:30:23.157 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001609828 2024-05-08T18:30:23.157 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.157 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.157 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:23.157 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.724433+0000", 2024-05-08T18:30:23.157 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00055512499999999995 2024-05-08T18:30:23.158 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.158 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.158 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:23.158 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.724528+0000", 2024-05-08T18:30:23.158 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.4887000000000001e-05 2024-05-08T18:30:23.158 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.158 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.158 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:23.158 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.724601+0000", 2024-05-08T18:30:23.158 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2601999999999994e-05 2024-05-08T18:30:23.158 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:23.158 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:23.158 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:23.159 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.159 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.159 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:23.159 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.761586+0000", 2024-05-08T18:30:23.159 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 31.370485929000001, 2024-05-08T18:30:23.159 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031756979999999998, 2024-05-08T18:30:23.159 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:23.159 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:23.159 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:23.159 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:23.159 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:23.159 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:23.159 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 227 2024-05-08T18:30:23.160 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.160 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:23.160 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.160 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:23.160 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.761586+0000", 2024-05-08T18:30:23.160 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:23.160 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.160 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.160 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:23.160 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.761586+0000", 2024-05-08T18:30:23.160 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:23.160 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.160 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.160 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:23.161 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.761588+0000", 2024-05-08T18:30:23.161 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7499999999999999e-06 2024-05-08T18:30:23.161 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.161 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.161 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:23.161 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.761600+0000", 2024-05-08T18:30:23.161 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2003e-05 2024-05-08T18:30:23.161 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.161 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.161 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:23.161 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.761632+0000", 2024-05-08T18:30:23.161 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1933000000000001e-05 2024-05-08T18:30:23.161 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.162 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.162 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:23.162 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.761648+0000", 2024-05-08T18:30:23.162 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5339999999999999e-05 2024-05-08T18:30:23.162 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.162 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.162 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:23.162 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.761773+0000", 2024-05-08T18:30:23.162 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012576199999999999 2024-05-08T18:30:23.162 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.162 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.162 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:23.163 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.762037+0000", 2024-05-08T18:30:23.163 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00026385100000000001 2024-05-08T18:30:23.163 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.163 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.163 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:23.163 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.762455+0000", 2024-05-08T18:30:23.163 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00041760700000000002 2024-05-08T18:30:23.163 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.163 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.163 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:23.163 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.764035+0000", 2024-05-08T18:30:23.163 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001580318 2024-05-08T18:30:23.163 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.164 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.164 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:23.164 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.764602+0000", 2024-05-08T18:30:23.164 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00056661899999999998 2024-05-08T18:30:23.164 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.164 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.164 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:23.164 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.764685+0000", 2024-05-08T18:30:23.164 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.3562999999999999e-05 2024-05-08T18:30:23.164 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.164 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.164 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:23.164 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.764761+0000", 2024-05-08T18:30:23.164 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.5951999999999994e-05 2024-05-08T18:30:23.165 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:23.165 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:23.165 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:23.165 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.165 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.165 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:23.165 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.768858+0000", 2024-05-08T18:30:23.165 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 31.363213345999998, 2024-05-08T18:30:23.165 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031906619999999999, 2024-05-08T18:30:23.165 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:23.165 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:23.165 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:23.165 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:23.166 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:23.166 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:23.166 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 229 2024-05-08T18:30:23.166 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.166 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:23.166 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.166 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:23.166 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.768858+0000", 2024-05-08T18:30:23.166 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:23.166 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.166 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.166 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:23.166 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.768858+0000", 2024-05-08T18:30:23.166 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:23.167 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.167 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.167 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:23.167 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.768861+0000", 2024-05-08T18:30:23.167 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5469999999999999e-06 2024-05-08T18:30:23.167 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.167 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.167 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:23.167 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.768872+0000", 2024-05-08T18:30:23.167 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1712999999999999e-05 2024-05-08T18:30:23.167 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.167 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.167 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:23.168 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.768903+0000", 2024-05-08T18:30:23.168 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0636000000000003e-05 2024-05-08T18:30:23.168 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.168 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.168 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:23.168 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.768918+0000", 2024-05-08T18:30:23.168 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4977000000000001e-05 2024-05-08T18:30:23.168 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.168 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.168 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:23.168 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.769037+0000", 2024-05-08T18:30:23.168 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011918599999999999 2024-05-08T18:30:23.168 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.168 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.169 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:23.169 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.769256+0000", 2024-05-08T18:30:23.169 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021839400000000001 2024-05-08T18:30:23.169 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.169 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.169 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:30:23.169 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.769656+0000", 2024-05-08T18:30:23.169 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00040066400000000001 2024-05-08T18:30:23.169 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.169 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.169 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:23.169 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.771116+0000", 2024-05-08T18:30:23.169 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001459389 2024-05-08T18:30:23.169 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.170 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.170 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:23.170 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.771896+0000", 2024-05-08T18:30:23.170 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00077997400000000001 2024-05-08T18:30:23.170 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.170 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.170 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:23.170 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.771984+0000", 2024-05-08T18:30:23.170 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8483e-05 2024-05-08T18:30:23.170 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.170 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.170 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:23.171 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772049+0000", 2024-05-08T18:30:23.171 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.4698999999999998e-05 2024-05-08T18:30:23.171 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:23.171 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:23.171 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:23.171 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.171 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.171 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:23.171 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.776086+0000", 2024-05-08T18:30:23.171 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 31.355985355000001, 2024-05-08T18:30:23.171 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0037528710000000001, 2024-05-08T18:30:23.171 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:23.171 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:23.171 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:23.172 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:23.172 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:23.172 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:23.172 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 231 2024-05-08T18:30:23.172 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.172 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:23.172 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.172 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:23.172 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.776086+0000", 2024-05-08T18:30:23.172 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:23.172 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.172 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.172 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:23.172 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.776086+0000", 2024-05-08T18:30:23.173 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:23.173 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.173 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.173 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:23.173 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.776089+0000", 2024-05-08T18:30:23.173 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8870000000000001e-06 2024-05-08T18:30:23.173 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.173 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.173 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:23.173 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.776102+0000", 2024-05-08T18:30:23.173 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.294e-05 2024-05-08T18:30:23.173 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.173 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.173 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:23.174 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.776132+0000", 2024-05-08T18:30:23.174 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0113000000000001e-05 2024-05-08T18:30:23.174 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.174 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.174 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:23.174 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.776150+0000", 2024-05-08T18:30:23.174 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8216999999999999e-05 2024-05-08T18:30:23.174 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.174 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.174 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:23.174 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.776268+0000", 2024-05-08T18:30:23.174 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000117395 2024-05-08T18:30:23.174 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.174 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.175 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:23.175 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.776514+0000", 2024-05-08T18:30:23.175 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024602899999999999 2024-05-08T18:30:23.175 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.175 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.175 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:23.175 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.776920+0000", 2024-05-08T18:30:23.175 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000406723 2024-05-08T18:30:23.175 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.175 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.175 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:23.175 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.778360+0000", 2024-05-08T18:30:23.175 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0014393279999999999 2024-05-08T18:30:23.175 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.176 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.176 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:23.176 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.779687+0000", 2024-05-08T18:30:23.176 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001327674 2024-05-08T18:30:23.176 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.176 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.176 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:23.176 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.779777+0000", 2024-05-08T18:30:23.176 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9152000000000003e-05 2024-05-08T18:30:23.176 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.176 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.176 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:23.176 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.779839+0000", 2024-05-08T18:30:23.176 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.2413e-05 2024-05-08T18:30:23.177 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:23.177 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:23.177 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:23.177 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.177 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.177 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:257 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:23.177 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.802295+0000", 2024-05-08T18:30:23.177 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 31.329776214999999, 2024-05-08T18:30:23.177 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0030517880000000002, 2024-05-08T18:30:23.177 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:23.177 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:23.177 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:23.177 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:23.178 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:23.178 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:23.178 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 257 2024-05-08T18:30:23.178 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.178 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:23.178 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.178 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:23.178 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.802295+0000", 2024-05-08T18:30:23.178 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:23.178 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.178 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.178 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:23.178 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.802295+0000", 2024-05-08T18:30:23.179 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:23.179 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.179 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.179 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:23.179 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.802296+0000", 2024-05-08T18:30:23.179 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.6700000000000002e-07 2024-05-08T18:30:23.179 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.179 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.179 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:23.179 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.802301+0000", 2024-05-08T18:30:23.179 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.0250000000000002e-06 2024-05-08T18:30:23.179 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.179 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.179 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:23.180 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.802321+0000", 2024-05-08T18:30:23.180 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9521000000000002e-05 2024-05-08T18:30:23.180 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.180 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.180 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:23.180 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.802330+0000", 2024-05-08T18:30:23.180 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.4259999999999992e-06 2024-05-08T18:30:23.180 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.180 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.180 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:23.180 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.802386+0000", 2024-05-08T18:30:23.180 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5974999999999999e-05 2024-05-08T18:30:23.180 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.180 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.181 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:23.181 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.802463+0000", 2024-05-08T18:30:23.181 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6582999999999995e-05 2024-05-08T18:30:23.181 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.181 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.181 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:23.181 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.802613+0000", 2024-05-08T18:30:23.181 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000150715 2024-05-08T18:30:23.181 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.181 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.181 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:23.181 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.803223+0000", 2024-05-08T18:30:23.181 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00060949799999999998 2024-05-08T18:30:23.182 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.182 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.182 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:23.182 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.805250+0000", 2024-05-08T18:30:23.182 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0020268339999999999 2024-05-08T18:30:23.182 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.182 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.182 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:23.182 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.805303+0000", 2024-05-08T18:30:23.182 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3562e-05 2024-05-08T18:30:23.182 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.182 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.182 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:23.182 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.805347+0000", 2024-05-08T18:30:23.183 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3682e-05 2024-05-08T18:30:23.183 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:23.183 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:23.183 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:23.183 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.183 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.183 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:422 6.c 6:338eb7e9:::obj_delete_at_hint.0000000008:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:23.183 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.847436+0000", 2024-05-08T18:30:23.183 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 31.284635152, 2024-05-08T18:30:23.183 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0029413439999999998, 2024-05-08T18:30:23.183 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:23.183 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:23.183 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:23.184 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:23.184 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:23.184 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:23.184 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 422 2024-05-08T18:30:23.184 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.184 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:23.184 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.184 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:23.184 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847436+0000", 2024-05-08T18:30:23.184 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:23.184 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.184 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.184 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:23.184 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847436+0000", 2024-05-08T18:30:23.185 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:23.185 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.185 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.185 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:23.185 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847437+0000", 2024-05-08T18:30:23.185 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.009e-06 2024-05-08T18:30:23.185 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.185 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.185 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:23.185 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847442+0000", 2024-05-08T18:30:23.185 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9049999999999996e-06 2024-05-08T18:30:23.185 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.185 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.185 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:23.186 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847454+0000", 2024-05-08T18:30:23.186 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1358e-05 2024-05-08T18:30:23.186 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.186 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.186 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:23.186 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847459+0000", 2024-05-08T18:30:23.186 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7180000000000001e-06 2024-05-08T18:30:23.186 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.186 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.186 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:23.186 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847516+0000", 2024-05-08T18:30:23.186 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6558999999999998e-05 2024-05-08T18:30:23.186 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.187 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.187 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:23.187 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847582+0000", 2024-05-08T18:30:23.187 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5772000000000007e-05 2024-05-08T18:30:23.187 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.187 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.187 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:23.187 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847718+0000", 2024-05-08T18:30:23.187 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013664100000000001 2024-05-08T18:30:23.187 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.187 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.187 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:23.187 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.848257+0000", 2024-05-08T18:30:23.187 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00053853699999999996 2024-05-08T18:30:23.188 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.188 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.188 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:23.188 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.850320+0000", 2024-05-08T18:30:23.188 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0020627530000000001 2024-05-08T18:30:23.188 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.188 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.188 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:23.188 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.850351+0000", 2024-05-08T18:30:23.188 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1501000000000002e-05 2024-05-08T18:30:23.188 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.188 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.188 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:23.188 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.850378+0000", 2024-05-08T18:30:23.189 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6591e-05 2024-05-08T18:30:23.189 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:23.189 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:23.189 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:23.189 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.189 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.189 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:535 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:23.189 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.912581+0000", 2024-05-08T18:30:23.189 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 31.219490092000001, 2024-05-08T18:30:23.189 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002943775, 2024-05-08T18:30:23.189 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:23.189 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:23.189 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:23.189 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:23.190 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:23.190 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:23.190 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 535 2024-05-08T18:30:23.190 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.190 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:23.190 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.190 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:23.190 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912581+0000", 2024-05-08T18:30:23.190 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:23.190 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.190 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.190 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:23.190 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912581+0000", 2024-05-08T18:30:23.190 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:23.191 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.191 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.191 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:23.191 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912582+0000", 2024-05-08T18:30:23.191 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.093e-06 2024-05-08T18:30:23.191 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.191 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.191 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:23.191 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912588+0000", 2024-05-08T18:30:23.191 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3920000000000002e-06 2024-05-08T18:30:23.191 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.191 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.191 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:23.192 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912601+0000", 2024-05-08T18:30:23.192 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2911000000000001e-05 2024-05-08T18:30:23.192 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.192 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.192 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:23.192 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912607+0000", 2024-05-08T18:30:23.192 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3960000000000003e-06 2024-05-08T18:30:23.192 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.192 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.192 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:23.192 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912664+0000", 2024-05-08T18:30:23.192 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6410999999999999e-05 2024-05-08T18:30:23.192 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.193 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.193 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:23.193 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912721+0000", 2024-05-08T18:30:23.193 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7141000000000001e-05 2024-05-08T18:30:23.193 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.193 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.193 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:23.193 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912842+0000", 2024-05-08T18:30:23.193 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000120868 2024-05-08T18:30:23.193 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.193 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.193 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:23.193 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.913333+0000", 2024-05-08T18:30:23.193 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00049123600000000004 2024-05-08T18:30:23.194 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.194 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.194 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:23.194 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.915446+0000", 2024-05-08T18:30:23.194 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0021135020000000002 2024-05-08T18:30:23.194 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.194 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.194 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:23.194 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.915481+0000", 2024-05-08T18:30:23.194 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4304999999999998e-05 2024-05-08T18:30:23.194 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.194 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.194 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:23.195 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.915525+0000", 2024-05-08T18:30:23.195 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4520000000000001e-05 2024-05-08T18:30:23.195 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:23.195 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:23.195 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:23.195 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.195 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.195 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:541 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:23.195 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.916718+0000", 2024-05-08T18:30:23.195 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 31.215353257, 2024-05-08T18:30:23.195 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0041779829999999997, 2024-05-08T18:30:23.195 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:23.195 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:23.196 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:23.196 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:23.196 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:23.196 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:23.196 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 541 2024-05-08T18:30:23.196 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.196 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:23.196 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.196 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:23.196 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.916718+0000", 2024-05-08T18:30:23.196 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:23.196 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.196 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.197 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:23.197 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.916718+0000", 2024-05-08T18:30:23.197 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:23.197 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.197 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.197 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:23.197 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.916719+0000", 2024-05-08T18:30:23.197 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0100000000000005e-07 2024-05-08T18:30:23.197 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.197 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.197 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:23.197 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.916722+0000", 2024-05-08T18:30:23.197 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7760000000000002e-06 2024-05-08T18:30:23.198 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.198 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.198 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:23.198 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.916729+0000", 2024-05-08T18:30:23.198 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.8290000000000008e-06 2024-05-08T18:30:23.198 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.198 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.198 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:23.198 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.916734+0000", 2024-05-08T18:30:23.198 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3109999999999999e-06 2024-05-08T18:30:23.198 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.198 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.198 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:23.198 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.916776+0000", 2024-05-08T18:30:23.199 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.2086999999999999e-05 2024-05-08T18:30:23.199 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.199 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.199 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:23.199 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.916824+0000", 2024-05-08T18:30:23.199 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8412999999999999e-05 2024-05-08T18:30:23.199 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.199 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.199 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:23.199 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.916929+0000", 2024-05-08T18:30:23.199 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010480900000000001 2024-05-08T18:30:23.199 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.199 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.199 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:23.200 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.917428+0000", 2024-05-08T18:30:23.200 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00049889599999999997 2024-05-08T18:30:23.200 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.200 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.200 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:23.200 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.920833+0000", 2024-05-08T18:30:23.200 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0034047140000000001 2024-05-08T18:30:23.200 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.200 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.200 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:23.200 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.920868+0000", 2024-05-08T18:30:23.200 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5750999999999997e-05 2024-05-08T18:30:23.200 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.200 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.201 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:23.201 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.920896+0000", 2024-05-08T18:30:23.201 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7796e-05 2024-05-08T18:30:23.201 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:23.201 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:23.201 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:23.201 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.201 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.201 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:778 6.1b 6:dc490aaa:::obj_delete_at_hint.0000000067:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:23.201 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.191226+0000", 2024-05-08T18:30:23.201 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 30.940844982000002, 2024-05-08T18:30:23.201 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0029603540000000001, 2024-05-08T18:30:23.201 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:23.201 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:23.202 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:23.202 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:23.202 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:23.202 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:23.202 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 778 2024-05-08T18:30:23.202 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.202 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:23.202 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.202 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:23.202 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.191226+0000", 2024-05-08T18:30:23.202 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:23.202 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.202 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.203 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:23.203 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.191226+0000", 2024-05-08T18:30:23.203 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:23.203 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.203 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.203 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:23.203 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.191229+0000", 2024-05-08T18:30:23.203 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5299999999999999e-06 2024-05-08T18:30:23.203 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.203 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.203 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:23.203 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.191242+0000", 2024-05-08T18:30:23.203 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2816999999999999e-05 2024-05-08T18:30:23.203 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.204 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.204 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:23.204 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.191274+0000", 2024-05-08T18:30:23.204 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1846e-05 2024-05-08T18:30:23.204 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.204 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.204 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:23.204 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.191288+0000", 2024-05-08T18:30:23.204 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.468e-05 2024-05-08T18:30:23.204 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.204 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.204 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:23.204 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.191468+0000", 2024-05-08T18:30:23.204 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00017983499999999999 2024-05-08T18:30:23.204 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.205 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.205 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:23.205 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.191688+0000", 2024-05-08T18:30:23.205 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021985799999999999 2024-05-08T18:30:23.205 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.205 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.205 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:30:23.205 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.192001+0000", 2024-05-08T18:30:23.205 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00031337800000000001 2024-05-08T18:30:23.205 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.205 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.205 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:23.205 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.193245+0000", 2024-05-08T18:30:23.206 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012436400000000001 2024-05-08T18:30:23.206 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.206 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.206 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:23.206 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.194036+0000", 2024-05-08T18:30:23.206 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00079059699999999998 2024-05-08T18:30:23.206 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.206 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.206 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:23.206 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.194121+0000", 2024-05-08T18:30:23.206 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5270000000000002e-05 2024-05-08T18:30:23.206 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.206 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.206 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:23.207 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.194187+0000", 2024-05-08T18:30:23.207 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5902999999999996e-05 2024-05-08T18:30:23.207 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:23.207 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:23.207 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:23.207 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.207 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.207 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:780 6.1b 6:dc490aaa:::obj_delete_at_hint.0000000067:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:23.207 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.195206+0000", 2024-05-08T18:30:23.207 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 30.936865012999998, 2024-05-08T18:30:23.207 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00291544, 2024-05-08T18:30:23.207 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:23.207 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:23.208 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:23.208 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:23.208 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:23.208 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:23.208 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 780 2024-05-08T18:30:23.208 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.208 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:23.208 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.208 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:23.208 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.195206+0000", 2024-05-08T18:30:23.208 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:23.208 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.208 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.209 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:23.209 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.195206+0000", 2024-05-08T18:30:23.209 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:23.209 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.209 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.209 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:23.209 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.195208+0000", 2024-05-08T18:30:23.209 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0669999999999999e-06 2024-05-08T18:30:23.209 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.209 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.209 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:23.209 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.195220+0000", 2024-05-08T18:30:23.209 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.131e-05 2024-05-08T18:30:23.209 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.210 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.210 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:23.210 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.195250+0000", 2024-05-08T18:30:23.210 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0562999999999999e-05 2024-05-08T18:30:23.210 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.210 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.210 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:23.210 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.195270+0000", 2024-05-08T18:30:23.210 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9989000000000001e-05 2024-05-08T18:30:23.210 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.210 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.210 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:23.210 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.195395+0000", 2024-05-08T18:30:23.211 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012439600000000001 2024-05-08T18:30:23.211 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.211 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.211 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:23.211 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.195523+0000", 2024-05-08T18:30:23.211 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012824900000000001 2024-05-08T18:30:23.211 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.211 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.211 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:30:23.211 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.195808+0000", 2024-05-08T18:30:23.211 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00028518100000000002 2024-05-08T18:30:23.211 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.211 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.211 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:23.212 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.196897+0000", 2024-05-08T18:30:23.212 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0010887850000000001 2024-05-08T18:30:23.212 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.212 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.212 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:23.212 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.197964+0000", 2024-05-08T18:30:23.212 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0010671789999999999 2024-05-08T18:30:23.212 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.212 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.212 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:23.212 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.198044+0000", 2024-05-08T18:30:23.212 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.9616000000000005e-05 2024-05-08T18:30:23.212 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.213 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.213 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:23.213 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.198122+0000", 2024-05-08T18:30:23.213 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.8104999999999998e-05 2024-05-08T18:30:23.213 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:23.213 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:23.213 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:23.213 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.213 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.213 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:826 6.6 6:64735f45:::obj_delete_at_hint.0000000083:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:23.213 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.299128+0000", 2024-05-08T18:30:23.213 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 30.832943934999999, 2024-05-08T18:30:23.213 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0029196479999999999, 2024-05-08T18:30:23.213 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:23.214 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:23.214 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:23.214 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:23.214 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:23.214 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:23.214 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 826 2024-05-08T18:30:23.214 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.214 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:23.214 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.214 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:23.214 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.299128+0000", 2024-05-08T18:30:23.214 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:23.214 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.215 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.215 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:23.215 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.299128+0000", 2024-05-08T18:30:23.215 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:23.215 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.215 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.215 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:23.215 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.299129+0000", 2024-05-08T18:30:23.215 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.711e-06 2024-05-08T18:30:23.215 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.215 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.215 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:23.215 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.299137+0000", 2024-05-08T18:30:23.216 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6650000000000003e-06 2024-05-08T18:30:23.216 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.216 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.216 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:23.216 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.299157+0000", 2024-05-08T18:30:23.216 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.02e-05 2024-05-08T18:30:23.216 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.216 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.216 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:23.216 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.299166+0000", 2024-05-08T18:30:23.216 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7530000000000007e-06 2024-05-08T18:30:23.216 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.216 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.217 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:23.217 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.299240+0000", 2024-05-08T18:30:23.217 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.4297999999999999e-05 2024-05-08T18:30:23.217 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.217 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.217 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:23.217 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.299444+0000", 2024-05-08T18:30:23.217 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00020382399999999999 2024-05-08T18:30:23.217 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.217 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.217 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:23.217 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.299777+0000", 2024-05-08T18:30:23.217 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00033331700000000002 2024-05-08T18:30:23.217 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.218 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.218 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:23.218 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.301060+0000", 2024-05-08T18:30:23.218 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012829569999999999 2024-05-08T18:30:23.218 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.218 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.218 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:23.218 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.301865+0000", 2024-05-08T18:30:23.218 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00080503400000000004 2024-05-08T18:30:23.218 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.218 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.218 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:23.219 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.301979+0000", 2024-05-08T18:30:23.219 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011324600000000001 2024-05-08T18:30:23.219 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.219 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.219 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:23.219 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.302047+0000", 2024-05-08T18:30:23.219 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8643e-05 2024-05-08T18:30:23.219 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:23.219 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:23.219 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:23.219 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.219 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.219 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:838 6.c 6:330b1641:::obj_delete_at_hint.0000000087:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:23.220 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.328043+0000", 2024-05-08T18:30:23.220 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 30.804028791, 2024-05-08T18:30:23.220 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031589180000000001, 2024-05-08T18:30:23.220 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:23.220 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:23.220 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:23.220 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:23.220 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:23.220 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:23.220 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 838 2024-05-08T18:30:23.220 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.220 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:23.220 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.221 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:23.221 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.328043+0000", 2024-05-08T18:30:23.221 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:23.221 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.221 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.221 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:23.221 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.328043+0000", 2024-05-08T18:30:23.221 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:23.221 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.221 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.221 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:23.221 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.328045+0000", 2024-05-08T18:30:23.221 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3760000000000002e-06 2024-05-08T18:30:23.222 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.222 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.222 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:23.222 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.328057+0000", 2024-05-08T18:30:23.222 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1534e-05 2024-05-08T18:30:23.222 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.222 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.222 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:23.222 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.328087+0000", 2024-05-08T18:30:23.222 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0870000000000001e-05 2024-05-08T18:30:23.222 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.222 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.222 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:23.223 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.328102+0000", 2024-05-08T18:30:23.223 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4679e-05 2024-05-08T18:30:23.223 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.223 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.223 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:23.223 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.328217+0000", 2024-05-08T18:30:23.223 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011519300000000001 2024-05-08T18:30:23.223 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.223 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.223 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:23.223 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.328446+0000", 2024-05-08T18:30:23.223 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00022893499999999999 2024-05-08T18:30:23.223 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.224 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.224 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:23.224 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.328770+0000", 2024-05-08T18:30:23.224 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00032349700000000001 2024-05-08T18:30:23.224 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.224 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.224 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:23.224 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.330008+0000", 2024-05-08T18:30:23.224 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001238404 2024-05-08T18:30:23.224 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.224 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.224 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:23.224 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.331026+0000", 2024-05-08T18:30:23.224 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001017612 2024-05-08T18:30:23.225 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.225 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.225 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:23.225 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.331117+0000", 2024-05-08T18:30:23.225 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0932000000000003e-05 2024-05-08T18:30:23.225 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.225 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.225 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:23.225 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.331202+0000", 2024-05-08T18:30:23.225 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.4886e-05 2024-05-08T18:30:23.225 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:23.225 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:23.225 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:23.225 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.226 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.226 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:850 6.6 6:624175ac:::obj_delete_at_hint.0000000091:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:23.226 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.356951+0000", 2024-05-08T18:30:23.226 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 30.775120703999999, 2024-05-08T18:30:23.226 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028779000000000001, 2024-05-08T18:30:23.226 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:23.226 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:23.226 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:23.226 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:23.226 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:23.226 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:23.226 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 850 2024-05-08T18:30:23.226 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.227 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:23.227 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.227 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:23.227 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.356951+0000", 2024-05-08T18:30:23.227 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:23.227 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.227 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.227 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:23.227 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.356951+0000", 2024-05-08T18:30:23.227 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:23.227 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.227 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.227 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:23.228 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.356953+0000", 2024-05-08T18:30:23.228 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.446e-06 2024-05-08T18:30:23.228 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.228 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.228 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:23.228 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.356965+0000", 2024-05-08T18:30:23.228 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1404e-05 2024-05-08T18:30:23.228 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.228 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.228 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:23.228 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.356994+0000", 2024-05-08T18:30:23.228 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9526000000000002e-05 2024-05-08T18:30:23.228 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.228 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.228 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:23.229 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.357009+0000", 2024-05-08T18:30:23.229 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5126000000000001e-05 2024-05-08T18:30:23.229 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.229 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.229 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:23.229 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.357126+0000", 2024-05-08T18:30:23.229 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000116989 2024-05-08T18:30:23.229 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.229 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.229 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:23.229 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.357349+0000", 2024-05-08T18:30:23.229 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00022298899999999999 2024-05-08T18:30:23.230 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.230 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.230 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:23.230 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.357665+0000", 2024-05-08T18:30:23.230 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00031592700000000003 2024-05-08T18:30:23.230 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.230 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.230 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:23.230 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.358771+0000", 2024-05-08T18:30:23.230 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001105595 2024-05-08T18:30:23.230 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.230 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.230 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:23.231 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.359672+0000", 2024-05-08T18:30:23.231 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00090080300000000004 2024-05-08T18:30:23.231 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.231 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.231 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:23.231 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.359762+0000", 2024-05-08T18:30:23.231 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0099000000000006e-05 2024-05-08T18:30:23.231 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.231 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.231 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:23.231 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.359829+0000", 2024-05-08T18:30:23.231 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6995999999999993e-05 2024-05-08T18:30:23.231 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:23.231 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:23.232 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:23.232 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.232 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.232 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:852 6.6 6:624175ac:::obj_delete_at_hint.0000000091:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:23.232 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.360655+0000", 2024-05-08T18:30:23.232 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 30.771416837, 2024-05-08T18:30:23.232 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028684650000000002, 2024-05-08T18:30:23.232 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:23.232 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:23.232 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:23.232 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:23.232 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:23.232 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:23.233 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 852 2024-05-08T18:30:23.233 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.233 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:23.233 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.233 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:23.233 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.360655+0000", 2024-05-08T18:30:23.233 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:23.233 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.233 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.233 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:23.233 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.360655+0000", 2024-05-08T18:30:23.233 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:23.233 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.234 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.234 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:23.234 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.360656+0000", 2024-05-08T18:30:23.234 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.457e-06 2024-05-08T18:30:23.234 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.234 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.234 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:23.234 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.360663+0000", 2024-05-08T18:30:23.234 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5429999999999999e-06 2024-05-08T18:30:23.234 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.234 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.234 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:23.234 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.360682+0000", 2024-05-08T18:30:23.234 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9020000000000001e-05 2024-05-08T18:30:23.235 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.235 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.235 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:23.235 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.360693+0000", 2024-05-08T18:30:23.235 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.114e-05 2024-05-08T18:30:23.235 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.235 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.235 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:23.235 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.360775+0000", 2024-05-08T18:30:23.235 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.2206000000000005e-05 2024-05-08T18:30:23.235 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.236 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.236 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:23.236 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.360899+0000", 2024-05-08T18:30:23.236 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000124206 2024-05-08T18:30:23.236 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.236 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.236 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:23.236 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.361162+0000", 2024-05-08T18:30:23.236 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00026328400000000002 2024-05-08T18:30:23.236 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.236 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.236 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:23.236 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.362180+0000", 2024-05-08T18:30:23.237 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0010175119999999999 2024-05-08T18:30:23.237 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.237 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.237 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:23.237 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.363368+0000", 2024-05-08T18:30:23.237 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001187991 2024-05-08T18:30:23.237 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.237 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.237 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:23.237 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.363456+0000", 2024-05-08T18:30:23.237 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8016999999999994e-05 2024-05-08T18:30:23.237 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.237 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.237 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:23.238 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.363523+0000", 2024-05-08T18:30:23.238 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7088999999999994e-05 2024-05-08T18:30:23.238 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:23.238 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:23.238 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:23.238 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.238 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.238 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:865 6.c 6:31288c1b:::obj_delete_at_hint.0000000096:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:23.238 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.392164+0000", 2024-05-08T18:30:23.238 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 30.739907735999999, 2024-05-08T18:30:23.238 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0029815470000000002, 2024-05-08T18:30:23.238 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:23.238 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:23.239 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:23.239 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:23.239 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:23.239 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:23.239 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 865 2024-05-08T18:30:23.239 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.239 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:23.239 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.239 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:23.239 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.392164+0000", 2024-05-08T18:30:23.239 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:23.239 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.239 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.239 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:23.240 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.392164+0000", 2024-05-08T18:30:23.240 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:23.240 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.240 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.240 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:23.240 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.392166+0000", 2024-05-08T18:30:23.240 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4059999999999999e-06 2024-05-08T18:30:23.240 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.240 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.240 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:23.240 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.392177+0000", 2024-05-08T18:30:23.240 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1260000000000001e-05 2024-05-08T18:30:23.240 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.240 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.241 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:23.241 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.392208+0000", 2024-05-08T18:30:23.241 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0484000000000002e-05 2024-05-08T18:30:23.241 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.241 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.241 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:23.241 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.392222+0000", 2024-05-08T18:30:23.241 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4343e-05 2024-05-08T18:30:23.241 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.241 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.241 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:23.241 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.392355+0000", 2024-05-08T18:30:23.241 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000132602 2024-05-08T18:30:23.241 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.242 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.242 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:23.242 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.392565+0000", 2024-05-08T18:30:23.242 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000210442 2024-05-08T18:30:23.242 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.242 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.242 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:23.242 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.392874+0000", 2024-05-08T18:30:23.242 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00030868099999999999 2024-05-08T18:30:23.242 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.242 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.242 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:23.242 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.394087+0000", 2024-05-08T18:30:23.242 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012133300000000001 2024-05-08T18:30:23.243 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.243 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.243 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:23.243 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.394976+0000", 2024-05-08T18:30:23.243 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000888977 2024-05-08T18:30:23.243 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.243 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.243 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:23.243 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.395068+0000", 2024-05-08T18:30:23.243 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.2188999999999994e-05 2024-05-08T18:30:23.243 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.243 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.243 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:23.244 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.395145+0000", 2024-05-08T18:30:23.244 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6833000000000001e-05 2024-05-08T18:30:23.244 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:23.244 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:23.244 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:23.244 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.244 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.244 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:871 6.11 6:8d7f253a:::obj_delete_at_hint.0000000098:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:23.244 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.405724+0000", 2024-05-08T18:30:23.244 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 30.726347180000001, 2024-05-08T18:30:23.244 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0030012530000000002, 2024-05-08T18:30:23.244 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:23.244 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:23.244 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:23.245 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:23.245 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:23.245 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:23.245 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 871 2024-05-08T18:30:23.245 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.245 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:23.245 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.245 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:23.245 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.405724+0000", 2024-05-08T18:30:23.245 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:23.245 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.245 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.245 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:23.245 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.405724+0000", 2024-05-08T18:30:23.246 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:23.246 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.246 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.246 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:23.246 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.405726+0000", 2024-05-08T18:30:23.246 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1299999999999999e-06 2024-05-08T18:30:23.246 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.246 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.246 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:23.246 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.405737+0000", 2024-05-08T18:30:23.246 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0763e-05 2024-05-08T18:30:23.246 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.247 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.247 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:23.247 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.405762+0000", 2024-05-08T18:30:23.247 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5323000000000001e-05 2024-05-08T18:30:23.247 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.247 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.247 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:23.247 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.405776+0000", 2024-05-08T18:30:23.247 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3862999999999999e-05 2024-05-08T18:30:23.247 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.247 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.247 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:23.247 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.405928+0000", 2024-05-08T18:30:23.247 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015190000000000001 2024-05-08T18:30:23.247 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.248 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.248 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:23.248 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.406159+0000", 2024-05-08T18:30:23.248 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023114399999999999 2024-05-08T18:30:23.248 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.248 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.248 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:23.248 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.406453+0000", 2024-05-08T18:30:23.248 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00029329699999999998 2024-05-08T18:30:23.248 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.248 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.248 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:23.248 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.408103+0000", 2024-05-08T18:30:23.248 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0016499869999999999 2024-05-08T18:30:23.249 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.249 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.249 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:23.249 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.408520+0000", 2024-05-08T18:30:23.249 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00041694099999999999 2024-05-08T18:30:23.249 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.249 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.249 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:23.249 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.408606+0000", 2024-05-08T18:30:23.249 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6809000000000002e-05 2024-05-08T18:30:23.249 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.249 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.249 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:23.249 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.408726+0000", 2024-05-08T18:30:23.250 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000119096 2024-05-08T18:30:23.250 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:23.250 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:23.250 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:23.250 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.250 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.250 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:934 6.11 6:8cd774bc:::obj_delete_at_hint.0000000119:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:23.250 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.550387+0000", 2024-05-08T18:30:23.250 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 30.581684227, 2024-05-08T18:30:23.250 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0033028739999999999, 2024-05-08T18:30:23.250 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:23.250 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:23.250 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:23.250 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:23.251 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:23.251 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:23.251 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 934 2024-05-08T18:30:23.251 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.251 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:23.251 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.251 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:23.251 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.550387+0000", 2024-05-08T18:30:23.251 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:23.251 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.251 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.251 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:23.251 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.550387+0000", 2024-05-08T18:30:23.251 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:23.251 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.252 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.252 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:23.252 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.550390+0000", 2024-05-08T18:30:23.252 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.706e-06 2024-05-08T18:30:23.252 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.252 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.252 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:23.252 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.550401+0000", 2024-05-08T18:30:23.252 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1437000000000001e-05 2024-05-08T18:30:23.252 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.252 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.252 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:23.252 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.550433+0000", 2024-05-08T18:30:23.253 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2005999999999998e-05 2024-05-08T18:30:23.253 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.253 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.253 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:23.253 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.550448+0000", 2024-05-08T18:30:23.253 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5007e-05 2024-05-08T18:30:23.253 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.253 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.253 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:23.253 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.550607+0000", 2024-05-08T18:30:23.253 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000158288 2024-05-08T18:30:23.253 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.253 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.253 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:23.254 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.550974+0000", 2024-05-08T18:30:23.254 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00036768400000000001 2024-05-08T18:30:23.254 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.254 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.254 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:23.254 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.551516+0000", 2024-05-08T18:30:23.254 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00054126900000000004 2024-05-08T18:30:23.254 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.254 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.254 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:23.254 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.552847+0000", 2024-05-08T18:30:23.254 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0013308899999999999 2024-05-08T18:30:23.254 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.254 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.255 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:23.255 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.553531+0000", 2024-05-08T18:30:23.255 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00068438799999999997 2024-05-08T18:30:23.255 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.255 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.255 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:23.255 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.553621+0000", 2024-05-08T18:30:23.255 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9779999999999998e-05 2024-05-08T18:30:23.255 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:23.255 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:23.255 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:23.255 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.553690+0000", 2024-05-08T18:30:23.255 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9418999999999994e-05 2024-05-08T18:30:23.255 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:23.255 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:23.256 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:23.256 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:23.256 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:23.256 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:30:23.257 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-08T18:30:23.258 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:30:23.257+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:30:23.281 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2024-05-08T18:30:23.281 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:30:23.298 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2024-05-08T18:30:23.298 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:30:23.315 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2024-05-08T18:30:23.315 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:30:23.332 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2024-05-08T18:30:23.332 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:30:23.353 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2024-05-08T18:30:23.354 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:30:23.358 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:30:23.361+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:30:23.373 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2024-05-08T18:30:23.374 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:30:23.391 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:23.392 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:23.395 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2024-05-08T18:30:23.395 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:30:23.406 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-08T18:30:23.415 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2024-05-08T18:30:23.416 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:30:23.459 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:30:23.455+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:30:23.529 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:23.529 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:23.543 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-08T18:30:23.561 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:30:23.561+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:30:23.661 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:30:23.661+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:30:23.704 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:23.705 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:23.719 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-08T18:30:23.764 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:30:23.763+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:30:23.836 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:23.836 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:23.850 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-08T18:30:23.864 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:30:23.865+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:30:23.891 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-08T18:30:23.965 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:30:23.963+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:30:24.014 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:24.014 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:24.028 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-08T18:30:24.065 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:30:24.069+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:30:24.167 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:30:24.163+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:30:24.195 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:24.195 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:24.209 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-08T18:30:24.296 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:30:24.295+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:30:24.369 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:30:24.367+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:30:24.378 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:24.378 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:24.392 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-08T18:30:24.480 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:30:24.479+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:30:24.560 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:24.560 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:24.571 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:30:24.573+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:30:24.574 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-08T18:30:24.672 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:30:24.673+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:30:24.742 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:24.742 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:24.756 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-08T18:30:24.773 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:30:24.773+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:30:24.875 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:30:24.871+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:30:24.880 INFO:teuthology.orchestra.run.smithi097.stderr:noscrub is set 2024-05-08T18:30:24.881 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:24.881 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:24.896 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-08T18:30:24.984 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:30:24.983+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:30:25.067 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:25.067 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:25.075 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:30:25.071+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:30:25.081 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-08T18:30:25.176 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:30:25.177+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:30:25.248 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:25.249 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:25.263 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-08T18:30:25.277 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:30:25.275+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:30:25.377 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:30:25.375+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:30:25.393 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:25.393 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:25.407 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-08T18:30:25.436 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-08T18:30:25.498 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:30:25.501+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:30:25.533 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:25.533 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:25.548 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-08T18:30:25.590 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:30:25.593+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:30:25.600 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2024-05-08T18:30:25.600 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:30:25.617 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2024-05-08T18:30:25.617 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:30:25.634 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2024-05-08T18:30:25.634 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:30:25.654 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2024-05-08T18:30:25.654 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:30:25.675 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2024-05-08T18:30:25.675 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:30:25.680 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:30:25.675+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:30:25.695 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2024-05-08T18:30:25.696 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:30:25.708 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:30:25.709 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2024-05-08T18:30:25.709 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2024-05-08T18:30:25.709 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-05-08T18:30:25.709 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.709 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4206.0:24 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'14, mlcod=16'9)", 2024-05-08T18:30:25.709 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:27.162224+0000", 2024-05-08T18:30:25.709 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 58.546696304000001, 2024-05-08T18:30:25.709 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032712890000000001, 2024-05-08T18:30:25.709 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:25.709 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:25.709 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:25.709 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:25.709 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.710 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:25.710 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162224+0000", 2024-05-08T18:30:25.710 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:25.710 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.710 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.710 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:25.710 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162224+0000", 2024-05-08T18:30:25.710 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:25.710 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.711 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.711 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:25.711 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162225+0000", 2024-05-08T18:30:25.711 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4899999999999999e-06 2024-05-08T18:30:25.711 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.711 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.711 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:25.711 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162306+0000", 2024-05-08T18:30:25.711 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.0589999999999999e-05 2024-05-08T18:30:25.711 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.711 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.711 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:25.711 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162332+0000", 2024-05-08T18:30:25.712 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5658999999999999e-05 2024-05-08T18:30:25.712 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.712 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.712 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:25.712 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162345+0000", 2024-05-08T18:30:25.712 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3512999999999999e-05 2024-05-08T18:30:25.712 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.712 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.712 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:25.712 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162465+0000", 2024-05-08T18:30:25.712 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000119577 2024-05-08T18:30:25.712 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.712 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.712 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:25.712 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162513+0000", 2024-05-08T18:30:25.713 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8773999999999998e-05 2024-05-08T18:30:25.713 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.713 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.713 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:25.713 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.165405+0000", 2024-05-08T18:30:25.713 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028919200000000001 2024-05-08T18:30:25.713 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.713 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.713 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:25.713 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.165495+0000", 2024-05-08T18:30:25.713 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9765999999999994e-05 2024-05-08T18:30:25.713 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:25.713 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:25.714 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:25.714 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.714 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.714 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4206.0:25 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'15, mlcod=16'10)", 2024-05-08T18:30:25.714 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:27.164793+0000", 2024-05-08T18:30:25.714 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 58.544127176000003, 2024-05-08T18:30:25.714 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032285249999999999, 2024-05-08T18:30:25.714 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:25.714 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:25.714 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:25.714 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:25.714 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.714 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:25.714 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164793+0000", 2024-05-08T18:30:25.715 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:25.715 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.715 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.715 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:25.715 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164793+0000", 2024-05-08T18:30:25.715 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:25.715 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.715 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.715 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:25.715 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164795+0000", 2024-05-08T18:30:25.715 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0999999999999998e-06 2024-05-08T18:30:25.715 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.715 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.715 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:25.716 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164811+0000", 2024-05-08T18:30:25.716 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5722999999999998e-05 2024-05-08T18:30:25.716 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.716 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.716 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:25.716 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164841+0000", 2024-05-08T18:30:25.716 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0355999999999999e-05 2024-05-08T18:30:25.716 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.716 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.716 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:25.716 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164861+0000", 2024-05-08T18:30:25.716 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9533000000000001e-05 2024-05-08T18:30:25.716 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.716 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.717 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:25.717 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164984+0000", 2024-05-08T18:30:25.717 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000123146 2024-05-08T18:30:25.717 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.717 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.717 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:25.717 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.165024+0000", 2024-05-08T18:30:25.717 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9690000000000001e-05 2024-05-08T18:30:25.717 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.717 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.717 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:25.717 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.167935+0000", 2024-05-08T18:30:25.717 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0029113300000000002 2024-05-08T18:30:25.718 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.718 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.718 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:25.718 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.168021+0000", 2024-05-08T18:30:25.718 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6646999999999999e-05 2024-05-08T18:30:25.718 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:25.718 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:25.718 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:25.718 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.718 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.718 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:30:25.718 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:48.674737+0000", 2024-05-08T18:30:25.718 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 37.034183257999999, 2024-05-08T18:30:25.719 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0035019780000000002, 2024-05-08T18:30:25.719 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:25.719 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:25.719 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:25.719 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:25.719 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:25.719 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:25.719 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 60 2024-05-08T18:30:25.719 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.719 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:25.719 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.719 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:25.719 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674737+0000", 2024-05-08T18:30:25.719 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:25.720 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.720 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.720 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:25.720 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674737+0000", 2024-05-08T18:30:25.720 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:25.720 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.720 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.720 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:25.720 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674740+0000", 2024-05-08T18:30:25.720 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.36e-06 2024-05-08T18:30:25.720 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.720 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.720 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:25.720 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674753+0000", 2024-05-08T18:30:25.721 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3151e-05 2024-05-08T18:30:25.721 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.721 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.721 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:25.721 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674789+0000", 2024-05-08T18:30:25.721 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5929000000000001e-05 2024-05-08T18:30:25.721 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.721 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.721 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:25.721 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674813+0000", 2024-05-08T18:30:25.721 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3325000000000001e-05 2024-05-08T18:30:25.721 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.721 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.722 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:25.722 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674981+0000", 2024-05-08T18:30:25.722 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016879899999999999 2024-05-08T18:30:25.722 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.722 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.722 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:25.722 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.675304+0000", 2024-05-08T18:30:25.722 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00032214400000000001 2024-05-08T18:30:25.722 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.722 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.722 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:25.722 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.675639+0000", 2024-05-08T18:30:25.722 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00033494699999999999 2024-05-08T18:30:25.723 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.723 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.723 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:25.723 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.676901+0000", 2024-05-08T18:30:25.723 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001262167 2024-05-08T18:30:25.723 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.723 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.723 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:25.723 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678078+0000", 2024-05-08T18:30:25.723 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001177588 2024-05-08T18:30:25.723 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.723 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.723 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:25.723 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678171+0000", 2024-05-08T18:30:25.724 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.2331999999999996e-05 2024-05-08T18:30:25.724 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.724 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.724 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:25.724 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678239+0000", 2024-05-08T18:30:25.724 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8236000000000002e-05 2024-05-08T18:30:25.724 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:25.724 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:25.724 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:25.724 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.724 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.724 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:61 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94069412632064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:30:25.724 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:48.678410+0000", 2024-05-08T18:30:25.725 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 37.030509866000003, 2024-05-08T18:30:25.725 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0026001800000000001, 2024-05-08T18:30:25.725 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:25.725 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:25.725 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:25.725 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:25.725 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:25.725 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:25.725 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 61 2024-05-08T18:30:25.725 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.725 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:25.725 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.725 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:25.725 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678410+0000", 2024-05-08T18:30:25.726 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:25.726 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.726 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.726 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:25.726 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678410+0000", 2024-05-08T18:30:25.726 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:25.726 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.726 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.726 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:25.726 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678413+0000", 2024-05-08T18:30:25.726 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.34e-06 2024-05-08T18:30:25.726 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.726 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.727 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:25.727 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678421+0000", 2024-05-08T18:30:25.727 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6910000000000003e-06 2024-05-08T18:30:25.727 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.727 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.727 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:25.727 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678447+0000", 2024-05-08T18:30:25.727 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6010999999999999e-05 2024-05-08T18:30:25.727 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.727 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.727 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:25.727 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678461+0000", 2024-05-08T18:30:25.727 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3900000000000001e-05 2024-05-08T18:30:25.728 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.728 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.728 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:25.728 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678560+0000", 2024-05-08T18:30:25.728 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.8834999999999998e-05 2024-05-08T18:30:25.728 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.728 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.728 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:25.728 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678704+0000", 2024-05-08T18:30:25.728 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000143769 2024-05-08T18:30:25.728 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.728 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.728 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:25.729 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678942+0000", 2024-05-08T18:30:25.729 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023861800000000001 2024-05-08T18:30:25.729 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.729 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.729 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:25.729 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.680269+0000", 2024-05-08T18:30:25.729 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001326484 2024-05-08T18:30:25.729 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.729 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.730 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:25.730 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.680823+0000", 2024-05-08T18:30:25.730 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00055455900000000004 2024-05-08T18:30:25.730 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.730 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.730 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:25.730 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.680908+0000", 2024-05-08T18:30:25.730 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.4073999999999995e-05 2024-05-08T18:30:25.730 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.730 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.730 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:25.730 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.681010+0000", 2024-05-08T18:30:25.730 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010289900000000001 2024-05-08T18:30:25.731 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:25.731 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:25.731 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:25.731 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.731 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.731 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:30:25.731 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.671896+0000", 2024-05-08T18:30:25.731 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 34.037023980999997, 2024-05-08T18:30:25.731 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032352349999999999, 2024-05-08T18:30:25.731 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:25.731 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:25.731 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:25.731 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:25.732 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:25.732 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:25.732 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 206 2024-05-08T18:30:25.732 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.732 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:25.732 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.732 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:25.732 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671896+0000", 2024-05-08T18:30:25.732 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:25.732 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.732 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.732 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:25.732 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671896+0000", 2024-05-08T18:30:25.732 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:25.733 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.733 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.733 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:25.733 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671901+0000", 2024-05-08T18:30:25.733 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.763e-06 2024-05-08T18:30:25.733 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.733 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.733 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:25.733 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671920+0000", 2024-05-08T18:30:25.733 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9403e-05 2024-05-08T18:30:25.733 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.733 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.733 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:25.733 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671969+0000", 2024-05-08T18:30:25.734 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8343000000000001e-05 2024-05-08T18:30:25.734 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.734 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.734 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:25.734 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671996+0000", 2024-05-08T18:30:25.734 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7307000000000001e-05 2024-05-08T18:30:25.734 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.734 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.734 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:25.734 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.672149+0000", 2024-05-08T18:30:25.734 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015336500000000001 2024-05-08T18:30:25.734 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.734 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.735 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:25.735 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.672393+0000", 2024-05-08T18:30:25.735 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024380800000000001 2024-05-08T18:30:25.735 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.735 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.735 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:25.735 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.672838+0000", 2024-05-08T18:30:25.735 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00044472700000000001 2024-05-08T18:30:25.735 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.735 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.735 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:25.735 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.674218+0000", 2024-05-08T18:30:25.735 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001380243 2024-05-08T18:30:25.736 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.736 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.736 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:25.736 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.674963+0000", 2024-05-08T18:30:25.736 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00074534999999999998 2024-05-08T18:30:25.736 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.736 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.736 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:25.736 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675057+0000", 2024-05-08T18:30:25.736 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.3633000000000003e-05 2024-05-08T18:30:25.736 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.736 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.736 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:25.736 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675131+0000", 2024-05-08T18:30:25.737 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.4293000000000002e-05 2024-05-08T18:30:25.737 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:25.737 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:25.737 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:25.737 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.737 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.737 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:25.737 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.694194+0000", 2024-05-08T18:30:25.737 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 34.014726582999998, 2024-05-08T18:30:25.737 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0087385129999999998, 2024-05-08T18:30:25.737 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:25.737 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:25.737 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:25.738 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:25.738 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:25.738 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:25.738 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 210 2024-05-08T18:30:25.738 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.738 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:25.738 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.738 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:25.738 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694194+0000", 2024-05-08T18:30:25.738 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:25.738 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.738 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.738 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:25.739 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694194+0000", 2024-05-08T18:30:25.739 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:25.739 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.739 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.739 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:25.739 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694196+0000", 2024-05-08T18:30:25.739 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6299999999999998e-06 2024-05-08T18:30:25.739 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.739 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.739 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:25.739 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694208+0000", 2024-05-08T18:30:25.739 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.187e-05 2024-05-08T18:30:25.739 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.740 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.740 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:25.740 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694240+0000", 2024-05-08T18:30:25.740 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1673e-05 2024-05-08T18:30:25.740 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.740 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.740 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:25.740 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694255+0000", 2024-05-08T18:30:25.740 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5573000000000002e-05 2024-05-08T18:30:25.740 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.740 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.740 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:25.740 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694394+0000", 2024-05-08T18:30:25.741 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000138536 2024-05-08T18:30:25.741 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.741 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.741 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-05-08T18:30:25.741 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694405+0000", 2024-05-08T18:30:25.741 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0883000000000001e-05 2024-05-08T18:30:25.741 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.741 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.741 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:25.741 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.699491+0000", 2024-05-08T18:30:25.741 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0050861939999999996 2024-05-08T18:30:25.741 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.741 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.741 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:25.742 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.699829+0000", 2024-05-08T18:30:25.742 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000338191 2024-05-08T18:30:25.742 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.742 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.742 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:30:25.742 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.700504+0000", 2024-05-08T18:30:25.742 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000674481 2024-05-08T18:30:25.742 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.742 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.742 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:25.742 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.702152+0000", 2024-05-08T18:30:25.742 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0016487450000000001 2024-05-08T18:30:25.743 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.743 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.743 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:25.743 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.702792+0000", 2024-05-08T18:30:25.743 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00063962800000000005 2024-05-08T18:30:25.743 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.743 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.743 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:25.743 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.702874+0000", 2024-05-08T18:30:25.743 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.2091999999999999e-05 2024-05-08T18:30:25.743 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.743 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.743 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:25.743 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.702932+0000", 2024-05-08T18:30:25.744 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8016999999999997e-05 2024-05-08T18:30:25.744 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:25.744 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:25.744 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:25.744 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.744 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.744 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:25.744 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.728239+0000", 2024-05-08T18:30:25.744 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 33.980680722000002, 2024-05-08T18:30:25.744 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0035376119999999999, 2024-05-08T18:30:25.744 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:25.744 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:25.744 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:25.745 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:25.745 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:25.745 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:25.745 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 218 2024-05-08T18:30:25.745 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.745 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:25.745 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.745 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:25.745 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728239+0000", 2024-05-08T18:30:25.745 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:25.745 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.745 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.745 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:25.745 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728239+0000", 2024-05-08T18:30:25.746 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:25.746 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.746 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.746 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:25.746 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728242+0000", 2024-05-08T18:30:25.746 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0130000000000002e-06 2024-05-08T18:30:25.746 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.746 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.746 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:25.746 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728254+0000", 2024-05-08T18:30:25.746 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.172e-05 2024-05-08T18:30:25.746 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.746 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.747 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:25.747 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728285+0000", 2024-05-08T18:30:25.747 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0703000000000001e-05 2024-05-08T18:30:25.747 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.747 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.747 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:25.747 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728301+0000", 2024-05-08T18:30:25.747 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5656999999999999e-05 2024-05-08T18:30:25.747 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.747 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.747 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:25.747 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728460+0000", 2024-05-08T18:30:25.747 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015934200000000001 2024-05-08T18:30:25.747 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.748 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.748 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:25.748 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728803+0000", 2024-05-08T18:30:25.748 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00034267400000000001 2024-05-08T18:30:25.748 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.748 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.748 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:25.748 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.729485+0000", 2024-05-08T18:30:25.748 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00068206799999999998 2024-05-08T18:30:25.748 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.748 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.748 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:25.748 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731218+0000", 2024-05-08T18:30:25.748 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0017332630000000001 2024-05-08T18:30:25.749 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.749 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.749 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:25.749 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731615+0000", 2024-05-08T18:30:25.749 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00039671699999999999 2024-05-08T18:30:25.749 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.749 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.749 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:25.749 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731709+0000", 2024-05-08T18:30:25.749 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.4740000000000004e-05 2024-05-08T18:30:25.749 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.749 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.749 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:25.749 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731777+0000", 2024-05-08T18:30:25.750 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7714999999999998e-05 2024-05-08T18:30:25.750 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:25.750 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:25.750 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:25.750 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.750 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.750 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:25.750 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.743331+0000", 2024-05-08T18:30:25.750 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 33.965588738999998, 2024-05-08T18:30:25.750 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031193229999999998, 2024-05-08T18:30:25.750 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:25.750 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:25.750 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:25.750 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:25.751 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:25.751 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:25.751 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 222 2024-05-08T18:30:25.751 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.751 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:25.751 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.751 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:25.751 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743331+0000", 2024-05-08T18:30:25.751 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:25.751 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.751 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.751 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:25.751 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743331+0000", 2024-05-08T18:30:25.751 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:25.752 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.752 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.752 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:25.752 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743334+0000", 2024-05-08T18:30:25.752 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2900000000000001e-06 2024-05-08T18:30:25.752 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.752 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.752 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:25.752 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743345+0000", 2024-05-08T18:30:25.752 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0947e-05 2024-05-08T18:30:25.752 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.752 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.752 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:25.752 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743375+0000", 2024-05-08T18:30:25.753 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0298999999999999e-05 2024-05-08T18:30:25.753 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.753 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.753 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:25.753 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743390+0000", 2024-05-08T18:30:25.753 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4606999999999999e-05 2024-05-08T18:30:25.753 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.753 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.753 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:25.753 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743524+0000", 2024-05-08T18:30:25.753 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000134105 2024-05-08T18:30:25.753 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.753 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.753 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:25.754 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743738+0000", 2024-05-08T18:30:25.754 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000214222 2024-05-08T18:30:25.754 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.754 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.754 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:30:25.754 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.744159+0000", 2024-05-08T18:30:25.754 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00042102300000000002 2024-05-08T18:30:25.754 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.754 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.754 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:25.754 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.745399+0000", 2024-05-08T18:30:25.754 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012400309999999999 2024-05-08T18:30:25.754 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.754 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.755 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:25.755 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.746296+0000", 2024-05-08T18:30:25.755 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00089682 2024-05-08T18:30:25.755 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.755 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.755 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:25.755 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.746385+0000", 2024-05-08T18:30:25.755 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9289000000000005e-05 2024-05-08T18:30:25.755 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.755 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.755 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:25.755 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.746451+0000", 2024-05-08T18:30:25.755 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5690000000000003e-05 2024-05-08T18:30:25.755 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:25.756 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:25.756 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:25.756 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.756 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.756 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:25.756 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.772338+0000", 2024-05-08T18:30:25.756 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 33.936582539, 2024-05-08T18:30:25.756 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0035084059999999999, 2024-05-08T18:30:25.756 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:25.756 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:25.756 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:25.756 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:25.756 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:25.756 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:25.757 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 230 2024-05-08T18:30:25.757 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.757 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:25.757 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.757 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:25.757 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772338+0000", 2024-05-08T18:30:25.757 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:25.757 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.757 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.757 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:25.757 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772338+0000", 2024-05-08T18:30:25.757 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:25.757 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.757 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.758 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:25.758 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772340+0000", 2024-05-08T18:30:25.758 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3460000000000001e-06 2024-05-08T18:30:25.758 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.758 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.758 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:25.758 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772352+0000", 2024-05-08T18:30:25.758 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2284e-05 2024-05-08T18:30:25.758 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.758 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.758 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:25.758 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772382+0000", 2024-05-08T18:30:25.758 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0083e-05 2024-05-08T18:30:25.759 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.759 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.759 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:25.759 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772397+0000", 2024-05-08T18:30:25.759 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4963000000000001e-05 2024-05-08T18:30:25.759 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.759 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.759 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:25.759 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772508+0000", 2024-05-08T18:30:25.759 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000110402 2024-05-08T18:30:25.759 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.759 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.759 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:25.759 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772742+0000", 2024-05-08T18:30:25.759 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023428899999999999 2024-05-08T18:30:25.760 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.760 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.760 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:30:25.760 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.773183+0000", 2024-05-08T18:30:25.760 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00044107899999999998 2024-05-08T18:30:25.760 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.760 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.760 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:25.760 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.774488+0000", 2024-05-08T18:30:25.760 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0013053940000000001 2024-05-08T18:30:25.760 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.760 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.760 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:25.760 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.775689+0000", 2024-05-08T18:30:25.761 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012004699999999999 2024-05-08T18:30:25.761 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.761 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.761 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:25.761 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.775777+0000", 2024-05-08T18:30:25.761 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8483e-05 2024-05-08T18:30:25.761 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.761 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.761 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:25.761 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.775846+0000", 2024-05-08T18:30:25.761 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8613000000000002e-05 2024-05-08T18:30:25.761 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:25.761 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:25.761 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:25.762 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.762 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.762 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:25.762 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.790921+0000", 2024-05-08T18:30:25.762 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 33.917999193, 2024-05-08T18:30:25.762 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003116869, 2024-05-08T18:30:25.762 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:25.762 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:25.762 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:25.762 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:25.762 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:25.762 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:25.762 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 235 2024-05-08T18:30:25.762 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.763 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:25.763 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.763 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:25.763 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790921+0000", 2024-05-08T18:30:25.763 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:25.763 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.763 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.763 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:25.763 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790921+0000", 2024-05-08T18:30:25.763 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:25.763 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.763 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.763 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:25.764 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790923+0000", 2024-05-08T18:30:25.764 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3199999999999998e-06 2024-05-08T18:30:25.764 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.764 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.764 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:25.764 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790934+0000", 2024-05-08T18:30:25.764 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.117e-05 2024-05-08T18:30:25.764 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.764 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.764 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:25.764 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790965+0000", 2024-05-08T18:30:25.764 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0392999999999999e-05 2024-05-08T18:30:25.764 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.764 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.765 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:25.765 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790981+0000", 2024-05-08T18:30:25.765 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5699999999999999e-05 2024-05-08T18:30:25.765 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.765 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.765 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:25.765 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.791093+0000", 2024-05-08T18:30:25.765 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000112062 2024-05-08T18:30:25.765 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.765 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.765 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:25.765 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.791324+0000", 2024-05-08T18:30:25.765 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023142200000000001 2024-05-08T18:30:25.766 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.766 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.766 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:25.766 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.791761+0000", 2024-05-08T18:30:25.766 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00043669999999999999 2024-05-08T18:30:25.766 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.766 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.766 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:25.766 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.792996+0000", 2024-05-08T18:30:25.766 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001235713 2024-05-08T18:30:25.766 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.766 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.766 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:25.766 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.793850+0000", 2024-05-08T18:30:25.767 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00085392400000000005 2024-05-08T18:30:25.767 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.767 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.767 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:25.767 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.793971+0000", 2024-05-08T18:30:25.767 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000120516 2024-05-08T18:30:25.767 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.767 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.767 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:25.767 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794038+0000", 2024-05-08T18:30:25.767 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6948999999999999e-05 2024-05-08T18:30:25.767 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:25.767 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:25.767 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:25.768 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.768 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.768 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:349 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:25.768 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.817315+0000", 2024-05-08T18:30:25.768 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 33.891605321999997, 2024-05-08T18:30:25.768 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0036888580000000002, 2024-05-08T18:30:25.768 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:25.768 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:25.768 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:25.768 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:25.768 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:25.768 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:25.768 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 349 2024-05-08T18:30:25.768 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.769 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:25.769 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.769 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:25.769 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817315+0000", 2024-05-08T18:30:25.769 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:25.769 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.769 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.769 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:25.769 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817315+0000", 2024-05-08T18:30:25.769 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:25.769 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.769 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.769 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:25.769 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817316+0000", 2024-05-08T18:30:25.770 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3370000000000001e-06 2024-05-08T18:30:25.770 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.770 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.770 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:25.770 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817323+0000", 2024-05-08T18:30:25.770 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.4300000000000003e-06 2024-05-08T18:30:25.770 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.770 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.770 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:25.770 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817337+0000", 2024-05-08T18:30:25.770 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4025999999999999e-05 2024-05-08T18:30:25.770 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.770 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.771 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:25.771 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817345+0000", 2024-05-08T18:30:25.771 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5669999999999995e-06 2024-05-08T18:30:25.771 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.771 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.771 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:25.771 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817407+0000", 2024-05-08T18:30:25.771 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1882000000000001e-05 2024-05-08T18:30:25.771 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.771 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.771 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:25.771 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817508+0000", 2024-05-08T18:30:25.771 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000100585 2024-05-08T18:30:25.772 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.772 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.772 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:25.772 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817673+0000", 2024-05-08T18:30:25.772 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000165802 2024-05-08T18:30:25.772 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.772 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.772 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:25.772 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.818715+0000", 2024-05-08T18:30:25.772 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0010417720000000001 2024-05-08T18:30:25.772 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.772 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.772 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:25.772 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.820892+0000", 2024-05-08T18:30:25.772 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0021771859999999998 2024-05-08T18:30:25.773 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.773 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.773 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:25.773 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.820950+0000", 2024-05-08T18:30:25.773 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7636000000000002e-05 2024-05-08T18:30:25.773 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.773 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.773 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:25.773 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.821004+0000", 2024-05-08T18:30:25.773 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3634999999999997e-05 2024-05-08T18:30:25.773 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:25.773 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:25.773 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:25.773 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.774 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.774 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:406 6.16 6:6dc3b799:reshard::reshard.0000000006:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:25.774 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.840465+0000", 2024-05-08T18:30:25.774 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 33.868455156000003, 2024-05-08T18:30:25.774 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003613032, 2024-05-08T18:30:25.774 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:25.774 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:25.774 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:25.774 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:25.774 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:25.774 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:25.774 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 406 2024-05-08T18:30:25.774 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.775 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:25.775 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.775 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:25.775 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840465+0000", 2024-05-08T18:30:25.775 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:25.775 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.775 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.775 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:25.775 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840465+0000", 2024-05-08T18:30:25.775 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:25.775 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.775 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.775 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:25.775 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840466+0000", 2024-05-08T18:30:25.775 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7499999999999999e-07 2024-05-08T18:30:25.776 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.776 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.776 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:25.776 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840471+0000", 2024-05-08T18:30:25.776 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9699999999999998e-06 2024-05-08T18:30:25.776 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.776 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.776 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:25.776 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840484+0000", 2024-05-08T18:30:25.776 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2717999999999999e-05 2024-05-08T18:30:25.776 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.776 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.776 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:25.777 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840490+0000", 2024-05-08T18:30:25.777 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.472e-06 2024-05-08T18:30:25.777 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.777 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.777 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:25.777 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840536+0000", 2024-05-08T18:30:25.777 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6409000000000002e-05 2024-05-08T18:30:25.777 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.777 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.777 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:25.777 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840591+0000", 2024-05-08T18:30:25.777 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4911000000000003e-05 2024-05-08T18:30:25.777 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.777 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.777 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:30:25.778 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840745+0000", 2024-05-08T18:30:25.778 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015394900000000001 2024-05-08T18:30:25.778 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.778 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.778 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:25.778 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.841269+0000", 2024-05-08T18:30:25.778 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00052347299999999999 2024-05-08T18:30:25.778 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.778 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.778 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:25.778 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.843997+0000", 2024-05-08T18:30:25.778 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0027285080000000001 2024-05-08T18:30:25.778 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.779 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.779 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:25.779 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844033+0000", 2024-05-08T18:30:25.779 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6038000000000003e-05 2024-05-08T18:30:25.779 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.779 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.779 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:25.779 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844078+0000", 2024-05-08T18:30:25.779 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4709000000000002e-05 2024-05-08T18:30:25.779 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:25.779 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:25.779 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:25.779 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.779 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.780 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:413 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:25.780 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.844187+0000", 2024-05-08T18:30:25.780 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 33.864733579000003, 2024-05-08T18:30:25.780 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0024835069999999998, 2024-05-08T18:30:25.780 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:25.780 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:25.780 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:25.780 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:25.780 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:25.780 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:25.780 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 413 2024-05-08T18:30:25.780 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.780 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:25.780 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.781 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:25.781 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844187+0000", 2024-05-08T18:30:25.781 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:25.781 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.781 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.781 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:25.781 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844187+0000", 2024-05-08T18:30:25.781 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:25.781 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.781 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.781 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:25.781 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844187+0000", 2024-05-08T18:30:25.781 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9999999999999996e-07 2024-05-08T18:30:25.782 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.782 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.782 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:25.782 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844192+0000", 2024-05-08T18:30:25.782 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7899999999999999e-06 2024-05-08T18:30:25.782 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.782 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.782 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:25.782 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844203+0000", 2024-05-08T18:30:25.782 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1002000000000001e-05 2024-05-08T18:30:25.782 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.782 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.782 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:25.783 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844209+0000", 2024-05-08T18:30:25.783 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6570000000000002e-06 2024-05-08T18:30:25.783 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.783 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.783 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:25.783 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844270+0000", 2024-05-08T18:30:25.783 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0810999999999998e-05 2024-05-08T18:30:25.783 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.783 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.783 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:25.783 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844419+0000", 2024-05-08T18:30:25.783 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000149097 2024-05-08T18:30:25.783 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.784 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.784 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:30:25.784 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844611+0000", 2024-05-08T18:30:25.784 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00019247900000000001 2024-05-08T18:30:25.784 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.784 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.784 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:25.784 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.845287+0000", 2024-05-08T18:30:25.784 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00067526000000000001 2024-05-08T18:30:25.784 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.784 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.784 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:25.784 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.846609+0000", 2024-05-08T18:30:25.784 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001322124 2024-05-08T18:30:25.785 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.785 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.785 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:25.785 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.846642+0000", 2024-05-08T18:30:25.785 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3654e-05 2024-05-08T18:30:25.785 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.785 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.785 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:25.785 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.846670+0000", 2024-05-08T18:30:25.785 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7733e-05 2024-05-08T18:30:25.785 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:25.785 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:25.785 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:25.785 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.786 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.786 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:420 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:25.786 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.847096+0000", 2024-05-08T18:30:25.786 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 33.861824284999997, 2024-05-08T18:30:25.786 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0026261589999999999, 2024-05-08T18:30:25.786 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:25.786 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:25.786 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:25.786 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:25.786 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:25.786 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:25.786 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 420 2024-05-08T18:30:25.786 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.787 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:25.787 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.787 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:25.787 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847096+0000", 2024-05-08T18:30:25.787 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:25.787 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.787 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.787 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:25.787 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847096+0000", 2024-05-08T18:30:25.787 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:25.787 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.787 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.787 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:25.788 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847097+0000", 2024-05-08T18:30:25.788 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.5499999999999996e-07 2024-05-08T18:30:25.788 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.788 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.788 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:25.788 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847103+0000", 2024-05-08T18:30:25.788 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8969999999999996e-06 2024-05-08T18:30:25.788 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.788 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.788 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:25.788 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847114+0000", 2024-05-08T18:30:25.788 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1549000000000001e-05 2024-05-08T18:30:25.788 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.788 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.789 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:25.789 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847120+0000", 2024-05-08T18:30:25.789 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5509999999999999e-06 2024-05-08T18:30:25.789 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.789 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.789 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:25.789 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847166+0000", 2024-05-08T18:30:25.789 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6683e-05 2024-05-08T18:30:25.789 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.789 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.789 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:25.789 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847213+0000", 2024-05-08T18:30:25.789 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6659000000000002e-05 2024-05-08T18:30:25.789 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.790 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.790 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:30:25.790 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847315+0000", 2024-05-08T18:30:25.790 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000102336 2024-05-08T18:30:25.790 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.790 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.790 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:25.790 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847840+0000", 2024-05-08T18:30:25.790 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00052475000000000004 2024-05-08T18:30:25.790 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.790 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.790 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:25.790 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.849660+0000", 2024-05-08T18:30:25.791 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001819563 2024-05-08T18:30:25.791 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.791 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.791 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:25.791 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.849695+0000", 2024-05-08T18:30:25.791 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4761000000000001e-05 2024-05-08T18:30:25.791 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.791 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.791 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:25.791 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.849722+0000", 2024-05-08T18:30:25.791 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7455000000000001e-05 2024-05-08T18:30:25.791 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:25.791 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:25.792 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:25.792 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.792 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.792 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:532 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:25.792 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.908603+0000", 2024-05-08T18:30:25.792 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 33.800316735000003, 2024-05-08T18:30:25.792 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0038838950000000001, 2024-05-08T18:30:25.792 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:25.792 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:25.792 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:25.792 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:25.792 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:25.792 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:25.792 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 532 2024-05-08T18:30:25.793 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.793 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:25.793 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.793 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:25.793 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908603+0000", 2024-05-08T18:30:25.793 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:25.793 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.793 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.793 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:25.793 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908603+0000", 2024-05-08T18:30:25.793 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:25.793 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.793 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.793 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:25.794 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908605+0000", 2024-05-08T18:30:25.794 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1179999999999999e-06 2024-05-08T18:30:25.794 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.794 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.794 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:25.794 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908608+0000", 2024-05-08T18:30:25.794 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7419999999999999e-06 2024-05-08T18:30:25.794 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.794 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.794 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:25.794 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908618+0000", 2024-05-08T18:30:25.794 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.6889999999999999e-06 2024-05-08T18:30:25.794 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.794 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.795 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:25.795 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908625+0000", 2024-05-08T18:30:25.795 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1300000000000003e-06 2024-05-08T18:30:25.795 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.795 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.795 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:25.795 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908669+0000", 2024-05-08T18:30:25.795 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3832000000000003e-05 2024-05-08T18:30:25.795 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.795 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.795 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:25.795 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908724+0000", 2024-05-08T18:30:25.795 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5222000000000001e-05 2024-05-08T18:30:25.795 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.796 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.796 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:30:25.796 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908854+0000", 2024-05-08T18:30:25.796 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012953500000000001 2024-05-08T18:30:25.796 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.796 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.796 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:25.796 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.909511+0000", 2024-05-08T18:30:25.796 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00065768399999999996 2024-05-08T18:30:25.796 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.796 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.796 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:25.796 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912426+0000", 2024-05-08T18:30:25.797 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0029146599999999999 2024-05-08T18:30:25.797 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.797 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.797 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:25.797 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912461+0000", 2024-05-08T18:30:25.797 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4934999999999997e-05 2024-05-08T18:30:25.797 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.797 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.797 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:25.797 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912487+0000", 2024-05-08T18:30:25.797 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6347999999999999e-05 2024-05-08T18:30:25.797 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:25.797 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:25.797 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:25.798 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.798 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.798 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:534 6.9 6:9268b73e:::obj_delete_at_hint.0000000019:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:25.798 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.910153+0000", 2024-05-08T18:30:25.798 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 33.798767278, 2024-05-08T18:30:25.798 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0051089680000000002, 2024-05-08T18:30:25.798 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:25.798 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:25.798 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:25.798 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:25.798 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:25.798 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:25.798 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 534 2024-05-08T18:30:25.798 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.799 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:25.799 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.799 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:25.799 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910153+0000", 2024-05-08T18:30:25.799 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:25.799 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.799 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.799 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:25.799 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910153+0000", 2024-05-08T18:30:25.799 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:25.799 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.799 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.799 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:25.800 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910154+0000", 2024-05-08T18:30:25.800 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1039999999999999e-06 2024-05-08T18:30:25.800 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.800 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.800 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:25.800 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910158+0000", 2024-05-08T18:30:25.800 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7400000000000002e-06 2024-05-08T18:30:25.800 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.800 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.800 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:25.800 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910167+0000", 2024-05-08T18:30:25.800 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8880000000000003e-06 2024-05-08T18:30:25.800 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.800 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.801 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:25.801 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910173+0000", 2024-05-08T18:30:25.801 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.844e-06 2024-05-08T18:30:25.801 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.801 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.801 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:25.801 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910220+0000", 2024-05-08T18:30:25.801 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6582000000000002e-05 2024-05-08T18:30:25.801 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.801 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.801 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:25.801 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910287+0000", 2024-05-08T18:30:25.801 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7271e-05 2024-05-08T18:30:25.801 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.802 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.802 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:30:25.802 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910402+0000", 2024-05-08T18:30:25.802 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115127 2024-05-08T18:30:25.802 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.802 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.802 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:25.802 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910881+0000", 2024-05-08T18:30:25.802 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000479025 2024-05-08T18:30:25.802 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.802 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.802 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:25.802 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.915206+0000", 2024-05-08T18:30:25.803 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.004324357 2024-05-08T18:30:25.803 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.803 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.803 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:25.803 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.915237+0000", 2024-05-08T18:30:25.803 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1590000000000001e-05 2024-05-08T18:30:25.803 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.803 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.803 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:25.803 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.915262+0000", 2024-05-08T18:30:25.803 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.444e-05 2024-05-08T18:30:25.803 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:25.803 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:25.803 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:25.804 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.804 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.804 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:583 6.0 6:03bbb29a:::obj_delete_at_hint.0000000026:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:25.804 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.947199+0000", 2024-05-08T18:30:25.804 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 33.761721080999997, 2024-05-08T18:30:25.804 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0025081510000000001, 2024-05-08T18:30:25.804 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:25.804 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:25.804 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:25.804 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:25.804 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:25.804 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:25.804 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 583 2024-05-08T18:30:25.804 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.805 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:25.805 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.805 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:25.805 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947199+0000", 2024-05-08T18:30:25.805 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:25.805 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.805 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.805 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:25.805 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947199+0000", 2024-05-08T18:30:25.805 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:25.805 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.805 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.805 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:25.805 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947200+0000", 2024-05-08T18:30:25.806 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3799999999999997e-07 2024-05-08T18:30:25.806 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.806 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.806 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:25.806 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947207+0000", 2024-05-08T18:30:25.806 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2030000000000003e-06 2024-05-08T18:30:25.806 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.806 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.806 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:25.806 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947217+0000", 2024-05-08T18:30:25.806 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0138e-05 2024-05-08T18:30:25.806 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.806 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.807 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:25.807 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947224+0000", 2024-05-08T18:30:25.807 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5289999999999997e-06 2024-05-08T18:30:25.807 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.807 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.807 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:25.807 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.948039+0000", 2024-05-08T18:30:25.807 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00081500599999999996 2024-05-08T18:30:25.807 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.807 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.807 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:25.807 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.948230+0000", 2024-05-08T18:30:25.807 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000191838 2024-05-08T18:30:25.807 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.808 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.808 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:25.808 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.948606+0000", 2024-05-08T18:30:25.808 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00037547900000000001 2024-05-08T18:30:25.808 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.808 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.808 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:25.808 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.949406+0000", 2024-05-08T18:30:25.808 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000799674 2024-05-08T18:30:25.808 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.808 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.808 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:25.808 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.949630+0000", 2024-05-08T18:30:25.808 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00022474699999999999 2024-05-08T18:30:25.809 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.809 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.809 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:25.809 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.949664+0000", 2024-05-08T18:30:25.809 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3535999999999999e-05 2024-05-08T18:30:25.809 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.809 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.809 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:25.809 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.949707+0000", 2024-05-08T18:30:25.809 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3362999999999998e-05 2024-05-08T18:30:25.809 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:25.809 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:25.809 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:25.809 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.810 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.810 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:25.810 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.263796+0000", 2024-05-08T18:30:25.810 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 33.445123813000002, 2024-05-08T18:30:25.810 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0027788019999999999, 2024-05-08T18:30:25.810 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:25.810 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:25.810 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:25.810 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:25.810 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:25.810 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:25.810 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 811 2024-05-08T18:30:25.810 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.811 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:25.811 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.811 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:25.811 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263796+0000", 2024-05-08T18:30:25.811 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:25.811 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.811 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.811 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:25.811 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263796+0000", 2024-05-08T18:30:25.811 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:25.811 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.811 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.812 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:25.812 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263799+0000", 2024-05-08T18:30:25.812 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5569999999999998e-06 2024-05-08T18:30:25.812 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.812 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.812 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:25.812 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263812+0000", 2024-05-08T18:30:25.812 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3145999999999999e-05 2024-05-08T18:30:25.812 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.812 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.812 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:25.812 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263842+0000", 2024-05-08T18:30:25.812 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0193e-05 2024-05-08T18:30:25.812 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.813 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.813 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:25.813 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263860+0000", 2024-05-08T18:30:25.813 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7880000000000002e-05 2024-05-08T18:30:25.813 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.813 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.813 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:25.813 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263979+0000", 2024-05-08T18:30:25.813 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011919899999999999 2024-05-08T18:30:25.813 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.813 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.813 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:25.813 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.264222+0000", 2024-05-08T18:30:25.814 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024290800000000001 2024-05-08T18:30:25.814 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.814 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.814 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:25.814 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.264545+0000", 2024-05-08T18:30:25.814 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00032300200000000002 2024-05-08T18:30:25.814 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.814 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.814 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:25.814 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.265682+0000", 2024-05-08T18:30:25.814 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001136464 2024-05-08T18:30:25.814 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.814 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.814 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:25.815 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.266397+0000", 2024-05-08T18:30:25.815 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00071512799999999999 2024-05-08T18:30:25.815 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.815 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.815 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:25.815 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.266504+0000", 2024-05-08T18:30:25.815 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000107019 2024-05-08T18:30:25.815 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.815 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.815 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:25.815 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.266575+0000", 2024-05-08T18:30:25.815 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1305999999999998e-05 2024-05-08T18:30:25.815 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:25.815 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:25.816 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:25.816 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.816 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.816 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:25.816 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.445706+0000", 2024-05-08T18:30:25.816 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 33.263214097000002, 2024-05-08T18:30:25.816 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0026820630000000002, 2024-05-08T18:30:25.816 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:25.816 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:25.816 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:25.816 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:25.816 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:25.816 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:25.816 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 889 2024-05-08T18:30:25.817 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.817 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:25.817 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.817 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:25.817 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445706+0000", 2024-05-08T18:30:25.817 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:25.817 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.817 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.817 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:25.818 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445706+0000", 2024-05-08T18:30:25.818 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:25.818 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.818 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.818 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:25.818 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445709+0000", 2024-05-08T18:30:25.818 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0299999999999998e-06 2024-05-08T18:30:25.818 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.818 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.818 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:25.818 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445721+0000", 2024-05-08T18:30:25.818 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2366e-05 2024-05-08T18:30:25.818 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.819 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.819 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:25.819 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445752+0000", 2024-05-08T18:30:25.819 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0287e-05 2024-05-08T18:30:25.819 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.819 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.819 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:25.819 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445773+0000", 2024-05-08T18:30:25.819 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1367000000000001e-05 2024-05-08T18:30:25.819 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.819 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.819 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:25.819 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445892+0000", 2024-05-08T18:30:25.819 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000119311 2024-05-08T18:30:25.820 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.820 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.820 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:25.820 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.446158+0000", 2024-05-08T18:30:25.820 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000265441 2024-05-08T18:30:25.820 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.820 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.820 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:25.820 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.446465+0000", 2024-05-08T18:30:25.820 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00030754300000000002 2024-05-08T18:30:25.820 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.820 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.820 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:25.820 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.447511+0000", 2024-05-08T18:30:25.821 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001045975 2024-05-08T18:30:25.821 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.821 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.821 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:25.821 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.448171+0000", 2024-05-08T18:30:25.821 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00065971200000000002 2024-05-08T18:30:25.821 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.821 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.821 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:25.821 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.448273+0000", 2024-05-08T18:30:25.821 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000101592 2024-05-08T18:30:25.821 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.821 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.821 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:25.822 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.448388+0000", 2024-05-08T18:30:25.822 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115439 2024-05-08T18:30:25.822 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:25.822 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:25.822 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:25.822 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.822 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.822 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1020 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_add in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-05-08T18:30:25.822 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:30:21.842276+0000", 2024-05-08T18:30:25.822 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 3.8666445559999998, 2024-05-08T18:30:25.822 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0025898760000000001, 2024-05-08T18:30:25.822 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:25.822 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:25.823 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:25.823 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:25.823 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:25.823 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:25.823 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1020 2024-05-08T18:30:25.823 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.823 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:25.823 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.823 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:25.823 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842276+0000", 2024-05-08T18:30:25.823 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:25.823 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.823 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.823 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:25.824 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842276+0000", 2024-05-08T18:30:25.824 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:25.824 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.824 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.824 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:25.824 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842278+0000", 2024-05-08T18:30:25.824 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6129999999999998e-06 2024-05-08T18:30:25.824 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.824 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.824 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:25.824 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842290+0000", 2024-05-08T18:30:25.824 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2187999999999999e-05 2024-05-08T18:30:25.824 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.825 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.825 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:25.825 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842319+0000", 2024-05-08T18:30:25.825 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8782e-05 2024-05-08T18:30:25.825 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.825 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.825 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:25.825 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842336+0000", 2024-05-08T18:30:25.825 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6826000000000001e-05 2024-05-08T18:30:25.825 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.825 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.825 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:25.825 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842450+0000", 2024-05-08T18:30:25.825 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000113829 2024-05-08T18:30:25.826 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.826 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.826 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:25.826 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842627+0000", 2024-05-08T18:30:25.826 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00017756599999999999 2024-05-08T18:30:25.826 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.826 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.826 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:25.826 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842794+0000", 2024-05-08T18:30:25.826 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000166866 2024-05-08T18:30:25.826 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.826 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.826 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:25.826 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.843540+0000", 2024-05-08T18:30:25.827 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00074611700000000003 2024-05-08T18:30:25.827 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.827 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.827 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:25.827 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.844762+0000", 2024-05-08T18:30:25.827 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012220309999999999 2024-05-08T18:30:25.827 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.827 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.827 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:25.827 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.844806+0000", 2024-05-08T18:30:25.827 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3414000000000001e-05 2024-05-08T18:30:25.827 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:25.827 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:25.828 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:25.828 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.844865+0000", 2024-05-08T18:30:25.828 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9644e-05 2024-05-08T18:30:25.828 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:25.828 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:25.828 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:25.828 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:25.828 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:25.828 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:30:25.829 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2024-05-08T18:30:25.829 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:30:25.830 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-08T18:30:25.831 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2024-05-08T18:30:25.832 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:30:25.832 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:30:25.833+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:30:25.930 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:30:25.927+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:30:26.001 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:30:26.001 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:30:26.002 INFO:teuthology.orchestra.run.smithi097.stdout: "num_ops": 0 2024-05-08T18:30:26.002 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:30:26.016 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-08T18:30:26.031 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:30:26.027+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:30:26.132 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:30:26.131+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:30:26.138 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:30:26.138 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:30:26.138 INFO:teuthology.orchestra.run.smithi097.stdout: "complaint_time": 30, 2024-05-08T18:30:26.139 INFO:teuthology.orchestra.run.smithi097.stdout: "num_blocked_ops": 0 2024-05-08T18:30:26.139 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:30:26.153 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-08T18:30:26.233 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:30:26.231+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:30:26.280 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:30:26.280 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2024-05-08T18:30:26.280 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2024-05-08T18:30:26.280 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-05-08T18:30:26.280 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.280 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4479.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-05-08T18:30:26.280 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:44.576320+0000", 2024-05-08T18:30:26.280 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 41.703238593999998, 2024-05-08T18:30:26.280 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019751892, 2024-05-08T18:30:26.280 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:26.281 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:26.281 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "reached pg", 2024-05-08T18:30:26.281 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:26.281 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4479", 2024-05-08T18:30:26.281 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3577501689", 2024-05-08T18:30:26.281 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 2 2024-05-08T18:30:26.281 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.281 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:26.281 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.281 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:26.281 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576320+0000", 2024-05-08T18:30:26.281 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:26.281 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.281 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.282 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:26.282 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576320+0000", 2024-05-08T18:30:26.282 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:26.282 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.282 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.282 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:26.282 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576323+0000", 2024-05-08T18:30:26.282 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.813e-06 2024-05-08T18:30:26.282 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.282 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.282 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:26.282 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576335+0000", 2024-05-08T18:30:26.282 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2330000000000001e-05 2024-05-08T18:30:26.283 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.283 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.283 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:26.283 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576367+0000", 2024-05-08T18:30:26.283 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2036999999999998e-05 2024-05-08T18:30:26.283 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.283 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.283 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:26.283 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576394+0000", 2024-05-08T18:30:26.283 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6529e-05 2024-05-08T18:30:26.283 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.283 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.283 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:26.283 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576550+0000", 2024-05-08T18:30:26.284 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000156718 2024-05-08T18:30:26.284 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.284 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.284 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-05-08T18:30:26.284 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576560+0000", 2024-05-08T18:30:26.284 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0040999999999999e-05 2024-05-08T18:30:26.284 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.284 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.284 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:26.284 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.587240+0000", 2024-05-08T18:30:26.284 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010679266999999999 2024-05-08T18:30:26.284 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.284 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.284 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2024-05-08T18:30:26.285 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.587266+0000", 2024-05-08T18:30:26.285 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6642e-05 2024-05-08T18:30:26.285 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.285 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.285 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:26.285 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.595882+0000", 2024-05-08T18:30:26.285 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0086159600000000006 2024-05-08T18:30:26.285 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.285 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.285 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:26.285 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.596072+0000", 2024-05-08T18:30:26.285 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000189555 2024-05-08T18:30:26.285 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:26.285 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:26.286 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:26.286 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.286 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.286 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:30:26.286 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:48.766182+0000", 2024-05-08T18:30:26.286 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 37.513376567000002, 2024-05-08T18:30:26.286 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031881209999999999, 2024-05-08T18:30:26.286 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:26.286 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:26.286 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:26.286 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:26.286 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:26.286 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:26.287 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 193 2024-05-08T18:30:26.287 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.287 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:26.287 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.287 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:26.287 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766182+0000", 2024-05-08T18:30:26.287 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:26.287 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.287 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.287 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:26.287 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766182+0000", 2024-05-08T18:30:26.287 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:26.287 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.287 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.288 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:26.288 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766184+0000", 2024-05-08T18:30:26.288 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4159999999999998e-06 2024-05-08T18:30:26.288 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.288 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.288 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:26.288 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766196+0000", 2024-05-08T18:30:26.288 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1814000000000001e-05 2024-05-08T18:30:26.288 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.288 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.288 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:26.288 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766227+0000", 2024-05-08T18:30:26.288 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0676000000000002e-05 2024-05-08T18:30:26.288 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.289 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.289 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:26.289 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766242+0000", 2024-05-08T18:30:26.289 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5497000000000001e-05 2024-05-08T18:30:26.289 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.289 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.289 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:26.289 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766354+0000", 2024-05-08T18:30:26.289 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000111579 2024-05-08T18:30:26.289 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.289 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.289 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:26.289 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766569+0000", 2024-05-08T18:30:26.289 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000214978 2024-05-08T18:30:26.289 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.290 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.290 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:26.290 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766834+0000", 2024-05-08T18:30:26.290 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00026551500000000002 2024-05-08T18:30:26.290 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.290 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.290 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:26.290 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.768577+0000", 2024-05-08T18:30:26.290 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001742513 2024-05-08T18:30:26.290 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.290 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.290 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:26.290 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.769150+0000", 2024-05-08T18:30:26.291 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00057320500000000003 2024-05-08T18:30:26.291 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.291 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.291 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:26.291 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.769250+0000", 2024-05-08T18:30:26.291 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.9846000000000006e-05 2024-05-08T18:30:26.291 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.291 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.291 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:26.291 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.769370+0000", 2024-05-08T18:30:26.292 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012008200000000001 2024-05-08T18:30:26.292 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:26.292 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:26.292 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:26.292 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.292 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.292 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:26.292 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.679562+0000", 2024-05-08T18:30:26.292 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 34.599996863000001, 2024-05-08T18:30:26.292 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0086320800000000003, 2024-05-08T18:30:26.292 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:26.292 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:26.292 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:26.292 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:26.293 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:26.293 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:26.293 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 208 2024-05-08T18:30:26.293 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.293 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:26.293 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.293 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:26.293 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679562+0000", 2024-05-08T18:30:26.293 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:26.293 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.293 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.293 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:26.293 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679562+0000", 2024-05-08T18:30:26.293 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:26.294 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.294 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.294 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:26.294 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679565+0000", 2024-05-08T18:30:26.294 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0800000000000002e-06 2024-05-08T18:30:26.294 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.294 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.294 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:26.294 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679578+0000", 2024-05-08T18:30:26.294 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3217000000000001e-05 2024-05-08T18:30:26.294 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.294 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.294 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:26.295 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679610+0000", 2024-05-08T18:30:26.295 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1696000000000003e-05 2024-05-08T18:30:26.295 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.295 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.295 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:26.295 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679625+0000", 2024-05-08T18:30:26.295 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5824e-05 2024-05-08T18:30:26.295 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.295 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.295 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:26.295 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679758+0000", 2024-05-08T18:30:26.295 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013231199999999999 2024-05-08T18:30:26.295 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.295 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.296 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-05-08T18:30:26.296 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679770+0000", 2024-05-08T18:30:26.296 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1800000000000001e-05 2024-05-08T18:30:26.296 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.296 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.296 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:26.296 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.685241+0000", 2024-05-08T18:30:26.296 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0054710169999999999 2024-05-08T18:30:26.296 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.297 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.297 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:26.297 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.685444+0000", 2024-05-08T18:30:26.297 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000203835 2024-05-08T18:30:26.297 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.297 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.297 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:26.297 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.685842+0000", 2024-05-08T18:30:26.297 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00039773 2024-05-08T18:30:26.297 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.297 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.298 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:26.298 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.687232+0000", 2024-05-08T18:30:26.298 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00139011 2024-05-08T18:30:26.298 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.298 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.298 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:26.298 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.688049+0000", 2024-05-08T18:30:26.298 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00081667000000000003 2024-05-08T18:30:26.298 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.298 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.298 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:26.299 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.688135+0000", 2024-05-08T18:30:26.299 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6299999999999997e-05 2024-05-08T18:30:26.299 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.299 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.299 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:26.299 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.688194+0000", 2024-05-08T18:30:26.299 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8489000000000002e-05 2024-05-08T18:30:26.299 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:26.299 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:26.299 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:26.299 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.300 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.300 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:26.300 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.707114+0000", 2024-05-08T18:30:26.300 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 34.572444849, 2024-05-08T18:30:26.300 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031802990000000001, 2024-05-08T18:30:26.300 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:26.300 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:26.300 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:26.300 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:26.301 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:26.301 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:26.301 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 212 2024-05-08T18:30:26.301 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.301 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:26.301 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.301 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:26.301 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707114+0000", 2024-05-08T18:30:26.301 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:26.301 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.302 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.302 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:26.302 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707114+0000", 2024-05-08T18:30:26.302 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:26.302 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.302 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.302 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:26.302 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707117+0000", 2024-05-08T18:30:26.302 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8629999999999999e-06 2024-05-08T18:30:26.302 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.302 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.303 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:26.303 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707129+0000", 2024-05-08T18:30:26.303 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2150000000000001e-05 2024-05-08T18:30:26.303 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.303 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.303 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:26.303 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707158+0000", 2024-05-08T18:30:26.303 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9513999999999999e-05 2024-05-08T18:30:26.303 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.303 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.303 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:26.303 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707173+0000", 2024-05-08T18:30:26.304 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5136e-05 2024-05-08T18:30:26.304 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.304 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.304 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:26.304 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707309+0000", 2024-05-08T18:30:26.304 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000135609 2024-05-08T18:30:26.304 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.304 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.304 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:26.304 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707523+0000", 2024-05-08T18:30:26.304 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021362200000000001 2024-05-08T18:30:26.304 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.305 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.305 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:26.305 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707918+0000", 2024-05-08T18:30:26.305 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00039556299999999998 2024-05-08T18:30:26.305 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.305 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.305 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:26.305 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.709166+0000", 2024-05-08T18:30:26.305 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012476410000000001 2024-05-08T18:30:26.305 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.305 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.306 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:26.306 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.710145+0000", 2024-05-08T18:30:26.306 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00097909899999999998 2024-05-08T18:30:26.306 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.306 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.306 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:26.306 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.710231+0000", 2024-05-08T18:30:26.306 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5625999999999996e-05 2024-05-08T18:30:26.306 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.306 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.306 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:26.306 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.710294+0000", 2024-05-08T18:30:26.307 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3476e-05 2024-05-08T18:30:26.307 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:26.307 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:26.307 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:26.307 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.307 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.307 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:26.307 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.731985+0000", 2024-05-08T18:30:26.307 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 34.547573624000002, 2024-05-08T18:30:26.307 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0039250600000000002, 2024-05-08T18:30:26.307 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:26.307 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:26.308 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:26.308 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:26.308 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:26.308 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:26.308 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 219 2024-05-08T18:30:26.308 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.308 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:26.308 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.308 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:26.308 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731985+0000", 2024-05-08T18:30:26.308 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:26.308 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.309 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.309 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:26.309 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731985+0000", 2024-05-08T18:30:26.309 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:26.309 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.309 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.309 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:26.309 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731988+0000", 2024-05-08T18:30:26.309 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6599999999999999e-06 2024-05-08T18:30:26.309 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.309 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.310 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:26.310 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.732017+0000", 2024-05-08T18:30:26.310 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9692999999999998e-05 2024-05-08T18:30:26.310 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.310 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.310 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:26.310 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.732048+0000", 2024-05-08T18:30:26.310 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1066999999999999e-05 2024-05-08T18:30:26.310 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.310 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.310 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:26.311 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.732064+0000", 2024-05-08T18:30:26.311 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5786000000000001e-05 2024-05-08T18:30:26.311 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.311 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.311 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:26.311 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.732213+0000", 2024-05-08T18:30:26.311 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014895899999999999 2024-05-08T18:30:26.311 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.311 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.311 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:26.311 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.732572+0000", 2024-05-08T18:30:26.312 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000358904 2024-05-08T18:30:26.312 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.312 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.312 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:26.312 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.733349+0000", 2024-05-08T18:30:26.312 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00077657699999999997 2024-05-08T18:30:26.312 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.312 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.312 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:26.312 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.734899+0000", 2024-05-08T18:30:26.312 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001550652 2024-05-08T18:30:26.313 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.313 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.313 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:26.313 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.735641+0000", 2024-05-08T18:30:26.313 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00074222000000000003 2024-05-08T18:30:26.313 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.313 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.313 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:26.313 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.735801+0000", 2024-05-08T18:30:26.313 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015913599999999999 2024-05-08T18:30:26.313 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.313 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.314 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:26.314 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.735910+0000", 2024-05-08T18:30:26.314 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000109406 2024-05-08T18:30:26.314 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:26.314 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:26.314 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:26.314 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.314 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.314 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:26.314 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.750251+0000", 2024-05-08T18:30:26.314 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 34.529307692000003, 2024-05-08T18:30:26.315 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0038408600000000002, 2024-05-08T18:30:26.315 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:26.315 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:26.315 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:26.315 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:26.315 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:26.315 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:26.315 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 224 2024-05-08T18:30:26.315 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.315 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:26.315 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.316 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:26.316 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750251+0000", 2024-05-08T18:30:26.316 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:26.316 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.316 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.316 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:26.316 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750251+0000", 2024-05-08T18:30:26.316 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:26.316 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.316 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.316 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:26.316 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750253+0000", 2024-05-08T18:30:26.317 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2129999999999998e-06 2024-05-08T18:30:26.317 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.317 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.317 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:26.317 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750265+0000", 2024-05-08T18:30:26.317 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1484000000000001e-05 2024-05-08T18:30:26.317 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.317 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.317 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:26.317 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750293+0000", 2024-05-08T18:30:26.317 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8673000000000001e-05 2024-05-08T18:30:26.317 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.318 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.318 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:26.318 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750308+0000", 2024-05-08T18:30:26.318 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4620000000000001e-05 2024-05-08T18:30:26.318 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.318 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.318 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:26.318 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750459+0000", 2024-05-08T18:30:26.318 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000151619 2024-05-08T18:30:26.318 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.318 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.319 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:26.319 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750822+0000", 2024-05-08T18:30:26.319 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000362467 2024-05-08T18:30:26.319 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.319 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.319 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:26.319 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.751591+0000", 2024-05-08T18:30:26.319 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00076934699999999998 2024-05-08T18:30:26.319 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.319 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.319 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:26.319 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.753042+0000", 2024-05-08T18:30:26.320 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001450652 2024-05-08T18:30:26.320 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.320 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.320 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:26.320 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.753792+0000", 2024-05-08T18:30:26.320 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00075045500000000002 2024-05-08T18:30:26.320 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.320 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.320 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:26.320 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.753977+0000", 2024-05-08T18:30:26.320 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000184511 2024-05-08T18:30:26.321 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.321 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.321 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:26.321 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.754092+0000", 2024-05-08T18:30:26.321 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000114819 2024-05-08T18:30:26.321 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:26.321 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:26.321 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:26.321 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.321 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.321 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:26.321 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.783902+0000", 2024-05-08T18:30:26.322 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 34.495656961000002, 2024-05-08T18:30:26.322 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003120046, 2024-05-08T18:30:26.322 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:26.322 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:26.322 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:26.322 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:26.322 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:26.322 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:26.322 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 233 2024-05-08T18:30:26.322 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.322 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:26.322 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.323 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:26.323 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.783902+0000", 2024-05-08T18:30:26.323 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:26.323 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.323 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.323 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:26.323 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.783902+0000", 2024-05-08T18:30:26.323 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:26.323 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.323 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.323 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:26.324 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.783904+0000", 2024-05-08T18:30:26.324 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5229999999999998e-06 2024-05-08T18:30:26.324 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.324 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.324 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:26.324 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.783916+0000", 2024-05-08T18:30:26.324 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1513e-05 2024-05-08T18:30:26.324 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.324 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.324 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:26.324 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.783947+0000", 2024-05-08T18:30:26.324 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1353000000000003e-05 2024-05-08T18:30:26.325 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.325 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.325 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:26.325 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.783964+0000", 2024-05-08T18:30:26.325 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6643e-05 2024-05-08T18:30:26.325 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.325 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.325 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:26.325 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.784110+0000", 2024-05-08T18:30:26.325 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014627299999999999 2024-05-08T18:30:26.325 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.325 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.325 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:26.326 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.784329+0000", 2024-05-08T18:30:26.326 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021892099999999999 2024-05-08T18:30:26.326 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.326 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.326 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:26.326 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.784752+0000", 2024-05-08T18:30:26.326 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00042336700000000001 2024-05-08T18:30:26.326 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.326 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.326 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:26.326 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.786093+0000", 2024-05-08T18:30:26.327 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00134107 2024-05-08T18:30:26.327 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.327 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.327 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:26.327 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.786863+0000", 2024-05-08T18:30:26.327 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00076949099999999997 2024-05-08T18:30:26.327 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.327 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.327 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:26.327 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.786955+0000", 2024-05-08T18:30:26.327 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.2478999999999993e-05 2024-05-08T18:30:26.328 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.328 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.328 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:26.328 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.787022+0000", 2024-05-08T18:30:26.328 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6413000000000003e-05 2024-05-08T18:30:26.328 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:26.328 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:26.328 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:26.328 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.328 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.328 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:341 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:26.328 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.816045+0000", 2024-05-08T18:30:26.329 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 34.463513624000001, 2024-05-08T18:30:26.329 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002875154, 2024-05-08T18:30:26.329 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:26.329 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:26.329 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:26.329 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:26.329 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:26.329 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:26.329 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 341 2024-05-08T18:30:26.329 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.329 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:26.330 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.330 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:26.330 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816045+0000", 2024-05-08T18:30:26.330 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:26.330 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.330 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.330 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:26.330 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816045+0000", 2024-05-08T18:30:26.330 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:26.330 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.330 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.331 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:26.331 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816046+0000", 2024-05-08T18:30:26.331 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9199999999999999e-07 2024-05-08T18:30:26.331 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.331 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.331 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:26.331 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816050+0000", 2024-05-08T18:30:26.331 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0260000000000001e-06 2024-05-08T18:30:26.331 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.331 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.331 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:26.331 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816060+0000", 2024-05-08T18:30:26.332 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0297e-05 2024-05-08T18:30:26.332 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.332 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.332 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:26.332 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816065+0000", 2024-05-08T18:30:26.332 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.237e-06 2024-05-08T18:30:26.332 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.332 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.332 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:26.332 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816122+0000", 2024-05-08T18:30:26.332 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6168000000000002e-05 2024-05-08T18:30:26.332 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.333 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.333 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:26.333 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816198+0000", 2024-05-08T18:30:26.333 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6511e-05 2024-05-08T18:30:26.333 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.333 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.333 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:26.333 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816305+0000", 2024-05-08T18:30:26.333 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000106487 2024-05-08T18:30:26.333 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.333 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.334 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:26.334 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816886+0000", 2024-05-08T18:30:26.334 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00058187199999999999 2024-05-08T18:30:26.334 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.334 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.334 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:26.334 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.818821+0000", 2024-05-08T18:30:26.334 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001934362 2024-05-08T18:30:26.334 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.334 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.334 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:26.334 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.818880+0000", 2024-05-08T18:30:26.335 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9210999999999999e-05 2024-05-08T18:30:26.335 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.335 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.335 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:26.335 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.818920+0000", 2024-05-08T18:30:26.335 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0091e-05 2024-05-08T18:30:26.335 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:26.335 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:26.335 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:26.335 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.335 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.335 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:26.336 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.086431+0000", 2024-05-08T18:30:26.336 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 34.193127804, 2024-05-08T18:30:26.336 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028335959999999999, 2024-05-08T18:30:26.336 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:26.336 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:26.336 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:26.336 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:26.336 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:26.336 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:26.336 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 733 2024-05-08T18:30:26.336 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.337 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:26.337 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.337 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:26.337 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086431+0000", 2024-05-08T18:30:26.337 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:26.337 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.337 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.337 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:26.337 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086431+0000", 2024-05-08T18:30:26.337 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:26.337 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.338 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.338 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:26.338 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086433+0000", 2024-05-08T18:30:26.338 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8899999999999999e-06 2024-05-08T18:30:26.338 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.338 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.338 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:26.338 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086441+0000", 2024-05-08T18:30:26.338 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.3100000000000001e-06 2024-05-08T18:30:26.338 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.338 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.338 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:26.339 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086460+0000", 2024-05-08T18:30:26.339 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8703999999999999e-05 2024-05-08T18:30:26.339 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.339 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.339 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:26.339 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086471+0000", 2024-05-08T18:30:26.339 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1324e-05 2024-05-08T18:30:26.339 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.339 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.339 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:26.339 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086590+0000", 2024-05-08T18:30:26.339 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000118625 2024-05-08T18:30:26.340 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.340 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.340 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:26.340 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086817+0000", 2024-05-08T18:30:26.340 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000226958 2024-05-08T18:30:26.340 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.340 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.340 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:26.340 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.087131+0000", 2024-05-08T18:30:26.340 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00031478799999999998 2024-05-08T18:30:26.340 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.340 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.341 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:26.341 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.088025+0000", 2024-05-08T18:30:26.341 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00089402999999999998 2024-05-08T18:30:26.341 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.341 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.341 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:26.341 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.089123+0000", 2024-05-08T18:30:26.341 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001097598 2024-05-08T18:30:26.341 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.341 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.341 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:26.341 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.089200+0000", 2024-05-08T18:30:26.342 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7333e-05 2024-05-08T18:30:26.342 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.342 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.342 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:26.342 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.089264+0000", 2024-05-08T18:30:26.342 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.4035999999999995e-05 2024-05-08T18:30:26.342 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:26.342 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:26.342 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:26.342 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.342 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.342 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:751 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:26.342 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.125611+0000", 2024-05-08T18:30:26.343 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 34.153947111999997, 2024-05-08T18:30:26.343 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032716749999999999, 2024-05-08T18:30:26.343 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:26.343 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:26.343 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:26.343 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:26.343 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:26.343 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:26.343 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 751 2024-05-08T18:30:26.343 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.343 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:26.344 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.344 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:26.344 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125611+0000", 2024-05-08T18:30:26.344 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:26.344 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.344 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.344 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:26.344 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125611+0000", 2024-05-08T18:30:26.344 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:26.344 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.344 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.344 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:26.345 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125614+0000", 2024-05-08T18:30:26.345 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.12e-06 2024-05-08T18:30:26.345 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.345 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.345 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:26.345 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125624+0000", 2024-05-08T18:30:26.345 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0492999999999999e-05 2024-05-08T18:30:26.345 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.345 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.345 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:26.345 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125650+0000", 2024-05-08T18:30:26.345 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5907000000000001e-05 2024-05-08T18:30:26.346 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.346 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.346 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:26.346 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125667+0000", 2024-05-08T18:30:26.346 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.694e-05 2024-05-08T18:30:26.346 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.346 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.346 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:26.346 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125801+0000", 2024-05-08T18:30:26.346 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000134482 2024-05-08T18:30:26.346 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.347 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.347 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:26.347 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.126174+0000", 2024-05-08T18:30:26.347 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00037294999999999999 2024-05-08T18:30:26.347 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.347 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.347 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:26.347 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.126750+0000", 2024-05-08T18:30:26.347 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00057538900000000004 2024-05-08T18:30:26.347 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.347 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.347 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:26.348 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.127997+0000", 2024-05-08T18:30:26.348 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001247761 2024-05-08T18:30:26.348 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.348 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.348 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:26.348 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.128731+0000", 2024-05-08T18:30:26.348 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00073338099999999996 2024-05-08T18:30:26.348 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.348 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.348 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:26.348 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.128817+0000", 2024-05-08T18:30:26.349 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5993000000000002e-05 2024-05-08T18:30:26.349 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.349 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.349 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:26.349 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.128883+0000", 2024-05-08T18:30:26.349 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6259000000000004e-05 2024-05-08T18:30:26.349 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:26.349 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:26.349 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:26.349 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.349 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.349 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:753 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:26.350 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.129809+0000", 2024-05-08T18:30:26.350 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 34.149749573999998, 2024-05-08T18:30:26.350 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0033775440000000001, 2024-05-08T18:30:26.350 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:26.350 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:26.350 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:26.350 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:26.350 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:26.350 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:26.350 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 753 2024-05-08T18:30:26.350 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.351 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:26.351 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.351 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:26.351 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129809+0000", 2024-05-08T18:30:26.351 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:26.351 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.351 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.351 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:26.351 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129809+0000", 2024-05-08T18:30:26.351 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:26.351 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.351 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.352 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:26.352 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129811+0000", 2024-05-08T18:30:26.352 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1730000000000002e-06 2024-05-08T18:30:26.352 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.352 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.352 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:26.352 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129822+0000", 2024-05-08T18:30:26.352 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0583e-05 2024-05-08T18:30:26.352 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.352 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.352 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:26.352 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129852+0000", 2024-05-08T18:30:26.353 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0744000000000002e-05 2024-05-08T18:30:26.353 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.353 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.353 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:26.353 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129870+0000", 2024-05-08T18:30:26.353 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7955999999999999e-05 2024-05-08T18:30:26.353 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.353 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.353 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:26.353 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.130018+0000", 2024-05-08T18:30:26.353 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014747600000000001 2024-05-08T18:30:26.353 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.354 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.354 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:26.354 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.130259+0000", 2024-05-08T18:30:26.354 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024079099999999999 2024-05-08T18:30:26.354 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.354 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.354 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:26.354 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.130734+0000", 2024-05-08T18:30:26.354 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00047562 2024-05-08T18:30:26.354 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.354 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.355 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:26.355 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.131997+0000", 2024-05-08T18:30:26.355 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012626429999999999 2024-05-08T18:30:26.355 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.355 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.355 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:26.355 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.132923+0000", 2024-05-08T18:30:26.355 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00092627599999999997 2024-05-08T18:30:26.355 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.355 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.355 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:26.355 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.133076+0000", 2024-05-08T18:30:26.356 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000152989 2024-05-08T18:30:26.356 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.356 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.356 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:26.356 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.133187+0000", 2024-05-08T18:30:26.356 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000110293 2024-05-08T18:30:26.356 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:26.356 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:26.356 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:26.356 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.356 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.357 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:26.357 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.228247+0000", 2024-05-08T18:30:26.357 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 34.051311964, 2024-05-08T18:30:26.357 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032753449999999998, 2024-05-08T18:30:26.357 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:26.357 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:26.357 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:26.357 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:26.357 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:26.357 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:26.357 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 796 2024-05-08T18:30:26.358 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.358 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:26.358 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.358 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:26.358 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228247+0000", 2024-05-08T18:30:26.358 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:26.358 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.358 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.358 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:26.358 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228247+0000", 2024-05-08T18:30:26.358 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:26.359 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.359 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.359 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:26.359 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228249+0000", 2024-05-08T18:30:26.359 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3800000000000001e-06 2024-05-08T18:30:26.359 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.359 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.359 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:26.359 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228260+0000", 2024-05-08T18:30:26.359 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1496e-05 2024-05-08T18:30:26.359 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.359 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.360 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:26.360 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228292+0000", 2024-05-08T18:30:26.360 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1294000000000002e-05 2024-05-08T18:30:26.360 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.360 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.360 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:26.360 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228306+0000", 2024-05-08T18:30:26.360 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4606e-05 2024-05-08T18:30:26.360 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.360 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.360 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:26.361 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228443+0000", 2024-05-08T18:30:26.361 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013672599999999999 2024-05-08T18:30:26.361 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.361 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.361 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:26.361 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228813+0000", 2024-05-08T18:30:26.361 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00036987000000000001 2024-05-08T18:30:26.361 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.361 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.361 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:26.362 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.229365+0000", 2024-05-08T18:30:26.362 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00055210600000000002 2024-05-08T18:30:26.362 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.362 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.362 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:26.362 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.230800+0000", 2024-05-08T18:30:26.362 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001435006 2024-05-08T18:30:26.362 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.362 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.362 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:26.362 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.231369+0000", 2024-05-08T18:30:26.362 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00056848499999999998 2024-05-08T18:30:26.363 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.363 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.363 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:26.363 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.231455+0000", 2024-05-08T18:30:26.363 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6905999999999998e-05 2024-05-08T18:30:26.363 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.363 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.363 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:26.363 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.231522+0000", 2024-05-08T18:30:26.363 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6470000000000006e-05 2024-05-08T18:30:26.363 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:26.364 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:26.364 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:26.364 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.364 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.364 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:798 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:26.364 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.232573+0000", 2024-05-08T18:30:26.364 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 34.046985857000003, 2024-05-08T18:30:26.364 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0030406690000000002, 2024-05-08T18:30:26.364 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:26.364 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:26.364 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:26.365 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:26.365 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:26.365 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:26.365 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 798 2024-05-08T18:30:26.365 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.365 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:26.365 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.365 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:26.365 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232573+0000", 2024-05-08T18:30:26.365 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:26.365 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.365 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.366 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:26.366 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232573+0000", 2024-05-08T18:30:26.366 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:26.366 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.366 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.366 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:26.366 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232574+0000", 2024-05-08T18:30:26.366 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.446e-06 2024-05-08T18:30:26.366 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.366 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.366 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:26.367 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232581+0000", 2024-05-08T18:30:26.367 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.0670000000000003e-06 2024-05-08T18:30:26.367 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.367 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.367 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:26.367 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232600+0000", 2024-05-08T18:30:26.367 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8822999999999999e-05 2024-05-08T18:30:26.367 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.367 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.367 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:26.367 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232611+0000", 2024-05-08T18:30:26.367 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1233000000000001e-05 2024-05-08T18:30:26.368 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.368 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.368 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:26.368 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232731+0000", 2024-05-08T18:30:26.368 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000120189 2024-05-08T18:30:26.368 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.368 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.368 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:26.368 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232963+0000", 2024-05-08T18:30:26.368 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023111900000000001 2024-05-08T18:30:26.368 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.368 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.369 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:26.369 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.233441+0000", 2024-05-08T18:30:26.369 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00047866899999999998 2024-05-08T18:30:26.369 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.369 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.369 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:26.369 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.234542+0000", 2024-05-08T18:30:26.369 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001101245 2024-05-08T18:30:26.369 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.369 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.369 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:26.369 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.235349+0000", 2024-05-08T18:30:26.369 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000806567 2024-05-08T18:30:26.370 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.370 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.370 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:26.370 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.235498+0000", 2024-05-08T18:30:26.370 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014907200000000001 2024-05-08T18:30:26.370 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.370 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.370 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:26.370 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.235613+0000", 2024-05-08T18:30:26.370 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115239 2024-05-08T18:30:26.370 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:26.370 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:26.371 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:26.371 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.371 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.371 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:26.371 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.248596+0000", 2024-05-08T18:30:26.371 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 34.030962051000003, 2024-05-08T18:30:26.371 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002919984, 2024-05-08T18:30:26.371 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:26.371 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:26.371 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:26.371 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:26.371 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:26.372 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:26.372 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 805 2024-05-08T18:30:26.372 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.372 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:26.372 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.372 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:26.372 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248596+0000", 2024-05-08T18:30:26.372 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:26.372 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.372 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.372 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:26.373 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248596+0000", 2024-05-08T18:30:26.373 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:26.373 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.373 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.373 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:26.373 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248599+0000", 2024-05-08T18:30:26.373 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3630000000000001e-06 2024-05-08T18:30:26.373 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.373 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.373 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:26.373 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248610+0000", 2024-05-08T18:30:26.373 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1267000000000001e-05 2024-05-08T18:30:26.374 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.374 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.374 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:26.374 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248641+0000", 2024-05-08T18:30:26.374 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1309999999999997e-05 2024-05-08T18:30:26.374 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.374 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.374 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:26.374 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248656+0000", 2024-05-08T18:30:26.374 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4449e-05 2024-05-08T18:30:26.374 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.375 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.375 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:26.375 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248781+0000", 2024-05-08T18:30:26.375 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012500900000000001 2024-05-08T18:30:26.375 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.375 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.375 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:26.375 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.249001+0000", 2024-05-08T18:30:26.375 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021963500000000001 2024-05-08T18:30:26.375 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.375 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.376 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:26.376 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.249341+0000", 2024-05-08T18:30:26.376 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00034004100000000002 2024-05-08T18:30:26.376 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.376 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.376 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:26.376 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.250473+0000", 2024-05-08T18:30:26.376 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0011324180000000001 2024-05-08T18:30:26.376 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.376 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.376 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:26.376 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.251230+0000", 2024-05-08T18:30:26.376 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00075751400000000004 2024-05-08T18:30:26.377 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.377 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.377 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:26.377 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.251394+0000", 2024-05-08T18:30:26.377 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016379200000000001 2024-05-08T18:30:26.377 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.377 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.377 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:26.377 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.251516+0000", 2024-05-08T18:30:26.377 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012218600000000001 2024-05-08T18:30:26.377 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:26.378 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:26.378 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:26.378 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.378 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.378 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:26.378 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.313184+0000", 2024-05-08T18:30:26.378 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 33.966374375999997, 2024-05-08T18:30:26.378 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003040016, 2024-05-08T18:30:26.378 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:26.378 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:26.378 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:26.379 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:26.379 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:26.379 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:26.379 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 832 2024-05-08T18:30:26.379 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.379 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:26.379 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.379 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:26.379 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313184+0000", 2024-05-08T18:30:26.379 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:26.379 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.379 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.380 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:26.380 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313184+0000", 2024-05-08T18:30:26.380 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:26.380 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.380 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.380 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:26.380 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313187+0000", 2024-05-08T18:30:26.380 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5100000000000001e-06 2024-05-08T18:30:26.380 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.380 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.380 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:26.380 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313199+0000", 2024-05-08T18:30:26.381 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.201e-05 2024-05-08T18:30:26.381 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.381 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.381 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:26.381 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313229+0000", 2024-05-08T18:30:26.381 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9839e-05 2024-05-08T18:30:26.381 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.381 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.381 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:26.381 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313243+0000", 2024-05-08T18:30:26.381 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4727e-05 2024-05-08T18:30:26.381 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.382 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.382 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:26.382 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313358+0000", 2024-05-08T18:30:26.382 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115016 2024-05-08T18:30:26.382 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.382 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.382 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:26.382 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313577+0000", 2024-05-08T18:30:26.382 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021897799999999999 2024-05-08T18:30:26.382 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.382 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.383 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:26.383 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313889+0000", 2024-05-08T18:30:26.383 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00031210400000000001 2024-05-08T18:30:26.383 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.383 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.383 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:26.383 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.315229+0000", 2024-05-08T18:30:26.383 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001339963 2024-05-08T18:30:26.383 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.383 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.383 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:26.383 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.315938+0000", 2024-05-08T18:30:26.384 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00070853400000000003 2024-05-08T18:30:26.384 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.384 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.384 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:26.384 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.316111+0000", 2024-05-08T18:30:26.384 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000173396 2024-05-08T18:30:26.384 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.384 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.384 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:26.384 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.316224+0000", 2024-05-08T18:30:26.384 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000112939 2024-05-08T18:30:26.384 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:26.385 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:26.385 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:26.385 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.385 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.385 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:834 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:26.385 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.317499+0000", 2024-05-08T18:30:26.385 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 33.962059576999998, 2024-05-08T18:30:26.385 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0033281109999999999, 2024-05-08T18:30:26.385 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:26.385 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:26.385 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:26.385 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:26.386 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:26.386 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:26.386 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 834 2024-05-08T18:30:26.386 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.386 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:26.386 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.386 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:26.386 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317499+0000", 2024-05-08T18:30:26.386 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:26.386 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.386 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.387 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:26.387 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317499+0000", 2024-05-08T18:30:26.387 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:26.387 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.387 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.387 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:26.387 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317501+0000", 2024-05-08T18:30:26.387 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9400000000000001e-06 2024-05-08T18:30:26.387 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.387 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.388 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:26.388 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317511+0000", 2024-05-08T18:30:26.388 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0297e-05 2024-05-08T18:30:26.388 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.388 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.388 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:26.388 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317532+0000", 2024-05-08T18:30:26.388 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1013e-05 2024-05-08T18:30:26.388 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.388 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.388 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:26.388 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317543+0000", 2024-05-08T18:30:26.389 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0757000000000001e-05 2024-05-08T18:30:26.389 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.389 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.389 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:26.389 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317658+0000", 2024-05-08T18:30:26.389 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115129 2024-05-08T18:30:26.389 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.389 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.389 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:26.389 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317887+0000", 2024-05-08T18:30:26.389 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00022880099999999999 2024-05-08T18:30:26.390 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.390 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.390 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:26.390 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.318378+0000", 2024-05-08T18:30:26.390 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00049129000000000002 2024-05-08T18:30:26.390 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.390 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.390 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:26.390 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.319597+0000", 2024-05-08T18:30:26.390 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012188469999999999 2024-05-08T18:30:26.390 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.391 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.391 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:26.391 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.320566+0000", 2024-05-08T18:30:26.391 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00096881599999999995 2024-05-08T18:30:26.391 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.391 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.391 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:26.391 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.320713+0000", 2024-05-08T18:30:26.391 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014691500000000001 2024-05-08T18:30:26.391 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.391 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.392 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:26.392 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.320827+0000", 2024-05-08T18:30:26.392 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000114306 2024-05-08T18:30:26.392 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:26.392 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:26.392 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:26.392 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.392 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.392 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:26.392 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.505569+0000", 2024-05-08T18:30:26.392 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 33.773989124000003, 2024-05-08T18:30:26.393 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028584309999999998, 2024-05-08T18:30:26.393 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:26.393 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:26.393 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:26.393 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:26.393 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:26.393 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:26.393 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 916 2024-05-08T18:30:26.393 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.393 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:26.393 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.393 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:26.394 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505569+0000", 2024-05-08T18:30:26.394 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:26.394 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.394 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.394 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:26.394 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505569+0000", 2024-05-08T18:30:26.394 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:26.394 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.394 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.394 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:26.394 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505572+0000", 2024-05-08T18:30:26.395 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3659999999999999e-06 2024-05-08T18:30:26.395 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.395 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.395 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:26.395 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505583+0000", 2024-05-08T18:30:26.395 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1574e-05 2024-05-08T18:30:26.395 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.395 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.395 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:26.395 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505614+0000", 2024-05-08T18:30:26.395 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0670000000000003e-05 2024-05-08T18:30:26.395 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.396 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.396 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:26.396 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505629+0000", 2024-05-08T18:30:26.396 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5063e-05 2024-05-08T18:30:26.396 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.396 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.396 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:26.396 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505754+0000", 2024-05-08T18:30:26.396 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012508899999999999 2024-05-08T18:30:26.396 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.396 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.396 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:26.397 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505988+0000", 2024-05-08T18:30:26.397 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023334699999999999 2024-05-08T18:30:26.397 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.397 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.397 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:26.397 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.506299+0000", 2024-05-08T18:30:26.397 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000311811 2024-05-08T18:30:26.397 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.397 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.397 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:26.397 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.507489+0000", 2024-05-08T18:30:26.398 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0011899510000000001 2024-05-08T18:30:26.398 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.398 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.398 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:26.398 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.508141+0000", 2024-05-08T18:30:26.398 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00065180200000000005 2024-05-08T18:30:26.398 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.398 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.398 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:26.398 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.508306+0000", 2024-05-08T18:30:26.399 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016450199999999999 2024-05-08T18:30:26.399 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.399 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.399 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:26.399 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.508428+0000", 2024-05-08T18:30:26.399 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000122256 2024-05-08T18:30:26.399 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:26.399 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:26.399 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:26.399 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.399 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.400 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:918 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:26.400 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.509337+0000", 2024-05-08T18:30:26.400 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 33.770221057000001, 2024-05-08T18:30:26.400 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002971787, 2024-05-08T18:30:26.400 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:26.400 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:26.400 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:26.400 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:26.400 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:26.400 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:26.400 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 918 2024-05-08T18:30:26.401 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.401 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:26.401 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.401 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:26.401 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509337+0000", 2024-05-08T18:30:26.401 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:26.401 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.401 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.401 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:26.401 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509337+0000", 2024-05-08T18:30:26.401 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:26.401 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.402 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.402 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:26.402 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509340+0000", 2024-05-08T18:30:26.402 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2570000000000002e-06 2024-05-08T18:30:26.402 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.402 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.402 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:26.402 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509351+0000", 2024-05-08T18:30:26.402 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0933e-05 2024-05-08T18:30:26.402 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.402 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.403 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:26.403 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509382+0000", 2024-05-08T18:30:26.403 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1198999999999997e-05 2024-05-08T18:30:26.403 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.403 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.403 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:26.403 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509400+0000", 2024-05-08T18:30:26.403 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8236999999999998e-05 2024-05-08T18:30:26.403 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.403 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.403 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:26.403 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509529+0000", 2024-05-08T18:30:26.404 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012905600000000001 2024-05-08T18:30:26.404 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.404 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.404 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:26.404 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509777+0000", 2024-05-08T18:30:26.404 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024786799999999999 2024-05-08T18:30:26.404 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.404 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.404 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:26.404 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.510284+0000", 2024-05-08T18:30:26.404 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000506796 2024-05-08T18:30:26.404 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.405 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.405 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:26.405 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.511453+0000", 2024-05-08T18:30:26.405 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001169575 2024-05-08T18:30:26.405 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.405 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.405 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:26.405 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.512051+0000", 2024-05-08T18:30:26.405 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00059743100000000005 2024-05-08T18:30:26.405 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.405 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.405 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:26.406 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.512199+0000", 2024-05-08T18:30:26.406 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000148486 2024-05-08T18:30:26.406 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.406 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.406 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:26.406 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.512309+0000", 2024-05-08T18:30:26.406 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000109949 2024-05-08T18:30:26.406 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:26.406 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:26.406 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:26.406 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.407 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.407 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:931 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:26.407 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.543277+0000", 2024-05-08T18:30:26.407 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 33.736281902000002, 2024-05-08T18:30:26.407 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028250710000000002, 2024-05-08T18:30:26.407 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:26.407 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:26.407 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:26.407 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:26.407 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:26.407 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:26.407 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 931 2024-05-08T18:30:26.408 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.408 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:26.408 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.408 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:26.408 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543277+0000", 2024-05-08T18:30:26.408 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:26.408 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.408 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.408 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:26.408 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543277+0000", 2024-05-08T18:30:26.408 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:26.409 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.409 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.409 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:26.409 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543279+0000", 2024-05-08T18:30:26.409 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.373e-06 2024-05-08T18:30:26.409 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.409 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.409 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:26.409 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543291+0000", 2024-05-08T18:30:26.409 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1517e-05 2024-05-08T18:30:26.409 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.409 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.410 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:26.410 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543323+0000", 2024-05-08T18:30:26.410 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2292000000000002e-05 2024-05-08T18:30:26.410 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.410 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.410 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:26.410 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543340+0000", 2024-05-08T18:30:26.410 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.749e-05 2024-05-08T18:30:26.410 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.410 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.410 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:26.411 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543462+0000", 2024-05-08T18:30:26.411 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000121413 2024-05-08T18:30:26.411 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.411 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.411 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:26.411 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543681+0000", 2024-05-08T18:30:26.411 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021974200000000001 2024-05-08T18:30:26.411 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.411 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.411 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:26.411 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.544004+0000", 2024-05-08T18:30:26.412 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00032268900000000003 2024-05-08T18:30:26.412 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.412 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.412 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:26.412 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.545158+0000", 2024-05-08T18:30:26.412 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0011540190000000001 2024-05-08T18:30:26.412 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.412 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.412 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:26.412 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.545970+0000", 2024-05-08T18:30:26.412 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00081224300000000004 2024-05-08T18:30:26.413 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.413 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.413 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:26.413 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.546043+0000", 2024-05-08T18:30:26.413 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.3067999999999999e-05 2024-05-08T18:30:26.413 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.413 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.413 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:26.413 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.546102+0000", 2024-05-08T18:30:26.413 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8224999999999999e-05 2024-05-08T18:30:26.413 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:26.413 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:26.414 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:26.414 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.414 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.414 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:26.414 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.578568+0000", 2024-05-08T18:30:26.414 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 33.700990994999998, 2024-05-08T18:30:26.414 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0030345839999999999, 2024-05-08T18:30:26.414 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:26.414 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:26.414 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:26.414 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:26.415 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:26.415 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:26.415 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 946 2024-05-08T18:30:26.415 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.415 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:26.415 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.415 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:26.415 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578568+0000", 2024-05-08T18:30:26.415 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:26.415 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.415 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.415 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:26.416 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578568+0000", 2024-05-08T18:30:26.416 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:26.416 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.416 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.416 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:26.416 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578570+0000", 2024-05-08T18:30:26.416 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3700000000000002e-06 2024-05-08T18:30:26.416 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.416 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.416 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:26.416 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578582+0000", 2024-05-08T18:30:26.417 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1627000000000001e-05 2024-05-08T18:30:26.417 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.417 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.417 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:26.417 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578612+0000", 2024-05-08T18:30:26.417 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0103e-05 2024-05-08T18:30:26.417 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.417 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.417 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:26.417 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578627+0000", 2024-05-08T18:30:26.417 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4949999999999999e-05 2024-05-08T18:30:26.417 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.417 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.418 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:26.418 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578750+0000", 2024-05-08T18:30:26.418 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012309899999999999 2024-05-08T18:30:26.418 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.418 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.418 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:26.418 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.579042+0000", 2024-05-08T18:30:26.418 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00029212500000000001 2024-05-08T18:30:26.418 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.418 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.418 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:26.418 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.579557+0000", 2024-05-08T18:30:26.419 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00051536900000000001 2024-05-08T18:30:26.419 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.419 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.419 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:26.419 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.580698+0000", 2024-05-08T18:30:26.419 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001140774 2024-05-08T18:30:26.419 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.419 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.419 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:26.419 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.581367+0000", 2024-05-08T18:30:26.419 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00066884799999999999 2024-05-08T18:30:26.419 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.420 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.420 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:26.420 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.581489+0000", 2024-05-08T18:30:26.420 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012265600000000001 2024-05-08T18:30:26.420 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.420 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.420 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:26.420 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.581602+0000", 2024-05-08T18:30:26.420 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000112663 2024-05-08T18:30:26.420 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:26.420 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:26.421 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:26.421 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:26.421 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:26.421 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:30:26.423 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-08T18:30:26.423 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:30:26.425+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:30:26.523 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:30:26.525+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:30:26.595 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:30:26.596 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:30:26.596 INFO:teuthology.orchestra.run.smithi097.stdout: "num_ops": 0 2024-05-08T18:30:26.596 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:30:26.611 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-08T18:30:26.654 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:30:26.657+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:30:26.724 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:30:26.725+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:30:26.773 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:30:26.774 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:30:26.774 INFO:teuthology.orchestra.run.smithi097.stdout: "complaint_time": 30, 2024-05-08T18:30:26.774 INFO:teuthology.orchestra.run.smithi097.stdout: "num_blocked_ops": 0 2024-05-08T18:30:26.774 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:30:26.788 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-08T18:30:26.830 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:30:26.833+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:30:26.904 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-08T18:30:26.954 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:30:26.957+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:30:26.957 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:30:26.957 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2024-05-08T18:30:26.958 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2024-05-08T18:30:26.958 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-05-08T18:30:26.958 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.958 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4479.0:40 5.b 5:d797044f:::zonegroup_info.ea3b680f-900d-4805-81ec-055811625780:head [create,call version.set in=10b,writefull 0~436] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-05-08T18:30:26.958 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:44.637551+0000", 2024-05-08T18:30:26.958 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 42.322040717999997, 2024-05-08T18:30:26.958 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003054013, 2024-05-08T18:30:26.958 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:26.958 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:26.958 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:26.958 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:26.958 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4479", 2024-05-08T18:30:26.959 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3577501689", 2024-05-08T18:30:26.959 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 40 2024-05-08T18:30:26.959 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.959 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:26.959 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.959 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:26.959 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.637551+0000", 2024-05-08T18:30:26.959 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:26.959 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.959 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.959 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:26.959 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.637551+0000", 2024-05-08T18:30:26.959 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:26.960 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.960 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.960 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:26.960 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.637554+0000", 2024-05-08T18:30:26.960 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6599999999999999e-06 2024-05-08T18:30:26.960 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.960 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.960 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:26.960 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.637576+0000", 2024-05-08T18:30:26.960 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1965999999999999e-05 2024-05-08T18:30:26.960 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.960 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.960 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:26.961 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.637603+0000", 2024-05-08T18:30:26.961 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7257e-05 2024-05-08T18:30:26.961 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.961 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.961 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:26.961 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.637623+0000", 2024-05-08T18:30:26.961 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9570000000000001e-05 2024-05-08T18:30:26.961 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.961 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.961 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:26.961 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.637766+0000", 2024-05-08T18:30:26.961 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000143435 2024-05-08T18:30:26.962 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.962 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.962 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:26.962 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.638167+0000", 2024-05-08T18:30:26.962 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00040082399999999998 2024-05-08T18:30:26.962 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.962 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.962 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:26.962 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.638627+0000", 2024-05-08T18:30:26.962 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00046019300000000002 2024-05-08T18:30:26.962 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.962 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.963 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:26.963 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.640399+0000", 2024-05-08T18:30:26.963 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0017714199999999999 2024-05-08T18:30:26.963 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.963 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.963 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:26.963 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.640447+0000", 2024-05-08T18:30:26.963 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8383000000000001e-05 2024-05-08T18:30:26.963 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.963 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.963 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:26.963 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.640534+0000", 2024-05-08T18:30:26.963 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7078999999999998e-05 2024-05-08T18:30:26.964 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.964 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.964 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:26.964 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.640606+0000", 2024-05-08T18:30:26.964 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1225999999999999e-05 2024-05-08T18:30:26.964 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:26.964 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:26.964 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:26.964 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.964 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.964 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4479.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-05-08T18:30:26.964 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:44.643918+0000", 2024-05-08T18:30:26.965 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 42.315674442999999, 2024-05-08T18:30:26.965 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002986004, 2024-05-08T18:30:26.965 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:26.965 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:26.965 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:26.965 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:26.965 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4479", 2024-05-08T18:30:26.965 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3577501689", 2024-05-08T18:30:26.965 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 42 2024-05-08T18:30:26.965 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.965 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:26.965 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.965 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:26.965 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.643918+0000", 2024-05-08T18:30:26.966 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:26.966 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.966 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.966 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:26.966 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.643918+0000", 2024-05-08T18:30:26.966 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:26.966 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.967 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.967 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:26.967 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.643919+0000", 2024-05-08T18:30:26.967 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4729999999999999e-06 2024-05-08T18:30:26.967 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.967 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.967 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:26.967 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.643927+0000", 2024-05-08T18:30:26.967 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6389999999999992e-06 2024-05-08T18:30:26.967 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.967 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.967 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:26.967 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.643945+0000", 2024-05-08T18:30:26.967 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8195000000000001e-05 2024-05-08T18:30:26.968 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.968 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.968 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:26.968 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.643954+0000", 2024-05-08T18:30:26.968 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5210000000000002e-06 2024-05-08T18:30:26.968 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.968 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.968 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:26.968 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.644123+0000", 2024-05-08T18:30:26.968 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016904999999999999 2024-05-08T18:30:26.968 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.968 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.968 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:26.968 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.644315+0000", 2024-05-08T18:30:26.968 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00019202800000000001 2024-05-08T18:30:26.969 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.969 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.969 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:26.969 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.644505+0000", 2024-05-08T18:30:26.969 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000190552 2024-05-08T18:30:26.969 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.969 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.969 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:26.969 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.645877+0000", 2024-05-08T18:30:26.969 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001371702 2024-05-08T18:30:26.969 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.969 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.969 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:26.970 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.646778+0000", 2024-05-08T18:30:26.970 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00090065700000000002 2024-05-08T18:30:26.970 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.970 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.970 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:26.970 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.646843+0000", 2024-05-08T18:30:26.970 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5504000000000002e-05 2024-05-08T18:30:26.970 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.970 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.970 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:26.970 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.646904+0000", 2024-05-08T18:30:26.970 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0683000000000002e-05 2024-05-08T18:30:26.970 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:26.971 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:26.971 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:26.971 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.971 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.971 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:57 7.3 e30/29 7:c609908c:::notify.5:head v 30'2, mlcod=0'0)", 2024-05-08T18:30:26.971 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:48.669376+0000", 2024-05-08T18:30:26.971 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 38.290216334999997, 2024-05-08T18:30:26.971 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0041509479999999998, 2024-05-08T18:30:26.971 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:26.971 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:26.971 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:26.971 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:26.971 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.971 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:26.972 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669376+0000", 2024-05-08T18:30:26.972 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:26.972 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.972 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.972 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:26.972 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669376+0000", 2024-05-08T18:30:26.972 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:26.972 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.972 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.972 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:26.972 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669378+0000", 2024-05-08T18:30:26.972 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.79e-06 2024-05-08T18:30:26.972 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.973 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.973 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:26.973 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669393+0000", 2024-05-08T18:30:26.973 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5053e-05 2024-05-08T18:30:26.973 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.973 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.973 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:26.973 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669427+0000", 2024-05-08T18:30:26.973 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4326999999999998e-05 2024-05-08T18:30:26.973 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.973 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.973 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:26.973 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669451+0000", 2024-05-08T18:30:26.973 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3629e-05 2024-05-08T18:30:26.974 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.974 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.974 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:26.974 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669563+0000", 2024-05-08T18:30:26.974 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011251099999999999 2024-05-08T18:30:26.974 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.974 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.974 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:26.974 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669607+0000", 2024-05-08T18:30:26.974 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3877e-05 2024-05-08T18:30:26.974 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.974 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.974 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:26.975 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.673401+0000", 2024-05-08T18:30:26.975 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0037942819999999999 2024-05-08T18:30:26.975 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.975 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.975 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:26.975 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.673527+0000", 2024-05-08T18:30:26.975 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012547900000000001 2024-05-08T18:30:26.975 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:26.975 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:26.975 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:26.975 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.975 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.976 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:58 7.14 e30/29 7:2b04a3e9:::notify.6:head v 30'1, mlcod=0'0)", 2024-05-08T18:30:26.976 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:48.669496+0000", 2024-05-08T18:30:26.976 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 38.290095962999999, 2024-05-08T18:30:26.976 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0046805609999999997, 2024-05-08T18:30:26.976 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:26.976 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:26.976 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:26.976 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:26.976 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.976 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:26.976 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669496+0000", 2024-05-08T18:30:26.976 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:26.976 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.976 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.977 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:26.977 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669496+0000", 2024-05-08T18:30:26.977 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:26.977 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.977 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.977 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:26.977 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669497+0000", 2024-05-08T18:30:26.977 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0100000000000001e-06 2024-05-08T18:30:26.977 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.977 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.977 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:26.977 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669507+0000", 2024-05-08T18:30:26.977 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.7540000000000001e-06 2024-05-08T18:30:26.977 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.978 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.978 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:26.978 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669528+0000", 2024-05-08T18:30:26.978 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.05e-05 2024-05-08T18:30:26.978 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.978 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.978 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:26.978 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669544+0000", 2024-05-08T18:30:26.978 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6716000000000001e-05 2024-05-08T18:30:26.978 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.978 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.978 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:26.978 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669667+0000", 2024-05-08T18:30:26.979 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012275799999999999 2024-05-08T18:30:26.979 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.979 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.979 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:26.979 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669706+0000", 2024-05-08T18:30:26.979 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8764999999999999e-05 2024-05-08T18:30:26.979 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.979 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.979 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:26.979 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674100+0000", 2024-05-08T18:30:26.979 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.004394528 2024-05-08T18:30:26.979 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.979 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.980 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:26.980 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674177+0000", 2024-05-08T18:30:26.980 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6530000000000001e-05 2024-05-08T18:30:26.980 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:26.980 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:26.980 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:26.980 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.980 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.980 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:26.980 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.794231+0000", 2024-05-08T18:30:26.980 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 35.165361572000002, 2024-05-08T18:30:26.980 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031872810000000001, 2024-05-08T18:30:26.980 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:26.980 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:26.981 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:26.981 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:26.981 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:26.981 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:26.981 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 236 2024-05-08T18:30:26.981 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.981 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:26.981 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.981 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:26.981 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794231+0000", 2024-05-08T18:30:26.981 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:26.981 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.981 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.981 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:26.981 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794231+0000", 2024-05-08T18:30:26.982 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:26.982 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.982 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.982 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:26.982 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794234+0000", 2024-05-08T18:30:26.982 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.36e-06 2024-05-08T18:30:26.982 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.982 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.982 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:26.982 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794248+0000", 2024-05-08T18:30:26.982 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4372999999999999e-05 2024-05-08T18:30:26.982 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.982 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.982 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:26.983 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794279+0000", 2024-05-08T18:30:26.983 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1075999999999999e-05 2024-05-08T18:30:26.983 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.983 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.983 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:26.983 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794295+0000", 2024-05-08T18:30:26.983 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5386000000000001e-05 2024-05-08T18:30:26.983 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.983 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.983 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:26.983 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794416+0000", 2024-05-08T18:30:26.983 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012071899999999999 2024-05-08T18:30:26.983 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.983 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.984 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:26.984 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794638+0000", 2024-05-08T18:30:26.984 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00022262599999999999 2024-05-08T18:30:26.984 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.984 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.984 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:26.984 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.795061+0000", 2024-05-08T18:30:26.984 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00042248900000000001 2024-05-08T18:30:26.984 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.984 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.984 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:26.984 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.796477+0000", 2024-05-08T18:30:26.984 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0014162230000000001 2024-05-08T18:30:26.985 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.985 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.985 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:26.985 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.797258+0000", 2024-05-08T18:30:26.985 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00078159400000000004 2024-05-08T18:30:26.985 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.985 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.985 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:26.985 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.797349+0000", 2024-05-08T18:30:26.985 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0462000000000002e-05 2024-05-08T18:30:26.985 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.985 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.986 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:26.986 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.797418+0000", 2024-05-08T18:30:26.986 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8973000000000005e-05 2024-05-08T18:30:26.986 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:26.986 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:26.986 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:26.986 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.986 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.986 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:281 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:26.986 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.806063+0000", 2024-05-08T18:30:26.986 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 35.153529438, 2024-05-08T18:30:26.986 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002923761, 2024-05-08T18:30:26.986 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:26.987 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:26.987 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:26.987 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:26.987 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:26.987 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:26.987 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 281 2024-05-08T18:30:26.987 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.987 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:26.987 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.987 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:26.987 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.806063+0000", 2024-05-08T18:30:26.987 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:26.987 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.988 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.988 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:26.988 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.806063+0000", 2024-05-08T18:30:26.988 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:26.988 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.988 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.988 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:26.988 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.806064+0000", 2024-05-08T18:30:26.988 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.204e-06 2024-05-08T18:30:26.988 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.988 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.988 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:26.988 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.806073+0000", 2024-05-08T18:30:26.988 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5609999999999999e-06 2024-05-08T18:30:26.989 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.989 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.989 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:26.989 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.806089+0000", 2024-05-08T18:30:26.989 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6673000000000001e-05 2024-05-08T18:30:26.989 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.989 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.989 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:26.989 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.806098+0000", 2024-05-08T18:30:26.989 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8899999999999996e-06 2024-05-08T18:30:26.989 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.989 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.989 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:26.990 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.806165+0000", 2024-05-08T18:30:26.990 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6927999999999993e-05 2024-05-08T18:30:26.990 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.990 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.990 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:26.990 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.806298+0000", 2024-05-08T18:30:26.990 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000132886 2024-05-08T18:30:26.990 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.990 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.990 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:26.990 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.806453+0000", 2024-05-08T18:30:26.990 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000155339 2024-05-08T18:30:26.990 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.990 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.991 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:26.991 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.807157+0000", 2024-05-08T18:30:26.991 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00070363900000000004 2024-05-08T18:30:26.991 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.991 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.991 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:26.991 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.808880+0000", 2024-05-08T18:30:26.991 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0017227130000000001 2024-05-08T18:30:26.991 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.991 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.991 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:26.991 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.808938+0000", 2024-05-08T18:30:26.991 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8814999999999998e-05 2024-05-08T18:30:26.992 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.992 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.992 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:26.992 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.808987+0000", 2024-05-08T18:30:26.992 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8112999999999998e-05 2024-05-08T18:30:26.992 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:26.992 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:26.992 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:26.992 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.992 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.992 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:304 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:26.992 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.809645+0000", 2024-05-08T18:30:26.992 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 35.149947599999997, 2024-05-08T18:30:26.993 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031633579999999998, 2024-05-08T18:30:26.993 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:26.993 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:26.993 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:26.993 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:26.993 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:26.993 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:26.993 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 304 2024-05-08T18:30:26.993 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.993 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:26.993 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.993 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:26.993 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809645+0000", 2024-05-08T18:30:26.993 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:26.994 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.994 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.994 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:26.994 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809645+0000", 2024-05-08T18:30:26.994 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:26.994 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.994 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.994 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:26.994 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809646+0000", 2024-05-08T18:30:26.994 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.113e-06 2024-05-08T18:30:26.994 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.994 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.994 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:26.995 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809652+0000", 2024-05-08T18:30:26.995 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1650000000000003e-06 2024-05-08T18:30:26.995 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.995 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.995 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:26.995 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809668+0000", 2024-05-08T18:30:26.995 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6025e-05 2024-05-08T18:30:26.995 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.995 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.995 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:26.995 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809678+0000", 2024-05-08T18:30:26.995 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0456e-05 2024-05-08T18:30:26.995 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.995 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.996 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:26.996 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809745+0000", 2024-05-08T18:30:26.996 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7088000000000005e-05 2024-05-08T18:30:26.996 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.996 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.996 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:26.996 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809803+0000", 2024-05-08T18:30:26.996 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7405999999999999e-05 2024-05-08T18:30:26.996 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.996 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.996 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:26.996 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809951+0000", 2024-05-08T18:30:26.996 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014775500000000001 2024-05-08T18:30:26.997 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.997 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.997 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:26.997 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.810564+0000", 2024-05-08T18:30:26.997 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00061324899999999996 2024-05-08T18:30:26.997 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.997 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.997 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:26.997 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.812744+0000", 2024-05-08T18:30:26.997 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0021804509999999999 2024-05-08T18:30:26.997 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.997 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.997 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:26.998 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.812781+0000", 2024-05-08T18:30:26.998 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6554999999999998e-05 2024-05-08T18:30:26.998 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.998 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.998 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:26.998 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.812808+0000", 2024-05-08T18:30:26.998 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7095000000000001e-05 2024-05-08T18:30:26.998 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:26.998 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:26.998 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:26.998 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.998 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.998 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:26.999 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.105553+0000", 2024-05-08T18:30:26.999 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 34.854039589000003, 2024-05-08T18:30:26.999 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028754850000000001, 2024-05-08T18:30:26.999 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:26.999 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:26.999 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:26.999 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:26.999 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:26.999 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:26.999 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 742 2024-05-08T18:30:26.999 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:26.999 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:26.999 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:26.999 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:27.000 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.105553+0000", 2024-05-08T18:30:27.000 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:27.000 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.000 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.000 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:27.000 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.105553+0000", 2024-05-08T18:30:27.000 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:27.000 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.000 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.000 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:27.000 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.105556+0000", 2024-05-08T18:30:27.000 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3100000000000001e-06 2024-05-08T18:30:27.001 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.001 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.001 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:27.001 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.105569+0000", 2024-05-08T18:30:27.001 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2754e-05 2024-05-08T18:30:27.001 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.002 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.002 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:27.002 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.105601+0000", 2024-05-08T18:30:27.002 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2435999999999999e-05 2024-05-08T18:30:27.002 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.002 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.003 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:27.003 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.105616+0000", 2024-05-08T18:30:27.003 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4657e-05 2024-05-08T18:30:27.003 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.003 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.004 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:27.004 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.105804+0000", 2024-05-08T18:30:27.004 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00018861799999999999 2024-05-08T18:30:27.004 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.004 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.004 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:27.005 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.106054+0000", 2024-05-08T18:30:27.005 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024948499999999997 2024-05-08T18:30:27.005 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.005 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.005 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:27.005 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.106390+0000", 2024-05-08T18:30:27.006 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00033640100000000001 2024-05-08T18:30:27.006 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.006 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.006 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:27.006 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.107527+0000", 2024-05-08T18:30:27.006 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001136871 2024-05-08T18:30:27.006 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.006 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.006 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:27.006 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.108265+0000", 2024-05-08T18:30:27.007 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00073753100000000004 2024-05-08T18:30:27.007 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.007 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.007 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:27.007 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.108353+0000", 2024-05-08T18:30:27.007 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8232999999999994e-05 2024-05-08T18:30:27.007 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.007 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.007 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:27.007 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.108428+0000", 2024-05-08T18:30:27.007 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.5189000000000001e-05 2024-05-08T18:30:27.007 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:27.007 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:27.007 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:27.008 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.008 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.008 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:27.008 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.148015+0000", 2024-05-08T18:30:27.008 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 34.811577646000003, 2024-05-08T18:30:27.008 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032297409999999999, 2024-05-08T18:30:27.008 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:27.008 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:27.008 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:27.008 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:27.008 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:27.008 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:27.008 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 760 2024-05-08T18:30:27.008 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.009 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:27.009 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.009 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:27.009 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.148015+0000", 2024-05-08T18:30:27.009 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:27.009 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.009 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.009 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:27.009 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.148015+0000", 2024-05-08T18:30:27.009 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:27.009 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.009 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.009 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:27.009 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.148017+0000", 2024-05-08T18:30:27.010 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1830000000000001e-06 2024-05-08T18:30:27.010 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.010 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.010 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:27.010 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.148030+0000", 2024-05-08T18:30:27.010 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2893e-05 2024-05-08T18:30:27.010 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.010 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.010 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:27.010 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.148061+0000", 2024-05-08T18:30:27.010 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0953e-05 2024-05-08T18:30:27.010 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.010 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.010 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:27.011 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.148077+0000", 2024-05-08T18:30:27.011 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6554000000000001e-05 2024-05-08T18:30:27.011 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.011 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.011 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:27.011 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.148230+0000", 2024-05-08T18:30:27.011 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015263899999999999 2024-05-08T18:30:27.011 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.011 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.011 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:27.011 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.148592+0000", 2024-05-08T18:30:27.011 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00036219699999999997 2024-05-08T18:30:27.011 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.012 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.012 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:27.012 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.149139+0000", 2024-05-08T18:30:27.012 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00054734599999999999 2024-05-08T18:30:27.012 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.012 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.012 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:27.012 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.150505+0000", 2024-05-08T18:30:27.012 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001365479 2024-05-08T18:30:27.012 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.012 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.012 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:27.012 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.151087+0000", 2024-05-08T18:30:27.012 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00058201200000000002 2024-05-08T18:30:27.013 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.013 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.013 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:27.013 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.151175+0000", 2024-05-08T18:30:27.013 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8199e-05 2024-05-08T18:30:27.013 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.013 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.013 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:27.013 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.151244+0000", 2024-05-08T18:30:27.013 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9286e-05 2024-05-08T18:30:27.013 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:27.013 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:27.013 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:27.013 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.014 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.014 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:27.014 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.277376+0000", 2024-05-08T18:30:27.014 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 34.682215728000003, 2024-05-08T18:30:27.014 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032022190000000001, 2024-05-08T18:30:27.014 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:27.014 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:27.014 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:27.014 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:27.014 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:27.014 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:27.014 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 817 2024-05-08T18:30:27.014 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.014 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:27.015 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.015 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:27.015 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.277376+0000", 2024-05-08T18:30:27.015 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:27.015 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.015 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.015 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:27.015 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.277376+0000", 2024-05-08T18:30:27.015 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:27.015 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.015 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.015 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:27.015 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.277379+0000", 2024-05-08T18:30:27.015 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4430000000000002e-06 2024-05-08T18:30:27.016 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.016 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.016 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:27.016 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.277391+0000", 2024-05-08T18:30:27.016 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1634000000000001e-05 2024-05-08T18:30:27.016 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.016 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.016 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:27.016 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.277421+0000", 2024-05-08T18:30:27.016 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0691999999999997e-05 2024-05-08T18:30:27.016 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.016 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.016 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:27.017 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.277438+0000", 2024-05-08T18:30:27.017 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7102999999999999e-05 2024-05-08T18:30:27.017 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.017 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.017 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:27.017 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.277602+0000", 2024-05-08T18:30:27.017 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016345300000000001 2024-05-08T18:30:27.017 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.017 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.017 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:27.017 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.278019+0000", 2024-05-08T18:30:27.017 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00041724699999999998 2024-05-08T18:30:27.017 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.017 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.017 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:27.018 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.278573+0000", 2024-05-08T18:30:27.018 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00055391900000000005 2024-05-08T18:30:27.018 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.018 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.018 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:27.018 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.279973+0000", 2024-05-08T18:30:27.018 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0013995819999999999 2024-05-08T18:30:27.018 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.018 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.018 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:27.018 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.280422+0000", 2024-05-08T18:30:27.018 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00044940699999999997 2024-05-08T18:30:27.018 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.019 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.019 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:27.019 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.280509+0000", 2024-05-08T18:30:27.019 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7455999999999997e-05 2024-05-08T18:30:27.019 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.019 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.019 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:27.019 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.280579+0000", 2024-05-08T18:30:27.019 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9282999999999994e-05 2024-05-08T18:30:27.019 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:27.019 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:27.019 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:27.019 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.020 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.020 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:27.020 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.281716+0000", 2024-05-08T18:30:27.020 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 34.677876361000003, 2024-05-08T18:30:27.020 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003275881, 2024-05-08T18:30:27.020 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:27.020 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:27.020 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:27.020 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:27.020 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:27.020 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:27.020 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 819 2024-05-08T18:30:27.021 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.021 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:27.021 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.021 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:27.021 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.281716+0000", 2024-05-08T18:30:27.021 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:27.021 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.021 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.021 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:27.021 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.281716+0000", 2024-05-08T18:30:27.021 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:27.021 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.021 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.021 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:27.022 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.281718+0000", 2024-05-08T18:30:27.022 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.863e-06 2024-05-08T18:30:27.022 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.022 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.022 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:27.022 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.281728+0000", 2024-05-08T18:30:27.022 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0550000000000001e-05 2024-05-08T18:30:27.022 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.022 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.023 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:27.023 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.281760+0000", 2024-05-08T18:30:27.023 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2150000000000002e-05 2024-05-08T18:30:27.023 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.023 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.023 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:27.023 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.281776+0000", 2024-05-08T18:30:27.023 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6005999999999999e-05 2024-05-08T18:30:27.023 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.023 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.023 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:27.023 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.281917+0000", 2024-05-08T18:30:27.023 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014070200000000001 2024-05-08T18:30:27.023 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.024 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.024 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:27.024 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.282148+0000", 2024-05-08T18:30:27.024 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023095200000000001 2024-05-08T18:30:27.024 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.024 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.024 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:27.024 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.282641+0000", 2024-05-08T18:30:27.024 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00049337999999999997 2024-05-08T18:30:27.024 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.024 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.024 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:27.024 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.284070+0000", 2024-05-08T18:30:27.024 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0014287950000000001 2024-05-08T18:30:27.025 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.025 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.025 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:27.025 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.284837+0000", 2024-05-08T18:30:27.025 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00076679799999999996 2024-05-08T18:30:27.025 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.025 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.025 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:27.025 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.284925+0000", 2024-05-08T18:30:27.025 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8165999999999996e-05 2024-05-08T18:30:27.025 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.025 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.025 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:27.026 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.284992+0000", 2024-05-08T18:30:27.026 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6519000000000005e-05 2024-05-08T18:30:27.026 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:27.026 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:27.026 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:27.026 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.026 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.026 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:27.026 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.334745+0000", 2024-05-08T18:30:27.026 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 34.624847451000001, 2024-05-08T18:30:27.026 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032404719999999999, 2024-05-08T18:30:27.026 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:27.026 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:27.027 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:27.027 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:27.027 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:27.027 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:27.027 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 841 2024-05-08T18:30:27.027 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.027 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:27.027 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.027 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:27.027 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.334745+0000", 2024-05-08T18:30:27.028 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:27.028 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.028 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.028 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:27.028 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.334745+0000", 2024-05-08T18:30:27.028 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:27.028 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.028 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.028 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:27.028 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.334747+0000", 2024-05-08T18:30:27.028 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.407e-06 2024-05-08T18:30:27.028 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.028 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.028 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:27.029 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.334759+0000", 2024-05-08T18:30:27.029 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1883e-05 2024-05-08T18:30:27.029 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.029 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.029 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:27.029 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.334789+0000", 2024-05-08T18:30:27.029 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9957000000000001e-05 2024-05-08T18:30:27.029 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.029 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.029 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:27.029 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.334804+0000", 2024-05-08T18:30:27.029 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4713e-05 2024-05-08T18:30:27.029 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.030 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.030 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:27.030 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.334951+0000", 2024-05-08T18:30:27.030 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000147675 2024-05-08T18:30:27.030 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.030 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.030 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:27.030 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.335304+0000", 2024-05-08T18:30:27.030 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00035214099999999999 2024-05-08T18:30:27.030 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.030 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.030 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:27.030 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.335859+0000", 2024-05-08T18:30:27.031 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00055546899999999995 2024-05-08T18:30:27.031 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.031 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.031 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:27.031 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.337168+0000", 2024-05-08T18:30:27.031 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0013087299999999999 2024-05-08T18:30:27.031 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.031 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.031 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:27.031 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.337808+0000", 2024-05-08T18:30:27.031 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00064005500000000005 2024-05-08T18:30:27.032 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.032 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.032 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:27.032 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.337894+0000", 2024-05-08T18:30:27.032 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6593000000000003e-05 2024-05-08T18:30:27.032 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.032 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.032 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:27.032 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.337985+0000", 2024-05-08T18:30:27.032 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0848999999999997e-05 2024-05-08T18:30:27.032 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:27.032 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:27.033 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:27.033 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.033 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.033 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:27.033 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.338870+0000", 2024-05-08T18:30:27.033 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 34.620722702000002, 2024-05-08T18:30:27.033 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002862121, 2024-05-08T18:30:27.033 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:27.033 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:27.033 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:27.033 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:27.033 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:27.033 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:27.033 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 843 2024-05-08T18:30:27.033 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.034 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:27.034 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.034 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:27.034 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.338870+0000", 2024-05-08T18:30:27.034 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:27.034 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.034 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.034 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:27.034 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.338870+0000", 2024-05-08T18:30:27.034 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:27.034 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.034 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.035 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:27.035 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.338872+0000", 2024-05-08T18:30:27.035 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3429999999999998e-06 2024-05-08T18:30:27.035 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.035 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.035 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:27.035 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.338883+0000", 2024-05-08T18:30:27.035 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1447000000000001e-05 2024-05-08T18:30:27.035 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.035 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.035 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:27.035 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.338914+0000", 2024-05-08T18:30:27.035 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1052e-05 2024-05-08T18:30:27.035 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.036 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.036 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:27.036 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.338932+0000", 2024-05-08T18:30:27.036 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7604e-05 2024-05-08T18:30:27.036 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.036 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.036 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:27.036 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.339019+0000", 2024-05-08T18:30:27.036 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6982000000000002e-05 2024-05-08T18:30:27.036 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.036 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.037 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:27.037 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.339139+0000", 2024-05-08T18:30:27.037 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011978599999999999 2024-05-08T18:30:27.037 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.037 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.037 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:27.037 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.339415+0000", 2024-05-08T18:30:27.037 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00027644799999999999 2024-05-08T18:30:27.037 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.037 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.037 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:27.037 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.340619+0000", 2024-05-08T18:30:27.037 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012043010000000001 2024-05-08T18:30:27.038 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.038 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.038 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:27.038 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.341454+0000", 2024-05-08T18:30:27.038 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00083464300000000004 2024-05-08T18:30:27.038 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.038 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.038 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:27.038 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.341609+0000", 2024-05-08T18:30:27.038 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000154752 2024-05-08T18:30:27.038 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.038 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.039 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:27.039 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.341732+0000", 2024-05-08T18:30:27.039 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012276299999999999 2024-05-08T18:30:27.039 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:27.039 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:27.039 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:27.039 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.039 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.039 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:27.039 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.349287+0000", 2024-05-08T18:30:27.039 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 34.610304872999997, 2024-05-08T18:30:27.039 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032683220000000002, 2024-05-08T18:30:27.039 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:27.040 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:27.040 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:27.040 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:27.040 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:27.040 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:27.040 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 847 2024-05-08T18:30:27.040 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.040 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:27.040 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.040 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:27.040 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.349287+0000", 2024-05-08T18:30:27.040 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:27.040 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.040 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.040 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:27.041 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.349287+0000", 2024-05-08T18:30:27.041 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:27.041 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.041 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.041 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:27.041 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.349290+0000", 2024-05-08T18:30:27.041 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3369999999999998e-06 2024-05-08T18:30:27.041 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.041 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.041 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:27.042 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.349318+0000", 2024-05-08T18:30:27.042 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8419999999999999e-05 2024-05-08T18:30:27.042 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.042 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.042 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:27.042 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.349348+0000", 2024-05-08T18:30:27.042 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0260000000000002e-05 2024-05-08T18:30:27.042 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.042 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.042 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:27.042 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.349364+0000", 2024-05-08T18:30:27.042 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5359999999999999e-05 2024-05-08T18:30:27.042 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.043 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.043 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:27.043 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.349511+0000", 2024-05-08T18:30:27.043 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014760199999999999 2024-05-08T18:30:27.043 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.043 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.043 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:27.043 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.349872+0000", 2024-05-08T18:30:27.043 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00036035 2024-05-08T18:30:27.043 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.043 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.043 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:27.043 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.350432+0000", 2024-05-08T18:30:27.044 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00056059600000000001 2024-05-08T18:30:27.044 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.044 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.044 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:27.044 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.351817+0000", 2024-05-08T18:30:27.044 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001385063 2024-05-08T18:30:27.044 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.044 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.044 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:27.044 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.352402+0000", 2024-05-08T18:30:27.044 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00058490500000000004 2024-05-08T18:30:27.044 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.044 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.044 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:27.044 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.352488+0000", 2024-05-08T18:30:27.045 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6032999999999994e-05 2024-05-08T18:30:27.045 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.045 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.045 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:27.045 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.352556+0000", 2024-05-08T18:30:27.045 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7396000000000003e-05 2024-05-08T18:30:27.045 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:27.045 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:27.045 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:27.045 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.045 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.045 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:27.045 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.353786+0000", 2024-05-08T18:30:27.046 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 34.605806037999997, 2024-05-08T18:30:27.046 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0029130850000000002, 2024-05-08T18:30:27.046 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:27.046 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:27.046 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:27.046 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:27.046 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:27.046 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:27.047 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 849 2024-05-08T18:30:27.047 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.047 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:27.047 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.047 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:27.047 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.353786+0000", 2024-05-08T18:30:27.047 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:27.047 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.047 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.047 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:27.047 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.353786+0000", 2024-05-08T18:30:27.047 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:27.047 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.048 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.048 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:27.048 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.353788+0000", 2024-05-08T18:30:27.048 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0370000000000001e-06 2024-05-08T18:30:27.048 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.048 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.048 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:27.048 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.353799+0000", 2024-05-08T18:30:27.048 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0686000000000001e-05 2024-05-08T18:30:27.048 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.048 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.048 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:27.048 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.353832+0000", 2024-05-08T18:30:27.048 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.341e-05 2024-05-08T18:30:27.049 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.049 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.049 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:27.049 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.353851+0000", 2024-05-08T18:30:27.049 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8343999999999999e-05 2024-05-08T18:30:27.049 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.049 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.049 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:27.049 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.353980+0000", 2024-05-08T18:30:27.049 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012914900000000001 2024-05-08T18:30:27.049 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.049 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.050 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:27.050 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.354123+0000", 2024-05-08T18:30:27.050 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000142912 2024-05-08T18:30:27.050 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.050 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.050 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:27.050 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.354393+0000", 2024-05-08T18:30:27.050 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00027009799999999997 2024-05-08T18:30:27.050 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.050 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.050 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:27.050 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.355769+0000", 2024-05-08T18:30:27.050 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001375839 2024-05-08T18:30:27.051 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.051 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.051 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:27.051 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.356421+0000", 2024-05-08T18:30:27.051 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00065227799999999995 2024-05-08T18:30:27.051 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.051 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.051 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:27.051 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.356592+0000", 2024-05-08T18:30:27.051 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000170586 2024-05-08T18:30:27.051 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.051 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.051 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:27.052 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.356699+0000", 2024-05-08T18:30:27.052 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010774599999999999 2024-05-08T18:30:27.052 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:27.052 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:27.052 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:27.052 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.052 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.052 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:27.052 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.402673+0000", 2024-05-08T18:30:27.052 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 34.556919364999999, 2024-05-08T18:30:27.052 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002928295, 2024-05-08T18:30:27.052 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:27.052 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:27.052 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:27.053 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:27.053 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:27.053 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:27.053 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 870 2024-05-08T18:30:27.053 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.053 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:27.054 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.054 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:27.054 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.402673+0000", 2024-05-08T18:30:27.054 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:27.054 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.054 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.054 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:27.054 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.402673+0000", 2024-05-08T18:30:27.054 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:27.054 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.054 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.054 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:27.055 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.402675+0000", 2024-05-08T18:30:27.055 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0030000000000001e-06 2024-05-08T18:30:27.055 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.055 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.055 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:27.055 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.402685+0000", 2024-05-08T18:30:27.055 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0566e-05 2024-05-08T18:30:27.055 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.055 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.055 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:27.056 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.402714+0000", 2024-05-08T18:30:27.056 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8804999999999999e-05 2024-05-08T18:30:27.056 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.056 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.056 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:27.056 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.402731+0000", 2024-05-08T18:30:27.056 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6731e-05 2024-05-08T18:30:27.056 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.056 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.056 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:27.057 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.402863+0000", 2024-05-08T18:30:27.057 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013194199999999999 2024-05-08T18:30:27.057 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.057 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.057 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:27.057 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.403096+0000", 2024-05-08T18:30:27.057 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023309900000000001 2024-05-08T18:30:27.057 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.057 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.057 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:27.057 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.403553+0000", 2024-05-08T18:30:27.057 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00045738700000000002 2024-05-08T18:30:27.057 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.057 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.058 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:27.058 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.404843+0000", 2024-05-08T18:30:27.058 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012894650000000001 2024-05-08T18:30:27.058 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.058 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.058 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:27.058 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.405348+0000", 2024-05-08T18:30:27.058 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00050483600000000004 2024-05-08T18:30:27.058 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.058 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.058 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:27.058 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.405491+0000", 2024-05-08T18:30:27.059 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014349299999999999 2024-05-08T18:30:27.059 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.059 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.059 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:27.059 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.405601+0000", 2024-05-08T18:30:27.059 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000109968 2024-05-08T18:30:27.059 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:27.059 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:27.059 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:27.059 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.059 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.059 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:27.059 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.484247+0000", 2024-05-08T18:30:27.060 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 34.475345165, 2024-05-08T18:30:27.060 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028903679999999999, 2024-05-08T18:30:27.060 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:27.060 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:27.060 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:27.060 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:27.060 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:27.060 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:27.060 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 907 2024-05-08T18:30:27.060 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.060 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:27.060 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.060 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:27.061 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.484247+0000", 2024-05-08T18:30:27.061 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:27.061 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.061 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.061 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:27.061 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.484247+0000", 2024-05-08T18:30:27.061 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:27.061 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.061 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.061 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:27.061 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.484250+0000", 2024-05-08T18:30:27.062 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6900000000000001e-06 2024-05-08T18:30:27.062 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.062 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.062 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:27.062 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.484263+0000", 2024-05-08T18:30:27.062 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2967e-05 2024-05-08T18:30:27.062 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.062 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.062 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:27.062 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.484294+0000", 2024-05-08T18:30:27.062 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1016000000000003e-05 2024-05-08T18:30:27.062 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.063 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.063 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:27.063 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.484309+0000", 2024-05-08T18:30:27.063 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5187e-05 2024-05-08T18:30:27.063 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.063 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.063 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:27.063 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.484467+0000", 2024-05-08T18:30:27.063 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015810499999999999 2024-05-08T18:30:27.063 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.063 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.064 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:27.064 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.484698+0000", 2024-05-08T18:30:27.064 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000230852 2024-05-08T18:30:27.064 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.064 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.064 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:27.065 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.485026+0000", 2024-05-08T18:30:27.065 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00032833 2024-05-08T18:30:27.065 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.065 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.065 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:27.065 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.486177+0000", 2024-05-08T18:30:27.065 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0011504309999999999 2024-05-08T18:30:27.065 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.065 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.065 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:27.065 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.486978+0000", 2024-05-08T18:30:27.066 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000801161 2024-05-08T18:30:27.066 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.066 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.066 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:27.066 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.487068+0000", 2024-05-08T18:30:27.066 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0435999999999999e-05 2024-05-08T18:30:27.066 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.066 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.066 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:27.066 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.487137+0000", 2024-05-08T18:30:27.066 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9193e-05 2024-05-08T18:30:27.066 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:27.067 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:27.067 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:27.067 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.067 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.067 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:27.067 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.585363+0000", 2024-05-08T18:30:27.067 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 34.374229321999998, 2024-05-08T18:30:27.067 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028400080000000002, 2024-05-08T18:30:27.067 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:27.067 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:27.067 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:27.068 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:27.068 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:27.068 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:27.068 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 949 2024-05-08T18:30:27.068 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.068 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:27.068 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.068 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:27.068 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.585363+0000", 2024-05-08T18:30:27.068 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:27.068 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.068 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.068 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:27.069 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.585363+0000", 2024-05-08T18:30:27.069 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:27.069 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.069 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.069 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:27.069 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.585366+0000", 2024-05-08T18:30:27.069 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7099999999999999e-06 2024-05-08T18:30:27.069 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.069 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.069 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:27.069 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.585378+0000", 2024-05-08T18:30:27.069 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1970000000000001e-05 2024-05-08T18:30:27.069 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.070 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.070 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:27.070 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.585408+0000", 2024-05-08T18:30:27.070 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0389999999999999e-05 2024-05-08T18:30:27.070 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.070 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.070 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:27.071 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.585423+0000", 2024-05-08T18:30:27.071 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4929999999999999e-05 2024-05-08T18:30:27.071 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.071 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.071 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:27.071 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.585559+0000", 2024-05-08T18:30:27.071 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013563599999999999 2024-05-08T18:30:27.072 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.072 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.072 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:27.072 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.585780+0000", 2024-05-08T18:30:27.072 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000221828 2024-05-08T18:30:27.072 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.072 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.072 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:27.073 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.586121+0000", 2024-05-08T18:30:27.073 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000340181 2024-05-08T18:30:27.073 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.073 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.073 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:27.073 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.587268+0000", 2024-05-08T18:30:27.073 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001146984 2024-05-08T18:30:27.073 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.073 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.074 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:27.074 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.588047+0000", 2024-05-08T18:30:27.074 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000779877 2024-05-08T18:30:27.074 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.074 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.074 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:27.075 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.588136+0000", 2024-05-08T18:30:27.075 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8483e-05 2024-05-08T18:30:27.075 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.075 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.075 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:27.075 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.588203+0000", 2024-05-08T18:30:27.076 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7019000000000003e-05 2024-05-08T18:30:27.076 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:27.076 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:27.076 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:27.076 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.076 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.076 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:951 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:27.077 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.589044+0000", 2024-05-08T18:30:27.077 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 34.370547899999998, 2024-05-08T18:30:27.077 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002802672, 2024-05-08T18:30:27.077 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:27.077 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:27.077 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:27.077 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:27.078 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:27.078 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:27.078 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 951 2024-05-08T18:30:27.078 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.078 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:27.078 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.078 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:27.078 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.589044+0000", 2024-05-08T18:30:27.079 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:27.079 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.079 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.079 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:27.079 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.589044+0000", 2024-05-08T18:30:27.079 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:27.080 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.080 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.080 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:27.080 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.589046+0000", 2024-05-08T18:30:27.080 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6670000000000001e-06 2024-05-08T18:30:27.080 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.081 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.081 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:27.081 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.589054+0000", 2024-05-08T18:30:27.081 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.2600000000000005e-06 2024-05-08T18:30:27.081 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.081 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.081 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:27.082 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.589076+0000", 2024-05-08T18:30:27.082 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1373e-05 2024-05-08T18:30:27.082 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.082 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.082 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:27.082 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.589088+0000", 2024-05-08T18:30:27.082 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2768999999999999e-05 2024-05-08T18:30:27.083 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.083 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.083 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:27.083 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.589220+0000", 2024-05-08T18:30:27.083 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013146300000000001 2024-05-08T18:30:27.083 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.083 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.083 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:27.083 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.589462+0000", 2024-05-08T18:30:27.083 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024250500000000001 2024-05-08T18:30:27.084 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.084 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.084 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:27.084 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.589956+0000", 2024-05-08T18:30:27.084 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00049331600000000005 2024-05-08T18:30:27.084 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.084 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.084 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:27.084 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.591337+0000", 2024-05-08T18:30:27.084 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0013816290000000001 2024-05-08T18:30:27.084 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.084 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.084 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:27.085 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.591688+0000", 2024-05-08T18:30:27.085 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00035083400000000001 2024-05-08T18:30:27.085 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.085 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.085 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:27.085 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.591780+0000", 2024-05-08T18:30:27.085 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.2312999999999995e-05 2024-05-08T18:30:27.085 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.085 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.085 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:27.085 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.591847+0000", 2024-05-08T18:30:27.085 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6543000000000003e-05 2024-05-08T18:30:27.085 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:27.085 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:27.086 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:27.086 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.086 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.086 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:27.086 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.599312+0000", 2024-05-08T18:30:27.086 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 34.360280435999996, 2024-05-08T18:30:27.086 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0027928190000000002, 2024-05-08T18:30:27.086 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:27.086 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:27.086 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:27.086 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:27.086 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:27.087 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:27.087 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 955 2024-05-08T18:30:27.087 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.087 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:27.087 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.087 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:27.087 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.599312+0000", 2024-05-08T18:30:27.087 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:27.087 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.087 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.087 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:27.088 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.599312+0000", 2024-05-08T18:30:27.088 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:27.088 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.088 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.088 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:27.088 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.599314+0000", 2024-05-08T18:30:27.088 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.396e-06 2024-05-08T18:30:27.088 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.088 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.088 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:27.088 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.599325+0000", 2024-05-08T18:30:27.089 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1063999999999999e-05 2024-05-08T18:30:27.089 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.089 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.089 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:27.089 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.599354+0000", 2024-05-08T18:30:27.089 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8462999999999998e-05 2024-05-08T18:30:27.089 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.089 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.089 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:27.089 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.599369+0000", 2024-05-08T18:30:27.089 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4963000000000001e-05 2024-05-08T18:30:27.089 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.089 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.089 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:27.090 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.599503+0000", 2024-05-08T18:30:27.090 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013385299999999999 2024-05-08T18:30:27.090 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.090 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.090 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:27.090 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.599744+0000", 2024-05-08T18:30:27.090 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024137400000000001 2024-05-08T18:30:27.090 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.090 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.090 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:27.090 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.600084+0000", 2024-05-08T18:30:27.090 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00033999399999999998 2024-05-08T18:30:27.091 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.091 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.091 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:27.091 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.601319+0000", 2024-05-08T18:30:27.091 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012348140000000001 2024-05-08T18:30:27.091 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.091 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.091 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:27.091 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.601956+0000", 2024-05-08T18:30:27.091 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00063721199999999996 2024-05-08T18:30:27.091 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.091 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.091 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:27.091 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.602038+0000", 2024-05-08T18:30:27.092 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.1705999999999993e-05 2024-05-08T18:30:27.092 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.092 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.092 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:27.092 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.602105+0000", 2024-05-08T18:30:27.092 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6979999999999999e-05 2024-05-08T18:30:27.092 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:27.092 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:27.092 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:27.092 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:27.093 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:27.093 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:30:27.094 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-08T18:30:27.095 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:30:27.095+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:30:27.194 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:30:27.197+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:30:27.261 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:30:27.261 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:30:27.261 INFO:teuthology.orchestra.run.smithi097.stdout: "num_ops": 0 2024-05-08T18:30:27.261 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:30:27.262 INFO:teuthology.orchestra.run.smithi097.stderr:nodeep-scrub is set 2024-05-08T18:30:27.282 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-08T18:30:27.295 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:30:27.291+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:30:27.396 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:30:27.397+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:30:27.451 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:30:27.451 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:30:27.451 INFO:teuthology.orchestra.run.smithi097.stdout: "complaint_time": 30, 2024-05-08T18:30:27.451 INFO:teuthology.orchestra.run.smithi097.stdout: "num_blocked_ops": 0 2024-05-08T18:30:27.451 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:30:27.466 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-08T18:30:27.497 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:30:27.495+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:30:27.599 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:30:27.599+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:30:27.635 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:30:27.635 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2024-05-08T18:30:27.635 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2024-05-08T18:30:27.635 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-05-08T18:30:27.635 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.635 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:57 7.3 7:c609908c:::notify.5:head [watch watch cookie 94069412621696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:30:27.635 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:48.668590+0000", 2024-05-08T18:30:27.636 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 38.966100416000003, 2024-05-08T18:30:27.636 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0054375830000000002, 2024-05-08T18:30:27.636 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:27.636 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:27.636 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:27.636 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:27.636 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:27.636 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:27.636 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 57 2024-05-08T18:30:27.636 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.636 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:27.636 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.636 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:27.636 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668590+0000", 2024-05-08T18:30:27.637 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:27.637 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.637 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.637 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:27.637 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668590+0000", 2024-05-08T18:30:27.637 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:27.637 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.637 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.637 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:27.637 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668592+0000", 2024-05-08T18:30:27.637 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0930000000000001e-06 2024-05-08T18:30:27.637 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.637 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.638 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:27.638 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668619+0000", 2024-05-08T18:30:27.638 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7396999999999999e-05 2024-05-08T18:30:27.638 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.638 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.638 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:27.638 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668650+0000", 2024-05-08T18:30:27.638 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0620000000000002e-05 2024-05-08T18:30:27.638 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.638 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.638 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:27.638 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668672+0000", 2024-05-08T18:30:27.638 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2093e-05 2024-05-08T18:30:27.638 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.639 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.639 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:27.639 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668782+0000", 2024-05-08T18:30:27.639 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011010600000000001 2024-05-08T18:30:27.639 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.639 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.639 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:27.639 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668934+0000", 2024-05-08T18:30:27.639 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000152268 2024-05-08T18:30:27.639 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.639 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.639 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-05-08T18:30:27.639 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669177+0000", 2024-05-08T18:30:27.639 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024286500000000001 2024-05-08T18:30:27.640 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.640 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.640 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:27.640 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.670404+0000", 2024-05-08T18:30:27.640 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001226932 2024-05-08T18:30:27.640 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.640 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.640 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:27.640 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.673822+0000", 2024-05-08T18:30:27.640 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003417776 2024-05-08T18:30:27.640 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.640 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.640 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:27.640 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.673924+0000", 2024-05-08T18:30:27.640 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000102379 2024-05-08T18:30:27.641 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.641 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.641 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:27.641 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674027+0000", 2024-05-08T18:30:27.641 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010305400000000001 2024-05-08T18:30:27.641 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:27.641 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:27.641 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:27.641 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.641 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.641 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:58 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:30:27.641 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:48.668750+0000", 2024-05-08T18:30:27.641 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 38.965939990000003, 2024-05-08T18:30:27.641 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0057687559999999999, 2024-05-08T18:30:27.642 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:27.642 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:27.642 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:27.642 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:27.642 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:27.642 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:27.642 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 58 2024-05-08T18:30:27.642 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.642 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:27.642 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.642 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:27.642 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668750+0000", 2024-05-08T18:30:27.643 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:27.643 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.643 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.643 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:27.643 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668750+0000", 2024-05-08T18:30:27.643 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:27.643 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.643 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.643 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:27.643 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668752+0000", 2024-05-08T18:30:27.643 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.64e-06 2024-05-08T18:30:27.643 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.643 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.644 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:27.644 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668760+0000", 2024-05-08T18:30:27.644 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5529999999999993e-06 2024-05-08T18:30:27.644 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.644 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.644 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:27.644 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668787+0000", 2024-05-08T18:30:27.644 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6475999999999999e-05 2024-05-08T18:30:27.644 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.644 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.644 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:27.644 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668804+0000", 2024-05-08T18:30:27.644 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7163000000000002e-05 2024-05-08T18:30:27.645 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.645 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.645 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:27.645 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668906+0000", 2024-05-08T18:30:27.645 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010241 2024-05-08T18:30:27.645 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.645 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.645 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:27.645 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669068+0000", 2024-05-08T18:30:27.645 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016144400000000001 2024-05-08T18:30:27.645 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.645 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.645 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-05-08T18:30:27.645 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669226+0000", 2024-05-08T18:30:27.645 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000158639 2024-05-08T18:30:27.646 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.646 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.646 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:27.646 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.670439+0000", 2024-05-08T18:30:27.646 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012124480000000001 2024-05-08T18:30:27.646 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.646 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.646 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:27.646 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674406+0000", 2024-05-08T18:30:27.646 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0039675259999999999 2024-05-08T18:30:27.646 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.646 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.647 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:27.647 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674469+0000", 2024-05-08T18:30:27.647 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.2903000000000004e-05 2024-05-08T18:30:27.647 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.647 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.647 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:27.647 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674519+0000", 2024-05-08T18:30:27.647 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9554e-05 2024-05-08T18:30:27.647 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:27.647 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:27.647 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:27.647 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.647 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.647 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:30:27.647 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.675404+0000", 2024-05-08T18:30:27.648 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 35.959286218999999, 2024-05-08T18:30:27.648 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003903147, 2024-05-08T18:30:27.648 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:27.648 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:27.648 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:27.648 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:27.648 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:27.648 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:27.648 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 207 2024-05-08T18:30:27.648 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.648 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:27.648 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.648 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:27.648 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675404+0000", 2024-05-08T18:30:27.649 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:27.649 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.649 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.649 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:27.649 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675404+0000", 2024-05-08T18:30:27.649 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:27.649 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.649 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.649 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:27.649 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675407+0000", 2024-05-08T18:30:27.649 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1729999999999999e-06 2024-05-08T18:30:27.649 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.649 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.649 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:27.650 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675422+0000", 2024-05-08T18:30:27.650 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.485e-05 2024-05-08T18:30:27.650 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.650 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.650 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:27.650 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675454+0000", 2024-05-08T18:30:27.650 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1656000000000003e-05 2024-05-08T18:30:27.650 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.650 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.650 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:27.650 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675470+0000", 2024-05-08T18:30:27.650 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.626e-05 2024-05-08T18:30:27.650 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.651 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.651 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:27.651 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675683+0000", 2024-05-08T18:30:27.651 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021312600000000001 2024-05-08T18:30:27.651 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.651 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.651 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:27.651 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675972+0000", 2024-05-08T18:30:27.651 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00028885100000000002 2024-05-08T18:30:27.651 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.651 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.651 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:30:27.651 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.676369+0000", 2024-05-08T18:30:27.651 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000397227 2024-05-08T18:30:27.652 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.652 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.652 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:27.652 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.677780+0000", 2024-05-08T18:30:27.652 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001411186 2024-05-08T18:30:27.652 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.652 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.652 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:27.652 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679153+0000", 2024-05-08T18:30:27.652 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0013725720000000001 2024-05-08T18:30:27.652 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.652 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.652 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:27.653 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679240+0000", 2024-05-08T18:30:27.653 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7412999999999998e-05 2024-05-08T18:30:27.653 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.653 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.653 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:27.653 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679307+0000", 2024-05-08T18:30:27.653 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6833000000000002e-05 2024-05-08T18:30:27.653 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:27.653 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:27.653 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:27.653 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.653 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.653 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:27.653 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.721317+0000", 2024-05-08T18:30:27.654 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 35.913373473, 2024-05-08T18:30:27.654 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032842140000000001, 2024-05-08T18:30:27.654 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:27.654 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:27.654 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:27.654 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:27.654 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:27.654 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:27.654 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 216 2024-05-08T18:30:27.654 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.654 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:27.654 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.654 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:27.655 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.721317+0000", 2024-05-08T18:30:27.655 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:27.655 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.655 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.655 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:27.655 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.721317+0000", 2024-05-08T18:30:27.655 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:27.655 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.655 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.655 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:27.655 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.721320+0000", 2024-05-08T18:30:27.655 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.303e-06 2024-05-08T18:30:27.655 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.655 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.656 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:27.656 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.721335+0000", 2024-05-08T18:30:27.656 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4543e-05 2024-05-08T18:30:27.656 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.656 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.656 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:27.656 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.721370+0000", 2024-05-08T18:30:27.656 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5336000000000002e-05 2024-05-08T18:30:27.656 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.656 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.656 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:27.656 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.721393+0000", 2024-05-08T18:30:27.656 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2710000000000001e-05 2024-05-08T18:30:27.656 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.657 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.657 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:27.657 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.721592+0000", 2024-05-08T18:30:27.657 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00019917900000000001 2024-05-08T18:30:27.657 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.657 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.657 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:27.657 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.721815+0000", 2024-05-08T18:30:27.657 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000223742 2024-05-08T18:30:27.657 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.657 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.657 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:27.657 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.722268+0000", 2024-05-08T18:30:27.657 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00045295900000000001 2024-05-08T18:30:27.658 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.658 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.658 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:27.658 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.723878+0000", 2024-05-08T18:30:27.658 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001609828 2024-05-08T18:30:27.658 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.658 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.658 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:27.658 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.724433+0000", 2024-05-08T18:30:27.658 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00055512499999999995 2024-05-08T18:30:27.658 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.658 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.658 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:27.658 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.724528+0000", 2024-05-08T18:30:27.659 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.4887000000000001e-05 2024-05-08T18:30:27.659 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.659 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.659 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:27.659 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.724601+0000", 2024-05-08T18:30:27.659 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2601999999999994e-05 2024-05-08T18:30:27.659 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:27.659 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:27.659 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:27.659 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.659 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.659 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:27.659 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.761586+0000", 2024-05-08T18:30:27.659 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 35.873104627000004, 2024-05-08T18:30:27.660 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031756979999999998, 2024-05-08T18:30:27.660 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:27.660 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:27.660 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:27.660 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:27.660 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:27.660 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:27.660 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 227 2024-05-08T18:30:27.660 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.660 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:27.660 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.660 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:27.660 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.761586+0000", 2024-05-08T18:30:27.660 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:27.660 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.661 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.661 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:27.661 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.761586+0000", 2024-05-08T18:30:27.661 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:27.661 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.661 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.661 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:27.661 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.761588+0000", 2024-05-08T18:30:27.661 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7499999999999999e-06 2024-05-08T18:30:27.661 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.661 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.661 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:27.661 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.761600+0000", 2024-05-08T18:30:27.662 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2003e-05 2024-05-08T18:30:27.662 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.662 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.662 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:27.662 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.761632+0000", 2024-05-08T18:30:27.662 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1933000000000001e-05 2024-05-08T18:30:27.662 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.662 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.662 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:27.662 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.761648+0000", 2024-05-08T18:30:27.662 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5339999999999999e-05 2024-05-08T18:30:27.662 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.662 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.663 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:27.663 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.761773+0000", 2024-05-08T18:30:27.663 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012576199999999999 2024-05-08T18:30:27.663 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.663 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.663 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:27.663 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.762037+0000", 2024-05-08T18:30:27.663 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00026385100000000001 2024-05-08T18:30:27.663 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.663 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.663 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:27.663 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.762455+0000", 2024-05-08T18:30:27.663 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00041760700000000002 2024-05-08T18:30:27.663 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.663 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.665 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:27.665 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.764035+0000", 2024-05-08T18:30:27.666 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001580318 2024-05-08T18:30:27.666 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.666 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.666 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:27.666 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.764602+0000", 2024-05-08T18:30:27.666 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00056661899999999998 2024-05-08T18:30:27.666 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.666 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.666 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:27.666 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.764685+0000", 2024-05-08T18:30:27.666 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.3562999999999999e-05 2024-05-08T18:30:27.666 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.667 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.667 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:27.667 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.764761+0000", 2024-05-08T18:30:27.667 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.5951999999999994e-05 2024-05-08T18:30:27.667 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:27.667 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:27.667 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:27.667 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.667 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.667 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:27.667 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.768858+0000", 2024-05-08T18:30:27.667 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 35.865832044000001, 2024-05-08T18:30:27.667 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031906619999999999, 2024-05-08T18:30:27.667 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:27.668 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:27.668 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:27.668 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:27.668 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:27.668 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:27.668 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 229 2024-05-08T18:30:27.668 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.668 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:27.668 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.668 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:27.668 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.768858+0000", 2024-05-08T18:30:27.668 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:27.668 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.668 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.669 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:27.669 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.768858+0000", 2024-05-08T18:30:27.669 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:27.669 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.669 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.669 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:27.669 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.768861+0000", 2024-05-08T18:30:27.669 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5469999999999999e-06 2024-05-08T18:30:27.669 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.669 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.669 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:27.669 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.768872+0000", 2024-05-08T18:30:27.669 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1712999999999999e-05 2024-05-08T18:30:27.670 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.670 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.670 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:27.670 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.768903+0000", 2024-05-08T18:30:27.670 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0636000000000003e-05 2024-05-08T18:30:27.670 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.670 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.670 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:27.670 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.768918+0000", 2024-05-08T18:30:27.670 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4977000000000001e-05 2024-05-08T18:30:27.670 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.670 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.670 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:27.671 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.769037+0000", 2024-05-08T18:30:27.671 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011918599999999999 2024-05-08T18:30:27.671 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.671 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.671 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:27.671 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.769256+0000", 2024-05-08T18:30:27.671 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021839400000000001 2024-05-08T18:30:27.671 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.671 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.671 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:30:27.671 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.769656+0000", 2024-05-08T18:30:27.671 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00040066400000000001 2024-05-08T18:30:27.671 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.671 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.672 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:27.672 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.771116+0000", 2024-05-08T18:30:27.672 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001459389 2024-05-08T18:30:27.672 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.672 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.672 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:27.672 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.771896+0000", 2024-05-08T18:30:27.672 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00077997400000000001 2024-05-08T18:30:27.672 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.672 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.672 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:27.672 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.771984+0000", 2024-05-08T18:30:27.672 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8483e-05 2024-05-08T18:30:27.672 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.673 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.673 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:27.673 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772049+0000", 2024-05-08T18:30:27.673 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.4698999999999998e-05 2024-05-08T18:30:27.673 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:27.673 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:27.673 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:27.673 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.673 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.673 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:27.673 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.776086+0000", 2024-05-08T18:30:27.673 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 35.858604053000001, 2024-05-08T18:30:27.673 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0037528710000000001, 2024-05-08T18:30:27.673 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:27.674 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:27.674 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:27.674 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:27.674 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:27.674 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:27.674 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 231 2024-05-08T18:30:27.674 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.674 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:27.674 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.674 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:27.674 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.776086+0000", 2024-05-08T18:30:27.674 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:27.674 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.675 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.675 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:27.675 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.776086+0000", 2024-05-08T18:30:27.675 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:27.675 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.675 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.675 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:27.675 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.776089+0000", 2024-05-08T18:30:27.675 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8870000000000001e-06 2024-05-08T18:30:27.675 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.675 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.675 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:27.675 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.776102+0000", 2024-05-08T18:30:27.675 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.294e-05 2024-05-08T18:30:27.675 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.676 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.676 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:27.676 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.776132+0000", 2024-05-08T18:30:27.676 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0113000000000001e-05 2024-05-08T18:30:27.676 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.676 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.676 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:27.676 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.776150+0000", 2024-05-08T18:30:27.676 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8216999999999999e-05 2024-05-08T18:30:27.676 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.676 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.676 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:27.676 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.776268+0000", 2024-05-08T18:30:27.676 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000117395 2024-05-08T18:30:27.677 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.677 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.677 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:27.677 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.776514+0000", 2024-05-08T18:30:27.677 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024602899999999999 2024-05-08T18:30:27.677 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.677 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.677 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:27.677 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.776920+0000", 2024-05-08T18:30:27.677 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000406723 2024-05-08T18:30:27.677 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.677 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.677 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:27.677 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.778360+0000", 2024-05-08T18:30:27.677 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0014393279999999999 2024-05-08T18:30:27.678 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.678 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.678 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:27.678 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.779687+0000", 2024-05-08T18:30:27.678 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001327674 2024-05-08T18:30:27.678 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.678 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.678 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:27.678 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.779777+0000", 2024-05-08T18:30:27.678 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9152000000000003e-05 2024-05-08T18:30:27.678 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.678 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.679 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:27.679 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.779839+0000", 2024-05-08T18:30:27.679 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.2413e-05 2024-05-08T18:30:27.679 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:27.679 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:27.679 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:27.679 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.679 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.679 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:257 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:27.679 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.802295+0000", 2024-05-08T18:30:27.679 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 35.832394913000002, 2024-05-08T18:30:27.679 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0030517880000000002, 2024-05-08T18:30:27.679 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:27.679 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:27.680 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:27.680 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:27.680 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:27.680 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:27.680 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 257 2024-05-08T18:30:27.680 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.680 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:27.680 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.680 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:27.680 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.802295+0000", 2024-05-08T18:30:27.680 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:27.680 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.680 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.680 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:27.681 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.802295+0000", 2024-05-08T18:30:27.681 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:27.681 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.681 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.681 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:27.681 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.802296+0000", 2024-05-08T18:30:27.681 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.6700000000000002e-07 2024-05-08T18:30:27.681 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.681 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.681 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:27.681 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.802301+0000", 2024-05-08T18:30:27.681 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.0250000000000002e-06 2024-05-08T18:30:27.681 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.681 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.682 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:27.682 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.802321+0000", 2024-05-08T18:30:27.682 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9521000000000002e-05 2024-05-08T18:30:27.682 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.682 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.682 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:27.682 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.802330+0000", 2024-05-08T18:30:27.682 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.4259999999999992e-06 2024-05-08T18:30:27.682 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.682 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.682 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:27.682 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.802386+0000", 2024-05-08T18:30:27.682 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5974999999999999e-05 2024-05-08T18:30:27.683 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.683 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.683 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:27.683 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.802463+0000", 2024-05-08T18:30:27.683 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6582999999999995e-05 2024-05-08T18:30:27.683 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.683 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.683 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:27.683 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.802613+0000", 2024-05-08T18:30:27.683 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000150715 2024-05-08T18:30:27.683 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.683 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.683 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:27.683 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.803223+0000", 2024-05-08T18:30:27.684 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00060949799999999998 2024-05-08T18:30:27.684 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.684 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.684 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:27.684 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.805250+0000", 2024-05-08T18:30:27.684 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0020268339999999999 2024-05-08T18:30:27.684 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.684 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.684 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:27.684 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.805303+0000", 2024-05-08T18:30:27.684 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3562e-05 2024-05-08T18:30:27.684 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.684 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.684 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:27.685 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.805347+0000", 2024-05-08T18:30:27.685 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3682e-05 2024-05-08T18:30:27.685 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:27.685 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:27.685 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:27.685 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.685 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.685 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:422 6.c 6:338eb7e9:::obj_delete_at_hint.0000000008:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:27.685 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.847436+0000", 2024-05-08T18:30:27.685 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 35.787253849999999, 2024-05-08T18:30:27.685 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0029413439999999998, 2024-05-08T18:30:27.685 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:27.685 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:27.685 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:27.686 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:27.686 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:27.686 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:27.686 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 422 2024-05-08T18:30:27.686 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.686 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:27.686 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.686 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:27.686 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847436+0000", 2024-05-08T18:30:27.686 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:27.686 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.686 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.686 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:27.686 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847436+0000", 2024-05-08T18:30:27.687 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:27.687 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.687 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.687 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:27.687 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847437+0000", 2024-05-08T18:30:27.687 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.009e-06 2024-05-08T18:30:27.687 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.687 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.687 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:27.687 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847442+0000", 2024-05-08T18:30:27.687 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9049999999999996e-06 2024-05-08T18:30:27.687 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.687 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.687 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:27.688 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847454+0000", 2024-05-08T18:30:27.688 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1358e-05 2024-05-08T18:30:27.688 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.688 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.688 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:27.688 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847459+0000", 2024-05-08T18:30:27.688 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7180000000000001e-06 2024-05-08T18:30:27.688 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.688 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.688 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:27.688 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847516+0000", 2024-05-08T18:30:27.688 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6558999999999998e-05 2024-05-08T18:30:27.688 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.689 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.689 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:27.689 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847582+0000", 2024-05-08T18:30:27.689 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5772000000000007e-05 2024-05-08T18:30:27.689 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.689 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.689 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:27.689 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847718+0000", 2024-05-08T18:30:27.689 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013664100000000001 2024-05-08T18:30:27.689 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.689 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.689 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:27.689 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.848257+0000", 2024-05-08T18:30:27.689 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00053853699999999996 2024-05-08T18:30:27.690 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.690 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.690 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:27.690 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.850320+0000", 2024-05-08T18:30:27.690 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0020627530000000001 2024-05-08T18:30:27.690 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.690 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.690 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:27.690 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.850351+0000", 2024-05-08T18:30:27.690 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1501000000000002e-05 2024-05-08T18:30:27.690 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.690 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.690 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:27.690 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.850378+0000", 2024-05-08T18:30:27.691 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6591e-05 2024-05-08T18:30:27.691 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:27.691 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:27.691 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:27.691 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.691 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.691 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:535 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:27.691 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.912581+0000", 2024-05-08T18:30:27.691 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 35.72210879, 2024-05-08T18:30:27.691 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002943775, 2024-05-08T18:30:27.691 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:27.691 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:27.691 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:27.691 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:27.692 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:27.692 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:27.692 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 535 2024-05-08T18:30:27.692 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.692 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:27.692 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.692 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:27.692 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912581+0000", 2024-05-08T18:30:27.692 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:27.692 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.693 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.693 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:27.693 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912581+0000", 2024-05-08T18:30:27.693 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:27.693 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.693 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.693 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:27.693 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912582+0000", 2024-05-08T18:30:27.693 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.093e-06 2024-05-08T18:30:27.693 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.693 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.693 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:27.693 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912588+0000", 2024-05-08T18:30:27.693 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3920000000000002e-06 2024-05-08T18:30:27.694 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.694 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.694 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:27.694 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912601+0000", 2024-05-08T18:30:27.694 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2911000000000001e-05 2024-05-08T18:30:27.694 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.694 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.694 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:27.694 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912607+0000", 2024-05-08T18:30:27.694 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3960000000000003e-06 2024-05-08T18:30:27.694 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.694 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.694 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:27.695 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912664+0000", 2024-05-08T18:30:27.695 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6410999999999999e-05 2024-05-08T18:30:27.695 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.695 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.695 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:27.695 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912721+0000", 2024-05-08T18:30:27.695 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7141000000000001e-05 2024-05-08T18:30:27.695 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.695 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.695 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:27.695 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912842+0000", 2024-05-08T18:30:27.695 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000120868 2024-05-08T18:30:27.695 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.696 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.696 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:27.696 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.913333+0000", 2024-05-08T18:30:27.696 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00049123600000000004 2024-05-08T18:30:27.696 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.696 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.696 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:27.696 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.915446+0000", 2024-05-08T18:30:27.696 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0021135020000000002 2024-05-08T18:30:27.696 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.696 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.696 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:27.696 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.915481+0000", 2024-05-08T18:30:27.696 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4304999999999998e-05 2024-05-08T18:30:27.696 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.697 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.697 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:27.697 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.915525+0000", 2024-05-08T18:30:27.697 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4520000000000001e-05 2024-05-08T18:30:27.697 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:27.697 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:27.697 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:27.697 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.697 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.697 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:541 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:27.697 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.916718+0000", 2024-05-08T18:30:27.697 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 35.717971955000003, 2024-05-08T18:30:27.697 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0041779829999999997, 2024-05-08T18:30:27.697 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:27.698 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:27.698 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:27.698 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:27.698 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:27.698 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:27.698 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 541 2024-05-08T18:30:27.698 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.698 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:27.698 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.698 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:27.698 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.916718+0000", 2024-05-08T18:30:27.698 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:27.698 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.699 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.699 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:27.699 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.916718+0000", 2024-05-08T18:30:27.699 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:27.699 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.699 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.699 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:27.699 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.916719+0000", 2024-05-08T18:30:27.699 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0100000000000005e-07 2024-05-08T18:30:27.699 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.699 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.699 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:27.699 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.916722+0000", 2024-05-08T18:30:27.699 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7760000000000002e-06 2024-05-08T18:30:27.700 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.700 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.700 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:27.700 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.916729+0000", 2024-05-08T18:30:27.700 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.8290000000000008e-06 2024-05-08T18:30:27.700 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.700 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.700 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:27.700 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.916734+0000", 2024-05-08T18:30:27.700 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3109999999999999e-06 2024-05-08T18:30:27.700 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.700 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.700 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:27.700 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.916776+0000", 2024-05-08T18:30:27.701 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.2086999999999999e-05 2024-05-08T18:30:27.701 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.701 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.701 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:27.701 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.916824+0000", 2024-05-08T18:30:27.701 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8412999999999999e-05 2024-05-08T18:30:27.701 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.701 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.701 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:27.701 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.916929+0000", 2024-05-08T18:30:27.701 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010480900000000001 2024-05-08T18:30:27.701 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.701 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.701 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:27.701 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.917428+0000", 2024-05-08T18:30:27.702 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00049889599999999997 2024-05-08T18:30:27.702 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.702 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.702 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:27.702 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.920833+0000", 2024-05-08T18:30:27.702 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0034047140000000001 2024-05-08T18:30:27.702 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.702 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.702 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:27.702 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.920868+0000", 2024-05-08T18:30:27.702 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5750999999999997e-05 2024-05-08T18:30:27.702 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.702 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.702 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:27.703 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.920896+0000", 2024-05-08T18:30:27.703 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7796e-05 2024-05-08T18:30:27.703 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:27.703 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:27.703 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:27.703 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.703 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.703 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:778 6.1b 6:dc490aaa:::obj_delete_at_hint.0000000067:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:27.703 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.191226+0000", 2024-05-08T18:30:27.703 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 35.443463680000001, 2024-05-08T18:30:27.703 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0029603540000000001, 2024-05-08T18:30:27.703 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:27.703 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:27.703 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:27.704 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:27.704 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:27.704 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:27.704 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 778 2024-05-08T18:30:27.704 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.704 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:27.704 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.704 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:27.704 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.191226+0000", 2024-05-08T18:30:27.704 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:27.705 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.705 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.705 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:27.705 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.191226+0000", 2024-05-08T18:30:27.705 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:27.705 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.705 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.705 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:27.705 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.191229+0000", 2024-05-08T18:30:27.705 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5299999999999999e-06 2024-05-08T18:30:27.705 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.705 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.705 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:27.705 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.191242+0000", 2024-05-08T18:30:27.706 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2816999999999999e-05 2024-05-08T18:30:27.706 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.706 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.706 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:27.706 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.191274+0000", 2024-05-08T18:30:27.706 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1846e-05 2024-05-08T18:30:27.706 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.706 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.706 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:27.706 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.191288+0000", 2024-05-08T18:30:27.706 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.468e-05 2024-05-08T18:30:27.706 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.706 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.706 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:27.707 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.191468+0000", 2024-05-08T18:30:27.707 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00017983499999999999 2024-05-08T18:30:27.707 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.707 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.707 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:27.707 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.191688+0000", 2024-05-08T18:30:27.707 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021985799999999999 2024-05-08T18:30:27.707 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.707 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.707 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:30:27.707 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.192001+0000", 2024-05-08T18:30:27.707 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00031337800000000001 2024-05-08T18:30:27.708 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.708 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.708 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:27.708 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.193245+0000", 2024-05-08T18:30:27.708 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012436400000000001 2024-05-08T18:30:27.708 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.708 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.708 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:27.708 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.194036+0000", 2024-05-08T18:30:27.708 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00079059699999999998 2024-05-08T18:30:27.708 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.708 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.708 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:27.708 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.194121+0000", 2024-05-08T18:30:27.709 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5270000000000002e-05 2024-05-08T18:30:27.709 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.709 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.709 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:27.709 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.194187+0000", 2024-05-08T18:30:27.709 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5902999999999996e-05 2024-05-08T18:30:27.709 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:27.709 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:27.709 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:27.709 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.709 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.709 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:780 6.1b 6:dc490aaa:::obj_delete_at_hint.0000000067:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:27.709 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.195206+0000", 2024-05-08T18:30:27.709 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 35.439483711000001, 2024-05-08T18:30:27.710 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00291544, 2024-05-08T18:30:27.710 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:27.710 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:27.710 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:27.710 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:27.710 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:27.710 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:27.710 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 780 2024-05-08T18:30:27.710 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.710 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:27.710 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.710 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:27.710 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.195206+0000", 2024-05-08T18:30:27.711 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:27.711 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.711 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.711 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:27.711 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.195206+0000", 2024-05-08T18:30:27.711 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:27.711 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.711 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.711 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:27.711 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.195208+0000", 2024-05-08T18:30:27.711 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0669999999999999e-06 2024-05-08T18:30:27.711 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.711 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.711 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:27.712 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.195220+0000", 2024-05-08T18:30:27.712 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.131e-05 2024-05-08T18:30:27.712 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.712 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.712 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:27.712 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.195250+0000", 2024-05-08T18:30:27.712 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0562999999999999e-05 2024-05-08T18:30:27.712 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.712 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.712 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:27.712 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.195270+0000", 2024-05-08T18:30:27.712 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9989000000000001e-05 2024-05-08T18:30:27.712 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.712 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.713 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:27.713 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.195395+0000", 2024-05-08T18:30:27.713 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012439600000000001 2024-05-08T18:30:27.713 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.713 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.713 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:27.713 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.195523+0000", 2024-05-08T18:30:27.713 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012824900000000001 2024-05-08T18:30:27.713 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.713 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.713 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:30:27.713 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.195808+0000", 2024-05-08T18:30:27.713 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00028518100000000002 2024-05-08T18:30:27.713 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.713 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.714 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:27.714 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.196897+0000", 2024-05-08T18:30:27.714 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0010887850000000001 2024-05-08T18:30:27.714 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.714 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.714 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:27.714 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.197964+0000", 2024-05-08T18:30:27.714 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0010671789999999999 2024-05-08T18:30:27.714 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.714 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.714 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:27.714 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.198044+0000", 2024-05-08T18:30:27.714 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.9616000000000005e-05 2024-05-08T18:30:27.714 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.715 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.715 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:27.715 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.198122+0000", 2024-05-08T18:30:27.715 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.8104999999999998e-05 2024-05-08T18:30:27.715 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:27.715 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:27.715 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:27.715 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.715 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.715 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:826 6.6 6:64735f45:::obj_delete_at_hint.0000000083:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:27.715 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.299128+0000", 2024-05-08T18:30:27.715 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 35.335562633000002, 2024-05-08T18:30:27.715 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0029196479999999999, 2024-05-08T18:30:27.715 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:27.716 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:27.716 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:27.716 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:27.716 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:27.716 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:27.716 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 826 2024-05-08T18:30:27.716 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.716 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:27.716 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.716 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:27.716 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.299128+0000", 2024-05-08T18:30:27.716 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:27.716 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.716 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.717 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:27.717 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.299128+0000", 2024-05-08T18:30:27.717 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:27.717 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.717 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.717 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:27.717 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.299129+0000", 2024-05-08T18:30:27.717 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.711e-06 2024-05-08T18:30:27.717 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.717 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.717 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:27.717 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.299137+0000", 2024-05-08T18:30:27.717 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6650000000000003e-06 2024-05-08T18:30:27.717 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.717 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.718 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:27.718 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.299157+0000", 2024-05-08T18:30:27.718 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.02e-05 2024-05-08T18:30:27.718 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.718 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.718 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:27.718 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.299166+0000", 2024-05-08T18:30:27.718 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7530000000000007e-06 2024-05-08T18:30:27.718 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.718 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.718 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:27.718 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.299240+0000", 2024-05-08T18:30:27.718 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.4297999999999999e-05 2024-05-08T18:30:27.719 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.719 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.719 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:27.719 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.299444+0000", 2024-05-08T18:30:27.719 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00020382399999999999 2024-05-08T18:30:27.719 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.719 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.719 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:27.719 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.299777+0000", 2024-05-08T18:30:27.719 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00033331700000000002 2024-05-08T18:30:27.719 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.719 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.719 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:27.719 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.301060+0000", 2024-05-08T18:30:27.720 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012829569999999999 2024-05-08T18:30:27.720 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.720 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.720 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:27.720 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.301865+0000", 2024-05-08T18:30:27.720 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00080503400000000004 2024-05-08T18:30:27.720 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.720 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.720 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:27.720 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.301979+0000", 2024-05-08T18:30:27.720 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011324600000000001 2024-05-08T18:30:27.720 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.720 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.720 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:27.721 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.302047+0000", 2024-05-08T18:30:27.721 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8643e-05 2024-05-08T18:30:27.721 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:27.721 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:27.721 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:27.721 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.721 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.721 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:838 6.c 6:330b1641:::obj_delete_at_hint.0000000087:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:27.721 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.328043+0000", 2024-05-08T18:30:27.721 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 35.306647488999999, 2024-05-08T18:30:27.721 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031589180000000001, 2024-05-08T18:30:27.721 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:27.721 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:27.722 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:27.722 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:27.722 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:27.722 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:27.722 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 838 2024-05-08T18:30:27.722 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.722 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:27.722 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.722 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:27.722 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.328043+0000", 2024-05-08T18:30:27.722 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:27.722 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.722 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.723 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:27.723 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.328043+0000", 2024-05-08T18:30:27.723 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:27.723 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.723 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.723 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:27.723 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.328045+0000", 2024-05-08T18:30:27.723 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3760000000000002e-06 2024-05-08T18:30:27.723 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.723 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.723 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:27.723 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.328057+0000", 2024-05-08T18:30:27.723 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1534e-05 2024-05-08T18:30:27.723 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.724 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.724 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:27.724 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.328087+0000", 2024-05-08T18:30:27.724 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0870000000000001e-05 2024-05-08T18:30:27.724 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.724 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.724 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:27.724 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.328102+0000", 2024-05-08T18:30:27.724 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4679e-05 2024-05-08T18:30:27.724 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.724 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.724 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:27.724 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.328217+0000", 2024-05-08T18:30:27.724 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011519300000000001 2024-05-08T18:30:27.725 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.725 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.725 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:27.725 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.328446+0000", 2024-05-08T18:30:27.725 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00022893499999999999 2024-05-08T18:30:27.725 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.725 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.725 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:27.725 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.328770+0000", 2024-05-08T18:30:27.725 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00032349700000000001 2024-05-08T18:30:27.725 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.725 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.725 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:27.726 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.330008+0000", 2024-05-08T18:30:27.726 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001238404 2024-05-08T18:30:27.726 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.726 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.726 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:27.726 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.331026+0000", 2024-05-08T18:30:27.726 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001017612 2024-05-08T18:30:27.726 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.726 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.726 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:27.726 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.331117+0000", 2024-05-08T18:30:27.726 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0932000000000003e-05 2024-05-08T18:30:27.726 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.727 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.727 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:27.727 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.331202+0000", 2024-05-08T18:30:27.727 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.4886e-05 2024-05-08T18:30:27.727 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:27.727 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:27.727 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:27.727 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.727 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.727 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:850 6.6 6:624175ac:::obj_delete_at_hint.0000000091:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:27.727 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.356951+0000", 2024-05-08T18:30:27.727 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 35.277739402000002, 2024-05-08T18:30:27.727 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028779000000000001, 2024-05-08T18:30:27.727 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:27.728 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:27.728 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:27.728 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:27.728 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:27.728 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:27.728 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 850 2024-05-08T18:30:27.728 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.728 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:27.728 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.728 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:27.728 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.356951+0000", 2024-05-08T18:30:27.728 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:27.728 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.728 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.729 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:27.729 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.356951+0000", 2024-05-08T18:30:27.729 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:27.729 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.729 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.729 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:27.729 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.356953+0000", 2024-05-08T18:30:27.729 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.446e-06 2024-05-08T18:30:27.729 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.729 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.729 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:27.729 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.356965+0000", 2024-05-08T18:30:27.729 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1404e-05 2024-05-08T18:30:27.729 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.730 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.730 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:27.730 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.356994+0000", 2024-05-08T18:30:27.730 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9526000000000002e-05 2024-05-08T18:30:27.730 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.730 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.730 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:27.730 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.357009+0000", 2024-05-08T18:30:27.730 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5126000000000001e-05 2024-05-08T18:30:27.730 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.730 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.730 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:27.730 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.357126+0000", 2024-05-08T18:30:27.730 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000116989 2024-05-08T18:30:27.730 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.731 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.731 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:27.731 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.357349+0000", 2024-05-08T18:30:27.731 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00022298899999999999 2024-05-08T18:30:27.731 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.731 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.731 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:27.731 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.357665+0000", 2024-05-08T18:30:27.731 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00031592700000000003 2024-05-08T18:30:27.731 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.731 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.731 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:27.731 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.358771+0000", 2024-05-08T18:30:27.731 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001105595 2024-05-08T18:30:27.732 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.732 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.732 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:27.732 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.359672+0000", 2024-05-08T18:30:27.732 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00090080300000000004 2024-05-08T18:30:27.732 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.732 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.732 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:27.732 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.359762+0000", 2024-05-08T18:30:27.732 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0099000000000006e-05 2024-05-08T18:30:27.732 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.732 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.732 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:27.732 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.359829+0000", 2024-05-08T18:30:27.733 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6995999999999993e-05 2024-05-08T18:30:27.733 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:27.733 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:27.733 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:27.733 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.733 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.733 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:852 6.6 6:624175ac:::obj_delete_at_hint.0000000091:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:27.733 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.360655+0000", 2024-05-08T18:30:27.733 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 35.274035535000003, 2024-05-08T18:30:27.733 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028684650000000002, 2024-05-08T18:30:27.733 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:27.733 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:27.733 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:27.733 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:27.733 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:27.734 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:27.734 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 852 2024-05-08T18:30:27.734 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.734 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:27.734 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.734 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:27.734 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.360655+0000", 2024-05-08T18:30:27.734 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:27.734 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.734 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.734 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:27.734 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.360655+0000", 2024-05-08T18:30:27.734 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:27.735 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.735 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.735 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:27.735 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.360656+0000", 2024-05-08T18:30:27.735 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.457e-06 2024-05-08T18:30:27.735 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.735 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.735 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:27.735 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.360663+0000", 2024-05-08T18:30:27.735 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5429999999999999e-06 2024-05-08T18:30:27.735 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.735 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.735 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:27.735 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.360682+0000", 2024-05-08T18:30:27.735 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9020000000000001e-05 2024-05-08T18:30:27.736 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.736 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.736 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:27.736 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.360693+0000", 2024-05-08T18:30:27.736 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.114e-05 2024-05-08T18:30:27.736 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.736 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.736 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:27.736 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.360775+0000", 2024-05-08T18:30:27.736 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.2206000000000005e-05 2024-05-08T18:30:27.736 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.736 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.736 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:27.736 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.360899+0000", 2024-05-08T18:30:27.736 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000124206 2024-05-08T18:30:27.737 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.737 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.737 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:27.737 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.361162+0000", 2024-05-08T18:30:27.737 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00026328400000000002 2024-05-08T18:30:27.737 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.737 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.737 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:27.737 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.362180+0000", 2024-05-08T18:30:27.737 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0010175119999999999 2024-05-08T18:30:27.737 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.737 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.737 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:27.737 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.363368+0000", 2024-05-08T18:30:27.738 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001187991 2024-05-08T18:30:27.738 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.738 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.738 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:27.738 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.363456+0000", 2024-05-08T18:30:27.738 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8016999999999994e-05 2024-05-08T18:30:27.738 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.738 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.738 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:27.738 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.363523+0000", 2024-05-08T18:30:27.738 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7088999999999994e-05 2024-05-08T18:30:27.738 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:27.738 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:27.738 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:27.739 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.739 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.739 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:865 6.c 6:31288c1b:::obj_delete_at_hint.0000000096:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:27.739 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.392164+0000", 2024-05-08T18:30:27.739 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 35.242526433999998, 2024-05-08T18:30:27.739 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0029815470000000002, 2024-05-08T18:30:27.739 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:27.739 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:27.739 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:27.739 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:27.739 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:27.739 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:27.739 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 865 2024-05-08T18:30:27.739 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.739 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:27.740 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.740 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:27.740 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.392164+0000", 2024-05-08T18:30:27.740 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:27.740 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.740 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.740 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:27.740 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.392164+0000", 2024-05-08T18:30:27.740 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:27.740 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.740 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.740 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:27.740 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.392166+0000", 2024-05-08T18:30:27.740 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4059999999999999e-06 2024-05-08T18:30:27.741 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.741 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.741 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:27.741 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.392177+0000", 2024-05-08T18:30:27.741 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1260000000000001e-05 2024-05-08T18:30:27.741 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.741 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.741 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:27.741 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.392208+0000", 2024-05-08T18:30:27.741 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0484000000000002e-05 2024-05-08T18:30:27.741 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.741 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.741 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:27.741 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.392222+0000", 2024-05-08T18:30:27.741 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4343e-05 2024-05-08T18:30:27.742 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.742 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.742 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:27.742 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.392355+0000", 2024-05-08T18:30:27.742 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000132602 2024-05-08T18:30:27.742 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.742 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.742 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:27.742 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.392565+0000", 2024-05-08T18:30:27.742 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000210442 2024-05-08T18:30:27.742 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.742 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.742 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:27.742 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.392874+0000", 2024-05-08T18:30:27.743 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00030868099999999999 2024-05-08T18:30:27.743 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.743 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.743 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:27.743 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.394087+0000", 2024-05-08T18:30:27.743 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012133300000000001 2024-05-08T18:30:27.743 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.743 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.743 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:27.743 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.394976+0000", 2024-05-08T18:30:27.743 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000888977 2024-05-08T18:30:27.743 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.743 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.743 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:27.743 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.395068+0000", 2024-05-08T18:30:27.744 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.2188999999999994e-05 2024-05-08T18:30:27.744 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.744 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.744 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:27.744 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.395145+0000", 2024-05-08T18:30:27.744 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6833000000000001e-05 2024-05-08T18:30:27.744 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:27.744 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:27.744 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:27.744 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.744 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.744 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:871 6.11 6:8d7f253a:::obj_delete_at_hint.0000000098:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:27.744 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.405724+0000", 2024-05-08T18:30:27.744 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 35.228965877999997, 2024-05-08T18:30:27.744 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0030012530000000002, 2024-05-08T18:30:27.745 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:27.745 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:27.745 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:27.745 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:27.745 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:27.745 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:27.745 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 871 2024-05-08T18:30:27.745 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.745 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:27.745 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.745 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:27.745 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.405724+0000", 2024-05-08T18:30:27.745 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:27.745 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.745 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.746 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:27.746 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.405724+0000", 2024-05-08T18:30:27.746 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:27.746 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.746 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.746 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:27.746 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.405726+0000", 2024-05-08T18:30:27.746 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1299999999999999e-06 2024-05-08T18:30:27.746 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.746 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.746 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:27.746 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.405737+0000", 2024-05-08T18:30:27.746 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0763e-05 2024-05-08T18:30:27.747 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.747 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.747 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:27.747 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.405762+0000", 2024-05-08T18:30:27.747 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5323000000000001e-05 2024-05-08T18:30:27.747 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.747 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.747 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:27.747 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.405776+0000", 2024-05-08T18:30:27.747 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3862999999999999e-05 2024-05-08T18:30:27.747 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.747 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.747 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:27.747 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.405928+0000", 2024-05-08T18:30:27.747 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015190000000000001 2024-05-08T18:30:27.748 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.748 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.748 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:27.748 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.406159+0000", 2024-05-08T18:30:27.748 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023114399999999999 2024-05-08T18:30:27.748 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.748 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.748 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:27.748 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.406453+0000", 2024-05-08T18:30:27.748 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00029329699999999998 2024-05-08T18:30:27.748 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.748 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.748 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:27.748 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.408103+0000", 2024-05-08T18:30:27.749 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0016499869999999999 2024-05-08T18:30:27.749 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.749 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.749 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:27.749 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.408520+0000", 2024-05-08T18:30:27.749 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00041694099999999999 2024-05-08T18:30:27.749 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.749 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.749 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:27.749 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.408606+0000", 2024-05-08T18:30:27.749 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6809000000000002e-05 2024-05-08T18:30:27.749 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.749 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.749 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:27.750 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.408726+0000", 2024-05-08T18:30:27.750 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000119096 2024-05-08T18:30:27.750 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:27.750 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:27.750 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:27.750 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.750 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.750 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:934 6.11 6:8cd774bc:::obj_delete_at_hint.0000000119:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:27.750 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.550387+0000", 2024-05-08T18:30:27.750 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 35.084302925000003, 2024-05-08T18:30:27.750 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0033028739999999999, 2024-05-08T18:30:27.750 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:27.750 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:27.751 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:27.751 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:27.751 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:27.751 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:27.751 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 934 2024-05-08T18:30:27.751 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.751 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:27.751 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.751 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:27.751 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.550387+0000", 2024-05-08T18:30:27.751 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:27.751 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.751 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.752 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:27.752 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.550387+0000", 2024-05-08T18:30:27.752 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:27.752 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.752 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.752 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:27.752 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.550390+0000", 2024-05-08T18:30:27.752 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.706e-06 2024-05-08T18:30:27.752 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.752 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.752 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:27.752 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.550401+0000", 2024-05-08T18:30:27.752 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1437000000000001e-05 2024-05-08T18:30:27.752 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.752 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.753 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:27.753 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.550433+0000", 2024-05-08T18:30:27.753 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2005999999999998e-05 2024-05-08T18:30:27.753 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.753 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.753 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:27.753 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.550448+0000", 2024-05-08T18:30:27.753 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5007e-05 2024-05-08T18:30:27.753 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.753 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.753 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:27.753 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.550607+0000", 2024-05-08T18:30:27.753 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000158288 2024-05-08T18:30:27.753 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.754 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.754 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:27.754 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.550974+0000", 2024-05-08T18:30:27.754 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00036768400000000001 2024-05-08T18:30:27.754 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.754 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.754 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:27.754 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.551516+0000", 2024-05-08T18:30:27.754 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00054126900000000004 2024-05-08T18:30:27.754 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.754 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.754 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:27.754 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.552847+0000", 2024-05-08T18:30:27.755 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0013308899999999999 2024-05-08T18:30:27.755 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.755 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.755 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:27.755 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.553531+0000", 2024-05-08T18:30:27.755 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00068438799999999997 2024-05-08T18:30:27.755 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.755 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.755 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:27.755 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.553621+0000", 2024-05-08T18:30:27.755 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9779999999999998e-05 2024-05-08T18:30:27.755 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:27.755 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:27.756 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:27.756 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.553690+0000", 2024-05-08T18:30:27.756 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9418999999999994e-05 2024-05-08T18:30:27.756 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:27.756 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:27.756 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:27.756 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:27.756 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:27.756 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:30:27.758 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-08T18:30:27.758 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:30:27.755+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:30:27.833 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-08T18:30:27.878 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:30:27.881+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:30:27.890 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:30:27.890 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:30:27.890 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 0 2024-05-08T18:30:27.890 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:30:27.905 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-08T18:30:27.959 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:30:27.955+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:30:27.986 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2024-05-08T18:30:27.987 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:30:28.002 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2024-05-08T18:30:28.003 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:30:28.019 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2024-05-08T18:30:28.020 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:30:28.028 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:30:28.028 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:30:28.028 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2024-05-08T18:30:28.029 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2024-05-08T18:30:28.029 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:30:28.037 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2024-05-08T18:30:28.037 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:30:28.043 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-08T18:30:28.057 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2024-05-08T18:30:28.057 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:30:28.075 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2024-05-08T18:30:28.076 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:30:28.084 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:30:28.083+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:30:28.096 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2024-05-08T18:30:28.097 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:30:28.115 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2024-05-08T18:30:28.115 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:30:28.161 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:30:28.159+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:30:28.215 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:28.215 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:28.229 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-08T18:30:28.272 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:30:28.271+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:30:28.363 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:30:28.365+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:30:28.395 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:28.395 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:28.409 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-08T18:30:28.465 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:30:28.465+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:30:28.532 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:28.532 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:28.547 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-08T18:30:28.592 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:30:28.591+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:30:28.666 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:30:28.663+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:30:28.668 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:28.668 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:28.683 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-08T18:30:28.767 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:30:28.769+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:30:28.849 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:28.849 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:28.863 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-08T18:30:28.912 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:30:28.911+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:30:28.970 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:30:28.972+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:30:28.985 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:28.986 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:29.000 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-08T18:30:29.084 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:30:29.083+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:30:29.166 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:29.166 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:29.171 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:30:29.167+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:30:29.180 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-08T18:30:29.272 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:30:29.272+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:30:29.289 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-08T18:30:29.338 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:29.338 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:29.352 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-08T18:30:29.400 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:30:29.399+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:30:29.474 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:30:29.471+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:30:29.475 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:29.475 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:29.490 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-08T18:30:29.580 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:30:29.579+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:30:29.655 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:29.656 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:29.670 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-08T18:30:29.712 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:30:29.711+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:30:29.776 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:30:29.775+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:30:29.795 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:29.796 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:29.810 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-08T18:30:29.877 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:30:29.875+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:30:29.928 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:29.928 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:29.943 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-08T18:30:29.990 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:30:29.992+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:30:30.060 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:30.060 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:30.073 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-08T18:30:30.079 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:30:30.075+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:30:30.134 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-08T18:30:30.210 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:30:30.212+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:30:30.236 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:30.237 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:30.250 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-08T18:30:30.281 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:30:30.279+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:30:30.291 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2024-05-08T18:30:30.292 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:30:30.307 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2024-05-08T18:30:30.308 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:30:30.325 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2024-05-08T18:30:30.325 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:30:30.340 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2024-05-08T18:30:30.340 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:30:30.360 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2024-05-08T18:30:30.360 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:30:30.381 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2024-05-08T18:30:30.381 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:30:30.381 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:30:30.380+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:30:30.401 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2024-05-08T18:30:30.402 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:30:30.402 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:30:30.402 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:30:30.402 INFO:teuthology.orchestra.run.smithi097.stdout: "complaint_time": 30, 2024-05-08T18:30:30.402 INFO:teuthology.orchestra.run.smithi097.stdout: "num_blocked_ops": 0 2024-05-08T18:30:30.402 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:30:30.415 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-08T18:30:30.423 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2024-05-08T18:30:30.423 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:30:30.483 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:30:30.484+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:30:30.484 INFO:teuthology.orchestra.run.smithi097.stderr:noscrub is unset 2024-05-08T18:30:30.544 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:30:30.544 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2024-05-08T18:30:30.544 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2024-05-08T18:30:30.544 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-05-08T18:30:30.544 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.544 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4479.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-05-08T18:30:30.544 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:44.576320+0000", 2024-05-08T18:30:30.544 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 45.967595559999999, 2024-05-08T18:30:30.544 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019751892, 2024-05-08T18:30:30.544 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:30.545 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:30.545 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "reached pg", 2024-05-08T18:30:30.545 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:30.545 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4479", 2024-05-08T18:30:30.545 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3577501689", 2024-05-08T18:30:30.545 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 2 2024-05-08T18:30:30.545 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.545 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:30.545 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.545 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:30.545 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576320+0000", 2024-05-08T18:30:30.545 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:30.545 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.545 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.545 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:30.546 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576320+0000", 2024-05-08T18:30:30.546 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:30.546 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.546 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.546 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:30.546 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576323+0000", 2024-05-08T18:30:30.546 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.813e-06 2024-05-08T18:30:30.546 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.546 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.546 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:30.546 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576335+0000", 2024-05-08T18:30:30.546 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2330000000000001e-05 2024-05-08T18:30:30.546 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.547 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.547 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:30.547 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576367+0000", 2024-05-08T18:30:30.547 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2036999999999998e-05 2024-05-08T18:30:30.547 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.547 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.547 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:30.547 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576394+0000", 2024-05-08T18:30:30.547 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6529e-05 2024-05-08T18:30:30.547 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.547 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.547 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:30.547 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576550+0000", 2024-05-08T18:30:30.547 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000156718 2024-05-08T18:30:30.548 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.548 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.548 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-05-08T18:30:30.548 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576560+0000", 2024-05-08T18:30:30.548 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0040999999999999e-05 2024-05-08T18:30:30.548 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.548 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.548 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:30.548 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.587240+0000", 2024-05-08T18:30:30.548 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010679266999999999 2024-05-08T18:30:30.548 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.548 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.548 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2024-05-08T18:30:30.549 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.587266+0000", 2024-05-08T18:30:30.549 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6642e-05 2024-05-08T18:30:30.549 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.549 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.549 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:30.549 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.595882+0000", 2024-05-08T18:30:30.549 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0086159600000000006 2024-05-08T18:30:30.549 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.549 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.549 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:30.549 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.596072+0000", 2024-05-08T18:30:30.549 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000189555 2024-05-08T18:30:30.549 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:30.549 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:30.550 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:30.550 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.550 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.550 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:30:30.550 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:48.766182+0000", 2024-05-08T18:30:30.550 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 41.777733533000003, 2024-05-08T18:30:30.550 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031881209999999999, 2024-05-08T18:30:30.550 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:30.550 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:30.550 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:30.550 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:30.550 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:30.550 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:30.550 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 193 2024-05-08T18:30:30.551 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.551 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:30.551 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.551 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:30.551 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766182+0000", 2024-05-08T18:30:30.551 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:30.551 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.551 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.551 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:30.551 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766182+0000", 2024-05-08T18:30:30.551 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:30.551 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.551 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.551 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:30.552 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766184+0000", 2024-05-08T18:30:30.552 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4159999999999998e-06 2024-05-08T18:30:30.552 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.552 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.552 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:30.552 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766196+0000", 2024-05-08T18:30:30.552 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1814000000000001e-05 2024-05-08T18:30:30.552 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.552 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.552 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:30.552 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766227+0000", 2024-05-08T18:30:30.552 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0676000000000002e-05 2024-05-08T18:30:30.552 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.552 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.553 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:30.553 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766242+0000", 2024-05-08T18:30:30.553 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5497000000000001e-05 2024-05-08T18:30:30.553 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.553 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.553 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:30.553 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766354+0000", 2024-05-08T18:30:30.553 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000111579 2024-05-08T18:30:30.553 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.553 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.553 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:30.553 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766569+0000", 2024-05-08T18:30:30.553 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000214978 2024-05-08T18:30:30.553 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.554 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.554 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:30.554 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766834+0000", 2024-05-08T18:30:30.554 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00026551500000000002 2024-05-08T18:30:30.554 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.554 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.554 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:30.554 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.768577+0000", 2024-05-08T18:30:30.554 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001742513 2024-05-08T18:30:30.554 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.554 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.554 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:30.554 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.769150+0000", 2024-05-08T18:30:30.554 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00057320500000000003 2024-05-08T18:30:30.555 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.555 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.555 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:30.555 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.769250+0000", 2024-05-08T18:30:30.555 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.9846000000000006e-05 2024-05-08T18:30:30.555 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.555 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.555 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:30.555 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.769370+0000", 2024-05-08T18:30:30.555 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012008200000000001 2024-05-08T18:30:30.555 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:30.555 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:30.555 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:30.556 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.556 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.556 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:30.556 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.679562+0000", 2024-05-08T18:30:30.556 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 38.864353829000002, 2024-05-08T18:30:30.556 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0086320800000000003, 2024-05-08T18:30:30.556 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:30.556 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:30.556 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:30.556 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:30.556 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:30.556 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:30.556 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 208 2024-05-08T18:30:30.557 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.557 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:30.557 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.557 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:30.557 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679562+0000", 2024-05-08T18:30:30.557 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:30.557 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.557 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.557 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:30.557 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679562+0000", 2024-05-08T18:30:30.557 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:30.557 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.557 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.557 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:30.558 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679565+0000", 2024-05-08T18:30:30.558 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0800000000000002e-06 2024-05-08T18:30:30.558 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.558 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.558 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:30.558 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679578+0000", 2024-05-08T18:30:30.558 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3217000000000001e-05 2024-05-08T18:30:30.558 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.558 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.558 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:30.558 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679610+0000", 2024-05-08T18:30:30.558 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1696000000000003e-05 2024-05-08T18:30:30.558 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.559 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.559 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:30.559 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679625+0000", 2024-05-08T18:30:30.559 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5824e-05 2024-05-08T18:30:30.559 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.559 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.559 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:30.559 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679758+0000", 2024-05-08T18:30:30.559 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013231199999999999 2024-05-08T18:30:30.559 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.559 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.559 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-05-08T18:30:30.559 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679770+0000", 2024-05-08T18:30:30.560 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1800000000000001e-05 2024-05-08T18:30:30.560 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.560 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.560 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:30.560 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.685241+0000", 2024-05-08T18:30:30.560 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0054710169999999999 2024-05-08T18:30:30.560 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.560 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.560 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:30.560 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.685444+0000", 2024-05-08T18:30:30.560 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000203835 2024-05-08T18:30:30.560 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.560 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.561 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:30.561 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.685842+0000", 2024-05-08T18:30:30.561 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00039773 2024-05-08T18:30:30.561 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.561 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.561 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:30.561 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.687232+0000", 2024-05-08T18:30:30.561 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00139011 2024-05-08T18:30:30.561 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.561 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.561 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:30.561 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.688049+0000", 2024-05-08T18:30:30.561 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00081667000000000003 2024-05-08T18:30:30.561 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.562 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.562 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:30.562 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.688135+0000", 2024-05-08T18:30:30.562 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6299999999999997e-05 2024-05-08T18:30:30.562 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.562 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.562 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:30.562 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.688194+0000", 2024-05-08T18:30:30.562 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8489000000000002e-05 2024-05-08T18:30:30.562 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:30.562 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:30.562 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:30.563 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.563 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.563 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:30.563 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.707114+0000", 2024-05-08T18:30:30.563 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 38.836801815000001, 2024-05-08T18:30:30.563 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031802990000000001, 2024-05-08T18:30:30.563 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:30.563 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:30.563 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:30.563 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:30.563 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:30.563 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:30.563 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 212 2024-05-08T18:30:30.564 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.564 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:30.564 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.564 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:30.564 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707114+0000", 2024-05-08T18:30:30.564 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:30.564 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.564 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.564 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:30.564 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707114+0000", 2024-05-08T18:30:30.564 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:30.564 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.564 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.564 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:30.565 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707117+0000", 2024-05-08T18:30:30.565 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8629999999999999e-06 2024-05-08T18:30:30.565 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.565 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.565 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:30.565 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707129+0000", 2024-05-08T18:30:30.565 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2150000000000001e-05 2024-05-08T18:30:30.565 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.565 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.565 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:30.565 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707158+0000", 2024-05-08T18:30:30.565 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9513999999999999e-05 2024-05-08T18:30:30.565 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.566 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.566 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:30.566 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707173+0000", 2024-05-08T18:30:30.566 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5136e-05 2024-05-08T18:30:30.566 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.566 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.566 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:30.566 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707309+0000", 2024-05-08T18:30:30.566 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000135609 2024-05-08T18:30:30.566 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.566 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.566 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:30.566 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707523+0000", 2024-05-08T18:30:30.566 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021362200000000001 2024-05-08T18:30:30.567 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.567 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.567 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:30.567 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707918+0000", 2024-05-08T18:30:30.567 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00039556299999999998 2024-05-08T18:30:30.567 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.567 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.567 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:30.567 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.709166+0000", 2024-05-08T18:30:30.567 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012476410000000001 2024-05-08T18:30:30.567 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.567 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.567 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:30.568 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.710145+0000", 2024-05-08T18:30:30.568 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00097909899999999998 2024-05-08T18:30:30.568 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.568 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.568 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:30.568 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.710231+0000", 2024-05-08T18:30:30.568 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5625999999999996e-05 2024-05-08T18:30:30.568 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.568 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.568 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:30.568 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.710294+0000", 2024-05-08T18:30:30.568 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3476e-05 2024-05-08T18:30:30.568 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:30.569 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:30.569 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:30.569 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.569 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.569 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:30.569 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.731985+0000", 2024-05-08T18:30:30.569 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 38.811930590000003, 2024-05-08T18:30:30.569 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0039250600000000002, 2024-05-08T18:30:30.569 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:30.569 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:30.569 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:30.569 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:30.569 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:30.569 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:30.570 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 219 2024-05-08T18:30:30.570 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.570 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:30.570 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.570 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:30.570 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731985+0000", 2024-05-08T18:30:30.570 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:30.570 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.570 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.570 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:30.570 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731985+0000", 2024-05-08T18:30:30.570 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:30.571 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.571 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.571 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:30.571 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731988+0000", 2024-05-08T18:30:30.571 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6599999999999999e-06 2024-05-08T18:30:30.571 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.571 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.571 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:30.571 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.732017+0000", 2024-05-08T18:30:30.571 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9692999999999998e-05 2024-05-08T18:30:30.571 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.571 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.571 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:30.572 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.732048+0000", 2024-05-08T18:30:30.572 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1066999999999999e-05 2024-05-08T18:30:30.572 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.572 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.572 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:30.572 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.732064+0000", 2024-05-08T18:30:30.572 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5786000000000001e-05 2024-05-08T18:30:30.572 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.572 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.572 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:30.572 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.732213+0000", 2024-05-08T18:30:30.572 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014895899999999999 2024-05-08T18:30:30.572 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.573 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.573 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:30.573 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.732572+0000", 2024-05-08T18:30:30.573 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000358904 2024-05-08T18:30:30.573 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.573 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.573 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:30.573 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.733349+0000", 2024-05-08T18:30:30.573 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00077657699999999997 2024-05-08T18:30:30.573 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.573 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.573 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:30.573 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.734899+0000", 2024-05-08T18:30:30.573 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001550652 2024-05-08T18:30:30.573 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.574 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.574 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:30.574 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.735641+0000", 2024-05-08T18:30:30.574 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00074222000000000003 2024-05-08T18:30:30.574 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.574 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.574 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:30.574 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.735801+0000", 2024-05-08T18:30:30.574 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015913599999999999 2024-05-08T18:30:30.574 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.574 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.574 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:30.574 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.735910+0000", 2024-05-08T18:30:30.575 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000109406 2024-05-08T18:30:30.575 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:30.575 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:30.575 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:30.575 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.575 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.575 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:30.575 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.750251+0000", 2024-05-08T18:30:30.575 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 38.793664657999997, 2024-05-08T18:30:30.575 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0038408600000000002, 2024-05-08T18:30:30.575 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:30.575 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:30.575 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:30.575 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:30.575 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:30.576 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:30.576 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 224 2024-05-08T18:30:30.576 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.576 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:30.576 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.576 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:30.576 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750251+0000", 2024-05-08T18:30:30.576 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:30.576 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.576 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.576 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:30.576 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750251+0000", 2024-05-08T18:30:30.576 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:30.576 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.577 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.577 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:30.577 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750253+0000", 2024-05-08T18:30:30.577 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2129999999999998e-06 2024-05-08T18:30:30.577 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.577 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.577 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:30.577 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750265+0000", 2024-05-08T18:30:30.577 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1484000000000001e-05 2024-05-08T18:30:30.577 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.577 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.577 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:30.577 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750293+0000", 2024-05-08T18:30:30.578 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8673000000000001e-05 2024-05-08T18:30:30.578 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.578 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.578 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:30.578 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750308+0000", 2024-05-08T18:30:30.578 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4620000000000001e-05 2024-05-08T18:30:30.578 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.578 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.578 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:30.578 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750459+0000", 2024-05-08T18:30:30.578 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000151619 2024-05-08T18:30:30.578 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.578 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.578 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:30.579 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750822+0000", 2024-05-08T18:30:30.579 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000362467 2024-05-08T18:30:30.579 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.579 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.579 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:30.579 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.751591+0000", 2024-05-08T18:30:30.579 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00076934699999999998 2024-05-08T18:30:30.579 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.579 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.579 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:30.579 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.753042+0000", 2024-05-08T18:30:30.579 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001450652 2024-05-08T18:30:30.579 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.579 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.579 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:30.580 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.753792+0000", 2024-05-08T18:30:30.580 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00075045500000000002 2024-05-08T18:30:30.580 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.580 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.580 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:30.580 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.753977+0000", 2024-05-08T18:30:30.580 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000184511 2024-05-08T18:30:30.580 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.580 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.580 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:30.580 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.754092+0000", 2024-05-08T18:30:30.580 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000114819 2024-05-08T18:30:30.580 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:30.580 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:30.581 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:30.581 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.581 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.581 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:30.581 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.783902+0000", 2024-05-08T18:30:30.581 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 38.760013927000003, 2024-05-08T18:30:30.581 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003120046, 2024-05-08T18:30:30.581 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:30.581 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:30.581 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:30.581 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:30.581 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:30.582 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:30.582 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 233 2024-05-08T18:30:30.582 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.582 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:30.582 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.582 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:30.582 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.783902+0000", 2024-05-08T18:30:30.582 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:30.582 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.582 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.582 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:30.582 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.783902+0000", 2024-05-08T18:30:30.582 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:30.583 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.583 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.583 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:30.583 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.783904+0000", 2024-05-08T18:30:30.583 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5229999999999998e-06 2024-05-08T18:30:30.583 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.583 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.583 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:30.583 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.783916+0000", 2024-05-08T18:30:30.583 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1513e-05 2024-05-08T18:30:30.583 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.583 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.583 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:30.583 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.783947+0000", 2024-05-08T18:30:30.584 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1353000000000003e-05 2024-05-08T18:30:30.584 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.584 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.584 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:30.584 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.783964+0000", 2024-05-08T18:30:30.584 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6643e-05 2024-05-08T18:30:30.584 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.584 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.584 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:30.584 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.784110+0000", 2024-05-08T18:30:30.584 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014627299999999999 2024-05-08T18:30:30.584 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.584 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.584 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:30.585 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.784329+0000", 2024-05-08T18:30:30.585 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021892099999999999 2024-05-08T18:30:30.585 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.585 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.585 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:30.585 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.784752+0000", 2024-05-08T18:30:30.585 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00042336700000000001 2024-05-08T18:30:30.585 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.585 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.585 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:30.585 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.786093+0000", 2024-05-08T18:30:30.585 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00134107 2024-05-08T18:30:30.585 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.585 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.585 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:30.586 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.786863+0000", 2024-05-08T18:30:30.586 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00076949099999999997 2024-05-08T18:30:30.586 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.586 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.586 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:30.586 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.786955+0000", 2024-05-08T18:30:30.586 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.2478999999999993e-05 2024-05-08T18:30:30.586 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.586 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.586 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:30.586 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.787022+0000", 2024-05-08T18:30:30.586 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6413000000000003e-05 2024-05-08T18:30:30.586 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:30.586 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:30.587 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:30.587 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.587 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.587 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:341 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:30.587 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.816045+0000", 2024-05-08T18:30:30.587 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 38.727870590000002, 2024-05-08T18:30:30.587 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002875154, 2024-05-08T18:30:30.587 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:30.587 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:30.587 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:30.587 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:30.587 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:30.587 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:30.587 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 341 2024-05-08T18:30:30.588 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.588 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:30.588 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.588 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:30.588 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816045+0000", 2024-05-08T18:30:30.588 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:30.588 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.588 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.588 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:30.588 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816045+0000", 2024-05-08T18:30:30.588 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:30.588 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.588 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.589 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:30.589 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816046+0000", 2024-05-08T18:30:30.589 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9199999999999999e-07 2024-05-08T18:30:30.589 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.589 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.589 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:30.589 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816050+0000", 2024-05-08T18:30:30.589 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0260000000000001e-06 2024-05-08T18:30:30.589 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.589 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.589 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:30.589 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816060+0000", 2024-05-08T18:30:30.590 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0297e-05 2024-05-08T18:30:30.590 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.590 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.590 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:30.590 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816065+0000", 2024-05-08T18:30:30.590 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.237e-06 2024-05-08T18:30:30.590 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.590 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.590 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:30.590 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816122+0000", 2024-05-08T18:30:30.590 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6168000000000002e-05 2024-05-08T18:30:30.590 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.591 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.591 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:30.591 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816198+0000", 2024-05-08T18:30:30.591 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6511e-05 2024-05-08T18:30:30.591 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.591 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.591 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:30.591 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816305+0000", 2024-05-08T18:30:30.591 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000106487 2024-05-08T18:30:30.591 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.591 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.591 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:30.591 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816886+0000", 2024-05-08T18:30:30.591 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00058187199999999999 2024-05-08T18:30:30.592 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.592 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.592 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:30.592 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.818821+0000", 2024-05-08T18:30:30.592 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001934362 2024-05-08T18:30:30.592 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.592 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.592 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:30.592 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.818880+0000", 2024-05-08T18:30:30.592 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9210999999999999e-05 2024-05-08T18:30:30.592 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.592 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.592 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:30.593 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.818920+0000", 2024-05-08T18:30:30.593 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0091e-05 2024-05-08T18:30:30.593 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:30.593 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:30.593 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:30.593 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.593 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.593 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:30.593 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.086431+0000", 2024-05-08T18:30:30.593 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 38.457484770000001, 2024-05-08T18:30:30.593 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028335959999999999, 2024-05-08T18:30:30.593 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:30.593 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:30.593 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:30.594 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:30.594 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:30.594 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:30.594 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 733 2024-05-08T18:30:30.594 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.594 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:30.594 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.594 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:30.594 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086431+0000", 2024-05-08T18:30:30.594 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:30.594 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.594 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.594 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:30.595 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086431+0000", 2024-05-08T18:30:30.595 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:30.595 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.595 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.595 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:30.595 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086433+0000", 2024-05-08T18:30:30.595 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8899999999999999e-06 2024-05-08T18:30:30.595 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.595 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.595 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:30.595 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086441+0000", 2024-05-08T18:30:30.595 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.3100000000000001e-06 2024-05-08T18:30:30.595 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.596 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.596 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:30.596 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086460+0000", 2024-05-08T18:30:30.596 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8703999999999999e-05 2024-05-08T18:30:30.596 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.596 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.596 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:30.596 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086471+0000", 2024-05-08T18:30:30.596 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1324e-05 2024-05-08T18:30:30.596 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.596 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.596 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:30.596 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086590+0000", 2024-05-08T18:30:30.597 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000118625 2024-05-08T18:30:30.597 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.597 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.597 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:30.597 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086817+0000", 2024-05-08T18:30:30.597 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000226958 2024-05-08T18:30:30.597 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.597 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.597 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:30.597 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.087131+0000", 2024-05-08T18:30:30.597 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00031478799999999998 2024-05-08T18:30:30.597 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.597 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.597 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:30.597 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.088025+0000", 2024-05-08T18:30:30.598 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00089402999999999998 2024-05-08T18:30:30.598 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.598 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.598 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:30.598 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.089123+0000", 2024-05-08T18:30:30.598 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001097598 2024-05-08T18:30:30.598 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.598 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.598 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:30.598 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.089200+0000", 2024-05-08T18:30:30.598 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7333e-05 2024-05-08T18:30:30.598 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.598 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.599 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:30.599 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.089264+0000", 2024-05-08T18:30:30.599 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.4035999999999995e-05 2024-05-08T18:30:30.599 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:30.599 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:30.599 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:30.599 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.599 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.599 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:751 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:30.599 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.125611+0000", 2024-05-08T18:30:30.599 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 38.418304077999998, 2024-05-08T18:30:30.599 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032716749999999999, 2024-05-08T18:30:30.599 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:30.600 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:30.600 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:30.600 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:30.600 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:30.600 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:30.600 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 751 2024-05-08T18:30:30.600 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.600 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:30.600 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.600 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:30.600 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125611+0000", 2024-05-08T18:30:30.600 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:30.600 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.601 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.601 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:30.601 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125611+0000", 2024-05-08T18:30:30.601 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:30.601 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.601 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.601 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:30.601 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125614+0000", 2024-05-08T18:30:30.601 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.12e-06 2024-05-08T18:30:30.601 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.601 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.602 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:30.602 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125624+0000", 2024-05-08T18:30:30.602 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0492999999999999e-05 2024-05-08T18:30:30.602 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.602 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.602 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:30.602 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125650+0000", 2024-05-08T18:30:30.602 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5907000000000001e-05 2024-05-08T18:30:30.602 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.602 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.602 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:30.602 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125667+0000", 2024-05-08T18:30:30.603 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.694e-05 2024-05-08T18:30:30.603 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.603 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.603 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:30.603 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125801+0000", 2024-05-08T18:30:30.603 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000134482 2024-05-08T18:30:30.603 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.603 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.603 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:30.603 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.126174+0000", 2024-05-08T18:30:30.603 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00037294999999999999 2024-05-08T18:30:30.603 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.604 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.604 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:30.604 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.126750+0000", 2024-05-08T18:30:30.604 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00057538900000000004 2024-05-08T18:30:30.604 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.604 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.604 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:30.604 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.127997+0000", 2024-05-08T18:30:30.604 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001247761 2024-05-08T18:30:30.604 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.604 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.604 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:30.604 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.128731+0000", 2024-05-08T18:30:30.605 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00073338099999999996 2024-05-08T18:30:30.605 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.605 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.605 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:30.605 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.128817+0000", 2024-05-08T18:30:30.605 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5993000000000002e-05 2024-05-08T18:30:30.605 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.605 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.605 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:30.605 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.128883+0000", 2024-05-08T18:30:30.605 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6259000000000004e-05 2024-05-08T18:30:30.605 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:30.605 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:30.606 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:30.606 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.606 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.606 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:753 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:30.606 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.129809+0000", 2024-05-08T18:30:30.606 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 38.414106539999999, 2024-05-08T18:30:30.606 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0033775440000000001, 2024-05-08T18:30:30.606 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:30.606 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:30.606 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:30.606 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:30.606 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:30.607 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:30.607 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 753 2024-05-08T18:30:30.607 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.607 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:30.607 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.607 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:30.607 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129809+0000", 2024-05-08T18:30:30.607 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:30.607 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.607 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.607 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:30.607 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129809+0000", 2024-05-08T18:30:30.607 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:30.607 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.608 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.608 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:30.608 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129811+0000", 2024-05-08T18:30:30.608 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1730000000000002e-06 2024-05-08T18:30:30.608 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.608 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.608 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:30.608 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129822+0000", 2024-05-08T18:30:30.608 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0583e-05 2024-05-08T18:30:30.608 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.608 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.608 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:30.608 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129852+0000", 2024-05-08T18:30:30.609 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0744000000000002e-05 2024-05-08T18:30:30.609 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.609 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.609 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:30.609 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129870+0000", 2024-05-08T18:30:30.609 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7955999999999999e-05 2024-05-08T18:30:30.609 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.609 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.609 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:30.609 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.130018+0000", 2024-05-08T18:30:30.609 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014747600000000001 2024-05-08T18:30:30.609 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.609 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.609 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:30.610 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.130259+0000", 2024-05-08T18:30:30.610 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024079099999999999 2024-05-08T18:30:30.610 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.610 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.610 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:30.610 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.130734+0000", 2024-05-08T18:30:30.610 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00047562 2024-05-08T18:30:30.610 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.610 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.610 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:30.610 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.131997+0000", 2024-05-08T18:30:30.610 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012626429999999999 2024-05-08T18:30:30.611 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.611 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.611 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:30.611 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.132923+0000", 2024-05-08T18:30:30.611 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00092627599999999997 2024-05-08T18:30:30.611 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.611 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.611 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:30.611 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.133076+0000", 2024-05-08T18:30:30.611 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000152989 2024-05-08T18:30:30.611 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.611 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.611 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:30.611 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.133187+0000", 2024-05-08T18:30:30.612 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000110293 2024-05-08T18:30:30.612 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:30.612 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:30.612 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:30.612 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.612 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.612 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:30.612 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.228247+0000", 2024-05-08T18:30:30.612 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 38.315668930000001, 2024-05-08T18:30:30.612 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032753449999999998, 2024-05-08T18:30:30.612 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:30.612 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:30.612 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:30.612 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:30.613 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:30.613 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:30.613 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 796 2024-05-08T18:30:30.613 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.613 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:30.613 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.613 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:30.613 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228247+0000", 2024-05-08T18:30:30.613 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:30.613 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.613 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.613 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:30.613 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228247+0000", 2024-05-08T18:30:30.613 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:30.614 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.614 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.614 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:30.614 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228249+0000", 2024-05-08T18:30:30.614 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3800000000000001e-06 2024-05-08T18:30:30.614 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.614 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.614 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:30.614 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228260+0000", 2024-05-08T18:30:30.614 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1496e-05 2024-05-08T18:30:30.614 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.614 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.614 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:30.614 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228292+0000", 2024-05-08T18:30:30.615 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1294000000000002e-05 2024-05-08T18:30:30.615 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.615 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.615 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:30.615 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228306+0000", 2024-05-08T18:30:30.615 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4606e-05 2024-05-08T18:30:30.615 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.615 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.615 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:30.615 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228443+0000", 2024-05-08T18:30:30.615 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013672599999999999 2024-05-08T18:30:30.615 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.615 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.615 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:30.616 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228813+0000", 2024-05-08T18:30:30.616 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00036987000000000001 2024-05-08T18:30:30.616 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.616 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.616 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:30.616 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.229365+0000", 2024-05-08T18:30:30.616 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00055210600000000002 2024-05-08T18:30:30.616 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.616 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.616 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:30.616 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.230800+0000", 2024-05-08T18:30:30.616 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001435006 2024-05-08T18:30:30.616 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.616 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.617 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:30.617 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.231369+0000", 2024-05-08T18:30:30.617 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00056848499999999998 2024-05-08T18:30:30.617 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.617 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.617 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:30.617 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.231455+0000", 2024-05-08T18:30:30.617 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6905999999999998e-05 2024-05-08T18:30:30.617 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.617 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.617 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:30.617 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.231522+0000", 2024-05-08T18:30:30.617 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6470000000000006e-05 2024-05-08T18:30:30.617 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:30.618 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:30.618 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:30.618 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.618 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.618 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:798 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:30.618 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.232573+0000", 2024-05-08T18:30:30.618 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 38.311342822999997, 2024-05-08T18:30:30.618 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0030406690000000002, 2024-05-08T18:30:30.618 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:30.618 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:30.618 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:30.618 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:30.618 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:30.618 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:30.619 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 798 2024-05-08T18:30:30.619 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.619 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:30.619 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.619 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:30.619 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232573+0000", 2024-05-08T18:30:30.619 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:30.619 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.619 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.619 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:30.619 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232573+0000", 2024-05-08T18:30:30.619 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:30.619 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.620 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.620 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:30.620 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232574+0000", 2024-05-08T18:30:30.620 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.446e-06 2024-05-08T18:30:30.620 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.620 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.620 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:30.620 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232581+0000", 2024-05-08T18:30:30.620 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.0670000000000003e-06 2024-05-08T18:30:30.620 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.620 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.620 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:30.620 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232600+0000", 2024-05-08T18:30:30.620 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8822999999999999e-05 2024-05-08T18:30:30.621 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.621 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.621 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:30.621 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232611+0000", 2024-05-08T18:30:30.621 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1233000000000001e-05 2024-05-08T18:30:30.621 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.621 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.621 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:30.621 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232731+0000", 2024-05-08T18:30:30.621 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000120189 2024-05-08T18:30:30.621 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.621 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.621 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:30.621 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232963+0000", 2024-05-08T18:30:30.622 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023111900000000001 2024-05-08T18:30:30.622 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.622 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.622 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:30.622 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.233441+0000", 2024-05-08T18:30:30.622 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00047866899999999998 2024-05-08T18:30:30.622 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.622 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.622 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:30.622 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.234542+0000", 2024-05-08T18:30:30.622 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001101245 2024-05-08T18:30:30.622 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.622 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.623 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:30.623 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.235349+0000", 2024-05-08T18:30:30.623 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000806567 2024-05-08T18:30:30.623 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.623 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.623 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:30.623 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.235498+0000", 2024-05-08T18:30:30.623 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014907200000000001 2024-05-08T18:30:30.623 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.623 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.623 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:30.623 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.235613+0000", 2024-05-08T18:30:30.623 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115239 2024-05-08T18:30:30.623 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:30.624 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:30.624 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:30.624 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.624 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.624 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:30.624 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.248596+0000", 2024-05-08T18:30:30.624 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 38.295319016999997, 2024-05-08T18:30:30.624 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002919984, 2024-05-08T18:30:30.624 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:30.624 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:30.624 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:30.624 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:30.624 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:30.624 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:30.625 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 805 2024-05-08T18:30:30.625 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.625 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:30.625 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.625 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:30.625 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248596+0000", 2024-05-08T18:30:30.625 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:30.625 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.625 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.625 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:30.625 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248596+0000", 2024-05-08T18:30:30.625 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:30.625 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.626 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.626 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:30.626 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248599+0000", 2024-05-08T18:30:30.626 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3630000000000001e-06 2024-05-08T18:30:30.626 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.626 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.626 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:30.626 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248610+0000", 2024-05-08T18:30:30.626 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1267000000000001e-05 2024-05-08T18:30:30.626 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.626 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.626 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:30.626 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248641+0000", 2024-05-08T18:30:30.627 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1309999999999997e-05 2024-05-08T18:30:30.627 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.627 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.627 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:30.627 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248656+0000", 2024-05-08T18:30:30.627 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4449e-05 2024-05-08T18:30:30.627 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.627 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.627 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:30.627 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248781+0000", 2024-05-08T18:30:30.627 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012500900000000001 2024-05-08T18:30:30.627 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.627 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.627 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:30.627 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.249001+0000", 2024-05-08T18:30:30.628 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021963500000000001 2024-05-08T18:30:30.628 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.628 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.628 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:30.628 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.249341+0000", 2024-05-08T18:30:30.628 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00034004100000000002 2024-05-08T18:30:30.628 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.628 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.628 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:30.628 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.250473+0000", 2024-05-08T18:30:30.628 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0011324180000000001 2024-05-08T18:30:30.628 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.628 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.628 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:30.628 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.251230+0000", 2024-05-08T18:30:30.629 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00075751400000000004 2024-05-08T18:30:30.629 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.629 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.629 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:30.629 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.251394+0000", 2024-05-08T18:30:30.629 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016379200000000001 2024-05-08T18:30:30.629 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.629 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.629 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:30.629 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.251516+0000", 2024-05-08T18:30:30.629 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012218600000000001 2024-05-08T18:30:30.629 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:30.629 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:30.630 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:30.630 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.630 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.630 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:30.630 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.313184+0000", 2024-05-08T18:30:30.630 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 38.230731341999999, 2024-05-08T18:30:30.630 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003040016, 2024-05-08T18:30:30.630 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:30.630 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:30.630 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:30.630 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:30.630 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:30.630 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:30.631 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 832 2024-05-08T18:30:30.631 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.631 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:30.631 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.631 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:30.631 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313184+0000", 2024-05-08T18:30:30.631 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:30.631 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.631 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.631 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:30.631 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313184+0000", 2024-05-08T18:30:30.631 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:30.631 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.631 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.631 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:30.632 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313187+0000", 2024-05-08T18:30:30.632 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5100000000000001e-06 2024-05-08T18:30:30.632 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.632 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.632 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:30.632 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313199+0000", 2024-05-08T18:30:30.632 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.201e-05 2024-05-08T18:30:30.632 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.632 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.632 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:30.632 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313229+0000", 2024-05-08T18:30:30.632 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9839e-05 2024-05-08T18:30:30.632 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.633 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.633 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:30.633 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313243+0000", 2024-05-08T18:30:30.633 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4727e-05 2024-05-08T18:30:30.633 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.633 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.633 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:30.633 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313358+0000", 2024-05-08T18:30:30.633 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115016 2024-05-08T18:30:30.633 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.633 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.633 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:30.633 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313577+0000", 2024-05-08T18:30:30.633 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021897799999999999 2024-05-08T18:30:30.634 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.634 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.634 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:30.634 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313889+0000", 2024-05-08T18:30:30.634 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00031210400000000001 2024-05-08T18:30:30.634 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.634 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.634 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:30.634 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.315229+0000", 2024-05-08T18:30:30.634 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001339963 2024-05-08T18:30:30.634 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.634 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.634 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:30.635 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.315938+0000", 2024-05-08T18:30:30.635 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00070853400000000003 2024-05-08T18:30:30.635 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.635 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.635 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:30.635 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.316111+0000", 2024-05-08T18:30:30.635 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000173396 2024-05-08T18:30:30.635 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.635 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.635 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:30.635 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.316224+0000", 2024-05-08T18:30:30.635 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000112939 2024-05-08T18:30:30.635 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:30.636 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:30.636 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:30.636 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.636 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.636 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:834 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:30.636 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.317499+0000", 2024-05-08T18:30:30.636 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 38.226416542999999, 2024-05-08T18:30:30.636 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0033281109999999999, 2024-05-08T18:30:30.636 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:30.636 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:30.636 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:30.636 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:30.636 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:30.636 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:30.636 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 834 2024-05-08T18:30:30.636 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.637 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:30.637 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.637 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:30.637 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317499+0000", 2024-05-08T18:30:30.637 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:30.637 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.637 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.637 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:30.637 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317499+0000", 2024-05-08T18:30:30.637 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:30.637 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.637 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.637 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:30.637 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317501+0000", 2024-05-08T18:30:30.638 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9400000000000001e-06 2024-05-08T18:30:30.638 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.638 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.638 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:30.638 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317511+0000", 2024-05-08T18:30:30.638 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0297e-05 2024-05-08T18:30:30.638 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.638 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.638 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:30.638 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317532+0000", 2024-05-08T18:30:30.638 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1013e-05 2024-05-08T18:30:30.638 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.638 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.639 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:30.639 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317543+0000", 2024-05-08T18:30:30.639 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0757000000000001e-05 2024-05-08T18:30:30.639 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.639 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.639 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:30.639 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317658+0000", 2024-05-08T18:30:30.639 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115129 2024-05-08T18:30:30.639 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.639 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.639 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:30.639 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317887+0000", 2024-05-08T18:30:30.639 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00022880099999999999 2024-05-08T18:30:30.639 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.640 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.640 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:30.640 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.318378+0000", 2024-05-08T18:30:30.640 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00049129000000000002 2024-05-08T18:30:30.640 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.640 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.640 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:30.640 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.319597+0000", 2024-05-08T18:30:30.640 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012188469999999999 2024-05-08T18:30:30.640 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.640 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.640 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:30.640 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.320566+0000", 2024-05-08T18:30:30.640 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00096881599999999995 2024-05-08T18:30:30.641 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.641 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.641 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:30.641 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.320713+0000", 2024-05-08T18:30:30.641 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014691500000000001 2024-05-08T18:30:30.641 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.641 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.641 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:30.641 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.320827+0000", 2024-05-08T18:30:30.641 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000114306 2024-05-08T18:30:30.641 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:30.641 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:30.641 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:30.641 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.642 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.642 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:30.642 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.505569+0000", 2024-05-08T18:30:30.642 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 38.038346089999997, 2024-05-08T18:30:30.642 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028584309999999998, 2024-05-08T18:30:30.642 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:30.642 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:30.642 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:30.642 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:30.642 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:30.642 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:30.642 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 916 2024-05-08T18:30:30.642 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.642 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:30.643 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.643 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:30.643 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505569+0000", 2024-05-08T18:30:30.643 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:30.643 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.643 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.643 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:30.643 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505569+0000", 2024-05-08T18:30:30.643 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:30.643 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.643 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.643 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:30.643 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505572+0000", 2024-05-08T18:30:30.643 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3659999999999999e-06 2024-05-08T18:30:30.644 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.644 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.644 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:30.644 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505583+0000", 2024-05-08T18:30:30.644 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1574e-05 2024-05-08T18:30:30.644 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.644 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.644 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:30.644 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505614+0000", 2024-05-08T18:30:30.644 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0670000000000003e-05 2024-05-08T18:30:30.644 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.644 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.644 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:30.644 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505629+0000", 2024-05-08T18:30:30.645 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5063e-05 2024-05-08T18:30:30.645 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.645 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.645 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:30.645 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505754+0000", 2024-05-08T18:30:30.645 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012508899999999999 2024-05-08T18:30:30.645 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.645 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.645 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:30.645 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505988+0000", 2024-05-08T18:30:30.645 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023334699999999999 2024-05-08T18:30:30.645 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.645 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.645 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:30.646 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.506299+0000", 2024-05-08T18:30:30.646 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000311811 2024-05-08T18:30:30.646 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.646 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.646 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:30.646 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.507489+0000", 2024-05-08T18:30:30.646 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0011899510000000001 2024-05-08T18:30:30.646 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.646 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.646 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:30.646 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.508141+0000", 2024-05-08T18:30:30.646 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00065180200000000005 2024-05-08T18:30:30.646 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.646 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.647 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:30.647 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.508306+0000", 2024-05-08T18:30:30.647 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016450199999999999 2024-05-08T18:30:30.647 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.647 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.647 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:30.647 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.508428+0000", 2024-05-08T18:30:30.647 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000122256 2024-05-08T18:30:30.647 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:30.647 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:30.647 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:30.647 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.647 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.648 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:918 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:30.648 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.509337+0000", 2024-05-08T18:30:30.648 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 38.034578023000002, 2024-05-08T18:30:30.648 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002971787, 2024-05-08T18:30:30.648 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:30.648 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:30.648 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:30.648 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:30.648 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:30.648 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:30.648 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 918 2024-05-08T18:30:30.648 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.648 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:30.648 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.649 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:30.649 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509337+0000", 2024-05-08T18:30:30.649 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:30.649 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.649 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.649 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:30.649 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509337+0000", 2024-05-08T18:30:30.649 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:30.649 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.649 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.649 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:30.649 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509340+0000", 2024-05-08T18:30:30.649 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2570000000000002e-06 2024-05-08T18:30:30.650 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.650 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.650 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:30.650 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509351+0000", 2024-05-08T18:30:30.650 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0933e-05 2024-05-08T18:30:30.650 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.650 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.650 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:30.650 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509382+0000", 2024-05-08T18:30:30.650 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1198999999999997e-05 2024-05-08T18:30:30.650 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.650 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.650 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:30.651 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509400+0000", 2024-05-08T18:30:30.651 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8236999999999998e-05 2024-05-08T18:30:30.651 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.651 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.651 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:30.651 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509529+0000", 2024-05-08T18:30:30.651 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012905600000000001 2024-05-08T18:30:30.651 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.651 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.651 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:30.651 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509777+0000", 2024-05-08T18:30:30.651 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024786799999999999 2024-05-08T18:30:30.651 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.652 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.652 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:30.652 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.510284+0000", 2024-05-08T18:30:30.652 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000506796 2024-05-08T18:30:30.652 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.652 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.652 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:30.652 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.511453+0000", 2024-05-08T18:30:30.652 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001169575 2024-05-08T18:30:30.652 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.652 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.652 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:30.653 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.512051+0000", 2024-05-08T18:30:30.653 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00059743100000000005 2024-05-08T18:30:30.653 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.653 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.653 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:30.653 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.512199+0000", 2024-05-08T18:30:30.653 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000148486 2024-05-08T18:30:30.653 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.653 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.653 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:30.653 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.512309+0000", 2024-05-08T18:30:30.653 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000109949 2024-05-08T18:30:30.653 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:30.654 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:30.654 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:30.654 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.654 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.654 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:931 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:30.654 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.543277+0000", 2024-05-08T18:30:30.654 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 38.000638868000003, 2024-05-08T18:30:30.654 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028250710000000002, 2024-05-08T18:30:30.654 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:30.654 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:30.654 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:30.654 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:30.654 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:30.655 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:30.655 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 931 2024-05-08T18:30:30.655 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.655 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:30.655 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.655 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:30.655 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543277+0000", 2024-05-08T18:30:30.655 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:30.655 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.655 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.655 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:30.655 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543277+0000", 2024-05-08T18:30:30.655 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:30.655 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.655 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.656 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:30.656 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543279+0000", 2024-05-08T18:30:30.656 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.373e-06 2024-05-08T18:30:30.656 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.656 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.656 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:30.656 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543291+0000", 2024-05-08T18:30:30.656 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1517e-05 2024-05-08T18:30:30.656 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.656 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.656 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:30.656 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543323+0000", 2024-05-08T18:30:30.656 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2292000000000002e-05 2024-05-08T18:30:30.657 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.657 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.657 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:30.657 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543340+0000", 2024-05-08T18:30:30.657 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.749e-05 2024-05-08T18:30:30.657 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.657 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.657 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:30.657 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543462+0000", 2024-05-08T18:30:30.657 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000121413 2024-05-08T18:30:30.657 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.657 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.657 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:30.657 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543681+0000", 2024-05-08T18:30:30.658 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021974200000000001 2024-05-08T18:30:30.658 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.658 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.658 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:30.658 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.544004+0000", 2024-05-08T18:30:30.658 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00032268900000000003 2024-05-08T18:30:30.658 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.658 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.658 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:30.658 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.545158+0000", 2024-05-08T18:30:30.658 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0011540190000000001 2024-05-08T18:30:30.658 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.658 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.659 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:30.659 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.545970+0000", 2024-05-08T18:30:30.659 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00081224300000000004 2024-05-08T18:30:30.659 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.659 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.659 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:30.659 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.546043+0000", 2024-05-08T18:30:30.659 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.3067999999999999e-05 2024-05-08T18:30:30.659 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.659 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.659 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:30.659 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.546102+0000", 2024-05-08T18:30:30.659 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8224999999999999e-05 2024-05-08T18:30:30.659 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:30.660 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:30.660 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:30.660 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.660 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.660 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:30.660 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.578568+0000", 2024-05-08T18:30:30.660 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 37.965347960999999, 2024-05-08T18:30:30.660 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0030345839999999999, 2024-05-08T18:30:30.660 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:30.660 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:30.660 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:30.660 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:30.660 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:30.660 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:30.661 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 946 2024-05-08T18:30:30.661 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.661 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:30.661 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.661 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:30.661 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578568+0000", 2024-05-08T18:30:30.661 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:30.661 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.661 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.661 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:30.661 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578568+0000", 2024-05-08T18:30:30.661 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:30.661 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.661 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.662 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:30.662 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578570+0000", 2024-05-08T18:30:30.662 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3700000000000002e-06 2024-05-08T18:30:30.662 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.662 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.662 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:30.662 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578582+0000", 2024-05-08T18:30:30.662 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1627000000000001e-05 2024-05-08T18:30:30.662 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.662 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.662 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:30.662 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578612+0000", 2024-05-08T18:30:30.662 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0103e-05 2024-05-08T18:30:30.663 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.663 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.663 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:30.663 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578627+0000", 2024-05-08T18:30:30.663 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4949999999999999e-05 2024-05-08T18:30:30.663 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.663 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.663 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:30.663 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578750+0000", 2024-05-08T18:30:30.663 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012309899999999999 2024-05-08T18:30:30.663 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.663 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.663 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:30.663 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.579042+0000", 2024-05-08T18:30:30.664 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00029212500000000001 2024-05-08T18:30:30.664 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.664 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.664 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:30.664 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.579557+0000", 2024-05-08T18:30:30.664 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00051536900000000001 2024-05-08T18:30:30.664 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.664 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.664 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:30.664 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.580698+0000", 2024-05-08T18:30:30.664 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001140774 2024-05-08T18:30:30.664 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.664 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.665 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:30.665 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.581367+0000", 2024-05-08T18:30:30.665 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00066884799999999999 2024-05-08T18:30:30.665 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.665 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.665 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:30.665 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.581489+0000", 2024-05-08T18:30:30.665 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012265600000000001 2024-05-08T18:30:30.665 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:30.665 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:30.665 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:30.665 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.581602+0000", 2024-05-08T18:30:30.665 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000112663 2024-05-08T18:30:30.665 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:30.666 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:30.666 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:30.666 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:30.666 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:30.666 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:30:30.667 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-08T18:30:30.668 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:30:30.663+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:30:30.768 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:30:30.767+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:30:30.841 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:30:30.842 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:30:30.842 INFO:teuthology.orchestra.run.smithi097.stdout: "num_ops": 0 2024-05-08T18:30:30.842 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:30:30.857 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-08T18:30:30.906 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:30:30.908+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:30:30.970 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:30:30.967+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:30:30.978 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:30:30.978 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:30:30.978 INFO:teuthology.orchestra.run.smithi097.stdout: "complaint_time": 30, 2024-05-08T18:30:30.978 INFO:teuthology.orchestra.run.smithi097.stdout: "num_blocked_ops": 0 2024-05-08T18:30:30.979 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:30:30.992 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-08T18:30:31.082 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:30:31.084+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:30:31.165 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:30:31.165 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2024-05-08T18:30:31.165 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2024-05-08T18:30:31.165 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-05-08T18:30:31.165 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.165 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4479.0:40 5.b 5:d797044f:::zonegroup_info.ea3b680f-900d-4805-81ec-055811625780:head [create,call version.set in=10b,writefull 0~436] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-05-08T18:30:31.166 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:44.637551+0000", 2024-05-08T18:30:31.166 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 46.527418591999997, 2024-05-08T18:30:31.166 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003054013, 2024-05-08T18:30:31.166 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:31.166 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:31.166 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:31.166 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:31.166 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4479", 2024-05-08T18:30:31.166 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3577501689", 2024-05-08T18:30:31.166 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 40 2024-05-08T18:30:31.166 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.166 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:31.167 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.167 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:31.167 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.637551+0000", 2024-05-08T18:30:31.167 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:31.167 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.167 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.167 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:31.167 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.637551+0000", 2024-05-08T18:30:31.167 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:31.167 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.167 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.167 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:31.167 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.637554+0000", 2024-05-08T18:30:31.167 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6599999999999999e-06 2024-05-08T18:30:31.167 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.168 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.168 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:31.168 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.637576+0000", 2024-05-08T18:30:31.168 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1965999999999999e-05 2024-05-08T18:30:31.168 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.168 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.168 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:31.168 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.637603+0000", 2024-05-08T18:30:31.168 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7257e-05 2024-05-08T18:30:31.168 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.168 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.168 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:31.168 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.637623+0000", 2024-05-08T18:30:31.168 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9570000000000001e-05 2024-05-08T18:30:31.169 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.169 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.169 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:31.169 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.637766+0000", 2024-05-08T18:30:31.169 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000143435 2024-05-08T18:30:31.169 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.169 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.169 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:31.169 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.638167+0000", 2024-05-08T18:30:31.169 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00040082399999999998 2024-05-08T18:30:31.169 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.169 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.169 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:31.170 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.638627+0000", 2024-05-08T18:30:31.170 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00046019300000000002 2024-05-08T18:30:31.170 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.170 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.170 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:31.170 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.640399+0000", 2024-05-08T18:30:31.170 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0017714199999999999 2024-05-08T18:30:31.170 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.170 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.170 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:31.170 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.640447+0000", 2024-05-08T18:30:31.170 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8383000000000001e-05 2024-05-08T18:30:31.170 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.171 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.171 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:31.171 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.640534+0000", 2024-05-08T18:30:31.171 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7078999999999998e-05 2024-05-08T18:30:31.171 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.171 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.171 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:31.171 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.640606+0000", 2024-05-08T18:30:31.171 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1225999999999999e-05 2024-05-08T18:30:31.171 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:31.171 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:31.171 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:31.171 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.171 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.172 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4479.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-05-08T18:30:31.172 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:44.643918+0000", 2024-05-08T18:30:31.172 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 46.521052316999999, 2024-05-08T18:30:31.172 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002986004, 2024-05-08T18:30:31.172 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:31.172 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:31.172 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:31.172 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:31.172 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4479", 2024-05-08T18:30:31.172 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3577501689", 2024-05-08T18:30:31.172 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 42 2024-05-08T18:30:31.172 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.172 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:31.173 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.173 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:31.173 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.643918+0000", 2024-05-08T18:30:31.173 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:31.173 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.173 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.173 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:31.173 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.643918+0000", 2024-05-08T18:30:31.173 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:31.173 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.173 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.173 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:31.173 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.643919+0000", 2024-05-08T18:30:31.173 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4729999999999999e-06 2024-05-08T18:30:31.174 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.174 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.174 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:31.174 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.643927+0000", 2024-05-08T18:30:31.174 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6389999999999992e-06 2024-05-08T18:30:31.174 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.174 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.174 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:31.174 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.643945+0000", 2024-05-08T18:30:31.174 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8195000000000001e-05 2024-05-08T18:30:31.174 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.174 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.174 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:31.174 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.643954+0000", 2024-05-08T18:30:31.174 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5210000000000002e-06 2024-05-08T18:30:31.175 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.175 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.175 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:31.175 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.644123+0000", 2024-05-08T18:30:31.175 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016904999999999999 2024-05-08T18:30:31.175 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.175 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.175 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:31.175 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.644315+0000", 2024-05-08T18:30:31.175 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00019202800000000001 2024-05-08T18:30:31.175 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.175 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.175 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:31.175 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.644505+0000", 2024-05-08T18:30:31.176 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000190552 2024-05-08T18:30:31.176 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.176 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.176 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:31.176 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.645877+0000", 2024-05-08T18:30:31.176 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001371702 2024-05-08T18:30:31.176 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.176 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.176 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:31.176 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.646778+0000", 2024-05-08T18:30:31.176 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00090065700000000002 2024-05-08T18:30:31.176 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.176 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.177 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:31.177 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.646843+0000", 2024-05-08T18:30:31.177 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5504000000000002e-05 2024-05-08T18:30:31.177 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.177 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.177 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:31.177 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.646904+0000", 2024-05-08T18:30:31.177 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0683000000000002e-05 2024-05-08T18:30:31.177 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:31.177 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:31.177 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:31.177 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.177 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.177 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:57 7.3 e30/29 7:c609908c:::notify.5:head v 30'2, mlcod=0'0)", 2024-05-08T18:30:31.178 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:48.669376+0000", 2024-05-08T18:30:31.178 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 42.495594208999997, 2024-05-08T18:30:31.178 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0041509479999999998, 2024-05-08T18:30:31.178 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:31.178 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:31.178 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:31.178 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:31.178 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.178 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:31.178 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669376+0000", 2024-05-08T18:30:31.178 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:31.178 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.178 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.179 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:31.179 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669376+0000", 2024-05-08T18:30:31.179 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:31.179 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.179 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.179 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:31.179 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669378+0000", 2024-05-08T18:30:31.179 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.79e-06 2024-05-08T18:30:31.179 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.179 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.179 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:31.179 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669393+0000", 2024-05-08T18:30:31.179 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5053e-05 2024-05-08T18:30:31.179 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.180 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.180 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:31.180 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669427+0000", 2024-05-08T18:30:31.180 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4326999999999998e-05 2024-05-08T18:30:31.180 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.180 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.180 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:31.180 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669451+0000", 2024-05-08T18:30:31.180 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3629e-05 2024-05-08T18:30:31.180 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.180 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.180 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:31.180 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669563+0000", 2024-05-08T18:30:31.181 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011251099999999999 2024-05-08T18:30:31.181 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.181 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.181 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:31.181 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669607+0000", 2024-05-08T18:30:31.181 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3877e-05 2024-05-08T18:30:31.181 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.181 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.181 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:31.181 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.673401+0000", 2024-05-08T18:30:31.181 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0037942819999999999 2024-05-08T18:30:31.181 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.181 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.181 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:31.182 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.673527+0000", 2024-05-08T18:30:31.182 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012547900000000001 2024-05-08T18:30:31.182 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:31.182 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:31.182 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:31.182 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.182 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.182 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:58 7.14 e30/29 7:2b04a3e9:::notify.6:head v 30'1, mlcod=0'0)", 2024-05-08T18:30:31.182 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:48.669496+0000", 2024-05-08T18:30:31.182 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 42.495473836999999, 2024-05-08T18:30:31.182 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0046805609999999997, 2024-05-08T18:30:31.182 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:31.182 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:31.182 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:31.183 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:31.183 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.183 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:31.183 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669496+0000", 2024-05-08T18:30:31.183 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:31.183 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.183 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.183 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:31.183 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669496+0000", 2024-05-08T18:30:31.183 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:31.183 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.183 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.183 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:31.183 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669497+0000", 2024-05-08T18:30:31.184 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0100000000000001e-06 2024-05-08T18:30:31.184 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.184 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.184 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:31.184 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669507+0000", 2024-05-08T18:30:31.184 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.7540000000000001e-06 2024-05-08T18:30:31.184 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.184 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.184 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:31.184 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669528+0000", 2024-05-08T18:30:31.184 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.05e-05 2024-05-08T18:30:31.184 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.184 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.184 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:31.184 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669544+0000", 2024-05-08T18:30:31.185 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6716000000000001e-05 2024-05-08T18:30:31.185 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.185 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.185 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:31.185 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669667+0000", 2024-05-08T18:30:31.185 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012275799999999999 2024-05-08T18:30:31.185 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.185 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.185 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:31.185 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669706+0000", 2024-05-08T18:30:31.185 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8764999999999999e-05 2024-05-08T18:30:31.185 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.185 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.185 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:31.186 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674100+0000", 2024-05-08T18:30:31.186 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.004394528 2024-05-08T18:30:31.186 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.186 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.186 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:31.186 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674177+0000", 2024-05-08T18:30:31.186 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6530000000000001e-05 2024-05-08T18:30:31.186 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:31.186 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:31.186 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:31.186 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.186 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.186 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:31.187 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.794231+0000", 2024-05-08T18:30:31.187 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 39.370739446000002, 2024-05-08T18:30:31.187 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031872810000000001, 2024-05-08T18:30:31.187 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:31.187 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:31.187 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:31.187 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:31.187 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:31.187 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:31.187 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 236 2024-05-08T18:30:31.187 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.187 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:31.187 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.187 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:31.188 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794231+0000", 2024-05-08T18:30:31.188 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:31.188 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.188 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.188 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:31.188 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794231+0000", 2024-05-08T18:30:31.188 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:31.188 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.188 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.188 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:31.188 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794234+0000", 2024-05-08T18:30:31.188 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.36e-06 2024-05-08T18:30:31.188 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.188 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.188 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:31.189 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794248+0000", 2024-05-08T18:30:31.189 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4372999999999999e-05 2024-05-08T18:30:31.189 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.189 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.189 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:31.189 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794279+0000", 2024-05-08T18:30:31.189 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1075999999999999e-05 2024-05-08T18:30:31.189 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.189 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.189 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:31.189 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794295+0000", 2024-05-08T18:30:31.189 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5386000000000001e-05 2024-05-08T18:30:31.189 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.190 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.190 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:31.190 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794416+0000", 2024-05-08T18:30:31.190 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012071899999999999 2024-05-08T18:30:31.190 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.190 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.190 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:31.190 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794638+0000", 2024-05-08T18:30:31.190 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00022262599999999999 2024-05-08T18:30:31.190 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.190 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.190 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:31.190 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.795061+0000", 2024-05-08T18:30:31.190 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00042248900000000001 2024-05-08T18:30:31.191 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.191 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.191 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:31.191 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.796477+0000", 2024-05-08T18:30:31.191 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0014162230000000001 2024-05-08T18:30:31.191 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.191 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.191 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:31.191 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.797258+0000", 2024-05-08T18:30:31.191 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00078159400000000004 2024-05-08T18:30:31.191 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.191 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.191 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:31.192 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.797349+0000", 2024-05-08T18:30:31.192 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0462000000000002e-05 2024-05-08T18:30:31.192 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.192 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.192 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:31.192 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.797418+0000", 2024-05-08T18:30:31.192 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8973000000000005e-05 2024-05-08T18:30:31.192 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:31.192 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:31.192 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:31.192 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.192 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.192 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:281 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:31.192 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.806063+0000", 2024-05-08T18:30:31.193 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 39.358907311999999, 2024-05-08T18:30:31.193 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002923761, 2024-05-08T18:30:31.193 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:31.193 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:31.193 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:31.193 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:31.193 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:31.193 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:31.193 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 281 2024-05-08T18:30:31.194 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.194 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:31.194 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.194 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:31.194 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.806063+0000", 2024-05-08T18:30:31.194 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:31.194 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.194 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.194 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:31.194 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.806063+0000", 2024-05-08T18:30:31.194 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:31.194 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.194 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.195 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:31.195 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.806064+0000", 2024-05-08T18:30:31.195 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.204e-06 2024-05-08T18:30:31.195 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.195 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.195 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:31.195 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.806073+0000", 2024-05-08T18:30:31.195 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5609999999999999e-06 2024-05-08T18:30:31.195 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.195 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.195 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:31.195 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.806089+0000", 2024-05-08T18:30:31.195 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6673000000000001e-05 2024-05-08T18:30:31.196 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.196 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.196 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:31.196 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.806098+0000", 2024-05-08T18:30:31.196 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8899999999999996e-06 2024-05-08T18:30:31.196 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.196 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.196 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:31.196 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.806165+0000", 2024-05-08T18:30:31.196 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6927999999999993e-05 2024-05-08T18:30:31.196 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.196 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.196 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:31.197 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.806298+0000", 2024-05-08T18:30:31.197 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000132886 2024-05-08T18:30:31.197 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.197 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.197 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:31.197 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.806453+0000", 2024-05-08T18:30:31.197 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000155339 2024-05-08T18:30:31.197 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.197 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.197 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:31.197 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.807157+0000", 2024-05-08T18:30:31.197 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00070363900000000004 2024-05-08T18:30:31.197 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.197 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.197 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:31.198 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.808880+0000", 2024-05-08T18:30:31.198 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0017227130000000001 2024-05-08T18:30:31.198 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.198 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.198 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:31.198 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.808938+0000", 2024-05-08T18:30:31.198 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8814999999999998e-05 2024-05-08T18:30:31.198 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.198 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.198 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:31.198 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.808987+0000", 2024-05-08T18:30:31.198 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8112999999999998e-05 2024-05-08T18:30:31.198 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:31.198 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:31.199 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:31.199 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.199 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.199 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:304 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:31.199 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.809645+0000", 2024-05-08T18:30:31.199 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 39.355325473999997, 2024-05-08T18:30:31.199 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031633579999999998, 2024-05-08T18:30:31.199 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:31.199 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:31.199 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:31.199 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:31.199 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:31.199 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:31.199 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 304 2024-05-08T18:30:31.200 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.200 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:31.200 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.200 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:31.200 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809645+0000", 2024-05-08T18:30:31.200 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:31.200 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.200 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.200 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:31.200 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809645+0000", 2024-05-08T18:30:31.200 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:31.200 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.200 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.200 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:31.201 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809646+0000", 2024-05-08T18:30:31.201 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.113e-06 2024-05-08T18:30:31.201 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.201 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.201 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:31.201 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809652+0000", 2024-05-08T18:30:31.201 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1650000000000003e-06 2024-05-08T18:30:31.201 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.201 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.201 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:31.201 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809668+0000", 2024-05-08T18:30:31.201 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6025e-05 2024-05-08T18:30:31.201 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.202 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.202 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:31.202 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809678+0000", 2024-05-08T18:30:31.202 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0456e-05 2024-05-08T18:30:31.202 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.202 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.202 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:31.202 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809745+0000", 2024-05-08T18:30:31.202 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7088000000000005e-05 2024-05-08T18:30:31.202 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.202 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.202 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:31.202 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809803+0000", 2024-05-08T18:30:31.203 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7405999999999999e-05 2024-05-08T18:30:31.203 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.203 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.203 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:31.203 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809951+0000", 2024-05-08T18:30:31.203 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014775500000000001 2024-05-08T18:30:31.203 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.203 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.203 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:31.203 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.810564+0000", 2024-05-08T18:30:31.203 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00061324899999999996 2024-05-08T18:30:31.203 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.203 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.203 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:31.204 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.812744+0000", 2024-05-08T18:30:31.204 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0021804509999999999 2024-05-08T18:30:31.204 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.204 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.204 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:31.204 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.812781+0000", 2024-05-08T18:30:31.204 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6554999999999998e-05 2024-05-08T18:30:31.204 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.204 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.204 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:31.204 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.812808+0000", 2024-05-08T18:30:31.204 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7095000000000001e-05 2024-05-08T18:30:31.204 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:31.204 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:31.204 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:31.205 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.205 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.205 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:31.205 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.105553+0000", 2024-05-08T18:30:31.205 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 39.059417463000003, 2024-05-08T18:30:31.205 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028754850000000001, 2024-05-08T18:30:31.205 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:31.205 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:31.205 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:31.205 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:31.205 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:31.205 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:31.205 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 742 2024-05-08T18:30:31.205 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.205 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:31.206 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.206 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:31.206 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.105553+0000", 2024-05-08T18:30:31.206 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:31.206 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.206 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.206 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:31.206 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.105553+0000", 2024-05-08T18:30:31.206 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:31.206 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.206 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.206 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:31.206 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.105556+0000", 2024-05-08T18:30:31.206 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3100000000000001e-06 2024-05-08T18:30:31.207 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.207 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.207 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:31.207 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.105569+0000", 2024-05-08T18:30:31.207 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2754e-05 2024-05-08T18:30:31.207 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.207 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.207 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:31.207 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.105601+0000", 2024-05-08T18:30:31.207 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2435999999999999e-05 2024-05-08T18:30:31.207 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.207 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.207 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:31.207 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.105616+0000", 2024-05-08T18:30:31.208 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4657e-05 2024-05-08T18:30:31.208 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.208 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.208 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:31.208 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.105804+0000", 2024-05-08T18:30:31.208 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00018861799999999999 2024-05-08T18:30:31.208 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.208 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.208 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:31.208 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.106054+0000", 2024-05-08T18:30:31.208 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024948499999999997 2024-05-08T18:30:31.208 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.208 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.209 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:31.209 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.106390+0000", 2024-05-08T18:30:31.209 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00033640100000000001 2024-05-08T18:30:31.209 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.209 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.209 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:31.209 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.107527+0000", 2024-05-08T18:30:31.209 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001136871 2024-05-08T18:30:31.209 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.209 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.209 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:31.209 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.108265+0000", 2024-05-08T18:30:31.209 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00073753100000000004 2024-05-08T18:30:31.209 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.210 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.210 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:31.210 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.108353+0000", 2024-05-08T18:30:31.210 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8232999999999994e-05 2024-05-08T18:30:31.210 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.210 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.210 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:31.210 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.108428+0000", 2024-05-08T18:30:31.210 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.5189000000000001e-05 2024-05-08T18:30:31.210 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:31.210 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:31.210 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:31.210 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.210 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.211 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:31.211 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.148015+0000", 2024-05-08T18:30:31.211 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 39.016955520000003, 2024-05-08T18:30:31.211 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032297409999999999, 2024-05-08T18:30:31.211 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:31.211 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:31.211 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:31.211 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:31.211 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:31.211 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:31.211 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 760 2024-05-08T18:30:31.211 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.211 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:31.211 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.212 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:31.212 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.148015+0000", 2024-05-08T18:30:31.212 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:31.212 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.212 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.212 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:31.212 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.148015+0000", 2024-05-08T18:30:31.212 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:31.212 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.212 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.212 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:31.212 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.148017+0000", 2024-05-08T18:30:31.212 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1830000000000001e-06 2024-05-08T18:30:31.213 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.213 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.213 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:31.213 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.148030+0000", 2024-05-08T18:30:31.213 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2893e-05 2024-05-08T18:30:31.213 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.213 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.213 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:31.213 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.148061+0000", 2024-05-08T18:30:31.213 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0953e-05 2024-05-08T18:30:31.213 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.213 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.213 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:31.213 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.148077+0000", 2024-05-08T18:30:31.214 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6554000000000001e-05 2024-05-08T18:30:31.214 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.214 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.214 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:31.214 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.148230+0000", 2024-05-08T18:30:31.214 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015263899999999999 2024-05-08T18:30:31.214 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.214 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.214 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:31.214 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.148592+0000", 2024-05-08T18:30:31.214 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00036219699999999997 2024-05-08T18:30:31.214 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.214 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.215 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:31.215 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.149139+0000", 2024-05-08T18:30:31.215 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00054734599999999999 2024-05-08T18:30:31.215 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.215 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.215 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:31.215 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.150505+0000", 2024-05-08T18:30:31.215 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001365479 2024-05-08T18:30:31.215 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.215 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.215 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:31.215 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.151087+0000", 2024-05-08T18:30:31.215 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00058201200000000002 2024-05-08T18:30:31.215 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.215 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.216 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:31.216 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.151175+0000", 2024-05-08T18:30:31.216 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8199e-05 2024-05-08T18:30:31.216 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.216 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.216 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:31.216 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.151244+0000", 2024-05-08T18:30:31.216 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9286e-05 2024-05-08T18:30:31.216 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:31.216 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:31.216 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:31.216 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.216 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.216 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:31.216 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.277376+0000", 2024-05-08T18:30:31.217 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 38.887593602000003, 2024-05-08T18:30:31.217 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032022190000000001, 2024-05-08T18:30:31.217 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:31.217 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:31.217 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:31.217 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:31.217 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:31.217 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:31.217 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 817 2024-05-08T18:30:31.217 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.217 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:31.217 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.217 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:31.217 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.277376+0000", 2024-05-08T18:30:31.218 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:31.218 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.218 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.218 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:31.218 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.277376+0000", 2024-05-08T18:30:31.218 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:31.218 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.218 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.218 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:31.218 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.277379+0000", 2024-05-08T18:30:31.218 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4430000000000002e-06 2024-05-08T18:30:31.218 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.218 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.218 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:31.219 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.277391+0000", 2024-05-08T18:30:31.219 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1634000000000001e-05 2024-05-08T18:30:31.219 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.219 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.219 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:31.219 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.277421+0000", 2024-05-08T18:30:31.219 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0691999999999997e-05 2024-05-08T18:30:31.219 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.219 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.219 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:31.219 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.277438+0000", 2024-05-08T18:30:31.219 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7102999999999999e-05 2024-05-08T18:30:31.219 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.219 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.220 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:31.220 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.277602+0000", 2024-05-08T18:30:31.220 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016345300000000001 2024-05-08T18:30:31.220 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.220 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.220 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:31.220 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.278019+0000", 2024-05-08T18:30:31.220 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00041724699999999998 2024-05-08T18:30:31.220 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.220 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.220 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:31.220 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.278573+0000", 2024-05-08T18:30:31.220 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00055391900000000005 2024-05-08T18:30:31.220 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.221 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.221 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:31.221 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.279973+0000", 2024-05-08T18:30:31.221 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0013995819999999999 2024-05-08T18:30:31.221 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.221 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.221 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:31.221 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.280422+0000", 2024-05-08T18:30:31.221 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00044940699999999997 2024-05-08T18:30:31.221 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.221 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.221 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:31.221 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.280509+0000", 2024-05-08T18:30:31.221 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7455999999999997e-05 2024-05-08T18:30:31.222 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.222 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.222 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:31.222 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.280579+0000", 2024-05-08T18:30:31.222 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9282999999999994e-05 2024-05-08T18:30:31.222 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:31.222 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:31.222 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:31.222 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.222 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.222 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:31.222 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.281716+0000", 2024-05-08T18:30:31.222 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 38.883254235000003, 2024-05-08T18:30:31.223 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003275881, 2024-05-08T18:30:31.223 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:31.223 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:31.223 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:31.223 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:31.223 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:31.223 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:31.223 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 819 2024-05-08T18:30:31.223 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.223 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:31.223 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.223 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:31.223 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.281716+0000", 2024-05-08T18:30:31.223 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:31.224 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.224 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.224 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:31.224 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.281716+0000", 2024-05-08T18:30:31.224 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:31.224 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.224 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.224 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:31.224 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.281718+0000", 2024-05-08T18:30:31.224 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.863e-06 2024-05-08T18:30:31.224 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.224 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.224 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:31.225 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.281728+0000", 2024-05-08T18:30:31.225 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0550000000000001e-05 2024-05-08T18:30:31.225 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.225 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.225 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:31.225 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.281760+0000", 2024-05-08T18:30:31.225 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2150000000000002e-05 2024-05-08T18:30:31.225 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.225 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.225 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:31.225 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.281776+0000", 2024-05-08T18:30:31.225 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6005999999999999e-05 2024-05-08T18:30:31.225 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.226 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.226 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:31.226 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.281917+0000", 2024-05-08T18:30:31.226 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014070200000000001 2024-05-08T18:30:31.226 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.226 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.226 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:31.226 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.282148+0000", 2024-05-08T18:30:31.226 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023095200000000001 2024-05-08T18:30:31.226 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.226 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.226 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:31.226 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.282641+0000", 2024-05-08T18:30:31.226 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00049337999999999997 2024-05-08T18:30:31.227 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.227 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.227 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:31.227 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.284070+0000", 2024-05-08T18:30:31.227 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0014287950000000001 2024-05-08T18:30:31.227 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.227 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.227 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:31.227 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.284837+0000", 2024-05-08T18:30:31.227 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00076679799999999996 2024-05-08T18:30:31.227 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.227 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.227 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:31.227 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.284925+0000", 2024-05-08T18:30:31.228 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8165999999999996e-05 2024-05-08T18:30:31.228 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.228 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.228 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:31.228 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.284992+0000", 2024-05-08T18:30:31.228 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6519000000000005e-05 2024-05-08T18:30:31.228 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:31.228 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:31.228 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:31.228 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.228 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.228 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:31.228 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.334745+0000", 2024-05-08T18:30:31.228 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 38.830225325000001, 2024-05-08T18:30:31.228 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032404719999999999, 2024-05-08T18:30:31.229 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:31.229 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:31.229 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:31.229 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:31.229 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:31.229 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:31.229 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 841 2024-05-08T18:30:31.229 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.229 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:31.229 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.229 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:31.229 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.334745+0000", 2024-05-08T18:30:31.229 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:31.229 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.230 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.230 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:31.230 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.334745+0000", 2024-05-08T18:30:31.230 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:31.230 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.230 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.230 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:31.230 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.334747+0000", 2024-05-08T18:30:31.230 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.407e-06 2024-05-08T18:30:31.230 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.230 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.230 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:31.230 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.334759+0000", 2024-05-08T18:30:31.231 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1883e-05 2024-05-08T18:30:31.231 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.231 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.231 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:31.231 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.334789+0000", 2024-05-08T18:30:31.231 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9957000000000001e-05 2024-05-08T18:30:31.231 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.231 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.231 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:31.231 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.334804+0000", 2024-05-08T18:30:31.231 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4713e-05 2024-05-08T18:30:31.231 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.231 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.232 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:31.232 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.334951+0000", 2024-05-08T18:30:31.232 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000147675 2024-05-08T18:30:31.232 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.232 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.232 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:31.232 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.335304+0000", 2024-05-08T18:30:31.232 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00035214099999999999 2024-05-08T18:30:31.232 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.232 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.232 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:31.232 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.335859+0000", 2024-05-08T18:30:31.232 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00055546899999999995 2024-05-08T18:30:31.232 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.232 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.233 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:31.233 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.337168+0000", 2024-05-08T18:30:31.233 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0013087299999999999 2024-05-08T18:30:31.233 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.233 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.233 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:31.233 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.337808+0000", 2024-05-08T18:30:31.233 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00064005500000000005 2024-05-08T18:30:31.233 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.233 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.233 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:31.233 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.337894+0000", 2024-05-08T18:30:31.233 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6593000000000003e-05 2024-05-08T18:30:31.233 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.234 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.234 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:31.234 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.337985+0000", 2024-05-08T18:30:31.234 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0848999999999997e-05 2024-05-08T18:30:31.234 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:31.234 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:31.234 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:31.234 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.234 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.234 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:31.234 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.338870+0000", 2024-05-08T18:30:31.234 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 38.826100576000002, 2024-05-08T18:30:31.234 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002862121, 2024-05-08T18:30:31.234 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:31.235 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:31.235 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:31.235 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:31.235 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:31.235 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:31.235 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 843 2024-05-08T18:30:31.235 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.235 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:31.235 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.235 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:31.235 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.338870+0000", 2024-05-08T18:30:31.235 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:31.235 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.236 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.236 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:31.236 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.338870+0000", 2024-05-08T18:30:31.236 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:31.236 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.236 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.236 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:31.236 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.338872+0000", 2024-05-08T18:30:31.236 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3429999999999998e-06 2024-05-08T18:30:31.236 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.236 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.236 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:31.236 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.338883+0000", 2024-05-08T18:30:31.236 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1447000000000001e-05 2024-05-08T18:30:31.237 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.237 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.237 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:31.237 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.338914+0000", 2024-05-08T18:30:31.237 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1052e-05 2024-05-08T18:30:31.237 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.237 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.237 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:31.237 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.338932+0000", 2024-05-08T18:30:31.237 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7604e-05 2024-05-08T18:30:31.237 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.237 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.237 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:31.237 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.339019+0000", 2024-05-08T18:30:31.237 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6982000000000002e-05 2024-05-08T18:30:31.238 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.238 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.238 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:31.238 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.339139+0000", 2024-05-08T18:30:31.238 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011978599999999999 2024-05-08T18:30:31.238 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.238 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.238 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:31.238 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.339415+0000", 2024-05-08T18:30:31.238 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00027644799999999999 2024-05-08T18:30:31.238 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.238 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.238 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:31.239 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.340619+0000", 2024-05-08T18:30:31.239 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012043010000000001 2024-05-08T18:30:31.239 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.239 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.239 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:31.239 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.341454+0000", 2024-05-08T18:30:31.239 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00083464300000000004 2024-05-08T18:30:31.239 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.239 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.239 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:31.239 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.341609+0000", 2024-05-08T18:30:31.239 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000154752 2024-05-08T18:30:31.239 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.239 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.239 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:31.240 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.341732+0000", 2024-05-08T18:30:31.240 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012276299999999999 2024-05-08T18:30:31.240 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:31.240 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:31.240 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:31.240 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.240 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.240 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:31.240 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.349287+0000", 2024-05-08T18:30:31.240 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 38.815682746999997, 2024-05-08T18:30:31.240 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032683220000000002, 2024-05-08T18:30:31.240 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:31.240 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:31.240 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:31.240 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:31.241 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:31.241 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:31.241 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 847 2024-05-08T18:30:31.241 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.241 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:31.241 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.241 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:31.241 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.349287+0000", 2024-05-08T18:30:31.241 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:31.241 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.241 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.241 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:31.241 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.349287+0000", 2024-05-08T18:30:31.242 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:31.242 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.242 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.242 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:31.242 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.349290+0000", 2024-05-08T18:30:31.242 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3369999999999998e-06 2024-05-08T18:30:31.242 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.242 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.242 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:31.242 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.349318+0000", 2024-05-08T18:30:31.242 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8419999999999999e-05 2024-05-08T18:30:31.242 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.242 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.242 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:31.243 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.349348+0000", 2024-05-08T18:30:31.243 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0260000000000002e-05 2024-05-08T18:30:31.243 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.243 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.243 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:31.243 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.349364+0000", 2024-05-08T18:30:31.243 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5359999999999999e-05 2024-05-08T18:30:31.243 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.243 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.243 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:31.243 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.349511+0000", 2024-05-08T18:30:31.243 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014760199999999999 2024-05-08T18:30:31.243 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.243 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.244 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:31.244 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.349872+0000", 2024-05-08T18:30:31.244 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00036035 2024-05-08T18:30:31.244 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.244 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.244 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:31.244 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.350432+0000", 2024-05-08T18:30:31.244 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00056059600000000001 2024-05-08T18:30:31.244 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.244 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.244 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:31.244 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.351817+0000", 2024-05-08T18:30:31.244 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001385063 2024-05-08T18:30:31.245 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.245 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.245 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:31.245 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.352402+0000", 2024-05-08T18:30:31.245 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00058490500000000004 2024-05-08T18:30:31.245 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.245 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.245 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:31.245 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.352488+0000", 2024-05-08T18:30:31.245 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6032999999999994e-05 2024-05-08T18:30:31.245 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.245 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.245 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:31.245 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.352556+0000", 2024-05-08T18:30:31.246 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7396000000000003e-05 2024-05-08T18:30:31.246 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:31.246 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:31.246 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:31.246 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.246 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.246 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:31.246 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.353786+0000", 2024-05-08T18:30:31.246 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 38.811183911999997, 2024-05-08T18:30:31.246 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0029130850000000002, 2024-05-08T18:30:31.246 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:31.246 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:31.246 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:31.247 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:31.247 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:31.247 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:31.247 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 849 2024-05-08T18:30:31.247 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.247 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:31.247 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.247 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:31.247 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.353786+0000", 2024-05-08T18:30:31.247 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:31.247 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.247 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.247 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:31.247 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.353786+0000", 2024-05-08T18:30:31.248 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:31.248 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.248 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.248 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:31.248 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.353788+0000", 2024-05-08T18:30:31.248 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0370000000000001e-06 2024-05-08T18:30:31.248 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.248 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.248 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:31.248 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.353799+0000", 2024-05-08T18:30:31.248 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0686000000000001e-05 2024-05-08T18:30:31.248 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.248 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.248 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:31.248 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.353832+0000", 2024-05-08T18:30:31.249 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.341e-05 2024-05-08T18:30:31.249 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.249 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.249 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:31.249 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.353851+0000", 2024-05-08T18:30:31.249 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8343999999999999e-05 2024-05-08T18:30:31.249 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.249 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.249 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:31.249 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.353980+0000", 2024-05-08T18:30:31.249 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012914900000000001 2024-05-08T18:30:31.249 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.249 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.250 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:31.250 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.354123+0000", 2024-05-08T18:30:31.250 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000142912 2024-05-08T18:30:31.250 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.250 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.250 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:31.250 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.354393+0000", 2024-05-08T18:30:31.250 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00027009799999999997 2024-05-08T18:30:31.250 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.250 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.250 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:31.250 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.355769+0000", 2024-05-08T18:30:31.250 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001375839 2024-05-08T18:30:31.251 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.251 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.251 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:31.251 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.356421+0000", 2024-05-08T18:30:31.251 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00065227799999999995 2024-05-08T18:30:31.251 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.251 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.251 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:31.251 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.356592+0000", 2024-05-08T18:30:31.251 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000170586 2024-05-08T18:30:31.251 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.251 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.251 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:31.252 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.356699+0000", 2024-05-08T18:30:31.252 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010774599999999999 2024-05-08T18:30:31.252 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:31.252 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:31.252 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:31.252 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.252 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.252 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:31.252 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.402673+0000", 2024-05-08T18:30:31.252 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 38.762297238999999, 2024-05-08T18:30:31.252 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002928295, 2024-05-08T18:30:31.252 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:31.252 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:31.253 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:31.253 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:31.253 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:31.253 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:31.253 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 870 2024-05-08T18:30:31.253 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.253 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:31.253 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.253 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:31.253 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.402673+0000", 2024-05-08T18:30:31.253 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:31.253 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.253 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.254 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:31.254 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.402673+0000", 2024-05-08T18:30:31.254 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:31.254 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.254 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.254 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:31.254 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.402675+0000", 2024-05-08T18:30:31.254 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0030000000000001e-06 2024-05-08T18:30:31.254 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.254 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.254 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:31.254 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.402685+0000", 2024-05-08T18:30:31.255 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0566e-05 2024-05-08T18:30:31.255 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.255 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.255 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:31.255 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.402714+0000", 2024-05-08T18:30:31.255 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8804999999999999e-05 2024-05-08T18:30:31.255 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.255 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.255 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:31.255 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.402731+0000", 2024-05-08T18:30:31.255 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6731e-05 2024-05-08T18:30:31.256 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.256 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.256 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:31.256 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.402863+0000", 2024-05-08T18:30:31.256 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013194199999999999 2024-05-08T18:30:31.256 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.256 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.256 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:31.256 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.403096+0000", 2024-05-08T18:30:31.256 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023309900000000001 2024-05-08T18:30:31.256 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.256 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.257 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:31.257 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.403553+0000", 2024-05-08T18:30:31.257 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00045738700000000002 2024-05-08T18:30:31.257 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.257 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.257 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:31.257 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.404843+0000", 2024-05-08T18:30:31.257 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012894650000000001 2024-05-08T18:30:31.257 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.257 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.257 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:31.257 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.405348+0000", 2024-05-08T18:30:31.257 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00050483600000000004 2024-05-08T18:30:31.258 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.258 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.258 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:31.258 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.405491+0000", 2024-05-08T18:30:31.258 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014349299999999999 2024-05-08T18:30:31.258 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.258 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.258 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:31.258 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.405601+0000", 2024-05-08T18:30:31.258 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000109968 2024-05-08T18:30:31.258 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:31.258 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:31.258 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:31.259 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.259 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.259 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:31.259 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.484247+0000", 2024-05-08T18:30:31.259 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 38.680723039, 2024-05-08T18:30:31.259 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028903679999999999, 2024-05-08T18:30:31.259 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:31.259 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:31.259 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:31.259 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:31.259 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:31.259 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:31.259 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 907 2024-05-08T18:30:31.259 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.259 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:31.260 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.260 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:31.260 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.484247+0000", 2024-05-08T18:30:31.260 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:31.260 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.260 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.260 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:31.260 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.484247+0000", 2024-05-08T18:30:31.260 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:31.260 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.260 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.260 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:31.261 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.484250+0000", 2024-05-08T18:30:31.261 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6900000000000001e-06 2024-05-08T18:30:31.261 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.261 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.261 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:31.261 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.484263+0000", 2024-05-08T18:30:31.261 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2967e-05 2024-05-08T18:30:31.261 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.261 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.261 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:31.261 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.484294+0000", 2024-05-08T18:30:31.261 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1016000000000003e-05 2024-05-08T18:30:31.262 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.262 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.262 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:31.262 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.484309+0000", 2024-05-08T18:30:31.262 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5187e-05 2024-05-08T18:30:31.262 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.262 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.262 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:31.262 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.484467+0000", 2024-05-08T18:30:31.262 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015810499999999999 2024-05-08T18:30:31.262 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.263 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.263 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:31.263 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.484698+0000", 2024-05-08T18:30:31.263 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000230852 2024-05-08T18:30:31.263 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.263 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.263 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:31.263 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.485026+0000", 2024-05-08T18:30:31.263 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00032833 2024-05-08T18:30:31.263 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.263 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.263 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:31.263 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.486177+0000", 2024-05-08T18:30:31.263 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0011504309999999999 2024-05-08T18:30:31.264 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.264 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.264 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:31.264 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.486978+0000", 2024-05-08T18:30:31.264 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000801161 2024-05-08T18:30:31.264 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.264 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.264 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:31.264 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.487068+0000", 2024-05-08T18:30:31.264 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0435999999999999e-05 2024-05-08T18:30:31.264 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.264 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.265 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:31.265 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.487137+0000", 2024-05-08T18:30:31.265 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9193e-05 2024-05-08T18:30:31.265 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:31.265 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:31.265 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:31.265 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.265 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.265 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:31.265 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.585363+0000", 2024-05-08T18:30:31.265 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 38.579607195999998, 2024-05-08T18:30:31.265 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028400080000000002, 2024-05-08T18:30:31.265 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:31.266 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:31.266 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:31.266 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:31.266 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:31.266 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:31.266 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 949 2024-05-08T18:30:31.266 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.266 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:31.266 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.266 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:31.266 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.585363+0000", 2024-05-08T18:30:31.267 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:31.267 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.267 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.267 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:31.267 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.585363+0000", 2024-05-08T18:30:31.267 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:31.267 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.267 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.267 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:31.267 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.585366+0000", 2024-05-08T18:30:31.267 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7099999999999999e-06 2024-05-08T18:30:31.267 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.268 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.268 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:31.268 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.585378+0000", 2024-05-08T18:30:31.268 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1970000000000001e-05 2024-05-08T18:30:31.268 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.268 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.268 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:31.268 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.585408+0000", 2024-05-08T18:30:31.268 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0389999999999999e-05 2024-05-08T18:30:31.268 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.268 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.268 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:31.269 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.585423+0000", 2024-05-08T18:30:31.269 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4929999999999999e-05 2024-05-08T18:30:31.269 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.269 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.269 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:31.269 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.585559+0000", 2024-05-08T18:30:31.269 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013563599999999999 2024-05-08T18:30:31.269 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.269 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.269 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:31.269 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.585780+0000", 2024-05-08T18:30:31.269 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000221828 2024-05-08T18:30:31.269 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.269 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.270 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:31.270 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.586121+0000", 2024-05-08T18:30:31.270 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000340181 2024-05-08T18:30:31.270 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.270 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.270 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:31.270 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.587268+0000", 2024-05-08T18:30:31.270 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001146984 2024-05-08T18:30:31.270 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.270 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.270 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:31.270 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.588047+0000", 2024-05-08T18:30:31.270 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000779877 2024-05-08T18:30:31.271 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.271 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.271 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:31.271 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.588136+0000", 2024-05-08T18:30:31.271 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8483e-05 2024-05-08T18:30:31.271 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.271 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.271 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:31.271 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.588203+0000", 2024-05-08T18:30:31.271 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7019000000000003e-05 2024-05-08T18:30:31.271 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:31.271 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:31.272 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:31.272 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.272 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.272 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:951 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:31.272 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.589044+0000", 2024-05-08T18:30:31.272 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 38.575925773999998, 2024-05-08T18:30:31.272 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002802672, 2024-05-08T18:30:31.272 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:31.272 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:31.272 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:31.272 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:31.272 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:31.272 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:31.273 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 951 2024-05-08T18:30:31.273 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.273 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:31.273 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.273 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:31.273 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.589044+0000", 2024-05-08T18:30:31.273 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:31.273 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.273 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.273 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:31.273 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.589044+0000", 2024-05-08T18:30:31.273 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:31.273 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.274 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.274 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:31.274 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.589046+0000", 2024-05-08T18:30:31.274 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6670000000000001e-06 2024-05-08T18:30:31.274 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.274 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.274 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:31.274 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.589054+0000", 2024-05-08T18:30:31.274 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.2600000000000005e-06 2024-05-08T18:30:31.274 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.274 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.274 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:31.274 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.589076+0000", 2024-05-08T18:30:31.275 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1373e-05 2024-05-08T18:30:31.275 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.275 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.275 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:31.275 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.589088+0000", 2024-05-08T18:30:31.275 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2768999999999999e-05 2024-05-08T18:30:31.275 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.275 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.275 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:31.275 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.589220+0000", 2024-05-08T18:30:31.275 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013146300000000001 2024-05-08T18:30:31.275 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.275 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.275 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:31.276 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.589462+0000", 2024-05-08T18:30:31.276 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024250500000000001 2024-05-08T18:30:31.276 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.276 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.276 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:31.276 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.589956+0000", 2024-05-08T18:30:31.276 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00049331600000000005 2024-05-08T18:30:31.276 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.276 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.276 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:31.276 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.591337+0000", 2024-05-08T18:30:31.276 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0013816290000000001 2024-05-08T18:30:31.276 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.277 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.277 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:31.277 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.591688+0000", 2024-05-08T18:30:31.277 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00035083400000000001 2024-05-08T18:30:31.277 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.277 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.277 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:31.277 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.591780+0000", 2024-05-08T18:30:31.277 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.2312999999999995e-05 2024-05-08T18:30:31.277 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.277 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.277 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:31.277 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.591847+0000", 2024-05-08T18:30:31.278 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6543000000000003e-05 2024-05-08T18:30:31.278 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:31.278 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:31.278 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:31.278 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.278 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.278 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:31.278 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.599312+0000", 2024-05-08T18:30:31.278 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 38.565658310000003, 2024-05-08T18:30:31.278 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0027928190000000002, 2024-05-08T18:30:31.278 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:31.278 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:31.278 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:31.279 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:31.279 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:31.279 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:31.279 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 955 2024-05-08T18:30:31.279 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.279 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:31.279 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.279 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:31.279 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.599312+0000", 2024-05-08T18:30:31.279 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:31.279 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.279 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.279 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:31.279 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.599312+0000", 2024-05-08T18:30:31.280 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:31.280 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.280 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.280 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:31.280 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.599314+0000", 2024-05-08T18:30:31.280 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.396e-06 2024-05-08T18:30:31.280 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.280 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.280 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:31.280 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.599325+0000", 2024-05-08T18:30:31.280 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1063999999999999e-05 2024-05-08T18:30:31.280 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.280 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.281 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:31.281 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.599354+0000", 2024-05-08T18:30:31.281 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8462999999999998e-05 2024-05-08T18:30:31.281 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.281 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.281 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:31.281 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.599369+0000", 2024-05-08T18:30:31.281 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4963000000000001e-05 2024-05-08T18:30:31.281 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.281 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.281 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:31.281 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.599503+0000", 2024-05-08T18:30:31.281 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013385299999999999 2024-05-08T18:30:31.282 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.282 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.282 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:31.282 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.599744+0000", 2024-05-08T18:30:31.282 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024137400000000001 2024-05-08T18:30:31.282 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.282 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.282 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:31.282 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.600084+0000", 2024-05-08T18:30:31.282 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00033999399999999998 2024-05-08T18:30:31.282 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.282 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.282 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:31.283 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.601319+0000", 2024-05-08T18:30:31.283 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012348140000000001 2024-05-08T18:30:31.283 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.283 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.283 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:31.283 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.601956+0000", 2024-05-08T18:30:31.283 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00063721199999999996 2024-05-08T18:30:31.283 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.283 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.283 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:31.283 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.602038+0000", 2024-05-08T18:30:31.283 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.1705999999999993e-05 2024-05-08T18:30:31.283 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.283 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.283 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:31.283 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.602105+0000", 2024-05-08T18:30:31.284 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6979999999999999e-05 2024-05-08T18:30:31.284 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:31.284 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:31.284 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:31.284 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:31.284 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:31.284 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:30:31.286 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-08T18:30:31.286 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:30:31.283+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:30:31.386 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:30:31.388+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:30:31.456 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:30:31.456 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:30:31.456 INFO:teuthology.orchestra.run.smithi097.stdout: "num_ops": 0 2024-05-08T18:30:31.457 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:30:31.471 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-08T18:30:31.514 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:30:31.516+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:30:31.589 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:30:31.588+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:30:31.639 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:30:31.639 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:30:31.639 INFO:teuthology.orchestra.run.smithi097.stdout: "complaint_time": 30, 2024-05-08T18:30:31.639 INFO:teuthology.orchestra.run.smithi097.stdout: "num_blocked_ops": 0 2024-05-08T18:30:31.639 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:30:31.653 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-08T18:30:31.694 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:30:31.696+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:30:31.790 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:30:31.787+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:30:31.821 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:30:31.821 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2024-05-08T18:30:31.821 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2024-05-08T18:30:31.821 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-05-08T18:30:31.821 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.821 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:57 7.3 7:c609908c:::notify.5:head [watch watch cookie 94069412621696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:30:31.822 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:48.668590+0000", 2024-05-08T18:30:31.822 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 43.151457100000002, 2024-05-08T18:30:31.822 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0054375830000000002, 2024-05-08T18:30:31.822 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:31.822 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:31.822 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:31.822 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:31.822 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:31.822 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:31.822 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 57 2024-05-08T18:30:31.822 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.822 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:31.822 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.823 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:31.823 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668590+0000", 2024-05-08T18:30:31.823 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:31.823 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.823 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.823 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:31.823 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668590+0000", 2024-05-08T18:30:31.823 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:31.823 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.823 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.823 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:31.823 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668592+0000", 2024-05-08T18:30:31.823 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0930000000000001e-06 2024-05-08T18:30:31.824 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.824 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.824 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:31.824 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668619+0000", 2024-05-08T18:30:31.824 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7396999999999999e-05 2024-05-08T18:30:31.824 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.824 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.824 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:31.824 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668650+0000", 2024-05-08T18:30:31.824 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0620000000000002e-05 2024-05-08T18:30:31.824 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.825 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.825 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:31.825 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668672+0000", 2024-05-08T18:30:31.825 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2093e-05 2024-05-08T18:30:31.825 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.825 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.825 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:31.825 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668782+0000", 2024-05-08T18:30:31.825 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011010600000000001 2024-05-08T18:30:31.825 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.825 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.825 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:31.825 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668934+0000", 2024-05-08T18:30:31.826 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000152268 2024-05-08T18:30:31.826 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.826 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.826 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-05-08T18:30:31.826 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669177+0000", 2024-05-08T18:30:31.826 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024286500000000001 2024-05-08T18:30:31.826 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.826 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.826 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:31.826 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.670404+0000", 2024-05-08T18:30:31.826 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001226932 2024-05-08T18:30:31.826 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.826 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.827 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:31.827 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.673822+0000", 2024-05-08T18:30:31.827 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003417776 2024-05-08T18:30:31.827 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.827 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.827 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:31.827 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.673924+0000", 2024-05-08T18:30:31.827 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000102379 2024-05-08T18:30:31.827 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.827 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.827 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:31.827 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674027+0000", 2024-05-08T18:30:31.827 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010305400000000001 2024-05-08T18:30:31.828 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:31.828 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:31.828 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:31.828 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.828 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.828 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:58 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:30:31.828 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:48.668750+0000", 2024-05-08T18:30:31.828 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 43.151296674000001, 2024-05-08T18:30:31.828 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0057687559999999999, 2024-05-08T18:30:31.828 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:31.828 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:31.828 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:31.828 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:31.828 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:31.829 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:31.829 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 58 2024-05-08T18:30:31.829 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.829 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:31.829 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.829 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:31.829 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668750+0000", 2024-05-08T18:30:31.829 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:31.829 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.829 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.829 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:31.829 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668750+0000", 2024-05-08T18:30:31.829 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:31.829 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.829 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.829 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:31.830 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668752+0000", 2024-05-08T18:30:31.830 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.64e-06 2024-05-08T18:30:31.830 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.830 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.830 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:31.830 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668760+0000", 2024-05-08T18:30:31.830 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5529999999999993e-06 2024-05-08T18:30:31.830 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.830 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.830 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:31.830 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668787+0000", 2024-05-08T18:30:31.830 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6475999999999999e-05 2024-05-08T18:30:31.830 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.830 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.830 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:31.831 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668804+0000", 2024-05-08T18:30:31.831 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7163000000000002e-05 2024-05-08T18:30:31.831 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.831 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.831 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:31.831 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668906+0000", 2024-05-08T18:30:31.831 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010241 2024-05-08T18:30:31.831 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.831 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.831 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:31.831 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669068+0000", 2024-05-08T18:30:31.831 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016144400000000001 2024-05-08T18:30:31.832 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.832 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.832 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-05-08T18:30:31.832 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669226+0000", 2024-05-08T18:30:31.832 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000158639 2024-05-08T18:30:31.832 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.832 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.832 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:31.832 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.670439+0000", 2024-05-08T18:30:31.832 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012124480000000001 2024-05-08T18:30:31.833 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.833 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.833 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:31.833 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674406+0000", 2024-05-08T18:30:31.833 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0039675259999999999 2024-05-08T18:30:31.833 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.833 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.833 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:31.833 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674469+0000", 2024-05-08T18:30:31.834 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.2903000000000004e-05 2024-05-08T18:30:31.834 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.834 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.834 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:31.834 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674519+0000", 2024-05-08T18:30:31.834 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9554e-05 2024-05-08T18:30:31.834 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:31.834 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:31.834 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:31.834 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.834 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.835 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:30:31.835 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.675404+0000", 2024-05-08T18:30:31.835 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 40.144642902999998, 2024-05-08T18:30:31.835 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003903147, 2024-05-08T18:30:31.835 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:31.835 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:31.835 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:31.835 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:31.835 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:31.835 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:31.835 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 207 2024-05-08T18:30:31.836 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.836 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:31.836 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.836 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:31.836 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675404+0000", 2024-05-08T18:30:31.836 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:31.836 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.836 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.836 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:31.836 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675404+0000", 2024-05-08T18:30:31.836 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:31.836 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.836 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.836 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:31.837 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675407+0000", 2024-05-08T18:30:31.837 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1729999999999999e-06 2024-05-08T18:30:31.837 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.837 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.837 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:31.837 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675422+0000", 2024-05-08T18:30:31.837 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.485e-05 2024-05-08T18:30:31.837 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.837 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.837 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:31.837 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675454+0000", 2024-05-08T18:30:31.837 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1656000000000003e-05 2024-05-08T18:30:31.837 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.837 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.838 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:31.838 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675470+0000", 2024-05-08T18:30:31.838 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.626e-05 2024-05-08T18:30:31.838 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.838 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.838 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:31.838 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675683+0000", 2024-05-08T18:30:31.838 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021312600000000001 2024-05-08T18:30:31.838 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.838 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.838 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:31.838 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675972+0000", 2024-05-08T18:30:31.838 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00028885100000000002 2024-05-08T18:30:31.839 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.839 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.839 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:30:31.840 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.676369+0000", 2024-05-08T18:30:31.840 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000397227 2024-05-08T18:30:31.840 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.840 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.840 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:31.840 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.677780+0000", 2024-05-08T18:30:31.840 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001411186 2024-05-08T18:30:31.840 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.840 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.840 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:31.840 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679153+0000", 2024-05-08T18:30:31.840 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0013725720000000001 2024-05-08T18:30:31.840 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.840 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.841 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:31.841 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679240+0000", 2024-05-08T18:30:31.841 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7412999999999998e-05 2024-05-08T18:30:31.841 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.841 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.841 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:31.841 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679307+0000", 2024-05-08T18:30:31.841 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6833000000000002e-05 2024-05-08T18:30:31.841 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:31.841 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:31.841 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:31.841 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.841 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.842 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:31.842 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.721317+0000", 2024-05-08T18:30:31.842 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 40.098730156999999, 2024-05-08T18:30:31.842 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032842140000000001, 2024-05-08T18:30:31.842 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:31.842 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:31.842 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:31.842 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:31.842 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:31.842 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:31.842 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 216 2024-05-08T18:30:31.842 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.842 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:31.842 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.843 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:31.843 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.721317+0000", 2024-05-08T18:30:31.843 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:31.843 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.843 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.843 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:31.843 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.721317+0000", 2024-05-08T18:30:31.843 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:31.843 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.843 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.843 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:31.843 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.721320+0000", 2024-05-08T18:30:31.843 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.303e-06 2024-05-08T18:30:31.844 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.844 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.844 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:31.844 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.721335+0000", 2024-05-08T18:30:31.844 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4543e-05 2024-05-08T18:30:31.844 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.844 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.844 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:31.844 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.721370+0000", 2024-05-08T18:30:31.844 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5336000000000002e-05 2024-05-08T18:30:31.844 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.844 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.844 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:31.844 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.721393+0000", 2024-05-08T18:30:31.844 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2710000000000001e-05 2024-05-08T18:30:31.845 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.845 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.845 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:31.845 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.721592+0000", 2024-05-08T18:30:31.845 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00019917900000000001 2024-05-08T18:30:31.845 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.845 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.845 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:31.845 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.721815+0000", 2024-05-08T18:30:31.845 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000223742 2024-05-08T18:30:31.845 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.845 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.845 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:31.845 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.722268+0000", 2024-05-08T18:30:31.846 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00045295900000000001 2024-05-08T18:30:31.846 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.846 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.846 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:31.846 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.723878+0000", 2024-05-08T18:30:31.846 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001609828 2024-05-08T18:30:31.846 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.846 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.846 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:31.846 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.724433+0000", 2024-05-08T18:30:31.846 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00055512499999999995 2024-05-08T18:30:31.846 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.846 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.846 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:31.847 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.724528+0000", 2024-05-08T18:30:31.847 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.4887000000000001e-05 2024-05-08T18:30:31.847 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.847 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.847 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:31.847 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.724601+0000", 2024-05-08T18:30:31.847 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2601999999999994e-05 2024-05-08T18:30:31.847 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:31.847 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:31.847 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:31.847 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.847 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.847 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:31.847 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.761586+0000", 2024-05-08T18:30:31.848 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 40.058461311000002, 2024-05-08T18:30:31.848 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031756979999999998, 2024-05-08T18:30:31.848 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:31.848 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:31.848 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:31.848 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:31.848 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:31.848 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:31.848 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 227 2024-05-08T18:30:31.848 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.848 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:31.848 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.849 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:31.849 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.761586+0000", 2024-05-08T18:30:31.849 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:31.849 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.849 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.849 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:31.849 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.761586+0000", 2024-05-08T18:30:31.849 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:31.849 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.849 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.849 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:31.849 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.761588+0000", 2024-05-08T18:30:31.849 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7499999999999999e-06 2024-05-08T18:30:31.850 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.850 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.850 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:31.850 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.761600+0000", 2024-05-08T18:30:31.850 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2003e-05 2024-05-08T18:30:31.850 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.850 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.850 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:31.850 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.761632+0000", 2024-05-08T18:30:31.850 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1933000000000001e-05 2024-05-08T18:30:31.850 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.850 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.850 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:31.850 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.761648+0000", 2024-05-08T18:30:31.851 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5339999999999999e-05 2024-05-08T18:30:31.851 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.851 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.851 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:31.851 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.761773+0000", 2024-05-08T18:30:31.851 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012576199999999999 2024-05-08T18:30:31.851 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.851 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.851 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:31.851 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.762037+0000", 2024-05-08T18:30:31.851 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00026385100000000001 2024-05-08T18:30:31.851 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.852 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.852 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:31.852 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.762455+0000", 2024-05-08T18:30:31.852 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00041760700000000002 2024-05-08T18:30:31.852 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.852 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.852 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:31.852 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.764035+0000", 2024-05-08T18:30:31.852 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001580318 2024-05-08T18:30:31.852 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.852 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.852 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:31.852 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.764602+0000", 2024-05-08T18:30:31.852 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00056661899999999998 2024-05-08T18:30:31.853 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.853 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.853 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:31.853 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.764685+0000", 2024-05-08T18:30:31.853 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.3562999999999999e-05 2024-05-08T18:30:31.853 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.853 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.853 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:31.853 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.764761+0000", 2024-05-08T18:30:31.853 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.5951999999999994e-05 2024-05-08T18:30:31.853 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:31.853 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:31.853 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:31.853 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.853 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.854 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:31.854 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.768858+0000", 2024-05-08T18:30:31.854 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 40.051188728, 2024-05-08T18:30:31.854 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031906619999999999, 2024-05-08T18:30:31.854 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:31.854 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:31.854 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:31.854 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:31.854 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:31.854 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:31.855 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 229 2024-05-08T18:30:31.855 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.855 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:31.855 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.855 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:31.855 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.768858+0000", 2024-05-08T18:30:31.855 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:31.855 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.855 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.855 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:31.855 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.768858+0000", 2024-05-08T18:30:31.855 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:31.855 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.856 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.856 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:31.856 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.768861+0000", 2024-05-08T18:30:31.856 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5469999999999999e-06 2024-05-08T18:30:31.856 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.856 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.856 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:31.856 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.768872+0000", 2024-05-08T18:30:31.856 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1712999999999999e-05 2024-05-08T18:30:31.856 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.856 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.856 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:31.856 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.768903+0000", 2024-05-08T18:30:31.857 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0636000000000003e-05 2024-05-08T18:30:31.857 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.857 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.857 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:31.857 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.768918+0000", 2024-05-08T18:30:31.857 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4977000000000001e-05 2024-05-08T18:30:31.857 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.857 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.857 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:31.857 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.769037+0000", 2024-05-08T18:30:31.857 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011918599999999999 2024-05-08T18:30:31.857 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.857 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.857 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:31.857 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.769256+0000", 2024-05-08T18:30:31.857 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021839400000000001 2024-05-08T18:30:31.858 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.858 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.858 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:30:31.858 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.769656+0000", 2024-05-08T18:30:31.858 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00040066400000000001 2024-05-08T18:30:31.858 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.858 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.858 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:31.858 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.771116+0000", 2024-05-08T18:30:31.858 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001459389 2024-05-08T18:30:31.858 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.858 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.858 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:31.859 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.771896+0000", 2024-05-08T18:30:31.859 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00077997400000000001 2024-05-08T18:30:31.859 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.859 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.859 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:31.859 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.771984+0000", 2024-05-08T18:30:31.859 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8483e-05 2024-05-08T18:30:31.859 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.859 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.859 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:31.859 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772049+0000", 2024-05-08T18:30:31.859 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.4698999999999998e-05 2024-05-08T18:30:31.859 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:31.859 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:31.859 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:31.860 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.860 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.860 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:31.860 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.776086+0000", 2024-05-08T18:30:31.860 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 40.043960736999999, 2024-05-08T18:30:31.860 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0037528710000000001, 2024-05-08T18:30:31.860 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:31.860 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:31.860 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:31.860 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:31.860 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:31.860 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:31.860 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 231 2024-05-08T18:30:31.860 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.860 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:31.861 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.861 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:31.861 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.776086+0000", 2024-05-08T18:30:31.861 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:31.861 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.861 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.861 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:31.861 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.776086+0000", 2024-05-08T18:30:31.861 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:31.861 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.861 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.861 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:31.861 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.776089+0000", 2024-05-08T18:30:31.862 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8870000000000001e-06 2024-05-08T18:30:31.862 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.862 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.862 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:31.862 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.776102+0000", 2024-05-08T18:30:31.862 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.294e-05 2024-05-08T18:30:31.862 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.862 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.862 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:31.862 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.776132+0000", 2024-05-08T18:30:31.862 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0113000000000001e-05 2024-05-08T18:30:31.862 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.862 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.863 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:31.863 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.776150+0000", 2024-05-08T18:30:31.863 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8216999999999999e-05 2024-05-08T18:30:31.863 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.863 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.863 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:31.863 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.776268+0000", 2024-05-08T18:30:31.863 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000117395 2024-05-08T18:30:31.863 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.863 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.863 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:31.863 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.776514+0000", 2024-05-08T18:30:31.863 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024602899999999999 2024-05-08T18:30:31.863 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.864 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.864 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:31.864 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.776920+0000", 2024-05-08T18:30:31.864 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000406723 2024-05-08T18:30:31.864 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.864 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.864 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:31.864 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.778360+0000", 2024-05-08T18:30:31.864 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0014393279999999999 2024-05-08T18:30:31.864 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.864 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.864 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:31.864 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.779687+0000", 2024-05-08T18:30:31.865 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001327674 2024-05-08T18:30:31.865 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.865 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.865 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:31.865 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.779777+0000", 2024-05-08T18:30:31.865 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9152000000000003e-05 2024-05-08T18:30:31.865 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.865 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.865 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:31.865 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.779839+0000", 2024-05-08T18:30:31.865 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.2413e-05 2024-05-08T18:30:31.865 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:31.865 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:31.865 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:31.865 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.866 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.866 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:257 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:31.866 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.802295+0000", 2024-05-08T18:30:31.866 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 40.017751597, 2024-05-08T18:30:31.866 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0030517880000000002, 2024-05-08T18:30:31.866 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:31.866 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:31.866 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:31.866 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:31.866 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:31.867 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:31.867 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 257 2024-05-08T18:30:31.867 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.867 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:31.867 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.867 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:31.867 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.802295+0000", 2024-05-08T18:30:31.867 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:31.867 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.867 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.867 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:31.867 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.802295+0000", 2024-05-08T18:30:31.868 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:31.868 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.868 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.868 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:31.868 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.802296+0000", 2024-05-08T18:30:31.868 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.6700000000000002e-07 2024-05-08T18:30:31.868 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.868 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.868 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:31.868 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.802301+0000", 2024-05-08T18:30:31.868 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.0250000000000002e-06 2024-05-08T18:30:31.868 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.868 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.868 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:31.869 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.802321+0000", 2024-05-08T18:30:31.869 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9521000000000002e-05 2024-05-08T18:30:31.869 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.869 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.869 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:31.869 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.802330+0000", 2024-05-08T18:30:31.869 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.4259999999999992e-06 2024-05-08T18:30:31.869 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.869 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.869 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:31.869 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.802386+0000", 2024-05-08T18:30:31.869 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5974999999999999e-05 2024-05-08T18:30:31.869 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.869 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.870 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:31.870 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.802463+0000", 2024-05-08T18:30:31.870 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6582999999999995e-05 2024-05-08T18:30:31.870 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.870 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.870 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:31.870 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.802613+0000", 2024-05-08T18:30:31.870 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000150715 2024-05-08T18:30:31.870 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.870 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.870 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:31.870 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.803223+0000", 2024-05-08T18:30:31.871 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00060949799999999998 2024-05-08T18:30:31.871 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.871 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.871 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:31.871 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.805250+0000", 2024-05-08T18:30:31.871 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0020268339999999999 2024-05-08T18:30:31.871 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.871 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.871 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:31.871 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.805303+0000", 2024-05-08T18:30:31.871 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3562e-05 2024-05-08T18:30:31.871 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.871 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.871 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:31.872 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.805347+0000", 2024-05-08T18:30:31.872 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3682e-05 2024-05-08T18:30:31.872 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:31.872 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:31.872 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:31.872 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.872 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.872 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:422 6.c 6:338eb7e9:::obj_delete_at_hint.0000000008:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:31.872 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.847436+0000", 2024-05-08T18:30:31.872 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 39.972610533999998, 2024-05-08T18:30:31.872 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0029413439999999998, 2024-05-08T18:30:31.872 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:31.872 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:31.872 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:31.873 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:31.873 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:31.873 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:31.873 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 422 2024-05-08T18:30:31.873 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.873 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:31.873 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.873 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:31.873 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847436+0000", 2024-05-08T18:30:31.873 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:31.873 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.873 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.873 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:31.873 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847436+0000", 2024-05-08T18:30:31.873 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:31.874 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.874 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.874 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:31.874 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847437+0000", 2024-05-08T18:30:31.874 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.009e-06 2024-05-08T18:30:31.874 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.874 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.874 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:31.874 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847442+0000", 2024-05-08T18:30:31.874 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9049999999999996e-06 2024-05-08T18:30:31.874 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.874 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.874 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:31.874 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847454+0000", 2024-05-08T18:30:31.875 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1358e-05 2024-05-08T18:30:31.875 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.875 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.875 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:31.875 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847459+0000", 2024-05-08T18:30:31.875 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7180000000000001e-06 2024-05-08T18:30:31.875 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.875 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.875 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:31.875 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847516+0000", 2024-05-08T18:30:31.875 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6558999999999998e-05 2024-05-08T18:30:31.875 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.875 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.875 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:31.876 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847582+0000", 2024-05-08T18:30:31.876 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5772000000000007e-05 2024-05-08T18:30:31.876 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.876 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.876 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:31.876 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847718+0000", 2024-05-08T18:30:31.876 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013664100000000001 2024-05-08T18:30:31.876 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.876 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.876 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:31.876 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.848257+0000", 2024-05-08T18:30:31.876 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00053853699999999996 2024-05-08T18:30:31.876 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.876 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.876 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:31.876 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.850320+0000", 2024-05-08T18:30:31.877 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0020627530000000001 2024-05-08T18:30:31.877 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.877 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.877 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:31.877 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.850351+0000", 2024-05-08T18:30:31.877 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1501000000000002e-05 2024-05-08T18:30:31.877 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.877 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.877 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:31.877 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.850378+0000", 2024-05-08T18:30:31.877 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6591e-05 2024-05-08T18:30:31.877 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:31.877 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:31.877 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:31.877 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.877 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.878 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:535 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:31.878 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.912581+0000", 2024-05-08T18:30:31.878 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 39.907465473999999, 2024-05-08T18:30:31.878 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002943775, 2024-05-08T18:30:31.878 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:31.878 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:31.878 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:31.878 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:31.878 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:31.878 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:31.878 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 535 2024-05-08T18:30:31.878 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.878 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:31.878 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.879 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:31.879 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912581+0000", 2024-05-08T18:30:31.879 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:31.879 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.879 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.879 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:31.879 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912581+0000", 2024-05-08T18:30:31.879 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:31.879 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.879 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.879 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:31.879 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912582+0000", 2024-05-08T18:30:31.879 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.093e-06 2024-05-08T18:30:31.879 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.879 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.880 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:31.880 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912588+0000", 2024-05-08T18:30:31.880 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3920000000000002e-06 2024-05-08T18:30:31.880 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.880 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.880 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:31.880 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912601+0000", 2024-05-08T18:30:31.880 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2911000000000001e-05 2024-05-08T18:30:31.880 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.880 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.880 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:31.880 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912607+0000", 2024-05-08T18:30:31.880 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3960000000000003e-06 2024-05-08T18:30:31.881 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.881 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.881 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:31.881 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912664+0000", 2024-05-08T18:30:31.881 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6410999999999999e-05 2024-05-08T18:30:31.881 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.881 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.881 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:31.881 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912721+0000", 2024-05-08T18:30:31.881 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7141000000000001e-05 2024-05-08T18:30:31.881 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.881 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.881 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:31.881 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912842+0000", 2024-05-08T18:30:31.882 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000120868 2024-05-08T18:30:31.882 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.882 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.882 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:31.882 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.913333+0000", 2024-05-08T18:30:31.882 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00049123600000000004 2024-05-08T18:30:31.882 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.882 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.882 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:31.882 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.915446+0000", 2024-05-08T18:30:31.882 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0021135020000000002 2024-05-08T18:30:31.882 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.882 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.882 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:31.883 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.915481+0000", 2024-05-08T18:30:31.883 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4304999999999998e-05 2024-05-08T18:30:31.883 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.883 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.883 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:31.883 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.915525+0000", 2024-05-08T18:30:31.883 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4520000000000001e-05 2024-05-08T18:30:31.883 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:31.883 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:31.883 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:31.883 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.883 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.883 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:541 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:31.884 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.916718+0000", 2024-05-08T18:30:31.884 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 39.903328639000001, 2024-05-08T18:30:31.884 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0041779829999999997, 2024-05-08T18:30:31.884 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:31.884 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:31.884 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:31.884 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:31.884 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:31.884 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:31.884 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 541 2024-05-08T18:30:31.884 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.884 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:31.884 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.884 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:31.884 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.916718+0000", 2024-05-08T18:30:31.885 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:31.885 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.885 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.885 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:31.885 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.916718+0000", 2024-05-08T18:30:31.885 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:31.885 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.885 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.885 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:31.885 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.916719+0000", 2024-05-08T18:30:31.885 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0100000000000005e-07 2024-05-08T18:30:31.885 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.885 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.885 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:31.886 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.916722+0000", 2024-05-08T18:30:31.886 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7760000000000002e-06 2024-05-08T18:30:31.886 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.886 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.886 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:31.886 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.916729+0000", 2024-05-08T18:30:31.886 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.8290000000000008e-06 2024-05-08T18:30:31.886 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.886 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.886 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:31.886 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.916734+0000", 2024-05-08T18:30:31.886 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3109999999999999e-06 2024-05-08T18:30:31.886 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.887 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.887 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:31.887 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.916776+0000", 2024-05-08T18:30:31.887 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.2086999999999999e-05 2024-05-08T18:30:31.887 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.887 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.887 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:31.887 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.916824+0000", 2024-05-08T18:30:31.887 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8412999999999999e-05 2024-05-08T18:30:31.887 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.887 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.887 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:31.887 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.916929+0000", 2024-05-08T18:30:31.887 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010480900000000001 2024-05-08T18:30:31.888 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.888 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.888 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:31.888 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.917428+0000", 2024-05-08T18:30:31.888 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00049889599999999997 2024-05-08T18:30:31.888 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.888 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.888 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:31.888 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.920833+0000", 2024-05-08T18:30:31.888 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0034047140000000001 2024-05-08T18:30:31.888 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.888 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.888 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:31.889 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.920868+0000", 2024-05-08T18:30:31.889 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5750999999999997e-05 2024-05-08T18:30:31.889 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.889 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.889 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:31.889 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.920896+0000", 2024-05-08T18:30:31.889 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7796e-05 2024-05-08T18:30:31.889 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:31.889 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:31.889 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:31.889 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.889 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.889 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:778 6.1b 6:dc490aaa:::obj_delete_at_hint.0000000067:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:31.889 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.191226+0000", 2024-05-08T18:30:31.890 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 39.628820363999999, 2024-05-08T18:30:31.890 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0029603540000000001, 2024-05-08T18:30:31.890 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:31.890 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:31.890 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:31.890 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:31.890 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:31.890 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:31.890 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 778 2024-05-08T18:30:31.890 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.890 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:31.890 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.890 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:31.891 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.191226+0000", 2024-05-08T18:30:31.891 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:31.891 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.891 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.891 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:31.891 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.191226+0000", 2024-05-08T18:30:31.891 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:31.891 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.891 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.891 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:31.891 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.191229+0000", 2024-05-08T18:30:31.891 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5299999999999999e-06 2024-05-08T18:30:31.891 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.891 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.892 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:31.892 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.191242+0000", 2024-05-08T18:30:31.892 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2816999999999999e-05 2024-05-08T18:30:31.892 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.892 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.892 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:31.892 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.191274+0000", 2024-05-08T18:30:31.892 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1846e-05 2024-05-08T18:30:31.892 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.892 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.892 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:31.892 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.191288+0000", 2024-05-08T18:30:31.892 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.468e-05 2024-05-08T18:30:31.893 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.893 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.893 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:31.893 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.191468+0000", 2024-05-08T18:30:31.893 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00017983499999999999 2024-05-08T18:30:31.893 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.893 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.893 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:31.893 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.191688+0000", 2024-05-08T18:30:31.893 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021985799999999999 2024-05-08T18:30:31.893 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.893 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.893 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:30:31.893 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.192001+0000", 2024-05-08T18:30:31.894 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00031337800000000001 2024-05-08T18:30:31.894 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.894 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.894 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:31.894 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.193245+0000", 2024-05-08T18:30:31.894 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012436400000000001 2024-05-08T18:30:31.894 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.894 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.894 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:31.894 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.194036+0000", 2024-05-08T18:30:31.894 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00079059699999999998 2024-05-08T18:30:31.894 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.894 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.894 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:31.895 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.194121+0000", 2024-05-08T18:30:31.895 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5270000000000002e-05 2024-05-08T18:30:31.895 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.895 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.895 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:31.895 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.194187+0000", 2024-05-08T18:30:31.895 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5902999999999996e-05 2024-05-08T18:30:31.895 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:31.895 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:31.895 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:31.895 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.895 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.895 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:780 6.1b 6:dc490aaa:::obj_delete_at_hint.0000000067:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:31.896 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.195206+0000", 2024-05-08T18:30:31.896 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 39.624840395, 2024-05-08T18:30:31.896 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00291544, 2024-05-08T18:30:31.896 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:31.896 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:31.896 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:31.896 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:31.896 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:31.896 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:31.896 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 780 2024-05-08T18:30:31.896 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.896 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:31.896 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.896 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:31.897 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.195206+0000", 2024-05-08T18:30:31.897 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:31.897 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.897 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.897 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:31.897 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.195206+0000", 2024-05-08T18:30:31.897 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:31.897 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.897 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.897 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:31.897 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.195208+0000", 2024-05-08T18:30:31.897 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0669999999999999e-06 2024-05-08T18:30:31.897 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.897 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.898 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:31.898 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.195220+0000", 2024-05-08T18:30:31.898 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.131e-05 2024-05-08T18:30:31.898 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.898 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.898 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:31.898 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.195250+0000", 2024-05-08T18:30:31.898 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0562999999999999e-05 2024-05-08T18:30:31.898 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.898 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.898 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:31.898 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.195270+0000", 2024-05-08T18:30:31.899 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9989000000000001e-05 2024-05-08T18:30:31.899 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.899 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.899 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:31.899 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.195395+0000", 2024-05-08T18:30:31.899 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012439600000000001 2024-05-08T18:30:31.899 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.899 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.899 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:31.899 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.195523+0000", 2024-05-08T18:30:31.899 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012824900000000001 2024-05-08T18:30:31.899 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.899 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.899 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:30:31.900 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.195808+0000", 2024-05-08T18:30:31.900 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00028518100000000002 2024-05-08T18:30:31.900 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.900 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.900 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:31.900 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.196897+0000", 2024-05-08T18:30:31.900 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0010887850000000001 2024-05-08T18:30:31.900 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.900 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.900 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:31.900 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.197964+0000", 2024-05-08T18:30:31.900 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0010671789999999999 2024-05-08T18:30:31.900 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.900 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.901 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:31.901 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.198044+0000", 2024-05-08T18:30:31.901 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.9616000000000005e-05 2024-05-08T18:30:31.901 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.901 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.901 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:31.901 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.198122+0000", 2024-05-08T18:30:31.901 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.8104999999999998e-05 2024-05-08T18:30:31.901 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:31.901 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:31.901 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:31.901 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.901 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.902 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:826 6.6 6:64735f45:::obj_delete_at_hint.0000000083:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:31.902 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.299128+0000", 2024-05-08T18:30:31.902 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 39.520919317000001, 2024-05-08T18:30:31.902 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0029196479999999999, 2024-05-08T18:30:31.902 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:31.902 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:31.902 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:31.902 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:31.902 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:31.902 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:31.902 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 826 2024-05-08T18:30:31.902 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.903 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:31.903 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.903 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:31.903 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.299128+0000", 2024-05-08T18:30:31.903 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:31.903 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.903 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.903 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:31.903 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.299128+0000", 2024-05-08T18:30:31.903 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:31.903 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.903 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.903 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:31.903 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.299129+0000", 2024-05-08T18:30:31.903 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.711e-06 2024-05-08T18:30:31.904 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.904 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.904 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:31.904 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.299137+0000", 2024-05-08T18:30:31.904 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6650000000000003e-06 2024-05-08T18:30:31.904 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.904 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.904 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:31.904 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.299157+0000", 2024-05-08T18:30:31.904 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.02e-05 2024-05-08T18:30:31.904 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.904 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.904 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:31.904 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.299166+0000", 2024-05-08T18:30:31.905 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7530000000000007e-06 2024-05-08T18:30:31.905 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.905 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.905 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:31.905 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.299240+0000", 2024-05-08T18:30:31.905 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.4297999999999999e-05 2024-05-08T18:30:31.905 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.905 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.905 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:31.905 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.299444+0000", 2024-05-08T18:30:31.905 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00020382399999999999 2024-05-08T18:30:31.905 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.905 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.905 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:31.905 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.299777+0000", 2024-05-08T18:30:31.906 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00033331700000000002 2024-05-08T18:30:31.906 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.906 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.906 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:31.906 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.301060+0000", 2024-05-08T18:30:31.906 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012829569999999999 2024-05-08T18:30:31.906 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.906 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.906 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:31.906 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.301865+0000", 2024-05-08T18:30:31.906 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00080503400000000004 2024-05-08T18:30:31.906 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.906 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.907 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:31.907 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.301979+0000", 2024-05-08T18:30:31.907 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011324600000000001 2024-05-08T18:30:31.907 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.907 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.907 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:31.907 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.302047+0000", 2024-05-08T18:30:31.907 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8643e-05 2024-05-08T18:30:31.907 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:31.907 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:31.907 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:31.907 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.907 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.908 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:838 6.c 6:330b1641:::obj_delete_at_hint.0000000087:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:31.908 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.328043+0000", 2024-05-08T18:30:31.908 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 39.492004172999998, 2024-05-08T18:30:31.908 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031589180000000001, 2024-05-08T18:30:31.908 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:31.908 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:31.908 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:31.908 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:31.908 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:31.908 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:31.908 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 838 2024-05-08T18:30:31.908 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.908 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:31.908 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.909 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:31.909 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.328043+0000", 2024-05-08T18:30:31.909 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:31.909 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.909 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.909 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:31.909 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.328043+0000", 2024-05-08T18:30:31.909 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:31.909 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.909 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.909 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:31.909 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.328045+0000", 2024-05-08T18:30:31.909 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3760000000000002e-06 2024-05-08T18:30:31.910 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.910 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.910 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:31.910 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.328057+0000", 2024-05-08T18:30:31.910 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1534e-05 2024-05-08T18:30:31.910 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.910 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.910 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:31.910 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.328087+0000", 2024-05-08T18:30:31.910 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0870000000000001e-05 2024-05-08T18:30:31.910 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.910 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.910 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:31.910 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.328102+0000", 2024-05-08T18:30:31.911 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4679e-05 2024-05-08T18:30:31.911 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.911 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.911 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:31.911 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.328217+0000", 2024-05-08T18:30:31.911 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011519300000000001 2024-05-08T18:30:31.911 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.911 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.911 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:31.911 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.328446+0000", 2024-05-08T18:30:31.911 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00022893499999999999 2024-05-08T18:30:31.911 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.911 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.911 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:31.912 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.328770+0000", 2024-05-08T18:30:31.912 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00032349700000000001 2024-05-08T18:30:31.912 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.912 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.912 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:31.912 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.330008+0000", 2024-05-08T18:30:31.912 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001238404 2024-05-08T18:30:31.912 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.912 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.912 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:31.912 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.331026+0000", 2024-05-08T18:30:31.912 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001017612 2024-05-08T18:30:31.912 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.913 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.913 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:31.913 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.331117+0000", 2024-05-08T18:30:31.913 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0932000000000003e-05 2024-05-08T18:30:31.913 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.913 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.913 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:31.913 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.331202+0000", 2024-05-08T18:30:31.913 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.4886e-05 2024-05-08T18:30:31.913 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:31.913 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:31.913 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:31.913 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.913 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.913 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:850 6.6 6:624175ac:::obj_delete_at_hint.0000000091:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:31.914 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.356951+0000", 2024-05-08T18:30:31.914 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 39.463096086, 2024-05-08T18:30:31.914 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028779000000000001, 2024-05-08T18:30:31.914 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:31.914 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:31.914 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:31.914 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:31.914 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:31.914 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:31.914 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 850 2024-05-08T18:30:31.914 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.914 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:31.914 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.915 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:31.915 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.356951+0000", 2024-05-08T18:30:31.915 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:31.915 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.915 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.915 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:31.915 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.356951+0000", 2024-05-08T18:30:31.915 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:31.915 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.915 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.915 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:31.915 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.356953+0000", 2024-05-08T18:30:31.915 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.446e-06 2024-05-08T18:30:31.916 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.916 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.916 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:31.916 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.356965+0000", 2024-05-08T18:30:31.916 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1404e-05 2024-05-08T18:30:31.916 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.916 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.916 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:31.916 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.356994+0000", 2024-05-08T18:30:31.916 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9526000000000002e-05 2024-05-08T18:30:31.916 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.916 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.916 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:31.916 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.357009+0000", 2024-05-08T18:30:31.917 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5126000000000001e-05 2024-05-08T18:30:31.917 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.917 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.917 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:31.917 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.357126+0000", 2024-05-08T18:30:31.917 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000116989 2024-05-08T18:30:31.917 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.917 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.917 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:31.917 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.357349+0000", 2024-05-08T18:30:31.917 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00022298899999999999 2024-05-08T18:30:31.917 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.917 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.917 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:31.918 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.357665+0000", 2024-05-08T18:30:31.918 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00031592700000000003 2024-05-08T18:30:31.918 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.918 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.918 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:31.918 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.358771+0000", 2024-05-08T18:30:31.918 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001105595 2024-05-08T18:30:31.918 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.918 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.918 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:31.918 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.359672+0000", 2024-05-08T18:30:31.918 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00090080300000000004 2024-05-08T18:30:31.918 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.918 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.919 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:31.919 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.359762+0000", 2024-05-08T18:30:31.919 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0099000000000006e-05 2024-05-08T18:30:31.919 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.919 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.919 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:31.919 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.359829+0000", 2024-05-08T18:30:31.919 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6995999999999993e-05 2024-05-08T18:30:31.919 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:31.919 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:31.919 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:31.919 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.919 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.919 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:852 6.6 6:624175ac:::obj_delete_at_hint.0000000091:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:31.919 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.360655+0000", 2024-05-08T18:30:31.920 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 39.459392219000001, 2024-05-08T18:30:31.920 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028684650000000002, 2024-05-08T18:30:31.920 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:31.920 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:31.920 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:31.920 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:31.920 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:31.920 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:31.920 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 852 2024-05-08T18:30:31.920 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.920 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:31.920 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.920 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:31.920 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.360655+0000", 2024-05-08T18:30:31.921 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:31.921 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.921 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.921 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:31.921 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.360655+0000", 2024-05-08T18:30:31.921 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:31.921 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.921 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.921 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:31.921 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.360656+0000", 2024-05-08T18:30:31.921 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.457e-06 2024-05-08T18:30:31.921 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.921 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.921 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:31.922 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.360663+0000", 2024-05-08T18:30:31.922 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5429999999999999e-06 2024-05-08T18:30:31.922 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.922 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.922 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:31.922 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.360682+0000", 2024-05-08T18:30:31.922 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9020000000000001e-05 2024-05-08T18:30:31.922 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.922 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.922 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:31.922 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.360693+0000", 2024-05-08T18:30:31.922 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.114e-05 2024-05-08T18:30:31.922 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.923 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.923 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:31.923 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.360775+0000", 2024-05-08T18:30:31.923 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.2206000000000005e-05 2024-05-08T18:30:31.923 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.923 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.923 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:31.923 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.360899+0000", 2024-05-08T18:30:31.923 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000124206 2024-05-08T18:30:31.923 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.923 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.923 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:31.923 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.361162+0000", 2024-05-08T18:30:31.923 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00026328400000000002 2024-05-08T18:30:31.924 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.924 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.924 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:31.924 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.362180+0000", 2024-05-08T18:30:31.924 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0010175119999999999 2024-05-08T18:30:31.924 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.924 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.924 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:31.924 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.363368+0000", 2024-05-08T18:30:31.924 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001187991 2024-05-08T18:30:31.924 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.924 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.924 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:31.924 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.363456+0000", 2024-05-08T18:30:31.925 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8016999999999994e-05 2024-05-08T18:30:31.925 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.925 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.925 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:31.925 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.363523+0000", 2024-05-08T18:30:31.925 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7088999999999994e-05 2024-05-08T18:30:31.925 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:31.925 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:31.925 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:31.925 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.925 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.925 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:865 6.c 6:31288c1b:::obj_delete_at_hint.0000000096:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:31.925 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.392164+0000", 2024-05-08T18:30:31.926 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 39.427883117999997, 2024-05-08T18:30:31.926 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0029815470000000002, 2024-05-08T18:30:31.926 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:31.926 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:31.926 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:31.926 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:31.926 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:31.926 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:31.926 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 865 2024-05-08T18:30:31.926 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.926 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:31.926 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.926 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:31.926 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.392164+0000", 2024-05-08T18:30:31.927 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:31.927 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.927 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.927 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:31.927 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.392164+0000", 2024-05-08T18:30:31.927 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:31.927 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.927 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.927 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:31.927 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.392166+0000", 2024-05-08T18:30:31.927 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4059999999999999e-06 2024-05-08T18:30:31.927 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.927 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.927 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:31.928 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.392177+0000", 2024-05-08T18:30:31.928 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1260000000000001e-05 2024-05-08T18:30:31.928 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.928 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.928 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:31.928 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.392208+0000", 2024-05-08T18:30:31.928 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0484000000000002e-05 2024-05-08T18:30:31.928 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.928 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.928 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:31.928 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.392222+0000", 2024-05-08T18:30:31.928 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4343e-05 2024-05-08T18:30:31.928 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.928 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.928 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:31.929 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.392355+0000", 2024-05-08T18:30:31.929 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000132602 2024-05-08T18:30:31.929 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.929 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.929 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:31.929 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.392565+0000", 2024-05-08T18:30:31.929 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000210442 2024-05-08T18:30:31.929 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.929 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.929 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:31.929 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.392874+0000", 2024-05-08T18:30:31.929 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00030868099999999999 2024-05-08T18:30:31.929 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.929 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.929 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:31.930 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.394087+0000", 2024-05-08T18:30:31.930 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012133300000000001 2024-05-08T18:30:31.930 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.930 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.930 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:31.930 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.394976+0000", 2024-05-08T18:30:31.930 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000888977 2024-05-08T18:30:31.930 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.930 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.930 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:31.930 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.395068+0000", 2024-05-08T18:30:31.930 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.2188999999999994e-05 2024-05-08T18:30:31.930 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.931 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.931 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:31.931 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.395145+0000", 2024-05-08T18:30:31.931 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6833000000000001e-05 2024-05-08T18:30:31.931 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:31.931 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:31.931 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:31.931 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.931 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.931 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:871 6.11 6:8d7f253a:::obj_delete_at_hint.0000000098:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:31.931 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.405724+0000", 2024-05-08T18:30:31.931 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 39.414322562000002, 2024-05-08T18:30:31.931 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0030012530000000002, 2024-05-08T18:30:31.931 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:31.931 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:31.932 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:31.932 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:31.932 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:31.932 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:31.932 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 871 2024-05-08T18:30:31.932 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.932 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:31.932 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.932 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:31.932 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.405724+0000", 2024-05-08T18:30:31.932 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:31.932 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.933 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.933 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:31.933 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.405724+0000", 2024-05-08T18:30:31.933 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:31.933 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.933 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.933 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:31.933 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.405726+0000", 2024-05-08T18:30:31.933 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1299999999999999e-06 2024-05-08T18:30:31.933 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.933 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.933 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:31.933 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.405737+0000", 2024-05-08T18:30:31.933 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0763e-05 2024-05-08T18:30:31.934 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.934 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.934 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:31.934 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.405762+0000", 2024-05-08T18:30:31.934 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5323000000000001e-05 2024-05-08T18:30:31.934 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.934 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.934 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:31.934 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.405776+0000", 2024-05-08T18:30:31.934 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3862999999999999e-05 2024-05-08T18:30:31.934 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.934 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.934 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:31.934 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.405928+0000", 2024-05-08T18:30:31.935 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015190000000000001 2024-05-08T18:30:31.935 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.935 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.935 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:31.935 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.406159+0000", 2024-05-08T18:30:31.935 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023114399999999999 2024-05-08T18:30:31.935 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.935 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.935 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:31.935 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.406453+0000", 2024-05-08T18:30:31.935 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00029329699999999998 2024-05-08T18:30:31.935 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.935 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.936 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:31.936 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.408103+0000", 2024-05-08T18:30:31.936 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0016499869999999999 2024-05-08T18:30:31.936 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.936 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.936 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:31.936 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.408520+0000", 2024-05-08T18:30:31.936 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00041694099999999999 2024-05-08T18:30:31.936 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.936 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.936 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:31.936 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.408606+0000", 2024-05-08T18:30:31.936 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6809000000000002e-05 2024-05-08T18:30:31.936 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.936 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.937 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:31.937 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.408726+0000", 2024-05-08T18:30:31.937 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000119096 2024-05-08T18:30:31.937 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:31.937 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:31.937 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:31.937 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.937 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.937 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:934 6.11 6:8cd774bc:::obj_delete_at_hint.0000000119:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:31.937 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.550387+0000", 2024-05-08T18:30:31.937 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 39.269659609000001, 2024-05-08T18:30:31.937 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0033028739999999999, 2024-05-08T18:30:31.937 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:31.937 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:31.938 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:31.938 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:31.938 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:31.938 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:31.938 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 934 2024-05-08T18:30:31.938 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.938 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:31.938 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.938 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:31.938 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.550387+0000", 2024-05-08T18:30:31.938 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:31.938 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.938 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.939 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:31.939 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.550387+0000", 2024-05-08T18:30:31.939 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:31.939 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.939 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.939 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:31.939 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.550390+0000", 2024-05-08T18:30:31.939 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.706e-06 2024-05-08T18:30:31.939 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.939 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.939 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:31.939 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.550401+0000", 2024-05-08T18:30:31.939 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1437000000000001e-05 2024-05-08T18:30:31.939 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.940 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.940 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:31.940 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.550433+0000", 2024-05-08T18:30:31.940 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2005999999999998e-05 2024-05-08T18:30:31.940 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.940 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.940 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:31.940 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.550448+0000", 2024-05-08T18:30:31.940 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5007e-05 2024-05-08T18:30:31.940 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.940 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.940 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:31.940 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.550607+0000", 2024-05-08T18:30:31.940 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000158288 2024-05-08T18:30:31.941 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.941 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.941 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:31.941 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.550974+0000", 2024-05-08T18:30:31.941 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00036768400000000001 2024-05-08T18:30:31.941 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.941 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.941 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:31.941 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.551516+0000", 2024-05-08T18:30:31.941 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00054126900000000004 2024-05-08T18:30:31.941 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.941 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.941 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:31.941 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.552847+0000", 2024-05-08T18:30:31.941 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0013308899999999999 2024-05-08T18:30:31.941 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.942 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.942 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:31.942 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.553531+0000", 2024-05-08T18:30:31.942 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00068438799999999997 2024-05-08T18:30:31.942 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.942 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.942 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:31.942 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.553621+0000", 2024-05-08T18:30:31.942 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9779999999999998e-05 2024-05-08T18:30:31.942 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:31.942 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:31.942 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:31.942 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.553690+0000", 2024-05-08T18:30:31.942 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9418999999999994e-05 2024-05-08T18:30:31.943 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:31.943 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:31.943 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:31.943 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:31.943 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:31.943 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:30:31.944 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-08T18:30:31.945 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:30:31.943+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:30:32.046 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:30:32.048+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:30:32.076 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:30:32.076 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:30:32.076 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 0 2024-05-08T18:30:32.076 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:30:32.091 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-08T18:30:32.147 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:30:32.148+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:30:32.212 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:30:32.212 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:30:32.212 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2024-05-08T18:30:32.213 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2024-05-08T18:30:32.213 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:30:32.227 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-08T18:30:32.272 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:30:32.271+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:30:32.349 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:30:32.349 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2024-05-08T18:30:32.349 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2024-05-08T18:30:32.350 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-05-08T18:30:32.350 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.350 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:32.350 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.699928+0000", 2024-05-08T18:30:32.350 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 40.646768063000003, 2024-05-08T18:30:32.350 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0036032490000000002, 2024-05-08T18:30:32.350 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:32.350 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:32.350 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:32.350 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:32.350 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:32.350 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:32.351 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 211 2024-05-08T18:30:32.351 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.351 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:32.351 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.351 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:32.351 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.699928+0000", 2024-05-08T18:30:32.351 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:32.351 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.351 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.351 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:32.351 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.699928+0000", 2024-05-08T18:30:32.351 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:32.351 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.351 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.351 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:32.352 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.699931+0000", 2024-05-08T18:30:32.352 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4139999999999998e-06 2024-05-08T18:30:32.352 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.352 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.352 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:32.352 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.699946+0000", 2024-05-08T18:30:32.352 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4528999999999999e-05 2024-05-08T18:30:32.352 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.352 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.352 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:32.352 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.699984+0000", 2024-05-08T18:30:32.352 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8444e-05 2024-05-08T18:30:32.352 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.353 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.353 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:32.353 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.700004+0000", 2024-05-08T18:30:32.353 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0169999999999998e-05 2024-05-08T18:30:32.353 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.353 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.353 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:32.353 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.700162+0000", 2024-05-08T18:30:32.353 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015799799999999999 2024-05-08T18:30:32.353 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.353 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.353 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:32.353 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.700414+0000", 2024-05-08T18:30:32.353 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00025214500000000001 2024-05-08T18:30:32.353 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.354 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.354 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:32.354 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.700839+0000", 2024-05-08T18:30:32.354 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00042484 2024-05-08T18:30:32.354 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.354 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.354 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:32.354 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.702506+0000", 2024-05-08T18:30:32.354 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001666357 2024-05-08T18:30:32.354 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.354 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.354 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:32.354 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.703357+0000", 2024-05-08T18:30:32.354 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00085149399999999995 2024-05-08T18:30:32.355 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.355 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.355 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:32.355 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.703454+0000", 2024-05-08T18:30:32.355 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6688999999999995e-05 2024-05-08T18:30:32.355 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.355 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.355 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:32.355 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.703531+0000", 2024-05-08T18:30:32.355 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.7169000000000006e-05 2024-05-08T18:30:32.355 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:32.355 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:32.355 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:32.355 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.355 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.356 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:32.356 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.776807+0000", 2024-05-08T18:30:32.356 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 40.569889199999999, 2024-05-08T18:30:32.356 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0033805409999999999, 2024-05-08T18:30:32.356 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:32.356 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:32.356 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:32.356 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:32.356 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:32.356 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:32.356 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 232 2024-05-08T18:30:32.356 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.357 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:32.357 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.357 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:32.357 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.776807+0000", 2024-05-08T18:30:32.357 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:32.357 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.357 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.357 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:32.357 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.776807+0000", 2024-05-08T18:30:32.357 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:32.357 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.357 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.357 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:32.357 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.776810+0000", 2024-05-08T18:30:32.358 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6540000000000001e-06 2024-05-08T18:30:32.358 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.358 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.358 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:32.358 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.776824+0000", 2024-05-08T18:30:32.358 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3383e-05 2024-05-08T18:30:32.358 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.358 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.358 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:32.358 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.776856+0000", 2024-05-08T18:30:32.358 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2775999999999999e-05 2024-05-08T18:30:32.358 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.359 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.359 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:32.359 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.776873+0000", 2024-05-08T18:30:32.359 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6483000000000001e-05 2024-05-08T18:30:32.359 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.359 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.359 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:32.359 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.776999+0000", 2024-05-08T18:30:32.359 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000125876 2024-05-08T18:30:32.359 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.359 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.359 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:32.359 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.777228+0000", 2024-05-08T18:30:32.359 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000229531 2024-05-08T18:30:32.359 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.360 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.360 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:32.360 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.777648+0000", 2024-05-08T18:30:32.360 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000420037 2024-05-08T18:30:32.360 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.360 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.360 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:32.360 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.779272+0000", 2024-05-08T18:30:32.360 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0016235780000000001 2024-05-08T18:30:32.360 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.360 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.360 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:32.360 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.780027+0000", 2024-05-08T18:30:32.360 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00075524100000000003 2024-05-08T18:30:32.361 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.361 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.361 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:32.361 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.780116+0000", 2024-05-08T18:30:32.361 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8776000000000005e-05 2024-05-08T18:30:32.361 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.361 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.361 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:32.361 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.780187+0000", 2024-05-08T18:30:32.361 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1205999999999996e-05 2024-05-08T18:30:32.361 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:32.361 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:32.361 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:32.361 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.362 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.362 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:285 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:32.362 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.803745+0000", 2024-05-08T18:30:32.362 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 40.542950914000002, 2024-05-08T18:30:32.362 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0034481960000000002, 2024-05-08T18:30:32.362 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:32.362 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:32.362 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:32.362 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:32.362 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:32.362 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:32.362 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 285 2024-05-08T18:30:32.362 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.363 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:32.363 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.363 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:32.363 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.803745+0000", 2024-05-08T18:30:32.363 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:32.363 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.363 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.363 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:32.363 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.803745+0000", 2024-05-08T18:30:32.363 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:32.363 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.363 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.364 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:32.364 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.803748+0000", 2024-05-08T18:30:32.364 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.813e-06 2024-05-08T18:30:32.364 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.364 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.364 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:32.364 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.803762+0000", 2024-05-08T18:30:32.364 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4653e-05 2024-05-08T18:30:32.364 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.364 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.364 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:32.364 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.803791+0000", 2024-05-08T18:30:32.364 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8540000000000001e-05 2024-05-08T18:30:32.364 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.364 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.364 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:32.365 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.803817+0000", 2024-05-08T18:30:32.365 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5973e-05 2024-05-08T18:30:32.365 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.365 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.365 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:32.365 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.803975+0000", 2024-05-08T18:30:32.365 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000158336 2024-05-08T18:30:32.365 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.365 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.365 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:32.365 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.804502+0000", 2024-05-08T18:30:32.365 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00052658900000000005 2024-05-08T18:30:32.365 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.365 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.365 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:32.366 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.804966+0000", 2024-05-08T18:30:32.366 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00046399599999999999 2024-05-08T18:30:32.366 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.366 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.366 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:32.366 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.806289+0000", 2024-05-08T18:30:32.366 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0013233769999999999 2024-05-08T18:30:32.366 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.366 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.366 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:32.366 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.807001+0000", 2024-05-08T18:30:32.366 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000711314 2024-05-08T18:30:32.366 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.367 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.367 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:32.367 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.807096+0000", 2024-05-08T18:30:32.367 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.5276000000000001e-05 2024-05-08T18:30:32.367 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.367 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.367 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:32.367 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.807193+0000", 2024-05-08T18:30:32.367 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7329000000000003e-05 2024-05-08T18:30:32.367 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:32.367 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:32.367 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:32.367 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.369 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.369 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:317 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:32.369 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.808256+0000", 2024-05-08T18:30:32.369 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 40.538439502000003, 2024-05-08T18:30:32.369 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0038944359999999998, 2024-05-08T18:30:32.369 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:32.370 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:32.370 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:32.370 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:32.370 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:32.370 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:32.370 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 317 2024-05-08T18:30:32.370 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.370 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:32.370 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.370 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:32.370 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.808256+0000", 2024-05-08T18:30:32.370 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:32.370 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.371 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.371 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:32.371 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.808256+0000", 2024-05-08T18:30:32.371 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:32.371 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.371 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.371 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:32.371 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.808258+0000", 2024-05-08T18:30:32.371 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0559999999999999e-06 2024-05-08T18:30:32.371 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.371 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.371 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:32.371 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.808270+0000", 2024-05-08T18:30:32.371 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1537e-05 2024-05-08T18:30:32.372 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.372 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.372 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:32.372 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.808299+0000", 2024-05-08T18:30:32.372 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.9127000000000001e-05 2024-05-08T18:30:32.372 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.372 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.372 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:32.372 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.808324+0000", 2024-05-08T18:30:32.372 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5182e-05 2024-05-08T18:30:32.372 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.372 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.372 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:32.372 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.808471+0000", 2024-05-08T18:30:32.373 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014631900000000001 2024-05-08T18:30:32.373 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.373 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.373 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:32.373 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.808717+0000", 2024-05-08T18:30:32.373 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00024595200000000002 2024-05-08T18:30:32.373 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.373 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.373 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:32.373 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.809072+0000", 2024-05-08T18:30:32.373 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00035547699999999998 2024-05-08T18:30:32.373 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.373 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.373 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:32.374 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.810447+0000", 2024-05-08T18:30:32.374 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0013745929999999999 2024-05-08T18:30:32.374 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.374 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.374 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:32.374 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.811938+0000", 2024-05-08T18:30:32.374 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0014914290000000001 2024-05-08T18:30:32.374 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.374 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.374 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:32.374 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.812078+0000", 2024-05-08T18:30:32.374 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000140319 2024-05-08T18:30:32.374 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.374 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.375 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:32.375 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.812151+0000", 2024-05-08T18:30:32.375 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.2445000000000002e-05 2024-05-08T18:30:32.375 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:32.375 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:32.375 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:32.375 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.375 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.375 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:552 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:32.375 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.923892+0000", 2024-05-08T18:30:32.375 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 40.422804235000001, 2024-05-08T18:30:32.375 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029063259999999999, 2024-05-08T18:30:32.375 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:32.375 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:32.376 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:32.376 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:32.376 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:32.376 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:32.376 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 552 2024-05-08T18:30:32.376 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.376 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:32.376 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.376 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:32.376 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.923892+0000", 2024-05-08T18:30:32.376 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:32.376 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.376 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.376 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:32.376 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.923892+0000", 2024-05-08T18:30:32.377 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:32.377 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.377 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.377 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:32.377 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.923893+0000", 2024-05-08T18:30:32.377 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.082e-06 2024-05-08T18:30:32.377 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.377 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.377 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:32.377 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.923899+0000", 2024-05-08T18:30:32.377 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.426e-06 2024-05-08T18:30:32.377 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.377 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.377 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:32.377 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.923913+0000", 2024-05-08T18:30:32.378 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3869000000000001e-05 2024-05-08T18:30:32.378 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.378 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.378 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:32.378 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.923922+0000", 2024-05-08T18:30:32.378 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8850000000000005e-06 2024-05-08T18:30:32.378 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.378 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.378 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:32.378 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.924023+0000", 2024-05-08T18:30:32.378 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010135400000000001 2024-05-08T18:30:32.378 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.378 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.379 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:32.379 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.924230+0000", 2024-05-08T18:30:32.379 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020649500000000001 2024-05-08T18:30:32.379 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.379 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.379 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:32.379 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.924685+0000", 2024-05-08T18:30:32.379 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00045504299999999997 2024-05-08T18:30:32.379 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.379 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.379 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:32.379 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.925792+0000", 2024-05-08T18:30:32.379 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0011076790000000001 2024-05-08T18:30:32.380 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.380 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.380 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:32.380 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.926566+0000", 2024-05-08T18:30:32.380 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00077379200000000003 2024-05-08T18:30:32.380 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.380 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.380 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:32.380 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.926705+0000", 2024-05-08T18:30:32.380 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013870700000000001 2024-05-08T18:30:32.380 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.380 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.380 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:32.380 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.926798+0000", 2024-05-08T18:30:32.381 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2993999999999998e-05 2024-05-08T18:30:32.381 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:32.381 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:32.381 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:32.381 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.381 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.381 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:709 6.1e 6:7af5a05b:::obj_delete_at_hint.0000000044:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:32.381 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.033719+0000", 2024-05-08T18:30:32.381 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 40.312976476000003, 2024-05-08T18:30:32.381 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0027890480000000001, 2024-05-08T18:30:32.381 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:32.381 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:32.381 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:32.381 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:32.382 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:32.382 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:32.382 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 709 2024-05-08T18:30:32.382 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.382 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:32.382 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.382 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:32.382 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.033719+0000", 2024-05-08T18:30:32.382 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:32.382 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.382 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.382 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:32.382 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.033719+0000", 2024-05-08T18:30:32.383 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:32.383 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.383 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.383 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:32.383 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.033723+0000", 2024-05-08T18:30:32.383 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1920000000000001e-06 2024-05-08T18:30:32.383 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.383 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.383 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:32.383 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.033736+0000", 2024-05-08T18:30:32.383 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3125000000000001e-05 2024-05-08T18:30:32.383 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.383 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.383 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:32.384 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.033768+0000", 2024-05-08T18:30:32.384 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2422999999999998e-05 2024-05-08T18:30:32.384 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.384 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.384 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:32.384 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.033789+0000", 2024-05-08T18:30:32.384 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1084999999999999e-05 2024-05-08T18:30:32.384 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.384 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.384 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:32.384 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.033912+0000", 2024-05-08T18:30:32.384 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000123261 2024-05-08T18:30:32.384 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.384 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.384 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:32.385 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.034132+0000", 2024-05-08T18:30:32.385 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00021992100000000001 2024-05-08T18:30:32.385 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.385 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.385 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:32.385 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.034452+0000", 2024-05-08T18:30:32.385 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00031989399999999998 2024-05-08T18:30:32.385 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.385 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.385 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:32.385 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.035605+0000", 2024-05-08T18:30:32.385 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0011523410000000001 2024-05-08T18:30:32.385 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.386 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.386 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:32.386 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.036356+0000", 2024-05-08T18:30:32.386 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00075177800000000004 2024-05-08T18:30:32.386 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.386 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.386 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:32.386 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.036443+0000", 2024-05-08T18:30:32.386 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.6348999999999996e-05 2024-05-08T18:30:32.386 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.386 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.386 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:32.386 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.036508+0000", 2024-05-08T18:30:32.387 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5679000000000006e-05 2024-05-08T18:30:32.387 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:32.387 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:32.387 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:32.387 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.387 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.387 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:32.387 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.070187+0000", 2024-05-08T18:30:32.387 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 40.276508847999999, 2024-05-08T18:30:32.387 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0030597110000000001, 2024-05-08T18:30:32.387 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:32.387 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:32.387 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:32.387 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:32.388 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:32.388 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:32.388 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 727 2024-05-08T18:30:32.388 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.388 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:32.388 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.388 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:32.388 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.070187+0000", 2024-05-08T18:30:32.388 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:32.388 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.388 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.388 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:32.388 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.070187+0000", 2024-05-08T18:30:32.388 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:32.388 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.389 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.389 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:32.389 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.070189+0000", 2024-05-08T18:30:32.389 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.53e-06 2024-05-08T18:30:32.389 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.389 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.389 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:32.389 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.070197+0000", 2024-05-08T18:30:32.389 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2600000000000005e-06 2024-05-08T18:30:32.389 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.389 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.389 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:32.389 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.070220+0000", 2024-05-08T18:30:32.389 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3357e-05 2024-05-08T18:30:32.389 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.390 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.390 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:32.390 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.070232+0000", 2024-05-08T18:30:32.390 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.217e-05 2024-05-08T18:30:32.390 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.390 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.390 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:32.390 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.070334+0000", 2024-05-08T18:30:32.390 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000101486 2024-05-08T18:30:32.390 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.390 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.390 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:32.391 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.070585+0000", 2024-05-08T18:30:32.391 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00025155799999999998 2024-05-08T18:30:32.391 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.391 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.391 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-05-08T18:30:32.391 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.070921+0000", 2024-05-08T18:30:32.391 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00033587999999999999 2024-05-08T18:30:32.391 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.391 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.391 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:32.391 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.071956+0000", 2024-05-08T18:30:32.391 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010343629999999999 2024-05-08T18:30:32.391 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.391 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.392 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:32.392 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.073088+0000", 2024-05-08T18:30:32.392 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001132641 2024-05-08T18:30:32.392 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.392 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.392 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:32.392 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.073178+0000", 2024-05-08T18:30:32.392 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.9579000000000004e-05 2024-05-08T18:30:32.392 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.392 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.392 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:32.392 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.073247+0000", 2024-05-08T18:30:32.392 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8887000000000006e-05 2024-05-08T18:30:32.392 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:32.392 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:32.393 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:32.393 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.393 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.393 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:775 6.1e 6:7db93595:::obj_delete_at_hint.0000000066:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:32.393 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.180158+0000", 2024-05-08T18:30:32.393 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 40.166537568999999, 2024-05-08T18:30:32.393 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0030746160000000001, 2024-05-08T18:30:32.393 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:32.393 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:32.393 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:32.393 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:32.393 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:32.393 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:32.393 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 775 2024-05-08T18:30:32.394 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.394 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:32.394 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.394 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:32.394 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.180158+0000", 2024-05-08T18:30:32.394 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:32.394 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.394 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.394 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:32.394 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.180158+0000", 2024-05-08T18:30:32.394 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:32.394 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.394 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.395 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:32.395 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.180161+0000", 2024-05-08T18:30:32.395 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8399999999999999e-06 2024-05-08T18:30:32.395 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.395 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.395 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:32.395 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.180172+0000", 2024-05-08T18:30:32.395 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0876000000000001e-05 2024-05-08T18:30:32.395 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.395 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.395 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:32.395 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.180203+0000", 2024-05-08T18:30:32.395 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0639999999999998e-05 2024-05-08T18:30:32.395 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.396 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.396 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:32.396 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.180221+0000", 2024-05-08T18:30:32.396 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8326e-05 2024-05-08T18:30:32.396 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.396 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.396 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:32.396 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.180398+0000", 2024-05-08T18:30:32.396 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000176563 2024-05-08T18:30:32.396 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.396 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.396 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:32.396 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.180616+0000", 2024-05-08T18:30:32.396 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000218731 2024-05-08T18:30:32.397 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.397 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.397 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:32.397 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.180934+0000", 2024-05-08T18:30:32.397 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00031749799999999999 2024-05-08T18:30:32.397 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.397 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.397 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:32.397 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.182159+0000", 2024-05-08T18:30:32.397 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0012251810000000001 2024-05-08T18:30:32.397 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.397 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.397 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:32.397 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.182951+0000", 2024-05-08T18:30:32.398 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00079208000000000002 2024-05-08T18:30:32.398 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.398 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.398 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:32.398 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.183109+0000", 2024-05-08T18:30:32.398 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015750900000000001 2024-05-08T18:30:32.398 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.398 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.398 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:32.398 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.183233+0000", 2024-05-08T18:30:32.398 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012437200000000001 2024-05-08T18:30:32.398 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:32.398 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:32.399 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:32.399 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.399 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.399 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:777 6.1e 6:7db93595:::obj_delete_at_hint.0000000066:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:32.399 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.184358+0000", 2024-05-08T18:30:32.399 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 40.162337725, 2024-05-08T18:30:32.399 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0031944019999999998, 2024-05-08T18:30:32.399 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:32.399 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:32.399 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:32.399 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:32.399 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:32.399 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:32.399 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 777 2024-05-08T18:30:32.399 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.400 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:32.400 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.400 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:32.400 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.184358+0000", 2024-05-08T18:30:32.400 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:32.400 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.400 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.400 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:32.400 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.184358+0000", 2024-05-08T18:30:32.400 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:32.400 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.400 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.400 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:32.400 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.184360+0000", 2024-05-08T18:30:32.401 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5069999999999999e-06 2024-05-08T18:30:32.401 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.401 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.401 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:32.401 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.184367+0000", 2024-05-08T18:30:32.401 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6629999999999993e-06 2024-05-08T18:30:32.401 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.401 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.401 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:32.401 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.184388+0000", 2024-05-08T18:30:32.401 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0755999999999999e-05 2024-05-08T18:30:32.401 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.401 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.401 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:32.402 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.184399+0000", 2024-05-08T18:30:32.402 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0896999999999999e-05 2024-05-08T18:30:32.402 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.402 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.402 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:32.402 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.184512+0000", 2024-05-08T18:30:32.402 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000113346 2024-05-08T18:30:32.402 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.402 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.402 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:32.402 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.184733+0000", 2024-05-08T18:30:32.402 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022113800000000001 2024-05-08T18:30:32.402 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.403 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.403 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:32.403 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.185202+0000", 2024-05-08T18:30:32.403 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00046851999999999999 2024-05-08T18:30:32.403 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.403 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.403 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:32.403 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.186306+0000", 2024-05-08T18:30:32.403 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001104184 2024-05-08T18:30:32.403 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.403 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.403 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:32.403 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.187288+0000", 2024-05-08T18:30:32.403 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00098171 2024-05-08T18:30:32.404 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.404 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.404 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:32.404 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.187438+0000", 2024-05-08T18:30:32.404 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000150629 2024-05-08T18:30:32.404 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.404 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.404 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:32.404 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.187553+0000", 2024-05-08T18:30:32.404 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000114052 2024-05-08T18:30:32.404 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:32.404 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:32.404 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:32.404 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.404 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.405 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:808 6.1a 6:5a206276:::obj_delete_at_hint.0000000077:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:32.405 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.252316+0000", 2024-05-08T18:30:32.405 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 40.094380313000002, 2024-05-08T18:30:32.405 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0027908820000000002, 2024-05-08T18:30:32.405 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:32.405 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:32.405 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:32.405 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:32.405 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:32.405 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:32.405 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 808 2024-05-08T18:30:32.405 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.405 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:32.405 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.405 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:32.405 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.252316+0000", 2024-05-08T18:30:32.406 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:32.406 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.406 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.406 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:32.406 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.252316+0000", 2024-05-08T18:30:32.406 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:32.406 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.406 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.406 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:32.406 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.252318+0000", 2024-05-08T18:30:32.406 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5500000000000001e-06 2024-05-08T18:30:32.406 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.406 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.407 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:32.407 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.252331+0000", 2024-05-08T18:30:32.407 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.252e-05 2024-05-08T18:30:32.407 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.407 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.407 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:32.407 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.252362+0000", 2024-05-08T18:30:32.407 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1720000000000001e-05 2024-05-08T18:30:32.407 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.407 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.407 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:32.407 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.252377+0000", 2024-05-08T18:30:32.407 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4440000000000001e-05 2024-05-08T18:30:32.407 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.407 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.408 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:32.408 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.252513+0000", 2024-05-08T18:30:32.408 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013657200000000001 2024-05-08T18:30:32.408 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.408 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.408 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:32.408 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.252746+0000", 2024-05-08T18:30:32.408 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000232499 2024-05-08T18:30:32.408 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.408 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.408 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:32.408 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.253071+0000", 2024-05-08T18:30:32.408 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00032540299999999999 2024-05-08T18:30:32.408 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.409 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.409 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:32.409 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.254176+0000", 2024-05-08T18:30:32.409 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0011052519999999999 2024-05-08T18:30:32.409 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.409 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.409 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:32.409 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.254957+0000", 2024-05-08T18:30:32.409 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00078004099999999998 2024-05-08T18:30:32.409 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.409 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.409 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:32.409 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.255041+0000", 2024-05-08T18:30:32.410 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4492000000000004e-05 2024-05-08T18:30:32.410 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.410 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.410 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:32.410 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.255106+0000", 2024-05-08T18:30:32.410 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5393000000000002e-05 2024-05-08T18:30:32.410 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:32.410 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:32.410 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:32.410 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.410 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.410 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:810 6.1a 6:5a206276:::obj_delete_at_hint.0000000077:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:32.410 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.256569+0000", 2024-05-08T18:30:32.411 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 40.090127258999999, 2024-05-08T18:30:32.411 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0034505130000000001, 2024-05-08T18:30:32.411 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:32.411 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:32.411 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:32.411 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:32.411 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:32.411 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:32.411 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 810 2024-05-08T18:30:32.411 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.411 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:32.411 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.411 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:32.411 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.256569+0000", 2024-05-08T18:30:32.411 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:32.412 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.412 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.412 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:32.412 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.256569+0000", 2024-05-08T18:30:32.412 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:32.412 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.412 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.412 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:32.412 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.256571+0000", 2024-05-08T18:30:32.412 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2029999999999999e-06 2024-05-08T18:30:32.412 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.412 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.412 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:32.412 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.256582+0000", 2024-05-08T18:30:32.413 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.101e-05 2024-05-08T18:30:32.413 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.413 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.413 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:32.413 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.256614+0000", 2024-05-08T18:30:32.413 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2353e-05 2024-05-08T18:30:32.413 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.413 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.413 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:32.413 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.256632+0000", 2024-05-08T18:30:32.413 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8349999999999999e-05 2024-05-08T18:30:32.413 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.413 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.413 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:32.414 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.256767+0000", 2024-05-08T18:30:32.414 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000134819 2024-05-08T18:30:32.414 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.414 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.414 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:32.414 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.256990+0000", 2024-05-08T18:30:32.414 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022293899999999999 2024-05-08T18:30:32.414 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.414 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.414 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:32.414 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.257487+0000", 2024-05-08T18:30:32.414 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00049632599999999995 2024-05-08T18:30:32.414 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.415 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.415 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:32.415 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.258822+0000", 2024-05-08T18:30:32.415 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001335166 2024-05-08T18:30:32.415 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.415 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.415 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:32.415 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.259867+0000", 2024-05-08T18:30:32.415 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010454349999999999 2024-05-08T18:30:32.415 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.415 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.415 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:32.415 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.259955+0000", 2024-05-08T18:30:32.415 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.7699000000000002e-05 2024-05-08T18:30:32.416 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.416 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.416 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:32.416 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.260019+0000", 2024-05-08T18:30:32.416 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4213000000000003e-05 2024-05-08T18:30:32.416 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:32.416 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:32.416 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:32.416 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.416 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.416 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:814 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:32.416 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.266538+0000", 2024-05-08T18:30:32.416 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 40.080158333, 2024-05-08T18:30:32.416 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0030056010000000001, 2024-05-08T18:30:32.416 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:32.417 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:32.417 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:32.417 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:32.417 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:32.417 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:32.417 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 814 2024-05-08T18:30:32.417 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.417 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:32.417 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.417 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:32.417 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.266538+0000", 2024-05-08T18:30:32.417 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:32.417 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.417 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.418 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:32.418 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.266538+0000", 2024-05-08T18:30:32.418 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:32.418 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.418 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.418 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:32.418 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.266540+0000", 2024-05-08T18:30:32.418 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2400000000000002e-06 2024-05-08T18:30:32.418 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.418 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.418 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:32.418 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.266550+0000", 2024-05-08T18:30:32.418 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0464e-05 2024-05-08T18:30:32.419 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.419 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.419 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:32.419 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.266581+0000", 2024-05-08T18:30:32.419 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.099e-05 2024-05-08T18:30:32.419 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.419 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.419 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:32.419 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.266596+0000", 2024-05-08T18:30:32.419 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5176e-05 2024-05-08T18:30:32.419 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.419 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.419 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:32.419 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.266711+0000", 2024-05-08T18:30:32.420 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000114759 2024-05-08T18:30:32.420 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.420 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.420 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:32.420 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.266936+0000", 2024-05-08T18:30:32.420 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022446200000000001 2024-05-08T18:30:32.420 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.420 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.420 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:32.420 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.267272+0000", 2024-05-08T18:30:32.420 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00033655099999999998 2024-05-08T18:30:32.420 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.420 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.420 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:32.420 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.268417+0000", 2024-05-08T18:30:32.421 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0011447409999999999 2024-05-08T18:30:32.421 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.421 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.421 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:32.421 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.269263+0000", 2024-05-08T18:30:32.421 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00084657600000000003 2024-05-08T18:30:32.421 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.421 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.421 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:32.421 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.269418+0000", 2024-05-08T18:30:32.421 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015471300000000001 2024-05-08T18:30:32.421 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.421 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.422 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:32.422 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.269543+0000", 2024-05-08T18:30:32.422 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000124929 2024-05-08T18:30:32.422 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:32.422 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:32.422 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:32.422 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.422 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.422 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:816 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:32.422 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.270693+0000", 2024-05-08T18:30:32.422 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 40.076003225000001, 2024-05-08T18:30:32.422 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0031451119999999998, 2024-05-08T18:30:32.422 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:32.422 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:32.423 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:32.423 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:32.423 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:32.423 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:32.423 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 816 2024-05-08T18:30:32.423 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.423 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:32.423 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.423 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:32.423 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.270693+0000", 2024-05-08T18:30:32.423 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:32.423 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.423 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.423 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:32.424 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.270693+0000", 2024-05-08T18:30:32.424 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:32.424 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.424 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.424 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:32.424 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.270695+0000", 2024-05-08T18:30:32.424 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0669999999999999e-06 2024-05-08T18:30:32.424 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.424 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.424 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:32.424 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.270704+0000", 2024-05-08T18:30:32.424 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4830000000000005e-06 2024-05-08T18:30:32.424 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.425 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.425 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:32.425 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.270728+0000", 2024-05-08T18:30:32.425 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.4297000000000001e-05 2024-05-08T18:30:32.425 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.425 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.425 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:32.425 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.270740+0000", 2024-05-08T18:30:32.425 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1922999999999999e-05 2024-05-08T18:30:32.425 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.425 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.425 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:32.425 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.270855+0000", 2024-05-08T18:30:32.425 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011418599999999999 2024-05-08T18:30:32.425 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.426 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.426 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:32.426 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.271088+0000", 2024-05-08T18:30:32.426 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000233718 2024-05-08T18:30:32.426 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.426 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.426 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:32.426 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.271548+0000", 2024-05-08T18:30:32.426 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00045974299999999998 2024-05-08T18:30:32.426 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.426 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.426 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:32.426 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.272854+0000", 2024-05-08T18:30:32.427 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0013054799999999999 2024-05-08T18:30:32.427 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.427 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.427 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:32.427 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.273569+0000", 2024-05-08T18:30:32.427 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00071561400000000005 2024-05-08T18:30:32.427 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.427 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.427 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:32.427 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.273726+0000", 2024-05-08T18:30:32.427 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000156856 2024-05-08T18:30:32.427 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.427 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.427 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:32.427 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.273838+0000", 2024-05-08T18:30:32.428 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011174499999999999 2024-05-08T18:30:32.428 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:32.428 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:32.428 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:32.428 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.428 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.428 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:32.428 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.422427+0000", 2024-05-08T18:30:32.428 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 39.924268896000001, 2024-05-08T18:30:32.428 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0031426190000000001, 2024-05-08T18:30:32.428 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:32.428 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:32.428 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:32.428 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:32.428 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:32.428 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:32.429 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 880 2024-05-08T18:30:32.429 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.429 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:32.429 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.429 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:32.429 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.422427+0000", 2024-05-08T18:30:32.429 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:32.429 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.429 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.429 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:32.429 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.422427+0000", 2024-05-08T18:30:32.429 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:32.429 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.429 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.430 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:32.430 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.422431+0000", 2024-05-08T18:30:32.430 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.777e-06 2024-05-08T18:30:32.430 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.430 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.430 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:32.430 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.422445+0000", 2024-05-08T18:30:32.430 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.451e-05 2024-05-08T18:30:32.430 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.430 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.430 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:32.430 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.422479+0000", 2024-05-08T18:30:32.430 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4078999999999997e-05 2024-05-08T18:30:32.430 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.431 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.431 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:32.431 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.422495+0000", 2024-05-08T18:30:32.431 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5947000000000002e-05 2024-05-08T18:30:32.431 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.431 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.431 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:32.431 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.422609+0000", 2024-05-08T18:30:32.431 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000113879 2024-05-08T18:30:32.431 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.431 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.431 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:32.431 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.422844+0000", 2024-05-08T18:30:32.432 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000234465 2024-05-08T18:30:32.432 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.432 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.432 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:32.432 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.423201+0000", 2024-05-08T18:30:32.432 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00035789699999999998 2024-05-08T18:30:32.432 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.432 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.432 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:32.432 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.424352+0000", 2024-05-08T18:30:32.432 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0011504709999999999 2024-05-08T18:30:32.432 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.432 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.432 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:32.433 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.425288+0000", 2024-05-08T18:30:32.433 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00093638300000000005 2024-05-08T18:30:32.433 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.433 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.433 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:32.433 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.425451+0000", 2024-05-08T18:30:32.433 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000162628 2024-05-08T18:30:32.433 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.433 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.433 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:32.433 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.425570+0000", 2024-05-08T18:30:32.433 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000118583 2024-05-08T18:30:32.433 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:32.433 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:32.434 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:32.434 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.434 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.434 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:913 6.2 6:47403372:::obj_delete_at_hint.0000000112:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:32.434 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.494354+0000", 2024-05-08T18:30:32.434 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 39.852341590999998, 2024-05-08T18:30:32.434 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003088276, 2024-05-08T18:30:32.434 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:32.434 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:32.435 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:32.435 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:32.435 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:32.435 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:32.435 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 913 2024-05-08T18:30:32.435 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.435 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:32.435 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.435 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:32.435 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.494354+0000", 2024-05-08T18:30:32.435 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:32.435 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.435 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.435 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:32.436 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.494354+0000", 2024-05-08T18:30:32.436 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:32.436 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.436 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.436 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:32.436 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.494357+0000", 2024-05-08T18:30:32.436 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.553e-06 2024-05-08T18:30:32.436 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.436 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.436 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:32.436 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.494368+0000", 2024-05-08T18:30:32.436 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1426999999999999e-05 2024-05-08T18:30:32.436 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.437 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.437 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:32.437 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.494419+0000", 2024-05-08T18:30:32.437 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1053000000000001e-05 2024-05-08T18:30:32.437 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.437 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.437 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:32.437 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.494434+0000", 2024-05-08T18:30:32.437 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5216e-05 2024-05-08T18:30:32.437 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.437 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.437 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:32.437 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.494564+0000", 2024-05-08T18:30:32.437 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012956900000000001 2024-05-08T18:30:32.438 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.438 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.438 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:32.438 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.494798+0000", 2024-05-08T18:30:32.438 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000234248 2024-05-08T18:30:32.438 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.438 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.438 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:32.438 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.495123+0000", 2024-05-08T18:30:32.438 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00032466500000000002 2024-05-08T18:30:32.438 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.438 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.438 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:32.439 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.496226+0000", 2024-05-08T18:30:32.439 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001102701 2024-05-08T18:30:32.439 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.439 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.439 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:32.439 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.497153+0000", 2024-05-08T18:30:32.439 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00092721999999999998 2024-05-08T18:30:32.439 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.439 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.439 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:32.439 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.497329+0000", 2024-05-08T18:30:32.439 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000176579 2024-05-08T18:30:32.439 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.439 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.440 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:32.440 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.497443+0000", 2024-05-08T18:30:32.440 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000113045 2024-05-08T18:30:32.440 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:32.440 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:32.440 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:32.440 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.440 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.440 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:915 6.2 6:47403372:::obj_delete_at_hint.0000000112:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:32.440 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.498847+0000", 2024-05-08T18:30:32.440 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 39.847848525000003, 2024-05-08T18:30:32.440 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003160459, 2024-05-08T18:30:32.440 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:32.440 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:32.440 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:32.440 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:32.441 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:32.441 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:32.441 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 915 2024-05-08T18:30:32.441 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.441 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:32.441 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.441 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:32.441 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.498847+0000", 2024-05-08T18:30:32.441 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:32.441 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.441 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.441 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:32.441 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.498847+0000", 2024-05-08T18:30:32.441 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:32.442 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.442 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.442 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:32.442 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.498850+0000", 2024-05-08T18:30:32.442 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.4099999999999998e-06 2024-05-08T18:30:32.442 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.442 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.442 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:32.442 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.498863+0000", 2024-05-08T18:30:32.442 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3013000000000001e-05 2024-05-08T18:30:32.442 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.442 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.442 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:32.442 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.498895+0000", 2024-05-08T18:30:32.443 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2682999999999999e-05 2024-05-08T18:30:32.443 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.443 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.443 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:32.443 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.498911+0000", 2024-05-08T18:30:32.443 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.525e-05 2024-05-08T18:30:32.443 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.443 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.443 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:32.443 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.499039+0000", 2024-05-08T18:30:32.443 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012856900000000001 2024-05-08T18:30:32.443 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.443 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.443 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:32.444 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.499264+0000", 2024-05-08T18:30:32.444 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022517500000000001 2024-05-08T18:30:32.444 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.444 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.444 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:32.444 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.499740+0000", 2024-05-08T18:30:32.444 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00047553299999999999 2024-05-08T18:30:32.444 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.444 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.444 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:32.444 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.501192+0000", 2024-05-08T18:30:32.444 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001451735 2024-05-08T18:30:32.444 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.445 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.445 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:32.445 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.501751+0000", 2024-05-08T18:30:32.445 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000559239 2024-05-08T18:30:32.445 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.445 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.445 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:32.445 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.501902+0000", 2024-05-08T18:30:32.445 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015061600000000001 2024-05-08T18:30:32.445 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.445 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.445 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:32.445 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.502008+0000", 2024-05-08T18:30:32.445 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000106236 2024-05-08T18:30:32.445 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:32.446 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:32.446 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:32.446 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.446 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.446 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:925 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:32.446 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.523895+0000", 2024-05-08T18:30:32.446 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 39.822801122000001, 2024-05-08T18:30:32.446 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003635302, 2024-05-08T18:30:32.446 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:32.446 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:32.446 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:32.446 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:32.446 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:32.447 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:32.447 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 925 2024-05-08T18:30:32.447 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.447 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:32.447 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.447 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:32.447 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.523895+0000", 2024-05-08T18:30:32.447 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:32.447 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.447 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.447 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:32.447 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.523895+0000", 2024-05-08T18:30:32.447 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:32.448 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.448 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.448 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:32.448 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.523897+0000", 2024-05-08T18:30:32.448 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1969999999999999e-06 2024-05-08T18:30:32.448 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.448 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.448 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:32.448 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.523908+0000", 2024-05-08T18:30:32.448 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0706e-05 2024-05-08T18:30:32.448 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.448 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.448 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:32.448 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.523938+0000", 2024-05-08T18:30:32.448 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0395999999999998e-05 2024-05-08T18:30:32.449 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.449 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.449 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:32.449 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.523953+0000", 2024-05-08T18:30:32.449 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4673e-05 2024-05-08T18:30:32.449 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.449 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.449 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:32.449 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.524105+0000", 2024-05-08T18:30:32.449 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015204300000000001 2024-05-08T18:30:32.449 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.449 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.449 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:32.449 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.524460+0000", 2024-05-08T18:30:32.450 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00035539000000000002 2024-05-08T18:30:32.450 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.450 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.450 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:32.450 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.525003+0000", 2024-05-08T18:30:32.450 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00054241000000000001 2024-05-08T18:30:32.450 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.450 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.450 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:32.450 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.526198+0000", 2024-05-08T18:30:32.450 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0011955500000000001 2024-05-08T18:30:32.450 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.450 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.450 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:32.451 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.527258+0000", 2024-05-08T18:30:32.451 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010595489999999999 2024-05-08T18:30:32.451 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.451 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.451 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:32.451 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.527414+0000", 2024-05-08T18:30:32.451 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000156732 2024-05-08T18:30:32.451 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.451 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.451 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:32.451 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.527530+0000", 2024-05-08T18:30:32.451 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011565600000000001 2024-05-08T18:30:32.451 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:32.451 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:32.451 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:32.452 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.452 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.452 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:927 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:32.452 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.528868+0000", 2024-05-08T18:30:32.452 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 39.817827723999997, 2024-05-08T18:30:32.452 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00302987, 2024-05-08T18:30:32.452 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:32.452 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:32.452 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:32.452 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:32.452 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:32.452 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:32.452 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 927 2024-05-08T18:30:32.452 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.453 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:32.453 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.453 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:32.453 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.528868+0000", 2024-05-08T18:30:32.453 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:32.453 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.453 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.453 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:32.453 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.528868+0000", 2024-05-08T18:30:32.453 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:32.453 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.453 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.453 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:32.453 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.528870+0000", 2024-05-08T18:30:32.454 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6199999999999999e-06 2024-05-08T18:30:32.454 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.454 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.454 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:32.454 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.528877+0000", 2024-05-08T18:30:32.454 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4070000000000004e-06 2024-05-08T18:30:32.454 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.454 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.454 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:32.454 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.528899+0000", 2024-05-08T18:30:32.454 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1495999999999999e-05 2024-05-08T18:30:32.454 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.454 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.454 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:32.455 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.528910+0000", 2024-05-08T18:30:32.455 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1562999999999999e-05 2024-05-08T18:30:32.455 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.455 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.455 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:32.455 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.529027+0000", 2024-05-08T18:30:32.455 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000116873 2024-05-08T18:30:32.455 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.455 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.455 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:32.455 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.529258+0000", 2024-05-08T18:30:32.455 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000231065 2024-05-08T18:30:32.455 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.455 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.456 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:32.456 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.529732+0000", 2024-05-08T18:30:32.456 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000474043 2024-05-08T18:30:32.456 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.456 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.456 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:32.456 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.530983+0000", 2024-05-08T18:30:32.456 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0012505929999999999 2024-05-08T18:30:32.456 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.456 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.456 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:32.456 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.531621+0000", 2024-05-08T18:30:32.456 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00063814899999999996 2024-05-08T18:30:32.456 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.456 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.457 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:32.457 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.531785+0000", 2024-05-08T18:30:32.457 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016452200000000001 2024-05-08T18:30:32.457 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.457 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.457 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:32.457 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.531898+0000", 2024-05-08T18:30:32.457 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000112539 2024-05-08T18:30:32.457 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:32.457 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:32.457 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:32.457 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.457 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.458 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:32.458 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.532086+0000", 2024-05-08T18:30:32.458 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 39.814609359000002, 2024-05-08T18:30:32.458 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032260779999999998, 2024-05-08T18:30:32.458 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:32.458 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:32.458 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:32.458 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:32.458 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:32.458 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:32.458 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 928 2024-05-08T18:30:32.458 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.458 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:32.458 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.459 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:32.459 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.532086+0000", 2024-05-08T18:30:32.459 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:32.459 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.459 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.459 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:32.459 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.532086+0000", 2024-05-08T18:30:32.459 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:32.459 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.459 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.459 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:32.459 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.532088+0000", 2024-05-08T18:30:32.459 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8670000000000001e-06 2024-05-08T18:30:32.459 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.460 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.460 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:32.460 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.532097+0000", 2024-05-08T18:30:32.460 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.6929999999999996e-06 2024-05-08T18:30:32.460 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.460 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.460 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:32.460 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.532121+0000", 2024-05-08T18:30:32.460 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3572999999999999e-05 2024-05-08T18:30:32.460 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.460 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.460 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:32.460 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.532134+0000", 2024-05-08T18:30:32.460 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3823e-05 2024-05-08T18:30:32.461 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.461 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.461 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:32.461 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.532255+0000", 2024-05-08T18:30:32.461 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012074900000000001 2024-05-08T18:30:32.461 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.461 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.461 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:32.461 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.532588+0000", 2024-05-08T18:30:32.461 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000333068 2024-05-08T18:30:32.461 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.461 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.461 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:32.461 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.533135+0000", 2024-05-08T18:30:32.462 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000546259 2024-05-08T18:30:32.462 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.462 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.462 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:32.462 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.534441+0000", 2024-05-08T18:30:32.462 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0013061500000000001 2024-05-08T18:30:32.462 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.462 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.462 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:32.462 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.535049+0000", 2024-05-08T18:30:32.462 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00060823500000000005 2024-05-08T18:30:32.462 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.462 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.463 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:32.463 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.535203+0000", 2024-05-08T18:30:32.463 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015383500000000001 2024-05-08T18:30:32.463 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.463 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.463 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:32.463 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.535313+0000", 2024-05-08T18:30:32.463 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000109826 2024-05-08T18:30:32.463 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:32.463 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:32.463 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:32.463 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.463 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.463 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:930 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:32.464 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.536650+0000", 2024-05-08T18:30:32.464 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 39.810046073999999, 2024-05-08T18:30:32.464 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029677129999999999, 2024-05-08T18:30:32.464 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:32.464 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:32.464 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:32.464 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:32.464 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:32.464 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:32.464 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 930 2024-05-08T18:30:32.464 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.464 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:32.464 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.464 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:32.465 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.536650+0000", 2024-05-08T18:30:32.465 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:32.465 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.465 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.465 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:32.465 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.536650+0000", 2024-05-08T18:30:32.465 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:32.465 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.465 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.465 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:32.465 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.536652+0000", 2024-05-08T18:30:32.465 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1660000000000001e-06 2024-05-08T18:30:32.465 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.465 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.466 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:32.466 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.536680+0000", 2024-05-08T18:30:32.466 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8084000000000001e-05 2024-05-08T18:30:32.466 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.466 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.466 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:32.466 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.536711+0000", 2024-05-08T18:30:32.466 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1123e-05 2024-05-08T18:30:32.466 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.466 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.466 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:32.466 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.536729+0000", 2024-05-08T18:30:32.466 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8189000000000002e-05 2024-05-08T18:30:32.466 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.467 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.467 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:32.467 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.536852+0000", 2024-05-08T18:30:32.467 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000122729 2024-05-08T18:30:32.467 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.467 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.467 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:32.467 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.537074+0000", 2024-05-08T18:30:32.467 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022180600000000001 2024-05-08T18:30:32.467 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.467 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.467 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:32.467 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.537526+0000", 2024-05-08T18:30:32.467 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00045219599999999998 2024-05-08T18:30:32.468 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.468 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.468 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:32.468 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.538973+0000", 2024-05-08T18:30:32.468 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001447102 2024-05-08T18:30:32.468 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.468 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.468 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:32.468 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.539410+0000", 2024-05-08T18:30:32.468 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00043727399999999997 2024-05-08T18:30:32.468 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.468 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.468 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:32.468 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.539503+0000", 2024-05-08T18:30:32.469 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2338999999999998e-05 2024-05-08T18:30:32.469 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:32.469 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:32.469 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:32.469 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.539617+0000", 2024-05-08T18:30:32.469 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011470499999999999 2024-05-08T18:30:32.469 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:32.469 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:32.469 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:32.469 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:32.469 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:32.469 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:30:32.470 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:30:32.347+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:30:32.471 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-08T18:30:32.471 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-08T18:30:32.504 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-08T18:30:32.512 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:30:32.511+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:30:32.574 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:30:32.571+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:30:32.626 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2024-05-08T18:30:32.626 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:30:32.641 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:30:32.641 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:30:32.641 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 0 2024-05-08T18:30:32.642 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:30:32.643 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2024-05-08T18:30:32.643 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:30:32.656 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-08T18:30:32.662 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2024-05-08T18:30:32.662 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:30:32.679 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2024-05-08T18:30:32.680 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:30:32.696 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:30:32.695+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:30:32.697 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2024-05-08T18:30:32.698 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:30:32.715 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2024-05-08T18:30:32.715 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:30:32.732 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2024-05-08T18:30:32.732 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:30:32.749 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2024-05-08T18:30:32.750 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:30:32.776 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:30:32.776+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:30:32.823 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:32.823 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:32.837 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-08T18:30:32.884 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:30:32.883+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:30:32.959 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:32.959 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:32.973 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-08T18:30:33.017 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:30:33.015+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:30:33.079 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:30:33.080+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:30:33.134 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:33.134 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:33.148 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-08T18:30:33.180 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:30:33.180+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:30:33.270 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:33.270 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:33.281 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:30:33.280+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:30:33.284 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-08T18:30:33.381 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:30:33.379+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:30:33.402 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:33.402 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:33.416 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-08T18:30:33.501 INFO:teuthology.orchestra.run.smithi097.stderr:nodeep-scrub is unset 2024-05-08T18:30:33.504 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:30:33.503+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:30:33.583 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:33.583 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:33.584 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:30:33.584+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:30:33.597 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-08T18:30:33.684 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:30:33.684+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:30:33.762 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:33.857 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:33.859 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-08T18:30:33.859 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:30:33.855+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:30:33.960 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:30:33.960+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:30:34.030 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:34.030 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:34.043 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-08T18:30:34.060 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:30:34.059+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:30:34.161 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:30:34.159+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:30:34.175 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:34.175 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:34.190 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-08T18:30:34.262 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:30:34.259+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:30:34.312 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:34.312 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:34.326 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-08T18:30:34.370 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:30:34.372+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:30:34.444 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:34.444 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:34.457 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-08T18:30:34.503 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:30:34.504+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:30:34.565 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:30:34.564+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:30:34.626 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:34.627 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:34.641 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-08T18:30:34.686 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:30:34.688+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:30:34.767 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-08T18:30:34.768 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:30:34.763+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:30:34.809 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:34.810 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:34.825 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-08T18:30:34.868 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:30:34.867+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:30:34.921 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2024-05-08T18:30:34.921 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:30:34.938 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2024-05-08T18:30:34.939 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:30:34.955 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2024-05-08T18:30:34.955 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:30:34.969 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:30:34.968+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:30:34.972 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2024-05-08T18:30:34.972 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:30:34.992 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:30:34.992 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2024-05-08T18:30:34.992 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2024-05-08T18:30:34.992 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-05-08T18:30:34.993 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:34.993 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4479.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-05-08T18:30:34.993 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:44.576320+0000", 2024-05-08T18:30:34.993 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 50.417678015, 2024-05-08T18:30:34.993 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019751892, 2024-05-08T18:30:34.993 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:34.993 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:34.993 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "reached pg", 2024-05-08T18:30:34.993 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:34.993 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4479", 2024-05-08T18:30:34.993 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3577501689", 2024-05-08T18:30:34.993 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 2 2024-05-08T18:30:34.993 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:34.994 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:34.994 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:34.994 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:34.994 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576320+0000", 2024-05-08T18:30:34.994 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:34.994 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:34.994 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:34.994 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:34.994 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576320+0000", 2024-05-08T18:30:34.994 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:34.994 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:34.994 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:34.994 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:34.994 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576323+0000", 2024-05-08T18:30:34.995 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.813e-06 2024-05-08T18:30:34.995 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:34.995 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:34.995 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:34.995 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576335+0000", 2024-05-08T18:30:34.995 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2330000000000001e-05 2024-05-08T18:30:34.995 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:34.995 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:34.995 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:34.995 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576367+0000", 2024-05-08T18:30:34.995 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2036999999999998e-05 2024-05-08T18:30:34.995 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:34.995 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:34.996 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:34.996 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576394+0000", 2024-05-08T18:30:34.996 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6529e-05 2024-05-08T18:30:34.996 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:34.996 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:34.996 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:34.996 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576550+0000", 2024-05-08T18:30:34.996 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000156718 2024-05-08T18:30:34.996 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:34.996 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:34.996 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-05-08T18:30:34.996 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576560+0000", 2024-05-08T18:30:34.996 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0040999999999999e-05 2024-05-08T18:30:34.996 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:34.997 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:34.997 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:34.997 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.587240+0000", 2024-05-08T18:30:34.997 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010679266999999999 2024-05-08T18:30:34.997 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:34.997 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:34.997 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2024-05-08T18:30:34.997 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.587266+0000", 2024-05-08T18:30:34.997 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6642e-05 2024-05-08T18:30:34.997 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:34.997 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:34.997 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:34.997 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.595882+0000", 2024-05-08T18:30:34.997 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0086159600000000006 2024-05-08T18:30:34.998 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:34.998 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:34.998 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:34.998 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.596072+0000", 2024-05-08T18:30:34.998 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000189555 2024-05-08T18:30:34.998 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:34.998 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:34.998 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:34.998 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:34.998 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:34.998 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:30:34.998 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:48.766182+0000", 2024-05-08T18:30:34.998 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 46.227815988000003, 2024-05-08T18:30:34.999 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031881209999999999, 2024-05-08T18:30:34.999 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:34.999 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:34.999 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:34.999 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:34.999 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:34.999 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:34.999 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 193 2024-05-08T18:30:34.999 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:34.999 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:34.999 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:34.999 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:34.999 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766182+0000", 2024-05-08T18:30:35.000 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:35.000 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.000 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.000 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:35.000 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766182+0000", 2024-05-08T18:30:35.000 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:35.000 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.000 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.000 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:35.000 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766184+0000", 2024-05-08T18:30:35.000 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4159999999999998e-06 2024-05-08T18:30:35.000 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.000 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.000 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:35.001 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766196+0000", 2024-05-08T18:30:35.001 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1814000000000001e-05 2024-05-08T18:30:35.001 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.001 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.001 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:35.001 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766227+0000", 2024-05-08T18:30:35.001 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0676000000000002e-05 2024-05-08T18:30:35.001 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.001 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.001 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:35.001 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766242+0000", 2024-05-08T18:30:35.001 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5497000000000001e-05 2024-05-08T18:30:35.001 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.002 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.002 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:35.002 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766354+0000", 2024-05-08T18:30:35.002 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000111579 2024-05-08T18:30:35.002 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.002 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.002 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:35.002 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766569+0000", 2024-05-08T18:30:35.002 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000214978 2024-05-08T18:30:35.002 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.002 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.002 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:35.002 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766834+0000", 2024-05-08T18:30:35.003 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00026551500000000002 2024-05-08T18:30:35.003 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.003 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.003 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:35.003 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.768577+0000", 2024-05-08T18:30:35.003 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001742513 2024-05-08T18:30:35.003 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.003 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.003 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:35.003 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.769150+0000", 2024-05-08T18:30:35.003 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00057320500000000003 2024-05-08T18:30:35.003 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.003 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.004 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:35.004 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.769250+0000", 2024-05-08T18:30:35.004 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.9846000000000006e-05 2024-05-08T18:30:35.004 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.004 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.004 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:35.004 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.769370+0000", 2024-05-08T18:30:35.004 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012008200000000001 2024-05-08T18:30:35.004 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:35.004 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:35.004 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:35.004 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.004 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.004 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:35.004 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.679562+0000", 2024-05-08T18:30:35.005 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 43.314436284000003, 2024-05-08T18:30:35.005 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0086320800000000003, 2024-05-08T18:30:35.005 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:35.005 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:35.005 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:35.005 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:35.005 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:35.005 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:35.005 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 208 2024-05-08T18:30:35.005 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.005 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:35.005 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.005 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:35.006 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679562+0000", 2024-05-08T18:30:35.006 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:35.006 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.006 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.006 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:35.006 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679562+0000", 2024-05-08T18:30:35.006 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:35.006 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.006 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.006 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:35.006 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679565+0000", 2024-05-08T18:30:35.006 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0800000000000002e-06 2024-05-08T18:30:35.007 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.007 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.007 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:35.007 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679578+0000", 2024-05-08T18:30:35.007 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3217000000000001e-05 2024-05-08T18:30:35.007 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.007 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.007 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:35.007 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679610+0000", 2024-05-08T18:30:35.007 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1696000000000003e-05 2024-05-08T18:30:35.007 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.007 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.007 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:35.008 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679625+0000", 2024-05-08T18:30:35.008 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5824e-05 2024-05-08T18:30:35.008 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.008 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.008 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:35.008 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679758+0000", 2024-05-08T18:30:35.008 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013231199999999999 2024-05-08T18:30:35.008 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.008 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.008 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-05-08T18:30:35.008 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679770+0000", 2024-05-08T18:30:35.008 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1800000000000001e-05 2024-05-08T18:30:35.008 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.008 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.008 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:35.009 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.685241+0000", 2024-05-08T18:30:35.009 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0054710169999999999 2024-05-08T18:30:35.009 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.009 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.009 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:35.009 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.685444+0000", 2024-05-08T18:30:35.009 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000203835 2024-05-08T18:30:35.009 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.009 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.009 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:35.009 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.685842+0000", 2024-05-08T18:30:35.009 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00039773 2024-05-08T18:30:35.009 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.009 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.010 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:35.010 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.687232+0000", 2024-05-08T18:30:35.010 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00139011 2024-05-08T18:30:35.010 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.010 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.010 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:35.010 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.688049+0000", 2024-05-08T18:30:35.010 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00081667000000000003 2024-05-08T18:30:35.010 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.010 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.010 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:35.010 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.688135+0000", 2024-05-08T18:30:35.010 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6299999999999997e-05 2024-05-08T18:30:35.010 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.011 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.011 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:35.011 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.688194+0000", 2024-05-08T18:30:35.011 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8489000000000002e-05 2024-05-08T18:30:35.011 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:35.011 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:35.011 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:35.011 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.011 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.011 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:35.011 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.707114+0000", 2024-05-08T18:30:35.011 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 43.286884270000002, 2024-05-08T18:30:35.011 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031802990000000001, 2024-05-08T18:30:35.011 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:35.011 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:35.012 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:35.012 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:35.012 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:35.012 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:35.012 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 212 2024-05-08T18:30:35.012 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.012 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:35.012 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.012 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:35.012 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707114+0000", 2024-05-08T18:30:35.012 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:35.012 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.013 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.013 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:35.013 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707114+0000", 2024-05-08T18:30:35.013 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:35.013 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.013 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.013 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:35.013 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707117+0000", 2024-05-08T18:30:35.013 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8629999999999999e-06 2024-05-08T18:30:35.013 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.013 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.013 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:35.013 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707129+0000", 2024-05-08T18:30:35.014 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2150000000000001e-05 2024-05-08T18:30:35.014 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.014 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.014 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:35.014 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707158+0000", 2024-05-08T18:30:35.014 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9513999999999999e-05 2024-05-08T18:30:35.014 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.014 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.014 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:35.014 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707173+0000", 2024-05-08T18:30:35.014 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5136e-05 2024-05-08T18:30:35.014 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.014 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.014 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:35.015 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707309+0000", 2024-05-08T18:30:35.015 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000135609 2024-05-08T18:30:35.015 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.015 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.015 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:35.015 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707523+0000", 2024-05-08T18:30:35.015 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021362200000000001 2024-05-08T18:30:35.015 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.015 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.015 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:35.015 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707918+0000", 2024-05-08T18:30:35.015 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00039556299999999998 2024-05-08T18:30:35.015 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.015 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.015 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:35.016 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.709166+0000", 2024-05-08T18:30:35.016 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012476410000000001 2024-05-08T18:30:35.016 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.016 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.016 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:35.016 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.710145+0000", 2024-05-08T18:30:35.016 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00097909899999999998 2024-05-08T18:30:35.016 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.016 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.016 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:35.016 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.710231+0000", 2024-05-08T18:30:35.016 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5625999999999996e-05 2024-05-08T18:30:35.016 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.016 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.016 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:35.017 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.710294+0000", 2024-05-08T18:30:35.017 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3476e-05 2024-05-08T18:30:35.017 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:35.017 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:35.017 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:35.017 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.017 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.017 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:35.017 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.731985+0000", 2024-05-08T18:30:35.017 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 43.262013045000003, 2024-05-08T18:30:35.018 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0039250600000000002, 2024-05-08T18:30:35.018 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:35.018 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:35.018 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:35.018 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:35.018 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:35.018 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:35.018 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 219 2024-05-08T18:30:35.018 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.018 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:35.018 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.019 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:35.019 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731985+0000", 2024-05-08T18:30:35.019 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:35.019 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.019 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.019 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:35.019 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731985+0000", 2024-05-08T18:30:35.019 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:35.019 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.019 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.019 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:35.019 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731988+0000", 2024-05-08T18:30:35.019 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6599999999999999e-06 2024-05-08T18:30:35.019 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.019 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.020 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:35.020 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.732017+0000", 2024-05-08T18:30:35.020 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9692999999999998e-05 2024-05-08T18:30:35.020 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.020 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.020 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:35.020 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.732048+0000", 2024-05-08T18:30:35.020 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1066999999999999e-05 2024-05-08T18:30:35.020 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.020 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.020 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:35.020 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.732064+0000", 2024-05-08T18:30:35.020 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5786000000000001e-05 2024-05-08T18:30:35.020 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.021 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.021 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:35.021 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.732213+0000", 2024-05-08T18:30:35.021 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014895899999999999 2024-05-08T18:30:35.021 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.021 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.021 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:35.021 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.732572+0000", 2024-05-08T18:30:35.021 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000358904 2024-05-08T18:30:35.021 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.021 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.021 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:35.022 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.733349+0000", 2024-05-08T18:30:35.022 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00077657699999999997 2024-05-08T18:30:35.022 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.022 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.022 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:35.022 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.734899+0000", 2024-05-08T18:30:35.022 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001550652 2024-05-08T18:30:35.022 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.022 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.022 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:35.022 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.735641+0000", 2024-05-08T18:30:35.022 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00074222000000000003 2024-05-08T18:30:35.022 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.022 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.023 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:35.023 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.735801+0000", 2024-05-08T18:30:35.023 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015913599999999999 2024-05-08T18:30:35.023 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.023 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.023 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:35.023 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.735910+0000", 2024-05-08T18:30:35.023 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000109406 2024-05-08T18:30:35.023 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:35.023 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:35.023 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:35.023 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.023 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.023 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:35.024 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.750251+0000", 2024-05-08T18:30:35.024 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 43.243747112999998, 2024-05-08T18:30:35.024 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0038408600000000002, 2024-05-08T18:30:35.024 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:35.024 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:35.024 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:35.024 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:35.024 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:35.024 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:35.024 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 224 2024-05-08T18:30:35.024 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.024 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:35.024 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.024 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:35.025 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750251+0000", 2024-05-08T18:30:35.025 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:35.025 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.025 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.025 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:35.025 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750251+0000", 2024-05-08T18:30:35.025 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:35.025 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.025 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.025 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:35.025 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750253+0000", 2024-05-08T18:30:35.025 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2129999999999998e-06 2024-05-08T18:30:35.025 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.026 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.026 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:35.026 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750265+0000", 2024-05-08T18:30:35.026 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1484000000000001e-05 2024-05-08T18:30:35.026 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.026 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.026 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:35.026 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750293+0000", 2024-05-08T18:30:35.026 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8673000000000001e-05 2024-05-08T18:30:35.026 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.026 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.026 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:35.026 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750308+0000", 2024-05-08T18:30:35.027 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4620000000000001e-05 2024-05-08T18:30:35.027 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.027 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.027 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:35.027 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750459+0000", 2024-05-08T18:30:35.027 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000151619 2024-05-08T18:30:35.027 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.027 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.027 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:35.027 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750822+0000", 2024-05-08T18:30:35.027 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000362467 2024-05-08T18:30:35.027 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.027 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.027 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:35.027 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.751591+0000", 2024-05-08T18:30:35.028 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00076934699999999998 2024-05-08T18:30:35.028 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.028 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.028 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:35.028 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.753042+0000", 2024-05-08T18:30:35.028 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001450652 2024-05-08T18:30:35.028 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.028 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.028 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:35.028 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.753792+0000", 2024-05-08T18:30:35.028 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00075045500000000002 2024-05-08T18:30:35.028 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.028 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.028 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:35.029 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.753977+0000", 2024-05-08T18:30:35.029 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000184511 2024-05-08T18:30:35.029 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.029 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.029 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:35.029 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.754092+0000", 2024-05-08T18:30:35.029 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000114819 2024-05-08T18:30:35.029 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:35.029 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:35.029 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:35.029 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.029 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.029 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:35.029 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.783902+0000", 2024-05-08T18:30:35.029 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 43.210096382000003, 2024-05-08T18:30:35.030 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003120046, 2024-05-08T18:30:35.030 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:35.030 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:35.030 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:35.030 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:35.030 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:35.030 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:35.030 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 233 2024-05-08T18:30:35.030 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.030 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:35.030 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.030 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:35.030 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.783902+0000", 2024-05-08T18:30:35.030 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:35.031 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.031 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.031 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:35.031 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.783902+0000", 2024-05-08T18:30:35.031 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:35.031 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.031 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.031 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:35.031 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.783904+0000", 2024-05-08T18:30:35.031 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5229999999999998e-06 2024-05-08T18:30:35.031 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.031 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.031 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:35.031 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.783916+0000", 2024-05-08T18:30:35.031 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1513e-05 2024-05-08T18:30:35.032 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.032 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.032 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:35.032 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.783947+0000", 2024-05-08T18:30:35.032 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1353000000000003e-05 2024-05-08T18:30:35.032 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.032 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.032 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:35.032 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.783964+0000", 2024-05-08T18:30:35.032 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6643e-05 2024-05-08T18:30:35.032 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.032 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.032 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:35.032 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.784110+0000", 2024-05-08T18:30:35.032 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014627299999999999 2024-05-08T18:30:35.033 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.033 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.033 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:35.033 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.784329+0000", 2024-05-08T18:30:35.033 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021892099999999999 2024-05-08T18:30:35.033 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.033 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.033 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:35.033 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.784752+0000", 2024-05-08T18:30:35.033 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00042336700000000001 2024-05-08T18:30:35.033 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.033 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.033 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:35.033 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.786093+0000", 2024-05-08T18:30:35.034 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00134107 2024-05-08T18:30:35.034 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.034 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.034 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:35.034 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.786863+0000", 2024-05-08T18:30:35.034 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00076949099999999997 2024-05-08T18:30:35.034 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.034 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.034 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:35.034 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.786955+0000", 2024-05-08T18:30:35.034 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.2478999999999993e-05 2024-05-08T18:30:35.034 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.034 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.035 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:35.035 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.787022+0000", 2024-05-08T18:30:35.035 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6413000000000003e-05 2024-05-08T18:30:35.035 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:35.035 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:35.035 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:35.035 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.035 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.035 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:341 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:35.035 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.816045+0000", 2024-05-08T18:30:35.035 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 43.177953045000002, 2024-05-08T18:30:35.035 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002875154, 2024-05-08T18:30:35.035 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:35.035 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:35.036 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:35.036 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:35.036 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:35.036 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:35.036 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 341 2024-05-08T18:30:35.036 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.036 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:35.036 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.036 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:35.036 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816045+0000", 2024-05-08T18:30:35.036 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:35.036 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.036 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.036 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:35.037 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816045+0000", 2024-05-08T18:30:35.037 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:35.037 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.037 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.037 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:35.037 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816046+0000", 2024-05-08T18:30:35.037 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9199999999999999e-07 2024-05-08T18:30:35.037 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.037 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.037 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:35.037 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816050+0000", 2024-05-08T18:30:35.038 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0260000000000001e-06 2024-05-08T18:30:35.038 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.038 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.038 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:35.038 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816060+0000", 2024-05-08T18:30:35.038 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0297e-05 2024-05-08T18:30:35.038 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.038 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.038 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:35.038 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816065+0000", 2024-05-08T18:30:35.038 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.237e-06 2024-05-08T18:30:35.038 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.038 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.038 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:35.039 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816122+0000", 2024-05-08T18:30:35.039 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6168000000000002e-05 2024-05-08T18:30:35.039 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.039 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.039 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:35.039 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816198+0000", 2024-05-08T18:30:35.039 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6511e-05 2024-05-08T18:30:35.039 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.039 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.039 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:35.039 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816305+0000", 2024-05-08T18:30:35.039 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000106487 2024-05-08T18:30:35.039 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.039 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.040 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:35.040 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816886+0000", 2024-05-08T18:30:35.040 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00058187199999999999 2024-05-08T18:30:35.040 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.040 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.040 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:35.040 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.818821+0000", 2024-05-08T18:30:35.040 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001934362 2024-05-08T18:30:35.040 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.040 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.040 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:35.040 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.818880+0000", 2024-05-08T18:30:35.040 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9210999999999999e-05 2024-05-08T18:30:35.041 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.041 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.041 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:35.041 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.818920+0000", 2024-05-08T18:30:35.041 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0091e-05 2024-05-08T18:30:35.041 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:35.041 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:35.041 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:35.041 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.041 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.041 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:35.041 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.086431+0000", 2024-05-08T18:30:35.041 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 42.907567225000001, 2024-05-08T18:30:35.041 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028335959999999999, 2024-05-08T18:30:35.041 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:35.042 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:35.042 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:35.042 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:35.042 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:35.042 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:35.042 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 733 2024-05-08T18:30:35.042 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.042 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:35.042 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.042 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:35.042 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086431+0000", 2024-05-08T18:30:35.042 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:35.042 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.042 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.043 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:35.043 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086431+0000", 2024-05-08T18:30:35.043 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:35.043 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.043 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.043 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:35.043 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086433+0000", 2024-05-08T18:30:35.043 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8899999999999999e-06 2024-05-08T18:30:35.043 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.043 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.043 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:35.043 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086441+0000", 2024-05-08T18:30:35.043 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.3100000000000001e-06 2024-05-08T18:30:35.043 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.043 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.044 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:35.044 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086460+0000", 2024-05-08T18:30:35.044 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8703999999999999e-05 2024-05-08T18:30:35.044 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.044 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.044 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:35.044 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086471+0000", 2024-05-08T18:30:35.044 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1324e-05 2024-05-08T18:30:35.044 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.044 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.044 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:35.044 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086590+0000", 2024-05-08T18:30:35.044 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000118625 2024-05-08T18:30:35.044 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.045 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.045 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:35.045 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086817+0000", 2024-05-08T18:30:35.045 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000226958 2024-05-08T18:30:35.045 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.045 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.045 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:35.045 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.087131+0000", 2024-05-08T18:30:35.045 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00031478799999999998 2024-05-08T18:30:35.045 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.045 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.045 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:35.045 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.088025+0000", 2024-05-08T18:30:35.045 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00089402999999999998 2024-05-08T18:30:35.045 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.046 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.046 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:35.046 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.089123+0000", 2024-05-08T18:30:35.046 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001097598 2024-05-08T18:30:35.046 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.046 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.046 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:35.046 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.089200+0000", 2024-05-08T18:30:35.046 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7333e-05 2024-05-08T18:30:35.046 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.046 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.046 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:35.046 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.089264+0000", 2024-05-08T18:30:35.046 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.4035999999999995e-05 2024-05-08T18:30:35.046 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:35.047 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:35.047 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:35.047 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.047 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.047 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:751 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:35.047 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.125611+0000", 2024-05-08T18:30:35.047 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 42.868386532999999, 2024-05-08T18:30:35.047 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032716749999999999, 2024-05-08T18:30:35.047 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:35.047 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:35.047 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:35.047 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:35.047 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:35.047 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:35.048 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 751 2024-05-08T18:30:35.048 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.048 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:35.048 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.048 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:35.048 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125611+0000", 2024-05-08T18:30:35.048 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:35.048 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.048 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.048 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:35.048 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125611+0000", 2024-05-08T18:30:35.048 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:35.048 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.048 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.049 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:35.049 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125614+0000", 2024-05-08T18:30:35.049 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.12e-06 2024-05-08T18:30:35.049 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.049 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.049 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:35.049 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125624+0000", 2024-05-08T18:30:35.049 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0492999999999999e-05 2024-05-08T18:30:35.049 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.049 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.049 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:35.049 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125650+0000", 2024-05-08T18:30:35.049 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5907000000000001e-05 2024-05-08T18:30:35.050 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.050 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.050 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:35.050 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125667+0000", 2024-05-08T18:30:35.050 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.694e-05 2024-05-08T18:30:35.050 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.050 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.050 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:35.050 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125801+0000", 2024-05-08T18:30:35.050 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000134482 2024-05-08T18:30:35.050 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.050 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.050 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:35.050 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.126174+0000", 2024-05-08T18:30:35.051 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00037294999999999999 2024-05-08T18:30:35.051 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.051 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.051 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:35.051 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.126750+0000", 2024-05-08T18:30:35.051 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00057538900000000004 2024-05-08T18:30:35.051 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.051 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.051 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:35.051 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.127997+0000", 2024-05-08T18:30:35.051 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001247761 2024-05-08T18:30:35.051 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.051 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.051 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:35.052 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.128731+0000", 2024-05-08T18:30:35.052 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00073338099999999996 2024-05-08T18:30:35.052 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.052 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.052 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:35.052 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.128817+0000", 2024-05-08T18:30:35.052 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5993000000000002e-05 2024-05-08T18:30:35.052 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.052 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.052 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:35.052 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.128883+0000", 2024-05-08T18:30:35.052 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6259000000000004e-05 2024-05-08T18:30:35.052 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:35.052 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:35.052 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:35.053 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.053 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.053 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:753 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:35.053 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.129809+0000", 2024-05-08T18:30:35.053 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 42.864188994999999, 2024-05-08T18:30:35.053 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0033775440000000001, 2024-05-08T18:30:35.053 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:35.053 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:35.053 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:35.053 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:35.053 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:35.053 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:35.053 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 753 2024-05-08T18:30:35.053 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.053 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:35.054 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.054 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:35.054 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129809+0000", 2024-05-08T18:30:35.054 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:35.054 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.054 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.054 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:35.054 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129809+0000", 2024-05-08T18:30:35.054 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:35.054 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.054 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.054 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:35.054 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129811+0000", 2024-05-08T18:30:35.054 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1730000000000002e-06 2024-05-08T18:30:35.054 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.055 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.055 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:35.055 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129822+0000", 2024-05-08T18:30:35.055 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0583e-05 2024-05-08T18:30:35.055 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.055 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.055 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:35.055 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129852+0000", 2024-05-08T18:30:35.055 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0744000000000002e-05 2024-05-08T18:30:35.055 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.055 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.055 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:35.055 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129870+0000", 2024-05-08T18:30:35.055 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7955999999999999e-05 2024-05-08T18:30:35.056 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.056 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.056 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:35.056 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.130018+0000", 2024-05-08T18:30:35.056 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014747600000000001 2024-05-08T18:30:35.056 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.056 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.056 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:35.056 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.130259+0000", 2024-05-08T18:30:35.056 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024079099999999999 2024-05-08T18:30:35.056 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.056 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.056 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:35.056 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.130734+0000", 2024-05-08T18:30:35.057 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00047562 2024-05-08T18:30:35.057 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.057 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.057 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:35.057 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.131997+0000", 2024-05-08T18:30:35.057 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012626429999999999 2024-05-08T18:30:35.057 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.057 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.057 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:35.057 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.132923+0000", 2024-05-08T18:30:35.057 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00092627599999999997 2024-05-08T18:30:35.057 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.057 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.057 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:35.058 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.133076+0000", 2024-05-08T18:30:35.058 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000152989 2024-05-08T18:30:35.058 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.058 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.058 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:35.058 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.133187+0000", 2024-05-08T18:30:35.058 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000110293 2024-05-08T18:30:35.058 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:35.058 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:35.058 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:35.058 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.058 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.058 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:35.059 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.228247+0000", 2024-05-08T18:30:35.059 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 42.765751385000002, 2024-05-08T18:30:35.059 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032753449999999998, 2024-05-08T18:30:35.059 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:35.059 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:35.059 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:35.059 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:35.059 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:35.059 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:35.059 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 796 2024-05-08T18:30:35.059 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.059 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:35.059 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.060 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:35.060 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228247+0000", 2024-05-08T18:30:35.060 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:35.060 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.060 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.060 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:35.060 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228247+0000", 2024-05-08T18:30:35.060 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:35.060 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.060 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.060 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:35.060 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228249+0000", 2024-05-08T18:30:35.060 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3800000000000001e-06 2024-05-08T18:30:35.060 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.061 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.061 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:35.061 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228260+0000", 2024-05-08T18:30:35.061 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1496e-05 2024-05-08T18:30:35.061 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.061 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.061 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:35.061 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228292+0000", 2024-05-08T18:30:35.061 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1294000000000002e-05 2024-05-08T18:30:35.061 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.061 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.061 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:35.061 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228306+0000", 2024-05-08T18:30:35.061 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4606e-05 2024-05-08T18:30:35.061 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.062 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.062 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:35.062 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228443+0000", 2024-05-08T18:30:35.062 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013672599999999999 2024-05-08T18:30:35.062 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.062 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.062 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:35.062 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228813+0000", 2024-05-08T18:30:35.062 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00036987000000000001 2024-05-08T18:30:35.062 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.062 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.062 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:35.063 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.229365+0000", 2024-05-08T18:30:35.063 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00055210600000000002 2024-05-08T18:30:35.063 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.063 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.063 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:35.063 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.230800+0000", 2024-05-08T18:30:35.063 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001435006 2024-05-08T18:30:35.063 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.064 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.064 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:35.064 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.231369+0000", 2024-05-08T18:30:35.064 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00056848499999999998 2024-05-08T18:30:35.064 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.064 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.064 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:35.064 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.231455+0000", 2024-05-08T18:30:35.064 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6905999999999998e-05 2024-05-08T18:30:35.064 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.064 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.064 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:35.064 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.231522+0000", 2024-05-08T18:30:35.065 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6470000000000006e-05 2024-05-08T18:30:35.065 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:35.065 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:35.065 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:35.065 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.065 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.065 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:798 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:35.065 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.232573+0000", 2024-05-08T18:30:35.065 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 42.761425277999997, 2024-05-08T18:30:35.065 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0030406690000000002, 2024-05-08T18:30:35.065 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:35.065 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:35.065 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:35.066 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:35.066 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:35.066 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:35.066 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 798 2024-05-08T18:30:35.066 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.066 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:35.066 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.066 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:35.066 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232573+0000", 2024-05-08T18:30:35.066 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:35.066 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.066 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.066 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:35.067 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232573+0000", 2024-05-08T18:30:35.067 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:35.067 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.067 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.067 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:35.067 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232574+0000", 2024-05-08T18:30:35.067 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.446e-06 2024-05-08T18:30:35.067 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.067 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.067 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:35.067 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232581+0000", 2024-05-08T18:30:35.067 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.0670000000000003e-06 2024-05-08T18:30:35.068 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.068 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.068 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:35.068 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232600+0000", 2024-05-08T18:30:35.068 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8822999999999999e-05 2024-05-08T18:30:35.068 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.068 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.068 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:35.068 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232611+0000", 2024-05-08T18:30:35.068 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1233000000000001e-05 2024-05-08T18:30:35.068 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.068 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.068 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:35.069 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232731+0000", 2024-05-08T18:30:35.069 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000120189 2024-05-08T18:30:35.069 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.069 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.069 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:35.069 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232963+0000", 2024-05-08T18:30:35.069 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023111900000000001 2024-05-08T18:30:35.069 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.069 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.069 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:35.069 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.233441+0000", 2024-05-08T18:30:35.069 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00047866899999999998 2024-05-08T18:30:35.070 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.070 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.070 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:35.070 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.234542+0000", 2024-05-08T18:30:35.070 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001101245 2024-05-08T18:30:35.070 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.070 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.070 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:35.070 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.235349+0000", 2024-05-08T18:30:35.070 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000806567 2024-05-08T18:30:35.070 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.070 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.070 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:35.071 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.235498+0000", 2024-05-08T18:30:35.071 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014907200000000001 2024-05-08T18:30:35.071 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.071 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.071 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:35.071 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.235613+0000", 2024-05-08T18:30:35.071 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115239 2024-05-08T18:30:35.071 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:35.071 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:35.071 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:35.071 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.071 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.071 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:35.071 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.248596+0000", 2024-05-08T18:30:35.072 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 42.745401471999998, 2024-05-08T18:30:35.072 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002919984, 2024-05-08T18:30:35.072 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:35.072 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:35.072 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:35.072 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:35.072 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:35.072 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:35.072 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 805 2024-05-08T18:30:35.072 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.072 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:35.072 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.073 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:35.073 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248596+0000", 2024-05-08T18:30:35.073 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:35.073 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.073 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.073 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:35.073 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248596+0000", 2024-05-08T18:30:35.073 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:35.073 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.073 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.073 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:35.074 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248599+0000", 2024-05-08T18:30:35.074 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3630000000000001e-06 2024-05-08T18:30:35.074 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.074 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.074 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:35.074 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248610+0000", 2024-05-08T18:30:35.074 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1267000000000001e-05 2024-05-08T18:30:35.074 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.074 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.074 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:35.074 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248641+0000", 2024-05-08T18:30:35.074 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1309999999999997e-05 2024-05-08T18:30:35.074 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.075 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.075 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:35.075 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248656+0000", 2024-05-08T18:30:35.075 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4449e-05 2024-05-08T18:30:35.075 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.075 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.075 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:35.075 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248781+0000", 2024-05-08T18:30:35.075 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012500900000000001 2024-05-08T18:30:35.075 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.075 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.075 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:35.075 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.249001+0000", 2024-05-08T18:30:35.076 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021963500000000001 2024-05-08T18:30:35.076 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.076 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.076 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:35.076 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.249341+0000", 2024-05-08T18:30:35.076 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00034004100000000002 2024-05-08T18:30:35.076 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.076 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.076 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:35.076 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.250473+0000", 2024-05-08T18:30:35.076 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0011324180000000001 2024-05-08T18:30:35.076 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.076 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.077 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:35.077 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.251230+0000", 2024-05-08T18:30:35.077 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00075751400000000004 2024-05-08T18:30:35.077 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.077 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.077 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:35.077 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.251394+0000", 2024-05-08T18:30:35.077 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016379200000000001 2024-05-08T18:30:35.077 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.077 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.077 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:35.077 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.251516+0000", 2024-05-08T18:30:35.078 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012218600000000001 2024-05-08T18:30:35.078 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:35.078 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:35.078 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:35.078 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.078 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.078 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:35.078 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.313184+0000", 2024-05-08T18:30:35.078 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 42.680813796999999, 2024-05-08T18:30:35.078 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003040016, 2024-05-08T18:30:35.078 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:35.078 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:35.078 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:35.079 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:35.079 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:35.079 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:35.079 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 832 2024-05-08T18:30:35.079 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.079 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:35.079 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.079 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:35.079 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313184+0000", 2024-05-08T18:30:35.079 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:35.079 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.079 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.079 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:35.079 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313184+0000", 2024-05-08T18:30:35.080 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:35.080 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.080 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.080 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:35.080 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313187+0000", 2024-05-08T18:30:35.080 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5100000000000001e-06 2024-05-08T18:30:35.080 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.080 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.080 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:35.080 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313199+0000", 2024-05-08T18:30:35.080 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.201e-05 2024-05-08T18:30:35.080 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.080 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.080 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:35.081 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313229+0000", 2024-05-08T18:30:35.081 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9839e-05 2024-05-08T18:30:35.081 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.081 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.081 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:35.081 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313243+0000", 2024-05-08T18:30:35.081 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4727e-05 2024-05-08T18:30:35.081 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.081 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.081 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:35.081 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313358+0000", 2024-05-08T18:30:35.081 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115016 2024-05-08T18:30:35.081 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.081 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.082 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:35.082 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313577+0000", 2024-05-08T18:30:35.082 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021897799999999999 2024-05-08T18:30:35.082 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.082 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.082 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:35.082 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313889+0000", 2024-05-08T18:30:35.082 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00031210400000000001 2024-05-08T18:30:35.082 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.082 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.082 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:35.082 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.315229+0000", 2024-05-08T18:30:35.082 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001339963 2024-05-08T18:30:35.083 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.083 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.083 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:35.083 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.315938+0000", 2024-05-08T18:30:35.083 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00070853400000000003 2024-05-08T18:30:35.083 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.083 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.083 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:35.083 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.316111+0000", 2024-05-08T18:30:35.083 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000173396 2024-05-08T18:30:35.083 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.083 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.083 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:35.084 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.316224+0000", 2024-05-08T18:30:35.084 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000112939 2024-05-08T18:30:35.084 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:35.084 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:35.084 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:35.084 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.084 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.084 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:834 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:35.084 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.317499+0000", 2024-05-08T18:30:35.084 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 42.676498998, 2024-05-08T18:30:35.084 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0033281109999999999, 2024-05-08T18:30:35.084 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:35.084 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:35.084 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:35.085 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:35.085 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:35.085 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:35.085 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 834 2024-05-08T18:30:35.085 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.085 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:35.085 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.085 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:35.085 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317499+0000", 2024-05-08T18:30:35.085 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:35.085 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.085 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.085 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:35.086 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317499+0000", 2024-05-08T18:30:35.086 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:35.086 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.086 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.086 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:35.086 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317501+0000", 2024-05-08T18:30:35.086 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9400000000000001e-06 2024-05-08T18:30:35.086 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.086 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.086 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:35.086 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317511+0000", 2024-05-08T18:30:35.086 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0297e-05 2024-05-08T18:30:35.087 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.087 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.087 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:35.087 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317532+0000", 2024-05-08T18:30:35.087 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1013e-05 2024-05-08T18:30:35.087 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.087 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.087 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:35.087 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317543+0000", 2024-05-08T18:30:35.087 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0757000000000001e-05 2024-05-08T18:30:35.087 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.087 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.087 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:35.087 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317658+0000", 2024-05-08T18:30:35.088 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115129 2024-05-08T18:30:35.088 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.088 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.088 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:35.088 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317887+0000", 2024-05-08T18:30:35.088 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00022880099999999999 2024-05-08T18:30:35.088 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.088 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.088 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:35.088 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.318378+0000", 2024-05-08T18:30:35.088 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00049129000000000002 2024-05-08T18:30:35.088 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.088 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.088 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:35.089 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.319597+0000", 2024-05-08T18:30:35.089 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012188469999999999 2024-05-08T18:30:35.089 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.089 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.089 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:35.089 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.320566+0000", 2024-05-08T18:30:35.089 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00096881599999999995 2024-05-08T18:30:35.089 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.089 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.089 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:35.089 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.320713+0000", 2024-05-08T18:30:35.089 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014691500000000001 2024-05-08T18:30:35.089 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.089 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.090 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:35.090 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.320827+0000", 2024-05-08T18:30:35.090 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000114306 2024-05-08T18:30:35.090 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:35.090 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:35.090 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:35.090 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.090 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.090 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:35.090 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.505569+0000", 2024-05-08T18:30:35.090 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 42.488428544999998, 2024-05-08T18:30:35.090 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028584309999999998, 2024-05-08T18:30:35.090 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:35.091 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:35.091 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:35.091 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:35.091 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:35.091 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:35.091 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 916 2024-05-08T18:30:35.091 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.091 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:35.091 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.091 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:35.091 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505569+0000", 2024-05-08T18:30:35.091 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:35.091 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.091 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.092 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:35.092 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505569+0000", 2024-05-08T18:30:35.092 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:35.092 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.092 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.092 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:35.092 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505572+0000", 2024-05-08T18:30:35.092 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3659999999999999e-06 2024-05-08T18:30:35.092 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.092 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.092 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:35.092 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505583+0000", 2024-05-08T18:30:35.092 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1574e-05 2024-05-08T18:30:35.093 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.093 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.093 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:35.093 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505614+0000", 2024-05-08T18:30:35.093 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0670000000000003e-05 2024-05-08T18:30:35.093 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.093 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.093 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:35.093 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505629+0000", 2024-05-08T18:30:35.093 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5063e-05 2024-05-08T18:30:35.093 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.093 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.093 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:35.093 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505754+0000", 2024-05-08T18:30:35.094 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012508899999999999 2024-05-08T18:30:35.094 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.094 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.094 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:35.094 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505988+0000", 2024-05-08T18:30:35.094 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023334699999999999 2024-05-08T18:30:35.094 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.094 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.094 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:35.094 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.506299+0000", 2024-05-08T18:30:35.094 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000311811 2024-05-08T18:30:35.095 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.095 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.095 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:35.095 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.507489+0000", 2024-05-08T18:30:35.095 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0011899510000000001 2024-05-08T18:30:35.095 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.095 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.095 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:35.095 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.508141+0000", 2024-05-08T18:30:35.095 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00065180200000000005 2024-05-08T18:30:35.095 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.095 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.095 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:35.096 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.508306+0000", 2024-05-08T18:30:35.096 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016450199999999999 2024-05-08T18:30:35.096 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.096 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.096 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:35.096 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.508428+0000", 2024-05-08T18:30:35.096 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000122256 2024-05-08T18:30:35.096 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:35.096 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:35.096 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:35.096 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.096 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.096 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:918 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:35.097 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.509337+0000", 2024-05-08T18:30:35.097 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 42.484660478000002, 2024-05-08T18:30:35.097 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002971787, 2024-05-08T18:30:35.097 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:35.097 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:35.097 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:35.097 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:35.097 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:35.097 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:35.097 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 918 2024-05-08T18:30:35.097 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.097 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:35.097 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.098 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:35.098 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509337+0000", 2024-05-08T18:30:35.098 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:35.098 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.098 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.098 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:35.098 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509337+0000", 2024-05-08T18:30:35.098 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:35.098 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.098 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.098 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:35.098 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509340+0000", 2024-05-08T18:30:35.098 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2570000000000002e-06 2024-05-08T18:30:35.099 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.099 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.099 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:35.099 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509351+0000", 2024-05-08T18:30:35.099 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0933e-05 2024-05-08T18:30:35.099 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.099 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.099 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:35.099 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509382+0000", 2024-05-08T18:30:35.099 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1198999999999997e-05 2024-05-08T18:30:35.099 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.099 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.099 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:35.099 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509400+0000", 2024-05-08T18:30:35.100 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8236999999999998e-05 2024-05-08T18:30:35.100 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.100 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.100 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:35.100 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509529+0000", 2024-05-08T18:30:35.100 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012905600000000001 2024-05-08T18:30:35.100 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.100 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.100 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:35.100 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509777+0000", 2024-05-08T18:30:35.100 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024786799999999999 2024-05-08T18:30:35.100 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.100 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.101 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:35.101 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.510284+0000", 2024-05-08T18:30:35.101 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000506796 2024-05-08T18:30:35.101 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.101 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.101 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:35.101 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.511453+0000", 2024-05-08T18:30:35.101 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001169575 2024-05-08T18:30:35.101 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.101 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.101 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:35.101 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.512051+0000", 2024-05-08T18:30:35.101 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00059743100000000005 2024-05-08T18:30:35.101 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.102 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.102 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:35.102 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.512199+0000", 2024-05-08T18:30:35.102 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000148486 2024-05-08T18:30:35.102 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.102 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.102 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:35.102 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.512309+0000", 2024-05-08T18:30:35.102 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000109949 2024-05-08T18:30:35.102 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:35.102 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:35.102 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:35.103 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.103 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.103 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:931 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:35.103 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.543277+0000", 2024-05-08T18:30:35.103 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 42.450721323000003, 2024-05-08T18:30:35.103 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028250710000000002, 2024-05-08T18:30:35.103 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:35.103 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:35.103 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:35.103 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:35.103 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:35.103 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:35.103 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 931 2024-05-08T18:30:35.104 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.104 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:35.104 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.104 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:35.104 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543277+0000", 2024-05-08T18:30:35.104 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:35.104 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.104 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.104 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:35.104 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543277+0000", 2024-05-08T18:30:35.104 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:35.104 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.104 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.104 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:35.105 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543279+0000", 2024-05-08T18:30:35.105 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.373e-06 2024-05-08T18:30:35.105 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.105 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.105 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:35.105 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543291+0000", 2024-05-08T18:30:35.105 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1517e-05 2024-05-08T18:30:35.105 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.105 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.105 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:35.105 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543323+0000", 2024-05-08T18:30:35.105 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2292000000000002e-05 2024-05-08T18:30:35.105 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.105 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.106 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:35.106 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543340+0000", 2024-05-08T18:30:35.106 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.749e-05 2024-05-08T18:30:35.106 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.106 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.106 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:35.106 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543462+0000", 2024-05-08T18:30:35.106 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000121413 2024-05-08T18:30:35.106 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.106 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.106 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:35.106 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543681+0000", 2024-05-08T18:30:35.107 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021974200000000001 2024-05-08T18:30:35.107 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.107 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.107 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:35.107 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.544004+0000", 2024-05-08T18:30:35.107 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00032268900000000003 2024-05-08T18:30:35.107 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.107 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.107 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:35.107 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.545158+0000", 2024-05-08T18:30:35.107 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0011540190000000001 2024-05-08T18:30:35.107 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.107 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.107 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:35.108 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.545970+0000", 2024-05-08T18:30:35.108 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00081224300000000004 2024-05-08T18:30:35.108 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.108 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.108 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:35.108 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.546043+0000", 2024-05-08T18:30:35.108 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.3067999999999999e-05 2024-05-08T18:30:35.108 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.108 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.108 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:35.108 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.546102+0000", 2024-05-08T18:30:35.108 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8224999999999999e-05 2024-05-08T18:30:35.108 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:35.109 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:35.109 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:35.109 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.109 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.109 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:35.109 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.578568+0000", 2024-05-08T18:30:35.109 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 42.415430416, 2024-05-08T18:30:35.109 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0030345839999999999, 2024-05-08T18:30:35.109 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:35.109 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:35.109 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:35.109 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:35.109 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:35.109 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:35.110 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 946 2024-05-08T18:30:35.110 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.110 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:35.110 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.110 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:35.110 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578568+0000", 2024-05-08T18:30:35.110 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:35.110 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.110 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.110 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:35.110 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578568+0000", 2024-05-08T18:30:35.110 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:35.110 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.110 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.111 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:35.111 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578570+0000", 2024-05-08T18:30:35.111 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3700000000000002e-06 2024-05-08T18:30:35.111 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.111 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.111 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:35.111 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578582+0000", 2024-05-08T18:30:35.111 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1627000000000001e-05 2024-05-08T18:30:35.111 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.111 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.111 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:35.111 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578612+0000", 2024-05-08T18:30:35.111 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0103e-05 2024-05-08T18:30:35.111 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.112 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.112 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:35.112 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578627+0000", 2024-05-08T18:30:35.112 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4949999999999999e-05 2024-05-08T18:30:35.112 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.112 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.112 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:35.112 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578750+0000", 2024-05-08T18:30:35.112 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012309899999999999 2024-05-08T18:30:35.112 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.112 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.112 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:35.112 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.579042+0000", 2024-05-08T18:30:35.112 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00029212500000000001 2024-05-08T18:30:35.113 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.113 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.113 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:35.113 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.579557+0000", 2024-05-08T18:30:35.113 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00051536900000000001 2024-05-08T18:30:35.113 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.113 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.113 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:35.113 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.580698+0000", 2024-05-08T18:30:35.113 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001140774 2024-05-08T18:30:35.113 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.113 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.113 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:35.113 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.581367+0000", 2024-05-08T18:30:35.114 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00066884799999999999 2024-05-08T18:30:35.114 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.114 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.114 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:35.114 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.581489+0000", 2024-05-08T18:30:35.114 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012265600000000001 2024-05-08T18:30:35.114 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.114 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.114 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:35.114 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.581602+0000", 2024-05-08T18:30:35.114 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000112663 2024-05-08T18:30:35.114 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:35.114 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:35.115 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:35.115 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:35.115 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:35.115 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:30:35.116 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2024-05-08T18:30:35.116 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:30:35.117 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-08T18:30:35.117 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2024-05-08T18:30:35.118 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:30:35.118 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2024-05-08T18:30:35.118 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:30:35.119 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2024-05-08T18:30:35.119 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:30:35.120 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:30:35.116+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:30:35.217 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:30:35.216+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:30:35.286 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:30:35.286 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:30:35.286 INFO:teuthology.orchestra.run.smithi097.stdout: "num_ops": 0 2024-05-08T18:30:35.286 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:30:35.300 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-08T18:30:35.342 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:30:35.344+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:30:35.420 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:30:35.415+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:30:35.467 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:30:35.468 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:30:35.468 INFO:teuthology.orchestra.run.smithi097.stdout: "complaint_time": 30, 2024-05-08T18:30:35.468 INFO:teuthology.orchestra.run.smithi097.stdout: "num_blocked_ops": 0 2024-05-08T18:30:35.468 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:30:35.482 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-08T18:30:35.520 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:30:35.519+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:30:35.527 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-08T18:30:35.602 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:30:35.602 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2024-05-08T18:30:35.602 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2024-05-08T18:30:35.602 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-05-08T18:30:35.602 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.602 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4479.0:40 5.b 5:d797044f:::zonegroup_info.ea3b680f-900d-4805-81ec-055811625780:head [create,call version.set in=10b,writefull 0~436] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-05-08T18:30:35.602 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:44.637551+0000", 2024-05-08T18:30:35.602 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 50.965826077999999, 2024-05-08T18:30:35.602 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003054013, 2024-05-08T18:30:35.602 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:35.602 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:35.603 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:35.603 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:35.603 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4479", 2024-05-08T18:30:35.603 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3577501689", 2024-05-08T18:30:35.603 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 40 2024-05-08T18:30:35.603 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.603 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:35.603 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.603 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:35.603 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.637551+0000", 2024-05-08T18:30:35.603 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:35.603 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.603 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.604 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:35.604 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.637551+0000", 2024-05-08T18:30:35.604 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:35.604 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.604 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.604 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:35.604 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.637554+0000", 2024-05-08T18:30:35.604 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6599999999999999e-06 2024-05-08T18:30:35.604 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.604 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.604 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:35.604 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.637576+0000", 2024-05-08T18:30:35.604 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1965999999999999e-05 2024-05-08T18:30:35.604 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.604 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.605 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:35.605 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.637603+0000", 2024-05-08T18:30:35.605 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7257e-05 2024-05-08T18:30:35.605 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.605 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.605 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:35.605 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.637623+0000", 2024-05-08T18:30:35.605 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9570000000000001e-05 2024-05-08T18:30:35.605 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.605 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.605 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:35.605 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.637766+0000", 2024-05-08T18:30:35.605 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000143435 2024-05-08T18:30:35.605 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.606 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.606 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:35.606 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.638167+0000", 2024-05-08T18:30:35.606 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00040082399999999998 2024-05-08T18:30:35.606 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.606 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.606 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:35.606 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.638627+0000", 2024-05-08T18:30:35.606 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00046019300000000002 2024-05-08T18:30:35.606 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.606 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.606 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:35.606 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.640399+0000", 2024-05-08T18:30:35.606 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0017714199999999999 2024-05-08T18:30:35.607 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.607 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.607 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:35.607 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.640447+0000", 2024-05-08T18:30:35.607 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8383000000000001e-05 2024-05-08T18:30:35.607 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.607 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.607 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:35.607 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.640534+0000", 2024-05-08T18:30:35.607 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7078999999999998e-05 2024-05-08T18:30:35.608 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.608 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.608 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:35.608 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.640606+0000", 2024-05-08T18:30:35.608 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1225999999999999e-05 2024-05-08T18:30:35.608 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:35.608 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:35.608 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:35.608 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.608 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.608 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4479.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-05-08T18:30:35.608 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:44.643918+0000", 2024-05-08T18:30:35.608 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 50.959459803000001, 2024-05-08T18:30:35.608 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002986004, 2024-05-08T18:30:35.609 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:35.609 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:35.609 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:35.609 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:35.609 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4479", 2024-05-08T18:30:35.609 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3577501689", 2024-05-08T18:30:35.609 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 42 2024-05-08T18:30:35.609 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.609 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:35.609 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.609 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:35.609 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.643918+0000", 2024-05-08T18:30:35.609 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:35.609 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.610 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.610 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:35.610 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.643918+0000", 2024-05-08T18:30:35.610 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:35.610 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.610 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.610 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:35.610 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.643919+0000", 2024-05-08T18:30:35.610 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4729999999999999e-06 2024-05-08T18:30:35.610 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.610 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.610 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:35.610 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.643927+0000", 2024-05-08T18:30:35.611 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6389999999999992e-06 2024-05-08T18:30:35.611 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.611 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.611 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:35.611 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.643945+0000", 2024-05-08T18:30:35.611 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8195000000000001e-05 2024-05-08T18:30:35.611 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.611 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.611 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:35.611 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.643954+0000", 2024-05-08T18:30:35.611 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5210000000000002e-06 2024-05-08T18:30:35.611 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.611 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.611 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:35.611 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.644123+0000", 2024-05-08T18:30:35.612 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016904999999999999 2024-05-08T18:30:35.612 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.612 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.612 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:35.612 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.644315+0000", 2024-05-08T18:30:35.612 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00019202800000000001 2024-05-08T18:30:35.612 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.612 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.612 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:35.612 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.644505+0000", 2024-05-08T18:30:35.612 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000190552 2024-05-08T18:30:35.612 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.612 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.612 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:35.613 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.645877+0000", 2024-05-08T18:30:35.613 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001371702 2024-05-08T18:30:35.613 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.613 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.613 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:35.613 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.646778+0000", 2024-05-08T18:30:35.613 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00090065700000000002 2024-05-08T18:30:35.613 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.613 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.613 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:35.613 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.646843+0000", 2024-05-08T18:30:35.613 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5504000000000002e-05 2024-05-08T18:30:35.613 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.613 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.613 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:35.614 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.646904+0000", 2024-05-08T18:30:35.614 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0683000000000002e-05 2024-05-08T18:30:35.614 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:35.614 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:35.614 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:35.614 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.614 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.614 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:57 7.3 e30/29 7:c609908c:::notify.5:head v 30'2, mlcod=0'0)", 2024-05-08T18:30:35.614 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:48.669376+0000", 2024-05-08T18:30:35.614 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 46.934001694999999, 2024-05-08T18:30:35.614 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0041509479999999998, 2024-05-08T18:30:35.614 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:35.614 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:35.614 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:35.615 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:35.615 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.615 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:35.615 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669376+0000", 2024-05-08T18:30:35.615 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:35.615 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.615 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.615 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:35.615 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669376+0000", 2024-05-08T18:30:35.615 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:35.615 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.615 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.615 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:35.615 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669378+0000", 2024-05-08T18:30:35.616 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.79e-06 2024-05-08T18:30:35.616 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.616 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.616 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:35.616 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669393+0000", 2024-05-08T18:30:35.616 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5053e-05 2024-05-08T18:30:35.616 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.616 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.616 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:35.616 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669427+0000", 2024-05-08T18:30:35.616 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4326999999999998e-05 2024-05-08T18:30:35.616 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.616 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.617 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:35.617 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669451+0000", 2024-05-08T18:30:35.617 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3629e-05 2024-05-08T18:30:35.617 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.617 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.617 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:35.617 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669563+0000", 2024-05-08T18:30:35.617 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011251099999999999 2024-05-08T18:30:35.617 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.617 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.617 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:35.617 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669607+0000", 2024-05-08T18:30:35.617 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3877e-05 2024-05-08T18:30:35.617 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.618 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.618 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:35.618 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.673401+0000", 2024-05-08T18:30:35.618 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0037942819999999999 2024-05-08T18:30:35.618 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.618 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.618 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:35.618 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.673527+0000", 2024-05-08T18:30:35.618 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012547900000000001 2024-05-08T18:30:35.618 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:35.618 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:35.619 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:35.619 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.619 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.619 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:58 7.14 e30/29 7:2b04a3e9:::notify.6:head v 30'1, mlcod=0'0)", 2024-05-08T18:30:35.619 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:48.669496+0000", 2024-05-08T18:30:35.619 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 46.933881323000001, 2024-05-08T18:30:35.619 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0046805609999999997, 2024-05-08T18:30:35.619 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:35.619 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:35.619 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:35.619 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:35.619 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.619 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:35.619 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669496+0000", 2024-05-08T18:30:35.620 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:35.620 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.620 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.620 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:35.620 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669496+0000", 2024-05-08T18:30:35.620 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:35.620 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.620 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.620 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:35.620 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669497+0000", 2024-05-08T18:30:35.621 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0100000000000001e-06 2024-05-08T18:30:35.621 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.621 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.621 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:35.621 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669507+0000", 2024-05-08T18:30:35.621 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.7540000000000001e-06 2024-05-08T18:30:35.621 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.621 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.621 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:35.621 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669528+0000", 2024-05-08T18:30:35.621 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.05e-05 2024-05-08T18:30:35.621 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.621 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.622 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:35.622 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669544+0000", 2024-05-08T18:30:35.622 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6716000000000001e-05 2024-05-08T18:30:35.622 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.622 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.622 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:35.622 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669667+0000", 2024-05-08T18:30:35.622 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012275799999999999 2024-05-08T18:30:35.622 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.622 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.622 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:35.622 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669706+0000", 2024-05-08T18:30:35.622 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8764999999999999e-05 2024-05-08T18:30:35.622 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.623 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.623 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:35.623 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674100+0000", 2024-05-08T18:30:35.623 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.004394528 2024-05-08T18:30:35.623 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.623 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.623 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:35.623 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674177+0000", 2024-05-08T18:30:35.623 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6530000000000001e-05 2024-05-08T18:30:35.623 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:35.623 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:35.623 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:35.623 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.624 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.624 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:35.624 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.794231+0000", 2024-05-08T18:30:35.624 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 43.809146931999997, 2024-05-08T18:30:35.624 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031872810000000001, 2024-05-08T18:30:35.624 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:35.624 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:35.624 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:35.624 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:35.624 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:35.624 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:35.624 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 236 2024-05-08T18:30:35.624 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.624 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:35.625 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.625 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:35.625 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794231+0000", 2024-05-08T18:30:35.625 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:35.625 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.625 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.625 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:35.625 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794231+0000", 2024-05-08T18:30:35.625 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:35.625 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.625 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.625 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:35.625 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794234+0000", 2024-05-08T18:30:35.626 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.36e-06 2024-05-08T18:30:35.626 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.626 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.626 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:35.626 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794248+0000", 2024-05-08T18:30:35.626 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4372999999999999e-05 2024-05-08T18:30:35.626 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.626 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.626 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:35.626 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794279+0000", 2024-05-08T18:30:35.626 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1075999999999999e-05 2024-05-08T18:30:35.626 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.626 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.626 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:35.627 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794295+0000", 2024-05-08T18:30:35.627 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5386000000000001e-05 2024-05-08T18:30:35.627 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.627 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.627 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:35.627 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794416+0000", 2024-05-08T18:30:35.627 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012071899999999999 2024-05-08T18:30:35.627 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.627 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.627 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:35.627 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794638+0000", 2024-05-08T18:30:35.627 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00022262599999999999 2024-05-08T18:30:35.627 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.627 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.628 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:35.628 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.795061+0000", 2024-05-08T18:30:35.628 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00042248900000000001 2024-05-08T18:30:35.628 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.628 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.628 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:35.628 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.796477+0000", 2024-05-08T18:30:35.628 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0014162230000000001 2024-05-08T18:30:35.628 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.628 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.628 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:35.628 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.797258+0000", 2024-05-08T18:30:35.628 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00078159400000000004 2024-05-08T18:30:35.628 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.629 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.629 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:35.629 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.797349+0000", 2024-05-08T18:30:35.629 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0462000000000002e-05 2024-05-08T18:30:35.629 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.629 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.629 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:35.629 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.797418+0000", 2024-05-08T18:30:35.629 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8973000000000005e-05 2024-05-08T18:30:35.629 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:35.629 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:35.629 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:35.629 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.629 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.630 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:281 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:35.630 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.806063+0000", 2024-05-08T18:30:35.630 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 43.797314798000002, 2024-05-08T18:30:35.630 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002923761, 2024-05-08T18:30:35.630 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:35.630 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:35.630 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:35.630 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:35.630 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:35.630 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:35.630 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 281 2024-05-08T18:30:35.630 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.630 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:35.631 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.631 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:35.631 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.806063+0000", 2024-05-08T18:30:35.631 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:35.631 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.631 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.631 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:35.631 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.806063+0000", 2024-05-08T18:30:35.631 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:35.631 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.631 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.631 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:35.631 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.806064+0000", 2024-05-08T18:30:35.631 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.204e-06 2024-05-08T18:30:35.631 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.632 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.632 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:35.632 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.806073+0000", 2024-05-08T18:30:35.632 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5609999999999999e-06 2024-05-08T18:30:35.632 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.632 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.632 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:35.632 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.806089+0000", 2024-05-08T18:30:35.632 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6673000000000001e-05 2024-05-08T18:30:35.632 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.632 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.632 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:35.632 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.806098+0000", 2024-05-08T18:30:35.632 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8899999999999996e-06 2024-05-08T18:30:35.632 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.633 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.633 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:35.633 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.806165+0000", 2024-05-08T18:30:35.633 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6927999999999993e-05 2024-05-08T18:30:35.633 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.633 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.633 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:35.633 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.806298+0000", 2024-05-08T18:30:35.633 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000132886 2024-05-08T18:30:35.633 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.633 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.633 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:35.633 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.806453+0000", 2024-05-08T18:30:35.633 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000155339 2024-05-08T18:30:35.634 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.634 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.634 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:35.634 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.807157+0000", 2024-05-08T18:30:35.634 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00070363900000000004 2024-05-08T18:30:35.634 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.634 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.634 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:35.634 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.808880+0000", 2024-05-08T18:30:35.634 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0017227130000000001 2024-05-08T18:30:35.634 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.634 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.634 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:35.634 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.808938+0000", 2024-05-08T18:30:35.635 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8814999999999998e-05 2024-05-08T18:30:35.635 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.635 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.635 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:35.635 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.808987+0000", 2024-05-08T18:30:35.635 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8112999999999998e-05 2024-05-08T18:30:35.635 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:35.635 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:35.635 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:35.635 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.635 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.635 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:304 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:35.635 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.809645+0000", 2024-05-08T18:30:35.635 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 43.79373296, 2024-05-08T18:30:35.635 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031633579999999998, 2024-05-08T18:30:35.636 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:35.636 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:35.636 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:35.636 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:35.636 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:35.636 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:35.636 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 304 2024-05-08T18:30:35.636 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.636 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:35.636 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.636 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:35.636 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809645+0000", 2024-05-08T18:30:35.636 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:35.636 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.637 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.637 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:35.637 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809645+0000", 2024-05-08T18:30:35.637 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:35.637 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.637 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.637 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:35.637 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809646+0000", 2024-05-08T18:30:35.637 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.113e-06 2024-05-08T18:30:35.637 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.637 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.637 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:35.637 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809652+0000", 2024-05-08T18:30:35.637 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1650000000000003e-06 2024-05-08T18:30:35.637 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.638 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.638 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:35.638 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809668+0000", 2024-05-08T18:30:35.638 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6025e-05 2024-05-08T18:30:35.638 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.638 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.638 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:35.638 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809678+0000", 2024-05-08T18:30:35.638 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0456e-05 2024-05-08T18:30:35.638 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.638 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.638 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:35.638 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809745+0000", 2024-05-08T18:30:35.638 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7088000000000005e-05 2024-05-08T18:30:35.639 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.639 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.639 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:35.639 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809803+0000", 2024-05-08T18:30:35.639 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7405999999999999e-05 2024-05-08T18:30:35.639 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.639 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.639 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:35.639 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809951+0000", 2024-05-08T18:30:35.639 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014775500000000001 2024-05-08T18:30:35.639 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.639 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.639 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:35.639 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.810564+0000", 2024-05-08T18:30:35.640 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00061324899999999996 2024-05-08T18:30:35.640 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.640 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.640 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:35.640 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.812744+0000", 2024-05-08T18:30:35.640 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0021804509999999999 2024-05-08T18:30:35.640 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.640 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.640 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:35.640 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.812781+0000", 2024-05-08T18:30:35.640 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6554999999999998e-05 2024-05-08T18:30:35.640 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.640 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.640 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:35.641 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.812808+0000", 2024-05-08T18:30:35.641 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7095000000000001e-05 2024-05-08T18:30:35.641 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:35.641 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:35.641 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:35.641 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.641 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.641 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:35.641 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.105553+0000", 2024-05-08T18:30:35.641 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 43.497824948999998, 2024-05-08T18:30:35.641 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028754850000000001, 2024-05-08T18:30:35.641 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:35.641 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:35.641 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:35.641 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:35.642 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:35.642 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:35.642 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 742 2024-05-08T18:30:35.642 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.642 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:35.642 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.642 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:35.642 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.105553+0000", 2024-05-08T18:30:35.642 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:35.642 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.642 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.642 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:35.642 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.105553+0000", 2024-05-08T18:30:35.642 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:35.643 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.643 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.643 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:35.643 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.105556+0000", 2024-05-08T18:30:35.643 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3100000000000001e-06 2024-05-08T18:30:35.643 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.643 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.643 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:35.643 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.105569+0000", 2024-05-08T18:30:35.643 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2754e-05 2024-05-08T18:30:35.643 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.643 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.643 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:35.643 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.105601+0000", 2024-05-08T18:30:35.643 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2435999999999999e-05 2024-05-08T18:30:35.644 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.644 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.644 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:35.644 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.105616+0000", 2024-05-08T18:30:35.644 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4657e-05 2024-05-08T18:30:35.644 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.644 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.644 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:35.644 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.105804+0000", 2024-05-08T18:30:35.644 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00018861799999999999 2024-05-08T18:30:35.644 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.644 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.644 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:35.644 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.106054+0000", 2024-05-08T18:30:35.645 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024948499999999997 2024-05-08T18:30:35.645 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.645 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.645 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:35.645 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.106390+0000", 2024-05-08T18:30:35.645 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00033640100000000001 2024-05-08T18:30:35.645 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.645 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.645 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:35.645 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.107527+0000", 2024-05-08T18:30:35.645 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001136871 2024-05-08T18:30:35.645 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.645 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.645 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:35.646 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.108265+0000", 2024-05-08T18:30:35.646 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00073753100000000004 2024-05-08T18:30:35.646 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.646 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.646 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:35.646 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.108353+0000", 2024-05-08T18:30:35.646 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8232999999999994e-05 2024-05-08T18:30:35.646 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.646 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.646 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:35.646 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.108428+0000", 2024-05-08T18:30:35.646 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.5189000000000001e-05 2024-05-08T18:30:35.646 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:35.646 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:35.647 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:35.647 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.647 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.647 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:35.647 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.148015+0000", 2024-05-08T18:30:35.647 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 43.455363005999999, 2024-05-08T18:30:35.647 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032297409999999999, 2024-05-08T18:30:35.647 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:35.647 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:35.647 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:35.647 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:35.647 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:35.647 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:35.647 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 760 2024-05-08T18:30:35.647 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.648 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:35.648 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.648 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:35.648 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.148015+0000", 2024-05-08T18:30:35.648 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:35.648 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.648 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.648 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:35.648 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.148015+0000", 2024-05-08T18:30:35.648 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:35.648 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.648 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.648 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:35.649 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.148017+0000", 2024-05-08T18:30:35.649 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1830000000000001e-06 2024-05-08T18:30:35.649 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.649 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.649 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:35.649 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.148030+0000", 2024-05-08T18:30:35.649 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2893e-05 2024-05-08T18:30:35.649 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.649 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.649 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:35.649 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.148061+0000", 2024-05-08T18:30:35.649 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0953e-05 2024-05-08T18:30:35.649 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.649 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.649 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:35.650 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.148077+0000", 2024-05-08T18:30:35.650 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6554000000000001e-05 2024-05-08T18:30:35.650 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.650 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.650 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:35.650 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.148230+0000", 2024-05-08T18:30:35.650 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015263899999999999 2024-05-08T18:30:35.650 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.650 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.650 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:35.650 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.148592+0000", 2024-05-08T18:30:35.650 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00036219699999999997 2024-05-08T18:30:35.650 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.651 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.651 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:35.651 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.149139+0000", 2024-05-08T18:30:35.651 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00054734599999999999 2024-05-08T18:30:35.651 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.651 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.651 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:35.651 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.150505+0000", 2024-05-08T18:30:35.651 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001365479 2024-05-08T18:30:35.651 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.651 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.652 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:35.652 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.151087+0000", 2024-05-08T18:30:35.652 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00058201200000000002 2024-05-08T18:30:35.652 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.652 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.652 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:35.652 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.151175+0000", 2024-05-08T18:30:35.652 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8199e-05 2024-05-08T18:30:35.652 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.652 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.652 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:35.652 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.151244+0000", 2024-05-08T18:30:35.652 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9286e-05 2024-05-08T18:30:35.652 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:35.652 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:35.653 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:35.653 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.653 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.653 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:35.653 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.277376+0000", 2024-05-08T18:30:35.653 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 43.326001087999998, 2024-05-08T18:30:35.653 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032022190000000001, 2024-05-08T18:30:35.653 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:35.653 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:35.653 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:35.653 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:35.653 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:35.653 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:35.653 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 817 2024-05-08T18:30:35.654 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.654 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:35.654 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.654 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:35.654 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.277376+0000", 2024-05-08T18:30:35.654 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:35.654 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.654 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.654 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:35.654 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.277376+0000", 2024-05-08T18:30:35.654 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:35.654 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.654 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.654 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:35.655 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.277379+0000", 2024-05-08T18:30:35.655 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4430000000000002e-06 2024-05-08T18:30:35.655 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.655 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.655 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:35.655 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.277391+0000", 2024-05-08T18:30:35.655 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1634000000000001e-05 2024-05-08T18:30:35.655 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.655 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.655 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:35.655 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.277421+0000", 2024-05-08T18:30:35.655 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0691999999999997e-05 2024-05-08T18:30:35.655 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.655 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.656 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:35.656 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.277438+0000", 2024-05-08T18:30:35.656 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7102999999999999e-05 2024-05-08T18:30:35.656 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.656 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.656 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:35.656 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.277602+0000", 2024-05-08T18:30:35.656 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016345300000000001 2024-05-08T18:30:35.656 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.656 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.656 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:35.656 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.278019+0000", 2024-05-08T18:30:35.656 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00041724699999999998 2024-05-08T18:30:35.656 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.657 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.657 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:35.657 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.278573+0000", 2024-05-08T18:30:35.657 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00055391900000000005 2024-05-08T18:30:35.657 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.657 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.657 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:35.657 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.279973+0000", 2024-05-08T18:30:35.657 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0013995819999999999 2024-05-08T18:30:35.657 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.657 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.657 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:35.657 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.280422+0000", 2024-05-08T18:30:35.657 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00044940699999999997 2024-05-08T18:30:35.658 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.658 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.658 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:35.658 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.280509+0000", 2024-05-08T18:30:35.658 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7455999999999997e-05 2024-05-08T18:30:35.658 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.658 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.658 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:35.658 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.280579+0000", 2024-05-08T18:30:35.658 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9282999999999994e-05 2024-05-08T18:30:35.658 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:35.658 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:35.658 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:35.659 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.659 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.659 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:35.659 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.281716+0000", 2024-05-08T18:30:35.659 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 43.321661720999998, 2024-05-08T18:30:35.659 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003275881, 2024-05-08T18:30:35.659 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:35.659 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:35.659 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:35.659 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:35.659 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:35.659 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:35.659 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 819 2024-05-08T18:30:35.659 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.660 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:35.660 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.660 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:35.660 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.281716+0000", 2024-05-08T18:30:35.660 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:35.660 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.660 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.660 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:35.660 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.281716+0000", 2024-05-08T18:30:35.660 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:35.660 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.660 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.660 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:35.660 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.281718+0000", 2024-05-08T18:30:35.661 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.863e-06 2024-05-08T18:30:35.661 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.661 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.661 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:35.661 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.281728+0000", 2024-05-08T18:30:35.661 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0550000000000001e-05 2024-05-08T18:30:35.661 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.661 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.661 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:35.661 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.281760+0000", 2024-05-08T18:30:35.661 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2150000000000002e-05 2024-05-08T18:30:35.661 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.661 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.662 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:35.662 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.281776+0000", 2024-05-08T18:30:35.662 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6005999999999999e-05 2024-05-08T18:30:35.662 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.662 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.662 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:35.662 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.281917+0000", 2024-05-08T18:30:35.662 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014070200000000001 2024-05-08T18:30:35.662 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.662 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.662 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:35.662 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.282148+0000", 2024-05-08T18:30:35.662 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023095200000000001 2024-05-08T18:30:35.662 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.663 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.663 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:35.663 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.282641+0000", 2024-05-08T18:30:35.663 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00049337999999999997 2024-05-08T18:30:35.663 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.663 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.663 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:35.663 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.284070+0000", 2024-05-08T18:30:35.663 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0014287950000000001 2024-05-08T18:30:35.663 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.663 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.663 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:35.663 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.284837+0000", 2024-05-08T18:30:35.663 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00076679799999999996 2024-05-08T18:30:35.664 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.664 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.664 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:35.664 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.284925+0000", 2024-05-08T18:30:35.664 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8165999999999996e-05 2024-05-08T18:30:35.664 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.664 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.664 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:35.664 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.284992+0000", 2024-05-08T18:30:35.664 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6519000000000005e-05 2024-05-08T18:30:35.664 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:35.664 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:35.664 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:35.664 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.665 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.665 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:35.665 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.334745+0000", 2024-05-08T18:30:35.665 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 43.268632811000003, 2024-05-08T18:30:35.665 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032404719999999999, 2024-05-08T18:30:35.665 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:35.665 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:35.665 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:35.665 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:35.665 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:35.665 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:35.665 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 841 2024-05-08T18:30:35.665 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.665 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:35.666 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.666 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:35.666 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.334745+0000", 2024-05-08T18:30:35.666 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:35.666 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.666 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.666 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:35.666 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.334745+0000", 2024-05-08T18:30:35.666 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:35.666 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.666 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.666 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:35.666 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.334747+0000", 2024-05-08T18:30:35.666 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.407e-06 2024-05-08T18:30:35.667 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.667 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.667 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:35.667 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.334759+0000", 2024-05-08T18:30:35.667 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1883e-05 2024-05-08T18:30:35.667 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.667 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.667 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:35.667 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.334789+0000", 2024-05-08T18:30:35.667 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9957000000000001e-05 2024-05-08T18:30:35.667 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.667 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.667 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:35.667 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.334804+0000", 2024-05-08T18:30:35.668 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4713e-05 2024-05-08T18:30:35.668 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.668 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.668 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:35.668 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.334951+0000", 2024-05-08T18:30:35.668 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000147675 2024-05-08T18:30:35.668 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.668 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.668 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:35.668 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.335304+0000", 2024-05-08T18:30:35.668 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00035214099999999999 2024-05-08T18:30:35.668 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.668 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.668 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:35.668 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.335859+0000", 2024-05-08T18:30:35.669 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00055546899999999995 2024-05-08T18:30:35.669 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.669 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.669 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:35.669 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.337168+0000", 2024-05-08T18:30:35.669 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0013087299999999999 2024-05-08T18:30:35.669 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.669 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.669 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:35.669 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.337808+0000", 2024-05-08T18:30:35.669 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00064005500000000005 2024-05-08T18:30:35.669 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.669 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.669 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:35.669 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.337894+0000", 2024-05-08T18:30:35.670 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6593000000000003e-05 2024-05-08T18:30:35.670 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.670 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.670 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:35.670 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.337985+0000", 2024-05-08T18:30:35.670 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0848999999999997e-05 2024-05-08T18:30:35.670 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:35.670 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:35.670 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:35.670 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.670 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.670 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:35.670 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.338870+0000", 2024-05-08T18:30:35.670 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 43.264508061999997, 2024-05-08T18:30:35.671 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002862121, 2024-05-08T18:30:35.671 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:35.671 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:35.671 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:35.671 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:35.671 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:35.671 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:35.671 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 843 2024-05-08T18:30:35.671 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.671 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:35.671 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.671 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:35.671 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.338870+0000", 2024-05-08T18:30:35.672 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:35.672 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.672 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.672 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:35.672 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.338870+0000", 2024-05-08T18:30:35.672 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:35.672 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.672 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.672 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:35.672 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.338872+0000", 2024-05-08T18:30:35.672 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3429999999999998e-06 2024-05-08T18:30:35.672 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.672 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.672 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:35.672 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.338883+0000", 2024-05-08T18:30:35.673 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1447000000000001e-05 2024-05-08T18:30:35.673 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.673 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.673 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:35.673 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.338914+0000", 2024-05-08T18:30:35.673 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1052e-05 2024-05-08T18:30:35.673 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.673 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.673 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:35.673 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.338932+0000", 2024-05-08T18:30:35.673 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7604e-05 2024-05-08T18:30:35.673 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.673 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.673 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:35.674 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.339019+0000", 2024-05-08T18:30:35.674 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6982000000000002e-05 2024-05-08T18:30:35.674 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.674 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.674 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:35.674 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.339139+0000", 2024-05-08T18:30:35.674 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011978599999999999 2024-05-08T18:30:35.674 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.674 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.674 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:35.674 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.339415+0000", 2024-05-08T18:30:35.674 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00027644799999999999 2024-05-08T18:30:35.674 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.675 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.675 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:35.675 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.340619+0000", 2024-05-08T18:30:35.675 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012043010000000001 2024-05-08T18:30:35.675 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.675 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.675 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:35.675 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.341454+0000", 2024-05-08T18:30:35.675 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00083464300000000004 2024-05-08T18:30:35.675 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.675 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.675 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:35.675 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.341609+0000", 2024-05-08T18:30:35.676 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000154752 2024-05-08T18:30:35.676 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.676 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.676 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:35.676 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.341732+0000", 2024-05-08T18:30:35.676 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012276299999999999 2024-05-08T18:30:35.676 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:35.676 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:35.676 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:35.676 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.676 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.676 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:35.676 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.349287+0000", 2024-05-08T18:30:35.676 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 43.254090232999999, 2024-05-08T18:30:35.677 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032683220000000002, 2024-05-08T18:30:35.677 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:35.677 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:35.677 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:35.677 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:35.677 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:35.677 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:35.677 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 847 2024-05-08T18:30:35.677 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.677 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:35.677 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.677 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:35.677 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.349287+0000", 2024-05-08T18:30:35.678 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:35.678 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.678 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.678 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:35.678 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.349287+0000", 2024-05-08T18:30:35.678 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:35.678 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.678 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.678 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:35.678 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.349290+0000", 2024-05-08T18:30:35.678 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3369999999999998e-06 2024-05-08T18:30:35.678 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.678 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.678 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:35.678 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.349318+0000", 2024-05-08T18:30:35.679 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8419999999999999e-05 2024-05-08T18:30:35.679 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.679 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.679 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:35.679 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.349348+0000", 2024-05-08T18:30:35.679 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0260000000000002e-05 2024-05-08T18:30:35.679 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.679 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.679 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:35.679 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.349364+0000", 2024-05-08T18:30:35.679 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5359999999999999e-05 2024-05-08T18:30:35.679 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.679 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.679 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:35.680 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.349511+0000", 2024-05-08T18:30:35.680 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014760199999999999 2024-05-08T18:30:35.680 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.680 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.680 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:35.680 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.349872+0000", 2024-05-08T18:30:35.680 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00036035 2024-05-08T18:30:35.680 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.680 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.680 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:35.680 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.350432+0000", 2024-05-08T18:30:35.680 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00056059600000000001 2024-05-08T18:30:35.680 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.680 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.681 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:35.681 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.351817+0000", 2024-05-08T18:30:35.681 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001385063 2024-05-08T18:30:35.681 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.681 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.681 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:35.681 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.352402+0000", 2024-05-08T18:30:35.681 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00058490500000000004 2024-05-08T18:30:35.681 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.681 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.681 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:35.681 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.352488+0000", 2024-05-08T18:30:35.681 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6032999999999994e-05 2024-05-08T18:30:35.681 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.681 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.682 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:35.682 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.352556+0000", 2024-05-08T18:30:35.682 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7396000000000003e-05 2024-05-08T18:30:35.682 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:35.682 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:35.682 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:35.682 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.682 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.682 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:35.682 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.353786+0000", 2024-05-08T18:30:35.682 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 43.249591398, 2024-05-08T18:30:35.682 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0029130850000000002, 2024-05-08T18:30:35.682 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:35.682 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:35.683 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:35.683 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:35.683 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:35.683 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:35.683 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 849 2024-05-08T18:30:35.683 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.683 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:35.683 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.683 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:35.683 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.353786+0000", 2024-05-08T18:30:35.683 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:35.683 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.683 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.683 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:35.683 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.353786+0000", 2024-05-08T18:30:35.684 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:35.684 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.684 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.684 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:35.684 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.353788+0000", 2024-05-08T18:30:35.684 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0370000000000001e-06 2024-05-08T18:30:35.684 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.684 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.684 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:35.684 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.353799+0000", 2024-05-08T18:30:35.684 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0686000000000001e-05 2024-05-08T18:30:35.684 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.684 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.684 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:35.684 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.353832+0000", 2024-05-08T18:30:35.685 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.341e-05 2024-05-08T18:30:35.685 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.685 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.685 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:35.685 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.353851+0000", 2024-05-08T18:30:35.685 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8343999999999999e-05 2024-05-08T18:30:35.685 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.685 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.685 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:35.685 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.353980+0000", 2024-05-08T18:30:35.685 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012914900000000001 2024-05-08T18:30:35.685 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.685 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.685 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:35.686 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.354123+0000", 2024-05-08T18:30:35.686 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000142912 2024-05-08T18:30:35.686 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.686 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.686 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:35.686 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.354393+0000", 2024-05-08T18:30:35.686 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00027009799999999997 2024-05-08T18:30:35.686 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.686 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.686 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:35.686 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.355769+0000", 2024-05-08T18:30:35.686 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001375839 2024-05-08T18:30:35.686 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.686 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.687 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:35.687 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.356421+0000", 2024-05-08T18:30:35.687 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00065227799999999995 2024-05-08T18:30:35.687 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.687 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.687 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:35.687 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.356592+0000", 2024-05-08T18:30:35.687 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000170586 2024-05-08T18:30:35.687 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.687 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.687 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:35.687 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.356699+0000", 2024-05-08T18:30:35.687 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010774599999999999 2024-05-08T18:30:35.687 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:35.688 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:35.688 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:35.688 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.688 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.688 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:35.688 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.402673+0000", 2024-05-08T18:30:35.688 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 43.200704725000001, 2024-05-08T18:30:35.688 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002928295, 2024-05-08T18:30:35.688 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:35.688 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:35.688 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:35.688 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:35.688 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:35.688 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:35.688 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 870 2024-05-08T18:30:35.689 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.689 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:35.689 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.689 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:35.689 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.402673+0000", 2024-05-08T18:30:35.689 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:35.689 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.689 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.689 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:35.689 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.402673+0000", 2024-05-08T18:30:35.689 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:35.689 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.689 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.689 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:35.690 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.402675+0000", 2024-05-08T18:30:35.690 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0030000000000001e-06 2024-05-08T18:30:35.690 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.690 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.690 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:35.690 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.402685+0000", 2024-05-08T18:30:35.690 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0566e-05 2024-05-08T18:30:35.690 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.690 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.690 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:35.690 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.402714+0000", 2024-05-08T18:30:35.690 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8804999999999999e-05 2024-05-08T18:30:35.690 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.690 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.690 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:35.691 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.402731+0000", 2024-05-08T18:30:35.691 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6731e-05 2024-05-08T18:30:35.691 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.691 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.691 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:35.691 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.402863+0000", 2024-05-08T18:30:35.691 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013194199999999999 2024-05-08T18:30:35.691 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.691 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.691 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:35.691 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.403096+0000", 2024-05-08T18:30:35.691 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023309900000000001 2024-05-08T18:30:35.691 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.691 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.692 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:35.692 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.403553+0000", 2024-05-08T18:30:35.692 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00045738700000000002 2024-05-08T18:30:35.692 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.692 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.692 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:35.692 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.404843+0000", 2024-05-08T18:30:35.692 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012894650000000001 2024-05-08T18:30:35.692 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.692 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.692 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:35.692 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.405348+0000", 2024-05-08T18:30:35.692 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00050483600000000004 2024-05-08T18:30:35.692 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.692 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.693 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:35.693 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.405491+0000", 2024-05-08T18:30:35.693 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014349299999999999 2024-05-08T18:30:35.693 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.693 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.693 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:35.693 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.405601+0000", 2024-05-08T18:30:35.693 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000109968 2024-05-08T18:30:35.693 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:35.693 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:35.693 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:35.693 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.693 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.693 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:35.694 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.484247+0000", 2024-05-08T18:30:35.694 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 43.119130525000003, 2024-05-08T18:30:35.694 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028903679999999999, 2024-05-08T18:30:35.694 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:35.694 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:35.694 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:35.694 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:35.694 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:35.694 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:35.694 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 907 2024-05-08T18:30:35.694 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.694 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:35.694 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.694 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:35.695 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.484247+0000", 2024-05-08T18:30:35.695 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:35.695 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.695 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.695 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:35.695 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.484247+0000", 2024-05-08T18:30:35.695 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:35.695 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.695 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.695 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:35.695 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.484250+0000", 2024-05-08T18:30:35.695 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6900000000000001e-06 2024-05-08T18:30:35.695 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.695 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.696 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:35.696 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.484263+0000", 2024-05-08T18:30:35.696 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2967e-05 2024-05-08T18:30:35.696 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.696 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.696 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:35.696 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.484294+0000", 2024-05-08T18:30:35.696 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1016000000000003e-05 2024-05-08T18:30:35.696 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.696 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.696 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:35.696 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.484309+0000", 2024-05-08T18:30:35.696 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5187e-05 2024-05-08T18:30:35.696 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.697 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.697 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:35.697 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.484467+0000", 2024-05-08T18:30:35.697 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015810499999999999 2024-05-08T18:30:35.697 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.697 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.697 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:35.697 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.484698+0000", 2024-05-08T18:30:35.697 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000230852 2024-05-08T18:30:35.697 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.697 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.697 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:35.697 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.485026+0000", 2024-05-08T18:30:35.697 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00032833 2024-05-08T18:30:35.697 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.698 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.698 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:35.698 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.486177+0000", 2024-05-08T18:30:35.698 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0011504309999999999 2024-05-08T18:30:35.698 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.698 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.698 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:35.698 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.486978+0000", 2024-05-08T18:30:35.698 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000801161 2024-05-08T18:30:35.698 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.698 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.698 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:35.698 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.487068+0000", 2024-05-08T18:30:35.698 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0435999999999999e-05 2024-05-08T18:30:35.699 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.699 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.699 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:35.699 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.487137+0000", 2024-05-08T18:30:35.699 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9193e-05 2024-05-08T18:30:35.699 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:35.699 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:35.699 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:35.699 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.699 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.699 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:35.699 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.585363+0000", 2024-05-08T18:30:35.699 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 43.018014682, 2024-05-08T18:30:35.700 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028400080000000002, 2024-05-08T18:30:35.700 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:35.700 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:35.700 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:35.700 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:35.700 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:35.700 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:35.700 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 949 2024-05-08T18:30:35.700 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.700 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:35.700 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.700 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:35.700 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.585363+0000", 2024-05-08T18:30:35.700 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:35.700 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.701 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.701 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:35.701 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.585363+0000", 2024-05-08T18:30:35.701 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:35.701 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.701 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.701 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:35.701 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.585366+0000", 2024-05-08T18:30:35.701 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7099999999999999e-06 2024-05-08T18:30:35.701 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.701 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.701 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:35.701 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.585378+0000", 2024-05-08T18:30:35.701 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1970000000000001e-05 2024-05-08T18:30:35.701 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.702 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.702 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:35.702 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.585408+0000", 2024-05-08T18:30:35.702 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0389999999999999e-05 2024-05-08T18:30:35.702 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.702 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.702 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:35.702 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.585423+0000", 2024-05-08T18:30:35.702 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4929999999999999e-05 2024-05-08T18:30:35.702 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.702 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.702 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:35.702 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.585559+0000", 2024-05-08T18:30:35.702 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013563599999999999 2024-05-08T18:30:35.703 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.703 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.703 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:35.703 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.585780+0000", 2024-05-08T18:30:35.703 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000221828 2024-05-08T18:30:35.703 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.703 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.703 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:35.703 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.586121+0000", 2024-05-08T18:30:35.703 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000340181 2024-05-08T18:30:35.703 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.703 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.703 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:35.703 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.587268+0000", 2024-05-08T18:30:35.703 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001146984 2024-05-08T18:30:35.704 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.704 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.704 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:35.704 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.588047+0000", 2024-05-08T18:30:35.704 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000779877 2024-05-08T18:30:35.704 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.704 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.704 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:35.704 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.588136+0000", 2024-05-08T18:30:35.704 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8483e-05 2024-05-08T18:30:35.704 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.704 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.704 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:35.704 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.588203+0000", 2024-05-08T18:30:35.704 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7019000000000003e-05 2024-05-08T18:30:35.705 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:35.705 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:35.705 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:35.705 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.705 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.705 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:951 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:35.705 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.589044+0000", 2024-05-08T18:30:35.705 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 43.014333260000001, 2024-05-08T18:30:35.705 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002802672, 2024-05-08T18:30:35.705 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:35.705 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:35.705 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:35.705 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:35.705 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:35.705 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:35.706 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 951 2024-05-08T18:30:35.706 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.706 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:35.706 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.706 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:35.706 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.589044+0000", 2024-05-08T18:30:35.706 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:35.706 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.706 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.706 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:35.706 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.589044+0000", 2024-05-08T18:30:35.706 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:35.706 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.706 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.707 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:35.707 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.589046+0000", 2024-05-08T18:30:35.707 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6670000000000001e-06 2024-05-08T18:30:35.707 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.707 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.707 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:35.707 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.589054+0000", 2024-05-08T18:30:35.707 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.2600000000000005e-06 2024-05-08T18:30:35.707 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.707 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.707 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:35.707 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.589076+0000", 2024-05-08T18:30:35.707 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1373e-05 2024-05-08T18:30:35.707 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.707 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.708 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:35.708 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.589088+0000", 2024-05-08T18:30:35.708 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2768999999999999e-05 2024-05-08T18:30:35.708 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.708 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.708 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:35.708 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.589220+0000", 2024-05-08T18:30:35.708 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013146300000000001 2024-05-08T18:30:35.708 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.708 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.708 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:35.708 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.589462+0000", 2024-05-08T18:30:35.708 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024250500000000001 2024-05-08T18:30:35.708 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.709 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.709 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:35.709 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.589956+0000", 2024-05-08T18:30:35.709 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00049331600000000005 2024-05-08T18:30:35.709 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.709 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.709 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:35.709 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.591337+0000", 2024-05-08T18:30:35.709 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0013816290000000001 2024-05-08T18:30:35.709 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.709 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.709 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:35.709 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.591688+0000", 2024-05-08T18:30:35.709 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00035083400000000001 2024-05-08T18:30:35.709 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.710 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.710 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:35.710 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.591780+0000", 2024-05-08T18:30:35.710 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.2312999999999995e-05 2024-05-08T18:30:35.710 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.710 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.710 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:35.710 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.591847+0000", 2024-05-08T18:30:35.710 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6543000000000003e-05 2024-05-08T18:30:35.710 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:35.710 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:35.710 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:35.710 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.710 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.711 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:35.711 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.599312+0000", 2024-05-08T18:30:35.711 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 43.004065795999999, 2024-05-08T18:30:35.711 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0027928190000000002, 2024-05-08T18:30:35.711 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:35.711 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:35.711 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:35.711 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:35.711 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:35.711 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:35.711 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 955 2024-05-08T18:30:35.711 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.711 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:35.711 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.712 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:35.712 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.599312+0000", 2024-05-08T18:30:35.712 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:35.712 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.712 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.712 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:35.712 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.599312+0000", 2024-05-08T18:30:35.712 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:35.712 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.712 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.712 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:35.712 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.599314+0000", 2024-05-08T18:30:35.712 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.396e-06 2024-05-08T18:30:35.712 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.713 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.713 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:35.713 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.599325+0000", 2024-05-08T18:30:35.713 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1063999999999999e-05 2024-05-08T18:30:35.713 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.713 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.713 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:35.713 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.599354+0000", 2024-05-08T18:30:35.713 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8462999999999998e-05 2024-05-08T18:30:35.713 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.713 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.713 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:35.713 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.599369+0000", 2024-05-08T18:30:35.713 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4963000000000001e-05 2024-05-08T18:30:35.714 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.714 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.714 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:35.714 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.599503+0000", 2024-05-08T18:30:35.714 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013385299999999999 2024-05-08T18:30:35.714 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.714 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.714 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:35.714 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.599744+0000", 2024-05-08T18:30:35.714 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024137400000000001 2024-05-08T18:30:35.714 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.714 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.714 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:35.714 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.600084+0000", 2024-05-08T18:30:35.715 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00033999399999999998 2024-05-08T18:30:35.715 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.715 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.715 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:35.715 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.601319+0000", 2024-05-08T18:30:35.715 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012348140000000001 2024-05-08T18:30:35.715 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.715 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.715 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:35.715 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.601956+0000", 2024-05-08T18:30:35.715 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00063721199999999996 2024-05-08T18:30:35.715 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.715 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.715 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:35.715 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.602038+0000", 2024-05-08T18:30:35.716 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.1705999999999993e-05 2024-05-08T18:30:35.716 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:35.716 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:35.716 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:35.716 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.602105+0000", 2024-05-08T18:30:35.716 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6979999999999999e-05 2024-05-08T18:30:35.716 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:35.716 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:35.716 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:35.716 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:35.716 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:35.716 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:30:35.718 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-08T18:30:35.718 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:30:35.716+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:30:35.818 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:30:35.820+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:30:35.887 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:30:35.887 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:30:35.887 INFO:teuthology.orchestra.run.smithi097.stdout: "num_ops": 0 2024-05-08T18:30:35.887 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:30:35.900 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-08T18:30:35.942 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:30:35.944+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:30:36.020 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:30:36.020+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:30:36.064 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:30:36.064 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:30:36.064 INFO:teuthology.orchestra.run.smithi097.stdout: "complaint_time": 30, 2024-05-08T18:30:36.064 INFO:teuthology.orchestra.run.smithi097.stdout: "num_blocked_ops": 0 2024-05-08T18:30:36.064 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:30:36.077 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-08T18:30:36.162 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:30:36.164+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:30:36.222 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:30:36.224+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:30:36.242 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:30:36.242 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2024-05-08T18:30:36.242 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2024-05-08T18:30:36.242 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-05-08T18:30:36.242 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.243 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:57 7.3 7:c609908c:::notify.5:head [watch watch cookie 94069412621696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:30:36.243 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:48.668590+0000", 2024-05-08T18:30:36.243 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 47.574893932000002, 2024-05-08T18:30:36.243 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0054375830000000002, 2024-05-08T18:30:36.243 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:36.243 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:36.243 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:36.243 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:36.243 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:36.243 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:36.243 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 57 2024-05-08T18:30:36.243 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.243 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:36.244 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.244 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:36.244 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668590+0000", 2024-05-08T18:30:36.244 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:36.244 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.244 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.244 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:36.244 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668590+0000", 2024-05-08T18:30:36.244 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:36.244 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.244 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.244 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:36.244 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668592+0000", 2024-05-08T18:30:36.244 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0930000000000001e-06 2024-05-08T18:30:36.245 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.245 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.245 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:36.245 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668619+0000", 2024-05-08T18:30:36.245 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7396999999999999e-05 2024-05-08T18:30:36.245 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.245 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.245 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:36.246 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668650+0000", 2024-05-08T18:30:36.246 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0620000000000002e-05 2024-05-08T18:30:36.246 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.246 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.246 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:36.246 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668672+0000", 2024-05-08T18:30:36.246 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2093e-05 2024-05-08T18:30:36.246 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.247 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.247 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:36.247 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668782+0000", 2024-05-08T18:30:36.247 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011010600000000001 2024-05-08T18:30:36.247 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.247 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.247 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:36.247 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668934+0000", 2024-05-08T18:30:36.247 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000152268 2024-05-08T18:30:36.247 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.247 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.247 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-05-08T18:30:36.247 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669177+0000", 2024-05-08T18:30:36.247 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024286500000000001 2024-05-08T18:30:36.248 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.248 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.248 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:36.248 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.670404+0000", 2024-05-08T18:30:36.248 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001226932 2024-05-08T18:30:36.248 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.248 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.248 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:36.248 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.673822+0000", 2024-05-08T18:30:36.248 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003417776 2024-05-08T18:30:36.248 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.248 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.248 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:36.248 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.673924+0000", 2024-05-08T18:30:36.249 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000102379 2024-05-08T18:30:36.249 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.249 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.249 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:36.249 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674027+0000", 2024-05-08T18:30:36.249 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010305400000000001 2024-05-08T18:30:36.249 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:36.249 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:36.249 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:36.249 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.249 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.249 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:58 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:30:36.249 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:48.668750+0000", 2024-05-08T18:30:36.249 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 47.574733506000001, 2024-05-08T18:30:36.250 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0057687559999999999, 2024-05-08T18:30:36.250 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:36.250 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:36.250 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:36.250 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:36.250 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:36.250 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:36.250 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 58 2024-05-08T18:30:36.250 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.251 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:36.251 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.251 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:36.251 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668750+0000", 2024-05-08T18:30:36.251 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:36.251 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.252 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.252 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:36.252 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668750+0000", 2024-05-08T18:30:36.252 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:36.252 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.252 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.252 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:36.252 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668752+0000", 2024-05-08T18:30:36.252 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.64e-06 2024-05-08T18:30:36.252 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.252 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.252 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:36.252 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668760+0000", 2024-05-08T18:30:36.252 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5529999999999993e-06 2024-05-08T18:30:36.252 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.253 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.253 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:36.253 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668787+0000", 2024-05-08T18:30:36.253 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6475999999999999e-05 2024-05-08T18:30:36.253 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.253 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.253 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:36.253 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668804+0000", 2024-05-08T18:30:36.253 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7163000000000002e-05 2024-05-08T18:30:36.253 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.253 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.253 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:36.253 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668906+0000", 2024-05-08T18:30:36.253 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010241 2024-05-08T18:30:36.254 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.254 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.254 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:36.254 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669068+0000", 2024-05-08T18:30:36.254 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016144400000000001 2024-05-08T18:30:36.254 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.254 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.254 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-05-08T18:30:36.254 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669226+0000", 2024-05-08T18:30:36.254 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000158639 2024-05-08T18:30:36.254 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.255 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.255 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:36.255 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.670439+0000", 2024-05-08T18:30:36.255 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012124480000000001 2024-05-08T18:30:36.255 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.255 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.255 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:36.255 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674406+0000", 2024-05-08T18:30:36.255 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0039675259999999999 2024-05-08T18:30:36.255 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.255 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.255 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:36.255 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674469+0000", 2024-05-08T18:30:36.255 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.2903000000000004e-05 2024-05-08T18:30:36.256 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.256 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.256 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:36.256 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674519+0000", 2024-05-08T18:30:36.256 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9554e-05 2024-05-08T18:30:36.256 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:36.256 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:36.256 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:36.256 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.256 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.256 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:30:36.257 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.675404+0000", 2024-05-08T18:30:36.257 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 44.568079734999998, 2024-05-08T18:30:36.257 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003903147, 2024-05-08T18:30:36.257 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:36.257 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:36.258 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:36.258 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:36.258 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:36.258 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:36.258 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 207 2024-05-08T18:30:36.258 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.258 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:36.258 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.258 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:36.258 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675404+0000", 2024-05-08T18:30:36.258 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:36.258 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.259 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.259 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:36.259 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675404+0000", 2024-05-08T18:30:36.259 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:36.259 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.259 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.259 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:36.259 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675407+0000", 2024-05-08T18:30:36.259 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1729999999999999e-06 2024-05-08T18:30:36.259 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.259 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.259 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:36.259 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675422+0000", 2024-05-08T18:30:36.259 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.485e-05 2024-05-08T18:30:36.260 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.260 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.260 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:36.260 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675454+0000", 2024-05-08T18:30:36.260 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1656000000000003e-05 2024-05-08T18:30:36.260 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.260 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.260 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:36.260 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675470+0000", 2024-05-08T18:30:36.260 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.626e-05 2024-05-08T18:30:36.260 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.260 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.260 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:36.260 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675683+0000", 2024-05-08T18:30:36.261 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021312600000000001 2024-05-08T18:30:36.261 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.261 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.261 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:36.261 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675972+0000", 2024-05-08T18:30:36.261 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00028885100000000002 2024-05-08T18:30:36.261 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.261 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.261 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:30:36.261 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.676369+0000", 2024-05-08T18:30:36.261 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000397227 2024-05-08T18:30:36.262 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.262 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.262 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:36.262 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.677780+0000", 2024-05-08T18:30:36.262 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001411186 2024-05-08T18:30:36.262 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.262 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.262 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:36.262 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679153+0000", 2024-05-08T18:30:36.262 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0013725720000000001 2024-05-08T18:30:36.262 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.262 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.263 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:36.263 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679240+0000", 2024-05-08T18:30:36.263 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7412999999999998e-05 2024-05-08T18:30:36.263 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.263 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.263 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:36.263 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679307+0000", 2024-05-08T18:30:36.263 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6833000000000002e-05 2024-05-08T18:30:36.264 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:36.264 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:36.264 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:36.264 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.264 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.264 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:36.264 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.721317+0000", 2024-05-08T18:30:36.264 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 44.522166988999999, 2024-05-08T18:30:36.264 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032842140000000001, 2024-05-08T18:30:36.264 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:36.264 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:36.264 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:36.264 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:36.265 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:36.265 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:36.265 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 216 2024-05-08T18:30:36.265 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.265 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:36.265 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.265 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:36.265 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.721317+0000", 2024-05-08T18:30:36.265 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:36.265 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.265 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.265 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:36.265 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.721317+0000", 2024-05-08T18:30:36.265 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:36.266 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.266 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.266 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:36.266 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.721320+0000", 2024-05-08T18:30:36.266 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.303e-06 2024-05-08T18:30:36.266 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.266 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.266 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:36.266 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.721335+0000", 2024-05-08T18:30:36.266 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4543e-05 2024-05-08T18:30:36.266 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.266 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.266 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:36.267 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.721370+0000", 2024-05-08T18:30:36.267 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5336000000000002e-05 2024-05-08T18:30:36.267 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.267 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.267 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:36.267 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.721393+0000", 2024-05-08T18:30:36.267 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2710000000000001e-05 2024-05-08T18:30:36.267 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.267 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.267 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:36.267 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.721592+0000", 2024-05-08T18:30:36.267 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00019917900000000001 2024-05-08T18:30:36.268 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.268 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.268 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:36.268 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.721815+0000", 2024-05-08T18:30:36.268 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000223742 2024-05-08T18:30:36.268 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.268 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.269 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:36.269 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.722268+0000", 2024-05-08T18:30:36.269 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00045295900000000001 2024-05-08T18:30:36.269 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.269 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.269 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:36.269 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.723878+0000", 2024-05-08T18:30:36.269 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001609828 2024-05-08T18:30:36.270 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.270 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.270 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:36.270 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.724433+0000", 2024-05-08T18:30:36.270 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00055512499999999995 2024-05-08T18:30:36.270 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.270 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.270 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:36.270 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.724528+0000", 2024-05-08T18:30:36.270 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.4887000000000001e-05 2024-05-08T18:30:36.270 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.271 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.271 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:36.271 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.724601+0000", 2024-05-08T18:30:36.271 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2601999999999994e-05 2024-05-08T18:30:36.271 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:36.271 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:36.271 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:36.271 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.271 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.271 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:36.271 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.761586+0000", 2024-05-08T18:30:36.271 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 44.481898143000002, 2024-05-08T18:30:36.271 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031756979999999998, 2024-05-08T18:30:36.271 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:36.272 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:36.272 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:36.272 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:36.272 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:36.272 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:36.272 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 227 2024-05-08T18:30:36.272 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.272 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:36.272 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.273 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:36.273 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.761586+0000", 2024-05-08T18:30:36.273 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:36.273 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.273 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.273 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:36.273 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.761586+0000", 2024-05-08T18:30:36.273 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:36.273 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.273 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.273 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:36.273 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.761588+0000", 2024-05-08T18:30:36.274 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7499999999999999e-06 2024-05-08T18:30:36.274 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.274 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.274 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:36.274 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.761600+0000", 2024-05-08T18:30:36.274 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2003e-05 2024-05-08T18:30:36.274 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.274 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.274 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:36.274 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.761632+0000", 2024-05-08T18:30:36.274 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1933000000000001e-05 2024-05-08T18:30:36.274 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.274 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.275 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:36.275 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.761648+0000", 2024-05-08T18:30:36.275 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5339999999999999e-05 2024-05-08T18:30:36.275 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.275 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.275 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:36.275 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.761773+0000", 2024-05-08T18:30:36.275 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012576199999999999 2024-05-08T18:30:36.275 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.275 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.275 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:36.275 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.762037+0000", 2024-05-08T18:30:36.275 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00026385100000000001 2024-05-08T18:30:36.276 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.276 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.276 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:36.276 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.762455+0000", 2024-05-08T18:30:36.276 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00041760700000000002 2024-05-08T18:30:36.276 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.276 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.276 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:36.276 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.764035+0000", 2024-05-08T18:30:36.276 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001580318 2024-05-08T18:30:36.277 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.277 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.277 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:36.277 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.764602+0000", 2024-05-08T18:30:36.277 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00056661899999999998 2024-05-08T18:30:36.277 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.277 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.277 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:36.277 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.764685+0000", 2024-05-08T18:30:36.277 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.3562999999999999e-05 2024-05-08T18:30:36.277 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.278 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.278 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:36.278 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.764761+0000", 2024-05-08T18:30:36.278 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.5951999999999994e-05 2024-05-08T18:30:36.278 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:36.278 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:36.278 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:36.278 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.278 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.278 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:36.278 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.768858+0000", 2024-05-08T18:30:36.279 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 44.47462556, 2024-05-08T18:30:36.279 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031906619999999999, 2024-05-08T18:30:36.279 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:36.279 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:36.279 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:36.279 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:36.279 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:36.280 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:36.280 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 229 2024-05-08T18:30:36.280 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.280 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:36.280 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.280 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:36.280 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.768858+0000", 2024-05-08T18:30:36.280 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:36.280 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.280 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.280 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:36.280 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.768858+0000", 2024-05-08T18:30:36.280 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:36.280 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.281 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.281 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:36.281 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.768861+0000", 2024-05-08T18:30:36.281 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5469999999999999e-06 2024-05-08T18:30:36.281 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.281 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.281 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:36.281 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.768872+0000", 2024-05-08T18:30:36.281 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1712999999999999e-05 2024-05-08T18:30:36.281 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.281 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.282 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:36.282 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.768903+0000", 2024-05-08T18:30:36.282 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0636000000000003e-05 2024-05-08T18:30:36.282 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.282 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.282 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:36.282 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.768918+0000", 2024-05-08T18:30:36.282 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4977000000000001e-05 2024-05-08T18:30:36.282 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.282 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.282 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:36.283 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.769037+0000", 2024-05-08T18:30:36.283 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011918599999999999 2024-05-08T18:30:36.283 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.283 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.283 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:36.283 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.769256+0000", 2024-05-08T18:30:36.283 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021839400000000001 2024-05-08T18:30:36.283 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.283 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.283 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:30:36.283 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.769656+0000", 2024-05-08T18:30:36.283 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00040066400000000001 2024-05-08T18:30:36.284 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.284 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.284 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:36.284 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.771116+0000", 2024-05-08T18:30:36.284 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001459389 2024-05-08T18:30:36.284 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.284 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.284 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:36.284 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.771896+0000", 2024-05-08T18:30:36.284 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00077997400000000001 2024-05-08T18:30:36.284 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.284 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.284 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:36.284 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.771984+0000", 2024-05-08T18:30:36.285 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8483e-05 2024-05-08T18:30:36.285 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.285 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.285 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:36.285 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772049+0000", 2024-05-08T18:30:36.285 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.4698999999999998e-05 2024-05-08T18:30:36.285 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:36.285 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:36.285 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:36.285 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.285 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.285 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:36.285 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.776086+0000", 2024-05-08T18:30:36.285 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 44.467397568999999, 2024-05-08T18:30:36.285 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0037528710000000001, 2024-05-08T18:30:36.286 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:36.286 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:36.286 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:36.286 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:36.286 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:36.286 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:36.286 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 231 2024-05-08T18:30:36.286 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.286 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:36.286 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.286 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:36.286 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.776086+0000", 2024-05-08T18:30:36.286 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:36.287 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.287 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.287 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:36.287 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.776086+0000", 2024-05-08T18:30:36.287 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:36.287 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.287 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.287 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:36.287 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.776089+0000", 2024-05-08T18:30:36.287 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8870000000000001e-06 2024-05-08T18:30:36.287 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.287 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.287 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:36.287 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.776102+0000", 2024-05-08T18:30:36.287 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.294e-05 2024-05-08T18:30:36.288 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.288 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.288 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:36.288 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.776132+0000", 2024-05-08T18:30:36.288 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0113000000000001e-05 2024-05-08T18:30:36.288 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.288 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.288 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:36.288 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.776150+0000", 2024-05-08T18:30:36.288 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8216999999999999e-05 2024-05-08T18:30:36.288 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.288 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.288 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:36.288 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.776268+0000", 2024-05-08T18:30:36.289 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000117395 2024-05-08T18:30:36.289 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.289 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.289 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:36.289 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.776514+0000", 2024-05-08T18:30:36.289 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024602899999999999 2024-05-08T18:30:36.289 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.289 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.289 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:36.289 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.776920+0000", 2024-05-08T18:30:36.290 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000406723 2024-05-08T18:30:36.290 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.290 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.290 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:36.290 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.778360+0000", 2024-05-08T18:30:36.290 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0014393279999999999 2024-05-08T18:30:36.290 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.290 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.290 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:36.290 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.779687+0000", 2024-05-08T18:30:36.290 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001327674 2024-05-08T18:30:36.290 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.291 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.291 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:36.291 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.779777+0000", 2024-05-08T18:30:36.291 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9152000000000003e-05 2024-05-08T18:30:36.291 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.291 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.291 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:36.291 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.779839+0000", 2024-05-08T18:30:36.291 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.2413e-05 2024-05-08T18:30:36.291 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:36.291 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:36.291 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:36.291 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.291 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.292 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:257 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:36.292 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.802295+0000", 2024-05-08T18:30:36.292 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 44.441188429, 2024-05-08T18:30:36.292 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0030517880000000002, 2024-05-08T18:30:36.292 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:36.292 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:36.292 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:36.292 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:36.292 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:36.292 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:36.292 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 257 2024-05-08T18:30:36.292 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.292 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:36.292 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.293 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:36.293 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.802295+0000", 2024-05-08T18:30:36.293 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:36.293 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.293 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.293 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:36.293 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.802295+0000", 2024-05-08T18:30:36.294 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:36.294 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.294 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.294 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:36.294 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.802296+0000", 2024-05-08T18:30:36.294 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.6700000000000002e-07 2024-05-08T18:30:36.294 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.294 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.294 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:36.294 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.802301+0000", 2024-05-08T18:30:36.294 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.0250000000000002e-06 2024-05-08T18:30:36.294 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.295 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.295 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:36.295 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.802321+0000", 2024-05-08T18:30:36.295 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9521000000000002e-05 2024-05-08T18:30:36.295 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.295 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.295 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:36.295 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.802330+0000", 2024-05-08T18:30:36.295 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.4259999999999992e-06 2024-05-08T18:30:36.295 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.295 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.295 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:36.295 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.802386+0000", 2024-05-08T18:30:36.295 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5974999999999999e-05 2024-05-08T18:30:36.295 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.296 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.296 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:36.296 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.802463+0000", 2024-05-08T18:30:36.296 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6582999999999995e-05 2024-05-08T18:30:36.296 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.296 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.296 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:36.296 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.802613+0000", 2024-05-08T18:30:36.296 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000150715 2024-05-08T18:30:36.296 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.296 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.296 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:36.296 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.803223+0000", 2024-05-08T18:30:36.296 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00060949799999999998 2024-05-08T18:30:36.297 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.297 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.297 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:36.297 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.805250+0000", 2024-05-08T18:30:36.297 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0020268339999999999 2024-05-08T18:30:36.297 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.297 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.297 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:36.297 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.805303+0000", 2024-05-08T18:30:36.297 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3562e-05 2024-05-08T18:30:36.297 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.297 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.297 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:36.297 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.805347+0000", 2024-05-08T18:30:36.298 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3682e-05 2024-05-08T18:30:36.298 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:36.298 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:36.298 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:36.298 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.298 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.298 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:422 6.c 6:338eb7e9:::obj_delete_at_hint.0000000008:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:36.298 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.847436+0000", 2024-05-08T18:30:36.298 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 44.396047365999998, 2024-05-08T18:30:36.298 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0029413439999999998, 2024-05-08T18:30:36.298 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:36.298 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:36.298 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:36.299 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:36.299 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:36.299 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:36.299 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 422 2024-05-08T18:30:36.299 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.299 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:36.299 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.299 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:36.299 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847436+0000", 2024-05-08T18:30:36.299 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:36.299 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.299 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.299 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:36.300 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847436+0000", 2024-05-08T18:30:36.300 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:36.300 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.300 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.300 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:36.300 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847437+0000", 2024-05-08T18:30:36.300 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.009e-06 2024-05-08T18:30:36.300 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.300 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.300 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:36.300 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847442+0000", 2024-05-08T18:30:36.301 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9049999999999996e-06 2024-05-08T18:30:36.301 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.301 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.301 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:36.301 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847454+0000", 2024-05-08T18:30:36.301 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1358e-05 2024-05-08T18:30:36.301 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.302 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.302 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:36.302 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847459+0000", 2024-05-08T18:30:36.302 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7180000000000001e-06 2024-05-08T18:30:36.302 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.302 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.302 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:36.302 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847516+0000", 2024-05-08T18:30:36.302 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6558999999999998e-05 2024-05-08T18:30:36.302 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.302 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.302 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:36.302 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847582+0000", 2024-05-08T18:30:36.303 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5772000000000007e-05 2024-05-08T18:30:36.303 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.303 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.303 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:36.303 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847718+0000", 2024-05-08T18:30:36.303 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013664100000000001 2024-05-08T18:30:36.303 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.303 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.303 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:36.303 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.848257+0000", 2024-05-08T18:30:36.303 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00053853699999999996 2024-05-08T18:30:36.304 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.304 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.304 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:36.304 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.850320+0000", 2024-05-08T18:30:36.304 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0020627530000000001 2024-05-08T18:30:36.304 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.304 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.304 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:36.304 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.850351+0000", 2024-05-08T18:30:36.305 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1501000000000002e-05 2024-05-08T18:30:36.305 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.305 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.305 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:36.305 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.850378+0000", 2024-05-08T18:30:36.305 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6591e-05 2024-05-08T18:30:36.305 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:36.305 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:36.305 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:36.305 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.305 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.306 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:535 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:36.306 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.912581+0000", 2024-05-08T18:30:36.306 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 44.330902305999999, 2024-05-08T18:30:36.306 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002943775, 2024-05-08T18:30:36.306 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:36.306 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:36.306 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:36.306 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:36.306 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:36.306 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:36.306 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 535 2024-05-08T18:30:36.306 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.306 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:36.307 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.307 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:36.307 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912581+0000", 2024-05-08T18:30:36.307 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:36.307 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.307 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.307 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:36.307 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912581+0000", 2024-05-08T18:30:36.307 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:36.307 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.307 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.307 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:36.307 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912582+0000", 2024-05-08T18:30:36.307 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.093e-06 2024-05-08T18:30:36.308 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.308 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.308 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:36.308 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912588+0000", 2024-05-08T18:30:36.308 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3920000000000002e-06 2024-05-08T18:30:36.308 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.308 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.308 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:36.308 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912601+0000", 2024-05-08T18:30:36.308 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2911000000000001e-05 2024-05-08T18:30:36.308 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.308 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.308 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:36.308 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912607+0000", 2024-05-08T18:30:36.309 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3960000000000003e-06 2024-05-08T18:30:36.309 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.309 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.309 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:36.309 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912664+0000", 2024-05-08T18:30:36.309 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6410999999999999e-05 2024-05-08T18:30:36.309 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.309 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.309 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:36.309 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912721+0000", 2024-05-08T18:30:36.309 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7141000000000001e-05 2024-05-08T18:30:36.309 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.309 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.309 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:36.309 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912842+0000", 2024-05-08T18:30:36.310 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000120868 2024-05-08T18:30:36.310 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.310 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.310 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:36.310 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.913333+0000", 2024-05-08T18:30:36.310 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00049123600000000004 2024-05-08T18:30:36.310 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.310 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.311 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:36.311 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.915446+0000", 2024-05-08T18:30:36.311 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0021135020000000002 2024-05-08T18:30:36.311 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.311 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.311 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:36.311 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.915481+0000", 2024-05-08T18:30:36.311 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4304999999999998e-05 2024-05-08T18:30:36.311 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.312 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.312 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:36.312 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.915525+0000", 2024-05-08T18:30:36.312 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4520000000000001e-05 2024-05-08T18:30:36.312 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:36.312 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:36.312 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:36.312 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.312 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.313 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:541 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:36.313 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.916718+0000", 2024-05-08T18:30:36.313 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 44.326765471000002, 2024-05-08T18:30:36.313 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0041779829999999997, 2024-05-08T18:30:36.313 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:36.313 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:36.313 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:36.313 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:36.314 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:36.314 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:36.314 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 541 2024-05-08T18:30:36.314 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.314 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:36.314 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.314 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:36.314 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.916718+0000", 2024-05-08T18:30:36.315 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:36.315 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.315 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.315 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:36.315 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.916718+0000", 2024-05-08T18:30:36.315 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:36.315 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.315 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.315 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:36.316 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.916719+0000", 2024-05-08T18:30:36.316 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0100000000000005e-07 2024-05-08T18:30:36.316 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.316 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.316 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:36.316 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.916722+0000", 2024-05-08T18:30:36.316 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7760000000000002e-06 2024-05-08T18:30:36.316 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.317 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.317 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:36.317 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.916729+0000", 2024-05-08T18:30:36.317 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.8290000000000008e-06 2024-05-08T18:30:36.317 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.317 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.317 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:36.317 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.916734+0000", 2024-05-08T18:30:36.317 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3109999999999999e-06 2024-05-08T18:30:36.318 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.318 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.318 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:36.318 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.916776+0000", 2024-05-08T18:30:36.318 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.2086999999999999e-05 2024-05-08T18:30:36.318 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.318 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.318 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:36.318 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.916824+0000", 2024-05-08T18:30:36.318 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8412999999999999e-05 2024-05-08T18:30:36.318 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.318 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.319 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:36.319 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.916929+0000", 2024-05-08T18:30:36.319 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010480900000000001 2024-05-08T18:30:36.319 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.319 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.319 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:36.319 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.917428+0000", 2024-05-08T18:30:36.319 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00049889599999999997 2024-05-08T18:30:36.319 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.319 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.319 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:36.319 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.920833+0000", 2024-05-08T18:30:36.319 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0034047140000000001 2024-05-08T18:30:36.320 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.320 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.320 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:36.320 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.920868+0000", 2024-05-08T18:30:36.320 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5750999999999997e-05 2024-05-08T18:30:36.320 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.320 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.320 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:36.320 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.920896+0000", 2024-05-08T18:30:36.320 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7796e-05 2024-05-08T18:30:36.320 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:36.320 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:36.320 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:36.320 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.321 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.321 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:778 6.1b 6:dc490aaa:::obj_delete_at_hint.0000000067:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:36.321 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.191226+0000", 2024-05-08T18:30:36.321 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 44.052257195999999, 2024-05-08T18:30:36.321 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0029603540000000001, 2024-05-08T18:30:36.321 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:36.321 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:36.322 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:36.322 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:36.322 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:36.322 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:36.322 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 778 2024-05-08T18:30:36.322 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.322 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:36.322 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.322 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:36.322 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.191226+0000", 2024-05-08T18:30:36.322 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:36.322 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.322 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.322 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:36.323 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.191226+0000", 2024-05-08T18:30:36.323 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:36.323 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.323 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.323 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:36.323 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.191229+0000", 2024-05-08T18:30:36.323 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5299999999999999e-06 2024-05-08T18:30:36.323 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.323 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.323 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:36.323 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.191242+0000", 2024-05-08T18:30:36.323 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2816999999999999e-05 2024-05-08T18:30:36.323 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.323 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.324 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:36.324 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.191274+0000", 2024-05-08T18:30:36.324 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1846e-05 2024-05-08T18:30:36.324 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.324 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.324 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:36.324 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.191288+0000", 2024-05-08T18:30:36.324 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.468e-05 2024-05-08T18:30:36.324 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.324 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.324 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:36.324 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.191468+0000", 2024-05-08T18:30:36.324 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00017983499999999999 2024-05-08T18:30:36.324 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.325 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.325 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:36.325 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.191688+0000", 2024-05-08T18:30:36.325 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021985799999999999 2024-05-08T18:30:36.325 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.325 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.325 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:30:36.325 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.192001+0000", 2024-05-08T18:30:36.325 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00031337800000000001 2024-05-08T18:30:36.325 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.325 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.326 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:36.326 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.193245+0000", 2024-05-08T18:30:36.326 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012436400000000001 2024-05-08T18:30:36.326 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.326 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.326 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:36.326 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.194036+0000", 2024-05-08T18:30:36.326 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00079059699999999998 2024-05-08T18:30:36.326 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.326 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.327 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:36.327 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.194121+0000", 2024-05-08T18:30:36.327 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5270000000000002e-05 2024-05-08T18:30:36.327 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.327 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.327 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:36.327 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.194187+0000", 2024-05-08T18:30:36.327 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5902999999999996e-05 2024-05-08T18:30:36.327 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:36.327 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:36.327 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:36.327 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.327 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.328 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:780 6.1b 6:dc490aaa:::obj_delete_at_hint.0000000067:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:36.328 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.195206+0000", 2024-05-08T18:30:36.328 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 44.048277227, 2024-05-08T18:30:36.328 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00291544, 2024-05-08T18:30:36.328 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:36.328 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:36.328 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:36.328 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:36.328 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:36.328 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:36.328 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 780 2024-05-08T18:30:36.328 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.328 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:36.328 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.328 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:36.329 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.195206+0000", 2024-05-08T18:30:36.329 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:36.329 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.329 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.329 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:36.329 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.195206+0000", 2024-05-08T18:30:36.329 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:36.329 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.329 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.329 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:36.329 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.195208+0000", 2024-05-08T18:30:36.329 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0669999999999999e-06 2024-05-08T18:30:36.329 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.329 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.330 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:36.330 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.195220+0000", 2024-05-08T18:30:36.330 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.131e-05 2024-05-08T18:30:36.330 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.330 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.330 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:36.330 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.195250+0000", 2024-05-08T18:30:36.330 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0562999999999999e-05 2024-05-08T18:30:36.330 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.330 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.330 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:36.330 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.195270+0000", 2024-05-08T18:30:36.330 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9989000000000001e-05 2024-05-08T18:30:36.330 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.331 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.331 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:36.331 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.195395+0000", 2024-05-08T18:30:36.331 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012439600000000001 2024-05-08T18:30:36.331 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.331 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.331 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:36.331 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.195523+0000", 2024-05-08T18:30:36.331 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012824900000000001 2024-05-08T18:30:36.331 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.332 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.332 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:30:36.332 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.195808+0000", 2024-05-08T18:30:36.332 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00028518100000000002 2024-05-08T18:30:36.332 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.332 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.332 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:36.332 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.196897+0000", 2024-05-08T18:30:36.332 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0010887850000000001 2024-05-08T18:30:36.332 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.332 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.332 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:36.332 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.197964+0000", 2024-05-08T18:30:36.333 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0010671789999999999 2024-05-08T18:30:36.333 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.333 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.333 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:36.333 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.198044+0000", 2024-05-08T18:30:36.333 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.9616000000000005e-05 2024-05-08T18:30:36.333 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.333 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.333 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:36.333 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.198122+0000", 2024-05-08T18:30:36.333 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.8104999999999998e-05 2024-05-08T18:30:36.333 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:36.333 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:36.333 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:36.334 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.334 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.334 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:826 6.6 6:64735f45:::obj_delete_at_hint.0000000083:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:36.334 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.299128+0000", 2024-05-08T18:30:36.334 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 43.944356149000001, 2024-05-08T18:30:36.334 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0029196479999999999, 2024-05-08T18:30:36.334 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:36.334 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:36.334 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:36.334 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:36.334 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:36.334 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:36.334 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 826 2024-05-08T18:30:36.334 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.335 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:36.335 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.335 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:36.335 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.299128+0000", 2024-05-08T18:30:36.335 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:36.335 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.335 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.335 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:36.335 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.299128+0000", 2024-05-08T18:30:36.335 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:36.335 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.335 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.335 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:36.335 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.299129+0000", 2024-05-08T18:30:36.336 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.711e-06 2024-05-08T18:30:36.336 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.336 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.336 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:36.336 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.299137+0000", 2024-05-08T18:30:36.336 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6650000000000003e-06 2024-05-08T18:30:36.336 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.336 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.336 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:36.336 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.299157+0000", 2024-05-08T18:30:36.336 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.02e-05 2024-05-08T18:30:36.336 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.336 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.336 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:36.337 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.299166+0000", 2024-05-08T18:30:36.337 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7530000000000007e-06 2024-05-08T18:30:36.337 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.337 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.337 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:36.337 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.299240+0000", 2024-05-08T18:30:36.337 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.4297999999999999e-05 2024-05-08T18:30:36.337 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.337 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.337 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:36.337 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.299444+0000", 2024-05-08T18:30:36.337 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00020382399999999999 2024-05-08T18:30:36.337 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.337 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.337 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:36.338 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.299777+0000", 2024-05-08T18:30:36.338 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00033331700000000002 2024-05-08T18:30:36.338 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.338 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.338 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:36.338 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.301060+0000", 2024-05-08T18:30:36.338 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012829569999999999 2024-05-08T18:30:36.338 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.338 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.338 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:36.339 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.301865+0000", 2024-05-08T18:30:36.339 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00080503400000000004 2024-05-08T18:30:36.339 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.339 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.339 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:36.339 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.301979+0000", 2024-05-08T18:30:36.339 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011324600000000001 2024-05-08T18:30:36.339 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.339 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.339 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:36.339 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.302047+0000", 2024-05-08T18:30:36.339 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8643e-05 2024-05-08T18:30:36.339 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:36.340 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:36.340 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:36.340 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.340 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.340 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:838 6.c 6:330b1641:::obj_delete_at_hint.0000000087:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:36.340 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.328043+0000", 2024-05-08T18:30:36.340 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 43.915441004999998, 2024-05-08T18:30:36.341 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031589180000000001, 2024-05-08T18:30:36.341 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:36.341 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:36.341 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:36.341 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:36.341 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:36.341 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:36.341 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 838 2024-05-08T18:30:36.341 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.341 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:36.341 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.341 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:36.341 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.328043+0000", 2024-05-08T18:30:36.341 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:36.342 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.342 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.342 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:36.342 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.328043+0000", 2024-05-08T18:30:36.342 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:36.342 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.342 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.342 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:36.342 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.328045+0000", 2024-05-08T18:30:36.343 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3760000000000002e-06 2024-05-08T18:30:36.343 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.343 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.343 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:36.343 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.328057+0000", 2024-05-08T18:30:36.343 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1534e-05 2024-05-08T18:30:36.343 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.343 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.343 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:36.343 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.328087+0000", 2024-05-08T18:30:36.343 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0870000000000001e-05 2024-05-08T18:30:36.343 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.343 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.343 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:36.344 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.328102+0000", 2024-05-08T18:30:36.344 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4679e-05 2024-05-08T18:30:36.344 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.344 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.344 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:36.344 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.328217+0000", 2024-05-08T18:30:36.344 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011519300000000001 2024-05-08T18:30:36.344 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.344 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.344 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:36.344 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.328446+0000", 2024-05-08T18:30:36.344 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00022893499999999999 2024-05-08T18:30:36.344 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.345 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.345 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:36.345 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.328770+0000", 2024-05-08T18:30:36.345 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00032349700000000001 2024-05-08T18:30:36.345 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.345 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.345 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:36.345 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.330008+0000", 2024-05-08T18:30:36.345 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001238404 2024-05-08T18:30:36.345 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.345 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.345 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:36.345 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.331026+0000", 2024-05-08T18:30:36.345 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001017612 2024-05-08T18:30:36.346 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.346 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.346 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:36.346 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.331117+0000", 2024-05-08T18:30:36.346 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0932000000000003e-05 2024-05-08T18:30:36.346 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.346 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.346 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:36.346 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.331202+0000", 2024-05-08T18:30:36.346 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.4886e-05 2024-05-08T18:30:36.346 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:36.346 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:36.346 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:36.347 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.347 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.347 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:850 6.6 6:624175ac:::obj_delete_at_hint.0000000091:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:36.347 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.356951+0000", 2024-05-08T18:30:36.347 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 43.886532918, 2024-05-08T18:30:36.347 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028779000000000001, 2024-05-08T18:30:36.347 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:36.347 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:36.347 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:36.348 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:36.348 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:36.348 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:36.348 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 850 2024-05-08T18:30:36.348 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.348 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:36.348 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.348 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:36.348 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.356951+0000", 2024-05-08T18:30:36.348 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:36.348 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.348 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.349 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:36.349 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.356951+0000", 2024-05-08T18:30:36.349 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:36.349 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.349 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.349 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:36.349 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.356953+0000", 2024-05-08T18:30:36.349 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.446e-06 2024-05-08T18:30:36.349 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.349 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.349 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:36.349 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.356965+0000", 2024-05-08T18:30:36.349 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1404e-05 2024-05-08T18:30:36.349 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.350 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.350 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:36.350 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.356994+0000", 2024-05-08T18:30:36.350 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9526000000000002e-05 2024-05-08T18:30:36.350 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.350 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.350 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:36.350 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.357009+0000", 2024-05-08T18:30:36.350 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5126000000000001e-05 2024-05-08T18:30:36.350 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.350 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.350 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:36.351 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.357126+0000", 2024-05-08T18:30:36.351 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000116989 2024-05-08T18:30:36.351 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.351 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.351 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:36.351 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.357349+0000", 2024-05-08T18:30:36.351 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00022298899999999999 2024-05-08T18:30:36.351 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.351 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.351 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:36.351 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.357665+0000", 2024-05-08T18:30:36.351 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00031592700000000003 2024-05-08T18:30:36.351 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.351 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.351 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:36.352 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.358771+0000", 2024-05-08T18:30:36.352 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001105595 2024-05-08T18:30:36.352 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.352 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.352 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:36.352 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.359672+0000", 2024-05-08T18:30:36.352 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00090080300000000004 2024-05-08T18:30:36.352 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.353 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.353 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:36.353 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.359762+0000", 2024-05-08T18:30:36.353 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0099000000000006e-05 2024-05-08T18:30:36.353 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.353 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.353 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:36.353 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.359829+0000", 2024-05-08T18:30:36.353 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6995999999999993e-05 2024-05-08T18:30:36.353 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:36.353 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:36.353 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:36.354 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.354 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.354 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:852 6.6 6:624175ac:::obj_delete_at_hint.0000000091:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:36.354 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.360655+0000", 2024-05-08T18:30:36.354 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 43.882829051000002, 2024-05-08T18:30:36.354 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028684650000000002, 2024-05-08T18:30:36.354 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:36.354 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:36.354 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:36.354 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:36.354 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:36.354 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:36.355 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 852 2024-05-08T18:30:36.355 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.355 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:36.355 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.355 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:36.355 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.360655+0000", 2024-05-08T18:30:36.355 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:36.355 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.356 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.356 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:36.356 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.360655+0000", 2024-05-08T18:30:36.356 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:36.356 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.356 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.356 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:36.356 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.360656+0000", 2024-05-08T18:30:36.356 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.457e-06 2024-05-08T18:30:36.356 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.356 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.356 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:36.356 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.360663+0000", 2024-05-08T18:30:36.357 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5429999999999999e-06 2024-05-08T18:30:36.357 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.357 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.357 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:36.357 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.360682+0000", 2024-05-08T18:30:36.357 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9020000000000001e-05 2024-05-08T18:30:36.357 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.357 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.357 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:36.357 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.360693+0000", 2024-05-08T18:30:36.357 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.114e-05 2024-05-08T18:30:36.357 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.357 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.357 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:36.358 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.360775+0000", 2024-05-08T18:30:36.358 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.2206000000000005e-05 2024-05-08T18:30:36.358 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.358 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.358 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:36.358 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.360899+0000", 2024-05-08T18:30:36.358 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000124206 2024-05-08T18:30:36.358 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.358 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.358 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:36.358 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.361162+0000", 2024-05-08T18:30:36.358 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00026328400000000002 2024-05-08T18:30:36.358 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.359 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.359 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:36.359 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.362180+0000", 2024-05-08T18:30:36.359 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0010175119999999999 2024-05-08T18:30:36.359 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.359 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.359 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:36.359 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.363368+0000", 2024-05-08T18:30:36.359 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001187991 2024-05-08T18:30:36.359 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.359 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.359 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:36.359 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.363456+0000", 2024-05-08T18:30:36.359 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8016999999999994e-05 2024-05-08T18:30:36.360 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.360 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.360 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:36.360 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.363523+0000", 2024-05-08T18:30:36.360 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7088999999999994e-05 2024-05-08T18:30:36.360 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:36.360 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:36.360 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:36.360 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.360 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.360 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:865 6.c 6:31288c1b:::obj_delete_at_hint.0000000096:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:36.360 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.392164+0000", 2024-05-08T18:30:36.360 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 43.851319949999997, 2024-05-08T18:30:36.360 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0029815470000000002, 2024-05-08T18:30:36.361 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:36.361 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:36.361 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:36.361 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:36.361 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:36.361 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:36.361 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 865 2024-05-08T18:30:36.361 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.361 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:36.361 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.361 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:36.361 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.392164+0000", 2024-05-08T18:30:36.361 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:36.362 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.362 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.362 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:36.362 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.392164+0000", 2024-05-08T18:30:36.362 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:36.362 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.362 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.362 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:36.362 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.392166+0000", 2024-05-08T18:30:36.362 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4059999999999999e-06 2024-05-08T18:30:36.362 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.362 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.363 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:36.363 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.392177+0000", 2024-05-08T18:30:36.363 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1260000000000001e-05 2024-05-08T18:30:36.363 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.363 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.363 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:36.363 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.392208+0000", 2024-05-08T18:30:36.363 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0484000000000002e-05 2024-05-08T18:30:36.364 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.364 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.364 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:36.364 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.392222+0000", 2024-05-08T18:30:36.364 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4343e-05 2024-05-08T18:30:36.364 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.364 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.364 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:36.364 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.392355+0000", 2024-05-08T18:30:36.364 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000132602 2024-05-08T18:30:36.364 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.364 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.364 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:36.364 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.392565+0000", 2024-05-08T18:30:36.365 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000210442 2024-05-08T18:30:36.365 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.365 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.365 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:36.365 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.392874+0000", 2024-05-08T18:30:36.365 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00030868099999999999 2024-05-08T18:30:36.365 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.365 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.365 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:36.365 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.394087+0000", 2024-05-08T18:30:36.365 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012133300000000001 2024-05-08T18:30:36.365 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.365 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.365 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:36.366 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.394976+0000", 2024-05-08T18:30:36.366 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000888977 2024-05-08T18:30:36.366 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.366 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.366 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:36.366 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.395068+0000", 2024-05-08T18:30:36.366 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.2188999999999994e-05 2024-05-08T18:30:36.366 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.366 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.366 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:36.366 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.395145+0000", 2024-05-08T18:30:36.366 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6833000000000001e-05 2024-05-08T18:30:36.366 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:36.366 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:36.367 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:36.367 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.367 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.367 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:871 6.11 6:8d7f253a:::obj_delete_at_hint.0000000098:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:36.367 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.405724+0000", 2024-05-08T18:30:36.367 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 43.837759394000003, 2024-05-08T18:30:36.367 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0030012530000000002, 2024-05-08T18:30:36.367 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:36.367 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:36.367 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:36.367 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:36.368 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:36.368 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:36.368 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 871 2024-05-08T18:30:36.368 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.368 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:36.368 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.368 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:36.368 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.405724+0000", 2024-05-08T18:30:36.368 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:36.368 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.368 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.368 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:36.368 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.405724+0000", 2024-05-08T18:30:36.369 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:36.369 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.369 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.369 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:36.369 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.405726+0000", 2024-05-08T18:30:36.369 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1299999999999999e-06 2024-05-08T18:30:36.369 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.369 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.369 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:36.369 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.405737+0000", 2024-05-08T18:30:36.369 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0763e-05 2024-05-08T18:30:36.369 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.369 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.369 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:36.369 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.405762+0000", 2024-05-08T18:30:36.370 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5323000000000001e-05 2024-05-08T18:30:36.370 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.370 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.370 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:36.370 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.405776+0000", 2024-05-08T18:30:36.370 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3862999999999999e-05 2024-05-08T18:30:36.370 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.370 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.370 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:36.371 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.405928+0000", 2024-05-08T18:30:36.371 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015190000000000001 2024-05-08T18:30:36.371 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.371 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.371 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:36.371 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.406159+0000", 2024-05-08T18:30:36.371 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023114399999999999 2024-05-08T18:30:36.371 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.371 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.371 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:36.372 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.406453+0000", 2024-05-08T18:30:36.372 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00029329699999999998 2024-05-08T18:30:36.372 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.372 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.372 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:36.372 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.408103+0000", 2024-05-08T18:30:36.372 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0016499869999999999 2024-05-08T18:30:36.372 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.372 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.372 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:36.372 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.408520+0000", 2024-05-08T18:30:36.372 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00041694099999999999 2024-05-08T18:30:36.372 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.372 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.372 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:36.373 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.408606+0000", 2024-05-08T18:30:36.373 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6809000000000002e-05 2024-05-08T18:30:36.373 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.373 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.373 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:36.373 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.408726+0000", 2024-05-08T18:30:36.373 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000119096 2024-05-08T18:30:36.373 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:36.373 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:36.373 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:36.373 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.374 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.374 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:934 6.11 6:8cd774bc:::obj_delete_at_hint.0000000119:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:36.374 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.550387+0000", 2024-05-08T18:30:36.374 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 43.693096441000002, 2024-05-08T18:30:36.374 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0033028739999999999, 2024-05-08T18:30:36.374 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:36.374 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:36.374 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:36.374 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:36.374 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:36.374 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:36.374 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 934 2024-05-08T18:30:36.374 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.375 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:36.375 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.375 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:36.375 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.550387+0000", 2024-05-08T18:30:36.375 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:36.375 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.375 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.375 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:36.375 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.550387+0000", 2024-05-08T18:30:36.375 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:36.375 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.375 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.375 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:36.375 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.550390+0000", 2024-05-08T18:30:36.375 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.706e-06 2024-05-08T18:30:36.376 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.376 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.376 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:36.376 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.550401+0000", 2024-05-08T18:30:36.376 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1437000000000001e-05 2024-05-08T18:30:36.376 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.376 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.376 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:36.376 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.550433+0000", 2024-05-08T18:30:36.376 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2005999999999998e-05 2024-05-08T18:30:36.376 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.376 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.376 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:36.376 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.550448+0000", 2024-05-08T18:30:36.377 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5007e-05 2024-05-08T18:30:36.377 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.377 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.377 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:36.377 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.550607+0000", 2024-05-08T18:30:36.377 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000158288 2024-05-08T18:30:36.377 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.377 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.377 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:36.377 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.550974+0000", 2024-05-08T18:30:36.377 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00036768400000000001 2024-05-08T18:30:36.377 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.377 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.377 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:36.378 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.551516+0000", 2024-05-08T18:30:36.378 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00054126900000000004 2024-05-08T18:30:36.378 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.378 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.378 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:36.378 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.552847+0000", 2024-05-08T18:30:36.378 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0013308899999999999 2024-05-08T18:30:36.378 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.379 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.379 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:36.379 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.553531+0000", 2024-05-08T18:30:36.379 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00068438799999999997 2024-05-08T18:30:36.379 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.379 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.379 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:36.379 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.553621+0000", 2024-05-08T18:30:36.379 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9779999999999998e-05 2024-05-08T18:30:36.379 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:36.380 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:36.380 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:36.380 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.553690+0000", 2024-05-08T18:30:36.380 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9418999999999994e-05 2024-05-08T18:30:36.380 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:36.380 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:36.380 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:36.380 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:36.380 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:36.380 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:30:36.382 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-08T18:30:36.382 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:30:36.383+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:30:36.483 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:30:36.479+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:30:36.514 INFO:teuthology.orchestra.run.smithi097.stderr:noscrub is set 2024-05-08T18:30:36.517 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:30:36.517 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:30:36.517 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 0 2024-05-08T18:30:36.517 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:30:36.532 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-08T18:30:36.584 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:30:36.584+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:30:36.685 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:30:36.684+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:30:36.702 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:30:36.702 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:30:36.702 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2024-05-08T18:30:36.702 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2024-05-08T18:30:36.702 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:30:36.716 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-08T18:30:36.785 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:30:36.783+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:30:36.846 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:30:36.846 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2024-05-08T18:30:36.846 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2024-05-08T18:30:36.846 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-05-08T18:30:36.846 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.847 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:36.847 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.699928+0000", 2024-05-08T18:30:36.847 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 45.143752894000002, 2024-05-08T18:30:36.847 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0036032490000000002, 2024-05-08T18:30:36.847 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:36.847 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:36.847 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:36.847 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:36.847 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:36.847 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:36.847 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 211 2024-05-08T18:30:36.847 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.847 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:36.848 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.848 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:36.848 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.699928+0000", 2024-05-08T18:30:36.848 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:36.848 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.848 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.848 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:36.848 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.699928+0000", 2024-05-08T18:30:36.848 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:36.848 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.848 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.848 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:36.848 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.699931+0000", 2024-05-08T18:30:36.848 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4139999999999998e-06 2024-05-08T18:30:36.849 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.849 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.849 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:36.849 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.699946+0000", 2024-05-08T18:30:36.849 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4528999999999999e-05 2024-05-08T18:30:36.849 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.849 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.849 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:36.849 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.699984+0000", 2024-05-08T18:30:36.849 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8444e-05 2024-05-08T18:30:36.849 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.849 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.849 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:36.849 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.700004+0000", 2024-05-08T18:30:36.850 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0169999999999998e-05 2024-05-08T18:30:36.850 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.850 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.850 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:36.850 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.700162+0000", 2024-05-08T18:30:36.850 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015799799999999999 2024-05-08T18:30:36.850 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.850 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.850 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:36.850 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.700414+0000", 2024-05-08T18:30:36.850 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00025214500000000001 2024-05-08T18:30:36.850 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.851 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.851 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:36.851 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.700839+0000", 2024-05-08T18:30:36.851 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00042484 2024-05-08T18:30:36.851 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.851 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.851 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:36.851 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.702506+0000", 2024-05-08T18:30:36.851 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001666357 2024-05-08T18:30:36.851 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.851 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.851 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:36.852 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.703357+0000", 2024-05-08T18:30:36.852 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00085149399999999995 2024-05-08T18:30:36.852 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.852 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.852 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:36.852 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.703454+0000", 2024-05-08T18:30:36.852 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6688999999999995e-05 2024-05-08T18:30:36.852 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.852 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.852 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:36.852 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.703531+0000", 2024-05-08T18:30:36.852 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.7169000000000006e-05 2024-05-08T18:30:36.852 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:36.853 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:36.853 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:36.853 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.853 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.853 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:36.853 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.776807+0000", 2024-05-08T18:30:36.853 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 45.066874030999998, 2024-05-08T18:30:36.853 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0033805409999999999, 2024-05-08T18:30:36.853 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:36.853 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:36.853 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:36.853 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:36.853 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:36.853 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:36.854 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 232 2024-05-08T18:30:36.854 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.854 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:36.854 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.854 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:36.854 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.776807+0000", 2024-05-08T18:30:36.854 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:36.854 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.854 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.854 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:36.854 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.776807+0000", 2024-05-08T18:30:36.854 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:36.854 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.855 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.855 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:36.855 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.776810+0000", 2024-05-08T18:30:36.855 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6540000000000001e-06 2024-05-08T18:30:36.855 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.855 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.855 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:36.855 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.776824+0000", 2024-05-08T18:30:36.855 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3383e-05 2024-05-08T18:30:36.855 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.855 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.855 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:36.855 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.776856+0000", 2024-05-08T18:30:36.856 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2775999999999999e-05 2024-05-08T18:30:36.856 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.856 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.856 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:36.856 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.776873+0000", 2024-05-08T18:30:36.856 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6483000000000001e-05 2024-05-08T18:30:36.856 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.856 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.856 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:36.856 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.776999+0000", 2024-05-08T18:30:36.856 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000125876 2024-05-08T18:30:36.856 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.856 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.857 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:36.857 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.777228+0000", 2024-05-08T18:30:36.857 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000229531 2024-05-08T18:30:36.857 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.857 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.857 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:36.857 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.777648+0000", 2024-05-08T18:30:36.857 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000420037 2024-05-08T18:30:36.857 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.857 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.857 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:36.857 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.779272+0000", 2024-05-08T18:30:36.857 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0016235780000000001 2024-05-08T18:30:36.857 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.858 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.858 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:36.858 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.780027+0000", 2024-05-08T18:30:36.858 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00075524100000000003 2024-05-08T18:30:36.858 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.858 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.858 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:36.858 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.780116+0000", 2024-05-08T18:30:36.858 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8776000000000005e-05 2024-05-08T18:30:36.858 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.858 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.858 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:36.858 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.780187+0000", 2024-05-08T18:30:36.858 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1205999999999996e-05 2024-05-08T18:30:36.859 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:36.859 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:36.859 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:36.859 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.859 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.859 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:285 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:36.859 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.803745+0000", 2024-05-08T18:30:36.859 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 45.039935745000001, 2024-05-08T18:30:36.859 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0034481960000000002, 2024-05-08T18:30:36.859 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:36.860 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:36.860 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:36.860 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:36.860 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:36.860 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:36.860 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 285 2024-05-08T18:30:36.860 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.860 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:36.860 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.860 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:36.860 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.803745+0000", 2024-05-08T18:30:36.860 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:36.861 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.861 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.861 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:36.861 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.803745+0000", 2024-05-08T18:30:36.861 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:36.861 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.861 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.861 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:36.861 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.803748+0000", 2024-05-08T18:30:36.861 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.813e-06 2024-05-08T18:30:36.861 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.861 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.861 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:36.862 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.803762+0000", 2024-05-08T18:30:36.862 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4653e-05 2024-05-08T18:30:36.862 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.862 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.862 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:36.862 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.803791+0000", 2024-05-08T18:30:36.862 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8540000000000001e-05 2024-05-08T18:30:36.862 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.862 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.862 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:36.862 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.803817+0000", 2024-05-08T18:30:36.862 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5973e-05 2024-05-08T18:30:36.862 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.863 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.863 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:36.863 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.803975+0000", 2024-05-08T18:30:36.863 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000158336 2024-05-08T18:30:36.863 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.863 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.863 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:36.863 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.804502+0000", 2024-05-08T18:30:36.863 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00052658900000000005 2024-05-08T18:30:36.863 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.863 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.863 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:36.863 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.804966+0000", 2024-05-08T18:30:36.864 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00046399599999999999 2024-05-08T18:30:36.864 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.864 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.864 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:36.864 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.806289+0000", 2024-05-08T18:30:36.864 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0013233769999999999 2024-05-08T18:30:36.864 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.864 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.864 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:36.864 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.807001+0000", 2024-05-08T18:30:36.864 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000711314 2024-05-08T18:30:36.864 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.864 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.864 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:36.865 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.807096+0000", 2024-05-08T18:30:36.865 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.5276000000000001e-05 2024-05-08T18:30:36.865 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.865 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.865 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:36.865 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.807193+0000", 2024-05-08T18:30:36.865 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7329000000000003e-05 2024-05-08T18:30:36.865 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:36.865 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:36.865 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:36.865 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.865 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.865 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:317 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:36.866 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.808256+0000", 2024-05-08T18:30:36.866 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 45.035424333000002, 2024-05-08T18:30:36.866 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0038944359999999998, 2024-05-08T18:30:36.866 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:36.866 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:36.866 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:36.866 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:36.866 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:36.866 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:36.866 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 317 2024-05-08T18:30:36.866 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.866 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:36.866 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.867 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:36.867 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.808256+0000", 2024-05-08T18:30:36.867 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:36.867 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.867 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.867 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:36.867 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.808256+0000", 2024-05-08T18:30:36.867 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:36.867 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.867 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.867 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:36.867 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.808258+0000", 2024-05-08T18:30:36.867 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0559999999999999e-06 2024-05-08T18:30:36.868 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.868 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.868 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:36.868 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.808270+0000", 2024-05-08T18:30:36.868 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1537e-05 2024-05-08T18:30:36.868 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.868 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.868 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:36.868 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.808299+0000", 2024-05-08T18:30:36.868 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.9127000000000001e-05 2024-05-08T18:30:36.868 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.868 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.868 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:36.868 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.808324+0000", 2024-05-08T18:30:36.869 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5182e-05 2024-05-08T18:30:36.869 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.869 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.869 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:36.869 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.808471+0000", 2024-05-08T18:30:36.869 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014631900000000001 2024-05-08T18:30:36.869 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.869 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.869 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:36.869 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.808717+0000", 2024-05-08T18:30:36.869 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00024595200000000002 2024-05-08T18:30:36.869 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.869 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.869 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:36.870 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.809072+0000", 2024-05-08T18:30:36.870 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00035547699999999998 2024-05-08T18:30:36.870 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.870 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.870 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:36.870 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.810447+0000", 2024-05-08T18:30:36.870 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0013745929999999999 2024-05-08T18:30:36.870 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.870 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.870 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:36.870 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.811938+0000", 2024-05-08T18:30:36.871 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0014914290000000001 2024-05-08T18:30:36.871 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.871 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.871 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:36.871 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.812078+0000", 2024-05-08T18:30:36.871 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000140319 2024-05-08T18:30:36.871 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.871 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.871 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:36.871 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.812151+0000", 2024-05-08T18:30:36.871 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.2445000000000002e-05 2024-05-08T18:30:36.871 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:36.871 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:36.872 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:36.872 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.872 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.872 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:552 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:36.872 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.923892+0000", 2024-05-08T18:30:36.872 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 44.919789066, 2024-05-08T18:30:36.872 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029063259999999999, 2024-05-08T18:30:36.872 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:36.872 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:36.872 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:36.872 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:36.872 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:36.872 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:36.873 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 552 2024-05-08T18:30:36.873 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.873 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:36.873 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.873 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:36.873 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.923892+0000", 2024-05-08T18:30:36.873 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:36.873 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.873 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.873 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:36.873 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.923892+0000", 2024-05-08T18:30:36.873 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:36.873 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.873 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.874 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:36.874 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.923893+0000", 2024-05-08T18:30:36.874 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.082e-06 2024-05-08T18:30:36.874 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.874 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.874 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:36.874 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.923899+0000", 2024-05-08T18:30:36.874 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.426e-06 2024-05-08T18:30:36.874 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.874 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.874 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:36.874 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.923913+0000", 2024-05-08T18:30:36.874 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3869000000000001e-05 2024-05-08T18:30:36.875 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.875 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.875 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:36.875 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.923922+0000", 2024-05-08T18:30:36.875 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8850000000000005e-06 2024-05-08T18:30:36.875 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.875 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.875 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:36.875 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.924023+0000", 2024-05-08T18:30:36.875 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010135400000000001 2024-05-08T18:30:36.875 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.875 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.875 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:36.876 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.924230+0000", 2024-05-08T18:30:36.876 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020649500000000001 2024-05-08T18:30:36.876 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.876 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.876 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:36.876 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.924685+0000", 2024-05-08T18:30:36.876 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00045504299999999997 2024-05-08T18:30:36.876 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.876 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.876 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:36.876 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.925792+0000", 2024-05-08T18:30:36.876 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0011076790000000001 2024-05-08T18:30:36.877 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.877 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.877 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:36.877 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.926566+0000", 2024-05-08T18:30:36.877 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00077379200000000003 2024-05-08T18:30:36.877 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.877 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.877 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:36.877 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.926705+0000", 2024-05-08T18:30:36.877 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013870700000000001 2024-05-08T18:30:36.877 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.877 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.877 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:36.877 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.926798+0000", 2024-05-08T18:30:36.878 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2993999999999998e-05 2024-05-08T18:30:36.878 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:36.878 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:36.878 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:36.878 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.878 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.878 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:709 6.1e 6:7af5a05b:::obj_delete_at_hint.0000000044:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:36.878 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.033719+0000", 2024-05-08T18:30:36.878 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 44.809961307000002, 2024-05-08T18:30:36.878 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0027890480000000001, 2024-05-08T18:30:36.878 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:36.878 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:36.878 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:36.879 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:36.879 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:36.879 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:36.879 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 709 2024-05-08T18:30:36.879 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.879 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:36.879 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.879 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:36.879 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.033719+0000", 2024-05-08T18:30:36.879 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:36.879 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.879 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.879 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:36.879 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.033719+0000", 2024-05-08T18:30:36.881 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:36.881 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.881 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.881 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:36.881 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.033723+0000", 2024-05-08T18:30:36.881 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1920000000000001e-06 2024-05-08T18:30:36.881 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.881 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.881 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:36.881 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.033736+0000", 2024-05-08T18:30:36.881 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3125000000000001e-05 2024-05-08T18:30:36.882 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.882 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.882 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:36.882 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.033768+0000", 2024-05-08T18:30:36.882 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2422999999999998e-05 2024-05-08T18:30:36.882 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.882 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.882 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:36.882 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.033789+0000", 2024-05-08T18:30:36.882 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1084999999999999e-05 2024-05-08T18:30:36.882 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.882 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.882 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:36.882 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.033912+0000", 2024-05-08T18:30:36.883 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000123261 2024-05-08T18:30:36.883 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.883 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.883 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:36.883 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.034132+0000", 2024-05-08T18:30:36.883 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00021992100000000001 2024-05-08T18:30:36.883 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.883 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.883 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:36.883 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.034452+0000", 2024-05-08T18:30:36.883 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00031989399999999998 2024-05-08T18:30:36.883 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.884 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.884 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:36.884 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.035605+0000", 2024-05-08T18:30:36.884 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0011523410000000001 2024-05-08T18:30:36.884 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.884 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.884 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:36.884 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.036356+0000", 2024-05-08T18:30:36.884 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00075177800000000004 2024-05-08T18:30:36.884 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.884 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.884 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:36.884 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.036443+0000", 2024-05-08T18:30:36.884 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.6348999999999996e-05 2024-05-08T18:30:36.885 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.885 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.885 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:36.885 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.036508+0000", 2024-05-08T18:30:36.885 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5679000000000006e-05 2024-05-08T18:30:36.885 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:36.885 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:36.885 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:36.885 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.885 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.886 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:36.886 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.070187+0000", 2024-05-08T18:30:36.886 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 44.773493678999998, 2024-05-08T18:30:36.886 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0030597110000000001, 2024-05-08T18:30:36.886 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:36.886 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:36.886 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:36.886 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:36.886 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:36.886 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:36.886 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 727 2024-05-08T18:30:36.886 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.886 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:36.887 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.887 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:36.887 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.070187+0000", 2024-05-08T18:30:36.887 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:36.887 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.887 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.887 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:36.887 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.070187+0000", 2024-05-08T18:30:36.887 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:36.887 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.887 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.887 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:36.887 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.070189+0000", 2024-05-08T18:30:36.888 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.53e-06 2024-05-08T18:30:36.888 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.888 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.888 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:36.888 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.070197+0000", 2024-05-08T18:30:36.888 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2600000000000005e-06 2024-05-08T18:30:36.888 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.888 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.888 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:36.888 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.070220+0000", 2024-05-08T18:30:36.888 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3357e-05 2024-05-08T18:30:36.888 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.888 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.888 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:36.889 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.070232+0000", 2024-05-08T18:30:36.889 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.217e-05 2024-05-08T18:30:36.889 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.889 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.889 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:36.889 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.070334+0000", 2024-05-08T18:30:36.889 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000101486 2024-05-08T18:30:36.889 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.889 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.889 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:36.889 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.070585+0000", 2024-05-08T18:30:36.889 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00025155799999999998 2024-05-08T18:30:36.889 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.889 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.890 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-05-08T18:30:36.890 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.070921+0000", 2024-05-08T18:30:36.890 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00033587999999999999 2024-05-08T18:30:36.890 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.890 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.890 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:36.890 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.071956+0000", 2024-05-08T18:30:36.890 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010343629999999999 2024-05-08T18:30:36.890 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.890 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.890 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:36.890 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.073088+0000", 2024-05-08T18:30:36.890 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001132641 2024-05-08T18:30:36.890 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.891 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.891 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:36.891 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.073178+0000", 2024-05-08T18:30:36.891 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.9579000000000004e-05 2024-05-08T18:30:36.891 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.891 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.891 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:36.891 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.073247+0000", 2024-05-08T18:30:36.891 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8887000000000006e-05 2024-05-08T18:30:36.891 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:36.891 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:36.891 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:36.891 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.891 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.892 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:775 6.1e 6:7db93595:::obj_delete_at_hint.0000000066:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:36.892 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.180158+0000", 2024-05-08T18:30:36.892 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 44.663522399999998, 2024-05-08T18:30:36.892 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0030746160000000001, 2024-05-08T18:30:36.892 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:36.892 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:36.892 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:36.892 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:36.892 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:36.892 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:36.892 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 775 2024-05-08T18:30:36.892 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.892 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:36.892 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.893 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:36.893 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.180158+0000", 2024-05-08T18:30:36.893 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:36.893 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.893 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.893 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:36.893 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.180158+0000", 2024-05-08T18:30:36.893 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:36.893 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.893 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.893 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:36.894 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.180161+0000", 2024-05-08T18:30:36.894 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8399999999999999e-06 2024-05-08T18:30:36.894 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.894 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.894 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:36.894 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.180172+0000", 2024-05-08T18:30:36.894 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0876000000000001e-05 2024-05-08T18:30:36.894 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.894 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.894 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:36.895 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.180203+0000", 2024-05-08T18:30:36.895 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0639999999999998e-05 2024-05-08T18:30:36.895 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.895 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.895 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:36.895 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.180221+0000", 2024-05-08T18:30:36.895 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8326e-05 2024-05-08T18:30:36.895 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.895 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.895 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:36.895 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.180398+0000", 2024-05-08T18:30:36.895 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000176563 2024-05-08T18:30:36.895 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.896 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.896 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:36.896 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.180616+0000", 2024-05-08T18:30:36.896 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000218731 2024-05-08T18:30:36.896 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.896 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.896 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:36.896 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.180934+0000", 2024-05-08T18:30:36.896 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00031749799999999999 2024-05-08T18:30:36.896 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.896 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.896 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:36.896 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.182159+0000", 2024-05-08T18:30:36.896 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0012251810000000001 2024-05-08T18:30:36.897 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.897 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.897 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:36.897 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.182951+0000", 2024-05-08T18:30:36.897 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00079208000000000002 2024-05-08T18:30:36.897 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.897 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.897 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:36.897 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.183109+0000", 2024-05-08T18:30:36.897 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015750900000000001 2024-05-08T18:30:36.897 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.897 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.897 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:36.898 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.183233+0000", 2024-05-08T18:30:36.898 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012437200000000001 2024-05-08T18:30:36.898 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:36.898 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:36.898 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:36.898 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.898 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.898 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:777 6.1e 6:7db93595:::obj_delete_at_hint.0000000066:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:36.898 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.184358+0000", 2024-05-08T18:30:36.898 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 44.659322555999999, 2024-05-08T18:30:36.898 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0031944019999999998, 2024-05-08T18:30:36.898 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:36.898 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:36.899 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:36.899 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:36.899 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:36.899 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:36.899 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 777 2024-05-08T18:30:36.899 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.899 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:36.899 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.899 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:36.899 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.184358+0000", 2024-05-08T18:30:36.899 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:36.899 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.899 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.899 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:36.899 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.184358+0000", 2024-05-08T18:30:36.900 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:36.900 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.900 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.900 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:36.900 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.184360+0000", 2024-05-08T18:30:36.900 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5069999999999999e-06 2024-05-08T18:30:36.900 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.900 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.900 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:36.900 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.184367+0000", 2024-05-08T18:30:36.900 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6629999999999993e-06 2024-05-08T18:30:36.900 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.900 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.900 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:36.901 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.184388+0000", 2024-05-08T18:30:36.901 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0755999999999999e-05 2024-05-08T18:30:36.901 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.901 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.901 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:36.901 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.184399+0000", 2024-05-08T18:30:36.901 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0896999999999999e-05 2024-05-08T18:30:36.901 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.901 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.901 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:36.901 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.184512+0000", 2024-05-08T18:30:36.901 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000113346 2024-05-08T18:30:36.901 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.902 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.902 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:36.902 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.184733+0000", 2024-05-08T18:30:36.902 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022113800000000001 2024-05-08T18:30:36.902 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.902 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.902 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:36.902 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.185202+0000", 2024-05-08T18:30:36.902 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00046851999999999999 2024-05-08T18:30:36.902 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.902 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.903 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:36.903 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.186306+0000", 2024-05-08T18:30:36.903 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001104184 2024-05-08T18:30:36.903 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.903 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.903 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:36.903 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.187288+0000", 2024-05-08T18:30:36.903 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00098171 2024-05-08T18:30:36.903 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.903 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.903 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:36.903 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.187438+0000", 2024-05-08T18:30:36.903 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000150629 2024-05-08T18:30:36.903 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.904 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.904 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:36.904 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.187553+0000", 2024-05-08T18:30:36.904 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000114052 2024-05-08T18:30:36.904 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:36.904 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:36.904 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:36.904 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.904 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.904 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:808 6.1a 6:5a206276:::obj_delete_at_hint.0000000077:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:36.904 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.252316+0000", 2024-05-08T18:30:36.904 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 44.591365144000001, 2024-05-08T18:30:36.904 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0027908820000000002, 2024-05-08T18:30:36.905 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:36.905 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:36.905 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:36.905 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:36.905 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:36.905 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:36.905 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 808 2024-05-08T18:30:36.905 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.905 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:36.905 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.906 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:36.906 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.252316+0000", 2024-05-08T18:30:36.906 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:36.906 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.906 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.906 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:36.906 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.252316+0000", 2024-05-08T18:30:36.906 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:36.906 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.906 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.906 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:36.906 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.252318+0000", 2024-05-08T18:30:36.906 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5500000000000001e-06 2024-05-08T18:30:36.907 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.907 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.907 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:36.907 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.252331+0000", 2024-05-08T18:30:36.907 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.252e-05 2024-05-08T18:30:36.907 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.907 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.907 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:36.907 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.252362+0000", 2024-05-08T18:30:36.907 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1720000000000001e-05 2024-05-08T18:30:36.907 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.907 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.908 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:36.908 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.252377+0000", 2024-05-08T18:30:36.908 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4440000000000001e-05 2024-05-08T18:30:36.908 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.908 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.908 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:36.908 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.252513+0000", 2024-05-08T18:30:36.908 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013657200000000001 2024-05-08T18:30:36.908 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.908 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.908 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:36.908 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.252746+0000", 2024-05-08T18:30:36.908 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000232499 2024-05-08T18:30:36.909 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.909 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.909 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:36.909 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.253071+0000", 2024-05-08T18:30:36.909 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00032540299999999999 2024-05-08T18:30:36.909 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.909 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.909 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:36.909 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.254176+0000", 2024-05-08T18:30:36.909 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0011052519999999999 2024-05-08T18:30:36.909 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.910 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.910 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:36.910 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.254957+0000", 2024-05-08T18:30:36.910 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00078004099999999998 2024-05-08T18:30:36.910 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.910 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.910 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:36.910 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.255041+0000", 2024-05-08T18:30:36.910 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4492000000000004e-05 2024-05-08T18:30:36.910 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.910 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.910 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:36.910 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.255106+0000", 2024-05-08T18:30:36.910 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5393000000000002e-05 2024-05-08T18:30:36.911 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:36.911 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:36.911 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:36.911 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.911 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.911 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:810 6.1a 6:5a206276:::obj_delete_at_hint.0000000077:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:36.911 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.256569+0000", 2024-05-08T18:30:36.911 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 44.587112089999998, 2024-05-08T18:30:36.911 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0034505130000000001, 2024-05-08T18:30:36.911 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:36.911 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:36.911 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:36.911 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:36.912 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:36.912 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:36.912 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 810 2024-05-08T18:30:36.912 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.912 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:36.912 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.912 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:36.912 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.256569+0000", 2024-05-08T18:30:36.912 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:36.912 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.913 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.913 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:36.913 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.256569+0000", 2024-05-08T18:30:36.913 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:36.913 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.913 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.913 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:36.913 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.256571+0000", 2024-05-08T18:30:36.913 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2029999999999999e-06 2024-05-08T18:30:36.913 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.913 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.914 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:36.914 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.256582+0000", 2024-05-08T18:30:36.914 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.101e-05 2024-05-08T18:30:36.914 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.914 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.914 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:36.914 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.256614+0000", 2024-05-08T18:30:36.914 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2353e-05 2024-05-08T18:30:36.914 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.914 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.914 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:36.914 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.256632+0000", 2024-05-08T18:30:36.914 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8349999999999999e-05 2024-05-08T18:30:36.914 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.915 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.915 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:36.915 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.256767+0000", 2024-05-08T18:30:36.915 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000134819 2024-05-08T18:30:36.915 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.915 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.915 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:36.915 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.256990+0000", 2024-05-08T18:30:36.915 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022293899999999999 2024-05-08T18:30:36.915 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.915 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.915 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:36.915 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.257487+0000", 2024-05-08T18:30:36.915 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00049632599999999995 2024-05-08T18:30:36.916 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.916 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.916 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:36.916 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.258822+0000", 2024-05-08T18:30:36.916 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001335166 2024-05-08T18:30:36.916 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.916 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.916 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:36.916 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.259867+0000", 2024-05-08T18:30:36.916 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010454349999999999 2024-05-08T18:30:36.916 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.916 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.916 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:36.916 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.259955+0000", 2024-05-08T18:30:36.917 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.7699000000000002e-05 2024-05-08T18:30:36.917 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.917 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.917 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:36.917 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.260019+0000", 2024-05-08T18:30:36.917 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4213000000000003e-05 2024-05-08T18:30:36.917 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:36.917 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:36.917 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:36.917 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.917 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.917 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:814 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:36.917 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.266538+0000", 2024-05-08T18:30:36.917 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 44.577143163999999, 2024-05-08T18:30:36.917 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0030056010000000001, 2024-05-08T18:30:36.918 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:36.918 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:36.918 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:36.918 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:36.918 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:36.918 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:36.918 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 814 2024-05-08T18:30:36.918 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.918 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:36.918 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.918 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:36.918 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.266538+0000", 2024-05-08T18:30:36.918 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:36.918 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.919 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.919 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:36.919 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.266538+0000", 2024-05-08T18:30:36.919 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:36.919 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.919 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.919 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:36.919 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.266540+0000", 2024-05-08T18:30:36.919 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2400000000000002e-06 2024-05-08T18:30:36.919 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.919 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.919 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:36.920 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.266550+0000", 2024-05-08T18:30:36.920 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0464e-05 2024-05-08T18:30:36.920 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.920 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.920 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:36.920 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.266581+0000", 2024-05-08T18:30:36.920 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.099e-05 2024-05-08T18:30:36.920 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.920 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.920 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:36.920 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.266596+0000", 2024-05-08T18:30:36.920 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5176e-05 2024-05-08T18:30:36.920 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.921 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.921 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:36.921 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.266711+0000", 2024-05-08T18:30:36.921 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000114759 2024-05-08T18:30:36.921 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.921 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.921 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:36.921 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.266936+0000", 2024-05-08T18:30:36.921 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022446200000000001 2024-05-08T18:30:36.921 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.921 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.921 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:36.921 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.267272+0000", 2024-05-08T18:30:36.922 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00033655099999999998 2024-05-08T18:30:36.922 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.922 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.922 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:36.922 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.268417+0000", 2024-05-08T18:30:36.922 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0011447409999999999 2024-05-08T18:30:36.922 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.922 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.922 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:36.922 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.269263+0000", 2024-05-08T18:30:36.922 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00084657600000000003 2024-05-08T18:30:36.922 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.922 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.923 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:36.923 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.269418+0000", 2024-05-08T18:30:36.923 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015471300000000001 2024-05-08T18:30:36.923 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.923 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.923 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:36.923 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.269543+0000", 2024-05-08T18:30:36.923 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000124929 2024-05-08T18:30:36.923 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:36.923 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:36.923 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:36.923 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.923 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.923 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:816 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:36.924 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.270693+0000", 2024-05-08T18:30:36.924 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 44.572988056, 2024-05-08T18:30:36.924 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0031451119999999998, 2024-05-08T18:30:36.924 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:36.924 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:36.924 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:36.924 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:36.924 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:36.924 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:36.924 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 816 2024-05-08T18:30:36.924 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.924 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:36.924 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.925 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:36.925 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.270693+0000", 2024-05-08T18:30:36.925 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:36.925 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.925 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.925 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:36.925 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.270693+0000", 2024-05-08T18:30:36.925 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:36.925 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.925 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.925 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:36.925 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.270695+0000", 2024-05-08T18:30:36.925 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0669999999999999e-06 2024-05-08T18:30:36.926 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.926 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.926 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:36.926 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.270704+0000", 2024-05-08T18:30:36.926 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4830000000000005e-06 2024-05-08T18:30:36.926 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.926 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.926 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:36.926 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.270728+0000", 2024-05-08T18:30:36.926 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.4297000000000001e-05 2024-05-08T18:30:36.926 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.926 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.926 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:36.926 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.270740+0000", 2024-05-08T18:30:36.927 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1922999999999999e-05 2024-05-08T18:30:36.927 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.927 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.927 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:36.927 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.270855+0000", 2024-05-08T18:30:36.927 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011418599999999999 2024-05-08T18:30:36.927 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.927 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.927 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:36.927 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.271088+0000", 2024-05-08T18:30:36.928 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000233718 2024-05-08T18:30:36.928 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.928 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.928 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:36.928 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.271548+0000", 2024-05-08T18:30:36.928 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00045974299999999998 2024-05-08T18:30:36.928 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.928 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.928 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:36.928 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.272854+0000", 2024-05-08T18:30:36.928 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0013054799999999999 2024-05-08T18:30:36.928 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.928 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.928 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:36.929 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.273569+0000", 2024-05-08T18:30:36.929 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00071561400000000005 2024-05-08T18:30:36.929 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.929 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.929 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:36.929 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.273726+0000", 2024-05-08T18:30:36.929 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000156856 2024-05-08T18:30:36.929 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.929 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.929 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:36.929 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.273838+0000", 2024-05-08T18:30:36.929 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011174499999999999 2024-05-08T18:30:36.929 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:36.929 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:36.930 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:36.930 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.930 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.930 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:36.930 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.422427+0000", 2024-05-08T18:30:36.930 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 44.421253727, 2024-05-08T18:30:36.930 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0031426190000000001, 2024-05-08T18:30:36.930 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:36.930 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:36.930 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:36.930 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:36.930 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:36.930 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:36.931 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 880 2024-05-08T18:30:36.931 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.931 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:36.931 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.931 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:36.931 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.422427+0000", 2024-05-08T18:30:36.931 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:36.931 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.931 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.931 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:36.931 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.422427+0000", 2024-05-08T18:30:36.931 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:36.931 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.931 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.931 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:36.932 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.422431+0000", 2024-05-08T18:30:36.932 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.777e-06 2024-05-08T18:30:36.932 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.932 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.932 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:36.932 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.422445+0000", 2024-05-08T18:30:36.932 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.451e-05 2024-05-08T18:30:36.932 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.932 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.932 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:36.932 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.422479+0000", 2024-05-08T18:30:36.932 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4078999999999997e-05 2024-05-08T18:30:36.932 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.933 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.933 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:36.933 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.422495+0000", 2024-05-08T18:30:36.933 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5947000000000002e-05 2024-05-08T18:30:36.933 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.933 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.933 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:36.933 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.422609+0000", 2024-05-08T18:30:36.933 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000113879 2024-05-08T18:30:36.933 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.933 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.933 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:36.933 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.422844+0000", 2024-05-08T18:30:36.933 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000234465 2024-05-08T18:30:36.934 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.934 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.934 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:36.934 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.423201+0000", 2024-05-08T18:30:36.934 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00035789699999999998 2024-05-08T18:30:36.934 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.934 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.934 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:36.934 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.424352+0000", 2024-05-08T18:30:36.934 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0011504709999999999 2024-05-08T18:30:36.934 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.934 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.934 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:36.934 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.425288+0000", 2024-05-08T18:30:36.935 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00093638300000000005 2024-05-08T18:30:36.935 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.935 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.935 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:36.935 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.425451+0000", 2024-05-08T18:30:36.935 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000162628 2024-05-08T18:30:36.935 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.935 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.935 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:36.935 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.425570+0000", 2024-05-08T18:30:36.935 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000118583 2024-05-08T18:30:36.936 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:36.936 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:36.936 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:36.936 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.936 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.936 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:913 6.2 6:47403372:::obj_delete_at_hint.0000000112:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:36.936 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.494354+0000", 2024-05-08T18:30:36.936 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 44.349326421999997, 2024-05-08T18:30:36.936 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003088276, 2024-05-08T18:30:36.936 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:36.936 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:36.936 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:36.936 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:36.936 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:36.937 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:36.937 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 913 2024-05-08T18:30:36.937 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.937 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:36.937 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.937 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:36.937 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.494354+0000", 2024-05-08T18:30:36.937 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:36.937 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.937 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.937 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:36.937 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.494354+0000", 2024-05-08T18:30:36.937 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:36.937 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.938 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.938 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:36.938 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.494357+0000", 2024-05-08T18:30:36.938 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.553e-06 2024-05-08T18:30:36.938 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.938 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.938 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:36.938 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.494368+0000", 2024-05-08T18:30:36.938 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1426999999999999e-05 2024-05-08T18:30:36.938 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.938 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.938 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:36.938 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.494419+0000", 2024-05-08T18:30:36.939 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1053000000000001e-05 2024-05-08T18:30:36.939 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.939 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.939 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:36.939 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.494434+0000", 2024-05-08T18:30:36.939 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5216e-05 2024-05-08T18:30:36.939 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.939 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.939 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:36.939 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.494564+0000", 2024-05-08T18:30:36.939 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012956900000000001 2024-05-08T18:30:36.939 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.939 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.939 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:36.940 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.494798+0000", 2024-05-08T18:30:36.940 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000234248 2024-05-08T18:30:36.940 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.940 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.940 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:36.940 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.495123+0000", 2024-05-08T18:30:36.940 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00032466500000000002 2024-05-08T18:30:36.940 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.940 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.940 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:36.940 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.496226+0000", 2024-05-08T18:30:36.940 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001102701 2024-05-08T18:30:36.940 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.941 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.941 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:36.941 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.497153+0000", 2024-05-08T18:30:36.941 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00092721999999999998 2024-05-08T18:30:36.941 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.941 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.941 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:36.941 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.497329+0000", 2024-05-08T18:30:36.941 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000176579 2024-05-08T18:30:36.941 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.941 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.941 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:36.941 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.497443+0000", 2024-05-08T18:30:36.941 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000113045 2024-05-08T18:30:36.942 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:36.942 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:36.942 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:36.942 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.942 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.942 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:915 6.2 6:47403372:::obj_delete_at_hint.0000000112:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:36.942 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.498847+0000", 2024-05-08T18:30:36.942 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 44.344833356000002, 2024-05-08T18:30:36.942 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003160459, 2024-05-08T18:30:36.942 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:36.942 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:36.942 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:36.942 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:36.943 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:36.943 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:36.943 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 915 2024-05-08T18:30:36.943 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.943 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:36.943 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.943 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:36.943 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.498847+0000", 2024-05-08T18:30:36.943 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:36.943 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.943 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.943 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:36.943 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.498847+0000", 2024-05-08T18:30:36.943 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:36.944 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.944 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.944 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:36.944 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.498850+0000", 2024-05-08T18:30:36.944 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.4099999999999998e-06 2024-05-08T18:30:36.944 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.944 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.944 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:36.944 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.498863+0000", 2024-05-08T18:30:36.944 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3013000000000001e-05 2024-05-08T18:30:36.944 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.944 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.944 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:36.944 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.498895+0000", 2024-05-08T18:30:36.945 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2682999999999999e-05 2024-05-08T18:30:36.945 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.945 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.945 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:36.945 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.498911+0000", 2024-05-08T18:30:36.945 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.525e-05 2024-05-08T18:30:36.945 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.945 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.945 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:36.945 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.499039+0000", 2024-05-08T18:30:36.945 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012856900000000001 2024-05-08T18:30:36.945 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.945 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.945 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:36.946 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.499264+0000", 2024-05-08T18:30:36.946 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022517500000000001 2024-05-08T18:30:36.946 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.946 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.946 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:36.946 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.499740+0000", 2024-05-08T18:30:36.946 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00047553299999999999 2024-05-08T18:30:36.946 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.946 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.946 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:36.946 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.501192+0000", 2024-05-08T18:30:36.946 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001451735 2024-05-08T18:30:36.946 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.947 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.947 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:36.947 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.501751+0000", 2024-05-08T18:30:36.947 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000559239 2024-05-08T18:30:36.947 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.947 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.947 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:36.947 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.501902+0000", 2024-05-08T18:30:36.947 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015061600000000001 2024-05-08T18:30:36.947 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.947 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.947 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:36.947 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.502008+0000", 2024-05-08T18:30:36.948 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000106236 2024-05-08T18:30:36.948 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:36.948 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:36.948 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:36.948 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.948 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.948 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:925 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:36.948 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.523895+0000", 2024-05-08T18:30:36.948 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 44.319785953, 2024-05-08T18:30:36.948 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003635302, 2024-05-08T18:30:36.948 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:36.948 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:36.948 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:36.949 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:36.949 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:36.949 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:36.949 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 925 2024-05-08T18:30:36.949 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.949 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:36.949 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.949 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:36.949 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.523895+0000", 2024-05-08T18:30:36.949 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:36.949 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.949 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.949 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:36.950 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.523895+0000", 2024-05-08T18:30:36.950 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:36.950 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.950 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.950 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:36.950 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.523897+0000", 2024-05-08T18:30:36.950 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1969999999999999e-06 2024-05-08T18:30:36.950 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.950 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.950 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:36.950 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.523908+0000", 2024-05-08T18:30:36.950 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0706e-05 2024-05-08T18:30:36.951 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.951 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.951 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:36.951 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.523938+0000", 2024-05-08T18:30:36.951 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0395999999999998e-05 2024-05-08T18:30:36.951 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.951 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.951 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:36.951 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.523953+0000", 2024-05-08T18:30:36.951 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4673e-05 2024-05-08T18:30:36.951 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.951 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.951 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:36.951 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.524105+0000", 2024-05-08T18:30:36.952 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015204300000000001 2024-05-08T18:30:36.952 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.952 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.952 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:36.952 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.524460+0000", 2024-05-08T18:30:36.952 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00035539000000000002 2024-05-08T18:30:36.952 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.952 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.952 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:36.952 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.525003+0000", 2024-05-08T18:30:36.952 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00054241000000000001 2024-05-08T18:30:36.952 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.952 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.952 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:36.953 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.526198+0000", 2024-05-08T18:30:36.953 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0011955500000000001 2024-05-08T18:30:36.953 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.953 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.953 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:36.953 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.527258+0000", 2024-05-08T18:30:36.953 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010595489999999999 2024-05-08T18:30:36.953 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.953 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.953 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:36.953 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.527414+0000", 2024-05-08T18:30:36.953 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000156732 2024-05-08T18:30:36.953 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.953 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.954 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:36.954 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.527530+0000", 2024-05-08T18:30:36.954 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011565600000000001 2024-05-08T18:30:36.954 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:36.954 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:36.954 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:36.954 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.954 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.954 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:927 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:36.954 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.528868+0000", 2024-05-08T18:30:36.954 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 44.314812555000003, 2024-05-08T18:30:36.954 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00302987, 2024-05-08T18:30:36.954 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:36.954 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:36.955 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:36.955 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:36.955 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:36.955 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:36.955 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 927 2024-05-08T18:30:36.955 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.955 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:36.955 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.955 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:36.955 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.528868+0000", 2024-05-08T18:30:36.955 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:36.955 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.955 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.955 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:36.956 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.528868+0000", 2024-05-08T18:30:36.956 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:36.956 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.956 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.956 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:36.956 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.528870+0000", 2024-05-08T18:30:36.956 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6199999999999999e-06 2024-05-08T18:30:36.956 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.956 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.956 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:36.956 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.528877+0000", 2024-05-08T18:30:36.956 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4070000000000004e-06 2024-05-08T18:30:36.957 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.957 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.957 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:36.957 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.528899+0000", 2024-05-08T18:30:36.957 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1495999999999999e-05 2024-05-08T18:30:36.957 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.957 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.957 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:36.957 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.528910+0000", 2024-05-08T18:30:36.957 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1562999999999999e-05 2024-05-08T18:30:36.957 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.957 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.957 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:36.957 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.529027+0000", 2024-05-08T18:30:36.957 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000116873 2024-05-08T18:30:36.958 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.958 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.958 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:36.958 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.529258+0000", 2024-05-08T18:30:36.958 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000231065 2024-05-08T18:30:36.958 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.958 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.958 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:36.958 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.529732+0000", 2024-05-08T18:30:36.958 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000474043 2024-05-08T18:30:36.958 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.958 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.958 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:36.959 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.530983+0000", 2024-05-08T18:30:36.959 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0012505929999999999 2024-05-08T18:30:36.959 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.959 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.959 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:36.959 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.531621+0000", 2024-05-08T18:30:36.959 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00063814899999999996 2024-05-08T18:30:36.959 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.959 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.959 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:36.959 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.531785+0000", 2024-05-08T18:30:36.959 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016452200000000001 2024-05-08T18:30:36.959 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.959 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.959 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:36.960 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.531898+0000", 2024-05-08T18:30:36.960 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000112539 2024-05-08T18:30:36.960 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:36.960 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:36.960 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:36.960 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.960 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.960 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:36.960 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.532086+0000", 2024-05-08T18:30:36.960 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 44.311594190000001, 2024-05-08T18:30:36.960 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032260779999999998, 2024-05-08T18:30:36.960 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:36.960 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:36.961 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:36.961 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:36.961 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:36.961 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:36.961 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 928 2024-05-08T18:30:36.961 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.961 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:36.961 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.961 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:36.961 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.532086+0000", 2024-05-08T18:30:36.961 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:36.961 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.961 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.961 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:36.962 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.532086+0000", 2024-05-08T18:30:36.962 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:36.962 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.962 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.962 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:36.962 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.532088+0000", 2024-05-08T18:30:36.962 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8670000000000001e-06 2024-05-08T18:30:36.962 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.962 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.962 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:36.962 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.532097+0000", 2024-05-08T18:30:36.962 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.6929999999999996e-06 2024-05-08T18:30:36.962 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.963 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.963 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:36.963 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.532121+0000", 2024-05-08T18:30:36.963 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3572999999999999e-05 2024-05-08T18:30:36.963 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.963 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.963 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:36.963 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.532134+0000", 2024-05-08T18:30:36.963 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3823e-05 2024-05-08T18:30:36.963 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.963 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.963 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:36.963 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.532255+0000", 2024-05-08T18:30:36.964 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012074900000000001 2024-05-08T18:30:36.964 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.964 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.964 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:36.964 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.532588+0000", 2024-05-08T18:30:36.964 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000333068 2024-05-08T18:30:36.964 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.964 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.964 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:36.964 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.533135+0000", 2024-05-08T18:30:36.964 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000546259 2024-05-08T18:30:36.964 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.964 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.964 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:36.965 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.534441+0000", 2024-05-08T18:30:36.965 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0013061500000000001 2024-05-08T18:30:36.965 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.965 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.965 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:36.965 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.535049+0000", 2024-05-08T18:30:36.965 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00060823500000000005 2024-05-08T18:30:36.965 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.965 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.965 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:36.965 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.535203+0000", 2024-05-08T18:30:36.965 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015383500000000001 2024-05-08T18:30:36.965 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.966 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.966 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:36.966 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.535313+0000", 2024-05-08T18:30:36.966 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000109826 2024-05-08T18:30:36.966 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:36.966 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:36.966 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:36.966 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.966 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.966 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:930 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:36.966 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.536650+0000", 2024-05-08T18:30:36.966 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 44.307030904999998, 2024-05-08T18:30:36.966 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029677129999999999, 2024-05-08T18:30:36.967 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:36.967 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:36.967 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:36.967 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:36.967 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:36.967 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:36.967 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 930 2024-05-08T18:30:36.967 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.967 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:36.967 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.967 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:36.967 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.536650+0000", 2024-05-08T18:30:36.967 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:36.968 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.968 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.968 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:36.968 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.536650+0000", 2024-05-08T18:30:36.968 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:36.968 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.968 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.968 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:36.968 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.536652+0000", 2024-05-08T18:30:36.968 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1660000000000001e-06 2024-05-08T18:30:36.968 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.968 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.968 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:36.968 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.536680+0000", 2024-05-08T18:30:36.969 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8084000000000001e-05 2024-05-08T18:30:36.969 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.969 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.969 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:36.969 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.536711+0000", 2024-05-08T18:30:36.969 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1123e-05 2024-05-08T18:30:36.969 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.969 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.969 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:36.969 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.536729+0000", 2024-05-08T18:30:36.969 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8189000000000002e-05 2024-05-08T18:30:36.969 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.969 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.970 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:36.970 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.536852+0000", 2024-05-08T18:30:36.970 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000122729 2024-05-08T18:30:36.970 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.970 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.970 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:36.970 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.537074+0000", 2024-05-08T18:30:36.970 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022180600000000001 2024-05-08T18:30:36.970 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.970 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.970 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:36.970 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.537526+0000", 2024-05-08T18:30:36.970 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00045219599999999998 2024-05-08T18:30:36.970 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.971 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.971 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:36.971 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.538973+0000", 2024-05-08T18:30:36.971 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001447102 2024-05-08T18:30:36.971 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.971 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.971 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:36.971 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.539410+0000", 2024-05-08T18:30:36.971 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00043727399999999997 2024-05-08T18:30:36.971 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.971 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.971 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:36.971 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.539503+0000", 2024-05-08T18:30:36.972 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2338999999999998e-05 2024-05-08T18:30:36.972 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:36.972 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:36.972 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:36.972 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.539617+0000", 2024-05-08T18:30:36.972 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011470499999999999 2024-05-08T18:30:36.972 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:36.972 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:36.972 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:36.972 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:36.972 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:36.972 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:30:36.974 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-08T18:30:36.974 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:30:36.971+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:30:37.075 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:30:37.076+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:30:37.121 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-08T18:30:37.146 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:30:37.146 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:30:37.146 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 0 2024-05-08T18:30:37.146 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:30:37.160 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-08T18:30:37.176 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:30:37.176+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:30:37.275 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2024-05-08T18:30:37.276 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:30:37.277 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:30:37.275+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:30:37.285 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:30:37.285 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:30:37.285 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2024-05-08T18:30:37.285 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2024-05-08T18:30:37.285 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:30:37.292 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2024-05-08T18:30:37.292 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:30:37.299 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-08T18:30:37.308 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2024-05-08T18:30:37.308 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:30:37.324 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2024-05-08T18:30:37.325 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:30:37.345 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2024-05-08T18:30:37.345 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:30:37.364 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2024-05-08T18:30:37.365 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:30:37.378 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:30:37.380+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:30:37.382 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2024-05-08T18:30:37.383 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:30:37.403 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2024-05-08T18:30:37.403 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:30:37.466 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:37.466 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:37.480 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-08T18:30:37.480 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:30:37.475+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:30:37.581 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:30:37.580+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:30:37.644 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:37.644 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:37.659 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-08T18:30:37.704 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:30:37.703+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:30:37.776 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:37.776 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:37.781 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:30:37.780+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:30:37.790 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-08T18:30:37.882 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:30:37.879+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:30:37.953 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:37.953 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:37.967 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-08T18:30:37.983 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:30:37.984+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:30:38.084 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:30:38.083+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:30:38.135 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:38.135 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:38.149 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-08T18:30:38.186 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:30:38.184+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:30:38.287 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:30:38.283+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:30:38.316 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:38.316 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:38.330 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-08T18:30:38.416 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:30:38.415+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:30:38.488 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:30:38.488+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:30:38.497 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:38.498 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:38.512 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-08T18:30:38.537 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-08T18:30:38.589 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:30:38.587+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:30:38.647 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:38.647 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:38.663 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-08T18:30:38.690 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:30:38.687+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:30:38.783 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:38.783 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:38.791 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:30:38.792+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:30:38.797 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-08T18:30:38.892 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:30:38.891+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:30:38.950 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:38.951 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:38.964 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-08T18:30:39.010 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:30:39.012+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:30:39.083 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:39.083 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:39.094 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:30:39.096+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:30:39.095 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-08T18:30:39.196 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:30:39.195+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:30:39.260 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:39.261 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:39.274 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-08T18:30:39.322 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:30:39.324+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:30:39.397 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:39.397 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:39.397 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:30:39.395+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:30:39.411 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-08T18:30:39.421 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-08T18:30:39.498 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:30:39.500+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:30:39.519 INFO:teuthology.orchestra.run.smithi097.stderr:nodeep-scrub is set 2024-05-08T18:30:39.588 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:39.588 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:39.598 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2024-05-08T18:30:39.598 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:30:39.600 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:30:39.595+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:30:39.603 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-08T18:30:39.614 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2024-05-08T18:30:39.615 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:30:39.630 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2024-05-08T18:30:39.630 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:30:39.646 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2024-05-08T18:30:39.646 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:30:39.666 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2024-05-08T18:30:39.667 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:30:39.686 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2024-05-08T18:30:39.686 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:30:39.701 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:30:39.699+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:30:39.706 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2024-05-08T18:30:39.706 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:30:39.725 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:30:39.726 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:30:39.726 INFO:teuthology.orchestra.run.smithi097.stdout: "complaint_time": 30, 2024-05-08T18:30:39.726 INFO:teuthology.orchestra.run.smithi097.stdout: "num_blocked_ops": 0 2024-05-08T18:30:39.726 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:30:39.727 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2024-05-08T18:30:39.727 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:30:39.741 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-08T18:30:39.831 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:30:39.832+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:30:39.902 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:30:39.902 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2024-05-08T18:30:39.902 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2024-05-08T18:30:39.902 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-05-08T18:30:39.902 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.903 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4479.0:40 5.b 5:d797044f:::zonegroup_info.ea3b680f-900d-4805-81ec-055811625780:head [create,call version.set in=10b,writefull 0~436] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-05-08T18:30:39.903 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:44.637551+0000", 2024-05-08T18:30:39.903 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 55.263638696000001, 2024-05-08T18:30:39.903 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003054013, 2024-05-08T18:30:39.903 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:39.903 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:39.903 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:39.903 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:39.903 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4479", 2024-05-08T18:30:39.903 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3577501689", 2024-05-08T18:30:39.903 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 40 2024-05-08T18:30:39.903 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.903 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:39.904 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.904 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:39.904 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.637551+0000", 2024-05-08T18:30:39.904 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:39.904 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.904 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.904 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:39.904 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.637551+0000", 2024-05-08T18:30:39.904 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:39.904 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.904 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.904 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:39.904 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.637554+0000", 2024-05-08T18:30:39.905 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6599999999999999e-06 2024-05-08T18:30:39.905 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.905 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.905 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:39.905 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.637576+0000", 2024-05-08T18:30:39.905 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1965999999999999e-05 2024-05-08T18:30:39.905 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.905 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.905 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:39.905 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.637603+0000", 2024-05-08T18:30:39.905 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7257e-05 2024-05-08T18:30:39.905 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.905 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.905 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:39.906 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.637623+0000", 2024-05-08T18:30:39.906 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9570000000000001e-05 2024-05-08T18:30:39.906 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.906 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.906 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:39.906 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.637766+0000", 2024-05-08T18:30:39.906 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000143435 2024-05-08T18:30:39.906 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.906 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.906 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:39.906 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.638167+0000", 2024-05-08T18:30:39.906 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00040082399999999998 2024-05-08T18:30:39.906 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.907 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.907 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:39.907 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.638627+0000", 2024-05-08T18:30:39.907 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00046019300000000002 2024-05-08T18:30:39.907 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.907 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.907 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:39.907 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.640399+0000", 2024-05-08T18:30:39.907 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0017714199999999999 2024-05-08T18:30:39.907 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.907 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.907 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:39.907 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.640447+0000", 2024-05-08T18:30:39.908 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8383000000000001e-05 2024-05-08T18:30:39.908 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.908 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.908 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:39.908 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.640534+0000", 2024-05-08T18:30:39.908 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7078999999999998e-05 2024-05-08T18:30:39.908 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.908 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.908 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:39.908 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.640606+0000", 2024-05-08T18:30:39.908 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1225999999999999e-05 2024-05-08T18:30:39.908 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:39.908 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:39.908 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:39.909 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.909 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.909 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4479.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-05-08T18:30:39.909 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:44.643918+0000", 2024-05-08T18:30:39.909 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 55.257272421000003, 2024-05-08T18:30:39.909 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002986004, 2024-05-08T18:30:39.909 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:39.909 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:39.909 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:39.909 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:39.909 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4479", 2024-05-08T18:30:39.909 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3577501689", 2024-05-08T18:30:39.909 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 42 2024-05-08T18:30:39.910 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.910 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:39.910 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.910 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:39.910 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.643918+0000", 2024-05-08T18:30:39.910 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:39.910 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.910 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.910 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:39.910 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.643918+0000", 2024-05-08T18:30:39.910 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:39.911 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.911 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.911 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:39.911 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.643919+0000", 2024-05-08T18:30:39.911 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4729999999999999e-06 2024-05-08T18:30:39.911 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.911 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.911 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:39.911 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.643927+0000", 2024-05-08T18:30:39.911 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6389999999999992e-06 2024-05-08T18:30:39.911 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.911 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.911 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:39.911 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.643945+0000", 2024-05-08T18:30:39.911 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8195000000000001e-05 2024-05-08T18:30:39.912 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.912 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.912 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:39.912 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.643954+0000", 2024-05-08T18:30:39.912 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5210000000000002e-06 2024-05-08T18:30:39.912 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.912 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.912 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:39.912 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.644123+0000", 2024-05-08T18:30:39.912 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016904999999999999 2024-05-08T18:30:39.912 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.912 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.912 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:39.912 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.644315+0000", 2024-05-08T18:30:39.913 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00019202800000000001 2024-05-08T18:30:39.913 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.913 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.913 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:39.913 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.644505+0000", 2024-05-08T18:30:39.913 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000190552 2024-05-08T18:30:39.913 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.913 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.913 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:39.913 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.645877+0000", 2024-05-08T18:30:39.913 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001371702 2024-05-08T18:30:39.913 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.914 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.914 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:39.914 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.646778+0000", 2024-05-08T18:30:39.914 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00090065700000000002 2024-05-08T18:30:39.914 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.914 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.914 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:39.914 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.646843+0000", 2024-05-08T18:30:39.914 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5504000000000002e-05 2024-05-08T18:30:39.914 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.914 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.915 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:39.915 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.646904+0000", 2024-05-08T18:30:39.915 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0683000000000002e-05 2024-05-08T18:30:39.915 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:39.915 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:39.915 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:39.915 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.915 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.915 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:57 7.3 e30/29 7:c609908c:::notify.5:head v 30'2, mlcod=0'0)", 2024-05-08T18:30:39.915 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:48.669376+0000", 2024-05-08T18:30:39.916 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 51.231814313000001, 2024-05-08T18:30:39.916 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0041509479999999998, 2024-05-08T18:30:39.916 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:39.916 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:39.916 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:39.916 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:39.916 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.916 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:39.917 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669376+0000", 2024-05-08T18:30:39.917 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:39.917 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.917 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.917 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:39.917 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669376+0000", 2024-05-08T18:30:39.917 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:39.918 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.918 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.918 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:39.918 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669378+0000", 2024-05-08T18:30:39.918 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.79e-06 2024-05-08T18:30:39.918 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.918 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.918 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:39.918 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669393+0000", 2024-05-08T18:30:39.918 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5053e-05 2024-05-08T18:30:39.918 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.919 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.919 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:39.919 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669427+0000", 2024-05-08T18:30:39.919 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4326999999999998e-05 2024-05-08T18:30:39.919 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.919 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.919 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:39.919 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669451+0000", 2024-05-08T18:30:39.919 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3629e-05 2024-05-08T18:30:39.920 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.920 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.920 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:39.920 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669563+0000", 2024-05-08T18:30:39.920 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011251099999999999 2024-05-08T18:30:39.920 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.921 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.921 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:39.921 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669607+0000", 2024-05-08T18:30:39.921 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3877e-05 2024-05-08T18:30:39.921 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.921 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.921 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:39.921 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.673401+0000", 2024-05-08T18:30:39.921 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0037942819999999999 2024-05-08T18:30:39.921 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.921 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.921 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:39.921 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.673527+0000", 2024-05-08T18:30:39.922 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012547900000000001 2024-05-08T18:30:39.922 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:39.922 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:39.922 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:39.922 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.922 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.922 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:58 7.14 e30/29 7:2b04a3e9:::notify.6:head v 30'1, mlcod=0'0)", 2024-05-08T18:30:39.922 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:48.669496+0000", 2024-05-08T18:30:39.922 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 51.231693941000003, 2024-05-08T18:30:39.922 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0046805609999999997, 2024-05-08T18:30:39.922 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:39.922 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:39.922 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:39.923 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:39.923 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.923 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:39.923 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669496+0000", 2024-05-08T18:30:39.923 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:39.923 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.923 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.923 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:39.923 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669496+0000", 2024-05-08T18:30:39.923 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:39.923 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.923 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.923 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:39.924 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669497+0000", 2024-05-08T18:30:39.924 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0100000000000001e-06 2024-05-08T18:30:39.924 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.924 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.924 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:39.924 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669507+0000", 2024-05-08T18:30:39.924 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.7540000000000001e-06 2024-05-08T18:30:39.924 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.924 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.924 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:39.924 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669528+0000", 2024-05-08T18:30:39.924 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.05e-05 2024-05-08T18:30:39.925 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.925 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.925 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:39.925 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669544+0000", 2024-05-08T18:30:39.925 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6716000000000001e-05 2024-05-08T18:30:39.925 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.925 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.925 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:39.925 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669667+0000", 2024-05-08T18:30:39.925 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012275799999999999 2024-05-08T18:30:39.925 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.925 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.925 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:39.926 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669706+0000", 2024-05-08T18:30:39.926 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8764999999999999e-05 2024-05-08T18:30:39.926 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.926 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.926 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:39.926 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674100+0000", 2024-05-08T18:30:39.926 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.004394528 2024-05-08T18:30:39.926 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.926 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.926 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:39.926 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674177+0000", 2024-05-08T18:30:39.926 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6530000000000001e-05 2024-05-08T18:30:39.926 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:39.926 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:39.927 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:39.927 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.927 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.927 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:39.927 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.794231+0000", 2024-05-08T18:30:39.927 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 48.106959549999999, 2024-05-08T18:30:39.927 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031872810000000001, 2024-05-08T18:30:39.927 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:39.927 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:39.927 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:39.928 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:39.928 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:39.928 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:39.928 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 236 2024-05-08T18:30:39.928 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.928 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:39.928 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.928 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:39.928 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794231+0000", 2024-05-08T18:30:39.928 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:39.929 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.929 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.929 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:39.929 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794231+0000", 2024-05-08T18:30:39.929 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:39.929 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.929 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.929 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:39.929 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794234+0000", 2024-05-08T18:30:39.929 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.36e-06 2024-05-08T18:30:39.930 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.930 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.930 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:39.930 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794248+0000", 2024-05-08T18:30:39.930 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4372999999999999e-05 2024-05-08T18:30:39.930 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.930 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.930 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:39.930 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794279+0000", 2024-05-08T18:30:39.930 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1075999999999999e-05 2024-05-08T18:30:39.930 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.930 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.930 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:39.931 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794295+0000", 2024-05-08T18:30:39.931 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5386000000000001e-05 2024-05-08T18:30:39.931 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.931 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.931 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:39.931 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794416+0000", 2024-05-08T18:30:39.931 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012071899999999999 2024-05-08T18:30:39.931 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.931 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.931 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:39.931 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794638+0000", 2024-05-08T18:30:39.931 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00022262599999999999 2024-05-08T18:30:39.931 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.932 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.932 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:39.932 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.795061+0000", 2024-05-08T18:30:39.932 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00042248900000000001 2024-05-08T18:30:39.932 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.932 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.932 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:39.932 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.796477+0000", 2024-05-08T18:30:39.932 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0014162230000000001 2024-05-08T18:30:39.932 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.932 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.932 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:39.932 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.797258+0000", 2024-05-08T18:30:39.932 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00078159400000000004 2024-05-08T18:30:39.933 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.933 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.933 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:39.933 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.797349+0000", 2024-05-08T18:30:39.933 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0462000000000002e-05 2024-05-08T18:30:39.933 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.933 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.933 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:39.933 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.797418+0000", 2024-05-08T18:30:39.933 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8973000000000005e-05 2024-05-08T18:30:39.933 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:39.933 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:39.934 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:39.934 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.934 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.934 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:281 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:39.934 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.806063+0000", 2024-05-08T18:30:39.934 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 48.095127415999997, 2024-05-08T18:30:39.934 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002923761, 2024-05-08T18:30:39.934 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:39.934 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:39.934 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:39.934 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:39.934 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:39.935 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:39.935 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 281 2024-05-08T18:30:39.935 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.935 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:39.935 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.935 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:39.935 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.806063+0000", 2024-05-08T18:30:39.935 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:39.935 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.935 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.935 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:39.935 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.806063+0000", 2024-05-08T18:30:39.935 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:39.936 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.936 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.936 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:39.936 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.806064+0000", 2024-05-08T18:30:39.936 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.204e-06 2024-05-08T18:30:39.936 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.936 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.936 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:39.936 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.806073+0000", 2024-05-08T18:30:39.936 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5609999999999999e-06 2024-05-08T18:30:39.936 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.936 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.936 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:39.937 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.806089+0000", 2024-05-08T18:30:39.937 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6673000000000001e-05 2024-05-08T18:30:39.937 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.937 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.937 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:39.937 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.806098+0000", 2024-05-08T18:30:39.937 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8899999999999996e-06 2024-05-08T18:30:39.937 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.937 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.937 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:39.937 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.806165+0000", 2024-05-08T18:30:39.937 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6927999999999993e-05 2024-05-08T18:30:39.937 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.938 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.938 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:39.938 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.806298+0000", 2024-05-08T18:30:39.938 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000132886 2024-05-08T18:30:39.938 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.938 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.938 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:39.938 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.806453+0000", 2024-05-08T18:30:39.938 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000155339 2024-05-08T18:30:39.938 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.938 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.938 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:39.939 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.807157+0000", 2024-05-08T18:30:39.939 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00070363900000000004 2024-05-08T18:30:39.939 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.939 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.939 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:39.939 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.808880+0000", 2024-05-08T18:30:39.939 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0017227130000000001 2024-05-08T18:30:39.939 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.939 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.939 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:39.939 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.808938+0000", 2024-05-08T18:30:39.939 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8814999999999998e-05 2024-05-08T18:30:39.939 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.939 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.940 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:39.940 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.808987+0000", 2024-05-08T18:30:39.940 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8112999999999998e-05 2024-05-08T18:30:39.940 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:39.940 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:39.940 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:39.940 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.940 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.940 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:304 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:39.940 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.809645+0000", 2024-05-08T18:30:39.940 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 48.091545578000002, 2024-05-08T18:30:39.940 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031633579999999998, 2024-05-08T18:30:39.941 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:39.941 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:39.941 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:39.941 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:39.941 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:39.941 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:39.941 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 304 2024-05-08T18:30:39.941 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.941 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:39.941 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.941 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:39.941 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809645+0000", 2024-05-08T18:30:39.941 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:39.941 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.942 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.942 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:39.942 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809645+0000", 2024-05-08T18:30:39.942 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:39.942 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.942 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.942 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:39.942 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809646+0000", 2024-05-08T18:30:39.942 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.113e-06 2024-05-08T18:30:39.942 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.942 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.942 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:39.943 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809652+0000", 2024-05-08T18:30:39.943 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1650000000000003e-06 2024-05-08T18:30:39.943 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.943 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.943 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:39.943 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809668+0000", 2024-05-08T18:30:39.943 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6025e-05 2024-05-08T18:30:39.943 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.943 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.943 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:39.943 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809678+0000", 2024-05-08T18:30:39.943 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0456e-05 2024-05-08T18:30:39.943 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.943 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.944 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:39.944 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809745+0000", 2024-05-08T18:30:39.944 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7088000000000005e-05 2024-05-08T18:30:39.944 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.944 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.944 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:39.944 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809803+0000", 2024-05-08T18:30:39.944 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7405999999999999e-05 2024-05-08T18:30:39.944 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.944 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.944 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:39.944 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809951+0000", 2024-05-08T18:30:39.944 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014775500000000001 2024-05-08T18:30:39.945 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.945 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.945 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:39.945 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.810564+0000", 2024-05-08T18:30:39.945 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00061324899999999996 2024-05-08T18:30:39.945 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.945 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.945 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:39.945 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.812744+0000", 2024-05-08T18:30:39.945 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0021804509999999999 2024-05-08T18:30:39.945 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.945 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.945 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:39.945 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.812781+0000", 2024-05-08T18:30:39.946 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6554999999999998e-05 2024-05-08T18:30:39.946 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.946 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.946 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:39.946 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.812808+0000", 2024-05-08T18:30:39.946 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7095000000000001e-05 2024-05-08T18:30:39.946 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:39.946 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:39.946 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:39.946 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.946 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.946 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:39.946 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.105553+0000", 2024-05-08T18:30:39.947 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 47.795637567, 2024-05-08T18:30:39.947 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028754850000000001, 2024-05-08T18:30:39.947 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:39.947 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:39.947 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:39.947 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:39.947 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:39.947 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:39.947 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 742 2024-05-08T18:30:39.947 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.947 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:39.947 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.947 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:39.947 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.105553+0000", 2024-05-08T18:30:39.948 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:39.948 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.948 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.948 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:39.948 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.105553+0000", 2024-05-08T18:30:39.948 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:39.948 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.948 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.948 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:39.948 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.105556+0000", 2024-05-08T18:30:39.948 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3100000000000001e-06 2024-05-08T18:30:39.948 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.948 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.949 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:39.949 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.105569+0000", 2024-05-08T18:30:39.949 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2754e-05 2024-05-08T18:30:39.949 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.949 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.949 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:39.949 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.105601+0000", 2024-05-08T18:30:39.949 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2435999999999999e-05 2024-05-08T18:30:39.949 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.949 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.949 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:39.950 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.105616+0000", 2024-05-08T18:30:39.950 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4657e-05 2024-05-08T18:30:39.950 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.950 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.950 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:39.950 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.105804+0000", 2024-05-08T18:30:39.950 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00018861799999999999 2024-05-08T18:30:39.950 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.950 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.951 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:39.951 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.106054+0000", 2024-05-08T18:30:39.951 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024948499999999997 2024-05-08T18:30:39.951 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.951 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.951 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:39.951 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.106390+0000", 2024-05-08T18:30:39.951 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00033640100000000001 2024-05-08T18:30:39.951 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.951 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.951 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:39.951 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.107527+0000", 2024-05-08T18:30:39.951 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001136871 2024-05-08T18:30:39.951 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.953 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.953 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:39.953 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.108265+0000", 2024-05-08T18:30:39.953 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00073753100000000004 2024-05-08T18:30:39.953 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.954 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.954 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:39.954 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.108353+0000", 2024-05-08T18:30:39.954 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8232999999999994e-05 2024-05-08T18:30:39.954 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.954 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.954 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:39.954 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.108428+0000", 2024-05-08T18:30:39.954 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.5189000000000001e-05 2024-05-08T18:30:39.954 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:39.954 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:39.955 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:39.955 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.955 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.955 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:39.955 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.148015+0000", 2024-05-08T18:30:39.955 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 47.753175624000001, 2024-05-08T18:30:39.955 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032297409999999999, 2024-05-08T18:30:39.955 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:39.955 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:39.955 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:39.955 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:39.955 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:39.955 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:39.955 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 760 2024-05-08T18:30:39.956 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.956 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:39.956 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.956 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:39.956 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.148015+0000", 2024-05-08T18:30:39.956 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:39.956 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.956 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.956 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:39.956 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.148015+0000", 2024-05-08T18:30:39.956 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:39.956 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.956 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.957 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:39.957 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.148017+0000", 2024-05-08T18:30:39.957 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1830000000000001e-06 2024-05-08T18:30:39.957 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.957 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.957 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:39.957 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.148030+0000", 2024-05-08T18:30:39.957 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2893e-05 2024-05-08T18:30:39.957 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.957 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.957 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:39.957 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.148061+0000", 2024-05-08T18:30:39.957 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0953e-05 2024-05-08T18:30:39.958 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.958 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.958 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:39.958 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.148077+0000", 2024-05-08T18:30:39.958 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6554000000000001e-05 2024-05-08T18:30:39.958 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.958 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.958 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:39.958 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.148230+0000", 2024-05-08T18:30:39.958 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015263899999999999 2024-05-08T18:30:39.958 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.958 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.958 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:39.959 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.148592+0000", 2024-05-08T18:30:39.959 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00036219699999999997 2024-05-08T18:30:39.959 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.959 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.959 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:39.959 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.149139+0000", 2024-05-08T18:30:39.959 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00054734599999999999 2024-05-08T18:30:39.959 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.959 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.959 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:39.959 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.150505+0000", 2024-05-08T18:30:39.959 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001365479 2024-05-08T18:30:39.959 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.960 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.960 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:39.960 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.151087+0000", 2024-05-08T18:30:39.960 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00058201200000000002 2024-05-08T18:30:39.960 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.960 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.960 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:39.960 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.151175+0000", 2024-05-08T18:30:39.960 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8199e-05 2024-05-08T18:30:39.960 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.960 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.960 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:39.960 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.151244+0000", 2024-05-08T18:30:39.960 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9286e-05 2024-05-08T18:30:39.961 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:39.961 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:39.961 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:39.961 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.961 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.961 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:39.961 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.277376+0000", 2024-05-08T18:30:39.961 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 47.623813706, 2024-05-08T18:30:39.961 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032022190000000001, 2024-05-08T18:30:39.961 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:39.961 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:39.961 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:39.961 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:39.962 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:39.962 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:39.962 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 817 2024-05-08T18:30:39.962 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.962 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:39.962 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.962 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:39.962 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.277376+0000", 2024-05-08T18:30:39.962 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:39.962 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.962 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.962 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:39.962 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.277376+0000", 2024-05-08T18:30:39.963 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:39.963 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.963 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.963 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:39.963 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.277379+0000", 2024-05-08T18:30:39.963 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4430000000000002e-06 2024-05-08T18:30:39.963 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.963 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.963 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:39.963 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.277391+0000", 2024-05-08T18:30:39.963 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1634000000000001e-05 2024-05-08T18:30:39.963 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.963 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.964 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:39.964 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.277421+0000", 2024-05-08T18:30:39.964 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0691999999999997e-05 2024-05-08T18:30:39.964 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.964 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.964 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:39.964 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.277438+0000", 2024-05-08T18:30:39.964 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7102999999999999e-05 2024-05-08T18:30:39.964 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.964 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.964 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:39.964 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.277602+0000", 2024-05-08T18:30:39.964 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016345300000000001 2024-05-08T18:30:39.964 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.965 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.965 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:39.965 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.278019+0000", 2024-05-08T18:30:39.965 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00041724699999999998 2024-05-08T18:30:39.965 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.965 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.965 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:39.965 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.278573+0000", 2024-05-08T18:30:39.965 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00055391900000000005 2024-05-08T18:30:39.965 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.965 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.965 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:39.965 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.279973+0000", 2024-05-08T18:30:39.966 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0013995819999999999 2024-05-08T18:30:39.966 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.966 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.966 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:39.966 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.280422+0000", 2024-05-08T18:30:39.966 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00044940699999999997 2024-05-08T18:30:39.966 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.966 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.966 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:39.966 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.280509+0000", 2024-05-08T18:30:39.966 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7455999999999997e-05 2024-05-08T18:30:39.966 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.966 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.967 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:39.967 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.280579+0000", 2024-05-08T18:30:39.967 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9282999999999994e-05 2024-05-08T18:30:39.967 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:39.967 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:39.967 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:39.967 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.967 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.967 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:39.968 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.281716+0000", 2024-05-08T18:30:39.968 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 47.619474339, 2024-05-08T18:30:39.968 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003275881, 2024-05-08T18:30:39.968 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:39.968 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:39.968 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:39.969 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:39.969 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:39.969 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:39.969 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 819 2024-05-08T18:30:39.969 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.970 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:39.970 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.970 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:39.970 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.281716+0000", 2024-05-08T18:30:39.970 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:39.970 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.971 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.971 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:39.971 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.281716+0000", 2024-05-08T18:30:39.971 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:39.971 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.972 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.972 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:39.972 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.281718+0000", 2024-05-08T18:30:39.972 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.863e-06 2024-05-08T18:30:39.972 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.972 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.973 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:39.973 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.281728+0000", 2024-05-08T18:30:39.973 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0550000000000001e-05 2024-05-08T18:30:39.973 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.973 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.973 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:39.973 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.281760+0000", 2024-05-08T18:30:39.973 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2150000000000002e-05 2024-05-08T18:30:39.973 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.973 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.974 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:39.974 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.281776+0000", 2024-05-08T18:30:39.974 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6005999999999999e-05 2024-05-08T18:30:39.974 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.974 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.974 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:39.974 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.281917+0000", 2024-05-08T18:30:39.974 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014070200000000001 2024-05-08T18:30:39.974 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.974 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.974 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:39.974 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.282148+0000", 2024-05-08T18:30:39.975 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023095200000000001 2024-05-08T18:30:39.975 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.975 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.975 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:39.975 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.282641+0000", 2024-05-08T18:30:39.975 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00049337999999999997 2024-05-08T18:30:39.975 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.975 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.975 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:39.975 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.284070+0000", 2024-05-08T18:30:39.975 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0014287950000000001 2024-05-08T18:30:39.975 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.975 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.976 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:39.976 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.284837+0000", 2024-05-08T18:30:39.976 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00076679799999999996 2024-05-08T18:30:39.976 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.976 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.976 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:39.976 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.284925+0000", 2024-05-08T18:30:39.976 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8165999999999996e-05 2024-05-08T18:30:39.976 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.976 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.976 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:39.976 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.284992+0000", 2024-05-08T18:30:39.976 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6519000000000005e-05 2024-05-08T18:30:39.977 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:39.977 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:39.977 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:39.977 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.977 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.977 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:39.977 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.334745+0000", 2024-05-08T18:30:39.977 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 47.566445428999998, 2024-05-08T18:30:39.977 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032404719999999999, 2024-05-08T18:30:39.977 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:39.977 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:39.978 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:39.978 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:39.978 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:39.978 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:39.978 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 841 2024-05-08T18:30:39.978 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.978 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:39.978 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.978 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:39.978 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.334745+0000", 2024-05-08T18:30:39.979 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:39.979 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.979 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.979 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:39.979 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.334745+0000", 2024-05-08T18:30:39.979 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:39.979 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.979 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.979 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:39.979 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.334747+0000", 2024-05-08T18:30:39.979 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.407e-06 2024-05-08T18:30:39.980 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.980 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.980 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:39.980 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.334759+0000", 2024-05-08T18:30:39.980 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1883e-05 2024-05-08T18:30:39.980 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.980 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.980 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:39.980 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.334789+0000", 2024-05-08T18:30:39.980 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9957000000000001e-05 2024-05-08T18:30:39.980 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.980 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.980 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:39.981 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.334804+0000", 2024-05-08T18:30:39.981 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4713e-05 2024-05-08T18:30:39.981 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.981 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.981 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:39.981 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.334951+0000", 2024-05-08T18:30:39.981 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000147675 2024-05-08T18:30:39.981 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.981 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.981 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:39.981 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.335304+0000", 2024-05-08T18:30:39.981 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00035214099999999999 2024-05-08T18:30:39.981 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.981 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.982 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:39.982 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.335859+0000", 2024-05-08T18:30:39.982 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00055546899999999995 2024-05-08T18:30:39.982 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.982 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.982 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:39.982 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.337168+0000", 2024-05-08T18:30:39.982 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0013087299999999999 2024-05-08T18:30:39.982 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.982 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.982 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:39.982 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.337808+0000", 2024-05-08T18:30:39.983 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00064005500000000005 2024-05-08T18:30:39.983 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.983 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.983 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:39.983 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.337894+0000", 2024-05-08T18:30:39.983 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6593000000000003e-05 2024-05-08T18:30:39.983 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.983 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.983 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:39.983 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.337985+0000", 2024-05-08T18:30:39.983 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0848999999999997e-05 2024-05-08T18:30:39.983 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:39.983 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:39.984 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:39.984 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.984 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.984 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:39.984 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.338870+0000", 2024-05-08T18:30:39.984 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 47.562320679999999, 2024-05-08T18:30:39.984 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002862121, 2024-05-08T18:30:39.984 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:39.984 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:39.984 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:39.984 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:39.984 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:39.984 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:39.985 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 843 2024-05-08T18:30:39.985 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.985 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:39.985 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.985 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:39.985 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.338870+0000", 2024-05-08T18:30:39.985 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:39.985 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.985 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.985 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:39.985 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.338870+0000", 2024-05-08T18:30:39.985 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:39.985 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.985 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.986 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:39.986 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.338872+0000", 2024-05-08T18:30:39.986 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3429999999999998e-06 2024-05-08T18:30:39.986 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.986 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.986 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:39.986 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.338883+0000", 2024-05-08T18:30:39.986 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1447000000000001e-05 2024-05-08T18:30:39.986 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.986 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.986 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:39.987 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.338914+0000", 2024-05-08T18:30:39.987 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1052e-05 2024-05-08T18:30:39.987 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.987 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.987 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:39.987 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.338932+0000", 2024-05-08T18:30:39.987 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7604e-05 2024-05-08T18:30:39.987 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.987 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.987 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:39.987 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.339019+0000", 2024-05-08T18:30:39.987 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6982000000000002e-05 2024-05-08T18:30:39.987 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.987 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.988 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:39.988 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.339139+0000", 2024-05-08T18:30:39.988 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011978599999999999 2024-05-08T18:30:39.988 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.988 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.988 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:39.988 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.339415+0000", 2024-05-08T18:30:39.988 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00027644799999999999 2024-05-08T18:30:39.988 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.988 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.988 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:39.988 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.340619+0000", 2024-05-08T18:30:39.988 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012043010000000001 2024-05-08T18:30:39.988 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.989 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.989 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:39.989 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.341454+0000", 2024-05-08T18:30:39.989 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00083464300000000004 2024-05-08T18:30:39.989 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.989 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.989 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:39.989 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.341609+0000", 2024-05-08T18:30:39.989 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000154752 2024-05-08T18:30:39.989 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.989 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.989 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:39.989 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.341732+0000", 2024-05-08T18:30:39.990 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012276299999999999 2024-05-08T18:30:39.990 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:39.990 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:39.990 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:39.990 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.990 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.990 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:39.990 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.349287+0000", 2024-05-08T18:30:39.990 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 47.551902851000001, 2024-05-08T18:30:39.990 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032683220000000002, 2024-05-08T18:30:39.990 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:39.990 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:39.990 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:39.991 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:39.991 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:39.991 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:39.991 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 847 2024-05-08T18:30:39.991 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.991 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:39.991 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.991 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:39.991 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.349287+0000", 2024-05-08T18:30:39.991 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:39.991 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.991 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.991 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:39.992 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.349287+0000", 2024-05-08T18:30:39.992 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:39.992 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.992 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.992 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:39.992 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.349290+0000", 2024-05-08T18:30:39.992 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3369999999999998e-06 2024-05-08T18:30:39.992 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.992 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.992 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:39.992 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.349318+0000", 2024-05-08T18:30:39.992 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8419999999999999e-05 2024-05-08T18:30:39.992 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.992 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.993 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:39.993 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.349348+0000", 2024-05-08T18:30:39.993 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0260000000000002e-05 2024-05-08T18:30:39.993 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.993 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.993 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:39.993 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.349364+0000", 2024-05-08T18:30:39.993 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5359999999999999e-05 2024-05-08T18:30:39.993 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.993 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.994 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:39.994 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.349511+0000", 2024-05-08T18:30:39.994 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014760199999999999 2024-05-08T18:30:39.994 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.994 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.994 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:39.994 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.349872+0000", 2024-05-08T18:30:39.994 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00036035 2024-05-08T18:30:39.994 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.994 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.994 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:39.994 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.350432+0000", 2024-05-08T18:30:39.994 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00056059600000000001 2024-05-08T18:30:39.995 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.995 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.995 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:39.995 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.351817+0000", 2024-05-08T18:30:39.995 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001385063 2024-05-08T18:30:39.995 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.995 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.995 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:39.995 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.352402+0000", 2024-05-08T18:30:39.995 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00058490500000000004 2024-05-08T18:30:39.995 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.995 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.995 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:39.995 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.352488+0000", 2024-05-08T18:30:39.996 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6032999999999994e-05 2024-05-08T18:30:39.996 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.996 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.996 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:39.996 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.352556+0000", 2024-05-08T18:30:39.996 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7396000000000003e-05 2024-05-08T18:30:39.996 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:39.996 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:39.996 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:39.996 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.996 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.996 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:39.996 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.353786+0000", 2024-05-08T18:30:39.997 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 47.547404016000002, 2024-05-08T18:30:39.997 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0029130850000000002, 2024-05-08T18:30:39.997 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:39.997 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:39.997 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:39.997 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:39.997 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:39.997 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:39.997 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 849 2024-05-08T18:30:39.997 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.997 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:39.997 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.997 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:39.997 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.353786+0000", 2024-05-08T18:30:39.997 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:39.998 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.998 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.998 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:39.998 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.353786+0000", 2024-05-08T18:30:39.998 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:39.998 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.998 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.998 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:39.998 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.353788+0000", 2024-05-08T18:30:39.998 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0370000000000001e-06 2024-05-08T18:30:39.999 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.999 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.999 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:39.999 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.353799+0000", 2024-05-08T18:30:39.999 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0686000000000001e-05 2024-05-08T18:30:39.999 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.999 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:39.999 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:39.999 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.353832+0000", 2024-05-08T18:30:39.999 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.341e-05 2024-05-08T18:30:39.999 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:39.999 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.000 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:40.000 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.353851+0000", 2024-05-08T18:30:40.000 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8343999999999999e-05 2024-05-08T18:30:40.000 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.000 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.000 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:40.000 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.353980+0000", 2024-05-08T18:30:40.000 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012914900000000001 2024-05-08T18:30:40.000 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.000 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.000 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:40.000 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.354123+0000", 2024-05-08T18:30:40.000 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000142912 2024-05-08T18:30:40.000 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.001 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.001 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:40.001 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.354393+0000", 2024-05-08T18:30:40.001 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00027009799999999997 2024-05-08T18:30:40.001 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.001 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.001 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:40.001 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.355769+0000", 2024-05-08T18:30:40.001 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001375839 2024-05-08T18:30:40.001 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.001 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.001 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:40.001 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.356421+0000", 2024-05-08T18:30:40.001 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00065227799999999995 2024-05-08T18:30:40.002 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.002 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.002 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:40.002 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.356592+0000", 2024-05-08T18:30:40.002 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000170586 2024-05-08T18:30:40.002 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.002 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.002 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:40.002 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.356699+0000", 2024-05-08T18:30:40.002 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010774599999999999 2024-05-08T18:30:40.002 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:40.003 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:40.003 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:40.003 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.003 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.003 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:40.003 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.402673+0000", 2024-05-08T18:30:40.003 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 47.498517343000003, 2024-05-08T18:30:40.003 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002928295, 2024-05-08T18:30:40.003 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:40.003 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:40.003 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:40.003 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:40.003 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:40.004 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:40.004 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 870 2024-05-08T18:30:40.004 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.004 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:40.004 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.004 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:40.004 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.402673+0000", 2024-05-08T18:30:40.004 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:40.004 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.004 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.004 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:40.004 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.402673+0000", 2024-05-08T18:30:40.004 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:40.004 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.005 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.005 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:40.005 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.402675+0000", 2024-05-08T18:30:40.005 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0030000000000001e-06 2024-05-08T18:30:40.005 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.005 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.005 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:40.005 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.402685+0000", 2024-05-08T18:30:40.005 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0566e-05 2024-05-08T18:30:40.005 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.005 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.005 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:40.006 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.402714+0000", 2024-05-08T18:30:40.006 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8804999999999999e-05 2024-05-08T18:30:40.006 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.006 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.006 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:40.006 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.402731+0000", 2024-05-08T18:30:40.007 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6731e-05 2024-05-08T18:30:40.007 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.007 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.007 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:40.007 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.402863+0000", 2024-05-08T18:30:40.007 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013194199999999999 2024-05-08T18:30:40.008 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.008 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.008 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:40.008 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.403096+0000", 2024-05-08T18:30:40.008 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023309900000000001 2024-05-08T18:30:40.008 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.008 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.009 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:40.009 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.403553+0000", 2024-05-08T18:30:40.009 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00045738700000000002 2024-05-08T18:30:40.009 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.009 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.009 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:40.010 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.404843+0000", 2024-05-08T18:30:40.010 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012894650000000001 2024-05-08T18:30:40.010 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.010 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.010 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:40.010 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.405348+0000", 2024-05-08T18:30:40.011 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00050483600000000004 2024-05-08T18:30:40.011 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.011 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.011 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:40.011 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.405491+0000", 2024-05-08T18:30:40.011 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014349299999999999 2024-05-08T18:30:40.012 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.012 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.012 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:40.012 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.405601+0000", 2024-05-08T18:30:40.012 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000109968 2024-05-08T18:30:40.012 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:40.013 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:40.013 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:40.013 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.013 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.013 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:40.013 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.484247+0000", 2024-05-08T18:30:40.014 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 47.416943142999997, 2024-05-08T18:30:40.014 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028903679999999999, 2024-05-08T18:30:40.014 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:40.014 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:40.014 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:40.014 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:40.015 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:40.015 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:40.015 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 907 2024-05-08T18:30:40.015 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.015 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:40.015 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.015 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:40.016 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.484247+0000", 2024-05-08T18:30:40.016 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:40.016 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.016 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.016 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:40.017 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.484247+0000", 2024-05-08T18:30:40.017 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:40.017 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.017 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.017 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:40.017 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.484250+0000", 2024-05-08T18:30:40.017 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6900000000000001e-06 2024-05-08T18:30:40.018 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.018 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.018 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:40.018 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.484263+0000", 2024-05-08T18:30:40.018 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2967e-05 2024-05-08T18:30:40.019 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.019 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.019 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:40.019 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.484294+0000", 2024-05-08T18:30:40.019 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1016000000000003e-05 2024-05-08T18:30:40.019 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.019 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.020 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:40.020 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.484309+0000", 2024-05-08T18:30:40.020 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5187e-05 2024-05-08T18:30:40.020 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.020 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.021 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:40.021 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.484467+0000", 2024-05-08T18:30:40.021 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015810499999999999 2024-05-08T18:30:40.021 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.021 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.021 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:40.022 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.484698+0000", 2024-05-08T18:30:40.022 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000230852 2024-05-08T18:30:40.022 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.022 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.022 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:40.022 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.485026+0000", 2024-05-08T18:30:40.023 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00032833 2024-05-08T18:30:40.023 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.023 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.023 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:40.023 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.486177+0000", 2024-05-08T18:30:40.023 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0011504309999999999 2024-05-08T18:30:40.024 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.024 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.024 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:40.024 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.486978+0000", 2024-05-08T18:30:40.024 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000801161 2024-05-08T18:30:40.024 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.025 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.025 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:40.025 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.487068+0000", 2024-05-08T18:30:40.025 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0435999999999999e-05 2024-05-08T18:30:40.025 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.025 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.026 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:40.026 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.487137+0000", 2024-05-08T18:30:40.026 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9193e-05 2024-05-08T18:30:40.026 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:40.026 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:40.027 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:40.027 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.027 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.027 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:40.027 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.585363+0000", 2024-05-08T18:30:40.027 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 47.315827300000002, 2024-05-08T18:30:40.028 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028400080000000002, 2024-05-08T18:30:40.028 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:40.028 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:40.028 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:40.028 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:40.029 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:40.029 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:40.029 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 949 2024-05-08T18:30:40.029 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.029 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:40.029 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.030 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:40.030 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.585363+0000", 2024-05-08T18:30:40.030 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:40.030 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.030 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.031 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:40.031 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.585363+0000", 2024-05-08T18:30:40.031 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:40.031 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.031 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.031 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:40.032 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.585366+0000", 2024-05-08T18:30:40.032 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7099999999999999e-06 2024-05-08T18:30:40.032 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.032 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.032 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:40.033 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.585378+0000", 2024-05-08T18:30:40.033 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1970000000000001e-05 2024-05-08T18:30:40.033 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.033 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.033 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:40.034 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.585408+0000", 2024-05-08T18:30:40.034 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0389999999999999e-05 2024-05-08T18:30:40.034 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.034 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.034 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:40.035 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.585423+0000", 2024-05-08T18:30:40.035 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4929999999999999e-05 2024-05-08T18:30:40.035 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.035 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.035 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:40.035 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.585559+0000", 2024-05-08T18:30:40.036 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013563599999999999 2024-05-08T18:30:40.036 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.036 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.036 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:40.036 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.585780+0000", 2024-05-08T18:30:40.036 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000221828 2024-05-08T18:30:40.037 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.037 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.037 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:40.037 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.586121+0000", 2024-05-08T18:30:40.037 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000340181 2024-05-08T18:30:40.037 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.038 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.038 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:40.038 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.587268+0000", 2024-05-08T18:30:40.038 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001146984 2024-05-08T18:30:40.038 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.038 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.039 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:40.039 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.588047+0000", 2024-05-08T18:30:40.039 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000779877 2024-05-08T18:30:40.039 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.039 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.039 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:40.040 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.588136+0000", 2024-05-08T18:30:40.040 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8483e-05 2024-05-08T18:30:40.040 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.040 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.040 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:40.040 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.588203+0000", 2024-05-08T18:30:40.041 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7019000000000003e-05 2024-05-08T18:30:40.041 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:40.041 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:40.041 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:40.041 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.041 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.042 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:951 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:40.042 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.589044+0000", 2024-05-08T18:30:40.042 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 47.312145878000003, 2024-05-08T18:30:40.042 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002802672, 2024-05-08T18:30:40.042 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:40.042 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:40.042 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:40.043 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:40.043 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:40.043 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:40.043 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 951 2024-05-08T18:30:40.043 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.043 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:40.043 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.043 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:40.043 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.589044+0000", 2024-05-08T18:30:40.044 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:40.044 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.044 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.044 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:40.044 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.589044+0000", 2024-05-08T18:30:40.044 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:40.044 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.044 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.045 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:40.045 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.589046+0000", 2024-05-08T18:30:40.045 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6670000000000001e-06 2024-05-08T18:30:40.045 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.045 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.045 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:40.045 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.589054+0000", 2024-05-08T18:30:40.046 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.2600000000000005e-06 2024-05-08T18:30:40.046 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.046 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.046 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:40.046 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.589076+0000", 2024-05-08T18:30:40.046 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1373e-05 2024-05-08T18:30:40.046 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.046 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.047 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:40.047 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.589088+0000", 2024-05-08T18:30:40.047 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2768999999999999e-05 2024-05-08T18:30:40.047 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.047 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.047 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:40.047 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.589220+0000", 2024-05-08T18:30:40.047 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013146300000000001 2024-05-08T18:30:40.047 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.047 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.047 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:40.047 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.589462+0000", 2024-05-08T18:30:40.047 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024250500000000001 2024-05-08T18:30:40.048 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.048 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.048 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:40.048 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.589956+0000", 2024-05-08T18:30:40.048 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00049331600000000005 2024-05-08T18:30:40.048 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.048 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.048 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:40.048 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.591337+0000", 2024-05-08T18:30:40.048 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0013816290000000001 2024-05-08T18:30:40.048 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.048 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.048 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:40.049 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.591688+0000", 2024-05-08T18:30:40.049 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00035083400000000001 2024-05-08T18:30:40.049 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.049 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.049 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:40.049 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.591780+0000", 2024-05-08T18:30:40.049 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.2312999999999995e-05 2024-05-08T18:30:40.049 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.049 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.049 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:40.049 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.591847+0000", 2024-05-08T18:30:40.049 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6543000000000003e-05 2024-05-08T18:30:40.049 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:40.049 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:40.050 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:40.050 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.050 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.050 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:40.050 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.599312+0000", 2024-05-08T18:30:40.050 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 47.301878414000001, 2024-05-08T18:30:40.050 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0027928190000000002, 2024-05-08T18:30:40.050 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:40.050 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:40.050 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:40.050 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:40.050 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:40.050 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:40.051 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 955 2024-05-08T18:30:40.051 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.051 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:40.051 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.051 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:40.051 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.599312+0000", 2024-05-08T18:30:40.051 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:40.051 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.051 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.051 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:40.051 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.599312+0000", 2024-05-08T18:30:40.051 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:40.051 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.052 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.052 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:40.052 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.599314+0000", 2024-05-08T18:30:40.052 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.396e-06 2024-05-08T18:30:40.052 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.052 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.052 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:40.052 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.599325+0000", 2024-05-08T18:30:40.052 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1063999999999999e-05 2024-05-08T18:30:40.052 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.052 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.053 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:40.053 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.599354+0000", 2024-05-08T18:30:40.053 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8462999999999998e-05 2024-05-08T18:30:40.053 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.053 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.053 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:40.053 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.599369+0000", 2024-05-08T18:30:40.053 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4963000000000001e-05 2024-05-08T18:30:40.053 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.053 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.053 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:40.053 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.599503+0000", 2024-05-08T18:30:40.053 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013385299999999999 2024-05-08T18:30:40.053 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.054 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.054 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:40.054 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.599744+0000", 2024-05-08T18:30:40.054 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024137400000000001 2024-05-08T18:30:40.054 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.054 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.054 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:40.054 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.600084+0000", 2024-05-08T18:30:40.054 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00033999399999999998 2024-05-08T18:30:40.054 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.054 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.054 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:40.054 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.601319+0000", 2024-05-08T18:30:40.055 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012348140000000001 2024-05-08T18:30:40.055 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.055 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.055 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:40.055 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.601956+0000", 2024-05-08T18:30:40.055 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00063721199999999996 2024-05-08T18:30:40.055 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.055 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.055 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:40.055 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.602038+0000", 2024-05-08T18:30:40.055 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.1705999999999993e-05 2024-05-08T18:30:40.056 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.056 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.056 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:40.056 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.602105+0000", 2024-05-08T18:30:40.056 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6979999999999999e-05 2024-05-08T18:30:40.056 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:40.056 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:40.056 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:40.056 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:40.056 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:40.056 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:30:40.058 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-08T18:30:40.058 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:30:40.059+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:30:40.159 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:30:40.155+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:30:40.225 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-05-08T18:30:40.226 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-05-08T18:30:40.230 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:30:40.231 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:30:40.231 INFO:teuthology.orchestra.run.smithi097.stdout: "num_ops": 0 2024-05-08T18:30:40.231 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:30:40.245 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-08T18:30:40.259 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:30:40.259+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:30:40.360 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:30:40.355+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:30:40.370 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:30:40.370 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:30:40.370 INFO:teuthology.orchestra.run.smithi097.stdout: "complaint_time": 30, 2024-05-08T18:30:40.370 INFO:teuthology.orchestra.run.smithi097.stdout: "num_blocked_ops": 0 2024-05-08T18:30:40.371 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:30:40.385 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-08T18:30:40.461 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:30:40.459+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:30:40.512 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:30:40.512 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2024-05-08T18:30:40.512 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2024-05-08T18:30:40.512 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-05-08T18:30:40.512 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.512 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:57 7.3 7:c609908c:::notify.5:head [watch watch cookie 94069412621696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:30:40.512 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:48.668590+0000", 2024-05-08T18:30:40.513 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 51.844672639999999, 2024-05-08T18:30:40.513 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0054375830000000002, 2024-05-08T18:30:40.513 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:40.513 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:40.513 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:40.513 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:40.513 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:40.513 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:40.513 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 57 2024-05-08T18:30:40.513 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.513 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:40.513 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.513 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:40.514 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668590+0000", 2024-05-08T18:30:40.514 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:40.514 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.514 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.514 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:40.514 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668590+0000", 2024-05-08T18:30:40.514 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:40.514 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.514 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.514 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:40.514 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668592+0000", 2024-05-08T18:30:40.514 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0930000000000001e-06 2024-05-08T18:30:40.515 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.515 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.515 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:40.515 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668619+0000", 2024-05-08T18:30:40.515 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7396999999999999e-05 2024-05-08T18:30:40.515 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.515 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.515 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:40.515 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668650+0000", 2024-05-08T18:30:40.515 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0620000000000002e-05 2024-05-08T18:30:40.515 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.515 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.515 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:40.515 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668672+0000", 2024-05-08T18:30:40.516 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2093e-05 2024-05-08T18:30:40.516 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.516 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.516 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:40.516 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668782+0000", 2024-05-08T18:30:40.516 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011010600000000001 2024-05-08T18:30:40.516 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.516 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.516 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:40.516 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668934+0000", 2024-05-08T18:30:40.516 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000152268 2024-05-08T18:30:40.516 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.516 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.516 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-05-08T18:30:40.517 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669177+0000", 2024-05-08T18:30:40.517 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024286500000000001 2024-05-08T18:30:40.517 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.517 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.517 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:40.517 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.670404+0000", 2024-05-08T18:30:40.517 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001226932 2024-05-08T18:30:40.517 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.517 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.517 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:40.517 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.673822+0000", 2024-05-08T18:30:40.517 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003417776 2024-05-08T18:30:40.518 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.518 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.518 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:40.518 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.673924+0000", 2024-05-08T18:30:40.518 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000102379 2024-05-08T18:30:40.518 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.518 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.518 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:40.518 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674027+0000", 2024-05-08T18:30:40.518 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010305400000000001 2024-05-08T18:30:40.518 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:40.518 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:40.518 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:40.519 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.519 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.519 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:58 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:30:40.519 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:48.668750+0000", 2024-05-08T18:30:40.519 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 51.844512213999998, 2024-05-08T18:30:40.519 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0057687559999999999, 2024-05-08T18:30:40.519 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:40.519 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:40.519 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:40.519 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:40.519 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:40.519 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:40.520 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 58 2024-05-08T18:30:40.520 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.520 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:40.520 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.520 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:40.520 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668750+0000", 2024-05-08T18:30:40.520 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:40.520 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.520 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.520 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:40.520 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668750+0000", 2024-05-08T18:30:40.520 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:40.520 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.520 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.521 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:40.521 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668752+0000", 2024-05-08T18:30:40.521 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.64e-06 2024-05-08T18:30:40.521 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.521 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.521 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:40.521 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668760+0000", 2024-05-08T18:30:40.521 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5529999999999993e-06 2024-05-08T18:30:40.521 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.521 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.521 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:40.521 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668787+0000", 2024-05-08T18:30:40.521 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6475999999999999e-05 2024-05-08T18:30:40.522 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.522 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.522 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:40.522 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668804+0000", 2024-05-08T18:30:40.522 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7163000000000002e-05 2024-05-08T18:30:40.522 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.522 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.522 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:40.522 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668906+0000", 2024-05-08T18:30:40.522 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010241 2024-05-08T18:30:40.522 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.522 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.522 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:40.522 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669068+0000", 2024-05-08T18:30:40.522 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016144400000000001 2024-05-08T18:30:40.523 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.523 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.523 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-05-08T18:30:40.523 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669226+0000", 2024-05-08T18:30:40.523 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000158639 2024-05-08T18:30:40.523 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.523 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.523 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:40.523 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.670439+0000", 2024-05-08T18:30:40.523 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012124480000000001 2024-05-08T18:30:40.523 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.523 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.523 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:40.524 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674406+0000", 2024-05-08T18:30:40.524 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0039675259999999999 2024-05-08T18:30:40.524 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.524 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.524 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:40.524 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674469+0000", 2024-05-08T18:30:40.524 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.2903000000000004e-05 2024-05-08T18:30:40.524 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.524 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.524 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:40.524 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674519+0000", 2024-05-08T18:30:40.524 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9554e-05 2024-05-08T18:30:40.524 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:40.524 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:40.525 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:40.525 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.525 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.525 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:30:40.525 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.675404+0000", 2024-05-08T18:30:40.525 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 48.837858443000002, 2024-05-08T18:30:40.525 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003903147, 2024-05-08T18:30:40.525 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:40.525 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:40.525 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:40.525 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:40.525 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:40.525 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:40.526 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 207 2024-05-08T18:30:40.526 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.526 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:40.526 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.526 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:40.526 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675404+0000", 2024-05-08T18:30:40.526 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:40.526 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.526 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.526 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:40.526 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675404+0000", 2024-05-08T18:30:40.526 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:40.526 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.527 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.527 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:40.527 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675407+0000", 2024-05-08T18:30:40.527 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1729999999999999e-06 2024-05-08T18:30:40.527 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.527 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.527 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:40.527 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675422+0000", 2024-05-08T18:30:40.527 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.485e-05 2024-05-08T18:30:40.527 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.527 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.527 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:40.527 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675454+0000", 2024-05-08T18:30:40.527 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1656000000000003e-05 2024-05-08T18:30:40.528 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.528 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.528 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:40.528 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675470+0000", 2024-05-08T18:30:40.528 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.626e-05 2024-05-08T18:30:40.528 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.528 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.528 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:40.528 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675683+0000", 2024-05-08T18:30:40.528 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021312600000000001 2024-05-08T18:30:40.528 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.528 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.528 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:40.528 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675972+0000", 2024-05-08T18:30:40.529 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00028885100000000002 2024-05-08T18:30:40.529 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.529 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.529 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:30:40.529 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.676369+0000", 2024-05-08T18:30:40.529 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000397227 2024-05-08T18:30:40.529 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.529 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.529 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:40.529 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.677780+0000", 2024-05-08T18:30:40.529 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001411186 2024-05-08T18:30:40.529 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.529 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.530 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:40.530 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679153+0000", 2024-05-08T18:30:40.530 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0013725720000000001 2024-05-08T18:30:40.530 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.530 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.530 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:40.530 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679240+0000", 2024-05-08T18:30:40.530 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7412999999999998e-05 2024-05-08T18:30:40.530 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.530 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.530 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:40.530 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679307+0000", 2024-05-08T18:30:40.531 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6833000000000002e-05 2024-05-08T18:30:40.531 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:40.531 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:40.531 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:40.531 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.531 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.531 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:40.531 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.721317+0000", 2024-05-08T18:30:40.531 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 48.791945697000003, 2024-05-08T18:30:40.531 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032842140000000001, 2024-05-08T18:30:40.531 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:40.531 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:40.531 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:40.532 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:40.532 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:40.532 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:40.532 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 216 2024-05-08T18:30:40.532 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.532 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:40.532 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.532 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:40.532 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.721317+0000", 2024-05-08T18:30:40.532 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:40.532 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.532 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.532 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:40.533 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.721317+0000", 2024-05-08T18:30:40.533 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:40.533 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.533 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.533 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:40.533 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.721320+0000", 2024-05-08T18:30:40.533 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.303e-06 2024-05-08T18:30:40.533 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.533 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.533 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:40.533 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.721335+0000", 2024-05-08T18:30:40.533 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4543e-05 2024-05-08T18:30:40.533 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.533 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.534 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:40.534 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.721370+0000", 2024-05-08T18:30:40.534 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5336000000000002e-05 2024-05-08T18:30:40.534 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.534 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.534 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:40.534 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.721393+0000", 2024-05-08T18:30:40.534 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2710000000000001e-05 2024-05-08T18:30:40.534 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.534 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.534 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:40.534 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.721592+0000", 2024-05-08T18:30:40.535 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00019917900000000001 2024-05-08T18:30:40.535 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.535 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.535 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:40.535 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.721815+0000", 2024-05-08T18:30:40.535 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000223742 2024-05-08T18:30:40.535 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.535 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.535 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:40.535 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.722268+0000", 2024-05-08T18:30:40.535 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00045295900000000001 2024-05-08T18:30:40.535 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.535 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.535 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:40.536 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.723878+0000", 2024-05-08T18:30:40.536 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001609828 2024-05-08T18:30:40.536 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.536 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.536 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:40.536 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.724433+0000", 2024-05-08T18:30:40.536 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00055512499999999995 2024-05-08T18:30:40.536 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.536 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.536 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:40.536 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.724528+0000", 2024-05-08T18:30:40.536 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.4887000000000001e-05 2024-05-08T18:30:40.536 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.537 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.537 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:40.537 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.724601+0000", 2024-05-08T18:30:40.537 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2601999999999994e-05 2024-05-08T18:30:40.537 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:40.537 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:40.537 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:40.537 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.537 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.537 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:40.537 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.761586+0000", 2024-05-08T18:30:40.537 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 48.751676850999999, 2024-05-08T18:30:40.537 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031756979999999998, 2024-05-08T18:30:40.538 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:40.538 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:40.538 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:40.538 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:40.538 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:40.538 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:40.538 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 227 2024-05-08T18:30:40.538 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.538 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:40.538 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.538 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:40.538 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.761586+0000", 2024-05-08T18:30:40.538 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:40.538 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.539 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.539 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:40.539 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.761586+0000", 2024-05-08T18:30:40.539 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:40.539 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.539 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.539 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:40.539 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.761588+0000", 2024-05-08T18:30:40.539 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7499999999999999e-06 2024-05-08T18:30:40.539 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.539 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.539 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:40.539 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.761600+0000", 2024-05-08T18:30:40.540 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2003e-05 2024-05-08T18:30:40.540 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.540 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.540 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:40.540 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.761632+0000", 2024-05-08T18:30:40.540 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1933000000000001e-05 2024-05-08T18:30:40.540 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.540 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.540 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:40.540 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.761648+0000", 2024-05-08T18:30:40.540 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5339999999999999e-05 2024-05-08T18:30:40.540 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.540 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.540 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:40.541 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.761773+0000", 2024-05-08T18:30:40.541 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012576199999999999 2024-05-08T18:30:40.541 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.541 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.541 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:40.541 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.762037+0000", 2024-05-08T18:30:40.541 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00026385100000000001 2024-05-08T18:30:40.541 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.541 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.541 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:40.541 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.762455+0000", 2024-05-08T18:30:40.541 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00041760700000000002 2024-05-08T18:30:40.541 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.541 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.542 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:40.542 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.764035+0000", 2024-05-08T18:30:40.542 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001580318 2024-05-08T18:30:40.542 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.542 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.542 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:40.542 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.764602+0000", 2024-05-08T18:30:40.542 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00056661899999999998 2024-05-08T18:30:40.542 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.542 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.542 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:40.542 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.764685+0000", 2024-05-08T18:30:40.542 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.3562999999999999e-05 2024-05-08T18:30:40.543 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.543 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.543 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:40.543 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.764761+0000", 2024-05-08T18:30:40.543 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.5951999999999994e-05 2024-05-08T18:30:40.543 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:40.543 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:40.543 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:40.543 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.543 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.543 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:40.543 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.768858+0000", 2024-05-08T18:30:40.543 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 48.744404267999997, 2024-05-08T18:30:40.544 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031906619999999999, 2024-05-08T18:30:40.544 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:40.544 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:40.544 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:40.544 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:40.544 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:40.544 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:40.544 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 229 2024-05-08T18:30:40.544 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.544 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:40.544 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.544 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:40.544 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.768858+0000", 2024-05-08T18:30:40.545 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:40.545 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.545 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.545 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:40.545 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.768858+0000", 2024-05-08T18:30:40.545 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:40.545 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.545 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.545 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:40.545 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.768861+0000", 2024-05-08T18:30:40.545 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5469999999999999e-06 2024-05-08T18:30:40.545 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.545 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.545 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:40.545 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.768872+0000", 2024-05-08T18:30:40.546 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1712999999999999e-05 2024-05-08T18:30:40.546 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.546 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.546 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:40.546 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.768903+0000", 2024-05-08T18:30:40.546 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0636000000000003e-05 2024-05-08T18:30:40.546 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.546 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.546 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:40.546 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.768918+0000", 2024-05-08T18:30:40.546 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4977000000000001e-05 2024-05-08T18:30:40.546 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.546 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.547 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:40.547 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.769037+0000", 2024-05-08T18:30:40.547 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011918599999999999 2024-05-08T18:30:40.547 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.547 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.547 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:40.547 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.769256+0000", 2024-05-08T18:30:40.547 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021839400000000001 2024-05-08T18:30:40.547 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.547 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.547 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:30:40.547 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.769656+0000", 2024-05-08T18:30:40.547 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00040066400000000001 2024-05-08T18:30:40.547 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.548 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.548 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:40.548 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.771116+0000", 2024-05-08T18:30:40.548 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001459389 2024-05-08T18:30:40.548 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.548 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.548 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:40.548 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.771896+0000", 2024-05-08T18:30:40.548 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00077997400000000001 2024-05-08T18:30:40.548 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.548 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.548 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:40.548 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.771984+0000", 2024-05-08T18:30:40.548 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8483e-05 2024-05-08T18:30:40.549 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.549 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.549 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:40.549 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772049+0000", 2024-05-08T18:30:40.549 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.4698999999999998e-05 2024-05-08T18:30:40.549 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:40.549 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:40.549 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:40.549 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.549 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.549 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:40.549 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.776086+0000", 2024-05-08T18:30:40.549 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 48.737176277000003, 2024-05-08T18:30:40.549 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0037528710000000001, 2024-05-08T18:30:40.550 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:40.550 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:40.550 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:40.550 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:40.550 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:40.550 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:40.550 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 231 2024-05-08T18:30:40.550 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.550 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:40.550 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.550 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:40.550 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.776086+0000", 2024-05-08T18:30:40.550 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:40.551 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.551 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.551 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:40.551 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.776086+0000", 2024-05-08T18:30:40.551 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:40.551 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.551 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.551 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:40.551 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.776089+0000", 2024-05-08T18:30:40.551 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8870000000000001e-06 2024-05-08T18:30:40.551 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.551 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.551 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:40.552 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.776102+0000", 2024-05-08T18:30:40.552 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.294e-05 2024-05-08T18:30:40.552 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.552 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.552 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:40.552 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.776132+0000", 2024-05-08T18:30:40.552 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0113000000000001e-05 2024-05-08T18:30:40.552 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.552 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.552 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:40.552 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.776150+0000", 2024-05-08T18:30:40.552 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8216999999999999e-05 2024-05-08T18:30:40.552 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.553 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.553 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:40.553 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.776268+0000", 2024-05-08T18:30:40.553 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000117395 2024-05-08T18:30:40.553 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.553 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.553 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:40.553 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.776514+0000", 2024-05-08T18:30:40.553 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024602899999999999 2024-05-08T18:30:40.553 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.553 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.553 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:40.553 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.776920+0000", 2024-05-08T18:30:40.554 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000406723 2024-05-08T18:30:40.554 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.554 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.554 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:40.554 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.778360+0000", 2024-05-08T18:30:40.554 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0014393279999999999 2024-05-08T18:30:40.554 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.554 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.554 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:40.554 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.779687+0000", 2024-05-08T18:30:40.554 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001327674 2024-05-08T18:30:40.554 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.554 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.554 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:40.555 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.779777+0000", 2024-05-08T18:30:40.555 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9152000000000003e-05 2024-05-08T18:30:40.555 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.555 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.555 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:40.555 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.779839+0000", 2024-05-08T18:30:40.555 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.2413e-05 2024-05-08T18:30:40.555 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:40.555 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:40.555 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:40.555 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.555 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.556 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:257 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:40.556 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.802295+0000", 2024-05-08T18:30:40.556 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 48.710967136999997, 2024-05-08T18:30:40.556 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0030517880000000002, 2024-05-08T18:30:40.556 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:40.556 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:40.556 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:40.556 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:40.556 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:40.556 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:40.556 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 257 2024-05-08T18:30:40.556 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.556 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:40.557 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.557 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:40.557 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.802295+0000", 2024-05-08T18:30:40.557 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:40.557 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.557 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.557 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:40.557 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.802295+0000", 2024-05-08T18:30:40.557 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:40.557 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.557 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.557 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:40.557 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.802296+0000", 2024-05-08T18:30:40.557 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.6700000000000002e-07 2024-05-08T18:30:40.558 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.558 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.558 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:40.558 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.802301+0000", 2024-05-08T18:30:40.558 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.0250000000000002e-06 2024-05-08T18:30:40.558 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.558 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.558 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:40.558 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.802321+0000", 2024-05-08T18:30:40.558 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9521000000000002e-05 2024-05-08T18:30:40.558 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.558 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.558 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:40.559 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.802330+0000", 2024-05-08T18:30:40.559 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.4259999999999992e-06 2024-05-08T18:30:40.559 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.559 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.559 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:40.559 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.802386+0000", 2024-05-08T18:30:40.559 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5974999999999999e-05 2024-05-08T18:30:40.559 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.559 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.559 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:40.559 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.802463+0000", 2024-05-08T18:30:40.559 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6582999999999995e-05 2024-05-08T18:30:40.559 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.560 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.560 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:40.560 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.802613+0000", 2024-05-08T18:30:40.560 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000150715 2024-05-08T18:30:40.560 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.560 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.560 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:40.560 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.803223+0000", 2024-05-08T18:30:40.560 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00060949799999999998 2024-05-08T18:30:40.560 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.560 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.560 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:40.560 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.805250+0000", 2024-05-08T18:30:40.560 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0020268339999999999 2024-05-08T18:30:40.561 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.561 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.561 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:40.561 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.805303+0000", 2024-05-08T18:30:40.561 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3562e-05 2024-05-08T18:30:40.561 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.561 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.561 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:40.561 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.805347+0000", 2024-05-08T18:30:40.561 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3682e-05 2024-05-08T18:30:40.561 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:40.561 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:40.561 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:40.561 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.562 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.562 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:422 6.c 6:338eb7e9:::obj_delete_at_hint.0000000008:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:40.562 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.847436+0000", 2024-05-08T18:30:40.562 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 48.665826074000002, 2024-05-08T18:30:40.562 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0029413439999999998, 2024-05-08T18:30:40.562 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:40.562 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:40.562 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:40.562 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:40.562 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:40.562 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:40.562 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 422 2024-05-08T18:30:40.562 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.563 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:40.563 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.563 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:40.563 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847436+0000", 2024-05-08T18:30:40.563 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:40.563 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.563 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.563 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:40.563 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847436+0000", 2024-05-08T18:30:40.563 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:40.563 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.563 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.563 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:40.563 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847437+0000", 2024-05-08T18:30:40.564 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.009e-06 2024-05-08T18:30:40.564 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.564 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.564 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:40.564 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847442+0000", 2024-05-08T18:30:40.564 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9049999999999996e-06 2024-05-08T18:30:40.564 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.564 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.564 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:40.564 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847454+0000", 2024-05-08T18:30:40.564 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1358e-05 2024-05-08T18:30:40.564 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.564 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.564 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:40.565 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847459+0000", 2024-05-08T18:30:40.565 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7180000000000001e-06 2024-05-08T18:30:40.565 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.565 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.565 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:40.565 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847516+0000", 2024-05-08T18:30:40.565 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6558999999999998e-05 2024-05-08T18:30:40.565 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.565 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.565 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:40.565 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847582+0000", 2024-05-08T18:30:40.565 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5772000000000007e-05 2024-05-08T18:30:40.565 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.565 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.566 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:40.566 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847718+0000", 2024-05-08T18:30:40.566 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013664100000000001 2024-05-08T18:30:40.566 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.566 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.566 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:40.566 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.848257+0000", 2024-05-08T18:30:40.566 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00053853699999999996 2024-05-08T18:30:40.566 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.566 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.566 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:40.566 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.850320+0000", 2024-05-08T18:30:40.566 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0020627530000000001 2024-05-08T18:30:40.567 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.567 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.567 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:40.567 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.850351+0000", 2024-05-08T18:30:40.567 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1501000000000002e-05 2024-05-08T18:30:40.567 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.567 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.567 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:40.567 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.850378+0000", 2024-05-08T18:30:40.567 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6591e-05 2024-05-08T18:30:40.567 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:40.567 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:40.567 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:40.567 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.568 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.568 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:535 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:40.568 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.912581+0000", 2024-05-08T18:30:40.568 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 48.600681014000003, 2024-05-08T18:30:40.568 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002943775, 2024-05-08T18:30:40.568 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:40.568 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:40.568 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:40.568 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:40.568 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:40.568 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:40.568 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 535 2024-05-08T18:30:40.568 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.569 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:40.569 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.569 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:40.569 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912581+0000", 2024-05-08T18:30:40.569 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:40.569 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.569 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.569 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:40.569 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912581+0000", 2024-05-08T18:30:40.569 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:40.569 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.569 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.569 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:40.570 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912582+0000", 2024-05-08T18:30:40.570 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.093e-06 2024-05-08T18:30:40.570 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.570 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.570 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:40.570 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912588+0000", 2024-05-08T18:30:40.570 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3920000000000002e-06 2024-05-08T18:30:40.570 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.570 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.570 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:40.570 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912601+0000", 2024-05-08T18:30:40.570 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2911000000000001e-05 2024-05-08T18:30:40.570 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.570 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.573 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:40.573 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912607+0000", 2024-05-08T18:30:40.573 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3960000000000003e-06 2024-05-08T18:30:40.573 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.573 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.574 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:40.574 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912664+0000", 2024-05-08T18:30:40.574 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6410999999999999e-05 2024-05-08T18:30:40.574 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.574 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.574 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:40.574 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912721+0000", 2024-05-08T18:30:40.574 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7141000000000001e-05 2024-05-08T18:30:40.574 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.574 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.574 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:40.574 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912842+0000", 2024-05-08T18:30:40.574 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000120868 2024-05-08T18:30:40.575 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.575 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.575 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:40.575 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.913333+0000", 2024-05-08T18:30:40.575 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00049123600000000004 2024-05-08T18:30:40.575 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.575 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.575 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:40.575 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.915446+0000", 2024-05-08T18:30:40.575 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0021135020000000002 2024-05-08T18:30:40.575 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.575 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.575 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:40.576 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.915481+0000", 2024-05-08T18:30:40.576 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4304999999999998e-05 2024-05-08T18:30:40.576 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.576 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.576 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:40.576 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.915525+0000", 2024-05-08T18:30:40.576 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4520000000000001e-05 2024-05-08T18:30:40.576 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:40.576 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:40.576 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:40.576 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.576 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.576 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:541 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:40.576 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.916718+0000", 2024-05-08T18:30:40.577 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 48.596544178999999, 2024-05-08T18:30:40.577 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0041779829999999997, 2024-05-08T18:30:40.577 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:40.577 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:40.577 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:40.577 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:40.577 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:40.577 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:40.577 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 541 2024-05-08T18:30:40.577 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.577 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:40.577 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.577 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:40.577 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.916718+0000", 2024-05-08T18:30:40.578 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:40.578 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.578 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.578 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:40.578 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.916718+0000", 2024-05-08T18:30:40.578 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:40.578 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.578 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.578 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:40.578 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.916719+0000", 2024-05-08T18:30:40.578 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0100000000000005e-07 2024-05-08T18:30:40.578 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.578 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.579 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:40.579 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.916722+0000", 2024-05-08T18:30:40.579 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7760000000000002e-06 2024-05-08T18:30:40.579 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.579 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.579 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:40.579 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.916729+0000", 2024-05-08T18:30:40.579 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.8290000000000008e-06 2024-05-08T18:30:40.579 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.579 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.579 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:40.579 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.916734+0000", 2024-05-08T18:30:40.579 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3109999999999999e-06 2024-05-08T18:30:40.580 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.580 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.580 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:40.580 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.916776+0000", 2024-05-08T18:30:40.580 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.2086999999999999e-05 2024-05-08T18:30:40.580 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.580 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.580 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:40.580 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.916824+0000", 2024-05-08T18:30:40.580 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8412999999999999e-05 2024-05-08T18:30:40.580 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.580 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.580 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:40.580 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.916929+0000", 2024-05-08T18:30:40.581 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010480900000000001 2024-05-08T18:30:40.581 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.581 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.581 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:40.581 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.917428+0000", 2024-05-08T18:30:40.581 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00049889599999999997 2024-05-08T18:30:40.581 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.581 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.581 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:40.581 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.920833+0000", 2024-05-08T18:30:40.581 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0034047140000000001 2024-05-08T18:30:40.581 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.581 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.582 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:40.582 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.920868+0000", 2024-05-08T18:30:40.582 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5750999999999997e-05 2024-05-08T18:30:40.582 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.582 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.582 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:40.582 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.920896+0000", 2024-05-08T18:30:40.582 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7796e-05 2024-05-08T18:30:40.582 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:40.582 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:40.582 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:40.582 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.582 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.583 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:778 6.1b 6:dc490aaa:::obj_delete_at_hint.0000000067:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:40.583 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.191226+0000", 2024-05-08T18:30:40.583 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 48.322035904000003, 2024-05-08T18:30:40.583 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0029603540000000001, 2024-05-08T18:30:40.583 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:40.583 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:40.583 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:40.583 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:40.583 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:40.583 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:40.583 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 778 2024-05-08T18:30:40.583 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.583 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:40.584 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.584 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:40.584 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.191226+0000", 2024-05-08T18:30:40.584 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:40.584 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.584 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.584 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:40.584 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.191226+0000", 2024-05-08T18:30:40.584 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:40.584 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.584 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.584 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:40.584 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.191229+0000", 2024-05-08T18:30:40.585 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5299999999999999e-06 2024-05-08T18:30:40.585 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.585 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.585 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:40.585 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.191242+0000", 2024-05-08T18:30:40.585 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2816999999999999e-05 2024-05-08T18:30:40.585 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.585 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.585 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:40.585 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.191274+0000", 2024-05-08T18:30:40.585 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1846e-05 2024-05-08T18:30:40.585 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.585 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.585 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:40.586 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.191288+0000", 2024-05-08T18:30:40.586 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.468e-05 2024-05-08T18:30:40.586 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.586 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.586 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:40.586 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.191468+0000", 2024-05-08T18:30:40.586 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00017983499999999999 2024-05-08T18:30:40.586 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.586 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.586 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:40.586 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.191688+0000", 2024-05-08T18:30:40.586 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021985799999999999 2024-05-08T18:30:40.586 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.587 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.587 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:30:40.587 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.192001+0000", 2024-05-08T18:30:40.587 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00031337800000000001 2024-05-08T18:30:40.587 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.587 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.587 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:40.587 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.193245+0000", 2024-05-08T18:30:40.587 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012436400000000001 2024-05-08T18:30:40.587 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.587 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.587 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:40.588 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.194036+0000", 2024-05-08T18:30:40.588 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00079059699999999998 2024-05-08T18:30:40.588 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.588 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.588 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:40.588 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.194121+0000", 2024-05-08T18:30:40.588 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5270000000000002e-05 2024-05-08T18:30:40.588 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.588 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.588 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:40.588 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.194187+0000", 2024-05-08T18:30:40.588 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5902999999999996e-05 2024-05-08T18:30:40.588 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:40.589 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:40.589 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:40.589 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.589 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.589 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:780 6.1b 6:dc490aaa:::obj_delete_at_hint.0000000067:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:40.589 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.195206+0000", 2024-05-08T18:30:40.589 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 48.318055934999997, 2024-05-08T18:30:40.589 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00291544, 2024-05-08T18:30:40.589 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:40.589 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:40.589 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:40.589 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:40.589 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:40.589 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:40.590 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 780 2024-05-08T18:30:40.590 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.590 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:40.590 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.590 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:40.590 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.195206+0000", 2024-05-08T18:30:40.590 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:40.590 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.590 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.590 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:40.590 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.195206+0000", 2024-05-08T18:30:40.590 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:40.591 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.591 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.591 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:40.591 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.195208+0000", 2024-05-08T18:30:40.591 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0669999999999999e-06 2024-05-08T18:30:40.591 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.591 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.591 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:40.591 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.195220+0000", 2024-05-08T18:30:40.591 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.131e-05 2024-05-08T18:30:40.591 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.591 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.591 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:40.592 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.195250+0000", 2024-05-08T18:30:40.592 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0562999999999999e-05 2024-05-08T18:30:40.592 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.592 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.592 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:40.592 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.195270+0000", 2024-05-08T18:30:40.592 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9989000000000001e-05 2024-05-08T18:30:40.592 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.592 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.592 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:40.592 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.195395+0000", 2024-05-08T18:30:40.592 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012439600000000001 2024-05-08T18:30:40.592 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.593 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.593 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:40.593 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.195523+0000", 2024-05-08T18:30:40.593 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012824900000000001 2024-05-08T18:30:40.593 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.593 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.593 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:30:40.593 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.195808+0000", 2024-05-08T18:30:40.593 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00028518100000000002 2024-05-08T18:30:40.593 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.593 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.593 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:40.593 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.196897+0000", 2024-05-08T18:30:40.593 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0010887850000000001 2024-05-08T18:30:40.593 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.594 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.594 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:40.594 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.197964+0000", 2024-05-08T18:30:40.594 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0010671789999999999 2024-05-08T18:30:40.594 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.594 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.594 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:40.594 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.198044+0000", 2024-05-08T18:30:40.594 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.9616000000000005e-05 2024-05-08T18:30:40.594 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.594 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.594 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:40.595 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.198122+0000", 2024-05-08T18:30:40.595 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.8104999999999998e-05 2024-05-08T18:30:40.595 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:40.595 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:40.595 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:40.595 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.595 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.595 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:826 6.6 6:64735f45:::obj_delete_at_hint.0000000083:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:40.595 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.299128+0000", 2024-05-08T18:30:40.595 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 48.214134856999998, 2024-05-08T18:30:40.595 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0029196479999999999, 2024-05-08T18:30:40.595 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:40.596 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:40.596 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:40.596 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:40.596 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:40.596 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:40.596 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 826 2024-05-08T18:30:40.596 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.596 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:40.596 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.596 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:40.596 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.299128+0000", 2024-05-08T18:30:40.596 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:40.596 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.596 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.597 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:40.597 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.299128+0000", 2024-05-08T18:30:40.597 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:40.597 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.597 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.597 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:40.597 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.299129+0000", 2024-05-08T18:30:40.597 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.711e-06 2024-05-08T18:30:40.597 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.597 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.597 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:40.597 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.299137+0000", 2024-05-08T18:30:40.597 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6650000000000003e-06 2024-05-08T18:30:40.598 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.598 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.598 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:40.598 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.299157+0000", 2024-05-08T18:30:40.598 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.02e-05 2024-05-08T18:30:40.598 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.598 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.598 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:40.598 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.299166+0000", 2024-05-08T18:30:40.598 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7530000000000007e-06 2024-05-08T18:30:40.598 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.598 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.598 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:40.599 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.299240+0000", 2024-05-08T18:30:40.599 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.4297999999999999e-05 2024-05-08T18:30:40.599 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.599 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.599 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:40.599 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.299444+0000", 2024-05-08T18:30:40.599 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00020382399999999999 2024-05-08T18:30:40.599 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.599 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.599 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:40.599 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.299777+0000", 2024-05-08T18:30:40.599 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00033331700000000002 2024-05-08T18:30:40.599 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.599 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.600 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:40.600 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.301060+0000", 2024-05-08T18:30:40.600 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012829569999999999 2024-05-08T18:30:40.600 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.600 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.600 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:40.600 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.301865+0000", 2024-05-08T18:30:40.600 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00080503400000000004 2024-05-08T18:30:40.600 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.600 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.600 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:40.600 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.301979+0000", 2024-05-08T18:30:40.600 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011324600000000001 2024-05-08T18:30:40.600 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.601 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.601 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:40.601 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.302047+0000", 2024-05-08T18:30:40.601 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8643e-05 2024-05-08T18:30:40.601 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:40.601 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:40.601 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:40.601 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.601 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.601 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:838 6.c 6:330b1641:::obj_delete_at_hint.0000000087:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:40.601 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.328043+0000", 2024-05-08T18:30:40.601 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 48.185219713000002, 2024-05-08T18:30:40.601 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031589180000000001, 2024-05-08T18:30:40.602 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:40.602 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:40.602 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:40.602 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:40.602 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:40.602 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:40.602 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 838 2024-05-08T18:30:40.602 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.602 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:40.602 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.602 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:40.602 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.328043+0000", 2024-05-08T18:30:40.602 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:40.603 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.603 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.603 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:40.603 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.328043+0000", 2024-05-08T18:30:40.603 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:40.603 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.603 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.603 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:40.603 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.328045+0000", 2024-05-08T18:30:40.603 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3760000000000002e-06 2024-05-08T18:30:40.603 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.603 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.603 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:40.604 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.328057+0000", 2024-05-08T18:30:40.604 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1534e-05 2024-05-08T18:30:40.604 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.604 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.604 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:40.604 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.328087+0000", 2024-05-08T18:30:40.604 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0870000000000001e-05 2024-05-08T18:30:40.604 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.604 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.604 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:40.604 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.328102+0000", 2024-05-08T18:30:40.604 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4679e-05 2024-05-08T18:30:40.604 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.605 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.605 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:40.605 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.328217+0000", 2024-05-08T18:30:40.605 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011519300000000001 2024-05-08T18:30:40.605 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.605 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.605 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:40.605 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.328446+0000", 2024-05-08T18:30:40.605 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00022893499999999999 2024-05-08T18:30:40.605 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.605 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.605 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:40.605 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.328770+0000", 2024-05-08T18:30:40.605 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00032349700000000001 2024-05-08T18:30:40.606 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.606 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.606 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:40.606 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.330008+0000", 2024-05-08T18:30:40.606 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001238404 2024-05-08T18:30:40.606 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.606 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.606 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:40.606 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.331026+0000", 2024-05-08T18:30:40.606 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001017612 2024-05-08T18:30:40.606 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.606 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.606 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:40.607 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.331117+0000", 2024-05-08T18:30:40.607 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0932000000000003e-05 2024-05-08T18:30:40.607 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.607 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.607 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:40.607 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.331202+0000", 2024-05-08T18:30:40.607 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.4886e-05 2024-05-08T18:30:40.607 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:40.607 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:40.607 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:40.607 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.607 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.607 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:850 6.6 6:624175ac:::obj_delete_at_hint.0000000091:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:40.607 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.356951+0000", 2024-05-08T18:30:40.608 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 48.156311625999997, 2024-05-08T18:30:40.608 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028779000000000001, 2024-05-08T18:30:40.608 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:40.608 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:40.608 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:40.608 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:40.608 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:40.608 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:40.608 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 850 2024-05-08T18:30:40.608 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.608 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:40.608 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.608 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:40.608 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.356951+0000", 2024-05-08T18:30:40.609 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:40.609 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.609 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.609 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:40.609 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.356951+0000", 2024-05-08T18:30:40.609 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:40.609 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.609 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.609 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:40.609 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.356953+0000", 2024-05-08T18:30:40.609 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.446e-06 2024-05-08T18:30:40.609 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.609 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.610 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:40.610 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.356965+0000", 2024-05-08T18:30:40.610 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1404e-05 2024-05-08T18:30:40.610 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.610 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.610 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:40.610 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.356994+0000", 2024-05-08T18:30:40.610 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9526000000000002e-05 2024-05-08T18:30:40.610 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.610 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.610 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:40.610 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.357009+0000", 2024-05-08T18:30:40.610 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5126000000000001e-05 2024-05-08T18:30:40.610 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.611 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.611 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:40.611 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.357126+0000", 2024-05-08T18:30:40.611 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000116989 2024-05-08T18:30:40.611 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.611 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.611 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:40.611 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.357349+0000", 2024-05-08T18:30:40.611 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00022298899999999999 2024-05-08T18:30:40.611 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.611 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.611 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:40.611 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.357665+0000", 2024-05-08T18:30:40.612 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00031592700000000003 2024-05-08T18:30:40.612 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.612 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.612 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:40.612 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.358771+0000", 2024-05-08T18:30:40.612 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001105595 2024-05-08T18:30:40.612 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.612 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.612 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:40.612 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.359672+0000", 2024-05-08T18:30:40.612 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00090080300000000004 2024-05-08T18:30:40.612 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.612 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.612 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:40.613 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.359762+0000", 2024-05-08T18:30:40.613 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0099000000000006e-05 2024-05-08T18:30:40.613 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.613 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.613 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:40.613 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.359829+0000", 2024-05-08T18:30:40.613 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6995999999999993e-05 2024-05-08T18:30:40.613 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:40.613 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:40.613 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:40.613 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.613 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.613 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:852 6.6 6:624175ac:::obj_delete_at_hint.0000000091:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:40.614 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.360655+0000", 2024-05-08T18:30:40.614 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 48.152607758999999, 2024-05-08T18:30:40.614 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028684650000000002, 2024-05-08T18:30:40.614 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:40.614 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:40.614 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:40.614 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:40.614 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:40.614 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:40.614 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 852 2024-05-08T18:30:40.614 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.614 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:40.614 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.615 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:40.615 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.360655+0000", 2024-05-08T18:30:40.615 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:40.615 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.615 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.615 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:40.615 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.360655+0000", 2024-05-08T18:30:40.615 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:40.615 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.615 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.615 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:40.615 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.360656+0000", 2024-05-08T18:30:40.616 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.457e-06 2024-05-08T18:30:40.616 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.616 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.616 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:40.616 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.360663+0000", 2024-05-08T18:30:40.616 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5429999999999999e-06 2024-05-08T18:30:40.616 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.616 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.616 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:40.616 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.360682+0000", 2024-05-08T18:30:40.616 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9020000000000001e-05 2024-05-08T18:30:40.616 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.616 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.617 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:40.617 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.360693+0000", 2024-05-08T18:30:40.617 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.114e-05 2024-05-08T18:30:40.617 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.617 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.617 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:40.617 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.360775+0000", 2024-05-08T18:30:40.617 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.2206000000000005e-05 2024-05-08T18:30:40.617 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.617 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.617 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:40.617 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.360899+0000", 2024-05-08T18:30:40.617 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000124206 2024-05-08T18:30:40.618 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.618 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.618 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:40.618 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.361162+0000", 2024-05-08T18:30:40.618 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00026328400000000002 2024-05-08T18:30:40.618 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.618 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.618 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:40.618 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.362180+0000", 2024-05-08T18:30:40.618 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0010175119999999999 2024-05-08T18:30:40.618 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.618 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.618 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:40.619 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.363368+0000", 2024-05-08T18:30:40.619 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001187991 2024-05-08T18:30:40.619 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.619 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.619 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:40.619 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.363456+0000", 2024-05-08T18:30:40.619 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8016999999999994e-05 2024-05-08T18:30:40.619 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.619 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.619 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:40.619 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.363523+0000", 2024-05-08T18:30:40.619 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7088999999999994e-05 2024-05-08T18:30:40.619 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:40.619 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:40.620 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:40.620 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.620 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.620 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:865 6.c 6:31288c1b:::obj_delete_at_hint.0000000096:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:40.620 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.392164+0000", 2024-05-08T18:30:40.620 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 48.121098658000001, 2024-05-08T18:30:40.620 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0029815470000000002, 2024-05-08T18:30:40.620 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:40.620 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:40.620 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:40.620 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:40.620 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:40.620 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:40.621 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 865 2024-05-08T18:30:40.621 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.621 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:40.621 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.621 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:40.621 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.392164+0000", 2024-05-08T18:30:40.621 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:40.621 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.621 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.621 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:40.621 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.392164+0000", 2024-05-08T18:30:40.621 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:40.621 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.622 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.622 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:40.622 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.392166+0000", 2024-05-08T18:30:40.622 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4059999999999999e-06 2024-05-08T18:30:40.622 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.622 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.622 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:40.622 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.392177+0000", 2024-05-08T18:30:40.622 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1260000000000001e-05 2024-05-08T18:30:40.622 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.622 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.622 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:40.622 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.392208+0000", 2024-05-08T18:30:40.622 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0484000000000002e-05 2024-05-08T18:30:40.623 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.623 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.623 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:40.623 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.392222+0000", 2024-05-08T18:30:40.623 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4343e-05 2024-05-08T18:30:40.623 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.623 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.623 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:40.623 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.392355+0000", 2024-05-08T18:30:40.623 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000132602 2024-05-08T18:30:40.623 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.623 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.623 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:40.624 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.392565+0000", 2024-05-08T18:30:40.624 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000210442 2024-05-08T18:30:40.624 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.624 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.624 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:40.624 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.392874+0000", 2024-05-08T18:30:40.624 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00030868099999999999 2024-05-08T18:30:40.624 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.624 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.624 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:40.624 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.394087+0000", 2024-05-08T18:30:40.624 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012133300000000001 2024-05-08T18:30:40.624 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.624 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.625 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:40.625 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.394976+0000", 2024-05-08T18:30:40.625 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000888977 2024-05-08T18:30:40.625 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.625 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.625 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:40.625 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.395068+0000", 2024-05-08T18:30:40.625 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.2188999999999994e-05 2024-05-08T18:30:40.625 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.625 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.625 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:40.625 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.395145+0000", 2024-05-08T18:30:40.625 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6833000000000001e-05 2024-05-08T18:30:40.626 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:40.626 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:40.626 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:40.626 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.626 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.626 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:871 6.11 6:8d7f253a:::obj_delete_at_hint.0000000098:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:40.626 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.405724+0000", 2024-05-08T18:30:40.626 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 48.107538101999999, 2024-05-08T18:30:40.626 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0030012530000000002, 2024-05-08T18:30:40.626 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:40.626 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:40.626 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:40.626 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:40.626 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:40.627 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:40.627 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 871 2024-05-08T18:30:40.627 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.627 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:40.627 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.627 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:40.627 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.405724+0000", 2024-05-08T18:30:40.627 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:40.627 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.627 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.627 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:40.627 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.405724+0000", 2024-05-08T18:30:40.627 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:40.627 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.628 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.628 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:40.628 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.405726+0000", 2024-05-08T18:30:40.628 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1299999999999999e-06 2024-05-08T18:30:40.628 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.628 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.628 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:40.628 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.405737+0000", 2024-05-08T18:30:40.628 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0763e-05 2024-05-08T18:30:40.628 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.628 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.628 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:40.628 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.405762+0000", 2024-05-08T18:30:40.629 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5323000000000001e-05 2024-05-08T18:30:40.629 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.629 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.629 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:40.629 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.405776+0000", 2024-05-08T18:30:40.629 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3862999999999999e-05 2024-05-08T18:30:40.629 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.629 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.629 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:40.629 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.405928+0000", 2024-05-08T18:30:40.629 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015190000000000001 2024-05-08T18:30:40.629 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.629 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.630 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:40.630 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.406159+0000", 2024-05-08T18:30:40.630 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023114399999999999 2024-05-08T18:30:40.630 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.630 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.630 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:40.630 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.406453+0000", 2024-05-08T18:30:40.630 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00029329699999999998 2024-05-08T18:30:40.630 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.630 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.630 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:40.630 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.408103+0000", 2024-05-08T18:30:40.630 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0016499869999999999 2024-05-08T18:30:40.631 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.631 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.631 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:40.631 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.408520+0000", 2024-05-08T18:30:40.631 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00041694099999999999 2024-05-08T18:30:40.631 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.631 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.631 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:40.631 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.408606+0000", 2024-05-08T18:30:40.631 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6809000000000002e-05 2024-05-08T18:30:40.631 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.631 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.631 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:40.632 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.408726+0000", 2024-05-08T18:30:40.632 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000119096 2024-05-08T18:30:40.632 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:40.632 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:40.632 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:40.632 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.632 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.632 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:934 6.11 6:8cd774bc:::obj_delete_at_hint.0000000119:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:40.632 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.550387+0000", 2024-05-08T18:30:40.632 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 47.962875148999998, 2024-05-08T18:30:40.632 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0033028739999999999, 2024-05-08T18:30:40.632 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:40.632 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:40.633 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:40.633 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:40.633 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:40.633 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:40.633 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 934 2024-05-08T18:30:40.633 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.633 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:40.633 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.633 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:40.633 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.550387+0000", 2024-05-08T18:30:40.633 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:40.633 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.633 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.633 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:40.634 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.550387+0000", 2024-05-08T18:30:40.634 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:40.634 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.634 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.634 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:40.634 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.550390+0000", 2024-05-08T18:30:40.634 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.706e-06 2024-05-08T18:30:40.634 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.634 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.634 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:40.634 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.550401+0000", 2024-05-08T18:30:40.634 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1437000000000001e-05 2024-05-08T18:30:40.635 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.635 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.635 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:40.635 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.550433+0000", 2024-05-08T18:30:40.635 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2005999999999998e-05 2024-05-08T18:30:40.635 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.635 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.635 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:40.635 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.550448+0000", 2024-05-08T18:30:40.635 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5007e-05 2024-05-08T18:30:40.635 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.635 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.635 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:40.635 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.550607+0000", 2024-05-08T18:30:40.636 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000158288 2024-05-08T18:30:40.636 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.636 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.636 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:40.636 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.550974+0000", 2024-05-08T18:30:40.636 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00036768400000000001 2024-05-08T18:30:40.636 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.636 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.636 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:40.636 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.551516+0000", 2024-05-08T18:30:40.636 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00054126900000000004 2024-05-08T18:30:40.636 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.636 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.636 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:40.636 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.552847+0000", 2024-05-08T18:30:40.637 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0013308899999999999 2024-05-08T18:30:40.637 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.637 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.637 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:40.637 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.553531+0000", 2024-05-08T18:30:40.637 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00068438799999999997 2024-05-08T18:30:40.637 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.637 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.637 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:40.637 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.553621+0000", 2024-05-08T18:30:40.637 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9779999999999998e-05 2024-05-08T18:30:40.637 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:40.637 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:40.637 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:40.638 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.553690+0000", 2024-05-08T18:30:40.638 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9418999999999994e-05 2024-05-08T18:30:40.638 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:40.638 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:40.638 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:40.638 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:40.638 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:40.638 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:30:40.640 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-08T18:30:40.640 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:30:40.635+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:30:40.741 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:30:40.740+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:30:40.772 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:30:40.772 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:30:40.772 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 0 2024-05-08T18:30:40.772 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:30:40.786 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-08T18:30:40.842 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:30:40.839+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:30:40.908 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:30:40.908 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:30:40.908 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2024-05-08T18:30:40.908 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2024-05-08T18:30:40.908 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:30:40.922 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-08T18:30:40.965 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:30:40.963+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:30:41.044 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:30:41.039+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:30:41.092 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:30:41.093 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2024-05-08T18:30:41.093 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2024-05-08T18:30:41.093 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-05-08T18:30:41.093 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.093 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:41.093 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.699928+0000", 2024-05-08T18:30:41.093 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 49.390225911999998, 2024-05-08T18:30:41.093 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0036032490000000002, 2024-05-08T18:30:41.093 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:41.093 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:41.093 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:41.094 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:41.094 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:41.094 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:41.094 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 211 2024-05-08T18:30:41.094 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.094 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:41.094 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.094 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:41.094 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.699928+0000", 2024-05-08T18:30:41.094 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:41.094 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.094 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.095 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:41.095 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.699928+0000", 2024-05-08T18:30:41.095 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:41.095 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.095 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.095 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:41.095 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.699931+0000", 2024-05-08T18:30:41.095 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4139999999999998e-06 2024-05-08T18:30:41.095 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.095 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.095 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:41.095 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.699946+0000", 2024-05-08T18:30:41.095 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4528999999999999e-05 2024-05-08T18:30:41.095 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.096 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.096 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:41.096 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.699984+0000", 2024-05-08T18:30:41.096 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8444e-05 2024-05-08T18:30:41.096 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.096 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.096 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:41.096 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.700004+0000", 2024-05-08T18:30:41.096 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0169999999999998e-05 2024-05-08T18:30:41.096 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.096 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.096 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:41.097 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.700162+0000", 2024-05-08T18:30:41.097 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015799799999999999 2024-05-08T18:30:41.097 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.097 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.097 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:41.097 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.700414+0000", 2024-05-08T18:30:41.097 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00025214500000000001 2024-05-08T18:30:41.097 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.097 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.097 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:41.097 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.700839+0000", 2024-05-08T18:30:41.097 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00042484 2024-05-08T18:30:41.097 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.098 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.098 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:41.098 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.702506+0000", 2024-05-08T18:30:41.098 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001666357 2024-05-08T18:30:41.098 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.098 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.098 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:41.098 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.703357+0000", 2024-05-08T18:30:41.098 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00085149399999999995 2024-05-08T18:30:41.098 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.098 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.098 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:41.098 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.703454+0000", 2024-05-08T18:30:41.099 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6688999999999995e-05 2024-05-08T18:30:41.099 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.099 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.099 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:41.099 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.703531+0000", 2024-05-08T18:30:41.099 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.7169000000000006e-05 2024-05-08T18:30:41.099 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:41.099 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:41.099 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:41.099 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.099 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.099 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:41.099 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.776807+0000", 2024-05-08T18:30:41.099 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 49.313347049000001, 2024-05-08T18:30:41.101 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0033805409999999999, 2024-05-08T18:30:41.101 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:41.101 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:41.101 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:41.101 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:41.101 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:41.101 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:41.101 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 232 2024-05-08T18:30:41.101 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.102 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:41.102 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.102 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:41.102 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.776807+0000", 2024-05-08T18:30:41.102 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:41.102 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.102 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.102 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:41.102 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.776807+0000", 2024-05-08T18:30:41.102 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:41.102 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.102 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.102 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:41.102 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.776810+0000", 2024-05-08T18:30:41.103 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6540000000000001e-06 2024-05-08T18:30:41.103 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.103 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.103 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:41.103 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.776824+0000", 2024-05-08T18:30:41.103 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3383e-05 2024-05-08T18:30:41.103 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.103 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.103 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:41.103 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.776856+0000", 2024-05-08T18:30:41.103 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2775999999999999e-05 2024-05-08T18:30:41.103 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.103 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.103 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:41.104 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.776873+0000", 2024-05-08T18:30:41.104 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6483000000000001e-05 2024-05-08T18:30:41.104 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.104 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.104 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:41.104 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.776999+0000", 2024-05-08T18:30:41.104 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000125876 2024-05-08T18:30:41.104 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.104 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.104 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:41.104 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.777228+0000", 2024-05-08T18:30:41.104 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000229531 2024-05-08T18:30:41.104 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.104 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.105 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:41.105 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.777648+0000", 2024-05-08T18:30:41.105 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000420037 2024-05-08T18:30:41.105 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.105 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.105 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:41.105 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.779272+0000", 2024-05-08T18:30:41.105 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0016235780000000001 2024-05-08T18:30:41.105 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.105 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.105 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:41.105 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.780027+0000", 2024-05-08T18:30:41.105 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00075524100000000003 2024-05-08T18:30:41.105 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.106 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.106 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:41.106 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.780116+0000", 2024-05-08T18:30:41.106 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8776000000000005e-05 2024-05-08T18:30:41.106 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.106 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.106 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:41.106 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.780187+0000", 2024-05-08T18:30:41.106 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1205999999999996e-05 2024-05-08T18:30:41.106 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:41.106 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:41.106 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:41.106 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.107 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.107 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:285 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:41.107 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.803745+0000", 2024-05-08T18:30:41.107 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 49.286408762999997, 2024-05-08T18:30:41.107 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0034481960000000002, 2024-05-08T18:30:41.107 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:41.107 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:41.107 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:41.107 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:41.107 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:41.107 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:41.107 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 285 2024-05-08T18:30:41.107 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.108 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:41.108 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.108 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:41.108 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.803745+0000", 2024-05-08T18:30:41.108 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:41.108 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.108 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.108 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:41.108 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.803745+0000", 2024-05-08T18:30:41.108 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:41.108 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.108 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.108 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:41.108 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.803748+0000", 2024-05-08T18:30:41.109 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.813e-06 2024-05-08T18:30:41.109 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.109 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.109 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:41.109 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.803762+0000", 2024-05-08T18:30:41.109 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4653e-05 2024-05-08T18:30:41.109 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.109 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.109 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:41.109 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.803791+0000", 2024-05-08T18:30:41.109 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8540000000000001e-05 2024-05-08T18:30:41.109 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.109 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.109 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:41.110 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.803817+0000", 2024-05-08T18:30:41.110 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5973e-05 2024-05-08T18:30:41.110 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.110 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.110 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:41.110 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.803975+0000", 2024-05-08T18:30:41.110 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000158336 2024-05-08T18:30:41.110 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.110 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.110 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:41.110 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.804502+0000", 2024-05-08T18:30:41.110 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00052658900000000005 2024-05-08T18:30:41.110 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.110 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.111 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:41.111 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.804966+0000", 2024-05-08T18:30:41.111 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00046399599999999999 2024-05-08T18:30:41.111 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.111 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.111 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:41.111 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.806289+0000", 2024-05-08T18:30:41.111 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0013233769999999999 2024-05-08T18:30:41.111 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.111 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.111 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:41.111 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.807001+0000", 2024-05-08T18:30:41.111 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000711314 2024-05-08T18:30:41.112 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.112 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.112 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:41.112 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.807096+0000", 2024-05-08T18:30:41.112 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.5276000000000001e-05 2024-05-08T18:30:41.112 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.112 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.112 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:41.112 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.807193+0000", 2024-05-08T18:30:41.112 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7329000000000003e-05 2024-05-08T18:30:41.112 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:41.112 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:41.112 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:41.112 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.113 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.113 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:317 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:41.113 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.808256+0000", 2024-05-08T18:30:41.113 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 49.281897350999998, 2024-05-08T18:30:41.113 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0038944359999999998, 2024-05-08T18:30:41.113 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:41.113 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:41.113 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:41.113 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:41.113 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:41.113 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:41.113 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 317 2024-05-08T18:30:41.113 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.113 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:41.114 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.114 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:41.114 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.808256+0000", 2024-05-08T18:30:41.114 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:41.114 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.114 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.114 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:41.114 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.808256+0000", 2024-05-08T18:30:41.114 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:41.114 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.114 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.114 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:41.114 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.808258+0000", 2024-05-08T18:30:41.115 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0559999999999999e-06 2024-05-08T18:30:41.115 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.115 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.115 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:41.115 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.808270+0000", 2024-05-08T18:30:41.115 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1537e-05 2024-05-08T18:30:41.115 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.115 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.115 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:41.115 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.808299+0000", 2024-05-08T18:30:41.115 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.9127000000000001e-05 2024-05-08T18:30:41.115 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.115 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.115 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:41.115 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.808324+0000", 2024-05-08T18:30:41.116 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5182e-05 2024-05-08T18:30:41.116 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.116 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.116 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:41.116 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.808471+0000", 2024-05-08T18:30:41.116 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014631900000000001 2024-05-08T18:30:41.116 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.116 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.116 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:41.116 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.808717+0000", 2024-05-08T18:30:41.116 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00024595200000000002 2024-05-08T18:30:41.116 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.116 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.116 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:41.117 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.809072+0000", 2024-05-08T18:30:41.117 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00035547699999999998 2024-05-08T18:30:41.117 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.117 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.117 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:41.117 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.810447+0000", 2024-05-08T18:30:41.117 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0013745929999999999 2024-05-08T18:30:41.117 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.117 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.117 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:41.117 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.811938+0000", 2024-05-08T18:30:41.117 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0014914290000000001 2024-05-08T18:30:41.117 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.117 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.118 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:41.118 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.812078+0000", 2024-05-08T18:30:41.118 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000140319 2024-05-08T18:30:41.118 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.118 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.118 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:41.118 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.812151+0000", 2024-05-08T18:30:41.118 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.2445000000000002e-05 2024-05-08T18:30:41.118 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:41.118 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:41.118 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:41.118 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.118 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.118 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:552 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:41.119 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.923892+0000", 2024-05-08T18:30:41.119 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 49.166262084000003, 2024-05-08T18:30:41.119 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029063259999999999, 2024-05-08T18:30:41.119 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:41.119 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:41.119 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:41.119 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:41.119 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:41.119 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:41.119 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 552 2024-05-08T18:30:41.119 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.119 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:41.119 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.119 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:41.120 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.923892+0000", 2024-05-08T18:30:41.120 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:41.120 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.120 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.120 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:41.120 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.923892+0000", 2024-05-08T18:30:41.120 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:41.120 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.120 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.120 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:41.120 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.923893+0000", 2024-05-08T18:30:41.120 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.082e-06 2024-05-08T18:30:41.120 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.120 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.121 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:41.121 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.923899+0000", 2024-05-08T18:30:41.121 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.426e-06 2024-05-08T18:30:41.121 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.121 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.121 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:41.121 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.923913+0000", 2024-05-08T18:30:41.121 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3869000000000001e-05 2024-05-08T18:30:41.121 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.121 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.121 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:41.121 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.923922+0000", 2024-05-08T18:30:41.121 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8850000000000005e-06 2024-05-08T18:30:41.121 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.121 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.122 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:41.122 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.924023+0000", 2024-05-08T18:30:41.122 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010135400000000001 2024-05-08T18:30:41.122 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.122 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.122 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:41.122 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.924230+0000", 2024-05-08T18:30:41.122 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020649500000000001 2024-05-08T18:30:41.122 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.122 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.122 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:41.122 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.924685+0000", 2024-05-08T18:30:41.123 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00045504299999999997 2024-05-08T18:30:41.123 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.123 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.123 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:41.123 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.925792+0000", 2024-05-08T18:30:41.123 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0011076790000000001 2024-05-08T18:30:41.123 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.123 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.123 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:41.123 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.926566+0000", 2024-05-08T18:30:41.123 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00077379200000000003 2024-05-08T18:30:41.123 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.123 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.123 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:41.124 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.926705+0000", 2024-05-08T18:30:41.124 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013870700000000001 2024-05-08T18:30:41.124 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.124 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.124 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:41.124 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.926798+0000", 2024-05-08T18:30:41.124 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2993999999999998e-05 2024-05-08T18:30:41.124 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:41.124 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:41.124 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:41.124 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.124 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.124 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:709 6.1e 6:7af5a05b:::obj_delete_at_hint.0000000044:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:41.125 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.033719+0000", 2024-05-08T18:30:41.125 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 49.056434324999998, 2024-05-08T18:30:41.125 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0027890480000000001, 2024-05-08T18:30:41.125 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:41.125 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:41.125 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:41.125 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:41.125 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:41.125 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:41.125 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 709 2024-05-08T18:30:41.125 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.125 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:41.125 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.125 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:41.126 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.033719+0000", 2024-05-08T18:30:41.126 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:41.126 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.126 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.126 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:41.126 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.033719+0000", 2024-05-08T18:30:41.126 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:41.126 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.126 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.126 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:41.126 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.033723+0000", 2024-05-08T18:30:41.126 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1920000000000001e-06 2024-05-08T18:30:41.126 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.127 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.127 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:41.127 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.033736+0000", 2024-05-08T18:30:41.127 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3125000000000001e-05 2024-05-08T18:30:41.127 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.127 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.127 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:41.127 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.033768+0000", 2024-05-08T18:30:41.127 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2422999999999998e-05 2024-05-08T18:30:41.127 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.127 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.127 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:41.127 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.033789+0000", 2024-05-08T18:30:41.128 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1084999999999999e-05 2024-05-08T18:30:41.128 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.128 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.128 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:41.128 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.033912+0000", 2024-05-08T18:30:41.128 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000123261 2024-05-08T18:30:41.128 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.128 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.128 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:41.128 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.034132+0000", 2024-05-08T18:30:41.128 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00021992100000000001 2024-05-08T18:30:41.128 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.128 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.129 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:41.129 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.034452+0000", 2024-05-08T18:30:41.129 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00031989399999999998 2024-05-08T18:30:41.129 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.129 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.129 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:41.129 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.035605+0000", 2024-05-08T18:30:41.129 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0011523410000000001 2024-05-08T18:30:41.129 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.129 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.129 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:41.129 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.036356+0000", 2024-05-08T18:30:41.129 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00075177800000000004 2024-05-08T18:30:41.129 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.130 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.130 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:41.130 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.036443+0000", 2024-05-08T18:30:41.130 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.6348999999999996e-05 2024-05-08T18:30:41.130 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.130 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.130 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:41.130 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.036508+0000", 2024-05-08T18:30:41.130 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5679000000000006e-05 2024-05-08T18:30:41.130 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:41.130 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:41.130 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:41.130 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.131 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.131 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:41.131 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.070187+0000", 2024-05-08T18:30:41.131 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 49.019966697000001, 2024-05-08T18:30:41.131 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0030597110000000001, 2024-05-08T18:30:41.131 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:41.131 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:41.131 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:41.131 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:41.131 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:41.131 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:41.131 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 727 2024-05-08T18:30:41.131 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.131 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:41.132 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.132 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:41.132 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.070187+0000", 2024-05-08T18:30:41.132 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:41.132 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.132 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.132 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:41.132 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.070187+0000", 2024-05-08T18:30:41.132 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:41.132 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.132 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.132 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:41.132 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.070189+0000", 2024-05-08T18:30:41.132 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.53e-06 2024-05-08T18:30:41.133 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.133 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.133 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:41.133 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.070197+0000", 2024-05-08T18:30:41.133 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2600000000000005e-06 2024-05-08T18:30:41.133 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.133 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.133 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:41.133 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.070220+0000", 2024-05-08T18:30:41.133 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3357e-05 2024-05-08T18:30:41.133 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.133 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.133 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:41.133 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.070232+0000", 2024-05-08T18:30:41.133 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.217e-05 2024-05-08T18:30:41.134 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.134 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.134 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:41.134 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.070334+0000", 2024-05-08T18:30:41.134 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000101486 2024-05-08T18:30:41.134 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.134 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.134 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:41.134 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.070585+0000", 2024-05-08T18:30:41.134 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00025155799999999998 2024-05-08T18:30:41.134 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.134 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.134 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-05-08T18:30:41.134 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.070921+0000", 2024-05-08T18:30:41.135 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00033587999999999999 2024-05-08T18:30:41.135 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.135 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.135 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:41.135 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.071956+0000", 2024-05-08T18:30:41.135 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010343629999999999 2024-05-08T18:30:41.135 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.135 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.135 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:41.135 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.073088+0000", 2024-05-08T18:30:41.135 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001132641 2024-05-08T18:30:41.135 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.135 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.135 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:41.136 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.073178+0000", 2024-05-08T18:30:41.136 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.9579000000000004e-05 2024-05-08T18:30:41.136 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.136 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.136 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:41.136 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.073247+0000", 2024-05-08T18:30:41.136 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8887000000000006e-05 2024-05-08T18:30:41.136 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:41.136 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:41.136 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:41.136 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.136 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.136 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:775 6.1e 6:7db93595:::obj_delete_at_hint.0000000066:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:41.136 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.180158+0000", 2024-05-08T18:30:41.137 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 48.909995418000001, 2024-05-08T18:30:41.137 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0030746160000000001, 2024-05-08T18:30:41.137 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:41.137 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:41.137 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:41.137 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:41.137 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:41.137 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:41.137 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 775 2024-05-08T18:30:41.137 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.137 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:41.137 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.137 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:41.137 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.180158+0000", 2024-05-08T18:30:41.138 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:41.138 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.138 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.138 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:41.138 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.180158+0000", 2024-05-08T18:30:41.138 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:41.138 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.138 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.138 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:41.138 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.180161+0000", 2024-05-08T18:30:41.138 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8399999999999999e-06 2024-05-08T18:30:41.138 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.138 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.139 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:41.139 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.180172+0000", 2024-05-08T18:30:41.139 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0876000000000001e-05 2024-05-08T18:30:41.139 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.139 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.139 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:41.139 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.180203+0000", 2024-05-08T18:30:41.139 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0639999999999998e-05 2024-05-08T18:30:41.139 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.139 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.139 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:41.139 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.180221+0000", 2024-05-08T18:30:41.139 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8326e-05 2024-05-08T18:30:41.139 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.140 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.140 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:41.140 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.180398+0000", 2024-05-08T18:30:41.140 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000176563 2024-05-08T18:30:41.140 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.140 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.140 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:41.140 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.180616+0000", 2024-05-08T18:30:41.140 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000218731 2024-05-08T18:30:41.140 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.140 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.140 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:41.140 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.180934+0000", 2024-05-08T18:30:41.140 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00031749799999999999 2024-05-08T18:30:41.141 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.141 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.141 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:41.141 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.182159+0000", 2024-05-08T18:30:41.141 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0012251810000000001 2024-05-08T18:30:41.141 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.141 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.141 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:41.141 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.182951+0000", 2024-05-08T18:30:41.141 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00079208000000000002 2024-05-08T18:30:41.141 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.141 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.141 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:41.142 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.183109+0000", 2024-05-08T18:30:41.142 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015750900000000001 2024-05-08T18:30:41.142 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.142 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.142 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:41.142 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.183233+0000", 2024-05-08T18:30:41.142 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012437200000000001 2024-05-08T18:30:41.142 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:41.142 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:41.142 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:41.142 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.142 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.142 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:777 6.1e 6:7db93595:::obj_delete_at_hint.0000000066:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:41.142 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.184358+0000", 2024-05-08T18:30:41.143 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 48.905795574000003, 2024-05-08T18:30:41.143 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0031944019999999998, 2024-05-08T18:30:41.143 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:41.143 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:41.143 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:41.143 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:41.143 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:41.143 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:41.143 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 777 2024-05-08T18:30:41.144 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.144 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:41.144 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.144 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:41.144 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.184358+0000", 2024-05-08T18:30:41.144 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:41.144 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.144 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.144 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:41.144 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.184358+0000", 2024-05-08T18:30:41.144 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:41.144 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.144 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.144 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:41.145 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.184360+0000", 2024-05-08T18:30:41.145 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5069999999999999e-06 2024-05-08T18:30:41.145 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.145 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.145 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:41.145 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.184367+0000", 2024-05-08T18:30:41.145 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6629999999999993e-06 2024-05-08T18:30:41.145 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.145 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.145 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:41.145 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.184388+0000", 2024-05-08T18:30:41.145 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0755999999999999e-05 2024-05-08T18:30:41.145 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.146 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.146 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:41.146 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.184399+0000", 2024-05-08T18:30:41.146 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0896999999999999e-05 2024-05-08T18:30:41.146 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.146 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.146 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:41.146 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.184512+0000", 2024-05-08T18:30:41.146 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000113346 2024-05-08T18:30:41.146 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.146 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.146 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:41.146 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.184733+0000", 2024-05-08T18:30:41.147 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022113800000000001 2024-05-08T18:30:41.147 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.147 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.147 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:41.147 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.185202+0000", 2024-05-08T18:30:41.147 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00046851999999999999 2024-05-08T18:30:41.147 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.147 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.147 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:41.147 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.186306+0000", 2024-05-08T18:30:41.147 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001104184 2024-05-08T18:30:41.147 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.147 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.147 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:41.148 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.187288+0000", 2024-05-08T18:30:41.148 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00098171 2024-05-08T18:30:41.148 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.148 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.148 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:41.148 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.187438+0000", 2024-05-08T18:30:41.148 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000150629 2024-05-08T18:30:41.148 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.148 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.148 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:41.148 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.187553+0000", 2024-05-08T18:30:41.148 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000114052 2024-05-08T18:30:41.148 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:41.148 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:41.149 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:41.149 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.149 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.149 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:808 6.1a 6:5a206276:::obj_delete_at_hint.0000000077:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:41.149 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.252316+0000", 2024-05-08T18:30:41.149 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 48.837838161999997, 2024-05-08T18:30:41.149 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0027908820000000002, 2024-05-08T18:30:41.149 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:41.149 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:41.149 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:41.149 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:41.149 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:41.149 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:41.149 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 808 2024-05-08T18:30:41.150 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.150 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:41.150 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.150 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:41.150 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.252316+0000", 2024-05-08T18:30:41.150 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:41.150 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.150 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.150 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:41.150 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.252316+0000", 2024-05-08T18:30:41.150 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:41.150 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.151 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.151 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:41.151 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.252318+0000", 2024-05-08T18:30:41.151 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5500000000000001e-06 2024-05-08T18:30:41.151 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.151 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.151 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:41.151 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.252331+0000", 2024-05-08T18:30:41.151 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.252e-05 2024-05-08T18:30:41.151 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.151 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.151 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:41.151 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.252362+0000", 2024-05-08T18:30:41.151 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1720000000000001e-05 2024-05-08T18:30:41.152 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.152 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.152 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:41.152 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.252377+0000", 2024-05-08T18:30:41.152 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4440000000000001e-05 2024-05-08T18:30:41.152 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.152 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.152 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:41.152 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.252513+0000", 2024-05-08T18:30:41.152 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013657200000000001 2024-05-08T18:30:41.152 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.152 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.153 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:41.153 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.252746+0000", 2024-05-08T18:30:41.153 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000232499 2024-05-08T18:30:41.153 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.153 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.153 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:41.153 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.253071+0000", 2024-05-08T18:30:41.153 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00032540299999999999 2024-05-08T18:30:41.153 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.153 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.153 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:41.153 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.254176+0000", 2024-05-08T18:30:41.153 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0011052519999999999 2024-05-08T18:30:41.153 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.154 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.154 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:41.154 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.254957+0000", 2024-05-08T18:30:41.154 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00078004099999999998 2024-05-08T18:30:41.154 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.154 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.154 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:41.154 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.255041+0000", 2024-05-08T18:30:41.154 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4492000000000004e-05 2024-05-08T18:30:41.154 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.154 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.154 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:41.154 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.255106+0000", 2024-05-08T18:30:41.154 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5393000000000002e-05 2024-05-08T18:30:41.155 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:41.155 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:41.155 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:41.155 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.155 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.155 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:810 6.1a 6:5a206276:::obj_delete_at_hint.0000000077:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:41.155 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.256569+0000", 2024-05-08T18:30:41.155 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 48.833585108000001, 2024-05-08T18:30:41.155 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0034505130000000001, 2024-05-08T18:30:41.155 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:41.155 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:41.155 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:41.155 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:41.156 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:41.156 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:41.156 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 810 2024-05-08T18:30:41.156 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.156 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:41.156 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.156 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:41.156 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.256569+0000", 2024-05-08T18:30:41.156 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:41.156 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.156 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.156 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:41.156 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.256569+0000", 2024-05-08T18:30:41.156 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:41.157 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.157 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.157 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:41.157 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.256571+0000", 2024-05-08T18:30:41.157 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2029999999999999e-06 2024-05-08T18:30:41.157 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.157 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.157 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:41.157 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.256582+0000", 2024-05-08T18:30:41.157 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.101e-05 2024-05-08T18:30:41.157 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.157 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.157 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:41.157 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.256614+0000", 2024-05-08T18:30:41.158 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2353e-05 2024-05-08T18:30:41.158 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.158 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.158 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:41.158 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.256632+0000", 2024-05-08T18:30:41.158 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8349999999999999e-05 2024-05-08T18:30:41.158 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.158 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.158 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:41.158 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.256767+0000", 2024-05-08T18:30:41.158 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000134819 2024-05-08T18:30:41.158 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.158 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.158 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:41.159 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.256990+0000", 2024-05-08T18:30:41.159 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022293899999999999 2024-05-08T18:30:41.159 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.159 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.159 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:41.159 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.257487+0000", 2024-05-08T18:30:41.159 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00049632599999999995 2024-05-08T18:30:41.159 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.159 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.159 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:41.159 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.258822+0000", 2024-05-08T18:30:41.159 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001335166 2024-05-08T18:30:41.159 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.160 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.160 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:41.160 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.259867+0000", 2024-05-08T18:30:41.160 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010454349999999999 2024-05-08T18:30:41.160 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.160 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.160 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:41.160 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.259955+0000", 2024-05-08T18:30:41.160 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.7699000000000002e-05 2024-05-08T18:30:41.160 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.160 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.160 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:41.160 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.260019+0000", 2024-05-08T18:30:41.160 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4213000000000003e-05 2024-05-08T18:30:41.161 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:41.161 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:41.161 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:41.161 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.161 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.161 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:814 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:41.161 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.266538+0000", 2024-05-08T18:30:41.161 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 48.823616182000002, 2024-05-08T18:30:41.161 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0030056010000000001, 2024-05-08T18:30:41.161 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:41.161 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:41.161 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:41.161 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:41.161 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:41.161 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:41.162 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 814 2024-05-08T18:30:41.162 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.162 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:41.162 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.162 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:41.162 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.266538+0000", 2024-05-08T18:30:41.162 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:41.162 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.162 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.162 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:41.162 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.266538+0000", 2024-05-08T18:30:41.162 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:41.162 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.163 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.163 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:41.163 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.266540+0000", 2024-05-08T18:30:41.163 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2400000000000002e-06 2024-05-08T18:30:41.163 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.163 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.163 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:41.163 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.266550+0000", 2024-05-08T18:30:41.163 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0464e-05 2024-05-08T18:30:41.163 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.163 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.163 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:41.163 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.266581+0000", 2024-05-08T18:30:41.163 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.099e-05 2024-05-08T18:30:41.164 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.164 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.164 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:41.164 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.266596+0000", 2024-05-08T18:30:41.164 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5176e-05 2024-05-08T18:30:41.164 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.164 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.164 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:41.164 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.266711+0000", 2024-05-08T18:30:41.164 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000114759 2024-05-08T18:30:41.164 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.164 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.164 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:41.164 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.266936+0000", 2024-05-08T18:30:41.165 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022446200000000001 2024-05-08T18:30:41.165 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.165 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.165 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:41.165 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.267272+0000", 2024-05-08T18:30:41.165 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00033655099999999998 2024-05-08T18:30:41.165 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.165 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.165 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:41.165 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.268417+0000", 2024-05-08T18:30:41.165 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0011447409999999999 2024-05-08T18:30:41.165 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.165 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.165 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:41.166 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.269263+0000", 2024-05-08T18:30:41.166 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00084657600000000003 2024-05-08T18:30:41.166 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.166 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.166 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:41.166 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.269418+0000", 2024-05-08T18:30:41.166 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015471300000000001 2024-05-08T18:30:41.166 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.166 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.166 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:41.166 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.269543+0000", 2024-05-08T18:30:41.166 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000124929 2024-05-08T18:30:41.166 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:41.166 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:41.167 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:41.167 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.167 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.167 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:816 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:41.167 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.270693+0000", 2024-05-08T18:30:41.167 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 48.819461074000003, 2024-05-08T18:30:41.167 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0031451119999999998, 2024-05-08T18:30:41.167 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:41.167 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:41.167 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:41.167 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:41.167 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:41.167 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:41.167 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 816 2024-05-08T18:30:41.168 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.168 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:41.168 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.168 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:41.168 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.270693+0000", 2024-05-08T18:30:41.168 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:41.168 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.168 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.168 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:41.168 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.270693+0000", 2024-05-08T18:30:41.168 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:41.168 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.168 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.168 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:41.169 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.270695+0000", 2024-05-08T18:30:41.169 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0669999999999999e-06 2024-05-08T18:30:41.169 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.169 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.169 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:41.169 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.270704+0000", 2024-05-08T18:30:41.169 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4830000000000005e-06 2024-05-08T18:30:41.169 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.169 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.169 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:41.169 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.270728+0000", 2024-05-08T18:30:41.169 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.4297000000000001e-05 2024-05-08T18:30:41.169 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.169 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.170 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:41.170 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.270740+0000", 2024-05-08T18:30:41.170 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1922999999999999e-05 2024-05-08T18:30:41.170 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.170 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.170 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:41.170 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.270855+0000", 2024-05-08T18:30:41.170 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011418599999999999 2024-05-08T18:30:41.170 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.170 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.170 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:41.170 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.271088+0000", 2024-05-08T18:30:41.170 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000233718 2024-05-08T18:30:41.170 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.171 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.171 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:41.171 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.271548+0000", 2024-05-08T18:30:41.171 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00045974299999999998 2024-05-08T18:30:41.171 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.171 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.171 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:41.171 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.272854+0000", 2024-05-08T18:30:41.171 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0013054799999999999 2024-05-08T18:30:41.171 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.171 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.171 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:41.171 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.273569+0000", 2024-05-08T18:30:41.171 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00071561400000000005 2024-05-08T18:30:41.172 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.172 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.172 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:41.172 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.273726+0000", 2024-05-08T18:30:41.172 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000156856 2024-05-08T18:30:41.172 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.172 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.172 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:41.172 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.273838+0000", 2024-05-08T18:30:41.172 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011174499999999999 2024-05-08T18:30:41.172 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:41.172 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:41.172 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:41.172 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.173 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.173 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:41.173 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.422427+0000", 2024-05-08T18:30:41.173 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 48.667726745000003, 2024-05-08T18:30:41.173 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0031426190000000001, 2024-05-08T18:30:41.173 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:41.173 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:41.173 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:41.173 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:41.173 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:41.173 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:41.173 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 880 2024-05-08T18:30:41.173 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.173 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:41.174 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.174 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:41.174 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.422427+0000", 2024-05-08T18:30:41.174 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:41.174 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.174 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.174 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:41.174 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.422427+0000", 2024-05-08T18:30:41.174 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:41.174 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.174 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.174 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:41.174 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.422431+0000", 2024-05-08T18:30:41.175 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.777e-06 2024-05-08T18:30:41.175 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.175 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.175 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:41.175 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.422445+0000", 2024-05-08T18:30:41.175 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.451e-05 2024-05-08T18:30:41.175 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.175 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.175 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:41.175 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.422479+0000", 2024-05-08T18:30:41.175 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4078999999999997e-05 2024-05-08T18:30:41.175 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.175 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.175 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:41.176 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.422495+0000", 2024-05-08T18:30:41.176 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5947000000000002e-05 2024-05-08T18:30:41.176 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.176 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.176 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:41.176 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.422609+0000", 2024-05-08T18:30:41.176 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000113879 2024-05-08T18:30:41.176 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.176 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.176 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:41.176 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.422844+0000", 2024-05-08T18:30:41.176 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000234465 2024-05-08T18:30:41.176 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.176 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.176 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:41.177 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.423201+0000", 2024-05-08T18:30:41.177 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00035789699999999998 2024-05-08T18:30:41.177 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.177 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.177 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:41.177 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.424352+0000", 2024-05-08T18:30:41.177 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0011504709999999999 2024-05-08T18:30:41.177 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.177 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.177 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:41.177 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.425288+0000", 2024-05-08T18:30:41.177 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00093638300000000005 2024-05-08T18:30:41.177 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.177 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.178 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:41.178 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.425451+0000", 2024-05-08T18:30:41.178 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000162628 2024-05-08T18:30:41.178 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.178 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.178 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:41.178 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.425570+0000", 2024-05-08T18:30:41.178 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000118583 2024-05-08T18:30:41.178 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:41.178 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:41.178 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:41.178 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.178 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.178 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:913 6.2 6:47403372:::obj_delete_at_hint.0000000112:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:41.179 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.494354+0000", 2024-05-08T18:30:41.179 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 48.59579944, 2024-05-08T18:30:41.179 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003088276, 2024-05-08T18:30:41.179 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:41.179 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:41.179 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:41.179 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:41.179 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:41.179 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:41.179 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 913 2024-05-08T18:30:41.179 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.179 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:41.179 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.180 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:41.180 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.494354+0000", 2024-05-08T18:30:41.180 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:41.180 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.180 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.180 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:41.180 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.494354+0000", 2024-05-08T18:30:41.180 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:41.180 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.180 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.180 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:41.180 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.494357+0000", 2024-05-08T18:30:41.180 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.553e-06 2024-05-08T18:30:41.181 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.181 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.181 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:41.181 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.494368+0000", 2024-05-08T18:30:41.181 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1426999999999999e-05 2024-05-08T18:30:41.181 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.181 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.181 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:41.181 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.494419+0000", 2024-05-08T18:30:41.181 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1053000000000001e-05 2024-05-08T18:30:41.181 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.181 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.181 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:41.182 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.494434+0000", 2024-05-08T18:30:41.182 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5216e-05 2024-05-08T18:30:41.182 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.182 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.182 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:41.182 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.494564+0000", 2024-05-08T18:30:41.182 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012956900000000001 2024-05-08T18:30:41.182 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.182 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.182 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:41.182 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.494798+0000", 2024-05-08T18:30:41.182 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000234248 2024-05-08T18:30:41.182 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.183 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.183 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:41.183 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.495123+0000", 2024-05-08T18:30:41.183 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00032466500000000002 2024-05-08T18:30:41.183 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.183 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.183 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:41.183 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.496226+0000", 2024-05-08T18:30:41.183 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001102701 2024-05-08T18:30:41.183 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.183 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.183 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:41.183 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.497153+0000", 2024-05-08T18:30:41.183 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00092721999999999998 2024-05-08T18:30:41.184 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.184 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.184 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:41.184 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.497329+0000", 2024-05-08T18:30:41.184 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000176579 2024-05-08T18:30:41.184 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.184 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.184 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:41.184 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.497443+0000", 2024-05-08T18:30:41.184 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000113045 2024-05-08T18:30:41.184 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:41.184 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:41.184 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:41.184 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.185 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.185 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:915 6.2 6:47403372:::obj_delete_at_hint.0000000112:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:41.185 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.498847+0000", 2024-05-08T18:30:41.185 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 48.591306373999998, 2024-05-08T18:30:41.185 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003160459, 2024-05-08T18:30:41.185 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:41.185 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:41.185 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:41.185 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:41.185 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:41.185 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:41.185 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 915 2024-05-08T18:30:41.185 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.185 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:41.185 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.186 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:41.186 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.498847+0000", 2024-05-08T18:30:41.186 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:41.186 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.186 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.186 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:41.186 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.498847+0000", 2024-05-08T18:30:41.186 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:41.186 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.186 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.186 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:41.186 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.498850+0000", 2024-05-08T18:30:41.186 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.4099999999999998e-06 2024-05-08T18:30:41.186 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.187 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.187 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:41.187 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.498863+0000", 2024-05-08T18:30:41.187 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3013000000000001e-05 2024-05-08T18:30:41.187 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.187 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.187 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:41.187 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.498895+0000", 2024-05-08T18:30:41.187 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2682999999999999e-05 2024-05-08T18:30:41.187 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.187 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.187 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:41.187 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.498911+0000", 2024-05-08T18:30:41.187 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.525e-05 2024-05-08T18:30:41.188 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.188 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.188 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:41.188 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.499039+0000", 2024-05-08T18:30:41.188 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012856900000000001 2024-05-08T18:30:41.188 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.188 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.188 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:41.188 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.499264+0000", 2024-05-08T18:30:41.188 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022517500000000001 2024-05-08T18:30:41.188 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.188 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.188 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:41.188 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.499740+0000", 2024-05-08T18:30:41.188 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00047553299999999999 2024-05-08T18:30:41.189 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.189 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.189 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:41.189 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.501192+0000", 2024-05-08T18:30:41.189 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001451735 2024-05-08T18:30:41.189 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.189 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.189 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:41.189 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.501751+0000", 2024-05-08T18:30:41.189 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000559239 2024-05-08T18:30:41.189 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.189 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.189 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:41.189 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.501902+0000", 2024-05-08T18:30:41.190 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015061600000000001 2024-05-08T18:30:41.190 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.190 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.190 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:41.190 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.502008+0000", 2024-05-08T18:30:41.190 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000106236 2024-05-08T18:30:41.190 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:41.190 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:41.190 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:41.190 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.190 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.190 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:925 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:41.190 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.523895+0000", 2024-05-08T18:30:41.191 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 48.566258971000003, 2024-05-08T18:30:41.191 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003635302, 2024-05-08T18:30:41.191 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:41.191 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:41.191 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:41.191 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:41.191 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:41.191 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:41.191 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 925 2024-05-08T18:30:41.191 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.191 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:41.191 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.191 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:41.191 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.523895+0000", 2024-05-08T18:30:41.192 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:41.192 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.192 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.192 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:41.192 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.523895+0000", 2024-05-08T18:30:41.192 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:41.192 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.192 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.192 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:41.192 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.523897+0000", 2024-05-08T18:30:41.192 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1969999999999999e-06 2024-05-08T18:30:41.192 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.192 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.192 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:41.193 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.523908+0000", 2024-05-08T18:30:41.193 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0706e-05 2024-05-08T18:30:41.193 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.193 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.193 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:41.193 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.523938+0000", 2024-05-08T18:30:41.193 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0395999999999998e-05 2024-05-08T18:30:41.193 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.193 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.193 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:41.193 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.523953+0000", 2024-05-08T18:30:41.193 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4673e-05 2024-05-08T18:30:41.193 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.193 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.194 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:41.194 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.524105+0000", 2024-05-08T18:30:41.194 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015204300000000001 2024-05-08T18:30:41.194 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.194 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.194 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:41.194 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.524460+0000", 2024-05-08T18:30:41.194 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00035539000000000002 2024-05-08T18:30:41.194 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.194 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.194 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:41.194 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.525003+0000", 2024-05-08T18:30:41.194 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00054241000000000001 2024-05-08T18:30:41.194 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.195 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.195 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:41.195 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.526198+0000", 2024-05-08T18:30:41.195 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0011955500000000001 2024-05-08T18:30:41.195 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.195 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.195 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:41.195 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.527258+0000", 2024-05-08T18:30:41.195 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010595489999999999 2024-05-08T18:30:41.195 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.195 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.195 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:41.195 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.527414+0000", 2024-05-08T18:30:41.196 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000156732 2024-05-08T18:30:41.196 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.196 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.196 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:41.196 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.527530+0000", 2024-05-08T18:30:41.196 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011565600000000001 2024-05-08T18:30:41.196 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:41.196 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:41.196 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:41.196 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.196 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.196 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:927 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:41.196 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.528868+0000", 2024-05-08T18:30:41.196 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 48.561285572999999, 2024-05-08T18:30:41.197 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00302987, 2024-05-08T18:30:41.197 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:41.197 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:41.197 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:41.197 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:41.197 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:41.197 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:41.197 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 927 2024-05-08T18:30:41.197 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.197 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:41.197 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.197 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:41.197 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.528868+0000", 2024-05-08T18:30:41.198 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:41.198 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.198 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.198 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:41.198 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.528868+0000", 2024-05-08T18:30:41.198 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:41.198 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.198 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.198 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:41.198 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.528870+0000", 2024-05-08T18:30:41.198 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6199999999999999e-06 2024-05-08T18:30:41.198 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.198 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.199 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:41.199 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.528877+0000", 2024-05-08T18:30:41.199 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4070000000000004e-06 2024-05-08T18:30:41.199 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.199 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.199 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:41.199 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.528899+0000", 2024-05-08T18:30:41.199 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1495999999999999e-05 2024-05-08T18:30:41.199 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.199 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.199 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:41.199 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.528910+0000", 2024-05-08T18:30:41.199 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1562999999999999e-05 2024-05-08T18:30:41.199 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.200 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.200 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:41.200 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.529027+0000", 2024-05-08T18:30:41.200 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000116873 2024-05-08T18:30:41.200 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.200 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.200 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:41.200 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.529258+0000", 2024-05-08T18:30:41.200 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000231065 2024-05-08T18:30:41.200 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.200 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.200 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:41.200 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.529732+0000", 2024-05-08T18:30:41.200 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000474043 2024-05-08T18:30:41.201 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.201 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.201 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:41.201 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.530983+0000", 2024-05-08T18:30:41.201 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0012505929999999999 2024-05-08T18:30:41.201 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.201 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.201 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:41.201 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.531621+0000", 2024-05-08T18:30:41.201 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00063814899999999996 2024-05-08T18:30:41.201 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.201 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.201 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:41.201 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.531785+0000", 2024-05-08T18:30:41.202 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016452200000000001 2024-05-08T18:30:41.202 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.202 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.202 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:41.202 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.531898+0000", 2024-05-08T18:30:41.202 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000112539 2024-05-08T18:30:41.202 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:41.202 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:41.202 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:41.202 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.202 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.202 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:41.202 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.532086+0000", 2024-05-08T18:30:41.202 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 48.558067207999997, 2024-05-08T18:30:41.203 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032260779999999998, 2024-05-08T18:30:41.203 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:41.203 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:41.203 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:41.203 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:41.203 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:41.203 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:41.203 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 928 2024-05-08T18:30:41.203 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.203 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:41.203 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.203 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:41.203 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.532086+0000", 2024-05-08T18:30:41.203 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:41.204 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.204 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.204 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:41.204 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.532086+0000", 2024-05-08T18:30:41.204 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:41.204 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.204 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.204 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:41.204 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.532088+0000", 2024-05-08T18:30:41.204 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8670000000000001e-06 2024-05-08T18:30:41.204 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.204 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.204 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:41.205 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.532097+0000", 2024-05-08T18:30:41.205 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.6929999999999996e-06 2024-05-08T18:30:41.205 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.205 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.205 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:41.205 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.532121+0000", 2024-05-08T18:30:41.205 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3572999999999999e-05 2024-05-08T18:30:41.205 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.205 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.205 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:41.205 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.532134+0000", 2024-05-08T18:30:41.205 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3823e-05 2024-05-08T18:30:41.205 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.205 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.206 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:41.206 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.532255+0000", 2024-05-08T18:30:41.206 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012074900000000001 2024-05-08T18:30:41.206 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.206 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.206 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:41.206 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.532588+0000", 2024-05-08T18:30:41.206 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000333068 2024-05-08T18:30:41.206 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.206 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.206 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:41.206 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.533135+0000", 2024-05-08T18:30:41.206 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000546259 2024-05-08T18:30:41.207 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.207 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.207 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:41.207 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.534441+0000", 2024-05-08T18:30:41.207 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0013061500000000001 2024-05-08T18:30:41.207 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.207 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.207 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:41.207 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.535049+0000", 2024-05-08T18:30:41.207 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00060823500000000005 2024-05-08T18:30:41.207 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.207 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.207 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:41.208 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.535203+0000", 2024-05-08T18:30:41.208 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015383500000000001 2024-05-08T18:30:41.208 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.208 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.208 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:41.208 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.535313+0000", 2024-05-08T18:30:41.208 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000109826 2024-05-08T18:30:41.208 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:41.208 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:41.208 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:41.208 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.208 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.208 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:930 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:41.208 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.536650+0000", 2024-05-08T18:30:41.209 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 48.553503923000001, 2024-05-08T18:30:41.209 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029677129999999999, 2024-05-08T18:30:41.209 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:41.209 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:41.209 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:41.209 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:41.209 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:41.209 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:41.209 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 930 2024-05-08T18:30:41.209 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.209 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:41.209 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.209 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:41.209 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.536650+0000", 2024-05-08T18:30:41.210 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:41.210 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.210 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.210 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:41.210 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.536650+0000", 2024-05-08T18:30:41.210 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:41.210 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.210 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.210 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:41.210 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.536652+0000", 2024-05-08T18:30:41.210 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1660000000000001e-06 2024-05-08T18:30:41.210 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.210 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.210 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:41.211 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.536680+0000", 2024-05-08T18:30:41.211 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8084000000000001e-05 2024-05-08T18:30:41.211 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.211 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.211 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:41.211 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.536711+0000", 2024-05-08T18:30:41.211 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1123e-05 2024-05-08T18:30:41.211 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.211 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.211 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:41.211 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.536729+0000", 2024-05-08T18:30:41.211 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8189000000000002e-05 2024-05-08T18:30:41.211 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.212 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.212 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:41.212 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.536852+0000", 2024-05-08T18:30:41.212 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000122729 2024-05-08T18:30:41.212 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.212 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.212 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:41.212 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.537074+0000", 2024-05-08T18:30:41.212 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022180600000000001 2024-05-08T18:30:41.212 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.212 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.212 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:41.212 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.537526+0000", 2024-05-08T18:30:41.213 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00045219599999999998 2024-05-08T18:30:41.213 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.213 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.213 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:41.213 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.538973+0000", 2024-05-08T18:30:41.213 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001447102 2024-05-08T18:30:41.213 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.213 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.213 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:41.213 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.539410+0000", 2024-05-08T18:30:41.213 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00043727399999999997 2024-05-08T18:30:41.213 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.213 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.213 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:41.214 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.539503+0000", 2024-05-08T18:30:41.214 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2338999999999998e-05 2024-05-08T18:30:41.214 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.214 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.214 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:41.214 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.539617+0000", 2024-05-08T18:30:41.214 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011470499999999999 2024-05-08T18:30:41.214 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:41.214 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:41.214 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:41.214 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:41.214 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:41.214 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:30:41.216 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-08T18:30:41.216 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:30:41.215+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:30:41.317 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:30:41.315+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:30:41.387 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:30:41.387 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:30:41.387 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 0 2024-05-08T18:30:41.387 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:30:41.402 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-08T18:30:41.418 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:30:41.420+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:30:41.519 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:30:41.515+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:30:41.547 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-08T18:30:41.568 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:30:41.569 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:30:41.569 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2024-05-08T18:30:41.569 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2024-05-08T18:30:41.569 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:30:41.583 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-08T18:30:41.625 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:30:41.623+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:30:41.721 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:30:41.720+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:30:41.745 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-08T18:30:41.747 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:30:41.747 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2024-05-08T18:30:41.747 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2024-05-08T18:30:41.747 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-05-08T18:30:41.747 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.747 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4479.0:37 5.f 5:f43b6ece:::zone_names.default:head [create,call version.set in=10b,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-05-08T18:30:41.747 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:44.627414+0000", 2024-05-08T18:30:41.747 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 57.117115874, 2024-05-08T18:30:41.747 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029966429999999998, 2024-05-08T18:30:41.748 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:41.748 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:41.748 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:41.748 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:41.748 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4479", 2024-05-08T18:30:41.748 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3577501689", 2024-05-08T18:30:41.748 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 37 2024-05-08T18:30:41.748 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.749 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:41.749 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.749 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:41.749 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.627414+0000", 2024-05-08T18:30:41.749 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:41.749 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.749 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.749 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:41.749 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.627414+0000", 2024-05-08T18:30:41.749 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:41.749 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.749 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.749 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:41.750 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.627416+0000", 2024-05-08T18:30:41.750 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9580000000000001e-06 2024-05-08T18:30:41.750 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.750 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.750 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:41.750 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.627427+0000", 2024-05-08T18:30:41.750 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1657e-05 2024-05-08T18:30:41.750 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.750 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.750 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:41.750 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.627454+0000", 2024-05-08T18:30:41.750 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6619e-05 2024-05-08T18:30:41.750 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.751 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.751 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:41.751 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.627474+0000", 2024-05-08T18:30:41.751 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9612000000000001e-05 2024-05-08T18:30:41.751 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.751 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.751 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:41.751 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.627647+0000", 2024-05-08T18:30:41.751 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017374999999999999 2024-05-08T18:30:41.751 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.751 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.751 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:41.751 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.627861+0000", 2024-05-08T18:30:41.752 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000213358 2024-05-08T18:30:41.752 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.752 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.752 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:41.752 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.628153+0000", 2024-05-08T18:30:41.752 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029198899999999999 2024-05-08T18:30:41.752 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.752 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.752 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:41.752 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.629544+0000", 2024-05-08T18:30:41.752 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0013916390000000001 2024-05-08T18:30:41.752 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.752 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.753 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:41.753 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.630221+0000", 2024-05-08T18:30:41.753 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00067613500000000002 2024-05-08T18:30:41.753 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.753 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.753 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:41.753 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.630321+0000", 2024-05-08T18:30:41.753 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000100126 2024-05-08T18:30:41.753 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.753 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.753 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:41.753 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.630411+0000", 2024-05-08T18:30:41.753 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.9800000000000001e-05 2024-05-08T18:30:41.753 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:41.754 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:41.754 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:41.754 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.754 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.754 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4479.0:41 5.f 5:f4c53578:::zonegroups_names.default:head [create,call version.set in=10b,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-05-08T18:30:41.754 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:44.637466+0000", 2024-05-08T18:30:41.754 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 57.107063914999998, 2024-05-08T18:30:41.754 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0030003949999999999, 2024-05-08T18:30:41.754 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:41.754 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:41.754 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:41.754 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:41.754 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4479", 2024-05-08T18:30:41.755 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3577501689", 2024-05-08T18:30:41.755 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 41 2024-05-08T18:30:41.755 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.755 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:41.755 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.755 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:41.755 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.637466+0000", 2024-05-08T18:30:41.755 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:41.755 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.755 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.755 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:41.755 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.637466+0000", 2024-05-08T18:30:41.755 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:41.755 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.756 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.756 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:41.756 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.637468+0000", 2024-05-08T18:30:41.756 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2800000000000002e-06 2024-05-08T18:30:41.756 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.756 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.756 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:41.756 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.637479+0000", 2024-05-08T18:30:41.756 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0674e-05 2024-05-08T18:30:41.756 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.756 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.756 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:41.756 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.637508+0000", 2024-05-08T18:30:41.757 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8921999999999999e-05 2024-05-08T18:30:41.757 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.757 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.757 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:41.757 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.637522+0000", 2024-05-08T18:30:41.757 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3923e-05 2024-05-08T18:30:41.757 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.757 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.757 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:41.757 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.637647+0000", 2024-05-08T18:30:41.757 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000124905 2024-05-08T18:30:41.757 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.757 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.757 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:41.758 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.637852+0000", 2024-05-08T18:30:41.758 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000205081 2024-05-08T18:30:41.758 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.758 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.758 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:41.758 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.638101+0000", 2024-05-08T18:30:41.758 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000248953 2024-05-08T18:30:41.758 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.758 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.758 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:41.758 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.639345+0000", 2024-05-08T18:30:41.758 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001244754 2024-05-08T18:30:41.758 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.758 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.759 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:41.759 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.640197+0000", 2024-05-08T18:30:41.759 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000851614 2024-05-08T18:30:41.759 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.759 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.759 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:41.759 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.640353+0000", 2024-05-08T18:30:41.759 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015631600000000001 2024-05-08T18:30:41.759 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.759 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.759 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:41.759 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.640466+0000", 2024-05-08T18:30:41.759 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000112973 2024-05-08T18:30:41.759 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:41.760 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:41.760 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:41.760 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.760 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.760 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:30:41.760 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.664338+0000", 2024-05-08T18:30:41.760 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 50.080192103999998, 2024-05-08T18:30:41.760 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039355429999999997, 2024-05-08T18:30:41.760 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:41.760 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:41.760 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:41.760 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:41.760 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:41.760 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:41.760 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 205 2024-05-08T18:30:41.761 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.761 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:41.761 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.761 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:41.761 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.664338+0000", 2024-05-08T18:30:41.761 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:41.761 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.761 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.761 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:41.761 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.664338+0000", 2024-05-08T18:30:41.761 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:41.761 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.761 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.762 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:41.762 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.664341+0000", 2024-05-08T18:30:41.762 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2399999999999999e-06 2024-05-08T18:30:41.762 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.762 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.762 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:41.762 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.664355+0000", 2024-05-08T18:30:41.762 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.453e-05 2024-05-08T18:30:41.762 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.762 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.762 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:41.762 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.664392+0000", 2024-05-08T18:30:41.762 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7033000000000003e-05 2024-05-08T18:30:41.763 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.763 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.763 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:41.763 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.664419+0000", 2024-05-08T18:30:41.763 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6086000000000001e-05 2024-05-08T18:30:41.763 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.763 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.763 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:41.763 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.664586+0000", 2024-05-08T18:30:41.763 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016752299999999999 2024-05-08T18:30:41.763 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.763 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.763 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:41.763 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.664831+0000", 2024-05-08T18:30:41.764 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00024510800000000001 2024-05-08T18:30:41.764 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.764 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.764 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:41.764 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.665420+0000", 2024-05-08T18:30:41.764 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00058862499999999996 2024-05-08T18:30:41.764 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.764 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.764 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:41.764 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.667096+0000", 2024-05-08T18:30:41.764 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0016765199999999999 2024-05-08T18:30:41.764 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.764 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.764 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:41.765 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.668109+0000", 2024-05-08T18:30:41.765 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001012829 2024-05-08T18:30:41.765 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.765 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.765 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:41.765 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.668200+0000", 2024-05-08T18:30:41.765 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1186000000000004e-05 2024-05-08T18:30:41.765 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.765 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.765 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:41.765 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.668273+0000", 2024-05-08T18:30:41.765 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.2862999999999997e-05 2024-05-08T18:30:41.765 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:41.765 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:41.766 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:41.766 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.766 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.766 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:41.766 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.732858+0000", 2024-05-08T18:30:41.766 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 50.011671755999998, 2024-05-08T18:30:41.766 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0033301939999999999, 2024-05-08T18:30:41.766 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:41.766 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:41.766 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:41.766 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:41.766 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:41.766 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:41.767 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 220 2024-05-08T18:30:41.767 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.767 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:41.767 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.767 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:41.767 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.732858+0000", 2024-05-08T18:30:41.767 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:41.767 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.767 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.767 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:41.767 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.732858+0000", 2024-05-08T18:30:41.767 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:41.767 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.768 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.768 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:41.768 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.732861+0000", 2024-05-08T18:30:41.768 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.9129999999999999e-06 2024-05-08T18:30:41.768 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.768 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.768 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:41.768 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.732874+0000", 2024-05-08T18:30:41.768 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3349999999999999e-05 2024-05-08T18:30:41.768 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.768 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.768 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:41.768 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.732900+0000", 2024-05-08T18:30:41.769 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6186999999999998e-05 2024-05-08T18:30:41.769 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.769 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.769 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:41.769 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.732916+0000", 2024-05-08T18:30:41.769 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5648999999999999e-05 2024-05-08T18:30:41.769 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.769 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.769 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:41.769 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.733097+0000", 2024-05-08T18:30:41.769 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00018121599999999999 2024-05-08T18:30:41.769 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.769 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.769 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:41.770 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.733299+0000", 2024-05-08T18:30:41.770 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020179799999999999 2024-05-08T18:30:41.770 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.770 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.770 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:41.770 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.733694+0000", 2024-05-08T18:30:41.770 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00039455000000000002 2024-05-08T18:30:41.770 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.770 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.770 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:41.770 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.735124+0000", 2024-05-08T18:30:41.770 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001430239 2024-05-08T18:30:41.770 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.771 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.771 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:41.771 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.736037+0000", 2024-05-08T18:30:41.771 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00091359999999999998 2024-05-08T18:30:41.771 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.771 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.771 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:41.771 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.736122+0000", 2024-05-08T18:30:41.771 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4313000000000004e-05 2024-05-08T18:30:41.771 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.771 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.771 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:41.771 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.736188+0000", 2024-05-08T18:30:41.771 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6378999999999996e-05 2024-05-08T18:30:41.772 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:41.772 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:41.772 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:41.772 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.772 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.772 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:223 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:41.772 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.743358+0000", 2024-05-08T18:30:41.772 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 50.001171544000002, 2024-05-08T18:30:41.772 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003279718, 2024-05-08T18:30:41.772 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:41.772 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:41.772 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:41.772 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:41.773 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:41.773 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:41.773 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 223 2024-05-08T18:30:41.773 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.773 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:41.773 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.773 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:41.773 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.743358+0000", 2024-05-08T18:30:41.773 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:41.773 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.773 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.773 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:41.773 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.743358+0000", 2024-05-08T18:30:41.773 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:41.774 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.774 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.774 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:41.774 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.743361+0000", 2024-05-08T18:30:41.774 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3269999999999999e-06 2024-05-08T18:30:41.774 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.774 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.774 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:41.774 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.743372+0000", 2024-05-08T18:30:41.774 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1202999999999999e-05 2024-05-08T18:30:41.774 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.774 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.774 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:41.775 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.743402+0000", 2024-05-08T18:30:41.775 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0580000000000002e-05 2024-05-08T18:30:41.775 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.775 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.775 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:41.775 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.743417+0000", 2024-05-08T18:30:41.775 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5067e-05 2024-05-08T18:30:41.775 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.775 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.775 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:41.775 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.743529+0000", 2024-05-08T18:30:41.775 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011130599999999999 2024-05-08T18:30:41.775 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.775 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.775 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:41.776 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.743744+0000", 2024-05-08T18:30:41.776 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000215324 2024-05-08T18:30:41.776 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.776 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.776 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:41.776 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.744137+0000", 2024-05-08T18:30:41.776 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00039347699999999999 2024-05-08T18:30:41.776 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.776 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.776 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:41.776 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.745510+0000", 2024-05-08T18:30:41.776 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001372063 2024-05-08T18:30:41.776 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.776 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.777 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:41.777 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.746486+0000", 2024-05-08T18:30:41.777 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00097615600000000005 2024-05-08T18:30:41.777 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.777 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.777 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:41.777 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.746574+0000", 2024-05-08T18:30:41.777 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8598999999999997e-05 2024-05-08T18:30:41.777 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.777 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.777 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:41.777 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.746638+0000", 2024-05-08T18:30:41.777 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3615999999999995e-05 2024-05-08T18:30:41.777 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:41.777 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:41.778 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:41.778 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.778 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.778 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:225 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:41.778 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.750971+0000", 2024-05-08T18:30:41.778 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 49.993558958999998, 2024-05-08T18:30:41.778 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0033719510000000002, 2024-05-08T18:30:41.778 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:41.778 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:41.778 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:41.778 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:41.778 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:41.778 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:41.778 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 225 2024-05-08T18:30:41.779 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.779 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:41.779 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.779 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:41.779 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.750971+0000", 2024-05-08T18:30:41.779 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:41.779 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.779 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.779 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:41.779 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.750971+0000", 2024-05-08T18:30:41.779 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:41.779 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.779 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.779 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:41.780 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.750973+0000", 2024-05-08T18:30:41.780 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.243e-06 2024-05-08T18:30:41.780 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.780 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.780 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:41.780 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.751001+0000", 2024-05-08T18:30:41.780 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8082999999999999e-05 2024-05-08T18:30:41.780 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.780 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.780 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:41.780 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.751029+0000", 2024-05-08T18:30:41.780 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.792e-05 2024-05-08T18:30:41.780 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.780 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.780 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:41.781 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.751051+0000", 2024-05-08T18:30:41.781 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2166000000000001e-05 2024-05-08T18:30:41.781 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.781 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.781 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:41.781 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.751239+0000", 2024-05-08T18:30:41.781 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000187362 2024-05-08T18:30:41.781 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.781 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.781 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:41.781 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.751462+0000", 2024-05-08T18:30:41.781 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000223482 2024-05-08T18:30:41.781 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.781 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.781 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:41.782 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.751893+0000", 2024-05-08T18:30:41.782 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00043102 2024-05-08T18:30:41.782 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.782 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.782 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:41.782 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.753297+0000", 2024-05-08T18:30:41.782 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001403619 2024-05-08T18:30:41.782 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.782 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.782 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:41.782 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.754186+0000", 2024-05-08T18:30:41.782 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00088948399999999996 2024-05-08T18:30:41.782 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.782 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.783 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:41.783 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.754280+0000", 2024-05-08T18:30:41.783 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.3838999999999994e-05 2024-05-08T18:30:41.783 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.783 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.783 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:41.783 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.754343+0000", 2024-05-08T18:30:41.783 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2732999999999997e-05 2024-05-08T18:30:41.783 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:41.783 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:41.783 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:41.783 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.783 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.783 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:226 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:41.783 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.754700+0000", 2024-05-08T18:30:41.784 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 49.989829403999998, 2024-05-08T18:30:41.784 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032180080000000001, 2024-05-08T18:30:41.784 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:41.784 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:41.784 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:41.784 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:41.784 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:41.784 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:41.784 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 226 2024-05-08T18:30:41.784 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.784 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:41.784 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.784 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:41.784 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.754700+0000", 2024-05-08T18:30:41.785 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:41.785 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.785 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.785 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:41.785 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.754700+0000", 2024-05-08T18:30:41.785 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:41.785 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.785 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.785 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:41.785 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.754702+0000", 2024-05-08T18:30:41.785 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.86e-06 2024-05-08T18:30:41.785 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.785 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.785 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:41.786 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.754711+0000", 2024-05-08T18:30:41.786 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.0399999999999998e-06 2024-05-08T18:30:41.786 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.786 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.786 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:41.786 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.754735+0000", 2024-05-08T18:30:41.786 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3496e-05 2024-05-08T18:30:41.786 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.786 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.787 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:41.787 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.754753+0000", 2024-05-08T18:30:41.787 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8406e-05 2024-05-08T18:30:41.787 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.787 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.787 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:41.787 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.754941+0000", 2024-05-08T18:30:41.787 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00018746600000000001 2024-05-08T18:30:41.787 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.787 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.787 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:41.787 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.755164+0000", 2024-05-08T18:30:41.787 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022307800000000001 2024-05-08T18:30:41.787 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.788 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.788 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:41.788 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.755552+0000", 2024-05-08T18:30:41.788 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00038834999999999998 2024-05-08T18:30:41.788 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.788 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.788 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:41.788 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.757079+0000", 2024-05-08T18:30:41.788 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001527055 2024-05-08T18:30:41.788 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.788 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.788 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:41.788 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.757769+0000", 2024-05-08T18:30:41.788 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00068953199999999997 2024-05-08T18:30:41.788 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.789 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.789 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:41.789 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.757848+0000", 2024-05-08T18:30:41.789 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9342e-05 2024-05-08T18:30:41.789 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.789 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.789 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:41.789 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.757918+0000", 2024-05-08T18:30:41.789 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0382999999999993e-05 2024-05-08T18:30:41.789 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:41.789 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:41.789 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:41.789 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.789 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.790 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:234 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:41.790 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.783973+0000", 2024-05-08T18:30:41.790 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 49.960557039999998, 2024-05-08T18:30:41.790 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003359374, 2024-05-08T18:30:41.790 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:41.790 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:41.790 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:41.790 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:41.790 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:41.790 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:41.790 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 234 2024-05-08T18:30:41.790 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.790 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:41.791 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.791 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:41.791 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.783973+0000", 2024-05-08T18:30:41.791 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:41.791 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.791 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.791 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:41.791 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.783973+0000", 2024-05-08T18:30:41.791 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:41.791 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.791 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.791 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:41.791 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.783975+0000", 2024-05-08T18:30:41.791 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2970000000000002e-06 2024-05-08T18:30:41.792 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.792 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.792 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:41.792 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.783986+0000", 2024-05-08T18:30:41.792 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0726e-05 2024-05-08T18:30:41.792 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.792 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.792 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:41.792 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.784016+0000", 2024-05-08T18:30:41.792 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0459000000000001e-05 2024-05-08T18:30:41.792 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.792 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.792 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:41.792 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.784032+0000", 2024-05-08T18:30:41.793 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5316999999999999e-05 2024-05-08T18:30:41.793 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.793 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.793 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:41.793 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.784155+0000", 2024-05-08T18:30:41.793 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012393199999999999 2024-05-08T18:30:41.793 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.793 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.793 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:41.793 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.784377+0000", 2024-05-08T18:30:41.793 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000221179 2024-05-08T18:30:41.793 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.793 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.793 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:41.794 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.784794+0000", 2024-05-08T18:30:41.794 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00041709599999999999 2024-05-08T18:30:41.794 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.794 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.794 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:41.794 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.786199+0000", 2024-05-08T18:30:41.794 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001405346 2024-05-08T18:30:41.794 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.794 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.794 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:41.794 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.787171+0000", 2024-05-08T18:30:41.794 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00097187 2024-05-08T18:30:41.794 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.795 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.795 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:41.795 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.787265+0000", 2024-05-08T18:30:41.795 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4055000000000007e-05 2024-05-08T18:30:41.795 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.795 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.795 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:41.795 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.787332+0000", 2024-05-08T18:30:41.795 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7096999999999998e-05 2024-05-08T18:30:41.795 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:41.795 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:41.795 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:41.795 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.795 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.795 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:425 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:41.796 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.847197+0000", 2024-05-08T18:30:41.796 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 49.897332374999998, 2024-05-08T18:30:41.796 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003317646, 2024-05-08T18:30:41.796 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:41.796 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:41.796 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:41.796 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:41.796 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:41.796 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:41.796 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 425 2024-05-08T18:30:41.796 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.796 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:41.796 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.796 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:41.797 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.847197+0000", 2024-05-08T18:30:41.797 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:41.797 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.797 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.797 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:41.797 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.847197+0000", 2024-05-08T18:30:41.797 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:41.797 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.797 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.797 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:41.797 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.847200+0000", 2024-05-08T18:30:41.797 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1629999999999999e-06 2024-05-08T18:30:41.797 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.798 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.798 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:41.798 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.847210+0000", 2024-05-08T18:30:41.798 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0180000000000001e-05 2024-05-08T18:30:41.798 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.798 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.798 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:41.798 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.847234+0000", 2024-05-08T18:30:41.798 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3879999999999998e-05 2024-05-08T18:30:41.798 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.798 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.798 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:41.798 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.847247+0000", 2024-05-08T18:30:41.798 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3263e-05 2024-05-08T18:30:41.799 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.799 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.799 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:41.799 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.847356+0000", 2024-05-08T18:30:41.799 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000108906 2024-05-08T18:30:41.799 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.799 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.799 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:41.799 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.847647+0000", 2024-05-08T18:30:41.799 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029143799999999998 2024-05-08T18:30:41.799 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.799 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.799 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:41.799 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.848062+0000", 2024-05-08T18:30:41.800 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000415227 2024-05-08T18:30:41.800 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.800 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.800 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:41.800 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.849591+0000", 2024-05-08T18:30:41.800 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0015288980000000001 2024-05-08T18:30:41.800 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.800 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.800 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:41.800 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.850244+0000", 2024-05-08T18:30:41.800 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000652336 2024-05-08T18:30:41.800 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.800 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.800 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:41.800 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.850418+0000", 2024-05-08T18:30:41.801 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000174284 2024-05-08T18:30:41.801 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.801 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.801 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:41.801 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.850515+0000", 2024-05-08T18:30:41.801 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7071000000000006e-05 2024-05-08T18:30:41.801 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:41.801 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:41.801 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:41.801 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.801 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.801 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:433 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:41.801 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.851403+0000", 2024-05-08T18:30:41.801 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 49.893126594000002, 2024-05-08T18:30:41.802 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032407109999999999, 2024-05-08T18:30:41.802 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:41.802 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:41.802 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:41.802 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:41.802 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:41.802 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:41.802 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 433 2024-05-08T18:30:41.802 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.802 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:41.802 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.802 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:41.802 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.851403+0000", 2024-05-08T18:30:41.803 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:41.803 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.803 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.803 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:41.803 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.851403+0000", 2024-05-08T18:30:41.803 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:41.803 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.803 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.803 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:41.803 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.851405+0000", 2024-05-08T18:30:41.803 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.463e-06 2024-05-08T18:30:41.803 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.803 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.804 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:41.804 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.851411+0000", 2024-05-08T18:30:41.804 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2369999999999997e-06 2024-05-08T18:30:41.804 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.804 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.804 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:41.804 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.851428+0000", 2024-05-08T18:30:41.804 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.696e-05 2024-05-08T18:30:41.804 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.804 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.804 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:41.804 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.851446+0000", 2024-05-08T18:30:41.804 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7706e-05 2024-05-08T18:30:41.805 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.805 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.805 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:41.805 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.851552+0000", 2024-05-08T18:30:41.805 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000106236 2024-05-08T18:30:41.805 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.805 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.805 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:41.805 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.851746+0000", 2024-05-08T18:30:41.805 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000194093 2024-05-08T18:30:41.805 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.805 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.805 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:41.805 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.852148+0000", 2024-05-08T18:30:41.805 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00040243100000000002 2024-05-08T18:30:41.806 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.806 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.806 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:41.806 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.854255+0000", 2024-05-08T18:30:41.806 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002107135 2024-05-08T18:30:41.806 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.806 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.806 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:41.806 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.854326+0000", 2024-05-08T18:30:41.806 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0902999999999995e-05 2024-05-08T18:30:41.806 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.806 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.806 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:41.807 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.854568+0000", 2024-05-08T18:30:41.807 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00024141500000000001 2024-05-08T18:30:41.807 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.807 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.807 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:41.807 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.854644+0000", 2024-05-08T18:30:41.807 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6131999999999995e-05 2024-05-08T18:30:41.807 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:41.807 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:41.807 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:41.807 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.807 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.807 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:436 6.a 6:55b0279d:reshard::reshard.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:41.807 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.852129+0000", 2024-05-08T18:30:41.807 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 49.892400786000003, 2024-05-08T18:30:41.808 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0053015019999999996, 2024-05-08T18:30:41.808 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:41.809 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:41.809 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:41.809 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:41.809 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:41.809 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:41.809 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 436 2024-05-08T18:30:41.810 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.810 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:41.810 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.810 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:41.810 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.852129+0000", 2024-05-08T18:30:41.810 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:41.810 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.810 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.810 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:41.810 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.852129+0000", 2024-05-08T18:30:41.810 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:41.810 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.810 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.810 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:41.811 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.852130+0000", 2024-05-08T18:30:41.811 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.353e-06 2024-05-08T18:30:41.811 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.811 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.811 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:41.811 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.852137+0000", 2024-05-08T18:30:41.811 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6900000000000003e-06 2024-05-08T18:30:41.811 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.811 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.811 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:41.811 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.852156+0000", 2024-05-08T18:30:41.811 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9143e-05 2024-05-08T18:30:41.811 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.811 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.812 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:41.812 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.852169+0000", 2024-05-08T18:30:41.812 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.308e-05 2024-05-08T18:30:41.812 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.812 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.812 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:41.812 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.852700+0000", 2024-05-08T18:30:41.812 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00053086599999999996 2024-05-08T18:30:41.812 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.812 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.812 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:41.812 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.853030+0000", 2024-05-08T18:30:41.812 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00033040100000000002 2024-05-08T18:30:41.812 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.813 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.813 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:41.813 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.853514+0000", 2024-05-08T18:30:41.813 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000483969 2024-05-08T18:30:41.813 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.813 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.813 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:41.813 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.856337+0000", 2024-05-08T18:30:41.813 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0028227349999999998 2024-05-08T18:30:41.813 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.813 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.813 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:41.813 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.857285+0000", 2024-05-08T18:30:41.813 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00094820600000000005 2024-05-08T18:30:41.814 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.814 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.814 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:41.814 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.857366+0000", 2024-05-08T18:30:41.814 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.0889000000000004e-05 2024-05-08T18:30:41.814 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.814 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.814 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:41.814 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.857430+0000", 2024-05-08T18:30:41.814 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4170000000000004e-05 2024-05-08T18:30:41.814 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:41.814 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:41.814 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:41.815 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.815 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.815 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:478 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:41.815 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.876745+0000", 2024-05-08T18:30:41.815 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 49.86778425, 2024-05-08T18:30:41.815 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0046303550000000001, 2024-05-08T18:30:41.815 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:41.815 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:41.815 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:41.815 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:41.815 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:41.815 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:41.815 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 478 2024-05-08T18:30:41.815 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.816 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:41.816 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.816 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:41.816 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.876745+0000", 2024-05-08T18:30:41.816 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:41.816 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.816 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.816 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:41.816 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.876745+0000", 2024-05-08T18:30:41.816 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:41.816 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.816 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.816 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:41.816 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.876748+0000", 2024-05-08T18:30:41.817 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2819999999999999e-06 2024-05-08T18:30:41.817 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.817 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.817 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:41.817 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.876758+0000", 2024-05-08T18:30:41.817 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0485e-05 2024-05-08T18:30:41.817 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.817 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.817 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:41.817 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.876788+0000", 2024-05-08T18:30:41.817 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.9879e-05 2024-05-08T18:30:41.817 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.817 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.817 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:41.818 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.876805+0000", 2024-05-08T18:30:41.818 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.643e-05 2024-05-08T18:30:41.818 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.818 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.818 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:41.818 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.876917+0000", 2024-05-08T18:30:41.818 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000112377 2024-05-08T18:30:41.818 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.818 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.818 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:41.818 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877094+0000", 2024-05-08T18:30:41.818 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000177131 2024-05-08T18:30:41.818 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.819 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.819 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:41.819 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877441+0000", 2024-05-08T18:30:41.819 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00034716100000000002 2024-05-08T18:30:41.819 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.819 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.819 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:41.819 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.878479+0000", 2024-05-08T18:30:41.819 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010378729999999999 2024-05-08T18:30:41.819 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.819 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.819 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:41.819 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.881252+0000", 2024-05-08T18:30:41.819 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0027728710000000001 2024-05-08T18:30:41.820 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.820 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.820 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:41.820 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.881322+0000", 2024-05-08T18:30:41.820 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0394000000000004e-05 2024-05-08T18:30:41.820 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.820 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.820 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:41.820 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.881376+0000", 2024-05-08T18:30:41.820 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3471999999999999e-05 2024-05-08T18:30:41.820 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:41.820 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:41.820 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:41.820 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.821 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.821 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:479 6.d 6:b3052b9f:reshard::reshard.0000000013:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:41.821 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.877922+0000", 2024-05-08T18:30:41.821 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 49.866608151999998, 2024-05-08T18:30:41.821 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0030756400000000001, 2024-05-08T18:30:41.821 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:41.821 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:41.821 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:41.821 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:41.821 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:41.821 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:41.821 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 479 2024-05-08T18:30:41.821 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.821 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:41.822 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.822 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:41.822 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877922+0000", 2024-05-08T18:30:41.822 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:41.822 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.822 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.822 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:41.822 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877922+0000", 2024-05-08T18:30:41.822 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:41.822 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.822 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.822 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:41.822 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877923+0000", 2024-05-08T18:30:41.823 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8670000000000001e-06 2024-05-08T18:30:41.823 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.823 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.823 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:41.823 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877933+0000", 2024-05-08T18:30:41.823 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.0860000000000008e-06 2024-05-08T18:30:41.823 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.823 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.823 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:41.823 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877970+0000", 2024-05-08T18:30:41.823 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7762999999999997e-05 2024-05-08T18:30:41.823 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.823 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.824 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:41.824 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877997+0000", 2024-05-08T18:30:41.824 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6883e-05 2024-05-08T18:30:41.824 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.824 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.824 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:41.824 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.878108+0000", 2024-05-08T18:30:41.824 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000110797 2024-05-08T18:30:41.824 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.824 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.824 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:41.824 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.878403+0000", 2024-05-08T18:30:41.824 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029509799999999999 2024-05-08T18:30:41.824 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.825 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.825 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:41.825 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.878744+0000", 2024-05-08T18:30:41.825 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00034075899999999999 2024-05-08T18:30:41.825 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.825 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.825 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:41.825 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.879800+0000", 2024-05-08T18:30:41.825 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010564420000000001 2024-05-08T18:30:41.825 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.825 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.825 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:41.825 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.880740+0000", 2024-05-08T18:30:41.825 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000940167 2024-05-08T18:30:41.826 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.826 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.826 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:41.826 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.880880+0000", 2024-05-08T18:30:41.826 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000139796 2024-05-08T18:30:41.826 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.826 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.826 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:41.826 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.880997+0000", 2024-05-08T18:30:41.826 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000116982 2024-05-08T18:30:41.826 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:41.826 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:41.826 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:41.826 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.827 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.827 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:766 6.19 6:9edc23b1:::obj_delete_at_hint.0000000063:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:41.827 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.158937+0000", 2024-05-08T18:30:41.827 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 49.585592261000002, 2024-05-08T18:30:41.827 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0030448300000000001, 2024-05-08T18:30:41.827 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:41.827 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:41.827 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:41.827 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:41.827 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:41.827 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:41.827 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 766 2024-05-08T18:30:41.827 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.827 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:41.828 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.828 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:41.828 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.158937+0000", 2024-05-08T18:30:41.828 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:41.828 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.828 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.828 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:41.828 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.158937+0000", 2024-05-08T18:30:41.828 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:41.828 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.828 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.828 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:41.828 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.158940+0000", 2024-05-08T18:30:41.829 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6170000000000001e-06 2024-05-08T18:30:41.829 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.829 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.829 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:41.829 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.158952+0000", 2024-05-08T18:30:41.829 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1559000000000001e-05 2024-05-08T18:30:41.829 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.829 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.829 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:41.829 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.158982+0000", 2024-05-08T18:30:41.829 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0406999999999999e-05 2024-05-08T18:30:41.829 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.829 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.829 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:41.829 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.159000+0000", 2024-05-08T18:30:41.829 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8e-05 2024-05-08T18:30:41.830 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.830 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.830 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:41.830 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.159090+0000", 2024-05-08T18:30:41.830 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.0124999999999995e-05 2024-05-08T18:30:41.830 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.830 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.830 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:41.830 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.159296+0000", 2024-05-08T18:30:41.830 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000205663 2024-05-08T18:30:41.830 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.830 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.831 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:41.831 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.159600+0000", 2024-05-08T18:30:41.831 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00030387699999999998 2024-05-08T18:30:41.831 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.831 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.831 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:41.831 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.160694+0000", 2024-05-08T18:30:41.831 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001094228 2024-05-08T18:30:41.831 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.831 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.831 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:41.831 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.161818+0000", 2024-05-08T18:30:41.831 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001124388 2024-05-08T18:30:41.831 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.831 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.832 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:41.832 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.161908+0000", 2024-05-08T18:30:41.832 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.9629000000000005e-05 2024-05-08T18:30:41.832 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.832 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.832 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:41.832 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.161982+0000", 2024-05-08T18:30:41.832 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4337000000000003e-05 2024-05-08T18:30:41.832 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:41.832 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:41.832 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:41.832 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.832 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.832 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:820 6.a 6:50a39311:::obj_delete_at_hint.0000000081:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:41.833 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.281842+0000", 2024-05-08T18:30:41.833 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 49.462687860000003, 2024-05-08T18:30:41.833 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0030574130000000001, 2024-05-08T18:30:41.833 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:41.833 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:41.833 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:41.833 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:41.833 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:41.833 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:41.833 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 820 2024-05-08T18:30:41.833 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.833 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:41.833 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.834 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:41.834 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.281842+0000", 2024-05-08T18:30:41.834 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:41.834 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.834 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.834 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:41.834 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.281842+0000", 2024-05-08T18:30:41.834 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:41.834 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.834 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.834 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:41.834 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.281845+0000", 2024-05-08T18:30:41.834 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8439999999999998e-06 2024-05-08T18:30:41.834 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.835 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.835 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:41.835 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.281856+0000", 2024-05-08T18:30:41.835 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.148e-05 2024-05-08T18:30:41.835 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.835 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.835 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:41.835 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.281887+0000", 2024-05-08T18:30:41.835 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1239999999999999e-05 2024-05-08T18:30:41.835 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.835 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.835 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:41.835 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.281903+0000", 2024-05-08T18:30:41.836 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5223e-05 2024-05-08T18:30:41.836 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.836 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.836 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:41.836 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.282084+0000", 2024-05-08T18:30:41.836 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00018167500000000001 2024-05-08T18:30:41.836 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.836 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.836 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:41.836 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.282301+0000", 2024-05-08T18:30:41.836 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00021651099999999999 2024-05-08T18:30:41.836 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.836 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.836 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:41.837 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.282634+0000", 2024-05-08T18:30:41.837 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000332758 2024-05-08T18:30:41.837 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.837 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.837 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:41.837 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.283836+0000", 2024-05-08T18:30:41.837 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001202397 2024-05-08T18:30:41.837 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.837 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.837 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:41.837 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.284750+0000", 2024-05-08T18:30:41.837 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00091438999999999995 2024-05-08T18:30:41.837 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.837 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.837 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:41.838 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.284836+0000", 2024-05-08T18:30:41.838 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.5855999999999999e-05 2024-05-08T18:30:41.838 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.838 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.838 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:41.838 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.284899+0000", 2024-05-08T18:30:41.838 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3039000000000004e-05 2024-05-08T18:30:41.838 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:41.838 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:41.838 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:41.838 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.838 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.838 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:835 6.7 6:e09767b9:::obj_delete_at_hint.0000000086:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:41.839 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.317765+0000", 2024-05-08T18:30:41.839 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 49.426764970999997, 2024-05-08T18:30:41.839 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029952809999999998, 2024-05-08T18:30:41.839 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:41.839 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:41.839 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:41.839 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:41.839 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:41.839 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:41.839 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 835 2024-05-08T18:30:41.839 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.839 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:41.839 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.840 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:41.840 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.317765+0000", 2024-05-08T18:30:41.840 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:41.840 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.840 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.840 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:41.840 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.317765+0000", 2024-05-08T18:30:41.840 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:41.840 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.840 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.840 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:41.840 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.317767+0000", 2024-05-08T18:30:41.840 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.057e-06 2024-05-08T18:30:41.840 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.841 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.841 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:41.841 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.317780+0000", 2024-05-08T18:30:41.841 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.36e-05 2024-05-08T18:30:41.841 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.841 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.841 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:41.841 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.317810+0000", 2024-05-08T18:30:41.841 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.9989999999999999e-05 2024-05-08T18:30:41.841 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.841 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.841 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:41.841 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.317832+0000", 2024-05-08T18:30:41.841 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1650000000000001e-05 2024-05-08T18:30:41.842 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.842 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.842 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:41.842 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.317954+0000", 2024-05-08T18:30:41.842 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000121465 2024-05-08T18:30:41.842 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.842 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.842 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:41.842 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.318189+0000", 2024-05-08T18:30:41.842 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000235818 2024-05-08T18:30:41.842 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.842 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.842 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:41.843 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.318532+0000", 2024-05-08T18:30:41.843 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00034245100000000002 2024-05-08T18:30:41.843 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.843 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.843 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:41.843 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.319625+0000", 2024-05-08T18:30:41.843 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010931280000000001 2024-05-08T18:30:41.843 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.843 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.843 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:41.843 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.320612+0000", 2024-05-08T18:30:41.843 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00098682299999999995 2024-05-08T18:30:41.843 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.844 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.844 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:41.844 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.320698+0000", 2024-05-08T18:30:41.844 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.5813e-05 2024-05-08T18:30:41.844 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.844 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.844 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:41.844 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.320760+0000", 2024-05-08T18:30:41.844 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2485999999999998e-05 2024-05-08T18:30:41.844 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:41.844 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:41.844 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:41.844 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.844 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.845 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:922 6.d 6:b6c174be:::obj_delete_at_hint.0000000115:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:41.845 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.516256+0000", 2024-05-08T18:30:41.845 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 49.228274018999997, 2024-05-08T18:30:41.845 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032949839999999999, 2024-05-08T18:30:41.845 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:41.845 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:41.845 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:41.845 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:41.845 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:41.845 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:41.845 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 922 2024-05-08T18:30:41.845 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.845 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:41.845 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.846 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:41.846 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.516256+0000", 2024-05-08T18:30:41.846 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:41.846 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.846 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.846 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:41.846 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.516256+0000", 2024-05-08T18:30:41.846 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:41.846 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.846 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.846 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:41.846 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.516258+0000", 2024-05-08T18:30:41.846 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.4399999999999999e-06 2024-05-08T18:30:41.847 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.847 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.847 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:41.847 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.516269+0000", 2024-05-08T18:30:41.847 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0797e-05 2024-05-08T18:30:41.847 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.847 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.847 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:41.847 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.516299+0000", 2024-05-08T18:30:41.847 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0213e-05 2024-05-08T18:30:41.847 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.847 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.847 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:41.847 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.516314+0000", 2024-05-08T18:30:41.848 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4600000000000001e-05 2024-05-08T18:30:41.848 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.848 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.848 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:41.848 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.516424+0000", 2024-05-08T18:30:41.848 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000110376 2024-05-08T18:30:41.848 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.848 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.848 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:41.848 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.516635+0000", 2024-05-08T18:30:41.848 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000210628 2024-05-08T18:30:41.848 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.848 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.848 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:41.848 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.516947+0000", 2024-05-08T18:30:41.849 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00031246699999999997 2024-05-08T18:30:41.849 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.849 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.849 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:41.849 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.517949+0000", 2024-05-08T18:30:41.849 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010017400000000001 2024-05-08T18:30:41.849 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.849 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.849 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:41.849 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.519389+0000", 2024-05-08T18:30:41.849 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001439655 2024-05-08T18:30:41.849 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.849 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.849 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:41.850 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.519475+0000", 2024-05-08T18:30:41.850 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.6485999999999998e-05 2024-05-08T18:30:41.850 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.850 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.850 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:41.850 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.519551+0000", 2024-05-08T18:30:41.850 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5581999999999996e-05 2024-05-08T18:30:41.850 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:41.850 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:41.850 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:41.850 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.850 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.850 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:940 6.a 6:517698f6:::obj_delete_at_hint.0000000121:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:41.851 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.560553+0000", 2024-05-08T18:30:41.851 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 49.183977171000002, 2024-05-08T18:30:41.851 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0030017569999999999, 2024-05-08T18:30:41.851 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:41.851 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:41.851 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:41.851 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:41.851 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:41.851 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:41.851 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 940 2024-05-08T18:30:41.851 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.851 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:41.851 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.851 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:41.852 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.560553+0000", 2024-05-08T18:30:41.852 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:41.852 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.852 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.852 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:41.852 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.560553+0000", 2024-05-08T18:30:41.852 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:41.852 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.852 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.852 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:41.852 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.560555+0000", 2024-05-08T18:30:41.852 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.39e-06 2024-05-08T18:30:41.852 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.852 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.852 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:41.853 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.560566+0000", 2024-05-08T18:30:41.853 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1484000000000001e-05 2024-05-08T18:30:41.853 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.853 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.853 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:41.853 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.560596+0000", 2024-05-08T18:30:41.853 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0001999999999998e-05 2024-05-08T18:30:41.853 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.853 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.853 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:41.853 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.560612+0000", 2024-05-08T18:30:41.853 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5690000000000001e-05 2024-05-08T18:30:41.853 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.853 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.854 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:41.854 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.560747+0000", 2024-05-08T18:30:41.854 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013494900000000001 2024-05-08T18:30:41.854 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.854 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.854 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:41.854 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.560961+0000", 2024-05-08T18:30:41.854 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000214305 2024-05-08T18:30:41.854 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.854 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.854 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:41.854 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.561281+0000", 2024-05-08T18:30:41.854 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00031933800000000001 2024-05-08T18:30:41.855 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.855 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.855 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:41.855 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.562399+0000", 2024-05-08T18:30:41.855 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0011180280000000001 2024-05-08T18:30:41.855 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.855 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.855 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:41.855 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.563407+0000", 2024-05-08T18:30:41.855 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010080519999999999 2024-05-08T18:30:41.855 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.855 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.855 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:41.855 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.563489+0000", 2024-05-08T18:30:41.856 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1725999999999996e-05 2024-05-08T18:30:41.856 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.856 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.856 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:41.856 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.563554+0000", 2024-05-08T18:30:41.856 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5792999999999998e-05 2024-05-08T18:30:41.856 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:41.856 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:41.856 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:41.856 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.856 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.856 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:943 6.19 6:9f21944d:::obj_delete_at_hint.0000000122:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:41.856 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.567777+0000", 2024-05-08T18:30:41.856 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 49.176752280000002, 2024-05-08T18:30:41.857 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0033921939999999999, 2024-05-08T18:30:41.857 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:41.857 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:41.857 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:41.857 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:41.857 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:41.857 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:41.857 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 943 2024-05-08T18:30:41.857 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.857 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:41.857 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.857 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:41.857 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.567777+0000", 2024-05-08T18:30:41.857 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:41.857 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.858 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.858 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:41.858 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.567777+0000", 2024-05-08T18:30:41.858 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:41.858 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.858 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.858 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:41.858 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.567779+0000", 2024-05-08T18:30:41.858 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8330000000000001e-06 2024-05-08T18:30:41.858 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.858 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.858 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:41.858 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.567788+0000", 2024-05-08T18:30:41.858 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4999999999999999e-06 2024-05-08T18:30:41.859 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.859 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.859 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:41.859 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.567812+0000", 2024-05-08T18:30:41.859 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.4207e-05 2024-05-08T18:30:41.859 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.859 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.859 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:41.859 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.567836+0000", 2024-05-08T18:30:41.859 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.4196e-05 2024-05-08T18:30:41.859 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.859 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.859 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:41.860 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.567954+0000", 2024-05-08T18:30:41.860 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011794300000000001 2024-05-08T18:30:41.860 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.860 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.860 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:41.860 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.568170+0000", 2024-05-08T18:30:41.860 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00021626100000000001 2024-05-08T18:30:41.860 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.860 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.860 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:41.860 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.568485+0000", 2024-05-08T18:30:41.860 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00031442800000000001 2024-05-08T18:30:41.860 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.860 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.861 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:41.861 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.569555+0000", 2024-05-08T18:30:41.861 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010698750000000001 2024-05-08T18:30:41.861 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.861 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.861 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:41.861 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.570899+0000", 2024-05-08T18:30:41.861 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0013446700000000001 2024-05-08T18:30:41.861 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.861 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.861 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:41.861 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.571058+0000", 2024-05-08T18:30:41.861 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015871900000000001 2024-05-08T18:30:41.862 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.862 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.862 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:41.862 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.571170+0000", 2024-05-08T18:30:41.862 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000111562 2024-05-08T18:30:41.862 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:41.862 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:41.862 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:41.862 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.862 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.862 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:952 6.a 6:541d369a:::obj_delete_at_hint.0000000125:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:41.862 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.588764+0000", 2024-05-08T18:30:41.863 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 49.155765248999998, 2024-05-08T18:30:41.863 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003183399, 2024-05-08T18:30:41.863 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:41.863 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:41.863 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:41.863 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:41.863 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:41.863 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:41.863 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 952 2024-05-08T18:30:41.863 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.863 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:41.863 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.863 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:41.863 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.588764+0000", 2024-05-08T18:30:41.863 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:41.864 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.864 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.864 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:41.864 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.588764+0000", 2024-05-08T18:30:41.864 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:41.864 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.864 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.864 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:41.864 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.588767+0000", 2024-05-08T18:30:41.864 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.39e-06 2024-05-08T18:30:41.864 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.864 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.864 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:41.865 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.588778+0000", 2024-05-08T18:30:41.865 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1304000000000001e-05 2024-05-08T18:30:41.865 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.865 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.865 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:41.865 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.588810+0000", 2024-05-08T18:30:41.865 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1726000000000001e-05 2024-05-08T18:30:41.865 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.865 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.865 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:41.865 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.588834+0000", 2024-05-08T18:30:41.865 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3845999999999998e-05 2024-05-08T18:30:41.865 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.865 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.866 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:41.866 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.588987+0000", 2024-05-08T18:30:41.866 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015300200000000001 2024-05-08T18:30:41.866 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.866 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.866 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:41.866 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.589197+0000", 2024-05-08T18:30:41.866 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020992299999999999 2024-05-08T18:30:41.866 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.866 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.866 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:41.866 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.589536+0000", 2024-05-08T18:30:41.866 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00033939300000000001 2024-05-08T18:30:41.866 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.867 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.867 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:41.867 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.590827+0000", 2024-05-08T18:30:41.867 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0012906 2024-05-08T18:30:41.867 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.867 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.867 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:41.867 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.591757+0000", 2024-05-08T18:30:41.867 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00093020699999999995 2024-05-08T18:30:41.867 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.867 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.867 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:41.867 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.591881+0000", 2024-05-08T18:30:41.867 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012406900000000001 2024-05-08T18:30:41.868 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:41.868 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:41.868 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:41.868 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.591948+0000", 2024-05-08T18:30:41.868 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6939000000000004e-05 2024-05-08T18:30:41.868 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:41.868 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:41.868 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:41.868 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:41.868 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:41.868 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:30:41.870 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:30:41.868+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:30:41.871 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-08T18:30:41.889 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2024-05-08T18:30:41.890 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:30:41.906 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2024-05-08T18:30:41.906 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:30:41.922 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2024-05-08T18:30:41.922 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:30:41.939 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2024-05-08T18:30:41.939 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:30:41.958 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2024-05-08T18:30:41.959 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:30:41.971 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:30:41.972+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:30:41.977 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2024-05-08T18:30:41.977 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:30:41.997 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2024-05-08T18:30:41.998 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:30:42.001 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:42.001 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:42.016 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-08T18:30:42.016 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2024-05-08T18:30:42.017 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:30:42.072 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:30:42.071+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:30:42.138 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:42.138 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:42.153 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-08T18:30:42.174 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:30:42.172+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:30:42.275 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:30:42.276+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:30:42.312 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:42.313 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:42.327 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-08T18:30:42.375 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:30:42.371+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:30:42.443 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:42.443 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:42.459 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-08T18:30:42.501 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:30:42.499+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:30:42.536 INFO:teuthology.orchestra.run.smithi097.stderr:noscrub is unset 2024-05-08T18:30:42.606 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:30:42.608+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:30:42.627 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:42.627 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:42.641 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-08T18:30:42.678 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:30:42.676+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:30:42.759 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:42.760 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:42.772 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-08T18:30:42.778 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:30:42.775+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:30:42.879 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:30:42.880+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:30:42.907 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:42.908 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:42.922 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-08T18:30:42.980 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:30:42.975+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:30:43.081 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:30:43.080+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:30:43.094 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:43.094 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:43.109 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-08T18:30:43.182 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:30:43.183+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:30:43.275 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:43.275 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:43.282 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:30:43.283+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:30:43.289 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-08T18:30:43.383 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:30:43.384+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:30:43.412 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:43.412 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:43.426 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-08T18:30:43.483 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:30:43.479+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:30:43.584 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:30:43.583+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:30:43.594 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:43.594 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:43.608 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-08T18:30:43.685 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:30:43.683+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:30:43.731 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:43.731 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:43.745 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-08T18:30:43.786 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:30:43.783+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:30:43.862 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:43.862 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:43.877 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-08T18:30:43.926 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:30:43.928+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:30:43.987 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:30:43.983+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:30:43.998 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:43.998 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:44.012 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-08T18:30:44.034 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-08T18:30:44.089 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:30:44.087+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:30:44.187 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:44.187 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:44.190 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:30:44.187+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:30:44.199 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2024-05-08T18:30:44.199 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:30:44.201 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-08T18:30:44.216 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2024-05-08T18:30:44.217 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:30:44.235 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2024-05-08T18:30:44.235 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:30:44.251 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2024-05-08T18:30:44.252 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:30:44.272 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2024-05-08T18:30:44.273 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:30:44.290 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:30:44.287+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:30:44.293 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2024-05-08T18:30:44.294 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:30:44.314 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2024-05-08T18:30:44.314 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:30:44.318 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:30:44.318 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:30:44.318 INFO:teuthology.orchestra.run.smithi097.stdout: "num_ops": 0 2024-05-08T18:30:44.318 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:30:44.333 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-08T18:30:44.336 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2024-05-08T18:30:44.337 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:30:44.402 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:30:44.404+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:30:44.458 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:30:44.458 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:30:44.458 INFO:teuthology.orchestra.run.smithi097.stdout: "complaint_time": 30, 2024-05-08T18:30:44.459 INFO:teuthology.orchestra.run.smithi097.stdout: "num_blocked_ops": 0 2024-05-08T18:30:44.459 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:30:44.472 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-08T18:30:44.492 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:30:44.491+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:30:44.564 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-08T18:30:44.594 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:30:44.591+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:30:44.645 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:30:44.645 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2024-05-08T18:30:44.645 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2024-05-08T18:30:44.645 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-05-08T18:30:44.645 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.645 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:57 7.3 7:c609908c:::notify.5:head [watch watch cookie 94069412621696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:30:44.645 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:48.668590+0000", 2024-05-08T18:30:44.646 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 55.977670521, 2024-05-08T18:30:44.646 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0054375830000000002, 2024-05-08T18:30:44.646 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:44.646 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:44.646 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:44.646 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:44.646 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:44.646 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:44.646 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 57 2024-05-08T18:30:44.646 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.646 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:44.646 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.646 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:44.647 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668590+0000", 2024-05-08T18:30:44.647 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:44.647 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.647 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.647 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:44.647 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668590+0000", 2024-05-08T18:30:44.647 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:44.647 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.647 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.647 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:44.647 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668592+0000", 2024-05-08T18:30:44.647 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0930000000000001e-06 2024-05-08T18:30:44.647 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.647 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.648 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:44.648 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668619+0000", 2024-05-08T18:30:44.648 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7396999999999999e-05 2024-05-08T18:30:44.648 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.648 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.648 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:44.648 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668650+0000", 2024-05-08T18:30:44.648 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0620000000000002e-05 2024-05-08T18:30:44.648 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.648 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.648 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:44.648 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668672+0000", 2024-05-08T18:30:44.648 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2093e-05 2024-05-08T18:30:44.648 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.649 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.649 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:44.649 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668782+0000", 2024-05-08T18:30:44.649 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011010600000000001 2024-05-08T18:30:44.649 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.649 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.649 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:44.649 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668934+0000", 2024-05-08T18:30:44.649 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000152268 2024-05-08T18:30:44.649 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.649 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.649 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-05-08T18:30:44.649 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669177+0000", 2024-05-08T18:30:44.650 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024286500000000001 2024-05-08T18:30:44.650 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.650 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.650 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:44.650 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.670404+0000", 2024-05-08T18:30:44.650 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001226932 2024-05-08T18:30:44.650 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.650 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.650 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:44.650 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.673822+0000", 2024-05-08T18:30:44.650 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003417776 2024-05-08T18:30:44.650 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.650 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.651 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:44.651 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.673924+0000", 2024-05-08T18:30:44.651 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000102379 2024-05-08T18:30:44.651 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.651 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.651 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:44.651 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674027+0000", 2024-05-08T18:30:44.651 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010305400000000001 2024-05-08T18:30:44.651 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:44.651 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:44.651 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:44.651 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.651 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.651 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:58 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:30:44.652 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:48.668750+0000", 2024-05-08T18:30:44.652 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 55.977510095, 2024-05-08T18:30:44.652 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0057687559999999999, 2024-05-08T18:30:44.652 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:44.652 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:44.652 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:44.652 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:44.652 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:44.652 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:44.652 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 58 2024-05-08T18:30:44.652 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.652 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:44.652 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.652 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:44.653 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668750+0000", 2024-05-08T18:30:44.653 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:44.653 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.653 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.653 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:44.653 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668750+0000", 2024-05-08T18:30:44.653 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:44.653 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.653 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.653 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:44.653 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668752+0000", 2024-05-08T18:30:44.653 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.64e-06 2024-05-08T18:30:44.653 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.653 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.654 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:44.654 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668760+0000", 2024-05-08T18:30:44.654 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5529999999999993e-06 2024-05-08T18:30:44.654 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.654 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.654 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:44.654 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668787+0000", 2024-05-08T18:30:44.654 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6475999999999999e-05 2024-05-08T18:30:44.654 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.654 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.654 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:44.654 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668804+0000", 2024-05-08T18:30:44.654 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7163000000000002e-05 2024-05-08T18:30:44.655 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.655 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.655 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:44.655 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668906+0000", 2024-05-08T18:30:44.655 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010241 2024-05-08T18:30:44.655 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.655 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.655 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:44.655 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669068+0000", 2024-05-08T18:30:44.655 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016144400000000001 2024-05-08T18:30:44.655 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.655 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.655 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-05-08T18:30:44.655 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669226+0000", 2024-05-08T18:30:44.655 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000158639 2024-05-08T18:30:44.656 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.656 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.656 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:44.656 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.670439+0000", 2024-05-08T18:30:44.656 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012124480000000001 2024-05-08T18:30:44.656 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.656 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.656 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:44.656 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674406+0000", 2024-05-08T18:30:44.656 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0039675259999999999 2024-05-08T18:30:44.656 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.656 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.656 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:44.657 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674469+0000", 2024-05-08T18:30:44.657 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.2903000000000004e-05 2024-05-08T18:30:44.657 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.657 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.657 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:44.657 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674519+0000", 2024-05-08T18:30:44.657 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9554e-05 2024-05-08T18:30:44.657 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:44.657 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:44.657 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:44.657 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.657 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.657 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:30:44.657 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.675404+0000", 2024-05-08T18:30:44.657 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 52.970856324000003, 2024-05-08T18:30:44.658 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003903147, 2024-05-08T18:30:44.658 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:44.658 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:44.658 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:44.658 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:44.658 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:44.658 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:44.658 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 207 2024-05-08T18:30:44.658 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.658 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:44.658 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.658 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:44.658 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675404+0000", 2024-05-08T18:30:44.659 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:44.659 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.659 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.659 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:44.659 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675404+0000", 2024-05-08T18:30:44.659 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:44.659 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.659 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.659 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:44.659 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675407+0000", 2024-05-08T18:30:44.659 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1729999999999999e-06 2024-05-08T18:30:44.659 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.659 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.660 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:44.660 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675422+0000", 2024-05-08T18:30:44.660 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.485e-05 2024-05-08T18:30:44.660 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.660 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.660 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:44.660 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675454+0000", 2024-05-08T18:30:44.660 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1656000000000003e-05 2024-05-08T18:30:44.660 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.660 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.660 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:44.660 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675470+0000", 2024-05-08T18:30:44.660 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.626e-05 2024-05-08T18:30:44.660 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.661 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.661 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:44.661 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675683+0000", 2024-05-08T18:30:44.661 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021312600000000001 2024-05-08T18:30:44.661 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.661 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.661 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:44.661 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675972+0000", 2024-05-08T18:30:44.661 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00028885100000000002 2024-05-08T18:30:44.661 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.661 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.661 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:30:44.661 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.676369+0000", 2024-05-08T18:30:44.661 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000397227 2024-05-08T18:30:44.662 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.662 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.662 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:44.662 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.677780+0000", 2024-05-08T18:30:44.662 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001411186 2024-05-08T18:30:44.662 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.662 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.662 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:44.662 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679153+0000", 2024-05-08T18:30:44.662 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0013725720000000001 2024-05-08T18:30:44.662 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.662 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.663 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:44.663 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679240+0000", 2024-05-08T18:30:44.663 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7412999999999998e-05 2024-05-08T18:30:44.663 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.663 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.663 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:44.663 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679307+0000", 2024-05-08T18:30:44.663 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6833000000000002e-05 2024-05-08T18:30:44.663 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:44.663 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:44.663 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:44.663 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.663 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.664 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:44.664 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.721317+0000", 2024-05-08T18:30:44.664 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 52.924943577999997, 2024-05-08T18:30:44.664 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032842140000000001, 2024-05-08T18:30:44.664 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:44.664 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:44.664 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:44.664 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:44.664 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:44.664 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:44.664 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 216 2024-05-08T18:30:44.664 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.664 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:44.665 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.665 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:44.665 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.721317+0000", 2024-05-08T18:30:44.665 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:44.665 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.665 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.665 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:44.665 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.721317+0000", 2024-05-08T18:30:44.665 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:44.665 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.665 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.665 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:44.665 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.721320+0000", 2024-05-08T18:30:44.666 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.303e-06 2024-05-08T18:30:44.666 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.666 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.666 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:44.666 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.721335+0000", 2024-05-08T18:30:44.666 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4543e-05 2024-05-08T18:30:44.666 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.666 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.666 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:44.666 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.721370+0000", 2024-05-08T18:30:44.666 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5336000000000002e-05 2024-05-08T18:30:44.666 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.666 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.667 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:44.667 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.721393+0000", 2024-05-08T18:30:44.667 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2710000000000001e-05 2024-05-08T18:30:44.667 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.667 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.667 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:44.667 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.721592+0000", 2024-05-08T18:30:44.667 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00019917900000000001 2024-05-08T18:30:44.667 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.667 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.667 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:44.667 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.721815+0000", 2024-05-08T18:30:44.667 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000223742 2024-05-08T18:30:44.667 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.668 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.668 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:44.668 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.722268+0000", 2024-05-08T18:30:44.668 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00045295900000000001 2024-05-08T18:30:44.668 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.668 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.668 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:44.668 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.723878+0000", 2024-05-08T18:30:44.668 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001609828 2024-05-08T18:30:44.668 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.668 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.668 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:44.668 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.724433+0000", 2024-05-08T18:30:44.668 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00055512499999999995 2024-05-08T18:30:44.669 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.669 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.669 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:44.669 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.724528+0000", 2024-05-08T18:30:44.669 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.4887000000000001e-05 2024-05-08T18:30:44.669 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.669 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.669 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:44.669 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.724601+0000", 2024-05-08T18:30:44.669 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2601999999999994e-05 2024-05-08T18:30:44.669 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:44.669 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:44.670 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:44.670 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.670 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.670 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:44.670 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.761586+0000", 2024-05-08T18:30:44.670 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 52.884674732000001, 2024-05-08T18:30:44.670 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031756979999999998, 2024-05-08T18:30:44.670 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:44.670 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:44.670 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:44.670 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:44.670 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:44.670 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:44.671 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 227 2024-05-08T18:30:44.671 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.671 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:44.671 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.671 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:44.671 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.761586+0000", 2024-05-08T18:30:44.671 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:44.671 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.671 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.671 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:44.671 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.761586+0000", 2024-05-08T18:30:44.671 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:44.671 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.671 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.671 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:44.672 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.761588+0000", 2024-05-08T18:30:44.672 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7499999999999999e-06 2024-05-08T18:30:44.672 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.672 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.672 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:44.672 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.761600+0000", 2024-05-08T18:30:44.672 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2003e-05 2024-05-08T18:30:44.672 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.672 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.672 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:44.672 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.761632+0000", 2024-05-08T18:30:44.672 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1933000000000001e-05 2024-05-08T18:30:44.672 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.673 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.673 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:44.673 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.761648+0000", 2024-05-08T18:30:44.673 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5339999999999999e-05 2024-05-08T18:30:44.673 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.673 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.673 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:44.673 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.761773+0000", 2024-05-08T18:30:44.673 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012576199999999999 2024-05-08T18:30:44.673 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.673 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.673 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:44.673 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.762037+0000", 2024-05-08T18:30:44.674 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00026385100000000001 2024-05-08T18:30:44.674 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.674 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.674 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:44.674 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.762455+0000", 2024-05-08T18:30:44.674 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00041760700000000002 2024-05-08T18:30:44.674 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.674 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.674 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:44.674 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.764035+0000", 2024-05-08T18:30:44.674 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001580318 2024-05-08T18:30:44.674 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.674 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.675 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:44.675 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.764602+0000", 2024-05-08T18:30:44.675 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00056661899999999998 2024-05-08T18:30:44.675 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.675 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.675 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:44.675 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.764685+0000", 2024-05-08T18:30:44.675 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.3562999999999999e-05 2024-05-08T18:30:44.675 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.675 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.675 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:44.675 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.764761+0000", 2024-05-08T18:30:44.675 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.5951999999999994e-05 2024-05-08T18:30:44.675 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:44.676 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:44.676 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:44.676 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.676 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.676 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:44.676 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.768858+0000", 2024-05-08T18:30:44.676 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 52.877402148999998, 2024-05-08T18:30:44.676 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031906619999999999, 2024-05-08T18:30:44.676 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:44.676 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:44.676 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:44.676 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:44.676 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:44.677 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:44.677 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 229 2024-05-08T18:30:44.677 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.677 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:44.677 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.677 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:44.677 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.768858+0000", 2024-05-08T18:30:44.677 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:44.677 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.677 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.677 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:44.677 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.768858+0000", 2024-05-08T18:30:44.677 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:44.677 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.678 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.678 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:44.678 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.768861+0000", 2024-05-08T18:30:44.678 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5469999999999999e-06 2024-05-08T18:30:44.678 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.678 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.678 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:44.678 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.768872+0000", 2024-05-08T18:30:44.678 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1712999999999999e-05 2024-05-08T18:30:44.678 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.678 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.678 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:44.678 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.768903+0000", 2024-05-08T18:30:44.679 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0636000000000003e-05 2024-05-08T18:30:44.679 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.679 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.679 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:44.679 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.768918+0000", 2024-05-08T18:30:44.679 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4977000000000001e-05 2024-05-08T18:30:44.679 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.679 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.679 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:44.679 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.769037+0000", 2024-05-08T18:30:44.679 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011918599999999999 2024-05-08T18:30:44.679 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.679 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.679 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:44.680 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.769256+0000", 2024-05-08T18:30:44.680 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021839400000000001 2024-05-08T18:30:44.680 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.680 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.680 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:30:44.680 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.769656+0000", 2024-05-08T18:30:44.680 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00040066400000000001 2024-05-08T18:30:44.680 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.680 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.680 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:44.680 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.771116+0000", 2024-05-08T18:30:44.680 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001459389 2024-05-08T18:30:44.680 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.680 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.680 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:44.681 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.771896+0000", 2024-05-08T18:30:44.681 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00077997400000000001 2024-05-08T18:30:44.681 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.681 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.681 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:44.681 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.771984+0000", 2024-05-08T18:30:44.681 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8483e-05 2024-05-08T18:30:44.681 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.681 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.681 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:44.681 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772049+0000", 2024-05-08T18:30:44.681 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.4698999999999998e-05 2024-05-08T18:30:44.681 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:44.682 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:44.682 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:44.682 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.682 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.682 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:44.682 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.776086+0000", 2024-05-08T18:30:44.682 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 52.870174157999998, 2024-05-08T18:30:44.682 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0037528710000000001, 2024-05-08T18:30:44.682 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:44.682 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:44.682 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:44.682 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:44.682 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:44.682 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:44.683 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 231 2024-05-08T18:30:44.683 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.683 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:44.683 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.683 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:44.683 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.776086+0000", 2024-05-08T18:30:44.683 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:44.683 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.683 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.683 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:44.683 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.776086+0000", 2024-05-08T18:30:44.683 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:44.683 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.683 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.684 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:44.684 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.776089+0000", 2024-05-08T18:30:44.684 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8870000000000001e-06 2024-05-08T18:30:44.684 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.684 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.684 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:44.684 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.776102+0000", 2024-05-08T18:30:44.684 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.294e-05 2024-05-08T18:30:44.684 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.684 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.684 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:44.684 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.776132+0000", 2024-05-08T18:30:44.684 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0113000000000001e-05 2024-05-08T18:30:44.685 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.685 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.685 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:44.685 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.776150+0000", 2024-05-08T18:30:44.685 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8216999999999999e-05 2024-05-08T18:30:44.685 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.685 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.685 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:44.685 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.776268+0000", 2024-05-08T18:30:44.685 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000117395 2024-05-08T18:30:44.685 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.685 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.685 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:44.685 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.776514+0000", 2024-05-08T18:30:44.686 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024602899999999999 2024-05-08T18:30:44.686 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.686 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.686 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:44.686 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.776920+0000", 2024-05-08T18:30:44.686 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000406723 2024-05-08T18:30:44.686 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.686 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.686 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:44.686 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.778360+0000", 2024-05-08T18:30:44.686 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0014393279999999999 2024-05-08T18:30:44.686 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.686 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.687 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:44.687 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.779687+0000", 2024-05-08T18:30:44.687 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001327674 2024-05-08T18:30:44.687 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.687 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.687 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:44.687 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.779777+0000", 2024-05-08T18:30:44.687 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9152000000000003e-05 2024-05-08T18:30:44.687 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.687 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.687 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:44.687 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.779839+0000", 2024-05-08T18:30:44.687 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.2413e-05 2024-05-08T18:30:44.687 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:44.688 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:44.688 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:44.688 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.688 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.688 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:257 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:44.688 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.802295+0000", 2024-05-08T18:30:44.688 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 52.843965017999999, 2024-05-08T18:30:44.688 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0030517880000000002, 2024-05-08T18:30:44.688 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:44.688 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:44.688 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:44.688 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:44.688 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:44.689 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:44.689 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 257 2024-05-08T18:30:44.689 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.689 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:44.689 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.689 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:44.689 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.802295+0000", 2024-05-08T18:30:44.689 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:44.689 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.689 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.689 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:44.689 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.802295+0000", 2024-05-08T18:30:44.689 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:44.689 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.690 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.690 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:44.690 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.802296+0000", 2024-05-08T18:30:44.690 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.6700000000000002e-07 2024-05-08T18:30:44.690 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.690 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.690 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:44.690 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.802301+0000", 2024-05-08T18:30:44.690 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.0250000000000002e-06 2024-05-08T18:30:44.690 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.690 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.690 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:44.690 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.802321+0000", 2024-05-08T18:30:44.690 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9521000000000002e-05 2024-05-08T18:30:44.691 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.691 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.691 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:44.691 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.802330+0000", 2024-05-08T18:30:44.691 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.4259999999999992e-06 2024-05-08T18:30:44.691 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.691 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.691 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:44.691 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.802386+0000", 2024-05-08T18:30:44.691 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5974999999999999e-05 2024-05-08T18:30:44.691 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.691 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.691 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:44.691 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.802463+0000", 2024-05-08T18:30:44.692 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6582999999999995e-05 2024-05-08T18:30:44.692 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.692 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.692 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:44.692 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.802613+0000", 2024-05-08T18:30:44.692 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000150715 2024-05-08T18:30:44.692 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.692 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.692 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:44.692 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.803223+0000", 2024-05-08T18:30:44.692 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00060949799999999998 2024-05-08T18:30:44.692 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.692 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.692 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:44.693 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.805250+0000", 2024-05-08T18:30:44.693 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0020268339999999999 2024-05-08T18:30:44.693 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.693 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.693 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:44.693 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.805303+0000", 2024-05-08T18:30:44.693 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3562e-05 2024-05-08T18:30:44.693 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.693 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.693 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:44.693 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.805347+0000", 2024-05-08T18:30:44.693 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3682e-05 2024-05-08T18:30:44.693 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:44.693 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:44.694 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:44.694 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.694 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.694 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:422 6.c 6:338eb7e9:::obj_delete_at_hint.0000000008:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:44.694 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.847436+0000", 2024-05-08T18:30:44.694 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 52.798823955000003, 2024-05-08T18:30:44.694 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0029413439999999998, 2024-05-08T18:30:44.694 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:44.694 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:44.694 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:44.694 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:44.694 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:44.694 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:44.695 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 422 2024-05-08T18:30:44.695 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.695 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:44.695 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.695 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:44.695 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847436+0000", 2024-05-08T18:30:44.695 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:44.695 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.695 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.695 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:44.695 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847436+0000", 2024-05-08T18:30:44.695 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:44.695 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.696 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.696 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:44.696 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847437+0000", 2024-05-08T18:30:44.696 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.009e-06 2024-05-08T18:30:44.696 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.696 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.696 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:44.696 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847442+0000", 2024-05-08T18:30:44.696 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9049999999999996e-06 2024-05-08T18:30:44.696 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.696 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.696 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:44.696 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847454+0000", 2024-05-08T18:30:44.696 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1358e-05 2024-05-08T18:30:44.696 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.697 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.697 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:44.697 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847459+0000", 2024-05-08T18:30:44.697 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7180000000000001e-06 2024-05-08T18:30:44.697 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.697 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.697 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:44.697 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847516+0000", 2024-05-08T18:30:44.697 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6558999999999998e-05 2024-05-08T18:30:44.697 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.697 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.697 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:44.697 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847582+0000", 2024-05-08T18:30:44.697 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5772000000000007e-05 2024-05-08T18:30:44.698 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.698 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.698 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:44.698 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847718+0000", 2024-05-08T18:30:44.698 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013664100000000001 2024-05-08T18:30:44.698 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.698 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.698 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:44.698 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.848257+0000", 2024-05-08T18:30:44.698 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00053853699999999996 2024-05-08T18:30:44.698 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.698 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.698 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:44.698 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.850320+0000", 2024-05-08T18:30:44.699 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0020627530000000001 2024-05-08T18:30:44.699 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.699 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.699 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:44.699 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.850351+0000", 2024-05-08T18:30:44.699 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1501000000000002e-05 2024-05-08T18:30:44.699 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.699 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.699 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:44.699 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.850378+0000", 2024-05-08T18:30:44.699 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6591e-05 2024-05-08T18:30:44.699 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:44.699 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:44.700 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:44.700 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.700 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.700 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:535 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:44.700 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.912581+0000", 2024-05-08T18:30:44.700 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 52.733678894999997, 2024-05-08T18:30:44.700 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002943775, 2024-05-08T18:30:44.700 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:44.700 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:44.700 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:44.700 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:44.700 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:44.700 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:44.700 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 535 2024-05-08T18:30:44.700 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.701 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:44.701 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.701 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:44.701 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912581+0000", 2024-05-08T18:30:44.701 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:44.701 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.701 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.701 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:44.701 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912581+0000", 2024-05-08T18:30:44.701 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:44.701 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.701 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.701 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:44.702 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912582+0000", 2024-05-08T18:30:44.702 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.093e-06 2024-05-08T18:30:44.702 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.702 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.702 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:44.702 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912588+0000", 2024-05-08T18:30:44.702 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3920000000000002e-06 2024-05-08T18:30:44.702 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.702 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.702 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:44.702 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912601+0000", 2024-05-08T18:30:44.702 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2911000000000001e-05 2024-05-08T18:30:44.702 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.703 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.703 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:44.703 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912607+0000", 2024-05-08T18:30:44.703 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3960000000000003e-06 2024-05-08T18:30:44.703 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.703 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.703 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:44.703 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912664+0000", 2024-05-08T18:30:44.703 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6410999999999999e-05 2024-05-08T18:30:44.703 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.703 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.703 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:44.703 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912721+0000", 2024-05-08T18:30:44.704 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7141000000000001e-05 2024-05-08T18:30:44.704 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.704 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.704 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:44.704 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912842+0000", 2024-05-08T18:30:44.704 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000120868 2024-05-08T18:30:44.704 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.704 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.704 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:44.704 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.913333+0000", 2024-05-08T18:30:44.704 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00049123600000000004 2024-05-08T18:30:44.704 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.704 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.704 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:44.705 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.915446+0000", 2024-05-08T18:30:44.705 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0021135020000000002 2024-05-08T18:30:44.705 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.705 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.705 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:44.705 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.915481+0000", 2024-05-08T18:30:44.705 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4304999999999998e-05 2024-05-08T18:30:44.705 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.705 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.705 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:44.705 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.915525+0000", 2024-05-08T18:30:44.705 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4520000000000001e-05 2024-05-08T18:30:44.705 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:44.705 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:44.706 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:44.706 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.706 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.706 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:541 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:44.706 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.916718+0000", 2024-05-08T18:30:44.706 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 52.72954206, 2024-05-08T18:30:44.706 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0041779829999999997, 2024-05-08T18:30:44.706 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:44.706 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:44.706 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:44.706 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:44.706 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:44.706 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:44.707 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 541 2024-05-08T18:30:44.707 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.707 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:44.707 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.707 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:44.707 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.916718+0000", 2024-05-08T18:30:44.707 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:44.707 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.707 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.707 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:44.707 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.916718+0000", 2024-05-08T18:30:44.707 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:44.707 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.707 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.707 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:44.708 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.916719+0000", 2024-05-08T18:30:44.708 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0100000000000005e-07 2024-05-08T18:30:44.708 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.708 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.708 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:44.708 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.916722+0000", 2024-05-08T18:30:44.708 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7760000000000002e-06 2024-05-08T18:30:44.708 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.708 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.708 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:44.708 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.916729+0000", 2024-05-08T18:30:44.708 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.8290000000000008e-06 2024-05-08T18:30:44.708 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.708 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.708 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:44.709 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.916734+0000", 2024-05-08T18:30:44.709 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3109999999999999e-06 2024-05-08T18:30:44.709 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.709 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.709 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:44.709 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.916776+0000", 2024-05-08T18:30:44.709 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.2086999999999999e-05 2024-05-08T18:30:44.709 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.709 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.709 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:44.709 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.916824+0000", 2024-05-08T18:30:44.709 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8412999999999999e-05 2024-05-08T18:30:44.709 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.709 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.710 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:44.710 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.916929+0000", 2024-05-08T18:30:44.710 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010480900000000001 2024-05-08T18:30:44.710 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.710 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.710 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:44.710 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.917428+0000", 2024-05-08T18:30:44.710 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00049889599999999997 2024-05-08T18:30:44.710 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.710 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.710 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:44.710 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.920833+0000", 2024-05-08T18:30:44.710 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0034047140000000001 2024-05-08T18:30:44.710 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.711 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.711 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:44.711 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.920868+0000", 2024-05-08T18:30:44.711 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5750999999999997e-05 2024-05-08T18:30:44.711 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.711 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.711 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:44.711 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.920896+0000", 2024-05-08T18:30:44.711 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7796e-05 2024-05-08T18:30:44.711 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:44.711 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:44.711 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:44.711 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.711 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.711 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:778 6.1b 6:dc490aaa:::obj_delete_at_hint.0000000067:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:44.712 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.191226+0000", 2024-05-08T18:30:44.712 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 52.455033784999998, 2024-05-08T18:30:44.712 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0029603540000000001, 2024-05-08T18:30:44.712 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:44.712 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:44.712 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:44.712 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:44.712 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:44.712 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:44.712 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 778 2024-05-08T18:30:44.712 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.712 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:44.712 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.712 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:44.713 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.191226+0000", 2024-05-08T18:30:44.713 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:44.713 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.713 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.713 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:44.713 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.191226+0000", 2024-05-08T18:30:44.713 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:44.713 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.713 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.713 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:44.713 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.191229+0000", 2024-05-08T18:30:44.713 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5299999999999999e-06 2024-05-08T18:30:44.713 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.713 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.714 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:44.714 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.191242+0000", 2024-05-08T18:30:44.714 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2816999999999999e-05 2024-05-08T18:30:44.714 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.714 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.714 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:44.714 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.191274+0000", 2024-05-08T18:30:44.714 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1846e-05 2024-05-08T18:30:44.714 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.714 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.714 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:44.714 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.191288+0000", 2024-05-08T18:30:44.714 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.468e-05 2024-05-08T18:30:44.714 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.715 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.715 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:44.715 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.191468+0000", 2024-05-08T18:30:44.715 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00017983499999999999 2024-05-08T18:30:44.715 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.715 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.715 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:44.715 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.191688+0000", 2024-05-08T18:30:44.715 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021985799999999999 2024-05-08T18:30:44.715 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.715 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.715 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:30:44.715 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.192001+0000", 2024-05-08T18:30:44.716 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00031337800000000001 2024-05-08T18:30:44.716 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.716 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.716 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:44.716 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.193245+0000", 2024-05-08T18:30:44.716 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012436400000000001 2024-05-08T18:30:44.716 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.716 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.716 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:44.716 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.194036+0000", 2024-05-08T18:30:44.716 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00079059699999999998 2024-05-08T18:30:44.716 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.716 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.716 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:44.717 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.194121+0000", 2024-05-08T18:30:44.717 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5270000000000002e-05 2024-05-08T18:30:44.717 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.717 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.717 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:44.717 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.194187+0000", 2024-05-08T18:30:44.717 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5902999999999996e-05 2024-05-08T18:30:44.717 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:44.717 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:44.717 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:44.717 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.717 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.717 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:780 6.1b 6:dc490aaa:::obj_delete_at_hint.0000000067:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:44.717 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.195206+0000", 2024-05-08T18:30:44.718 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 52.451053815999998, 2024-05-08T18:30:44.718 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00291544, 2024-05-08T18:30:44.718 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:44.718 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:44.718 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:44.718 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:44.718 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:44.718 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:44.718 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 780 2024-05-08T18:30:44.718 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.718 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:44.718 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.718 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:44.718 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.195206+0000", 2024-05-08T18:30:44.719 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:44.719 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.719 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.719 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:44.719 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.195206+0000", 2024-05-08T18:30:44.719 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:44.719 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.719 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.719 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:44.719 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.195208+0000", 2024-05-08T18:30:44.719 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0669999999999999e-06 2024-05-08T18:30:44.719 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.719 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.719 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:44.720 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.195220+0000", 2024-05-08T18:30:44.720 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.131e-05 2024-05-08T18:30:44.720 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.720 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.720 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:44.720 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.195250+0000", 2024-05-08T18:30:44.720 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0562999999999999e-05 2024-05-08T18:30:44.720 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.720 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.720 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:44.720 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.195270+0000", 2024-05-08T18:30:44.720 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9989000000000001e-05 2024-05-08T18:30:44.720 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.720 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.720 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:44.721 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.195395+0000", 2024-05-08T18:30:44.721 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012439600000000001 2024-05-08T18:30:44.721 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.721 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.721 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:44.721 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.195523+0000", 2024-05-08T18:30:44.721 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012824900000000001 2024-05-08T18:30:44.721 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.721 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.721 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:30:44.721 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.195808+0000", 2024-05-08T18:30:44.721 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00028518100000000002 2024-05-08T18:30:44.721 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.721 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.722 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:44.722 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.196897+0000", 2024-05-08T18:30:44.722 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0010887850000000001 2024-05-08T18:30:44.722 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.722 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.722 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:44.722 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.197964+0000", 2024-05-08T18:30:44.722 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0010671789999999999 2024-05-08T18:30:44.722 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.722 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.722 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:44.722 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.198044+0000", 2024-05-08T18:30:44.722 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.9616000000000005e-05 2024-05-08T18:30:44.722 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.723 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.723 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:44.723 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.198122+0000", 2024-05-08T18:30:44.723 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.8104999999999998e-05 2024-05-08T18:30:44.723 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:44.723 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:44.723 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:44.723 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.723 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.723 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:826 6.6 6:64735f45:::obj_delete_at_hint.0000000083:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:44.723 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.299128+0000", 2024-05-08T18:30:44.723 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 52.347132737999999, 2024-05-08T18:30:44.723 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0029196479999999999, 2024-05-08T18:30:44.723 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:44.723 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:44.724 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:44.724 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:44.724 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:44.724 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:44.724 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 826 2024-05-08T18:30:44.724 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.724 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:44.724 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.724 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:44.724 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.299128+0000", 2024-05-08T18:30:44.724 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:44.724 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.724 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.724 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:44.725 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.299128+0000", 2024-05-08T18:30:44.725 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:44.725 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.725 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.725 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:44.725 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.299129+0000", 2024-05-08T18:30:44.725 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.711e-06 2024-05-08T18:30:44.725 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.725 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.725 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:44.725 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.299137+0000", 2024-05-08T18:30:44.725 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6650000000000003e-06 2024-05-08T18:30:44.725 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.725 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.725 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:44.726 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.299157+0000", 2024-05-08T18:30:44.726 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.02e-05 2024-05-08T18:30:44.726 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.726 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.726 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:44.726 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.299166+0000", 2024-05-08T18:30:44.726 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7530000000000007e-06 2024-05-08T18:30:44.726 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.726 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.726 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:44.726 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.299240+0000", 2024-05-08T18:30:44.726 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.4297999999999999e-05 2024-05-08T18:30:44.726 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.726 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.727 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:44.727 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.299444+0000", 2024-05-08T18:30:44.727 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00020382399999999999 2024-05-08T18:30:44.727 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.727 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.727 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:44.727 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.299777+0000", 2024-05-08T18:30:44.727 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00033331700000000002 2024-05-08T18:30:44.727 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.727 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.727 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:44.727 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.301060+0000", 2024-05-08T18:30:44.727 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012829569999999999 2024-05-08T18:30:44.727 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.728 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.728 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:44.728 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.301865+0000", 2024-05-08T18:30:44.728 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00080503400000000004 2024-05-08T18:30:44.728 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.728 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.728 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:44.728 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.301979+0000", 2024-05-08T18:30:44.728 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011324600000000001 2024-05-08T18:30:44.728 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.728 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.728 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:44.728 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.302047+0000", 2024-05-08T18:30:44.728 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8643e-05 2024-05-08T18:30:44.728 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:44.729 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:44.729 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:44.729 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.729 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.729 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:838 6.c 6:330b1641:::obj_delete_at_hint.0000000087:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:44.729 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.328043+0000", 2024-05-08T18:30:44.729 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 52.318217593999996, 2024-05-08T18:30:44.729 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031589180000000001, 2024-05-08T18:30:44.729 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:44.729 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:44.729 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:44.729 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:44.729 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:44.730 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:44.730 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 838 2024-05-08T18:30:44.730 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.730 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:44.730 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.730 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:44.730 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.328043+0000", 2024-05-08T18:30:44.730 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:44.730 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.730 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.730 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:44.730 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.328043+0000", 2024-05-08T18:30:44.730 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:44.731 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.731 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.731 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:44.731 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.328045+0000", 2024-05-08T18:30:44.731 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3760000000000002e-06 2024-05-08T18:30:44.731 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.731 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.731 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:44.731 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.328057+0000", 2024-05-08T18:30:44.731 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1534e-05 2024-05-08T18:30:44.731 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.731 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.731 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:44.732 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.328087+0000", 2024-05-08T18:30:44.732 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0870000000000001e-05 2024-05-08T18:30:44.732 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.732 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.732 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:44.732 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.328102+0000", 2024-05-08T18:30:44.732 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4679e-05 2024-05-08T18:30:44.732 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.732 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.732 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:44.732 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.328217+0000", 2024-05-08T18:30:44.732 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011519300000000001 2024-05-08T18:30:44.732 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.732 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.733 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:44.733 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.328446+0000", 2024-05-08T18:30:44.733 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00022893499999999999 2024-05-08T18:30:44.733 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.733 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.733 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:44.733 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.328770+0000", 2024-05-08T18:30:44.733 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00032349700000000001 2024-05-08T18:30:44.733 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.733 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.733 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:44.733 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.330008+0000", 2024-05-08T18:30:44.733 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001238404 2024-05-08T18:30:44.733 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.734 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.734 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:44.734 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.331026+0000", 2024-05-08T18:30:44.734 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001017612 2024-05-08T18:30:44.734 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.734 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.734 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:44.734 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.331117+0000", 2024-05-08T18:30:44.734 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0932000000000003e-05 2024-05-08T18:30:44.734 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.734 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.734 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:44.734 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.331202+0000", 2024-05-08T18:30:44.734 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.4886e-05 2024-05-08T18:30:44.735 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:44.735 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:44.735 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:44.735 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.735 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.735 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:850 6.6 6:624175ac:::obj_delete_at_hint.0000000091:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:44.735 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.356951+0000", 2024-05-08T18:30:44.735 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 52.289309506999999, 2024-05-08T18:30:44.735 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028779000000000001, 2024-05-08T18:30:44.735 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:44.735 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:44.735 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:44.736 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:44.736 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:44.736 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:44.736 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 850 2024-05-08T18:30:44.736 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.736 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:44.736 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.736 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:44.736 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.356951+0000", 2024-05-08T18:30:44.736 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:44.736 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.736 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.737 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:44.737 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.356951+0000", 2024-05-08T18:30:44.737 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:44.737 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.737 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.737 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:44.737 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.356953+0000", 2024-05-08T18:30:44.737 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.446e-06 2024-05-08T18:30:44.737 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.737 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.737 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:44.737 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.356965+0000", 2024-05-08T18:30:44.737 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1404e-05 2024-05-08T18:30:44.738 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.738 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.738 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:44.738 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.356994+0000", 2024-05-08T18:30:44.738 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9526000000000002e-05 2024-05-08T18:30:44.738 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.738 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.738 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:44.738 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.357009+0000", 2024-05-08T18:30:44.738 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5126000000000001e-05 2024-05-08T18:30:44.738 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.738 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.738 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:44.738 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.357126+0000", 2024-05-08T18:30:44.739 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000116989 2024-05-08T18:30:44.739 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.739 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.739 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:44.739 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.357349+0000", 2024-05-08T18:30:44.739 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00022298899999999999 2024-05-08T18:30:44.739 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.739 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.739 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:44.739 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.357665+0000", 2024-05-08T18:30:44.739 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00031592700000000003 2024-05-08T18:30:44.739 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.739 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.739 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:44.739 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.358771+0000", 2024-05-08T18:30:44.740 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001105595 2024-05-08T18:30:44.740 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.740 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.740 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:44.740 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.359672+0000", 2024-05-08T18:30:44.740 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00090080300000000004 2024-05-08T18:30:44.740 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.740 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.740 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:44.740 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.359762+0000", 2024-05-08T18:30:44.740 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0099000000000006e-05 2024-05-08T18:30:44.740 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.740 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.741 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:44.741 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.359829+0000", 2024-05-08T18:30:44.741 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6995999999999993e-05 2024-05-08T18:30:44.741 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:44.741 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:44.741 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:44.741 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.741 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.741 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:852 6.6 6:624175ac:::obj_delete_at_hint.0000000091:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:44.741 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.360655+0000", 2024-05-08T18:30:44.741 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 52.28560564, 2024-05-08T18:30:44.741 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028684650000000002, 2024-05-08T18:30:44.741 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:44.741 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:44.742 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:44.742 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:44.742 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:44.742 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:44.742 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 852 2024-05-08T18:30:44.742 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.742 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:44.742 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.742 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:44.742 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.360655+0000", 2024-05-08T18:30:44.742 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:44.742 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.742 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.743 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:44.743 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.360655+0000", 2024-05-08T18:30:44.743 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:44.743 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.743 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.743 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:44.743 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.360656+0000", 2024-05-08T18:30:44.743 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.457e-06 2024-05-08T18:30:44.743 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.743 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.743 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:44.743 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.360663+0000", 2024-05-08T18:30:44.743 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5429999999999999e-06 2024-05-08T18:30:44.744 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.744 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.744 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:44.744 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.360682+0000", 2024-05-08T18:30:44.744 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9020000000000001e-05 2024-05-08T18:30:44.744 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.744 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.744 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:44.744 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.360693+0000", 2024-05-08T18:30:44.744 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.114e-05 2024-05-08T18:30:44.744 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.744 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.744 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:44.744 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.360775+0000", 2024-05-08T18:30:44.744 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.2206000000000005e-05 2024-05-08T18:30:44.745 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.745 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.745 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:44.745 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.360899+0000", 2024-05-08T18:30:44.745 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000124206 2024-05-08T18:30:44.745 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.745 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.745 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:44.745 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.361162+0000", 2024-05-08T18:30:44.745 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00026328400000000002 2024-05-08T18:30:44.745 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.745 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.745 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:44.746 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.362180+0000", 2024-05-08T18:30:44.746 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0010175119999999999 2024-05-08T18:30:44.746 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.746 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.746 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:44.746 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.363368+0000", 2024-05-08T18:30:44.746 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001187991 2024-05-08T18:30:44.746 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.746 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.746 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:44.746 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.363456+0000", 2024-05-08T18:30:44.746 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8016999999999994e-05 2024-05-08T18:30:44.746 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.747 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.747 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:44.747 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.363523+0000", 2024-05-08T18:30:44.747 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7088999999999994e-05 2024-05-08T18:30:44.747 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:44.747 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:44.747 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:44.747 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.747 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.747 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:865 6.c 6:31288c1b:::obj_delete_at_hint.0000000096:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:44.747 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.392164+0000", 2024-05-08T18:30:44.747 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 52.254096539000003, 2024-05-08T18:30:44.747 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0029815470000000002, 2024-05-08T18:30:44.748 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:44.748 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:44.748 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:44.748 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:44.748 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:44.748 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:44.748 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 865 2024-05-08T18:30:44.748 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.748 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:44.748 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.748 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:44.748 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.392164+0000", 2024-05-08T18:30:44.748 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:44.748 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.749 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.749 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:44.749 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.392164+0000", 2024-05-08T18:30:44.749 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:44.749 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.749 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.749 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:44.749 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.392166+0000", 2024-05-08T18:30:44.749 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4059999999999999e-06 2024-05-08T18:30:44.749 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.749 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.749 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:44.749 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.392177+0000", 2024-05-08T18:30:44.749 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1260000000000001e-05 2024-05-08T18:30:44.749 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.750 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.750 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:44.750 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.392208+0000", 2024-05-08T18:30:44.750 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0484000000000002e-05 2024-05-08T18:30:44.750 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.750 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.750 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:44.750 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.392222+0000", 2024-05-08T18:30:44.750 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4343e-05 2024-05-08T18:30:44.750 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.750 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.750 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:44.750 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.392355+0000", 2024-05-08T18:30:44.751 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000132602 2024-05-08T18:30:44.751 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.751 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.751 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:44.751 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.392565+0000", 2024-05-08T18:30:44.751 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000210442 2024-05-08T18:30:44.751 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.751 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.751 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:44.751 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.392874+0000", 2024-05-08T18:30:44.751 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00030868099999999999 2024-05-08T18:30:44.751 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.751 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.751 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:44.752 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.394087+0000", 2024-05-08T18:30:44.752 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012133300000000001 2024-05-08T18:30:44.752 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.752 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.752 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:44.752 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.394976+0000", 2024-05-08T18:30:44.752 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000888977 2024-05-08T18:30:44.752 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.752 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.752 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:44.752 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.395068+0000", 2024-05-08T18:30:44.752 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.2188999999999994e-05 2024-05-08T18:30:44.752 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.752 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.752 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:44.753 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.395145+0000", 2024-05-08T18:30:44.753 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6833000000000001e-05 2024-05-08T18:30:44.753 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:44.753 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:44.753 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:44.753 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.753 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.753 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:871 6.11 6:8d7f253a:::obj_delete_at_hint.0000000098:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:44.753 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.405724+0000", 2024-05-08T18:30:44.753 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 52.240535983000001, 2024-05-08T18:30:44.753 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0030012530000000002, 2024-05-08T18:30:44.753 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:44.753 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:44.753 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:44.754 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:44.754 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:44.754 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:44.754 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 871 2024-05-08T18:30:44.754 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.754 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:44.754 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.754 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:44.754 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.405724+0000", 2024-05-08T18:30:44.754 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:44.754 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.754 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.754 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:44.754 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.405724+0000", 2024-05-08T18:30:44.755 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:44.755 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.755 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.755 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:44.755 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.405726+0000", 2024-05-08T18:30:44.755 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1299999999999999e-06 2024-05-08T18:30:44.755 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.755 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.755 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:44.755 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.405737+0000", 2024-05-08T18:30:44.755 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0763e-05 2024-05-08T18:30:44.755 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.755 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.755 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:44.755 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.405762+0000", 2024-05-08T18:30:44.756 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5323000000000001e-05 2024-05-08T18:30:44.756 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.756 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.756 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:44.756 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.405776+0000", 2024-05-08T18:30:44.756 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3862999999999999e-05 2024-05-08T18:30:44.756 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.756 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.756 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:44.756 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.405928+0000", 2024-05-08T18:30:44.756 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015190000000000001 2024-05-08T18:30:44.756 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.756 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.757 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:44.757 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.406159+0000", 2024-05-08T18:30:44.757 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023114399999999999 2024-05-08T18:30:44.757 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.757 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.757 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:44.757 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.406453+0000", 2024-05-08T18:30:44.757 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00029329699999999998 2024-05-08T18:30:44.757 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.757 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.757 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:44.757 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.408103+0000", 2024-05-08T18:30:44.757 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0016499869999999999 2024-05-08T18:30:44.757 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.758 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.758 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:44.758 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.408520+0000", 2024-05-08T18:30:44.758 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00041694099999999999 2024-05-08T18:30:44.758 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.758 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.758 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:44.758 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.408606+0000", 2024-05-08T18:30:44.758 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6809000000000002e-05 2024-05-08T18:30:44.758 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.758 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.758 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:44.758 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.408726+0000", 2024-05-08T18:30:44.759 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000119096 2024-05-08T18:30:44.759 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:44.759 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:44.759 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:44.759 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.759 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.759 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:934 6.11 6:8cd774bc:::obj_delete_at_hint.0000000119:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:44.759 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.550387+0000", 2024-05-08T18:30:44.759 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 52.09587303, 2024-05-08T18:30:44.759 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0033028739999999999, 2024-05-08T18:30:44.759 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:44.759 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:44.759 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:44.759 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:44.760 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:44.760 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:44.760 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 934 2024-05-08T18:30:44.760 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.760 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:44.760 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.760 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:44.760 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.550387+0000", 2024-05-08T18:30:44.760 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:44.760 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.760 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.760 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:44.760 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.550387+0000", 2024-05-08T18:30:44.760 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:44.761 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.761 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.761 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:44.761 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.550390+0000", 2024-05-08T18:30:44.761 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.706e-06 2024-05-08T18:30:44.761 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.761 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.761 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:44.761 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.550401+0000", 2024-05-08T18:30:44.761 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1437000000000001e-05 2024-05-08T18:30:44.761 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.761 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.761 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:44.761 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.550433+0000", 2024-05-08T18:30:44.762 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2005999999999998e-05 2024-05-08T18:30:44.762 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.762 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.762 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:44.762 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.550448+0000", 2024-05-08T18:30:44.762 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5007e-05 2024-05-08T18:30:44.762 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.762 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.762 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:44.762 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.550607+0000", 2024-05-08T18:30:44.762 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000158288 2024-05-08T18:30:44.762 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.762 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.762 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:44.763 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.550974+0000", 2024-05-08T18:30:44.763 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00036768400000000001 2024-05-08T18:30:44.763 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.763 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.763 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:44.763 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.551516+0000", 2024-05-08T18:30:44.763 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00054126900000000004 2024-05-08T18:30:44.763 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.763 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.763 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:44.763 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.552847+0000", 2024-05-08T18:30:44.763 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0013308899999999999 2024-05-08T18:30:44.763 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.763 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.763 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:44.764 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.553531+0000", 2024-05-08T18:30:44.764 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00068438799999999997 2024-05-08T18:30:44.764 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.764 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.764 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:44.764 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.553621+0000", 2024-05-08T18:30:44.764 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9779999999999998e-05 2024-05-08T18:30:44.764 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:44.764 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:44.764 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:44.764 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.553690+0000", 2024-05-08T18:30:44.764 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9418999999999994e-05 2024-05-08T18:30:44.764 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:44.764 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:44.765 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:44.765 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:44.765 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:44.765 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:30:44.766 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-08T18:30:44.767 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:30:44.768+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:30:44.868 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:30:44.863+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:30:44.899 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:30:44.899 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:30:44.899 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 0 2024-05-08T18:30:44.899 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:30:44.913 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-08T18:30:44.968 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:30:44.968+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:30:45.069 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:30:45.067+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:30:45.074 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:30:45.074 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:30:45.074 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2024-05-08T18:30:45.074 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2024-05-08T18:30:45.074 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:30:45.088 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-08T18:30:45.171 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:30:45.172+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:30:45.259 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:30:45.259 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2024-05-08T18:30:45.259 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2024-05-08T18:30:45.259 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-05-08T18:30:45.259 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.259 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:45.259 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.699928+0000", 2024-05-08T18:30:45.259 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 53.558726176999997, 2024-05-08T18:30:45.259 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0036032490000000002, 2024-05-08T18:30:45.260 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:45.260 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:45.260 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:45.260 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:45.260 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:45.260 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:45.260 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 211 2024-05-08T18:30:45.260 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.260 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:45.260 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.260 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:45.260 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.699928+0000", 2024-05-08T18:30:45.260 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:45.260 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.261 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.261 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:45.261 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.699928+0000", 2024-05-08T18:30:45.261 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:45.261 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.261 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.261 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:45.261 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.699931+0000", 2024-05-08T18:30:45.261 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4139999999999998e-06 2024-05-08T18:30:45.261 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.261 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.261 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:45.261 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.699946+0000", 2024-05-08T18:30:45.262 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4528999999999999e-05 2024-05-08T18:30:45.262 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.262 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.262 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:45.262 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.699984+0000", 2024-05-08T18:30:45.262 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8444e-05 2024-05-08T18:30:45.262 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.262 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.262 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:45.262 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.700004+0000", 2024-05-08T18:30:45.262 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0169999999999998e-05 2024-05-08T18:30:45.262 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.262 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.262 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:45.263 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.700162+0000", 2024-05-08T18:30:45.263 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015799799999999999 2024-05-08T18:30:45.263 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.263 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.263 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:45.263 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.700414+0000", 2024-05-08T18:30:45.263 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00025214500000000001 2024-05-08T18:30:45.263 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.263 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.263 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:45.263 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.700839+0000", 2024-05-08T18:30:45.263 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00042484 2024-05-08T18:30:45.263 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.263 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.264 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:45.264 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.702506+0000", 2024-05-08T18:30:45.264 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001666357 2024-05-08T18:30:45.264 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.264 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.264 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:45.264 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.703357+0000", 2024-05-08T18:30:45.264 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00085149399999999995 2024-05-08T18:30:45.264 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.264 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.264 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:45.264 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.703454+0000", 2024-05-08T18:30:45.264 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6688999999999995e-05 2024-05-08T18:30:45.264 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.265 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.265 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:45.265 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.703531+0000", 2024-05-08T18:30:45.265 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.7169000000000006e-05 2024-05-08T18:30:45.265 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:45.265 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:45.265 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:45.265 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.265 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.265 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:45.265 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.776807+0000", 2024-05-08T18:30:45.265 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 53.481847313999999, 2024-05-08T18:30:45.265 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0033805409999999999, 2024-05-08T18:30:45.265 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:45.266 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:45.266 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:45.266 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:45.266 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:45.266 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:45.266 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 232 2024-05-08T18:30:45.266 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.266 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:45.266 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.266 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:45.266 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.776807+0000", 2024-05-08T18:30:45.266 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:45.266 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.266 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.267 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:45.267 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.776807+0000", 2024-05-08T18:30:45.267 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:45.267 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.267 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.267 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:45.267 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.776810+0000", 2024-05-08T18:30:45.267 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6540000000000001e-06 2024-05-08T18:30:45.267 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.267 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.267 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:45.267 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.776824+0000", 2024-05-08T18:30:45.267 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3383e-05 2024-05-08T18:30:45.267 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.268 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.268 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:45.268 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.776856+0000", 2024-05-08T18:30:45.268 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2775999999999999e-05 2024-05-08T18:30:45.268 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.268 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.268 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:45.268 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.776873+0000", 2024-05-08T18:30:45.268 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6483000000000001e-05 2024-05-08T18:30:45.268 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.268 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.268 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:45.268 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.776999+0000", 2024-05-08T18:30:45.268 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000125876 2024-05-08T18:30:45.268 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.269 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.269 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:45.269 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.777228+0000", 2024-05-08T18:30:45.269 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000229531 2024-05-08T18:30:45.269 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.269 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.269 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:45.269 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.777648+0000", 2024-05-08T18:30:45.269 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000420037 2024-05-08T18:30:45.269 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.269 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.269 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:45.269 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.779272+0000", 2024-05-08T18:30:45.270 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0016235780000000001 2024-05-08T18:30:45.270 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.270 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.270 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:45.270 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.780027+0000", 2024-05-08T18:30:45.270 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00075524100000000003 2024-05-08T18:30:45.270 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.270 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.270 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:45.270 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.780116+0000", 2024-05-08T18:30:45.270 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8776000000000005e-05 2024-05-08T18:30:45.270 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.270 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.270 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:45.270 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.780187+0000", 2024-05-08T18:30:45.271 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1205999999999996e-05 2024-05-08T18:30:45.271 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:45.271 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:45.271 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:45.271 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.271 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.271 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:285 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:45.271 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.803745+0000", 2024-05-08T18:30:45.271 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 53.454909028000003, 2024-05-08T18:30:45.271 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0034481960000000002, 2024-05-08T18:30:45.271 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:45.271 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:45.271 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:45.271 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:45.272 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:45.272 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:45.272 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 285 2024-05-08T18:30:45.272 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.272 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:45.272 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.272 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:45.272 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.803745+0000", 2024-05-08T18:30:45.272 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:45.272 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.272 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.272 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:45.272 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.803745+0000", 2024-05-08T18:30:45.272 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:45.273 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.273 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.273 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:45.273 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.803748+0000", 2024-05-08T18:30:45.273 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.813e-06 2024-05-08T18:30:45.273 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.273 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.273 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:45.273 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.803762+0000", 2024-05-08T18:30:45.273 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4653e-05 2024-05-08T18:30:45.273 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.273 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.273 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:45.273 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.803791+0000", 2024-05-08T18:30:45.274 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8540000000000001e-05 2024-05-08T18:30:45.274 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.274 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.274 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:45.274 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.803817+0000", 2024-05-08T18:30:45.274 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5973e-05 2024-05-08T18:30:45.274 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.274 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.274 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:45.274 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.803975+0000", 2024-05-08T18:30:45.274 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000158336 2024-05-08T18:30:45.274 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.274 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.275 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:45.275 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.804502+0000", 2024-05-08T18:30:45.275 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00052658900000000005 2024-05-08T18:30:45.275 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.275 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.275 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:45.275 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.804966+0000", 2024-05-08T18:30:45.275 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00046399599999999999 2024-05-08T18:30:45.275 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.275 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.275 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:45.275 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.806289+0000", 2024-05-08T18:30:45.275 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0013233769999999999 2024-05-08T18:30:45.275 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.276 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.276 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:45.276 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.807001+0000", 2024-05-08T18:30:45.276 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000711314 2024-05-08T18:30:45.276 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.276 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.276 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:45.276 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.807096+0000", 2024-05-08T18:30:45.276 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.5276000000000001e-05 2024-05-08T18:30:45.276 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.276 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.276 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:45.277 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.807193+0000", 2024-05-08T18:30:45.277 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7329000000000003e-05 2024-05-08T18:30:45.277 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:45.277 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:45.277 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:45.277 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.277 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.277 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:317 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:45.277 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.808256+0000", 2024-05-08T18:30:45.277 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 53.450397615999997, 2024-05-08T18:30:45.277 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0038944359999999998, 2024-05-08T18:30:45.277 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:45.277 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:45.277 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:45.277 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:45.278 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:45.278 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:45.278 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 317 2024-05-08T18:30:45.278 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.278 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:45.278 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.278 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:45.278 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.808256+0000", 2024-05-08T18:30:45.278 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:45.278 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.278 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.278 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:45.278 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.808256+0000", 2024-05-08T18:30:45.278 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:45.279 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.279 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.279 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:45.279 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.808258+0000", 2024-05-08T18:30:45.279 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0559999999999999e-06 2024-05-08T18:30:45.279 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.279 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.279 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:45.279 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.808270+0000", 2024-05-08T18:30:45.279 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1537e-05 2024-05-08T18:30:45.279 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.279 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.279 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:45.280 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.808299+0000", 2024-05-08T18:30:45.280 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.9127000000000001e-05 2024-05-08T18:30:45.280 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.280 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.280 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:45.280 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.808324+0000", 2024-05-08T18:30:45.280 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5182e-05 2024-05-08T18:30:45.280 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.280 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.280 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:45.280 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.808471+0000", 2024-05-08T18:30:45.280 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014631900000000001 2024-05-08T18:30:45.280 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.280 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.280 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:45.281 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.808717+0000", 2024-05-08T18:30:45.281 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00024595200000000002 2024-05-08T18:30:45.281 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.281 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.281 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:45.281 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.809072+0000", 2024-05-08T18:30:45.281 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00035547699999999998 2024-05-08T18:30:45.281 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.281 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.281 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:45.281 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.810447+0000", 2024-05-08T18:30:45.281 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0013745929999999999 2024-05-08T18:30:45.281 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.281 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.282 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:45.282 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.811938+0000", 2024-05-08T18:30:45.282 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0014914290000000001 2024-05-08T18:30:45.282 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.282 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.282 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:45.282 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.812078+0000", 2024-05-08T18:30:45.282 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000140319 2024-05-08T18:30:45.282 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.282 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.282 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:45.282 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.812151+0000", 2024-05-08T18:30:45.282 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.2445000000000002e-05 2024-05-08T18:30:45.282 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:45.283 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:45.283 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:45.283 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.283 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.283 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:552 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:45.283 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.923892+0000", 2024-05-08T18:30:45.283 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 53.334762349000002, 2024-05-08T18:30:45.283 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029063259999999999, 2024-05-08T18:30:45.283 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:45.283 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:45.283 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:45.283 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:45.283 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:45.283 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:45.283 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 552 2024-05-08T18:30:45.284 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.284 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:45.284 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.284 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:45.284 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.923892+0000", 2024-05-08T18:30:45.284 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:45.284 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.284 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.284 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:45.284 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.923892+0000", 2024-05-08T18:30:45.284 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:45.284 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.284 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.284 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:45.284 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.923893+0000", 2024-05-08T18:30:45.285 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.082e-06 2024-05-08T18:30:45.285 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.285 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.285 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:45.285 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.923899+0000", 2024-05-08T18:30:45.285 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.426e-06 2024-05-08T18:30:45.285 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.285 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.285 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:45.285 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.923913+0000", 2024-05-08T18:30:45.285 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3869000000000001e-05 2024-05-08T18:30:45.285 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.285 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.285 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:45.286 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.923922+0000", 2024-05-08T18:30:45.286 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8850000000000005e-06 2024-05-08T18:30:45.286 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.286 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.286 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:45.286 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.924023+0000", 2024-05-08T18:30:45.286 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010135400000000001 2024-05-08T18:30:45.286 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.286 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.286 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:45.286 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.924230+0000", 2024-05-08T18:30:45.286 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020649500000000001 2024-05-08T18:30:45.286 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.287 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.289 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:45.290 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.924685+0000", 2024-05-08T18:30:45.290 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00045504299999999997 2024-05-08T18:30:45.290 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.290 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.290 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:45.290 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.925792+0000", 2024-05-08T18:30:45.290 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0011076790000000001 2024-05-08T18:30:45.290 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.290 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.290 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:45.290 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.926566+0000", 2024-05-08T18:30:45.291 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00077379200000000003 2024-05-08T18:30:45.291 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.291 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.291 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:45.291 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.926705+0000", 2024-05-08T18:30:45.291 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013870700000000001 2024-05-08T18:30:45.291 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.291 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.291 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:45.291 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.926798+0000", 2024-05-08T18:30:45.291 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2993999999999998e-05 2024-05-08T18:30:45.291 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:45.291 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:45.291 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:45.291 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.292 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.292 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:709 6.1e 6:7af5a05b:::obj_delete_at_hint.0000000044:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:45.292 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.033719+0000", 2024-05-08T18:30:45.292 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 53.224934589999997, 2024-05-08T18:30:45.292 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0027890480000000001, 2024-05-08T18:30:45.292 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:45.292 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:45.292 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:45.292 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:45.292 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:45.292 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:45.292 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 709 2024-05-08T18:30:45.292 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.293 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:45.293 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.293 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:45.293 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.033719+0000", 2024-05-08T18:30:45.293 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:45.293 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.293 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.293 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:45.293 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.033719+0000", 2024-05-08T18:30:45.293 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:45.293 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.293 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.293 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:45.293 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.033723+0000", 2024-05-08T18:30:45.294 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1920000000000001e-06 2024-05-08T18:30:45.294 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.294 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.294 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:45.294 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.033736+0000", 2024-05-08T18:30:45.294 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3125000000000001e-05 2024-05-08T18:30:45.294 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.294 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.294 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:45.294 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.033768+0000", 2024-05-08T18:30:45.294 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2422999999999998e-05 2024-05-08T18:30:45.294 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.294 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.294 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:45.295 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.033789+0000", 2024-05-08T18:30:45.295 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1084999999999999e-05 2024-05-08T18:30:45.295 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.295 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.295 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:45.295 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.033912+0000", 2024-05-08T18:30:45.295 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000123261 2024-05-08T18:30:45.295 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.295 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.295 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:45.295 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.034132+0000", 2024-05-08T18:30:45.295 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00021992100000000001 2024-05-08T18:30:45.295 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.295 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.296 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:45.296 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.034452+0000", 2024-05-08T18:30:45.296 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00031989399999999998 2024-05-08T18:30:45.296 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.296 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.296 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:45.296 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.035605+0000", 2024-05-08T18:30:45.296 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0011523410000000001 2024-05-08T18:30:45.296 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.296 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.296 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:45.296 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.036356+0000", 2024-05-08T18:30:45.296 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00075177800000000004 2024-05-08T18:30:45.296 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.297 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.297 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:45.297 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.036443+0000", 2024-05-08T18:30:45.297 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.6348999999999996e-05 2024-05-08T18:30:45.297 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.297 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.297 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:45.297 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.036508+0000", 2024-05-08T18:30:45.297 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5679000000000006e-05 2024-05-08T18:30:45.297 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:45.297 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:45.297 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:45.297 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.297 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.298 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:45.298 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.070187+0000", 2024-05-08T18:30:45.298 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 53.188466962, 2024-05-08T18:30:45.298 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0030597110000000001, 2024-05-08T18:30:45.298 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:45.298 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:45.298 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:45.298 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:45.298 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:45.298 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:45.298 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 727 2024-05-08T18:30:45.298 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.298 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:45.298 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.299 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:45.299 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.070187+0000", 2024-05-08T18:30:45.299 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:45.299 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.299 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.299 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:45.299 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.070187+0000", 2024-05-08T18:30:45.299 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:45.299 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.299 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.299 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:45.299 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.070189+0000", 2024-05-08T18:30:45.299 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.53e-06 2024-05-08T18:30:45.299 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.300 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.300 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:45.300 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.070197+0000", 2024-05-08T18:30:45.300 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2600000000000005e-06 2024-05-08T18:30:45.300 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.300 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.300 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:45.300 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.070220+0000", 2024-05-08T18:30:45.300 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3357e-05 2024-05-08T18:30:45.300 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.300 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.300 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:45.300 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.070232+0000", 2024-05-08T18:30:45.300 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.217e-05 2024-05-08T18:30:45.301 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.301 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.301 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:45.301 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.070334+0000", 2024-05-08T18:30:45.301 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000101486 2024-05-08T18:30:45.301 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.301 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.301 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:45.301 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.070585+0000", 2024-05-08T18:30:45.301 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00025155799999999998 2024-05-08T18:30:45.301 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.301 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.301 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-05-08T18:30:45.301 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.070921+0000", 2024-05-08T18:30:45.302 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00033587999999999999 2024-05-08T18:30:45.302 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.302 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.302 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:45.302 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.071956+0000", 2024-05-08T18:30:45.302 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010343629999999999 2024-05-08T18:30:45.302 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.302 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.302 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:45.302 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.073088+0000", 2024-05-08T18:30:45.302 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001132641 2024-05-08T18:30:45.302 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.302 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.302 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:45.303 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.073178+0000", 2024-05-08T18:30:45.303 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.9579000000000004e-05 2024-05-08T18:30:45.303 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.303 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.303 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:45.303 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.073247+0000", 2024-05-08T18:30:45.303 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8887000000000006e-05 2024-05-08T18:30:45.303 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:45.303 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:45.303 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:45.303 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.303 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.303 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:775 6.1e 6:7db93595:::obj_delete_at_hint.0000000066:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:45.303 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.180158+0000", 2024-05-08T18:30:45.304 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 53.078495683, 2024-05-08T18:30:45.304 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0030746160000000001, 2024-05-08T18:30:45.304 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:45.304 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:45.304 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:45.304 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:45.304 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:45.304 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:45.304 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 775 2024-05-08T18:30:45.304 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.304 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:45.304 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.304 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:45.304 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.180158+0000", 2024-05-08T18:30:45.305 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:45.305 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.305 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.305 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:45.305 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.180158+0000", 2024-05-08T18:30:45.305 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:45.305 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.305 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.305 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:45.305 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.180161+0000", 2024-05-08T18:30:45.305 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8399999999999999e-06 2024-05-08T18:30:45.305 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.305 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.305 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:45.305 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.180172+0000", 2024-05-08T18:30:45.306 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0876000000000001e-05 2024-05-08T18:30:45.306 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.306 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.306 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:45.306 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.180203+0000", 2024-05-08T18:30:45.306 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0639999999999998e-05 2024-05-08T18:30:45.306 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.306 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.306 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:45.306 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.180221+0000", 2024-05-08T18:30:45.306 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8326e-05 2024-05-08T18:30:45.307 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.307 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.307 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:45.307 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.180398+0000", 2024-05-08T18:30:45.307 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000176563 2024-05-08T18:30:45.307 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.307 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.307 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:45.307 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.180616+0000", 2024-05-08T18:30:45.308 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000218731 2024-05-08T18:30:45.308 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.308 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.308 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:45.308 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.180934+0000", 2024-05-08T18:30:45.308 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00031749799999999999 2024-05-08T18:30:45.308 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.308 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.308 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:45.308 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.182159+0000", 2024-05-08T18:30:45.308 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0012251810000000001 2024-05-08T18:30:45.308 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.308 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.308 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:45.309 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.182951+0000", 2024-05-08T18:30:45.309 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00079208000000000002 2024-05-08T18:30:45.309 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.309 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.309 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:45.309 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.183109+0000", 2024-05-08T18:30:45.309 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015750900000000001 2024-05-08T18:30:45.309 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.309 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.309 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:45.309 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.183233+0000", 2024-05-08T18:30:45.309 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012437200000000001 2024-05-08T18:30:45.309 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:45.309 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:45.310 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:45.310 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.310 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.310 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:777 6.1e 6:7db93595:::obj_delete_at_hint.0000000066:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:45.310 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.184358+0000", 2024-05-08T18:30:45.310 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 53.074295839000001, 2024-05-08T18:30:45.310 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0031944019999999998, 2024-05-08T18:30:45.310 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:45.310 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:45.310 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:45.310 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:45.310 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:45.310 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:45.311 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 777 2024-05-08T18:30:45.311 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.311 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:45.311 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.311 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:45.311 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.184358+0000", 2024-05-08T18:30:45.311 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:45.311 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.311 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.311 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:45.311 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.184358+0000", 2024-05-08T18:30:45.311 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:45.311 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.311 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.311 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:45.312 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.184360+0000", 2024-05-08T18:30:45.312 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5069999999999999e-06 2024-05-08T18:30:45.312 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.312 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.312 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:45.312 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.184367+0000", 2024-05-08T18:30:45.312 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6629999999999993e-06 2024-05-08T18:30:45.312 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.312 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.312 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:45.312 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.184388+0000", 2024-05-08T18:30:45.312 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0755999999999999e-05 2024-05-08T18:30:45.312 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.312 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.312 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:45.313 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.184399+0000", 2024-05-08T18:30:45.313 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0896999999999999e-05 2024-05-08T18:30:45.313 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.313 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.313 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:45.313 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.184512+0000", 2024-05-08T18:30:45.313 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000113346 2024-05-08T18:30:45.313 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.313 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.313 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:45.313 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.184733+0000", 2024-05-08T18:30:45.313 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022113800000000001 2024-05-08T18:30:45.313 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.313 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.314 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:45.314 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.185202+0000", 2024-05-08T18:30:45.314 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00046851999999999999 2024-05-08T18:30:45.314 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.314 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.314 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:45.314 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.186306+0000", 2024-05-08T18:30:45.314 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001104184 2024-05-08T18:30:45.314 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.314 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.314 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:45.314 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.187288+0000", 2024-05-08T18:30:45.314 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00098171 2024-05-08T18:30:45.315 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.315 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.315 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:45.315 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.187438+0000", 2024-05-08T18:30:45.315 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000150629 2024-05-08T18:30:45.315 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.315 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.315 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:45.315 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.187553+0000", 2024-05-08T18:30:45.315 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000114052 2024-05-08T18:30:45.315 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:45.315 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:45.315 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:45.315 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.316 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.316 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:808 6.1a 6:5a206276:::obj_delete_at_hint.0000000077:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:45.316 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.252316+0000", 2024-05-08T18:30:45.316 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 53.006338427000003, 2024-05-08T18:30:45.316 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0027908820000000002, 2024-05-08T18:30:45.316 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:45.316 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:45.316 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:45.316 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:45.316 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:45.316 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:45.316 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 808 2024-05-08T18:30:45.316 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.316 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:45.316 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.317 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:45.317 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.252316+0000", 2024-05-08T18:30:45.317 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:45.317 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.317 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.317 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:45.317 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.252316+0000", 2024-05-08T18:30:45.317 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:45.317 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.317 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.317 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:45.317 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.252318+0000", 2024-05-08T18:30:45.317 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5500000000000001e-06 2024-05-08T18:30:45.317 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.318 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.318 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:45.318 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.252331+0000", 2024-05-08T18:30:45.318 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.252e-05 2024-05-08T18:30:45.318 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.318 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.318 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:45.318 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.252362+0000", 2024-05-08T18:30:45.318 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1720000000000001e-05 2024-05-08T18:30:45.318 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.318 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.318 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:45.318 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.252377+0000", 2024-05-08T18:30:45.318 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4440000000000001e-05 2024-05-08T18:30:45.319 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.319 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.319 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:45.319 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.252513+0000", 2024-05-08T18:30:45.319 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013657200000000001 2024-05-08T18:30:45.319 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.319 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.319 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:45.319 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.252746+0000", 2024-05-08T18:30:45.319 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000232499 2024-05-08T18:30:45.319 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.319 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.319 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:45.320 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.253071+0000", 2024-05-08T18:30:45.320 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00032540299999999999 2024-05-08T18:30:45.320 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.320 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.320 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:45.320 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.254176+0000", 2024-05-08T18:30:45.320 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0011052519999999999 2024-05-08T18:30:45.320 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.320 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.320 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:45.320 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.254957+0000", 2024-05-08T18:30:45.320 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00078004099999999998 2024-05-08T18:30:45.320 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.320 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.321 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:45.321 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.255041+0000", 2024-05-08T18:30:45.321 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4492000000000004e-05 2024-05-08T18:30:45.321 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.321 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.321 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:45.321 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.255106+0000", 2024-05-08T18:30:45.321 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5393000000000002e-05 2024-05-08T18:30:45.321 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:45.321 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:45.321 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:45.321 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.321 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.321 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:810 6.1a 6:5a206276:::obj_delete_at_hint.0000000077:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:45.322 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.256569+0000", 2024-05-08T18:30:45.322 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 53.002085373, 2024-05-08T18:30:45.322 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0034505130000000001, 2024-05-08T18:30:45.322 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:45.322 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:45.322 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:45.322 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:45.322 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:45.322 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:45.322 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 810 2024-05-08T18:30:45.322 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.322 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:45.322 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.323 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:45.323 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.256569+0000", 2024-05-08T18:30:45.323 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:45.323 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.323 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.323 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:45.323 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.256569+0000", 2024-05-08T18:30:45.323 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:45.323 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.323 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.323 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:45.323 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.256571+0000", 2024-05-08T18:30:45.323 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2029999999999999e-06 2024-05-08T18:30:45.323 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.324 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.324 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:45.324 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.256582+0000", 2024-05-08T18:30:45.324 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.101e-05 2024-05-08T18:30:45.324 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.324 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.324 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:45.324 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.256614+0000", 2024-05-08T18:30:45.324 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2353e-05 2024-05-08T18:30:45.324 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.324 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.324 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:45.324 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.256632+0000", 2024-05-08T18:30:45.324 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8349999999999999e-05 2024-05-08T18:30:45.325 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.325 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.325 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:45.325 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.256767+0000", 2024-05-08T18:30:45.325 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000134819 2024-05-08T18:30:45.325 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.325 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.325 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:45.325 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.256990+0000", 2024-05-08T18:30:45.325 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022293899999999999 2024-05-08T18:30:45.325 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.325 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.325 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:45.325 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.257487+0000", 2024-05-08T18:30:45.325 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00049632599999999995 2024-05-08T18:30:45.326 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.326 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.326 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:45.326 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.258822+0000", 2024-05-08T18:30:45.326 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001335166 2024-05-08T18:30:45.326 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.326 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.326 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:45.326 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.259867+0000", 2024-05-08T18:30:45.326 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010454349999999999 2024-05-08T18:30:45.326 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.326 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.326 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:45.326 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.259955+0000", 2024-05-08T18:30:45.327 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.7699000000000002e-05 2024-05-08T18:30:45.327 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.327 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.327 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:45.327 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.260019+0000", 2024-05-08T18:30:45.327 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4213000000000003e-05 2024-05-08T18:30:45.327 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:45.327 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:45.327 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:45.327 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.327 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.327 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:814 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:45.327 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.266538+0000", 2024-05-08T18:30:45.327 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 52.992116447000001, 2024-05-08T18:30:45.328 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0030056010000000001, 2024-05-08T18:30:45.328 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:45.328 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:45.328 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:45.328 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:45.328 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:45.328 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:45.328 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 814 2024-05-08T18:30:45.328 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.328 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:45.328 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.328 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:45.328 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.266538+0000", 2024-05-08T18:30:45.328 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:45.329 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.329 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.329 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:45.329 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.266538+0000", 2024-05-08T18:30:45.329 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:45.329 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.329 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.329 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:45.329 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.266540+0000", 2024-05-08T18:30:45.329 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2400000000000002e-06 2024-05-08T18:30:45.329 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.329 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.329 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:45.329 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.266550+0000", 2024-05-08T18:30:45.329 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0464e-05 2024-05-08T18:30:45.330 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.330 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.330 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:45.330 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.266581+0000", 2024-05-08T18:30:45.330 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.099e-05 2024-05-08T18:30:45.330 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.330 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.330 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:45.330 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.266596+0000", 2024-05-08T18:30:45.330 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5176e-05 2024-05-08T18:30:45.330 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.330 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.330 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:45.330 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.266711+0000", 2024-05-08T18:30:45.331 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000114759 2024-05-08T18:30:45.331 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.331 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.331 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:45.331 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.266936+0000", 2024-05-08T18:30:45.331 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022446200000000001 2024-05-08T18:30:45.331 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.331 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.331 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:45.331 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.267272+0000", 2024-05-08T18:30:45.331 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00033655099999999998 2024-05-08T18:30:45.331 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.331 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.331 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:45.332 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.268417+0000", 2024-05-08T18:30:45.332 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0011447409999999999 2024-05-08T18:30:45.332 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.332 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.332 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:45.332 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.269263+0000", 2024-05-08T18:30:45.332 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00084657600000000003 2024-05-08T18:30:45.332 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.332 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.332 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:45.332 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.269418+0000", 2024-05-08T18:30:45.332 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015471300000000001 2024-05-08T18:30:45.332 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.332 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.333 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:45.333 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.269543+0000", 2024-05-08T18:30:45.333 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000124929 2024-05-08T18:30:45.333 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:45.333 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:45.333 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:45.333 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.333 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.333 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:816 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:45.333 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.270693+0000", 2024-05-08T18:30:45.333 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 52.987961339000002, 2024-05-08T18:30:45.333 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0031451119999999998, 2024-05-08T18:30:45.333 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:45.333 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:45.334 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:45.334 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:45.334 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:45.334 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:45.334 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 816 2024-05-08T18:30:45.334 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.334 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:45.334 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.334 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:45.334 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.270693+0000", 2024-05-08T18:30:45.334 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:45.334 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.334 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.334 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:45.335 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.270693+0000", 2024-05-08T18:30:45.335 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:45.335 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.335 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.335 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:45.335 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.270695+0000", 2024-05-08T18:30:45.335 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0669999999999999e-06 2024-05-08T18:30:45.335 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.335 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.335 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:45.335 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.270704+0000", 2024-05-08T18:30:45.335 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4830000000000005e-06 2024-05-08T18:30:45.335 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.336 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.336 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:45.336 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.270728+0000", 2024-05-08T18:30:45.336 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.4297000000000001e-05 2024-05-08T18:30:45.336 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.336 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.336 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:45.336 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.270740+0000", 2024-05-08T18:30:45.336 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1922999999999999e-05 2024-05-08T18:30:45.336 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.336 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.336 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:45.336 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.270855+0000", 2024-05-08T18:30:45.336 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011418599999999999 2024-05-08T18:30:45.337 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.337 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.337 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:45.337 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.271088+0000", 2024-05-08T18:30:45.337 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000233718 2024-05-08T18:30:45.337 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.337 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.337 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:45.337 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.271548+0000", 2024-05-08T18:30:45.337 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00045974299999999998 2024-05-08T18:30:45.337 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.337 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.337 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:45.337 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.272854+0000", 2024-05-08T18:30:45.337 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0013054799999999999 2024-05-08T18:30:45.338 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.338 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.338 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:45.338 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.273569+0000", 2024-05-08T18:30:45.338 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00071561400000000005 2024-05-08T18:30:45.338 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.338 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.338 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:45.338 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.273726+0000", 2024-05-08T18:30:45.338 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000156856 2024-05-08T18:30:45.338 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.338 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.338 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:45.338 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.273838+0000", 2024-05-08T18:30:45.339 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011174499999999999 2024-05-08T18:30:45.339 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:45.339 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:45.339 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:45.339 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.339 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.339 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:45.339 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.422427+0000", 2024-05-08T18:30:45.339 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 52.836227010000002, 2024-05-08T18:30:45.339 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0031426190000000001, 2024-05-08T18:30:45.339 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:45.339 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:45.339 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:45.339 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:45.340 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:45.340 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:45.340 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 880 2024-05-08T18:30:45.340 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.340 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:45.340 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.340 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:45.340 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.422427+0000", 2024-05-08T18:30:45.340 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:45.340 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.340 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.340 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:45.340 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.422427+0000", 2024-05-08T18:30:45.340 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:45.340 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.341 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.341 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:45.341 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.422431+0000", 2024-05-08T18:30:45.341 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.777e-06 2024-05-08T18:30:45.341 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.341 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.341 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:45.341 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.422445+0000", 2024-05-08T18:30:45.341 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.451e-05 2024-05-08T18:30:45.341 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.341 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.341 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:45.341 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.422479+0000", 2024-05-08T18:30:45.341 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4078999999999997e-05 2024-05-08T18:30:45.341 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.342 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.342 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:45.342 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.422495+0000", 2024-05-08T18:30:45.342 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5947000000000002e-05 2024-05-08T18:30:45.342 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.342 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.342 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:45.342 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.422609+0000", 2024-05-08T18:30:45.342 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000113879 2024-05-08T18:30:45.342 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.342 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.342 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:45.342 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.422844+0000", 2024-05-08T18:30:45.343 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000234465 2024-05-08T18:30:45.343 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.343 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.343 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:45.343 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.423201+0000", 2024-05-08T18:30:45.343 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00035789699999999998 2024-05-08T18:30:45.343 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.343 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.343 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:45.343 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.424352+0000", 2024-05-08T18:30:45.343 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0011504709999999999 2024-05-08T18:30:45.343 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.343 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.343 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:45.344 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.425288+0000", 2024-05-08T18:30:45.344 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00093638300000000005 2024-05-08T18:30:45.344 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.344 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.344 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:45.344 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.425451+0000", 2024-05-08T18:30:45.344 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000162628 2024-05-08T18:30:45.344 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.344 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.344 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:45.344 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.425570+0000", 2024-05-08T18:30:45.344 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000118583 2024-05-08T18:30:45.344 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:45.344 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:45.345 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:45.345 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.345 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.345 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:913 6.2 6:47403372:::obj_delete_at_hint.0000000112:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:45.345 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.494354+0000", 2024-05-08T18:30:45.345 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 52.764299704999999, 2024-05-08T18:30:45.345 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003088276, 2024-05-08T18:30:45.345 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:45.345 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:45.345 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:45.345 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:45.345 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:45.345 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:45.345 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 913 2024-05-08T18:30:45.346 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.346 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:45.346 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.346 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:45.346 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.494354+0000", 2024-05-08T18:30:45.346 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:45.346 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.346 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.346 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:45.346 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.494354+0000", 2024-05-08T18:30:45.346 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:45.346 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.346 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.346 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:45.347 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.494357+0000", 2024-05-08T18:30:45.347 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.553e-06 2024-05-08T18:30:45.347 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.347 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.347 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:45.347 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.494368+0000", 2024-05-08T18:30:45.347 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1426999999999999e-05 2024-05-08T18:30:45.347 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.347 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.347 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:45.347 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.494419+0000", 2024-05-08T18:30:45.347 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1053000000000001e-05 2024-05-08T18:30:45.347 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.347 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.348 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:45.348 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.494434+0000", 2024-05-08T18:30:45.348 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5216e-05 2024-05-08T18:30:45.348 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.348 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.348 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:45.348 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.494564+0000", 2024-05-08T18:30:45.348 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012956900000000001 2024-05-08T18:30:45.348 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.348 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.348 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:45.348 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.494798+0000", 2024-05-08T18:30:45.348 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000234248 2024-05-08T18:30:45.348 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.349 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.349 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:45.349 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.495123+0000", 2024-05-08T18:30:45.349 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00032466500000000002 2024-05-08T18:30:45.349 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.349 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.349 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:45.349 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.496226+0000", 2024-05-08T18:30:45.349 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001102701 2024-05-08T18:30:45.349 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.349 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.349 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:45.349 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.497153+0000", 2024-05-08T18:30:45.349 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00092721999999999998 2024-05-08T18:30:45.350 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.350 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.350 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:45.350 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.497329+0000", 2024-05-08T18:30:45.350 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000176579 2024-05-08T18:30:45.350 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.350 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.350 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:45.350 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.497443+0000", 2024-05-08T18:30:45.350 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000113045 2024-05-08T18:30:45.350 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:45.350 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:45.351 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:45.351 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.351 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.351 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:915 6.2 6:47403372:::obj_delete_at_hint.0000000112:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:45.351 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.498847+0000", 2024-05-08T18:30:45.351 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 52.759806638999997, 2024-05-08T18:30:45.351 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003160459, 2024-05-08T18:30:45.351 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:45.351 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:45.351 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:45.351 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:45.351 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:45.351 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:45.351 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 915 2024-05-08T18:30:45.352 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.352 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:45.352 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.352 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:45.352 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.498847+0000", 2024-05-08T18:30:45.352 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:45.352 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.352 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.352 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:45.352 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.498847+0000", 2024-05-08T18:30:45.352 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:45.352 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.352 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.352 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:45.352 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.498850+0000", 2024-05-08T18:30:45.353 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.4099999999999998e-06 2024-05-08T18:30:45.353 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.353 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.353 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:45.353 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.498863+0000", 2024-05-08T18:30:45.353 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3013000000000001e-05 2024-05-08T18:30:45.353 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.353 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.353 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:45.353 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.498895+0000", 2024-05-08T18:30:45.353 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2682999999999999e-05 2024-05-08T18:30:45.353 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.353 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.353 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:45.353 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.498911+0000", 2024-05-08T18:30:45.354 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.525e-05 2024-05-08T18:30:45.354 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.354 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.354 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:45.354 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.499039+0000", 2024-05-08T18:30:45.354 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012856900000000001 2024-05-08T18:30:45.354 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.354 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.354 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:45.354 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.499264+0000", 2024-05-08T18:30:45.354 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022517500000000001 2024-05-08T18:30:45.354 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.354 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.354 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:45.355 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.499740+0000", 2024-05-08T18:30:45.355 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00047553299999999999 2024-05-08T18:30:45.355 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.355 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.355 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:45.355 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.501192+0000", 2024-05-08T18:30:45.355 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001451735 2024-05-08T18:30:45.355 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.355 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.355 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:45.355 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.501751+0000", 2024-05-08T18:30:45.355 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000559239 2024-05-08T18:30:45.355 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.355 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.355 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:45.356 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.501902+0000", 2024-05-08T18:30:45.356 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015061600000000001 2024-05-08T18:30:45.356 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.356 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.356 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:45.356 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.502008+0000", 2024-05-08T18:30:45.356 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000106236 2024-05-08T18:30:45.356 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:45.356 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:45.356 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:45.356 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.356 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.356 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:925 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:45.356 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.523895+0000", 2024-05-08T18:30:45.357 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 52.734759236000002, 2024-05-08T18:30:45.357 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003635302, 2024-05-08T18:30:45.357 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:45.357 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:45.357 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:45.357 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:45.357 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:45.357 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:45.357 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 925 2024-05-08T18:30:45.357 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.357 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:45.357 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.357 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:45.357 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.523895+0000", 2024-05-08T18:30:45.358 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:45.358 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.358 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.358 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:45.358 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.523895+0000", 2024-05-08T18:30:45.358 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:45.358 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.358 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.358 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:45.358 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.523897+0000", 2024-05-08T18:30:45.358 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1969999999999999e-06 2024-05-08T18:30:45.358 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.358 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.358 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:45.359 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.523908+0000", 2024-05-08T18:30:45.359 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0706e-05 2024-05-08T18:30:45.359 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.359 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.359 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:45.359 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.523938+0000", 2024-05-08T18:30:45.359 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0395999999999998e-05 2024-05-08T18:30:45.359 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.359 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.359 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:45.359 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.523953+0000", 2024-05-08T18:30:45.359 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4673e-05 2024-05-08T18:30:45.359 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.359 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.360 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:45.360 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.524105+0000", 2024-05-08T18:30:45.360 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015204300000000001 2024-05-08T18:30:45.360 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.360 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.360 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:45.360 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.524460+0000", 2024-05-08T18:30:45.360 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00035539000000000002 2024-05-08T18:30:45.360 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.360 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.360 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:45.360 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.525003+0000", 2024-05-08T18:30:45.360 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00054241000000000001 2024-05-08T18:30:45.360 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.360 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.361 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:45.361 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.526198+0000", 2024-05-08T18:30:45.361 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0011955500000000001 2024-05-08T18:30:45.361 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.361 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.361 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:45.361 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.527258+0000", 2024-05-08T18:30:45.361 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010595489999999999 2024-05-08T18:30:45.361 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.361 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.361 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:45.361 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.527414+0000", 2024-05-08T18:30:45.361 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000156732 2024-05-08T18:30:45.361 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.362 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.362 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:45.362 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.527530+0000", 2024-05-08T18:30:45.362 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011565600000000001 2024-05-08T18:30:45.362 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:45.362 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:45.362 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:45.362 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.362 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.362 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:927 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:45.362 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.528868+0000", 2024-05-08T18:30:45.362 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 52.729785837999998, 2024-05-08T18:30:45.362 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00302987, 2024-05-08T18:30:45.363 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:45.363 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:45.363 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:45.363 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:45.363 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:45.363 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:45.363 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 927 2024-05-08T18:30:45.363 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.363 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:45.363 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.363 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:45.363 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.528868+0000", 2024-05-08T18:30:45.363 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:45.363 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.364 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.364 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:45.364 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.528868+0000", 2024-05-08T18:30:45.364 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:45.364 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.364 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.364 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:45.364 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.528870+0000", 2024-05-08T18:30:45.364 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6199999999999999e-06 2024-05-08T18:30:45.364 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.364 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.364 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:45.364 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.528877+0000", 2024-05-08T18:30:45.364 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4070000000000004e-06 2024-05-08T18:30:45.365 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.365 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.365 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:45.365 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.528899+0000", 2024-05-08T18:30:45.365 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1495999999999999e-05 2024-05-08T18:30:45.365 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.365 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.365 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:45.365 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.528910+0000", 2024-05-08T18:30:45.365 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1562999999999999e-05 2024-05-08T18:30:45.365 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.365 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.365 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:45.365 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.529027+0000", 2024-05-08T18:30:45.366 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000116873 2024-05-08T18:30:45.366 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.366 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.366 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:45.366 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.529258+0000", 2024-05-08T18:30:45.366 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000231065 2024-05-08T18:30:45.366 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.366 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.366 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:45.366 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.529732+0000", 2024-05-08T18:30:45.366 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000474043 2024-05-08T18:30:45.366 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.366 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.366 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:45.367 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.530983+0000", 2024-05-08T18:30:45.367 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0012505929999999999 2024-05-08T18:30:45.367 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.367 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.367 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:45.367 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.531621+0000", 2024-05-08T18:30:45.367 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00063814899999999996 2024-05-08T18:30:45.367 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.367 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.367 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:45.367 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.531785+0000", 2024-05-08T18:30:45.367 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016452200000000001 2024-05-08T18:30:45.367 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.367 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.367 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:45.368 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.531898+0000", 2024-05-08T18:30:45.368 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000112539 2024-05-08T18:30:45.368 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:45.368 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:45.368 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:45.368 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.368 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.368 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:45.368 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.532086+0000", 2024-05-08T18:30:45.368 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 52.726567473000003, 2024-05-08T18:30:45.368 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032260779999999998, 2024-05-08T18:30:45.368 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:45.368 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:45.369 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:45.369 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:45.369 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:45.369 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:45.369 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 928 2024-05-08T18:30:45.369 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.369 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:45.369 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.369 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:45.369 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.532086+0000", 2024-05-08T18:30:45.369 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:45.369 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.369 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.369 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:45.369 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.532086+0000", 2024-05-08T18:30:45.370 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:45.370 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.370 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.370 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:45.370 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.532088+0000", 2024-05-08T18:30:45.370 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8670000000000001e-06 2024-05-08T18:30:45.370 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.370 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.370 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:45.370 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.532097+0000", 2024-05-08T18:30:45.370 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.6929999999999996e-06 2024-05-08T18:30:45.370 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.370 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.371 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:45.371 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.532121+0000", 2024-05-08T18:30:45.371 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3572999999999999e-05 2024-05-08T18:30:45.371 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.371 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.371 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:45.371 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.532134+0000", 2024-05-08T18:30:45.371 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3823e-05 2024-05-08T18:30:45.371 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.371 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.371 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:45.371 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.532255+0000", 2024-05-08T18:30:45.371 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012074900000000001 2024-05-08T18:30:45.371 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.371 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.371 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:45.372 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.532588+0000", 2024-05-08T18:30:45.372 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000333068 2024-05-08T18:30:45.372 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.372 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.372 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:45.372 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.533135+0000", 2024-05-08T18:30:45.372 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000546259 2024-05-08T18:30:45.372 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.372 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.372 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:45.372 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.534441+0000", 2024-05-08T18:30:45.372 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0013061500000000001 2024-05-08T18:30:45.372 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.372 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.373 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:45.373 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.535049+0000", 2024-05-08T18:30:45.373 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00060823500000000005 2024-05-08T18:30:45.373 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.373 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.373 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:45.373 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.535203+0000", 2024-05-08T18:30:45.373 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015383500000000001 2024-05-08T18:30:45.373 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.373 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.373 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:45.373 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.535313+0000", 2024-05-08T18:30:45.373 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000109826 2024-05-08T18:30:45.373 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:45.374 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:45.374 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:45.374 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.374 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.374 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:930 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:45.374 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.536650+0000", 2024-05-08T18:30:45.374 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 52.722004188, 2024-05-08T18:30:45.374 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029677129999999999, 2024-05-08T18:30:45.374 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:45.374 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:45.374 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:45.374 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:45.374 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:45.375 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:45.375 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 930 2024-05-08T18:30:45.375 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.375 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:45.375 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.375 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:45.375 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.536650+0000", 2024-05-08T18:30:45.375 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:45.375 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.375 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.375 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:45.375 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.536650+0000", 2024-05-08T18:30:45.375 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:45.375 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.376 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.376 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:45.376 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.536652+0000", 2024-05-08T18:30:45.376 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1660000000000001e-06 2024-05-08T18:30:45.376 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.376 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.376 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:45.376 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.536680+0000", 2024-05-08T18:30:45.376 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8084000000000001e-05 2024-05-08T18:30:45.376 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.376 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.376 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:45.376 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.536711+0000", 2024-05-08T18:30:45.376 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1123e-05 2024-05-08T18:30:45.377 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.377 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.377 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:45.377 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.536729+0000", 2024-05-08T18:30:45.377 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8189000000000002e-05 2024-05-08T18:30:45.377 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.377 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.377 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:45.377 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.536852+0000", 2024-05-08T18:30:45.377 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000122729 2024-05-08T18:30:45.377 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.377 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.377 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:45.377 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.537074+0000", 2024-05-08T18:30:45.377 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022180600000000001 2024-05-08T18:30:45.378 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.378 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.378 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:45.378 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.537526+0000", 2024-05-08T18:30:45.378 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00045219599999999998 2024-05-08T18:30:45.378 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.378 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.378 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:45.378 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.538973+0000", 2024-05-08T18:30:45.378 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001447102 2024-05-08T18:30:45.378 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.378 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.378 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:45.379 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.539410+0000", 2024-05-08T18:30:45.379 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00043727399999999997 2024-05-08T18:30:45.379 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.379 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.379 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:45.379 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.539503+0000", 2024-05-08T18:30:45.379 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2338999999999998e-05 2024-05-08T18:30:45.379 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.379 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.379 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:45.379 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.539617+0000", 2024-05-08T18:30:45.379 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011470499999999999 2024-05-08T18:30:45.379 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:45.380 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:45.380 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:45.380 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:45.380 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:45.380 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:30:45.381 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-08T18:30:45.382 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:30:45.380+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:30:45.482 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:30:45.479+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:30:45.510 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:30:45.510 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:30:45.510 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 0 2024-05-08T18:30:45.510 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:30:45.524 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-08T18:30:45.564 INFO:teuthology.orchestra.run.smithi097.stderr:nodeep-scrub is unset 2024-05-08T18:30:45.613 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:30:45.611+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:30:45.683 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:30:45.679+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:30:45.688 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:30:45.688 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:30:45.688 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2024-05-08T18:30:45.688 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2024-05-08T18:30:45.689 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:30:45.702 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-08T18:30:45.783 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:30:45.784+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:30:45.865 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:30:45.865 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2024-05-08T18:30:45.865 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2024-05-08T18:30:45.865 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-05-08T18:30:45.865 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.865 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4479.0:37 5.f 5:f43b6ece:::zone_names.default:head [create,call version.set in=10b,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-05-08T18:30:45.866 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:44.627414+0000", 2024-05-08T18:30:45.866 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 61.235297072999998, 2024-05-08T18:30:45.866 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029966429999999998, 2024-05-08T18:30:45.866 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:45.866 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:45.866 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:45.866 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:45.866 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4479", 2024-05-08T18:30:45.866 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3577501689", 2024-05-08T18:30:45.866 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 37 2024-05-08T18:30:45.866 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.866 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:45.866 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.866 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:45.867 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.627414+0000", 2024-05-08T18:30:45.867 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:45.867 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.867 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.867 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:45.867 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.627414+0000", 2024-05-08T18:30:45.867 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:45.867 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.867 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.867 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:45.867 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.627416+0000", 2024-05-08T18:30:45.867 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9580000000000001e-06 2024-05-08T18:30:45.867 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.868 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.868 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:45.868 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.627427+0000", 2024-05-08T18:30:45.868 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1657e-05 2024-05-08T18:30:45.868 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.868 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.868 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:45.868 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.627454+0000", 2024-05-08T18:30:45.868 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6619e-05 2024-05-08T18:30:45.868 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.868 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.868 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:45.868 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.627474+0000", 2024-05-08T18:30:45.868 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9612000000000001e-05 2024-05-08T18:30:45.869 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.869 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.869 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:45.869 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.627647+0000", 2024-05-08T18:30:45.869 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017374999999999999 2024-05-08T18:30:45.869 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.869 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.869 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:45.869 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.627861+0000", 2024-05-08T18:30:45.869 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000213358 2024-05-08T18:30:45.869 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.869 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.869 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:45.869 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.628153+0000", 2024-05-08T18:30:45.870 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029198899999999999 2024-05-08T18:30:45.870 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.870 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.870 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:45.870 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.629544+0000", 2024-05-08T18:30:45.870 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0013916390000000001 2024-05-08T18:30:45.870 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.870 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.870 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:45.870 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.630221+0000", 2024-05-08T18:30:45.870 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00067613500000000002 2024-05-08T18:30:45.870 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.870 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.870 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:45.871 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.630321+0000", 2024-05-08T18:30:45.871 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000100126 2024-05-08T18:30:45.871 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.871 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.871 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:45.871 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.630411+0000", 2024-05-08T18:30:45.871 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.9800000000000001e-05 2024-05-08T18:30:45.871 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:45.871 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:45.871 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:45.871 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.871 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.871 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4479.0:41 5.f 5:f4c53578:::zonegroups_names.default:head [create,call version.set in=10b,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-05-08T18:30:45.871 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:44.637466+0000", 2024-05-08T18:30:45.872 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 61.225245114000003, 2024-05-08T18:30:45.872 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0030003949999999999, 2024-05-08T18:30:45.872 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:45.872 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:45.872 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:45.872 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:45.872 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4479", 2024-05-08T18:30:45.872 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3577501689", 2024-05-08T18:30:45.872 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 41 2024-05-08T18:30:45.872 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.872 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:45.872 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.872 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:45.872 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.637466+0000", 2024-05-08T18:30:45.873 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:45.873 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.873 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.873 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:45.873 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.637466+0000", 2024-05-08T18:30:45.873 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:45.873 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.873 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.873 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:45.873 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.637468+0000", 2024-05-08T18:30:45.873 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2800000000000002e-06 2024-05-08T18:30:45.873 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.873 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.873 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:45.874 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.637479+0000", 2024-05-08T18:30:45.874 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0674e-05 2024-05-08T18:30:45.874 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.874 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.874 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:45.874 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.637508+0000", 2024-05-08T18:30:45.874 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8921999999999999e-05 2024-05-08T18:30:45.874 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.874 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.874 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:45.874 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.637522+0000", 2024-05-08T18:30:45.874 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3923e-05 2024-05-08T18:30:45.874 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.875 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.875 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:45.875 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.637647+0000", 2024-05-08T18:30:45.875 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000124905 2024-05-08T18:30:45.875 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.875 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.875 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:45.875 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.637852+0000", 2024-05-08T18:30:45.875 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000205081 2024-05-08T18:30:45.875 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.875 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.875 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:45.875 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.638101+0000", 2024-05-08T18:30:45.875 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000248953 2024-05-08T18:30:45.876 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.876 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.876 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:45.876 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.639345+0000", 2024-05-08T18:30:45.876 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001244754 2024-05-08T18:30:45.876 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.876 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.876 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:45.876 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.640197+0000", 2024-05-08T18:30:45.876 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000851614 2024-05-08T18:30:45.876 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.876 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.876 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:45.876 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.640353+0000", 2024-05-08T18:30:45.877 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015631600000000001 2024-05-08T18:30:45.877 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.877 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.877 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:45.877 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.640466+0000", 2024-05-08T18:30:45.877 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000112973 2024-05-08T18:30:45.877 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:45.877 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:45.877 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:45.877 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.877 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.877 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:30:45.877 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.664338+0000", 2024-05-08T18:30:45.878 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 54.198373302999997, 2024-05-08T18:30:45.878 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039355429999999997, 2024-05-08T18:30:45.878 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:45.878 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:45.878 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:45.878 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:45.878 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:45.878 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:45.878 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 205 2024-05-08T18:30:45.878 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.878 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:45.878 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.879 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:45.879 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.664338+0000", 2024-05-08T18:30:45.879 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:45.879 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.879 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.879 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:45.879 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.664338+0000", 2024-05-08T18:30:45.879 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:45.879 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.879 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.879 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:45.879 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.664341+0000", 2024-05-08T18:30:45.879 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2399999999999999e-06 2024-05-08T18:30:45.880 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.880 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.880 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:45.880 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.664355+0000", 2024-05-08T18:30:45.880 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.453e-05 2024-05-08T18:30:45.880 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.880 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.880 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:45.880 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.664392+0000", 2024-05-08T18:30:45.880 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7033000000000003e-05 2024-05-08T18:30:45.880 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.880 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.880 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:45.880 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.664419+0000", 2024-05-08T18:30:45.881 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6086000000000001e-05 2024-05-08T18:30:45.881 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.881 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.881 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:45.881 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.664586+0000", 2024-05-08T18:30:45.881 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016752299999999999 2024-05-08T18:30:45.881 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.881 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.881 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:45.881 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.664831+0000", 2024-05-08T18:30:45.881 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00024510800000000001 2024-05-08T18:30:45.881 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.881 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.882 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:45.882 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.665420+0000", 2024-05-08T18:30:45.882 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00058862499999999996 2024-05-08T18:30:45.882 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.882 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.882 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:45.882 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.667096+0000", 2024-05-08T18:30:45.882 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0016765199999999999 2024-05-08T18:30:45.882 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.882 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.882 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:45.882 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.668109+0000", 2024-05-08T18:30:45.882 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001012829 2024-05-08T18:30:45.883 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.883 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.883 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:45.883 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.668200+0000", 2024-05-08T18:30:45.883 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1186000000000004e-05 2024-05-08T18:30:45.883 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.883 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.883 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:45.883 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.668273+0000", 2024-05-08T18:30:45.883 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.2862999999999997e-05 2024-05-08T18:30:45.883 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:45.883 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:45.883 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:45.883 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.884 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.884 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:45.884 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.732858+0000", 2024-05-08T18:30:45.884 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 54.129852954999997, 2024-05-08T18:30:45.884 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0033301939999999999, 2024-05-08T18:30:45.884 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:45.884 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:45.884 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:45.884 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:45.884 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:45.884 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:45.884 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 220 2024-05-08T18:30:45.884 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.885 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:45.885 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.885 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:45.885 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.732858+0000", 2024-05-08T18:30:45.885 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:45.885 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.885 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.885 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:45.885 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.732858+0000", 2024-05-08T18:30:45.885 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:45.885 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.885 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.885 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:45.885 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.732861+0000", 2024-05-08T18:30:45.885 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.9129999999999999e-06 2024-05-08T18:30:45.886 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.886 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.886 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:45.886 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.732874+0000", 2024-05-08T18:30:45.886 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3349999999999999e-05 2024-05-08T18:30:45.886 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.886 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.886 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:45.886 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.732900+0000", 2024-05-08T18:30:45.886 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6186999999999998e-05 2024-05-08T18:30:45.886 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.886 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.886 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:45.887 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.732916+0000", 2024-05-08T18:30:45.887 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5648999999999999e-05 2024-05-08T18:30:45.887 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.887 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.887 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:45.887 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.733097+0000", 2024-05-08T18:30:45.887 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00018121599999999999 2024-05-08T18:30:45.887 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.887 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.887 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:45.887 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.733299+0000", 2024-05-08T18:30:45.887 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020179799999999999 2024-05-08T18:30:45.887 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.887 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.887 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:45.888 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.733694+0000", 2024-05-08T18:30:45.888 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00039455000000000002 2024-05-08T18:30:45.888 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.888 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.888 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:45.888 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.735124+0000", 2024-05-08T18:30:45.888 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001430239 2024-05-08T18:30:45.888 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.888 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.888 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:45.888 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.736037+0000", 2024-05-08T18:30:45.888 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00091359999999999998 2024-05-08T18:30:45.888 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.888 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.889 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:45.889 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.736122+0000", 2024-05-08T18:30:45.889 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4313000000000004e-05 2024-05-08T18:30:45.889 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.889 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.889 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:45.889 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.736188+0000", 2024-05-08T18:30:45.889 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6378999999999996e-05 2024-05-08T18:30:45.889 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:45.889 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:45.889 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:45.889 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.889 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.889 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:223 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:45.889 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.743358+0000", 2024-05-08T18:30:45.889 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 54.119352743, 2024-05-08T18:30:45.890 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003279718, 2024-05-08T18:30:45.890 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:45.890 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:45.890 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:45.890 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:45.890 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:45.890 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:45.890 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 223 2024-05-08T18:30:45.890 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.890 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:45.890 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.890 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:45.890 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.743358+0000", 2024-05-08T18:30:45.891 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:45.891 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.891 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.891 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:45.891 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.743358+0000", 2024-05-08T18:30:45.891 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:45.891 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.891 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.891 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:45.891 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.743361+0000", 2024-05-08T18:30:45.891 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3269999999999999e-06 2024-05-08T18:30:45.891 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.891 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.891 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:45.892 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.743372+0000", 2024-05-08T18:30:45.892 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1202999999999999e-05 2024-05-08T18:30:45.892 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.892 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.892 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:45.892 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.743402+0000", 2024-05-08T18:30:45.892 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0580000000000002e-05 2024-05-08T18:30:45.892 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.892 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.892 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:45.892 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.743417+0000", 2024-05-08T18:30:45.892 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5067e-05 2024-05-08T18:30:45.892 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.892 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.892 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:45.893 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.743529+0000", 2024-05-08T18:30:45.893 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011130599999999999 2024-05-08T18:30:45.893 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.893 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.893 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:45.893 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.743744+0000", 2024-05-08T18:30:45.893 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000215324 2024-05-08T18:30:45.893 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.893 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.893 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:45.893 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.744137+0000", 2024-05-08T18:30:45.893 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00039347699999999999 2024-05-08T18:30:45.893 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.894 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.894 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:45.894 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.745510+0000", 2024-05-08T18:30:45.894 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001372063 2024-05-08T18:30:45.894 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.894 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.894 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:45.894 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.746486+0000", 2024-05-08T18:30:45.894 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00097615600000000005 2024-05-08T18:30:45.894 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.894 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.894 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:45.894 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.746574+0000", 2024-05-08T18:30:45.895 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8598999999999997e-05 2024-05-08T18:30:45.895 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.895 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.895 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:45.895 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.746638+0000", 2024-05-08T18:30:45.895 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3615999999999995e-05 2024-05-08T18:30:45.895 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:45.895 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:45.895 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:45.895 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.895 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.895 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:225 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:45.895 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.750971+0000", 2024-05-08T18:30:45.895 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 54.111740158000003, 2024-05-08T18:30:45.896 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0033719510000000002, 2024-05-08T18:30:45.896 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:45.896 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:45.896 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:45.896 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:45.896 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:45.896 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:45.896 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 225 2024-05-08T18:30:45.896 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.896 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:45.896 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.896 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:45.896 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.750971+0000", 2024-05-08T18:30:45.897 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:45.897 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.897 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.897 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:45.897 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.750971+0000", 2024-05-08T18:30:45.897 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:45.897 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.897 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.897 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:45.897 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.750973+0000", 2024-05-08T18:30:45.897 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.243e-06 2024-05-08T18:30:45.897 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.897 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.897 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:45.898 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.751001+0000", 2024-05-08T18:30:45.898 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8082999999999999e-05 2024-05-08T18:30:45.898 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.898 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.898 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:45.898 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.751029+0000", 2024-05-08T18:30:45.898 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.792e-05 2024-05-08T18:30:45.898 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.898 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.898 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:45.898 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.751051+0000", 2024-05-08T18:30:45.898 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2166000000000001e-05 2024-05-08T18:30:45.898 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.899 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.899 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:45.899 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.751239+0000", 2024-05-08T18:30:45.899 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000187362 2024-05-08T18:30:45.899 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.899 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.899 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:45.899 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.751462+0000", 2024-05-08T18:30:45.899 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000223482 2024-05-08T18:30:45.899 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.899 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.899 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:45.899 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.751893+0000", 2024-05-08T18:30:45.899 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00043102 2024-05-08T18:30:45.899 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.900 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.900 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:45.900 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.753297+0000", 2024-05-08T18:30:45.900 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001403619 2024-05-08T18:30:45.900 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.900 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.900 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:45.900 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.754186+0000", 2024-05-08T18:30:45.900 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00088948399999999996 2024-05-08T18:30:45.900 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.900 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.900 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:45.900 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.754280+0000", 2024-05-08T18:30:45.900 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.3838999999999994e-05 2024-05-08T18:30:45.900 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.901 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.901 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:45.901 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.754343+0000", 2024-05-08T18:30:45.901 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2732999999999997e-05 2024-05-08T18:30:45.901 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:45.901 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:45.901 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:45.901 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.901 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.901 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:226 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:45.901 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.754700+0000", 2024-05-08T18:30:45.901 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 54.108010602999997, 2024-05-08T18:30:45.901 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032180080000000001, 2024-05-08T18:30:45.902 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:45.902 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:45.902 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:45.902 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:45.902 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:45.902 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:45.902 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 226 2024-05-08T18:30:45.902 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.902 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:45.902 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.902 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:45.902 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.754700+0000", 2024-05-08T18:30:45.902 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:45.902 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.903 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.903 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:45.903 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.754700+0000", 2024-05-08T18:30:45.903 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:45.903 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.903 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.903 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:45.903 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.754702+0000", 2024-05-08T18:30:45.903 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.86e-06 2024-05-08T18:30:45.903 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.903 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.903 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:45.903 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.754711+0000", 2024-05-08T18:30:45.903 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.0399999999999998e-06 2024-05-08T18:30:45.904 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.904 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.904 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:45.904 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.754735+0000", 2024-05-08T18:30:45.904 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3496e-05 2024-05-08T18:30:45.904 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.904 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.904 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:45.904 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.754753+0000", 2024-05-08T18:30:45.904 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8406e-05 2024-05-08T18:30:45.904 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.904 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.904 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:45.904 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.754941+0000", 2024-05-08T18:30:45.905 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00018746600000000001 2024-05-08T18:30:45.905 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.905 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.905 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:45.905 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.755164+0000", 2024-05-08T18:30:45.905 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022307800000000001 2024-05-08T18:30:45.905 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.905 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.905 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:45.905 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.755552+0000", 2024-05-08T18:30:45.905 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00038834999999999998 2024-05-08T18:30:45.905 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.905 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.906 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:45.906 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.757079+0000", 2024-05-08T18:30:45.906 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001527055 2024-05-08T18:30:45.906 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.906 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.906 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:45.906 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.757769+0000", 2024-05-08T18:30:45.906 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00068953199999999997 2024-05-08T18:30:45.906 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.906 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.906 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:45.906 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.757848+0000", 2024-05-08T18:30:45.906 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9342e-05 2024-05-08T18:30:45.906 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.907 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.907 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:45.907 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.757918+0000", 2024-05-08T18:30:45.907 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0382999999999993e-05 2024-05-08T18:30:45.907 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:45.907 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:45.907 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:45.907 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.907 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.907 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:234 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:45.907 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.783973+0000", 2024-05-08T18:30:45.907 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 54.078738239000003, 2024-05-08T18:30:45.907 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003359374, 2024-05-08T18:30:45.907 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:45.908 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:45.908 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:45.908 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:45.908 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:45.908 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:45.908 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 234 2024-05-08T18:30:45.908 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.908 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:45.908 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.908 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:45.908 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.783973+0000", 2024-05-08T18:30:45.908 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:45.908 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.908 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.909 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:45.909 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.783973+0000", 2024-05-08T18:30:45.909 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:45.909 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.909 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.909 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:45.909 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.783975+0000", 2024-05-08T18:30:45.909 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2970000000000002e-06 2024-05-08T18:30:45.909 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.909 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.909 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:45.909 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.783986+0000", 2024-05-08T18:30:45.909 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0726e-05 2024-05-08T18:30:45.909 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.910 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.910 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:45.910 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.784016+0000", 2024-05-08T18:30:45.910 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0459000000000001e-05 2024-05-08T18:30:45.910 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.910 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.910 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:45.910 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.784032+0000", 2024-05-08T18:30:45.910 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5316999999999999e-05 2024-05-08T18:30:45.910 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.910 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.910 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:45.911 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.784155+0000", 2024-05-08T18:30:45.911 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012393199999999999 2024-05-08T18:30:45.911 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.911 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.911 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:45.911 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.784377+0000", 2024-05-08T18:30:45.911 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000221179 2024-05-08T18:30:45.911 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.911 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.911 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:45.911 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.784794+0000", 2024-05-08T18:30:45.911 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00041709599999999999 2024-05-08T18:30:45.911 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.911 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.912 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:45.912 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.786199+0000", 2024-05-08T18:30:45.912 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001405346 2024-05-08T18:30:45.912 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.912 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.912 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:45.912 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.787171+0000", 2024-05-08T18:30:45.912 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00097187 2024-05-08T18:30:45.912 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.912 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.912 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:45.912 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.787265+0000", 2024-05-08T18:30:45.912 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4055000000000007e-05 2024-05-08T18:30:45.912 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.913 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.913 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:45.913 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.787332+0000", 2024-05-08T18:30:45.913 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7096999999999998e-05 2024-05-08T18:30:45.913 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:45.913 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:45.913 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:45.913 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.913 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.913 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:425 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:45.913 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.847197+0000", 2024-05-08T18:30:45.913 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 54.015513574000003, 2024-05-08T18:30:45.913 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003317646, 2024-05-08T18:30:45.913 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:45.914 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:45.914 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:45.914 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:45.914 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:45.914 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:45.914 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 425 2024-05-08T18:30:45.914 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.914 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:45.914 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.914 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:45.914 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.847197+0000", 2024-05-08T18:30:45.914 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:45.914 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.914 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.915 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:45.915 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.847197+0000", 2024-05-08T18:30:45.915 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:45.915 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.915 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.915 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:45.915 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.847200+0000", 2024-05-08T18:30:45.915 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1629999999999999e-06 2024-05-08T18:30:45.915 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.915 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.915 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:45.915 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.847210+0000", 2024-05-08T18:30:45.915 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0180000000000001e-05 2024-05-08T18:30:45.915 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.916 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.916 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:45.916 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.847234+0000", 2024-05-08T18:30:45.916 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3879999999999998e-05 2024-05-08T18:30:45.916 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.916 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.916 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:45.916 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.847247+0000", 2024-05-08T18:30:45.916 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3263e-05 2024-05-08T18:30:45.916 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.916 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.916 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:45.916 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.847356+0000", 2024-05-08T18:30:45.916 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000108906 2024-05-08T18:30:45.917 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.917 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.917 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:45.917 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.847647+0000", 2024-05-08T18:30:45.917 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029143799999999998 2024-05-08T18:30:45.917 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.917 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.917 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:45.917 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.848062+0000", 2024-05-08T18:30:45.917 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000415227 2024-05-08T18:30:45.917 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.917 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.917 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:45.917 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.849591+0000", 2024-05-08T18:30:45.918 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0015288980000000001 2024-05-08T18:30:45.918 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.918 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.918 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:45.918 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.850244+0000", 2024-05-08T18:30:45.918 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000652336 2024-05-08T18:30:45.918 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.918 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.918 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:45.918 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.850418+0000", 2024-05-08T18:30:45.918 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000174284 2024-05-08T18:30:45.918 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.918 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.918 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:45.919 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.850515+0000", 2024-05-08T18:30:45.919 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7071000000000006e-05 2024-05-08T18:30:45.919 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:45.919 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:45.919 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:45.919 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.919 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.919 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:433 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:45.919 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.851403+0000", 2024-05-08T18:30:45.919 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 54.011307793, 2024-05-08T18:30:45.919 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032407109999999999, 2024-05-08T18:30:45.919 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:45.919 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:45.919 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:45.920 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:45.920 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:45.920 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:45.920 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 433 2024-05-08T18:30:45.920 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.920 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:45.920 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.920 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:45.920 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.851403+0000", 2024-05-08T18:30:45.920 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:45.920 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.920 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.920 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:45.920 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.851403+0000", 2024-05-08T18:30:45.920 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:45.920 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.921 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.921 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:45.921 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.851405+0000", 2024-05-08T18:30:45.921 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.463e-06 2024-05-08T18:30:45.921 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.921 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.921 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:45.921 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.851411+0000", 2024-05-08T18:30:45.921 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2369999999999997e-06 2024-05-08T18:30:45.921 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.921 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.921 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:45.921 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.851428+0000", 2024-05-08T18:30:45.921 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.696e-05 2024-05-08T18:30:45.922 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.922 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.922 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:45.922 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.851446+0000", 2024-05-08T18:30:45.922 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7706e-05 2024-05-08T18:30:45.922 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.922 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.922 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:45.922 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.851552+0000", 2024-05-08T18:30:45.922 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000106236 2024-05-08T18:30:45.922 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.922 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.922 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:45.923 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.851746+0000", 2024-05-08T18:30:45.923 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000194093 2024-05-08T18:30:45.923 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.923 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.923 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:45.923 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.852148+0000", 2024-05-08T18:30:45.923 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00040243100000000002 2024-05-08T18:30:45.923 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.923 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.923 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:45.923 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.854255+0000", 2024-05-08T18:30:45.923 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002107135 2024-05-08T18:30:45.923 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.923 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.924 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:45.924 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.854326+0000", 2024-05-08T18:30:45.924 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0902999999999995e-05 2024-05-08T18:30:45.924 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.924 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.924 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:45.924 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.854568+0000", 2024-05-08T18:30:45.924 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00024141500000000001 2024-05-08T18:30:45.924 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.924 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.924 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:45.924 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.854644+0000", 2024-05-08T18:30:45.924 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6131999999999995e-05 2024-05-08T18:30:45.924 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:45.925 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:45.925 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:45.925 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.925 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.925 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:436 6.a 6:55b0279d:reshard::reshard.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:45.925 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.852129+0000", 2024-05-08T18:30:45.925 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 54.010581985000002, 2024-05-08T18:30:45.925 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0053015019999999996, 2024-05-08T18:30:45.925 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:45.925 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:45.925 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:45.925 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:45.925 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:45.925 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:45.926 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 436 2024-05-08T18:30:45.926 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.926 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:45.926 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.926 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:45.926 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.852129+0000", 2024-05-08T18:30:45.926 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:45.926 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.926 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.926 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:45.926 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.852129+0000", 2024-05-08T18:30:45.926 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:45.926 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.927 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.927 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:45.927 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.852130+0000", 2024-05-08T18:30:45.927 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.353e-06 2024-05-08T18:30:45.927 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.927 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.927 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:45.927 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.852137+0000", 2024-05-08T18:30:45.927 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6900000000000003e-06 2024-05-08T18:30:45.927 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.927 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.927 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:45.927 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.852156+0000", 2024-05-08T18:30:45.927 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9143e-05 2024-05-08T18:30:45.928 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.928 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.928 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:45.928 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.852169+0000", 2024-05-08T18:30:45.928 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.308e-05 2024-05-08T18:30:45.928 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.928 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.928 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:45.928 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.852700+0000", 2024-05-08T18:30:45.928 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00053086599999999996 2024-05-08T18:30:45.928 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.928 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.928 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:45.928 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.853030+0000", 2024-05-08T18:30:45.928 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00033040100000000002 2024-05-08T18:30:45.929 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.929 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.929 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:45.929 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.853514+0000", 2024-05-08T18:30:45.929 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000483969 2024-05-08T18:30:45.929 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.929 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.929 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:45.929 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.856337+0000", 2024-05-08T18:30:45.929 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0028227349999999998 2024-05-08T18:30:45.929 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.929 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.929 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:45.930 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.857285+0000", 2024-05-08T18:30:45.930 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00094820600000000005 2024-05-08T18:30:45.930 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.930 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.930 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:45.930 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.857366+0000", 2024-05-08T18:30:45.930 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.0889000000000004e-05 2024-05-08T18:30:45.930 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.930 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.930 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:45.930 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.857430+0000", 2024-05-08T18:30:45.930 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4170000000000004e-05 2024-05-08T18:30:45.930 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:45.930 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:45.931 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:45.931 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.931 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.931 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:478 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:45.931 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.876745+0000", 2024-05-08T18:30:45.931 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 53.985965448999998, 2024-05-08T18:30:45.931 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0046303550000000001, 2024-05-08T18:30:45.931 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:45.931 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:45.931 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:45.931 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:45.931 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:45.931 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:45.931 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 478 2024-05-08T18:30:45.931 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.931 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:45.932 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.932 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:45.932 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.876745+0000", 2024-05-08T18:30:45.932 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:45.932 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.932 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.932 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:45.932 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.876745+0000", 2024-05-08T18:30:45.932 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:45.932 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.932 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.932 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:45.932 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.876748+0000", 2024-05-08T18:30:45.932 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2819999999999999e-06 2024-05-08T18:30:45.933 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.933 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.933 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:45.933 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.876758+0000", 2024-05-08T18:30:45.933 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0485e-05 2024-05-08T18:30:45.933 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.933 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.933 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:45.933 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.876788+0000", 2024-05-08T18:30:45.933 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.9879e-05 2024-05-08T18:30:45.933 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.933 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.933 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:45.934 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.876805+0000", 2024-05-08T18:30:45.934 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.643e-05 2024-05-08T18:30:45.934 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.934 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.934 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:45.934 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.876917+0000", 2024-05-08T18:30:45.934 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000112377 2024-05-08T18:30:45.934 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.934 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.934 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:45.934 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877094+0000", 2024-05-08T18:30:45.934 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000177131 2024-05-08T18:30:45.934 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.935 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.935 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:45.935 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877441+0000", 2024-05-08T18:30:45.935 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00034716100000000002 2024-05-08T18:30:45.935 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.935 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.935 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:45.935 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.878479+0000", 2024-05-08T18:30:45.935 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010378729999999999 2024-05-08T18:30:45.935 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.935 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.935 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:45.935 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.881252+0000", 2024-05-08T18:30:45.935 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0027728710000000001 2024-05-08T18:30:45.936 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.936 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.936 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:45.936 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.881322+0000", 2024-05-08T18:30:45.936 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0394000000000004e-05 2024-05-08T18:30:45.936 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.936 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.936 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:45.936 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.881376+0000", 2024-05-08T18:30:45.936 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3471999999999999e-05 2024-05-08T18:30:45.936 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:45.936 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:45.936 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:45.936 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.937 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.937 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:479 6.d 6:b3052b9f:reshard::reshard.0000000013:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:45.937 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.877922+0000", 2024-05-08T18:30:45.937 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 53.984789351000003, 2024-05-08T18:30:45.937 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0030756400000000001, 2024-05-08T18:30:45.937 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:45.937 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:45.937 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:45.937 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:45.937 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:45.937 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:45.937 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 479 2024-05-08T18:30:45.937 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.937 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:45.938 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.938 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:45.938 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877922+0000", 2024-05-08T18:30:45.938 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:45.938 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.938 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.938 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:45.938 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877922+0000", 2024-05-08T18:30:45.938 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:45.938 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.938 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.938 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:45.938 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877923+0000", 2024-05-08T18:30:45.938 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8670000000000001e-06 2024-05-08T18:30:45.938 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.939 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.939 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:45.939 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877933+0000", 2024-05-08T18:30:45.939 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.0860000000000008e-06 2024-05-08T18:30:45.939 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.939 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.939 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:45.939 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877970+0000", 2024-05-08T18:30:45.939 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7762999999999997e-05 2024-05-08T18:30:45.939 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.939 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.939 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:45.939 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877997+0000", 2024-05-08T18:30:45.939 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6883e-05 2024-05-08T18:30:45.940 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.940 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.940 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:45.940 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.878108+0000", 2024-05-08T18:30:45.940 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000110797 2024-05-08T18:30:45.940 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.940 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.940 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:45.940 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.878403+0000", 2024-05-08T18:30:45.940 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029509799999999999 2024-05-08T18:30:45.940 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.940 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.940 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:45.941 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.878744+0000", 2024-05-08T18:30:45.941 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00034075899999999999 2024-05-08T18:30:45.941 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.941 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.941 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:45.941 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.879800+0000", 2024-05-08T18:30:45.941 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010564420000000001 2024-05-08T18:30:45.941 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.941 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.941 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:45.941 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.880740+0000", 2024-05-08T18:30:45.941 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000940167 2024-05-08T18:30:45.941 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.941 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.941 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:45.942 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.880880+0000", 2024-05-08T18:30:45.942 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000139796 2024-05-08T18:30:45.942 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.942 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.942 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:45.942 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.880997+0000", 2024-05-08T18:30:45.942 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000116982 2024-05-08T18:30:45.942 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:45.942 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:45.942 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:45.942 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.942 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.942 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:766 6.19 6:9edc23b1:::obj_delete_at_hint.0000000063:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:45.942 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.158937+0000", 2024-05-08T18:30:45.943 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 53.703773460000001, 2024-05-08T18:30:45.943 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0030448300000000001, 2024-05-08T18:30:45.943 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:45.943 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:45.943 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:45.943 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:45.943 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:45.943 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:45.943 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 766 2024-05-08T18:30:45.943 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.943 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:45.943 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.943 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:45.943 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.158937+0000", 2024-05-08T18:30:45.944 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:45.944 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.944 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.944 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:45.944 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.158937+0000", 2024-05-08T18:30:45.944 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:45.944 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.944 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.944 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:45.944 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.158940+0000", 2024-05-08T18:30:45.944 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6170000000000001e-06 2024-05-08T18:30:45.944 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.944 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.944 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:45.945 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.158952+0000", 2024-05-08T18:30:45.945 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1559000000000001e-05 2024-05-08T18:30:45.945 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.945 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.945 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:45.945 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.158982+0000", 2024-05-08T18:30:45.945 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0406999999999999e-05 2024-05-08T18:30:45.945 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.945 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.945 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:45.945 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.159000+0000", 2024-05-08T18:30:45.945 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8e-05 2024-05-08T18:30:45.945 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.945 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.946 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:45.946 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.159090+0000", 2024-05-08T18:30:45.946 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.0124999999999995e-05 2024-05-08T18:30:45.946 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.946 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.946 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:45.946 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.159296+0000", 2024-05-08T18:30:45.946 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000205663 2024-05-08T18:30:45.946 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.946 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.946 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:45.946 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.159600+0000", 2024-05-08T18:30:45.946 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00030387699999999998 2024-05-08T18:30:45.946 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.947 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.947 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:45.947 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.160694+0000", 2024-05-08T18:30:45.947 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001094228 2024-05-08T18:30:45.947 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.947 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.947 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:45.947 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.161818+0000", 2024-05-08T18:30:45.947 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001124388 2024-05-08T18:30:45.947 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.947 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.947 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:45.947 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.161908+0000", 2024-05-08T18:30:45.948 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.9629000000000005e-05 2024-05-08T18:30:45.948 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.948 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.948 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:45.948 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.161982+0000", 2024-05-08T18:30:45.948 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4337000000000003e-05 2024-05-08T18:30:45.948 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:45.948 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:45.948 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:45.948 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.948 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.948 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:820 6.a 6:50a39311:::obj_delete_at_hint.0000000081:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:45.948 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.281842+0000", 2024-05-08T18:30:45.948 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 53.580869059000001, 2024-05-08T18:30:45.949 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0030574130000000001, 2024-05-08T18:30:45.949 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:45.949 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:45.949 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:45.949 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:45.949 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:45.949 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:45.949 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 820 2024-05-08T18:30:45.949 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.949 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:45.949 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.949 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:45.949 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.281842+0000", 2024-05-08T18:30:45.949 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:45.950 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.950 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.950 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:45.950 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.281842+0000", 2024-05-08T18:30:45.950 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:45.950 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.950 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.950 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:45.950 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.281845+0000", 2024-05-08T18:30:45.950 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8439999999999998e-06 2024-05-08T18:30:45.950 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.950 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.950 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:45.951 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.281856+0000", 2024-05-08T18:30:45.951 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.148e-05 2024-05-08T18:30:45.951 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.951 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.951 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:45.951 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.281887+0000", 2024-05-08T18:30:45.951 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1239999999999999e-05 2024-05-08T18:30:45.951 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.951 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.951 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:45.951 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.281903+0000", 2024-05-08T18:30:45.951 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5223e-05 2024-05-08T18:30:45.951 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.951 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.952 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:45.952 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.282084+0000", 2024-05-08T18:30:45.952 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00018167500000000001 2024-05-08T18:30:45.952 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.952 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.952 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:45.952 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.282301+0000", 2024-05-08T18:30:45.952 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00021651099999999999 2024-05-08T18:30:45.952 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.952 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.952 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:45.952 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.282634+0000", 2024-05-08T18:30:45.952 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000332758 2024-05-08T18:30:45.952 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.953 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.953 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:45.953 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.283836+0000", 2024-05-08T18:30:45.953 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001202397 2024-05-08T18:30:45.953 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.953 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.953 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:45.953 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.284750+0000", 2024-05-08T18:30:45.953 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00091438999999999995 2024-05-08T18:30:45.953 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.953 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.953 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:45.953 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.284836+0000", 2024-05-08T18:30:45.953 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.5855999999999999e-05 2024-05-08T18:30:45.954 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.954 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.954 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:45.954 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.284899+0000", 2024-05-08T18:30:45.954 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3039000000000004e-05 2024-05-08T18:30:45.954 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:45.954 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:45.954 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:45.954 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.954 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.954 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:835 6.7 6:e09767b9:::obj_delete_at_hint.0000000086:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:45.954 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.317765+0000", 2024-05-08T18:30:45.954 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 53.544946170000003, 2024-05-08T18:30:45.954 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029952809999999998, 2024-05-08T18:30:45.955 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:45.955 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:45.955 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:45.955 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:45.955 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:45.955 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:45.955 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 835 2024-05-08T18:30:45.955 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.955 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:45.955 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.955 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:45.955 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.317765+0000", 2024-05-08T18:30:45.955 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:45.956 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.956 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.956 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:45.956 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.317765+0000", 2024-05-08T18:30:45.956 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:45.956 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.956 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.956 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:45.956 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.317767+0000", 2024-05-08T18:30:45.956 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.057e-06 2024-05-08T18:30:45.956 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.956 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.956 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:45.956 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.317780+0000", 2024-05-08T18:30:45.956 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.36e-05 2024-05-08T18:30:45.957 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.957 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.957 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:45.957 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.317810+0000", 2024-05-08T18:30:45.957 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.9989999999999999e-05 2024-05-08T18:30:45.957 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.957 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.957 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:45.957 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.317832+0000", 2024-05-08T18:30:45.957 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1650000000000001e-05 2024-05-08T18:30:45.957 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.957 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.957 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:45.957 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.317954+0000", 2024-05-08T18:30:45.958 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000121465 2024-05-08T18:30:45.958 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.958 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.958 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:45.958 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.318189+0000", 2024-05-08T18:30:45.958 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000235818 2024-05-08T18:30:45.958 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.958 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.958 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:45.958 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.318532+0000", 2024-05-08T18:30:45.958 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00034245100000000002 2024-05-08T18:30:45.958 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.958 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.959 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:45.959 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.319625+0000", 2024-05-08T18:30:45.959 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010931280000000001 2024-05-08T18:30:45.959 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.959 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.959 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:45.959 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.320612+0000", 2024-05-08T18:30:45.959 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00098682299999999995 2024-05-08T18:30:45.959 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.959 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.959 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:45.959 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.320698+0000", 2024-05-08T18:30:45.959 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.5813e-05 2024-05-08T18:30:45.959 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.959 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.960 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:45.960 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.320760+0000", 2024-05-08T18:30:45.960 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2485999999999998e-05 2024-05-08T18:30:45.960 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:45.960 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:45.960 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:45.960 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.960 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.960 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:922 6.d 6:b6c174be:::obj_delete_at_hint.0000000115:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:45.960 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.516256+0000", 2024-05-08T18:30:45.960 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 53.346455218000003, 2024-05-08T18:30:45.960 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032949839999999999, 2024-05-08T18:30:45.960 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:45.960 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:45.960 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:45.961 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:45.961 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:45.961 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:45.961 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 922 2024-05-08T18:30:45.961 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.961 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:45.961 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.961 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:45.961 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.516256+0000", 2024-05-08T18:30:45.961 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:45.961 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.961 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.961 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:45.961 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.516256+0000", 2024-05-08T18:30:45.961 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:45.962 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.962 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.962 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:45.962 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.516258+0000", 2024-05-08T18:30:45.962 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.4399999999999999e-06 2024-05-08T18:30:45.962 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.962 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.962 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:45.962 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.516269+0000", 2024-05-08T18:30:45.962 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0797e-05 2024-05-08T18:30:45.962 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.962 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.962 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:45.963 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.516299+0000", 2024-05-08T18:30:45.963 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0213e-05 2024-05-08T18:30:45.963 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.963 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.963 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:45.963 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.516314+0000", 2024-05-08T18:30:45.963 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4600000000000001e-05 2024-05-08T18:30:45.963 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.963 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.963 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:45.963 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.516424+0000", 2024-05-08T18:30:45.963 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000110376 2024-05-08T18:30:45.963 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.964 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.964 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:45.964 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.516635+0000", 2024-05-08T18:30:45.964 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000210628 2024-05-08T18:30:45.964 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.964 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.964 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:45.964 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.516947+0000", 2024-05-08T18:30:45.964 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00031246699999999997 2024-05-08T18:30:45.964 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.964 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.964 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:45.964 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.517949+0000", 2024-05-08T18:30:45.964 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010017400000000001 2024-05-08T18:30:45.965 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.965 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.965 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:45.965 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.519389+0000", 2024-05-08T18:30:45.965 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001439655 2024-05-08T18:30:45.965 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.965 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.965 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:45.965 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.519475+0000", 2024-05-08T18:30:45.965 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.6485999999999998e-05 2024-05-08T18:30:45.965 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.965 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.965 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:45.966 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.519551+0000", 2024-05-08T18:30:45.966 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5581999999999996e-05 2024-05-08T18:30:45.966 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:45.966 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:45.966 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:45.966 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.966 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.966 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:940 6.a 6:517698f6:::obj_delete_at_hint.0000000121:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:45.966 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.560553+0000", 2024-05-08T18:30:45.966 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 53.302158370000001, 2024-05-08T18:30:45.966 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0030017569999999999, 2024-05-08T18:30:45.966 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:45.966 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:45.967 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:45.967 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:45.967 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:45.967 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:45.967 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 940 2024-05-08T18:30:45.967 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.967 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:45.967 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.967 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:45.967 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.560553+0000", 2024-05-08T18:30:45.967 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:45.967 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.967 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.967 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:45.968 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.560553+0000", 2024-05-08T18:30:45.968 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:45.968 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.968 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.968 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:45.968 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.560555+0000", 2024-05-08T18:30:45.968 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.39e-06 2024-05-08T18:30:45.968 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.968 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.968 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:45.968 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.560566+0000", 2024-05-08T18:30:45.968 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1484000000000001e-05 2024-05-08T18:30:45.968 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.968 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.968 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:45.969 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.560596+0000", 2024-05-08T18:30:45.969 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0001999999999998e-05 2024-05-08T18:30:45.969 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.969 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.969 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:45.969 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.560612+0000", 2024-05-08T18:30:45.969 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5690000000000001e-05 2024-05-08T18:30:45.969 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.969 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.969 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:45.969 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.560747+0000", 2024-05-08T18:30:45.969 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013494900000000001 2024-05-08T18:30:45.969 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.969 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.969 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:45.970 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.560961+0000", 2024-05-08T18:30:45.970 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000214305 2024-05-08T18:30:45.970 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.970 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.970 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:45.970 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.561281+0000", 2024-05-08T18:30:45.970 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00031933800000000001 2024-05-08T18:30:45.970 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.970 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.970 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:45.970 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.562399+0000", 2024-05-08T18:30:45.970 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0011180280000000001 2024-05-08T18:30:45.970 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.971 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.971 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:45.971 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.563407+0000", 2024-05-08T18:30:45.971 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010080519999999999 2024-05-08T18:30:45.971 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.971 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.971 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:45.971 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.563489+0000", 2024-05-08T18:30:45.971 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1725999999999996e-05 2024-05-08T18:30:45.971 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.971 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.971 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:45.971 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.563554+0000", 2024-05-08T18:30:45.971 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5792999999999998e-05 2024-05-08T18:30:45.972 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:45.972 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:45.972 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:45.972 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.972 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.972 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:943 6.19 6:9f21944d:::obj_delete_at_hint.0000000122:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:45.972 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.567777+0000", 2024-05-08T18:30:45.972 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 53.294933479000001, 2024-05-08T18:30:45.972 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0033921939999999999, 2024-05-08T18:30:45.972 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:45.972 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:45.972 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:45.972 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:45.972 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:45.972 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:45.973 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 943 2024-05-08T18:30:45.973 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.973 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:45.973 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.973 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:45.973 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.567777+0000", 2024-05-08T18:30:45.973 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:45.973 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.973 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.973 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:45.973 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.567777+0000", 2024-05-08T18:30:45.973 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:45.973 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.973 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.974 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:45.974 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.567779+0000", 2024-05-08T18:30:45.974 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8330000000000001e-06 2024-05-08T18:30:45.974 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.974 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.974 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:45.974 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.567788+0000", 2024-05-08T18:30:45.974 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4999999999999999e-06 2024-05-08T18:30:45.974 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.974 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.974 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:45.974 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.567812+0000", 2024-05-08T18:30:45.974 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.4207e-05 2024-05-08T18:30:45.974 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.975 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.975 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:45.975 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.567836+0000", 2024-05-08T18:30:45.975 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.4196e-05 2024-05-08T18:30:45.975 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.975 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.975 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:45.975 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.567954+0000", 2024-05-08T18:30:45.975 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011794300000000001 2024-05-08T18:30:45.975 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.975 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.975 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:45.975 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.568170+0000", 2024-05-08T18:30:45.976 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00021626100000000001 2024-05-08T18:30:45.976 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.976 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.976 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:45.976 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.568485+0000", 2024-05-08T18:30:45.976 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00031442800000000001 2024-05-08T18:30:45.976 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.976 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.976 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:45.976 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.569555+0000", 2024-05-08T18:30:45.976 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010698750000000001 2024-05-08T18:30:45.976 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.976 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.977 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:45.977 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.570899+0000", 2024-05-08T18:30:45.977 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0013446700000000001 2024-05-08T18:30:45.977 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.977 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.977 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:45.977 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.571058+0000", 2024-05-08T18:30:45.977 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015871900000000001 2024-05-08T18:30:45.977 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.977 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.977 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:45.977 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.571170+0000", 2024-05-08T18:30:45.977 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000111562 2024-05-08T18:30:45.977 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:45.977 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:45.978 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:45.978 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.978 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.978 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:952 6.a 6:541d369a:::obj_delete_at_hint.0000000125:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:45.978 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.588764+0000", 2024-05-08T18:30:45.978 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 53.273946447999997, 2024-05-08T18:30:45.978 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003183399, 2024-05-08T18:30:45.978 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:45.978 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:45.978 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:45.978 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:45.978 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:45.978 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:45.979 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 952 2024-05-08T18:30:45.979 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.979 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:45.979 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.979 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:45.979 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.588764+0000", 2024-05-08T18:30:45.979 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:45.979 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.979 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.979 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:45.979 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.588764+0000", 2024-05-08T18:30:45.979 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:45.979 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.979 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.980 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:45.980 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.588767+0000", 2024-05-08T18:30:45.980 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.39e-06 2024-05-08T18:30:45.980 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.980 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.980 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:45.980 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.588778+0000", 2024-05-08T18:30:45.980 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1304000000000001e-05 2024-05-08T18:30:45.980 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.980 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.980 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:45.980 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.588810+0000", 2024-05-08T18:30:45.980 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1726000000000001e-05 2024-05-08T18:30:45.980 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.980 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.981 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:45.981 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.588834+0000", 2024-05-08T18:30:45.981 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3845999999999998e-05 2024-05-08T18:30:45.981 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.981 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.981 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:45.981 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.588987+0000", 2024-05-08T18:30:45.981 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015300200000000001 2024-05-08T18:30:45.981 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.981 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.981 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:45.981 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.589197+0000", 2024-05-08T18:30:45.981 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020992299999999999 2024-05-08T18:30:45.981 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.982 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.982 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:45.982 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.589536+0000", 2024-05-08T18:30:45.982 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00033939300000000001 2024-05-08T18:30:45.982 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.982 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.982 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:45.982 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.590827+0000", 2024-05-08T18:30:45.982 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0012906 2024-05-08T18:30:45.982 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.982 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.982 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:45.982 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.591757+0000", 2024-05-08T18:30:45.983 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00093020699999999995 2024-05-08T18:30:45.983 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.983 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.983 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:45.983 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.591881+0000", 2024-05-08T18:30:45.983 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012406900000000001 2024-05-08T18:30:45.983 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:45.983 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:45.983 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:45.983 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.591948+0000", 2024-05-08T18:30:45.983 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6939000000000004e-05 2024-05-08T18:30:45.983 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:45.983 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:45.983 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:45.983 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:45.984 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:45.984 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:30:45.985 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-08T18:30:45.986 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:30:45.984+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:30:46.086 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:30:46.083+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:30:46.114 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:30:46.114 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:30:46.114 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 0 2024-05-08T18:30:46.115 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:30:46.128 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-08T18:30:46.217 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:30:46.215+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:30:46.288 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:30:46.288+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:30:46.296 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:30:46.296 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:30:46.296 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2024-05-08T18:30:46.296 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2024-05-08T18:30:46.296 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:30:46.311 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-08T18:30:46.356 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-08T18:30:46.403 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:30:46.404+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:30:46.475 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:30:46.475 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2024-05-08T18:30:46.475 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2024-05-08T18:30:46.475 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-05-08T18:30:46.475 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.475 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:30:46.475 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:48.647802+0000", 2024-05-08T18:30:46.475 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 57.825388275000002, 2024-05-08T18:30:46.475 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0027254660000000002, 2024-05-08T18:30:46.475 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:46.475 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:46.475 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:46.476 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:46.476 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:46.476 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:46.476 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 46 2024-05-08T18:30:46.476 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.476 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:46.476 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.476 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:46.476 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.647802+0000", 2024-05-08T18:30:46.476 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:46.476 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.476 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.476 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:46.477 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.647802+0000", 2024-05-08T18:30:46.477 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:46.477 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.477 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.477 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:46.477 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.647805+0000", 2024-05-08T18:30:46.477 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8940000000000002e-06 2024-05-08T18:30:46.477 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.477 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.477 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:46.477 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.647816+0000", 2024-05-08T18:30:46.477 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0998999999999999e-05 2024-05-08T18:30:46.477 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.478 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.478 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:46.478 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.647846+0000", 2024-05-08T18:30:46.478 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.027e-05 2024-05-08T18:30:46.478 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.478 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.478 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:46.478 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.647865+0000", 2024-05-08T18:30:46.478 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.808e-05 2024-05-08T18:30:46.478 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.478 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.478 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:46.478 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.647994+0000", 2024-05-08T18:30:46.479 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012923899999999999 2024-05-08T18:30:46.479 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.479 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.479 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:46.479 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.648289+0000", 2024-05-08T18:30:46.479 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029495999999999998 2024-05-08T18:30:46.479 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.479 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.479 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:46.479 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.648576+0000", 2024-05-08T18:30:46.479 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00028707599999999999 2024-05-08T18:30:46.479 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.479 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.480 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:46.480 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.649703+0000", 2024-05-08T18:30:46.480 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001126658 2024-05-08T18:30:46.480 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.480 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.480 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:46.480 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.650337+0000", 2024-05-08T18:30:46.480 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00063405500000000001 2024-05-08T18:30:46.480 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.480 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.480 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:46.480 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.650451+0000", 2024-05-08T18:30:46.480 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011476600000000001 2024-05-08T18:30:46.480 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.481 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.481 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:46.481 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.650528+0000", 2024-05-08T18:30:46.481 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6469000000000003e-05 2024-05-08T18:30:46.481 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:46.481 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:46.481 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:46.481 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.481 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.481 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94069412627456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:30:46.481 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:48.650773+0000", 2024-05-08T18:30:46.481 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 57.822417737000002, 2024-05-08T18:30:46.481 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0024358209999999999, 2024-05-08T18:30:46.482 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:46.482 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:46.482 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:46.482 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:46.482 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:46.482 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:46.482 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 47 2024-05-08T18:30:46.482 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.482 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:46.482 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.482 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:46.482 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.650773+0000", 2024-05-08T18:30:46.482 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:46.482 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.483 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.483 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:46.483 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.650773+0000", 2024-05-08T18:30:46.483 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:46.483 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.483 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.483 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:46.483 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.650775+0000", 2024-05-08T18:30:46.483 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.4030000000000001e-06 2024-05-08T18:30:46.483 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.483 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.483 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:46.483 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.650785+0000", 2024-05-08T18:30:46.484 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0027000000000001e-05 2024-05-08T18:30:46.484 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.484 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.484 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:46.484 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.650814+0000", 2024-05-08T18:30:46.484 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8350000000000001e-05 2024-05-08T18:30:46.484 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.484 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.484 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:46.484 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.650848+0000", 2024-05-08T18:30:46.484 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4566000000000001e-05 2024-05-08T18:30:46.484 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.484 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.484 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:46.485 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.650963+0000", 2024-05-08T18:30:46.485 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011506300000000001 2024-05-08T18:30:46.485 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.485 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.485 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:46.485 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.651153+0000", 2024-05-08T18:30:46.485 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000189812 2024-05-08T18:30:46.485 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.485 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.485 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:46.485 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.651493+0000", 2024-05-08T18:30:46.485 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000339616 2024-05-08T18:30:46.485 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.485 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.485 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:46.486 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.652662+0000", 2024-05-08T18:30:46.486 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0011695410000000001 2024-05-08T18:30:46.486 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.486 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.486 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:46.486 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.652998+0000", 2024-05-08T18:30:46.486 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000335788 2024-05-08T18:30:46.486 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.486 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.486 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:46.486 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.653076+0000", 2024-05-08T18:30:46.486 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8120000000000004e-05 2024-05-08T18:30:46.486 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.486 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.487 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:46.487 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.653209+0000", 2024-05-08T18:30:46.487 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000132535 2024-05-08T18:30:46.487 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:46.487 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:46.487 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:46.487 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.487 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.487 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:30:46.487 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:48.659528+0000", 2024-05-08T18:30:46.487 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 57.813662522000001, 2024-05-08T18:30:46.487 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0025123260000000001, 2024-05-08T18:30:46.487 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:46.487 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:46.488 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:46.488 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:46.488 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:46.488 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:46.488 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 54 2024-05-08T18:30:46.488 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.488 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:46.488 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.488 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:46.488 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.659528+0000", 2024-05-08T18:30:46.488 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:46.488 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.488 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.488 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:46.489 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.659528+0000", 2024-05-08T18:30:46.489 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:46.489 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.489 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.489 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:46.489 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.659530+0000", 2024-05-08T18:30:46.489 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9429999999999999e-06 2024-05-08T18:30:46.489 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.489 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.489 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:46.489 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.659540+0000", 2024-05-08T18:30:46.489 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0147e-05 2024-05-08T18:30:46.489 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.490 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.490 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:46.490 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.659569+0000", 2024-05-08T18:30:46.490 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.923e-05 2024-05-08T18:30:46.490 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.490 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.490 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:46.490 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.659584+0000", 2024-05-08T18:30:46.490 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4996e-05 2024-05-08T18:30:46.490 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.490 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.490 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:46.490 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.659716+0000", 2024-05-08T18:30:46.491 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000131457 2024-05-08T18:30:46.491 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.491 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.491 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:46.491 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.659895+0000", 2024-05-08T18:30:46.491 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017940400000000001 2024-05-08T18:30:46.491 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.491 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.491 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:46.491 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.660092+0000", 2024-05-08T18:30:46.491 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000197002 2024-05-08T18:30:46.491 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.491 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.491 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:46.492 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.661227+0000", 2024-05-08T18:30:46.492 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0011346150000000001 2024-05-08T18:30:46.492 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.492 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.492 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:46.492 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.661907+0000", 2024-05-08T18:30:46.492 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00068008800000000002 2024-05-08T18:30:46.492 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.492 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.492 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:46.492 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.661978+0000", 2024-05-08T18:30:46.492 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1538999999999994e-05 2024-05-08T18:30:46.492 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.492 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.493 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:46.493 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.662040+0000", 2024-05-08T18:30:46.493 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1904999999999998e-05 2024-05-08T18:30:46.493 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:46.493 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:46.493 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:46.493 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.493 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.493 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94069412622848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:30:46.493 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:48.662241+0000", 2024-05-08T18:30:46.493 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 57.810949196000003, 2024-05-08T18:30:46.493 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029022259999999999, 2024-05-08T18:30:46.493 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:46.494 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:46.494 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:46.494 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:46.494 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:46.494 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:46.494 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 55 2024-05-08T18:30:46.494 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.494 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:46.494 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.494 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:46.494 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.662241+0000", 2024-05-08T18:30:46.494 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:46.494 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.494 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.495 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:46.495 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.662241+0000", 2024-05-08T18:30:46.495 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:46.495 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.495 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.495 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:46.495 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.662243+0000", 2024-05-08T18:30:46.495 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.716e-06 2024-05-08T18:30:46.495 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.495 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.495 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:46.495 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.662267+0000", 2024-05-08T18:30:46.495 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3949999999999999e-05 2024-05-08T18:30:46.495 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.496 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.496 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:46.496 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.662293+0000", 2024-05-08T18:30:46.496 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6376e-05 2024-05-08T18:30:46.496 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.496 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.496 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:46.496 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.662310+0000", 2024-05-08T18:30:46.496 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6520000000000001e-05 2024-05-08T18:30:46.496 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.496 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.496 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:46.496 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.662412+0000", 2024-05-08T18:30:46.496 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010228700000000001 2024-05-08T18:30:46.497 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.497 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.497 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:46.497 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.662514+0000", 2024-05-08T18:30:46.497 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0001019 2024-05-08T18:30:46.497 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.497 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.497 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:46.497 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.662714+0000", 2024-05-08T18:30:46.497 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020008100000000001 2024-05-08T18:30:46.497 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.497 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.497 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:46.497 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.663711+0000", 2024-05-08T18:30:46.498 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00099629899999999997 2024-05-08T18:30:46.498 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.498 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.498 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:46.498 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.664976+0000", 2024-05-08T18:30:46.498 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0012652679999999999 2024-05-08T18:30:46.498 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.498 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.498 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:46.498 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.665047+0000", 2024-05-08T18:30:46.498 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1277000000000002e-05 2024-05-08T18:30:46.498 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.498 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.498 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:46.499 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.665144+0000", 2024-05-08T18:30:46.499 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6552000000000007e-05 2024-05-08T18:30:46.499 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:46.499 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:46.499 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:46.499 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.499 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.499 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:209 6.3 e33/27 6:c60da066:gc::gc.4:head v 33'1, mlcod=0'0)", 2024-05-08T18:30:46.499 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.686317+0000", 2024-05-08T18:30:46.499 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 54.786873192000002, 2024-05-08T18:30:46.499 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032126889999999999, 2024-05-08T18:30:46.499 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:46.499 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:46.499 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:46.500 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:46.500 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.500 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:46.500 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.686317+0000", 2024-05-08T18:30:46.500 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:46.500 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.500 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.500 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:46.500 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.686317+0000", 2024-05-08T18:30:46.500 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:46.500 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.500 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.500 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:46.501 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.686318+0000", 2024-05-08T18:30:46.501 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5400000000000001e-07 2024-05-08T18:30:46.501 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.501 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.501 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:46.501 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.686326+0000", 2024-05-08T18:30:46.501 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3000000000000002e-06 2024-05-08T18:30:46.501 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.501 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.501 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:46.501 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.686358+0000", 2024-05-08T18:30:46.501 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1702999999999998e-05 2024-05-08T18:30:46.501 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.501 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.502 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:46.502 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.686374+0000", 2024-05-08T18:30:46.502 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6266e-05 2024-05-08T18:30:46.502 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.502 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.502 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:46.502 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.686530+0000", 2024-05-08T18:30:46.502 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015583599999999999 2024-05-08T18:30:46.502 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.502 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.502 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:46.502 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.686573+0000", 2024-05-08T18:30:46.502 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3248999999999999e-05 2024-05-08T18:30:46.502 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.503 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.503 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:46.503 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.689412+0000", 2024-05-08T18:30:46.503 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0028385720000000001 2024-05-08T18:30:46.503 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.503 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.503 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:46.503 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.689530+0000", 2024-05-08T18:30:46.503 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000118109 2024-05-08T18:30:46.503 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:46.503 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:46.503 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:46.503 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.503 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.504 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:217 6.15 e33/27 6:ab569f81:gc::gc.12:head v 33'1, mlcod=0'0)", 2024-05-08T18:30:46.504 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.722458+0000", 2024-05-08T18:30:46.504 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 54.750732651, 2024-05-08T18:30:46.504 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001760604, 2024-05-08T18:30:46.504 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:46.504 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:46.504 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:46.504 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:46.504 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.504 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:46.504 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.722458+0000", 2024-05-08T18:30:46.504 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:46.504 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.505 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.505 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:46.505 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.722458+0000", 2024-05-08T18:30:46.505 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:46.505 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.505 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.505 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:46.505 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.722460+0000", 2024-05-08T18:30:46.505 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.677e-06 2024-05-08T18:30:46.505 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.505 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.505 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:46.505 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.722471+0000", 2024-05-08T18:30:46.505 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0956e-05 2024-05-08T18:30:46.506 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.506 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.506 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:46.506 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.722496+0000", 2024-05-08T18:30:46.506 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5490000000000002e-05 2024-05-08T18:30:46.506 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.506 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.506 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:46.506 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.722511+0000", 2024-05-08T18:30:46.506 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4687e-05 2024-05-08T18:30:46.506 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.506 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.506 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:46.506 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.722609+0000", 2024-05-08T18:30:46.507 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8152000000000005e-05 2024-05-08T18:30:46.507 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.507 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.507 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:46.507 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.722638+0000", 2024-05-08T18:30:46.507 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.934e-05 2024-05-08T18:30:46.507 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.507 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.507 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:46.507 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.724127+0000", 2024-05-08T18:30:46.507 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001488622 2024-05-08T18:30:46.507 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.507 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.507 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:46.508 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.724219+0000", 2024-05-08T18:30:46.508 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1680000000000003e-05 2024-05-08T18:30:46.508 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:46.508 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:46.508 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:46.508 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.508 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.508 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:231 6.1f e33/27 6:fde4dd55:gc::gc.26:head v 33'1, mlcod=0'0)", 2024-05-08T18:30:46.508 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.773905+0000", 2024-05-08T18:30:46.508 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 54.699285111000002, 2024-05-08T18:30:46.508 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002018681, 2024-05-08T18:30:46.508 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:46.508 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:46.509 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:46.509 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:46.509 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.509 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:46.509 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.773905+0000", 2024-05-08T18:30:46.509 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:46.509 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.509 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.509 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:46.509 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.773905+0000", 2024-05-08T18:30:46.509 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:46.509 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.509 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.509 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:46.510 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.773906+0000", 2024-05-08T18:30:46.510 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2300000000000001e-07 2024-05-08T18:30:46.510 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.510 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.510 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:46.510 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.773913+0000", 2024-05-08T18:30:46.510 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8399999999999997e-06 2024-05-08T18:30:46.510 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.510 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.510 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:46.510 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.773938+0000", 2024-05-08T18:30:46.510 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.4977000000000002e-05 2024-05-08T18:30:46.510 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.510 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.511 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:46.511 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.773970+0000", 2024-05-08T18:30:46.511 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1673e-05 2024-05-08T18:30:46.511 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.511 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.511 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:46.511 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.774112+0000", 2024-05-08T18:30:46.511 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014273899999999999 2024-05-08T18:30:46.511 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.511 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.511 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:46.511 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.774167+0000", 2024-05-08T18:30:46.511 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4762000000000002e-05 2024-05-08T18:30:46.511 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.512 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.512 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:46.512 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.775832+0000", 2024-05-08T18:30:46.512 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0016648539999999999 2024-05-08T18:30:46.512 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.512 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.512 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:46.512 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.775924+0000", 2024-05-08T18:30:46.512 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2312999999999995e-05 2024-05-08T18:30:46.512 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:46.512 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:46.512 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:46.512 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.512 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.513 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:328 6.15 e33/27 6:ab569f81:gc::gc.12:head v 33'3, mlcod=33'1)", 2024-05-08T18:30:46.513 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.811368+0000", 2024-05-08T18:30:46.513 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 54.661822610000002, 2024-05-08T18:30:46.513 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0019828110000000001, 2024-05-08T18:30:46.513 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:46.513 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:46.513 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:46.513 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:46.513 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.513 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:46.513 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.811368+0000", 2024-05-08T18:30:46.513 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:46.513 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.513 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.513 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:46.514 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.811368+0000", 2024-05-08T18:30:46.514 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:46.514 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.514 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.514 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:46.514 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.811370+0000", 2024-05-08T18:30:46.514 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.883e-06 2024-05-08T18:30:46.514 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.514 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.514 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:46.514 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.811385+0000", 2024-05-08T18:30:46.514 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5489999999999999e-05 2024-05-08T18:30:46.514 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.514 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.515 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:46.515 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.811422+0000", 2024-05-08T18:30:46.517 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7023000000000001e-05 2024-05-08T18:30:46.518 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.518 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.518 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:46.518 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.811443+0000", 2024-05-08T18:30:46.518 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0194e-05 2024-05-08T18:30:46.518 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.518 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.518 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:46.518 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.811582+0000", 2024-05-08T18:30:46.518 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000139068 2024-05-08T18:30:46.518 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.518 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.518 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:46.519 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.811646+0000", 2024-05-08T18:30:46.519 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4113000000000001e-05 2024-05-08T18:30:46.519 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.519 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.519 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:46.519 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.813243+0000", 2024-05-08T18:30:46.519 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0015969249999999999 2024-05-08T18:30:46.519 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.519 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.519 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:46.519 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.813351+0000", 2024-05-08T18:30:46.519 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000108115 2024-05-08T18:30:46.519 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:46.519 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:46.520 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:46.520 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.520 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.520 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:341 6.1 e33/27 6:856b9b26:reshard::reshard.0000000002:head v 33'2, mlcod=0'0)", 2024-05-08T18:30:46.520 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.813091+0000", 2024-05-08T18:30:46.520 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 54.660099342999999, 2024-05-08T18:30:46.520 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0021783459999999998, 2024-05-08T18:30:46.520 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:46.520 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:46.520 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:46.520 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:46.520 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.520 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:46.520 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.813091+0000", 2024-05-08T18:30:46.521 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:46.521 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.521 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.521 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:46.521 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.813091+0000", 2024-05-08T18:30:46.521 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:46.521 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.521 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.521 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:46.521 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.813093+0000", 2024-05-08T18:30:46.521 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.813e-06 2024-05-08T18:30:46.521 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.521 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.521 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:46.522 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.813107+0000", 2024-05-08T18:30:46.522 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3730000000000001e-05 2024-05-08T18:30:46.522 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.522 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.522 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:46.522 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.813177+0000", 2024-05-08T18:30:46.522 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9801999999999993e-05 2024-05-08T18:30:46.522 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.522 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.522 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:46.522 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.813198+0000", 2024-05-08T18:30:46.522 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1347000000000001e-05 2024-05-08T18:30:46.522 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.523 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.523 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:46.523 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.813321+0000", 2024-05-08T18:30:46.523 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000123192 2024-05-08T18:30:46.523 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.523 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.523 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:46.523 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.813373+0000", 2024-05-08T18:30:46.523 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2046999999999998e-05 2024-05-08T18:30:46.523 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.523 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.523 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:46.523 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.815181+0000", 2024-05-08T18:30:46.524 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001807562 2024-05-08T18:30:46.524 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.524 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.524 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:46.524 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.815270+0000", 2024-05-08T18:30:46.524 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8852999999999998e-05 2024-05-08T18:30:46.524 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:46.524 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:46.524 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:46.524 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.524 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.524 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:404 6.3 e33/27 6:c623b173:gc::gc.16:head v 33'6, mlcod=33'4)", 2024-05-08T18:30:46.524 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.837510+0000", 2024-05-08T18:30:46.525 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 54.635681032000001, 2024-05-08T18:30:46.525 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0023724549999999999, 2024-05-08T18:30:46.525 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:46.525 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:46.525 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:46.525 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:46.525 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.525 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:46.525 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.837510+0000", 2024-05-08T18:30:46.525 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:46.525 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.525 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.525 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:46.525 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.837510+0000", 2024-05-08T18:30:46.525 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:46.526 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.526 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.526 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:46.526 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.837511+0000", 2024-05-08T18:30:46.526 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.863e-06 2024-05-08T18:30:46.526 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.526 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.526 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:46.526 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.837526+0000", 2024-05-08T18:30:46.526 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4756999999999999e-05 2024-05-08T18:30:46.526 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.527 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.527 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:46.527 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.837564+0000", 2024-05-08T18:30:46.527 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7645999999999998e-05 2024-05-08T18:30:46.527 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.527 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.527 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:46.527 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.837584+0000", 2024-05-08T18:30:46.527 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9763999999999999e-05 2024-05-08T18:30:46.527 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.527 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.527 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:46.527 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.837724+0000", 2024-05-08T18:30:46.527 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014080200000000001 2024-05-08T18:30:46.528 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.528 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.528 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:46.528 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.837776+0000", 2024-05-08T18:30:46.528 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1279000000000002e-05 2024-05-08T18:30:46.528 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.528 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.528 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:46.528 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.839770+0000", 2024-05-08T18:30:46.528 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001994048 2024-05-08T18:30:46.528 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.528 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.528 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:46.528 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.839882+0000", 2024-05-08T18:30:46.529 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000112296 2024-05-08T18:30:46.529 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:46.529 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:46.529 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:46.529 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.529 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.529 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:414 6.c e33/27 6:338eb7e9:::obj_delete_at_hint.0000000008:head v 33'3, mlcod=33'1)", 2024-05-08T18:30:46.529 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.841401+0000", 2024-05-08T18:30:46.529 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 54.631789882, 2024-05-08T18:30:46.529 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001916865, 2024-05-08T18:30:46.529 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:46.529 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:46.529 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:46.529 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:46.530 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.530 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:46.530 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.841401+0000", 2024-05-08T18:30:46.530 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:46.530 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.530 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.530 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:46.530 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.841401+0000", 2024-05-08T18:30:46.530 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:46.530 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.530 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.530 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:46.530 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.841402+0000", 2024-05-08T18:30:46.531 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6899999999999999e-06 2024-05-08T18:30:46.531 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.531 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.531 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:46.531 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.841414+0000", 2024-05-08T18:30:46.531 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.183e-05 2024-05-08T18:30:46.531 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.531 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.531 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:46.531 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.841435+0000", 2024-05-08T18:30:46.531 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0876000000000001e-05 2024-05-08T18:30:46.531 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.531 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.532 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:46.532 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.841451+0000", 2024-05-08T18:30:46.532 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5784e-05 2024-05-08T18:30:46.532 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.532 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.532 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:46.532 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.841597+0000", 2024-05-08T18:30:46.532 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014639899999999999 2024-05-08T18:30:46.532 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.532 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.532 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:46.532 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.841656+0000", 2024-05-08T18:30:46.532 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8485e-05 2024-05-08T18:30:46.533 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.533 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.533 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:46.533 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.843235+0000", 2024-05-08T18:30:46.533 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0015787920000000001 2024-05-08T18:30:46.533 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.533 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.533 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:46.533 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.843318+0000", 2024-05-08T18:30:46.533 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3009000000000004e-05 2024-05-08T18:30:46.533 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:46.533 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:46.533 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:46.533 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.534 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.534 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:422 6.c e33/27 6:338eb7e9:::obj_delete_at_hint.0000000008:head v 33'4, mlcod=33'2)", 2024-05-08T18:30:46.534 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.844520+0000", 2024-05-08T18:30:46.534 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 54.628670735999997, 2024-05-08T18:30:46.534 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002269929, 2024-05-08T18:30:46.534 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:46.534 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:46.534 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:46.534 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:46.534 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.534 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:46.534 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.844520+0000", 2024-05-08T18:30:46.534 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:46.535 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.535 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.535 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:46.535 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.844520+0000", 2024-05-08T18:30:46.535 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:46.535 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.535 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.535 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:46.535 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.844522+0000", 2024-05-08T18:30:46.535 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.643e-06 2024-05-08T18:30:46.535 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.535 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.535 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:46.535 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.844577+0000", 2024-05-08T18:30:46.536 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5976000000000001e-05 2024-05-08T18:30:46.536 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.536 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.536 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:46.536 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.844613+0000", 2024-05-08T18:30:46.536 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5339999999999997e-05 2024-05-08T18:30:46.536 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.536 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.536 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:46.536 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.844638+0000", 2024-05-08T18:30:46.536 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5165999999999999e-05 2024-05-08T18:30:46.536 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.536 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.537 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:46.537 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.844795+0000", 2024-05-08T18:30:46.537 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015660899999999999 2024-05-08T18:30:46.537 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.537 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.537 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:46.537 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.844841+0000", 2024-05-08T18:30:46.537 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6279999999999997e-05 2024-05-08T18:30:46.537 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.537 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.537 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:46.537 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.846707+0000", 2024-05-08T18:30:46.537 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0018657249999999999 2024-05-08T18:30:46.538 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.538 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.538 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:46.538 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.846790+0000", 2024-05-08T18:30:46.538 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3189999999999995e-05 2024-05-08T18:30:46.538 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:46.538 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:46.538 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:46.538 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.538 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.538 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:425 6.a e33/27 6:50d64734:::obj_delete_at_hint.0000000009:head v 33'2, mlcod=0'0)", 2024-05-08T18:30:46.538 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.848220+0000", 2024-05-08T18:30:46.538 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 54.624970617999999, 2024-05-08T18:30:46.539 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0017145109999999999, 2024-05-08T18:30:46.539 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:46.539 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:46.539 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:46.539 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:46.539 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.539 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:46.539 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.848220+0000", 2024-05-08T18:30:46.539 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:46.539 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.539 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.539 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:46.539 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.848220+0000", 2024-05-08T18:30:46.539 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:46.540 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.540 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.540 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:46.540 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.848222+0000", 2024-05-08T18:30:46.540 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9630000000000001e-06 2024-05-08T18:30:46.540 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.540 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.540 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:46.540 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.848254+0000", 2024-05-08T18:30:46.540 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2047e-05 2024-05-08T18:30:46.540 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.540 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.540 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:46.541 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.848273+0000", 2024-05-08T18:30:46.541 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9493000000000001e-05 2024-05-08T18:30:46.541 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.541 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.541 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:46.541 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.848286+0000", 2024-05-08T18:30:46.541 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2490000000000001e-05 2024-05-08T18:30:46.541 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.541 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.541 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:46.541 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.848414+0000", 2024-05-08T18:30:46.541 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000127785 2024-05-08T18:30:46.541 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.542 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.542 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:46.542 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.848448+0000", 2024-05-08T18:30:46.542 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4233999999999998e-05 2024-05-08T18:30:46.542 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.542 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.542 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:46.542 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.849855+0000", 2024-05-08T18:30:46.542 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001407482 2024-05-08T18:30:46.542 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.542 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.542 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:46.543 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.849934+0000", 2024-05-08T18:30:46.543 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9017000000000006e-05 2024-05-08T18:30:46.543 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:46.543 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:46.543 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:46.543 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.543 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.543 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:436 6.a e33/27 6:55b0279d:reshard::reshard.0000000009:head v 33'4, mlcod=33'1)", 2024-05-08T18:30:46.543 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.853725+0000", 2024-05-08T18:30:46.543 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 54.619465101000003, 2024-05-08T18:30:46.543 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032824949999999999, 2024-05-08T18:30:46.543 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:46.543 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:46.543 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:46.544 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:46.544 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.544 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:46.544 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.853725+0000", 2024-05-08T18:30:46.544 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:46.544 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.544 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.544 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:46.544 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.853725+0000", 2024-05-08T18:30:46.544 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:46.544 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.544 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.544 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:46.545 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.853727+0000", 2024-05-08T18:30:46.545 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6899999999999999e-06 2024-05-08T18:30:46.545 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.545 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.545 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:46.545 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.853742+0000", 2024-05-08T18:30:46.545 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.517e-05 2024-05-08T18:30:46.545 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.545 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.545 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:46.545 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.853778+0000", 2024-05-08T18:30:46.545 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5173999999999999e-05 2024-05-08T18:30:46.545 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.546 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.546 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:46.546 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.853791+0000", 2024-05-08T18:30:46.546 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.345e-05 2024-05-08T18:30:46.546 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.546 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.546 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:46.546 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.853912+0000", 2024-05-08T18:30:46.546 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012149199999999999 2024-05-08T18:30:46.546 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.546 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.546 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:46.546 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.853960+0000", 2024-05-08T18:30:46.547 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7262999999999998e-05 2024-05-08T18:30:46.547 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.547 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.547 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:46.547 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.856896+0000", 2024-05-08T18:30:46.547 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029363700000000002 2024-05-08T18:30:46.547 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.547 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.547 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:46.547 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.857008+0000", 2024-05-08T18:30:46.547 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011188600000000001 2024-05-08T18:30:46.547 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:46.547 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:46.547 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:46.548 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.548 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.548 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:457 6.1 e33/27 6:80b6fe23:reshard::reshard.0000000011:head v 33'3, mlcod=33'1)", 2024-05-08T18:30:46.548 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.865322+0000", 2024-05-08T18:30:46.548 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 54.607868455999999, 2024-05-08T18:30:46.548 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001750756, 2024-05-08T18:30:46.548 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:46.548 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:46.548 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:46.548 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:46.548 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.548 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:46.548 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.865322+0000", 2024-05-08T18:30:46.548 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:46.549 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.549 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.549 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:46.549 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.865322+0000", 2024-05-08T18:30:46.549 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:46.549 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.549 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.549 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:46.549 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.865325+0000", 2024-05-08T18:30:46.549 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5660000000000001e-06 2024-05-08T18:30:46.549 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.549 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.549 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:46.549 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.865339+0000", 2024-05-08T18:30:46.550 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.412e-05 2024-05-08T18:30:46.550 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.550 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.550 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:46.550 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.865366+0000", 2024-05-08T18:30:46.550 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7453e-05 2024-05-08T18:30:46.550 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.550 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.550 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:46.550 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.865383+0000", 2024-05-08T18:30:46.550 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.683e-05 2024-05-08T18:30:46.550 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.551 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.551 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:46.551 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.865514+0000", 2024-05-08T18:30:46.551 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000131369 2024-05-08T18:30:46.551 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.551 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.551 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:46.551 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.865583+0000", 2024-05-08T18:30:46.551 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8526000000000001e-05 2024-05-08T18:30:46.551 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.551 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.551 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:46.551 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.866974+0000", 2024-05-08T18:30:46.551 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001391193 2024-05-08T18:30:46.552 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.552 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.552 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:46.552 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.867073+0000", 2024-05-08T18:30:46.552 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8698999999999998e-05 2024-05-08T18:30:46.552 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:46.552 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:46.552 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:46.552 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.552 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.552 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:478 6.a e33/27 6:5127e642:gc::gc.21:head v 33'6, mlcod=33'4)", 2024-05-08T18:30:46.552 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.877617+0000", 2024-05-08T18:30:46.552 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 54.595573342999998, 2024-05-08T18:30:46.552 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0033938589999999999, 2024-05-08T18:30:46.553 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:46.553 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:46.553 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:46.553 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:46.553 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.553 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:46.553 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877617+0000", 2024-05-08T18:30:46.553 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:46.553 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.553 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.553 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:46.553 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877617+0000", 2024-05-08T18:30:46.553 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:46.553 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.554 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.554 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:46.554 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877619+0000", 2024-05-08T18:30:46.554 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.902e-06 2024-05-08T18:30:46.554 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.554 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.554 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:46.554 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877633+0000", 2024-05-08T18:30:46.554 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4143e-05 2024-05-08T18:30:46.554 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.554 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.554 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:46.554 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877667+0000", 2024-05-08T18:30:46.554 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3516999999999998e-05 2024-05-08T18:30:46.555 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.555 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.555 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:46.555 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877685+0000", 2024-05-08T18:30:46.555 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7931000000000002e-05 2024-05-08T18:30:46.555 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.555 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.555 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:46.555 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877842+0000", 2024-05-08T18:30:46.555 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015742800000000001 2024-05-08T18:30:46.555 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.555 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.555 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:46.555 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877890+0000", 2024-05-08T18:30:46.556 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7654000000000001e-05 2024-05-08T18:30:46.556 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.556 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.556 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:46.556 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.880908+0000", 2024-05-08T18:30:46.556 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0030181219999999998 2024-05-08T18:30:46.556 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.556 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.556 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:46.556 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.881011+0000", 2024-05-08T18:30:46.556 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000103162 2024-05-08T18:30:46.556 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:46.556 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:46.556 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:46.557 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.557 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.557 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:535 6.1f e33/27 6:fde4dd55:gc::gc.26:head v 33'2, mlcod=0'0)", 2024-05-08T18:30:46.557 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.909602+0000", 2024-05-08T18:30:46.557 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 54.563588897999999, 2024-05-08T18:30:46.557 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0023004039999999998, 2024-05-08T18:30:46.557 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:46.557 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:46.557 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:46.557 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:46.557 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.557 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:46.557 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.909602+0000", 2024-05-08T18:30:46.557 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:46.558 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.558 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.558 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:46.558 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.909602+0000", 2024-05-08T18:30:46.558 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:46.558 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.558 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.558 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:46.558 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.909604+0000", 2024-05-08T18:30:46.558 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8360000000000001e-06 2024-05-08T18:30:46.558 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.558 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.558 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:46.558 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.909615+0000", 2024-05-08T18:30:46.559 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1596999999999999e-05 2024-05-08T18:30:46.559 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.559 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.559 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:46.559 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.909643+0000", 2024-05-08T18:30:46.559 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7457000000000002e-05 2024-05-08T18:30:46.559 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.559 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.559 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:46.559 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.909662+0000", 2024-05-08T18:30:46.559 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9052999999999999e-05 2024-05-08T18:30:46.559 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.559 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.559 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:46.560 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.909758+0000", 2024-05-08T18:30:46.560 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6372000000000005e-05 2024-05-08T18:30:46.560 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.560 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.560 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:46.560 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.909780+0000", 2024-05-08T18:30:46.560 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1719999999999999e-05 2024-05-08T18:30:46.560 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.560 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.560 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:46.561 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.911830+0000", 2024-05-08T18:30:46.561 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002050072 2024-05-08T18:30:46.561 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.561 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.561 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:46.561 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.911902+0000", 2024-05-08T18:30:46.561 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.2297000000000003e-05 2024-05-08T18:30:46.561 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:46.561 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:46.561 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:46.561 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.561 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.561 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:541 6.1f e33/27 6:fde4dd55:gc::gc.26:head v 33'3, mlcod=33'1)", 2024-05-08T18:30:46.562 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.913684+0000", 2024-05-08T18:30:46.562 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 54.559506849999998, 2024-05-08T18:30:46.562 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0036425770000000001, 2024-05-08T18:30:46.562 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:46.562 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:46.562 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:46.562 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:46.562 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.562 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:46.562 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.913684+0000", 2024-05-08T18:30:46.562 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:46.562 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.562 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.562 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:46.563 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.913684+0000", 2024-05-08T18:30:46.563 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:46.563 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.563 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.563 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:46.563 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.913685+0000", 2024-05-08T18:30:46.563 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5859999999999999e-06 2024-05-08T18:30:46.563 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.563 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.563 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:46.563 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.913696+0000", 2024-05-08T18:30:46.563 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1080000000000001e-05 2024-05-08T18:30:46.563 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.563 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.564 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:46.564 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.913720+0000", 2024-05-08T18:30:46.564 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3614000000000001e-05 2024-05-08T18:30:46.564 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.564 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.564 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:46.564 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.913740+0000", 2024-05-08T18:30:46.564 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9836000000000001e-05 2024-05-08T18:30:46.564 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.564 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.564 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:46.564 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.913901+0000", 2024-05-08T18:30:46.564 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000161039 2024-05-08T18:30:46.565 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.565 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.565 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:46.565 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.913935+0000", 2024-05-08T18:30:46.565 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4353000000000001e-05 2024-05-08T18:30:46.565 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.565 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.565 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:46.565 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.917225+0000", 2024-05-08T18:30:46.566 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032897669999999999 2024-05-08T18:30:46.566 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.566 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.566 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:46.566 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.917326+0000", 2024-05-08T18:30:46.566 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000101302 2024-05-08T18:30:46.566 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:46.566 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:46.566 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:46.566 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.566 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.566 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:543 6.15 e33/27 6:ae95b544:::obj_delete_at_hint.0000000020:head v 33'5, mlcod=33'3)", 2024-05-08T18:30:46.566 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.916649+0000", 2024-05-08T18:30:46.566 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 54.556541297000003, 2024-05-08T18:30:46.567 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003362739, 2024-05-08T18:30:46.567 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:46.567 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:46.567 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:46.567 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:46.567 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.567 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:46.567 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.916649+0000", 2024-05-08T18:30:46.567 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:46.567 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.567 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.567 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:46.567 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.916649+0000", 2024-05-08T18:30:46.568 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:46.568 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.568 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.568 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:46.568 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.916651+0000", 2024-05-08T18:30:46.568 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7269999999999999e-06 2024-05-08T18:30:46.568 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.568 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.568 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:46.568 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.916663+0000", 2024-05-08T18:30:46.568 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2183e-05 2024-05-08T18:30:46.568 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.568 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.569 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:46.569 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.916691+0000", 2024-05-08T18:30:46.569 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7864e-05 2024-05-08T18:30:46.569 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.569 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.569 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:46.569 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.916710+0000", 2024-05-08T18:30:46.569 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.912e-05 2024-05-08T18:30:46.569 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.569 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.569 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:46.569 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.916851+0000", 2024-05-08T18:30:46.569 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000141163 2024-05-08T18:30:46.570 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.570 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.570 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:46.570 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.916909+0000", 2024-05-08T18:30:46.570 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.7686000000000003e-05 2024-05-08T18:30:46.570 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.570 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.570 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:46.570 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.919900+0000", 2024-05-08T18:30:46.570 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029909540000000001 2024-05-08T18:30:46.570 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.570 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.570 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:46.571 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.920012+0000", 2024-05-08T18:30:46.571 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000112042 2024-05-08T18:30:46.571 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:46.571 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:46.571 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:46.571 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.571 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.571 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:695 6.3 e33/27 6:c31f41d7:gc::gc.10:head v 33'12, mlcod=33'10)", 2024-05-08T18:30:46.571 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.017806+0000", 2024-05-08T18:30:46.571 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 54.455385012999997, 2024-05-08T18:30:46.571 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001718373, 2024-05-08T18:30:46.571 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:46.571 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:46.572 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:46.572 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:46.572 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.572 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:46.572 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.017806+0000", 2024-05-08T18:30:46.572 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:46.572 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.572 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.572 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:46.572 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.017806+0000", 2024-05-08T18:30:46.572 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:46.572 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.572 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.573 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:46.573 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.017807+0000", 2024-05-08T18:30:46.573 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8199999999999999e-06 2024-05-08T18:30:46.573 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.573 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.573 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:46.573 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.017818+0000", 2024-05-08T18:30:46.573 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0519999999999999e-05 2024-05-08T18:30:46.573 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.573 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.573 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:46.573 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.017846+0000", 2024-05-08T18:30:46.573 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7729000000000002e-05 2024-05-08T18:30:46.573 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.574 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.574 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:46.574 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.017859+0000", 2024-05-08T18:30:46.574 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3337e-05 2024-05-08T18:30:46.574 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.574 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.574 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:46.574 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.017990+0000", 2024-05-08T18:30:46.574 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013146499999999999 2024-05-08T18:30:46.574 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.574 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.574 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:46.574 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.018039+0000", 2024-05-08T18:30:46.575 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8816999999999997e-05 2024-05-08T18:30:46.575 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.575 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.575 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:46.575 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.019397+0000", 2024-05-08T18:30:46.575 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0013575359999999999 2024-05-08T18:30:46.575 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:46.575 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:46.575 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:46.575 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.019524+0000", 2024-05-08T18:30:46.575 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012714900000000001 2024-05-08T18:30:46.575 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:46.575 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:46.575 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:46.576 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:46.576 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:46.576 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:30:46.577 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2024-05-08T18:30:46.577 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:30:46.578 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2024-05-08T18:30:46.578 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:30:46.579 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-08T18:30:46.579 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:30:46.575+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:30:46.579 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2024-05-08T18:30:46.580 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:30:46.580 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2024-05-08T18:30:46.580 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:30:46.583 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2024-05-08T18:30:46.583 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:30:46.603 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2024-05-08T18:30:46.603 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:30:46.624 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2024-05-08T18:30:46.624 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:30:46.643 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2024-05-08T18:30:46.643 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:30:46.677 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:30:46.675+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:30:46.752 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:46.752 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:46.767 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-08T18:30:46.808 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:30:46.807+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:30:46.880 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:30:46.880+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:30:46.929 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:46.929 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:46.943 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-08T18:30:46.988 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:30:46.987+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:30:47.065 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:47.065 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:47.079 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-08T18:30:47.081 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:30:47.080+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:30:47.182 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:30:47.183+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:30:47.210 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:47.210 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:47.224 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-08T18:30:47.283 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:30:47.284+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:30:47.346 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:47.346 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:47.360 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-08T18:30:47.403 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:30:47.404+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:30:47.485 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:30:47.483+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:30:47.528 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:47.528 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:47.542 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-08T18:30:47.586 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:30:47.588+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:30:47.589 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-08T18:30:47.667 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:47.667 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:47.682 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-08T18:30:47.726 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:30:47.728+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:30:47.787 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:30:47.788+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:30:47.798 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:47.798 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:47.812 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-08T18:30:47.888 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:30:47.883+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:30:47.977 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:47.977 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:47.988 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:30:47.987+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:30:47.991 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-08T18:30:48.090 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:30:48.088+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:30:48.109 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:48.109 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:48.122 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-08T18:30:48.206 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:30:48.208+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:30:48.285 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:48.285 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:48.292 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:30:48.292+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:30:48.299 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-08T18:30:48.393 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:30:48.392+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:30:48.475 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:48.475 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:48.489 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-08T18:30:48.531 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:30:48.532+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:30:48.564 INFO:teuthology.orchestra.run.smithi097.stderr:noscrub is set 2024-05-08T18:30:48.631 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:30:48.632+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:30:48.658 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:48.659 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:48.661 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-08T18:30:48.674 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-08T18:30:48.719 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:30:48.720+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:30:48.797 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:30:48.795+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:30:48.803 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2024-05-08T18:30:48.803 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:30:48.818 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2024-05-08T18:30:48.819 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:30:48.835 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2024-05-08T18:30:48.835 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:30:48.846 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:48.846 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:48.850 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2024-05-08T18:30:48.850 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:30:48.860 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-08T18:30:48.871 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2024-05-08T18:30:48.871 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:30:48.891 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2024-05-08T18:30:48.891 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:30:48.897 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:30:48.896+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:30:48.911 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2024-05-08T18:30:48.911 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:30:48.931 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2024-05-08T18:30:48.932 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:30:48.973 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:30:48.973 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2024-05-08T18:30:48.974 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2024-05-08T18:30:48.974 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-05-08T18:30:48.974 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:48.974 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:57 7.3 7:c609908c:::notify.5:head [watch watch cookie 94069412621696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:30:48.974 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:48.668590+0000", 2024-05-08T18:30:48.974 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 60.305901194999997, 2024-05-08T18:30:48.974 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0054375830000000002, 2024-05-08T18:30:48.974 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:48.974 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:48.974 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:48.974 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:48.974 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:48.974 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:48.975 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 57 2024-05-08T18:30:48.975 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:48.975 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:48.975 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:48.975 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:48.975 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668590+0000", 2024-05-08T18:30:48.975 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:48.975 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:48.975 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:48.975 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:48.975 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668590+0000", 2024-05-08T18:30:48.975 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:48.975 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:48.976 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:48.976 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:48.976 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668592+0000", 2024-05-08T18:30:48.976 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0930000000000001e-06 2024-05-08T18:30:48.976 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:48.976 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:48.976 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:48.976 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668619+0000", 2024-05-08T18:30:48.976 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7396999999999999e-05 2024-05-08T18:30:48.976 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:48.976 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:48.976 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:48.976 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668650+0000", 2024-05-08T18:30:48.976 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0620000000000002e-05 2024-05-08T18:30:48.977 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:48.977 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:48.977 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:48.977 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668672+0000", 2024-05-08T18:30:48.977 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2093e-05 2024-05-08T18:30:48.977 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:48.977 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:48.977 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:48.977 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668782+0000", 2024-05-08T18:30:48.977 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011010600000000001 2024-05-08T18:30:48.977 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:48.977 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:48.977 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:48.977 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668934+0000", 2024-05-08T18:30:48.978 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000152268 2024-05-08T18:30:48.978 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:48.978 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:48.978 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-05-08T18:30:48.978 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669177+0000", 2024-05-08T18:30:48.978 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024286500000000001 2024-05-08T18:30:48.978 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:48.978 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:48.978 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:48.978 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.670404+0000", 2024-05-08T18:30:48.978 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001226932 2024-05-08T18:30:48.978 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:48.978 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:48.979 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:48.979 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.673822+0000", 2024-05-08T18:30:48.979 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003417776 2024-05-08T18:30:48.979 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:48.979 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:48.979 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:48.979 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.673924+0000", 2024-05-08T18:30:48.979 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000102379 2024-05-08T18:30:48.979 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:48.979 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:48.979 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:48.979 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674027+0000", 2024-05-08T18:30:48.979 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010305400000000001 2024-05-08T18:30:48.979 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:48.980 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:48.980 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:48.980 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:48.980 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:48.980 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:58 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:30:48.980 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:48.668750+0000", 2024-05-08T18:30:48.980 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 60.305740769000003, 2024-05-08T18:30:48.980 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0057687559999999999, 2024-05-08T18:30:48.980 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:48.980 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:48.980 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:48.980 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:48.980 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:48.981 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:48.981 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 58 2024-05-08T18:30:48.981 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:48.981 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:48.981 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:48.981 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:48.981 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668750+0000", 2024-05-08T18:30:48.981 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:48.981 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:48.981 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:48.981 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:48.981 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668750+0000", 2024-05-08T18:30:48.981 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:48.981 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:48.982 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:48.982 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:48.982 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668752+0000", 2024-05-08T18:30:48.982 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.64e-06 2024-05-08T18:30:48.982 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:48.982 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:48.982 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:48.982 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668760+0000", 2024-05-08T18:30:48.982 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5529999999999993e-06 2024-05-08T18:30:48.982 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:48.982 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:48.982 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:48.982 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668787+0000", 2024-05-08T18:30:48.982 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6475999999999999e-05 2024-05-08T18:30:48.983 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:48.983 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:48.983 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:48.983 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668804+0000", 2024-05-08T18:30:48.983 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7163000000000002e-05 2024-05-08T18:30:48.983 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:48.983 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:48.983 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:48.983 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668906+0000", 2024-05-08T18:30:48.984 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010241 2024-05-08T18:30:48.984 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:48.984 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:48.984 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:48.984 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669068+0000", 2024-05-08T18:30:48.984 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016144400000000001 2024-05-08T18:30:48.984 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:48.984 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:48.984 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-05-08T18:30:48.984 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669226+0000", 2024-05-08T18:30:48.985 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000158639 2024-05-08T18:30:48.985 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:48.985 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:48.985 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:48.985 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.670439+0000", 2024-05-08T18:30:48.985 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012124480000000001 2024-05-08T18:30:48.985 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:48.985 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:48.985 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:48.985 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674406+0000", 2024-05-08T18:30:48.985 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0039675259999999999 2024-05-08T18:30:48.985 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:48.985 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:48.985 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:48.986 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674469+0000", 2024-05-08T18:30:48.986 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.2903000000000004e-05 2024-05-08T18:30:48.986 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:48.986 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:48.986 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:48.986 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674519+0000", 2024-05-08T18:30:48.986 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9554e-05 2024-05-08T18:30:48.986 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:48.986 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:48.986 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:48.987 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:48.987 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:48.987 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:30:48.987 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.675404+0000", 2024-05-08T18:30:48.987 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 57.299086998, 2024-05-08T18:30:48.987 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003903147, 2024-05-08T18:30:48.987 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:48.987 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:48.987 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:48.987 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:48.988 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:48.988 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:48.988 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 207 2024-05-08T18:30:48.988 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:48.988 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:48.988 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:48.988 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:48.988 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675404+0000", 2024-05-08T18:30:48.988 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:48.988 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:48.988 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:48.988 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:48.988 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675404+0000", 2024-05-08T18:30:48.988 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:48.988 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:48.989 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:48.989 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:48.989 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675407+0000", 2024-05-08T18:30:48.989 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1729999999999999e-06 2024-05-08T18:30:48.989 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:48.989 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:48.989 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:48.989 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675422+0000", 2024-05-08T18:30:48.989 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.485e-05 2024-05-08T18:30:48.989 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:48.989 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:48.989 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:48.989 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675454+0000", 2024-05-08T18:30:48.990 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1656000000000003e-05 2024-05-08T18:30:48.990 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:48.990 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:48.990 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:48.990 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675470+0000", 2024-05-08T18:30:48.990 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.626e-05 2024-05-08T18:30:48.990 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:48.990 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:48.990 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:48.990 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675683+0000", 2024-05-08T18:30:48.990 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021312600000000001 2024-05-08T18:30:48.990 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:48.990 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:48.991 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:48.991 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675972+0000", 2024-05-08T18:30:48.991 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00028885100000000002 2024-05-08T18:30:48.991 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:48.991 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:48.991 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:30:48.991 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.676369+0000", 2024-05-08T18:30:48.991 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000397227 2024-05-08T18:30:48.991 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:48.991 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:48.991 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:48.991 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.677780+0000", 2024-05-08T18:30:48.991 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001411186 2024-05-08T18:30:48.991 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:48.992 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:48.992 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:48.992 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679153+0000", 2024-05-08T18:30:48.992 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0013725720000000001 2024-05-08T18:30:48.992 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:48.992 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:48.992 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:48.992 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679240+0000", 2024-05-08T18:30:48.992 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7412999999999998e-05 2024-05-08T18:30:48.992 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:48.992 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:48.992 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:48.992 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679307+0000", 2024-05-08T18:30:48.992 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6833000000000002e-05 2024-05-08T18:30:48.993 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:48.993 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:48.993 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:48.993 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:48.993 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:48.993 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:48.993 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.721317+0000", 2024-05-08T18:30:48.993 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 57.253174252000001, 2024-05-08T18:30:48.993 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032842140000000001, 2024-05-08T18:30:48.993 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:48.993 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:48.993 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:48.993 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:48.993 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:48.994 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:48.994 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 216 2024-05-08T18:30:48.994 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:48.994 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:48.994 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:48.994 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:48.994 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.721317+0000", 2024-05-08T18:30:48.994 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:48.994 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:48.994 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:48.994 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:48.994 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.721317+0000", 2024-05-08T18:30:48.994 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:48.995 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:48.995 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:48.995 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:48.995 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.721320+0000", 2024-05-08T18:30:48.995 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.303e-06 2024-05-08T18:30:48.995 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:48.995 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:48.995 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:48.995 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.721335+0000", 2024-05-08T18:30:48.995 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4543e-05 2024-05-08T18:30:48.995 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:48.995 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:48.995 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:48.995 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.721370+0000", 2024-05-08T18:30:48.996 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5336000000000002e-05 2024-05-08T18:30:48.996 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:48.996 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:48.996 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:48.996 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.721393+0000", 2024-05-08T18:30:48.996 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2710000000000001e-05 2024-05-08T18:30:48.996 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:48.996 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:48.996 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:48.996 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.721592+0000", 2024-05-08T18:30:48.996 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00019917900000000001 2024-05-08T18:30:48.996 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:48.996 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:48.996 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:48.997 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.721815+0000", 2024-05-08T18:30:48.997 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000223742 2024-05-08T18:30:48.997 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:48.997 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:48.997 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:48.997 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.722268+0000", 2024-05-08T18:30:48.997 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00045295900000000001 2024-05-08T18:30:48.997 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:48.997 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:48.997 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:48.997 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.723878+0000", 2024-05-08T18:30:48.997 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001609828 2024-05-08T18:30:48.997 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:48.997 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:48.998 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:48.998 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.724433+0000", 2024-05-08T18:30:48.998 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00055512499999999995 2024-05-08T18:30:48.998 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:48.998 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:48.998 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:48.998 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.724528+0000", 2024-05-08T18:30:48.998 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.4887000000000001e-05 2024-05-08T18:30:48.998 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:48.998 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:48.998 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:48.998 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.724601+0000", 2024-05-08T18:30:48.998 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2601999999999994e-05 2024-05-08T18:30:48.999 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:48.999 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:48.999 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:48.999 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:48.999 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:48.999 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:48.999 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.761586+0000", 2024-05-08T18:30:48.999 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 57.212905405999997, 2024-05-08T18:30:48.999 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031756979999999998, 2024-05-08T18:30:48.999 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:48.999 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:48.999 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:48.999 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:48.999 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:48.999 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:49.000 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 227 2024-05-08T18:30:49.000 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.000 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:49.000 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.000 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:49.000 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.761586+0000", 2024-05-08T18:30:49.000 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:49.000 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.000 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.000 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:49.000 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.761586+0000", 2024-05-08T18:30:49.000 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:49.000 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.000 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.001 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:49.001 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.761588+0000", 2024-05-08T18:30:49.001 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7499999999999999e-06 2024-05-08T18:30:49.001 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.001 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.001 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:49.001 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.761600+0000", 2024-05-08T18:30:49.001 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2003e-05 2024-05-08T18:30:49.001 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.001 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.001 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:49.001 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.761632+0000", 2024-05-08T18:30:49.001 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1933000000000001e-05 2024-05-08T18:30:49.001 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.002 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.002 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:49.002 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.761648+0000", 2024-05-08T18:30:49.002 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5339999999999999e-05 2024-05-08T18:30:49.002 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.002 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.002 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:49.002 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.761773+0000", 2024-05-08T18:30:49.002 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012576199999999999 2024-05-08T18:30:49.002 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.002 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.002 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:49.002 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.762037+0000", 2024-05-08T18:30:49.003 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00026385100000000001 2024-05-08T18:30:49.003 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.003 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.003 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:49.003 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.762455+0000", 2024-05-08T18:30:49.003 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00041760700000000002 2024-05-08T18:30:49.003 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.003 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.003 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:49.003 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.764035+0000", 2024-05-08T18:30:49.003 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001580318 2024-05-08T18:30:49.003 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.003 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.003 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:49.004 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.764602+0000", 2024-05-08T18:30:49.004 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00056661899999999998 2024-05-08T18:30:49.004 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.004 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.004 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:49.004 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.764685+0000", 2024-05-08T18:30:49.004 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.3562999999999999e-05 2024-05-08T18:30:49.004 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.004 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.004 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:49.004 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.764761+0000", 2024-05-08T18:30:49.004 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.5951999999999994e-05 2024-05-08T18:30:49.004 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:49.004 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:49.004 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:49.005 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.005 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.005 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:49.005 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.768858+0000", 2024-05-08T18:30:49.005 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 57.205632823000002, 2024-05-08T18:30:49.005 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031906619999999999, 2024-05-08T18:30:49.005 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:49.005 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:49.005 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:49.005 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:49.005 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:49.005 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:49.006 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 229 2024-05-08T18:30:49.006 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.006 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:49.006 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.006 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:49.006 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.768858+0000", 2024-05-08T18:30:49.006 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:49.006 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.006 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.006 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:49.006 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.768858+0000", 2024-05-08T18:30:49.006 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:49.006 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.007 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.007 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:49.007 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.768861+0000", 2024-05-08T18:30:49.007 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5469999999999999e-06 2024-05-08T18:30:49.007 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.007 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.007 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:49.007 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.768872+0000", 2024-05-08T18:30:49.007 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1712999999999999e-05 2024-05-08T18:30:49.007 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.007 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.007 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:49.007 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.768903+0000", 2024-05-08T18:30:49.008 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0636000000000003e-05 2024-05-08T18:30:49.008 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.008 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.008 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:49.008 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.768918+0000", 2024-05-08T18:30:49.008 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4977000000000001e-05 2024-05-08T18:30:49.008 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.008 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.008 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:49.008 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.769037+0000", 2024-05-08T18:30:49.008 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011918599999999999 2024-05-08T18:30:49.008 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.008 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.008 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:49.009 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.769256+0000", 2024-05-08T18:30:49.009 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021839400000000001 2024-05-08T18:30:49.009 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.009 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.009 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:30:49.009 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.769656+0000", 2024-05-08T18:30:49.009 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00040066400000000001 2024-05-08T18:30:49.009 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.009 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.009 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:49.009 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.771116+0000", 2024-05-08T18:30:49.009 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001459389 2024-05-08T18:30:49.009 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.009 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.010 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:49.010 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.771896+0000", 2024-05-08T18:30:49.010 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00077997400000000001 2024-05-08T18:30:49.010 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.010 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.010 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:49.010 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.771984+0000", 2024-05-08T18:30:49.010 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8483e-05 2024-05-08T18:30:49.010 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.010 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.010 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:49.010 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772049+0000", 2024-05-08T18:30:49.010 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.4698999999999998e-05 2024-05-08T18:30:49.011 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:49.011 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:49.011 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:49.011 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.011 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.011 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:49.011 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.776086+0000", 2024-05-08T18:30:49.011 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 57.198404832000001, 2024-05-08T18:30:49.011 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0037528710000000001, 2024-05-08T18:30:49.011 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:49.011 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:49.011 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:49.011 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:49.011 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:49.012 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:49.012 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 231 2024-05-08T18:30:49.012 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.012 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:49.012 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.012 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:49.012 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.776086+0000", 2024-05-08T18:30:49.012 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:49.012 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.012 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.012 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:49.012 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.776086+0000", 2024-05-08T18:30:49.012 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:49.012 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.013 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.013 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:49.013 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.776089+0000", 2024-05-08T18:30:49.013 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8870000000000001e-06 2024-05-08T18:30:49.013 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.013 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.013 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:49.013 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.776102+0000", 2024-05-08T18:30:49.013 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.294e-05 2024-05-08T18:30:49.013 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.013 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.013 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:49.013 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.776132+0000", 2024-05-08T18:30:49.013 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0113000000000001e-05 2024-05-08T18:30:49.014 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.014 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.014 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:49.014 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.776150+0000", 2024-05-08T18:30:49.014 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8216999999999999e-05 2024-05-08T18:30:49.014 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.014 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.014 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:49.014 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.776268+0000", 2024-05-08T18:30:49.014 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000117395 2024-05-08T18:30:49.014 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.014 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.014 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:49.015 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.776514+0000", 2024-05-08T18:30:49.015 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024602899999999999 2024-05-08T18:30:49.015 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.015 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.015 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:49.015 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.776920+0000", 2024-05-08T18:30:49.015 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000406723 2024-05-08T18:30:49.015 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.015 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.015 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:49.015 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.778360+0000", 2024-05-08T18:30:49.015 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0014393279999999999 2024-05-08T18:30:49.015 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.016 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.016 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:49.016 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.779687+0000", 2024-05-08T18:30:49.016 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001327674 2024-05-08T18:30:49.016 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.016 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.016 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:49.016 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.779777+0000", 2024-05-08T18:30:49.016 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9152000000000003e-05 2024-05-08T18:30:49.016 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.016 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.017 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:49.017 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.779839+0000", 2024-05-08T18:30:49.017 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.2413e-05 2024-05-08T18:30:49.017 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:49.017 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:49.017 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:49.017 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.017 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.017 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:257 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:49.017 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.802295+0000", 2024-05-08T18:30:49.017 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 57.172195692000003, 2024-05-08T18:30:49.017 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0030517880000000002, 2024-05-08T18:30:49.017 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:49.018 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:49.018 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:49.018 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:49.018 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:49.018 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:49.018 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 257 2024-05-08T18:30:49.018 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.018 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:49.018 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.018 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:49.018 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.802295+0000", 2024-05-08T18:30:49.018 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:49.018 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.019 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.019 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:49.019 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.802295+0000", 2024-05-08T18:30:49.019 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:49.019 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.019 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.019 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:49.019 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.802296+0000", 2024-05-08T18:30:49.019 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.6700000000000002e-07 2024-05-08T18:30:49.019 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.019 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.019 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:49.019 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.802301+0000", 2024-05-08T18:30:49.020 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.0250000000000002e-06 2024-05-08T18:30:49.020 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.020 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.020 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:49.020 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.802321+0000", 2024-05-08T18:30:49.020 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9521000000000002e-05 2024-05-08T18:30:49.020 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.020 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.020 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:49.020 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.802330+0000", 2024-05-08T18:30:49.020 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.4259999999999992e-06 2024-05-08T18:30:49.020 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.020 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.021 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:49.021 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.802386+0000", 2024-05-08T18:30:49.021 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5974999999999999e-05 2024-05-08T18:30:49.021 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.021 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.021 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:49.021 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.802463+0000", 2024-05-08T18:30:49.021 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6582999999999995e-05 2024-05-08T18:30:49.021 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.021 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.021 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:49.021 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.802613+0000", 2024-05-08T18:30:49.021 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000150715 2024-05-08T18:30:49.021 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.022 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.022 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:49.022 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.803223+0000", 2024-05-08T18:30:49.022 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00060949799999999998 2024-05-08T18:30:49.022 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.022 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.022 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:49.022 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.805250+0000", 2024-05-08T18:30:49.022 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0020268339999999999 2024-05-08T18:30:49.022 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.022 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.022 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:49.022 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.805303+0000", 2024-05-08T18:30:49.022 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3562e-05 2024-05-08T18:30:49.023 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.023 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.023 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:49.023 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.805347+0000", 2024-05-08T18:30:49.023 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3682e-05 2024-05-08T18:30:49.023 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:49.023 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:49.023 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:49.023 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.023 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.023 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:422 6.c 6:338eb7e9:::obj_delete_at_hint.0000000008:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:49.023 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.847436+0000", 2024-05-08T18:30:49.023 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 57.127054629, 2024-05-08T18:30:49.023 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0029413439999999998, 2024-05-08T18:30:49.024 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:49.024 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:49.024 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:49.024 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:49.024 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:49.024 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:49.024 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 422 2024-05-08T18:30:49.024 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.024 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:49.024 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.024 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:49.024 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847436+0000", 2024-05-08T18:30:49.024 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:49.024 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.025 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.025 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:49.025 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847436+0000", 2024-05-08T18:30:49.025 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:49.025 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.025 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.025 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:49.025 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847437+0000", 2024-05-08T18:30:49.025 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.009e-06 2024-05-08T18:30:49.025 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.025 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.025 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:49.025 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847442+0000", 2024-05-08T18:30:49.025 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9049999999999996e-06 2024-05-08T18:30:49.025 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.026 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.026 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:49.026 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847454+0000", 2024-05-08T18:30:49.026 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1358e-05 2024-05-08T18:30:49.026 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.026 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.026 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:49.026 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847459+0000", 2024-05-08T18:30:49.026 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7180000000000001e-06 2024-05-08T18:30:49.026 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.026 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.026 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:49.026 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847516+0000", 2024-05-08T18:30:49.027 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6558999999999998e-05 2024-05-08T18:30:49.027 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.027 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.027 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:49.027 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847582+0000", 2024-05-08T18:30:49.027 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5772000000000007e-05 2024-05-08T18:30:49.027 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.027 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.027 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:49.027 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847718+0000", 2024-05-08T18:30:49.027 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013664100000000001 2024-05-08T18:30:49.027 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.027 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.027 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:49.027 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.848257+0000", 2024-05-08T18:30:49.028 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00053853699999999996 2024-05-08T18:30:49.028 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.028 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.028 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:49.028 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.850320+0000", 2024-05-08T18:30:49.028 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0020627530000000001 2024-05-08T18:30:49.028 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.028 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.028 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:49.028 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.850351+0000", 2024-05-08T18:30:49.028 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1501000000000002e-05 2024-05-08T18:30:49.028 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.028 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.028 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:49.029 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.850378+0000", 2024-05-08T18:30:49.029 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6591e-05 2024-05-08T18:30:49.029 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:49.029 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:49.029 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:49.029 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.029 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.029 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:535 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:49.029 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.912581+0000", 2024-05-08T18:30:49.029 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 57.061909569000001, 2024-05-08T18:30:49.029 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002943775, 2024-05-08T18:30:49.029 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:49.029 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:49.029 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:49.030 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:49.030 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:49.030 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:49.030 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 535 2024-05-08T18:30:49.030 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.030 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:49.030 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.030 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:49.030 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912581+0000", 2024-05-08T18:30:49.030 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:49.030 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.030 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.030 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:49.030 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912581+0000", 2024-05-08T18:30:49.031 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:49.031 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.031 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.031 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:49.031 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912582+0000", 2024-05-08T18:30:49.031 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.093e-06 2024-05-08T18:30:49.031 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.031 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.031 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:49.031 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912588+0000", 2024-05-08T18:30:49.031 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3920000000000002e-06 2024-05-08T18:30:49.031 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.031 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.032 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:49.032 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912601+0000", 2024-05-08T18:30:49.032 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2911000000000001e-05 2024-05-08T18:30:49.032 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.032 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.032 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:49.032 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912607+0000", 2024-05-08T18:30:49.032 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3960000000000003e-06 2024-05-08T18:30:49.032 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.032 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.032 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:49.032 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912664+0000", 2024-05-08T18:30:49.032 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6410999999999999e-05 2024-05-08T18:30:49.032 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.032 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.033 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:49.033 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912721+0000", 2024-05-08T18:30:49.033 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7141000000000001e-05 2024-05-08T18:30:49.033 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.033 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.033 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:49.033 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912842+0000", 2024-05-08T18:30:49.033 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000120868 2024-05-08T18:30:49.033 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.033 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.033 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:49.033 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.913333+0000", 2024-05-08T18:30:49.033 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00049123600000000004 2024-05-08T18:30:49.033 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.034 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.034 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:49.034 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.915446+0000", 2024-05-08T18:30:49.034 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0021135020000000002 2024-05-08T18:30:49.034 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.034 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.034 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:49.034 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.915481+0000", 2024-05-08T18:30:49.034 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4304999999999998e-05 2024-05-08T18:30:49.034 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.034 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.034 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:49.034 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.915525+0000", 2024-05-08T18:30:49.035 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4520000000000001e-05 2024-05-08T18:30:49.035 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:49.035 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:49.035 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:49.035 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.035 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.035 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:541 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:49.035 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.916718+0000", 2024-05-08T18:30:49.035 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 57.057772733999997, 2024-05-08T18:30:49.035 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0041779829999999997, 2024-05-08T18:30:49.035 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:49.035 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:49.035 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:49.035 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:49.036 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:49.036 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:49.036 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 541 2024-05-08T18:30:49.036 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.036 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:49.036 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.036 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:49.036 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.916718+0000", 2024-05-08T18:30:49.036 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:49.036 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.036 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.036 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:49.036 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.916718+0000", 2024-05-08T18:30:49.036 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:49.037 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.037 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.037 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:49.037 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.916719+0000", 2024-05-08T18:30:49.037 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0100000000000005e-07 2024-05-08T18:30:49.037 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.037 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.037 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:49.037 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.916722+0000", 2024-05-08T18:30:49.037 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7760000000000002e-06 2024-05-08T18:30:49.037 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.037 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.037 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:49.037 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.916729+0000", 2024-05-08T18:30:49.038 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.8290000000000008e-06 2024-05-08T18:30:49.038 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.038 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.038 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:49.038 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.916734+0000", 2024-05-08T18:30:49.038 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3109999999999999e-06 2024-05-08T18:30:49.038 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.038 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.038 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:49.038 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.916776+0000", 2024-05-08T18:30:49.038 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.2086999999999999e-05 2024-05-08T18:30:49.038 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.038 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.038 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:49.039 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.916824+0000", 2024-05-08T18:30:49.039 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8412999999999999e-05 2024-05-08T18:30:49.039 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.039 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.039 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:49.039 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.916929+0000", 2024-05-08T18:30:49.039 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010480900000000001 2024-05-08T18:30:49.039 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.039 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.039 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:49.039 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.917428+0000", 2024-05-08T18:30:49.039 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00049889599999999997 2024-05-08T18:30:49.039 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.039 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.040 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:49.040 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.920833+0000", 2024-05-08T18:30:49.040 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0034047140000000001 2024-05-08T18:30:49.040 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.040 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.040 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:49.040 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.920868+0000", 2024-05-08T18:30:49.040 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5750999999999997e-05 2024-05-08T18:30:49.040 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.040 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.040 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:49.040 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.920896+0000", 2024-05-08T18:30:49.040 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7796e-05 2024-05-08T18:30:49.040 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:49.041 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:49.041 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:49.041 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.041 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.041 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:778 6.1b 6:dc490aaa:::obj_delete_at_hint.0000000067:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:49.041 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.191226+0000", 2024-05-08T18:30:49.041 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 56.783264459000002, 2024-05-08T18:30:49.041 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0029603540000000001, 2024-05-08T18:30:49.041 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:49.041 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:49.041 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:49.041 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:49.041 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:49.041 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:49.042 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 778 2024-05-08T18:30:49.042 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.042 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:49.042 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.042 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:49.042 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.191226+0000", 2024-05-08T18:30:49.042 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:49.042 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.042 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.042 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:49.042 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.191226+0000", 2024-05-08T18:30:49.042 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:49.042 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.042 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.043 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:49.043 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.191229+0000", 2024-05-08T18:30:49.043 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5299999999999999e-06 2024-05-08T18:30:49.043 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.043 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.043 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:49.043 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.191242+0000", 2024-05-08T18:30:49.043 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2816999999999999e-05 2024-05-08T18:30:49.043 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.043 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.043 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:49.043 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.191274+0000", 2024-05-08T18:30:49.043 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1846e-05 2024-05-08T18:30:49.043 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.044 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.044 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:49.044 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.191288+0000", 2024-05-08T18:30:49.044 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.468e-05 2024-05-08T18:30:49.044 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.044 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.044 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:49.044 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.191468+0000", 2024-05-08T18:30:49.044 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00017983499999999999 2024-05-08T18:30:49.044 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.044 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.044 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:49.044 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.191688+0000", 2024-05-08T18:30:49.044 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021985799999999999 2024-05-08T18:30:49.045 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.045 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.045 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:30:49.045 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.192001+0000", 2024-05-08T18:30:49.045 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00031337800000000001 2024-05-08T18:30:49.045 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.045 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.045 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:49.045 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.193245+0000", 2024-05-08T18:30:49.045 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012436400000000001 2024-05-08T18:30:49.045 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.045 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.045 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:49.045 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.194036+0000", 2024-05-08T18:30:49.046 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00079059699999999998 2024-05-08T18:30:49.046 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.046 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.046 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:49.046 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.194121+0000", 2024-05-08T18:30:49.046 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5270000000000002e-05 2024-05-08T18:30:49.046 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.046 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.046 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:49.046 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.194187+0000", 2024-05-08T18:30:49.046 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5902999999999996e-05 2024-05-08T18:30:49.046 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:49.046 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:49.047 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:49.047 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.047 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.047 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:780 6.1b 6:dc490aaa:::obj_delete_at_hint.0000000067:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:49.047 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.195206+0000", 2024-05-08T18:30:49.047 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 56.779284490000002, 2024-05-08T18:30:49.047 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00291544, 2024-05-08T18:30:49.047 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:49.047 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:49.047 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:49.047 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:49.047 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:49.047 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:49.047 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 780 2024-05-08T18:30:49.048 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.048 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:49.048 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.048 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:49.048 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.195206+0000", 2024-05-08T18:30:49.048 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:49.048 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.048 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.048 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:49.048 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.195206+0000", 2024-05-08T18:30:49.048 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:49.048 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.048 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.048 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:49.049 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.195208+0000", 2024-05-08T18:30:49.049 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0669999999999999e-06 2024-05-08T18:30:49.049 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.049 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.049 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:49.049 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.195220+0000", 2024-05-08T18:30:49.049 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.131e-05 2024-05-08T18:30:49.049 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.049 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.049 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:49.049 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.195250+0000", 2024-05-08T18:30:49.049 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0562999999999999e-05 2024-05-08T18:30:49.049 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.049 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.050 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:49.050 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.195270+0000", 2024-05-08T18:30:49.050 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9989000000000001e-05 2024-05-08T18:30:49.050 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.050 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.050 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:49.050 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.195395+0000", 2024-05-08T18:30:49.050 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012439600000000001 2024-05-08T18:30:49.050 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.050 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.050 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:49.050 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.195523+0000", 2024-05-08T18:30:49.050 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012824900000000001 2024-05-08T18:30:49.050 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.051 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.051 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:30:49.051 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.195808+0000", 2024-05-08T18:30:49.051 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00028518100000000002 2024-05-08T18:30:49.051 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.051 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.051 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:49.051 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.196897+0000", 2024-05-08T18:30:49.051 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0010887850000000001 2024-05-08T18:30:49.051 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.051 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.051 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:49.051 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.197964+0000", 2024-05-08T18:30:49.051 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0010671789999999999 2024-05-08T18:30:49.052 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.052 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.052 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:49.052 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.198044+0000", 2024-05-08T18:30:49.052 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.9616000000000005e-05 2024-05-08T18:30:49.052 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.052 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.052 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:49.052 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.198122+0000", 2024-05-08T18:30:49.052 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.8104999999999998e-05 2024-05-08T18:30:49.052 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:49.052 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:49.052 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:49.052 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.053 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.053 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:826 6.6 6:64735f45:::obj_delete_at_hint.0000000083:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:49.053 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.299128+0000", 2024-05-08T18:30:49.053 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 56.675363412000003, 2024-05-08T18:30:49.053 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0029196479999999999, 2024-05-08T18:30:49.053 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:49.053 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:49.053 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:49.053 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:49.053 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:49.053 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:49.053 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 826 2024-05-08T18:30:49.053 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.053 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:49.054 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.054 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:49.054 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.299128+0000", 2024-05-08T18:30:49.054 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:49.054 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.054 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.054 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:49.054 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.299128+0000", 2024-05-08T18:30:49.054 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:49.054 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.054 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.054 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:49.054 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.299129+0000", 2024-05-08T18:30:49.055 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.711e-06 2024-05-08T18:30:49.055 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.055 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.055 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:49.055 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.299137+0000", 2024-05-08T18:30:49.055 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6650000000000003e-06 2024-05-08T18:30:49.055 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.055 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.055 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:49.055 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.299157+0000", 2024-05-08T18:30:49.055 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.02e-05 2024-05-08T18:30:49.055 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.055 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.055 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:49.056 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.299166+0000", 2024-05-08T18:30:49.056 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7530000000000007e-06 2024-05-08T18:30:49.056 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.056 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.056 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:49.056 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.299240+0000", 2024-05-08T18:30:49.056 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.4297999999999999e-05 2024-05-08T18:30:49.056 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.056 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.056 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:49.056 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.299444+0000", 2024-05-08T18:30:49.056 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00020382399999999999 2024-05-08T18:30:49.056 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.056 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.057 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:49.057 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.299777+0000", 2024-05-08T18:30:49.057 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00033331700000000002 2024-05-08T18:30:49.057 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.057 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.057 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:49.057 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.301060+0000", 2024-05-08T18:30:49.057 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012829569999999999 2024-05-08T18:30:49.057 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.057 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.057 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:49.057 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.301865+0000", 2024-05-08T18:30:49.057 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00080503400000000004 2024-05-08T18:30:49.057 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.058 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.058 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:49.058 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.301979+0000", 2024-05-08T18:30:49.058 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011324600000000001 2024-05-08T18:30:49.058 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.058 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.058 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:49.058 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.302047+0000", 2024-05-08T18:30:49.058 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8643e-05 2024-05-08T18:30:49.058 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:49.058 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:49.058 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:49.058 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.059 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.059 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:838 6.c 6:330b1641:::obj_delete_at_hint.0000000087:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:49.059 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.328043+0000", 2024-05-08T18:30:49.059 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 56.646448268, 2024-05-08T18:30:49.059 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031589180000000001, 2024-05-08T18:30:49.059 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:49.059 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:49.059 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:49.059 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:49.059 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:49.059 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:49.059 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 838 2024-05-08T18:30:49.059 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.060 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:49.060 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.060 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:49.060 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.328043+0000", 2024-05-08T18:30:49.060 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:49.060 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.060 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.060 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:49.060 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.328043+0000", 2024-05-08T18:30:49.060 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:49.060 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.060 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.060 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:49.060 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.328045+0000", 2024-05-08T18:30:49.061 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3760000000000002e-06 2024-05-08T18:30:49.061 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.061 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.061 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:49.061 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.328057+0000", 2024-05-08T18:30:49.061 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1534e-05 2024-05-08T18:30:49.061 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.061 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.061 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:49.061 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.328087+0000", 2024-05-08T18:30:49.061 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0870000000000001e-05 2024-05-08T18:30:49.061 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.061 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.061 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:49.061 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.328102+0000", 2024-05-08T18:30:49.062 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4679e-05 2024-05-08T18:30:49.062 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.062 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.062 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:49.062 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.328217+0000", 2024-05-08T18:30:49.062 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011519300000000001 2024-05-08T18:30:49.062 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.062 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.062 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:49.062 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.328446+0000", 2024-05-08T18:30:49.062 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00022893499999999999 2024-05-08T18:30:49.062 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.062 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.063 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:49.063 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.328770+0000", 2024-05-08T18:30:49.063 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00032349700000000001 2024-05-08T18:30:49.063 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.063 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.063 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:49.063 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.330008+0000", 2024-05-08T18:30:49.063 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001238404 2024-05-08T18:30:49.063 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.063 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.063 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:49.063 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.331026+0000", 2024-05-08T18:30:49.063 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001017612 2024-05-08T18:30:49.063 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.064 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.064 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:49.064 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.331117+0000", 2024-05-08T18:30:49.064 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0932000000000003e-05 2024-05-08T18:30:49.064 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.064 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.064 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:49.064 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.331202+0000", 2024-05-08T18:30:49.064 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.4886e-05 2024-05-08T18:30:49.064 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:49.064 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:49.064 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:49.064 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.064 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.065 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:850 6.6 6:624175ac:::obj_delete_at_hint.0000000091:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:49.065 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.356951+0000", 2024-05-08T18:30:49.065 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 56.617540181000003, 2024-05-08T18:30:49.065 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028779000000000001, 2024-05-08T18:30:49.065 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:49.065 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:49.065 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:49.065 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:49.065 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:49.065 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:49.065 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 850 2024-05-08T18:30:49.065 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.065 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:49.065 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.066 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:49.066 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.356951+0000", 2024-05-08T18:30:49.066 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:49.066 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.066 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.066 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:49.066 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.356951+0000", 2024-05-08T18:30:49.066 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:49.066 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.066 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.066 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:49.066 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.356953+0000", 2024-05-08T18:30:49.066 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.446e-06 2024-05-08T18:30:49.066 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.067 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.067 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:49.067 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.356965+0000", 2024-05-08T18:30:49.067 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1404e-05 2024-05-08T18:30:49.067 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.067 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.067 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:49.067 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.356994+0000", 2024-05-08T18:30:49.067 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9526000000000002e-05 2024-05-08T18:30:49.067 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.067 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.067 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:49.067 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.357009+0000", 2024-05-08T18:30:49.067 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5126000000000001e-05 2024-05-08T18:30:49.068 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.068 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.068 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:49.068 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.357126+0000", 2024-05-08T18:30:49.068 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000116989 2024-05-08T18:30:49.068 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.068 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.068 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:49.068 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.357349+0000", 2024-05-08T18:30:49.068 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00022298899999999999 2024-05-08T18:30:49.068 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.068 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.068 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:49.068 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.357665+0000", 2024-05-08T18:30:49.069 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00031592700000000003 2024-05-08T18:30:49.069 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.069 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.069 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:49.069 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.358771+0000", 2024-05-08T18:30:49.069 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001105595 2024-05-08T18:30:49.069 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.069 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.069 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:49.069 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.359672+0000", 2024-05-08T18:30:49.069 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00090080300000000004 2024-05-08T18:30:49.069 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.069 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.069 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:49.070 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.359762+0000", 2024-05-08T18:30:49.070 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0099000000000006e-05 2024-05-08T18:30:49.070 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.070 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.070 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:49.070 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.359829+0000", 2024-05-08T18:30:49.070 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6995999999999993e-05 2024-05-08T18:30:49.070 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:49.070 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:49.070 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:49.070 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.070 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.070 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:852 6.6 6:624175ac:::obj_delete_at_hint.0000000091:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:49.070 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.360655+0000", 2024-05-08T18:30:49.071 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 56.613836313999997, 2024-05-08T18:30:49.071 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028684650000000002, 2024-05-08T18:30:49.071 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:49.071 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:49.071 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:49.071 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:49.071 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:49.071 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:49.071 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 852 2024-05-08T18:30:49.071 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.071 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:49.071 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.071 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:49.071 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.360655+0000", 2024-05-08T18:30:49.072 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:49.072 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.072 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.072 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:49.072 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.360655+0000", 2024-05-08T18:30:49.072 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:49.072 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.072 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.072 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:49.072 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.360656+0000", 2024-05-08T18:30:49.072 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.457e-06 2024-05-08T18:30:49.072 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.072 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.073 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:49.073 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.360663+0000", 2024-05-08T18:30:49.073 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5429999999999999e-06 2024-05-08T18:30:49.073 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.073 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.073 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:49.073 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.360682+0000", 2024-05-08T18:30:49.073 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9020000000000001e-05 2024-05-08T18:30:49.073 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.073 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.073 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:49.073 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.360693+0000", 2024-05-08T18:30:49.073 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.114e-05 2024-05-08T18:30:49.073 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.074 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.074 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:49.074 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.360775+0000", 2024-05-08T18:30:49.074 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.2206000000000005e-05 2024-05-08T18:30:49.074 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.074 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.074 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:49.074 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.360899+0000", 2024-05-08T18:30:49.074 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000124206 2024-05-08T18:30:49.074 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.074 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.074 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:49.074 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.361162+0000", 2024-05-08T18:30:49.074 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00026328400000000002 2024-05-08T18:30:49.075 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.075 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.075 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:49.075 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.362180+0000", 2024-05-08T18:30:49.075 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0010175119999999999 2024-05-08T18:30:49.075 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.075 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.075 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:49.075 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.363368+0000", 2024-05-08T18:30:49.075 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001187991 2024-05-08T18:30:49.075 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.075 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.075 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:49.076 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.363456+0000", 2024-05-08T18:30:49.076 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8016999999999994e-05 2024-05-08T18:30:49.076 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.076 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.076 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:49.076 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.363523+0000", 2024-05-08T18:30:49.076 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7088999999999994e-05 2024-05-08T18:30:49.076 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:49.076 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:49.076 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:49.076 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.076 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.076 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:865 6.c 6:31288c1b:::obj_delete_at_hint.0000000096:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:49.076 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.392164+0000", 2024-05-08T18:30:49.077 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 56.582327212999999, 2024-05-08T18:30:49.077 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0029815470000000002, 2024-05-08T18:30:49.077 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:49.077 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:49.077 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:49.077 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:49.077 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:49.077 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:49.077 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 865 2024-05-08T18:30:49.077 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.077 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:49.077 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.077 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:49.077 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.392164+0000", 2024-05-08T18:30:49.077 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:49.078 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.078 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.078 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:49.078 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.392164+0000", 2024-05-08T18:30:49.078 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:49.078 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.078 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.078 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:49.078 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.392166+0000", 2024-05-08T18:30:49.078 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4059999999999999e-06 2024-05-08T18:30:49.078 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.078 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.078 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:49.079 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.392177+0000", 2024-05-08T18:30:49.079 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1260000000000001e-05 2024-05-08T18:30:49.079 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.079 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.079 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:49.079 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.392208+0000", 2024-05-08T18:30:49.079 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0484000000000002e-05 2024-05-08T18:30:49.079 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.079 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.079 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:49.079 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.392222+0000", 2024-05-08T18:30:49.079 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4343e-05 2024-05-08T18:30:49.079 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.079 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.080 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:49.080 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.392355+0000", 2024-05-08T18:30:49.080 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000132602 2024-05-08T18:30:49.080 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.080 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.080 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:49.080 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.392565+0000", 2024-05-08T18:30:49.080 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000210442 2024-05-08T18:30:49.080 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.080 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.080 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:49.080 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.392874+0000", 2024-05-08T18:30:49.080 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00030868099999999999 2024-05-08T18:30:49.080 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.081 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.081 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:49.081 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.394087+0000", 2024-05-08T18:30:49.081 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012133300000000001 2024-05-08T18:30:49.081 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.081 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.081 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:49.081 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.394976+0000", 2024-05-08T18:30:49.081 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000888977 2024-05-08T18:30:49.081 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.081 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.081 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:49.081 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.395068+0000", 2024-05-08T18:30:49.081 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.2188999999999994e-05 2024-05-08T18:30:49.082 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.082 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.082 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:49.082 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.395145+0000", 2024-05-08T18:30:49.082 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6833000000000001e-05 2024-05-08T18:30:49.082 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:49.082 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:49.082 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:49.082 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.082 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.082 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:871 6.11 6:8d7f253a:::obj_delete_at_hint.0000000098:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:49.082 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.405724+0000", 2024-05-08T18:30:49.082 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 56.568766656999998, 2024-05-08T18:30:49.082 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0030012530000000002, 2024-05-08T18:30:49.083 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:49.083 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:49.083 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:49.083 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:49.083 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:49.083 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:49.083 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 871 2024-05-08T18:30:49.083 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.083 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:49.083 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.083 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:49.083 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.405724+0000", 2024-05-08T18:30:49.083 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:49.083 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.084 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.084 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:49.084 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.405724+0000", 2024-05-08T18:30:49.084 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:49.084 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.084 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.084 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:49.084 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.405726+0000", 2024-05-08T18:30:49.084 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1299999999999999e-06 2024-05-08T18:30:49.084 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.084 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.084 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:49.084 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.405737+0000", 2024-05-08T18:30:49.084 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0763e-05 2024-05-08T18:30:49.085 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.085 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.085 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:49.085 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.405762+0000", 2024-05-08T18:30:49.085 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5323000000000001e-05 2024-05-08T18:30:49.085 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.085 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.085 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:49.085 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.405776+0000", 2024-05-08T18:30:49.085 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3862999999999999e-05 2024-05-08T18:30:49.085 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.085 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.085 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:49.085 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.405928+0000", 2024-05-08T18:30:49.085 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015190000000000001 2024-05-08T18:30:49.086 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.086 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.086 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:49.086 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.406159+0000", 2024-05-08T18:30:49.086 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023114399999999999 2024-05-08T18:30:49.086 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.086 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.086 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:49.086 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.406453+0000", 2024-05-08T18:30:49.086 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00029329699999999998 2024-05-08T18:30:49.086 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.086 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.086 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:49.087 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.408103+0000", 2024-05-08T18:30:49.087 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0016499869999999999 2024-05-08T18:30:49.087 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.087 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.087 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:49.087 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.408520+0000", 2024-05-08T18:30:49.087 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00041694099999999999 2024-05-08T18:30:49.087 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.087 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.087 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:49.087 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.408606+0000", 2024-05-08T18:30:49.087 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6809000000000002e-05 2024-05-08T18:30:49.087 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.088 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.088 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:49.088 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.408726+0000", 2024-05-08T18:30:49.088 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000119096 2024-05-08T18:30:49.088 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:49.088 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:49.088 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:49.088 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.088 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.088 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:934 6.11 6:8cd774bc:::obj_delete_at_hint.0000000119:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:49.088 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.550387+0000", 2024-05-08T18:30:49.088 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 56.424103703999997, 2024-05-08T18:30:49.088 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0033028739999999999, 2024-05-08T18:30:49.088 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:30:49.089 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:30:49.089 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:49.089 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:30:49.089 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:30:49.089 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:49.089 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 934 2024-05-08T18:30:49.089 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.089 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:30:49.089 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.089 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:30:49.089 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.550387+0000", 2024-05-08T18:30:49.089 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:49.089 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.090 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.090 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:30:49.090 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.550387+0000", 2024-05-08T18:30:49.090 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:30:49.090 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.090 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.090 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:30:49.090 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.550390+0000", 2024-05-08T18:30:49.090 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.706e-06 2024-05-08T18:30:49.090 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.090 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.090 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:30:49.090 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.550401+0000", 2024-05-08T18:30:49.091 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1437000000000001e-05 2024-05-08T18:30:49.091 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.091 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.091 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:30:49.091 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.550433+0000", 2024-05-08T18:30:49.091 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2005999999999998e-05 2024-05-08T18:30:49.091 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.091 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.091 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:30:49.091 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.550448+0000", 2024-05-08T18:30:49.091 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5007e-05 2024-05-08T18:30:49.091 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.091 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.091 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:30:49.092 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.550607+0000", 2024-05-08T18:30:49.092 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000158288 2024-05-08T18:30:49.092 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.092 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.092 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:30:49.092 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.550974+0000", 2024-05-08T18:30:49.092 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00036768400000000001 2024-05-08T18:30:49.092 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.092 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.092 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:49.092 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.551516+0000", 2024-05-08T18:30:49.092 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00054126900000000004 2024-05-08T18:30:49.092 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.092 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.093 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:30:49.093 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.552847+0000", 2024-05-08T18:30:49.093 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0013308899999999999 2024-05-08T18:30:49.093 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.093 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.093 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:49.093 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.553531+0000", 2024-05-08T18:30:49.093 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00068438799999999997 2024-05-08T18:30:49.093 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.093 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.093 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:30:49.093 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.553621+0000", 2024-05-08T18:30:49.093 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9779999999999998e-05 2024-05-08T18:30:49.093 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:30:49.094 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:30:49.094 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:30:49.094 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.553690+0000", 2024-05-08T18:30:49.094 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9418999999999994e-05 2024-05-08T18:30:49.094 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:49.094 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:49.094 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:49.094 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:30:49.094 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:30:49.094 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:30:49.096 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-08T18:30:49.096 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:30:49.095+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:30:49.197 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:30:49.200+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:30:49.229 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:30:49.229 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:30:49.229 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 0 2024-05-08T18:30:49.229 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:30:49.243 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-08T18:30:49.298 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:30:49.295+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:30:49.359 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:30:49.360 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:30:49.360 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2024-05-08T18:30:49.360 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2024-05-08T18:30:49.360 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:30:49.374 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-08T18:30:49.417 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:30:49.415+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:30:49.500 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:30:49.500+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:30:49.545 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:30:49.545 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2024-05-08T18:30:49.546 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2024-05-08T18:30:49.546 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-05-08T18:30:49.546 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.546 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:49.546 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.699928+0000", 2024-05-08T18:30:49.546 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 57.842782262999997, 2024-05-08T18:30:49.546 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0036032490000000002, 2024-05-08T18:30:49.546 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:49.546 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:49.546 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:49.546 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:49.546 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:49.547 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:49.547 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 211 2024-05-08T18:30:49.547 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.547 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:49.547 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.547 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:49.547 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.699928+0000", 2024-05-08T18:30:49.547 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:49.547 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.547 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.547 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:49.547 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.699928+0000", 2024-05-08T18:30:49.548 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:49.548 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.548 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.548 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:49.548 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.699931+0000", 2024-05-08T18:30:49.548 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4139999999999998e-06 2024-05-08T18:30:49.548 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.548 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.548 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:49.548 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.699946+0000", 2024-05-08T18:30:49.548 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4528999999999999e-05 2024-05-08T18:30:49.548 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.548 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.548 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:49.549 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.699984+0000", 2024-05-08T18:30:49.549 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8444e-05 2024-05-08T18:30:49.549 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.549 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.549 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:49.549 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.700004+0000", 2024-05-08T18:30:49.549 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0169999999999998e-05 2024-05-08T18:30:49.549 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.549 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.549 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:49.549 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.700162+0000", 2024-05-08T18:30:49.549 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015799799999999999 2024-05-08T18:30:49.549 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.550 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.550 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:49.550 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.700414+0000", 2024-05-08T18:30:49.550 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00025214500000000001 2024-05-08T18:30:49.550 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.550 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.550 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:49.550 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.700839+0000", 2024-05-08T18:30:49.550 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00042484 2024-05-08T18:30:49.550 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.550 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.550 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:49.551 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.702506+0000", 2024-05-08T18:30:49.551 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001666357 2024-05-08T18:30:49.551 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.551 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.551 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:49.551 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.703357+0000", 2024-05-08T18:30:49.551 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00085149399999999995 2024-05-08T18:30:49.551 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.551 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.551 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:49.551 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.703454+0000", 2024-05-08T18:30:49.552 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6688999999999995e-05 2024-05-08T18:30:49.552 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.552 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.552 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:49.552 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.703531+0000", 2024-05-08T18:30:49.552 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.7169000000000006e-05 2024-05-08T18:30:49.552 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:49.552 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:49.552 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:49.552 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.553 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.553 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:49.553 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.776807+0000", 2024-05-08T18:30:49.553 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 57.765903399999999, 2024-05-08T18:30:49.553 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0033805409999999999, 2024-05-08T18:30:49.553 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:49.553 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:49.553 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:49.553 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:49.553 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:49.553 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:49.553 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 232 2024-05-08T18:30:49.553 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.553 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:49.554 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.554 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:49.554 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.776807+0000", 2024-05-08T18:30:49.554 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:49.554 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.554 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.554 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:49.554 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.776807+0000", 2024-05-08T18:30:49.554 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:49.554 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.554 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.554 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:49.554 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.776810+0000", 2024-05-08T18:30:49.555 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6540000000000001e-06 2024-05-08T18:30:49.555 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.555 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.555 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:49.555 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.776824+0000", 2024-05-08T18:30:49.555 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3383e-05 2024-05-08T18:30:49.555 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.555 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.555 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:49.555 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.776856+0000", 2024-05-08T18:30:49.555 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2775999999999999e-05 2024-05-08T18:30:49.555 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.555 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.555 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:49.556 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.776873+0000", 2024-05-08T18:30:49.556 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6483000000000001e-05 2024-05-08T18:30:49.556 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.556 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.556 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:49.556 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.776999+0000", 2024-05-08T18:30:49.556 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000125876 2024-05-08T18:30:49.556 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.556 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.556 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:49.556 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.777228+0000", 2024-05-08T18:30:49.556 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000229531 2024-05-08T18:30:49.556 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.556 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.557 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:49.557 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.777648+0000", 2024-05-08T18:30:49.557 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000420037 2024-05-08T18:30:49.557 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.557 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.557 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:49.557 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.779272+0000", 2024-05-08T18:30:49.557 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0016235780000000001 2024-05-08T18:30:49.557 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.557 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.557 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:49.557 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.780027+0000", 2024-05-08T18:30:49.558 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00075524100000000003 2024-05-08T18:30:49.558 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.558 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.558 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:49.558 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.780116+0000", 2024-05-08T18:30:49.558 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8776000000000005e-05 2024-05-08T18:30:49.558 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.558 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.558 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:49.558 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.780187+0000", 2024-05-08T18:30:49.558 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1205999999999996e-05 2024-05-08T18:30:49.558 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:49.558 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:49.559 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:49.559 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.559 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.559 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:285 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:49.559 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.803745+0000", 2024-05-08T18:30:49.559 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 57.738965114000003, 2024-05-08T18:30:49.559 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0034481960000000002, 2024-05-08T18:30:49.559 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:49.559 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:49.559 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:49.559 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:49.559 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:49.559 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:49.559 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 285 2024-05-08T18:30:49.559 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.560 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:49.560 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.560 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:49.560 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.803745+0000", 2024-05-08T18:30:49.560 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:49.560 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.560 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.560 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:49.560 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.803745+0000", 2024-05-08T18:30:49.560 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:49.560 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.560 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.561 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:49.561 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.803748+0000", 2024-05-08T18:30:49.561 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.813e-06 2024-05-08T18:30:49.561 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.561 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.561 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:49.561 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.803762+0000", 2024-05-08T18:30:49.561 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4653e-05 2024-05-08T18:30:49.561 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.561 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.561 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:49.561 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.803791+0000", 2024-05-08T18:30:49.561 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8540000000000001e-05 2024-05-08T18:30:49.562 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.562 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.562 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:49.562 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.803817+0000", 2024-05-08T18:30:49.562 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5973e-05 2024-05-08T18:30:49.562 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.562 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.562 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:49.562 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.803975+0000", 2024-05-08T18:30:49.562 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000158336 2024-05-08T18:30:49.562 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.562 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.562 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:49.563 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.804502+0000", 2024-05-08T18:30:49.563 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00052658900000000005 2024-05-08T18:30:49.563 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.563 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.563 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:49.563 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.804966+0000", 2024-05-08T18:30:49.563 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00046399599999999999 2024-05-08T18:30:49.563 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.563 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.563 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:49.563 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.806289+0000", 2024-05-08T18:30:49.563 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0013233769999999999 2024-05-08T18:30:49.563 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.564 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.564 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:49.564 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.807001+0000", 2024-05-08T18:30:49.564 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000711314 2024-05-08T18:30:49.564 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.564 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.564 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:49.564 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.807096+0000", 2024-05-08T18:30:49.564 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.5276000000000001e-05 2024-05-08T18:30:49.564 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.564 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.564 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:49.564 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.807193+0000", 2024-05-08T18:30:49.565 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7329000000000003e-05 2024-05-08T18:30:49.565 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:49.565 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:49.565 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:49.565 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.565 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.565 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:317 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:49.565 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.808256+0000", 2024-05-08T18:30:49.565 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 57.734453702000003, 2024-05-08T18:30:49.565 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0038944359999999998, 2024-05-08T18:30:49.565 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:49.565 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:49.565 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:49.566 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:49.566 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:49.566 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:49.566 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 317 2024-05-08T18:30:49.566 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.566 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:49.566 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.566 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:49.566 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.808256+0000", 2024-05-08T18:30:49.566 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:49.566 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.566 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.566 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:49.567 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.808256+0000", 2024-05-08T18:30:49.567 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:49.567 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.567 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.567 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:49.567 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.808258+0000", 2024-05-08T18:30:49.567 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0559999999999999e-06 2024-05-08T18:30:49.567 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.567 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.567 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:49.567 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.808270+0000", 2024-05-08T18:30:49.567 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1537e-05 2024-05-08T18:30:49.567 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.568 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.568 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:49.568 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.808299+0000", 2024-05-08T18:30:49.568 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.9127000000000001e-05 2024-05-08T18:30:49.568 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.568 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.568 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:49.568 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.808324+0000", 2024-05-08T18:30:49.568 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5182e-05 2024-05-08T18:30:49.568 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.568 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.568 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:49.568 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.808471+0000", 2024-05-08T18:30:49.569 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014631900000000001 2024-05-08T18:30:49.569 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.569 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.569 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:49.569 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.808717+0000", 2024-05-08T18:30:49.569 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00024595200000000002 2024-05-08T18:30:49.569 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.569 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.569 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:49.569 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.809072+0000", 2024-05-08T18:30:49.569 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00035547699999999998 2024-05-08T18:30:49.569 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.569 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.570 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:49.570 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.810447+0000", 2024-05-08T18:30:49.570 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0013745929999999999 2024-05-08T18:30:49.570 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.570 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.570 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:49.570 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.811938+0000", 2024-05-08T18:30:49.570 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0014914290000000001 2024-05-08T18:30:49.570 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.570 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.570 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:49.570 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.812078+0000", 2024-05-08T18:30:49.570 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000140319 2024-05-08T18:30:49.570 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.571 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.571 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:49.571 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.812151+0000", 2024-05-08T18:30:49.571 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.2445000000000002e-05 2024-05-08T18:30:49.571 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:49.571 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:49.571 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:49.571 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.571 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.571 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:552 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:49.571 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.923892+0000", 2024-05-08T18:30:49.571 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 57.618818435000001, 2024-05-08T18:30:49.571 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029063259999999999, 2024-05-08T18:30:49.572 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:49.572 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:49.572 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:49.572 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:49.572 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:49.572 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:49.572 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 552 2024-05-08T18:30:49.572 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.572 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:49.572 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.572 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:49.572 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.923892+0000", 2024-05-08T18:30:49.572 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:49.572 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.573 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.573 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:49.573 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.923892+0000", 2024-05-08T18:30:49.573 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:49.573 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.573 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.573 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:49.573 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.923893+0000", 2024-05-08T18:30:49.573 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.082e-06 2024-05-08T18:30:49.573 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.573 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.573 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:49.573 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.923899+0000", 2024-05-08T18:30:49.574 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.426e-06 2024-05-08T18:30:49.574 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.574 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.574 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:49.574 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.923913+0000", 2024-05-08T18:30:49.574 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3869000000000001e-05 2024-05-08T18:30:49.574 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.574 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.574 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:49.574 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.923922+0000", 2024-05-08T18:30:49.574 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8850000000000005e-06 2024-05-08T18:30:49.574 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.575 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.575 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:49.575 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.924023+0000", 2024-05-08T18:30:49.575 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010135400000000001 2024-05-08T18:30:49.575 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.575 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.575 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:49.575 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.924230+0000", 2024-05-08T18:30:49.575 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020649500000000001 2024-05-08T18:30:49.575 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.575 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.575 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:49.575 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.924685+0000", 2024-05-08T18:30:49.575 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00045504299999999997 2024-05-08T18:30:49.576 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.576 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.576 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:49.576 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.925792+0000", 2024-05-08T18:30:49.576 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0011076790000000001 2024-05-08T18:30:49.576 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.576 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.576 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:49.576 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.926566+0000", 2024-05-08T18:30:49.576 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00077379200000000003 2024-05-08T18:30:49.576 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.576 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.577 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:49.577 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.926705+0000", 2024-05-08T18:30:49.577 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013870700000000001 2024-05-08T18:30:49.577 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.577 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.577 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:49.577 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.926798+0000", 2024-05-08T18:30:49.577 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2993999999999998e-05 2024-05-08T18:30:49.577 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:49.577 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:49.577 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:49.578 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.578 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.578 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:709 6.1e 6:7af5a05b:::obj_delete_at_hint.0000000044:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:49.578 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.033719+0000", 2024-05-08T18:30:49.578 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 57.508990676000003, 2024-05-08T18:30:49.578 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0027890480000000001, 2024-05-08T18:30:49.578 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:49.578 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:49.578 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:49.578 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:49.578 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:49.579 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:49.579 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 709 2024-05-08T18:30:49.579 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.579 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:49.579 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.579 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:49.579 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.033719+0000", 2024-05-08T18:30:49.579 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:49.579 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.579 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.579 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:49.579 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.033719+0000", 2024-05-08T18:30:49.579 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:49.580 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.580 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.580 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:49.580 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.033723+0000", 2024-05-08T18:30:49.580 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1920000000000001e-06 2024-05-08T18:30:49.580 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.580 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.580 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:49.580 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.033736+0000", 2024-05-08T18:30:49.580 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3125000000000001e-05 2024-05-08T18:30:49.580 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.580 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.580 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:49.581 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.033768+0000", 2024-05-08T18:30:49.581 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2422999999999998e-05 2024-05-08T18:30:49.581 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.581 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.581 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:49.581 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.033789+0000", 2024-05-08T18:30:49.581 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1084999999999999e-05 2024-05-08T18:30:49.581 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.581 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.581 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:49.581 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.033912+0000", 2024-05-08T18:30:49.581 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000123261 2024-05-08T18:30:49.581 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.581 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.582 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:49.582 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.034132+0000", 2024-05-08T18:30:49.582 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00021992100000000001 2024-05-08T18:30:49.582 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.582 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.582 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:49.582 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.034452+0000", 2024-05-08T18:30:49.582 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00031989399999999998 2024-05-08T18:30:49.582 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.582 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.582 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:49.582 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.035605+0000", 2024-05-08T18:30:49.582 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0011523410000000001 2024-05-08T18:30:49.583 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.583 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.583 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:49.583 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.036356+0000", 2024-05-08T18:30:49.583 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00075177800000000004 2024-05-08T18:30:49.583 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.583 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.583 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:49.583 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.036443+0000", 2024-05-08T18:30:49.583 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.6348999999999996e-05 2024-05-08T18:30:49.583 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.583 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.583 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:49.583 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.036508+0000", 2024-05-08T18:30:49.584 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5679000000000006e-05 2024-05-08T18:30:49.584 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:49.584 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:49.584 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:49.584 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.584 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.584 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:49.584 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.070187+0000", 2024-05-08T18:30:49.584 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 57.472523047999999, 2024-05-08T18:30:49.584 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0030597110000000001, 2024-05-08T18:30:49.584 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:49.584 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:49.584 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:49.584 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:49.585 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:49.585 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:49.585 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 727 2024-05-08T18:30:49.585 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.585 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:49.585 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.585 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:49.585 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.070187+0000", 2024-05-08T18:30:49.585 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:49.585 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.585 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.585 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:49.585 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.070187+0000", 2024-05-08T18:30:49.585 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:49.585 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.586 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.586 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:49.586 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.070189+0000", 2024-05-08T18:30:49.586 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.53e-06 2024-05-08T18:30:49.586 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.586 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.586 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:49.586 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.070197+0000", 2024-05-08T18:30:49.586 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2600000000000005e-06 2024-05-08T18:30:49.586 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.586 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.586 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:49.587 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.070220+0000", 2024-05-08T18:30:49.587 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3357e-05 2024-05-08T18:30:49.587 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.587 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.587 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:49.587 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.070232+0000", 2024-05-08T18:30:49.587 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.217e-05 2024-05-08T18:30:49.587 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.587 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.587 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:49.587 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.070334+0000", 2024-05-08T18:30:49.587 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000101486 2024-05-08T18:30:49.587 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.588 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.588 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:49.588 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.070585+0000", 2024-05-08T18:30:49.588 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00025155799999999998 2024-05-08T18:30:49.588 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.588 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.588 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-05-08T18:30:49.588 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.070921+0000", 2024-05-08T18:30:49.588 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00033587999999999999 2024-05-08T18:30:49.588 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.588 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.588 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:49.588 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.071956+0000", 2024-05-08T18:30:49.588 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010343629999999999 2024-05-08T18:30:49.588 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.589 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.589 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:49.589 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.073088+0000", 2024-05-08T18:30:49.589 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001132641 2024-05-08T18:30:49.589 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.589 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.589 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:49.589 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.073178+0000", 2024-05-08T18:30:49.589 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.9579000000000004e-05 2024-05-08T18:30:49.589 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.589 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.589 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:49.589 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.073247+0000", 2024-05-08T18:30:49.589 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8887000000000006e-05 2024-05-08T18:30:49.589 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:49.590 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:49.590 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:49.590 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.590 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.590 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:775 6.1e 6:7db93595:::obj_delete_at_hint.0000000066:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:49.590 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.180158+0000", 2024-05-08T18:30:49.590 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 57.362551769, 2024-05-08T18:30:49.590 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0030746160000000001, 2024-05-08T18:30:49.590 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:49.590 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:49.590 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:49.590 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:49.590 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:49.590 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:49.590 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 775 2024-05-08T18:30:49.591 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.591 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:49.591 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.591 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:49.591 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.180158+0000", 2024-05-08T18:30:49.591 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:49.591 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.591 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.591 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:49.591 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.180158+0000", 2024-05-08T18:30:49.591 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:49.591 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.591 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.591 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:49.592 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.180161+0000", 2024-05-08T18:30:49.592 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8399999999999999e-06 2024-05-08T18:30:49.592 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.592 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.592 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:49.592 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.180172+0000", 2024-05-08T18:30:49.592 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0876000000000001e-05 2024-05-08T18:30:49.592 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.592 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.592 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:49.592 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.180203+0000", 2024-05-08T18:30:49.592 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0639999999999998e-05 2024-05-08T18:30:49.592 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.592 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.592 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:49.593 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.180221+0000", 2024-05-08T18:30:49.593 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8326e-05 2024-05-08T18:30:49.593 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.593 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.593 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:49.593 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.180398+0000", 2024-05-08T18:30:49.593 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000176563 2024-05-08T18:30:49.593 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.593 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.593 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:49.593 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.180616+0000", 2024-05-08T18:30:49.593 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000218731 2024-05-08T18:30:49.593 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.593 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.593 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:49.594 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.180934+0000", 2024-05-08T18:30:49.594 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00031749799999999999 2024-05-08T18:30:49.594 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.594 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.594 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:49.594 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.182159+0000", 2024-05-08T18:30:49.594 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0012251810000000001 2024-05-08T18:30:49.594 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.594 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.594 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:49.594 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.182951+0000", 2024-05-08T18:30:49.594 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00079208000000000002 2024-05-08T18:30:49.594 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.594 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.594 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:49.595 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.183109+0000", 2024-05-08T18:30:49.595 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015750900000000001 2024-05-08T18:30:49.595 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.595 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.595 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:49.595 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.183233+0000", 2024-05-08T18:30:49.595 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012437200000000001 2024-05-08T18:30:49.595 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:49.595 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:49.595 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:49.595 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.595 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.595 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:777 6.1e 6:7db93595:::obj_delete_at_hint.0000000066:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:49.595 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.184358+0000", 2024-05-08T18:30:49.596 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 57.358351925000001, 2024-05-08T18:30:49.596 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0031944019999999998, 2024-05-08T18:30:49.596 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:49.596 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:49.596 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:49.596 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:49.596 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:49.596 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:49.596 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 777 2024-05-08T18:30:49.596 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.596 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:49.596 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.597 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:49.597 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.184358+0000", 2024-05-08T18:30:49.597 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:49.597 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.597 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.597 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:49.597 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.184358+0000", 2024-05-08T18:30:49.597 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:49.597 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.597 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.597 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:49.597 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.184360+0000", 2024-05-08T18:30:49.597 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5069999999999999e-06 2024-05-08T18:30:49.598 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.598 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.598 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:49.598 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.184367+0000", 2024-05-08T18:30:49.598 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6629999999999993e-06 2024-05-08T18:30:49.598 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.598 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.598 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:49.598 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.184388+0000", 2024-05-08T18:30:49.598 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0755999999999999e-05 2024-05-08T18:30:49.598 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.598 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.598 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:49.598 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.184399+0000", 2024-05-08T18:30:49.599 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0896999999999999e-05 2024-05-08T18:30:49.599 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.599 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.599 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:49.599 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.184512+0000", 2024-05-08T18:30:49.599 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000113346 2024-05-08T18:30:49.599 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.599 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.599 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:49.599 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.184733+0000", 2024-05-08T18:30:49.599 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022113800000000001 2024-05-08T18:30:49.599 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.599 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.599 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:49.599 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.185202+0000", 2024-05-08T18:30:49.600 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00046851999999999999 2024-05-08T18:30:49.600 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.600 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.600 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:49.600 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.186306+0000", 2024-05-08T18:30:49.600 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001104184 2024-05-08T18:30:49.600 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.600 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.600 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:49.600 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.187288+0000", 2024-05-08T18:30:49.600 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00098171 2024-05-08T18:30:49.600 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.600 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.600 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:49.600 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.187438+0000", 2024-05-08T18:30:49.601 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000150629 2024-05-08T18:30:49.601 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.601 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.601 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:49.601 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.187553+0000", 2024-05-08T18:30:49.601 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000114052 2024-05-08T18:30:49.601 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:49.601 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:49.601 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:49.601 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.601 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.601 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:808 6.1a 6:5a206276:::obj_delete_at_hint.0000000077:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:49.601 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.252316+0000", 2024-05-08T18:30:49.601 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 57.290394513000003, 2024-05-08T18:30:49.601 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0027908820000000002, 2024-05-08T18:30:49.602 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:49.602 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:49.602 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:49.602 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:49.602 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:49.602 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:49.602 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 808 2024-05-08T18:30:49.602 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.602 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:49.602 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.602 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:49.602 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.252316+0000", 2024-05-08T18:30:49.602 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:49.602 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.602 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.603 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:49.603 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.252316+0000", 2024-05-08T18:30:49.603 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:49.603 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.603 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.603 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:49.603 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.252318+0000", 2024-05-08T18:30:49.603 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5500000000000001e-06 2024-05-08T18:30:49.603 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.603 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.603 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:49.603 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.252331+0000", 2024-05-08T18:30:49.603 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.252e-05 2024-05-08T18:30:49.603 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.603 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.604 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:49.604 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.252362+0000", 2024-05-08T18:30:49.604 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1720000000000001e-05 2024-05-08T18:30:49.604 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.604 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.604 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:49.604 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.252377+0000", 2024-05-08T18:30:49.604 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4440000000000001e-05 2024-05-08T18:30:49.604 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.604 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.604 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:49.604 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.252513+0000", 2024-05-08T18:30:49.604 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013657200000000001 2024-05-08T18:30:49.605 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.605 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.605 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:49.605 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.252746+0000", 2024-05-08T18:30:49.605 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000232499 2024-05-08T18:30:49.605 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.605 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.605 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:49.605 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.253071+0000", 2024-05-08T18:30:49.605 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00032540299999999999 2024-05-08T18:30:49.605 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.605 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.605 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:49.605 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.254176+0000", 2024-05-08T18:30:49.605 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0011052519999999999 2024-05-08T18:30:49.606 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.606 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.606 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:49.606 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.254957+0000", 2024-05-08T18:30:49.606 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00078004099999999998 2024-05-08T18:30:49.606 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.606 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.606 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:49.606 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.255041+0000", 2024-05-08T18:30:49.606 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4492000000000004e-05 2024-05-08T18:30:49.606 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.606 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.606 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:49.606 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.255106+0000", 2024-05-08T18:30:49.606 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5393000000000002e-05 2024-05-08T18:30:49.607 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:49.607 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:49.607 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:49.607 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.607 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.607 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:810 6.1a 6:5a206276:::obj_delete_at_hint.0000000077:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:49.607 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.256569+0000", 2024-05-08T18:30:49.607 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 57.286141459, 2024-05-08T18:30:49.607 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0034505130000000001, 2024-05-08T18:30:49.607 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:49.607 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:49.607 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:49.607 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:49.607 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:49.608 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:49.608 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 810 2024-05-08T18:30:49.608 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.608 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:49.608 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.608 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:49.608 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.256569+0000", 2024-05-08T18:30:49.608 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:49.608 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.608 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.608 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:49.608 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.256569+0000", 2024-05-08T18:30:49.608 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:49.608 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.608 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.609 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:49.609 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.256571+0000", 2024-05-08T18:30:49.609 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2029999999999999e-06 2024-05-08T18:30:49.609 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.609 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.609 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:49.609 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.256582+0000", 2024-05-08T18:30:49.609 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.101e-05 2024-05-08T18:30:49.609 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.609 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.609 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:49.609 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.256614+0000", 2024-05-08T18:30:49.609 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2353e-05 2024-05-08T18:30:49.609 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.609 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.609 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:49.610 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.256632+0000", 2024-05-08T18:30:49.610 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8349999999999999e-05 2024-05-08T18:30:49.610 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.610 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.610 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:49.610 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.256767+0000", 2024-05-08T18:30:49.610 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000134819 2024-05-08T18:30:49.610 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.610 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.610 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:49.610 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.256990+0000", 2024-05-08T18:30:49.610 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022293899999999999 2024-05-08T18:30:49.610 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.610 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.610 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:49.611 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.257487+0000", 2024-05-08T18:30:49.611 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00049632599999999995 2024-05-08T18:30:49.611 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.611 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.611 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:49.611 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.258822+0000", 2024-05-08T18:30:49.611 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001335166 2024-05-08T18:30:49.611 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.611 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.611 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:49.611 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.259867+0000", 2024-05-08T18:30:49.611 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010454349999999999 2024-05-08T18:30:49.611 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.611 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.611 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:49.612 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.259955+0000", 2024-05-08T18:30:49.612 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.7699000000000002e-05 2024-05-08T18:30:49.612 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.612 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.612 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:49.612 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.260019+0000", 2024-05-08T18:30:49.612 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4213000000000003e-05 2024-05-08T18:30:49.612 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:49.612 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:49.612 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:49.612 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.612 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.612 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:814 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:49.612 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.266538+0000", 2024-05-08T18:30:49.613 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 57.276172533, 2024-05-08T18:30:49.613 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0030056010000000001, 2024-05-08T18:30:49.613 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:49.613 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:49.613 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:49.613 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:49.613 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:49.613 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:49.613 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 814 2024-05-08T18:30:49.613 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.613 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:49.613 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.613 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:49.613 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.266538+0000", 2024-05-08T18:30:49.613 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:49.613 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.614 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.614 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:49.614 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.266538+0000", 2024-05-08T18:30:49.614 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:49.614 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.614 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.614 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:49.614 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.266540+0000", 2024-05-08T18:30:49.614 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2400000000000002e-06 2024-05-08T18:30:49.614 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.614 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.614 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:49.614 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.266550+0000", 2024-05-08T18:30:49.615 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0464e-05 2024-05-08T18:30:49.615 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.615 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.615 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:49.615 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.266581+0000", 2024-05-08T18:30:49.615 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.099e-05 2024-05-08T18:30:49.615 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.615 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.615 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:49.615 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.266596+0000", 2024-05-08T18:30:49.615 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5176e-05 2024-05-08T18:30:49.615 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.615 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.615 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:49.616 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.266711+0000", 2024-05-08T18:30:49.616 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000114759 2024-05-08T18:30:49.616 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.616 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.616 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:49.616 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.266936+0000", 2024-05-08T18:30:49.616 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022446200000000001 2024-05-08T18:30:49.616 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.616 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.616 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:49.616 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.267272+0000", 2024-05-08T18:30:49.616 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00033655099999999998 2024-05-08T18:30:49.616 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.616 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.616 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:49.617 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.268417+0000", 2024-05-08T18:30:49.617 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0011447409999999999 2024-05-08T18:30:49.617 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.617 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.617 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:49.617 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.269263+0000", 2024-05-08T18:30:49.617 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00084657600000000003 2024-05-08T18:30:49.617 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.617 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.617 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:49.617 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.269418+0000", 2024-05-08T18:30:49.617 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015471300000000001 2024-05-08T18:30:49.617 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.617 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.618 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:49.618 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.269543+0000", 2024-05-08T18:30:49.618 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000124929 2024-05-08T18:30:49.618 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:49.618 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:49.618 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:49.618 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.618 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.618 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:816 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:49.618 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.270693+0000", 2024-05-08T18:30:49.618 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 57.272017425000001, 2024-05-08T18:30:49.618 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0031451119999999998, 2024-05-08T18:30:49.618 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:49.619 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:49.619 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:49.619 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:49.619 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:49.619 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:49.619 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 816 2024-05-08T18:30:49.619 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.619 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:49.619 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.619 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:49.619 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.270693+0000", 2024-05-08T18:30:49.619 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:49.619 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.619 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.620 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:49.620 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.270693+0000", 2024-05-08T18:30:49.620 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:49.620 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.620 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.620 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:49.620 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.270695+0000", 2024-05-08T18:30:49.620 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0669999999999999e-06 2024-05-08T18:30:49.620 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.620 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.620 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:49.620 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.270704+0000", 2024-05-08T18:30:49.621 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4830000000000005e-06 2024-05-08T18:30:49.621 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.621 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.621 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:49.621 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.270728+0000", 2024-05-08T18:30:49.621 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.4297000000000001e-05 2024-05-08T18:30:49.621 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.621 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.621 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:49.621 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.270740+0000", 2024-05-08T18:30:49.621 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1922999999999999e-05 2024-05-08T18:30:49.621 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.621 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.622 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:49.622 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.270855+0000", 2024-05-08T18:30:49.622 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011418599999999999 2024-05-08T18:30:49.622 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.622 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.622 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:49.622 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.271088+0000", 2024-05-08T18:30:49.622 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000233718 2024-05-08T18:30:49.622 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.622 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.622 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:49.622 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.271548+0000", 2024-05-08T18:30:49.623 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00045974299999999998 2024-05-08T18:30:49.623 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.623 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.623 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:49.623 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.272854+0000", 2024-05-08T18:30:49.623 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0013054799999999999 2024-05-08T18:30:49.623 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.623 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.623 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:49.623 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.273569+0000", 2024-05-08T18:30:49.623 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00071561400000000005 2024-05-08T18:30:49.623 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.623 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.623 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:49.624 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.273726+0000", 2024-05-08T18:30:49.624 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000156856 2024-05-08T18:30:49.624 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.624 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.624 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:49.624 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.273838+0000", 2024-05-08T18:30:49.624 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011174499999999999 2024-05-08T18:30:49.624 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:49.624 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:49.624 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:49.624 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.624 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.624 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:49.624 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.422427+0000", 2024-05-08T18:30:49.624 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 57.120283096000001, 2024-05-08T18:30:49.625 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0031426190000000001, 2024-05-08T18:30:49.625 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:49.625 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:49.625 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:49.625 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:49.625 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:49.625 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:49.625 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 880 2024-05-08T18:30:49.625 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.625 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:49.625 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.625 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:49.625 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.422427+0000", 2024-05-08T18:30:49.625 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:49.625 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.626 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.626 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:49.626 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.422427+0000", 2024-05-08T18:30:49.626 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:49.626 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.626 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.626 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:49.626 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.422431+0000", 2024-05-08T18:30:49.626 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.777e-06 2024-05-08T18:30:49.626 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.626 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.626 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:49.627 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.422445+0000", 2024-05-08T18:30:49.627 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.451e-05 2024-05-08T18:30:49.627 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.627 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.627 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:49.627 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.422479+0000", 2024-05-08T18:30:49.627 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4078999999999997e-05 2024-05-08T18:30:49.627 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.627 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.627 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:49.627 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.422495+0000", 2024-05-08T18:30:49.627 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5947000000000002e-05 2024-05-08T18:30:49.627 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.628 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.628 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:49.628 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.422609+0000", 2024-05-08T18:30:49.628 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000113879 2024-05-08T18:30:49.628 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.628 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.628 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:49.628 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.422844+0000", 2024-05-08T18:30:49.628 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000234465 2024-05-08T18:30:49.628 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.628 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.628 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:49.628 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.423201+0000", 2024-05-08T18:30:49.629 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00035789699999999998 2024-05-08T18:30:49.629 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.629 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.629 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:49.629 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.424352+0000", 2024-05-08T18:30:49.629 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0011504709999999999 2024-05-08T18:30:49.629 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.629 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.629 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:49.629 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.425288+0000", 2024-05-08T18:30:49.629 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00093638300000000005 2024-05-08T18:30:49.629 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.629 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.629 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:49.629 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.425451+0000", 2024-05-08T18:30:49.629 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000162628 2024-05-08T18:30:49.629 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.630 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.630 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:49.630 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.425570+0000", 2024-05-08T18:30:49.630 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000118583 2024-05-08T18:30:49.630 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:49.630 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:49.630 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:49.630 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.630 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.630 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:913 6.2 6:47403372:::obj_delete_at_hint.0000000112:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:49.630 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.494354+0000", 2024-05-08T18:30:49.630 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 57.048355790999999, 2024-05-08T18:30:49.631 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003088276, 2024-05-08T18:30:49.631 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:49.631 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:49.631 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:49.631 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:49.631 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:49.631 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:49.631 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 913 2024-05-08T18:30:49.631 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.631 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:49.631 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.631 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:49.631 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.494354+0000", 2024-05-08T18:30:49.632 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:49.632 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.632 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.632 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:49.632 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.494354+0000", 2024-05-08T18:30:49.632 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:49.632 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.632 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.632 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:49.632 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.494357+0000", 2024-05-08T18:30:49.632 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.553e-06 2024-05-08T18:30:49.632 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.632 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.632 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:49.633 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.494368+0000", 2024-05-08T18:30:49.633 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1426999999999999e-05 2024-05-08T18:30:49.633 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.633 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.633 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:49.633 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.494419+0000", 2024-05-08T18:30:49.633 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1053000000000001e-05 2024-05-08T18:30:49.633 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.633 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.633 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:49.633 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.494434+0000", 2024-05-08T18:30:49.633 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5216e-05 2024-05-08T18:30:49.633 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.633 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.634 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:49.634 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.494564+0000", 2024-05-08T18:30:49.634 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012956900000000001 2024-05-08T18:30:49.634 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.634 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.634 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:49.634 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.494798+0000", 2024-05-08T18:30:49.634 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000234248 2024-05-08T18:30:49.634 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.634 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.634 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:49.634 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.495123+0000", 2024-05-08T18:30:49.634 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00032466500000000002 2024-05-08T18:30:49.634 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.635 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.635 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:49.635 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.496226+0000", 2024-05-08T18:30:49.635 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001102701 2024-05-08T18:30:49.635 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.635 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.635 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:49.635 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.497153+0000", 2024-05-08T18:30:49.635 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00092721999999999998 2024-05-08T18:30:49.635 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.635 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.635 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:49.635 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.497329+0000", 2024-05-08T18:30:49.635 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000176579 2024-05-08T18:30:49.635 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.636 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.636 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:49.636 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.497443+0000", 2024-05-08T18:30:49.636 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000113045 2024-05-08T18:30:49.636 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:49.636 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:49.636 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:49.636 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.636 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.636 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:915 6.2 6:47403372:::obj_delete_at_hint.0000000112:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:49.636 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.498847+0000", 2024-05-08T18:30:49.636 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 57.043862724999997, 2024-05-08T18:30:49.636 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003160459, 2024-05-08T18:30:49.636 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:49.637 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:49.637 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:49.637 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:49.637 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:49.637 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:49.637 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 915 2024-05-08T18:30:49.637 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.637 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:49.637 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.637 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:49.637 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.498847+0000", 2024-05-08T18:30:49.637 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:49.637 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.637 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.638 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:49.638 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.498847+0000", 2024-05-08T18:30:49.638 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:49.638 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.638 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.638 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:49.638 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.498850+0000", 2024-05-08T18:30:49.638 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.4099999999999998e-06 2024-05-08T18:30:49.638 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.638 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.638 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:49.638 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.498863+0000", 2024-05-08T18:30:49.638 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3013000000000001e-05 2024-05-08T18:30:49.639 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.639 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.639 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:49.639 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.498895+0000", 2024-05-08T18:30:49.639 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2682999999999999e-05 2024-05-08T18:30:49.639 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.639 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.639 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:49.639 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.498911+0000", 2024-05-08T18:30:49.639 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.525e-05 2024-05-08T18:30:49.639 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.639 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.639 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:49.639 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.499039+0000", 2024-05-08T18:30:49.640 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012856900000000001 2024-05-08T18:30:49.640 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.640 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.640 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:49.640 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.499264+0000", 2024-05-08T18:30:49.640 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022517500000000001 2024-05-08T18:30:49.640 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.640 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.640 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:49.640 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.499740+0000", 2024-05-08T18:30:49.640 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00047553299999999999 2024-05-08T18:30:49.640 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.640 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.640 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:49.640 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.501192+0000", 2024-05-08T18:30:49.641 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001451735 2024-05-08T18:30:49.641 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.641 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.641 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:49.641 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.501751+0000", 2024-05-08T18:30:49.641 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000559239 2024-05-08T18:30:49.641 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.641 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.641 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:49.641 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.501902+0000", 2024-05-08T18:30:49.641 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015061600000000001 2024-05-08T18:30:49.641 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.641 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.642 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:49.642 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.502008+0000", 2024-05-08T18:30:49.642 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000106236 2024-05-08T18:30:49.642 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:49.642 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:49.642 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:49.642 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.642 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.642 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:925 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:49.642 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.523895+0000", 2024-05-08T18:30:49.642 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 57.018815322000002, 2024-05-08T18:30:49.642 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003635302, 2024-05-08T18:30:49.642 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:49.642 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:49.643 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:49.643 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:49.643 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:49.643 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:49.643 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 925 2024-05-08T18:30:49.643 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.643 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:49.643 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.643 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:49.643 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.523895+0000", 2024-05-08T18:30:49.643 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:49.643 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.643 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.644 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:49.644 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.523895+0000", 2024-05-08T18:30:49.644 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:49.644 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.644 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.644 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:49.644 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.523897+0000", 2024-05-08T18:30:49.644 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1969999999999999e-06 2024-05-08T18:30:49.644 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.644 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.644 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:49.644 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.523908+0000", 2024-05-08T18:30:49.644 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0706e-05 2024-05-08T18:30:49.644 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.645 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.645 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:49.645 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.523938+0000", 2024-05-08T18:30:49.645 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0395999999999998e-05 2024-05-08T18:30:49.645 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.645 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.645 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:49.645 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.523953+0000", 2024-05-08T18:30:49.645 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4673e-05 2024-05-08T18:30:49.645 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.645 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.645 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:49.645 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.524105+0000", 2024-05-08T18:30:49.645 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015204300000000001 2024-05-08T18:30:49.646 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.646 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.646 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:49.646 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.524460+0000", 2024-05-08T18:30:49.646 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00035539000000000002 2024-05-08T18:30:49.646 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.646 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.646 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:49.646 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.525003+0000", 2024-05-08T18:30:49.646 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00054241000000000001 2024-05-08T18:30:49.646 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.646 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.646 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:49.647 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.526198+0000", 2024-05-08T18:30:49.647 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0011955500000000001 2024-05-08T18:30:49.647 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.647 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.647 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:49.647 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.527258+0000", 2024-05-08T18:30:49.647 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010595489999999999 2024-05-08T18:30:49.647 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.647 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.647 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:49.647 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.527414+0000", 2024-05-08T18:30:49.647 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000156732 2024-05-08T18:30:49.647 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.648 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.648 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:49.648 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.527530+0000", 2024-05-08T18:30:49.648 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011565600000000001 2024-05-08T18:30:49.648 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:49.648 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:49.648 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:49.648 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.648 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.648 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:927 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:49.648 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.528868+0000", 2024-05-08T18:30:49.648 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 57.013841923999998, 2024-05-08T18:30:49.648 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00302987, 2024-05-08T18:30:49.648 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:49.648 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:49.649 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:49.649 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:49.649 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:49.649 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:49.649 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 927 2024-05-08T18:30:49.649 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.649 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:49.649 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.649 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:49.649 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.528868+0000", 2024-05-08T18:30:49.649 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:49.649 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.649 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.649 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:49.650 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.528868+0000", 2024-05-08T18:30:49.650 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:49.650 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.650 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.650 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:49.650 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.528870+0000", 2024-05-08T18:30:49.650 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6199999999999999e-06 2024-05-08T18:30:49.650 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.650 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.650 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:49.650 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.528877+0000", 2024-05-08T18:30:49.650 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4070000000000004e-06 2024-05-08T18:30:49.650 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.650 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.651 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:49.651 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.528899+0000", 2024-05-08T18:30:49.651 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1495999999999999e-05 2024-05-08T18:30:49.651 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.651 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.651 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:49.651 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.528910+0000", 2024-05-08T18:30:49.651 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1562999999999999e-05 2024-05-08T18:30:49.651 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.651 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.651 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:49.651 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.529027+0000", 2024-05-08T18:30:49.652 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000116873 2024-05-08T18:30:49.652 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.652 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.652 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:49.652 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.529258+0000", 2024-05-08T18:30:49.652 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000231065 2024-05-08T18:30:49.652 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.652 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.652 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:49.652 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.529732+0000", 2024-05-08T18:30:49.652 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000474043 2024-05-08T18:30:49.652 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.653 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.653 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:49.653 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.530983+0000", 2024-05-08T18:30:49.653 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0012505929999999999 2024-05-08T18:30:49.653 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.653 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.653 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:49.653 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.531621+0000", 2024-05-08T18:30:49.653 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00063814899999999996 2024-05-08T18:30:49.653 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.653 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.653 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:49.653 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.531785+0000", 2024-05-08T18:30:49.653 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016452200000000001 2024-05-08T18:30:49.654 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.654 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.654 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:49.654 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.531898+0000", 2024-05-08T18:30:49.654 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000112539 2024-05-08T18:30:49.654 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:49.654 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:49.654 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:49.655 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.655 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.655 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:49.655 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.532086+0000", 2024-05-08T18:30:49.655 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 57.010623559000003, 2024-05-08T18:30:49.655 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032260779999999998, 2024-05-08T18:30:49.655 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:49.655 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:49.655 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:49.655 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:49.655 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:49.656 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:49.656 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 928 2024-05-08T18:30:49.656 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.656 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:49.656 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.656 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:49.656 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.532086+0000", 2024-05-08T18:30:49.656 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:49.656 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.656 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.656 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:49.657 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.532086+0000", 2024-05-08T18:30:49.657 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:49.657 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.657 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.657 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:49.657 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.532088+0000", 2024-05-08T18:30:49.657 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8670000000000001e-06 2024-05-08T18:30:49.657 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.657 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.657 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:49.657 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.532097+0000", 2024-05-08T18:30:49.657 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.6929999999999996e-06 2024-05-08T18:30:49.657 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.657 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.657 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:49.658 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.532121+0000", 2024-05-08T18:30:49.658 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3572999999999999e-05 2024-05-08T18:30:49.658 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.658 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.658 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:49.658 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.532134+0000", 2024-05-08T18:30:49.658 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3823e-05 2024-05-08T18:30:49.658 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.658 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.658 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:49.658 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.532255+0000", 2024-05-08T18:30:49.658 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012074900000000001 2024-05-08T18:30:49.658 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.658 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.659 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:49.659 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.532588+0000", 2024-05-08T18:30:49.659 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000333068 2024-05-08T18:30:49.659 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.659 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.659 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:49.659 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.533135+0000", 2024-05-08T18:30:49.659 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000546259 2024-05-08T18:30:49.659 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.659 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.659 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:49.659 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.534441+0000", 2024-05-08T18:30:49.659 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0013061500000000001 2024-05-08T18:30:49.659 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.660 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.660 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:49.660 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.535049+0000", 2024-05-08T18:30:49.660 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00060823500000000005 2024-05-08T18:30:49.660 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.660 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.660 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:49.660 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.535203+0000", 2024-05-08T18:30:49.660 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015383500000000001 2024-05-08T18:30:49.660 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.660 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.660 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:49.660 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.535313+0000", 2024-05-08T18:30:49.660 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000109826 2024-05-08T18:30:49.660 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:49.661 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:49.661 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:49.661 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.661 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.661 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:930 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:49.661 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.536650+0000", 2024-05-08T18:30:49.661 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 57.006060273999999, 2024-05-08T18:30:49.661 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029677129999999999, 2024-05-08T18:30:49.661 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:49.661 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:49.661 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:49.661 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:49.661 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:49.661 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:49.661 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 930 2024-05-08T18:30:49.662 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.662 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:49.662 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.662 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:49.662 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.536650+0000", 2024-05-08T18:30:49.662 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:49.662 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.662 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.662 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:49.662 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.536650+0000", 2024-05-08T18:30:49.662 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:49.662 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.662 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.662 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:49.662 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.536652+0000", 2024-05-08T18:30:49.663 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1660000000000001e-06 2024-05-08T18:30:49.663 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.663 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.663 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:49.663 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.536680+0000", 2024-05-08T18:30:49.663 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8084000000000001e-05 2024-05-08T18:30:49.663 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.663 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.663 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:49.663 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.536711+0000", 2024-05-08T18:30:49.663 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1123e-05 2024-05-08T18:30:49.663 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.664 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.664 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:49.664 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.536729+0000", 2024-05-08T18:30:49.664 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8189000000000002e-05 2024-05-08T18:30:49.664 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.664 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.664 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:49.664 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.536852+0000", 2024-05-08T18:30:49.664 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000122729 2024-05-08T18:30:49.664 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.664 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.664 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:49.664 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.537074+0000", 2024-05-08T18:30:49.664 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022180600000000001 2024-05-08T18:30:49.664 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.665 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.665 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:49.665 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.537526+0000", 2024-05-08T18:30:49.665 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00045219599999999998 2024-05-08T18:30:49.665 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.665 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.665 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:49.665 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.538973+0000", 2024-05-08T18:30:49.665 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001447102 2024-05-08T18:30:49.665 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.665 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.665 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:49.665 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.539410+0000", 2024-05-08T18:30:49.666 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00043727399999999997 2024-05-08T18:30:49.666 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.666 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.666 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:49.666 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.539503+0000", 2024-05-08T18:30:49.666 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2338999999999998e-05 2024-05-08T18:30:49.666 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:49.666 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:49.666 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:49.666 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.539617+0000", 2024-05-08T18:30:49.666 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011470499999999999 2024-05-08T18:30:49.666 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:49.666 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:49.666 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:49.667 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:49.667 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:49.667 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:30:49.668 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-08T18:30:49.669 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:30:49.668+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:30:49.769 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:30:49.768+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:30:49.797 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:30:49.797 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:30:49.797 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 0 2024-05-08T18:30:49.797 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:30:49.811 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-08T18:30:49.870 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:30:49.868+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:30:49.928 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:30:49.928 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:30:49.928 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2024-05-08T18:30:49.928 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2024-05-08T18:30:49.928 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:30:49.942 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-08T18:30:49.989 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:30:49.987+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:30:50.065 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:30:50.065 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2024-05-08T18:30:50.065 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2024-05-08T18:30:50.065 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-05-08T18:30:50.065 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.066 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4479.0:37 5.f 5:f43b6ece:::zone_names.default:head [create,call version.set in=10b,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-05-08T18:30:50.066 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:44.627414+0000", 2024-05-08T18:30:50.066 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 65.435791499000004, 2024-05-08T18:30:50.066 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029966429999999998, 2024-05-08T18:30:50.066 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:50.066 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:50.066 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:50.066 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:50.066 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4479", 2024-05-08T18:30:50.066 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3577501689", 2024-05-08T18:30:50.066 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 37 2024-05-08T18:30:50.067 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.067 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:50.067 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.067 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:50.067 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.627414+0000", 2024-05-08T18:30:50.067 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:50.067 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.068 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.068 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:50.068 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.627414+0000", 2024-05-08T18:30:50.068 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:50.068 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.068 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.068 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:50.068 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.627416+0000", 2024-05-08T18:30:50.068 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9580000000000001e-06 2024-05-08T18:30:50.068 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.068 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.068 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:50.069 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.627427+0000", 2024-05-08T18:30:50.069 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1657e-05 2024-05-08T18:30:50.069 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.069 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.069 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:50.069 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.627454+0000", 2024-05-08T18:30:50.069 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6619e-05 2024-05-08T18:30:50.069 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.069 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.069 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:50.069 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.627474+0000", 2024-05-08T18:30:50.069 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9612000000000001e-05 2024-05-08T18:30:50.069 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.070 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.070 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:50.070 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.627647+0000", 2024-05-08T18:30:50.070 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017374999999999999 2024-05-08T18:30:50.070 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.070 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.070 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:50.070 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.627861+0000", 2024-05-08T18:30:50.070 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000213358 2024-05-08T18:30:50.070 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.070 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.070 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:50.070 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.628153+0000", 2024-05-08T18:30:50.070 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029198899999999999 2024-05-08T18:30:50.071 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.071 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.071 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:50.071 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.629544+0000", 2024-05-08T18:30:50.071 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0013916390000000001 2024-05-08T18:30:50.071 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.071 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.071 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:50.071 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.630221+0000", 2024-05-08T18:30:50.071 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00067613500000000002 2024-05-08T18:30:50.071 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.071 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.072 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:50.072 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.630321+0000", 2024-05-08T18:30:50.072 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000100126 2024-05-08T18:30:50.072 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.072 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.072 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:50.072 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.630411+0000", 2024-05-08T18:30:50.072 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.9800000000000001e-05 2024-05-08T18:30:50.072 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:50.072 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:50.072 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:50.072 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.072 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.072 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4479.0:41 5.f 5:f4c53578:::zonegroups_names.default:head [create,call version.set in=10b,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-05-08T18:30:50.073 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:44.637466+0000", 2024-05-08T18:30:50.073 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 65.425739539999995, 2024-05-08T18:30:50.073 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0030003949999999999, 2024-05-08T18:30:50.073 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:50.073 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:50.073 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:50.073 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:50.073 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4479", 2024-05-08T18:30:50.073 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3577501689", 2024-05-08T18:30:50.073 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 41 2024-05-08T18:30:50.073 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.073 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:50.074 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.074 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:50.074 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.637466+0000", 2024-05-08T18:30:50.074 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:50.074 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.074 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.074 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:50.074 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.637466+0000", 2024-05-08T18:30:50.074 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:50.074 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.074 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.075 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:50.075 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.637468+0000", 2024-05-08T18:30:50.075 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2800000000000002e-06 2024-05-08T18:30:50.075 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.075 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.075 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:50.075 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.637479+0000", 2024-05-08T18:30:50.075 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0674e-05 2024-05-08T18:30:50.075 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.075 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.076 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:50.076 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.637508+0000", 2024-05-08T18:30:50.076 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8921999999999999e-05 2024-05-08T18:30:50.076 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.076 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.076 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:50.076 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.637522+0000", 2024-05-08T18:30:50.076 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3923e-05 2024-05-08T18:30:50.076 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.076 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.076 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:50.076 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.637647+0000", 2024-05-08T18:30:50.077 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000124905 2024-05-08T18:30:50.077 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.077 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.077 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:50.077 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.637852+0000", 2024-05-08T18:30:50.077 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000205081 2024-05-08T18:30:50.077 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.077 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.077 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:50.077 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.638101+0000", 2024-05-08T18:30:50.077 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000248953 2024-05-08T18:30:50.077 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.077 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.078 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:50.078 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.639345+0000", 2024-05-08T18:30:50.078 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001244754 2024-05-08T18:30:50.078 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.078 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.078 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:50.078 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.640197+0000", 2024-05-08T18:30:50.078 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000851614 2024-05-08T18:30:50.078 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.078 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.078 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:50.078 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.640353+0000", 2024-05-08T18:30:50.078 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015631600000000001 2024-05-08T18:30:50.078 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.079 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.079 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:50.079 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.640466+0000", 2024-05-08T18:30:50.079 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000112973 2024-05-08T18:30:50.079 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:50.079 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:50.079 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:50.079 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.079 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.079 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:30:50.079 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.664338+0000", 2024-05-08T18:30:50.079 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 58.398867729000003, 2024-05-08T18:30:50.080 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039355429999999997, 2024-05-08T18:30:50.080 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:50.080 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:50.080 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:50.080 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:50.080 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:50.080 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:50.080 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 205 2024-05-08T18:30:50.080 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.080 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:50.080 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.080 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:50.080 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.664338+0000", 2024-05-08T18:30:50.080 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:50.081 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.081 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.081 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:50.081 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.664338+0000", 2024-05-08T18:30:50.081 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:50.081 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.081 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.081 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:50.081 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.664341+0000", 2024-05-08T18:30:50.081 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2399999999999999e-06 2024-05-08T18:30:50.081 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.081 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.081 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:50.082 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.664355+0000", 2024-05-08T18:30:50.082 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.453e-05 2024-05-08T18:30:50.082 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.082 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.082 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:50.082 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.664392+0000", 2024-05-08T18:30:50.082 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7033000000000003e-05 2024-05-08T18:30:50.082 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.082 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.082 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:50.083 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.664419+0000", 2024-05-08T18:30:50.083 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6086000000000001e-05 2024-05-08T18:30:50.083 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.083 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.083 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:50.083 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.664586+0000", 2024-05-08T18:30:50.083 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016752299999999999 2024-05-08T18:30:50.083 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.083 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.083 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:50.083 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.664831+0000", 2024-05-08T18:30:50.083 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00024510800000000001 2024-05-08T18:30:50.083 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.083 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.084 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:50.084 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.665420+0000", 2024-05-08T18:30:50.084 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00058862499999999996 2024-05-08T18:30:50.084 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.084 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.084 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:50.084 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.667096+0000", 2024-05-08T18:30:50.084 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0016765199999999999 2024-05-08T18:30:50.084 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.084 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.084 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:50.084 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.668109+0000", 2024-05-08T18:30:50.085 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001012829 2024-05-08T18:30:50.085 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.085 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.085 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:50.085 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.668200+0000", 2024-05-08T18:30:50.085 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1186000000000004e-05 2024-05-08T18:30:50.085 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.085 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.085 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:50.085 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.668273+0000", 2024-05-08T18:30:50.085 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.2862999999999997e-05 2024-05-08T18:30:50.085 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:50.085 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:50.086 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:50.086 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.086 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.086 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:50.086 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.732858+0000", 2024-05-08T18:30:50.086 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 58.330347381000003, 2024-05-08T18:30:50.086 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0033301939999999999, 2024-05-08T18:30:50.086 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:50.086 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:50.087 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:50.087 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:50.087 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:50.087 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:50.087 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 220 2024-05-08T18:30:50.087 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.087 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:50.087 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.087 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:50.087 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.732858+0000", 2024-05-08T18:30:50.087 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:50.087 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.088 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.088 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:50.088 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.732858+0000", 2024-05-08T18:30:50.089 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:50.089 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.089 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.089 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:50.089 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.732861+0000", 2024-05-08T18:30:50.089 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.9129999999999999e-06 2024-05-08T18:30:50.089 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.089 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.089 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:50.089 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.732874+0000", 2024-05-08T18:30:50.089 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3349999999999999e-05 2024-05-08T18:30:50.089 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.089 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.090 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:50.090 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.732900+0000", 2024-05-08T18:30:50.090 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6186999999999998e-05 2024-05-08T18:30:50.090 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.090 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.090 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:50.090 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.732916+0000", 2024-05-08T18:30:50.090 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5648999999999999e-05 2024-05-08T18:30:50.090 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.090 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.090 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:50.090 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.733097+0000", 2024-05-08T18:30:50.090 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00018121599999999999 2024-05-08T18:30:50.091 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.091 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.091 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:50.091 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.733299+0000", 2024-05-08T18:30:50.091 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020179799999999999 2024-05-08T18:30:50.091 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.091 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.091 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:50.091 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.733694+0000", 2024-05-08T18:30:50.091 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00039455000000000002 2024-05-08T18:30:50.091 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.091 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.091 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:50.091 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.735124+0000", 2024-05-08T18:30:50.092 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001430239 2024-05-08T18:30:50.092 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.092 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.092 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:50.092 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.736037+0000", 2024-05-08T18:30:50.092 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00091359999999999998 2024-05-08T18:30:50.092 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.092 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.092 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:50.092 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.736122+0000", 2024-05-08T18:30:50.092 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4313000000000004e-05 2024-05-08T18:30:50.092 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.092 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.093 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:50.093 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.736188+0000", 2024-05-08T18:30:50.093 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6378999999999996e-05 2024-05-08T18:30:50.093 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:50.093 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:50.093 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:50.093 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.093 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.093 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:223 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:50.093 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.743358+0000", 2024-05-08T18:30:50.093 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 58.319847168999999, 2024-05-08T18:30:50.093 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003279718, 2024-05-08T18:30:50.093 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:50.094 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:50.094 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:50.094 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:50.094 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:50.094 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:50.094 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 223 2024-05-08T18:30:50.094 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.094 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:50.094 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.094 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:50.094 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.743358+0000", 2024-05-08T18:30:50.094 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:50.095 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.095 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.095 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:50.095 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.743358+0000", 2024-05-08T18:30:50.095 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:50.095 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.095 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.095 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:50.095 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.743361+0000", 2024-05-08T18:30:50.095 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3269999999999999e-06 2024-05-08T18:30:50.095 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.095 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.095 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:50.095 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.743372+0000", 2024-05-08T18:30:50.096 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1202999999999999e-05 2024-05-08T18:30:50.096 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.096 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.096 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:50.096 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.743402+0000", 2024-05-08T18:30:50.096 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0580000000000002e-05 2024-05-08T18:30:50.096 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.096 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.096 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:50.096 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.743417+0000", 2024-05-08T18:30:50.096 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5067e-05 2024-05-08T18:30:50.096 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.096 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.097 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:50.097 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.743529+0000", 2024-05-08T18:30:50.097 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011130599999999999 2024-05-08T18:30:50.097 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.097 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.097 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:50.097 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.743744+0000", 2024-05-08T18:30:50.097 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000215324 2024-05-08T18:30:50.097 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.097 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.097 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:50.097 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.744137+0000", 2024-05-08T18:30:50.097 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00039347699999999999 2024-05-08T18:30:50.098 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.098 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.098 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:50.098 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.745510+0000", 2024-05-08T18:30:50.098 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001372063 2024-05-08T18:30:50.098 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.098 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.098 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:50.098 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.746486+0000", 2024-05-08T18:30:50.098 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00097615600000000005 2024-05-08T18:30:50.098 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.098 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.098 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:50.099 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.746574+0000", 2024-05-08T18:30:50.099 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8598999999999997e-05 2024-05-08T18:30:50.099 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.099 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.099 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:50.099 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.746638+0000", 2024-05-08T18:30:50.099 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3615999999999995e-05 2024-05-08T18:30:50.099 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:50.099 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:50.099 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:50.099 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.099 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.099 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:225 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:50.100 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.750971+0000", 2024-05-08T18:30:50.100 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 58.312234584000002, 2024-05-08T18:30:50.100 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0033719510000000002, 2024-05-08T18:30:50.100 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:50.100 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:50.100 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:50.100 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:50.100 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:50.100 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:50.100 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 225 2024-05-08T18:30:50.100 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.100 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:50.100 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.100 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:50.101 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.750971+0000", 2024-05-08T18:30:50.101 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:50.101 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.101 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.101 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:50.101 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.750971+0000", 2024-05-08T18:30:50.101 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:50.101 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.101 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.101 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:50.101 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.750973+0000", 2024-05-08T18:30:50.101 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.243e-06 2024-05-08T18:30:50.101 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.102 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.102 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:50.102 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.751001+0000", 2024-05-08T18:30:50.102 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8082999999999999e-05 2024-05-08T18:30:50.102 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.102 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.102 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:50.102 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.751029+0000", 2024-05-08T18:30:50.102 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.792e-05 2024-05-08T18:30:50.102 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.102 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.102 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:50.102 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.751051+0000", 2024-05-08T18:30:50.102 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2166000000000001e-05 2024-05-08T18:30:50.103 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.103 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.103 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:50.103 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.751239+0000", 2024-05-08T18:30:50.103 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000187362 2024-05-08T18:30:50.103 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.103 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.103 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:50.103 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.751462+0000", 2024-05-08T18:30:50.103 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000223482 2024-05-08T18:30:50.103 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.103 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.103 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:50.104 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.751893+0000", 2024-05-08T18:30:50.104 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00043102 2024-05-08T18:30:50.104 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.104 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.104 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:50.104 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.753297+0000", 2024-05-08T18:30:50.104 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001403619 2024-05-08T18:30:50.104 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.104 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.104 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:50.104 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.754186+0000", 2024-05-08T18:30:50.104 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00088948399999999996 2024-05-08T18:30:50.104 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.104 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.105 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:50.105 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.754280+0000", 2024-05-08T18:30:50.105 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.3838999999999994e-05 2024-05-08T18:30:50.105 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.105 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.105 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:50.105 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.754343+0000", 2024-05-08T18:30:50.105 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2732999999999997e-05 2024-05-08T18:30:50.105 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:50.105 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:50.105 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:50.105 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.105 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.105 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:226 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:50.106 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.754700+0000", 2024-05-08T18:30:50.106 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 58.308505029000003, 2024-05-08T18:30:50.106 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032180080000000001, 2024-05-08T18:30:50.106 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:50.106 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:50.106 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:50.106 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:50.106 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:50.106 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:50.106 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 226 2024-05-08T18:30:50.106 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.106 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:50.106 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.106 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:50.107 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.754700+0000", 2024-05-08T18:30:50.107 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:50.107 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.107 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.107 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:50.107 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.754700+0000", 2024-05-08T18:30:50.107 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:50.107 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.107 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.107 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:50.107 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.754702+0000", 2024-05-08T18:30:50.107 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.86e-06 2024-05-08T18:30:50.107 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.108 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.108 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:50.108 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.754711+0000", 2024-05-08T18:30:50.108 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.0399999999999998e-06 2024-05-08T18:30:50.108 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.108 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.108 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:50.108 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.754735+0000", 2024-05-08T18:30:50.108 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3496e-05 2024-05-08T18:30:50.108 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.108 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.108 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:50.108 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.754753+0000", 2024-05-08T18:30:50.109 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8406e-05 2024-05-08T18:30:50.109 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.109 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.109 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:50.109 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.754941+0000", 2024-05-08T18:30:50.109 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00018746600000000001 2024-05-08T18:30:50.109 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.109 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.109 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:50.109 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.755164+0000", 2024-05-08T18:30:50.109 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022307800000000001 2024-05-08T18:30:50.109 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.109 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.109 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:50.110 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.755552+0000", 2024-05-08T18:30:50.110 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00038834999999999998 2024-05-08T18:30:50.110 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.110 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.110 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:50.110 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.757079+0000", 2024-05-08T18:30:50.110 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001527055 2024-05-08T18:30:50.110 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.110 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.110 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:50.110 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.757769+0000", 2024-05-08T18:30:50.110 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00068953199999999997 2024-05-08T18:30:50.110 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.111 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.111 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:50.111 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.757848+0000", 2024-05-08T18:30:50.111 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9342e-05 2024-05-08T18:30:50.111 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.111 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.111 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:50.111 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.757918+0000", 2024-05-08T18:30:50.111 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0382999999999993e-05 2024-05-08T18:30:50.111 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:50.111 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:50.111 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:50.111 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.112 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.112 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:234 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:50.112 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.783973+0000", 2024-05-08T18:30:50.112 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 58.279232665000002, 2024-05-08T18:30:50.112 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003359374, 2024-05-08T18:30:50.112 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:50.112 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:50.112 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:50.112 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:50.112 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:50.112 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:50.112 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 234 2024-05-08T18:30:50.112 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.112 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:50.113 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.113 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:50.113 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.783973+0000", 2024-05-08T18:30:50.113 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:50.113 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.113 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.113 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:50.113 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.783973+0000", 2024-05-08T18:30:50.113 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:50.113 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.113 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.113 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:50.113 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.783975+0000", 2024-05-08T18:30:50.113 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2970000000000002e-06 2024-05-08T18:30:50.114 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.114 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.114 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:50.114 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.783986+0000", 2024-05-08T18:30:50.114 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0726e-05 2024-05-08T18:30:50.114 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.114 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.114 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:50.114 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.784016+0000", 2024-05-08T18:30:50.114 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0459000000000001e-05 2024-05-08T18:30:50.114 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.114 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.115 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:50.115 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.784032+0000", 2024-05-08T18:30:50.115 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5316999999999999e-05 2024-05-08T18:30:50.115 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.115 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.115 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:50.115 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.784155+0000", 2024-05-08T18:30:50.115 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012393199999999999 2024-05-08T18:30:50.115 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.115 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.115 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:50.115 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.784377+0000", 2024-05-08T18:30:50.115 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000221179 2024-05-08T18:30:50.116 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.116 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.116 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:50.116 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.784794+0000", 2024-05-08T18:30:50.116 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00041709599999999999 2024-05-08T18:30:50.116 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.116 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.116 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:50.116 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.786199+0000", 2024-05-08T18:30:50.116 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001405346 2024-05-08T18:30:50.116 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.116 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.116 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:50.116 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.787171+0000", 2024-05-08T18:30:50.117 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00097187 2024-05-08T18:30:50.117 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.117 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.117 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:50.117 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.787265+0000", 2024-05-08T18:30:50.117 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4055000000000007e-05 2024-05-08T18:30:50.117 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.117 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.117 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:50.117 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.787332+0000", 2024-05-08T18:30:50.117 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7096999999999998e-05 2024-05-08T18:30:50.117 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:50.117 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:50.118 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:50.118 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.118 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.118 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:425 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:50.118 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.847197+0000", 2024-05-08T18:30:50.118 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 58.216008000000002, 2024-05-08T18:30:50.118 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003317646, 2024-05-08T18:30:50.118 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:50.118 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:50.118 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:50.118 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:50.118 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:50.118 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:50.119 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 425 2024-05-08T18:30:50.119 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.119 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:50.119 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.119 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:50.119 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.847197+0000", 2024-05-08T18:30:50.119 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:50.119 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.119 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.119 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:50.119 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.847197+0000", 2024-05-08T18:30:50.119 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:50.119 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.119 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.120 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:50.120 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.847200+0000", 2024-05-08T18:30:50.120 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1629999999999999e-06 2024-05-08T18:30:50.120 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.120 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.120 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:50.120 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.847210+0000", 2024-05-08T18:30:50.120 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0180000000000001e-05 2024-05-08T18:30:50.120 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.120 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.120 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:50.120 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.847234+0000", 2024-05-08T18:30:50.120 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3879999999999998e-05 2024-05-08T18:30:50.120 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.121 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.121 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:50.121 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.847247+0000", 2024-05-08T18:30:50.121 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3263e-05 2024-05-08T18:30:50.121 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.121 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.121 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:50.121 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.847356+0000", 2024-05-08T18:30:50.121 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000108906 2024-05-08T18:30:50.121 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.121 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.121 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:50.121 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.847647+0000", 2024-05-08T18:30:50.121 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029143799999999998 2024-05-08T18:30:50.122 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.122 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.122 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:50.122 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.848062+0000", 2024-05-08T18:30:50.122 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000415227 2024-05-08T18:30:50.122 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.122 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.122 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:50.122 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.849591+0000", 2024-05-08T18:30:50.122 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0015288980000000001 2024-05-08T18:30:50.122 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.122 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.122 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:50.122 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.850244+0000", 2024-05-08T18:30:50.123 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000652336 2024-05-08T18:30:50.123 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.123 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.123 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:50.123 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.850418+0000", 2024-05-08T18:30:50.123 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000174284 2024-05-08T18:30:50.123 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.123 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.123 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:50.123 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.850515+0000", 2024-05-08T18:30:50.123 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7071000000000006e-05 2024-05-08T18:30:50.123 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:50.123 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:50.123 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:50.124 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.124 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.124 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:433 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:50.124 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.851403+0000", 2024-05-08T18:30:50.124 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 58.211802218999999, 2024-05-08T18:30:50.124 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032407109999999999, 2024-05-08T18:30:50.124 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:50.124 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:50.124 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:50.124 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:50.124 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:50.124 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:50.125 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 433 2024-05-08T18:30:50.125 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.125 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:50.125 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.125 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:50.125 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.851403+0000", 2024-05-08T18:30:50.125 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:50.125 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.125 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.125 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:50.125 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.851403+0000", 2024-05-08T18:30:50.125 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:50.125 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.125 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.126 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:50.126 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.851405+0000", 2024-05-08T18:30:50.126 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.463e-06 2024-05-08T18:30:50.126 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.126 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.126 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:50.126 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.851411+0000", 2024-05-08T18:30:50.126 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2369999999999997e-06 2024-05-08T18:30:50.126 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.126 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.126 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:50.126 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.851428+0000", 2024-05-08T18:30:50.127 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.696e-05 2024-05-08T18:30:50.127 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.127 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.127 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:50.127 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.851446+0000", 2024-05-08T18:30:50.127 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7706e-05 2024-05-08T18:30:50.127 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.127 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.127 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:50.127 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.851552+0000", 2024-05-08T18:30:50.127 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000106236 2024-05-08T18:30:50.127 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.127 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.128 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:50.128 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.851746+0000", 2024-05-08T18:30:50.128 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000194093 2024-05-08T18:30:50.128 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.128 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.128 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:50.128 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.852148+0000", 2024-05-08T18:30:50.128 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00040243100000000002 2024-05-08T18:30:50.128 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.128 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.128 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:50.128 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.854255+0000", 2024-05-08T18:30:50.128 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002107135 2024-05-08T18:30:50.128 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.129 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.129 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:50.129 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.854326+0000", 2024-05-08T18:30:50.129 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0902999999999995e-05 2024-05-08T18:30:50.129 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.129 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.129 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:50.129 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.854568+0000", 2024-05-08T18:30:50.129 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00024141500000000001 2024-05-08T18:30:50.129 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.129 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.129 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:50.129 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.854644+0000", 2024-05-08T18:30:50.129 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6131999999999995e-05 2024-05-08T18:30:50.130 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:50.130 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:50.130 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:50.130 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.130 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.130 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:436 6.a 6:55b0279d:reshard::reshard.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:50.130 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.852129+0000", 2024-05-08T18:30:50.130 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 58.211076411000001, 2024-05-08T18:30:50.130 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0053015019999999996, 2024-05-08T18:30:50.130 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:50.130 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:50.130 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:50.131 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:50.131 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:50.131 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:50.131 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 436 2024-05-08T18:30:50.131 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.131 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:50.131 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.131 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:50.131 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.852129+0000", 2024-05-08T18:30:50.131 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:50.131 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.131 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.131 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:50.132 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.852129+0000", 2024-05-08T18:30:50.132 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:50.132 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.132 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.132 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:50.132 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.852130+0000", 2024-05-08T18:30:50.132 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.353e-06 2024-05-08T18:30:50.132 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.132 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.132 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:50.132 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.852137+0000", 2024-05-08T18:30:50.132 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6900000000000003e-06 2024-05-08T18:30:50.132 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.133 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.133 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:50.133 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.852156+0000", 2024-05-08T18:30:50.133 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9143e-05 2024-05-08T18:30:50.133 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.133 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.133 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:50.133 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.852169+0000", 2024-05-08T18:30:50.133 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.308e-05 2024-05-08T18:30:50.133 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.133 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.133 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:50.133 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.852700+0000", 2024-05-08T18:30:50.133 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00053086599999999996 2024-05-08T18:30:50.134 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.134 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.134 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:50.134 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.853030+0000", 2024-05-08T18:30:50.134 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00033040100000000002 2024-05-08T18:30:50.134 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.134 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.134 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:50.134 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.853514+0000", 2024-05-08T18:30:50.134 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000483969 2024-05-08T18:30:50.134 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.134 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.134 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:50.134 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.856337+0000", 2024-05-08T18:30:50.135 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0028227349999999998 2024-05-08T18:30:50.135 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.135 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.135 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:50.135 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.857285+0000", 2024-05-08T18:30:50.135 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00094820600000000005 2024-05-08T18:30:50.135 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.135 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.135 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:50.135 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.857366+0000", 2024-05-08T18:30:50.135 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.0889000000000004e-05 2024-05-08T18:30:50.135 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.135 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.136 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:50.136 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.857430+0000", 2024-05-08T18:30:50.136 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4170000000000004e-05 2024-05-08T18:30:50.136 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:50.136 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:50.136 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:50.136 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.136 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.136 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:478 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:50.136 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.876745+0000", 2024-05-08T18:30:50.136 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 58.186459874999997, 2024-05-08T18:30:50.136 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0046303550000000001, 2024-05-08T18:30:50.136 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:50.137 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:50.137 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:50.137 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:50.137 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:50.137 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:50.137 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 478 2024-05-08T18:30:50.137 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.137 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:50.137 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.137 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:50.137 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.876745+0000", 2024-05-08T18:30:50.137 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:50.137 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.137 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.138 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:50.138 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.876745+0000", 2024-05-08T18:30:50.138 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:50.138 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.138 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.138 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:50.138 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.876748+0000", 2024-05-08T18:30:50.138 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2819999999999999e-06 2024-05-08T18:30:50.138 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.138 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.138 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:50.138 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.876758+0000", 2024-05-08T18:30:50.138 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0485e-05 2024-05-08T18:30:50.139 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.139 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.139 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:50.139 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.876788+0000", 2024-05-08T18:30:50.139 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.9879e-05 2024-05-08T18:30:50.139 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.139 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.139 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:50.139 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.876805+0000", 2024-05-08T18:30:50.139 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.643e-05 2024-05-08T18:30:50.139 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.139 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.139 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:50.139 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.876917+0000", 2024-05-08T18:30:50.140 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000112377 2024-05-08T18:30:50.140 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.140 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.140 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:50.140 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877094+0000", 2024-05-08T18:30:50.140 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000177131 2024-05-08T18:30:50.140 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.140 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.140 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:50.140 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877441+0000", 2024-05-08T18:30:50.140 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00034716100000000002 2024-05-08T18:30:50.140 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.141 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.141 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:50.141 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.878479+0000", 2024-05-08T18:30:50.141 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010378729999999999 2024-05-08T18:30:50.141 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.141 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.141 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:50.141 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.881252+0000", 2024-05-08T18:30:50.141 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0027728710000000001 2024-05-08T18:30:50.141 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.141 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.141 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:50.141 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.881322+0000", 2024-05-08T18:30:50.141 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0394000000000004e-05 2024-05-08T18:30:50.142 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.142 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.142 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:50.142 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.881376+0000", 2024-05-08T18:30:50.142 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3471999999999999e-05 2024-05-08T18:30:50.142 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:50.142 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:50.142 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:50.142 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.142 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.142 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:479 6.d 6:b3052b9f:reshard::reshard.0000000013:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:50.142 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.877922+0000", 2024-05-08T18:30:50.142 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 58.185283777000002, 2024-05-08T18:30:50.143 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0030756400000000001, 2024-05-08T18:30:50.143 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:50.143 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:50.143 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:50.143 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:50.143 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:50.143 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:50.143 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 479 2024-05-08T18:30:50.143 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.143 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:50.143 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.143 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:50.144 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877922+0000", 2024-05-08T18:30:50.144 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:50.144 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.144 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.144 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:50.144 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877922+0000", 2024-05-08T18:30:50.144 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:50.144 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.144 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.144 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:50.144 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877923+0000", 2024-05-08T18:30:50.144 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8670000000000001e-06 2024-05-08T18:30:50.144 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.144 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.145 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:50.145 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877933+0000", 2024-05-08T18:30:50.145 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.0860000000000008e-06 2024-05-08T18:30:50.145 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.145 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.145 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:50.145 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877970+0000", 2024-05-08T18:30:50.145 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7762999999999997e-05 2024-05-08T18:30:50.145 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.145 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.145 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:50.145 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877997+0000", 2024-05-08T18:30:50.145 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6883e-05 2024-05-08T18:30:50.146 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.146 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.146 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:50.146 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.878108+0000", 2024-05-08T18:30:50.146 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000110797 2024-05-08T18:30:50.146 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.146 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.146 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:50.146 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.878403+0000", 2024-05-08T18:30:50.146 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029509799999999999 2024-05-08T18:30:50.146 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.146 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.146 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:50.147 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.878744+0000", 2024-05-08T18:30:50.147 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00034075899999999999 2024-05-08T18:30:50.147 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.147 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.147 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:50.147 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.879800+0000", 2024-05-08T18:30:50.147 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010564420000000001 2024-05-08T18:30:50.147 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.147 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.147 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:50.147 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.880740+0000", 2024-05-08T18:30:50.147 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000940167 2024-05-08T18:30:50.147 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.148 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.148 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:50.148 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.880880+0000", 2024-05-08T18:30:50.148 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000139796 2024-05-08T18:30:50.148 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.148 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.148 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:50.148 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.880997+0000", 2024-05-08T18:30:50.148 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000116982 2024-05-08T18:30:50.148 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:50.148 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:50.148 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:50.148 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.148 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.149 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:766 6.19 6:9edc23b1:::obj_delete_at_hint.0000000063:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:50.149 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.158937+0000", 2024-05-08T18:30:50.149 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 57.904267886, 2024-05-08T18:30:50.149 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0030448300000000001, 2024-05-08T18:30:50.149 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:50.149 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:50.149 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:50.149 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:50.149 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:50.149 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:50.149 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 766 2024-05-08T18:30:50.149 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.149 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:50.149 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.149 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:50.150 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.158937+0000", 2024-05-08T18:30:50.150 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:50.150 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.150 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.150 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:50.150 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.158937+0000", 2024-05-08T18:30:50.150 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:50.150 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.150 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.150 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:50.150 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.158940+0000", 2024-05-08T18:30:50.150 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6170000000000001e-06 2024-05-08T18:30:50.150 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.151 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.151 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:50.151 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.158952+0000", 2024-05-08T18:30:50.151 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1559000000000001e-05 2024-05-08T18:30:50.151 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.151 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.151 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:50.151 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.158982+0000", 2024-05-08T18:30:50.151 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0406999999999999e-05 2024-05-08T18:30:50.151 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.151 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.151 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:50.151 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.159000+0000", 2024-05-08T18:30:50.151 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8e-05 2024-05-08T18:30:50.152 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.152 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.152 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:50.152 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.159090+0000", 2024-05-08T18:30:50.152 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.0124999999999995e-05 2024-05-08T18:30:50.152 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.152 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.152 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:50.152 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.159296+0000", 2024-05-08T18:30:50.152 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000205663 2024-05-08T18:30:50.152 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.152 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.152 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:50.152 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.159600+0000", 2024-05-08T18:30:50.153 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00030387699999999998 2024-05-08T18:30:50.153 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.153 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.153 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:50.153 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.160694+0000", 2024-05-08T18:30:50.153 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001094228 2024-05-08T18:30:50.153 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.153 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.153 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:50.153 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.161818+0000", 2024-05-08T18:30:50.153 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001124388 2024-05-08T18:30:50.153 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.153 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.154 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:50.154 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.161908+0000", 2024-05-08T18:30:50.154 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.9629000000000005e-05 2024-05-08T18:30:50.154 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.154 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.154 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:50.154 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.161982+0000", 2024-05-08T18:30:50.154 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4337000000000003e-05 2024-05-08T18:30:50.154 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:50.154 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:50.154 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:50.154 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.154 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.155 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:820 6.a 6:50a39311:::obj_delete_at_hint.0000000081:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:50.155 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.281842+0000", 2024-05-08T18:30:50.155 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 57.781363485, 2024-05-08T18:30:50.155 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0030574130000000001, 2024-05-08T18:30:50.155 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:50.155 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:50.155 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:50.155 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:50.155 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:50.155 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:50.155 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 820 2024-05-08T18:30:50.155 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.155 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:50.156 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.156 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:50.156 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.281842+0000", 2024-05-08T18:30:50.156 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:50.156 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.156 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.156 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:50.156 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.281842+0000", 2024-05-08T18:30:50.156 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:50.156 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.156 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.156 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:50.156 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.281845+0000", 2024-05-08T18:30:50.157 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8439999999999998e-06 2024-05-08T18:30:50.157 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.157 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.157 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:50.157 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.281856+0000", 2024-05-08T18:30:50.157 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.148e-05 2024-05-08T18:30:50.157 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.157 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.157 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:50.157 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.281887+0000", 2024-05-08T18:30:50.157 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1239999999999999e-05 2024-05-08T18:30:50.157 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.157 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.157 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:50.158 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.281903+0000", 2024-05-08T18:30:50.158 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5223e-05 2024-05-08T18:30:50.158 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.158 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.158 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:50.158 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.282084+0000", 2024-05-08T18:30:50.158 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00018167500000000001 2024-05-08T18:30:50.158 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.158 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.158 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:50.158 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.282301+0000", 2024-05-08T18:30:50.158 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00021651099999999999 2024-05-08T18:30:50.158 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.159 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.159 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:50.159 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.282634+0000", 2024-05-08T18:30:50.159 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000332758 2024-05-08T18:30:50.159 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.159 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.159 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:50.159 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.283836+0000", 2024-05-08T18:30:50.159 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001202397 2024-05-08T18:30:50.159 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.159 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.159 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:50.159 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.284750+0000", 2024-05-08T18:30:50.159 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00091438999999999995 2024-05-08T18:30:50.160 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.160 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.160 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:50.160 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.284836+0000", 2024-05-08T18:30:50.160 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.5855999999999999e-05 2024-05-08T18:30:50.160 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.160 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.160 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:50.160 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.284899+0000", 2024-05-08T18:30:50.160 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3039000000000004e-05 2024-05-08T18:30:50.160 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:50.160 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:50.160 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:50.161 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.161 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.161 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:835 6.7 6:e09767b9:::obj_delete_at_hint.0000000086:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:50.161 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.317765+0000", 2024-05-08T18:30:50.161 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 57.745440596000002, 2024-05-08T18:30:50.161 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029952809999999998, 2024-05-08T18:30:50.161 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:50.161 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:50.161 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:50.161 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:50.161 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:50.161 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:50.161 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 835 2024-05-08T18:30:50.161 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.162 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:50.162 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.162 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:50.162 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.317765+0000", 2024-05-08T18:30:50.162 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:50.162 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.162 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.162 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:50.162 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.317765+0000", 2024-05-08T18:30:50.162 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:50.162 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.162 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.162 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:50.163 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.317767+0000", 2024-05-08T18:30:50.163 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.057e-06 2024-05-08T18:30:50.163 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.163 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.163 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:50.163 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.317780+0000", 2024-05-08T18:30:50.163 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.36e-05 2024-05-08T18:30:50.163 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.163 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.163 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:50.163 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.317810+0000", 2024-05-08T18:30:50.163 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.9989999999999999e-05 2024-05-08T18:30:50.163 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.163 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.164 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:50.164 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.317832+0000", 2024-05-08T18:30:50.164 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1650000000000001e-05 2024-05-08T18:30:50.164 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.164 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.164 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:50.164 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.317954+0000", 2024-05-08T18:30:50.164 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000121465 2024-05-08T18:30:50.164 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.164 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.164 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:50.164 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.318189+0000", 2024-05-08T18:30:50.164 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000235818 2024-05-08T18:30:50.165 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.165 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.165 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:50.165 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.318532+0000", 2024-05-08T18:30:50.165 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00034245100000000002 2024-05-08T18:30:50.165 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.165 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.165 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:50.165 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.319625+0000", 2024-05-08T18:30:50.165 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010931280000000001 2024-05-08T18:30:50.165 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.165 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.165 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:50.166 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.320612+0000", 2024-05-08T18:30:50.166 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00098682299999999995 2024-05-08T18:30:50.166 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.166 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.166 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:50.166 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.320698+0000", 2024-05-08T18:30:50.166 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.5813e-05 2024-05-08T18:30:50.166 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.166 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.166 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:50.166 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.320760+0000", 2024-05-08T18:30:50.166 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2485999999999998e-05 2024-05-08T18:30:50.167 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:50.167 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:50.167 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:50.167 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.167 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.167 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:922 6.d 6:b6c174be:::obj_delete_at_hint.0000000115:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:50.167 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.516256+0000", 2024-05-08T18:30:50.167 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 57.546949644000001, 2024-05-08T18:30:50.167 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032949839999999999, 2024-05-08T18:30:50.167 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:50.167 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:50.167 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:50.167 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:50.167 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:50.168 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:50.168 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 922 2024-05-08T18:30:50.168 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.168 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:50.168 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.168 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:50.168 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.516256+0000", 2024-05-08T18:30:50.168 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:50.168 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.168 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.168 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:50.168 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.516256+0000", 2024-05-08T18:30:50.168 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:50.169 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.169 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.169 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:50.169 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.516258+0000", 2024-05-08T18:30:50.169 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.4399999999999999e-06 2024-05-08T18:30:50.169 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.169 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.169 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:50.169 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.516269+0000", 2024-05-08T18:30:50.169 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0797e-05 2024-05-08T18:30:50.169 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.169 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.169 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:50.169 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.516299+0000", 2024-05-08T18:30:50.170 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0213e-05 2024-05-08T18:30:50.170 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.170 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.170 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:50.170 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.516314+0000", 2024-05-08T18:30:50.170 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4600000000000001e-05 2024-05-08T18:30:50.170 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.170 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.170 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:50.170 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.516424+0000", 2024-05-08T18:30:50.170 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000110376 2024-05-08T18:30:50.170 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.170 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.171 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:50.171 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.516635+0000", 2024-05-08T18:30:50.171 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000210628 2024-05-08T18:30:50.171 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.171 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.171 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:50.171 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.516947+0000", 2024-05-08T18:30:50.171 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00031246699999999997 2024-05-08T18:30:50.171 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.171 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.171 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:50.171 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.517949+0000", 2024-05-08T18:30:50.171 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010017400000000001 2024-05-08T18:30:50.171 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.172 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.172 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:50.172 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.519389+0000", 2024-05-08T18:30:50.172 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001439655 2024-05-08T18:30:50.172 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.172 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.172 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:50.172 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.519475+0000", 2024-05-08T18:30:50.172 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.6485999999999998e-05 2024-05-08T18:30:50.172 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.172 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.172 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:50.172 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.519551+0000", 2024-05-08T18:30:50.172 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5581999999999996e-05 2024-05-08T18:30:50.173 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:50.173 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:50.173 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:50.173 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.173 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.173 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:940 6.a 6:517698f6:::obj_delete_at_hint.0000000121:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:50.173 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.560553+0000", 2024-05-08T18:30:50.173 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 57.502652796, 2024-05-08T18:30:50.173 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0030017569999999999, 2024-05-08T18:30:50.173 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:50.173 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:50.173 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:50.173 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:50.174 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:50.174 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:50.174 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 940 2024-05-08T18:30:50.174 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.174 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:50.174 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.174 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:50.174 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.560553+0000", 2024-05-08T18:30:50.174 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:50.175 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.175 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.175 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:50.175 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.560553+0000", 2024-05-08T18:30:50.175 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:50.175 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.175 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.175 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:50.175 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.560555+0000", 2024-05-08T18:30:50.175 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.39e-06 2024-05-08T18:30:50.175 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.175 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.175 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:50.175 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.560566+0000", 2024-05-08T18:30:50.176 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1484000000000001e-05 2024-05-08T18:30:50.176 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.176 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.176 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:50.176 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.560596+0000", 2024-05-08T18:30:50.176 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0001999999999998e-05 2024-05-08T18:30:50.176 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.176 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.176 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:50.176 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.560612+0000", 2024-05-08T18:30:50.176 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5690000000000001e-05 2024-05-08T18:30:50.176 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.176 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.176 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:50.177 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.560747+0000", 2024-05-08T18:30:50.177 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013494900000000001 2024-05-08T18:30:50.177 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.177 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.177 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:50.177 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.560961+0000", 2024-05-08T18:30:50.177 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000214305 2024-05-08T18:30:50.177 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.177 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.177 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:50.177 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.561281+0000", 2024-05-08T18:30:50.177 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00031933800000000001 2024-05-08T18:30:50.177 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.178 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.178 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:50.178 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.562399+0000", 2024-05-08T18:30:50.178 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0011180280000000001 2024-05-08T18:30:50.178 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.178 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.178 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:50.178 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.563407+0000", 2024-05-08T18:30:50.178 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010080519999999999 2024-05-08T18:30:50.178 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.178 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.178 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:50.178 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.563489+0000", 2024-05-08T18:30:50.179 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1725999999999996e-05 2024-05-08T18:30:50.179 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.179 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.179 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:50.179 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.563554+0000", 2024-05-08T18:30:50.179 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5792999999999998e-05 2024-05-08T18:30:50.179 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:50.179 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:50.179 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:50.179 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.179 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.179 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:943 6.19 6:9f21944d:::obj_delete_at_hint.0000000122:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:50.179 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.567777+0000", 2024-05-08T18:30:50.180 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 57.495427905, 2024-05-08T18:30:50.180 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0033921939999999999, 2024-05-08T18:30:50.180 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:50.180 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:50.180 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:50.180 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:50.180 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:50.180 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:50.180 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 943 2024-05-08T18:30:50.180 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.180 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:50.180 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.180 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:50.181 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.567777+0000", 2024-05-08T18:30:50.181 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:50.181 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.181 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.181 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:50.181 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.567777+0000", 2024-05-08T18:30:50.181 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:50.181 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.181 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.181 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:50.181 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.567779+0000", 2024-05-08T18:30:50.181 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8330000000000001e-06 2024-05-08T18:30:50.181 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.182 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.182 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:50.182 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.567788+0000", 2024-05-08T18:30:50.182 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4999999999999999e-06 2024-05-08T18:30:50.182 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.182 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.182 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:50.182 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.567812+0000", 2024-05-08T18:30:50.182 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.4207e-05 2024-05-08T18:30:50.182 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.182 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.182 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:50.182 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.567836+0000", 2024-05-08T18:30:50.182 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.4196e-05 2024-05-08T18:30:50.183 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.183 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.183 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:50.183 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.567954+0000", 2024-05-08T18:30:50.183 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011794300000000001 2024-05-08T18:30:50.183 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.183 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.183 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:50.183 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.568170+0000", 2024-05-08T18:30:50.183 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00021626100000000001 2024-05-08T18:30:50.183 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.183 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.183 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:50.184 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.568485+0000", 2024-05-08T18:30:50.184 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00031442800000000001 2024-05-08T18:30:50.184 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.184 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.184 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:50.184 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.569555+0000", 2024-05-08T18:30:50.184 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010698750000000001 2024-05-08T18:30:50.184 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.184 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.184 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:50.184 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.570899+0000", 2024-05-08T18:30:50.184 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0013446700000000001 2024-05-08T18:30:50.184 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.185 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.185 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:50.185 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.571058+0000", 2024-05-08T18:30:50.185 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015871900000000001 2024-05-08T18:30:50.185 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.185 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.185 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:50.185 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.571170+0000", 2024-05-08T18:30:50.185 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000111562 2024-05-08T18:30:50.185 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:50.185 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:50.185 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:50.185 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.185 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.185 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:952 6.a 6:541d369a:::obj_delete_at_hint.0000000125:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:50.186 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.588764+0000", 2024-05-08T18:30:50.186 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 57.474440874000003, 2024-05-08T18:30:50.186 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003183399, 2024-05-08T18:30:50.186 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:50.186 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:50.186 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:50.186 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:50.186 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:50.186 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:50.186 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 952 2024-05-08T18:30:50.186 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.186 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:50.186 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.187 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:50.187 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.588764+0000", 2024-05-08T18:30:50.187 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:50.187 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.187 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.187 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:50.187 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.588764+0000", 2024-05-08T18:30:50.187 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:50.187 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.189 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.189 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:50.189 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.588767+0000", 2024-05-08T18:30:50.189 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.39e-06 2024-05-08T18:30:50.189 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.189 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.189 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:50.190 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.588778+0000", 2024-05-08T18:30:50.190 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1304000000000001e-05 2024-05-08T18:30:50.190 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.190 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.190 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:50.190 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.588810+0000", 2024-05-08T18:30:50.190 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1726000000000001e-05 2024-05-08T18:30:50.190 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.190 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.190 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:50.190 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.588834+0000", 2024-05-08T18:30:50.190 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3845999999999998e-05 2024-05-08T18:30:50.190 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.191 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.191 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:50.191 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.588987+0000", 2024-05-08T18:30:50.191 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015300200000000001 2024-05-08T18:30:50.191 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.191 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.191 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:50.191 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.589197+0000", 2024-05-08T18:30:50.191 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020992299999999999 2024-05-08T18:30:50.191 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.191 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.191 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:50.191 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.589536+0000", 2024-05-08T18:30:50.192 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00033939300000000001 2024-05-08T18:30:50.192 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.192 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.192 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:50.192 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.590827+0000", 2024-05-08T18:30:50.192 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0012906 2024-05-08T18:30:50.192 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.192 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.192 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:50.192 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.591757+0000", 2024-05-08T18:30:50.192 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00093020699999999995 2024-05-08T18:30:50.192 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.192 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.192 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:50.193 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.591881+0000", 2024-05-08T18:30:50.193 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012406900000000001 2024-05-08T18:30:50.193 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.193 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.193 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:50.193 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.591948+0000", 2024-05-08T18:30:50.193 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6939000000000004e-05 2024-05-08T18:30:50.193 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:50.193 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:50.193 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:50.193 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:50.193 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:50.193 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:30:50.195 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-08T18:30:50.196 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:30:50.195+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:30:50.296 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:30:50.296+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:30:50.366 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:30:50.366 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:30:50.366 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 0 2024-05-08T18:30:50.366 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:30:50.381 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-08T18:30:50.429 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:30:50.427+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:30:50.497 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:30:50.495+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:30:50.504 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:30:50.504 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:30:50.504 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2024-05-08T18:30:50.504 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2024-05-08T18:30:50.504 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:30:50.519 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-08T18:30:50.586 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-08T18:30:50.604 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:30:50.603+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:30:50.691 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:30:50.691 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2024-05-08T18:30:50.691 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2024-05-08T18:30:50.691 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-05-08T18:30:50.692 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.692 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:30:50.692 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:48.647802+0000", 2024-05-08T18:30:50.692 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 62.041975227000002, 2024-05-08T18:30:50.692 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0027254660000000002, 2024-05-08T18:30:50.692 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:50.692 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:50.692 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:50.692 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:50.692 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:50.692 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:50.692 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 46 2024-05-08T18:30:50.693 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.693 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:50.693 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.693 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:50.693 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.647802+0000", 2024-05-08T18:30:50.693 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:50.693 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.693 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.693 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:50.693 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.647802+0000", 2024-05-08T18:30:50.693 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:50.693 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.693 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.694 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:50.694 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.647805+0000", 2024-05-08T18:30:50.694 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8940000000000002e-06 2024-05-08T18:30:50.694 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.694 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.694 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:50.694 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.647816+0000", 2024-05-08T18:30:50.695 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0998999999999999e-05 2024-05-08T18:30:50.695 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.695 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.695 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:50.695 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.647846+0000", 2024-05-08T18:30:50.695 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.027e-05 2024-05-08T18:30:50.695 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.695 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.695 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:50.696 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.647865+0000", 2024-05-08T18:30:50.696 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.808e-05 2024-05-08T18:30:50.696 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.696 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.696 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:50.697 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.647994+0000", 2024-05-08T18:30:50.697 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012923899999999999 2024-05-08T18:30:50.697 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.697 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.697 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:50.697 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.648289+0000", 2024-05-08T18:30:50.697 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029495999999999998 2024-05-08T18:30:50.697 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.698 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.698 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:50.698 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.648576+0000", 2024-05-08T18:30:50.698 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00028707599999999999 2024-05-08T18:30:50.698 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.698 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.698 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:50.698 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.649703+0000", 2024-05-08T18:30:50.699 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001126658 2024-05-08T18:30:50.699 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.699 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.699 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:50.699 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.650337+0000", 2024-05-08T18:30:50.700 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00063405500000000001 2024-05-08T18:30:50.700 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.700 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.700 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:50.700 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.650451+0000", 2024-05-08T18:30:50.700 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011476600000000001 2024-05-08T18:30:50.700 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.700 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.700 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:50.700 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.650528+0000", 2024-05-08T18:30:50.700 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6469000000000003e-05 2024-05-08T18:30:50.700 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:50.700 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:50.700 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:50.700 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.701 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.701 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94069412627456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:30:50.701 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:48.650773+0000", 2024-05-08T18:30:50.701 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 62.039004689000002, 2024-05-08T18:30:50.701 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0024358209999999999, 2024-05-08T18:30:50.701 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:50.701 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:50.701 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:50.701 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:50.701 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:50.701 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:50.701 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 47 2024-05-08T18:30:50.701 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.701 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:50.702 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.702 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:50.702 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.650773+0000", 2024-05-08T18:30:50.702 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:50.702 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.702 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.702 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:50.702 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.650773+0000", 2024-05-08T18:30:50.702 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:50.702 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.702 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.702 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:50.702 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.650775+0000", 2024-05-08T18:30:50.703 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.4030000000000001e-06 2024-05-08T18:30:50.703 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.703 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.703 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:50.703 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.650785+0000", 2024-05-08T18:30:50.703 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0027000000000001e-05 2024-05-08T18:30:50.703 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.703 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.703 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:50.703 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.650814+0000", 2024-05-08T18:30:50.703 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8350000000000001e-05 2024-05-08T18:30:50.703 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.703 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.703 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:50.704 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.650848+0000", 2024-05-08T18:30:50.704 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4566000000000001e-05 2024-05-08T18:30:50.704 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.704 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.704 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:50.704 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.650963+0000", 2024-05-08T18:30:50.704 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011506300000000001 2024-05-08T18:30:50.704 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.704 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.704 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:50.704 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.651153+0000", 2024-05-08T18:30:50.704 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000189812 2024-05-08T18:30:50.704 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.704 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.705 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:50.705 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.651493+0000", 2024-05-08T18:30:50.705 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000339616 2024-05-08T18:30:50.705 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.705 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.705 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:50.705 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.652662+0000", 2024-05-08T18:30:50.705 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0011695410000000001 2024-05-08T18:30:50.705 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.705 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.705 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:50.705 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.652998+0000", 2024-05-08T18:30:50.705 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000335788 2024-05-08T18:30:50.705 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.706 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.706 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:50.706 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.653076+0000", 2024-05-08T18:30:50.706 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8120000000000004e-05 2024-05-08T18:30:50.706 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.706 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.706 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:50.706 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.653209+0000", 2024-05-08T18:30:50.706 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000132535 2024-05-08T18:30:50.706 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:50.706 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:50.706 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:50.706 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.706 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.707 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:30:50.707 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:48.659528+0000", 2024-05-08T18:30:50.707 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 62.030249474000001, 2024-05-08T18:30:50.707 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0025123260000000001, 2024-05-08T18:30:50.707 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:50.707 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:50.707 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:50.707 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:50.707 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:50.707 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:50.707 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 54 2024-05-08T18:30:50.707 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.707 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:50.707 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.708 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:50.708 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.659528+0000", 2024-05-08T18:30:50.708 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:50.708 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.708 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.708 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:50.708 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.659528+0000", 2024-05-08T18:30:50.708 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:50.708 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.708 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.708 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:50.708 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.659530+0000", 2024-05-08T18:30:50.708 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9429999999999999e-06 2024-05-08T18:30:50.708 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.709 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.709 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:50.709 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.659540+0000", 2024-05-08T18:30:50.709 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0147e-05 2024-05-08T18:30:50.709 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.709 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.709 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:50.709 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.659569+0000", 2024-05-08T18:30:50.709 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.923e-05 2024-05-08T18:30:50.709 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.709 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.709 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:50.709 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.659584+0000", 2024-05-08T18:30:50.709 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4996e-05 2024-05-08T18:30:50.710 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.710 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.710 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:50.710 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.659716+0000", 2024-05-08T18:30:50.710 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000131457 2024-05-08T18:30:50.710 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.710 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.710 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:50.710 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.659895+0000", 2024-05-08T18:30:50.710 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017940400000000001 2024-05-08T18:30:50.710 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.710 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.710 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:50.710 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.660092+0000", 2024-05-08T18:30:50.711 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000197002 2024-05-08T18:30:50.711 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.711 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.711 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:50.711 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.661227+0000", 2024-05-08T18:30:50.711 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0011346150000000001 2024-05-08T18:30:50.711 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.711 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.711 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:50.711 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.661907+0000", 2024-05-08T18:30:50.711 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00068008800000000002 2024-05-08T18:30:50.711 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.711 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.712 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:50.712 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.661978+0000", 2024-05-08T18:30:50.712 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1538999999999994e-05 2024-05-08T18:30:50.712 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.712 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.712 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:50.712 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.662040+0000", 2024-05-08T18:30:50.712 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1904999999999998e-05 2024-05-08T18:30:50.712 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:50.712 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:50.712 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:50.712 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.712 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.712 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94069412622848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:30:50.713 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:48.662241+0000", 2024-05-08T18:30:50.713 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 62.027536148000003, 2024-05-08T18:30:50.713 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029022259999999999, 2024-05-08T18:30:50.713 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:50.713 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:50.713 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:50.713 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:50.713 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:50.713 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:50.713 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 55 2024-05-08T18:30:50.713 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.713 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:50.713 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.714 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:50.714 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.662241+0000", 2024-05-08T18:30:50.714 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:50.714 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.714 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.714 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:50.714 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.662241+0000", 2024-05-08T18:30:50.714 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:50.714 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.714 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.714 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:50.714 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.662243+0000", 2024-05-08T18:30:50.714 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.716e-06 2024-05-08T18:30:50.715 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.715 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.715 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:50.715 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.662267+0000", 2024-05-08T18:30:50.715 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3949999999999999e-05 2024-05-08T18:30:50.715 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.715 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.715 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:50.715 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.662293+0000", 2024-05-08T18:30:50.715 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6376e-05 2024-05-08T18:30:50.715 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.715 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.715 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:50.716 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.662310+0000", 2024-05-08T18:30:50.716 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6520000000000001e-05 2024-05-08T18:30:50.716 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.716 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.716 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:50.716 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.662412+0000", 2024-05-08T18:30:50.716 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010228700000000001 2024-05-08T18:30:50.716 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.716 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.716 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:50.716 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.662514+0000", 2024-05-08T18:30:50.716 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0001019 2024-05-08T18:30:50.716 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.716 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.717 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:50.717 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.662714+0000", 2024-05-08T18:30:50.717 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020008100000000001 2024-05-08T18:30:50.717 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.717 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.717 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:50.717 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.663711+0000", 2024-05-08T18:30:50.717 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00099629899999999997 2024-05-08T18:30:50.717 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.717 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.717 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:50.717 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.664976+0000", 2024-05-08T18:30:50.717 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0012652679999999999 2024-05-08T18:30:50.717 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.717 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.718 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:50.718 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.665047+0000", 2024-05-08T18:30:50.718 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1277000000000002e-05 2024-05-08T18:30:50.718 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.718 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.718 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:50.718 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.665144+0000", 2024-05-08T18:30:50.718 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6552000000000007e-05 2024-05-08T18:30:50.718 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:50.718 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:50.718 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:50.718 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.718 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.719 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:209 6.3 e33/27 6:c60da066:gc::gc.4:head v 33'1, mlcod=0'0)", 2024-05-08T18:30:50.719 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.686317+0000", 2024-05-08T18:30:50.719 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 59.003460144000002, 2024-05-08T18:30:50.719 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032126889999999999, 2024-05-08T18:30:50.719 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:50.719 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:50.719 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:50.719 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:50.719 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.719 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:50.719 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.686317+0000", 2024-05-08T18:30:50.719 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:50.719 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.719 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.720 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:50.720 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.686317+0000", 2024-05-08T18:30:50.720 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:50.720 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.720 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.720 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:50.720 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.686318+0000", 2024-05-08T18:30:50.720 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5400000000000001e-07 2024-05-08T18:30:50.720 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.720 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.720 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:50.720 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.686326+0000", 2024-05-08T18:30:50.720 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3000000000000002e-06 2024-05-08T18:30:50.720 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.721 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.721 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:50.721 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.686358+0000", 2024-05-08T18:30:50.721 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1702999999999998e-05 2024-05-08T18:30:50.721 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.721 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.721 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:50.721 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.686374+0000", 2024-05-08T18:30:50.721 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6266e-05 2024-05-08T18:30:50.721 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.721 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.721 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:50.721 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.686530+0000", 2024-05-08T18:30:50.721 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015583599999999999 2024-05-08T18:30:50.722 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.722 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.722 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:50.722 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.686573+0000", 2024-05-08T18:30:50.722 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3248999999999999e-05 2024-05-08T18:30:50.722 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.722 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.722 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:50.722 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.689412+0000", 2024-05-08T18:30:50.722 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0028385720000000001 2024-05-08T18:30:50.722 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.722 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.723 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:50.723 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.689530+0000", 2024-05-08T18:30:50.723 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000118109 2024-05-08T18:30:50.723 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:50.723 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:50.723 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:50.723 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.723 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.723 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:217 6.15 e33/27 6:ab569f81:gc::gc.12:head v 33'1, mlcod=0'0)", 2024-05-08T18:30:50.723 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.722458+0000", 2024-05-08T18:30:50.723 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 58.967319603, 2024-05-08T18:30:50.723 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001760604, 2024-05-08T18:30:50.723 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:50.724 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:50.724 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:50.724 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:50.724 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.724 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:50.724 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.722458+0000", 2024-05-08T18:30:50.724 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:50.724 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.724 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.724 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:50.724 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.722458+0000", 2024-05-08T18:30:50.724 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:50.724 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.724 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.725 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:50.725 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.722460+0000", 2024-05-08T18:30:50.725 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.677e-06 2024-05-08T18:30:50.725 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.725 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.725 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:50.725 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.722471+0000", 2024-05-08T18:30:50.725 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0956e-05 2024-05-08T18:30:50.725 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.725 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.725 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:50.725 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.722496+0000", 2024-05-08T18:30:50.725 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5490000000000002e-05 2024-05-08T18:30:50.725 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.726 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.726 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:50.726 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.722511+0000", 2024-05-08T18:30:50.726 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4687e-05 2024-05-08T18:30:50.726 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.726 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.726 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:50.726 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.722609+0000", 2024-05-08T18:30:50.726 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8152000000000005e-05 2024-05-08T18:30:50.726 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.726 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.726 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:50.726 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.722638+0000", 2024-05-08T18:30:50.727 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.934e-05 2024-05-08T18:30:50.727 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.727 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.727 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:50.727 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.724127+0000", 2024-05-08T18:30:50.727 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001488622 2024-05-08T18:30:50.727 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.727 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.727 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:50.727 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.724219+0000", 2024-05-08T18:30:50.727 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1680000000000003e-05 2024-05-08T18:30:50.727 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:50.727 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:50.728 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:50.728 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.728 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.728 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:231 6.1f e33/27 6:fde4dd55:gc::gc.26:head v 33'1, mlcod=0'0)", 2024-05-08T18:30:50.728 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.773905+0000", 2024-05-08T18:30:50.728 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 58.915872063000002, 2024-05-08T18:30:50.728 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002018681, 2024-05-08T18:30:50.728 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:50.728 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:50.728 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:50.728 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:50.728 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.728 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:50.728 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.773905+0000", 2024-05-08T18:30:50.729 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:50.729 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.729 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.729 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:50.729 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.773905+0000", 2024-05-08T18:30:50.729 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:50.729 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.729 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.729 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:50.729 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.773906+0000", 2024-05-08T18:30:50.729 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2300000000000001e-07 2024-05-08T18:30:50.729 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.729 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.729 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:50.730 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.773913+0000", 2024-05-08T18:30:50.730 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8399999999999997e-06 2024-05-08T18:30:50.730 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.730 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.730 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:50.730 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.773938+0000", 2024-05-08T18:30:50.730 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.4977000000000002e-05 2024-05-08T18:30:50.730 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.730 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.730 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:50.730 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.773970+0000", 2024-05-08T18:30:50.730 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1673e-05 2024-05-08T18:30:50.730 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.731 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.731 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:50.731 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.774112+0000", 2024-05-08T18:30:50.731 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014273899999999999 2024-05-08T18:30:50.731 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.731 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.731 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:50.731 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.774167+0000", 2024-05-08T18:30:50.731 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4762000000000002e-05 2024-05-08T18:30:50.731 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.731 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.731 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:50.731 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.775832+0000", 2024-05-08T18:30:50.731 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0016648539999999999 2024-05-08T18:30:50.732 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.732 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.732 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:50.732 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.775924+0000", 2024-05-08T18:30:50.732 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2312999999999995e-05 2024-05-08T18:30:50.732 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:50.732 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:50.732 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:50.732 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.732 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.732 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:328 6.15 e33/27 6:ab569f81:gc::gc.12:head v 33'3, mlcod=33'1)", 2024-05-08T18:30:50.732 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.811368+0000", 2024-05-08T18:30:50.732 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 58.878409562000002, 2024-05-08T18:30:50.732 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0019828110000000001, 2024-05-08T18:30:50.733 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:50.733 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:50.733 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:50.733 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:50.733 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.733 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:50.733 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.811368+0000", 2024-05-08T18:30:50.733 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:50.733 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.733 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.733 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:50.733 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.811368+0000", 2024-05-08T18:30:50.733 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:50.733 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.733 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.734 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:50.734 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.811370+0000", 2024-05-08T18:30:50.734 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.883e-06 2024-05-08T18:30:50.734 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.734 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.734 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:50.734 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.811385+0000", 2024-05-08T18:30:50.734 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5489999999999999e-05 2024-05-08T18:30:50.734 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.734 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.734 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:50.734 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.811422+0000", 2024-05-08T18:30:50.734 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7023000000000001e-05 2024-05-08T18:30:50.735 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.735 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.735 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:50.735 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.811443+0000", 2024-05-08T18:30:50.735 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0194e-05 2024-05-08T18:30:50.735 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.735 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.735 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:50.735 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.811582+0000", 2024-05-08T18:30:50.735 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000139068 2024-05-08T18:30:50.735 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.735 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.735 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:50.735 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.811646+0000", 2024-05-08T18:30:50.736 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4113000000000001e-05 2024-05-08T18:30:50.736 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.736 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.736 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:50.736 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.813243+0000", 2024-05-08T18:30:50.736 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0015969249999999999 2024-05-08T18:30:50.736 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.736 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.736 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:50.736 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.813351+0000", 2024-05-08T18:30:50.736 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000108115 2024-05-08T18:30:50.736 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:50.736 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:50.736 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:50.737 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.737 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.737 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:341 6.1 e33/27 6:856b9b26:reshard::reshard.0000000002:head v 33'2, mlcod=0'0)", 2024-05-08T18:30:50.737 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.813091+0000", 2024-05-08T18:30:50.737 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 58.876686294999999, 2024-05-08T18:30:50.737 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0021783459999999998, 2024-05-08T18:30:50.737 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:50.737 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:50.737 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:50.737 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:50.737 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.737 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:50.737 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.813091+0000", 2024-05-08T18:30:50.737 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:50.738 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.738 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.738 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:50.738 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.813091+0000", 2024-05-08T18:30:50.738 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:50.738 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.738 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.738 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:50.738 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.813093+0000", 2024-05-08T18:30:50.738 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.813e-06 2024-05-08T18:30:50.738 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.738 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.738 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:50.738 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.813107+0000", 2024-05-08T18:30:50.739 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3730000000000001e-05 2024-05-08T18:30:50.739 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.739 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.739 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:50.739 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.813177+0000", 2024-05-08T18:30:50.739 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9801999999999993e-05 2024-05-08T18:30:50.739 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.739 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.739 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:50.739 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.813198+0000", 2024-05-08T18:30:50.739 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1347000000000001e-05 2024-05-08T18:30:50.739 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.740 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.740 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:50.740 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.813321+0000", 2024-05-08T18:30:50.740 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000123192 2024-05-08T18:30:50.740 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.740 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.740 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:50.740 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.813373+0000", 2024-05-08T18:30:50.740 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2046999999999998e-05 2024-05-08T18:30:50.740 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.740 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.740 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:50.740 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.815181+0000", 2024-05-08T18:30:50.740 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001807562 2024-05-08T18:30:50.740 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.741 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.741 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:50.741 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.815270+0000", 2024-05-08T18:30:50.741 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8852999999999998e-05 2024-05-08T18:30:50.741 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:50.741 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:50.741 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:50.741 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.741 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.741 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:404 6.3 e33/27 6:c623b173:gc::gc.16:head v 33'6, mlcod=33'4)", 2024-05-08T18:30:50.741 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.837510+0000", 2024-05-08T18:30:50.741 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 58.852267984000001, 2024-05-08T18:30:50.741 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0023724549999999999, 2024-05-08T18:30:50.741 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:50.741 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:50.742 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:50.742 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:50.742 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.742 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:50.742 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.837510+0000", 2024-05-08T18:30:50.742 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:50.742 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.742 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.742 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:50.742 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.837510+0000", 2024-05-08T18:30:50.742 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:50.742 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.743 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.743 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:50.743 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.837511+0000", 2024-05-08T18:30:50.743 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.863e-06 2024-05-08T18:30:50.743 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.743 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.743 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:50.743 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.837526+0000", 2024-05-08T18:30:50.743 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4756999999999999e-05 2024-05-08T18:30:50.743 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.743 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.743 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:50.743 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.837564+0000", 2024-05-08T18:30:50.743 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7645999999999998e-05 2024-05-08T18:30:50.743 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.744 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.744 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:50.744 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.837584+0000", 2024-05-08T18:30:50.744 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9763999999999999e-05 2024-05-08T18:30:50.744 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.744 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.744 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:50.744 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.837724+0000", 2024-05-08T18:30:50.744 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014080200000000001 2024-05-08T18:30:50.744 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.744 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.744 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:50.744 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.837776+0000", 2024-05-08T18:30:50.744 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1279000000000002e-05 2024-05-08T18:30:50.745 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.745 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.745 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:50.745 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.839770+0000", 2024-05-08T18:30:50.745 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001994048 2024-05-08T18:30:50.745 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.745 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.745 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:50.745 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.839882+0000", 2024-05-08T18:30:50.745 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000112296 2024-05-08T18:30:50.745 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:50.745 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:50.745 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:50.745 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.746 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.746 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:414 6.c e33/27 6:338eb7e9:::obj_delete_at_hint.0000000008:head v 33'3, mlcod=33'1)", 2024-05-08T18:30:50.746 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.841401+0000", 2024-05-08T18:30:50.746 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 58.848376834, 2024-05-08T18:30:50.746 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001916865, 2024-05-08T18:30:50.746 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:50.746 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:50.746 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:50.746 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:50.746 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.746 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:50.746 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.841401+0000", 2024-05-08T18:30:50.746 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:50.746 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.747 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.747 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:50.747 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.841401+0000", 2024-05-08T18:30:50.747 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:50.747 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.747 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.747 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:50.747 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.841402+0000", 2024-05-08T18:30:50.747 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6899999999999999e-06 2024-05-08T18:30:50.747 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.747 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.747 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:50.747 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.841414+0000", 2024-05-08T18:30:50.748 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.183e-05 2024-05-08T18:30:50.748 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.748 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.748 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:50.748 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.841435+0000", 2024-05-08T18:30:50.748 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0876000000000001e-05 2024-05-08T18:30:50.748 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.748 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.748 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:50.748 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.841451+0000", 2024-05-08T18:30:50.748 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5784e-05 2024-05-08T18:30:50.748 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.748 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.748 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:50.748 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.841597+0000", 2024-05-08T18:30:50.749 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014639899999999999 2024-05-08T18:30:50.749 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.749 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.749 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:50.749 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.841656+0000", 2024-05-08T18:30:50.749 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8485e-05 2024-05-08T18:30:50.749 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.749 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.749 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:50.749 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.843235+0000", 2024-05-08T18:30:50.749 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0015787920000000001 2024-05-08T18:30:50.749 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.749 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.749 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:50.750 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.843318+0000", 2024-05-08T18:30:50.750 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3009000000000004e-05 2024-05-08T18:30:50.750 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:50.750 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:50.750 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:50.750 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.750 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.750 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:422 6.c e33/27 6:338eb7e9:::obj_delete_at_hint.0000000008:head v 33'4, mlcod=33'2)", 2024-05-08T18:30:50.750 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.844520+0000", 2024-05-08T18:30:50.750 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 58.845257687999997, 2024-05-08T18:30:50.750 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002269929, 2024-05-08T18:30:50.750 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:50.750 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:50.750 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:50.751 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:50.751 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.751 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:50.751 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.844520+0000", 2024-05-08T18:30:50.751 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:50.751 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.751 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.751 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:50.751 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.844520+0000", 2024-05-08T18:30:50.751 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:50.751 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.751 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.751 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:50.751 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.844522+0000", 2024-05-08T18:30:50.752 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.643e-06 2024-05-08T18:30:50.752 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.752 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.752 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:50.752 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.844577+0000", 2024-05-08T18:30:50.752 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5976000000000001e-05 2024-05-08T18:30:50.752 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.752 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.752 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:50.752 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.844613+0000", 2024-05-08T18:30:50.752 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5339999999999997e-05 2024-05-08T18:30:50.752 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.752 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.752 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:50.752 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.844638+0000", 2024-05-08T18:30:50.753 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5165999999999999e-05 2024-05-08T18:30:50.753 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.753 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.753 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:50.753 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.844795+0000", 2024-05-08T18:30:50.753 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015660899999999999 2024-05-08T18:30:50.753 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.753 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.753 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:50.753 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.844841+0000", 2024-05-08T18:30:50.753 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6279999999999997e-05 2024-05-08T18:30:50.753 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.753 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.753 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:50.754 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.846707+0000", 2024-05-08T18:30:50.754 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0018657249999999999 2024-05-08T18:30:50.754 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.754 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.754 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:50.754 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.846790+0000", 2024-05-08T18:30:50.754 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3189999999999995e-05 2024-05-08T18:30:50.754 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:50.754 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:50.754 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:50.754 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.754 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.754 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:425 6.a e33/27 6:50d64734:::obj_delete_at_hint.0000000009:head v 33'2, mlcod=0'0)", 2024-05-08T18:30:50.754 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.848220+0000", 2024-05-08T18:30:50.754 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 58.841557569999999, 2024-05-08T18:30:50.755 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0017145109999999999, 2024-05-08T18:30:50.755 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:50.755 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:50.755 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:50.755 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:50.755 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.755 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:50.755 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.848220+0000", 2024-05-08T18:30:50.755 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:50.755 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.755 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.755 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:50.755 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.848220+0000", 2024-05-08T18:30:50.756 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:50.756 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.756 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.756 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:50.756 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.848222+0000", 2024-05-08T18:30:50.756 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9630000000000001e-06 2024-05-08T18:30:50.756 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.756 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.756 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:50.756 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.848254+0000", 2024-05-08T18:30:50.756 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2047e-05 2024-05-08T18:30:50.756 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.756 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.756 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:50.756 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.848273+0000", 2024-05-08T18:30:50.757 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9493000000000001e-05 2024-05-08T18:30:50.757 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.757 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.757 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:50.757 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.848286+0000", 2024-05-08T18:30:50.757 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2490000000000001e-05 2024-05-08T18:30:50.757 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.757 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.757 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:50.757 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.848414+0000", 2024-05-08T18:30:50.757 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000127785 2024-05-08T18:30:50.757 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.757 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.757 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:50.757 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.848448+0000", 2024-05-08T18:30:50.758 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4233999999999998e-05 2024-05-08T18:30:50.758 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.758 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.758 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:50.758 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.849855+0000", 2024-05-08T18:30:50.758 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001407482 2024-05-08T18:30:50.758 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.758 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.758 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:50.758 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.849934+0000", 2024-05-08T18:30:50.758 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9017000000000006e-05 2024-05-08T18:30:50.758 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:50.758 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:50.759 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:50.759 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.759 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.759 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:436 6.a e33/27 6:55b0279d:reshard::reshard.0000000009:head v 33'4, mlcod=33'1)", 2024-05-08T18:30:50.759 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.853725+0000", 2024-05-08T18:30:50.759 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 58.836052053000003, 2024-05-08T18:30:50.759 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032824949999999999, 2024-05-08T18:30:50.759 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:50.759 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:50.759 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:50.759 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:50.759 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.759 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:50.759 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.853725+0000", 2024-05-08T18:30:50.759 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:50.760 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.760 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.760 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:50.760 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.853725+0000", 2024-05-08T18:30:50.760 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:50.760 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.760 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.760 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:50.760 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.853727+0000", 2024-05-08T18:30:50.760 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6899999999999999e-06 2024-05-08T18:30:50.760 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.760 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.760 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:50.760 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.853742+0000", 2024-05-08T18:30:50.760 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.517e-05 2024-05-08T18:30:50.761 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.761 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.761 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:50.761 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.853778+0000", 2024-05-08T18:30:50.761 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5173999999999999e-05 2024-05-08T18:30:50.761 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.761 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.761 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:50.761 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.853791+0000", 2024-05-08T18:30:50.761 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.345e-05 2024-05-08T18:30:50.761 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.761 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.761 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:50.761 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.853912+0000", 2024-05-08T18:30:50.762 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012149199999999999 2024-05-08T18:30:50.762 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.762 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.762 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:50.762 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.853960+0000", 2024-05-08T18:30:50.762 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7262999999999998e-05 2024-05-08T18:30:50.762 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.762 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.762 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:50.762 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.856896+0000", 2024-05-08T18:30:50.762 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029363700000000002 2024-05-08T18:30:50.762 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.762 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.762 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:50.763 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.857008+0000", 2024-05-08T18:30:50.763 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011188600000000001 2024-05-08T18:30:50.763 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:50.763 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:50.763 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:50.763 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.763 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.763 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:457 6.1 e33/27 6:80b6fe23:reshard::reshard.0000000011:head v 33'3, mlcod=33'1)", 2024-05-08T18:30:50.763 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.865322+0000", 2024-05-08T18:30:50.763 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 58.824455407999999, 2024-05-08T18:30:50.763 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001750756, 2024-05-08T18:30:50.763 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:50.763 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:50.763 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:50.763 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:50.764 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.764 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:50.764 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.865322+0000", 2024-05-08T18:30:50.764 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:50.764 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.764 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.764 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:50.764 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.865322+0000", 2024-05-08T18:30:50.764 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:50.764 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.764 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.764 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:50.764 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.865325+0000", 2024-05-08T18:30:50.764 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5660000000000001e-06 2024-05-08T18:30:50.764 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.765 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.765 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:50.765 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.865339+0000", 2024-05-08T18:30:50.765 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.412e-05 2024-05-08T18:30:50.765 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.765 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.765 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:50.765 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.865366+0000", 2024-05-08T18:30:50.765 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7453e-05 2024-05-08T18:30:50.765 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.765 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.765 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:50.765 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.865383+0000", 2024-05-08T18:30:50.765 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.683e-05 2024-05-08T18:30:50.766 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.766 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.766 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:50.766 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.865514+0000", 2024-05-08T18:30:50.766 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000131369 2024-05-08T18:30:50.766 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.766 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.766 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:50.766 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.865583+0000", 2024-05-08T18:30:50.766 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8526000000000001e-05 2024-05-08T18:30:50.766 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.766 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.766 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:50.767 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.866974+0000", 2024-05-08T18:30:50.767 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001391193 2024-05-08T18:30:50.767 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.767 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.767 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:50.767 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.867073+0000", 2024-05-08T18:30:50.767 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8698999999999998e-05 2024-05-08T18:30:50.767 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:50.767 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:50.767 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:50.767 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.767 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.767 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:478 6.a e33/27 6:5127e642:gc::gc.21:head v 33'6, mlcod=33'4)", 2024-05-08T18:30:50.767 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.877617+0000", 2024-05-08T18:30:50.767 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 58.812160294999998, 2024-05-08T18:30:50.768 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0033938589999999999, 2024-05-08T18:30:50.768 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:50.768 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:50.768 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:50.768 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:50.768 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.768 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:50.768 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877617+0000", 2024-05-08T18:30:50.768 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:50.768 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.768 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.768 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:50.768 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877617+0000", 2024-05-08T18:30:50.768 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:50.769 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.769 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.769 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:50.769 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877619+0000", 2024-05-08T18:30:50.769 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.902e-06 2024-05-08T18:30:50.769 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.769 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.769 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:50.769 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877633+0000", 2024-05-08T18:30:50.769 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4143e-05 2024-05-08T18:30:50.769 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.769 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.769 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:50.769 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877667+0000", 2024-05-08T18:30:50.770 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3516999999999998e-05 2024-05-08T18:30:50.770 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.770 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.770 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:50.770 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877685+0000", 2024-05-08T18:30:50.770 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7931000000000002e-05 2024-05-08T18:30:50.770 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.770 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.770 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:50.770 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877842+0000", 2024-05-08T18:30:50.770 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015742800000000001 2024-05-08T18:30:50.770 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.770 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.771 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:50.771 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877890+0000", 2024-05-08T18:30:50.771 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7654000000000001e-05 2024-05-08T18:30:50.771 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.771 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.771 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:50.771 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.880908+0000", 2024-05-08T18:30:50.771 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0030181219999999998 2024-05-08T18:30:50.771 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.771 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.771 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:50.771 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.881011+0000", 2024-05-08T18:30:50.771 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000103162 2024-05-08T18:30:50.771 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:50.772 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:50.772 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:50.772 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.772 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.772 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:535 6.1f e33/27 6:fde4dd55:gc::gc.26:head v 33'2, mlcod=0'0)", 2024-05-08T18:30:50.772 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.909602+0000", 2024-05-08T18:30:50.772 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 58.780175849999999, 2024-05-08T18:30:50.772 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0023004039999999998, 2024-05-08T18:30:50.772 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:50.772 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:50.772 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:50.772 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:50.772 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.772 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:50.773 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.909602+0000", 2024-05-08T18:30:50.773 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:50.773 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.773 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.773 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:50.773 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.909602+0000", 2024-05-08T18:30:50.773 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:50.773 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.773 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.773 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:50.773 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.909604+0000", 2024-05-08T18:30:50.773 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8360000000000001e-06 2024-05-08T18:30:50.773 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.773 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.774 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:50.774 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.909615+0000", 2024-05-08T18:30:50.774 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1596999999999999e-05 2024-05-08T18:30:50.774 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.774 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.774 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:50.774 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.909643+0000", 2024-05-08T18:30:50.774 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7457000000000002e-05 2024-05-08T18:30:50.774 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.774 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.774 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:50.774 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.909662+0000", 2024-05-08T18:30:50.774 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9052999999999999e-05 2024-05-08T18:30:50.774 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.775 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.775 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:50.775 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.909758+0000", 2024-05-08T18:30:50.775 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6372000000000005e-05 2024-05-08T18:30:50.775 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.775 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.775 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:50.775 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.909780+0000", 2024-05-08T18:30:50.775 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1719999999999999e-05 2024-05-08T18:30:50.775 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.775 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.775 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:50.775 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.911830+0000", 2024-05-08T18:30:50.775 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002050072 2024-05-08T18:30:50.775 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.776 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.776 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:50.776 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.911902+0000", 2024-05-08T18:30:50.776 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.2297000000000003e-05 2024-05-08T18:30:50.776 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:50.776 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:50.776 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:50.776 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.776 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.776 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:541 6.1f e33/27 6:fde4dd55:gc::gc.26:head v 33'3, mlcod=33'1)", 2024-05-08T18:30:50.776 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.913684+0000", 2024-05-08T18:30:50.776 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 58.776093801999998, 2024-05-08T18:30:50.776 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0036425770000000001, 2024-05-08T18:30:50.776 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:50.777 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:50.777 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:50.777 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:50.777 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.777 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:50.777 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.913684+0000", 2024-05-08T18:30:50.777 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:50.777 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.777 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.777 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:50.777 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.913684+0000", 2024-05-08T18:30:50.777 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:50.777 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.777 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.778 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:50.778 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.913685+0000", 2024-05-08T18:30:50.778 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5859999999999999e-06 2024-05-08T18:30:50.778 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.778 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.778 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:50.778 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.913696+0000", 2024-05-08T18:30:50.778 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1080000000000001e-05 2024-05-08T18:30:50.778 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.778 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.778 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:50.778 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.913720+0000", 2024-05-08T18:30:50.778 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3614000000000001e-05 2024-05-08T18:30:50.779 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.779 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.779 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:50.779 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.913740+0000", 2024-05-08T18:30:50.779 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9836000000000001e-05 2024-05-08T18:30:50.779 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.779 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.779 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:50.779 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.913901+0000", 2024-05-08T18:30:50.779 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000161039 2024-05-08T18:30:50.779 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.779 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.779 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:50.779 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.913935+0000", 2024-05-08T18:30:50.780 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4353000000000001e-05 2024-05-08T18:30:50.780 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.780 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.780 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:50.780 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.917225+0000", 2024-05-08T18:30:50.780 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032897669999999999 2024-05-08T18:30:50.780 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.780 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.780 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:50.780 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.917326+0000", 2024-05-08T18:30:50.780 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000101302 2024-05-08T18:30:50.780 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:50.780 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:50.781 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:50.781 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.781 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.781 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:543 6.15 e33/27 6:ae95b544:::obj_delete_at_hint.0000000020:head v 33'5, mlcod=33'3)", 2024-05-08T18:30:50.781 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.916649+0000", 2024-05-08T18:30:50.781 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 58.773128249000003, 2024-05-08T18:30:50.781 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003362739, 2024-05-08T18:30:50.781 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:50.781 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:50.781 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:50.781 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:50.781 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.781 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:50.781 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.916649+0000", 2024-05-08T18:30:50.782 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:50.782 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.782 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.782 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:50.782 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.916649+0000", 2024-05-08T18:30:50.782 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:50.782 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.782 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.782 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:50.782 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.916651+0000", 2024-05-08T18:30:50.782 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7269999999999999e-06 2024-05-08T18:30:50.782 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.782 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.782 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:50.783 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.916663+0000", 2024-05-08T18:30:50.783 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2183e-05 2024-05-08T18:30:50.783 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.783 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.783 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:50.783 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.916691+0000", 2024-05-08T18:30:50.783 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7864e-05 2024-05-08T18:30:50.783 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.783 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.783 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:50.783 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.916710+0000", 2024-05-08T18:30:50.783 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.912e-05 2024-05-08T18:30:50.783 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.783 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.784 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:50.784 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.916851+0000", 2024-05-08T18:30:50.784 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000141163 2024-05-08T18:30:50.784 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.784 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.784 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:50.784 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.916909+0000", 2024-05-08T18:30:50.784 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.7686000000000003e-05 2024-05-08T18:30:50.784 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.784 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.784 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:50.784 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.919900+0000", 2024-05-08T18:30:50.784 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029909540000000001 2024-05-08T18:30:50.785 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.785 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.785 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:50.785 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.920012+0000", 2024-05-08T18:30:50.785 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000112042 2024-05-08T18:30:50.785 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:50.785 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:50.785 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:50.785 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.785 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.785 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:695 6.3 e33/27 6:c31f41d7:gc::gc.10:head v 33'12, mlcod=33'10)", 2024-05-08T18:30:50.785 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.017806+0000", 2024-05-08T18:30:50.785 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 58.671971964999997, 2024-05-08T18:30:50.785 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001718373, 2024-05-08T18:30:50.786 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:50.786 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:50.786 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:50.786 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:50.786 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.786 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:50.786 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.017806+0000", 2024-05-08T18:30:50.786 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:50.786 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.786 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.786 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:50.786 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.017806+0000", 2024-05-08T18:30:50.786 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:50.786 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.787 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.787 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:50.787 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.017807+0000", 2024-05-08T18:30:50.787 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8199999999999999e-06 2024-05-08T18:30:50.787 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.787 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.787 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:50.787 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.017818+0000", 2024-05-08T18:30:50.787 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0519999999999999e-05 2024-05-08T18:30:50.787 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.787 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.787 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:50.787 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.017846+0000", 2024-05-08T18:30:50.787 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7729000000000002e-05 2024-05-08T18:30:50.787 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.788 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.788 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:50.788 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.017859+0000", 2024-05-08T18:30:50.788 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3337e-05 2024-05-08T18:30:50.788 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.788 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.788 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:50.788 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.017990+0000", 2024-05-08T18:30:50.788 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013146499999999999 2024-05-08T18:30:50.788 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.788 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.788 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:50.788 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.018039+0000", 2024-05-08T18:30:50.788 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8816999999999997e-05 2024-05-08T18:30:50.789 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.789 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.789 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:50.789 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.019397+0000", 2024-05-08T18:30:50.789 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0013575359999999999 2024-05-08T18:30:50.789 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:50.789 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:50.789 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:50.789 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.019524+0000", 2024-05-08T18:30:50.789 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012714900000000001 2024-05-08T18:30:50.789 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:50.789 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:50.789 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:50.789 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:50.790 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:50.790 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:30:50.791 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-08T18:30:50.791 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:30:50.791+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:30:50.892 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:30:50.891+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:30:50.949 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-08T18:30:50.962 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:30:50.962 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:30:50.962 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 0 2024-05-08T18:30:50.962 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:30:50.976 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-08T18:30:50.995 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:30:50.995+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:30:51.093 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:30:51.091+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:30:51.094 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:30:51.094 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:30:51.094 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2024-05-08T18:30:51.094 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2024-05-08T18:30:51.094 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:30:51.098 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2024-05-08T18:30:51.098 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:30:51.108 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-08T18:30:51.115 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2024-05-08T18:30:51.115 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:30:51.131 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2024-05-08T18:30:51.131 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:30:51.149 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2024-05-08T18:30:51.149 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:30:51.166 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2024-05-08T18:30:51.166 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:30:51.184 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2024-05-08T18:30:51.184 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:30:51.194 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:30:51.195+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:30:51.204 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2024-05-08T18:30:51.204 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:30:51.225 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2024-05-08T18:30:51.226 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:30:51.232 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:51.232 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:51.247 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-08T18:30:51.296 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:30:51.291+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:30:51.396 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:30:51.395+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:30:51.405 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:51.406 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:51.420 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-08T18:30:51.498 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:30:51.495+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:30:51.576 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:51.576 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:51.592 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-08T18:30:51.597 INFO:teuthology.orchestra.run.smithi097.stderr:nodeep-scrub is set 2024-05-08T18:30:51.598 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:30:51.595+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:30:51.699 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:30:51.699+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:30:51.720 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:51.721 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:51.739 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-08T18:30:51.800 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:30:51.795+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:30:51.858 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:51.858 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:51.873 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-08T18:30:51.918 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:30:51.919+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:30:51.984 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:51.984 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:51.997 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-08T18:30:52.039 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:30:52.039+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:30:52.102 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:30:52.103+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:30:52.155 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:52.156 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:52.169 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-08T18:30:52.203 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:30:52.199+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:30:52.290 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:52.290 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:52.304 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-08T18:30:52.305 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:30:52.303+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:30:52.406 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:30:52.403+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:30:52.424 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:52.424 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:52.438 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-08T18:30:52.507 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:30:52.503+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:30:52.599 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:52.600 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:52.608 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:30:52.607+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:30:52.612 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-08T18:30:52.708 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:30:52.707+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:30:52.778 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:52.778 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:52.792 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-08T18:30:52.810 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:30:52.811+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:30:52.910 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:30:52.911+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:30:52.948 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:52.948 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:52.961 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-08T18:30:53.047 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:30:53.047+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:30:53.112 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:30:53.111+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:30:53.122 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:53.122 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:53.135 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-08T18:30:53.214 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:30:53.211+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:30:53.243 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-08T18:30:53.266 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:53.266 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:53.280 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-08T18:30:53.325 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:30:53.323+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:30:53.389 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2024-05-08T18:30:53.390 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:30:53.409 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2024-05-08T18:30:53.409 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:30:53.416 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:30:53.411+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:30:53.428 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2024-05-08T18:30:53.428 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:30:53.446 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2024-05-08T18:30:53.446 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:30:53.448 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:53.448 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:53.463 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-08T18:30:53.467 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2024-05-08T18:30:53.467 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:30:53.486 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2024-05-08T18:30:53.487 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:30:53.506 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2024-05-08T18:30:53.506 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:30:53.526 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2024-05-08T18:30:53.526 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:30:53.548 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:30:53.547+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:30:53.618 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-08T18:30:53.619 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:30:53.615+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:30:53.633 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:30:53.633 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2024-05-08T18:30:53.633 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2024-05-08T18:30:53.633 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-05-08T18:30:53.633 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.633 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:53.633 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.699928+0000", 2024-05-08T18:30:53.633 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 61.932468632000003, 2024-05-08T18:30:53.634 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0036032490000000002, 2024-05-08T18:30:53.634 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:53.634 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:53.634 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:53.634 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:53.634 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:53.634 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:53.634 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 211 2024-05-08T18:30:53.634 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.634 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:53.634 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.634 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:53.634 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.699928+0000", 2024-05-08T18:30:53.635 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:53.635 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.635 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.635 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:53.635 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.699928+0000", 2024-05-08T18:30:53.635 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:53.635 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.635 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.635 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:53.635 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.699931+0000", 2024-05-08T18:30:53.635 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4139999999999998e-06 2024-05-08T18:30:53.635 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.635 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.636 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:53.636 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.699946+0000", 2024-05-08T18:30:53.636 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4528999999999999e-05 2024-05-08T18:30:53.636 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.636 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.636 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:53.636 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.699984+0000", 2024-05-08T18:30:53.636 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8444e-05 2024-05-08T18:30:53.636 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.636 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.636 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:53.636 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.700004+0000", 2024-05-08T18:30:53.636 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0169999999999998e-05 2024-05-08T18:30:53.636 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.637 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.637 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:53.637 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.700162+0000", 2024-05-08T18:30:53.637 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015799799999999999 2024-05-08T18:30:53.637 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.637 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.637 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:53.637 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.700414+0000", 2024-05-08T18:30:53.637 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00025214500000000001 2024-05-08T18:30:53.637 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.637 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.637 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:53.637 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.700839+0000", 2024-05-08T18:30:53.637 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00042484 2024-05-08T18:30:53.638 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.638 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.638 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:53.638 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.702506+0000", 2024-05-08T18:30:53.638 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001666357 2024-05-08T18:30:53.638 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.638 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.638 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:53.638 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.703357+0000", 2024-05-08T18:30:53.638 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00085149399999999995 2024-05-08T18:30:53.638 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.638 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.638 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:53.639 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.703454+0000", 2024-05-08T18:30:53.639 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6688999999999995e-05 2024-05-08T18:30:53.639 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.639 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.639 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:53.639 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.703531+0000", 2024-05-08T18:30:53.639 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.7169000000000006e-05 2024-05-08T18:30:53.639 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:53.639 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:53.639 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:53.639 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.639 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.639 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:53.639 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.776807+0000", 2024-05-08T18:30:53.640 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 61.855589768999998, 2024-05-08T18:30:53.640 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0033805409999999999, 2024-05-08T18:30:53.640 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:53.640 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:53.640 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:53.640 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:53.640 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:53.640 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:53.640 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 232 2024-05-08T18:30:53.640 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.640 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:53.640 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.640 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:53.640 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.776807+0000", 2024-05-08T18:30:53.641 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:53.641 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.641 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.641 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:53.641 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.776807+0000", 2024-05-08T18:30:53.641 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:53.641 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.641 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.641 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:53.641 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.776810+0000", 2024-05-08T18:30:53.641 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6540000000000001e-06 2024-05-08T18:30:53.641 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.641 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.641 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:53.641 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.776824+0000", 2024-05-08T18:30:53.642 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3383e-05 2024-05-08T18:30:53.642 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.642 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.642 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:53.642 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.776856+0000", 2024-05-08T18:30:53.642 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2775999999999999e-05 2024-05-08T18:30:53.642 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.642 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.642 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:53.642 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.776873+0000", 2024-05-08T18:30:53.642 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6483000000000001e-05 2024-05-08T18:30:53.642 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.643 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.643 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:53.643 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.776999+0000", 2024-05-08T18:30:53.643 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000125876 2024-05-08T18:30:53.643 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.643 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.643 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:53.643 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.777228+0000", 2024-05-08T18:30:53.643 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000229531 2024-05-08T18:30:53.643 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.643 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.643 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:53.643 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.777648+0000", 2024-05-08T18:30:53.643 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000420037 2024-05-08T18:30:53.644 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.644 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.644 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:53.644 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.779272+0000", 2024-05-08T18:30:53.644 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0016235780000000001 2024-05-08T18:30:53.644 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.644 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.644 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:53.644 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.780027+0000", 2024-05-08T18:30:53.644 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00075524100000000003 2024-05-08T18:30:53.644 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.644 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.644 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:53.644 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.780116+0000", 2024-05-08T18:30:53.645 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8776000000000005e-05 2024-05-08T18:30:53.645 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.645 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.645 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:53.645 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.780187+0000", 2024-05-08T18:30:53.645 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1205999999999996e-05 2024-05-08T18:30:53.645 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:53.645 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:53.645 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:53.645 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.645 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.645 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:285 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:53.646 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.803745+0000", 2024-05-08T18:30:53.646 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 61.828651483000002, 2024-05-08T18:30:53.646 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0034481960000000002, 2024-05-08T18:30:53.646 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:53.646 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:53.646 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:53.646 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:53.646 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:53.646 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:53.646 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 285 2024-05-08T18:30:53.646 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.647 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:53.647 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.647 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:53.647 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.803745+0000", 2024-05-08T18:30:53.647 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:53.647 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.647 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.647 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:53.647 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.803745+0000", 2024-05-08T18:30:53.647 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:53.647 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.647 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.647 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:53.648 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.803748+0000", 2024-05-08T18:30:53.648 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.813e-06 2024-05-08T18:30:53.648 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.648 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.648 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:53.648 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.803762+0000", 2024-05-08T18:30:53.648 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4653e-05 2024-05-08T18:30:53.648 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.648 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.648 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:53.648 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.803791+0000", 2024-05-08T18:30:53.648 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8540000000000001e-05 2024-05-08T18:30:53.648 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.648 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.648 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:53.649 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.803817+0000", 2024-05-08T18:30:53.649 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5973e-05 2024-05-08T18:30:53.649 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.649 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.649 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:53.649 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.803975+0000", 2024-05-08T18:30:53.649 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000158336 2024-05-08T18:30:53.649 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.649 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.649 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:53.649 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.804502+0000", 2024-05-08T18:30:53.649 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00052658900000000005 2024-05-08T18:30:53.649 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.650 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.650 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:53.650 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.804966+0000", 2024-05-08T18:30:53.650 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00046399599999999999 2024-05-08T18:30:53.650 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.650 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.650 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:53.650 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.806289+0000", 2024-05-08T18:30:53.650 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0013233769999999999 2024-05-08T18:30:53.650 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.650 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.650 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:53.650 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.807001+0000", 2024-05-08T18:30:53.651 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000711314 2024-05-08T18:30:53.651 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.651 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.651 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:53.651 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.807096+0000", 2024-05-08T18:30:53.651 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.5276000000000001e-05 2024-05-08T18:30:53.651 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.651 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.651 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:53.651 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.807193+0000", 2024-05-08T18:30:53.651 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7329000000000003e-05 2024-05-08T18:30:53.651 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:53.651 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:53.652 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:53.652 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.652 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.652 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:317 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:53.652 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.808256+0000", 2024-05-08T18:30:53.652 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 61.824140071000002, 2024-05-08T18:30:53.652 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0038944359999999998, 2024-05-08T18:30:53.652 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:53.652 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:53.652 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:53.653 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:53.653 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:53.653 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:53.653 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 317 2024-05-08T18:30:53.653 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.653 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:53.653 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.653 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:53.653 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.808256+0000", 2024-05-08T18:30:53.653 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:53.653 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.653 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.653 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:53.654 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.808256+0000", 2024-05-08T18:30:53.654 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:53.654 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.654 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.654 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:53.654 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.808258+0000", 2024-05-08T18:30:53.654 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0559999999999999e-06 2024-05-08T18:30:53.654 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.654 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.654 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:53.654 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.808270+0000", 2024-05-08T18:30:53.654 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1537e-05 2024-05-08T18:30:53.655 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.655 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.655 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:53.655 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.808299+0000", 2024-05-08T18:30:53.655 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.9127000000000001e-05 2024-05-08T18:30:53.655 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.655 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.655 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:53.655 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.808324+0000", 2024-05-08T18:30:53.655 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5182e-05 2024-05-08T18:30:53.655 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.655 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.655 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:53.655 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.808471+0000", 2024-05-08T18:30:53.656 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014631900000000001 2024-05-08T18:30:53.656 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.656 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.656 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:53.656 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.808717+0000", 2024-05-08T18:30:53.656 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00024595200000000002 2024-05-08T18:30:53.656 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.656 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.656 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:53.656 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.809072+0000", 2024-05-08T18:30:53.656 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00035547699999999998 2024-05-08T18:30:53.656 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.656 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.657 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:53.657 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.810447+0000", 2024-05-08T18:30:53.657 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0013745929999999999 2024-05-08T18:30:53.657 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.657 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.657 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:53.657 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.811938+0000", 2024-05-08T18:30:53.657 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0014914290000000001 2024-05-08T18:30:53.657 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.657 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.657 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:53.657 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.812078+0000", 2024-05-08T18:30:53.657 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000140319 2024-05-08T18:30:53.657 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.658 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.658 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:53.658 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.812151+0000", 2024-05-08T18:30:53.658 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.2445000000000002e-05 2024-05-08T18:30:53.658 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:53.658 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:53.658 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:53.658 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.658 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.658 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:552 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:53.658 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.923892+0000", 2024-05-08T18:30:53.658 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 61.708504804, 2024-05-08T18:30:53.658 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029063259999999999, 2024-05-08T18:30:53.659 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:53.659 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:53.659 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:53.659 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:53.659 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:53.659 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:53.659 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 552 2024-05-08T18:30:53.659 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.659 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:53.659 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.659 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:53.659 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.923892+0000", 2024-05-08T18:30:53.659 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:53.660 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.660 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.660 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:53.660 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.923892+0000", 2024-05-08T18:30:53.660 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:53.660 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.660 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.660 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:53.660 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.923893+0000", 2024-05-08T18:30:53.660 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.082e-06 2024-05-08T18:30:53.660 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.660 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.660 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:53.661 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.923899+0000", 2024-05-08T18:30:53.661 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.426e-06 2024-05-08T18:30:53.661 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.661 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.661 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:53.661 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.923913+0000", 2024-05-08T18:30:53.661 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3869000000000001e-05 2024-05-08T18:30:53.661 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.661 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.661 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:53.661 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.923922+0000", 2024-05-08T18:30:53.661 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8850000000000005e-06 2024-05-08T18:30:53.661 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.661 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.661 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:53.662 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.924023+0000", 2024-05-08T18:30:53.662 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010135400000000001 2024-05-08T18:30:53.662 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.662 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.662 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:53.662 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.924230+0000", 2024-05-08T18:30:53.662 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020649500000000001 2024-05-08T18:30:53.662 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.662 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.662 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:53.662 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.924685+0000", 2024-05-08T18:30:53.662 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00045504299999999997 2024-05-08T18:30:53.662 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.663 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.663 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:53.663 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.925792+0000", 2024-05-08T18:30:53.663 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0011076790000000001 2024-05-08T18:30:53.663 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.663 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.663 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:53.663 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.926566+0000", 2024-05-08T18:30:53.663 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00077379200000000003 2024-05-08T18:30:53.663 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.663 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.663 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:53.664 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.926705+0000", 2024-05-08T18:30:53.664 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013870700000000001 2024-05-08T18:30:53.664 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.664 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.664 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:53.664 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.926798+0000", 2024-05-08T18:30:53.664 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2993999999999998e-05 2024-05-08T18:30:53.664 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:53.664 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:53.664 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:53.665 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.665 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.665 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:709 6.1e 6:7af5a05b:::obj_delete_at_hint.0000000044:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:53.665 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.033719+0000", 2024-05-08T18:30:53.665 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 61.598677045000002, 2024-05-08T18:30:53.665 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0027890480000000001, 2024-05-08T18:30:53.665 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:53.665 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:53.665 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:53.665 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:53.665 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:53.665 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:53.665 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 709 2024-05-08T18:30:53.666 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.666 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:53.666 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.666 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:53.666 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.033719+0000", 2024-05-08T18:30:53.666 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:53.666 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.666 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.666 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:53.666 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.033719+0000", 2024-05-08T18:30:53.666 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:53.666 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.666 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.667 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:53.667 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.033723+0000", 2024-05-08T18:30:53.667 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1920000000000001e-06 2024-05-08T18:30:53.667 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.667 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.667 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:53.667 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.033736+0000", 2024-05-08T18:30:53.667 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3125000000000001e-05 2024-05-08T18:30:53.667 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.667 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.667 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:53.667 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.033768+0000", 2024-05-08T18:30:53.667 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2422999999999998e-05 2024-05-08T18:30:53.668 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.668 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.668 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:53.668 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.033789+0000", 2024-05-08T18:30:53.668 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1084999999999999e-05 2024-05-08T18:30:53.668 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.668 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.668 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:53.668 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.033912+0000", 2024-05-08T18:30:53.668 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000123261 2024-05-08T18:30:53.668 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.668 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.668 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:53.668 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.034132+0000", 2024-05-08T18:30:53.669 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00021992100000000001 2024-05-08T18:30:53.669 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.669 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.669 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:53.669 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.034452+0000", 2024-05-08T18:30:53.669 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00031989399999999998 2024-05-08T18:30:53.669 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.669 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.669 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:53.669 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.035605+0000", 2024-05-08T18:30:53.669 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0011523410000000001 2024-05-08T18:30:53.669 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.669 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.669 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:53.670 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.036356+0000", 2024-05-08T18:30:53.670 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00075177800000000004 2024-05-08T18:30:53.670 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.670 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.670 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:53.670 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.036443+0000", 2024-05-08T18:30:53.670 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.6348999999999996e-05 2024-05-08T18:30:53.670 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.670 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.670 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:53.670 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.036508+0000", 2024-05-08T18:30:53.670 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5679000000000006e-05 2024-05-08T18:30:53.670 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:53.670 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:53.670 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:53.671 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.671 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.671 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:53.671 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.070187+0000", 2024-05-08T18:30:53.671 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 61.562209416999998, 2024-05-08T18:30:53.671 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0030597110000000001, 2024-05-08T18:30:53.671 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:53.671 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:53.671 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:53.671 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:53.671 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:53.671 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:53.671 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 727 2024-05-08T18:30:53.672 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.672 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:53.672 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.672 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:53.672 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.070187+0000", 2024-05-08T18:30:53.672 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:53.672 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.672 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.672 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:53.672 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.070187+0000", 2024-05-08T18:30:53.672 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:53.672 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.672 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.672 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:53.673 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.070189+0000", 2024-05-08T18:30:53.673 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.53e-06 2024-05-08T18:30:53.673 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.673 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.673 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:53.673 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.070197+0000", 2024-05-08T18:30:53.673 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2600000000000005e-06 2024-05-08T18:30:53.673 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.673 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.673 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:53.673 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.070220+0000", 2024-05-08T18:30:53.673 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3357e-05 2024-05-08T18:30:53.673 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.673 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.673 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:53.674 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.070232+0000", 2024-05-08T18:30:53.674 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.217e-05 2024-05-08T18:30:53.674 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.674 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.674 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:53.674 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.070334+0000", 2024-05-08T18:30:53.674 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000101486 2024-05-08T18:30:53.674 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.674 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.674 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:53.674 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.070585+0000", 2024-05-08T18:30:53.674 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00025155799999999998 2024-05-08T18:30:53.674 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.675 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.675 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-05-08T18:30:53.675 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.070921+0000", 2024-05-08T18:30:53.675 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00033587999999999999 2024-05-08T18:30:53.675 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.675 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.675 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:53.675 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.071956+0000", 2024-05-08T18:30:53.675 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010343629999999999 2024-05-08T18:30:53.675 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.675 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.675 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:53.675 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.073088+0000", 2024-05-08T18:30:53.675 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001132641 2024-05-08T18:30:53.676 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.676 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.676 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:53.676 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.073178+0000", 2024-05-08T18:30:53.676 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.9579000000000004e-05 2024-05-08T18:30:53.676 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.676 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.676 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:53.676 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.073247+0000", 2024-05-08T18:30:53.676 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8887000000000006e-05 2024-05-08T18:30:53.676 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:53.676 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:53.676 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:53.676 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.677 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.677 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:775 6.1e 6:7db93595:::obj_delete_at_hint.0000000066:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:53.677 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.180158+0000", 2024-05-08T18:30:53.677 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 61.452238137999998, 2024-05-08T18:30:53.677 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0030746160000000001, 2024-05-08T18:30:53.677 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:53.677 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:53.677 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:53.677 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:53.677 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:53.677 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:53.677 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 775 2024-05-08T18:30:53.677 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.678 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:53.678 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.678 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:53.678 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.180158+0000", 2024-05-08T18:30:53.678 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:53.678 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.678 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.678 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:53.678 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.180158+0000", 2024-05-08T18:30:53.678 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:53.678 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.678 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.679 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:53.679 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.180161+0000", 2024-05-08T18:30:53.679 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8399999999999999e-06 2024-05-08T18:30:53.679 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.679 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.679 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:53.679 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.180172+0000", 2024-05-08T18:30:53.679 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0876000000000001e-05 2024-05-08T18:30:53.679 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.679 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.679 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:53.679 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.180203+0000", 2024-05-08T18:30:53.679 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0639999999999998e-05 2024-05-08T18:30:53.680 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.680 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.680 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:53.680 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.180221+0000", 2024-05-08T18:30:53.680 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8326e-05 2024-05-08T18:30:53.680 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.680 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.680 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:53.680 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.180398+0000", 2024-05-08T18:30:53.680 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000176563 2024-05-08T18:30:53.680 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.680 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.680 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:53.681 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.180616+0000", 2024-05-08T18:30:53.681 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000218731 2024-05-08T18:30:53.681 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.681 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.681 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:53.681 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.180934+0000", 2024-05-08T18:30:53.681 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00031749799999999999 2024-05-08T18:30:53.681 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.681 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.681 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:53.681 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.182159+0000", 2024-05-08T18:30:53.681 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0012251810000000001 2024-05-08T18:30:53.681 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.681 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.682 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:53.682 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.182951+0000", 2024-05-08T18:30:53.682 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00079208000000000002 2024-05-08T18:30:53.682 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.682 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.682 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:53.682 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.183109+0000", 2024-05-08T18:30:53.682 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015750900000000001 2024-05-08T18:30:53.682 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.682 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.682 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:53.682 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.183233+0000", 2024-05-08T18:30:53.682 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012437200000000001 2024-05-08T18:30:53.683 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:53.683 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:53.683 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:53.683 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.683 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.683 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:777 6.1e 6:7db93595:::obj_delete_at_hint.0000000066:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:53.683 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.184358+0000", 2024-05-08T18:30:53.683 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 61.448038294, 2024-05-08T18:30:53.683 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0031944019999999998, 2024-05-08T18:30:53.683 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:53.683 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:53.683 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:53.683 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:53.684 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:53.684 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:53.684 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 777 2024-05-08T18:30:53.684 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.684 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:53.684 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.684 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:53.684 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.184358+0000", 2024-05-08T18:30:53.684 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:53.684 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.684 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.684 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:53.684 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.184358+0000", 2024-05-08T18:30:53.685 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:53.685 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.685 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.685 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:53.685 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.184360+0000", 2024-05-08T18:30:53.685 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5069999999999999e-06 2024-05-08T18:30:53.685 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.685 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.685 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:53.685 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.184367+0000", 2024-05-08T18:30:53.685 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6629999999999993e-06 2024-05-08T18:30:53.685 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.686 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.686 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:53.686 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.184388+0000", 2024-05-08T18:30:53.686 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0755999999999999e-05 2024-05-08T18:30:53.686 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.686 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.686 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:53.686 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.184399+0000", 2024-05-08T18:30:53.686 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0896999999999999e-05 2024-05-08T18:30:53.687 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.687 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.687 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:53.687 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.184512+0000", 2024-05-08T18:30:53.687 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000113346 2024-05-08T18:30:53.687 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.687 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.687 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:53.687 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.184733+0000", 2024-05-08T18:30:53.687 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022113800000000001 2024-05-08T18:30:53.687 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.687 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.687 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:53.687 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.185202+0000", 2024-05-08T18:30:53.688 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00046851999999999999 2024-05-08T18:30:53.688 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.688 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.688 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:53.688 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.186306+0000", 2024-05-08T18:30:53.688 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001104184 2024-05-08T18:30:53.688 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.688 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.688 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:53.688 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.187288+0000", 2024-05-08T18:30:53.688 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00098171 2024-05-08T18:30:53.688 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.688 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.688 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:53.689 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.187438+0000", 2024-05-08T18:30:53.689 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000150629 2024-05-08T18:30:53.689 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.689 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.689 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:53.689 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.187553+0000", 2024-05-08T18:30:53.689 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000114052 2024-05-08T18:30:53.689 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:53.689 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:53.689 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:53.689 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.689 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.689 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:808 6.1a 6:5a206276:::obj_delete_at_hint.0000000077:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:53.689 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.252316+0000", 2024-05-08T18:30:53.690 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 61.380080882000001, 2024-05-08T18:30:53.690 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0027908820000000002, 2024-05-08T18:30:53.690 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:53.690 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:53.690 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:53.690 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:53.690 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:53.690 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:53.690 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 808 2024-05-08T18:30:53.690 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.691 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:53.691 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.691 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:53.691 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.252316+0000", 2024-05-08T18:30:53.691 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:53.691 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.691 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.691 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:53.691 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.252316+0000", 2024-05-08T18:30:53.691 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:53.691 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.691 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.691 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:53.692 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.252318+0000", 2024-05-08T18:30:53.692 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5500000000000001e-06 2024-05-08T18:30:53.692 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.692 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.692 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:53.692 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.252331+0000", 2024-05-08T18:30:53.692 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.252e-05 2024-05-08T18:30:53.692 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.692 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.692 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:53.692 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.252362+0000", 2024-05-08T18:30:53.692 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1720000000000001e-05 2024-05-08T18:30:53.692 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.693 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.693 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:53.693 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.252377+0000", 2024-05-08T18:30:53.693 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4440000000000001e-05 2024-05-08T18:30:53.693 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.693 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.693 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:53.693 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.252513+0000", 2024-05-08T18:30:53.693 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013657200000000001 2024-05-08T18:30:53.693 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.693 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.693 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:53.693 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.252746+0000", 2024-05-08T18:30:53.694 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000232499 2024-05-08T18:30:53.694 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.694 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.694 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:53.694 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.253071+0000", 2024-05-08T18:30:53.694 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00032540299999999999 2024-05-08T18:30:53.694 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.694 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.694 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:53.694 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.254176+0000", 2024-05-08T18:30:53.694 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0011052519999999999 2024-05-08T18:30:53.694 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.695 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.695 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:53.695 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.254957+0000", 2024-05-08T18:30:53.695 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00078004099999999998 2024-05-08T18:30:53.695 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.695 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.695 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:53.695 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.255041+0000", 2024-05-08T18:30:53.695 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4492000000000004e-05 2024-05-08T18:30:53.695 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.695 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.695 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:53.696 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.255106+0000", 2024-05-08T18:30:53.696 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5393000000000002e-05 2024-05-08T18:30:53.696 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:53.696 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:53.696 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:53.696 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.696 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.696 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:810 6.1a 6:5a206276:::obj_delete_at_hint.0000000077:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:53.696 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.256569+0000", 2024-05-08T18:30:53.696 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 61.375827827999998, 2024-05-08T18:30:53.696 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0034505130000000001, 2024-05-08T18:30:53.696 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:53.696 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:53.697 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:53.697 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:53.697 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:53.697 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:53.697 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 810 2024-05-08T18:30:53.697 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.697 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:53.697 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.697 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:53.697 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.256569+0000", 2024-05-08T18:30:53.697 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:53.697 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.697 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.697 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:53.698 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.256569+0000", 2024-05-08T18:30:53.698 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:53.698 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.698 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.698 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:53.698 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.256571+0000", 2024-05-08T18:30:53.698 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2029999999999999e-06 2024-05-08T18:30:53.698 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.698 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.698 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:53.698 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.256582+0000", 2024-05-08T18:30:53.698 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.101e-05 2024-05-08T18:30:53.699 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.699 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.699 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:53.699 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.256614+0000", 2024-05-08T18:30:53.699 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2353e-05 2024-05-08T18:30:53.699 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.699 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.699 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:53.699 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.256632+0000", 2024-05-08T18:30:53.699 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8349999999999999e-05 2024-05-08T18:30:53.699 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.699 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.699 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:53.700 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.256767+0000", 2024-05-08T18:30:53.700 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000134819 2024-05-08T18:30:53.700 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.700 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.700 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:53.700 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.256990+0000", 2024-05-08T18:30:53.700 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022293899999999999 2024-05-08T18:30:53.700 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.700 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.700 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 5", 2024-05-08T18:30:53.700 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.257487+0000", 2024-05-08T18:30:53.700 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00049632599999999995 2024-05-08T18:30:53.701 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.701 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.701 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:53.701 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.258822+0000", 2024-05-08T18:30:53.701 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001335166 2024-05-08T18:30:53.701 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.701 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.701 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:53.701 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.259867+0000", 2024-05-08T18:30:53.701 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010454349999999999 2024-05-08T18:30:53.701 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.701 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.701 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:53.701 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.259955+0000", 2024-05-08T18:30:53.702 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.7699000000000002e-05 2024-05-08T18:30:53.702 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.702 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.702 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:53.702 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.260019+0000", 2024-05-08T18:30:53.702 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4213000000000003e-05 2024-05-08T18:30:53.702 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:53.702 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:53.702 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:53.702 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.702 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.702 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:814 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:53.702 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.266538+0000", 2024-05-08T18:30:53.702 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 61.365858901999999, 2024-05-08T18:30:53.703 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0030056010000000001, 2024-05-08T18:30:53.703 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:53.703 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:53.703 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:53.703 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:53.703 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:53.703 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:53.703 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 814 2024-05-08T18:30:53.703 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.703 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:53.703 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.703 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:53.703 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.266538+0000", 2024-05-08T18:30:53.703 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:53.704 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.704 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.704 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:53.704 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.266538+0000", 2024-05-08T18:30:53.704 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:53.704 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.704 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.704 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:53.704 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.266540+0000", 2024-05-08T18:30:53.704 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2400000000000002e-06 2024-05-08T18:30:53.704 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.704 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.704 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:53.704 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.266550+0000", 2024-05-08T18:30:53.705 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0464e-05 2024-05-08T18:30:53.705 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.705 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.705 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:53.705 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.266581+0000", 2024-05-08T18:30:53.705 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.099e-05 2024-05-08T18:30:53.705 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.705 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.705 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:53.705 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.266596+0000", 2024-05-08T18:30:53.705 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5176e-05 2024-05-08T18:30:53.705 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.705 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.705 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:53.705 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.266711+0000", 2024-05-08T18:30:53.706 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000114759 2024-05-08T18:30:53.706 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.706 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.706 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:53.706 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.266936+0000", 2024-05-08T18:30:53.706 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022446200000000001 2024-05-08T18:30:53.706 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.706 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.706 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:53.706 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.267272+0000", 2024-05-08T18:30:53.706 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00033655099999999998 2024-05-08T18:30:53.706 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.706 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.707 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:53.707 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.268417+0000", 2024-05-08T18:30:53.707 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0011447409999999999 2024-05-08T18:30:53.707 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.707 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.707 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:53.707 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.269263+0000", 2024-05-08T18:30:53.707 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00084657600000000003 2024-05-08T18:30:53.707 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.707 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.707 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:53.707 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.269418+0000", 2024-05-08T18:30:53.707 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015471300000000001 2024-05-08T18:30:53.708 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.708 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.708 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:53.708 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.269543+0000", 2024-05-08T18:30:53.708 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000124929 2024-05-08T18:30:53.708 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:53.708 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:53.708 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:53.708 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.708 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.708 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:816 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:53.708 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.270693+0000", 2024-05-08T18:30:53.708 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 61.361703794, 2024-05-08T18:30:53.708 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0031451119999999998, 2024-05-08T18:30:53.709 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:53.709 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:53.709 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:53.709 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:53.709 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:53.709 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:53.709 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 816 2024-05-08T18:30:53.709 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.709 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:53.709 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.709 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:53.709 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.270693+0000", 2024-05-08T18:30:53.709 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:53.709 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.710 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.710 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:53.710 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.270693+0000", 2024-05-08T18:30:53.710 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:53.710 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.710 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.710 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:53.710 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.270695+0000", 2024-05-08T18:30:53.710 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0669999999999999e-06 2024-05-08T18:30:53.710 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.710 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.710 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:53.710 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.270704+0000", 2024-05-08T18:30:53.711 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4830000000000005e-06 2024-05-08T18:30:53.711 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.711 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.711 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:53.711 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.270728+0000", 2024-05-08T18:30:53.711 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.4297000000000001e-05 2024-05-08T18:30:53.711 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.711 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.711 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:53.711 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.270740+0000", 2024-05-08T18:30:53.711 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1922999999999999e-05 2024-05-08T18:30:53.711 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.711 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.711 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:53.711 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.270855+0000", 2024-05-08T18:30:53.712 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011418599999999999 2024-05-08T18:30:53.712 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.712 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.712 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:53.712 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.271088+0000", 2024-05-08T18:30:53.712 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000233718 2024-05-08T18:30:53.712 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.712 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.712 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:53.712 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.271548+0000", 2024-05-08T18:30:53.712 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00045974299999999998 2024-05-08T18:30:53.712 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.712 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.712 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:53.713 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.272854+0000", 2024-05-08T18:30:53.713 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0013054799999999999 2024-05-08T18:30:53.713 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.713 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.713 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:53.713 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.273569+0000", 2024-05-08T18:30:53.713 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00071561400000000005 2024-05-08T18:30:53.713 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.713 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.713 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:53.713 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.273726+0000", 2024-05-08T18:30:53.713 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000156856 2024-05-08T18:30:53.713 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.713 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.714 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:53.714 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.273838+0000", 2024-05-08T18:30:53.714 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011174499999999999 2024-05-08T18:30:53.714 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:53.714 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:53.714 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:53.714 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.714 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.714 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:53.714 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.422427+0000", 2024-05-08T18:30:53.714 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 61.209969465, 2024-05-08T18:30:53.714 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0031426190000000001, 2024-05-08T18:30:53.714 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:53.714 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:53.715 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:53.715 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:53.715 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:53.715 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:53.715 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 880 2024-05-08T18:30:53.715 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.715 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:53.715 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.715 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:53.715 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.422427+0000", 2024-05-08T18:30:53.715 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:53.715 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.715 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.715 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:53.716 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.422427+0000", 2024-05-08T18:30:53.716 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:53.716 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.716 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.716 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:53.716 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.422431+0000", 2024-05-08T18:30:53.716 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.777e-06 2024-05-08T18:30:53.716 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.716 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.716 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:53.716 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.422445+0000", 2024-05-08T18:30:53.716 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.451e-05 2024-05-08T18:30:53.716 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.716 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.717 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:53.717 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.422479+0000", 2024-05-08T18:30:53.717 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4078999999999997e-05 2024-05-08T18:30:53.717 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.717 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.717 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:53.717 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.422495+0000", 2024-05-08T18:30:53.717 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5947000000000002e-05 2024-05-08T18:30:53.717 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.717 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.717 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:53.717 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.422609+0000", 2024-05-08T18:30:53.717 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000113879 2024-05-08T18:30:53.717 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.717 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.718 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:53.718 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.422844+0000", 2024-05-08T18:30:53.718 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000234465 2024-05-08T18:30:53.718 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.718 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.718 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:53.718 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.423201+0000", 2024-05-08T18:30:53.718 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00035789699999999998 2024-05-08T18:30:53.718 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.718 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.718 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:53.718 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.424352+0000", 2024-05-08T18:30:53.718 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0011504709999999999 2024-05-08T18:30:53.719 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.719 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.719 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:53.719 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.425288+0000", 2024-05-08T18:30:53.719 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00093638300000000005 2024-05-08T18:30:53.719 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.719 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.719 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:53.719 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.425451+0000", 2024-05-08T18:30:53.719 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000162628 2024-05-08T18:30:53.719 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.719 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.719 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:53.719 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.425570+0000", 2024-05-08T18:30:53.720 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000118583 2024-05-08T18:30:53.720 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:53.720 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:53.720 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:53.720 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.720 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.720 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:913 6.2 6:47403372:::obj_delete_at_hint.0000000112:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:53.720 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.494354+0000", 2024-05-08T18:30:53.720 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 61.138042159999998, 2024-05-08T18:30:53.720 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003088276, 2024-05-08T18:30:53.720 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:53.720 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:53.721 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:53.721 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:53.721 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:53.721 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:53.721 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 913 2024-05-08T18:30:53.721 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.721 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:53.721 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.721 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:53.721 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.494354+0000", 2024-05-08T18:30:53.721 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:53.721 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.721 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.722 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:53.722 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.494354+0000", 2024-05-08T18:30:53.722 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:53.722 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.722 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.722 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:53.722 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.494357+0000", 2024-05-08T18:30:53.722 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.553e-06 2024-05-08T18:30:53.722 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.722 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.722 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:53.722 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.494368+0000", 2024-05-08T18:30:53.722 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1426999999999999e-05 2024-05-08T18:30:53.722 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.723 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.723 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:53.723 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.494419+0000", 2024-05-08T18:30:53.723 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1053000000000001e-05 2024-05-08T18:30:53.723 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.723 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.723 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:53.723 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.494434+0000", 2024-05-08T18:30:53.723 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5216e-05 2024-05-08T18:30:53.723 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.723 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.723 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:53.723 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.494564+0000", 2024-05-08T18:30:53.724 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012956900000000001 2024-05-08T18:30:53.724 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.724 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.724 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:53.724 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.494798+0000", 2024-05-08T18:30:53.724 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000234248 2024-05-08T18:30:53.724 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.724 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.724 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:53.724 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.495123+0000", 2024-05-08T18:30:53.724 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00032466500000000002 2024-05-08T18:30:53.724 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.724 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.724 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:53.725 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.496226+0000", 2024-05-08T18:30:53.725 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001102701 2024-05-08T18:30:53.725 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.725 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.725 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:53.725 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.497153+0000", 2024-05-08T18:30:53.725 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00092721999999999998 2024-05-08T18:30:53.725 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.725 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.725 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:53.725 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.497329+0000", 2024-05-08T18:30:53.725 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000176579 2024-05-08T18:30:53.725 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.725 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.726 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:53.726 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.497443+0000", 2024-05-08T18:30:53.726 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000113045 2024-05-08T18:30:53.726 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:53.726 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:53.726 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:53.726 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.726 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.726 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:915 6.2 6:47403372:::obj_delete_at_hint.0000000112:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:53.726 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.498847+0000", 2024-05-08T18:30:53.726 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 61.133549094000003, 2024-05-08T18:30:53.726 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003160459, 2024-05-08T18:30:53.726 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:53.726 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:53.727 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:53.727 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:53.727 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:53.727 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:53.727 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 915 2024-05-08T18:30:53.727 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.727 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:53.727 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.727 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:53.727 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.498847+0000", 2024-05-08T18:30:53.727 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:53.727 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.727 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.727 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:53.727 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.498847+0000", 2024-05-08T18:30:53.728 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:53.728 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.728 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.728 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:53.728 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.498850+0000", 2024-05-08T18:30:53.728 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.4099999999999998e-06 2024-05-08T18:30:53.728 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.728 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.728 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:53.728 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.498863+0000", 2024-05-08T18:30:53.728 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3013000000000001e-05 2024-05-08T18:30:53.728 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.728 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.728 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:53.729 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.498895+0000", 2024-05-08T18:30:53.729 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2682999999999999e-05 2024-05-08T18:30:53.729 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.729 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.729 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:53.729 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.498911+0000", 2024-05-08T18:30:53.729 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.525e-05 2024-05-08T18:30:53.729 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.729 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.729 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:53.729 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.499039+0000", 2024-05-08T18:30:53.729 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012856900000000001 2024-05-08T18:30:53.729 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.729 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.730 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:53.730 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.499264+0000", 2024-05-08T18:30:53.730 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022517500000000001 2024-05-08T18:30:53.730 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.730 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.730 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:53.730 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.499740+0000", 2024-05-08T18:30:53.730 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00047553299999999999 2024-05-08T18:30:53.730 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.730 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.730 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:53.730 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.501192+0000", 2024-05-08T18:30:53.731 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001451735 2024-05-08T18:30:53.731 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.731 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.731 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:53.731 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.501751+0000", 2024-05-08T18:30:53.731 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000559239 2024-05-08T18:30:53.731 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.731 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.731 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:53.731 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.501902+0000", 2024-05-08T18:30:53.731 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015061600000000001 2024-05-08T18:30:53.731 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.731 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.731 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:53.732 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.502008+0000", 2024-05-08T18:30:53.732 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000106236 2024-05-08T18:30:53.732 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:53.732 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:53.732 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:53.732 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.732 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.732 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:925 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:53.732 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.523895+0000", 2024-05-08T18:30:53.732 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 61.108501691000001, 2024-05-08T18:30:53.732 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003635302, 2024-05-08T18:30:53.732 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:53.732 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:53.733 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:53.733 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:53.733 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:53.733 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:53.733 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 925 2024-05-08T18:30:53.733 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.733 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:53.733 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.733 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:53.733 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.523895+0000", 2024-05-08T18:30:53.733 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:53.733 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.733 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.733 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:53.734 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.523895+0000", 2024-05-08T18:30:53.734 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:53.734 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.734 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.734 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:53.734 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.523897+0000", 2024-05-08T18:30:53.734 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1969999999999999e-06 2024-05-08T18:30:53.734 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.734 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.734 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:53.734 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.523908+0000", 2024-05-08T18:30:53.734 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0706e-05 2024-05-08T18:30:53.734 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.735 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.735 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:53.735 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.523938+0000", 2024-05-08T18:30:53.735 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0395999999999998e-05 2024-05-08T18:30:53.735 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.735 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.735 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:53.735 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.523953+0000", 2024-05-08T18:30:53.735 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4673e-05 2024-05-08T18:30:53.735 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.735 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.735 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:53.735 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.524105+0000", 2024-05-08T18:30:53.735 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015204300000000001 2024-05-08T18:30:53.736 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.736 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.736 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:53.736 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.524460+0000", 2024-05-08T18:30:53.736 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00035539000000000002 2024-05-08T18:30:53.736 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.736 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.736 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:53.736 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.525003+0000", 2024-05-08T18:30:53.736 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00054241000000000001 2024-05-08T18:30:53.736 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.736 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.736 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:53.737 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.526198+0000", 2024-05-08T18:30:53.737 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0011955500000000001 2024-05-08T18:30:53.737 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.737 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.737 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:53.737 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.527258+0000", 2024-05-08T18:30:53.737 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010595489999999999 2024-05-08T18:30:53.737 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.737 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.737 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:53.737 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.527414+0000", 2024-05-08T18:30:53.737 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000156732 2024-05-08T18:30:53.737 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.737 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.738 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:53.738 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.527530+0000", 2024-05-08T18:30:53.738 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011565600000000001 2024-05-08T18:30:53.738 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:53.738 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:53.738 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:53.738 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.738 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.738 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:927 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:53.738 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.528868+0000", 2024-05-08T18:30:53.738 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 61.103528292999997, 2024-05-08T18:30:53.738 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00302987, 2024-05-08T18:30:53.739 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:53.739 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:53.739 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:53.739 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:53.739 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:53.739 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:53.739 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 927 2024-05-08T18:30:53.739 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.739 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:53.739 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.739 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:53.739 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.528868+0000", 2024-05-08T18:30:53.740 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:53.740 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.740 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.740 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:53.740 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.528868+0000", 2024-05-08T18:30:53.740 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:53.740 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.740 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.740 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:53.740 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.528870+0000", 2024-05-08T18:30:53.740 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6199999999999999e-06 2024-05-08T18:30:53.740 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.740 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.741 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:53.741 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.528877+0000", 2024-05-08T18:30:53.741 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4070000000000004e-06 2024-05-08T18:30:53.741 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.741 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.741 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:53.741 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.528899+0000", 2024-05-08T18:30:53.741 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1495999999999999e-05 2024-05-08T18:30:53.741 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.741 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.741 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:53.741 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.528910+0000", 2024-05-08T18:30:53.742 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1562999999999999e-05 2024-05-08T18:30:53.742 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.742 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.742 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:53.742 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.529027+0000", 2024-05-08T18:30:53.742 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000116873 2024-05-08T18:30:53.742 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.742 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.742 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:53.742 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.529258+0000", 2024-05-08T18:30:53.742 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000231065 2024-05-08T18:30:53.743 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.743 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.743 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:53.743 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.529732+0000", 2024-05-08T18:30:53.743 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000474043 2024-05-08T18:30:53.743 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.743 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.743 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:53.743 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.530983+0000", 2024-05-08T18:30:53.743 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0012505929999999999 2024-05-08T18:30:53.743 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.743 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.743 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:53.744 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.531621+0000", 2024-05-08T18:30:53.744 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00063814899999999996 2024-05-08T18:30:53.744 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.744 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.744 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:53.744 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.531785+0000", 2024-05-08T18:30:53.744 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016452200000000001 2024-05-08T18:30:53.744 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.744 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.744 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:53.744 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.531898+0000", 2024-05-08T18:30:53.744 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000112539 2024-05-08T18:30:53.744 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:53.744 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:53.745 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:53.745 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.745 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.745 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:53.745 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.532086+0000", 2024-05-08T18:30:53.745 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 61.100309928000001, 2024-05-08T18:30:53.745 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032260779999999998, 2024-05-08T18:30:53.745 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:53.745 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:53.745 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:53.745 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:53.745 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:53.745 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:53.745 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 928 2024-05-08T18:30:53.746 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.746 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:53.746 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.746 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:53.746 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.532086+0000", 2024-05-08T18:30:53.746 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:53.746 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.746 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.746 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:53.746 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.532086+0000", 2024-05-08T18:30:53.747 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:53.747 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.747 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.747 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:53.747 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.532088+0000", 2024-05-08T18:30:53.747 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8670000000000001e-06 2024-05-08T18:30:53.747 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.747 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.747 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:53.747 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.532097+0000", 2024-05-08T18:30:53.747 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.6929999999999996e-06 2024-05-08T18:30:53.747 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.747 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.747 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:53.748 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.532121+0000", 2024-05-08T18:30:53.748 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3572999999999999e-05 2024-05-08T18:30:53.748 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.748 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.748 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:53.748 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.532134+0000", 2024-05-08T18:30:53.748 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3823e-05 2024-05-08T18:30:53.748 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.748 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.748 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:53.748 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.532255+0000", 2024-05-08T18:30:53.748 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012074900000000001 2024-05-08T18:30:53.748 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.748 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.749 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:53.749 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.532588+0000", 2024-05-08T18:30:53.749 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000333068 2024-05-08T18:30:53.749 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.749 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.749 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:53.749 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.533135+0000", 2024-05-08T18:30:53.749 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000546259 2024-05-08T18:30:53.749 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.749 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.749 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:53.749 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.534441+0000", 2024-05-08T18:30:53.749 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0013061500000000001 2024-05-08T18:30:53.749 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.750 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.750 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:53.750 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.535049+0000", 2024-05-08T18:30:53.750 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00060823500000000005 2024-05-08T18:30:53.750 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.750 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.750 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:53.750 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.535203+0000", 2024-05-08T18:30:53.750 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015383500000000001 2024-05-08T18:30:53.750 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.750 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.750 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:53.750 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.535313+0000", 2024-05-08T18:30:53.750 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000109826 2024-05-08T18:30:53.751 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:53.751 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:53.751 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:53.751 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.751 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.751 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:930 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:53.751 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.536650+0000", 2024-05-08T18:30:53.751 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 61.095746642999998, 2024-05-08T18:30:53.751 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029677129999999999, 2024-05-08T18:30:53.751 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:53.751 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:53.751 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:53.751 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:53.751 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:53.752 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:53.752 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 930 2024-05-08T18:30:53.752 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.752 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:53.752 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.752 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:53.752 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.536650+0000", 2024-05-08T18:30:53.752 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:53.752 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.752 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.752 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:53.752 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.536650+0000", 2024-05-08T18:30:53.752 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:53.753 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.753 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.753 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:53.753 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.536652+0000", 2024-05-08T18:30:53.753 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1660000000000001e-06 2024-05-08T18:30:53.753 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.753 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.753 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:53.753 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.536680+0000", 2024-05-08T18:30:53.753 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8084000000000001e-05 2024-05-08T18:30:53.753 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.753 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.753 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:53.753 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.536711+0000", 2024-05-08T18:30:53.754 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1123e-05 2024-05-08T18:30:53.754 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.754 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.754 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:53.754 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.536729+0000", 2024-05-08T18:30:53.754 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8189000000000002e-05 2024-05-08T18:30:53.754 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.754 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.754 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:53.754 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.536852+0000", 2024-05-08T18:30:53.754 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000122729 2024-05-08T18:30:53.754 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.755 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.755 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:53.755 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.537074+0000", 2024-05-08T18:30:53.755 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022180600000000001 2024-05-08T18:30:53.755 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.755 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.755 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:53.755 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.537526+0000", 2024-05-08T18:30:53.755 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00045219599999999998 2024-05-08T18:30:53.755 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.755 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.755 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:53.755 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.538973+0000", 2024-05-08T18:30:53.755 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001447102 2024-05-08T18:30:53.756 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.756 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.756 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:53.756 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.539410+0000", 2024-05-08T18:30:53.756 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00043727399999999997 2024-05-08T18:30:53.756 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.756 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.756 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:53.756 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.539503+0000", 2024-05-08T18:30:53.756 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2338999999999998e-05 2024-05-08T18:30:53.756 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:53.756 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:53.756 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:53.756 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.539617+0000", 2024-05-08T18:30:53.757 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011470499999999999 2024-05-08T18:30:53.757 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:53.757 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:53.757 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:53.757 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:53.757 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:53.757 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:30:53.758 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-08T18:30:53.759 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:30:53.755+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:30:53.860 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:30:53.859+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:30:53.929 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:30:53.929 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:30:53.929 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 0 2024-05-08T18:30:53.929 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:30:53.943 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-08T18:30:53.989 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:30:53.987+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:30:54.062 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:30:54.059+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:30:54.067 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:30:54.067 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:30:54.067 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2024-05-08T18:30:54.067 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2024-05-08T18:30:54.067 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:30:54.081 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-08T18:30:54.163 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:30:54.163+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:30:54.252 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:30:54.325 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2024-05-08T18:30:54.325 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2024-05-08T18:30:54.325 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-05-08T18:30:54.325 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.326 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4479.0:37 5.f 5:f43b6ece:::zone_names.default:head [create,call version.set in=10b,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-05-08T18:30:54.326 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:44.627414+0000", 2024-05-08T18:30:54.326 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 69.622055019000001, 2024-05-08T18:30:54.326 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029966429999999998, 2024-05-08T18:30:54.326 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:54.326 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:54.326 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:54.326 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:54.326 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4479", 2024-05-08T18:30:54.326 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3577501689", 2024-05-08T18:30:54.326 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 37 2024-05-08T18:30:54.326 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.326 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:54.327 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.327 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:54.327 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.627414+0000", 2024-05-08T18:30:54.327 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:54.327 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.327 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.327 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:54.327 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.627414+0000", 2024-05-08T18:30:54.327 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:54.327 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.327 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.327 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:54.327 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.627416+0000", 2024-05-08T18:30:54.327 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9580000000000001e-06 2024-05-08T18:30:54.328 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.328 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.328 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:54.328 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.627427+0000", 2024-05-08T18:30:54.328 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1657e-05 2024-05-08T18:30:54.328 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.328 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.328 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:54.328 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.627454+0000", 2024-05-08T18:30:54.328 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6619e-05 2024-05-08T18:30:54.328 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.328 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.328 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:54.328 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.627474+0000", 2024-05-08T18:30:54.329 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9612000000000001e-05 2024-05-08T18:30:54.329 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.329 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.329 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:54.329 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.627647+0000", 2024-05-08T18:30:54.329 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017374999999999999 2024-05-08T18:30:54.329 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.329 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.329 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:54.329 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.627861+0000", 2024-05-08T18:30:54.329 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000213358 2024-05-08T18:30:54.329 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.330 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.330 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:54.330 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.628153+0000", 2024-05-08T18:30:54.330 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029198899999999999 2024-05-08T18:30:54.330 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.330 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.330 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:54.330 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.629544+0000", 2024-05-08T18:30:54.330 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0013916390000000001 2024-05-08T18:30:54.330 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.330 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.330 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:54.330 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.630221+0000", 2024-05-08T18:30:54.330 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00067613500000000002 2024-05-08T18:30:54.331 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.331 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.331 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:54.331 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.630321+0000", 2024-05-08T18:30:54.331 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000100126 2024-05-08T18:30:54.331 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.331 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.331 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:54.331 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.630411+0000", 2024-05-08T18:30:54.331 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.9800000000000001e-05 2024-05-08T18:30:54.331 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:54.331 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:54.331 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:54.331 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.332 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.332 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4479.0:41 5.f 5:f4c53578:::zonegroups_names.default:head [create,call version.set in=10b,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-05-08T18:30:54.332 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:44.637466+0000", 2024-05-08T18:30:54.332 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 69.612003060000006, 2024-05-08T18:30:54.332 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0030003949999999999, 2024-05-08T18:30:54.332 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:54.332 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:54.332 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:54.332 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:54.332 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4479", 2024-05-08T18:30:54.332 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3577501689", 2024-05-08T18:30:54.332 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 41 2024-05-08T18:30:54.332 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.332 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:54.333 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.333 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:54.333 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.637466+0000", 2024-05-08T18:30:54.333 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:54.333 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.333 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.333 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:54.333 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.637466+0000", 2024-05-08T18:30:54.333 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:54.333 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.333 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.333 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:54.333 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.637468+0000", 2024-05-08T18:30:54.334 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2800000000000002e-06 2024-05-08T18:30:54.334 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.334 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.334 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:54.334 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.637479+0000", 2024-05-08T18:30:54.334 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0674e-05 2024-05-08T18:30:54.334 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.334 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.334 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:54.334 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.637508+0000", 2024-05-08T18:30:54.334 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8921999999999999e-05 2024-05-08T18:30:54.334 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.335 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.335 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:54.335 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.637522+0000", 2024-05-08T18:30:54.335 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3923e-05 2024-05-08T18:30:54.335 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.335 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.335 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:54.335 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.637647+0000", 2024-05-08T18:30:54.335 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000124905 2024-05-08T18:30:54.335 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.335 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.335 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:54.335 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.637852+0000", 2024-05-08T18:30:54.335 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000205081 2024-05-08T18:30:54.336 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.336 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.336 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:54.336 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.638101+0000", 2024-05-08T18:30:54.336 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000248953 2024-05-08T18:30:54.336 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.336 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.336 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:54.336 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.639345+0000", 2024-05-08T18:30:54.336 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001244754 2024-05-08T18:30:54.336 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.336 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.336 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:54.337 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.640197+0000", 2024-05-08T18:30:54.337 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000851614 2024-05-08T18:30:54.337 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.337 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.337 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:54.337 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.640353+0000", 2024-05-08T18:30:54.337 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015631600000000001 2024-05-08T18:30:54.337 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.337 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.337 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:54.337 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.640466+0000", 2024-05-08T18:30:54.337 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000112973 2024-05-08T18:30:54.337 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:54.337 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:54.338 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:54.338 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.338 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.338 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:30:54.338 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.664338+0000", 2024-05-08T18:30:54.338 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 62.585131249, 2024-05-08T18:30:54.338 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039355429999999997, 2024-05-08T18:30:54.338 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:54.338 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:54.338 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:54.338 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:54.338 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:54.338 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:54.339 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 205 2024-05-08T18:30:54.339 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.339 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:54.339 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.339 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:54.339 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.664338+0000", 2024-05-08T18:30:54.339 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:54.339 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.339 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.339 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:54.339 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.664338+0000", 2024-05-08T18:30:54.339 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:54.339 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.339 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.340 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:54.340 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.664341+0000", 2024-05-08T18:30:54.340 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2399999999999999e-06 2024-05-08T18:30:54.340 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.340 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.340 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:54.340 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.664355+0000", 2024-05-08T18:30:54.340 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.453e-05 2024-05-08T18:30:54.340 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.340 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.340 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:54.340 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.664392+0000", 2024-05-08T18:30:54.340 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7033000000000003e-05 2024-05-08T18:30:54.341 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.341 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.341 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:54.341 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.664419+0000", 2024-05-08T18:30:54.341 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6086000000000001e-05 2024-05-08T18:30:54.341 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.341 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.341 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:54.341 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.664586+0000", 2024-05-08T18:30:54.341 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016752299999999999 2024-05-08T18:30:54.341 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.341 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.341 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:54.341 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.664831+0000", 2024-05-08T18:30:54.342 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00024510800000000001 2024-05-08T18:30:54.342 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.342 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.342 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:54.342 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.665420+0000", 2024-05-08T18:30:54.342 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00058862499999999996 2024-05-08T18:30:54.342 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.342 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.342 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:54.342 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.667096+0000", 2024-05-08T18:30:54.342 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0016765199999999999 2024-05-08T18:30:54.342 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.342 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.343 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:54.343 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.668109+0000", 2024-05-08T18:30:54.343 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001012829 2024-05-08T18:30:54.343 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.343 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.343 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:54.343 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.668200+0000", 2024-05-08T18:30:54.343 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1186000000000004e-05 2024-05-08T18:30:54.343 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.343 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.343 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:54.343 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.668273+0000", 2024-05-08T18:30:54.343 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.2862999999999997e-05 2024-05-08T18:30:54.344 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:54.344 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:54.344 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:54.344 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.344 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.344 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:54.344 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.732858+0000", 2024-05-08T18:30:54.344 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 62.516610901, 2024-05-08T18:30:54.344 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0033301939999999999, 2024-05-08T18:30:54.344 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:54.344 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:54.344 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:54.344 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:54.345 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:54.345 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:54.345 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 220 2024-05-08T18:30:54.345 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.345 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:54.345 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.345 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:54.345 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.732858+0000", 2024-05-08T18:30:54.345 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:54.345 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.345 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.345 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:54.345 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.732858+0000", 2024-05-08T18:30:54.346 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:54.346 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.346 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.346 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:54.346 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.732861+0000", 2024-05-08T18:30:54.346 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.9129999999999999e-06 2024-05-08T18:30:54.346 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.346 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.346 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:54.346 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.732874+0000", 2024-05-08T18:30:54.346 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3349999999999999e-05 2024-05-08T18:30:54.346 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.346 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.346 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:54.347 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.732900+0000", 2024-05-08T18:30:54.347 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6186999999999998e-05 2024-05-08T18:30:54.347 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.347 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.347 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:54.347 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.732916+0000", 2024-05-08T18:30:54.347 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5648999999999999e-05 2024-05-08T18:30:54.347 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.347 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.347 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:54.347 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.733097+0000", 2024-05-08T18:30:54.347 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00018121599999999999 2024-05-08T18:30:54.347 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.348 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.348 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:54.348 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.733299+0000", 2024-05-08T18:30:54.348 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020179799999999999 2024-05-08T18:30:54.348 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.348 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.348 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:54.348 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.733694+0000", 2024-05-08T18:30:54.348 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00039455000000000002 2024-05-08T18:30:54.348 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.348 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.348 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:54.348 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.735124+0000", 2024-05-08T18:30:54.349 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001430239 2024-05-08T18:30:54.349 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.349 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.349 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:54.349 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.736037+0000", 2024-05-08T18:30:54.349 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00091359999999999998 2024-05-08T18:30:54.349 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.349 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.349 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:54.349 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.736122+0000", 2024-05-08T18:30:54.349 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4313000000000004e-05 2024-05-08T18:30:54.349 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.349 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.349 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:54.350 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.736188+0000", 2024-05-08T18:30:54.350 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6378999999999996e-05 2024-05-08T18:30:54.350 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:54.350 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:54.350 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:54.350 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.350 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.350 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:223 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:54.350 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.743358+0000", 2024-05-08T18:30:54.350 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 62.506110689000003, 2024-05-08T18:30:54.350 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003279718, 2024-05-08T18:30:54.350 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:54.350 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:54.351 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:54.351 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:54.351 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:54.351 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:54.351 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 223 2024-05-08T18:30:54.351 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.351 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:54.351 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.351 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:54.351 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.743358+0000", 2024-05-08T18:30:54.351 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:54.351 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.351 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.352 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:54.352 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.743358+0000", 2024-05-08T18:30:54.352 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:54.352 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.352 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.352 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:54.352 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.743361+0000", 2024-05-08T18:30:54.352 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3269999999999999e-06 2024-05-08T18:30:54.352 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.352 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.352 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:54.352 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.743372+0000", 2024-05-08T18:30:54.352 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1202999999999999e-05 2024-05-08T18:30:54.352 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.353 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.353 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:54.353 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.743402+0000", 2024-05-08T18:30:54.353 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0580000000000002e-05 2024-05-08T18:30:54.353 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.353 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.353 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:54.353 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.743417+0000", 2024-05-08T18:30:54.353 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5067e-05 2024-05-08T18:30:54.353 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.353 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.353 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:54.353 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.743529+0000", 2024-05-08T18:30:54.354 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011130599999999999 2024-05-08T18:30:54.354 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.354 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.354 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:54.354 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.743744+0000", 2024-05-08T18:30:54.354 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000215324 2024-05-08T18:30:54.354 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.354 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.354 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:54.354 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.744137+0000", 2024-05-08T18:30:54.354 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00039347699999999999 2024-05-08T18:30:54.354 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.354 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.354 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:54.355 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.745510+0000", 2024-05-08T18:30:54.355 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001372063 2024-05-08T18:30:54.355 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.355 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.355 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:54.355 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.746486+0000", 2024-05-08T18:30:54.355 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00097615600000000005 2024-05-08T18:30:54.355 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.355 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.355 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:54.355 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.746574+0000", 2024-05-08T18:30:54.355 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8598999999999997e-05 2024-05-08T18:30:54.355 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.356 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.356 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:54.356 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.746638+0000", 2024-05-08T18:30:54.356 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3615999999999995e-05 2024-05-08T18:30:54.356 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:54.356 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:54.356 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:54.356 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.356 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.356 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:225 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:54.356 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.750971+0000", 2024-05-08T18:30:54.356 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 62.498498103999999, 2024-05-08T18:30:54.356 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0033719510000000002, 2024-05-08T18:30:54.357 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:54.357 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:54.357 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:54.357 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:54.357 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:54.357 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:54.357 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 225 2024-05-08T18:30:54.357 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.357 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:54.357 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.357 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:54.357 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.750971+0000", 2024-05-08T18:30:54.357 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:54.357 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.358 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.358 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:54.358 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.750971+0000", 2024-05-08T18:30:54.358 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:54.358 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.358 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.358 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:54.358 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.750973+0000", 2024-05-08T18:30:54.358 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.243e-06 2024-05-08T18:30:54.358 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.358 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.358 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:54.358 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.751001+0000", 2024-05-08T18:30:54.358 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8082999999999999e-05 2024-05-08T18:30:54.359 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.359 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.359 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:54.359 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.751029+0000", 2024-05-08T18:30:54.359 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.792e-05 2024-05-08T18:30:54.359 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.359 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.359 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:54.359 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.751051+0000", 2024-05-08T18:30:54.359 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2166000000000001e-05 2024-05-08T18:30:54.359 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.359 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.359 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:54.360 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.751239+0000", 2024-05-08T18:30:54.360 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000187362 2024-05-08T18:30:54.360 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.360 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.360 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:54.360 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.751462+0000", 2024-05-08T18:30:54.360 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000223482 2024-05-08T18:30:54.360 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.360 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.360 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:54.360 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.751893+0000", 2024-05-08T18:30:54.360 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00043102 2024-05-08T18:30:54.360 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.360 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.361 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:54.361 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.753297+0000", 2024-05-08T18:30:54.361 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001403619 2024-05-08T18:30:54.361 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.361 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.361 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:54.361 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.754186+0000", 2024-05-08T18:30:54.361 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00088948399999999996 2024-05-08T18:30:54.361 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.361 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.361 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:54.361 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.754280+0000", 2024-05-08T18:30:54.361 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.3838999999999994e-05 2024-05-08T18:30:54.361 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.362 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.362 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:54.362 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.754343+0000", 2024-05-08T18:30:54.362 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2732999999999997e-05 2024-05-08T18:30:54.362 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:54.362 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:54.362 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:54.362 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.362 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.362 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:226 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:54.362 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.754700+0000", 2024-05-08T18:30:54.362 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 62.494768549, 2024-05-08T18:30:54.362 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032180080000000001, 2024-05-08T18:30:54.362 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:54.363 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:54.363 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:54.363 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:54.363 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:54.363 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:54.363 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 226 2024-05-08T18:30:54.363 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.363 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:54.363 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.363 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:54.363 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.754700+0000", 2024-05-08T18:30:54.363 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:54.363 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.363 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.363 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:54.364 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.754700+0000", 2024-05-08T18:30:54.364 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:54.364 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.364 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.364 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:54.364 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.754702+0000", 2024-05-08T18:30:54.364 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.86e-06 2024-05-08T18:30:54.364 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.364 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.364 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:54.364 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.754711+0000", 2024-05-08T18:30:54.364 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.0399999999999998e-06 2024-05-08T18:30:54.364 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.364 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.365 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:54.365 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.754735+0000", 2024-05-08T18:30:54.365 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3496e-05 2024-05-08T18:30:54.365 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.365 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.365 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:54.365 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.754753+0000", 2024-05-08T18:30:54.365 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8406e-05 2024-05-08T18:30:54.365 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.365 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.365 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:54.365 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.754941+0000", 2024-05-08T18:30:54.365 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00018746600000000001 2024-05-08T18:30:54.365 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.365 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.366 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:54.366 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.755164+0000", 2024-05-08T18:30:54.366 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022307800000000001 2024-05-08T18:30:54.366 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.366 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.366 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:54.366 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.755552+0000", 2024-05-08T18:30:54.366 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00038834999999999998 2024-05-08T18:30:54.366 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.366 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.366 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:54.366 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.757079+0000", 2024-05-08T18:30:54.366 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001527055 2024-05-08T18:30:54.367 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.367 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.367 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:54.367 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.757769+0000", 2024-05-08T18:30:54.367 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00068953199999999997 2024-05-08T18:30:54.367 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.367 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.367 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:54.367 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.757848+0000", 2024-05-08T18:30:54.367 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9342e-05 2024-05-08T18:30:54.367 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.367 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.368 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:54.368 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.757918+0000", 2024-05-08T18:30:54.368 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0382999999999993e-05 2024-05-08T18:30:54.368 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:54.368 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:54.368 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:54.368 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.368 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.368 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:234 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:54.368 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.783973+0000", 2024-05-08T18:30:54.368 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 62.465496184999999, 2024-05-08T18:30:54.368 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003359374, 2024-05-08T18:30:54.368 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:54.368 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:54.369 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:54.369 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:54.369 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:54.369 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:54.369 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 234 2024-05-08T18:30:54.369 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.369 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:54.369 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.369 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:54.369 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.783973+0000", 2024-05-08T18:30:54.369 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:54.369 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.369 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.369 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:54.370 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.783973+0000", 2024-05-08T18:30:54.370 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:54.370 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.370 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.370 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:54.370 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.783975+0000", 2024-05-08T18:30:54.370 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2970000000000002e-06 2024-05-08T18:30:54.370 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.370 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.370 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:54.370 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.783986+0000", 2024-05-08T18:30:54.370 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0726e-05 2024-05-08T18:30:54.370 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.371 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.371 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:54.371 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.784016+0000", 2024-05-08T18:30:54.371 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0459000000000001e-05 2024-05-08T18:30:54.371 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.371 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.371 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:54.371 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.784032+0000", 2024-05-08T18:30:54.371 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5316999999999999e-05 2024-05-08T18:30:54.371 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.371 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.371 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:54.371 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.784155+0000", 2024-05-08T18:30:54.372 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012393199999999999 2024-05-08T18:30:54.372 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.372 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.372 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:54.372 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.784377+0000", 2024-05-08T18:30:54.372 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000221179 2024-05-08T18:30:54.372 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.372 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.372 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:54.372 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.784794+0000", 2024-05-08T18:30:54.372 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00041709599999999999 2024-05-08T18:30:54.372 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.372 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.372 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:54.373 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.786199+0000", 2024-05-08T18:30:54.373 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001405346 2024-05-08T18:30:54.373 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.373 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.373 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:54.373 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.787171+0000", 2024-05-08T18:30:54.373 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00097187 2024-05-08T18:30:54.373 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.373 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.373 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:54.373 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.787265+0000", 2024-05-08T18:30:54.373 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4055000000000007e-05 2024-05-08T18:30:54.373 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.373 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.374 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:54.374 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.787332+0000", 2024-05-08T18:30:54.374 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7096999999999998e-05 2024-05-08T18:30:54.374 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:54.374 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:54.374 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:54.374 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.374 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.374 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:425 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:54.374 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.847197+0000", 2024-05-08T18:30:54.374 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 62.402271519999999, 2024-05-08T18:30:54.374 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003317646, 2024-05-08T18:30:54.375 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:54.375 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:54.375 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:54.375 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:54.375 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:54.375 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:54.375 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 425 2024-05-08T18:30:54.375 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.375 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:54.375 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.375 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:54.375 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.847197+0000", 2024-05-08T18:30:54.375 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:54.375 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.376 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.376 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:54.376 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.847197+0000", 2024-05-08T18:30:54.376 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:54.376 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.376 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.376 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:54.376 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.847200+0000", 2024-05-08T18:30:54.376 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1629999999999999e-06 2024-05-08T18:30:54.376 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.376 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.376 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:54.376 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.847210+0000", 2024-05-08T18:30:54.376 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0180000000000001e-05 2024-05-08T18:30:54.377 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.377 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.377 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:54.377 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.847234+0000", 2024-05-08T18:30:54.377 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3879999999999998e-05 2024-05-08T18:30:54.377 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.377 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.377 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:54.377 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.847247+0000", 2024-05-08T18:30:54.377 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3263e-05 2024-05-08T18:30:54.377 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.377 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.377 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:54.378 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.847356+0000", 2024-05-08T18:30:54.378 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000108906 2024-05-08T18:30:54.378 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.378 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.378 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:54.378 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.847647+0000", 2024-05-08T18:30:54.378 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029143799999999998 2024-05-08T18:30:54.378 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.378 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.378 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:54.378 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.848062+0000", 2024-05-08T18:30:54.378 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000415227 2024-05-08T18:30:54.378 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.378 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.379 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:54.379 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.849591+0000", 2024-05-08T18:30:54.379 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0015288980000000001 2024-05-08T18:30:54.379 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.379 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.379 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:54.379 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.850244+0000", 2024-05-08T18:30:54.379 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000652336 2024-05-08T18:30:54.379 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.379 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.379 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:54.379 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.850418+0000", 2024-05-08T18:30:54.379 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000174284 2024-05-08T18:30:54.379 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.380 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.380 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:54.380 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.850515+0000", 2024-05-08T18:30:54.380 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7071000000000006e-05 2024-05-08T18:30:54.380 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:54.380 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:54.380 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:54.380 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.380 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.380 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:433 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:54.380 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.851403+0000", 2024-05-08T18:30:54.380 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 62.398065739000003, 2024-05-08T18:30:54.380 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032407109999999999, 2024-05-08T18:30:54.380 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:54.381 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:54.381 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:54.381 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:54.381 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:54.381 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:54.381 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 433 2024-05-08T18:30:54.381 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.381 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:54.381 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.381 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:54.381 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.851403+0000", 2024-05-08T18:30:54.381 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:54.381 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.382 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.382 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:54.382 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.851403+0000", 2024-05-08T18:30:54.382 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:54.382 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.382 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.382 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:54.382 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.851405+0000", 2024-05-08T18:30:54.382 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.463e-06 2024-05-08T18:30:54.382 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.382 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.382 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:54.382 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.851411+0000", 2024-05-08T18:30:54.383 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2369999999999997e-06 2024-05-08T18:30:54.383 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.383 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.383 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:54.383 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.851428+0000", 2024-05-08T18:30:54.383 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.696e-05 2024-05-08T18:30:54.383 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.383 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.383 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:54.383 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.851446+0000", 2024-05-08T18:30:54.383 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7706e-05 2024-05-08T18:30:54.383 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.383 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.383 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:54.384 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.851552+0000", 2024-05-08T18:30:54.384 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000106236 2024-05-08T18:30:54.384 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.384 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.384 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:54.384 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.851746+0000", 2024-05-08T18:30:54.384 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000194093 2024-05-08T18:30:54.384 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.384 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.384 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:54.384 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.852148+0000", 2024-05-08T18:30:54.384 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00040243100000000002 2024-05-08T18:30:54.384 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.385 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.385 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:54.385 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.854255+0000", 2024-05-08T18:30:54.385 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002107135 2024-05-08T18:30:54.385 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.385 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.385 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:54.385 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.854326+0000", 2024-05-08T18:30:54.385 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0902999999999995e-05 2024-05-08T18:30:54.385 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.385 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.385 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:54.385 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.854568+0000", 2024-05-08T18:30:54.386 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00024141500000000001 2024-05-08T18:30:54.386 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.386 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.386 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:54.386 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.854644+0000", 2024-05-08T18:30:54.386 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6131999999999995e-05 2024-05-08T18:30:54.386 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:54.386 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:54.386 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:54.386 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.386 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.386 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:436 6.a 6:55b0279d:reshard::reshard.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:54.386 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.852129+0000", 2024-05-08T18:30:54.386 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 62.397339930999998, 2024-05-08T18:30:54.387 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0053015019999999996, 2024-05-08T18:30:54.387 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:54.387 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:54.387 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:54.387 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:54.387 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:54.387 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:54.387 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 436 2024-05-08T18:30:54.387 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.387 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:54.387 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.387 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:54.387 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.852129+0000", 2024-05-08T18:30:54.387 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:54.388 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.388 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.388 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:54.388 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.852129+0000", 2024-05-08T18:30:54.388 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:54.388 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.388 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.388 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:54.388 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.852130+0000", 2024-05-08T18:30:54.388 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.353e-06 2024-05-08T18:30:54.388 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.388 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.388 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:54.388 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.852137+0000", 2024-05-08T18:30:54.389 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6900000000000003e-06 2024-05-08T18:30:54.389 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.389 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.389 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:54.389 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.852156+0000", 2024-05-08T18:30:54.389 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9143e-05 2024-05-08T18:30:54.389 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.389 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.389 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:54.389 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.852169+0000", 2024-05-08T18:30:54.389 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.308e-05 2024-05-08T18:30:54.389 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.389 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.389 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:54.390 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.852700+0000", 2024-05-08T18:30:54.390 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00053086599999999996 2024-05-08T18:30:54.390 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.390 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.390 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:54.390 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.853030+0000", 2024-05-08T18:30:54.390 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00033040100000000002 2024-05-08T18:30:54.390 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.390 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.390 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:54.390 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.853514+0000", 2024-05-08T18:30:54.390 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000483969 2024-05-08T18:30:54.390 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.390 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.391 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:54.391 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.856337+0000", 2024-05-08T18:30:54.391 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0028227349999999998 2024-05-08T18:30:54.391 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.391 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.391 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:54.391 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.857285+0000", 2024-05-08T18:30:54.391 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00094820600000000005 2024-05-08T18:30:54.391 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.391 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.391 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:54.391 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.857366+0000", 2024-05-08T18:30:54.391 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.0889000000000004e-05 2024-05-08T18:30:54.391 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.392 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.392 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:54.392 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.857430+0000", 2024-05-08T18:30:54.392 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4170000000000004e-05 2024-05-08T18:30:54.392 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:54.392 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:54.392 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:54.392 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.392 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.392 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:478 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:54.392 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.876745+0000", 2024-05-08T18:30:54.392 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 62.372723395000001, 2024-05-08T18:30:54.392 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0046303550000000001, 2024-05-08T18:30:54.392 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:54.393 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:54.393 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:54.393 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:54.393 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:54.393 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:54.393 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 478 2024-05-08T18:30:54.393 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.393 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:54.393 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.393 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:54.393 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.876745+0000", 2024-05-08T18:30:54.393 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:54.393 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.393 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.394 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:54.394 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.876745+0000", 2024-05-08T18:30:54.394 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:54.394 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.394 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.394 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:54.394 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.876748+0000", 2024-05-08T18:30:54.394 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2819999999999999e-06 2024-05-08T18:30:54.394 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.394 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.394 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:54.394 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.876758+0000", 2024-05-08T18:30:54.394 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0485e-05 2024-05-08T18:30:54.394 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.394 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.395 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:54.395 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.876788+0000", 2024-05-08T18:30:54.395 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.9879e-05 2024-05-08T18:30:54.395 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.395 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.395 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:54.395 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.876805+0000", 2024-05-08T18:30:54.395 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.643e-05 2024-05-08T18:30:54.395 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.395 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.395 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:54.395 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.876917+0000", 2024-05-08T18:30:54.395 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000112377 2024-05-08T18:30:54.396 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.396 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.396 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:54.396 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877094+0000", 2024-05-08T18:30:54.396 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000177131 2024-05-08T18:30:54.396 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.396 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.396 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:54.396 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877441+0000", 2024-05-08T18:30:54.396 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00034716100000000002 2024-05-08T18:30:54.396 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.396 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.396 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:54.397 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.878479+0000", 2024-05-08T18:30:54.397 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010378729999999999 2024-05-08T18:30:54.397 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.397 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.397 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:54.397 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.881252+0000", 2024-05-08T18:30:54.397 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0027728710000000001 2024-05-08T18:30:54.397 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.397 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.397 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:54.397 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.881322+0000", 2024-05-08T18:30:54.397 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0394000000000004e-05 2024-05-08T18:30:54.397 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.397 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.398 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:54.398 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.881376+0000", 2024-05-08T18:30:54.398 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3471999999999999e-05 2024-05-08T18:30:54.398 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:54.398 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:54.398 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:54.398 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.398 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.398 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:479 6.d 6:b3052b9f:reshard::reshard.0000000013:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:54.398 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.877922+0000", 2024-05-08T18:30:54.398 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 62.371547296999999, 2024-05-08T18:30:54.398 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0030756400000000001, 2024-05-08T18:30:54.398 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:54.399 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:54.399 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:54.399 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:54.399 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:54.399 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:54.399 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 479 2024-05-08T18:30:54.399 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.399 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:54.399 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.399 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:54.399 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877922+0000", 2024-05-08T18:30:54.399 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:54.399 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.400 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.400 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:54.400 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877922+0000", 2024-05-08T18:30:54.400 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:54.400 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.400 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.400 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:54.400 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877923+0000", 2024-05-08T18:30:54.400 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8670000000000001e-06 2024-05-08T18:30:54.400 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.400 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.400 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:54.400 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877933+0000", 2024-05-08T18:30:54.400 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.0860000000000008e-06 2024-05-08T18:30:54.401 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.401 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.401 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:54.401 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877970+0000", 2024-05-08T18:30:54.401 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7762999999999997e-05 2024-05-08T18:30:54.401 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.401 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.401 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:54.401 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877997+0000", 2024-05-08T18:30:54.401 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6883e-05 2024-05-08T18:30:54.401 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.401 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.401 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:54.401 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.878108+0000", 2024-05-08T18:30:54.401 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000110797 2024-05-08T18:30:54.402 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.402 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.402 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:54.402 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.878403+0000", 2024-05-08T18:30:54.402 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029509799999999999 2024-05-08T18:30:54.402 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.402 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.402 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:54.402 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.878744+0000", 2024-05-08T18:30:54.402 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00034075899999999999 2024-05-08T18:30:54.402 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.402 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.402 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:54.403 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.879800+0000", 2024-05-08T18:30:54.403 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010564420000000001 2024-05-08T18:30:54.403 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.403 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.403 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:54.403 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.880740+0000", 2024-05-08T18:30:54.403 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000940167 2024-05-08T18:30:54.403 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.403 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.403 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:54.403 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.880880+0000", 2024-05-08T18:30:54.403 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000139796 2024-05-08T18:30:54.403 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.403 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.404 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:54.404 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.880997+0000", 2024-05-08T18:30:54.404 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000116982 2024-05-08T18:30:54.404 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:54.404 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:54.404 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:54.404 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.404 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.404 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:766 6.19 6:9edc23b1:::obj_delete_at_hint.0000000063:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:54.404 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.158937+0000", 2024-05-08T18:30:54.404 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 62.090531405999997, 2024-05-08T18:30:54.404 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0030448300000000001, 2024-05-08T18:30:54.404 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:54.404 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:54.405 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:54.405 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:54.405 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:54.405 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:54.405 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 766 2024-05-08T18:30:54.405 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.405 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:54.405 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.405 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:54.405 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.158937+0000", 2024-05-08T18:30:54.405 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:54.405 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.405 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.405 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:54.406 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.158937+0000", 2024-05-08T18:30:54.406 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:54.406 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.406 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.406 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:54.406 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.158940+0000", 2024-05-08T18:30:54.406 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6170000000000001e-06 2024-05-08T18:30:54.406 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.406 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.406 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:54.406 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.158952+0000", 2024-05-08T18:30:54.406 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1559000000000001e-05 2024-05-08T18:30:54.406 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.407 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.407 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:54.407 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.158982+0000", 2024-05-08T18:30:54.407 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0406999999999999e-05 2024-05-08T18:30:54.407 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.407 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.407 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:54.407 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.159000+0000", 2024-05-08T18:30:54.407 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8e-05 2024-05-08T18:30:54.407 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.407 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.407 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:54.407 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.159090+0000", 2024-05-08T18:30:54.407 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.0124999999999995e-05 2024-05-08T18:30:54.408 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.408 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.408 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:54.408 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.159296+0000", 2024-05-08T18:30:54.408 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000205663 2024-05-08T18:30:54.408 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.408 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.408 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:54.408 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.159600+0000", 2024-05-08T18:30:54.408 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00030387699999999998 2024-05-08T18:30:54.408 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.408 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.408 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:54.408 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.160694+0000", 2024-05-08T18:30:54.408 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001094228 2024-05-08T18:30:54.409 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.409 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.409 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:54.409 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.161818+0000", 2024-05-08T18:30:54.409 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001124388 2024-05-08T18:30:54.409 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.409 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.409 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:54.409 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.161908+0000", 2024-05-08T18:30:54.409 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.9629000000000005e-05 2024-05-08T18:30:54.409 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.409 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.409 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:54.410 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.161982+0000", 2024-05-08T18:30:54.410 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4337000000000003e-05 2024-05-08T18:30:54.410 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:54.410 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:54.410 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:54.410 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.410 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.410 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:820 6.a 6:50a39311:::obj_delete_at_hint.0000000081:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:54.410 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.281842+0000", 2024-05-08T18:30:54.410 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 61.967627004999997, 2024-05-08T18:30:54.410 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0030574130000000001, 2024-05-08T18:30:54.410 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:54.410 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:54.411 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:54.411 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:54.411 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:54.411 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:54.411 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 820 2024-05-08T18:30:54.411 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.411 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:54.411 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.411 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:54.411 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.281842+0000", 2024-05-08T18:30:54.411 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:54.411 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.411 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.411 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:54.412 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.281842+0000", 2024-05-08T18:30:54.412 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:54.412 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.412 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.412 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:54.412 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.281845+0000", 2024-05-08T18:30:54.412 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8439999999999998e-06 2024-05-08T18:30:54.412 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.412 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.412 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:54.412 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.281856+0000", 2024-05-08T18:30:54.412 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.148e-05 2024-05-08T18:30:54.412 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.413 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.413 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:54.413 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.281887+0000", 2024-05-08T18:30:54.413 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1239999999999999e-05 2024-05-08T18:30:54.413 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.413 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.413 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:54.413 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.281903+0000", 2024-05-08T18:30:54.413 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5223e-05 2024-05-08T18:30:54.413 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.413 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.413 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:54.413 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.282084+0000", 2024-05-08T18:30:54.414 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00018167500000000001 2024-05-08T18:30:54.414 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.414 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.414 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:54.414 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.282301+0000", 2024-05-08T18:30:54.414 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00021651099999999999 2024-05-08T18:30:54.414 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.414 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.414 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:54.414 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.282634+0000", 2024-05-08T18:30:54.414 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000332758 2024-05-08T18:30:54.414 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.415 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.415 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:54.415 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.283836+0000", 2024-05-08T18:30:54.415 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001202397 2024-05-08T18:30:54.415 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.415 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.415 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:54.415 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.284750+0000", 2024-05-08T18:30:54.415 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00091438999999999995 2024-05-08T18:30:54.415 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.415 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.415 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:54.415 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.284836+0000", 2024-05-08T18:30:54.415 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.5855999999999999e-05 2024-05-08T18:30:54.416 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.416 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.416 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:54.416 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.284899+0000", 2024-05-08T18:30:54.416 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3039000000000004e-05 2024-05-08T18:30:54.416 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:54.416 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:54.416 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:54.416 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.416 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.416 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:835 6.7 6:e09767b9:::obj_delete_at_hint.0000000086:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:54.416 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.317765+0000", 2024-05-08T18:30:54.417 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 61.931704115999999, 2024-05-08T18:30:54.417 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029952809999999998, 2024-05-08T18:30:54.417 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:54.417 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:54.417 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:54.417 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:54.417 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:54.417 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:54.417 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 835 2024-05-08T18:30:54.417 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.417 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:54.418 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.418 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:54.418 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.317765+0000", 2024-05-08T18:30:54.418 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:54.418 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.418 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.418 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:54.418 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.317765+0000", 2024-05-08T18:30:54.418 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:54.418 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.418 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.418 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:54.418 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.317767+0000", 2024-05-08T18:30:54.419 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.057e-06 2024-05-08T18:30:54.419 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.419 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.419 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:54.419 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.317780+0000", 2024-05-08T18:30:54.419 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.36e-05 2024-05-08T18:30:54.419 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.419 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.419 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:54.419 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.317810+0000", 2024-05-08T18:30:54.419 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.9989999999999999e-05 2024-05-08T18:30:54.419 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.419 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.419 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:54.420 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.317832+0000", 2024-05-08T18:30:54.420 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1650000000000001e-05 2024-05-08T18:30:54.420 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.420 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.420 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:54.420 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.317954+0000", 2024-05-08T18:30:54.420 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000121465 2024-05-08T18:30:54.420 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.420 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.420 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:54.420 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.318189+0000", 2024-05-08T18:30:54.420 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000235818 2024-05-08T18:30:54.420 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.421 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.421 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:54.421 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.318532+0000", 2024-05-08T18:30:54.421 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00034245100000000002 2024-05-08T18:30:54.421 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.421 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.421 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:54.421 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.319625+0000", 2024-05-08T18:30:54.421 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010931280000000001 2024-05-08T18:30:54.421 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.421 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.421 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:54.421 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.320612+0000", 2024-05-08T18:30:54.422 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00098682299999999995 2024-05-08T18:30:54.422 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.422 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.422 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:54.422 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.320698+0000", 2024-05-08T18:30:54.422 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.5813e-05 2024-05-08T18:30:54.422 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.422 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.422 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:54.422 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.320760+0000", 2024-05-08T18:30:54.422 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2485999999999998e-05 2024-05-08T18:30:54.422 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:54.422 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:54.422 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:54.423 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.423 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.423 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:922 6.d 6:b6c174be:::obj_delete_at_hint.0000000115:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:54.423 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.516256+0000", 2024-05-08T18:30:54.423 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 61.733213163999999, 2024-05-08T18:30:54.423 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032949839999999999, 2024-05-08T18:30:54.423 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:54.423 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:54.423 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:54.423 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:54.423 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:54.423 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:54.423 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 922 2024-05-08T18:30:54.423 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.424 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:54.424 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.424 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:54.424 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.516256+0000", 2024-05-08T18:30:54.424 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:54.424 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.424 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.424 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:54.424 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.516256+0000", 2024-05-08T18:30:54.424 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:54.424 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.424 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.424 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:54.425 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.516258+0000", 2024-05-08T18:30:54.425 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.4399999999999999e-06 2024-05-08T18:30:54.425 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.425 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.425 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:54.425 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.516269+0000", 2024-05-08T18:30:54.425 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0797e-05 2024-05-08T18:30:54.425 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.425 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.425 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:54.425 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.516299+0000", 2024-05-08T18:30:54.425 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0213e-05 2024-05-08T18:30:54.425 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.425 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.426 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:54.426 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.516314+0000", 2024-05-08T18:30:54.426 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4600000000000001e-05 2024-05-08T18:30:54.426 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.426 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.426 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:54.426 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.516424+0000", 2024-05-08T18:30:54.426 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000110376 2024-05-08T18:30:54.426 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.426 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.426 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:54.426 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.516635+0000", 2024-05-08T18:30:54.426 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000210628 2024-05-08T18:30:54.426 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.427 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.427 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:54.427 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.516947+0000", 2024-05-08T18:30:54.427 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00031246699999999997 2024-05-08T18:30:54.427 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.427 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.427 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:54.427 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.517949+0000", 2024-05-08T18:30:54.427 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010017400000000001 2024-05-08T18:30:54.427 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.427 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.427 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:54.427 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.519389+0000", 2024-05-08T18:30:54.428 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001439655 2024-05-08T18:30:54.428 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.428 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.428 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:54.428 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.519475+0000", 2024-05-08T18:30:54.428 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.6485999999999998e-05 2024-05-08T18:30:54.428 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.428 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.428 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:54.428 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.519551+0000", 2024-05-08T18:30:54.428 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5581999999999996e-05 2024-05-08T18:30:54.428 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:54.428 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:54.428 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:54.429 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.429 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.429 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:940 6.a 6:517698f6:::obj_delete_at_hint.0000000121:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:54.429 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.560553+0000", 2024-05-08T18:30:54.429 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 61.688916315999997, 2024-05-08T18:30:54.429 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0030017569999999999, 2024-05-08T18:30:54.429 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:54.429 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:54.429 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:54.429 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:54.429 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:54.429 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:54.429 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 940 2024-05-08T18:30:54.429 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.430 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:54.430 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.430 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:54.430 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.560553+0000", 2024-05-08T18:30:54.430 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:54.430 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.430 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.430 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:54.430 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.560553+0000", 2024-05-08T18:30:54.430 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:54.430 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.430 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.430 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:54.430 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.560555+0000", 2024-05-08T18:30:54.431 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.39e-06 2024-05-08T18:30:54.431 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.431 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.431 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:54.431 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.560566+0000", 2024-05-08T18:30:54.431 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1484000000000001e-05 2024-05-08T18:30:54.431 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.431 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.431 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:54.431 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.560596+0000", 2024-05-08T18:30:54.431 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0001999999999998e-05 2024-05-08T18:30:54.431 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.431 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.431 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:54.432 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.560612+0000", 2024-05-08T18:30:54.432 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5690000000000001e-05 2024-05-08T18:30:54.432 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.432 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.432 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:54.432 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.560747+0000", 2024-05-08T18:30:54.432 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013494900000000001 2024-05-08T18:30:54.432 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.432 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.432 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:54.432 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.560961+0000", 2024-05-08T18:30:54.432 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000214305 2024-05-08T18:30:54.432 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.432 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.433 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:54.433 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.561281+0000", 2024-05-08T18:30:54.433 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00031933800000000001 2024-05-08T18:30:54.433 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.433 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.433 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:54.433 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.562399+0000", 2024-05-08T18:30:54.433 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0011180280000000001 2024-05-08T18:30:54.433 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.433 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.433 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:54.433 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.563407+0000", 2024-05-08T18:30:54.433 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010080519999999999 2024-05-08T18:30:54.433 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.434 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.434 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:54.434 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.563489+0000", 2024-05-08T18:30:54.434 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1725999999999996e-05 2024-05-08T18:30:54.434 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.434 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.434 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:54.434 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.563554+0000", 2024-05-08T18:30:54.434 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5792999999999998e-05 2024-05-08T18:30:54.434 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:54.434 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:54.434 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:54.434 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.434 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.435 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:943 6.19 6:9f21944d:::obj_delete_at_hint.0000000122:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:54.435 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.567777+0000", 2024-05-08T18:30:54.435 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 61.681691424999997, 2024-05-08T18:30:54.435 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0033921939999999999, 2024-05-08T18:30:54.435 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:54.435 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:54.435 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:54.435 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:54.435 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:54.435 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:54.435 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 943 2024-05-08T18:30:54.435 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.435 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:54.435 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.436 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:54.436 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.567777+0000", 2024-05-08T18:30:54.436 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:54.436 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.436 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.436 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:54.436 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.567777+0000", 2024-05-08T18:30:54.436 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:54.436 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.436 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.436 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:54.436 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.567779+0000", 2024-05-08T18:30:54.436 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8330000000000001e-06 2024-05-08T18:30:54.436 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.437 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.437 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:54.437 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.567788+0000", 2024-05-08T18:30:54.437 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4999999999999999e-06 2024-05-08T18:30:54.437 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.437 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.437 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:54.437 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.567812+0000", 2024-05-08T18:30:54.437 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.4207e-05 2024-05-08T18:30:54.437 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.437 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.437 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:54.437 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.567836+0000", 2024-05-08T18:30:54.437 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.4196e-05 2024-05-08T18:30:54.437 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.438 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.438 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:54.438 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.567954+0000", 2024-05-08T18:30:54.438 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011794300000000001 2024-05-08T18:30:54.438 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.438 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.438 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:54.438 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.568170+0000", 2024-05-08T18:30:54.438 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00021626100000000001 2024-05-08T18:30:54.438 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.438 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.438 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:54.438 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.568485+0000", 2024-05-08T18:30:54.439 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00031442800000000001 2024-05-08T18:30:54.439 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.439 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.439 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:54.439 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.569555+0000", 2024-05-08T18:30:54.439 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010698750000000001 2024-05-08T18:30:54.439 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.439 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.439 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:54.439 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.570899+0000", 2024-05-08T18:30:54.439 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0013446700000000001 2024-05-08T18:30:54.439 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.439 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.439 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:54.440 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.571058+0000", 2024-05-08T18:30:54.440 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015871900000000001 2024-05-08T18:30:54.440 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.440 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.440 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:54.440 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.571170+0000", 2024-05-08T18:30:54.440 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000111562 2024-05-08T18:30:54.440 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:54.440 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:54.440 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:54.440 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.440 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.440 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:952 6.a 6:541d369a:::obj_delete_at_hint.0000000125:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:54.440 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.588764+0000", 2024-05-08T18:30:54.441 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 61.660704394, 2024-05-08T18:30:54.441 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003183399, 2024-05-08T18:30:54.441 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:54.441 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:54.441 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:54.441 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:54.441 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:54.441 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:54.441 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 952 2024-05-08T18:30:54.441 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.441 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:54.441 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.441 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:54.441 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.588764+0000", 2024-05-08T18:30:54.442 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:54.442 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.442 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.442 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:54.442 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.588764+0000", 2024-05-08T18:30:54.442 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:54.442 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.442 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.442 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:54.442 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.588767+0000", 2024-05-08T18:30:54.442 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.39e-06 2024-05-08T18:30:54.442 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.442 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.442 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:54.443 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.588778+0000", 2024-05-08T18:30:54.443 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1304000000000001e-05 2024-05-08T18:30:54.443 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.443 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.443 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:54.443 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.588810+0000", 2024-05-08T18:30:54.443 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1726000000000001e-05 2024-05-08T18:30:54.443 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.443 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.443 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:54.443 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.588834+0000", 2024-05-08T18:30:54.443 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3845999999999998e-05 2024-05-08T18:30:54.443 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.443 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.444 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:54.444 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.588987+0000", 2024-05-08T18:30:54.444 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015300200000000001 2024-05-08T18:30:54.444 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.444 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.444 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:54.444 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.589197+0000", 2024-05-08T18:30:54.444 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020992299999999999 2024-05-08T18:30:54.444 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.444 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.444 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:54.444 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.589536+0000", 2024-05-08T18:30:54.444 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00033939300000000001 2024-05-08T18:30:54.444 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.445 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.445 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:54.445 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.590827+0000", 2024-05-08T18:30:54.445 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0012906 2024-05-08T18:30:54.445 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.445 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.445 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:54.445 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.591757+0000", 2024-05-08T18:30:54.445 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00093020699999999995 2024-05-08T18:30:54.445 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.445 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.445 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:54.445 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.591881+0000", 2024-05-08T18:30:54.445 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012406900000000001 2024-05-08T18:30:54.446 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.446 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.446 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:54.446 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.591948+0000", 2024-05-08T18:30:54.446 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6939000000000004e-05 2024-05-08T18:30:54.446 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:54.446 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:54.446 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:54.446 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:54.446 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:54.446 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:30:54.448 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-08T18:30:54.448 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:30:54.447+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:30:54.549 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:30:54.547+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:30:54.596 INFO:teuthology.orchestra.run.smithi097.stderr:noscrub is unset 2024-05-08T18:30:54.622 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:30:54.623 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:30:54.623 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 0 2024-05-08T18:30:54.623 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:30:54.637 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-08T18:30:54.688 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:30:54.687+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:30:54.750 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:30:54.747+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:30:54.763 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:30:54.763 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:30:54.763 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2024-05-08T18:30:54.764 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2024-05-08T18:30:54.764 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:30:54.778 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-08T18:30:54.851 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:30:54.851+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:30:54.944 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:30:54.944 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2024-05-08T18:30:54.944 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2024-05-08T18:30:54.945 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-05-08T18:30:54.945 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.945 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:30:54.945 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:48.647802+0000", 2024-05-08T18:30:54.945 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 66.295058776000005, 2024-05-08T18:30:54.945 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0027254660000000002, 2024-05-08T18:30:54.945 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:54.945 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:54.945 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:54.945 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:54.945 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:54.945 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:54.946 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 46 2024-05-08T18:30:54.946 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.946 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:54.946 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.946 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:54.946 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.647802+0000", 2024-05-08T18:30:54.946 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:54.946 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.946 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.946 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:54.946 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.647802+0000", 2024-05-08T18:30:54.946 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:54.946 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.946 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.947 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:54.947 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.647805+0000", 2024-05-08T18:30:54.947 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8940000000000002e-06 2024-05-08T18:30:54.947 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.947 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.947 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:54.947 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.647816+0000", 2024-05-08T18:30:54.947 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0998999999999999e-05 2024-05-08T18:30:54.947 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.947 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.947 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:54.947 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.647846+0000", 2024-05-08T18:30:54.947 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.027e-05 2024-05-08T18:30:54.948 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.948 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.948 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:54.948 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.647865+0000", 2024-05-08T18:30:54.948 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.808e-05 2024-05-08T18:30:54.948 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.948 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.948 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:54.948 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.647994+0000", 2024-05-08T18:30:54.948 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012923899999999999 2024-05-08T18:30:54.948 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.948 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.948 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:54.948 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.648289+0000", 2024-05-08T18:30:54.949 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029495999999999998 2024-05-08T18:30:54.949 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.949 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.949 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:54.949 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.648576+0000", 2024-05-08T18:30:54.949 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00028707599999999999 2024-05-08T18:30:54.949 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.949 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.949 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:54.949 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.649703+0000", 2024-05-08T18:30:54.949 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001126658 2024-05-08T18:30:54.949 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.949 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.949 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:54.950 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.650337+0000", 2024-05-08T18:30:54.950 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00063405500000000001 2024-05-08T18:30:54.950 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.950 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.950 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:54.950 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.650451+0000", 2024-05-08T18:30:54.950 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011476600000000001 2024-05-08T18:30:54.950 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.950 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.950 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:54.950 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.650528+0000", 2024-05-08T18:30:54.950 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6469000000000003e-05 2024-05-08T18:30:54.950 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:54.950 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:54.951 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:54.951 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.951 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.951 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94069412627456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:30:54.951 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:48.650773+0000", 2024-05-08T18:30:54.951 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 66.292088238000005, 2024-05-08T18:30:54.951 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0024358209999999999, 2024-05-08T18:30:54.951 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:54.951 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:54.951 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:54.951 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:54.951 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:54.951 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:54.952 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 47 2024-05-08T18:30:54.952 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.952 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:54.952 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.952 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:54.952 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.650773+0000", 2024-05-08T18:30:54.952 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:54.952 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.952 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.952 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:54.952 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.650773+0000", 2024-05-08T18:30:54.952 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:54.952 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.953 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.953 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:54.953 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.650775+0000", 2024-05-08T18:30:54.953 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.4030000000000001e-06 2024-05-08T18:30:54.953 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.953 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.953 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:54.953 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.650785+0000", 2024-05-08T18:30:54.953 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0027000000000001e-05 2024-05-08T18:30:54.954 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.954 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.954 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:54.954 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.650814+0000", 2024-05-08T18:30:54.954 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8350000000000001e-05 2024-05-08T18:30:54.954 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.954 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.954 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:54.954 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.650848+0000", 2024-05-08T18:30:54.954 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4566000000000001e-05 2024-05-08T18:30:54.954 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.954 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.954 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:54.955 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.650963+0000", 2024-05-08T18:30:54.955 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011506300000000001 2024-05-08T18:30:54.955 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.955 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.955 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:54.955 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.651153+0000", 2024-05-08T18:30:54.955 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000189812 2024-05-08T18:30:54.955 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.955 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.955 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:54.955 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.651493+0000", 2024-05-08T18:30:54.955 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000339616 2024-05-08T18:30:54.955 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.956 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.956 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:54.956 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.652662+0000", 2024-05-08T18:30:54.956 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0011695410000000001 2024-05-08T18:30:54.956 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.956 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.956 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:54.956 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.652998+0000", 2024-05-08T18:30:54.956 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000335788 2024-05-08T18:30:54.956 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.956 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.956 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:54.956 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.653076+0000", 2024-05-08T18:30:54.956 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8120000000000004e-05 2024-05-08T18:30:54.957 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.957 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.957 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:54.957 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.653209+0000", 2024-05-08T18:30:54.957 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000132535 2024-05-08T18:30:54.957 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:54.957 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:54.957 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:54.957 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.957 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.957 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:30:54.957 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:48.659528+0000", 2024-05-08T18:30:54.957 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 66.283333022999997, 2024-05-08T18:30:54.957 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0025123260000000001, 2024-05-08T18:30:54.958 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:54.958 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:54.958 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:54.958 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:54.958 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:54.958 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:54.958 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 54 2024-05-08T18:30:54.958 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.958 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:54.958 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.958 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:54.958 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.659528+0000", 2024-05-08T18:30:54.958 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:54.958 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.959 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.959 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:54.959 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.659528+0000", 2024-05-08T18:30:54.959 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:54.959 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.959 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.959 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:54.959 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.659530+0000", 2024-05-08T18:30:54.959 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9429999999999999e-06 2024-05-08T18:30:54.959 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.959 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.959 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:54.959 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.659540+0000", 2024-05-08T18:30:54.960 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0147e-05 2024-05-08T18:30:54.960 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.960 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.960 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:54.960 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.659569+0000", 2024-05-08T18:30:54.960 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.923e-05 2024-05-08T18:30:54.960 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.960 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.960 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:54.960 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.659584+0000", 2024-05-08T18:30:54.960 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4996e-05 2024-05-08T18:30:54.960 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.960 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.961 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:54.961 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.659716+0000", 2024-05-08T18:30:54.961 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000131457 2024-05-08T18:30:54.961 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.961 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.961 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:54.961 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.659895+0000", 2024-05-08T18:30:54.961 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017940400000000001 2024-05-08T18:30:54.961 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.961 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.961 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:54.961 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.660092+0000", 2024-05-08T18:30:54.961 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000197002 2024-05-08T18:30:54.961 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.962 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.962 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:54.962 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.661227+0000", 2024-05-08T18:30:54.962 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0011346150000000001 2024-05-08T18:30:54.962 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.962 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.962 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:54.962 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.661907+0000", 2024-05-08T18:30:54.962 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00068008800000000002 2024-05-08T18:30:54.962 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.962 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.962 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:54.962 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.661978+0000", 2024-05-08T18:30:54.963 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1538999999999994e-05 2024-05-08T18:30:54.963 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.963 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.963 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:54.963 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.662040+0000", 2024-05-08T18:30:54.963 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1904999999999998e-05 2024-05-08T18:30:54.963 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:54.963 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:54.963 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:54.963 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.963 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.963 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94069412622848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:30:54.963 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:48.662241+0000", 2024-05-08T18:30:54.964 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 66.280619697000006, 2024-05-08T18:30:54.964 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029022259999999999, 2024-05-08T18:30:54.964 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:54.964 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:54.964 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:54.964 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:54.964 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:54.964 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:54.964 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 55 2024-05-08T18:30:54.964 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.964 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:54.964 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.964 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:54.964 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.662241+0000", 2024-05-08T18:30:54.965 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:54.965 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.965 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.965 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:54.965 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.662241+0000", 2024-05-08T18:30:54.965 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:54.965 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.965 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.965 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:54.965 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.662243+0000", 2024-05-08T18:30:54.965 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.716e-06 2024-05-08T18:30:54.965 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.965 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.965 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:54.966 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.662267+0000", 2024-05-08T18:30:54.966 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3949999999999999e-05 2024-05-08T18:30:54.966 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.966 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.966 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:54.966 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.662293+0000", 2024-05-08T18:30:54.966 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6376e-05 2024-05-08T18:30:54.966 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.966 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.966 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:54.966 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.662310+0000", 2024-05-08T18:30:54.966 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6520000000000001e-05 2024-05-08T18:30:54.966 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.967 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.967 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:54.967 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.662412+0000", 2024-05-08T18:30:54.967 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010228700000000001 2024-05-08T18:30:54.967 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.967 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.967 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:54.967 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.662514+0000", 2024-05-08T18:30:54.967 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0001019 2024-05-08T18:30:54.967 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.967 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.967 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:54.967 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.662714+0000", 2024-05-08T18:30:54.968 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020008100000000001 2024-05-08T18:30:54.968 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.968 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.968 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:54.968 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.663711+0000", 2024-05-08T18:30:54.968 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00099629899999999997 2024-05-08T18:30:54.968 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.968 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.968 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:54.968 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.664976+0000", 2024-05-08T18:30:54.968 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0012652679999999999 2024-05-08T18:30:54.968 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.968 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.968 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:54.968 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.665047+0000", 2024-05-08T18:30:54.969 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1277000000000002e-05 2024-05-08T18:30:54.969 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.969 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.969 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:54.969 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.665144+0000", 2024-05-08T18:30:54.969 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6552000000000007e-05 2024-05-08T18:30:54.969 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:54.969 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:54.969 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:54.969 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.969 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.970 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:209 6.3 e33/27 6:c60da066:gc::gc.4:head v 33'1, mlcod=0'0)", 2024-05-08T18:30:54.970 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.686317+0000", 2024-05-08T18:30:54.970 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 63.256543692999998, 2024-05-08T18:30:54.970 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032126889999999999, 2024-05-08T18:30:54.970 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:54.970 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:54.970 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:54.970 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:54.970 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.970 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:54.970 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.686317+0000", 2024-05-08T18:30:54.970 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:54.970 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.971 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.971 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:54.971 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.686317+0000", 2024-05-08T18:30:54.971 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:54.971 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.971 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.971 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:54.971 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.686318+0000", 2024-05-08T18:30:54.971 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5400000000000001e-07 2024-05-08T18:30:54.971 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.971 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.971 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:54.971 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.686326+0000", 2024-05-08T18:30:54.971 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3000000000000002e-06 2024-05-08T18:30:54.971 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.972 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.972 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:54.972 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.686358+0000", 2024-05-08T18:30:54.972 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1702999999999998e-05 2024-05-08T18:30:54.972 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.972 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.972 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:54.972 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.686374+0000", 2024-05-08T18:30:54.972 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6266e-05 2024-05-08T18:30:54.972 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.973 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.973 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:54.973 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.686530+0000", 2024-05-08T18:30:54.973 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015583599999999999 2024-05-08T18:30:54.973 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.973 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.973 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:54.973 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.686573+0000", 2024-05-08T18:30:54.973 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3248999999999999e-05 2024-05-08T18:30:54.973 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.973 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.973 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:54.973 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.689412+0000", 2024-05-08T18:30:54.973 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0028385720000000001 2024-05-08T18:30:54.973 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.974 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.974 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:54.974 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.689530+0000", 2024-05-08T18:30:54.974 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000118109 2024-05-08T18:30:54.974 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:54.974 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:54.974 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:54.974 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.974 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.974 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:217 6.15 e33/27 6:ab569f81:gc::gc.12:head v 33'1, mlcod=0'0)", 2024-05-08T18:30:54.974 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.722458+0000", 2024-05-08T18:30:54.974 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 63.220403152000003, 2024-05-08T18:30:54.974 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001760604, 2024-05-08T18:30:54.975 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:54.975 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:54.975 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:54.975 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:54.975 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.975 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:54.975 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.722458+0000", 2024-05-08T18:30:54.975 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:54.975 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.975 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.975 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:54.975 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.722458+0000", 2024-05-08T18:30:54.975 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:54.975 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.976 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.976 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:54.976 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.722460+0000", 2024-05-08T18:30:54.976 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.677e-06 2024-05-08T18:30:54.976 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.976 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.976 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:54.976 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.722471+0000", 2024-05-08T18:30:54.976 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0956e-05 2024-05-08T18:30:54.976 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.976 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.976 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:54.976 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.722496+0000", 2024-05-08T18:30:54.976 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5490000000000002e-05 2024-05-08T18:30:54.976 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.977 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.977 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:54.977 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.722511+0000", 2024-05-08T18:30:54.977 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4687e-05 2024-05-08T18:30:54.977 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.977 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.977 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:54.977 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.722609+0000", 2024-05-08T18:30:54.977 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8152000000000005e-05 2024-05-08T18:30:54.977 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.977 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.977 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:54.977 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.722638+0000", 2024-05-08T18:30:54.977 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.934e-05 2024-05-08T18:30:54.978 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.978 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.978 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:54.978 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.724127+0000", 2024-05-08T18:30:54.978 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001488622 2024-05-08T18:30:54.978 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.978 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.978 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:54.978 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.724219+0000", 2024-05-08T18:30:54.978 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1680000000000003e-05 2024-05-08T18:30:54.978 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:54.978 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:54.978 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:54.978 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.979 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.979 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:231 6.1f e33/27 6:fde4dd55:gc::gc.26:head v 33'1, mlcod=0'0)", 2024-05-08T18:30:54.979 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.773905+0000", 2024-05-08T18:30:54.979 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 63.168955611999998, 2024-05-08T18:30:54.979 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002018681, 2024-05-08T18:30:54.979 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:54.979 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:54.979 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:54.979 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:54.979 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.979 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:54.979 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.773905+0000", 2024-05-08T18:30:54.979 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:54.979 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.980 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.980 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:54.980 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.773905+0000", 2024-05-08T18:30:54.980 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:54.980 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.980 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.980 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:54.980 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.773906+0000", 2024-05-08T18:30:54.980 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2300000000000001e-07 2024-05-08T18:30:54.980 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.980 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.980 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:54.980 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.773913+0000", 2024-05-08T18:30:54.980 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8399999999999997e-06 2024-05-08T18:30:54.980 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.981 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.981 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:54.981 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.773938+0000", 2024-05-08T18:30:54.981 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.4977000000000002e-05 2024-05-08T18:30:54.981 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.981 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.981 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:54.981 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.773970+0000", 2024-05-08T18:30:54.981 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1673e-05 2024-05-08T18:30:54.981 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.981 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.981 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:54.981 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.774112+0000", 2024-05-08T18:30:54.981 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014273899999999999 2024-05-08T18:30:54.981 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.982 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.982 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:54.982 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.774167+0000", 2024-05-08T18:30:54.982 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4762000000000002e-05 2024-05-08T18:30:54.982 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.982 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.982 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:54.982 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.775832+0000", 2024-05-08T18:30:54.982 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0016648539999999999 2024-05-08T18:30:54.982 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.982 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.982 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:54.982 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.775924+0000", 2024-05-08T18:30:54.982 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2312999999999995e-05 2024-05-08T18:30:54.983 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:54.983 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:54.983 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:54.983 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.983 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.983 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:328 6.15 e33/27 6:ab569f81:gc::gc.12:head v 33'3, mlcod=33'1)", 2024-05-08T18:30:54.983 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.811368+0000", 2024-05-08T18:30:54.983 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 63.131493110999997, 2024-05-08T18:30:54.983 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0019828110000000001, 2024-05-08T18:30:54.983 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:54.983 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:54.983 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:54.983 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:54.984 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.984 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:54.984 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.811368+0000", 2024-05-08T18:30:54.984 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:54.984 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.984 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.984 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:54.984 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.811368+0000", 2024-05-08T18:30:54.984 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:54.984 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.984 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.984 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:54.984 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.811370+0000", 2024-05-08T18:30:54.985 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.883e-06 2024-05-08T18:30:54.985 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.985 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.985 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:54.985 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.811385+0000", 2024-05-08T18:30:54.985 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5489999999999999e-05 2024-05-08T18:30:54.985 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.985 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.985 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:54.985 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.811422+0000", 2024-05-08T18:30:54.985 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7023000000000001e-05 2024-05-08T18:30:54.985 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.985 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.986 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:54.986 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.811443+0000", 2024-05-08T18:30:54.986 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0194e-05 2024-05-08T18:30:54.986 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.986 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.986 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:54.986 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.811582+0000", 2024-05-08T18:30:54.986 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000139068 2024-05-08T18:30:54.986 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.986 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.986 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:54.986 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.811646+0000", 2024-05-08T18:30:54.986 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4113000000000001e-05 2024-05-08T18:30:54.986 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.987 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.987 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:54.987 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.813243+0000", 2024-05-08T18:30:54.987 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0015969249999999999 2024-05-08T18:30:54.987 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.987 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.987 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:54.987 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.813351+0000", 2024-05-08T18:30:54.987 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000108115 2024-05-08T18:30:54.987 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:54.987 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:54.987 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:54.987 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.988 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.988 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:341 6.1 e33/27 6:856b9b26:reshard::reshard.0000000002:head v 33'2, mlcod=0'0)", 2024-05-08T18:30:54.988 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.813091+0000", 2024-05-08T18:30:54.988 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 63.129769844000002, 2024-05-08T18:30:54.988 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0021783459999999998, 2024-05-08T18:30:54.988 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:54.988 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:54.988 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:54.988 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:54.988 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.988 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:54.988 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.813091+0000", 2024-05-08T18:30:54.988 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:54.989 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.989 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.989 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:54.989 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.813091+0000", 2024-05-08T18:30:54.989 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:54.989 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.989 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.989 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:54.989 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.813093+0000", 2024-05-08T18:30:54.989 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.813e-06 2024-05-08T18:30:54.989 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.989 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.989 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:54.990 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.813107+0000", 2024-05-08T18:30:54.990 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3730000000000001e-05 2024-05-08T18:30:54.990 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.990 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.990 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:54.990 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.813177+0000", 2024-05-08T18:30:54.990 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9801999999999993e-05 2024-05-08T18:30:54.990 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.990 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.990 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:54.990 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.813198+0000", 2024-05-08T18:30:54.990 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1347000000000001e-05 2024-05-08T18:30:54.990 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.991 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.991 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:54.991 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.813321+0000", 2024-05-08T18:30:54.991 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000123192 2024-05-08T18:30:54.991 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.991 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.991 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:54.991 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.813373+0000", 2024-05-08T18:30:54.991 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2046999999999998e-05 2024-05-08T18:30:54.991 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.991 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.991 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:54.991 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.815181+0000", 2024-05-08T18:30:54.991 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001807562 2024-05-08T18:30:54.992 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.992 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.992 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:54.992 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.815270+0000", 2024-05-08T18:30:54.992 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8852999999999998e-05 2024-05-08T18:30:54.992 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:54.992 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:54.992 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:54.992 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.992 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.992 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:404 6.3 e33/27 6:c623b173:gc::gc.16:head v 33'6, mlcod=33'4)", 2024-05-08T18:30:54.992 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.837510+0000", 2024-05-08T18:30:54.992 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 63.105351532999997, 2024-05-08T18:30:54.993 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0023724549999999999, 2024-05-08T18:30:54.993 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:54.993 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:54.993 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:54.993 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:54.993 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.993 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:54.993 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.837510+0000", 2024-05-08T18:30:54.993 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:54.993 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.993 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.993 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:54.993 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.837510+0000", 2024-05-08T18:30:54.993 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:54.994 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.994 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.994 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:54.994 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.837511+0000", 2024-05-08T18:30:54.994 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.863e-06 2024-05-08T18:30:54.994 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.994 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.994 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:54.994 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.837526+0000", 2024-05-08T18:30:54.994 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4756999999999999e-05 2024-05-08T18:30:54.994 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.994 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.994 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:54.994 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.837564+0000", 2024-05-08T18:30:54.995 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7645999999999998e-05 2024-05-08T18:30:54.995 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.995 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.995 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:54.995 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.837584+0000", 2024-05-08T18:30:54.995 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9763999999999999e-05 2024-05-08T18:30:54.995 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.995 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.995 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:54.995 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.837724+0000", 2024-05-08T18:30:54.995 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014080200000000001 2024-05-08T18:30:54.995 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.995 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.995 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:54.995 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.837776+0000", 2024-05-08T18:30:54.996 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1279000000000002e-05 2024-05-08T18:30:54.996 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.996 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.996 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:54.996 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.839770+0000", 2024-05-08T18:30:54.996 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001994048 2024-05-08T18:30:54.996 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.996 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.996 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:54.996 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.839882+0000", 2024-05-08T18:30:54.996 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000112296 2024-05-08T18:30:54.996 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:54.996 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:54.997 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:54.997 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.997 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.997 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:414 6.c e33/27 6:338eb7e9:::obj_delete_at_hint.0000000008:head v 33'3, mlcod=33'1)", 2024-05-08T18:30:54.997 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.841401+0000", 2024-05-08T18:30:54.997 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 63.101460383000003, 2024-05-08T18:30:54.997 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001916865, 2024-05-08T18:30:54.997 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:54.997 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:54.997 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:54.997 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:54.997 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.997 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:54.997 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.841401+0000", 2024-05-08T18:30:54.998 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:54.998 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.998 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.998 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:54.998 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.841401+0000", 2024-05-08T18:30:54.998 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:54.998 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.998 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.998 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:54.998 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.841402+0000", 2024-05-08T18:30:54.998 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6899999999999999e-06 2024-05-08T18:30:54.998 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.998 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.998 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:54.999 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.841414+0000", 2024-05-08T18:30:54.999 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.183e-05 2024-05-08T18:30:54.999 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.999 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.999 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:54.999 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.841435+0000", 2024-05-08T18:30:54.999 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0876000000000001e-05 2024-05-08T18:30:54.999 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:54.999 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:54.999 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:54.999 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.841451+0000", 2024-05-08T18:30:54.999 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5784e-05 2024-05-08T18:30:54.999 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.000 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.000 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:55.000 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.841597+0000", 2024-05-08T18:30:55.000 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014639899999999999 2024-05-08T18:30:55.000 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.000 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.000 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:55.000 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.841656+0000", 2024-05-08T18:30:55.000 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8485e-05 2024-05-08T18:30:55.000 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.000 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.000 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:55.001 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.843235+0000", 2024-05-08T18:30:55.001 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0015787920000000001 2024-05-08T18:30:55.001 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.001 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.001 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:55.001 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.843318+0000", 2024-05-08T18:30:55.001 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3009000000000004e-05 2024-05-08T18:30:55.001 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:55.001 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:55.001 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:55.001 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.001 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.001 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:422 6.c e33/27 6:338eb7e9:::obj_delete_at_hint.0000000008:head v 33'4, mlcod=33'2)", 2024-05-08T18:30:55.001 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.844520+0000", 2024-05-08T18:30:55.002 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 63.098341237, 2024-05-08T18:30:55.002 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002269929, 2024-05-08T18:30:55.002 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:55.002 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:55.002 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:55.002 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:55.002 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.002 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:55.002 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.844520+0000", 2024-05-08T18:30:55.002 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:55.002 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.002 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.002 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:55.003 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.844520+0000", 2024-05-08T18:30:55.003 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:55.003 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.003 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.003 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:55.003 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.844522+0000", 2024-05-08T18:30:55.003 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.643e-06 2024-05-08T18:30:55.003 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.003 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.003 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:55.003 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.844577+0000", 2024-05-08T18:30:55.003 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5976000000000001e-05 2024-05-08T18:30:55.003 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.003 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.004 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:55.004 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.844613+0000", 2024-05-08T18:30:55.004 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5339999999999997e-05 2024-05-08T18:30:55.004 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.004 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.004 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:55.004 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.844638+0000", 2024-05-08T18:30:55.004 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5165999999999999e-05 2024-05-08T18:30:55.004 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.004 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.004 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:55.004 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.844795+0000", 2024-05-08T18:30:55.004 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015660899999999999 2024-05-08T18:30:55.004 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.004 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.005 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:55.005 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.844841+0000", 2024-05-08T18:30:55.005 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6279999999999997e-05 2024-05-08T18:30:55.005 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.005 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.005 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:55.005 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.846707+0000", 2024-05-08T18:30:55.005 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0018657249999999999 2024-05-08T18:30:55.005 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.005 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.005 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:55.005 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.846790+0000", 2024-05-08T18:30:55.005 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3189999999999995e-05 2024-05-08T18:30:55.006 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:55.006 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:55.006 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:55.006 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.006 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.006 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:425 6.a e33/27 6:50d64734:::obj_delete_at_hint.0000000009:head v 33'2, mlcod=0'0)", 2024-05-08T18:30:55.006 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.848220+0000", 2024-05-08T18:30:55.006 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 63.094641119000002, 2024-05-08T18:30:55.006 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0017145109999999999, 2024-05-08T18:30:55.006 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:55.006 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:55.006 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:55.007 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:55.007 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.007 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:55.007 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.848220+0000", 2024-05-08T18:30:55.007 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:55.007 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.007 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.007 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:55.007 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.848220+0000", 2024-05-08T18:30:55.007 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:55.007 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.007 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.007 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:55.007 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.848222+0000", 2024-05-08T18:30:55.008 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9630000000000001e-06 2024-05-08T18:30:55.008 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.008 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.008 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:55.008 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.848254+0000", 2024-05-08T18:30:55.008 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2047e-05 2024-05-08T18:30:55.008 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.008 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.008 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:55.008 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.848273+0000", 2024-05-08T18:30:55.008 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9493000000000001e-05 2024-05-08T18:30:55.008 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.008 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.008 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:55.009 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.848286+0000", 2024-05-08T18:30:55.009 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2490000000000001e-05 2024-05-08T18:30:55.009 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.009 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.009 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:55.009 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.848414+0000", 2024-05-08T18:30:55.009 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000127785 2024-05-08T18:30:55.009 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.009 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.009 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:55.009 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.848448+0000", 2024-05-08T18:30:55.009 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4233999999999998e-05 2024-05-08T18:30:55.009 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.009 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.009 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:55.010 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.849855+0000", 2024-05-08T18:30:55.010 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001407482 2024-05-08T18:30:55.010 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.010 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.010 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:55.010 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.849934+0000", 2024-05-08T18:30:55.010 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9017000000000006e-05 2024-05-08T18:30:55.010 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:55.010 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:55.010 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:55.010 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.010 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.011 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:436 6.a e33/27 6:55b0279d:reshard::reshard.0000000009:head v 33'4, mlcod=33'1)", 2024-05-08T18:30:55.011 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.853725+0000", 2024-05-08T18:30:55.011 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 63.089135601999999, 2024-05-08T18:30:55.011 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032824949999999999, 2024-05-08T18:30:55.011 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:55.011 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:55.011 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:55.011 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:55.011 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.011 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:55.011 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.853725+0000", 2024-05-08T18:30:55.011 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:55.011 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.012 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.012 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:55.012 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.853725+0000", 2024-05-08T18:30:55.012 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:55.012 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.012 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.012 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:55.012 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.853727+0000", 2024-05-08T18:30:55.012 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6899999999999999e-06 2024-05-08T18:30:55.012 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.012 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.012 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:55.012 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.853742+0000", 2024-05-08T18:30:55.012 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.517e-05 2024-05-08T18:30:55.013 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.013 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.013 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:55.013 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.853778+0000", 2024-05-08T18:30:55.013 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5173999999999999e-05 2024-05-08T18:30:55.013 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.013 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.013 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:55.013 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.853791+0000", 2024-05-08T18:30:55.013 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.345e-05 2024-05-08T18:30:55.013 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.013 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.013 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:55.013 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.853912+0000", 2024-05-08T18:30:55.013 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012149199999999999 2024-05-08T18:30:55.014 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.014 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.014 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:55.014 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.853960+0000", 2024-05-08T18:30:55.014 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7262999999999998e-05 2024-05-08T18:30:55.014 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.014 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.014 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:55.014 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.856896+0000", 2024-05-08T18:30:55.014 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029363700000000002 2024-05-08T18:30:55.014 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.014 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.014 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:55.014 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.857008+0000", 2024-05-08T18:30:55.015 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011188600000000001 2024-05-08T18:30:55.015 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:55.015 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:55.015 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:55.015 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.015 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.015 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:457 6.1 e33/27 6:80b6fe23:reshard::reshard.0000000011:head v 33'3, mlcod=33'1)", 2024-05-08T18:30:55.015 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.865322+0000", 2024-05-08T18:30:55.015 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 63.077538957000002, 2024-05-08T18:30:55.015 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001750756, 2024-05-08T18:30:55.015 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:55.015 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:55.015 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:55.016 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:55.016 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.016 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:55.016 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.865322+0000", 2024-05-08T18:30:55.016 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:55.016 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.016 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.016 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:55.016 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.865322+0000", 2024-05-08T18:30:55.016 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:55.016 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.016 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.016 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:55.016 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.865325+0000", 2024-05-08T18:30:55.016 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5660000000000001e-06 2024-05-08T18:30:55.017 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.017 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.017 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:55.017 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.865339+0000", 2024-05-08T18:30:55.017 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.412e-05 2024-05-08T18:30:55.017 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.017 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.017 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:55.017 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.865366+0000", 2024-05-08T18:30:55.017 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7453e-05 2024-05-08T18:30:55.017 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.017 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.017 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:55.017 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.865383+0000", 2024-05-08T18:30:55.018 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.683e-05 2024-05-08T18:30:55.018 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.018 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.018 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:55.018 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.865514+0000", 2024-05-08T18:30:55.018 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000131369 2024-05-08T18:30:55.018 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.018 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.018 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:55.018 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.865583+0000", 2024-05-08T18:30:55.018 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8526000000000001e-05 2024-05-08T18:30:55.018 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.018 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.018 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:55.019 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.866974+0000", 2024-05-08T18:30:55.019 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001391193 2024-05-08T18:30:55.019 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.019 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.019 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:55.019 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.867073+0000", 2024-05-08T18:30:55.019 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8698999999999998e-05 2024-05-08T18:30:55.019 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:55.019 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:55.019 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:55.019 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.019 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.019 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:478 6.a e33/27 6:5127e642:gc::gc.21:head v 33'6, mlcod=33'4)", 2024-05-08T18:30:55.019 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.877617+0000", 2024-05-08T18:30:55.020 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 63.065243844000001, 2024-05-08T18:30:55.020 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0033938589999999999, 2024-05-08T18:30:55.020 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:55.020 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:55.020 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:55.020 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:55.020 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.020 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:55.020 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877617+0000", 2024-05-08T18:30:55.020 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:55.020 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.020 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.020 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:55.020 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877617+0000", 2024-05-08T18:30:55.020 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:55.021 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.021 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.021 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:55.021 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877619+0000", 2024-05-08T18:30:55.021 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.902e-06 2024-05-08T18:30:55.021 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.021 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.021 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:55.021 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877633+0000", 2024-05-08T18:30:55.021 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4143e-05 2024-05-08T18:30:55.021 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.021 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.021 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:55.021 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877667+0000", 2024-05-08T18:30:55.022 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3516999999999998e-05 2024-05-08T18:30:55.022 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.022 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.022 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:55.022 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877685+0000", 2024-05-08T18:30:55.022 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7931000000000002e-05 2024-05-08T18:30:55.022 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.022 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.022 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:55.022 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877842+0000", 2024-05-08T18:30:55.022 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015742800000000001 2024-05-08T18:30:55.022 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.022 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.022 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:55.023 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877890+0000", 2024-05-08T18:30:55.023 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7654000000000001e-05 2024-05-08T18:30:55.023 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.023 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.023 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:55.023 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.880908+0000", 2024-05-08T18:30:55.023 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0030181219999999998 2024-05-08T18:30:55.023 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.023 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.023 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:55.023 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.881011+0000", 2024-05-08T18:30:55.023 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000103162 2024-05-08T18:30:55.023 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:55.023 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:55.023 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:55.024 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.024 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.024 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:535 6.1f e33/27 6:fde4dd55:gc::gc.26:head v 33'2, mlcod=0'0)", 2024-05-08T18:30:55.024 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.909602+0000", 2024-05-08T18:30:55.024 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 63.033259399000002, 2024-05-08T18:30:55.024 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0023004039999999998, 2024-05-08T18:30:55.024 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:55.024 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:55.024 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:55.024 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:55.024 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.024 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:55.024 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.909602+0000", 2024-05-08T18:30:55.024 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:55.025 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.025 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.025 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:55.025 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.909602+0000", 2024-05-08T18:30:55.025 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:55.025 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.025 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.025 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:55.025 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.909604+0000", 2024-05-08T18:30:55.025 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8360000000000001e-06 2024-05-08T18:30:55.025 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.025 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.025 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:55.025 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.909615+0000", 2024-05-08T18:30:55.025 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1596999999999999e-05 2024-05-08T18:30:55.026 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.026 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.026 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:55.026 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.909643+0000", 2024-05-08T18:30:55.026 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7457000000000002e-05 2024-05-08T18:30:55.026 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.026 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.026 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:55.026 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.909662+0000", 2024-05-08T18:30:55.026 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9052999999999999e-05 2024-05-08T18:30:55.026 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.026 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.026 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:55.026 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.909758+0000", 2024-05-08T18:30:55.027 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6372000000000005e-05 2024-05-08T18:30:55.027 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.027 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.027 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:55.027 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.909780+0000", 2024-05-08T18:30:55.027 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1719999999999999e-05 2024-05-08T18:30:55.027 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.027 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.027 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:55.027 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.911830+0000", 2024-05-08T18:30:55.027 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002050072 2024-05-08T18:30:55.027 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.027 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.027 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:55.027 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.911902+0000", 2024-05-08T18:30:55.028 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.2297000000000003e-05 2024-05-08T18:30:55.028 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:55.028 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:55.028 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:55.028 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.028 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.028 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:541 6.1f e33/27 6:fde4dd55:gc::gc.26:head v 33'3, mlcod=33'1)", 2024-05-08T18:30:55.028 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.913684+0000", 2024-05-08T18:30:55.028 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 63.029177351000001, 2024-05-08T18:30:55.028 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0036425770000000001, 2024-05-08T18:30:55.028 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:55.028 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:55.028 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:55.028 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:55.029 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.029 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:55.029 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.913684+0000", 2024-05-08T18:30:55.029 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:55.029 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.029 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.029 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:55.029 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.913684+0000", 2024-05-08T18:30:55.029 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:55.029 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.029 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.029 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:55.029 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.913685+0000", 2024-05-08T18:30:55.029 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5859999999999999e-06 2024-05-08T18:30:55.029 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.030 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.030 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:55.030 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.913696+0000", 2024-05-08T18:30:55.030 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1080000000000001e-05 2024-05-08T18:30:55.030 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.030 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.030 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:55.030 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.913720+0000", 2024-05-08T18:30:55.030 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3614000000000001e-05 2024-05-08T18:30:55.030 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.030 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.030 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:55.030 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.913740+0000", 2024-05-08T18:30:55.030 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9836000000000001e-05 2024-05-08T18:30:55.030 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.031 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.031 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:55.031 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.913901+0000", 2024-05-08T18:30:55.031 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000161039 2024-05-08T18:30:55.031 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.031 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.031 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:55.031 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.913935+0000", 2024-05-08T18:30:55.031 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4353000000000001e-05 2024-05-08T18:30:55.031 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.031 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.031 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:55.031 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.917225+0000", 2024-05-08T18:30:55.031 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032897669999999999 2024-05-08T18:30:55.032 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.032 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.032 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:55.032 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.917326+0000", 2024-05-08T18:30:55.032 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000101302 2024-05-08T18:30:55.032 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:55.032 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:55.032 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:55.032 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.032 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.032 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:543 6.15 e33/27 6:ae95b544:::obj_delete_at_hint.0000000020:head v 33'5, mlcod=33'3)", 2024-05-08T18:30:55.032 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.916649+0000", 2024-05-08T18:30:55.032 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 63.026211797999999, 2024-05-08T18:30:55.032 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003362739, 2024-05-08T18:30:55.032 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:55.033 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:55.033 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:55.033 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:55.033 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.033 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:55.033 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.916649+0000", 2024-05-08T18:30:55.033 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:55.033 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.033 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.033 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:55.033 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.916649+0000", 2024-05-08T18:30:55.033 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:55.033 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.033 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.034 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:55.034 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.916651+0000", 2024-05-08T18:30:55.034 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7269999999999999e-06 2024-05-08T18:30:55.034 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.034 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.034 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:55.034 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.916663+0000", 2024-05-08T18:30:55.034 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2183e-05 2024-05-08T18:30:55.034 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.034 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.034 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:55.034 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.916691+0000", 2024-05-08T18:30:55.034 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7864e-05 2024-05-08T18:30:55.034 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.035 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.035 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:55.035 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.916710+0000", 2024-05-08T18:30:55.035 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.912e-05 2024-05-08T18:30:55.035 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.035 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.035 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:55.035 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.916851+0000", 2024-05-08T18:30:55.035 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000141163 2024-05-08T18:30:55.035 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.035 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.035 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:55.035 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.916909+0000", 2024-05-08T18:30:55.035 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.7686000000000003e-05 2024-05-08T18:30:55.035 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.036 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.036 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:55.036 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.919900+0000", 2024-05-08T18:30:55.036 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029909540000000001 2024-05-08T18:30:55.036 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.036 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.036 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:55.036 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.920012+0000", 2024-05-08T18:30:55.036 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000112042 2024-05-08T18:30:55.036 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:55.036 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:55.036 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:55.036 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.036 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.037 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:695 6.3 e33/27 6:c31f41d7:gc::gc.10:head v 33'12, mlcod=33'10)", 2024-05-08T18:30:55.037 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.017806+0000", 2024-05-08T18:30:55.037 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 62.925055514, 2024-05-08T18:30:55.037 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001718373, 2024-05-08T18:30:55.037 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:55.037 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:55.037 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:55.037 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:55.037 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.037 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:55.037 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.017806+0000", 2024-05-08T18:30:55.037 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:55.037 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.037 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.038 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:55.038 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.017806+0000", 2024-05-08T18:30:55.038 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:55.038 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.038 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.038 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:55.038 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.017807+0000", 2024-05-08T18:30:55.038 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8199999999999999e-06 2024-05-08T18:30:55.038 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.038 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.038 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:55.038 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.017818+0000", 2024-05-08T18:30:55.038 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0519999999999999e-05 2024-05-08T18:30:55.038 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.039 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.039 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:55.039 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.017846+0000", 2024-05-08T18:30:55.039 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7729000000000002e-05 2024-05-08T18:30:55.039 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.039 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.039 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:55.039 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.017859+0000", 2024-05-08T18:30:55.039 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3337e-05 2024-05-08T18:30:55.039 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.039 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.039 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:55.039 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.017990+0000", 2024-05-08T18:30:55.039 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013146499999999999 2024-05-08T18:30:55.039 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.040 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.040 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:55.040 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.018039+0000", 2024-05-08T18:30:55.040 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8816999999999997e-05 2024-05-08T18:30:55.040 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.040 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.040 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:55.040 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.019397+0000", 2024-05-08T18:30:55.040 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0013575359999999999 2024-05-08T18:30:55.040 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.040 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.040 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:55.040 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.019524+0000", 2024-05-08T18:30:55.040 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012714900000000001 2024-05-08T18:30:55.041 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:55.041 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:55.041 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:55.041 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:55.041 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:55.041 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:30:55.043 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-08T18:30:55.043 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:30:55.043+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:30:55.144 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:30:55.143+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:30:55.171 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:30:55.171 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:30:55.171 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 0 2024-05-08T18:30:55.171 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:30:55.185 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-08T18:30:55.244 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:30:55.243+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:30:55.302 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:30:55.302 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:30:55.302 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2024-05-08T18:30:55.302 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2024-05-08T18:30:55.303 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:30:55.316 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-08T18:30:55.345 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:30:55.343+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:30:55.443 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:30:55.443 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2024-05-08T18:30:55.443 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2024-05-08T18:30:55.443 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-05-08T18:30:55.443 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.443 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:24 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [write 262144~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:55.444 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.154193+0000", 2024-05-08T18:30:55.444 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 88.286227668999999, 2024-05-08T18:30:55.444 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0085494309999999997, 2024-05-08T18:30:55.444 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:55.444 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:55.444 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:55.444 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:55.444 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:55.445 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:55.445 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 24 2024-05-08T18:30:55.445 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.445 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:55.445 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.445 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:55.445 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154193+0000", 2024-05-08T18:30:55.445 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:55.445 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.445 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.445 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:55.445 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154193+0000", 2024-05-08T18:30:55.445 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:55.446 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.446 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.446 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:55.446 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154194+0000", 2024-05-08T18:30:55.446 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.44e-06 2024-05-08T18:30:55.446 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.446 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.446 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:55.446 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154394+0000", 2024-05-08T18:30:55.446 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00019972499999999999 2024-05-08T18:30:55.446 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.446 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.447 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:55.447 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154417+0000", 2024-05-08T18:30:55.447 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2713000000000001e-05 2024-05-08T18:30:55.447 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.447 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.447 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:55.447 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154437+0000", 2024-05-08T18:30:55.447 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0027e-05 2024-05-08T18:30:55.447 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.447 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.447 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:55.447 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.158438+0000", 2024-05-08T18:30:55.447 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0040011459999999997 2024-05-08T18:30:55.447 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.448 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.448 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:55.448 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.158567+0000", 2024-05-08T18:30:55.448 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012923899999999999 2024-05-08T18:30:55.448 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.448 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.448 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:55.448 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.158787+0000", 2024-05-08T18:30:55.448 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000219581 2024-05-08T18:30:55.448 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.448 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.448 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:55.449 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.162013+0000", 2024-05-08T18:30:55.449 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032261759999999999 2024-05-08T18:30:55.449 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.449 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.449 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:55.449 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.162568+0000", 2024-05-08T18:30:55.449 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00055576900000000001 2024-05-08T18:30:55.449 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.449 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.449 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:55.449 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.162644+0000", 2024-05-08T18:30:55.449 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5516e-05 2024-05-08T18:30:55.449 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.449 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.450 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:55.450 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.162742+0000", 2024-05-08T18:30:55.450 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8098999999999997e-05 2024-05-08T18:30:55.450 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:55.450 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:55.450 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:55.450 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.450 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.450 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:25 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:55.450 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.154495+0000", 2024-05-08T18:30:55.450 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 88.285925375000005, 2024-05-08T18:30:55.450 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010784396999999999, 2024-05-08T18:30:55.451 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:55.451 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:55.451 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:55.451 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:55.451 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:55.451 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:55.451 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 25 2024-05-08T18:30:55.451 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.451 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:55.451 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.451 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:55.451 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154495+0000", 2024-05-08T18:30:55.451 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:55.451 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.452 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.452 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:55.452 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154495+0000", 2024-05-08T18:30:55.452 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:55.452 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.452 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.452 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:55.452 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154496+0000", 2024-05-08T18:30:55.452 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.454e-06 2024-05-08T18:30:55.452 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.452 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.452 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:55.452 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154509+0000", 2024-05-08T18:30:55.453 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2496e-05 2024-05-08T18:30:55.453 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.453 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.453 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:55.453 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154531+0000", 2024-05-08T18:30:55.453 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1987000000000001e-05 2024-05-08T18:30:55.453 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.453 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.453 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:55.453 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154547+0000", 2024-05-08T18:30:55.453 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.577e-05 2024-05-08T18:30:55.453 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.453 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.454 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:55.454 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.160949+0000", 2024-05-08T18:30:55.454 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.006401917 2024-05-08T18:30:55.454 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.454 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.454 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:55.454 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.161102+0000", 2024-05-08T18:30:55.454 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000153826 2024-05-08T18:30:55.454 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.454 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.454 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:55.454 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.161332+0000", 2024-05-08T18:30:55.454 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022918099999999999 2024-05-08T18:30:55.454 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.455 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.455 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:55.455 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.163838+0000", 2024-05-08T18:30:55.455 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0025064079999999999 2024-05-08T18:30:55.455 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.455 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.455 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:55.455 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.165121+0000", 2024-05-08T18:30:55.455 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0012825200000000001 2024-05-08T18:30:55.455 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.455 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.455 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:55.455 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.165212+0000", 2024-05-08T18:30:55.455 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1121999999999999e-05 2024-05-08T18:30:55.456 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.456 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.456 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:55.456 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.165279+0000", 2024-05-08T18:30:55.456 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7716e-05 2024-05-08T18:30:55.456 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:55.456 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:55.456 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:55.456 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.456 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.456 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:41 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:55.456 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247174+0000", 2024-05-08T18:30:55.456 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 88.193246392999995, 2024-05-08T18:30:55.456 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010013393000000001, 2024-05-08T18:30:55.457 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:55.457 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:55.457 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:55.457 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:55.457 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:55.457 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:55.457 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 41 2024-05-08T18:30:55.457 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.457 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:55.457 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.457 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:55.457 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247174+0000", 2024-05-08T18:30:55.457 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:55.458 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.458 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.458 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:55.458 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247174+0000", 2024-05-08T18:30:55.458 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:55.458 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.458 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.458 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:55.458 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247175+0000", 2024-05-08T18:30:55.458 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.9999999999999995e-07 2024-05-08T18:30:55.458 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.458 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.459 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:55.459 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247277+0000", 2024-05-08T18:30:55.459 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010243600000000001 2024-05-08T18:30:55.459 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.459 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.459 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:55.459 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247291+0000", 2024-05-08T18:30:55.459 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4076999999999999e-05 2024-05-08T18:30:55.459 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.459 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.459 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:55.459 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247301+0000", 2024-05-08T18:30:55.459 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0010000000000001e-05 2024-05-08T18:30:55.460 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.460 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.460 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:55.460 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.249555+0000", 2024-05-08T18:30:55.460 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0022539050000000001 2024-05-08T18:30:55.460 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.460 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.460 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:55.460 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.249700+0000", 2024-05-08T18:30:55.460 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014484599999999999 2024-05-08T18:30:55.460 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.460 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.460 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:55.460 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.249929+0000", 2024-05-08T18:30:55.461 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022904499999999999 2024-05-08T18:30:55.461 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.461 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.461 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:55.461 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.253695+0000", 2024-05-08T18:30:55.461 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0037656640000000002 2024-05-08T18:30:55.461 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.461 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.461 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:55.461 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.256970+0000", 2024-05-08T18:30:55.461 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003274608 2024-05-08T18:30:55.461 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.461 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.462 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:55.462 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.257052+0000", 2024-05-08T18:30:55.462 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2223000000000002e-05 2024-05-08T18:30:55.462 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.462 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.462 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:55.462 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.257187+0000", 2024-05-08T18:30:55.462 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013557900000000001 2024-05-08T18:30:55.462 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:55.462 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:55.462 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:55.462 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.462 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.462 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:42 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:55.463 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247321+0000", 2024-05-08T18:30:55.463 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 88.193099074000003, 2024-05-08T18:30:55.463 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013168572, 2024-05-08T18:30:55.463 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:55.463 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:55.463 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:55.463 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:55.463 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:55.463 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:55.463 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 42 2024-05-08T18:30:55.463 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.463 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:55.463 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.464 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:55.464 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247321+0000", 2024-05-08T18:30:55.464 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:55.464 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.464 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.464 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:55.464 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247321+0000", 2024-05-08T18:30:55.464 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:55.464 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.464 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.464 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:55.464 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247323+0000", 2024-05-08T18:30:55.464 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.24e-06 2024-05-08T18:30:55.464 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.465 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.465 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:55.465 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247329+0000", 2024-05-08T18:30:55.465 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1530000000000002e-06 2024-05-08T18:30:55.465 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.465 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.465 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:55.465 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247339+0000", 2024-05-08T18:30:55.465 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0387000000000001e-05 2024-05-08T18:30:55.465 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.465 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.465 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:55.465 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247347+0000", 2024-05-08T18:30:55.465 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9829999999999996e-06 2024-05-08T18:30:55.466 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.466 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.466 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:55.466 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.251488+0000", 2024-05-08T18:30:55.466 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0041412849999999998 2024-05-08T18:30:55.466 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.466 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.466 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:55.466 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.251672+0000", 2024-05-08T18:30:55.466 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00018354499999999999 2024-05-08T18:30:55.466 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.466 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.466 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:55.467 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.251949+0000", 2024-05-08T18:30:55.467 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00027695399999999999 2024-05-08T18:30:55.467 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.467 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.467 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:55.467 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.253810+0000", 2024-05-08T18:30:55.467 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001860806 2024-05-08T18:30:55.467 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.467 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.467 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:55.467 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260244+0000", 2024-05-08T18:30:55.467 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0064347939999999998 2024-05-08T18:30:55.467 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.467 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.468 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:55.468 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260376+0000", 2024-05-08T18:30:55.468 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000131829 2024-05-08T18:30:55.468 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.468 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.468 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:55.468 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260490+0000", 2024-05-08T18:30:55.468 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000113596 2024-05-08T18:30:55.468 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:55.468 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:55.468 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:55.468 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.468 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.469 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:43 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:55.469 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247367+0000", 2024-05-08T18:30:55.469 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 88.193053160999995, 2024-05-08T18:30:55.469 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013449025999999999, 2024-05-08T18:30:55.469 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:55.469 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:55.469 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:55.469 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:55.469 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:55.469 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:55.469 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 43 2024-05-08T18:30:55.469 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.469 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:55.469 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.470 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:55.470 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247367+0000", 2024-05-08T18:30:55.470 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:55.470 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.470 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.470 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:55.470 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247367+0000", 2024-05-08T18:30:55.470 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:55.470 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.470 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.470 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:55.470 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247368+0000", 2024-05-08T18:30:55.470 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1999999999999999e-07 2024-05-08T18:30:55.470 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.471 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.471 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:55.471 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247374+0000", 2024-05-08T18:30:55.471 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.19e-06 2024-05-08T18:30:55.471 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.471 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.471 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:55.471 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247384+0000", 2024-05-08T18:30:55.471 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0173000000000001e-05 2024-05-08T18:30:55.471 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.471 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.471 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:55.471 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247392+0000", 2024-05-08T18:30:55.471 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1869999999999997e-06 2024-05-08T18:30:55.472 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.472 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.472 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:55.472 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.252515+0000", 2024-05-08T18:30:55.472 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0051221399999999999 2024-05-08T18:30:55.472 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.472 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.472 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:55.472 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.252641+0000", 2024-05-08T18:30:55.472 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012609200000000001 2024-05-08T18:30:55.472 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.472 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.472 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:55.472 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.252842+0000", 2024-05-08T18:30:55.473 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000201619 2024-05-08T18:30:55.473 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.473 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.473 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:55.473 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.256828+0000", 2024-05-08T18:30:55.473 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039853989999999997 2024-05-08T18:30:55.473 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.473 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.473 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:55.473 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260515+0000", 2024-05-08T18:30:55.473 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0036875419999999998 2024-05-08T18:30:55.473 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.473 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.474 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:55.474 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260718+0000", 2024-05-08T18:30:55.474 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020229499999999999 2024-05-08T18:30:55.474 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.474 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.474 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:55.474 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260816+0000", 2024-05-08T18:30:55.474 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8669e-05 2024-05-08T18:30:55.474 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:55.474 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:55.474 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:55.474 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.474 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.474 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:55.475 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247466+0000", 2024-05-08T18:30:55.475 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 88.192954575000002, 2024-05-08T18:30:55.475 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013491806, 2024-05-08T18:30:55.475 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:55.475 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:55.475 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:55.475 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:55.475 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:55.475 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:55.475 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 44 2024-05-08T18:30:55.475 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.475 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:55.475 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.476 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:55.476 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247466+0000", 2024-05-08T18:30:55.476 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:55.476 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.476 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.476 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:55.476 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247466+0000", 2024-05-08T18:30:55.476 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:55.476 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.476 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.476 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:55.476 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247467+0000", 2024-05-08T18:30:55.476 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.263e-06 2024-05-08T18:30:55.477 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.477 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.477 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:55.477 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247585+0000", 2024-05-08T18:30:55.477 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011756600000000001 2024-05-08T18:30:55.477 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.477 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.477 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:55.477 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247598+0000", 2024-05-08T18:30:55.477 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3766e-05 2024-05-08T18:30:55.477 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.477 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.477 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:55.477 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247609+0000", 2024-05-08T18:30:55.478 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0604e-05 2024-05-08T18:30:55.478 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.478 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.478 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:55.478 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.253890+0000", 2024-05-08T18:30:55.478 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0062810440000000004 2024-05-08T18:30:55.478 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.478 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.478 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:55.478 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.254068+0000", 2024-05-08T18:30:55.478 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017848199999999999 2024-05-08T18:30:55.478 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.478 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.479 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:55.479 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.254488+0000", 2024-05-08T18:30:55.479 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00041965399999999999 2024-05-08T18:30:55.479 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.479 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.479 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:55.479 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.256949+0000", 2024-05-08T18:30:55.479 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002461254 2024-05-08T18:30:55.479 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.479 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.479 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:55.479 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260832+0000", 2024-05-08T18:30:55.479 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0038830539999999999 2024-05-08T18:30:55.479 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.480 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.480 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:55.480 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260906+0000", 2024-05-08T18:30:55.480 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3455999999999996e-05 2024-05-08T18:30:55.480 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.480 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.480 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:55.480 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260958+0000", 2024-05-08T18:30:55.480 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1663000000000003e-05 2024-05-08T18:30:55.480 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:55.480 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:55.480 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:55.480 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.480 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.481 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:55.481 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247630+0000", 2024-05-08T18:30:55.481 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 88.192790169999995, 2024-05-08T18:30:55.481 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013478753, 2024-05-08T18:30:55.481 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:55.481 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:55.481 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:55.481 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:55.481 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:55.481 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:55.481 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 45 2024-05-08T18:30:55.481 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.481 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:55.481 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.482 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:55.482 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247630+0000", 2024-05-08T18:30:55.482 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:55.482 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.482 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.482 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:55.482 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247630+0000", 2024-05-08T18:30:55.482 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:55.482 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.482 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.482 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:55.482 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247631+0000", 2024-05-08T18:30:55.482 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7399999999999991e-07 2024-05-08T18:30:55.483 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.483 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.483 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:55.483 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247637+0000", 2024-05-08T18:30:55.483 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.93e-06 2024-05-08T18:30:55.483 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.483 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.483 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:55.483 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247647+0000", 2024-05-08T18:30:55.483 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7459999999999995e-06 2024-05-08T18:30:55.483 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.483 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.483 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:55.483 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247654+0000", 2024-05-08T18:30:55.484 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4039999999999998e-06 2024-05-08T18:30:55.484 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.484 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.484 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:55.484 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.255829+0000", 2024-05-08T18:30:55.484 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0081749059999999991 2024-05-08T18:30:55.484 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.484 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.484 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:55.484 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.255979+0000", 2024-05-08T18:30:55.484 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015027899999999999 2024-05-08T18:30:55.484 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.484 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.484 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:55.484 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.256185+0000", 2024-05-08T18:30:55.485 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020583900000000001 2024-05-08T18:30:55.485 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.485 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.485 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:55.485 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260097+0000", 2024-05-08T18:30:55.485 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039121929999999996 2024-05-08T18:30:55.485 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.485 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.485 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:55.485 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260973+0000", 2024-05-08T18:30:55.485 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00087591999999999998 2024-05-08T18:30:55.485 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.485 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.485 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:55.486 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261056+0000", 2024-05-08T18:30:55.486 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3104999999999998e-05 2024-05-08T18:30:55.486 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.486 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.486 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:55.486 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261109+0000", 2024-05-08T18:30:55.486 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2457000000000003e-05 2024-05-08T18:30:55.486 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:55.486 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:55.486 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:55.486 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.486 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.487 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:55.487 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247667+0000", 2024-05-08T18:30:55.487 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 88.192752889999994, 2024-05-08T18:30:55.487 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013569098999999999, 2024-05-08T18:30:55.487 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:55.487 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:55.487 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:55.487 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:55.487 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:55.487 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:55.487 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 46 2024-05-08T18:30:55.487 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.487 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:55.487 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.488 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:55.488 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247667+0000", 2024-05-08T18:30:55.488 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:55.488 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.488 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.488 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:55.488 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247667+0000", 2024-05-08T18:30:55.488 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:55.488 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.488 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.488 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:55.488 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247668+0000", 2024-05-08T18:30:55.488 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7999999999999995e-07 2024-05-08T18:30:55.488 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.489 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.489 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:55.489 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247674+0000", 2024-05-08T18:30:55.489 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4369999999999998e-06 2024-05-08T18:30:55.489 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.489 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.489 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:55.489 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247683+0000", 2024-05-08T18:30:55.489 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4360000000000008e-06 2024-05-08T18:30:55.489 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.489 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.489 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:55.489 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247690+0000", 2024-05-08T18:30:55.489 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.43e-06 2024-05-08T18:30:55.490 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.490 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.490 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:55.490 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.257358+0000", 2024-05-08T18:30:55.490 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0096676890000000001 2024-05-08T18:30:55.490 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.490 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.490 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:55.490 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.257626+0000", 2024-05-08T18:30:55.490 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00026819099999999998 2024-05-08T18:30:55.490 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.490 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.490 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:55.491 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.258041+0000", 2024-05-08T18:30:55.491 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00041438400000000001 2024-05-08T18:30:55.491 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.491 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.491 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:55.491 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260224+0000", 2024-05-08T18:30:55.491 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0021830700000000001 2024-05-08T18:30:55.491 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.491 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.491 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:55.491 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261127+0000", 2024-05-08T18:30:55.491 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00090292300000000003 2024-05-08T18:30:55.491 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.491 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.492 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:55.492 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261191+0000", 2024-05-08T18:30:55.492 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4342000000000002e-05 2024-05-08T18:30:55.492 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.492 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.492 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:55.492 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261237+0000", 2024-05-08T18:30:55.492 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.5516999999999998e-05 2024-05-08T18:30:55.492 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:55.492 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:55.492 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:55.492 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.492 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.492 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:55.493 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247703+0000", 2024-05-08T18:30:55.493 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 88.192717407000004, 2024-05-08T18:30:55.493 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015020204000000001, 2024-05-08T18:30:55.493 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:55.493 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:55.493 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:55.493 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:55.493 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:55.493 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:55.493 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 47 2024-05-08T18:30:55.493 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.493 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:55.493 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.493 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:55.494 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247703+0000", 2024-05-08T18:30:55.494 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:55.494 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.494 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.494 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:55.494 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247703+0000", 2024-05-08T18:30:55.494 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:55.494 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.494 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.494 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:55.494 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247704+0000", 2024-05-08T18:30:55.494 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8299999999999996e-07 2024-05-08T18:30:55.494 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.494 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.495 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:55.495 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247877+0000", 2024-05-08T18:30:55.495 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000172979 2024-05-08T18:30:55.495 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.495 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.495 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:55.495 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247894+0000", 2024-05-08T18:30:55.495 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6912999999999999e-05 2024-05-08T18:30:55.495 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.495 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.495 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:55.495 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247903+0000", 2024-05-08T18:30:55.495 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1770000000000004e-06 2024-05-08T18:30:55.495 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.495 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.496 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:55.496 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.258767+0000", 2024-05-08T18:30:55.496 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010864409 2024-05-08T18:30:55.496 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.496 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.496 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:55.496 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.258898+0000", 2024-05-08T18:30:55.496 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000131199 2024-05-08T18:30:55.496 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.496 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.496 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:55.496 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.259117+0000", 2024-05-08T18:30:55.496 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000218889 2024-05-08T18:30:55.496 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.496 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.497 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:55.497 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.262372+0000", 2024-05-08T18:30:55.497 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032545679999999998 2024-05-08T18:30:55.497 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.497 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.497 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:55.497 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.262432+0000", 2024-05-08T18:30:55.497 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9913e-05 2024-05-08T18:30:55.497 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.497 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.497 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:55.497 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.262585+0000", 2024-05-08T18:30:55.497 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015361800000000001 2024-05-08T18:30:55.497 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.498 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.498 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:55.498 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.262723+0000", 2024-05-08T18:30:55.498 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000137856 2024-05-08T18:30:55.498 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:55.498 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:55.498 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:55.498 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.498 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.498 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:55.498 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247927+0000", 2024-05-08T18:30:55.499 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 88.192493369000005, 2024-05-08T18:30:55.499 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018387718000000001, 2024-05-08T18:30:55.499 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:55.499 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:55.499 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:55.499 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:55.499 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:55.499 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:55.499 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 48 2024-05-08T18:30:55.499 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.499 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:55.499 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.499 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:55.499 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247927+0000", 2024-05-08T18:30:55.500 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:55.500 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.500 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.500 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:55.500 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247927+0000", 2024-05-08T18:30:55.500 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:55.500 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.500 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.500 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:55.500 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247928+0000", 2024-05-08T18:30:55.500 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8400000000000003e-07 2024-05-08T18:30:55.500 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.500 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.501 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:55.501 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247935+0000", 2024-05-08T18:30:55.501 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1230000000000002e-06 2024-05-08T18:30:55.501 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.501 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.501 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:55.501 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247945+0000", 2024-05-08T18:30:55.501 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0346000000000001e-05 2024-05-08T18:30:55.501 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.501 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.501 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:55.501 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247953+0000", 2024-05-08T18:30:55.501 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8040000000000002e-06 2024-05-08T18:30:55.501 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.502 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.502 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:55.502 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261292+0000", 2024-05-08T18:30:55.502 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013339337 2024-05-08T18:30:55.502 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.502 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.502 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:55.502 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261424+0000", 2024-05-08T18:30:55.502 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013201900000000001 2024-05-08T18:30:55.502 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.502 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.502 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:55.502 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261628+0000", 2024-05-08T18:30:55.503 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020327499999999999 2024-05-08T18:30:55.503 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.503 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.503 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:55.503 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.263849+0000", 2024-05-08T18:30:55.503 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0022209759999999999 2024-05-08T18:30:55.503 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.503 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.503 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:55.503 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266167+0000", 2024-05-08T18:30:55.503 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002317979 2024-05-08T18:30:55.503 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.503 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.504 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:55.504 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266249+0000", 2024-05-08T18:30:55.504 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1996000000000006e-05 2024-05-08T18:30:55.504 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.504 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.504 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:55.504 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266315+0000", 2024-05-08T18:30:55.504 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5979e-05 2024-05-08T18:30:55.504 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:55.504 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:55.504 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:55.504 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.504 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.504 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:55.505 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247966+0000", 2024-05-08T18:30:55.505 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 88.192454436000006, 2024-05-08T18:30:55.505 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0194153, 2024-05-08T18:30:55.505 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:55.505 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:55.505 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:55.505 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:55.505 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:55.505 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:55.505 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 49 2024-05-08T18:30:55.505 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.505 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:55.506 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.506 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:55.506 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247966+0000", 2024-05-08T18:30:55.506 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:55.506 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.506 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.506 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:55.506 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247966+0000", 2024-05-08T18:30:55.506 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:55.506 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.506 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.506 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:55.506 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247967+0000", 2024-05-08T18:30:55.506 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0299999999999998e-07 2024-05-08T18:30:55.507 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.507 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.507 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:55.507 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247972+0000", 2024-05-08T18:30:55.507 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3600000000000004e-06 2024-05-08T18:30:55.507 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.507 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.507 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:55.507 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247981+0000", 2024-05-08T18:30:55.507 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.234e-06 2024-05-08T18:30:55.507 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.507 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.507 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:55.508 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247989+0000", 2024-05-08T18:30:55.508 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5159999999999997e-06 2024-05-08T18:30:55.508 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.508 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.508 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:55.508 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.262816+0000", 2024-05-08T18:30:55.508 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.014827399999999999 2024-05-08T18:30:55.508 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.508 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.508 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:55.508 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.262948+0000", 2024-05-08T18:30:55.508 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013166799999999999 2024-05-08T18:30:55.508 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.508 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.509 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:55.509 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.263153+0000", 2024-05-08T18:30:55.509 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000205272 2024-05-08T18:30:55.509 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.509 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.509 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:55.509 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266144+0000", 2024-05-08T18:30:55.509 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029912300000000001 2024-05-08T18:30:55.509 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.509 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.509 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:55.509 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.267226+0000", 2024-05-08T18:30:55.509 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010820580000000001 2024-05-08T18:30:55.510 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.510 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.510 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:55.510 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.267315+0000", 2024-05-08T18:30:55.510 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8793000000000002e-05 2024-05-08T18:30:55.510 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.510 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.510 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:55.510 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.267381+0000", 2024-05-08T18:30:55.510 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6066000000000001e-05 2024-05-08T18:30:55.510 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:55.510 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:55.510 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:55.511 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.511 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.511 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:55.511 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.248003+0000", 2024-05-08T18:30:55.511 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 88.192417136000003, 2024-05-08T18:30:55.511 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.020859638999999999, 2024-05-08T18:30:55.511 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:55.511 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:55.511 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:55.511 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:55.511 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:55.511 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:55.511 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 50 2024-05-08T18:30:55.511 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.512 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:55.512 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.512 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:55.512 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248003+0000", 2024-05-08T18:30:55.512 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:55.512 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.512 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.512 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:55.512 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248003+0000", 2024-05-08T18:30:55.512 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:55.512 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.512 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.512 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:55.512 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248004+0000", 2024-05-08T18:30:55.513 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5300000000000003e-07 2024-05-08T18:30:55.513 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.513 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.513 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:55.513 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248139+0000", 2024-05-08T18:30:55.513 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000135193 2024-05-08T18:30:55.513 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.513 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.513 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:55.513 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248151+0000", 2024-05-08T18:30:55.513 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.19e-05 2024-05-08T18:30:55.513 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.513 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.513 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:55.514 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248161+0000", 2024-05-08T18:30:55.514 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4599999999999992e-06 2024-05-08T18:30:55.514 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.514 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.514 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:55.514 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.263961+0000", 2024-05-08T18:30:55.514 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015800844000000001 2024-05-08T18:30:55.514 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.514 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.514 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:55.514 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.264091+0000", 2024-05-08T18:30:55.514 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012952300000000001 2024-05-08T18:30:55.514 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.515 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.515 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:55.515 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.264306+0000", 2024-05-08T18:30:55.515 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000215541 2024-05-08T18:30:55.515 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.515 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.515 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:55.515 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.267205+0000", 2024-05-08T18:30:55.515 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0028989910000000001 2024-05-08T18:30:55.515 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.515 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.515 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:55.515 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.268631+0000", 2024-05-08T18:30:55.516 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0014257320000000001 2024-05-08T18:30:55.516 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.516 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.516 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:55.516 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.268781+0000", 2024-05-08T18:30:55.516 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000149939 2024-05-08T18:30:55.516 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.516 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.516 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:55.516 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.268863+0000", 2024-05-08T18:30:55.516 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1762999999999996e-05 2024-05-08T18:30:55.516 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:55.516 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:55.516 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:55.517 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.517 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.517 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:55.517 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.248201+0000", 2024-05-08T18:30:55.517 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 88.192219381000001, 2024-05-08T18:30:55.517 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.022909783, 2024-05-08T18:30:55.517 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:55.517 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:55.517 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:55.517 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:55.517 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:55.517 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:55.518 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 51 2024-05-08T18:30:55.518 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.518 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:55.518 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.518 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:55.518 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248201+0000", 2024-05-08T18:30:55.518 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:55.518 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.518 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.518 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:55.518 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248201+0000", 2024-05-08T18:30:55.518 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:55.518 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.519 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.519 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:55.519 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248202+0000", 2024-05-08T18:30:55.519 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2999999999999999e-07 2024-05-08T18:30:55.519 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.519 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.519 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:55.519 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248209+0000", 2024-05-08T18:30:55.519 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5769999999999996e-06 2024-05-08T18:30:55.519 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.519 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.519 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:55.519 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248221+0000", 2024-05-08T18:30:55.519 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1165999999999999e-05 2024-05-08T18:30:55.520 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.520 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.520 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:55.520 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248229+0000", 2024-05-08T18:30:55.520 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1529999999999997e-06 2024-05-08T18:30:55.520 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.520 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.520 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:55.520 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.265146+0000", 2024-05-08T18:30:55.520 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016917492999999999 2024-05-08T18:30:55.520 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.520 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.520 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:55.521 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.265282+0000", 2024-05-08T18:30:55.521 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013597199999999999 2024-05-08T18:30:55.521 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.521 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.521 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:55.521 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.265488+0000", 2024-05-08T18:30:55.521 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000206212 2024-05-08T18:30:55.521 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.521 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.521 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:55.521 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.268442+0000", 2024-05-08T18:30:55.521 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002953841 2024-05-08T18:30:55.521 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.521 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.522 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:55.522 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.270951+0000", 2024-05-08T18:30:55.522 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0025085670000000002 2024-05-08T18:30:55.522 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.522 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.522 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:55.522 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.271042+0000", 2024-05-08T18:30:55.522 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1485999999999998e-05 2024-05-08T18:30:55.522 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.522 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.522 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:55.522 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.271111+0000", 2024-05-08T18:30:55.522 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8386000000000006e-05 2024-05-08T18:30:55.523 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:55.523 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:55.523 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:55.523 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.523 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.523 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:55.523 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.248244+0000", 2024-05-08T18:30:55.523 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 88.192176825000004, 2024-05-08T18:30:55.523 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.023010806000000002, 2024-05-08T18:30:55.523 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:55.523 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:55.523 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:55.523 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:55.524 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:55.524 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:55.524 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 52 2024-05-08T18:30:55.524 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.524 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:55.524 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.524 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:55.524 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248244+0000", 2024-05-08T18:30:55.524 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:55.524 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.524 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.524 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:55.524 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248244+0000", 2024-05-08T18:30:55.524 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:55.525 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.525 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.525 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:55.525 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248244+0000", 2024-05-08T18:30:55.525 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0999999999999998e-07 2024-05-08T18:30:55.525 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.525 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.525 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:55.525 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248251+0000", 2024-05-08T18:30:55.525 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9639999999999997e-06 2024-05-08T18:30:55.525 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.525 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.525 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:55.526 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248266+0000", 2024-05-08T18:30:55.526 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4996e-05 2024-05-08T18:30:55.526 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.526 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.526 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:55.526 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248274+0000", 2024-05-08T18:30:55.526 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8299999999999996e-06 2024-05-08T18:30:55.526 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.526 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.526 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:55.526 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266367+0000", 2024-05-08T18:30:55.526 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018092607 2024-05-08T18:30:55.526 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.527 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.527 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:55.527 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266532+0000", 2024-05-08T18:30:55.527 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016569600000000001 2024-05-08T18:30:55.527 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.527 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.527 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:55.527 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266729+0000", 2024-05-08T18:30:55.527 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00019630099999999999 2024-05-08T18:30:55.527 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.527 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.527 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:55.527 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.268574+0000", 2024-05-08T18:30:55.527 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0018452329999999999 2024-05-08T18:30:55.528 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.528 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.528 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:55.528 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.271128+0000", 2024-05-08T18:30:55.528 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00255369 2024-05-08T18:30:55.528 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.528 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.528 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:55.528 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.271199+0000", 2024-05-08T18:30:55.528 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1712999999999996e-05 2024-05-08T18:30:55.528 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.528 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.528 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:55.529 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.271254+0000", 2024-05-08T18:30:55.529 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5065999999999998e-05 2024-05-08T18:30:55.529 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:55.529 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:55.529 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:55.529 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.529 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.529 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:55.529 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.486052+0000", 2024-05-08T18:30:55.529 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 87.954368380999995, 2024-05-08T18:30:55.529 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0098898389999999992, 2024-05-08T18:30:55.529 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:55.529 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:55.529 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:55.530 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:55.530 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:55.530 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:55.530 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 72 2024-05-08T18:30:55.530 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.530 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:55.530 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.530 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:55.530 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486052+0000", 2024-05-08T18:30:55.530 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:55.530 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.530 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.530 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:55.531 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486052+0000", 2024-05-08T18:30:55.531 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:55.531 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.531 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.531 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:55.531 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486053+0000", 2024-05-08T18:30:55.531 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1200000000000001e-07 2024-05-08T18:30:55.531 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.531 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.531 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:55.531 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486188+0000", 2024-05-08T18:30:55.531 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013526200000000001 2024-05-08T18:30:55.531 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.532 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.532 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:55.532 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486205+0000", 2024-05-08T18:30:55.532 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6742e-05 2024-05-08T18:30:55.532 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.532 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.532 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:55.532 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486215+0000", 2024-05-08T18:30:55.532 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8290000000000003e-06 2024-05-08T18:30:55.532 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.532 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.532 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:55.532 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.491930+0000", 2024-05-08T18:30:55.533 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0057153660000000004 2024-05-08T18:30:55.533 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.533 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.533 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:55.533 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.491995+0000", 2024-05-08T18:30:55.533 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5289000000000005e-05 2024-05-08T18:30:55.533 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.533 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.533 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:55.533 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.492096+0000", 2024-05-08T18:30:55.533 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010101400000000001 2024-05-08T18:30:55.533 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.533 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.533 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:55.534 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.494152+0000", 2024-05-08T18:30:55.534 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0020560740000000002 2024-05-08T18:30:55.534 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.534 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.534 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:55.534 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.495860+0000", 2024-05-08T18:30:55.534 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0017076159999999999 2024-05-08T18:30:55.534 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.534 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.534 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:55.534 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.495903+0000", 2024-05-08T18:30:55.534 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3009000000000001e-05 2024-05-08T18:30:55.534 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.535 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.535 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:55.535 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.495942+0000", 2024-05-08T18:30:55.535 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8726000000000002e-05 2024-05-08T18:30:55.535 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:55.535 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:55.535 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:55.535 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.535 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.535 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:55.535 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.486234+0000", 2024-05-08T18:30:55.535 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 87.954186312999994, 2024-05-08T18:30:55.535 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0099742340000000002, 2024-05-08T18:30:55.536 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:55.536 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:55.536 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:55.536 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:55.536 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:55.536 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:55.536 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 73 2024-05-08T18:30:55.536 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.536 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:55.536 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.536 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:55.536 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486234+0000", 2024-05-08T18:30:55.536 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:55.537 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.537 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.537 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:55.537 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486234+0000", 2024-05-08T18:30:55.537 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:55.537 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.537 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.537 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:55.537 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486235+0000", 2024-05-08T18:30:55.537 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.108e-06 2024-05-08T18:30:55.537 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.537 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.537 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:55.537 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486241+0000", 2024-05-08T18:30:55.538 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4e-06 2024-05-08T18:30:55.538 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.538 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.538 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:55.538 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486251+0000", 2024-05-08T18:30:55.538 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0209e-05 2024-05-08T18:30:55.538 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.538 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.538 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:55.538 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486260+0000", 2024-05-08T18:30:55.538 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2709999999999998e-06 2024-05-08T18:30:55.538 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.539 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.539 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:55.539 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.493294+0000", 2024-05-08T18:30:55.539 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0070341070000000004 2024-05-08T18:30:55.539 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.539 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.539 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:55.539 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.493370+0000", 2024-05-08T18:30:55.539 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5846999999999994e-05 2024-05-08T18:30:55.539 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.539 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.539 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:55.539 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.493479+0000", 2024-05-08T18:30:55.540 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010905500000000001 2024-05-08T18:30:55.540 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.540 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.540 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:55.540 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.495950+0000", 2024-05-08T18:30:55.540 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0024709749999999998 2024-05-08T18:30:55.540 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.540 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.540 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:55.540 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496023+0000", 2024-05-08T18:30:55.540 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3071999999999994e-05 2024-05-08T18:30:55.540 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.541 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.541 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:55.541 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496091+0000", 2024-05-08T18:30:55.541 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7646999999999998e-05 2024-05-08T18:30:55.541 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.541 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.541 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:55.541 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496208+0000", 2024-05-08T18:30:55.541 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000117543 2024-05-08T18:30:55.541 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:55.541 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:55.541 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:55.542 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.542 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.542 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:55.542 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.486276+0000", 2024-05-08T18:30:55.542 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 87.954143987999998, 2024-05-08T18:30:55.542 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010822577, 2024-05-08T18:30:55.542 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:55.542 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:55.542 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:55.542 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:55.542 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:55.542 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:55.542 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 74 2024-05-08T18:30:55.543 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.543 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:55.543 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.543 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:55.543 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486276+0000", 2024-05-08T18:30:55.543 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:55.543 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.543 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.543 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:55.543 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486276+0000", 2024-05-08T18:30:55.543 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:55.543 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.543 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.544 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:55.544 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486277+0000", 2024-05-08T18:30:55.544 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1699999999999997e-07 2024-05-08T18:30:55.544 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.544 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.544 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:55.544 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486282+0000", 2024-05-08T18:30:55.544 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0429999999999998e-06 2024-05-08T18:30:55.544 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.544 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.544 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:55.544 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486294+0000", 2024-05-08T18:30:55.544 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1717e-05 2024-05-08T18:30:55.545 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.545 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.545 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:55.545 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486303+0000", 2024-05-08T18:30:55.545 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.3999999999999998e-06 2024-05-08T18:30:55.545 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.545 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.545 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:55.545 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.494424+0000", 2024-05-08T18:30:55.545 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0081205960000000008 2024-05-08T18:30:55.545 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.545 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.545 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:55.545 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.494539+0000", 2024-05-08T18:30:55.546 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000115661 2024-05-08T18:30:55.546 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.546 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.546 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:55.546 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.494704+0000", 2024-05-08T18:30:55.546 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016422999999999999 2024-05-08T18:30:55.546 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.546 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.546 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:55.546 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496800+0000", 2024-05-08T18:30:55.546 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002096508 2024-05-08T18:30:55.546 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.546 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.547 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:55.547 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496889+0000", 2024-05-08T18:30:55.547 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8349000000000004e-05 2024-05-08T18:30:55.547 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.547 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.547 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:55.547 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496983+0000", 2024-05-08T18:30:55.547 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4882000000000004e-05 2024-05-08T18:30:55.547 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.547 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.547 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:55.547 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.497099+0000", 2024-05-08T18:30:55.547 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000115474 2024-05-08T18:30:55.547 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:55.548 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:55.548 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:55.548 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.548 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.548 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:55.548 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.486324+0000", 2024-05-08T18:30:55.548 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 87.954095968000004, 2024-05-08T18:30:55.548 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010949207000000001, 2024-05-08T18:30:55.548 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:55.548 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:55.548 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:55.548 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:55.548 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:55.548 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:55.549 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 75 2024-05-08T18:30:55.549 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.549 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:55.549 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.549 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:55.549 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486324+0000", 2024-05-08T18:30:55.549 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:55.549 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.549 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.549 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:55.549 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486324+0000", 2024-05-08T18:30:55.549 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:55.549 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.550 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.550 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:55.550 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486325+0000", 2024-05-08T18:30:55.550 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6200000000000006e-07 2024-05-08T18:30:55.550 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.550 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.550 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:55.550 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486439+0000", 2024-05-08T18:30:55.550 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000113391 2024-05-08T18:30:55.550 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.550 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.550 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:55.550 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486455+0000", 2024-05-08T18:30:55.551 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5823000000000001e-05 2024-05-08T18:30:55.551 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.551 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.551 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:55.551 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486465+0000", 2024-05-08T18:30:55.551 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0879999999999999e-05 2024-05-08T18:30:55.551 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.551 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.551 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:55.551 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.495149+0000", 2024-05-08T18:30:55.551 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0086833589999999999 2024-05-08T18:30:55.551 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.551 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.551 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:55.552 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.495213+0000", 2024-05-08T18:30:55.552 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4176000000000004e-05 2024-05-08T18:30:55.552 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.552 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.552 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:55.552 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.495350+0000", 2024-05-08T18:30:55.552 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013709099999999999 2024-05-08T18:30:55.552 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.552 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.552 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:55.552 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496809+0000", 2024-05-08T18:30:55.552 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001458953 2024-05-08T18:30:55.552 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.553 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.553 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:55.553 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.497199+0000", 2024-05-08T18:30:55.553 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00039045200000000001 2024-05-08T18:30:55.553 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.553 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.553 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:55.553 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.497241+0000", 2024-05-08T18:30:55.553 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1378999999999998e-05 2024-05-08T18:30:55.553 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.553 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.553 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:55.553 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.497274+0000", 2024-05-08T18:30:55.553 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2740999999999997e-05 2024-05-08T18:30:55.554 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:55.554 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:55.554 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:55.554 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.554 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.554 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:55.554 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.486483+0000", 2024-05-08T18:30:55.554 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 87.953937792999994, 2024-05-08T18:30:55.554 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011783448, 2024-05-08T18:30:55.554 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:55.554 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:55.554 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:55.554 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:55.555 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:55.555 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:55.555 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 76 2024-05-08T18:30:55.555 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.555 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:55.555 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.555 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:55.555 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486483+0000", 2024-05-08T18:30:55.555 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:55.555 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.555 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.555 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:55.555 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486483+0000", 2024-05-08T18:30:55.556 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:55.556 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.556 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.556 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:55.556 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486483+0000", 2024-05-08T18:30:55.556 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6599999999999995e-07 2024-05-08T18:30:55.556 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.556 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.556 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:55.556 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486491+0000", 2024-05-08T18:30:55.556 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.2520000000000002e-06 2024-05-08T18:30:55.556 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.556 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.556 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:55.557 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486500+0000", 2024-05-08T18:30:55.557 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4420000000000004e-06 2024-05-08T18:30:55.557 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.557 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.557 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:55.557 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486507+0000", 2024-05-08T18:30:55.557 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3549999999999999e-06 2024-05-08T18:30:55.557 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.557 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.557 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:55.557 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496319+0000", 2024-05-08T18:30:55.557 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0098120529999999994 2024-05-08T18:30:55.557 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.558 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.558 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:55.558 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496391+0000", 2024-05-08T18:30:55.558 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1433000000000005e-05 2024-05-08T18:30:55.558 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.558 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.558 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:55.558 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496508+0000", 2024-05-08T18:30:55.558 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000116778 2024-05-08T18:30:55.558 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.558 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.558 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:55.558 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.497284+0000", 2024-05-08T18:30:55.558 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00077609100000000002 2024-05-08T18:30:55.559 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.559 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.559 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:55.559 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.498204+0000", 2024-05-08T18:30:55.559 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00092027299999999999 2024-05-08T18:30:55.559 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.559 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.559 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:55.559 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.498240+0000", 2024-05-08T18:30:55.559 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5979999999999998e-05 2024-05-08T18:30:55.559 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.559 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.559 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:55.559 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.498266+0000", 2024-05-08T18:30:55.560 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6024999999999999e-05 2024-05-08T18:30:55.560 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:55.560 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:55.560 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:55.560 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.560 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.560 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:94 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:55.560 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.842580+0000", 2024-05-08T18:30:55.560 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 87.597840492000003, 2024-05-08T18:30:55.560 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0085315870000000002, 2024-05-08T18:30:55.560 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:55.560 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:55.560 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:55.560 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:55.561 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:55.561 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:55.561 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 94 2024-05-08T18:30:55.561 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.561 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:55.561 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.561 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:55.561 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.842580+0000", 2024-05-08T18:30:55.561 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:55.561 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.561 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.561 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:55.561 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.842580+0000", 2024-05-08T18:30:55.562 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:55.562 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.562 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.562 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:55.562 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.842581+0000", 2024-05-08T18:30:55.562 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.11e-06 2024-05-08T18:30:55.562 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.562 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.562 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:55.562 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.842587+0000", 2024-05-08T18:30:55.562 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2899999999999999e-06 2024-05-08T18:30:55.562 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.562 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.563 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:55.563 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.842597+0000", 2024-05-08T18:30:55.563 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.007e-05 2024-05-08T18:30:55.563 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.563 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.563 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:55.563 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.842605+0000", 2024-05-08T18:30:55.563 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1270000000000003e-06 2024-05-08T18:30:55.563 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.563 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.563 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:55.563 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.848358+0000", 2024-05-08T18:30:55.563 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0057525140000000002 2024-05-08T18:30:55.564 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.564 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.564 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:55.564 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.848481+0000", 2024-05-08T18:30:55.564 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000123239 2024-05-08T18:30:55.564 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.564 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.564 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:55.564 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.848695+0000", 2024-05-08T18:30:55.564 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000213387 2024-05-08T18:30:55.564 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.564 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.564 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:55.564 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.849781+0000", 2024-05-08T18:30:55.565 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010868 2024-05-08T18:30:55.565 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.565 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.565 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:55.565 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.850990+0000", 2024-05-08T18:30:55.565 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0012084769999999999 2024-05-08T18:30:55.565 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.565 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.565 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:55.565 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.851059+0000", 2024-05-08T18:30:55.565 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9130999999999999e-05 2024-05-08T18:30:55.565 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:55.565 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:55.566 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:55.566 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.851111+0000", 2024-05-08T18:30:55.566 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2441999999999997e-05 2024-05-08T18:30:55.566 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:55.566 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:55.566 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:55.566 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:55.566 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:55.566 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:30:55.567 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-08T18:30:55.568 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:30:55.567+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:30:55.569 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-08T18:30:55.669 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:30:55.667+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:30:55.690 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:30:55.690 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:30:55.690 INFO:teuthology.orchestra.run.smithi097.stdout: "num_ops": 0 2024-05-08T18:30:55.691 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:30:55.705 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-08T18:30:55.713 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2024-05-08T18:30:55.713 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:30:55.730 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2024-05-08T18:30:55.730 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:30:55.746 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2024-05-08T18:30:55.746 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:30:55.763 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2024-05-08T18:30:55.763 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:30:55.769 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:30:55.767+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:30:55.783 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2024-05-08T18:30:55.784 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:30:55.804 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2024-05-08T18:30:55.804 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:30:55.822 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:55.822 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:55.825 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2024-05-08T18:30:55.825 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:30:55.835 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-08T18:30:55.847 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2024-05-08T18:30:55.847 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:30:55.871 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:30:55.867+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:30:55.961 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:55.961 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:55.972 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:30:55.971+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:30:55.974 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-08T18:30:56.073 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:30:56.071+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:30:56.088 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:56.089 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:56.103 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-08T18:30:56.174 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:30:56.171+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:30:56.219 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:56.219 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:56.233 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-08T18:30:56.282 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:30:56.283+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:30:56.356 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:56.357 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:56.370 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-08T18:30:56.411 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:30:56.411+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:30:56.475 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:30:56.475+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:30:56.535 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:56.535 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:56.548 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-08T18:30:56.591 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:30:56.591+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:30:56.620 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-08T18:30:56.678 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:30:56.679+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:30:56.707 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:56.707 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:56.721 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-08T18:30:56.779 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:30:56.779+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:30:56.840 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:56.840 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:56.853 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-08T18:30:56.895 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:30:56.895+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:30:56.981 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:30:56.979+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:30:57.007 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:57.007 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:57.021 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-08T18:30:57.082 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:30:57.079+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:30:57.132 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:57.132 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:57.145 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-08T18:30:57.183 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:30:57.179+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:30:57.284 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:30:57.283+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:30:57.307 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:57.307 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:57.322 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-08T18:30:57.386 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:30:57.383+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:30:57.455 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:57.455 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:57.469 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-08T18:30:57.487 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:30:57.487+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:30:57.588 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:30:57.587+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:30:57.632 INFO:teuthology.orchestra.run.smithi097.stderr:nodeep-scrub is unset 2024-05-08T18:30:57.638 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:57.638 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:57.653 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-08T18:30:57.698 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:30:57.699+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:30:57.776 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:57.776 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:57.789 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:30:57.787+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:30:57.790 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-08T18:30:57.865 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-08T18:30:57.891 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:30:57.887+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:30:57.916 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:57.916 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:57.930 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-08T18:30:57.991 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:30:57.991+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:30:58.009 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2024-05-08T18:30:58.010 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:30:58.030 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2024-05-08T18:30:58.030 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:30:58.046 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2024-05-08T18:30:58.046 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:30:58.062 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2024-05-08T18:30:58.063 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:30:58.083 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2024-05-08T18:30:58.084 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:30:58.092 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:30:58.091+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:30:58.094 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:30:58.095 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:30:58.104 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2024-05-08T18:30:58.104 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:30:58.109 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-08T18:30:58.122 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2024-05-08T18:30:58.123 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:30:58.141 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2024-05-08T18:30:58.141 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:30:58.193 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:30:58.191+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:30:58.234 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:30:58.234 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2024-05-08T18:30:58.235 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2024-05-08T18:30:58.235 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-05-08T18:30:58.235 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.235 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4479.0:37 5.f 5:f43b6ece:::zone_names.default:head [create,call version.set in=10b,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-05-08T18:30:58.235 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:44.627414+0000", 2024-05-08T18:30:58.235 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 73.604959543999996, 2024-05-08T18:30:58.236 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029966429999999998, 2024-05-08T18:30:58.236 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:58.236 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:58.236 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:58.236 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:58.237 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4479", 2024-05-08T18:30:58.237 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3577501689", 2024-05-08T18:30:58.237 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 37 2024-05-08T18:30:58.237 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.237 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:58.237 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.237 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:58.237 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.627414+0000", 2024-05-08T18:30:58.238 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:58.238 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.238 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.238 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:58.238 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.627414+0000", 2024-05-08T18:30:58.238 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:58.238 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.238 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.239 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:58.239 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.627416+0000", 2024-05-08T18:30:58.239 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9580000000000001e-06 2024-05-08T18:30:58.239 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.239 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.239 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:58.239 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.627427+0000", 2024-05-08T18:30:58.239 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1657e-05 2024-05-08T18:30:58.239 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.240 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.240 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:58.240 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.627454+0000", 2024-05-08T18:30:58.240 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6619e-05 2024-05-08T18:30:58.240 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.240 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.241 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:58.241 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.627474+0000", 2024-05-08T18:30:58.241 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9612000000000001e-05 2024-05-08T18:30:58.241 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.241 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.241 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:58.241 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.627647+0000", 2024-05-08T18:30:58.241 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017374999999999999 2024-05-08T18:30:58.242 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.242 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.242 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:58.242 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.627861+0000", 2024-05-08T18:30:58.242 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000213358 2024-05-08T18:30:58.242 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.242 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.242 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:58.243 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.628153+0000", 2024-05-08T18:30:58.243 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029198899999999999 2024-05-08T18:30:58.243 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.243 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.243 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:58.243 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.629544+0000", 2024-05-08T18:30:58.243 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0013916390000000001 2024-05-08T18:30:58.243 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.243 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.243 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:58.244 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.630221+0000", 2024-05-08T18:30:58.244 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00067613500000000002 2024-05-08T18:30:58.244 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.244 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.244 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:58.244 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.630321+0000", 2024-05-08T18:30:58.245 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000100126 2024-05-08T18:30:58.245 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.245 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.245 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:58.245 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.630411+0000", 2024-05-08T18:30:58.245 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.9800000000000001e-05 2024-05-08T18:30:58.246 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:58.246 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:58.246 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:58.246 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.246 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.246 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4479.0:41 5.f 5:f4c53578:::zonegroups_names.default:head [create,call version.set in=10b,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-05-08T18:30:58.246 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:44.637466+0000", 2024-05-08T18:30:58.246 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 73.594907585000001, 2024-05-08T18:30:58.246 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0030003949999999999, 2024-05-08T18:30:58.246 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:58.247 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:58.247 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:58.247 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:58.247 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4479", 2024-05-08T18:30:58.247 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3577501689", 2024-05-08T18:30:58.247 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 41 2024-05-08T18:30:58.247 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.248 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:58.248 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.248 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:58.248 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.637466+0000", 2024-05-08T18:30:58.248 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:58.248 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.248 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.249 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:58.249 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.637466+0000", 2024-05-08T18:30:58.249 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:58.249 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.249 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.250 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:58.250 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.637468+0000", 2024-05-08T18:30:58.250 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2800000000000002e-06 2024-05-08T18:30:58.250 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.250 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.251 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:58.251 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.637479+0000", 2024-05-08T18:30:58.251 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0674e-05 2024-05-08T18:30:58.251 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.251 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.251 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:58.251 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.637508+0000", 2024-05-08T18:30:58.251 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8921999999999999e-05 2024-05-08T18:30:58.251 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.251 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.251 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:58.252 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.637522+0000", 2024-05-08T18:30:58.252 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3923e-05 2024-05-08T18:30:58.252 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.252 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.252 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:58.252 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.637647+0000", 2024-05-08T18:30:58.252 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000124905 2024-05-08T18:30:58.252 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.253 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.253 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:58.253 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.637852+0000", 2024-05-08T18:30:58.253 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000205081 2024-05-08T18:30:58.253 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.253 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.253 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:58.253 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.638101+0000", 2024-05-08T18:30:58.253 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000248953 2024-05-08T18:30:58.253 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.254 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.254 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:58.254 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.639345+0000", 2024-05-08T18:30:58.254 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001244754 2024-05-08T18:30:58.254 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.255 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.255 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:58.255 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.640197+0000", 2024-05-08T18:30:58.255 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000851614 2024-05-08T18:30:58.255 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.256 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.256 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:58.256 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.640353+0000", 2024-05-08T18:30:58.256 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015631600000000001 2024-05-08T18:30:58.256 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.256 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.256 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:58.256 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:44.640466+0000", 2024-05-08T18:30:58.256 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000112973 2024-05-08T18:30:58.256 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:58.256 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:58.256 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:58.256 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.257 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.257 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:30:58.257 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.664338+0000", 2024-05-08T18:30:58.257 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 66.568035773999995, 2024-05-08T18:30:58.257 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039355429999999997, 2024-05-08T18:30:58.257 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:58.257 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:58.258 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:58.258 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:58.258 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:58.258 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:58.258 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 205 2024-05-08T18:30:58.258 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.258 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:58.258 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.259 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:58.259 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.664338+0000", 2024-05-08T18:30:58.259 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:58.259 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.259 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.259 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:58.260 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.664338+0000", 2024-05-08T18:30:58.260 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:58.260 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.260 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.260 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:58.261 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.664341+0000", 2024-05-08T18:30:58.261 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2399999999999999e-06 2024-05-08T18:30:58.261 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.261 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.261 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:58.261 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.664355+0000", 2024-05-08T18:30:58.261 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.453e-05 2024-05-08T18:30:58.261 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.262 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.262 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:58.262 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.664392+0000", 2024-05-08T18:30:58.262 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7033000000000003e-05 2024-05-08T18:30:58.262 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.262 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.262 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:58.263 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.664419+0000", 2024-05-08T18:30:58.263 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6086000000000001e-05 2024-05-08T18:30:58.263 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.263 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.263 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:58.263 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.664586+0000", 2024-05-08T18:30:58.263 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016752299999999999 2024-05-08T18:30:58.263 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.263 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.264 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:58.264 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.664831+0000", 2024-05-08T18:30:58.264 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00024510800000000001 2024-05-08T18:30:58.264 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.264 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.264 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:58.264 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.665420+0000", 2024-05-08T18:30:58.264 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00058862499999999996 2024-05-08T18:30:58.264 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.264 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.264 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:58.264 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.667096+0000", 2024-05-08T18:30:58.264 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0016765199999999999 2024-05-08T18:30:58.265 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.265 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.265 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:58.265 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.668109+0000", 2024-05-08T18:30:58.265 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001012829 2024-05-08T18:30:58.265 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.265 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.265 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:58.265 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.668200+0000", 2024-05-08T18:30:58.265 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1186000000000004e-05 2024-05-08T18:30:58.265 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.265 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.266 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:58.266 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.668273+0000", 2024-05-08T18:30:58.266 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.2862999999999997e-05 2024-05-08T18:30:58.266 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:58.266 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:58.266 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:58.267 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.267 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.267 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:58.267 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.732858+0000", 2024-05-08T18:30:58.267 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 66.499515426000002, 2024-05-08T18:30:58.267 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0033301939999999999, 2024-05-08T18:30:58.267 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:58.268 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:58.268 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:58.268 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:58.268 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:58.268 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:58.268 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 220 2024-05-08T18:30:58.269 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.269 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:58.269 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.269 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:58.269 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.732858+0000", 2024-05-08T18:30:58.270 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:58.270 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.270 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.270 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:58.270 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.732858+0000", 2024-05-08T18:30:58.270 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:58.271 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.271 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.271 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:58.271 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.732861+0000", 2024-05-08T18:30:58.271 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.9129999999999999e-06 2024-05-08T18:30:58.271 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.272 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.272 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:58.272 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.732874+0000", 2024-05-08T18:30:58.272 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3349999999999999e-05 2024-05-08T18:30:58.272 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.272 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.272 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:58.272 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.732900+0000", 2024-05-08T18:30:58.273 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6186999999999998e-05 2024-05-08T18:30:58.273 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.273 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.273 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:58.273 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.732916+0000", 2024-05-08T18:30:58.273 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5648999999999999e-05 2024-05-08T18:30:58.274 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.274 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.274 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:58.274 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.733097+0000", 2024-05-08T18:30:58.274 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00018121599999999999 2024-05-08T18:30:58.275 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.275 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.275 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:58.275 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.733299+0000", 2024-05-08T18:30:58.275 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020179799999999999 2024-05-08T18:30:58.275 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.276 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.276 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:58.276 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.733694+0000", 2024-05-08T18:30:58.276 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00039455000000000002 2024-05-08T18:30:58.276 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.276 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.276 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:58.276 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.735124+0000", 2024-05-08T18:30:58.277 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001430239 2024-05-08T18:30:58.277 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.277 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.277 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:58.277 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.736037+0000", 2024-05-08T18:30:58.277 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00091359999999999998 2024-05-08T18:30:58.277 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.277 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.277 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:58.277 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.736122+0000", 2024-05-08T18:30:58.277 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4313000000000004e-05 2024-05-08T18:30:58.277 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.278 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.278 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:58.278 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.736188+0000", 2024-05-08T18:30:58.278 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6378999999999996e-05 2024-05-08T18:30:58.278 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:58.278 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:58.278 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:58.278 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.278 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.278 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:223 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:58.278 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.743358+0000", 2024-05-08T18:30:58.279 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 66.489015214000005, 2024-05-08T18:30:58.279 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003279718, 2024-05-08T18:30:58.279 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:58.279 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:58.279 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:58.279 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:58.279 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:58.279 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:58.279 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 223 2024-05-08T18:30:58.279 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.279 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:58.279 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.279 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:58.280 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.743358+0000", 2024-05-08T18:30:58.280 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:58.280 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.280 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.280 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:58.280 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.743358+0000", 2024-05-08T18:30:58.280 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:58.280 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.280 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.280 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:58.280 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.743361+0000", 2024-05-08T18:30:58.280 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3269999999999999e-06 2024-05-08T18:30:58.281 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.281 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.281 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:58.281 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.743372+0000", 2024-05-08T18:30:58.281 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1202999999999999e-05 2024-05-08T18:30:58.281 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.281 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.281 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:58.281 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.743402+0000", 2024-05-08T18:30:58.281 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0580000000000002e-05 2024-05-08T18:30:58.281 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.281 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.281 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:58.282 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.743417+0000", 2024-05-08T18:30:58.282 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5067e-05 2024-05-08T18:30:58.282 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.282 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.282 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:58.282 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.743529+0000", 2024-05-08T18:30:58.282 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011130599999999999 2024-05-08T18:30:58.282 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.282 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.282 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:58.282 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.743744+0000", 2024-05-08T18:30:58.283 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000215324 2024-05-08T18:30:58.283 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.283 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.283 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:58.283 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.744137+0000", 2024-05-08T18:30:58.283 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00039347699999999999 2024-05-08T18:30:58.283 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.283 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.283 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:58.283 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.745510+0000", 2024-05-08T18:30:58.283 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001372063 2024-05-08T18:30:58.283 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.283 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.284 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:58.284 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.746486+0000", 2024-05-08T18:30:58.284 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00097615600000000005 2024-05-08T18:30:58.284 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.284 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.284 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:58.284 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.746574+0000", 2024-05-08T18:30:58.284 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8598999999999997e-05 2024-05-08T18:30:58.284 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.284 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.284 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:58.285 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.746638+0000", 2024-05-08T18:30:58.285 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3615999999999995e-05 2024-05-08T18:30:58.285 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:58.285 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:58.285 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:58.285 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.285 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.285 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:225 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:58.285 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.750971+0000", 2024-05-08T18:30:58.285 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 66.481402629000002, 2024-05-08T18:30:58.285 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0033719510000000002, 2024-05-08T18:30:58.285 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:58.286 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:58.286 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:58.286 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:58.286 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:58.286 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:58.286 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 225 2024-05-08T18:30:58.286 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.286 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:58.286 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.286 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:58.286 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.750971+0000", 2024-05-08T18:30:58.286 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:58.287 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.287 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.287 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:58.287 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.750971+0000", 2024-05-08T18:30:58.287 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:58.287 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.287 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.287 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:58.287 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.750973+0000", 2024-05-08T18:30:58.287 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.243e-06 2024-05-08T18:30:58.288 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.288 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.288 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:58.288 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.751001+0000", 2024-05-08T18:30:58.288 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8082999999999999e-05 2024-05-08T18:30:58.288 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.288 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.288 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:58.288 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.751029+0000", 2024-05-08T18:30:58.288 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.792e-05 2024-05-08T18:30:58.288 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.288 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.289 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:58.289 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.751051+0000", 2024-05-08T18:30:58.289 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2166000000000001e-05 2024-05-08T18:30:58.289 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.289 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.289 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:58.289 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.751239+0000", 2024-05-08T18:30:58.289 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000187362 2024-05-08T18:30:58.289 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.289 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.289 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:58.289 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.751462+0000", 2024-05-08T18:30:58.290 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000223482 2024-05-08T18:30:58.290 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.290 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.290 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:58.290 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.751893+0000", 2024-05-08T18:30:58.290 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00043102 2024-05-08T18:30:58.290 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.290 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.290 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:58.290 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.753297+0000", 2024-05-08T18:30:58.290 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001403619 2024-05-08T18:30:58.290 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.290 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.291 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:58.291 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.754186+0000", 2024-05-08T18:30:58.291 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00088948399999999996 2024-05-08T18:30:58.291 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.291 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.291 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:58.291 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.754280+0000", 2024-05-08T18:30:58.291 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.3838999999999994e-05 2024-05-08T18:30:58.291 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.291 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.291 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:58.292 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.754343+0000", 2024-05-08T18:30:58.292 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2732999999999997e-05 2024-05-08T18:30:58.292 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:58.292 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:58.292 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:58.292 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.292 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.292 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:226 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:58.292 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.754700+0000", 2024-05-08T18:30:58.292 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 66.477673073999995, 2024-05-08T18:30:58.292 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032180080000000001, 2024-05-08T18:30:58.292 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:58.292 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:58.293 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:58.293 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:58.293 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:58.293 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:58.293 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 226 2024-05-08T18:30:58.293 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.293 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:58.293 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.293 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:58.293 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.754700+0000", 2024-05-08T18:30:58.293 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:58.293 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.293 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.294 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:58.294 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.754700+0000", 2024-05-08T18:30:58.294 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:58.294 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.294 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.294 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:58.294 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.754702+0000", 2024-05-08T18:30:58.294 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.86e-06 2024-05-08T18:30:58.294 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.294 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.294 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:58.294 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.754711+0000", 2024-05-08T18:30:58.295 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.0399999999999998e-06 2024-05-08T18:30:58.295 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.295 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.295 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:58.295 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.754735+0000", 2024-05-08T18:30:58.295 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3496e-05 2024-05-08T18:30:58.295 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.295 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.295 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:58.295 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.754753+0000", 2024-05-08T18:30:58.295 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8406e-05 2024-05-08T18:30:58.295 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.296 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.296 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:58.296 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.754941+0000", 2024-05-08T18:30:58.296 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00018746600000000001 2024-05-08T18:30:58.296 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.296 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.296 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:58.296 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.755164+0000", 2024-05-08T18:30:58.296 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022307800000000001 2024-05-08T18:30:58.296 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.296 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.296 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:58.296 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.755552+0000", 2024-05-08T18:30:58.296 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00038834999999999998 2024-05-08T18:30:58.297 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.297 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.297 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:58.297 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.757079+0000", 2024-05-08T18:30:58.297 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001527055 2024-05-08T18:30:58.297 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.297 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.297 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:58.297 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.757769+0000", 2024-05-08T18:30:58.297 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00068953199999999997 2024-05-08T18:30:58.297 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.297 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.297 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:58.298 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.757848+0000", 2024-05-08T18:30:58.298 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9342e-05 2024-05-08T18:30:58.298 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.298 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.298 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:58.298 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.757918+0000", 2024-05-08T18:30:58.298 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0382999999999993e-05 2024-05-08T18:30:58.298 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:58.298 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:58.298 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:58.298 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.299 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.299 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:234 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:58.299 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.783973+0000", 2024-05-08T18:30:58.299 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 66.448400710000001, 2024-05-08T18:30:58.299 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003359374, 2024-05-08T18:30:58.299 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:58.299 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:58.299 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:58.299 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:58.299 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:58.299 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:58.299 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 234 2024-05-08T18:30:58.300 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.300 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:58.300 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.300 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:58.300 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.783973+0000", 2024-05-08T18:30:58.300 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:58.300 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.300 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.300 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:58.300 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.783973+0000", 2024-05-08T18:30:58.300 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:58.300 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.301 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.301 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:58.301 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.783975+0000", 2024-05-08T18:30:58.301 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2970000000000002e-06 2024-05-08T18:30:58.301 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.301 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.301 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:58.301 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.783986+0000", 2024-05-08T18:30:58.301 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0726e-05 2024-05-08T18:30:58.301 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.301 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.301 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:58.302 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.784016+0000", 2024-05-08T18:30:58.302 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0459000000000001e-05 2024-05-08T18:30:58.302 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.302 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.302 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:58.302 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.784032+0000", 2024-05-08T18:30:58.302 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5316999999999999e-05 2024-05-08T18:30:58.302 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.302 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.302 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:58.302 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.784155+0000", 2024-05-08T18:30:58.305 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012393199999999999 2024-05-08T18:30:58.306 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.306 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.306 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:58.306 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.784377+0000", 2024-05-08T18:30:58.306 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000221179 2024-05-08T18:30:58.306 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.306 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.306 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:58.306 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.784794+0000", 2024-05-08T18:30:58.307 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00041709599999999999 2024-05-08T18:30:58.307 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.307 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.307 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:58.307 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.786199+0000", 2024-05-08T18:30:58.307 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001405346 2024-05-08T18:30:58.307 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.307 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.307 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:58.307 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.787171+0000", 2024-05-08T18:30:58.307 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00097187 2024-05-08T18:30:58.307 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.307 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.307 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:58.308 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.787265+0000", 2024-05-08T18:30:58.308 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4055000000000007e-05 2024-05-08T18:30:58.308 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.308 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.308 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:58.308 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.787332+0000", 2024-05-08T18:30:58.308 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7096999999999998e-05 2024-05-08T18:30:58.308 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:58.308 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:58.308 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:58.308 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.308 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.309 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:425 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:58.309 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.847197+0000", 2024-05-08T18:30:58.309 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 66.385176044999994, 2024-05-08T18:30:58.309 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003317646, 2024-05-08T18:30:58.309 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:58.309 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:58.309 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:58.309 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:58.309 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:58.309 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:58.309 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 425 2024-05-08T18:30:58.309 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.309 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:58.310 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.310 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:58.310 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.847197+0000", 2024-05-08T18:30:58.310 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:58.310 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.310 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.310 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:58.310 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.847197+0000", 2024-05-08T18:30:58.310 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:58.310 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.310 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.310 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:58.310 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.847200+0000", 2024-05-08T18:30:58.311 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1629999999999999e-06 2024-05-08T18:30:58.311 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.311 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.311 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:58.311 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.847210+0000", 2024-05-08T18:30:58.311 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0180000000000001e-05 2024-05-08T18:30:58.311 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.311 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.311 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:58.311 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.847234+0000", 2024-05-08T18:30:58.311 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3879999999999998e-05 2024-05-08T18:30:58.311 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.311 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.311 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:58.312 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.847247+0000", 2024-05-08T18:30:58.312 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3263e-05 2024-05-08T18:30:58.312 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.312 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.312 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:58.312 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.847356+0000", 2024-05-08T18:30:58.312 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000108906 2024-05-08T18:30:58.312 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.312 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.312 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:58.312 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.847647+0000", 2024-05-08T18:30:58.312 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029143799999999998 2024-05-08T18:30:58.312 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.313 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.313 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:58.313 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.848062+0000", 2024-05-08T18:30:58.313 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000415227 2024-05-08T18:30:58.313 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.313 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.313 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:58.313 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.849591+0000", 2024-05-08T18:30:58.313 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0015288980000000001 2024-05-08T18:30:58.313 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.313 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.313 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:58.314 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.850244+0000", 2024-05-08T18:30:58.314 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000652336 2024-05-08T18:30:58.314 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.314 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.314 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:58.314 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.850418+0000", 2024-05-08T18:30:58.314 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000174284 2024-05-08T18:30:58.314 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.314 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.314 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:58.314 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.850515+0000", 2024-05-08T18:30:58.314 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7071000000000006e-05 2024-05-08T18:30:58.315 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:58.315 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:58.315 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:58.315 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.315 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.315 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:433 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:58.315 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.851403+0000", 2024-05-08T18:30:58.315 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 66.380970263999998, 2024-05-08T18:30:58.315 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032407109999999999, 2024-05-08T18:30:58.315 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:58.315 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:58.315 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:58.315 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:58.316 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:58.316 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:58.316 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 433 2024-05-08T18:30:58.316 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.316 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:58.316 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.316 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:58.316 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.851403+0000", 2024-05-08T18:30:58.316 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:58.316 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.316 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.316 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:58.317 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.851403+0000", 2024-05-08T18:30:58.317 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:58.317 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.317 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.317 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:58.317 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.851405+0000", 2024-05-08T18:30:58.317 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.463e-06 2024-05-08T18:30:58.317 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.317 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.317 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:58.318 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.851411+0000", 2024-05-08T18:30:58.318 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2369999999999997e-06 2024-05-08T18:30:58.318 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.318 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.318 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:58.318 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.851428+0000", 2024-05-08T18:30:58.318 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.696e-05 2024-05-08T18:30:58.318 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.318 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.318 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:58.318 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.851446+0000", 2024-05-08T18:30:58.319 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7706e-05 2024-05-08T18:30:58.319 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.319 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.319 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:58.319 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.851552+0000", 2024-05-08T18:30:58.319 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000106236 2024-05-08T18:30:58.319 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.319 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.319 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:58.319 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.851746+0000", 2024-05-08T18:30:58.319 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000194093 2024-05-08T18:30:58.319 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.319 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.320 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:58.320 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.852148+0000", 2024-05-08T18:30:58.320 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00040243100000000002 2024-05-08T18:30:58.320 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.320 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.320 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:58.320 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.854255+0000", 2024-05-08T18:30:58.320 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002107135 2024-05-08T18:30:58.320 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.320 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.320 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:58.320 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.854326+0000", 2024-05-08T18:30:58.321 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0902999999999995e-05 2024-05-08T18:30:58.321 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.321 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.321 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:58.321 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.854568+0000", 2024-05-08T18:30:58.321 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00024141500000000001 2024-05-08T18:30:58.321 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.321 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.321 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:58.321 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.854644+0000", 2024-05-08T18:30:58.321 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6131999999999995e-05 2024-05-08T18:30:58.321 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:58.322 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:58.322 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:58.322 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.322 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.322 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:436 6.a 6:55b0279d:reshard::reshard.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:58.322 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.852129+0000", 2024-05-08T18:30:58.322 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 66.380244456, 2024-05-08T18:30:58.322 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0053015019999999996, 2024-05-08T18:30:58.322 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:58.322 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:58.322 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:58.322 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:58.322 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:58.323 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:58.323 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 436 2024-05-08T18:30:58.323 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.323 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:58.323 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.323 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:58.323 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.852129+0000", 2024-05-08T18:30:58.323 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:58.323 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.323 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.323 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:58.323 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.852129+0000", 2024-05-08T18:30:58.324 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:58.324 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.324 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.324 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:58.324 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.852130+0000", 2024-05-08T18:30:58.324 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.353e-06 2024-05-08T18:30:58.324 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.324 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.324 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:58.324 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.852137+0000", 2024-05-08T18:30:58.324 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6900000000000003e-06 2024-05-08T18:30:58.324 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.324 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.325 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:58.325 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.852156+0000", 2024-05-08T18:30:58.325 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9143e-05 2024-05-08T18:30:58.325 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.325 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.325 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:58.325 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.852169+0000", 2024-05-08T18:30:58.325 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.308e-05 2024-05-08T18:30:58.325 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.325 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.325 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:58.325 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.852700+0000", 2024-05-08T18:30:58.325 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00053086599999999996 2024-05-08T18:30:58.326 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.326 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.326 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:58.326 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.853030+0000", 2024-05-08T18:30:58.326 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00033040100000000002 2024-05-08T18:30:58.326 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.326 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.326 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:58.326 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.853514+0000", 2024-05-08T18:30:58.326 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000483969 2024-05-08T18:30:58.326 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.326 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.327 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:58.327 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.856337+0000", 2024-05-08T18:30:58.327 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0028227349999999998 2024-05-08T18:30:58.327 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.327 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.327 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:58.327 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.857285+0000", 2024-05-08T18:30:58.327 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00094820600000000005 2024-05-08T18:30:58.327 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.327 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.327 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:58.327 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.857366+0000", 2024-05-08T18:30:58.327 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.0889000000000004e-05 2024-05-08T18:30:58.328 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.328 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.328 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:58.328 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.857430+0000", 2024-05-08T18:30:58.328 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4170000000000004e-05 2024-05-08T18:30:58.328 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:58.328 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:58.328 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:58.328 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.328 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.328 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:478 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:58.329 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.876745+0000", 2024-05-08T18:30:58.329 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 66.355627920000003, 2024-05-08T18:30:58.329 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0046303550000000001, 2024-05-08T18:30:58.329 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:58.329 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:58.329 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:58.329 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:58.329 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:58.329 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:58.329 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 478 2024-05-08T18:30:58.329 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.329 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:58.330 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.330 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:58.330 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.876745+0000", 2024-05-08T18:30:58.330 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:58.330 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.330 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.330 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:58.330 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.876745+0000", 2024-05-08T18:30:58.330 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:58.330 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.330 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.331 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:58.331 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.876748+0000", 2024-05-08T18:30:58.331 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2819999999999999e-06 2024-05-08T18:30:58.331 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.331 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.331 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:58.331 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.876758+0000", 2024-05-08T18:30:58.331 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0485e-05 2024-05-08T18:30:58.331 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.331 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.331 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:58.331 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.876788+0000", 2024-05-08T18:30:58.331 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.9879e-05 2024-05-08T18:30:58.332 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.332 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.332 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:58.332 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.876805+0000", 2024-05-08T18:30:58.332 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.643e-05 2024-05-08T18:30:58.332 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.332 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.332 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:58.332 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.876917+0000", 2024-05-08T18:30:58.332 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000112377 2024-05-08T18:30:58.332 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.332 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.332 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:58.333 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877094+0000", 2024-05-08T18:30:58.333 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000177131 2024-05-08T18:30:58.333 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.333 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.333 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:58.333 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877441+0000", 2024-05-08T18:30:58.333 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00034716100000000002 2024-05-08T18:30:58.333 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.333 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.333 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:58.333 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.878479+0000", 2024-05-08T18:30:58.333 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010378729999999999 2024-05-08T18:30:58.333 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.334 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.334 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:58.334 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.881252+0000", 2024-05-08T18:30:58.334 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0027728710000000001 2024-05-08T18:30:58.334 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.334 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.334 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:58.334 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.881322+0000", 2024-05-08T18:30:58.334 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0394000000000004e-05 2024-05-08T18:30:58.334 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.334 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.335 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:58.335 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.881376+0000", 2024-05-08T18:30:58.335 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3471999999999999e-05 2024-05-08T18:30:58.335 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:58.335 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:58.335 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:58.335 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.335 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.335 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:479 6.d 6:b3052b9f:reshard::reshard.0000000013:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:58.335 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.877922+0000", 2024-05-08T18:30:58.335 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 66.354451822000001, 2024-05-08T18:30:58.335 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0030756400000000001, 2024-05-08T18:30:58.335 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:58.336 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:58.336 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:58.336 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:58.336 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:58.336 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:58.336 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 479 2024-05-08T18:30:58.336 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.336 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:58.336 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.336 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:58.336 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877922+0000", 2024-05-08T18:30:58.336 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:58.336 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.336 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.337 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:58.337 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877922+0000", 2024-05-08T18:30:58.337 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:58.337 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.337 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.337 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:58.337 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877923+0000", 2024-05-08T18:30:58.337 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8670000000000001e-06 2024-05-08T18:30:58.337 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.337 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.337 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:58.337 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877933+0000", 2024-05-08T18:30:58.338 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.0860000000000008e-06 2024-05-08T18:30:58.338 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.338 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.338 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:58.338 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877970+0000", 2024-05-08T18:30:58.338 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7762999999999997e-05 2024-05-08T18:30:58.338 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.338 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.338 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:58.338 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877997+0000", 2024-05-08T18:30:58.338 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6883e-05 2024-05-08T18:30:58.338 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.339 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.339 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:58.339 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.878108+0000", 2024-05-08T18:30:58.339 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000110797 2024-05-08T18:30:58.339 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.339 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.339 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:58.339 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.878403+0000", 2024-05-08T18:30:58.339 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029509799999999999 2024-05-08T18:30:58.339 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.339 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.339 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:58.339 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.878744+0000", 2024-05-08T18:30:58.339 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00034075899999999999 2024-05-08T18:30:58.340 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.340 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.340 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:58.340 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.879800+0000", 2024-05-08T18:30:58.340 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010564420000000001 2024-05-08T18:30:58.340 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.340 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.340 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:58.340 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.880740+0000", 2024-05-08T18:30:58.340 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000940167 2024-05-08T18:30:58.340 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.340 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.340 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:58.341 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.880880+0000", 2024-05-08T18:30:58.341 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000139796 2024-05-08T18:30:58.341 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.341 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.341 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:58.341 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.880997+0000", 2024-05-08T18:30:58.341 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000116982 2024-05-08T18:30:58.341 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:58.341 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:58.341 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:58.341 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.341 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.341 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:766 6.19 6:9edc23b1:::obj_delete_at_hint.0000000063:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:58.342 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.158937+0000", 2024-05-08T18:30:58.342 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 66.073435931000006, 2024-05-08T18:30:58.342 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0030448300000000001, 2024-05-08T18:30:58.342 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:58.342 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:58.342 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:58.342 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:58.342 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:58.342 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:58.342 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 766 2024-05-08T18:30:58.342 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.342 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:58.343 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.343 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:58.343 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.158937+0000", 2024-05-08T18:30:58.343 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:58.343 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.343 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.343 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:58.343 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.158937+0000", 2024-05-08T18:30:58.343 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:58.343 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.343 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.343 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:58.343 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.158940+0000", 2024-05-08T18:30:58.343 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6170000000000001e-06 2024-05-08T18:30:58.344 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.344 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.344 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:58.344 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.158952+0000", 2024-05-08T18:30:58.344 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1559000000000001e-05 2024-05-08T18:30:58.344 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.344 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.344 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:58.344 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.158982+0000", 2024-05-08T18:30:58.344 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0406999999999999e-05 2024-05-08T18:30:58.344 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.344 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.344 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:58.345 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.159000+0000", 2024-05-08T18:30:58.345 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8e-05 2024-05-08T18:30:58.345 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.345 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.345 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:58.345 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.159090+0000", 2024-05-08T18:30:58.345 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.0124999999999995e-05 2024-05-08T18:30:58.345 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.345 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.345 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:58.345 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.159296+0000", 2024-05-08T18:30:58.345 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000205663 2024-05-08T18:30:58.346 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.346 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.346 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:58.346 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.159600+0000", 2024-05-08T18:30:58.346 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00030387699999999998 2024-05-08T18:30:58.346 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.346 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.346 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:58.346 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.160694+0000", 2024-05-08T18:30:58.346 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001094228 2024-05-08T18:30:58.346 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.346 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.346 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:58.346 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.161818+0000", 2024-05-08T18:30:58.347 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001124388 2024-05-08T18:30:58.347 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.347 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.347 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:58.347 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.161908+0000", 2024-05-08T18:30:58.347 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.9629000000000005e-05 2024-05-08T18:30:58.347 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.347 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.347 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:58.347 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.161982+0000", 2024-05-08T18:30:58.347 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4337000000000003e-05 2024-05-08T18:30:58.347 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:58.347 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:58.348 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:58.348 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.348 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.348 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:820 6.a 6:50a39311:::obj_delete_at_hint.0000000081:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:58.348 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.281842+0000", 2024-05-08T18:30:58.348 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 65.950531530000006, 2024-05-08T18:30:58.348 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0030574130000000001, 2024-05-08T18:30:58.348 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:58.348 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:58.348 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:58.348 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:58.348 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:58.349 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:58.349 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 820 2024-05-08T18:30:58.349 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.349 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:58.349 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.349 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:58.349 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.281842+0000", 2024-05-08T18:30:58.349 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:58.349 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.349 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.349 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:58.349 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.281842+0000", 2024-05-08T18:30:58.349 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:58.350 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.350 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.350 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:58.350 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.281845+0000", 2024-05-08T18:30:58.350 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8439999999999998e-06 2024-05-08T18:30:58.350 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.350 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.350 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:58.350 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.281856+0000", 2024-05-08T18:30:58.350 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.148e-05 2024-05-08T18:30:58.350 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.350 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.351 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:58.351 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.281887+0000", 2024-05-08T18:30:58.351 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1239999999999999e-05 2024-05-08T18:30:58.351 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.351 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.351 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:58.351 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.281903+0000", 2024-05-08T18:30:58.351 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5223e-05 2024-05-08T18:30:58.351 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.351 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.351 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:58.352 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.282084+0000", 2024-05-08T18:30:58.352 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00018167500000000001 2024-05-08T18:30:58.352 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.352 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.352 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:58.352 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.282301+0000", 2024-05-08T18:30:58.352 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00021651099999999999 2024-05-08T18:30:58.352 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.352 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.352 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:58.352 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.282634+0000", 2024-05-08T18:30:58.352 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000332758 2024-05-08T18:30:58.353 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.353 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.353 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:58.353 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.283836+0000", 2024-05-08T18:30:58.353 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001202397 2024-05-08T18:30:58.353 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.353 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.353 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:58.353 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.284750+0000", 2024-05-08T18:30:58.353 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00091438999999999995 2024-05-08T18:30:58.353 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.353 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.354 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:58.354 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.284836+0000", 2024-05-08T18:30:58.354 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.5855999999999999e-05 2024-05-08T18:30:58.354 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.354 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.354 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:58.354 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.284899+0000", 2024-05-08T18:30:58.354 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3039000000000004e-05 2024-05-08T18:30:58.354 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:58.354 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:58.355 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:58.355 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.355 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.355 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:835 6.7 6:e09767b9:::obj_delete_at_hint.0000000086:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:58.355 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.317765+0000", 2024-05-08T18:30:58.355 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 65.914608641000001, 2024-05-08T18:30:58.355 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029952809999999998, 2024-05-08T18:30:58.355 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:58.355 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:58.355 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:58.355 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:58.355 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:58.356 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:58.356 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 835 2024-05-08T18:30:58.356 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.356 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:58.356 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.356 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:58.356 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.317765+0000", 2024-05-08T18:30:58.356 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:58.356 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.356 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.356 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:58.356 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.317765+0000", 2024-05-08T18:30:58.356 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:58.356 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.356 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.357 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:58.357 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.317767+0000", 2024-05-08T18:30:58.357 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.057e-06 2024-05-08T18:30:58.357 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.357 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.357 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:58.357 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.317780+0000", 2024-05-08T18:30:58.357 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.36e-05 2024-05-08T18:30:58.357 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.357 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.357 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:58.357 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.317810+0000", 2024-05-08T18:30:58.357 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.9989999999999999e-05 2024-05-08T18:30:58.358 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.358 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.358 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:58.358 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.317832+0000", 2024-05-08T18:30:58.358 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1650000000000001e-05 2024-05-08T18:30:58.358 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.358 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.358 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:58.358 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.317954+0000", 2024-05-08T18:30:58.358 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000121465 2024-05-08T18:30:58.358 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.358 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.359 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:58.359 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.318189+0000", 2024-05-08T18:30:58.359 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000235818 2024-05-08T18:30:58.359 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.359 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.359 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 3", 2024-05-08T18:30:58.359 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.318532+0000", 2024-05-08T18:30:58.359 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00034245100000000002 2024-05-08T18:30:58.359 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.359 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.359 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:58.359 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.319625+0000", 2024-05-08T18:30:58.359 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010931280000000001 2024-05-08T18:30:58.360 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.360 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.360 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:58.360 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.320612+0000", 2024-05-08T18:30:58.360 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00098682299999999995 2024-05-08T18:30:58.360 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.360 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.360 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:58.360 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.320698+0000", 2024-05-08T18:30:58.360 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.5813e-05 2024-05-08T18:30:58.360 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.360 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.360 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:58.360 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.320760+0000", 2024-05-08T18:30:58.360 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2485999999999998e-05 2024-05-08T18:30:58.361 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:58.361 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:58.361 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:58.361 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.361 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.361 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:922 6.d 6:b6c174be:::obj_delete_at_hint.0000000115:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:58.361 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.516256+0000", 2024-05-08T18:30:58.361 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 65.716117689000001, 2024-05-08T18:30:58.361 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032949839999999999, 2024-05-08T18:30:58.361 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:58.361 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:58.361 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:58.361 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:58.361 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:58.362 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:58.362 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 922 2024-05-08T18:30:58.362 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.362 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:58.362 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.362 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:58.362 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.516256+0000", 2024-05-08T18:30:58.362 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:58.362 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.363 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.363 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:58.363 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.516256+0000", 2024-05-08T18:30:58.363 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:58.363 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.363 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.363 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:58.363 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.516258+0000", 2024-05-08T18:30:58.363 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.4399999999999999e-06 2024-05-08T18:30:58.363 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.363 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.363 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:58.363 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.516269+0000", 2024-05-08T18:30:58.364 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0797e-05 2024-05-08T18:30:58.364 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.364 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.364 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:58.364 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.516299+0000", 2024-05-08T18:30:58.364 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0213e-05 2024-05-08T18:30:58.364 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.364 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.364 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:58.364 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.516314+0000", 2024-05-08T18:30:58.365 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4600000000000001e-05 2024-05-08T18:30:58.365 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.365 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.365 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:58.365 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.516424+0000", 2024-05-08T18:30:58.365 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000110376 2024-05-08T18:30:58.365 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.365 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.365 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:58.365 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.516635+0000", 2024-05-08T18:30:58.365 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000210628 2024-05-08T18:30:58.365 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.365 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.366 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:58.366 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.516947+0000", 2024-05-08T18:30:58.366 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00031246699999999997 2024-05-08T18:30:58.366 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.366 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.366 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:58.366 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.517949+0000", 2024-05-08T18:30:58.366 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010017400000000001 2024-05-08T18:30:58.366 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.366 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.366 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:58.366 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.519389+0000", 2024-05-08T18:30:58.367 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001439655 2024-05-08T18:30:58.367 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.367 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.367 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:58.367 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.519475+0000", 2024-05-08T18:30:58.367 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.6485999999999998e-05 2024-05-08T18:30:58.367 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.367 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.367 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:58.367 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.519551+0000", 2024-05-08T18:30:58.367 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5581999999999996e-05 2024-05-08T18:30:58.367 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:58.367 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:58.368 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:58.368 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.368 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.368 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:940 6.a 6:517698f6:::obj_delete_at_hint.0000000121:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:58.368 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.560553+0000", 2024-05-08T18:30:58.368 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 65.671820840999999, 2024-05-08T18:30:58.368 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0030017569999999999, 2024-05-08T18:30:58.368 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:58.368 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:58.368 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:58.368 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:58.368 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:58.369 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:58.369 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 940 2024-05-08T18:30:58.369 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.369 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:58.369 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.369 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:58.369 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.560553+0000", 2024-05-08T18:30:58.369 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:58.369 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.369 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.369 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:58.369 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.560553+0000", 2024-05-08T18:30:58.369 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:58.369 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.370 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.370 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:58.370 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.560555+0000", 2024-05-08T18:30:58.370 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.39e-06 2024-05-08T18:30:58.370 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.370 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.370 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:58.370 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.560566+0000", 2024-05-08T18:30:58.370 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1484000000000001e-05 2024-05-08T18:30:58.370 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.370 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.370 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:58.371 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.560596+0000", 2024-05-08T18:30:58.371 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0001999999999998e-05 2024-05-08T18:30:58.371 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.371 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.371 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:58.371 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.560612+0000", 2024-05-08T18:30:58.371 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5690000000000001e-05 2024-05-08T18:30:58.371 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.371 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.371 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:58.371 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.560747+0000", 2024-05-08T18:30:58.371 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013494900000000001 2024-05-08T18:30:58.372 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.372 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.372 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:58.372 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.560961+0000", 2024-05-08T18:30:58.372 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000214305 2024-05-08T18:30:58.372 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.372 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.372 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:58.372 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.561281+0000", 2024-05-08T18:30:58.372 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00031933800000000001 2024-05-08T18:30:58.373 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.373 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.373 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:58.373 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.562399+0000", 2024-05-08T18:30:58.373 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0011180280000000001 2024-05-08T18:30:58.373 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.373 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.373 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:58.373 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.563407+0000", 2024-05-08T18:30:58.373 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010080519999999999 2024-05-08T18:30:58.373 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.374 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.374 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:58.374 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.563489+0000", 2024-05-08T18:30:58.374 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1725999999999996e-05 2024-05-08T18:30:58.374 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.374 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.374 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:58.374 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.563554+0000", 2024-05-08T18:30:58.374 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5792999999999998e-05 2024-05-08T18:30:58.374 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:58.374 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:58.375 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:58.375 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.375 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.375 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:943 6.19 6:9f21944d:::obj_delete_at_hint.0000000122:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:58.375 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.567777+0000", 2024-05-08T18:30:58.375 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 65.664595950000006, 2024-05-08T18:30:58.375 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0033921939999999999, 2024-05-08T18:30:58.375 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:58.375 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:58.375 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:58.375 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:58.376 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:58.376 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:58.376 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 943 2024-05-08T18:30:58.376 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.376 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:58.376 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.376 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:58.376 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.567777+0000", 2024-05-08T18:30:58.376 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:58.376 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.376 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.376 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:58.376 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.567777+0000", 2024-05-08T18:30:58.376 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:58.377 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.377 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.377 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:58.377 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.567779+0000", 2024-05-08T18:30:58.377 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8330000000000001e-06 2024-05-08T18:30:58.377 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.377 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.377 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:58.377 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.567788+0000", 2024-05-08T18:30:58.377 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4999999999999999e-06 2024-05-08T18:30:58.377 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.377 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.378 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:58.378 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.567812+0000", 2024-05-08T18:30:58.378 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.4207e-05 2024-05-08T18:30:58.378 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.378 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.378 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:58.378 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.567836+0000", 2024-05-08T18:30:58.378 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.4196e-05 2024-05-08T18:30:58.378 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.378 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.378 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:58.378 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.567954+0000", 2024-05-08T18:30:58.379 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011794300000000001 2024-05-08T18:30:58.379 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.379 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.379 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:58.379 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.568170+0000", 2024-05-08T18:30:58.379 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00021626100000000001 2024-05-08T18:30:58.379 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.379 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.379 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:58.379 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.568485+0000", 2024-05-08T18:30:58.379 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00031442800000000001 2024-05-08T18:30:58.379 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.379 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.380 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:58.380 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.569555+0000", 2024-05-08T18:30:58.380 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010698750000000001 2024-05-08T18:30:58.380 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.380 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.380 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:58.380 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.570899+0000", 2024-05-08T18:30:58.380 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0013446700000000001 2024-05-08T18:30:58.380 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.380 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.380 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:58.380 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.571058+0000", 2024-05-08T18:30:58.380 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015871900000000001 2024-05-08T18:30:58.381 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.381 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.381 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:58.381 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.571170+0000", 2024-05-08T18:30:58.381 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000111562 2024-05-08T18:30:58.381 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:58.381 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:58.381 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:58.381 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.381 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.381 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:952 6.a 6:541d369a:::obj_delete_at_hint.0000000125:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:30:58.381 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.588764+0000", 2024-05-08T18:30:58.382 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 65.643608919000002, 2024-05-08T18:30:58.382 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003183399, 2024-05-08T18:30:58.382 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:58.382 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:58.382 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:58.382 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:58.382 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:58.382 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:58.382 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 952 2024-05-08T18:30:58.382 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.382 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:58.382 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.382 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:58.383 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.588764+0000", 2024-05-08T18:30:58.383 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:58.383 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.383 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.383 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:58.383 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.588764+0000", 2024-05-08T18:30:58.383 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:58.383 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.383 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.384 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:58.384 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.588767+0000", 2024-05-08T18:30:58.384 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.39e-06 2024-05-08T18:30:58.384 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.384 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.384 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:58.384 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.588778+0000", 2024-05-08T18:30:58.384 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1304000000000001e-05 2024-05-08T18:30:58.384 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.384 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.384 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:58.384 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.588810+0000", 2024-05-08T18:30:58.384 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1726000000000001e-05 2024-05-08T18:30:58.384 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.385 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.385 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:58.385 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.588834+0000", 2024-05-08T18:30:58.385 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3845999999999998e-05 2024-05-08T18:30:58.385 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.385 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.385 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:58.385 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.588987+0000", 2024-05-08T18:30:58.385 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015300200000000001 2024-05-08T18:30:58.385 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.385 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.385 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:58.386 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.589197+0000", 2024-05-08T18:30:58.386 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020992299999999999 2024-05-08T18:30:58.386 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.386 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.386 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:30:58.386 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.589536+0000", 2024-05-08T18:30:58.386 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00033939300000000001 2024-05-08T18:30:58.386 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.386 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.386 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:58.386 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.590827+0000", 2024-05-08T18:30:58.387 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0012906 2024-05-08T18:30:58.387 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.387 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.387 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:58.387 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.591757+0000", 2024-05-08T18:30:58.387 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00093020699999999995 2024-05-08T18:30:58.387 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.387 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.387 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:58.387 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.591881+0000", 2024-05-08T18:30:58.387 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012406900000000001 2024-05-08T18:30:58.387 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.387 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.387 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:58.388 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.591948+0000", 2024-05-08T18:30:58.388 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6939000000000004e-05 2024-05-08T18:30:58.388 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:58.388 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:58.388 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:58.388 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:58.388 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:58.388 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:30:58.390 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-08T18:30:58.390 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:30:58.391+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:30:58.490 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:30:58.487+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:30:58.563 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:30:58.563 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:30:58.563 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 0 2024-05-08T18:30:58.563 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:30:58.577 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-08T18:30:58.621 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:30:58.619+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:30:58.692 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:30:58.687+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:30:58.741 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:30:58.741 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:30:58.741 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2024-05-08T18:30:58.741 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2024-05-08T18:30:58.741 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:30:58.756 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-08T18:30:58.792 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:30:58.791+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:30:58.893 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:30:58.891+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:30:58.920 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:30:58.920 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2024-05-08T18:30:58.920 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2024-05-08T18:30:58.920 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-05-08T18:30:58.920 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.920 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:30:58.921 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:48.647802+0000", 2024-05-08T18:30:58.921 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 70.270957189000001, 2024-05-08T18:30:58.921 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0027254660000000002, 2024-05-08T18:30:58.921 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:58.921 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:58.921 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:58.921 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:58.921 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:58.921 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:58.921 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 46 2024-05-08T18:30:58.921 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.921 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:58.921 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.921 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:58.922 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.647802+0000", 2024-05-08T18:30:58.922 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:58.922 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.922 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.922 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:58.922 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.647802+0000", 2024-05-08T18:30:58.922 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:58.922 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.922 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.922 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:58.922 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.647805+0000", 2024-05-08T18:30:58.922 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8940000000000002e-06 2024-05-08T18:30:58.923 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.923 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.923 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:58.923 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.647816+0000", 2024-05-08T18:30:58.923 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0998999999999999e-05 2024-05-08T18:30:58.923 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.923 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.923 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:58.923 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.647846+0000", 2024-05-08T18:30:58.923 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.027e-05 2024-05-08T18:30:58.923 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.923 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.923 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:58.923 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.647865+0000", 2024-05-08T18:30:58.924 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.808e-05 2024-05-08T18:30:58.924 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.924 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.924 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:58.924 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.647994+0000", 2024-05-08T18:30:58.924 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012923899999999999 2024-05-08T18:30:58.924 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.924 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.924 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:58.924 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.648289+0000", 2024-05-08T18:30:58.924 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029495999999999998 2024-05-08T18:30:58.924 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.924 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.924 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:58.925 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.648576+0000", 2024-05-08T18:30:58.925 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00028707599999999999 2024-05-08T18:30:58.925 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.925 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.925 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:58.925 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.649703+0000", 2024-05-08T18:30:58.925 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001126658 2024-05-08T18:30:58.925 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.925 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.925 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:58.925 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.650337+0000", 2024-05-08T18:30:58.925 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00063405500000000001 2024-05-08T18:30:58.925 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.926 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.926 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:58.926 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.650451+0000", 2024-05-08T18:30:58.926 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011476600000000001 2024-05-08T18:30:58.926 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.926 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.926 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:58.926 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.650528+0000", 2024-05-08T18:30:58.926 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6469000000000003e-05 2024-05-08T18:30:58.926 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:58.926 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:58.926 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:58.927 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.927 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.927 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94069412627456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:30:58.927 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:48.650773+0000", 2024-05-08T18:30:58.927 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 70.267986651000001, 2024-05-08T18:30:58.927 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0024358209999999999, 2024-05-08T18:30:58.927 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:58.927 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:58.927 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:58.927 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:58.927 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:58.927 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:58.927 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 47 2024-05-08T18:30:58.927 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.928 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:58.928 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.928 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:58.928 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.650773+0000", 2024-05-08T18:30:58.928 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:58.928 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.928 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.928 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:58.928 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.650773+0000", 2024-05-08T18:30:58.928 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:58.928 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.928 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.928 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:58.929 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.650775+0000", 2024-05-08T18:30:58.929 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.4030000000000001e-06 2024-05-08T18:30:58.929 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.929 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.929 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:58.929 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.650785+0000", 2024-05-08T18:30:58.929 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0027000000000001e-05 2024-05-08T18:30:58.929 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.929 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.929 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:58.929 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.650814+0000", 2024-05-08T18:30:58.929 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8350000000000001e-05 2024-05-08T18:30:58.929 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.929 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.930 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:58.930 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.650848+0000", 2024-05-08T18:30:58.930 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4566000000000001e-05 2024-05-08T18:30:58.930 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.930 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.930 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:58.930 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.650963+0000", 2024-05-08T18:30:58.930 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011506300000000001 2024-05-08T18:30:58.930 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.930 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.930 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:58.930 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.651153+0000", 2024-05-08T18:30:58.930 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000189812 2024-05-08T18:30:58.930 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.931 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.931 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 4", 2024-05-08T18:30:58.931 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.651493+0000", 2024-05-08T18:30:58.931 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000339616 2024-05-08T18:30:58.931 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.931 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.931 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:58.931 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.652662+0000", 2024-05-08T18:30:58.931 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0011695410000000001 2024-05-08T18:30:58.931 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.931 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.931 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:58.932 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.652998+0000", 2024-05-08T18:30:58.932 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000335788 2024-05-08T18:30:58.932 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.932 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.932 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:58.932 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.653076+0000", 2024-05-08T18:30:58.932 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8120000000000004e-05 2024-05-08T18:30:58.932 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.932 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.932 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:58.932 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.653209+0000", 2024-05-08T18:30:58.932 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000132535 2024-05-08T18:30:58.932 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:58.932 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:58.932 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:58.933 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.933 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.933 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:30:58.933 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:48.659528+0000", 2024-05-08T18:30:58.933 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 70.259231435999993, 2024-05-08T18:30:58.933 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0025123260000000001, 2024-05-08T18:30:58.933 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:58.933 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:58.933 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:58.933 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:58.933 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:58.933 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:58.933 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 54 2024-05-08T18:30:58.933 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.934 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:58.934 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.934 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:58.934 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.659528+0000", 2024-05-08T18:30:58.934 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:58.934 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.934 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.934 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:58.934 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.659528+0000", 2024-05-08T18:30:58.934 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:58.934 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.934 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.934 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:58.935 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.659530+0000", 2024-05-08T18:30:58.935 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9429999999999999e-06 2024-05-08T18:30:58.935 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.935 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.935 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:58.935 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.659540+0000", 2024-05-08T18:30:58.935 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0147e-05 2024-05-08T18:30:58.935 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.935 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.935 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:58.935 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.659569+0000", 2024-05-08T18:30:58.935 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.923e-05 2024-05-08T18:30:58.935 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.935 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.936 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:58.936 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.659584+0000", 2024-05-08T18:30:58.936 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4996e-05 2024-05-08T18:30:58.936 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.936 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.936 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:58.936 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.659716+0000", 2024-05-08T18:30:58.936 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000131457 2024-05-08T18:30:58.936 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.936 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.936 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:58.936 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.659895+0000", 2024-05-08T18:30:58.936 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017940400000000001 2024-05-08T18:30:58.936 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.937 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.937 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:58.937 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.660092+0000", 2024-05-08T18:30:58.937 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000197002 2024-05-08T18:30:58.937 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.937 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.937 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:58.937 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.661227+0000", 2024-05-08T18:30:58.937 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0011346150000000001 2024-05-08T18:30:58.937 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.937 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.937 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:58.937 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.661907+0000", 2024-05-08T18:30:58.937 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00068008800000000002 2024-05-08T18:30:58.938 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.938 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.938 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:58.938 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.661978+0000", 2024-05-08T18:30:58.938 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1538999999999994e-05 2024-05-08T18:30:58.938 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.938 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.938 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:58.938 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.662040+0000", 2024-05-08T18:30:58.938 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1904999999999998e-05 2024-05-08T18:30:58.938 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:58.938 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:58.939 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:58.939 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.939 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.939 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94069412622848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:30:58.939 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:48.662241+0000", 2024-05-08T18:30:58.939 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 70.256518110000002, 2024-05-08T18:30:58.939 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029022259999999999, 2024-05-08T18:30:58.939 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:58.939 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:58.939 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:58.939 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:58.939 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:30:58.939 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:30:58.940 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 55 2024-05-08T18:30:58.940 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.940 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:58.940 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.940 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:58.940 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.662241+0000", 2024-05-08T18:30:58.940 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:58.940 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.940 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.940 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:58.940 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.662241+0000", 2024-05-08T18:30:58.940 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:58.940 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.940 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.940 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:58.941 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.662243+0000", 2024-05-08T18:30:58.941 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.716e-06 2024-05-08T18:30:58.941 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.941 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.941 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:58.941 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.662267+0000", 2024-05-08T18:30:58.941 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3949999999999999e-05 2024-05-08T18:30:58.941 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.941 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.941 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:58.941 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.662293+0000", 2024-05-08T18:30:58.941 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6376e-05 2024-05-08T18:30:58.941 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.942 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.942 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:58.942 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.662310+0000", 2024-05-08T18:30:58.942 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6520000000000001e-05 2024-05-08T18:30:58.942 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.942 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.942 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:58.942 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.662412+0000", 2024-05-08T18:30:58.942 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010228700000000001 2024-05-08T18:30:58.942 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.942 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.942 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:58.942 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.662514+0000", 2024-05-08T18:30:58.942 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0001019 2024-05-08T18:30:58.943 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.943 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.943 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:30:58.943 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.662714+0000", 2024-05-08T18:30:58.943 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020008100000000001 2024-05-08T18:30:58.943 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.943 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.943 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:58.943 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.663711+0000", 2024-05-08T18:30:58.943 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00099629899999999997 2024-05-08T18:30:58.943 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.943 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.943 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:58.943 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.664976+0000", 2024-05-08T18:30:58.943 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0012652679999999999 2024-05-08T18:30:58.944 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.944 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.944 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:58.944 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.665047+0000", 2024-05-08T18:30:58.944 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1277000000000002e-05 2024-05-08T18:30:58.944 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.944 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.944 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:58.944 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.665144+0000", 2024-05-08T18:30:58.944 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6552000000000007e-05 2024-05-08T18:30:58.944 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:58.944 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:58.944 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:58.944 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.945 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.945 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:209 6.3 e33/27 6:c60da066:gc::gc.4:head v 33'1, mlcod=0'0)", 2024-05-08T18:30:58.945 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.686317+0000", 2024-05-08T18:30:58.945 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 67.232442105999993, 2024-05-08T18:30:58.945 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032126889999999999, 2024-05-08T18:30:58.945 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:58.945 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:58.945 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:58.945 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:58.945 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.945 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:58.945 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.686317+0000", 2024-05-08T18:30:58.945 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:58.945 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.946 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.946 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:58.946 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.686317+0000", 2024-05-08T18:30:58.946 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:58.946 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.946 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.946 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:58.946 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.686318+0000", 2024-05-08T18:30:58.946 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5400000000000001e-07 2024-05-08T18:30:58.946 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.946 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.946 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:58.946 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.686326+0000", 2024-05-08T18:30:58.946 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3000000000000002e-06 2024-05-08T18:30:58.947 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.947 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.947 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:58.947 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.686358+0000", 2024-05-08T18:30:58.947 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1702999999999998e-05 2024-05-08T18:30:58.947 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.947 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.947 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:58.947 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.686374+0000", 2024-05-08T18:30:58.947 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6266e-05 2024-05-08T18:30:58.947 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.947 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.947 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:58.947 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.686530+0000", 2024-05-08T18:30:58.947 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015583599999999999 2024-05-08T18:30:58.948 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.948 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.948 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:58.948 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.686573+0000", 2024-05-08T18:30:58.948 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3248999999999999e-05 2024-05-08T18:30:58.948 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.948 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.948 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:58.948 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.689412+0000", 2024-05-08T18:30:58.948 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0028385720000000001 2024-05-08T18:30:58.948 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.948 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.948 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:58.949 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.689530+0000", 2024-05-08T18:30:58.949 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000118109 2024-05-08T18:30:58.949 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:58.949 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:58.949 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:58.949 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.949 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.949 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:217 6.15 e33/27 6:ab569f81:gc::gc.12:head v 33'1, mlcod=0'0)", 2024-05-08T18:30:58.949 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.722458+0000", 2024-05-08T18:30:58.949 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 67.196301564999999, 2024-05-08T18:30:58.949 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001760604, 2024-05-08T18:30:58.949 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:58.949 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:58.949 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:58.950 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:58.950 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.950 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:58.950 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.722458+0000", 2024-05-08T18:30:58.950 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:58.950 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.950 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.950 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:58.950 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.722458+0000", 2024-05-08T18:30:58.950 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:58.950 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.950 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.950 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:58.951 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.722460+0000", 2024-05-08T18:30:58.951 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.677e-06 2024-05-08T18:30:58.951 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.951 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.951 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:58.951 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.722471+0000", 2024-05-08T18:30:58.951 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0956e-05 2024-05-08T18:30:58.951 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.951 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.951 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:58.951 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.722496+0000", 2024-05-08T18:30:58.951 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5490000000000002e-05 2024-05-08T18:30:58.951 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.951 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.952 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:58.952 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.722511+0000", 2024-05-08T18:30:58.952 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4687e-05 2024-05-08T18:30:58.952 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.952 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.952 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:58.952 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.722609+0000", 2024-05-08T18:30:58.952 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8152000000000005e-05 2024-05-08T18:30:58.952 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.952 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.952 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:58.952 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.722638+0000", 2024-05-08T18:30:58.952 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.934e-05 2024-05-08T18:30:58.953 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.953 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.953 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:58.953 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.724127+0000", 2024-05-08T18:30:58.953 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001488622 2024-05-08T18:30:58.953 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.953 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.953 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:58.953 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.724219+0000", 2024-05-08T18:30:58.953 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1680000000000003e-05 2024-05-08T18:30:58.953 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:58.953 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:58.953 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:58.953 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.954 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.954 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:231 6.1f e33/27 6:fde4dd55:gc::gc.26:head v 33'1, mlcod=0'0)", 2024-05-08T18:30:58.954 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.773905+0000", 2024-05-08T18:30:58.954 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 67.144854025000001, 2024-05-08T18:30:58.954 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002018681, 2024-05-08T18:30:58.954 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:58.954 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:58.954 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:58.954 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:58.954 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.954 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:58.954 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.773905+0000", 2024-05-08T18:30:58.954 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:58.955 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.955 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.955 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:58.955 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.773905+0000", 2024-05-08T18:30:58.955 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:58.955 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.955 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.955 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:58.955 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.773906+0000", 2024-05-08T18:30:58.955 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2300000000000001e-07 2024-05-08T18:30:58.955 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.955 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.955 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:58.955 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.773913+0000", 2024-05-08T18:30:58.956 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8399999999999997e-06 2024-05-08T18:30:58.956 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.956 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.956 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:58.956 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.773938+0000", 2024-05-08T18:30:58.956 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.4977000000000002e-05 2024-05-08T18:30:58.956 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.956 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.956 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:58.956 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.773970+0000", 2024-05-08T18:30:58.956 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1673e-05 2024-05-08T18:30:58.956 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.956 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.956 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:58.957 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.774112+0000", 2024-05-08T18:30:58.957 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014273899999999999 2024-05-08T18:30:58.957 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.957 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.957 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:58.957 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.774167+0000", 2024-05-08T18:30:58.957 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4762000000000002e-05 2024-05-08T18:30:58.957 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.957 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.957 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:58.957 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.775832+0000", 2024-05-08T18:30:58.957 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0016648539999999999 2024-05-08T18:30:58.957 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.957 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.958 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:58.958 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.775924+0000", 2024-05-08T18:30:58.958 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2312999999999995e-05 2024-05-08T18:30:58.958 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:58.958 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:58.958 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:58.958 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.958 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.958 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:328 6.15 e33/27 6:ab569f81:gc::gc.12:head v 33'3, mlcod=33'1)", 2024-05-08T18:30:58.958 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.811368+0000", 2024-05-08T18:30:58.958 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 67.107391523999993, 2024-05-08T18:30:58.958 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0019828110000000001, 2024-05-08T18:30:58.958 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:58.958 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:58.959 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:58.959 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:58.959 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.959 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:58.959 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.811368+0000", 2024-05-08T18:30:58.959 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:58.959 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.959 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.959 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:58.959 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.811368+0000", 2024-05-08T18:30:58.959 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:58.959 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.959 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.959 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:58.960 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.811370+0000", 2024-05-08T18:30:58.960 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.883e-06 2024-05-08T18:30:58.960 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.960 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.960 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:58.960 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.811385+0000", 2024-05-08T18:30:58.960 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5489999999999999e-05 2024-05-08T18:30:58.960 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.960 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.960 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:58.960 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.811422+0000", 2024-05-08T18:30:58.960 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7023000000000001e-05 2024-05-08T18:30:58.960 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.961 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.961 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:58.961 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.811443+0000", 2024-05-08T18:30:58.961 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0194e-05 2024-05-08T18:30:58.961 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.961 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.961 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:58.961 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.811582+0000", 2024-05-08T18:30:58.961 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000139068 2024-05-08T18:30:58.961 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.961 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.961 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:58.961 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.811646+0000", 2024-05-08T18:30:58.961 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4113000000000001e-05 2024-05-08T18:30:58.962 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.962 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.962 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:58.962 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.813243+0000", 2024-05-08T18:30:58.962 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0015969249999999999 2024-05-08T18:30:58.962 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.962 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.962 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:58.962 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.813351+0000", 2024-05-08T18:30:58.962 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000108115 2024-05-08T18:30:58.962 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:58.962 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:58.962 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:58.962 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.963 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.963 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:341 6.1 e33/27 6:856b9b26:reshard::reshard.0000000002:head v 33'2, mlcod=0'0)", 2024-05-08T18:30:58.963 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.813091+0000", 2024-05-08T18:30:58.963 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 67.105668257000005, 2024-05-08T18:30:58.963 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0021783459999999998, 2024-05-08T18:30:58.963 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:58.963 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:58.963 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:58.963 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:58.963 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.963 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:58.963 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.813091+0000", 2024-05-08T18:30:58.963 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:58.963 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.964 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.964 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:58.964 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.813091+0000", 2024-05-08T18:30:58.964 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:58.964 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.964 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.964 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:58.964 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.813093+0000", 2024-05-08T18:30:58.964 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.813e-06 2024-05-08T18:30:58.965 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.965 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.965 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:58.965 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.813107+0000", 2024-05-08T18:30:58.965 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3730000000000001e-05 2024-05-08T18:30:58.965 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.965 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.965 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:58.965 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.813177+0000", 2024-05-08T18:30:58.965 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9801999999999993e-05 2024-05-08T18:30:58.965 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.965 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.965 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:58.965 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.813198+0000", 2024-05-08T18:30:58.966 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1347000000000001e-05 2024-05-08T18:30:58.966 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.966 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.966 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:58.966 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.813321+0000", 2024-05-08T18:30:58.966 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000123192 2024-05-08T18:30:58.966 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.966 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.966 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:58.966 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.813373+0000", 2024-05-08T18:30:58.966 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2046999999999998e-05 2024-05-08T18:30:58.966 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.966 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.967 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:58.967 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.815181+0000", 2024-05-08T18:30:58.967 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001807562 2024-05-08T18:30:58.967 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.967 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.967 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:58.967 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.815270+0000", 2024-05-08T18:30:58.967 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8852999999999998e-05 2024-05-08T18:30:58.967 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:58.967 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:58.967 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:58.967 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.967 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.967 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:404 6.3 e33/27 6:c623b173:gc::gc.16:head v 33'6, mlcod=33'4)", 2024-05-08T18:30:58.968 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.837510+0000", 2024-05-08T18:30:58.968 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 67.081249946, 2024-05-08T18:30:58.968 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0023724549999999999, 2024-05-08T18:30:58.968 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:58.968 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:58.968 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:58.968 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:58.968 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.968 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:58.968 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.837510+0000", 2024-05-08T18:30:58.968 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:58.968 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.968 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.968 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:58.969 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.837510+0000", 2024-05-08T18:30:58.969 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:58.969 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.969 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.969 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:58.969 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.837511+0000", 2024-05-08T18:30:58.969 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.863e-06 2024-05-08T18:30:58.969 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.969 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.969 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:58.969 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.837526+0000", 2024-05-08T18:30:58.969 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4756999999999999e-05 2024-05-08T18:30:58.969 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.969 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.970 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:58.970 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.837564+0000", 2024-05-08T18:30:58.970 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7645999999999998e-05 2024-05-08T18:30:58.970 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.970 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.970 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:58.970 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.837584+0000", 2024-05-08T18:30:58.970 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9763999999999999e-05 2024-05-08T18:30:58.970 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.970 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.970 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:58.970 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.837724+0000", 2024-05-08T18:30:58.970 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014080200000000001 2024-05-08T18:30:58.970 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.971 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.971 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:58.971 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.837776+0000", 2024-05-08T18:30:58.971 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1279000000000002e-05 2024-05-08T18:30:58.971 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.971 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.971 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:58.971 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.839770+0000", 2024-05-08T18:30:58.971 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001994048 2024-05-08T18:30:58.971 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.971 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.971 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:58.971 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.839882+0000", 2024-05-08T18:30:58.971 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000112296 2024-05-08T18:30:58.971 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:58.972 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:58.972 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:58.972 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.972 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.972 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:414 6.c e33/27 6:338eb7e9:::obj_delete_at_hint.0000000008:head v 33'3, mlcod=33'1)", 2024-05-08T18:30:58.972 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.841401+0000", 2024-05-08T18:30:58.972 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 67.077358795999999, 2024-05-08T18:30:58.972 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001916865, 2024-05-08T18:30:58.972 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:58.972 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:58.972 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:58.972 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:58.972 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.973 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:58.973 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.841401+0000", 2024-05-08T18:30:58.973 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:58.973 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.973 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.973 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:58.973 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.841401+0000", 2024-05-08T18:30:58.973 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:58.973 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.973 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.973 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:58.973 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.841402+0000", 2024-05-08T18:30:58.973 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6899999999999999e-06 2024-05-08T18:30:58.973 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.973 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.974 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:58.974 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.841414+0000", 2024-05-08T18:30:58.974 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.183e-05 2024-05-08T18:30:58.974 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.974 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.974 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:58.974 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.841435+0000", 2024-05-08T18:30:58.974 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0876000000000001e-05 2024-05-08T18:30:58.974 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.974 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.974 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:58.974 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.841451+0000", 2024-05-08T18:30:58.974 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5784e-05 2024-05-08T18:30:58.975 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.975 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.975 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:58.975 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.841597+0000", 2024-05-08T18:30:58.975 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014639899999999999 2024-05-08T18:30:58.975 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.975 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.975 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:58.975 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.841656+0000", 2024-05-08T18:30:58.975 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8485e-05 2024-05-08T18:30:58.975 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.975 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.975 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:58.975 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.843235+0000", 2024-05-08T18:30:58.975 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0015787920000000001 2024-05-08T18:30:58.976 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.976 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.976 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:58.976 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.843318+0000", 2024-05-08T18:30:58.976 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3009000000000004e-05 2024-05-08T18:30:58.976 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:58.976 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:58.976 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:58.976 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.976 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.976 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:422 6.c e33/27 6:338eb7e9:::obj_delete_at_hint.0000000008:head v 33'4, mlcod=33'2)", 2024-05-08T18:30:58.976 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.844520+0000", 2024-05-08T18:30:58.976 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 67.074239649999996, 2024-05-08T18:30:58.976 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002269929, 2024-05-08T18:30:58.977 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:58.977 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:58.977 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:58.977 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:58.977 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.977 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:58.977 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.844520+0000", 2024-05-08T18:30:58.977 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:58.977 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.977 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.977 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:58.977 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.844520+0000", 2024-05-08T18:30:58.977 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:58.977 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.977 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.978 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:58.978 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.844522+0000", 2024-05-08T18:30:58.978 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.643e-06 2024-05-08T18:30:58.978 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.978 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.978 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:58.978 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.844577+0000", 2024-05-08T18:30:58.978 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5976000000000001e-05 2024-05-08T18:30:58.978 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.978 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.978 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:58.978 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.844613+0000", 2024-05-08T18:30:58.978 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5339999999999997e-05 2024-05-08T18:30:58.978 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.979 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.979 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:58.979 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.844638+0000", 2024-05-08T18:30:58.979 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5165999999999999e-05 2024-05-08T18:30:58.979 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.979 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.979 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:58.979 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.844795+0000", 2024-05-08T18:30:58.979 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015660899999999999 2024-05-08T18:30:58.979 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.979 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.979 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:58.979 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.844841+0000", 2024-05-08T18:30:58.979 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6279999999999997e-05 2024-05-08T18:30:58.980 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.980 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.980 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:58.980 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.846707+0000", 2024-05-08T18:30:58.980 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0018657249999999999 2024-05-08T18:30:58.980 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.980 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.980 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:58.980 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.846790+0000", 2024-05-08T18:30:58.980 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3189999999999995e-05 2024-05-08T18:30:58.980 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:58.980 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:58.980 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:58.980 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.981 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.981 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:425 6.a e33/27 6:50d64734:::obj_delete_at_hint.0000000009:head v 33'2, mlcod=0'0)", 2024-05-08T18:30:58.981 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.848220+0000", 2024-05-08T18:30:58.981 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 67.070539531999998, 2024-05-08T18:30:58.981 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0017145109999999999, 2024-05-08T18:30:58.981 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:58.981 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:58.981 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:58.981 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:58.981 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.981 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:58.981 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.848220+0000", 2024-05-08T18:30:58.981 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:58.981 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.982 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.982 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:58.982 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.848220+0000", 2024-05-08T18:30:58.982 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:58.982 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.982 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.982 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:58.982 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.848222+0000", 2024-05-08T18:30:58.982 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9630000000000001e-06 2024-05-08T18:30:58.982 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.982 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.982 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:58.982 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.848254+0000", 2024-05-08T18:30:58.982 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2047e-05 2024-05-08T18:30:58.983 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.983 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.983 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:58.983 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.848273+0000", 2024-05-08T18:30:58.983 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9493000000000001e-05 2024-05-08T18:30:58.983 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.983 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.983 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:58.983 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.848286+0000", 2024-05-08T18:30:58.983 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2490000000000001e-05 2024-05-08T18:30:58.983 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.983 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.983 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:58.983 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.848414+0000", 2024-05-08T18:30:58.983 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000127785 2024-05-08T18:30:58.984 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.984 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.984 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:58.984 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.848448+0000", 2024-05-08T18:30:58.984 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4233999999999998e-05 2024-05-08T18:30:58.984 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.984 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.984 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:58.984 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.849855+0000", 2024-05-08T18:30:58.984 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001407482 2024-05-08T18:30:58.984 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.984 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.984 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:58.984 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.849934+0000", 2024-05-08T18:30:58.985 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9017000000000006e-05 2024-05-08T18:30:58.985 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:58.985 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:58.985 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:58.985 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.985 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.985 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:436 6.a e33/27 6:55b0279d:reshard::reshard.0000000009:head v 33'4, mlcod=33'1)", 2024-05-08T18:30:58.985 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.853725+0000", 2024-05-08T18:30:58.985 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 67.065034014999995, 2024-05-08T18:30:58.985 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032824949999999999, 2024-05-08T18:30:58.985 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:58.985 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:58.985 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:58.985 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:58.986 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.986 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:58.986 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.853725+0000", 2024-05-08T18:30:58.986 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:58.986 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.986 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.986 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:58.986 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.853725+0000", 2024-05-08T18:30:58.986 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:58.986 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.986 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.986 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:58.986 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.853727+0000", 2024-05-08T18:30:58.987 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6899999999999999e-06 2024-05-08T18:30:58.987 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.987 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.987 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:58.987 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.853742+0000", 2024-05-08T18:30:58.987 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.517e-05 2024-05-08T18:30:58.987 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.987 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.987 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:58.987 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.853778+0000", 2024-05-08T18:30:58.987 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5173999999999999e-05 2024-05-08T18:30:58.987 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.987 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.987 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:58.988 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.853791+0000", 2024-05-08T18:30:58.988 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.345e-05 2024-05-08T18:30:58.988 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.988 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.988 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:58.988 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.853912+0000", 2024-05-08T18:30:58.988 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012149199999999999 2024-05-08T18:30:58.988 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.988 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.988 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:58.988 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.853960+0000", 2024-05-08T18:30:58.988 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7262999999999998e-05 2024-05-08T18:30:58.988 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.988 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.989 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:58.989 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.856896+0000", 2024-05-08T18:30:58.989 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029363700000000002 2024-05-08T18:30:58.989 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.989 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.989 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:58.989 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.857008+0000", 2024-05-08T18:30:58.989 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011188600000000001 2024-05-08T18:30:58.989 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:58.989 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:58.989 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:58.989 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.989 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.989 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:457 6.1 e33/27 6:80b6fe23:reshard::reshard.0000000011:head v 33'3, mlcod=33'1)", 2024-05-08T18:30:58.990 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.865322+0000", 2024-05-08T18:30:58.990 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 67.053437369999997, 2024-05-08T18:30:58.990 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001750756, 2024-05-08T18:30:58.990 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:58.990 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:58.990 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:58.990 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:58.990 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.990 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:58.990 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.865322+0000", 2024-05-08T18:30:58.990 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:58.990 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.990 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.991 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:58.991 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.865322+0000", 2024-05-08T18:30:58.991 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:58.991 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.991 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.991 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:58.991 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.865325+0000", 2024-05-08T18:30:58.991 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5660000000000001e-06 2024-05-08T18:30:58.991 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.991 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.991 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:58.991 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.865339+0000", 2024-05-08T18:30:58.991 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.412e-05 2024-05-08T18:30:58.991 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.992 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.992 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:58.992 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.865366+0000", 2024-05-08T18:30:58.992 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7453e-05 2024-05-08T18:30:58.992 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.992 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.992 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:58.992 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.865383+0000", 2024-05-08T18:30:58.992 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.683e-05 2024-05-08T18:30:58.992 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.992 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.992 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:58.992 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.865514+0000", 2024-05-08T18:30:58.993 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000131369 2024-05-08T18:30:58.993 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.993 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.993 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:58.993 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.865583+0000", 2024-05-08T18:30:58.993 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8526000000000001e-05 2024-05-08T18:30:58.993 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.993 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.993 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:58.993 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.866974+0000", 2024-05-08T18:30:58.993 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001391193 2024-05-08T18:30:58.993 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.993 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.994 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:58.994 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.867073+0000", 2024-05-08T18:30:58.994 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8698999999999998e-05 2024-05-08T18:30:58.994 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:58.994 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:58.994 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:58.994 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.994 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.994 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:478 6.a e33/27 6:5127e642:gc::gc.21:head v 33'6, mlcod=33'4)", 2024-05-08T18:30:58.994 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.877617+0000", 2024-05-08T18:30:58.994 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 67.041142257000004, 2024-05-08T18:30:58.994 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0033938589999999999, 2024-05-08T18:30:58.994 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:58.995 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:58.995 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:58.995 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:58.995 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.995 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:58.995 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877617+0000", 2024-05-08T18:30:58.995 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:58.995 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.995 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.995 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:58.995 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877617+0000", 2024-05-08T18:30:58.995 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:58.995 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.995 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.996 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:58.996 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877619+0000", 2024-05-08T18:30:58.996 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.902e-06 2024-05-08T18:30:58.996 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.996 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.996 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:58.996 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877633+0000", 2024-05-08T18:30:58.996 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4143e-05 2024-05-08T18:30:58.996 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.996 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.996 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:58.996 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877667+0000", 2024-05-08T18:30:58.996 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3516999999999998e-05 2024-05-08T18:30:58.996 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.997 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.997 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:58.997 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877685+0000", 2024-05-08T18:30:58.997 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7931000000000002e-05 2024-05-08T18:30:58.997 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.997 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.997 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:58.997 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877842+0000", 2024-05-08T18:30:58.997 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015742800000000001 2024-05-08T18:30:58.997 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.997 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.997 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:58.997 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877890+0000", 2024-05-08T18:30:58.997 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7654000000000001e-05 2024-05-08T18:30:58.998 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.998 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.998 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:58.998 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.880908+0000", 2024-05-08T18:30:58.998 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0030181219999999998 2024-05-08T18:30:58.998 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.998 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.998 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:58.998 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.881011+0000", 2024-05-08T18:30:58.998 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000103162 2024-05-08T18:30:58.998 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:58.998 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:58.998 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:58.999 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:58.999 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.999 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:535 6.1f e33/27 6:fde4dd55:gc::gc.26:head v 33'2, mlcod=0'0)", 2024-05-08T18:30:58.999 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.909602+0000", 2024-05-08T18:30:58.999 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 67.009157811999998, 2024-05-08T18:30:58.999 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0023004039999999998, 2024-05-08T18:30:58.999 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:58.999 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:58.999 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:58.999 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:58.999 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:58.999 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:58.999 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.909602+0000", 2024-05-08T18:30:58.999 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:59.000 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.000 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.000 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:59.000 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.909602+0000", 2024-05-08T18:30:59.000 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:59.000 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.000 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.000 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:59.000 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.909604+0000", 2024-05-08T18:30:59.000 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8360000000000001e-06 2024-05-08T18:30:59.000 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.000 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.000 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:59.001 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.909615+0000", 2024-05-08T18:30:59.001 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1596999999999999e-05 2024-05-08T18:30:59.001 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.001 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.001 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:59.001 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.909643+0000", 2024-05-08T18:30:59.001 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7457000000000002e-05 2024-05-08T18:30:59.001 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.001 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.001 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:59.001 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.909662+0000", 2024-05-08T18:30:59.001 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9052999999999999e-05 2024-05-08T18:30:59.001 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.001 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.002 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:59.002 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.909758+0000", 2024-05-08T18:30:59.002 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6372000000000005e-05 2024-05-08T18:30:59.002 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.002 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.002 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:59.002 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.909780+0000", 2024-05-08T18:30:59.002 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1719999999999999e-05 2024-05-08T18:30:59.002 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.002 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.002 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:59.002 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.911830+0000", 2024-05-08T18:30:59.002 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002050072 2024-05-08T18:30:59.002 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.003 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.003 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:59.003 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.911902+0000", 2024-05-08T18:30:59.003 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.2297000000000003e-05 2024-05-08T18:30:59.003 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:59.003 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:59.003 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:59.003 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.003 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.003 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:541 6.1f e33/27 6:fde4dd55:gc::gc.26:head v 33'3, mlcod=33'1)", 2024-05-08T18:30:59.003 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.913684+0000", 2024-05-08T18:30:59.003 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 67.005075763999997, 2024-05-08T18:30:59.003 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0036425770000000001, 2024-05-08T18:30:59.003 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:59.004 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:59.004 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:59.004 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:59.004 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.004 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:59.004 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.913684+0000", 2024-05-08T18:30:59.004 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:59.004 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.004 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.004 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:59.004 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.913684+0000", 2024-05-08T18:30:59.004 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:59.004 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.004 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.005 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:59.005 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.913685+0000", 2024-05-08T18:30:59.005 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5859999999999999e-06 2024-05-08T18:30:59.005 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.005 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.005 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:59.005 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.913696+0000", 2024-05-08T18:30:59.005 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1080000000000001e-05 2024-05-08T18:30:59.005 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.005 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.005 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:59.005 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.913720+0000", 2024-05-08T18:30:59.005 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3614000000000001e-05 2024-05-08T18:30:59.006 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.006 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.006 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:59.006 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.913740+0000", 2024-05-08T18:30:59.006 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9836000000000001e-05 2024-05-08T18:30:59.006 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.006 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.006 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:59.006 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.913901+0000", 2024-05-08T18:30:59.006 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000161039 2024-05-08T18:30:59.006 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.006 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.006 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:59.007 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.913935+0000", 2024-05-08T18:30:59.007 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4353000000000001e-05 2024-05-08T18:30:59.007 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.007 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.007 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:59.007 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.917225+0000", 2024-05-08T18:30:59.007 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032897669999999999 2024-05-08T18:30:59.007 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.007 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.007 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:59.007 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.917326+0000", 2024-05-08T18:30:59.007 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000101302 2024-05-08T18:30:59.007 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:59.008 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:59.008 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:59.008 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.008 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.008 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:543 6.15 e33/27 6:ae95b544:::obj_delete_at_hint.0000000020:head v 33'5, mlcod=33'3)", 2024-05-08T18:30:59.008 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.916649+0000", 2024-05-08T18:30:59.008 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 67.002110211000002, 2024-05-08T18:30:59.008 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003362739, 2024-05-08T18:30:59.008 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:59.008 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:59.008 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:59.008 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:59.008 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.008 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:59.009 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.916649+0000", 2024-05-08T18:30:59.009 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:59.009 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.009 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.009 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:59.009 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.916649+0000", 2024-05-08T18:30:59.009 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:59.009 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.009 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.009 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:59.009 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.916651+0000", 2024-05-08T18:30:59.009 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7269999999999999e-06 2024-05-08T18:30:59.009 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.009 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.010 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:59.010 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.916663+0000", 2024-05-08T18:30:59.010 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2183e-05 2024-05-08T18:30:59.010 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.010 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.010 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:59.010 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.916691+0000", 2024-05-08T18:30:59.010 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7864e-05 2024-05-08T18:30:59.010 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.010 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.010 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:59.010 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.916710+0000", 2024-05-08T18:30:59.010 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.912e-05 2024-05-08T18:30:59.011 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.011 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.011 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:59.011 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.916851+0000", 2024-05-08T18:30:59.011 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000141163 2024-05-08T18:30:59.011 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.011 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.011 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:59.011 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.916909+0000", 2024-05-08T18:30:59.011 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.7686000000000003e-05 2024-05-08T18:30:59.011 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.011 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.013 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:59.013 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.919900+0000", 2024-05-08T18:30:59.014 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029909540000000001 2024-05-08T18:30:59.014 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.014 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.014 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:59.014 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.920012+0000", 2024-05-08T18:30:59.014 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000112042 2024-05-08T18:30:59.014 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:59.014 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:59.014 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:59.014 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.014 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.014 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:695 6.3 e33/27 6:c31f41d7:gc::gc.10:head v 33'12, mlcod=33'10)", 2024-05-08T18:30:59.014 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.017806+0000", 2024-05-08T18:30:59.014 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 66.900953927000003, 2024-05-08T18:30:59.015 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001718373, 2024-05-08T18:30:59.015 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:59.015 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:59.015 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:59.015 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:59.015 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.015 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:59.015 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.017806+0000", 2024-05-08T18:30:59.015 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:59.015 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.015 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.015 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:59.015 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.017806+0000", 2024-05-08T18:30:59.015 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:59.016 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.016 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.016 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:59.016 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.017807+0000", 2024-05-08T18:30:59.016 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8199999999999999e-06 2024-05-08T18:30:59.016 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.016 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.016 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:59.016 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.017818+0000", 2024-05-08T18:30:59.016 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0519999999999999e-05 2024-05-08T18:30:59.016 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.016 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.016 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:59.016 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.017846+0000", 2024-05-08T18:30:59.017 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7729000000000002e-05 2024-05-08T18:30:59.017 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.017 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.017 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:59.017 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.017859+0000", 2024-05-08T18:30:59.017 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3337e-05 2024-05-08T18:30:59.017 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.017 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.017 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:59.017 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.017990+0000", 2024-05-08T18:30:59.017 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013146499999999999 2024-05-08T18:30:59.017 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.017 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.017 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:59.017 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.018039+0000", 2024-05-08T18:30:59.018 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8816999999999997e-05 2024-05-08T18:30:59.018 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.018 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.018 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:59.018 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.019397+0000", 2024-05-08T18:30:59.018 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0013575359999999999 2024-05-08T18:30:59.018 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.018 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.018 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:59.018 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.019524+0000", 2024-05-08T18:30:59.018 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012714900000000001 2024-05-08T18:30:59.018 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:59.018 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:59.018 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:59.019 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:59.019 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:59.019 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:30:59.020 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-08T18:30:59.021 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:30:59.019+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:30:59.120 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:30:59.119+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:30:59.192 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:30:59.192 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:30:59.192 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 0 2024-05-08T18:30:59.192 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:30:59.207 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-08T18:30:59.221 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:30:59.219+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:30:59.322 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:30:59.319+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:30:59.368 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:30:59.368 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:30:59.368 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2024-05-08T18:30:59.368 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2024-05-08T18:30:59.368 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:30:59.382 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-08T18:30:59.422 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:30:59.419+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:30:59.509 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:30:59.509 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2024-05-08T18:30:59.509 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2024-05-08T18:30:59.509 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-05-08T18:30:59.509 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.510 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:24 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [write 262144~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:59.510 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.154193+0000", 2024-05-08T18:30:59.510 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 92.352547071000004, 2024-05-08T18:30:59.510 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0085494309999999997, 2024-05-08T18:30:59.510 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:59.510 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:59.510 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:59.510 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:59.510 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:59.510 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:59.510 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 24 2024-05-08T18:30:59.510 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.511 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:59.511 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.511 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:59.511 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154193+0000", 2024-05-08T18:30:59.511 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:59.511 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.511 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.511 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:59.511 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154193+0000", 2024-05-08T18:30:59.511 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:59.511 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.511 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.511 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:59.511 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154194+0000", 2024-05-08T18:30:59.512 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.44e-06 2024-05-08T18:30:59.512 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.512 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.512 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:59.512 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154394+0000", 2024-05-08T18:30:59.512 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00019972499999999999 2024-05-08T18:30:59.512 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.512 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.512 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:59.512 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154417+0000", 2024-05-08T18:30:59.512 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2713000000000001e-05 2024-05-08T18:30:59.512 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.512 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.512 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:59.513 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154437+0000", 2024-05-08T18:30:59.513 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0027e-05 2024-05-08T18:30:59.513 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.513 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.513 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:59.513 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.158438+0000", 2024-05-08T18:30:59.513 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0040011459999999997 2024-05-08T18:30:59.513 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.513 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.513 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:59.513 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.158567+0000", 2024-05-08T18:30:59.513 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012923899999999999 2024-05-08T18:30:59.513 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.513 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.514 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:59.514 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.158787+0000", 2024-05-08T18:30:59.514 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000219581 2024-05-08T18:30:59.514 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.514 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.514 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:59.514 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.162013+0000", 2024-05-08T18:30:59.514 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032261759999999999 2024-05-08T18:30:59.514 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.514 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.514 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:59.514 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.162568+0000", 2024-05-08T18:30:59.514 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00055576900000000001 2024-05-08T18:30:59.515 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.515 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.515 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:59.515 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.162644+0000", 2024-05-08T18:30:59.515 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5516e-05 2024-05-08T18:30:59.515 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.515 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.515 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:59.515 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.162742+0000", 2024-05-08T18:30:59.515 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8098999999999997e-05 2024-05-08T18:30:59.515 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:59.515 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:59.515 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:59.515 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.516 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.516 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:25 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:59.516 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.154495+0000", 2024-05-08T18:30:59.516 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 92.352244776999996, 2024-05-08T18:30:59.516 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010784396999999999, 2024-05-08T18:30:59.516 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:59.516 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:59.516 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:59.516 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:59.516 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:59.516 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:59.516 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 25 2024-05-08T18:30:59.516 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.517 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:59.517 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.517 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:59.517 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154495+0000", 2024-05-08T18:30:59.517 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:59.517 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.517 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.517 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:59.517 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154495+0000", 2024-05-08T18:30:59.517 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:59.517 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.517 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.517 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:59.517 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154496+0000", 2024-05-08T18:30:59.518 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.454e-06 2024-05-08T18:30:59.518 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.518 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.518 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:59.518 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154509+0000", 2024-05-08T18:30:59.518 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2496e-05 2024-05-08T18:30:59.518 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.518 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.518 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:59.518 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154531+0000", 2024-05-08T18:30:59.518 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1987000000000001e-05 2024-05-08T18:30:59.518 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.518 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.518 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:59.519 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154547+0000", 2024-05-08T18:30:59.519 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.577e-05 2024-05-08T18:30:59.519 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.519 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.519 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:59.519 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.160949+0000", 2024-05-08T18:30:59.519 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.006401917 2024-05-08T18:30:59.519 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.519 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.519 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:59.519 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.161102+0000", 2024-05-08T18:30:59.519 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000153826 2024-05-08T18:30:59.519 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.519 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.520 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:59.520 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.161332+0000", 2024-05-08T18:30:59.520 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022918099999999999 2024-05-08T18:30:59.520 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.520 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.520 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:59.520 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.163838+0000", 2024-05-08T18:30:59.520 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0025064079999999999 2024-05-08T18:30:59.520 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.520 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.520 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:59.520 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.165121+0000", 2024-05-08T18:30:59.520 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0012825200000000001 2024-05-08T18:30:59.520 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.521 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.521 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:59.521 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.165212+0000", 2024-05-08T18:30:59.521 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1121999999999999e-05 2024-05-08T18:30:59.521 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.521 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.521 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:59.521 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.165279+0000", 2024-05-08T18:30:59.521 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7716e-05 2024-05-08T18:30:59.521 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:59.521 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:59.521 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:59.521 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.521 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.521 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:41 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:59.522 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247174+0000", 2024-05-08T18:30:59.522 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 92.259565795, 2024-05-08T18:30:59.522 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010013393000000001, 2024-05-08T18:30:59.522 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:59.522 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:59.522 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:59.522 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:59.522 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:59.522 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:59.522 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 41 2024-05-08T18:30:59.522 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.522 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:59.522 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.523 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:59.523 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247174+0000", 2024-05-08T18:30:59.523 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:59.523 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.523 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.523 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:59.523 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247174+0000", 2024-05-08T18:30:59.523 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:59.523 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.523 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.523 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:59.523 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247175+0000", 2024-05-08T18:30:59.523 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.9999999999999995e-07 2024-05-08T18:30:59.523 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.524 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.524 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:59.524 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247277+0000", 2024-05-08T18:30:59.524 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010243600000000001 2024-05-08T18:30:59.524 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.524 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.524 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:59.524 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247291+0000", 2024-05-08T18:30:59.524 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4076999999999999e-05 2024-05-08T18:30:59.524 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.524 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.524 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:59.524 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247301+0000", 2024-05-08T18:30:59.524 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0010000000000001e-05 2024-05-08T18:30:59.525 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.525 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.525 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:59.525 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.249555+0000", 2024-05-08T18:30:59.525 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0022539050000000001 2024-05-08T18:30:59.525 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.525 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.525 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:59.525 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.249700+0000", 2024-05-08T18:30:59.525 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014484599999999999 2024-05-08T18:30:59.525 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.525 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.525 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:59.525 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.249929+0000", 2024-05-08T18:30:59.525 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022904499999999999 2024-05-08T18:30:59.526 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.526 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.526 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:59.526 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.253695+0000", 2024-05-08T18:30:59.526 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0037656640000000002 2024-05-08T18:30:59.526 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.526 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.526 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:59.526 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.256970+0000", 2024-05-08T18:30:59.526 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003274608 2024-05-08T18:30:59.526 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.526 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.526 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:59.527 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.257052+0000", 2024-05-08T18:30:59.527 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2223000000000002e-05 2024-05-08T18:30:59.527 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.527 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.527 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:59.527 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.257187+0000", 2024-05-08T18:30:59.527 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013557900000000001 2024-05-08T18:30:59.527 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:59.527 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:59.527 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:59.527 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.527 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.527 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:42 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:59.527 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247321+0000", 2024-05-08T18:30:59.528 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 92.259418475999993, 2024-05-08T18:30:59.528 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013168572, 2024-05-08T18:30:59.528 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:59.528 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:59.528 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:59.528 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:59.528 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:59.528 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:59.528 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 42 2024-05-08T18:30:59.528 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.528 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:59.528 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.528 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:59.528 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247321+0000", 2024-05-08T18:30:59.529 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:59.529 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.529 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.529 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:59.529 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247321+0000", 2024-05-08T18:30:59.529 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:59.529 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.529 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.529 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:59.529 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247323+0000", 2024-05-08T18:30:59.529 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.24e-06 2024-05-08T18:30:59.529 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.529 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.529 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:59.530 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247329+0000", 2024-05-08T18:30:59.530 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1530000000000002e-06 2024-05-08T18:30:59.530 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.530 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.530 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:59.530 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247339+0000", 2024-05-08T18:30:59.530 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0387000000000001e-05 2024-05-08T18:30:59.530 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.530 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.530 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:59.530 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247347+0000", 2024-05-08T18:30:59.530 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9829999999999996e-06 2024-05-08T18:30:59.530 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.530 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.531 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:59.531 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.251488+0000", 2024-05-08T18:30:59.531 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0041412849999999998 2024-05-08T18:30:59.531 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.531 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.531 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:59.531 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.251672+0000", 2024-05-08T18:30:59.531 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00018354499999999999 2024-05-08T18:30:59.531 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.531 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.531 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:59.531 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.251949+0000", 2024-05-08T18:30:59.531 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00027695399999999999 2024-05-08T18:30:59.532 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.532 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.532 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:59.532 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.253810+0000", 2024-05-08T18:30:59.532 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001860806 2024-05-08T18:30:59.532 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.532 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.532 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:59.532 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260244+0000", 2024-05-08T18:30:59.532 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0064347939999999998 2024-05-08T18:30:59.532 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.532 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.532 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:59.532 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260376+0000", 2024-05-08T18:30:59.532 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000131829 2024-05-08T18:30:59.533 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.533 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.533 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:59.533 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260490+0000", 2024-05-08T18:30:59.533 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000113596 2024-05-08T18:30:59.533 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:59.533 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:59.533 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:59.533 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.533 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.533 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:43 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:59.533 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247367+0000", 2024-05-08T18:30:59.533 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 92.259372562999999, 2024-05-08T18:30:59.533 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013449025999999999, 2024-05-08T18:30:59.533 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:59.534 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:59.534 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:59.534 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:59.534 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:59.534 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:59.534 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 43 2024-05-08T18:30:59.534 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.534 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:59.534 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.534 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:59.534 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247367+0000", 2024-05-08T18:30:59.534 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:59.534 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.535 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.535 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:59.535 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247367+0000", 2024-05-08T18:30:59.535 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:59.535 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.535 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.535 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:59.535 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247368+0000", 2024-05-08T18:30:59.535 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1999999999999999e-07 2024-05-08T18:30:59.535 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.535 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.535 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:59.535 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247374+0000", 2024-05-08T18:30:59.535 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.19e-06 2024-05-08T18:30:59.535 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.536 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.536 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:59.536 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247384+0000", 2024-05-08T18:30:59.536 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0173000000000001e-05 2024-05-08T18:30:59.536 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.536 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.536 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:59.536 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247392+0000", 2024-05-08T18:30:59.536 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1869999999999997e-06 2024-05-08T18:30:59.536 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.536 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.536 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:59.536 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.252515+0000", 2024-05-08T18:30:59.536 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0051221399999999999 2024-05-08T18:30:59.537 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.537 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.537 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:59.537 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.252641+0000", 2024-05-08T18:30:59.537 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012609200000000001 2024-05-08T18:30:59.537 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.537 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.537 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:59.537 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.252842+0000", 2024-05-08T18:30:59.537 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000201619 2024-05-08T18:30:59.537 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.537 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.537 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:59.538 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.256828+0000", 2024-05-08T18:30:59.538 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039853989999999997 2024-05-08T18:30:59.538 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.538 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.538 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:59.538 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260515+0000", 2024-05-08T18:30:59.538 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0036875419999999998 2024-05-08T18:30:59.538 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.538 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.538 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:59.538 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260718+0000", 2024-05-08T18:30:59.538 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020229499999999999 2024-05-08T18:30:59.538 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.539 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.539 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:59.539 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260816+0000", 2024-05-08T18:30:59.539 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8669e-05 2024-05-08T18:30:59.539 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:59.539 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:59.539 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:59.539 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.539 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.539 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:59.539 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247466+0000", 2024-05-08T18:30:59.539 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 92.259273977000007, 2024-05-08T18:30:59.539 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013491806, 2024-05-08T18:30:59.539 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:59.540 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:59.540 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:59.540 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:59.540 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:59.540 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:59.540 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 44 2024-05-08T18:30:59.540 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.540 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:59.540 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.540 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:59.540 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247466+0000", 2024-05-08T18:30:59.540 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:59.540 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.540 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.541 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:59.541 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247466+0000", 2024-05-08T18:30:59.541 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:59.541 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.541 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.541 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:59.541 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247467+0000", 2024-05-08T18:30:59.541 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.263e-06 2024-05-08T18:30:59.541 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.541 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.541 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:59.541 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247585+0000", 2024-05-08T18:30:59.542 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011756600000000001 2024-05-08T18:30:59.542 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.542 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.542 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:59.542 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247598+0000", 2024-05-08T18:30:59.542 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3766e-05 2024-05-08T18:30:59.542 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.542 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.542 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:59.542 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247609+0000", 2024-05-08T18:30:59.542 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0604e-05 2024-05-08T18:30:59.542 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.542 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.543 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:59.543 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.253890+0000", 2024-05-08T18:30:59.543 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0062810440000000004 2024-05-08T18:30:59.543 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.543 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.543 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:59.543 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.254068+0000", 2024-05-08T18:30:59.543 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017848199999999999 2024-05-08T18:30:59.543 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.543 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.543 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:59.543 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.254488+0000", 2024-05-08T18:30:59.543 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00041965399999999999 2024-05-08T18:30:59.543 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.544 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.544 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:59.544 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.256949+0000", 2024-05-08T18:30:59.544 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002461254 2024-05-08T18:30:59.544 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.544 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.544 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:59.544 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260832+0000", 2024-05-08T18:30:59.544 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0038830539999999999 2024-05-08T18:30:59.544 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.544 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.544 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:59.544 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260906+0000", 2024-05-08T18:30:59.544 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3455999999999996e-05 2024-05-08T18:30:59.545 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.545 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.545 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:59.545 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260958+0000", 2024-05-08T18:30:59.545 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1663000000000003e-05 2024-05-08T18:30:59.545 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:59.545 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:59.545 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:59.545 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.545 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.545 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:59.545 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247630+0000", 2024-05-08T18:30:59.545 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 92.259109572, 2024-05-08T18:30:59.545 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013478753, 2024-05-08T18:30:59.546 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:59.546 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:59.546 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:59.546 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:59.546 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:59.546 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:59.546 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 45 2024-05-08T18:30:59.546 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.546 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:59.546 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.546 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:59.546 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247630+0000", 2024-05-08T18:30:59.546 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:59.547 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.547 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.547 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:59.547 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247630+0000", 2024-05-08T18:30:59.547 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:59.547 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.547 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.547 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:59.547 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247631+0000", 2024-05-08T18:30:59.547 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7399999999999991e-07 2024-05-08T18:30:59.547 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.547 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.547 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:59.547 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247637+0000", 2024-05-08T18:30:59.548 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.93e-06 2024-05-08T18:30:59.548 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.548 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.548 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:59.548 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247647+0000", 2024-05-08T18:30:59.548 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7459999999999995e-06 2024-05-08T18:30:59.548 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.548 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.548 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:59.548 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247654+0000", 2024-05-08T18:30:59.548 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4039999999999998e-06 2024-05-08T18:30:59.548 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.548 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.549 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:59.549 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.255829+0000", 2024-05-08T18:30:59.549 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0081749059999999991 2024-05-08T18:30:59.549 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.549 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.549 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:59.549 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.255979+0000", 2024-05-08T18:30:59.549 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015027899999999999 2024-05-08T18:30:59.549 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.549 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.549 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:59.549 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.256185+0000", 2024-05-08T18:30:59.549 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020583900000000001 2024-05-08T18:30:59.549 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.550 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.550 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:59.550 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260097+0000", 2024-05-08T18:30:59.550 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039121929999999996 2024-05-08T18:30:59.550 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.550 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.550 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:59.550 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260973+0000", 2024-05-08T18:30:59.550 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00087591999999999998 2024-05-08T18:30:59.550 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.550 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.550 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:59.550 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261056+0000", 2024-05-08T18:30:59.550 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3104999999999998e-05 2024-05-08T18:30:59.551 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.551 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.551 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:59.551 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261109+0000", 2024-05-08T18:30:59.551 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2457000000000003e-05 2024-05-08T18:30:59.551 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:59.551 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:59.551 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:59.551 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.551 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.551 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:59.551 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247667+0000", 2024-05-08T18:30:59.551 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 92.259072291999999, 2024-05-08T18:30:59.552 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013569098999999999, 2024-05-08T18:30:59.552 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:59.552 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:59.552 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:59.552 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:59.552 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:59.552 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:59.552 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 46 2024-05-08T18:30:59.552 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.552 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:59.552 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.552 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:59.552 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247667+0000", 2024-05-08T18:30:59.552 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:59.553 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.553 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.553 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:59.553 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247667+0000", 2024-05-08T18:30:59.553 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:59.553 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.553 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.553 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:59.553 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247668+0000", 2024-05-08T18:30:59.553 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7999999999999995e-07 2024-05-08T18:30:59.553 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.553 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.553 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:59.553 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247674+0000", 2024-05-08T18:30:59.554 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4369999999999998e-06 2024-05-08T18:30:59.554 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.554 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.554 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:59.554 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247683+0000", 2024-05-08T18:30:59.554 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4360000000000008e-06 2024-05-08T18:30:59.554 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.554 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.554 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:59.554 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247690+0000", 2024-05-08T18:30:59.554 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.43e-06 2024-05-08T18:30:59.554 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.554 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.555 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:59.555 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.257358+0000", 2024-05-08T18:30:59.555 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0096676890000000001 2024-05-08T18:30:59.555 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.555 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.555 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:59.555 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.257626+0000", 2024-05-08T18:30:59.555 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00026819099999999998 2024-05-08T18:30:59.555 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.555 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.555 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:59.555 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.258041+0000", 2024-05-08T18:30:59.555 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00041438400000000001 2024-05-08T18:30:59.555 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.556 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.556 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:59.556 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260224+0000", 2024-05-08T18:30:59.556 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0021830700000000001 2024-05-08T18:30:59.556 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.556 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.556 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:59.556 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261127+0000", 2024-05-08T18:30:59.556 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00090292300000000003 2024-05-08T18:30:59.556 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.556 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.556 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:59.556 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261191+0000", 2024-05-08T18:30:59.556 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4342000000000002e-05 2024-05-08T18:30:59.557 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.557 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.557 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:59.557 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261237+0000", 2024-05-08T18:30:59.557 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.5516999999999998e-05 2024-05-08T18:30:59.557 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:59.557 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:59.557 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:59.557 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.557 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.557 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:59.557 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247703+0000", 2024-05-08T18:30:59.557 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 92.259036808999994, 2024-05-08T18:30:59.557 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015020204000000001, 2024-05-08T18:30:59.558 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:59.558 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:59.558 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:59.558 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:59.558 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:59.558 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:59.558 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 47 2024-05-08T18:30:59.558 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.558 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:59.558 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.558 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:59.558 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247703+0000", 2024-05-08T18:30:59.558 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:59.559 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.559 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.559 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:59.559 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247703+0000", 2024-05-08T18:30:59.559 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:59.559 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.559 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.559 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:59.559 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247704+0000", 2024-05-08T18:30:59.559 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8299999999999996e-07 2024-05-08T18:30:59.559 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.559 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.559 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:59.559 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247877+0000", 2024-05-08T18:30:59.560 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000172979 2024-05-08T18:30:59.560 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.560 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.560 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:59.560 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247894+0000", 2024-05-08T18:30:59.560 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6912999999999999e-05 2024-05-08T18:30:59.560 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.560 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.560 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:59.560 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247903+0000", 2024-05-08T18:30:59.560 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1770000000000004e-06 2024-05-08T18:30:59.560 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.560 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.560 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:59.561 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.258767+0000", 2024-05-08T18:30:59.561 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010864409 2024-05-08T18:30:59.561 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.561 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.561 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:59.561 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.258898+0000", 2024-05-08T18:30:59.561 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000131199 2024-05-08T18:30:59.561 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.561 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.561 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:59.561 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.259117+0000", 2024-05-08T18:30:59.561 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000218889 2024-05-08T18:30:59.561 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.561 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.562 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:59.562 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.262372+0000", 2024-05-08T18:30:59.562 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032545679999999998 2024-05-08T18:30:59.562 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.562 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.562 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:59.562 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.262432+0000", 2024-05-08T18:30:59.562 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9913e-05 2024-05-08T18:30:59.562 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.562 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.562 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:59.562 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.262585+0000", 2024-05-08T18:30:59.562 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015361800000000001 2024-05-08T18:30:59.563 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.563 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.563 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:59.563 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.262723+0000", 2024-05-08T18:30:59.563 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000137856 2024-05-08T18:30:59.563 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:59.563 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:59.563 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:59.563 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.563 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.563 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:59.563 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247927+0000", 2024-05-08T18:30:59.563 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 92.258812770999995, 2024-05-08T18:30:59.563 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018387718000000001, 2024-05-08T18:30:59.564 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:59.564 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:59.564 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:59.564 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:59.564 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:59.564 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:59.564 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 48 2024-05-08T18:30:59.564 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.564 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:59.564 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.564 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:59.564 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247927+0000", 2024-05-08T18:30:59.564 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:59.565 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.565 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.565 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:59.565 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247927+0000", 2024-05-08T18:30:59.565 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:59.565 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.565 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.565 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:59.565 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247928+0000", 2024-05-08T18:30:59.565 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8400000000000003e-07 2024-05-08T18:30:59.565 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.565 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.565 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:59.565 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247935+0000", 2024-05-08T18:30:59.566 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1230000000000002e-06 2024-05-08T18:30:59.566 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.566 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.566 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:59.566 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247945+0000", 2024-05-08T18:30:59.566 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0346000000000001e-05 2024-05-08T18:30:59.566 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.566 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.566 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:59.566 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247953+0000", 2024-05-08T18:30:59.566 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8040000000000002e-06 2024-05-08T18:30:59.566 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.566 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.567 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:59.567 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261292+0000", 2024-05-08T18:30:59.567 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013339337 2024-05-08T18:30:59.567 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.567 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.567 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:59.567 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261424+0000", 2024-05-08T18:30:59.567 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013201900000000001 2024-05-08T18:30:59.567 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.567 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.567 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:59.567 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261628+0000", 2024-05-08T18:30:59.567 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020327499999999999 2024-05-08T18:30:59.568 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.568 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.568 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:59.568 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.263849+0000", 2024-05-08T18:30:59.568 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0022209759999999999 2024-05-08T18:30:59.568 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.568 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.568 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:59.568 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266167+0000", 2024-05-08T18:30:59.568 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002317979 2024-05-08T18:30:59.568 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.568 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.568 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:59.568 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266249+0000", 2024-05-08T18:30:59.569 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1996000000000006e-05 2024-05-08T18:30:59.569 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.569 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.569 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:59.569 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266315+0000", 2024-05-08T18:30:59.569 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5979e-05 2024-05-08T18:30:59.569 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:59.569 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:59.569 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:59.569 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.569 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.569 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:59.569 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247966+0000", 2024-05-08T18:30:59.570 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 92.258773837999996, 2024-05-08T18:30:59.570 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0194153, 2024-05-08T18:30:59.570 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:59.570 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:59.570 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:59.570 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:59.570 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:59.570 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:59.570 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 49 2024-05-08T18:30:59.570 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.570 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:59.570 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.570 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:59.571 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247966+0000", 2024-05-08T18:30:59.571 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:59.571 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.571 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.571 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:59.571 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247966+0000", 2024-05-08T18:30:59.571 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:59.571 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.571 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.571 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:59.571 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247967+0000", 2024-05-08T18:30:59.571 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0299999999999998e-07 2024-05-08T18:30:59.571 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.572 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.572 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:59.572 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247972+0000", 2024-05-08T18:30:59.572 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3600000000000004e-06 2024-05-08T18:30:59.572 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.572 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.572 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:59.572 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247981+0000", 2024-05-08T18:30:59.572 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.234e-06 2024-05-08T18:30:59.572 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.572 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.572 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:59.572 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247989+0000", 2024-05-08T18:30:59.572 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5159999999999997e-06 2024-05-08T18:30:59.573 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.573 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.573 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:59.573 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.262816+0000", 2024-05-08T18:30:59.573 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.014827399999999999 2024-05-08T18:30:59.573 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.573 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.573 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:59.573 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.262948+0000", 2024-05-08T18:30:59.573 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013166799999999999 2024-05-08T18:30:59.573 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.573 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.573 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:59.573 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.263153+0000", 2024-05-08T18:30:59.574 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000205272 2024-05-08T18:30:59.574 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.574 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.574 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:59.574 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266144+0000", 2024-05-08T18:30:59.574 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029912300000000001 2024-05-08T18:30:59.574 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.574 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.574 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:59.574 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.267226+0000", 2024-05-08T18:30:59.574 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010820580000000001 2024-05-08T18:30:59.574 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.574 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.575 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:59.575 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.267315+0000", 2024-05-08T18:30:59.575 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8793000000000002e-05 2024-05-08T18:30:59.575 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.575 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.575 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:59.575 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.267381+0000", 2024-05-08T18:30:59.575 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6066000000000001e-05 2024-05-08T18:30:59.575 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:59.575 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:59.575 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:59.575 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.576 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.576 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:59.576 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.248003+0000", 2024-05-08T18:30:59.576 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 92.258736537999994, 2024-05-08T18:30:59.576 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.020859638999999999, 2024-05-08T18:30:59.576 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:59.576 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:59.576 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:59.576 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:59.576 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:59.576 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:59.576 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 50 2024-05-08T18:30:59.576 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.577 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:59.577 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.577 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:59.577 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248003+0000", 2024-05-08T18:30:59.577 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:59.577 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.577 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.577 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:59.577 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248003+0000", 2024-05-08T18:30:59.577 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:59.577 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.577 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.577 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:59.577 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248004+0000", 2024-05-08T18:30:59.578 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5300000000000003e-07 2024-05-08T18:30:59.578 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.578 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.578 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:59.578 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248139+0000", 2024-05-08T18:30:59.578 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000135193 2024-05-08T18:30:59.578 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.578 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.578 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:59.578 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248151+0000", 2024-05-08T18:30:59.578 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.19e-05 2024-05-08T18:30:59.578 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.578 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.579 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:59.579 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248161+0000", 2024-05-08T18:30:59.579 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4599999999999992e-06 2024-05-08T18:30:59.579 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.579 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.579 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:59.579 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.263961+0000", 2024-05-08T18:30:59.579 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015800844000000001 2024-05-08T18:30:59.579 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.579 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.579 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:59.579 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.264091+0000", 2024-05-08T18:30:59.579 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012952300000000001 2024-05-08T18:30:59.580 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.580 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.580 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:59.580 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.264306+0000", 2024-05-08T18:30:59.580 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000215541 2024-05-08T18:30:59.580 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.580 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.580 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:59.580 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.267205+0000", 2024-05-08T18:30:59.580 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0028989910000000001 2024-05-08T18:30:59.580 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.580 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.580 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:59.580 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.268631+0000", 2024-05-08T18:30:59.581 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0014257320000000001 2024-05-08T18:30:59.581 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.581 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.581 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:59.581 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.268781+0000", 2024-05-08T18:30:59.581 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000149939 2024-05-08T18:30:59.581 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.581 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.581 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:59.581 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.268863+0000", 2024-05-08T18:30:59.581 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1762999999999996e-05 2024-05-08T18:30:59.581 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:59.581 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:59.581 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:59.582 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.582 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.582 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:59.582 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.248201+0000", 2024-05-08T18:30:59.582 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 92.258538783000006, 2024-05-08T18:30:59.582 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.022909783, 2024-05-08T18:30:59.582 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:59.582 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:59.582 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:59.582 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:59.582 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:59.582 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:59.583 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 51 2024-05-08T18:30:59.583 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.583 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:59.583 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.583 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:59.583 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248201+0000", 2024-05-08T18:30:59.583 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:59.583 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.583 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.583 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:59.583 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248201+0000", 2024-05-08T18:30:59.583 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:59.583 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.584 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.584 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:59.584 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248202+0000", 2024-05-08T18:30:59.584 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2999999999999999e-07 2024-05-08T18:30:59.584 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.584 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.584 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:59.584 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248209+0000", 2024-05-08T18:30:59.584 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5769999999999996e-06 2024-05-08T18:30:59.584 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.584 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.584 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:59.584 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248221+0000", 2024-05-08T18:30:59.585 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1165999999999999e-05 2024-05-08T18:30:59.585 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.585 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.585 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:59.585 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248229+0000", 2024-05-08T18:30:59.585 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1529999999999997e-06 2024-05-08T18:30:59.585 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.585 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.585 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:59.585 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.265146+0000", 2024-05-08T18:30:59.585 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016917492999999999 2024-05-08T18:30:59.585 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.585 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.586 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:59.586 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.265282+0000", 2024-05-08T18:30:59.586 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013597199999999999 2024-05-08T18:30:59.586 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.586 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.586 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:59.586 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.265488+0000", 2024-05-08T18:30:59.586 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000206212 2024-05-08T18:30:59.586 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.586 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.586 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:59.586 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.268442+0000", 2024-05-08T18:30:59.586 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002953841 2024-05-08T18:30:59.586 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.587 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.587 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:59.587 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.270951+0000", 2024-05-08T18:30:59.587 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0025085670000000002 2024-05-08T18:30:59.587 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.587 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.587 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:59.587 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.271042+0000", 2024-05-08T18:30:59.587 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1485999999999998e-05 2024-05-08T18:30:59.587 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.587 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.587 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:59.587 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.271111+0000", 2024-05-08T18:30:59.587 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8386000000000006e-05 2024-05-08T18:30:59.587 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:59.588 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:59.588 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:59.588 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.588 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.588 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:59.588 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.248244+0000", 2024-05-08T18:30:59.588 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 92.258496226999995, 2024-05-08T18:30:59.588 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.023010806000000002, 2024-05-08T18:30:59.588 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:59.588 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:59.588 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:59.588 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:59.588 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:59.589 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:59.589 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 52 2024-05-08T18:30:59.589 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.589 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:59.589 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.589 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:59.589 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248244+0000", 2024-05-08T18:30:59.589 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:59.589 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.589 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.589 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:59.589 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248244+0000", 2024-05-08T18:30:59.589 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:59.590 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.590 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.590 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:59.590 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248244+0000", 2024-05-08T18:30:59.590 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0999999999999998e-07 2024-05-08T18:30:59.590 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.590 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.590 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:59.590 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248251+0000", 2024-05-08T18:30:59.590 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9639999999999997e-06 2024-05-08T18:30:59.590 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.590 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.591 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:59.591 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248266+0000", 2024-05-08T18:30:59.591 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4996e-05 2024-05-08T18:30:59.591 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.591 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.591 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:59.591 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248274+0000", 2024-05-08T18:30:59.591 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8299999999999996e-06 2024-05-08T18:30:59.591 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.591 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.591 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:59.591 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266367+0000", 2024-05-08T18:30:59.591 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018092607 2024-05-08T18:30:59.591 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.592 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.592 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:59.592 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266532+0000", 2024-05-08T18:30:59.592 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016569600000000001 2024-05-08T18:30:59.592 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.592 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.592 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:59.592 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266729+0000", 2024-05-08T18:30:59.592 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00019630099999999999 2024-05-08T18:30:59.592 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.592 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.592 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:59.592 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.268574+0000", 2024-05-08T18:30:59.593 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0018452329999999999 2024-05-08T18:30:59.593 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.593 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.593 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:59.593 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.271128+0000", 2024-05-08T18:30:59.593 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00255369 2024-05-08T18:30:59.593 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.593 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.593 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:59.593 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.271199+0000", 2024-05-08T18:30:59.593 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1712999999999996e-05 2024-05-08T18:30:59.593 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.593 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.593 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:59.594 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.271254+0000", 2024-05-08T18:30:59.594 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5065999999999998e-05 2024-05-08T18:30:59.594 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:59.594 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:59.594 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:59.594 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.594 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.594 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:59.594 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.486052+0000", 2024-05-08T18:30:59.594 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 92.020687783, 2024-05-08T18:30:59.594 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0098898389999999992, 2024-05-08T18:30:59.594 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:59.594 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:59.595 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:59.595 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:59.595 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:59.595 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:59.595 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 72 2024-05-08T18:30:59.595 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.595 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:59.595 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.595 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:59.595 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486052+0000", 2024-05-08T18:30:59.595 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:59.595 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.595 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.595 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:59.596 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486052+0000", 2024-05-08T18:30:59.596 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:59.596 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.596 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.596 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:59.596 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486053+0000", 2024-05-08T18:30:59.596 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1200000000000001e-07 2024-05-08T18:30:59.596 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.596 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.596 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:59.596 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486188+0000", 2024-05-08T18:30:59.596 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013526200000000001 2024-05-08T18:30:59.597 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.597 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.597 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:59.597 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486205+0000", 2024-05-08T18:30:59.597 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6742e-05 2024-05-08T18:30:59.597 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.597 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.597 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:59.597 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486215+0000", 2024-05-08T18:30:59.597 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8290000000000003e-06 2024-05-08T18:30:59.597 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.597 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.597 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:59.597 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.491930+0000", 2024-05-08T18:30:59.597 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0057153660000000004 2024-05-08T18:30:59.598 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.598 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.598 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:59.598 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.491995+0000", 2024-05-08T18:30:59.598 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5289000000000005e-05 2024-05-08T18:30:59.598 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.598 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.598 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:59.598 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.492096+0000", 2024-05-08T18:30:59.598 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010101400000000001 2024-05-08T18:30:59.598 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.598 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.598 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:59.599 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.494152+0000", 2024-05-08T18:30:59.599 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0020560740000000002 2024-05-08T18:30:59.599 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.599 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.599 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:59.599 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.495860+0000", 2024-05-08T18:30:59.599 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0017076159999999999 2024-05-08T18:30:59.599 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.599 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.599 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:59.599 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.495903+0000", 2024-05-08T18:30:59.599 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3009000000000001e-05 2024-05-08T18:30:59.599 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.600 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.600 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:59.600 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.495942+0000", 2024-05-08T18:30:59.600 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8726000000000002e-05 2024-05-08T18:30:59.600 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:59.600 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:59.600 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:59.600 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.600 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.600 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:59.600 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.486234+0000", 2024-05-08T18:30:59.600 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 92.020505714999999, 2024-05-08T18:30:59.600 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0099742340000000002, 2024-05-08T18:30:59.600 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:59.601 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:59.601 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:59.601 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:59.601 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:59.601 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:59.601 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 73 2024-05-08T18:30:59.601 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.601 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:59.601 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.601 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:59.601 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486234+0000", 2024-05-08T18:30:59.601 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:59.601 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.602 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.602 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:59.602 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486234+0000", 2024-05-08T18:30:59.602 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:59.602 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.602 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.602 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:59.602 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486235+0000", 2024-05-08T18:30:59.602 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.108e-06 2024-05-08T18:30:59.602 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.602 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.602 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:59.602 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486241+0000", 2024-05-08T18:30:59.602 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4e-06 2024-05-08T18:30:59.603 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.603 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.603 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:59.603 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486251+0000", 2024-05-08T18:30:59.603 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0209e-05 2024-05-08T18:30:59.603 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.603 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.603 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:59.603 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486260+0000", 2024-05-08T18:30:59.603 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2709999999999998e-06 2024-05-08T18:30:59.603 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.603 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.603 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:59.603 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.493294+0000", 2024-05-08T18:30:59.604 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0070341070000000004 2024-05-08T18:30:59.604 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.604 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.604 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:59.604 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.493370+0000", 2024-05-08T18:30:59.604 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5846999999999994e-05 2024-05-08T18:30:59.604 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.604 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.604 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:59.604 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.493479+0000", 2024-05-08T18:30:59.604 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010905500000000001 2024-05-08T18:30:59.604 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.604 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.605 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:59.605 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.495950+0000", 2024-05-08T18:30:59.605 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0024709749999999998 2024-05-08T18:30:59.605 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.605 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.605 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:59.605 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496023+0000", 2024-05-08T18:30:59.605 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3071999999999994e-05 2024-05-08T18:30:59.605 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.605 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.605 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:59.605 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496091+0000", 2024-05-08T18:30:59.605 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7646999999999998e-05 2024-05-08T18:30:59.605 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.606 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.606 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:59.606 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496208+0000", 2024-05-08T18:30:59.606 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000117543 2024-05-08T18:30:59.606 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:59.606 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:59.606 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:59.606 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.606 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.606 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:59.606 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.486276+0000", 2024-05-08T18:30:59.606 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 92.020463390000003, 2024-05-08T18:30:59.606 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010822577, 2024-05-08T18:30:59.607 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:59.607 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:59.607 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:59.607 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:59.607 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:59.607 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:59.607 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 74 2024-05-08T18:30:59.607 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.607 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:59.607 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.607 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:59.607 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486276+0000", 2024-05-08T18:30:59.607 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:59.607 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.608 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.608 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:59.608 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486276+0000", 2024-05-08T18:30:59.608 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:59.608 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.608 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.608 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:59.608 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486277+0000", 2024-05-08T18:30:59.608 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1699999999999997e-07 2024-05-08T18:30:59.608 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.608 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.608 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:59.609 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486282+0000", 2024-05-08T18:30:59.609 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0429999999999998e-06 2024-05-08T18:30:59.609 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.609 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.609 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:59.609 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486294+0000", 2024-05-08T18:30:59.609 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1717e-05 2024-05-08T18:30:59.609 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.609 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.609 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:59.609 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486303+0000", 2024-05-08T18:30:59.609 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.3999999999999998e-06 2024-05-08T18:30:59.609 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.609 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.610 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:59.610 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.494424+0000", 2024-05-08T18:30:59.610 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0081205960000000008 2024-05-08T18:30:59.610 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.610 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.610 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:59.610 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.494539+0000", 2024-05-08T18:30:59.610 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000115661 2024-05-08T18:30:59.610 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.610 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.610 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:59.610 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.494704+0000", 2024-05-08T18:30:59.610 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016422999999999999 2024-05-08T18:30:59.611 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.611 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.611 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:59.611 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496800+0000", 2024-05-08T18:30:59.611 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002096508 2024-05-08T18:30:59.611 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.611 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.611 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:59.611 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496889+0000", 2024-05-08T18:30:59.611 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8349000000000004e-05 2024-05-08T18:30:59.611 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.611 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.611 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:59.612 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496983+0000", 2024-05-08T18:30:59.612 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4882000000000004e-05 2024-05-08T18:30:59.612 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.612 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.612 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:59.612 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.497099+0000", 2024-05-08T18:30:59.612 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000115474 2024-05-08T18:30:59.612 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:59.612 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:59.612 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:59.612 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.612 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.612 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:59.613 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.486324+0000", 2024-05-08T18:30:59.613 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 92.020415369999995, 2024-05-08T18:30:59.613 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010949207000000001, 2024-05-08T18:30:59.613 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:59.613 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:59.613 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:59.613 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:59.613 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:59.613 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:59.613 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 75 2024-05-08T18:30:59.613 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.613 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:59.613 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.613 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:59.613 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486324+0000", 2024-05-08T18:30:59.614 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:59.614 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.614 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.614 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:59.614 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486324+0000", 2024-05-08T18:30:59.614 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:59.614 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.614 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.614 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:59.614 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486325+0000", 2024-05-08T18:30:59.614 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6200000000000006e-07 2024-05-08T18:30:59.614 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.614 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.615 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:59.615 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486439+0000", 2024-05-08T18:30:59.615 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000113391 2024-05-08T18:30:59.615 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.615 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.615 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:59.615 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486455+0000", 2024-05-08T18:30:59.615 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5823000000000001e-05 2024-05-08T18:30:59.615 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.615 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.615 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:59.615 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486465+0000", 2024-05-08T18:30:59.615 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0879999999999999e-05 2024-05-08T18:30:59.615 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.616 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.616 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:59.616 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.495149+0000", 2024-05-08T18:30:59.616 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0086833589999999999 2024-05-08T18:30:59.616 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.616 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.616 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:59.616 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.495213+0000", 2024-05-08T18:30:59.616 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4176000000000004e-05 2024-05-08T18:30:59.616 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.616 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.616 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:59.616 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.495350+0000", 2024-05-08T18:30:59.616 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013709099999999999 2024-05-08T18:30:59.616 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.617 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.617 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:59.617 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496809+0000", 2024-05-08T18:30:59.617 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001458953 2024-05-08T18:30:59.617 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.617 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.617 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:59.617 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.497199+0000", 2024-05-08T18:30:59.617 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00039045200000000001 2024-05-08T18:30:59.617 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.617 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.617 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:59.617 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.497241+0000", 2024-05-08T18:30:59.617 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1378999999999998e-05 2024-05-08T18:30:59.618 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.618 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.618 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:59.618 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.497274+0000", 2024-05-08T18:30:59.618 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2740999999999997e-05 2024-05-08T18:30:59.618 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:59.618 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:59.618 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:59.618 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.618 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.621 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:59.621 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.486483+0000", 2024-05-08T18:30:59.621 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 92.020257194999999, 2024-05-08T18:30:59.621 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011783448, 2024-05-08T18:30:59.621 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:59.622 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:59.622 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:59.622 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:59.622 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:59.622 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:59.622 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 76 2024-05-08T18:30:59.622 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.622 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:59.622 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.622 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:59.622 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486483+0000", 2024-05-08T18:30:59.622 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:59.622 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.622 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.623 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:59.623 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486483+0000", 2024-05-08T18:30:59.623 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:59.623 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.623 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.623 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:59.623 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486483+0000", 2024-05-08T18:30:59.623 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6599999999999995e-07 2024-05-08T18:30:59.623 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.623 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.623 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:59.623 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486491+0000", 2024-05-08T18:30:59.623 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.2520000000000002e-06 2024-05-08T18:30:59.623 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.623 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.624 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:59.624 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486500+0000", 2024-05-08T18:30:59.624 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4420000000000004e-06 2024-05-08T18:30:59.624 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.624 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.624 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:59.624 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486507+0000", 2024-05-08T18:30:59.624 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3549999999999999e-06 2024-05-08T18:30:59.624 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.624 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.624 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:59.624 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496319+0000", 2024-05-08T18:30:59.624 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0098120529999999994 2024-05-08T18:30:59.624 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.625 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.625 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:59.625 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496391+0000", 2024-05-08T18:30:59.625 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1433000000000005e-05 2024-05-08T18:30:59.625 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.625 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.625 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:59.625 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496508+0000", 2024-05-08T18:30:59.625 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000116778 2024-05-08T18:30:59.625 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.625 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.625 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:59.625 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.497284+0000", 2024-05-08T18:30:59.626 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00077609100000000002 2024-05-08T18:30:59.626 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.626 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.626 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:59.626 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.498204+0000", 2024-05-08T18:30:59.626 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00092027299999999999 2024-05-08T18:30:59.626 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.626 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.626 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:59.626 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.498240+0000", 2024-05-08T18:30:59.626 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5979999999999998e-05 2024-05-08T18:30:59.626 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.627 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.627 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:59.627 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.498266+0000", 2024-05-08T18:30:59.627 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6024999999999999e-05 2024-05-08T18:30:59.627 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:59.627 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:59.627 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:59.627 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.627 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.627 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:94 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:30:59.627 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.842580+0000", 2024-05-08T18:30:59.627 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 91.664159893999994, 2024-05-08T18:30:59.627 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0085315870000000002, 2024-05-08T18:30:59.627 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:30:59.628 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:30:59.628 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:30:59.628 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:30:59.628 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:30:59.628 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:30:59.628 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 94 2024-05-08T18:30:59.628 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.628 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:30:59.628 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.628 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:30:59.628 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.842580+0000", 2024-05-08T18:30:59.628 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:59.628 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.629 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.629 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:30:59.629 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.842580+0000", 2024-05-08T18:30:59.629 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:30:59.629 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.629 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.629 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:30:59.629 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.842581+0000", 2024-05-08T18:30:59.629 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.11e-06 2024-05-08T18:30:59.629 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.629 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.629 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:30:59.629 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.842587+0000", 2024-05-08T18:30:59.629 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2899999999999999e-06 2024-05-08T18:30:59.630 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.630 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.630 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:30:59.630 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.842597+0000", 2024-05-08T18:30:59.630 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.007e-05 2024-05-08T18:30:59.630 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.630 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.630 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:30:59.630 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.842605+0000", 2024-05-08T18:30:59.630 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1270000000000003e-06 2024-05-08T18:30:59.630 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.630 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.630 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:30:59.630 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.848358+0000", 2024-05-08T18:30:59.631 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0057525140000000002 2024-05-08T18:30:59.631 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.631 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.631 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:30:59.631 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.848481+0000", 2024-05-08T18:30:59.631 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000123239 2024-05-08T18:30:59.631 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.631 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.631 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:30:59.631 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.848695+0000", 2024-05-08T18:30:59.631 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000213387 2024-05-08T18:30:59.631 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.631 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.631 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:30:59.632 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.849781+0000", 2024-05-08T18:30:59.632 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010868 2024-05-08T18:30:59.632 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.632 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.632 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:30:59.632 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.850990+0000", 2024-05-08T18:30:59.632 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0012084769999999999 2024-05-08T18:30:59.632 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.632 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.632 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:30:59.632 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.851059+0000", 2024-05-08T18:30:59.632 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9130999999999999e-05 2024-05-08T18:30:59.632 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:30:59.632 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:30:59.633 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:30:59.633 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.851111+0000", 2024-05-08T18:30:59.633 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2441999999999997e-05 2024-05-08T18:30:59.633 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:59.633 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:59.633 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:59.633 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:30:59.633 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:30:59.633 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:30:59.635 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:30:59.631+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:30:59.635 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-08T18:30:59.657 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-08T18:30:59.735 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:30:59.735+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:30:59.780 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:30:59.780 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:30:59.780 INFO:teuthology.orchestra.run.smithi097.stdout: "num_ops": 0 2024-05-08T18:30:59.780 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:30:59.795 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-08T18:30:59.836 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:30:59.831+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:30:59.913 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:30:59.913 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:30:59.913 INFO:teuthology.orchestra.run.smithi097.stdout: "complaint_time": 30, 2024-05-08T18:30:59.913 INFO:teuthology.orchestra.run.smithi097.stdout: "num_blocked_ops": 0 2024-05-08T18:30:59.913 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:30:59.926 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-08T18:30:59.936 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:30:59.935+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:31:00.037 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:31:00.035+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:31:00.050 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:00.050 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2024-05-08T18:31:00.050 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2024-05-08T18:31:00.050 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-05-08T18:31:00.050 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.050 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4206.0:24 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'14, mlcod=16'9)", 2024-05-08T18:31:00.050 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:27.162224+0000", 2024-05-08T18:31:00.050 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 92.886690169999994, 2024-05-08T18:31:00.050 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032712890000000001, 2024-05-08T18:31:00.050 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:00.050 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:00.050 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:00.051 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:00.051 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.051 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:00.051 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162224+0000", 2024-05-08T18:31:00.051 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:00.051 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.051 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.051 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:00.051 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162224+0000", 2024-05-08T18:31:00.051 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:00.051 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.051 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.052 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:00.052 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162225+0000", 2024-05-08T18:31:00.052 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4899999999999999e-06 2024-05-08T18:31:00.052 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.052 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.052 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:00.052 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162306+0000", 2024-05-08T18:31:00.052 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.0589999999999999e-05 2024-05-08T18:31:00.052 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.052 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.052 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:00.053 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162332+0000", 2024-05-08T18:31:00.053 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5658999999999999e-05 2024-05-08T18:31:00.053 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.053 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.053 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:00.053 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162345+0000", 2024-05-08T18:31:00.053 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3512999999999999e-05 2024-05-08T18:31:00.053 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.053 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.053 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:00.053 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162465+0000", 2024-05-08T18:31:00.053 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000119577 2024-05-08T18:31:00.053 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.054 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.054 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:00.054 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162513+0000", 2024-05-08T18:31:00.054 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8773999999999998e-05 2024-05-08T18:31:00.054 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.054 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.054 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:00.054 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.165405+0000", 2024-05-08T18:31:00.054 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028919200000000001 2024-05-08T18:31:00.054 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.054 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.054 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:00.055 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.165495+0000", 2024-05-08T18:31:00.055 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9765999999999994e-05 2024-05-08T18:31:00.055 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:00.055 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:00.055 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:00.055 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.055 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.055 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4206.0:25 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'15, mlcod=16'10)", 2024-05-08T18:31:00.055 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:27.164793+0000", 2024-05-08T18:31:00.055 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 92.884121042000004, 2024-05-08T18:31:00.055 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032285249999999999, 2024-05-08T18:31:00.056 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:00.056 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:00.056 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:00.056 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:00.056 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.056 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:00.056 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164793+0000", 2024-05-08T18:31:00.056 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:00.056 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.056 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.056 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:00.056 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164793+0000", 2024-05-08T18:31:00.057 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:00.057 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.057 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.057 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:00.057 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164795+0000", 2024-05-08T18:31:00.057 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0999999999999998e-06 2024-05-08T18:31:00.057 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.057 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.057 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:00.057 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164811+0000", 2024-05-08T18:31:00.057 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5722999999999998e-05 2024-05-08T18:31:00.058 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.058 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.058 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:00.058 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164841+0000", 2024-05-08T18:31:00.058 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0355999999999999e-05 2024-05-08T18:31:00.058 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.058 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.058 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:00.058 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164861+0000", 2024-05-08T18:31:00.058 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9533000000000001e-05 2024-05-08T18:31:00.058 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.058 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.059 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:00.059 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164984+0000", 2024-05-08T18:31:00.059 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000123146 2024-05-08T18:31:00.059 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.059 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.059 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:00.059 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.165024+0000", 2024-05-08T18:31:00.059 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9690000000000001e-05 2024-05-08T18:31:00.059 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.059 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.059 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:00.059 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.167935+0000", 2024-05-08T18:31:00.059 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0029113300000000002 2024-05-08T18:31:00.059 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.060 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.060 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:00.060 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.168021+0000", 2024-05-08T18:31:00.060 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6646999999999999e-05 2024-05-08T18:31:00.060 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:00.060 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:00.060 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:00.060 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.060 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.060 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:31:00.060 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:48.674737+0000", 2024-05-08T18:31:00.060 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 71.374177123999999, 2024-05-08T18:31:00.060 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0035019780000000002, 2024-05-08T18:31:00.061 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:00.061 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:00.061 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:00.061 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:00.061 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:00.061 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:00.061 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 60 2024-05-08T18:31:00.061 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.061 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:00.061 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.061 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:00.061 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674737+0000", 2024-05-08T18:31:00.062 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:00.062 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.062 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.062 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:00.062 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674737+0000", 2024-05-08T18:31:00.062 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:00.062 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.062 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.062 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:00.062 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674740+0000", 2024-05-08T18:31:00.062 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.36e-06 2024-05-08T18:31:00.062 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.062 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.063 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:00.063 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674753+0000", 2024-05-08T18:31:00.063 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3151e-05 2024-05-08T18:31:00.063 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.063 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.063 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:00.063 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674789+0000", 2024-05-08T18:31:00.063 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5929000000000001e-05 2024-05-08T18:31:00.063 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.063 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.063 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:00.063 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674813+0000", 2024-05-08T18:31:00.063 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3325000000000001e-05 2024-05-08T18:31:00.064 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.064 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.064 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:00.064 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674981+0000", 2024-05-08T18:31:00.064 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016879899999999999 2024-05-08T18:31:00.064 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.064 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.064 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:00.064 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.675304+0000", 2024-05-08T18:31:00.064 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00032214400000000001 2024-05-08T18:31:00.064 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.064 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.064 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-05-08T18:31:00.064 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.675639+0000", 2024-05-08T18:31:00.065 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00033494699999999999 2024-05-08T18:31:00.065 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.065 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.065 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:00.065 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.676901+0000", 2024-05-08T18:31:00.065 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001262167 2024-05-08T18:31:00.065 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.065 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.065 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:00.065 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678078+0000", 2024-05-08T18:31:00.065 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001177588 2024-05-08T18:31:00.065 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.065 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.065 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:00.066 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678171+0000", 2024-05-08T18:31:00.066 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.2331999999999996e-05 2024-05-08T18:31:00.066 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.066 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.066 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:00.066 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678239+0000", 2024-05-08T18:31:00.066 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8236000000000002e-05 2024-05-08T18:31:00.066 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:00.066 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:00.066 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:00.066 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.066 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.066 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:61 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94069412632064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:31:00.067 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:48.678410+0000", 2024-05-08T18:31:00.067 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 71.370503732000003, 2024-05-08T18:31:00.067 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0026001800000000001, 2024-05-08T18:31:00.067 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:00.067 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:00.067 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:00.067 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:00.067 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:00.067 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:00.068 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 61 2024-05-08T18:31:00.068 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.068 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:00.068 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.068 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:00.068 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678410+0000", 2024-05-08T18:31:00.068 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:00.068 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.068 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.068 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:00.068 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678410+0000", 2024-05-08T18:31:00.068 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:00.068 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.069 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.069 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:00.069 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678413+0000", 2024-05-08T18:31:00.069 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.34e-06 2024-05-08T18:31:00.069 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.069 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.069 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:00.069 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678421+0000", 2024-05-08T18:31:00.069 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6910000000000003e-06 2024-05-08T18:31:00.069 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.069 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.069 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:00.069 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678447+0000", 2024-05-08T18:31:00.070 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6010999999999999e-05 2024-05-08T18:31:00.070 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.070 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.070 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:00.070 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678461+0000", 2024-05-08T18:31:00.070 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3900000000000001e-05 2024-05-08T18:31:00.070 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.070 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.070 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:00.070 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678560+0000", 2024-05-08T18:31:00.070 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.8834999999999998e-05 2024-05-08T18:31:00.070 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.070 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.071 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:00.071 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678704+0000", 2024-05-08T18:31:00.071 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000143769 2024-05-08T18:31:00.071 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.071 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.071 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-05-08T18:31:00.071 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678942+0000", 2024-05-08T18:31:00.071 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023861800000000001 2024-05-08T18:31:00.071 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.071 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.071 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:00.071 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.680269+0000", 2024-05-08T18:31:00.071 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001326484 2024-05-08T18:31:00.071 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.072 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.072 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:00.072 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.680823+0000", 2024-05-08T18:31:00.072 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00055455900000000004 2024-05-08T18:31:00.072 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.072 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.072 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:00.072 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.680908+0000", 2024-05-08T18:31:00.072 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.4073999999999995e-05 2024-05-08T18:31:00.072 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.072 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.073 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:00.073 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.681010+0000", 2024-05-08T18:31:00.073 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010289900000000001 2024-05-08T18:31:00.073 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:00.073 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:00.073 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:00.073 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.073 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.073 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:31:00.073 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.671896+0000", 2024-05-08T18:31:00.074 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 68.377017847000005, 2024-05-08T18:31:00.074 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032352349999999999, 2024-05-08T18:31:00.074 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:00.074 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:00.074 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:00.074 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:00.074 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:00.074 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:00.074 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 206 2024-05-08T18:31:00.074 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.074 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:00.074 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.074 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:00.074 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671896+0000", 2024-05-08T18:31:00.075 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:00.075 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.075 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.075 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:00.075 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671896+0000", 2024-05-08T18:31:00.075 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:00.075 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.075 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.075 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:00.075 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671901+0000", 2024-05-08T18:31:00.075 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.763e-06 2024-05-08T18:31:00.075 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.075 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.075 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:00.076 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671920+0000", 2024-05-08T18:31:00.076 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9403e-05 2024-05-08T18:31:00.076 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.076 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.076 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:00.076 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671969+0000", 2024-05-08T18:31:00.076 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8343000000000001e-05 2024-05-08T18:31:00.076 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.076 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.076 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:00.076 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671996+0000", 2024-05-08T18:31:00.076 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7307000000000001e-05 2024-05-08T18:31:00.076 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.076 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.077 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:00.077 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.672149+0000", 2024-05-08T18:31:00.077 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015336500000000001 2024-05-08T18:31:00.077 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.077 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.077 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:00.077 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.672393+0000", 2024-05-08T18:31:00.077 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024380800000000001 2024-05-08T18:31:00.077 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.077 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.078 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-05-08T18:31:00.078 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.672838+0000", 2024-05-08T18:31:00.078 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00044472700000000001 2024-05-08T18:31:00.078 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.078 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.078 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:00.078 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.674218+0000", 2024-05-08T18:31:00.078 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001380243 2024-05-08T18:31:00.078 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.078 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.078 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:00.078 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.674963+0000", 2024-05-08T18:31:00.078 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00074534999999999998 2024-05-08T18:31:00.079 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.079 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.079 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:00.079 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675057+0000", 2024-05-08T18:31:00.079 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.3633000000000003e-05 2024-05-08T18:31:00.079 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.079 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.079 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:00.079 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675131+0000", 2024-05-08T18:31:00.079 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.4293000000000002e-05 2024-05-08T18:31:00.079 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:00.079 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:00.079 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:00.079 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.080 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.080 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:00.080 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.694194+0000", 2024-05-08T18:31:00.080 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 68.354720448999998, 2024-05-08T18:31:00.080 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0087385129999999998, 2024-05-08T18:31:00.080 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:00.080 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:00.080 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:00.080 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:00.080 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:00.080 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:00.080 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 210 2024-05-08T18:31:00.081 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.081 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:00.081 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.081 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:00.081 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694194+0000", 2024-05-08T18:31:00.081 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:00.081 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.081 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.081 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:00.081 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694194+0000", 2024-05-08T18:31:00.081 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:00.081 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.081 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.082 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:00.082 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694196+0000", 2024-05-08T18:31:00.082 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6299999999999998e-06 2024-05-08T18:31:00.082 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.082 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.082 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:00.082 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694208+0000", 2024-05-08T18:31:00.082 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.187e-05 2024-05-08T18:31:00.082 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.082 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.082 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:00.082 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694240+0000", 2024-05-08T18:31:00.082 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1673e-05 2024-05-08T18:31:00.082 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.083 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.083 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:00.083 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694255+0000", 2024-05-08T18:31:00.083 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5573000000000002e-05 2024-05-08T18:31:00.083 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.083 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.083 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:00.083 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694394+0000", 2024-05-08T18:31:00.083 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000138536 2024-05-08T18:31:00.083 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.083 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.083 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-05-08T18:31:00.083 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694405+0000", 2024-05-08T18:31:00.084 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0883000000000001e-05 2024-05-08T18:31:00.084 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.084 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.084 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:00.084 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.699491+0000", 2024-05-08T18:31:00.084 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0050861939999999996 2024-05-08T18:31:00.084 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.084 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.084 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:00.084 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.699829+0000", 2024-05-08T18:31:00.084 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000338191 2024-05-08T18:31:00.084 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.084 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.085 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:00.085 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.700504+0000", 2024-05-08T18:31:00.085 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000674481 2024-05-08T18:31:00.085 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.085 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.085 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:00.085 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.702152+0000", 2024-05-08T18:31:00.085 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0016487450000000001 2024-05-08T18:31:00.085 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.085 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.085 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:00.085 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.702792+0000", 2024-05-08T18:31:00.085 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00063962800000000005 2024-05-08T18:31:00.085 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.086 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.086 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:00.086 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.702874+0000", 2024-05-08T18:31:00.086 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.2091999999999999e-05 2024-05-08T18:31:00.086 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.086 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.086 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:00.086 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.702932+0000", 2024-05-08T18:31:00.086 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8016999999999997e-05 2024-05-08T18:31:00.087 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:00.087 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:00.087 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:00.087 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.087 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.087 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:00.087 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.728239+0000", 2024-05-08T18:31:00.087 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 68.320674588000003, 2024-05-08T18:31:00.087 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0035376119999999999, 2024-05-08T18:31:00.087 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:00.087 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:00.088 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:00.088 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:00.088 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:00.088 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:00.088 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 218 2024-05-08T18:31:00.088 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.089 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:00.089 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.089 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:00.089 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728239+0000", 2024-05-08T18:31:00.089 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:00.089 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.089 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.089 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:00.089 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728239+0000", 2024-05-08T18:31:00.089 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:00.089 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.089 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.089 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:00.089 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728242+0000", 2024-05-08T18:31:00.090 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0130000000000002e-06 2024-05-08T18:31:00.090 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.090 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.090 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:00.090 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728254+0000", 2024-05-08T18:31:00.090 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.172e-05 2024-05-08T18:31:00.090 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.090 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.091 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:00.091 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728285+0000", 2024-05-08T18:31:00.091 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0703000000000001e-05 2024-05-08T18:31:00.091 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.091 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.091 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:00.091 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728301+0000", 2024-05-08T18:31:00.092 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5656999999999999e-05 2024-05-08T18:31:00.092 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.092 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.092 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:00.092 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728460+0000", 2024-05-08T18:31:00.092 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015934200000000001 2024-05-08T18:31:00.092 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.093 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.093 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:00.093 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728803+0000", 2024-05-08T18:31:00.093 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00034267400000000001 2024-05-08T18:31:00.093 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.093 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.094 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:00.094 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.729485+0000", 2024-05-08T18:31:00.094 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00068206799999999998 2024-05-08T18:31:00.094 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.094 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.094 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:00.095 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731218+0000", 2024-05-08T18:31:00.095 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0017332630000000001 2024-05-08T18:31:00.095 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.095 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.095 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:00.095 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731615+0000", 2024-05-08T18:31:00.095 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00039671699999999999 2024-05-08T18:31:00.096 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.096 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.096 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:00.096 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731709+0000", 2024-05-08T18:31:00.096 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.4740000000000004e-05 2024-05-08T18:31:00.096 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.096 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.097 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:00.097 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731777+0000", 2024-05-08T18:31:00.097 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7714999999999998e-05 2024-05-08T18:31:00.097 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:00.097 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:00.097 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:00.097 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.097 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.098 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:00.098 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.743331+0000", 2024-05-08T18:31:00.098 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 68.305582604999998, 2024-05-08T18:31:00.098 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031193229999999998, 2024-05-08T18:31:00.098 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:00.098 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:00.099 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:00.099 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:00.099 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:00.099 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:00.099 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 222 2024-05-08T18:31:00.099 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.100 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:00.100 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.100 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:00.100 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743331+0000", 2024-05-08T18:31:00.100 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:00.100 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.100 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.100 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:00.100 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743331+0000", 2024-05-08T18:31:00.100 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:00.101 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.101 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.101 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:00.101 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743334+0000", 2024-05-08T18:31:00.101 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2900000000000001e-06 2024-05-08T18:31:00.101 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.101 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.101 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:00.101 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743345+0000", 2024-05-08T18:31:00.101 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0947e-05 2024-05-08T18:31:00.101 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.101 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.102 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:00.102 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743375+0000", 2024-05-08T18:31:00.102 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0298999999999999e-05 2024-05-08T18:31:00.102 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.102 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.102 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:00.102 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743390+0000", 2024-05-08T18:31:00.102 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4606999999999999e-05 2024-05-08T18:31:00.102 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.102 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.102 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:00.102 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743524+0000", 2024-05-08T18:31:00.102 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000134105 2024-05-08T18:31:00.103 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.103 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.103 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:00.103 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743738+0000", 2024-05-08T18:31:00.103 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000214222 2024-05-08T18:31:00.103 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.103 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.103 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:00.103 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.744159+0000", 2024-05-08T18:31:00.103 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00042102300000000002 2024-05-08T18:31:00.103 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.103 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.103 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:00.104 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.745399+0000", 2024-05-08T18:31:00.104 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012400309999999999 2024-05-08T18:31:00.104 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.104 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.104 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:00.104 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.746296+0000", 2024-05-08T18:31:00.104 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00089682 2024-05-08T18:31:00.104 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.104 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.104 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:00.104 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.746385+0000", 2024-05-08T18:31:00.104 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9289000000000005e-05 2024-05-08T18:31:00.104 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.104 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.105 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:00.105 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.746451+0000", 2024-05-08T18:31:00.105 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5690000000000003e-05 2024-05-08T18:31:00.105 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:00.105 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:00.105 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:00.105 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.105 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.105 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:00.105 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.772338+0000", 2024-05-08T18:31:00.105 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 68.276576405, 2024-05-08T18:31:00.105 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0035084059999999999, 2024-05-08T18:31:00.105 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:00.106 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:00.106 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:00.106 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:00.106 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:00.106 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:00.106 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 230 2024-05-08T18:31:00.106 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.106 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:00.106 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.106 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:00.106 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772338+0000", 2024-05-08T18:31:00.107 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:00.107 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.107 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.107 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:00.107 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772338+0000", 2024-05-08T18:31:00.107 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:00.107 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.107 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.107 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:00.107 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772340+0000", 2024-05-08T18:31:00.107 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3460000000000001e-06 2024-05-08T18:31:00.107 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.108 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.108 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:00.108 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772352+0000", 2024-05-08T18:31:00.108 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2284e-05 2024-05-08T18:31:00.108 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.108 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.108 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:00.108 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772382+0000", 2024-05-08T18:31:00.108 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0083e-05 2024-05-08T18:31:00.108 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.108 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.108 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:00.108 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772397+0000", 2024-05-08T18:31:00.108 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4963000000000001e-05 2024-05-08T18:31:00.109 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.109 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.109 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:00.109 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772508+0000", 2024-05-08T18:31:00.109 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000110402 2024-05-08T18:31:00.109 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.109 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.109 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:00.109 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772742+0000", 2024-05-08T18:31:00.109 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023428899999999999 2024-05-08T18:31:00.109 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.109 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.109 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:00.109 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.773183+0000", 2024-05-08T18:31:00.110 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00044107899999999998 2024-05-08T18:31:00.110 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.110 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.110 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:00.110 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.774488+0000", 2024-05-08T18:31:00.110 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0013053940000000001 2024-05-08T18:31:00.110 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.110 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.110 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:00.110 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.775689+0000", 2024-05-08T18:31:00.111 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012004699999999999 2024-05-08T18:31:00.111 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.111 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.111 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:00.111 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.775777+0000", 2024-05-08T18:31:00.111 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8483e-05 2024-05-08T18:31:00.111 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.111 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.112 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:00.112 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.775846+0000", 2024-05-08T18:31:00.112 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8613000000000002e-05 2024-05-08T18:31:00.112 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:00.112 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:00.112 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:00.112 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.112 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.113 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:00.113 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.790921+0000", 2024-05-08T18:31:00.113 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 68.257993059, 2024-05-08T18:31:00.113 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003116869, 2024-05-08T18:31:00.113 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:00.113 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:00.113 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:00.113 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:00.114 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:00.114 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:00.114 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 235 2024-05-08T18:31:00.114 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.114 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:00.114 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.114 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:00.114 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790921+0000", 2024-05-08T18:31:00.115 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:00.115 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.115 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.115 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:00.115 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790921+0000", 2024-05-08T18:31:00.115 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:00.115 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.115 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.116 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:00.116 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790923+0000", 2024-05-08T18:31:00.116 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3199999999999998e-06 2024-05-08T18:31:00.116 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.116 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.116 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:00.116 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790934+0000", 2024-05-08T18:31:00.116 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.117e-05 2024-05-08T18:31:00.117 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.117 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.117 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:00.117 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790965+0000", 2024-05-08T18:31:00.117 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0392999999999999e-05 2024-05-08T18:31:00.117 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.117 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.117 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:00.117 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790981+0000", 2024-05-08T18:31:00.118 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5699999999999999e-05 2024-05-08T18:31:00.118 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.118 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.118 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:00.118 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.791093+0000", 2024-05-08T18:31:00.118 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000112062 2024-05-08T18:31:00.118 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.118 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.119 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:00.119 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.791324+0000", 2024-05-08T18:31:00.119 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023142200000000001 2024-05-08T18:31:00.119 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.119 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.119 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:00.119 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.791761+0000", 2024-05-08T18:31:00.119 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00043669999999999999 2024-05-08T18:31:00.120 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.120 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.120 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:00.120 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.792996+0000", 2024-05-08T18:31:00.120 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001235713 2024-05-08T18:31:00.120 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.120 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.120 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:00.121 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.793850+0000", 2024-05-08T18:31:00.121 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00085392400000000005 2024-05-08T18:31:00.121 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.121 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.121 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:00.121 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.793971+0000", 2024-05-08T18:31:00.121 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000120516 2024-05-08T18:31:00.121 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.122 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.122 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:00.122 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794038+0000", 2024-05-08T18:31:00.122 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6948999999999999e-05 2024-05-08T18:31:00.122 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:00.122 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:00.122 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:00.122 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.123 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.123 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:349 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:00.123 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.817315+0000", 2024-05-08T18:31:00.123 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 68.231599188000004, 2024-05-08T18:31:00.123 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0036888580000000002, 2024-05-08T18:31:00.123 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:00.123 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:00.123 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:00.124 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:00.124 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:00.124 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:00.124 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 349 2024-05-08T18:31:00.124 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.124 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:00.124 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.124 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:00.124 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817315+0000", 2024-05-08T18:31:00.124 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:00.124 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.124 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.125 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:00.125 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817315+0000", 2024-05-08T18:31:00.125 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:00.125 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.125 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.125 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:00.125 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817316+0000", 2024-05-08T18:31:00.125 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3370000000000001e-06 2024-05-08T18:31:00.125 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.125 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.125 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:00.125 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817323+0000", 2024-05-08T18:31:00.126 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.4300000000000003e-06 2024-05-08T18:31:00.126 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.126 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.126 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:00.126 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817337+0000", 2024-05-08T18:31:00.126 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4025999999999999e-05 2024-05-08T18:31:00.126 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.126 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.126 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:00.126 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817345+0000", 2024-05-08T18:31:00.126 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5669999999999995e-06 2024-05-08T18:31:00.126 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.127 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.127 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:00.127 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817407+0000", 2024-05-08T18:31:00.127 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1882000000000001e-05 2024-05-08T18:31:00.127 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.127 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.127 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:00.127 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817508+0000", 2024-05-08T18:31:00.127 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000100585 2024-05-08T18:31:00.127 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.127 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.127 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:00.128 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817673+0000", 2024-05-08T18:31:00.128 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000165802 2024-05-08T18:31:00.128 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.128 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.128 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:00.128 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.818715+0000", 2024-05-08T18:31:00.128 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0010417720000000001 2024-05-08T18:31:00.128 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.128 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.128 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:00.128 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.820892+0000", 2024-05-08T18:31:00.128 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0021771859999999998 2024-05-08T18:31:00.128 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.129 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.129 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:00.129 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.820950+0000", 2024-05-08T18:31:00.129 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7636000000000002e-05 2024-05-08T18:31:00.129 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.129 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.129 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:00.129 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.821004+0000", 2024-05-08T18:31:00.129 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3634999999999997e-05 2024-05-08T18:31:00.129 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:00.129 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:00.129 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:00.129 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.129 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.130 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:406 6.16 6:6dc3b799:reshard::reshard.0000000006:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:00.130 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.840465+0000", 2024-05-08T18:31:00.130 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 68.208449021999996, 2024-05-08T18:31:00.130 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003613032, 2024-05-08T18:31:00.130 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:00.130 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:00.130 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:00.130 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:00.130 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:00.130 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:00.130 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 406 2024-05-08T18:31:00.130 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.131 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:00.131 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.131 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:00.131 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840465+0000", 2024-05-08T18:31:00.131 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:00.131 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.131 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.131 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:00.131 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840465+0000", 2024-05-08T18:31:00.131 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:00.131 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.131 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.131 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:00.132 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840466+0000", 2024-05-08T18:31:00.132 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7499999999999999e-07 2024-05-08T18:31:00.132 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.132 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.132 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:00.132 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840471+0000", 2024-05-08T18:31:00.132 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9699999999999998e-06 2024-05-08T18:31:00.132 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.132 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.132 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:00.133 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840484+0000", 2024-05-08T18:31:00.133 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2717999999999999e-05 2024-05-08T18:31:00.133 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.133 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.133 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:00.133 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840490+0000", 2024-05-08T18:31:00.133 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.472e-06 2024-05-08T18:31:00.133 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.133 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.133 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:00.133 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840536+0000", 2024-05-08T18:31:00.133 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6409000000000002e-05 2024-05-08T18:31:00.133 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.134 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.134 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:00.134 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840591+0000", 2024-05-08T18:31:00.134 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4911000000000003e-05 2024-05-08T18:31:00.134 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.134 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.134 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:00.134 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840745+0000", 2024-05-08T18:31:00.134 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015394900000000001 2024-05-08T18:31:00.134 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.134 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.135 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:00.135 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.841269+0000", 2024-05-08T18:31:00.135 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00052347299999999999 2024-05-08T18:31:00.135 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.135 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.135 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:00.135 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.843997+0000", 2024-05-08T18:31:00.135 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0027285080000000001 2024-05-08T18:31:00.136 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.136 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.136 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:00.136 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844033+0000", 2024-05-08T18:31:00.136 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6038000000000003e-05 2024-05-08T18:31:00.136 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.136 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.136 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:00.136 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844078+0000", 2024-05-08T18:31:00.136 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4709000000000002e-05 2024-05-08T18:31:00.136 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:00.136 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:00.136 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:00.137 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.137 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.137 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:413 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:00.137 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.844187+0000", 2024-05-08T18:31:00.137 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 68.204727445000003, 2024-05-08T18:31:00.137 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0024835069999999998, 2024-05-08T18:31:00.137 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:00.137 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:00.137 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:00.137 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:00.137 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:00.137 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:00.137 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 413 2024-05-08T18:31:00.138 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.138 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:00.138 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.138 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:00.138 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844187+0000", 2024-05-08T18:31:00.138 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:00.138 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.138 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.138 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:00.138 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844187+0000", 2024-05-08T18:31:00.138 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:00.138 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.139 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.139 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:00.139 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844187+0000", 2024-05-08T18:31:00.139 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9999999999999996e-07 2024-05-08T18:31:00.139 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.139 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.139 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:00.139 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844192+0000", 2024-05-08T18:31:00.139 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7899999999999999e-06 2024-05-08T18:31:00.139 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.139 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.139 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:00.139 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844203+0000", 2024-05-08T18:31:00.139 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1002000000000001e-05 2024-05-08T18:31:00.140 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.140 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.140 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:00.140 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844209+0000", 2024-05-08T18:31:00.140 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6570000000000002e-06 2024-05-08T18:31:00.140 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.140 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.140 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:00.140 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844270+0000", 2024-05-08T18:31:00.140 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0810999999999998e-05 2024-05-08T18:31:00.140 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.140 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.140 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:00.141 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844419+0000", 2024-05-08T18:31:00.141 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000149097 2024-05-08T18:31:00.141 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.141 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.141 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:00.141 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844611+0000", 2024-05-08T18:31:00.141 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00019247900000000001 2024-05-08T18:31:00.141 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.141 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.141 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:00.141 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.845287+0000", 2024-05-08T18:31:00.141 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00067526000000000001 2024-05-08T18:31:00.141 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.141 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.142 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:00.142 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.846609+0000", 2024-05-08T18:31:00.142 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001322124 2024-05-08T18:31:00.142 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.142 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.142 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:00.142 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.846642+0000", 2024-05-08T18:31:00.142 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3654e-05 2024-05-08T18:31:00.142 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.142 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.142 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:00.142 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.846670+0000", 2024-05-08T18:31:00.143 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7733e-05 2024-05-08T18:31:00.143 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:00.143 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:00.143 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:00.143 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.143 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.143 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:420 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:00.143 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.847096+0000", 2024-05-08T18:31:00.143 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 68.201818150999998, 2024-05-08T18:31:00.143 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0026261589999999999, 2024-05-08T18:31:00.143 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:00.143 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:00.143 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:00.143 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:00.144 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:00.144 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:00.144 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 420 2024-05-08T18:31:00.144 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.144 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:00.144 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.144 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:00.144 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847096+0000", 2024-05-08T18:31:00.144 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:00.144 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.144 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.144 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:00.144 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847096+0000", 2024-05-08T18:31:00.145 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:00.145 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.145 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.145 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:00.145 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847097+0000", 2024-05-08T18:31:00.145 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.5499999999999996e-07 2024-05-08T18:31:00.145 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.145 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.145 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:00.145 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847103+0000", 2024-05-08T18:31:00.145 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8969999999999996e-06 2024-05-08T18:31:00.145 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.145 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.145 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:00.146 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847114+0000", 2024-05-08T18:31:00.146 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1549000000000001e-05 2024-05-08T18:31:00.146 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.146 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.146 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:00.146 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847120+0000", 2024-05-08T18:31:00.146 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5509999999999999e-06 2024-05-08T18:31:00.146 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.146 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.146 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:00.146 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847166+0000", 2024-05-08T18:31:00.146 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6683e-05 2024-05-08T18:31:00.146 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.147 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.147 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:00.147 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847213+0000", 2024-05-08T18:31:00.147 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6659000000000002e-05 2024-05-08T18:31:00.147 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.147 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.147 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:00.147 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847315+0000", 2024-05-08T18:31:00.147 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000102336 2024-05-08T18:31:00.147 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.147 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.147 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:00.147 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847840+0000", 2024-05-08T18:31:00.148 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00052475000000000004 2024-05-08T18:31:00.148 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.148 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.148 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:00.148 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.849660+0000", 2024-05-08T18:31:00.148 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001819563 2024-05-08T18:31:00.148 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.148 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.148 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:00.148 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.849695+0000", 2024-05-08T18:31:00.148 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4761000000000001e-05 2024-05-08T18:31:00.148 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.148 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.149 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:00.149 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.849722+0000", 2024-05-08T18:31:00.149 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7455000000000001e-05 2024-05-08T18:31:00.149 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:00.149 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:00.149 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:00.149 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.149 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.149 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:532 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:00.149 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.908603+0000", 2024-05-08T18:31:00.149 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 68.140310600999996, 2024-05-08T18:31:00.149 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0038838950000000001, 2024-05-08T18:31:00.149 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:00.150 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:00.150 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:00.150 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:00.150 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:00.150 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:00.150 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 532 2024-05-08T18:31:00.150 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.150 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:00.150 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.150 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:00.150 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908603+0000", 2024-05-08T18:31:00.150 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:00.151 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.151 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.151 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:00.151 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908603+0000", 2024-05-08T18:31:00.151 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:00.151 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.151 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.151 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:00.151 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908605+0000", 2024-05-08T18:31:00.151 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1179999999999999e-06 2024-05-08T18:31:00.151 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.151 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.151 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:00.152 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908608+0000", 2024-05-08T18:31:00.152 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7419999999999999e-06 2024-05-08T18:31:00.152 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.152 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.152 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:00.152 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908618+0000", 2024-05-08T18:31:00.152 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.6889999999999999e-06 2024-05-08T18:31:00.152 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.152 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.152 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:00.152 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908625+0000", 2024-05-08T18:31:00.152 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1300000000000003e-06 2024-05-08T18:31:00.152 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.152 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.153 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:00.153 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908669+0000", 2024-05-08T18:31:00.153 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3832000000000003e-05 2024-05-08T18:31:00.153 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.153 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.153 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:00.153 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908724+0000", 2024-05-08T18:31:00.153 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5222000000000001e-05 2024-05-08T18:31:00.153 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.153 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.154 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:00.154 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908854+0000", 2024-05-08T18:31:00.154 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012953500000000001 2024-05-08T18:31:00.154 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.154 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.154 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:00.154 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.909511+0000", 2024-05-08T18:31:00.154 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00065768399999999996 2024-05-08T18:31:00.154 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.154 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.154 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:00.154 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912426+0000", 2024-05-08T18:31:00.155 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0029146599999999999 2024-05-08T18:31:00.155 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.155 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.155 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:00.155 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912461+0000", 2024-05-08T18:31:00.155 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4934999999999997e-05 2024-05-08T18:31:00.155 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.155 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.155 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:00.155 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912487+0000", 2024-05-08T18:31:00.155 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6347999999999999e-05 2024-05-08T18:31:00.155 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:00.155 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:00.156 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:00.156 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.156 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.156 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:534 6.9 6:9268b73e:::obj_delete_at_hint.0000000019:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:00.156 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.910153+0000", 2024-05-08T18:31:00.156 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 68.138761144, 2024-05-08T18:31:00.156 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0051089680000000002, 2024-05-08T18:31:00.156 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:00.156 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:00.156 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:00.157 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:00.157 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:00.157 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:00.157 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 534 2024-05-08T18:31:00.157 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.157 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:00.157 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.157 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:00.157 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910153+0000", 2024-05-08T18:31:00.157 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:00.157 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.157 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.157 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:00.158 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910153+0000", 2024-05-08T18:31:00.158 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:00.158 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.158 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.158 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:00.158 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910154+0000", 2024-05-08T18:31:00.158 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1039999999999999e-06 2024-05-08T18:31:00.158 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.158 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.158 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:00.158 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910158+0000", 2024-05-08T18:31:00.158 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7400000000000002e-06 2024-05-08T18:31:00.158 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.159 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.159 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:00.159 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910167+0000", 2024-05-08T18:31:00.159 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8880000000000003e-06 2024-05-08T18:31:00.159 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.159 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.159 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:00.159 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910173+0000", 2024-05-08T18:31:00.159 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.844e-06 2024-05-08T18:31:00.159 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.159 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.159 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:00.160 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910220+0000", 2024-05-08T18:31:00.160 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6582000000000002e-05 2024-05-08T18:31:00.160 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.160 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.160 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:00.160 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910287+0000", 2024-05-08T18:31:00.160 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7271e-05 2024-05-08T18:31:00.160 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.160 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.160 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:00.160 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910402+0000", 2024-05-08T18:31:00.160 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115127 2024-05-08T18:31:00.161 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.161 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.161 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:00.161 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910881+0000", 2024-05-08T18:31:00.161 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000479025 2024-05-08T18:31:00.161 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.161 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.161 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:00.161 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.915206+0000", 2024-05-08T18:31:00.161 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.004324357 2024-05-08T18:31:00.161 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.161 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.161 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:00.162 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.915237+0000", 2024-05-08T18:31:00.162 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1590000000000001e-05 2024-05-08T18:31:00.162 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.162 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.162 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:00.162 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.915262+0000", 2024-05-08T18:31:00.162 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.444e-05 2024-05-08T18:31:00.162 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:00.162 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:00.162 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:00.163 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.163 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.163 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:583 6.0 6:03bbb29a:::obj_delete_at_hint.0000000026:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:00.163 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.947199+0000", 2024-05-08T18:31:00.163 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 68.101714947000005, 2024-05-08T18:31:00.163 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0025081510000000001, 2024-05-08T18:31:00.163 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:00.163 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:00.163 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:00.163 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:00.163 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:00.163 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:00.163 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 583 2024-05-08T18:31:00.164 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.164 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:00.164 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.164 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:00.164 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947199+0000", 2024-05-08T18:31:00.164 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:00.164 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.164 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.164 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:00.164 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947199+0000", 2024-05-08T18:31:00.164 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:00.164 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.164 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.164 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:00.165 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947200+0000", 2024-05-08T18:31:00.165 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3799999999999997e-07 2024-05-08T18:31:00.165 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.165 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.165 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:00.165 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947207+0000", 2024-05-08T18:31:00.165 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2030000000000003e-06 2024-05-08T18:31:00.165 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.165 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.165 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:00.165 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947217+0000", 2024-05-08T18:31:00.165 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0138e-05 2024-05-08T18:31:00.165 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.166 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.166 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:00.166 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947224+0000", 2024-05-08T18:31:00.166 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5289999999999997e-06 2024-05-08T18:31:00.166 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.166 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.166 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:00.166 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.948039+0000", 2024-05-08T18:31:00.166 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00081500599999999996 2024-05-08T18:31:00.166 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.166 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.166 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:00.166 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.948230+0000", 2024-05-08T18:31:00.167 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000191838 2024-05-08T18:31:00.167 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.167 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.167 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:00.167 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.948606+0000", 2024-05-08T18:31:00.167 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00037547900000000001 2024-05-08T18:31:00.167 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.167 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.167 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:00.167 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.949406+0000", 2024-05-08T18:31:00.167 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000799674 2024-05-08T18:31:00.167 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.167 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.168 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:00.168 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.949630+0000", 2024-05-08T18:31:00.168 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00022474699999999999 2024-05-08T18:31:00.168 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.168 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.168 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:00.168 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.949664+0000", 2024-05-08T18:31:00.168 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3535999999999999e-05 2024-05-08T18:31:00.168 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.168 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.168 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:00.168 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.949707+0000", 2024-05-08T18:31:00.168 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3362999999999998e-05 2024-05-08T18:31:00.169 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:00.169 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:00.169 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:00.169 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.169 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.169 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:00.169 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.263796+0000", 2024-05-08T18:31:00.169 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 67.785117678999995, 2024-05-08T18:31:00.169 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0027788019999999999, 2024-05-08T18:31:00.169 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:00.169 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:00.169 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:00.169 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:00.170 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:00.170 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:00.170 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 811 2024-05-08T18:31:00.170 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.170 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:00.170 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.170 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:00.170 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263796+0000", 2024-05-08T18:31:00.170 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:00.170 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.170 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.170 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:00.171 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263796+0000", 2024-05-08T18:31:00.171 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:00.171 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.171 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.171 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:00.171 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263799+0000", 2024-05-08T18:31:00.171 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5569999999999998e-06 2024-05-08T18:31:00.171 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.171 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.171 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:00.171 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263812+0000", 2024-05-08T18:31:00.171 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3145999999999999e-05 2024-05-08T18:31:00.171 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.171 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.172 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:00.172 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263842+0000", 2024-05-08T18:31:00.172 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0193e-05 2024-05-08T18:31:00.172 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.172 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.172 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:00.172 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263860+0000", 2024-05-08T18:31:00.172 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7880000000000002e-05 2024-05-08T18:31:00.172 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.172 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.172 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:00.172 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263979+0000", 2024-05-08T18:31:00.172 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011919899999999999 2024-05-08T18:31:00.173 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.173 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.173 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:00.173 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.264222+0000", 2024-05-08T18:31:00.173 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024290800000000001 2024-05-08T18:31:00.173 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.173 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.173 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:00.173 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.264545+0000", 2024-05-08T18:31:00.173 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00032300200000000002 2024-05-08T18:31:00.173 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.174 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.174 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:00.174 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.265682+0000", 2024-05-08T18:31:00.174 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001136464 2024-05-08T18:31:00.174 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.174 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.174 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:00.174 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.266397+0000", 2024-05-08T18:31:00.174 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00071512799999999999 2024-05-08T18:31:00.174 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.174 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.174 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:00.174 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.266504+0000", 2024-05-08T18:31:00.175 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000107019 2024-05-08T18:31:00.175 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.175 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.175 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:00.175 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.266575+0000", 2024-05-08T18:31:00.175 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1305999999999998e-05 2024-05-08T18:31:00.175 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:00.175 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:00.175 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:00.175 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.175 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.175 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:00.175 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.445706+0000", 2024-05-08T18:31:00.176 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 67.603207963000003, 2024-05-08T18:31:00.176 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0026820630000000002, 2024-05-08T18:31:00.176 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:00.176 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:00.176 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:00.176 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:00.176 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:00.176 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:00.176 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 889 2024-05-08T18:31:00.176 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.176 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:00.176 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.176 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:00.176 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445706+0000", 2024-05-08T18:31:00.177 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:00.177 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.177 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.177 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:00.177 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445706+0000", 2024-05-08T18:31:00.177 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:00.177 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.177 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.177 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:00.177 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445709+0000", 2024-05-08T18:31:00.177 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0299999999999998e-06 2024-05-08T18:31:00.177 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.177 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.177 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:00.178 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445721+0000", 2024-05-08T18:31:00.178 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2366e-05 2024-05-08T18:31:00.178 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.178 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.178 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:00.178 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445752+0000", 2024-05-08T18:31:00.178 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0287e-05 2024-05-08T18:31:00.178 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.178 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.178 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:00.178 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445773+0000", 2024-05-08T18:31:00.178 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1367000000000001e-05 2024-05-08T18:31:00.178 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.179 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.179 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:00.179 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445892+0000", 2024-05-08T18:31:00.179 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000119311 2024-05-08T18:31:00.179 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.179 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.179 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:00.179 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.446158+0000", 2024-05-08T18:31:00.179 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000265441 2024-05-08T18:31:00.179 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.179 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.179 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:00.179 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.446465+0000", 2024-05-08T18:31:00.180 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00030754300000000002 2024-05-08T18:31:00.180 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.180 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.180 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:00.180 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.447511+0000", 2024-05-08T18:31:00.180 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001045975 2024-05-08T18:31:00.180 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.180 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.180 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:00.180 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.448171+0000", 2024-05-08T18:31:00.180 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00065971200000000002 2024-05-08T18:31:00.180 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.180 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.181 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:00.181 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.448273+0000", 2024-05-08T18:31:00.181 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000101592 2024-05-08T18:31:00.181 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.181 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.181 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:00.181 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.448388+0000", 2024-05-08T18:31:00.181 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115439 2024-05-08T18:31:00.181 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:00.181 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:00.181 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:00.181 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.181 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.182 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1020 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_add in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-05-08T18:31:00.182 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:30:21.842276+0000", 2024-05-08T18:31:00.182 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 38.206638421999997, 2024-05-08T18:31:00.182 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0025898760000000001, 2024-05-08T18:31:00.182 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:00.182 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:00.182 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:00.182 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:00.182 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:00.182 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:00.182 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1020 2024-05-08T18:31:00.182 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.182 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:00.183 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.183 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:00.183 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842276+0000", 2024-05-08T18:31:00.183 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:00.183 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.183 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.183 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:00.183 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842276+0000", 2024-05-08T18:31:00.183 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:00.183 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.183 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.183 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:00.183 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842278+0000", 2024-05-08T18:31:00.183 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6129999999999998e-06 2024-05-08T18:31:00.184 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.184 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.184 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:00.184 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842290+0000", 2024-05-08T18:31:00.184 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2187999999999999e-05 2024-05-08T18:31:00.184 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.184 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.184 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:00.184 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842319+0000", 2024-05-08T18:31:00.184 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8782e-05 2024-05-08T18:31:00.184 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.184 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.184 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:00.184 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842336+0000", 2024-05-08T18:31:00.185 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6826000000000001e-05 2024-05-08T18:31:00.185 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.185 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.185 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:00.185 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842450+0000", 2024-05-08T18:31:00.185 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000113829 2024-05-08T18:31:00.185 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.185 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.185 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:00.185 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842627+0000", 2024-05-08T18:31:00.185 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00017756599999999999 2024-05-08T18:31:00.185 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.185 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.185 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:00.186 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842794+0000", 2024-05-08T18:31:00.186 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000166866 2024-05-08T18:31:00.186 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.186 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.186 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:00.186 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.843540+0000", 2024-05-08T18:31:00.186 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00074611700000000003 2024-05-08T18:31:00.186 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.186 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.186 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:00.186 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.844762+0000", 2024-05-08T18:31:00.186 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012220309999999999 2024-05-08T18:31:00.187 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.187 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.187 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:00.187 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.844806+0000", 2024-05-08T18:31:00.187 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3414000000000001e-05 2024-05-08T18:31:00.187 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:00.187 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:00.187 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:00.187 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.844865+0000", 2024-05-08T18:31:00.187 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9644e-05 2024-05-08T18:31:00.187 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:00.187 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:00.187 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:00.187 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:00.188 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:00.188 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:00.188 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-08T18:31:00.190 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-08T18:31:00.190 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:31:00.187+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:31:00.290 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:31:00.287+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:31:00.347 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:00.347 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:31:00.347 INFO:teuthology.orchestra.run.smithi097.stdout: "num_ops": 0 2024-05-08T18:31:00.347 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:00.365 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-08T18:31:00.367 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2024-05-08T18:31:00.367 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:31:00.385 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2024-05-08T18:31:00.385 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:31:00.391 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:31:00.387+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:31:00.402 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2024-05-08T18:31:00.402 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:31:00.420 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2024-05-08T18:31:00.420 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:31:00.442 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2024-05-08T18:31:00.442 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:31:00.461 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2024-05-08T18:31:00.461 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:31:00.480 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:00.480 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:00.481 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2024-05-08T18:31:00.481 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:31:00.492 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:31:00.491+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:31:00.494 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-08T18:31:00.502 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2024-05-08T18:31:00.503 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:31:00.594 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:31:00.591+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:31:00.620 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:00.620 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:00.625 INFO:teuthology.orchestra.run.smithi097.stderr:noscrub is set 2024-05-08T18:31:00.639 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-08T18:31:00.695 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:31:00.695+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:31:00.754 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:00.754 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:00.767 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-08T18:31:00.796 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:31:00.791+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:31:00.896 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:31:00.895+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:31:00.926 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:00.926 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:00.939 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-08T18:31:01.027 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:31:01.027+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:31:01.098 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:31:01.095+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:31:01.099 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:01.099 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:01.112 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-08T18:31:01.199 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:31:01.199+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:31:01.273 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:01.274 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:01.288 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-08T18:31:01.300 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:31:01.299+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:31:01.401 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:01.401 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:01.401 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:31:01.403+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:31:01.414 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-08T18:31:01.502 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:31:01.499+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:31:01.531 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:01.531 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:01.545 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-08T18:31:01.603 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:31:01.603+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:31:01.679 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:01.679 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:01.693 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-08T18:31:01.737 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:31:01.735+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:31:01.804 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:31:01.803+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:31:01.814 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:01.815 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:01.829 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-08T18:31:01.905 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:31:01.903+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:31:01.999 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:01.999 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:02.007 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:31:02.007+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:31:02.013 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-08T18:31:02.107 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:31:02.103+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:31:02.133 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:02.133 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:02.147 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-08T18:31:02.208 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:31:02.207+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:31:02.308 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:31:02.307+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:31:02.312 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:02.313 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:02.327 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-08T18:31:02.409 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:31:02.407+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:31:02.449 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:02.449 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:02.465 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-08T18:31:02.510 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:31:02.507+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:31:02.521 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-08T18:31:02.611 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:31:02.611+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:31:02.633 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:02.633 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:02.648 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-08T18:31:02.654 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-08T18:31:02.675 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2024-05-08T18:31:02.676 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:31:02.697 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2024-05-08T18:31:02.698 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:31:02.711 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:31:02.707+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:31:02.729 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2024-05-08T18:31:02.729 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:31:02.760 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2024-05-08T18:31:02.760 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:31:02.767 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:02.767 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:02.779 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2024-05-08T18:31:02.779 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:31:02.782 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-08T18:31:02.811 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2024-05-08T18:31:02.811 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:31:02.825 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:31:02.823+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:31:02.843 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2024-05-08T18:31:02.843 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:31:02.875 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2024-05-08T18:31:02.875 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:31:02.913 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:31:02.911+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:31:02.948 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:31:02.948 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2024-05-08T18:31:02.948 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2024-05-08T18:31:02.948 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-05-08T18:31:02.949 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.949 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:31:02.949 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:48.647802+0000", 2024-05-08T18:31:02.949 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 74.298784073999997, 2024-05-08T18:31:02.949 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0027254660000000002, 2024-05-08T18:31:02.949 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:02.949 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:02.949 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:02.949 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:02.949 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:31:02.949 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:02.949 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 46 2024-05-08T18:31:02.949 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.950 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:02.950 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.950 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:02.950 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.647802+0000", 2024-05-08T18:31:02.950 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:02.950 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.950 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.950 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:02.950 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.647802+0000", 2024-05-08T18:31:02.950 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:02.950 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.950 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.950 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:02.951 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.647805+0000", 2024-05-08T18:31:02.951 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8940000000000002e-06 2024-05-08T18:31:02.951 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.951 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.951 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:02.951 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.647816+0000", 2024-05-08T18:31:02.951 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0998999999999999e-05 2024-05-08T18:31:02.951 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.951 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.951 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:02.951 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.647846+0000", 2024-05-08T18:31:02.951 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.027e-05 2024-05-08T18:31:02.951 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.952 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.952 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:02.952 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.647865+0000", 2024-05-08T18:31:02.952 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.808e-05 2024-05-08T18:31:02.952 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.952 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.952 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:02.952 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.647994+0000", 2024-05-08T18:31:02.952 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012923899999999999 2024-05-08T18:31:02.952 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.952 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.952 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:02.953 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.648289+0000", 2024-05-08T18:31:02.953 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029495999999999998 2024-05-08T18:31:02.953 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.953 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.953 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 4", 2024-05-08T18:31:02.953 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.648576+0000", 2024-05-08T18:31:02.953 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00028707599999999999 2024-05-08T18:31:02.953 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.953 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.953 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:02.953 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.649703+0000", 2024-05-08T18:31:02.953 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001126658 2024-05-08T18:31:02.953 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.954 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.954 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:02.954 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.650337+0000", 2024-05-08T18:31:02.954 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00063405500000000001 2024-05-08T18:31:02.954 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.954 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.954 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:02.954 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.650451+0000", 2024-05-08T18:31:02.954 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011476600000000001 2024-05-08T18:31:02.954 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.955 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.955 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:02.955 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.650528+0000", 2024-05-08T18:31:02.955 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6469000000000003e-05 2024-05-08T18:31:02.955 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:02.955 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:02.955 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:02.955 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.955 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.955 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94069412627456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:31:02.955 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:48.650773+0000", 2024-05-08T18:31:02.955 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 74.295813535999997, 2024-05-08T18:31:02.955 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0024358209999999999, 2024-05-08T18:31:02.955 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:02.956 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:02.956 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:02.956 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:02.956 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:31:02.956 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:02.956 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 47 2024-05-08T18:31:02.956 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.956 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:02.956 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.956 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:02.956 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.650773+0000", 2024-05-08T18:31:02.956 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:02.956 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.957 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.957 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:02.957 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.650773+0000", 2024-05-08T18:31:02.957 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:02.957 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.957 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.957 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:02.957 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.650775+0000", 2024-05-08T18:31:02.957 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.4030000000000001e-06 2024-05-08T18:31:02.957 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.957 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.957 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:02.958 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.650785+0000", 2024-05-08T18:31:02.958 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0027000000000001e-05 2024-05-08T18:31:02.958 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.958 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.958 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:02.958 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.650814+0000", 2024-05-08T18:31:02.958 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8350000000000001e-05 2024-05-08T18:31:02.958 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.958 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.958 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:02.958 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.650848+0000", 2024-05-08T18:31:02.958 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4566000000000001e-05 2024-05-08T18:31:02.958 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.959 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.959 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:02.959 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.650963+0000", 2024-05-08T18:31:02.959 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011506300000000001 2024-05-08T18:31:02.959 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.959 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.959 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:02.959 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.651153+0000", 2024-05-08T18:31:02.959 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000189812 2024-05-08T18:31:02.959 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.959 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.959 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 4", 2024-05-08T18:31:02.959 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.651493+0000", 2024-05-08T18:31:02.959 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000339616 2024-05-08T18:31:02.960 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.960 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.960 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:02.960 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.652662+0000", 2024-05-08T18:31:02.960 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0011695410000000001 2024-05-08T18:31:02.960 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.960 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.960 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:02.960 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.652998+0000", 2024-05-08T18:31:02.960 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000335788 2024-05-08T18:31:02.960 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.960 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.961 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:02.961 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.653076+0000", 2024-05-08T18:31:02.961 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8120000000000004e-05 2024-05-08T18:31:02.961 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.961 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.961 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:02.961 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.653209+0000", 2024-05-08T18:31:02.961 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000132535 2024-05-08T18:31:02.961 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:02.961 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:02.961 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:02.961 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.961 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.962 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:31:02.962 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:48.659528+0000", 2024-05-08T18:31:02.962 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 74.287058321000004, 2024-05-08T18:31:02.962 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0025123260000000001, 2024-05-08T18:31:02.962 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:02.962 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:02.962 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:02.962 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:02.962 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:31:02.962 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:02.962 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 54 2024-05-08T18:31:02.962 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.963 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:02.963 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.963 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:02.963 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.659528+0000", 2024-05-08T18:31:02.963 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:02.963 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.963 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.963 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:02.963 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.659528+0000", 2024-05-08T18:31:02.963 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:02.963 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.963 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.963 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:02.964 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.659530+0000", 2024-05-08T18:31:02.964 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9429999999999999e-06 2024-05-08T18:31:02.964 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.964 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.964 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:02.964 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.659540+0000", 2024-05-08T18:31:02.964 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0147e-05 2024-05-08T18:31:02.964 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.964 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.964 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:02.964 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.659569+0000", 2024-05-08T18:31:02.964 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.923e-05 2024-05-08T18:31:02.964 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.965 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.965 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:02.965 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.659584+0000", 2024-05-08T18:31:02.965 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4996e-05 2024-05-08T18:31:02.965 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.965 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.965 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:02.965 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.659716+0000", 2024-05-08T18:31:02.965 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000131457 2024-05-08T18:31:02.965 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.965 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.965 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:02.965 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.659895+0000", 2024-05-08T18:31:02.966 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017940400000000001 2024-05-08T18:31:02.966 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.966 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.966 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:31:02.966 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.660092+0000", 2024-05-08T18:31:02.966 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000197002 2024-05-08T18:31:02.966 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.966 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.966 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:02.966 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.661227+0000", 2024-05-08T18:31:02.966 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0011346150000000001 2024-05-08T18:31:02.966 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.966 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.967 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:02.967 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.661907+0000", 2024-05-08T18:31:02.967 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00068008800000000002 2024-05-08T18:31:02.967 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.967 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.967 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:02.967 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.661978+0000", 2024-05-08T18:31:02.967 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1538999999999994e-05 2024-05-08T18:31:02.967 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.967 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.967 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:02.967 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.662040+0000", 2024-05-08T18:31:02.968 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1904999999999998e-05 2024-05-08T18:31:02.968 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:02.968 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:02.968 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:02.968 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.968 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.968 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94069412622848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:31:02.968 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:48.662241+0000", 2024-05-08T18:31:02.968 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 74.284344994999998, 2024-05-08T18:31:02.968 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029022259999999999, 2024-05-08T18:31:02.968 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:02.968 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:02.968 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:02.969 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:02.969 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:31:02.969 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:02.969 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 55 2024-05-08T18:31:02.969 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.969 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:02.969 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.969 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:02.969 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.662241+0000", 2024-05-08T18:31:02.969 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:02.969 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.969 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.969 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:02.969 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.662241+0000", 2024-05-08T18:31:02.970 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:02.970 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.970 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.970 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:02.970 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.662243+0000", 2024-05-08T18:31:02.970 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.716e-06 2024-05-08T18:31:02.970 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.970 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.970 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:02.970 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.662267+0000", 2024-05-08T18:31:02.970 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3949999999999999e-05 2024-05-08T18:31:02.970 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.971 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.971 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:02.971 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.662293+0000", 2024-05-08T18:31:02.971 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6376e-05 2024-05-08T18:31:02.971 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.971 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.971 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:02.971 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.662310+0000", 2024-05-08T18:31:02.971 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6520000000000001e-05 2024-05-08T18:31:02.971 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.971 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.971 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:02.971 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.662412+0000", 2024-05-08T18:31:02.971 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010228700000000001 2024-05-08T18:31:02.972 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.972 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.972 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:02.972 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.662514+0000", 2024-05-08T18:31:02.972 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0001019 2024-05-08T18:31:02.972 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.972 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.972 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:31:02.972 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.662714+0000", 2024-05-08T18:31:02.972 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020008100000000001 2024-05-08T18:31:02.972 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.972 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.972 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:02.973 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.663711+0000", 2024-05-08T18:31:02.973 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00099629899999999997 2024-05-08T18:31:02.973 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.973 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.973 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:02.973 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.664976+0000", 2024-05-08T18:31:02.973 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0012652679999999999 2024-05-08T18:31:02.973 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.973 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.973 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:02.973 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.665047+0000", 2024-05-08T18:31:02.973 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1277000000000002e-05 2024-05-08T18:31:02.973 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.973 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.974 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:02.974 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:48.665144+0000", 2024-05-08T18:31:02.974 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6552000000000007e-05 2024-05-08T18:31:02.974 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:02.974 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:02.974 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:02.974 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.974 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.974 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:209 6.3 e33/27 6:c60da066:gc::gc.4:head v 33'1, mlcod=0'0)", 2024-05-08T18:31:02.974 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.686317+0000", 2024-05-08T18:31:02.974 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 71.260268991000004, 2024-05-08T18:31:02.974 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032126889999999999, 2024-05-08T18:31:02.974 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:02.975 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:02.975 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:02.975 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:02.975 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.975 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:02.975 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.686317+0000", 2024-05-08T18:31:02.975 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:02.975 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.975 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.975 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:02.975 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.686317+0000", 2024-05-08T18:31:02.975 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:02.975 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.976 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.976 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:02.976 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.686318+0000", 2024-05-08T18:31:02.976 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5400000000000001e-07 2024-05-08T18:31:02.976 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.976 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.976 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:02.976 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.686326+0000", 2024-05-08T18:31:02.976 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3000000000000002e-06 2024-05-08T18:31:02.976 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.976 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.976 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:02.977 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.686358+0000", 2024-05-08T18:31:02.977 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1702999999999998e-05 2024-05-08T18:31:02.977 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.977 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.977 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:02.977 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.686374+0000", 2024-05-08T18:31:02.977 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6266e-05 2024-05-08T18:31:02.977 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.977 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.977 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:02.977 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.686530+0000", 2024-05-08T18:31:02.977 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015583599999999999 2024-05-08T18:31:02.977 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.978 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.978 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:02.978 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.686573+0000", 2024-05-08T18:31:02.978 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3248999999999999e-05 2024-05-08T18:31:02.978 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.978 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.978 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:02.978 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.689412+0000", 2024-05-08T18:31:02.978 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0028385720000000001 2024-05-08T18:31:02.978 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.978 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.978 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:02.978 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.689530+0000", 2024-05-08T18:31:02.979 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000118109 2024-05-08T18:31:02.979 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:02.979 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:02.979 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:02.979 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.979 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.979 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:217 6.15 e33/27 6:ab569f81:gc::gc.12:head v 33'1, mlcod=0'0)", 2024-05-08T18:31:02.979 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.722458+0000", 2024-05-08T18:31:02.979 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 71.224128449999995, 2024-05-08T18:31:02.979 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001760604, 2024-05-08T18:31:02.979 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:02.979 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:02.979 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:02.980 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:02.980 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.980 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:02.980 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.722458+0000", 2024-05-08T18:31:02.980 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:02.980 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.980 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.980 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:02.980 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.722458+0000", 2024-05-08T18:31:02.980 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:02.980 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.980 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.981 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:02.981 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.722460+0000", 2024-05-08T18:31:02.981 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.677e-06 2024-05-08T18:31:02.981 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.981 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.981 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:02.981 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.722471+0000", 2024-05-08T18:31:02.981 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0956e-05 2024-05-08T18:31:02.981 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.981 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.981 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:02.981 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.722496+0000", 2024-05-08T18:31:02.981 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5490000000000002e-05 2024-05-08T18:31:02.982 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.982 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.982 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:02.982 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.722511+0000", 2024-05-08T18:31:02.982 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4687e-05 2024-05-08T18:31:02.982 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.982 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.982 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:02.982 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.722609+0000", 2024-05-08T18:31:02.982 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8152000000000005e-05 2024-05-08T18:31:02.982 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.982 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.983 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:02.983 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.722638+0000", 2024-05-08T18:31:02.983 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.934e-05 2024-05-08T18:31:02.983 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.983 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.983 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:02.983 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.724127+0000", 2024-05-08T18:31:02.983 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001488622 2024-05-08T18:31:02.983 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.983 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.983 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:02.983 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.724219+0000", 2024-05-08T18:31:02.983 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1680000000000003e-05 2024-05-08T18:31:02.983 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:02.984 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:02.984 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:02.984 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.984 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.984 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:231 6.1f e33/27 6:fde4dd55:gc::gc.26:head v 33'1, mlcod=0'0)", 2024-05-08T18:31:02.984 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.773905+0000", 2024-05-08T18:31:02.984 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 71.172680909999997, 2024-05-08T18:31:02.984 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002018681, 2024-05-08T18:31:02.984 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:02.984 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:02.984 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:02.984 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:02.984 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.985 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:02.985 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.773905+0000", 2024-05-08T18:31:02.985 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:02.985 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.985 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.985 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:02.985 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.773905+0000", 2024-05-08T18:31:02.985 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:02.985 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.985 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.985 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:02.985 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.773906+0000", 2024-05-08T18:31:02.986 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2300000000000001e-07 2024-05-08T18:31:02.986 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.986 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.986 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:02.986 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.773913+0000", 2024-05-08T18:31:02.986 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8399999999999997e-06 2024-05-08T18:31:02.986 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.986 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.986 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:02.986 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.773938+0000", 2024-05-08T18:31:02.986 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.4977000000000002e-05 2024-05-08T18:31:02.986 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.986 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.986 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:02.987 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.773970+0000", 2024-05-08T18:31:02.987 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1673e-05 2024-05-08T18:31:02.987 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.987 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.987 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:02.987 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.774112+0000", 2024-05-08T18:31:02.987 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014273899999999999 2024-05-08T18:31:02.987 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.987 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.987 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:02.987 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.774167+0000", 2024-05-08T18:31:02.987 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4762000000000002e-05 2024-05-08T18:31:02.987 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.988 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.988 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:02.988 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.775832+0000", 2024-05-08T18:31:02.988 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0016648539999999999 2024-05-08T18:31:02.988 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.988 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.988 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:02.988 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.775924+0000", 2024-05-08T18:31:02.988 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2312999999999995e-05 2024-05-08T18:31:02.988 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:02.988 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:02.988 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:02.988 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.989 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.989 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:328 6.15 e33/27 6:ab569f81:gc::gc.12:head v 33'3, mlcod=33'1)", 2024-05-08T18:31:02.989 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.811368+0000", 2024-05-08T18:31:02.989 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 71.135218409000004, 2024-05-08T18:31:02.989 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0019828110000000001, 2024-05-08T18:31:02.989 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:02.989 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:02.989 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:02.989 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:02.989 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.989 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:02.989 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.811368+0000", 2024-05-08T18:31:02.989 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:02.989 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.990 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.990 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:02.990 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.811368+0000", 2024-05-08T18:31:02.990 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:02.990 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.990 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.990 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:02.990 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.811370+0000", 2024-05-08T18:31:02.990 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.883e-06 2024-05-08T18:31:02.990 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.990 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.990 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:02.991 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.811385+0000", 2024-05-08T18:31:02.991 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5489999999999999e-05 2024-05-08T18:31:02.991 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.991 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.991 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:02.991 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.811422+0000", 2024-05-08T18:31:02.991 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7023000000000001e-05 2024-05-08T18:31:02.991 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.991 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.991 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:02.991 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.811443+0000", 2024-05-08T18:31:02.991 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0194e-05 2024-05-08T18:31:02.991 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.992 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.992 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:02.992 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.811582+0000", 2024-05-08T18:31:02.992 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000139068 2024-05-08T18:31:02.992 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.992 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.992 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:02.992 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.811646+0000", 2024-05-08T18:31:02.992 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4113000000000001e-05 2024-05-08T18:31:02.992 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.992 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.992 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:02.992 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.813243+0000", 2024-05-08T18:31:02.992 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0015969249999999999 2024-05-08T18:31:02.993 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.993 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.993 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:02.993 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.813351+0000", 2024-05-08T18:31:02.993 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000108115 2024-05-08T18:31:02.993 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:02.993 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:02.993 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:02.993 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.993 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.993 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:341 6.1 e33/27 6:856b9b26:reshard::reshard.0000000002:head v 33'2, mlcod=0'0)", 2024-05-08T18:31:02.993 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.813091+0000", 2024-05-08T18:31:02.993 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 71.133495142000001, 2024-05-08T18:31:02.994 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0021783459999999998, 2024-05-08T18:31:02.994 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:02.994 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:02.994 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:02.994 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:02.994 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.994 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:02.994 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.813091+0000", 2024-05-08T18:31:02.994 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:02.994 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.994 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.994 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:02.994 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.813091+0000", 2024-05-08T18:31:02.995 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:02.995 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.995 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.995 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:02.995 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.813093+0000", 2024-05-08T18:31:02.995 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.813e-06 2024-05-08T18:31:02.995 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.995 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.995 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:02.995 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.813107+0000", 2024-05-08T18:31:02.995 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3730000000000001e-05 2024-05-08T18:31:02.995 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.995 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.996 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:02.996 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.813177+0000", 2024-05-08T18:31:02.996 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9801999999999993e-05 2024-05-08T18:31:02.996 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.996 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.996 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:02.996 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.813198+0000", 2024-05-08T18:31:02.996 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1347000000000001e-05 2024-05-08T18:31:02.996 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.996 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.996 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:02.996 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.813321+0000", 2024-05-08T18:31:02.996 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000123192 2024-05-08T18:31:02.997 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.997 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.997 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:02.997 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.813373+0000", 2024-05-08T18:31:02.997 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2046999999999998e-05 2024-05-08T18:31:02.997 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.997 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.997 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:02.997 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.815181+0000", 2024-05-08T18:31:02.997 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001807562 2024-05-08T18:31:02.997 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.997 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.997 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:02.997 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.815270+0000", 2024-05-08T18:31:02.998 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8852999999999998e-05 2024-05-08T18:31:02.998 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:02.998 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:02.998 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:02.998 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.998 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.998 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:404 6.3 e33/27 6:c623b173:gc::gc.16:head v 33'6, mlcod=33'4)", 2024-05-08T18:31:02.998 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.837510+0000", 2024-05-08T18:31:02.998 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 71.109076830999996, 2024-05-08T18:31:02.998 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0023724549999999999, 2024-05-08T18:31:02.998 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:02.998 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:02.999 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:02.999 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:02.999 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.999 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:02.999 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.837510+0000", 2024-05-08T18:31:02.999 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:02.999 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.999 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.999 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:02.999 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.837510+0000", 2024-05-08T18:31:02.999 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:02.999 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:02.999 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:02.999 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:03.000 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.837511+0000", 2024-05-08T18:31:03.000 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.863e-06 2024-05-08T18:31:03.000 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.000 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.000 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:03.000 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.837526+0000", 2024-05-08T18:31:03.000 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4756999999999999e-05 2024-05-08T18:31:03.000 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.000 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.000 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:03.000 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.837564+0000", 2024-05-08T18:31:03.000 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7645999999999998e-05 2024-05-08T18:31:03.000 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.000 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.001 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:03.001 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.837584+0000", 2024-05-08T18:31:03.001 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9763999999999999e-05 2024-05-08T18:31:03.001 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.001 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.001 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:03.001 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.837724+0000", 2024-05-08T18:31:03.001 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014080200000000001 2024-05-08T18:31:03.001 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.001 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.001 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:03.001 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.837776+0000", 2024-05-08T18:31:03.001 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1279000000000002e-05 2024-05-08T18:31:03.001 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.002 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.002 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:03.002 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.839770+0000", 2024-05-08T18:31:03.002 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001994048 2024-05-08T18:31:03.002 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.002 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.002 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:03.002 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.839882+0000", 2024-05-08T18:31:03.002 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000112296 2024-05-08T18:31:03.002 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:03.002 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:03.002 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:03.002 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.003 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.003 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:414 6.c e33/27 6:338eb7e9:::obj_delete_at_hint.0000000008:head v 33'3, mlcod=33'1)", 2024-05-08T18:31:03.003 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.841401+0000", 2024-05-08T18:31:03.003 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 71.105185680999995, 2024-05-08T18:31:03.003 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001916865, 2024-05-08T18:31:03.003 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:03.003 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:03.003 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:03.003 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:03.003 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.003 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:03.003 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.841401+0000", 2024-05-08T18:31:03.003 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:03.003 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.004 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.004 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:03.004 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.841401+0000", 2024-05-08T18:31:03.004 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:03.004 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.004 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.004 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:03.004 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.841402+0000", 2024-05-08T18:31:03.004 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6899999999999999e-06 2024-05-08T18:31:03.004 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.004 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.004 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:03.004 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.841414+0000", 2024-05-08T18:31:03.005 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.183e-05 2024-05-08T18:31:03.005 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.005 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.005 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:03.005 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.841435+0000", 2024-05-08T18:31:03.005 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0876000000000001e-05 2024-05-08T18:31:03.005 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.005 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.005 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:03.005 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.841451+0000", 2024-05-08T18:31:03.005 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5784e-05 2024-05-08T18:31:03.005 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.005 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.005 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:03.006 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.841597+0000", 2024-05-08T18:31:03.006 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014639899999999999 2024-05-08T18:31:03.006 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.006 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.006 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:03.006 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.841656+0000", 2024-05-08T18:31:03.006 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.8485e-05 2024-05-08T18:31:03.006 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.006 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.006 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:03.006 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.843235+0000", 2024-05-08T18:31:03.006 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0015787920000000001 2024-05-08T18:31:03.006 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.007 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.007 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:03.007 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.843318+0000", 2024-05-08T18:31:03.007 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3009000000000004e-05 2024-05-08T18:31:03.007 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:03.007 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:03.007 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:03.007 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.007 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.007 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:422 6.c e33/27 6:338eb7e9:::obj_delete_at_hint.0000000008:head v 33'4, mlcod=33'2)", 2024-05-08T18:31:03.007 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.844520+0000", 2024-05-08T18:31:03.007 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 71.102066535000006, 2024-05-08T18:31:03.007 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002269929, 2024-05-08T18:31:03.007 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:03.008 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:03.008 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:03.008 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:03.008 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.008 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:03.008 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.844520+0000", 2024-05-08T18:31:03.008 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:03.008 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.008 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.008 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:03.008 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.844520+0000", 2024-05-08T18:31:03.008 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:03.008 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.008 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.009 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:03.009 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.844522+0000", 2024-05-08T18:31:03.009 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.643e-06 2024-05-08T18:31:03.009 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.009 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.009 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:03.009 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.844577+0000", 2024-05-08T18:31:03.009 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5976000000000001e-05 2024-05-08T18:31:03.009 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.009 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.009 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:03.009 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.844613+0000", 2024-05-08T18:31:03.009 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5339999999999997e-05 2024-05-08T18:31:03.010 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.010 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.010 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:03.010 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.844638+0000", 2024-05-08T18:31:03.010 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5165999999999999e-05 2024-05-08T18:31:03.010 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.010 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.010 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:03.010 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.844795+0000", 2024-05-08T18:31:03.010 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015660899999999999 2024-05-08T18:31:03.010 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.011 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.011 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:03.011 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.844841+0000", 2024-05-08T18:31:03.011 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6279999999999997e-05 2024-05-08T18:31:03.011 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.011 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.011 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:03.011 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.846707+0000", 2024-05-08T18:31:03.011 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0018657249999999999 2024-05-08T18:31:03.011 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.011 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.011 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:03.011 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.846790+0000", 2024-05-08T18:31:03.012 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3189999999999995e-05 2024-05-08T18:31:03.012 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:03.012 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:03.012 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:03.012 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.012 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.012 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:425 6.a e33/27 6:50d64734:::obj_delete_at_hint.0000000009:head v 33'2, mlcod=0'0)", 2024-05-08T18:31:03.012 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.848220+0000", 2024-05-08T18:31:03.012 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 71.098366416999994, 2024-05-08T18:31:03.012 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0017145109999999999, 2024-05-08T18:31:03.012 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:03.012 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:03.012 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:03.012 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:03.013 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.013 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:03.013 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.848220+0000", 2024-05-08T18:31:03.013 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:03.013 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.013 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.013 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:03.013 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.848220+0000", 2024-05-08T18:31:03.013 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:03.013 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.013 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.013 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:03.013 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.848222+0000", 2024-05-08T18:31:03.014 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9630000000000001e-06 2024-05-08T18:31:03.014 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.014 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.014 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:03.014 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.848254+0000", 2024-05-08T18:31:03.014 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2047e-05 2024-05-08T18:31:03.014 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.014 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.014 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:03.014 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.848273+0000", 2024-05-08T18:31:03.014 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9493000000000001e-05 2024-05-08T18:31:03.014 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.014 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.015 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:03.015 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.848286+0000", 2024-05-08T18:31:03.015 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2490000000000001e-05 2024-05-08T18:31:03.015 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.015 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.015 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:03.015 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.848414+0000", 2024-05-08T18:31:03.015 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000127785 2024-05-08T18:31:03.015 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.015 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.015 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:03.015 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.848448+0000", 2024-05-08T18:31:03.015 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4233999999999998e-05 2024-05-08T18:31:03.016 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.016 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.016 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:03.016 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.849855+0000", 2024-05-08T18:31:03.016 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001407482 2024-05-08T18:31:03.016 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.016 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.016 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:03.016 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.849934+0000", 2024-05-08T18:31:03.016 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9017000000000006e-05 2024-05-08T18:31:03.016 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:03.016 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:03.016 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:03.016 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.017 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.017 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:436 6.a e33/27 6:55b0279d:reshard::reshard.0000000009:head v 33'4, mlcod=33'1)", 2024-05-08T18:31:03.017 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.853725+0000", 2024-05-08T18:31:03.017 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 71.092860900000005, 2024-05-08T18:31:03.017 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032824949999999999, 2024-05-08T18:31:03.017 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:03.017 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:03.017 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:03.017 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:03.017 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.017 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:03.017 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.853725+0000", 2024-05-08T18:31:03.017 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:03.018 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.018 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.018 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:03.018 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.853725+0000", 2024-05-08T18:31:03.018 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:03.018 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.018 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.018 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:03.018 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.853727+0000", 2024-05-08T18:31:03.018 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6899999999999999e-06 2024-05-08T18:31:03.018 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.018 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.018 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:03.019 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.853742+0000", 2024-05-08T18:31:03.019 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.517e-05 2024-05-08T18:31:03.019 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.019 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.019 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:03.019 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.853778+0000", 2024-05-08T18:31:03.019 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5173999999999999e-05 2024-05-08T18:31:03.019 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.019 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.019 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:03.019 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.853791+0000", 2024-05-08T18:31:03.019 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.345e-05 2024-05-08T18:31:03.019 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.019 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.020 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:03.020 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.853912+0000", 2024-05-08T18:31:03.020 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012149199999999999 2024-05-08T18:31:03.020 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.020 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.020 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:03.020 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.853960+0000", 2024-05-08T18:31:03.020 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7262999999999998e-05 2024-05-08T18:31:03.020 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.020 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.020 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:03.020 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.856896+0000", 2024-05-08T18:31:03.020 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029363700000000002 2024-05-08T18:31:03.021 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.021 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.021 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:03.021 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.857008+0000", 2024-05-08T18:31:03.021 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011188600000000001 2024-05-08T18:31:03.021 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:03.021 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:03.021 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:03.021 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.021 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.021 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:457 6.1 e33/27 6:80b6fe23:reshard::reshard.0000000011:head v 33'3, mlcod=33'1)", 2024-05-08T18:31:03.021 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.865322+0000", 2024-05-08T18:31:03.021 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 71.081264254999994, 2024-05-08T18:31:03.021 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001750756, 2024-05-08T18:31:03.022 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:03.022 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:03.022 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:03.022 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:03.022 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.022 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:03.022 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.865322+0000", 2024-05-08T18:31:03.022 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:03.022 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.022 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.022 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:03.022 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.865322+0000", 2024-05-08T18:31:03.022 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:03.023 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.023 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.023 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:03.023 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.865325+0000", 2024-05-08T18:31:03.023 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5660000000000001e-06 2024-05-08T18:31:03.023 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.023 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.023 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:03.023 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.865339+0000", 2024-05-08T18:31:03.023 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.412e-05 2024-05-08T18:31:03.023 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.023 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.023 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:03.024 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.865366+0000", 2024-05-08T18:31:03.024 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7453e-05 2024-05-08T18:31:03.024 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.024 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.024 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:03.024 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.865383+0000", 2024-05-08T18:31:03.024 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.683e-05 2024-05-08T18:31:03.024 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.024 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.024 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:03.024 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.865514+0000", 2024-05-08T18:31:03.024 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000131369 2024-05-08T18:31:03.024 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.025 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.025 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:03.025 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.865583+0000", 2024-05-08T18:31:03.025 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8526000000000001e-05 2024-05-08T18:31:03.025 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.025 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.025 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:03.025 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.866974+0000", 2024-05-08T18:31:03.025 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001391193 2024-05-08T18:31:03.025 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.025 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.025 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:03.025 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.867073+0000", 2024-05-08T18:31:03.026 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8698999999999998e-05 2024-05-08T18:31:03.026 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:03.026 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:03.026 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:03.026 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.026 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.026 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:478 6.a e33/27 6:5127e642:gc::gc.21:head v 33'6, mlcod=33'4)", 2024-05-08T18:31:03.026 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.877617+0000", 2024-05-08T18:31:03.026 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 71.068969142, 2024-05-08T18:31:03.026 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0033938589999999999, 2024-05-08T18:31:03.026 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:03.026 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:03.027 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:03.027 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:03.027 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.027 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:03.027 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877617+0000", 2024-05-08T18:31:03.027 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:03.027 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.027 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.027 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:03.027 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877617+0000", 2024-05-08T18:31:03.027 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:03.027 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.027 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.027 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:03.028 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877619+0000", 2024-05-08T18:31:03.028 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.902e-06 2024-05-08T18:31:03.028 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.028 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.028 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:03.028 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877633+0000", 2024-05-08T18:31:03.028 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4143e-05 2024-05-08T18:31:03.028 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.028 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.028 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:03.028 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877667+0000", 2024-05-08T18:31:03.028 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3516999999999998e-05 2024-05-08T18:31:03.028 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.029 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.029 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:03.029 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877685+0000", 2024-05-08T18:31:03.029 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7931000000000002e-05 2024-05-08T18:31:03.029 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.029 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.029 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:03.029 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877842+0000", 2024-05-08T18:31:03.029 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015742800000000001 2024-05-08T18:31:03.029 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.029 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.029 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:03.029 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.877890+0000", 2024-05-08T18:31:03.030 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7654000000000001e-05 2024-05-08T18:31:03.030 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.030 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.030 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:03.030 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.880908+0000", 2024-05-08T18:31:03.030 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0030181219999999998 2024-05-08T18:31:03.030 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.030 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.030 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:03.030 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.881011+0000", 2024-05-08T18:31:03.030 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000103162 2024-05-08T18:31:03.030 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:03.030 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:03.031 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:03.031 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.031 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.031 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:535 6.1f e33/27 6:fde4dd55:gc::gc.26:head v 33'2, mlcod=0'0)", 2024-05-08T18:31:03.031 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.909602+0000", 2024-05-08T18:31:03.031 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 71.036984696999994, 2024-05-08T18:31:03.031 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0023004039999999998, 2024-05-08T18:31:03.031 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:03.031 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:03.031 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:03.031 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:03.031 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.031 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:03.031 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.909602+0000", 2024-05-08T18:31:03.032 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:03.032 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.032 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.032 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:03.032 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.909602+0000", 2024-05-08T18:31:03.032 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:03.032 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.032 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.032 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:03.032 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.909604+0000", 2024-05-08T18:31:03.032 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8360000000000001e-06 2024-05-08T18:31:03.032 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.032 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.032 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:03.033 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.909615+0000", 2024-05-08T18:31:03.033 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1596999999999999e-05 2024-05-08T18:31:03.033 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.033 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.033 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:03.033 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.909643+0000", 2024-05-08T18:31:03.033 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7457000000000002e-05 2024-05-08T18:31:03.033 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.033 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.033 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:03.033 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.909662+0000", 2024-05-08T18:31:03.033 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9052999999999999e-05 2024-05-08T18:31:03.033 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.033 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.034 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:03.034 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.909758+0000", 2024-05-08T18:31:03.034 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6372000000000005e-05 2024-05-08T18:31:03.034 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.034 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.034 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:03.034 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.909780+0000", 2024-05-08T18:31:03.034 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1719999999999999e-05 2024-05-08T18:31:03.034 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.034 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.034 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:03.034 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.911830+0000", 2024-05-08T18:31:03.034 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002050072 2024-05-08T18:31:03.034 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.035 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.035 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:03.035 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.911902+0000", 2024-05-08T18:31:03.035 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.2297000000000003e-05 2024-05-08T18:31:03.035 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:03.035 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:03.035 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:03.035 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.035 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.035 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:541 6.1f e33/27 6:fde4dd55:gc::gc.26:head v 33'3, mlcod=33'1)", 2024-05-08T18:31:03.035 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.913684+0000", 2024-05-08T18:31:03.035 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 71.032902648999993, 2024-05-08T18:31:03.035 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0036425770000000001, 2024-05-08T18:31:03.036 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:03.036 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:03.036 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:03.036 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:03.036 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.036 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:03.036 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.913684+0000", 2024-05-08T18:31:03.036 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:03.036 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.036 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.036 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:03.036 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.913684+0000", 2024-05-08T18:31:03.036 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:03.036 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.037 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.037 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:03.037 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.913685+0000", 2024-05-08T18:31:03.037 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5859999999999999e-06 2024-05-08T18:31:03.037 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.037 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.037 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:03.037 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.913696+0000", 2024-05-08T18:31:03.037 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1080000000000001e-05 2024-05-08T18:31:03.037 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.037 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.037 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:03.037 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.913720+0000", 2024-05-08T18:31:03.037 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3614000000000001e-05 2024-05-08T18:31:03.038 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.038 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.038 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:03.038 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.913740+0000", 2024-05-08T18:31:03.038 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9836000000000001e-05 2024-05-08T18:31:03.038 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.038 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.038 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:03.038 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.913901+0000", 2024-05-08T18:31:03.038 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000161039 2024-05-08T18:31:03.038 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.038 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.038 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:03.038 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.913935+0000", 2024-05-08T18:31:03.039 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4353000000000001e-05 2024-05-08T18:31:03.039 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.039 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.039 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:03.039 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.917225+0000", 2024-05-08T18:31:03.039 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032897669999999999 2024-05-08T18:31:03.039 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.039 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.039 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:03.039 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.917326+0000", 2024-05-08T18:31:03.039 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000101302 2024-05-08T18:31:03.039 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:03.040 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:03.040 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:03.040 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.040 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.040 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:543 6.15 e33/27 6:ae95b544:::obj_delete_at_hint.0000000020:head v 33'5, mlcod=33'3)", 2024-05-08T18:31:03.040 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:51.916649+0000", 2024-05-08T18:31:03.040 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 71.029937095999998, 2024-05-08T18:31:03.040 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003362739, 2024-05-08T18:31:03.040 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:03.040 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:03.040 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:03.040 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:03.040 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.040 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:03.041 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.916649+0000", 2024-05-08T18:31:03.041 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:03.041 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.041 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.041 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:03.041 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.916649+0000", 2024-05-08T18:31:03.041 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:03.041 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.041 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.041 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:03.041 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.916651+0000", 2024-05-08T18:31:03.041 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7269999999999999e-06 2024-05-08T18:31:03.041 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.041 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.042 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:03.042 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.916663+0000", 2024-05-08T18:31:03.042 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2183e-05 2024-05-08T18:31:03.042 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.042 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.042 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:03.042 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.916691+0000", 2024-05-08T18:31:03.042 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7864e-05 2024-05-08T18:31:03.042 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.042 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.042 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:03.042 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.916710+0000", 2024-05-08T18:31:03.042 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.912e-05 2024-05-08T18:31:03.043 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.043 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.043 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:03.043 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.916851+0000", 2024-05-08T18:31:03.043 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000141163 2024-05-08T18:31:03.043 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.043 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.043 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:03.043 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.916909+0000", 2024-05-08T18:31:03.043 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.7686000000000003e-05 2024-05-08T18:31:03.043 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.043 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.043 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:03.044 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.919900+0000", 2024-05-08T18:31:03.044 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029909540000000001 2024-05-08T18:31:03.044 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.044 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.044 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:03.044 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:51.920012+0000", 2024-05-08T18:31:03.044 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000112042 2024-05-08T18:31:03.044 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:03.044 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:03.044 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:03.044 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.044 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.044 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:695 6.3 e33/27 6:c31f41d7:gc::gc.10:head v 33'12, mlcod=33'10)", 2024-05-08T18:31:03.045 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:52.017806+0000", 2024-05-08T18:31:03.045 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 70.928780811999999, 2024-05-08T18:31:03.045 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001718373, 2024-05-08T18:31:03.045 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:03.045 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:03.045 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:03.045 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:03.045 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.045 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:03.045 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.017806+0000", 2024-05-08T18:31:03.045 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:03.045 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.046 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.046 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:03.046 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.017806+0000", 2024-05-08T18:31:03.046 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:03.046 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.046 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.046 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:03.046 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.017807+0000", 2024-05-08T18:31:03.046 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8199999999999999e-06 2024-05-08T18:31:03.046 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.046 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.046 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:03.046 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.017818+0000", 2024-05-08T18:31:03.047 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0519999999999999e-05 2024-05-08T18:31:03.047 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.047 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.047 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:03.047 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.017846+0000", 2024-05-08T18:31:03.047 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7729000000000002e-05 2024-05-08T18:31:03.047 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.047 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.047 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:03.047 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.017859+0000", 2024-05-08T18:31:03.047 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3337e-05 2024-05-08T18:31:03.047 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.047 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.047 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:03.048 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.017990+0000", 2024-05-08T18:31:03.048 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013146499999999999 2024-05-08T18:31:03.048 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.048 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.048 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:03.048 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.018039+0000", 2024-05-08T18:31:03.048 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8816999999999997e-05 2024-05-08T18:31:03.048 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.048 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.048 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:03.048 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.019397+0000", 2024-05-08T18:31:03.048 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0013575359999999999 2024-05-08T18:31:03.048 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.048 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.049 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:03.049 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:52.019524+0000", 2024-05-08T18:31:03.049 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012714900000000001 2024-05-08T18:31:03.049 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:03.049 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:03.049 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:03.049 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:03.049 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:03.049 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:31:03.051 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-08T18:31:03.051 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:31:03.051+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:31:03.151 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:31:03.151+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:31:03.219 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:31:03.219 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:31:03.219 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 0 2024-05-08T18:31:03.219 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:31:03.233 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-08T18:31:03.281 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:31:03.279+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:31:03.354 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:31:03.351+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:31:03.357 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:31:03.358 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:31:03.358 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2024-05-08T18:31:03.358 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2024-05-08T18:31:03.358 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:31:03.372 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-08T18:31:03.457 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:31:03.455+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:31:03.542 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:31:03.542 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2024-05-08T18:31:03.543 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2024-05-08T18:31:03.543 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-05-08T18:31:03.543 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.543 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:24 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [write 262144~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:03.543 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.154193+0000", 2024-05-08T18:31:03.543 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 96.385469956999998, 2024-05-08T18:31:03.543 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0085494309999999997, 2024-05-08T18:31:03.543 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:03.543 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:03.543 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:03.543 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:03.543 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:03.544 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:03.544 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 24 2024-05-08T18:31:03.544 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.544 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:03.544 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.544 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:03.544 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154193+0000", 2024-05-08T18:31:03.544 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:03.544 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.544 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.544 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:03.544 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154193+0000", 2024-05-08T18:31:03.544 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:03.544 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.545 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.545 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:03.545 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154194+0000", 2024-05-08T18:31:03.545 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.44e-06 2024-05-08T18:31:03.545 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.545 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.545 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:03.545 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154394+0000", 2024-05-08T18:31:03.545 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00019972499999999999 2024-05-08T18:31:03.545 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.545 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.545 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:03.546 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154417+0000", 2024-05-08T18:31:03.546 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2713000000000001e-05 2024-05-08T18:31:03.546 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.546 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.546 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:03.546 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154437+0000", 2024-05-08T18:31:03.546 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0027e-05 2024-05-08T18:31:03.546 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.546 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.546 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:03.546 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.158438+0000", 2024-05-08T18:31:03.546 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0040011459999999997 2024-05-08T18:31:03.546 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.547 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.547 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:03.547 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.158567+0000", 2024-05-08T18:31:03.547 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012923899999999999 2024-05-08T18:31:03.547 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.547 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.547 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:03.547 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.158787+0000", 2024-05-08T18:31:03.547 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000219581 2024-05-08T18:31:03.547 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.547 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.547 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:03.547 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.162013+0000", 2024-05-08T18:31:03.547 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032261759999999999 2024-05-08T18:31:03.548 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.548 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.548 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:03.548 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.162568+0000", 2024-05-08T18:31:03.548 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00055576900000000001 2024-05-08T18:31:03.548 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.548 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.548 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:03.548 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.162644+0000", 2024-05-08T18:31:03.548 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5516e-05 2024-05-08T18:31:03.548 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.548 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.548 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:03.549 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.162742+0000", 2024-05-08T18:31:03.549 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8098999999999997e-05 2024-05-08T18:31:03.549 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:03.549 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:03.549 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:03.549 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.549 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.549 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:25 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:03.549 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.154495+0000", 2024-05-08T18:31:03.549 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 96.385167663000004, 2024-05-08T18:31:03.549 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010784396999999999, 2024-05-08T18:31:03.549 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:03.549 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:03.550 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:03.550 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:03.550 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:03.550 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:03.550 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 25 2024-05-08T18:31:03.550 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.550 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:03.550 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.550 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:03.550 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154495+0000", 2024-05-08T18:31:03.550 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:03.550 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.550 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.551 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:03.551 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154495+0000", 2024-05-08T18:31:03.551 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:03.551 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.551 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.551 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:03.551 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154496+0000", 2024-05-08T18:31:03.551 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.454e-06 2024-05-08T18:31:03.551 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.551 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.551 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:03.551 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154509+0000", 2024-05-08T18:31:03.551 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2496e-05 2024-05-08T18:31:03.551 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.552 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.552 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:03.552 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154531+0000", 2024-05-08T18:31:03.552 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1987000000000001e-05 2024-05-08T18:31:03.552 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.552 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.552 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:03.552 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154547+0000", 2024-05-08T18:31:03.552 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.577e-05 2024-05-08T18:31:03.552 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.552 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.552 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:03.552 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.160949+0000", 2024-05-08T18:31:03.552 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.006401917 2024-05-08T18:31:03.553 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.553 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.553 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:03.553 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.161102+0000", 2024-05-08T18:31:03.553 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000153826 2024-05-08T18:31:03.553 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.553 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.553 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:03.553 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.161332+0000", 2024-05-08T18:31:03.553 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022918099999999999 2024-05-08T18:31:03.553 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.553 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.553 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:03.553 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.163838+0000", 2024-05-08T18:31:03.554 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0025064079999999999 2024-05-08T18:31:03.554 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.554 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.554 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:03.554 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.165121+0000", 2024-05-08T18:31:03.554 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0012825200000000001 2024-05-08T18:31:03.554 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.554 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.554 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:03.554 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.165212+0000", 2024-05-08T18:31:03.554 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1121999999999999e-05 2024-05-08T18:31:03.554 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.554 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.554 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:03.555 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.165279+0000", 2024-05-08T18:31:03.555 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7716e-05 2024-05-08T18:31:03.555 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:03.555 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:03.555 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:03.555 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.555 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.555 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:41 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:03.555 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247174+0000", 2024-05-08T18:31:03.555 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 96.292488680999995, 2024-05-08T18:31:03.555 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010013393000000001, 2024-05-08T18:31:03.555 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:03.555 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:03.555 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:03.556 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:03.556 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:03.556 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:03.556 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 41 2024-05-08T18:31:03.556 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.556 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:03.556 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.556 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:03.556 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247174+0000", 2024-05-08T18:31:03.556 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:03.556 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.556 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.556 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:03.556 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247174+0000", 2024-05-08T18:31:03.556 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:03.557 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.557 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.557 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:03.557 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247175+0000", 2024-05-08T18:31:03.557 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.9999999999999995e-07 2024-05-08T18:31:03.557 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.557 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.557 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:03.557 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247277+0000", 2024-05-08T18:31:03.557 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010243600000000001 2024-05-08T18:31:03.557 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.557 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.557 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:03.558 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247291+0000", 2024-05-08T18:31:03.558 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4076999999999999e-05 2024-05-08T18:31:03.558 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.558 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.558 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:03.558 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247301+0000", 2024-05-08T18:31:03.558 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0010000000000001e-05 2024-05-08T18:31:03.558 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.558 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.558 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:03.558 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.249555+0000", 2024-05-08T18:31:03.558 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0022539050000000001 2024-05-08T18:31:03.558 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.559 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.559 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:03.559 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.249700+0000", 2024-05-08T18:31:03.559 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014484599999999999 2024-05-08T18:31:03.559 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.559 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.559 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:03.559 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.249929+0000", 2024-05-08T18:31:03.559 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022904499999999999 2024-05-08T18:31:03.559 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.559 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.559 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:03.559 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.253695+0000", 2024-05-08T18:31:03.559 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0037656640000000002 2024-05-08T18:31:03.560 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.560 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.560 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:03.560 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.256970+0000", 2024-05-08T18:31:03.560 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003274608 2024-05-08T18:31:03.560 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.560 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.560 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:03.560 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.257052+0000", 2024-05-08T18:31:03.560 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2223000000000002e-05 2024-05-08T18:31:03.560 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.560 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.560 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:03.561 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.257187+0000", 2024-05-08T18:31:03.561 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013557900000000001 2024-05-08T18:31:03.561 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:03.561 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:03.561 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:03.561 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.561 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.561 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:42 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:03.561 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247321+0000", 2024-05-08T18:31:03.561 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 96.292341362000002, 2024-05-08T18:31:03.561 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013168572, 2024-05-08T18:31:03.561 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:03.561 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:03.561 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:03.562 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:03.562 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:03.562 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:03.562 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 42 2024-05-08T18:31:03.562 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.562 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:03.562 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.562 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:03.562 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247321+0000", 2024-05-08T18:31:03.562 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:03.562 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.562 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.562 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:03.563 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247321+0000", 2024-05-08T18:31:03.563 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:03.563 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.563 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.563 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:03.563 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247323+0000", 2024-05-08T18:31:03.563 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.24e-06 2024-05-08T18:31:03.563 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.563 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.563 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:03.563 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247329+0000", 2024-05-08T18:31:03.563 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1530000000000002e-06 2024-05-08T18:31:03.563 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.563 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.564 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:03.564 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247339+0000", 2024-05-08T18:31:03.564 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0387000000000001e-05 2024-05-08T18:31:03.564 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.564 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.564 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:03.564 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247347+0000", 2024-05-08T18:31:03.564 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9829999999999996e-06 2024-05-08T18:31:03.564 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.564 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.564 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:03.564 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.251488+0000", 2024-05-08T18:31:03.564 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0041412849999999998 2024-05-08T18:31:03.565 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.565 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.565 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:03.565 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.251672+0000", 2024-05-08T18:31:03.565 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00018354499999999999 2024-05-08T18:31:03.565 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.565 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.565 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:03.565 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.251949+0000", 2024-05-08T18:31:03.565 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00027695399999999999 2024-05-08T18:31:03.565 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.565 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.565 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:03.565 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.253810+0000", 2024-05-08T18:31:03.566 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001860806 2024-05-08T18:31:03.566 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.566 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.566 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:03.566 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260244+0000", 2024-05-08T18:31:03.566 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0064347939999999998 2024-05-08T18:31:03.566 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.566 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.566 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:03.566 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260376+0000", 2024-05-08T18:31:03.566 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000131829 2024-05-08T18:31:03.566 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.566 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.566 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:03.567 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260490+0000", 2024-05-08T18:31:03.567 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000113596 2024-05-08T18:31:03.567 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:03.567 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:03.567 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:03.567 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.567 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.567 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:43 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:03.567 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247367+0000", 2024-05-08T18:31:03.567 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 96.292295448999994, 2024-05-08T18:31:03.567 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013449025999999999, 2024-05-08T18:31:03.567 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:03.567 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:03.567 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:03.568 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:03.568 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:03.568 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:03.568 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 43 2024-05-08T18:31:03.568 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.568 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:03.568 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.568 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:03.568 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247367+0000", 2024-05-08T18:31:03.568 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:03.568 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.568 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.568 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:03.569 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247367+0000", 2024-05-08T18:31:03.569 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:03.569 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.569 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.569 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:03.569 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247368+0000", 2024-05-08T18:31:03.569 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1999999999999999e-07 2024-05-08T18:31:03.569 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.569 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.569 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:03.569 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247374+0000", 2024-05-08T18:31:03.569 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.19e-06 2024-05-08T18:31:03.569 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.570 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.570 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:03.570 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247384+0000", 2024-05-08T18:31:03.570 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0173000000000001e-05 2024-05-08T18:31:03.570 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.570 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.570 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:03.570 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247392+0000", 2024-05-08T18:31:03.570 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1869999999999997e-06 2024-05-08T18:31:03.570 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.570 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.570 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:03.570 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.252515+0000", 2024-05-08T18:31:03.571 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0051221399999999999 2024-05-08T18:31:03.571 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.571 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.571 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:03.571 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.252641+0000", 2024-05-08T18:31:03.571 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012609200000000001 2024-05-08T18:31:03.571 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.571 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.571 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:03.571 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.252842+0000", 2024-05-08T18:31:03.571 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000201619 2024-05-08T18:31:03.571 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.571 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.571 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:03.572 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.256828+0000", 2024-05-08T18:31:03.572 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039853989999999997 2024-05-08T18:31:03.572 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.572 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.572 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:03.572 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260515+0000", 2024-05-08T18:31:03.572 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0036875419999999998 2024-05-08T18:31:03.572 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.572 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.572 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:03.572 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260718+0000", 2024-05-08T18:31:03.572 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020229499999999999 2024-05-08T18:31:03.572 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.572 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.573 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:03.573 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260816+0000", 2024-05-08T18:31:03.573 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8669e-05 2024-05-08T18:31:03.573 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:03.573 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:03.573 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:03.573 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.573 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.573 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:03.573 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247466+0000", 2024-05-08T18:31:03.573 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 96.292196863000001, 2024-05-08T18:31:03.573 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013491806, 2024-05-08T18:31:03.573 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:03.573 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:03.573 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:03.574 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:03.574 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:03.574 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:03.574 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 44 2024-05-08T18:31:03.574 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.574 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:03.574 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.574 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:03.574 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247466+0000", 2024-05-08T18:31:03.574 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:03.574 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.574 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.575 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:03.575 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247466+0000", 2024-05-08T18:31:03.575 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:03.575 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.575 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.575 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:03.575 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247467+0000", 2024-05-08T18:31:03.575 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.263e-06 2024-05-08T18:31:03.575 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.575 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.575 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:03.575 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247585+0000", 2024-05-08T18:31:03.575 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011756600000000001 2024-05-08T18:31:03.575 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.576 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.576 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:03.576 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247598+0000", 2024-05-08T18:31:03.576 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3766e-05 2024-05-08T18:31:03.576 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.576 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.576 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:03.576 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247609+0000", 2024-05-08T18:31:03.576 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0604e-05 2024-05-08T18:31:03.576 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.576 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.576 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:03.576 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.253890+0000", 2024-05-08T18:31:03.576 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0062810440000000004 2024-05-08T18:31:03.577 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.577 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.577 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:03.577 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.254068+0000", 2024-05-08T18:31:03.577 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017848199999999999 2024-05-08T18:31:03.577 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.577 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.577 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:03.577 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.254488+0000", 2024-05-08T18:31:03.577 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00041965399999999999 2024-05-08T18:31:03.577 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.577 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.577 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:03.577 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.256949+0000", 2024-05-08T18:31:03.578 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002461254 2024-05-08T18:31:03.578 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.578 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.578 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:03.578 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260832+0000", 2024-05-08T18:31:03.578 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0038830539999999999 2024-05-08T18:31:03.578 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.578 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.578 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:03.578 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260906+0000", 2024-05-08T18:31:03.578 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3455999999999996e-05 2024-05-08T18:31:03.578 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.579 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.579 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:03.579 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260958+0000", 2024-05-08T18:31:03.579 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1663000000000003e-05 2024-05-08T18:31:03.579 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:03.579 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:03.579 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:03.579 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.579 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.579 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:03.579 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247630+0000", 2024-05-08T18:31:03.579 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 96.292032457999994, 2024-05-08T18:31:03.579 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013478753, 2024-05-08T18:31:03.580 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:03.580 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:03.580 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:03.580 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:03.580 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:03.580 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:03.580 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 45 2024-05-08T18:31:03.580 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.580 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:03.580 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.580 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:03.580 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247630+0000", 2024-05-08T18:31:03.580 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:03.580 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.581 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.581 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:03.581 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247630+0000", 2024-05-08T18:31:03.581 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:03.581 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.581 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.581 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:03.581 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247631+0000", 2024-05-08T18:31:03.581 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7399999999999991e-07 2024-05-08T18:31:03.581 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.581 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.581 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:03.581 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247637+0000", 2024-05-08T18:31:03.581 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.93e-06 2024-05-08T18:31:03.582 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.582 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.582 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:03.582 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247647+0000", 2024-05-08T18:31:03.582 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7459999999999995e-06 2024-05-08T18:31:03.582 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.582 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.582 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:03.582 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247654+0000", 2024-05-08T18:31:03.582 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4039999999999998e-06 2024-05-08T18:31:03.582 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.582 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.582 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:03.583 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.255829+0000", 2024-05-08T18:31:03.583 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0081749059999999991 2024-05-08T18:31:03.583 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.583 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.583 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:03.583 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.255979+0000", 2024-05-08T18:31:03.583 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015027899999999999 2024-05-08T18:31:03.583 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.583 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.583 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:03.583 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.256185+0000", 2024-05-08T18:31:03.583 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020583900000000001 2024-05-08T18:31:03.583 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.583 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.584 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:03.584 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260097+0000", 2024-05-08T18:31:03.584 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039121929999999996 2024-05-08T18:31:03.584 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.584 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.584 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:03.584 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260973+0000", 2024-05-08T18:31:03.584 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00087591999999999998 2024-05-08T18:31:03.584 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.584 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.584 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:03.584 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261056+0000", 2024-05-08T18:31:03.584 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3104999999999998e-05 2024-05-08T18:31:03.585 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.585 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.585 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:03.585 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261109+0000", 2024-05-08T18:31:03.585 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2457000000000003e-05 2024-05-08T18:31:03.585 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:03.585 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:03.585 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:03.585 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.585 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.585 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:03.585 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247667+0000", 2024-05-08T18:31:03.586 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 96.291995177999993, 2024-05-08T18:31:03.586 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013569098999999999, 2024-05-08T18:31:03.586 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:03.586 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:03.586 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:03.586 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:03.586 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:03.586 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:03.586 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 46 2024-05-08T18:31:03.586 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.586 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:03.586 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.586 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:03.586 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247667+0000", 2024-05-08T18:31:03.587 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:03.587 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.587 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.587 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:03.587 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247667+0000", 2024-05-08T18:31:03.587 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:03.587 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.587 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.587 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:03.587 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247668+0000", 2024-05-08T18:31:03.587 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7999999999999995e-07 2024-05-08T18:31:03.587 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.587 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.588 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:03.588 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247674+0000", 2024-05-08T18:31:03.588 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4369999999999998e-06 2024-05-08T18:31:03.588 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.588 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.588 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:03.588 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247683+0000", 2024-05-08T18:31:03.588 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4360000000000008e-06 2024-05-08T18:31:03.588 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.588 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.588 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:03.588 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247690+0000", 2024-05-08T18:31:03.588 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.43e-06 2024-05-08T18:31:03.589 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.589 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.589 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:03.589 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.257358+0000", 2024-05-08T18:31:03.589 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0096676890000000001 2024-05-08T18:31:03.589 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.589 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.589 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:03.589 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.257626+0000", 2024-05-08T18:31:03.589 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00026819099999999998 2024-05-08T18:31:03.589 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.589 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.589 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:03.590 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.258041+0000", 2024-05-08T18:31:03.590 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00041438400000000001 2024-05-08T18:31:03.590 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.590 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.590 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:03.590 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260224+0000", 2024-05-08T18:31:03.590 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0021830700000000001 2024-05-08T18:31:03.590 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.590 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.590 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:03.590 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261127+0000", 2024-05-08T18:31:03.590 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00090292300000000003 2024-05-08T18:31:03.591 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.591 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.591 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:03.591 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261191+0000", 2024-05-08T18:31:03.591 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4342000000000002e-05 2024-05-08T18:31:03.591 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.591 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.591 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:03.591 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261237+0000", 2024-05-08T18:31:03.591 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.5516999999999998e-05 2024-05-08T18:31:03.591 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:03.591 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:03.591 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:03.591 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.592 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.592 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:03.592 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247703+0000", 2024-05-08T18:31:03.592 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 96.291959695000003, 2024-05-08T18:31:03.592 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015020204000000001, 2024-05-08T18:31:03.592 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:03.592 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:03.592 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:03.592 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:03.592 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:03.592 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:03.592 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 47 2024-05-08T18:31:03.592 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.593 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:03.593 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.593 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:03.593 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247703+0000", 2024-05-08T18:31:03.593 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:03.593 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.593 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.593 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:03.593 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247703+0000", 2024-05-08T18:31:03.593 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:03.593 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.593 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.593 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:03.594 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247704+0000", 2024-05-08T18:31:03.594 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8299999999999996e-07 2024-05-08T18:31:03.594 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.594 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.594 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:03.594 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247877+0000", 2024-05-08T18:31:03.594 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000172979 2024-05-08T18:31:03.594 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.594 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.594 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:03.594 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247894+0000", 2024-05-08T18:31:03.594 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6912999999999999e-05 2024-05-08T18:31:03.594 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.595 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.595 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:03.595 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247903+0000", 2024-05-08T18:31:03.595 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1770000000000004e-06 2024-05-08T18:31:03.595 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.595 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.595 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:03.595 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.258767+0000", 2024-05-08T18:31:03.595 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010864409 2024-05-08T18:31:03.595 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.595 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.595 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:03.595 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.258898+0000", 2024-05-08T18:31:03.596 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000131199 2024-05-08T18:31:03.596 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.596 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.596 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:03.596 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.259117+0000", 2024-05-08T18:31:03.596 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000218889 2024-05-08T18:31:03.596 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.596 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.596 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:03.596 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.262372+0000", 2024-05-08T18:31:03.596 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032545679999999998 2024-05-08T18:31:03.596 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.596 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.596 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:03.597 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.262432+0000", 2024-05-08T18:31:03.597 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9913e-05 2024-05-08T18:31:03.597 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.597 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.597 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:03.597 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.262585+0000", 2024-05-08T18:31:03.597 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015361800000000001 2024-05-08T18:31:03.597 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.597 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.597 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:03.597 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.262723+0000", 2024-05-08T18:31:03.597 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000137856 2024-05-08T18:31:03.597 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:03.597 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:03.598 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:03.598 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.598 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.598 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:03.598 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247927+0000", 2024-05-08T18:31:03.598 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 96.291735657000004, 2024-05-08T18:31:03.598 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018387718000000001, 2024-05-08T18:31:03.598 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:03.598 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:03.598 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:03.598 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:03.598 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:03.599 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:03.599 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 48 2024-05-08T18:31:03.599 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.599 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:03.599 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.599 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:03.599 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247927+0000", 2024-05-08T18:31:03.599 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:03.599 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.599 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.599 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:03.599 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247927+0000", 2024-05-08T18:31:03.599 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:03.600 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.600 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.600 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:03.600 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247928+0000", 2024-05-08T18:31:03.600 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8400000000000003e-07 2024-05-08T18:31:03.600 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.600 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.600 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:03.600 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247935+0000", 2024-05-08T18:31:03.600 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1230000000000002e-06 2024-05-08T18:31:03.600 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.600 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.600 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:03.601 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247945+0000", 2024-05-08T18:31:03.601 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0346000000000001e-05 2024-05-08T18:31:03.601 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.601 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.601 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:03.601 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247953+0000", 2024-05-08T18:31:03.601 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8040000000000002e-06 2024-05-08T18:31:03.601 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.601 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.601 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:03.601 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261292+0000", 2024-05-08T18:31:03.601 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013339337 2024-05-08T18:31:03.601 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.602 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.602 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:03.602 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261424+0000", 2024-05-08T18:31:03.602 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013201900000000001 2024-05-08T18:31:03.602 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.602 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.602 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:03.602 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261628+0000", 2024-05-08T18:31:03.602 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020327499999999999 2024-05-08T18:31:03.602 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.602 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.602 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:03.602 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.263849+0000", 2024-05-08T18:31:03.603 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0022209759999999999 2024-05-08T18:31:03.603 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.603 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.603 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:03.603 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266167+0000", 2024-05-08T18:31:03.603 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002317979 2024-05-08T18:31:03.603 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.603 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.603 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:03.603 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266249+0000", 2024-05-08T18:31:03.603 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1996000000000006e-05 2024-05-08T18:31:03.603 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.603 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.603 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:03.604 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266315+0000", 2024-05-08T18:31:03.604 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5979e-05 2024-05-08T18:31:03.604 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:03.604 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:03.604 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:03.604 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.604 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.604 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:03.604 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247966+0000", 2024-05-08T18:31:03.604 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 96.291696724000005, 2024-05-08T18:31:03.604 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0194153, 2024-05-08T18:31:03.604 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:03.604 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:03.604 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:03.605 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:03.605 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:03.605 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:03.605 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 49 2024-05-08T18:31:03.605 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.605 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:03.605 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.605 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:03.605 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247966+0000", 2024-05-08T18:31:03.605 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:03.605 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.605 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.605 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:03.605 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247966+0000", 2024-05-08T18:31:03.606 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:03.606 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.606 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.606 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:03.606 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247967+0000", 2024-05-08T18:31:03.606 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0299999999999998e-07 2024-05-08T18:31:03.606 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.606 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.606 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:03.606 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247972+0000", 2024-05-08T18:31:03.606 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3600000000000004e-06 2024-05-08T18:31:03.606 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.606 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.607 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:03.607 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247981+0000", 2024-05-08T18:31:03.607 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.234e-06 2024-05-08T18:31:03.607 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.607 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.607 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:03.607 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247989+0000", 2024-05-08T18:31:03.607 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5159999999999997e-06 2024-05-08T18:31:03.607 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.607 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.607 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:03.607 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.262816+0000", 2024-05-08T18:31:03.607 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.014827399999999999 2024-05-08T18:31:03.607 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.607 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.608 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:03.608 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.262948+0000", 2024-05-08T18:31:03.608 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013166799999999999 2024-05-08T18:31:03.608 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.608 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.608 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:03.608 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.263153+0000", 2024-05-08T18:31:03.608 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000205272 2024-05-08T18:31:03.608 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.608 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.608 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:03.608 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266144+0000", 2024-05-08T18:31:03.608 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029912300000000001 2024-05-08T18:31:03.608 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.608 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.609 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:03.609 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.267226+0000", 2024-05-08T18:31:03.609 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010820580000000001 2024-05-08T18:31:03.609 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.609 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.609 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:03.609 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.267315+0000", 2024-05-08T18:31:03.609 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8793000000000002e-05 2024-05-08T18:31:03.609 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.609 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.609 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:03.609 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.267381+0000", 2024-05-08T18:31:03.609 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6066000000000001e-05 2024-05-08T18:31:03.609 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:03.609 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:03.610 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:03.610 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.610 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.610 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:03.610 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.248003+0000", 2024-05-08T18:31:03.610 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 96.291659424000002, 2024-05-08T18:31:03.610 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.020859638999999999, 2024-05-08T18:31:03.610 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:03.610 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:03.610 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:03.610 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:03.610 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:03.611 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:03.611 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 50 2024-05-08T18:31:03.611 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.611 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:03.611 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.611 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:03.611 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248003+0000", 2024-05-08T18:31:03.611 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:03.611 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.611 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.611 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:03.611 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248003+0000", 2024-05-08T18:31:03.611 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:03.611 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.612 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.612 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:03.612 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248004+0000", 2024-05-08T18:31:03.612 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5300000000000003e-07 2024-05-08T18:31:03.612 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.612 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.612 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:03.612 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248139+0000", 2024-05-08T18:31:03.612 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000135193 2024-05-08T18:31:03.612 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.612 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.612 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:03.612 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248151+0000", 2024-05-08T18:31:03.612 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.19e-05 2024-05-08T18:31:03.612 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.613 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.613 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:03.613 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248161+0000", 2024-05-08T18:31:03.613 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4599999999999992e-06 2024-05-08T18:31:03.613 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.613 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.613 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:03.613 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.263961+0000", 2024-05-08T18:31:03.613 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015800844000000001 2024-05-08T18:31:03.613 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.613 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.613 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:03.613 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.264091+0000", 2024-05-08T18:31:03.614 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012952300000000001 2024-05-08T18:31:03.614 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.614 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.614 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:03.614 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.264306+0000", 2024-05-08T18:31:03.614 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000215541 2024-05-08T18:31:03.614 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.614 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.614 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:03.614 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.267205+0000", 2024-05-08T18:31:03.614 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0028989910000000001 2024-05-08T18:31:03.615 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.615 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.615 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:03.615 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.268631+0000", 2024-05-08T18:31:03.615 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0014257320000000001 2024-05-08T18:31:03.615 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.615 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.615 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:03.615 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.268781+0000", 2024-05-08T18:31:03.615 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000149939 2024-05-08T18:31:03.615 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.615 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.615 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:03.616 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.268863+0000", 2024-05-08T18:31:03.616 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1762999999999996e-05 2024-05-08T18:31:03.616 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:03.616 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:03.616 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:03.616 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.616 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.616 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:03.616 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.248201+0000", 2024-05-08T18:31:03.616 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 96.291461669, 2024-05-08T18:31:03.616 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.022909783, 2024-05-08T18:31:03.616 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:03.616 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:03.616 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:03.617 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:03.617 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:03.617 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:03.617 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 51 2024-05-08T18:31:03.617 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.617 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:03.617 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.617 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:03.617 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248201+0000", 2024-05-08T18:31:03.617 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:03.617 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.617 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.617 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:03.618 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248201+0000", 2024-05-08T18:31:03.618 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:03.618 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.618 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.618 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:03.618 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248202+0000", 2024-05-08T18:31:03.618 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2999999999999999e-07 2024-05-08T18:31:03.618 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.618 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.618 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:03.618 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248209+0000", 2024-05-08T18:31:03.618 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5769999999999996e-06 2024-05-08T18:31:03.618 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.619 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.619 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:03.619 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248221+0000", 2024-05-08T18:31:03.619 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1165999999999999e-05 2024-05-08T18:31:03.619 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.619 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.619 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:03.619 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248229+0000", 2024-05-08T18:31:03.619 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1529999999999997e-06 2024-05-08T18:31:03.619 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.619 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.619 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:03.619 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.265146+0000", 2024-05-08T18:31:03.620 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016917492999999999 2024-05-08T18:31:03.620 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.620 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.620 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:03.620 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.265282+0000", 2024-05-08T18:31:03.620 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013597199999999999 2024-05-08T18:31:03.620 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.620 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.620 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:03.620 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.265488+0000", 2024-05-08T18:31:03.620 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000206212 2024-05-08T18:31:03.620 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.620 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.621 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:03.621 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.268442+0000", 2024-05-08T18:31:03.621 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002953841 2024-05-08T18:31:03.621 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.621 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.621 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:03.621 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.270951+0000", 2024-05-08T18:31:03.621 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0025085670000000002 2024-05-08T18:31:03.621 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.621 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.621 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:03.621 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.271042+0000", 2024-05-08T18:31:03.621 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1485999999999998e-05 2024-05-08T18:31:03.622 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.622 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.622 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:03.622 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.271111+0000", 2024-05-08T18:31:03.622 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8386000000000006e-05 2024-05-08T18:31:03.622 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:03.622 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:03.622 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:03.622 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.622 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.622 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:03.622 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.248244+0000", 2024-05-08T18:31:03.622 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 96.291419113000003, 2024-05-08T18:31:03.622 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.023010806000000002, 2024-05-08T18:31:03.623 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:03.623 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:03.623 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:03.623 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:03.623 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:03.623 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:03.623 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 52 2024-05-08T18:31:03.623 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.623 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:03.623 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.623 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:03.623 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248244+0000", 2024-05-08T18:31:03.623 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:03.623 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.624 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.624 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:03.624 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248244+0000", 2024-05-08T18:31:03.624 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:03.624 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.624 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.624 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:03.624 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248244+0000", 2024-05-08T18:31:03.624 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0999999999999998e-07 2024-05-08T18:31:03.624 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.624 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.624 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:03.624 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248251+0000", 2024-05-08T18:31:03.624 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9639999999999997e-06 2024-05-08T18:31:03.625 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.625 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.625 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:03.625 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248266+0000", 2024-05-08T18:31:03.625 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4996e-05 2024-05-08T18:31:03.625 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.625 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.625 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:03.625 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248274+0000", 2024-05-08T18:31:03.625 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8299999999999996e-06 2024-05-08T18:31:03.625 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.625 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.625 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:03.625 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266367+0000", 2024-05-08T18:31:03.626 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018092607 2024-05-08T18:31:03.626 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.626 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.626 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:03.626 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266532+0000", 2024-05-08T18:31:03.626 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016569600000000001 2024-05-08T18:31:03.626 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.626 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.626 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:03.626 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266729+0000", 2024-05-08T18:31:03.626 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00019630099999999999 2024-05-08T18:31:03.626 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.626 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.627 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:03.627 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.268574+0000", 2024-05-08T18:31:03.627 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0018452329999999999 2024-05-08T18:31:03.627 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.627 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.627 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:03.627 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.271128+0000", 2024-05-08T18:31:03.627 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00255369 2024-05-08T18:31:03.627 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.627 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.627 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:03.627 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.271199+0000", 2024-05-08T18:31:03.627 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1712999999999996e-05 2024-05-08T18:31:03.628 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.628 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.628 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:03.628 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.271254+0000", 2024-05-08T18:31:03.628 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5065999999999998e-05 2024-05-08T18:31:03.628 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:03.628 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:03.628 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:03.628 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.628 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.628 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:03.628 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.486052+0000", 2024-05-08T18:31:03.628 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 96.053610668999994, 2024-05-08T18:31:03.629 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0098898389999999992, 2024-05-08T18:31:03.629 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:03.629 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:03.629 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:03.629 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:03.629 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:03.629 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:03.629 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 72 2024-05-08T18:31:03.629 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.629 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:03.629 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.629 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:03.629 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486052+0000", 2024-05-08T18:31:03.629 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:03.630 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.630 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.630 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:03.630 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486052+0000", 2024-05-08T18:31:03.630 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:03.630 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.630 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.630 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:03.630 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486053+0000", 2024-05-08T18:31:03.630 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1200000000000001e-07 2024-05-08T18:31:03.630 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.630 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.631 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:03.631 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486188+0000", 2024-05-08T18:31:03.631 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013526200000000001 2024-05-08T18:31:03.631 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.631 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.631 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:03.631 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486205+0000", 2024-05-08T18:31:03.631 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6742e-05 2024-05-08T18:31:03.631 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.631 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.631 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:03.631 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486215+0000", 2024-05-08T18:31:03.631 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8290000000000003e-06 2024-05-08T18:31:03.631 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.632 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.632 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:03.632 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.491930+0000", 2024-05-08T18:31:03.632 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0057153660000000004 2024-05-08T18:31:03.632 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.632 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.632 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:03.632 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.491995+0000", 2024-05-08T18:31:03.632 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5289000000000005e-05 2024-05-08T18:31:03.632 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.632 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.632 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:03.632 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.492096+0000", 2024-05-08T18:31:03.633 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010101400000000001 2024-05-08T18:31:03.633 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.633 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.633 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:03.633 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.494152+0000", 2024-05-08T18:31:03.633 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0020560740000000002 2024-05-08T18:31:03.633 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.633 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.633 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:03.633 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.495860+0000", 2024-05-08T18:31:03.633 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0017076159999999999 2024-05-08T18:31:03.633 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.633 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.634 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:03.634 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.495903+0000", 2024-05-08T18:31:03.634 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3009000000000001e-05 2024-05-08T18:31:03.634 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.634 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.634 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:03.634 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.495942+0000", 2024-05-08T18:31:03.634 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8726000000000002e-05 2024-05-08T18:31:03.634 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:03.634 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:03.634 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:03.634 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.635 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.635 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:03.635 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.486234+0000", 2024-05-08T18:31:03.635 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 96.053428600999993, 2024-05-08T18:31:03.635 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0099742340000000002, 2024-05-08T18:31:03.635 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:03.635 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:03.635 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:03.635 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:03.635 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:03.635 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:03.635 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 73 2024-05-08T18:31:03.635 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.636 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:03.636 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.636 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:03.636 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486234+0000", 2024-05-08T18:31:03.636 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:03.636 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.636 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.636 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:03.636 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486234+0000", 2024-05-08T18:31:03.636 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:03.636 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.636 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.636 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:03.636 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486235+0000", 2024-05-08T18:31:03.637 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.108e-06 2024-05-08T18:31:03.637 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.637 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.637 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:03.637 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486241+0000", 2024-05-08T18:31:03.637 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4e-06 2024-05-08T18:31:03.637 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.637 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.637 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:03.637 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486251+0000", 2024-05-08T18:31:03.637 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0209e-05 2024-05-08T18:31:03.637 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.637 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.638 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:03.638 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486260+0000", 2024-05-08T18:31:03.638 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2709999999999998e-06 2024-05-08T18:31:03.638 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.638 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.638 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:03.638 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.493294+0000", 2024-05-08T18:31:03.638 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0070341070000000004 2024-05-08T18:31:03.638 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.638 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.638 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:03.638 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.493370+0000", 2024-05-08T18:31:03.638 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5846999999999994e-05 2024-05-08T18:31:03.639 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.639 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.639 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:03.639 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.493479+0000", 2024-05-08T18:31:03.639 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010905500000000001 2024-05-08T18:31:03.639 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.639 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.639 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:03.639 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.495950+0000", 2024-05-08T18:31:03.639 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0024709749999999998 2024-05-08T18:31:03.639 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.639 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.639 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:03.640 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496023+0000", 2024-05-08T18:31:03.640 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3071999999999994e-05 2024-05-08T18:31:03.640 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.640 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.640 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:03.640 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496091+0000", 2024-05-08T18:31:03.640 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7646999999999998e-05 2024-05-08T18:31:03.640 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.640 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.640 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:03.640 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496208+0000", 2024-05-08T18:31:03.640 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000117543 2024-05-08T18:31:03.640 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:03.640 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:03.641 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:03.641 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.641 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.641 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:03.641 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.486276+0000", 2024-05-08T18:31:03.641 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 96.053386275999998, 2024-05-08T18:31:03.641 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010822577, 2024-05-08T18:31:03.641 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:03.641 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:03.641 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:03.641 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:03.641 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:03.641 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:03.642 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 74 2024-05-08T18:31:03.642 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.642 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:03.642 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.642 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:03.642 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486276+0000", 2024-05-08T18:31:03.642 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:03.642 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.642 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.642 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:03.642 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486276+0000", 2024-05-08T18:31:03.642 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:03.642 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.643 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.643 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:03.643 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486277+0000", 2024-05-08T18:31:03.643 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1699999999999997e-07 2024-05-08T18:31:03.643 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.643 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.643 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:03.643 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486282+0000", 2024-05-08T18:31:03.643 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0429999999999998e-06 2024-05-08T18:31:03.643 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.643 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.643 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:03.643 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486294+0000", 2024-05-08T18:31:03.644 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1717e-05 2024-05-08T18:31:03.644 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.644 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.644 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:03.644 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486303+0000", 2024-05-08T18:31:03.644 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.3999999999999998e-06 2024-05-08T18:31:03.644 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.644 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.644 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:03.644 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.494424+0000", 2024-05-08T18:31:03.644 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0081205960000000008 2024-05-08T18:31:03.644 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.644 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.644 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:03.645 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.494539+0000", 2024-05-08T18:31:03.645 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000115661 2024-05-08T18:31:03.645 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.645 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.645 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:03.645 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.494704+0000", 2024-05-08T18:31:03.645 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016422999999999999 2024-05-08T18:31:03.645 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.645 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.645 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:03.645 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496800+0000", 2024-05-08T18:31:03.645 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002096508 2024-05-08T18:31:03.645 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.646 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.646 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:03.646 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496889+0000", 2024-05-08T18:31:03.646 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8349000000000004e-05 2024-05-08T18:31:03.646 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.646 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.646 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:03.646 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496983+0000", 2024-05-08T18:31:03.646 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4882000000000004e-05 2024-05-08T18:31:03.646 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.646 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.646 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:03.646 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.497099+0000", 2024-05-08T18:31:03.647 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000115474 2024-05-08T18:31:03.647 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:03.647 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:03.647 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:03.647 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.647 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.647 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:03.647 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.486324+0000", 2024-05-08T18:31:03.647 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 96.053338256000004, 2024-05-08T18:31:03.647 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010949207000000001, 2024-05-08T18:31:03.647 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:03.647 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:03.647 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:03.648 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:03.648 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:03.648 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:03.648 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 75 2024-05-08T18:31:03.648 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.648 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:03.648 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.648 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:03.648 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486324+0000", 2024-05-08T18:31:03.648 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:03.649 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.649 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.649 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:03.649 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486324+0000", 2024-05-08T18:31:03.649 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:03.649 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.649 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.649 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:03.649 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486325+0000", 2024-05-08T18:31:03.649 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6200000000000006e-07 2024-05-08T18:31:03.649 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.649 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.649 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:03.649 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486439+0000", 2024-05-08T18:31:03.650 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000113391 2024-05-08T18:31:03.650 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.650 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.650 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:03.650 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486455+0000", 2024-05-08T18:31:03.650 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5823000000000001e-05 2024-05-08T18:31:03.650 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.650 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.650 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:03.650 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486465+0000", 2024-05-08T18:31:03.650 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0879999999999999e-05 2024-05-08T18:31:03.650 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.650 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.651 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:03.651 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.495149+0000", 2024-05-08T18:31:03.651 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0086833589999999999 2024-05-08T18:31:03.651 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.651 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.651 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:03.651 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.495213+0000", 2024-05-08T18:31:03.651 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4176000000000004e-05 2024-05-08T18:31:03.651 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.651 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.651 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:03.651 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.495350+0000", 2024-05-08T18:31:03.651 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013709099999999999 2024-05-08T18:31:03.652 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.652 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.652 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:03.652 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496809+0000", 2024-05-08T18:31:03.652 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001458953 2024-05-08T18:31:03.652 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.652 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.652 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:03.652 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.497199+0000", 2024-05-08T18:31:03.652 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00039045200000000001 2024-05-08T18:31:03.652 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.652 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.652 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:03.652 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.497241+0000", 2024-05-08T18:31:03.653 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1378999999999998e-05 2024-05-08T18:31:03.653 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.653 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.653 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:03.653 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.497274+0000", 2024-05-08T18:31:03.653 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2740999999999997e-05 2024-05-08T18:31:03.653 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:03.653 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:03.653 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:03.653 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.653 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.653 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:03.653 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.486483+0000", 2024-05-08T18:31:03.653 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 96.053180080999994, 2024-05-08T18:31:03.654 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011783448, 2024-05-08T18:31:03.654 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:03.654 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:03.654 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:03.654 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:03.654 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:03.654 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:03.654 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 76 2024-05-08T18:31:03.654 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.654 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:03.654 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.654 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:03.654 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486483+0000", 2024-05-08T18:31:03.655 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:03.655 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.655 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.655 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:03.655 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486483+0000", 2024-05-08T18:31:03.655 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:03.655 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.655 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.655 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:03.655 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486483+0000", 2024-05-08T18:31:03.655 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6599999999999995e-07 2024-05-08T18:31:03.655 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.655 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.655 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:03.656 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486491+0000", 2024-05-08T18:31:03.656 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.2520000000000002e-06 2024-05-08T18:31:03.656 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.656 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.656 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:03.656 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486500+0000", 2024-05-08T18:31:03.656 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4420000000000004e-06 2024-05-08T18:31:03.656 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.656 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.656 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:03.656 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486507+0000", 2024-05-08T18:31:03.656 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3549999999999999e-06 2024-05-08T18:31:03.656 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.656 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.657 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:03.657 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496319+0000", 2024-05-08T18:31:03.657 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0098120529999999994 2024-05-08T18:31:03.657 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.657 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.657 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:03.657 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496391+0000", 2024-05-08T18:31:03.657 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1433000000000005e-05 2024-05-08T18:31:03.657 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.657 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.657 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:03.657 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496508+0000", 2024-05-08T18:31:03.657 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000116778 2024-05-08T18:31:03.658 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.658 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.658 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:03.658 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.497284+0000", 2024-05-08T18:31:03.658 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00077609100000000002 2024-05-08T18:31:03.658 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.658 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.658 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:03.658 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.498204+0000", 2024-05-08T18:31:03.658 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00092027299999999999 2024-05-08T18:31:03.658 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.658 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.659 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:03.659 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.498240+0000", 2024-05-08T18:31:03.659 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5979999999999998e-05 2024-05-08T18:31:03.659 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.659 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.659 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:03.659 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.498266+0000", 2024-05-08T18:31:03.659 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6024999999999999e-05 2024-05-08T18:31:03.659 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:03.659 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:03.659 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:03.659 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.659 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.659 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:94 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:03.660 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.842580+0000", 2024-05-08T18:31:03.660 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 95.697082780000002, 2024-05-08T18:31:03.660 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0085315870000000002, 2024-05-08T18:31:03.660 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:03.660 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:03.660 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:03.660 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:03.660 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:03.660 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:03.660 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 94 2024-05-08T18:31:03.660 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.660 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:03.660 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.660 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:03.661 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.842580+0000", 2024-05-08T18:31:03.661 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:03.661 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.661 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.661 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:03.661 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.842580+0000", 2024-05-08T18:31:03.661 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:03.661 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.661 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.661 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:03.661 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.842581+0000", 2024-05-08T18:31:03.661 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.11e-06 2024-05-08T18:31:03.661 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.661 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.662 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:03.662 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.842587+0000", 2024-05-08T18:31:03.662 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2899999999999999e-06 2024-05-08T18:31:03.662 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.662 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.662 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:03.662 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.842597+0000", 2024-05-08T18:31:03.662 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.007e-05 2024-05-08T18:31:03.662 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.662 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.662 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:03.662 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.842605+0000", 2024-05-08T18:31:03.662 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1270000000000003e-06 2024-05-08T18:31:03.663 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.663 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.663 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:03.663 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.848358+0000", 2024-05-08T18:31:03.663 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0057525140000000002 2024-05-08T18:31:03.663 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.663 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.663 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:03.663 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.848481+0000", 2024-05-08T18:31:03.663 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000123239 2024-05-08T18:31:03.663 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.663 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.663 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:03.663 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.848695+0000", 2024-05-08T18:31:03.663 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000213387 2024-05-08T18:31:03.664 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.664 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.664 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:03.664 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.849781+0000", 2024-05-08T18:31:03.664 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010868 2024-05-08T18:31:03.664 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.664 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.664 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:03.664 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.850990+0000", 2024-05-08T18:31:03.664 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0012084769999999999 2024-05-08T18:31:03.664 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.664 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.664 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:03.664 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.851059+0000", 2024-05-08T18:31:03.665 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9130999999999999e-05 2024-05-08T18:31:03.665 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:03.665 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:03.665 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:03.665 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.851111+0000", 2024-05-08T18:31:03.665 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2441999999999997e-05 2024-05-08T18:31:03.665 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:03.665 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:03.665 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:03.665 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:03.665 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:03.665 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:31:03.666 INFO:teuthology.orchestra.run.smithi097.stderr:nodeep-scrub is set 2024-05-08T18:31:03.667 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-08T18:31:03.668 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:31:03.667+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:31:03.768 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:31:03.767+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:31:03.778 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:03.778 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:31:03.778 INFO:teuthology.orchestra.run.smithi097.stdout: "num_ops": 0 2024-05-08T18:31:03.778 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:03.795 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-08T18:31:03.868 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:31:03.867+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:31:03.969 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:31:03.967+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:31:03.987 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:03.987 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:31:03.987 INFO:teuthology.orchestra.run.smithi097.stdout: "complaint_time": 30, 2024-05-08T18:31:03.987 INFO:teuthology.orchestra.run.smithi097.stdout: "num_blocked_ops": 0 2024-05-08T18:31:03.987 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:04.000 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-08T18:31:04.071 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:31:04.067+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:31:04.155 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:04.155 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2024-05-08T18:31:04.155 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2024-05-08T18:31:04.156 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-05-08T18:31:04.156 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.156 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4206.0:24 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'14, mlcod=16'9)", 2024-05-08T18:31:04.156 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:27.162224+0000", 2024-05-08T18:31:04.156 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 96.993210434000005, 2024-05-08T18:31:04.156 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032712890000000001, 2024-05-08T18:31:04.156 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:04.156 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:04.156 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:04.157 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:04.157 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.157 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:04.157 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162224+0000", 2024-05-08T18:31:04.157 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:04.157 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.157 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.157 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:04.157 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162224+0000", 2024-05-08T18:31:04.157 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:04.157 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.157 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.157 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:04.157 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162225+0000", 2024-05-08T18:31:04.158 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4899999999999999e-06 2024-05-08T18:31:04.158 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.158 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.158 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:04.158 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162306+0000", 2024-05-08T18:31:04.158 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.0589999999999999e-05 2024-05-08T18:31:04.158 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.158 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.158 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:04.158 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162332+0000", 2024-05-08T18:31:04.158 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5658999999999999e-05 2024-05-08T18:31:04.158 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.158 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.158 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:04.159 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162345+0000", 2024-05-08T18:31:04.159 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3512999999999999e-05 2024-05-08T18:31:04.159 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.159 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.159 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:04.159 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162465+0000", 2024-05-08T18:31:04.159 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000119577 2024-05-08T18:31:04.159 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.159 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.159 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:04.159 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162513+0000", 2024-05-08T18:31:04.159 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8773999999999998e-05 2024-05-08T18:31:04.159 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.160 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.160 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:04.160 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.165405+0000", 2024-05-08T18:31:04.160 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028919200000000001 2024-05-08T18:31:04.160 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.160 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.160 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:04.160 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.165495+0000", 2024-05-08T18:31:04.160 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9765999999999994e-05 2024-05-08T18:31:04.160 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:04.160 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:04.160 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:04.160 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.160 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.161 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4206.0:25 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'15, mlcod=16'10)", 2024-05-08T18:31:04.161 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:27.164793+0000", 2024-05-08T18:31:04.161 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 96.990641306000001, 2024-05-08T18:31:04.161 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032285249999999999, 2024-05-08T18:31:04.161 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:04.161 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:04.161 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:04.161 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:04.161 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.161 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:04.161 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164793+0000", 2024-05-08T18:31:04.161 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:04.161 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.161 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.162 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:04.162 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164793+0000", 2024-05-08T18:31:04.162 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:04.162 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.162 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.162 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:04.162 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164795+0000", 2024-05-08T18:31:04.162 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0999999999999998e-06 2024-05-08T18:31:04.162 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.162 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.162 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:04.162 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164811+0000", 2024-05-08T18:31:04.162 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5722999999999998e-05 2024-05-08T18:31:04.163 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.163 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.163 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:04.163 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164841+0000", 2024-05-08T18:31:04.163 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0355999999999999e-05 2024-05-08T18:31:04.163 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.163 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.163 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:04.163 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164861+0000", 2024-05-08T18:31:04.163 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9533000000000001e-05 2024-05-08T18:31:04.163 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.163 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.163 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:04.163 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164984+0000", 2024-05-08T18:31:04.164 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000123146 2024-05-08T18:31:04.164 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.164 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.164 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:04.164 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.165024+0000", 2024-05-08T18:31:04.164 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9690000000000001e-05 2024-05-08T18:31:04.164 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.164 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.164 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:04.164 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.167935+0000", 2024-05-08T18:31:04.164 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0029113300000000002 2024-05-08T18:31:04.164 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.165 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.165 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:04.165 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.168021+0000", 2024-05-08T18:31:04.165 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6646999999999999e-05 2024-05-08T18:31:04.165 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:04.165 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:04.165 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:04.165 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.165 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.165 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:31:04.165 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:48.674737+0000", 2024-05-08T18:31:04.165 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 75.480697387999996, 2024-05-08T18:31:04.165 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0035019780000000002, 2024-05-08T18:31:04.165 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:04.166 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:04.166 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:04.166 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:04.166 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:04.166 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:04.166 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 60 2024-05-08T18:31:04.166 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.166 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:04.166 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.166 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:04.167 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674737+0000", 2024-05-08T18:31:04.167 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:04.167 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.167 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.167 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:04.167 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674737+0000", 2024-05-08T18:31:04.167 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:04.167 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.167 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.167 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:04.167 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674740+0000", 2024-05-08T18:31:04.167 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.36e-06 2024-05-08T18:31:04.167 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.167 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.168 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:04.168 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674753+0000", 2024-05-08T18:31:04.168 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3151e-05 2024-05-08T18:31:04.168 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.168 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.168 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:04.168 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674789+0000", 2024-05-08T18:31:04.168 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5929000000000001e-05 2024-05-08T18:31:04.168 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.168 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.168 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:04.168 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674813+0000", 2024-05-08T18:31:04.168 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3325000000000001e-05 2024-05-08T18:31:04.168 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.169 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.169 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:04.169 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674981+0000", 2024-05-08T18:31:04.169 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016879899999999999 2024-05-08T18:31:04.169 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.169 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.169 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:04.169 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.675304+0000", 2024-05-08T18:31:04.169 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00032214400000000001 2024-05-08T18:31:04.169 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.169 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.169 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-05-08T18:31:04.169 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.675639+0000", 2024-05-08T18:31:04.170 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00033494699999999999 2024-05-08T18:31:04.170 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.170 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.170 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:04.170 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.676901+0000", 2024-05-08T18:31:04.170 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001262167 2024-05-08T18:31:04.170 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.170 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.170 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:04.170 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678078+0000", 2024-05-08T18:31:04.170 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001177588 2024-05-08T18:31:04.170 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.170 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.171 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:04.171 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678171+0000", 2024-05-08T18:31:04.171 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.2331999999999996e-05 2024-05-08T18:31:04.171 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.171 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.171 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:04.171 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678239+0000", 2024-05-08T18:31:04.171 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8236000000000002e-05 2024-05-08T18:31:04.171 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:04.171 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:04.171 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:04.171 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.171 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.172 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:61 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94069412632064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:31:04.172 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:48.678410+0000", 2024-05-08T18:31:04.172 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 75.477023996, 2024-05-08T18:31:04.172 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0026001800000000001, 2024-05-08T18:31:04.172 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:04.172 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:04.172 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:04.172 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:04.172 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:04.172 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:04.172 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 61 2024-05-08T18:31:04.172 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.172 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:04.172 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.173 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:04.173 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678410+0000", 2024-05-08T18:31:04.173 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:04.173 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.173 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.173 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:04.173 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678410+0000", 2024-05-08T18:31:04.173 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:04.173 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.173 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.173 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:04.173 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678413+0000", 2024-05-08T18:31:04.173 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.34e-06 2024-05-08T18:31:04.174 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.174 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.174 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:04.174 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678421+0000", 2024-05-08T18:31:04.174 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6910000000000003e-06 2024-05-08T18:31:04.174 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.174 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.174 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:04.174 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678447+0000", 2024-05-08T18:31:04.174 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6010999999999999e-05 2024-05-08T18:31:04.174 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.174 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.174 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:04.175 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678461+0000", 2024-05-08T18:31:04.175 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3900000000000001e-05 2024-05-08T18:31:04.175 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.175 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.175 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:04.175 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678560+0000", 2024-05-08T18:31:04.175 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.8834999999999998e-05 2024-05-08T18:31:04.175 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.175 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.175 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:04.175 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678704+0000", 2024-05-08T18:31:04.175 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000143769 2024-05-08T18:31:04.175 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.175 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.176 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-05-08T18:31:04.176 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678942+0000", 2024-05-08T18:31:04.176 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023861800000000001 2024-05-08T18:31:04.176 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.176 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.176 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:04.176 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.680269+0000", 2024-05-08T18:31:04.176 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001326484 2024-05-08T18:31:04.176 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.176 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.176 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:04.177 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.680823+0000", 2024-05-08T18:31:04.177 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00055455900000000004 2024-05-08T18:31:04.177 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.177 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.177 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:04.177 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.680908+0000", 2024-05-08T18:31:04.177 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.4073999999999995e-05 2024-05-08T18:31:04.177 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.177 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.177 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:04.177 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.681010+0000", 2024-05-08T18:31:04.177 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010289900000000001 2024-05-08T18:31:04.177 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:04.178 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:04.178 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:04.178 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.178 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.178 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:31:04.178 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.671896+0000", 2024-05-08T18:31:04.178 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 72.483538111000001, 2024-05-08T18:31:04.178 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032352349999999999, 2024-05-08T18:31:04.178 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:04.178 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:04.178 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:04.178 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:04.178 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:04.179 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:04.179 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 206 2024-05-08T18:31:04.179 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.179 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:04.179 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.179 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:04.179 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671896+0000", 2024-05-08T18:31:04.179 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:04.179 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.179 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.179 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:04.179 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671896+0000", 2024-05-08T18:31:04.179 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:04.180 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.180 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.180 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:04.180 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671901+0000", 2024-05-08T18:31:04.180 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.763e-06 2024-05-08T18:31:04.180 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.180 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.180 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:04.180 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671920+0000", 2024-05-08T18:31:04.180 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9403e-05 2024-05-08T18:31:04.180 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.180 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.180 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:04.180 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671969+0000", 2024-05-08T18:31:04.181 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8343000000000001e-05 2024-05-08T18:31:04.181 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.181 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.181 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:04.181 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671996+0000", 2024-05-08T18:31:04.181 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7307000000000001e-05 2024-05-08T18:31:04.181 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.181 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.181 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:04.181 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.672149+0000", 2024-05-08T18:31:04.181 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015336500000000001 2024-05-08T18:31:04.181 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.181 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.181 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:04.181 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.672393+0000", 2024-05-08T18:31:04.182 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024380800000000001 2024-05-08T18:31:04.182 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.182 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.182 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-05-08T18:31:04.182 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.672838+0000", 2024-05-08T18:31:04.182 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00044472700000000001 2024-05-08T18:31:04.182 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.182 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.182 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:04.182 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.674218+0000", 2024-05-08T18:31:04.182 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001380243 2024-05-08T18:31:04.182 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.182 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.183 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:04.183 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.674963+0000", 2024-05-08T18:31:04.183 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00074534999999999998 2024-05-08T18:31:04.183 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.183 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.183 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:04.183 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675057+0000", 2024-05-08T18:31:04.183 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.3633000000000003e-05 2024-05-08T18:31:04.183 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.183 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.183 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:04.183 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675131+0000", 2024-05-08T18:31:04.183 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.4293000000000002e-05 2024-05-08T18:31:04.183 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:04.184 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:04.184 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:04.184 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.184 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.184 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:04.184 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.694194+0000", 2024-05-08T18:31:04.184 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 72.461240712999995, 2024-05-08T18:31:04.184 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0087385129999999998, 2024-05-08T18:31:04.184 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:04.184 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:04.184 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:04.184 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:04.184 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:04.184 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:04.184 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 210 2024-05-08T18:31:04.185 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.185 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:04.185 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.185 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:04.185 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694194+0000", 2024-05-08T18:31:04.185 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:04.185 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.185 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.185 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:04.185 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694194+0000", 2024-05-08T18:31:04.185 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:04.185 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.185 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.186 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:04.186 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694196+0000", 2024-05-08T18:31:04.186 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6299999999999998e-06 2024-05-08T18:31:04.186 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.186 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.186 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:04.186 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694208+0000", 2024-05-08T18:31:04.186 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.187e-05 2024-05-08T18:31:04.186 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.186 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.186 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:04.186 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694240+0000", 2024-05-08T18:31:04.186 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1673e-05 2024-05-08T18:31:04.187 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.187 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.187 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:04.187 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694255+0000", 2024-05-08T18:31:04.187 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5573000000000002e-05 2024-05-08T18:31:04.187 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.187 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.187 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:04.187 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694394+0000", 2024-05-08T18:31:04.187 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000138536 2024-05-08T18:31:04.187 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.187 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.187 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-05-08T18:31:04.188 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694405+0000", 2024-05-08T18:31:04.188 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0883000000000001e-05 2024-05-08T18:31:04.188 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.188 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.188 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:04.188 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.699491+0000", 2024-05-08T18:31:04.188 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0050861939999999996 2024-05-08T18:31:04.188 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.188 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.188 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:04.188 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.699829+0000", 2024-05-08T18:31:04.188 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000338191 2024-05-08T18:31:04.188 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.188 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.189 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:04.189 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.700504+0000", 2024-05-08T18:31:04.189 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000674481 2024-05-08T18:31:04.189 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.189 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.189 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:04.189 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.702152+0000", 2024-05-08T18:31:04.189 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0016487450000000001 2024-05-08T18:31:04.189 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.189 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.189 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:04.189 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.702792+0000", 2024-05-08T18:31:04.189 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00063962800000000005 2024-05-08T18:31:04.189 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.190 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.190 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:04.190 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.702874+0000", 2024-05-08T18:31:04.190 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.2091999999999999e-05 2024-05-08T18:31:04.190 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.190 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.190 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:04.190 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.702932+0000", 2024-05-08T18:31:04.190 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8016999999999997e-05 2024-05-08T18:31:04.190 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:04.190 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:04.190 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:04.190 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.191 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.191 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:04.191 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.728239+0000", 2024-05-08T18:31:04.191 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 72.427194852, 2024-05-08T18:31:04.191 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0035376119999999999, 2024-05-08T18:31:04.191 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:04.191 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:04.191 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:04.191 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:04.191 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:04.191 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:04.191 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 218 2024-05-08T18:31:04.191 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.192 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:04.192 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.192 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:04.192 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728239+0000", 2024-05-08T18:31:04.192 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:04.192 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.192 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.192 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:04.192 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728239+0000", 2024-05-08T18:31:04.192 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:04.192 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.192 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.192 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:04.192 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728242+0000", 2024-05-08T18:31:04.192 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0130000000000002e-06 2024-05-08T18:31:04.193 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.193 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.193 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:04.193 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728254+0000", 2024-05-08T18:31:04.193 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.172e-05 2024-05-08T18:31:04.193 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.193 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.193 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:04.193 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728285+0000", 2024-05-08T18:31:04.193 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0703000000000001e-05 2024-05-08T18:31:04.193 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.193 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.193 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:04.193 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728301+0000", 2024-05-08T18:31:04.194 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5656999999999999e-05 2024-05-08T18:31:04.194 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.194 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.194 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:04.194 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728460+0000", 2024-05-08T18:31:04.194 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015934200000000001 2024-05-08T18:31:04.194 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.194 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.194 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:04.194 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728803+0000", 2024-05-08T18:31:04.194 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00034267400000000001 2024-05-08T18:31:04.194 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.194 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.194 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:04.195 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.729485+0000", 2024-05-08T18:31:04.195 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00068206799999999998 2024-05-08T18:31:04.195 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.195 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.195 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:04.195 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731218+0000", 2024-05-08T18:31:04.195 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0017332630000000001 2024-05-08T18:31:04.195 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.195 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.195 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:04.195 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731615+0000", 2024-05-08T18:31:04.195 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00039671699999999999 2024-05-08T18:31:04.195 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.195 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.195 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:04.196 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731709+0000", 2024-05-08T18:31:04.196 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.4740000000000004e-05 2024-05-08T18:31:04.196 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.196 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.196 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:04.196 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731777+0000", 2024-05-08T18:31:04.196 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7714999999999998e-05 2024-05-08T18:31:04.196 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:04.196 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:04.196 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:04.196 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.196 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.196 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:04.196 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.743331+0000", 2024-05-08T18:31:04.197 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 72.412102868999995, 2024-05-08T18:31:04.197 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031193229999999998, 2024-05-08T18:31:04.197 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:04.197 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:04.197 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:04.197 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:04.197 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:04.197 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:04.197 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 222 2024-05-08T18:31:04.197 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.197 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:04.197 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.197 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:04.197 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743331+0000", 2024-05-08T18:31:04.197 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:04.198 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.198 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.198 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:04.198 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743331+0000", 2024-05-08T18:31:04.198 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:04.198 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.198 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.198 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:04.198 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743334+0000", 2024-05-08T18:31:04.198 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2900000000000001e-06 2024-05-08T18:31:04.198 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.198 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.198 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:04.199 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743345+0000", 2024-05-08T18:31:04.199 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0947e-05 2024-05-08T18:31:04.199 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.199 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.199 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:04.199 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743375+0000", 2024-05-08T18:31:04.199 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0298999999999999e-05 2024-05-08T18:31:04.199 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.199 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.199 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:04.199 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743390+0000", 2024-05-08T18:31:04.199 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4606999999999999e-05 2024-05-08T18:31:04.199 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.200 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.200 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:04.200 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743524+0000", 2024-05-08T18:31:04.200 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000134105 2024-05-08T18:31:04.200 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.200 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.200 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:04.200 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743738+0000", 2024-05-08T18:31:04.200 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000214222 2024-05-08T18:31:04.200 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.200 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.200 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:04.200 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.744159+0000", 2024-05-08T18:31:04.200 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00042102300000000002 2024-05-08T18:31:04.201 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.201 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.201 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:04.201 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.745399+0000", 2024-05-08T18:31:04.201 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012400309999999999 2024-05-08T18:31:04.201 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.201 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.201 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:04.201 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.746296+0000", 2024-05-08T18:31:04.201 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00089682 2024-05-08T18:31:04.201 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.201 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.201 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:04.202 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.746385+0000", 2024-05-08T18:31:04.202 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9289000000000005e-05 2024-05-08T18:31:04.202 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.202 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.202 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:04.202 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.746451+0000", 2024-05-08T18:31:04.202 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5690000000000003e-05 2024-05-08T18:31:04.202 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:04.202 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:04.202 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:04.202 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.202 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.202 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:04.203 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.772338+0000", 2024-05-08T18:31:04.203 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 72.383096668999997, 2024-05-08T18:31:04.203 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0035084059999999999, 2024-05-08T18:31:04.203 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:04.203 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:04.203 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:04.203 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:04.203 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:04.203 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:04.203 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 230 2024-05-08T18:31:04.203 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.203 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:04.203 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.203 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:04.204 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772338+0000", 2024-05-08T18:31:04.204 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:04.204 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.204 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.204 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:04.204 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772338+0000", 2024-05-08T18:31:04.204 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:04.204 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.204 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.204 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:04.204 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772340+0000", 2024-05-08T18:31:04.204 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3460000000000001e-06 2024-05-08T18:31:04.204 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.204 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.205 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:04.205 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772352+0000", 2024-05-08T18:31:04.205 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2284e-05 2024-05-08T18:31:04.205 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.205 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.205 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:04.205 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772382+0000", 2024-05-08T18:31:04.205 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0083e-05 2024-05-08T18:31:04.205 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.205 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.205 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:04.205 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772397+0000", 2024-05-08T18:31:04.205 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4963000000000001e-05 2024-05-08T18:31:04.205 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.206 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.206 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:04.206 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772508+0000", 2024-05-08T18:31:04.206 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000110402 2024-05-08T18:31:04.206 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.206 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.206 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:04.206 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772742+0000", 2024-05-08T18:31:04.206 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023428899999999999 2024-05-08T18:31:04.206 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.206 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.206 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:04.206 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.773183+0000", 2024-05-08T18:31:04.206 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00044107899999999998 2024-05-08T18:31:04.207 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.207 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.207 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:04.207 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.774488+0000", 2024-05-08T18:31:04.207 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0013053940000000001 2024-05-08T18:31:04.207 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.207 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.207 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:04.207 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.775689+0000", 2024-05-08T18:31:04.207 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012004699999999999 2024-05-08T18:31:04.207 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.207 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.207 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:04.207 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.775777+0000", 2024-05-08T18:31:04.208 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8483e-05 2024-05-08T18:31:04.208 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.208 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.208 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:04.208 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.775846+0000", 2024-05-08T18:31:04.208 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8613000000000002e-05 2024-05-08T18:31:04.208 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:04.208 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:04.208 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:04.208 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.208 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.208 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:04.208 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.790921+0000", 2024-05-08T18:31:04.208 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 72.364513322999997, 2024-05-08T18:31:04.209 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003116869, 2024-05-08T18:31:04.209 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:04.209 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:04.209 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:04.209 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:04.209 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:04.209 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:04.209 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 235 2024-05-08T18:31:04.209 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.209 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:04.209 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.209 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:04.209 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790921+0000", 2024-05-08T18:31:04.209 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:04.209 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.210 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.210 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:04.210 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790921+0000", 2024-05-08T18:31:04.210 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:04.210 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.210 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.210 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:04.210 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790923+0000", 2024-05-08T18:31:04.210 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3199999999999998e-06 2024-05-08T18:31:04.210 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.210 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.210 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:04.210 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790934+0000", 2024-05-08T18:31:04.211 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.117e-05 2024-05-08T18:31:04.211 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.211 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.211 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:04.211 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790965+0000", 2024-05-08T18:31:04.211 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0392999999999999e-05 2024-05-08T18:31:04.211 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.211 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.211 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:04.211 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790981+0000", 2024-05-08T18:31:04.211 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5699999999999999e-05 2024-05-08T18:31:04.211 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.211 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.212 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:04.212 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.791093+0000", 2024-05-08T18:31:04.212 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000112062 2024-05-08T18:31:04.212 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.212 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.212 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:04.212 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.791324+0000", 2024-05-08T18:31:04.212 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023142200000000001 2024-05-08T18:31:04.212 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.212 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.212 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:04.212 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.791761+0000", 2024-05-08T18:31:04.212 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00043669999999999999 2024-05-08T18:31:04.212 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.212 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.213 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:04.213 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.792996+0000", 2024-05-08T18:31:04.213 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001235713 2024-05-08T18:31:04.213 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.213 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.213 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:04.213 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.793850+0000", 2024-05-08T18:31:04.213 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00085392400000000005 2024-05-08T18:31:04.213 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.213 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.213 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:04.213 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.793971+0000", 2024-05-08T18:31:04.213 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000120516 2024-05-08T18:31:04.213 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.214 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.214 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:04.214 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794038+0000", 2024-05-08T18:31:04.214 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6948999999999999e-05 2024-05-08T18:31:04.214 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:04.214 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:04.214 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:04.214 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.214 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.214 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:349 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:04.214 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.817315+0000", 2024-05-08T18:31:04.214 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 72.338119452000001, 2024-05-08T18:31:04.214 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0036888580000000002, 2024-05-08T18:31:04.215 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:04.215 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:04.215 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:04.215 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:04.215 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:04.215 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:04.215 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 349 2024-05-08T18:31:04.215 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.215 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:04.215 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.215 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:04.215 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817315+0000", 2024-05-08T18:31:04.215 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:04.215 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.216 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.216 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:04.216 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817315+0000", 2024-05-08T18:31:04.216 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:04.216 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.216 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.216 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:04.216 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817316+0000", 2024-05-08T18:31:04.216 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3370000000000001e-06 2024-05-08T18:31:04.216 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.216 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.216 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:04.216 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817323+0000", 2024-05-08T18:31:04.217 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.4300000000000003e-06 2024-05-08T18:31:04.217 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.217 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.217 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:04.217 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817337+0000", 2024-05-08T18:31:04.217 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4025999999999999e-05 2024-05-08T18:31:04.217 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.217 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.217 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:04.217 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817345+0000", 2024-05-08T18:31:04.217 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5669999999999995e-06 2024-05-08T18:31:04.217 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.217 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.217 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:04.218 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817407+0000", 2024-05-08T18:31:04.218 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1882000000000001e-05 2024-05-08T18:31:04.218 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.218 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.218 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:04.218 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817508+0000", 2024-05-08T18:31:04.218 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000100585 2024-05-08T18:31:04.218 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.218 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.218 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:04.218 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817673+0000", 2024-05-08T18:31:04.218 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000165802 2024-05-08T18:31:04.218 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.219 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.219 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:04.219 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.818715+0000", 2024-05-08T18:31:04.219 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0010417720000000001 2024-05-08T18:31:04.219 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.219 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.219 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:04.219 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.820892+0000", 2024-05-08T18:31:04.219 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0021771859999999998 2024-05-08T18:31:04.219 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.219 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.219 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:04.219 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.820950+0000", 2024-05-08T18:31:04.219 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7636000000000002e-05 2024-05-08T18:31:04.220 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.220 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.220 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:04.220 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.821004+0000", 2024-05-08T18:31:04.220 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3634999999999997e-05 2024-05-08T18:31:04.220 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:04.220 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:04.220 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:04.220 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.220 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.220 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:406 6.16 6:6dc3b799:reshard::reshard.0000000006:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:04.220 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.840465+0000", 2024-05-08T18:31:04.220 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 72.314969285999993, 2024-05-08T18:31:04.220 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003613032, 2024-05-08T18:31:04.220 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:04.221 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:04.221 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:04.221 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:04.221 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:04.221 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:04.221 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 406 2024-05-08T18:31:04.221 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.221 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:04.221 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.221 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:04.221 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840465+0000", 2024-05-08T18:31:04.221 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:04.221 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.221 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.222 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:04.222 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840465+0000", 2024-05-08T18:31:04.222 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:04.222 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.222 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.222 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:04.222 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840466+0000", 2024-05-08T18:31:04.222 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7499999999999999e-07 2024-05-08T18:31:04.222 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.222 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.222 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:04.222 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840471+0000", 2024-05-08T18:31:04.222 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9699999999999998e-06 2024-05-08T18:31:04.223 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.223 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.223 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:04.223 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840484+0000", 2024-05-08T18:31:04.223 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2717999999999999e-05 2024-05-08T18:31:04.223 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.223 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.223 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:04.223 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840490+0000", 2024-05-08T18:31:04.223 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.472e-06 2024-05-08T18:31:04.223 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.223 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.223 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:04.223 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840536+0000", 2024-05-08T18:31:04.224 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6409000000000002e-05 2024-05-08T18:31:04.224 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.224 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.224 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:04.224 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840591+0000", 2024-05-08T18:31:04.224 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4911000000000003e-05 2024-05-08T18:31:04.224 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.224 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.224 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:04.224 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840745+0000", 2024-05-08T18:31:04.224 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015394900000000001 2024-05-08T18:31:04.224 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.224 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.225 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:04.225 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.841269+0000", 2024-05-08T18:31:04.225 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00052347299999999999 2024-05-08T18:31:04.225 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.225 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.225 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:04.225 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.843997+0000", 2024-05-08T18:31:04.225 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0027285080000000001 2024-05-08T18:31:04.225 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.225 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.225 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:04.225 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844033+0000", 2024-05-08T18:31:04.225 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6038000000000003e-05 2024-05-08T18:31:04.225 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.225 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.226 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:04.226 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844078+0000", 2024-05-08T18:31:04.226 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4709000000000002e-05 2024-05-08T18:31:04.226 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:04.226 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:04.226 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:04.226 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.226 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.226 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:413 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:04.226 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.844187+0000", 2024-05-08T18:31:04.226 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 72.311247709, 2024-05-08T18:31:04.226 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0024835069999999998, 2024-05-08T18:31:04.226 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:04.227 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:04.227 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:04.227 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:04.227 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:04.227 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:04.227 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 413 2024-05-08T18:31:04.227 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.227 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:04.227 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.227 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:04.227 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844187+0000", 2024-05-08T18:31:04.227 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:04.227 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.227 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.228 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:04.228 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844187+0000", 2024-05-08T18:31:04.228 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:04.228 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.228 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.228 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:04.228 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844187+0000", 2024-05-08T18:31:04.228 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9999999999999996e-07 2024-05-08T18:31:04.228 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.228 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.228 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:04.228 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844192+0000", 2024-05-08T18:31:04.228 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7899999999999999e-06 2024-05-08T18:31:04.228 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.229 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.229 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:04.229 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844203+0000", 2024-05-08T18:31:04.229 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1002000000000001e-05 2024-05-08T18:31:04.229 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.229 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.229 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:04.229 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844209+0000", 2024-05-08T18:31:04.229 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6570000000000002e-06 2024-05-08T18:31:04.229 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.229 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.229 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:04.229 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844270+0000", 2024-05-08T18:31:04.229 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0810999999999998e-05 2024-05-08T18:31:04.230 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.230 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.230 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:04.230 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844419+0000", 2024-05-08T18:31:04.230 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000149097 2024-05-08T18:31:04.230 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.230 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.230 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:04.230 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844611+0000", 2024-05-08T18:31:04.230 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00019247900000000001 2024-05-08T18:31:04.230 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.230 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.230 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:04.231 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.845287+0000", 2024-05-08T18:31:04.231 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00067526000000000001 2024-05-08T18:31:04.231 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.231 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.231 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:04.231 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.846609+0000", 2024-05-08T18:31:04.231 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001322124 2024-05-08T18:31:04.231 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.231 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.231 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:04.231 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.846642+0000", 2024-05-08T18:31:04.231 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3654e-05 2024-05-08T18:31:04.231 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.231 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.232 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:04.232 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.846670+0000", 2024-05-08T18:31:04.232 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7733e-05 2024-05-08T18:31:04.232 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:04.232 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:04.232 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:04.232 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.232 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.232 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:420 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:04.232 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.847096+0000", 2024-05-08T18:31:04.232 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 72.308338414999994, 2024-05-08T18:31:04.232 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0026261589999999999, 2024-05-08T18:31:04.232 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:04.232 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:04.233 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:04.233 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:04.233 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:04.233 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:04.233 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 420 2024-05-08T18:31:04.233 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.233 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:04.233 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.233 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:04.233 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847096+0000", 2024-05-08T18:31:04.233 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:04.233 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.233 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.234 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:04.234 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847096+0000", 2024-05-08T18:31:04.234 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:04.234 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.234 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.234 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:04.234 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847097+0000", 2024-05-08T18:31:04.234 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.5499999999999996e-07 2024-05-08T18:31:04.234 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.234 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.234 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:04.234 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847103+0000", 2024-05-08T18:31:04.234 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8969999999999996e-06 2024-05-08T18:31:04.234 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.235 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.235 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:04.235 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847114+0000", 2024-05-08T18:31:04.235 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1549000000000001e-05 2024-05-08T18:31:04.235 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.235 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.235 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:04.235 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847120+0000", 2024-05-08T18:31:04.235 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5509999999999999e-06 2024-05-08T18:31:04.235 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.235 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.235 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:04.235 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847166+0000", 2024-05-08T18:31:04.235 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6683e-05 2024-05-08T18:31:04.236 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.236 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.236 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:04.236 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847213+0000", 2024-05-08T18:31:04.236 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6659000000000002e-05 2024-05-08T18:31:04.236 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.236 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.236 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:04.236 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847315+0000", 2024-05-08T18:31:04.236 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000102336 2024-05-08T18:31:04.236 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.236 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.236 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:04.236 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847840+0000", 2024-05-08T18:31:04.236 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00052475000000000004 2024-05-08T18:31:04.237 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.237 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.237 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:04.237 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.849660+0000", 2024-05-08T18:31:04.237 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001819563 2024-05-08T18:31:04.237 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.237 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.237 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:04.237 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.849695+0000", 2024-05-08T18:31:04.237 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4761000000000001e-05 2024-05-08T18:31:04.237 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.237 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.237 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:04.237 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.849722+0000", 2024-05-08T18:31:04.238 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7455000000000001e-05 2024-05-08T18:31:04.238 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:04.238 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:04.238 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:04.238 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.238 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.238 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:532 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:04.238 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.908603+0000", 2024-05-08T18:31:04.238 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 72.246830865000007, 2024-05-08T18:31:04.238 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0038838950000000001, 2024-05-08T18:31:04.238 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:04.238 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:04.238 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:04.238 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:04.239 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:04.239 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:04.239 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 532 2024-05-08T18:31:04.239 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.239 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:04.239 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.239 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:04.239 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908603+0000", 2024-05-08T18:31:04.239 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:04.239 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.239 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.239 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:04.239 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908603+0000", 2024-05-08T18:31:04.239 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:04.240 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.240 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.240 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:04.240 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908605+0000", 2024-05-08T18:31:04.240 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1179999999999999e-06 2024-05-08T18:31:04.240 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.240 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.240 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:04.240 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908608+0000", 2024-05-08T18:31:04.240 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7419999999999999e-06 2024-05-08T18:31:04.240 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.240 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.240 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:04.240 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908618+0000", 2024-05-08T18:31:04.241 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.6889999999999999e-06 2024-05-08T18:31:04.241 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.241 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.241 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:04.241 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908625+0000", 2024-05-08T18:31:04.241 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1300000000000003e-06 2024-05-08T18:31:04.241 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.241 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.241 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:04.241 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908669+0000", 2024-05-08T18:31:04.241 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3832000000000003e-05 2024-05-08T18:31:04.241 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.241 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.241 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:04.242 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908724+0000", 2024-05-08T18:31:04.242 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5222000000000001e-05 2024-05-08T18:31:04.242 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.242 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.242 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:04.242 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908854+0000", 2024-05-08T18:31:04.242 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012953500000000001 2024-05-08T18:31:04.242 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.242 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.242 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:04.242 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.909511+0000", 2024-05-08T18:31:04.242 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00065768399999999996 2024-05-08T18:31:04.242 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.242 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.243 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:04.243 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912426+0000", 2024-05-08T18:31:04.243 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0029146599999999999 2024-05-08T18:31:04.243 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.243 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.243 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:04.243 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912461+0000", 2024-05-08T18:31:04.243 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4934999999999997e-05 2024-05-08T18:31:04.243 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.243 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.243 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:04.243 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912487+0000", 2024-05-08T18:31:04.243 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6347999999999999e-05 2024-05-08T18:31:04.243 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:04.244 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:04.244 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:04.244 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.244 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.244 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:534 6.9 6:9268b73e:::obj_delete_at_hint.0000000019:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:04.244 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.910153+0000", 2024-05-08T18:31:04.244 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 72.245281407999997, 2024-05-08T18:31:04.244 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0051089680000000002, 2024-05-08T18:31:04.244 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:04.244 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:04.244 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:04.244 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:04.244 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:04.244 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:04.244 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 534 2024-05-08T18:31:04.245 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.245 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:04.245 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.245 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:04.245 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910153+0000", 2024-05-08T18:31:04.245 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:04.245 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.245 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.245 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:04.245 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910153+0000", 2024-05-08T18:31:04.245 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:04.245 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.245 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.245 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:04.246 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910154+0000", 2024-05-08T18:31:04.246 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1039999999999999e-06 2024-05-08T18:31:04.246 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.246 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.246 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:04.246 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910158+0000", 2024-05-08T18:31:04.246 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7400000000000002e-06 2024-05-08T18:31:04.246 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.246 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.246 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:04.246 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910167+0000", 2024-05-08T18:31:04.246 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8880000000000003e-06 2024-05-08T18:31:04.246 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.247 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.247 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:04.247 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910173+0000", 2024-05-08T18:31:04.247 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.844e-06 2024-05-08T18:31:04.247 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.247 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.247 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:04.247 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910220+0000", 2024-05-08T18:31:04.247 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6582000000000002e-05 2024-05-08T18:31:04.247 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.247 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.247 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:04.247 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910287+0000", 2024-05-08T18:31:04.247 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7271e-05 2024-05-08T18:31:04.248 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.248 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.248 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:04.248 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910402+0000", 2024-05-08T18:31:04.248 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115127 2024-05-08T18:31:04.248 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.248 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.248 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:04.248 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910881+0000", 2024-05-08T18:31:04.248 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000479025 2024-05-08T18:31:04.248 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.248 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.248 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:04.248 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.915206+0000", 2024-05-08T18:31:04.249 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.004324357 2024-05-08T18:31:04.249 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.249 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.249 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:04.249 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.915237+0000", 2024-05-08T18:31:04.249 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1590000000000001e-05 2024-05-08T18:31:04.249 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.249 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.249 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:04.249 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.915262+0000", 2024-05-08T18:31:04.249 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.444e-05 2024-05-08T18:31:04.249 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:04.249 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:04.249 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:04.250 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.250 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.250 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:583 6.0 6:03bbb29a:::obj_delete_at_hint.0000000026:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:04.250 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.947199+0000", 2024-05-08T18:31:04.250 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 72.208235211000002, 2024-05-08T18:31:04.250 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0025081510000000001, 2024-05-08T18:31:04.250 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:04.250 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:04.250 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:04.250 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:04.250 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:04.250 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:04.250 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 583 2024-05-08T18:31:04.251 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.251 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:04.251 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.251 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:04.251 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947199+0000", 2024-05-08T18:31:04.251 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:04.251 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.251 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.251 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:04.251 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947199+0000", 2024-05-08T18:31:04.251 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:04.251 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.251 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.251 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:04.251 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947200+0000", 2024-05-08T18:31:04.252 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3799999999999997e-07 2024-05-08T18:31:04.252 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.252 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.252 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:04.252 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947207+0000", 2024-05-08T18:31:04.252 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2030000000000003e-06 2024-05-08T18:31:04.252 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.252 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.252 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:04.252 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947217+0000", 2024-05-08T18:31:04.252 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0138e-05 2024-05-08T18:31:04.252 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.252 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.252 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:04.253 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947224+0000", 2024-05-08T18:31:04.253 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5289999999999997e-06 2024-05-08T18:31:04.253 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.253 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.253 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:04.253 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.948039+0000", 2024-05-08T18:31:04.253 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00081500599999999996 2024-05-08T18:31:04.253 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.253 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.253 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:04.253 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.948230+0000", 2024-05-08T18:31:04.253 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000191838 2024-05-08T18:31:04.253 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.254 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.254 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:04.254 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.948606+0000", 2024-05-08T18:31:04.254 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00037547900000000001 2024-05-08T18:31:04.254 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.254 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.254 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:04.254 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.949406+0000", 2024-05-08T18:31:04.254 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000799674 2024-05-08T18:31:04.254 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.254 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.254 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:04.254 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.949630+0000", 2024-05-08T18:31:04.254 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00022474699999999999 2024-05-08T18:31:04.255 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.255 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.255 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:04.255 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.949664+0000", 2024-05-08T18:31:04.255 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3535999999999999e-05 2024-05-08T18:31:04.255 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.255 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.255 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:04.255 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.949707+0000", 2024-05-08T18:31:04.255 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3362999999999998e-05 2024-05-08T18:31:04.255 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:04.255 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:04.255 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:04.256 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.256 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.256 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:04.256 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.263796+0000", 2024-05-08T18:31:04.256 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 71.891637943000006, 2024-05-08T18:31:04.256 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0027788019999999999, 2024-05-08T18:31:04.256 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:04.256 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:04.256 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:04.256 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:04.256 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:04.256 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:04.256 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 811 2024-05-08T18:31:04.256 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.257 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:04.257 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.257 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:04.257 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263796+0000", 2024-05-08T18:31:04.257 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:04.257 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.257 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.257 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:04.257 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263796+0000", 2024-05-08T18:31:04.257 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:04.257 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.257 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.257 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:04.257 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263799+0000", 2024-05-08T18:31:04.258 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5569999999999998e-06 2024-05-08T18:31:04.258 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.258 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.258 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:04.258 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263812+0000", 2024-05-08T18:31:04.258 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3145999999999999e-05 2024-05-08T18:31:04.258 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.258 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.258 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:04.258 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263842+0000", 2024-05-08T18:31:04.258 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0193e-05 2024-05-08T18:31:04.258 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.258 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.259 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:04.259 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263860+0000", 2024-05-08T18:31:04.259 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7880000000000002e-05 2024-05-08T18:31:04.259 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.259 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.259 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:04.259 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263979+0000", 2024-05-08T18:31:04.259 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011919899999999999 2024-05-08T18:31:04.259 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.259 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.259 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:04.259 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.264222+0000", 2024-05-08T18:31:04.259 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024290800000000001 2024-05-08T18:31:04.259 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.260 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.260 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:04.260 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.264545+0000", 2024-05-08T18:31:04.260 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00032300200000000002 2024-05-08T18:31:04.260 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.260 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.260 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:04.260 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.265682+0000", 2024-05-08T18:31:04.260 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001136464 2024-05-08T18:31:04.260 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.260 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.260 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:04.260 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.266397+0000", 2024-05-08T18:31:04.260 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00071512799999999999 2024-05-08T18:31:04.260 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.261 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.261 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:04.261 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.266504+0000", 2024-05-08T18:31:04.261 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000107019 2024-05-08T18:31:04.261 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.261 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.261 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:04.261 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.266575+0000", 2024-05-08T18:31:04.261 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1305999999999998e-05 2024-05-08T18:31:04.261 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:04.261 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:04.261 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:04.261 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.261 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.261 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:04.262 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.445706+0000", 2024-05-08T18:31:04.262 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 71.709728226999999, 2024-05-08T18:31:04.262 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0026820630000000002, 2024-05-08T18:31:04.262 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:04.262 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:04.262 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:04.262 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:04.262 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:04.262 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:04.262 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 889 2024-05-08T18:31:04.262 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.262 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:04.262 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.262 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:04.263 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445706+0000", 2024-05-08T18:31:04.263 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:04.263 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.263 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.263 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:04.263 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445706+0000", 2024-05-08T18:31:04.263 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:04.263 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.263 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.263 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:04.263 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445709+0000", 2024-05-08T18:31:04.263 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0299999999999998e-06 2024-05-08T18:31:04.263 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.263 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.264 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:04.264 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445721+0000", 2024-05-08T18:31:04.264 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2366e-05 2024-05-08T18:31:04.264 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.264 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.264 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:04.264 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445752+0000", 2024-05-08T18:31:04.264 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0287e-05 2024-05-08T18:31:04.264 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.264 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.264 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:04.264 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445773+0000", 2024-05-08T18:31:04.264 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1367000000000001e-05 2024-05-08T18:31:04.264 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.265 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.265 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:04.265 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445892+0000", 2024-05-08T18:31:04.265 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000119311 2024-05-08T18:31:04.265 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.265 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.265 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:04.265 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.446158+0000", 2024-05-08T18:31:04.265 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000265441 2024-05-08T18:31:04.265 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.265 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.265 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:04.265 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.446465+0000", 2024-05-08T18:31:04.265 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00030754300000000002 2024-05-08T18:31:04.266 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.266 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.266 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:04.266 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.447511+0000", 2024-05-08T18:31:04.266 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001045975 2024-05-08T18:31:04.266 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.266 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.266 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:04.266 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.448171+0000", 2024-05-08T18:31:04.266 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00065971200000000002 2024-05-08T18:31:04.266 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.266 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.266 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:04.267 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.448273+0000", 2024-05-08T18:31:04.267 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000101592 2024-05-08T18:31:04.267 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.267 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.267 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:04.267 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.448388+0000", 2024-05-08T18:31:04.267 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115439 2024-05-08T18:31:04.267 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:04.267 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:04.267 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:04.267 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.267 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.267 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1020 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_add in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-05-08T18:31:04.268 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:30:21.842276+0000", 2024-05-08T18:31:04.268 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 42.313158686000001, 2024-05-08T18:31:04.268 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0025898760000000001, 2024-05-08T18:31:04.268 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:04.268 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:04.268 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:04.268 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:04.268 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:04.268 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:04.268 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1020 2024-05-08T18:31:04.268 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.268 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:04.268 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.268 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:04.268 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842276+0000", 2024-05-08T18:31:04.269 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:04.269 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.269 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.269 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:04.269 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842276+0000", 2024-05-08T18:31:04.269 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:04.269 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.269 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.269 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:04.269 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842278+0000", 2024-05-08T18:31:04.269 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6129999999999998e-06 2024-05-08T18:31:04.269 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.269 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.269 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:04.270 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842290+0000", 2024-05-08T18:31:04.270 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2187999999999999e-05 2024-05-08T18:31:04.270 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.270 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.270 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:04.270 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842319+0000", 2024-05-08T18:31:04.270 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8782e-05 2024-05-08T18:31:04.270 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.270 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.270 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:04.270 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842336+0000", 2024-05-08T18:31:04.270 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6826000000000001e-05 2024-05-08T18:31:04.271 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.271 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.271 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:04.271 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842450+0000", 2024-05-08T18:31:04.271 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000113829 2024-05-08T18:31:04.271 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.271 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.271 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:04.271 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842627+0000", 2024-05-08T18:31:04.271 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00017756599999999999 2024-05-08T18:31:04.271 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.271 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.271 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:04.271 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842794+0000", 2024-05-08T18:31:04.272 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000166866 2024-05-08T18:31:04.272 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.272 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.272 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:04.272 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.843540+0000", 2024-05-08T18:31:04.272 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00074611700000000003 2024-05-08T18:31:04.272 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.272 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.272 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:04.272 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.844762+0000", 2024-05-08T18:31:04.272 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012220309999999999 2024-05-08T18:31:04.272 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.272 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.272 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:04.272 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.844806+0000", 2024-05-08T18:31:04.273 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3414000000000001e-05 2024-05-08T18:31:04.273 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.273 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.273 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:04.273 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.844865+0000", 2024-05-08T18:31:04.273 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9644e-05 2024-05-08T18:31:04.273 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:04.273 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:04.273 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:04.273 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:04.273 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:04.273 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:04.275 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-08T18:31:04.275 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:31:04.275+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:31:04.375 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:31:04.375+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:31:04.428 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:04.428 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:31:04.428 INFO:teuthology.orchestra.run.smithi097.stdout: "num_ops": 0 2024-05-08T18:31:04.428 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:04.441 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-08T18:31:04.476 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:31:04.475+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:31:04.548 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:04.548 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:31:04.548 INFO:teuthology.orchestra.run.smithi097.stdout: "complaint_time": 30, 2024-05-08T18:31:04.549 INFO:teuthology.orchestra.run.smithi097.stdout: "num_blocked_ops": 0 2024-05-08T18:31:04.549 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:04.561 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-08T18:31:04.607 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:31:04.607+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:31:04.677 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:31:04.675+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:31:04.713 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:04.713 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2024-05-08T18:31:04.713 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2024-05-08T18:31:04.713 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-05-08T18:31:04.713 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.714 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4479.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-05-08T18:31:04.714 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:44.576320+0000", 2024-05-08T18:31:04.714 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 80.137206814999999, 2024-05-08T18:31:04.714 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019751892, 2024-05-08T18:31:04.714 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:04.714 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:04.714 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "reached pg", 2024-05-08T18:31:04.714 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:04.714 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4479", 2024-05-08T18:31:04.714 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3577501689", 2024-05-08T18:31:04.714 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 2 2024-05-08T18:31:04.714 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.714 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:04.714 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.715 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:04.715 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576320+0000", 2024-05-08T18:31:04.715 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:04.715 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.715 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.715 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:04.715 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576320+0000", 2024-05-08T18:31:04.715 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:04.715 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.715 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.715 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:04.715 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576323+0000", 2024-05-08T18:31:04.715 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.813e-06 2024-05-08T18:31:04.716 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.716 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.716 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:04.716 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576335+0000", 2024-05-08T18:31:04.716 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2330000000000001e-05 2024-05-08T18:31:04.716 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.716 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.716 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:04.716 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576367+0000", 2024-05-08T18:31:04.716 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2036999999999998e-05 2024-05-08T18:31:04.716 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.716 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.716 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:04.716 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576394+0000", 2024-05-08T18:31:04.717 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6529e-05 2024-05-08T18:31:04.717 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.717 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.717 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:04.717 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576550+0000", 2024-05-08T18:31:04.717 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000156718 2024-05-08T18:31:04.717 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.717 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.717 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-05-08T18:31:04.717 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576560+0000", 2024-05-08T18:31:04.717 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0040999999999999e-05 2024-05-08T18:31:04.717 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.717 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.717 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:04.717 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.587240+0000", 2024-05-08T18:31:04.718 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010679266999999999 2024-05-08T18:31:04.718 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.718 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.718 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2024-05-08T18:31:04.718 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.587266+0000", 2024-05-08T18:31:04.718 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6642e-05 2024-05-08T18:31:04.718 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.718 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.718 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:04.718 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.595882+0000", 2024-05-08T18:31:04.718 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0086159600000000006 2024-05-08T18:31:04.718 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.718 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.719 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:04.719 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.596072+0000", 2024-05-08T18:31:04.719 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000189555 2024-05-08T18:31:04.719 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:04.719 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:04.719 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:04.719 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.719 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.719 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:31:04.719 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:48.766182+0000", 2024-05-08T18:31:04.719 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 75.947344787999995, 2024-05-08T18:31:04.719 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031881209999999999, 2024-05-08T18:31:04.719 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:04.719 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:04.719 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:04.720 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:04.720 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:04.720 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:04.720 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 193 2024-05-08T18:31:04.720 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.720 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:04.720 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.720 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:04.720 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766182+0000", 2024-05-08T18:31:04.720 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:04.720 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.720 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.720 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:04.720 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766182+0000", 2024-05-08T18:31:04.720 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:04.721 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.721 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.721 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:04.721 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766184+0000", 2024-05-08T18:31:04.721 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4159999999999998e-06 2024-05-08T18:31:04.721 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.721 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.721 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:04.721 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766196+0000", 2024-05-08T18:31:04.721 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1814000000000001e-05 2024-05-08T18:31:04.721 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.721 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.721 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:04.721 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766227+0000", 2024-05-08T18:31:04.721 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0676000000000002e-05 2024-05-08T18:31:04.722 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.722 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.722 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:04.722 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766242+0000", 2024-05-08T18:31:04.722 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5497000000000001e-05 2024-05-08T18:31:04.722 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.722 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.722 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:04.722 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766354+0000", 2024-05-08T18:31:04.722 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000111579 2024-05-08T18:31:04.722 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.722 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.722 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:04.722 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766569+0000", 2024-05-08T18:31:04.722 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000214978 2024-05-08T18:31:04.723 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.723 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.723 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:04.723 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766834+0000", 2024-05-08T18:31:04.723 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00026551500000000002 2024-05-08T18:31:04.723 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.723 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.723 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:04.723 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.768577+0000", 2024-05-08T18:31:04.723 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001742513 2024-05-08T18:31:04.723 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.723 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.723 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:04.723 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.769150+0000", 2024-05-08T18:31:04.723 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00057320500000000003 2024-05-08T18:31:04.724 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.724 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.724 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:04.724 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.769250+0000", 2024-05-08T18:31:04.724 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.9846000000000006e-05 2024-05-08T18:31:04.724 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.724 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.724 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:04.724 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.769370+0000", 2024-05-08T18:31:04.724 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012008200000000001 2024-05-08T18:31:04.724 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:04.724 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:04.724 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:04.724 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.724 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.725 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:04.725 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.679562+0000", 2024-05-08T18:31:04.725 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 73.033965084000002, 2024-05-08T18:31:04.725 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0086320800000000003, 2024-05-08T18:31:04.725 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:04.725 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:04.725 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:04.725 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:04.725 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:04.725 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:04.725 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 208 2024-05-08T18:31:04.725 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.725 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:04.725 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.726 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:04.726 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679562+0000", 2024-05-08T18:31:04.726 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:04.726 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.726 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.726 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:04.726 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679562+0000", 2024-05-08T18:31:04.726 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:04.726 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.726 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.726 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:04.726 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679565+0000", 2024-05-08T18:31:04.726 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0800000000000002e-06 2024-05-08T18:31:04.726 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.727 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.727 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:04.727 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679578+0000", 2024-05-08T18:31:04.727 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3217000000000001e-05 2024-05-08T18:31:04.727 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.727 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.727 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:04.727 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679610+0000", 2024-05-08T18:31:04.727 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1696000000000003e-05 2024-05-08T18:31:04.727 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.727 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.727 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:04.727 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679625+0000", 2024-05-08T18:31:04.727 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5824e-05 2024-05-08T18:31:04.728 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.728 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.728 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:04.728 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679758+0000", 2024-05-08T18:31:04.728 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013231199999999999 2024-05-08T18:31:04.728 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.728 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.728 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-05-08T18:31:04.728 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679770+0000", 2024-05-08T18:31:04.728 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1800000000000001e-05 2024-05-08T18:31:04.728 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.728 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.728 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:04.728 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.685241+0000", 2024-05-08T18:31:04.728 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0054710169999999999 2024-05-08T18:31:04.729 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.729 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.729 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:04.729 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.685444+0000", 2024-05-08T18:31:04.729 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000203835 2024-05-08T18:31:04.729 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.729 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.729 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:04.729 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.685842+0000", 2024-05-08T18:31:04.729 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00039773 2024-05-08T18:31:04.729 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.729 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.729 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:04.730 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.687232+0000", 2024-05-08T18:31:04.730 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00139011 2024-05-08T18:31:04.730 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.730 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.730 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:04.730 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.688049+0000", 2024-05-08T18:31:04.730 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00081667000000000003 2024-05-08T18:31:04.730 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.730 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.730 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:04.730 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.688135+0000", 2024-05-08T18:31:04.730 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6299999999999997e-05 2024-05-08T18:31:04.730 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.730 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.731 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:04.731 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.688194+0000", 2024-05-08T18:31:04.731 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8489000000000002e-05 2024-05-08T18:31:04.731 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:04.731 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:04.731 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:04.731 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.731 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.731 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:04.731 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.707114+0000", 2024-05-08T18:31:04.731 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 73.006413069999994, 2024-05-08T18:31:04.731 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031802990000000001, 2024-05-08T18:31:04.731 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:04.731 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:04.732 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:04.732 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:04.732 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:04.732 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:04.732 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 212 2024-05-08T18:31:04.732 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.732 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:04.732 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.732 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:04.732 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707114+0000", 2024-05-08T18:31:04.732 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:04.732 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.732 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.733 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:04.733 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707114+0000", 2024-05-08T18:31:04.733 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:04.733 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.733 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.733 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:04.733 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707117+0000", 2024-05-08T18:31:04.733 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8629999999999999e-06 2024-05-08T18:31:04.733 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.733 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.733 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:04.733 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707129+0000", 2024-05-08T18:31:04.733 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2150000000000001e-05 2024-05-08T18:31:04.733 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.733 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.734 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:04.734 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707158+0000", 2024-05-08T18:31:04.734 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9513999999999999e-05 2024-05-08T18:31:04.734 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.734 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.734 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:04.734 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707173+0000", 2024-05-08T18:31:04.734 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5136e-05 2024-05-08T18:31:04.734 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.734 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.734 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:04.734 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707309+0000", 2024-05-08T18:31:04.734 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000135609 2024-05-08T18:31:04.734 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.735 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.735 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:04.735 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707523+0000", 2024-05-08T18:31:04.735 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021362200000000001 2024-05-08T18:31:04.735 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.735 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.735 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:04.735 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707918+0000", 2024-05-08T18:31:04.735 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00039556299999999998 2024-05-08T18:31:04.735 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.735 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.735 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:04.735 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.709166+0000", 2024-05-08T18:31:04.735 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012476410000000001 2024-05-08T18:31:04.736 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.736 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.736 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:04.736 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.710145+0000", 2024-05-08T18:31:04.736 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00097909899999999998 2024-05-08T18:31:04.736 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.736 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.736 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:04.736 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.710231+0000", 2024-05-08T18:31:04.736 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5625999999999996e-05 2024-05-08T18:31:04.736 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.736 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.736 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:04.736 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.710294+0000", 2024-05-08T18:31:04.736 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3476e-05 2024-05-08T18:31:04.737 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:04.737 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:04.737 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:04.737 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.737 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.737 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:04.737 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.731985+0000", 2024-05-08T18:31:04.737 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 72.981541844999995, 2024-05-08T18:31:04.737 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0039250600000000002, 2024-05-08T18:31:04.737 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:04.737 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:04.737 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:04.737 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:04.737 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:04.738 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:04.738 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 219 2024-05-08T18:31:04.738 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.738 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:04.738 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.738 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:04.738 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731985+0000", 2024-05-08T18:31:04.738 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:04.738 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.738 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.738 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:04.738 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731985+0000", 2024-05-08T18:31:04.738 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:04.738 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.738 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.739 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:04.739 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731988+0000", 2024-05-08T18:31:04.739 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6599999999999999e-06 2024-05-08T18:31:04.739 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.739 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.739 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:04.739 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.732017+0000", 2024-05-08T18:31:04.739 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9692999999999998e-05 2024-05-08T18:31:04.739 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.739 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.739 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:04.739 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.732048+0000", 2024-05-08T18:31:04.739 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1066999999999999e-05 2024-05-08T18:31:04.739 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.739 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.740 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:04.740 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.732064+0000", 2024-05-08T18:31:04.740 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5786000000000001e-05 2024-05-08T18:31:04.740 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.740 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.740 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:04.740 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.732213+0000", 2024-05-08T18:31:04.740 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014895899999999999 2024-05-08T18:31:04.740 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.740 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.740 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:04.740 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.732572+0000", 2024-05-08T18:31:04.740 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000358904 2024-05-08T18:31:04.740 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.740 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.741 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:04.741 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.733349+0000", 2024-05-08T18:31:04.741 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00077657699999999997 2024-05-08T18:31:04.741 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.741 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.741 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:04.741 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.734899+0000", 2024-05-08T18:31:04.741 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001550652 2024-05-08T18:31:04.741 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.741 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.741 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:04.741 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.735641+0000", 2024-05-08T18:31:04.741 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00074222000000000003 2024-05-08T18:31:04.741 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.741 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.741 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:04.742 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.735801+0000", 2024-05-08T18:31:04.742 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015913599999999999 2024-05-08T18:31:04.742 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.742 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.742 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:04.742 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.735910+0000", 2024-05-08T18:31:04.742 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000109406 2024-05-08T18:31:04.742 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:04.742 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:04.742 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:04.742 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.742 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.742 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:04.742 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.750251+0000", 2024-05-08T18:31:04.743 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 72.963275913000004, 2024-05-08T18:31:04.743 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0038408600000000002, 2024-05-08T18:31:04.743 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:04.743 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:04.743 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:04.743 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:04.743 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:04.743 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:04.743 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 224 2024-05-08T18:31:04.743 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.743 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:04.743 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.743 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:04.743 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750251+0000", 2024-05-08T18:31:04.744 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:04.744 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.744 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.744 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:04.744 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750251+0000", 2024-05-08T18:31:04.744 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:04.744 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.744 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.744 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:04.744 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750253+0000", 2024-05-08T18:31:04.744 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2129999999999998e-06 2024-05-08T18:31:04.744 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.744 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.744 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:04.745 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750265+0000", 2024-05-08T18:31:04.745 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1484000000000001e-05 2024-05-08T18:31:04.745 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.745 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.745 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:04.745 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750293+0000", 2024-05-08T18:31:04.745 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8673000000000001e-05 2024-05-08T18:31:04.745 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.745 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.745 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:04.745 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750308+0000", 2024-05-08T18:31:04.745 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4620000000000001e-05 2024-05-08T18:31:04.745 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.745 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.745 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:04.746 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750459+0000", 2024-05-08T18:31:04.746 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000151619 2024-05-08T18:31:04.746 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.746 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.746 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:04.746 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750822+0000", 2024-05-08T18:31:04.746 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000362467 2024-05-08T18:31:04.746 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.746 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.746 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:04.746 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.751591+0000", 2024-05-08T18:31:04.746 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00076934699999999998 2024-05-08T18:31:04.746 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.746 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.747 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:04.747 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.753042+0000", 2024-05-08T18:31:04.747 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001450652 2024-05-08T18:31:04.747 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.747 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.747 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:04.747 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.753792+0000", 2024-05-08T18:31:04.747 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00075045500000000002 2024-05-08T18:31:04.747 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.747 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.747 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:04.747 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.753977+0000", 2024-05-08T18:31:04.747 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000184511 2024-05-08T18:31:04.747 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.747 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.748 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:04.748 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.754092+0000", 2024-05-08T18:31:04.748 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000114819 2024-05-08T18:31:04.748 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:04.748 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:04.748 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:04.748 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.748 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.748 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:04.748 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.783902+0000", 2024-05-08T18:31:04.748 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 72.929625181999995, 2024-05-08T18:31:04.748 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003120046, 2024-05-08T18:31:04.748 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:04.748 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:04.748 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:04.749 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:04.749 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:04.749 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:04.749 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 233 2024-05-08T18:31:04.749 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.749 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:04.749 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.749 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:04.749 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.783902+0000", 2024-05-08T18:31:04.749 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:04.749 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.749 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.749 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:04.749 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.783902+0000", 2024-05-08T18:31:04.749 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:04.749 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.750 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.750 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:04.750 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.783904+0000", 2024-05-08T18:31:04.750 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5229999999999998e-06 2024-05-08T18:31:04.750 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.750 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.750 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:04.750 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.783916+0000", 2024-05-08T18:31:04.750 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1513e-05 2024-05-08T18:31:04.750 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.750 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.750 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:04.750 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.783947+0000", 2024-05-08T18:31:04.750 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1353000000000003e-05 2024-05-08T18:31:04.751 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.751 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.751 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:04.751 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.783964+0000", 2024-05-08T18:31:04.751 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6643e-05 2024-05-08T18:31:04.751 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.751 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.751 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:04.751 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.784110+0000", 2024-05-08T18:31:04.751 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014627299999999999 2024-05-08T18:31:04.751 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.751 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.751 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:04.751 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.784329+0000", 2024-05-08T18:31:04.751 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021892099999999999 2024-05-08T18:31:04.752 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.752 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.752 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:04.752 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.784752+0000", 2024-05-08T18:31:04.752 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00042336700000000001 2024-05-08T18:31:04.752 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.752 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.752 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:04.752 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.786093+0000", 2024-05-08T18:31:04.752 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00134107 2024-05-08T18:31:04.752 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.752 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.752 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:04.752 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.786863+0000", 2024-05-08T18:31:04.752 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00076949099999999997 2024-05-08T18:31:04.753 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.753 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.753 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:04.753 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.786955+0000", 2024-05-08T18:31:04.753 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.2478999999999993e-05 2024-05-08T18:31:04.753 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.753 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.753 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:04.753 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.787022+0000", 2024-05-08T18:31:04.753 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6413000000000003e-05 2024-05-08T18:31:04.753 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:04.753 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:04.753 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:04.754 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.754 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.754 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:341 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:04.754 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.816045+0000", 2024-05-08T18:31:04.754 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 72.897481845000001, 2024-05-08T18:31:04.754 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002875154, 2024-05-08T18:31:04.754 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:04.754 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:04.754 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:04.754 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:04.754 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:04.754 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:04.754 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 341 2024-05-08T18:31:04.754 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.755 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:04.755 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.755 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:04.755 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816045+0000", 2024-05-08T18:31:04.755 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:04.755 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.755 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.755 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:04.755 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816045+0000", 2024-05-08T18:31:04.755 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:04.755 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.755 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.755 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:04.755 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816046+0000", 2024-05-08T18:31:04.756 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9199999999999999e-07 2024-05-08T18:31:04.756 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.756 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.756 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:04.756 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816050+0000", 2024-05-08T18:31:04.756 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0260000000000001e-06 2024-05-08T18:31:04.756 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.756 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.756 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:04.756 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816060+0000", 2024-05-08T18:31:04.756 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0297e-05 2024-05-08T18:31:04.756 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.756 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.756 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:04.757 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816065+0000", 2024-05-08T18:31:04.757 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.237e-06 2024-05-08T18:31:04.757 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.757 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.757 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:04.757 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816122+0000", 2024-05-08T18:31:04.757 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6168000000000002e-05 2024-05-08T18:31:04.757 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.757 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.757 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:04.757 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816198+0000", 2024-05-08T18:31:04.757 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6511e-05 2024-05-08T18:31:04.757 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.757 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.757 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:31:04.758 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816305+0000", 2024-05-08T18:31:04.758 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000106487 2024-05-08T18:31:04.758 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.758 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.758 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:04.758 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816886+0000", 2024-05-08T18:31:04.758 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00058187199999999999 2024-05-08T18:31:04.758 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.758 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.758 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:04.758 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.818821+0000", 2024-05-08T18:31:04.758 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001934362 2024-05-08T18:31:04.758 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.758 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.759 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:04.759 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.818880+0000", 2024-05-08T18:31:04.759 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9210999999999999e-05 2024-05-08T18:31:04.759 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.759 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.759 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:04.759 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.818920+0000", 2024-05-08T18:31:04.759 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0091e-05 2024-05-08T18:31:04.759 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:04.759 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:04.759 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:04.759 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.759 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.759 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:04.760 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.086431+0000", 2024-05-08T18:31:04.760 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 72.627096025, 2024-05-08T18:31:04.760 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028335959999999999, 2024-05-08T18:31:04.760 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:04.760 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:04.760 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:04.760 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:04.760 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:04.760 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:04.760 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 733 2024-05-08T18:31:04.760 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.760 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:04.760 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.760 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:04.760 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086431+0000", 2024-05-08T18:31:04.760 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:04.761 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.761 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.761 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:04.761 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086431+0000", 2024-05-08T18:31:04.761 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:04.761 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.761 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.761 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:04.761 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086433+0000", 2024-05-08T18:31:04.761 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8899999999999999e-06 2024-05-08T18:31:04.761 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.761 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.761 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:04.761 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086441+0000", 2024-05-08T18:31:04.762 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.3100000000000001e-06 2024-05-08T18:31:04.762 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.762 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.762 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:04.762 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086460+0000", 2024-05-08T18:31:04.762 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8703999999999999e-05 2024-05-08T18:31:04.762 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.762 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.762 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:04.762 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086471+0000", 2024-05-08T18:31:04.762 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1324e-05 2024-05-08T18:31:04.762 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.762 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.762 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:04.762 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086590+0000", 2024-05-08T18:31:04.763 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000118625 2024-05-08T18:31:04.763 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.763 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.763 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:04.763 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086817+0000", 2024-05-08T18:31:04.763 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000226958 2024-05-08T18:31:04.763 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.763 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.763 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:04.763 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.087131+0000", 2024-05-08T18:31:04.763 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00031478799999999998 2024-05-08T18:31:04.763 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.763 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.763 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:04.763 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.088025+0000", 2024-05-08T18:31:04.764 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00089402999999999998 2024-05-08T18:31:04.764 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.764 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.764 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:04.764 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.089123+0000", 2024-05-08T18:31:04.764 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001097598 2024-05-08T18:31:04.764 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.764 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.764 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:04.764 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.089200+0000", 2024-05-08T18:31:04.764 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7333e-05 2024-05-08T18:31:04.764 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.764 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.764 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:04.764 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.089264+0000", 2024-05-08T18:31:04.765 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.4035999999999995e-05 2024-05-08T18:31:04.765 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:04.765 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:04.765 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:04.765 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.765 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.765 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:751 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:04.765 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.125611+0000", 2024-05-08T18:31:04.765 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 72.587915332999998, 2024-05-08T18:31:04.765 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032716749999999999, 2024-05-08T18:31:04.765 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:04.765 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:04.765 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:04.765 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:04.765 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:04.766 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:04.766 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 751 2024-05-08T18:31:04.766 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.766 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:04.766 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.766 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:04.766 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125611+0000", 2024-05-08T18:31:04.766 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:04.766 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.766 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.766 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:04.766 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125611+0000", 2024-05-08T18:31:04.766 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:04.766 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.767 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.767 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:04.767 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125614+0000", 2024-05-08T18:31:04.767 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.12e-06 2024-05-08T18:31:04.767 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.767 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.767 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:04.767 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125624+0000", 2024-05-08T18:31:04.767 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0492999999999999e-05 2024-05-08T18:31:04.767 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.767 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.767 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:04.767 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125650+0000", 2024-05-08T18:31:04.767 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5907000000000001e-05 2024-05-08T18:31:04.768 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.768 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.768 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:04.768 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125667+0000", 2024-05-08T18:31:04.768 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.694e-05 2024-05-08T18:31:04.768 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.768 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.768 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:04.768 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125801+0000", 2024-05-08T18:31:04.768 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000134482 2024-05-08T18:31:04.768 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.768 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.768 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:04.768 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.126174+0000", 2024-05-08T18:31:04.768 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00037294999999999999 2024-05-08T18:31:04.769 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.769 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.769 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:04.769 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.126750+0000", 2024-05-08T18:31:04.769 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00057538900000000004 2024-05-08T18:31:04.769 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.769 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.769 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:04.769 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.127997+0000", 2024-05-08T18:31:04.769 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001247761 2024-05-08T18:31:04.769 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.769 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.769 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:04.769 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.128731+0000", 2024-05-08T18:31:04.770 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00073338099999999996 2024-05-08T18:31:04.770 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.770 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.770 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:04.770 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.128817+0000", 2024-05-08T18:31:04.770 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5993000000000002e-05 2024-05-08T18:31:04.770 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.770 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.770 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:04.770 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.128883+0000", 2024-05-08T18:31:04.770 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6259000000000004e-05 2024-05-08T18:31:04.770 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:04.770 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:04.770 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:04.771 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.771 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.771 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:753 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:04.771 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.129809+0000", 2024-05-08T18:31:04.771 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 72.583717794999998, 2024-05-08T18:31:04.771 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0033775440000000001, 2024-05-08T18:31:04.771 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:04.771 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:04.771 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:04.771 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:04.771 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:04.771 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:04.771 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 753 2024-05-08T18:31:04.771 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.771 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:04.772 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.772 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:04.772 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129809+0000", 2024-05-08T18:31:04.772 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:04.772 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.772 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.772 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:04.772 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129809+0000", 2024-05-08T18:31:04.772 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:04.772 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.772 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.772 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:04.772 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129811+0000", 2024-05-08T18:31:04.772 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1730000000000002e-06 2024-05-08T18:31:04.773 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.773 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.773 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:04.773 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129822+0000", 2024-05-08T18:31:04.773 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0583e-05 2024-05-08T18:31:04.773 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.773 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.773 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:04.773 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129852+0000", 2024-05-08T18:31:04.773 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0744000000000002e-05 2024-05-08T18:31:04.773 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.773 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.773 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:04.773 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129870+0000", 2024-05-08T18:31:04.773 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7955999999999999e-05 2024-05-08T18:31:04.774 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.774 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.774 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:04.774 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.130018+0000", 2024-05-08T18:31:04.774 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014747600000000001 2024-05-08T18:31:04.774 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.774 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.774 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:04.774 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.130259+0000", 2024-05-08T18:31:04.774 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024079099999999999 2024-05-08T18:31:04.774 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.774 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.774 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:04.774 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.130734+0000", 2024-05-08T18:31:04.775 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00047562 2024-05-08T18:31:04.775 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.775 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.775 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:04.775 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.131997+0000", 2024-05-08T18:31:04.775 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012626429999999999 2024-05-08T18:31:04.775 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.775 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.775 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:04.775 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.132923+0000", 2024-05-08T18:31:04.775 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00092627599999999997 2024-05-08T18:31:04.775 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.775 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.775 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:04.775 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.133076+0000", 2024-05-08T18:31:04.776 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000152989 2024-05-08T18:31:04.776 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.776 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.776 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:04.776 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.133187+0000", 2024-05-08T18:31:04.776 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000110293 2024-05-08T18:31:04.776 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:04.776 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:04.776 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:04.776 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.776 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.776 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:04.776 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.228247+0000", 2024-05-08T18:31:04.776 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 72.485280184999993, 2024-05-08T18:31:04.776 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032753449999999998, 2024-05-08T18:31:04.777 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:04.777 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:04.777 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:04.777 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:04.777 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:04.777 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:04.777 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 796 2024-05-08T18:31:04.777 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.777 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:04.777 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.777 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:04.777 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228247+0000", 2024-05-08T18:31:04.777 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:04.777 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.777 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.778 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:04.778 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228247+0000", 2024-05-08T18:31:04.778 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:04.778 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.778 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.778 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:04.778 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228249+0000", 2024-05-08T18:31:04.778 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3800000000000001e-06 2024-05-08T18:31:04.778 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.778 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.778 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:04.778 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228260+0000", 2024-05-08T18:31:04.778 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1496e-05 2024-05-08T18:31:04.778 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.778 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.779 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:04.779 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228292+0000", 2024-05-08T18:31:04.779 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1294000000000002e-05 2024-05-08T18:31:04.779 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.779 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.779 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:04.779 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228306+0000", 2024-05-08T18:31:04.779 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4606e-05 2024-05-08T18:31:04.779 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.779 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.779 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:04.779 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228443+0000", 2024-05-08T18:31:04.779 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013672599999999999 2024-05-08T18:31:04.779 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.780 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.780 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:04.780 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228813+0000", 2024-05-08T18:31:04.780 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00036987000000000001 2024-05-08T18:31:04.780 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.780 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.780 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:31:04.780 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.229365+0000", 2024-05-08T18:31:04.780 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00055210600000000002 2024-05-08T18:31:04.780 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.780 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.780 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:04.780 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.230800+0000", 2024-05-08T18:31:04.780 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001435006 2024-05-08T18:31:04.780 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.781 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.781 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:04.781 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.231369+0000", 2024-05-08T18:31:04.781 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00056848499999999998 2024-05-08T18:31:04.781 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.781 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.781 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:04.781 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.231455+0000", 2024-05-08T18:31:04.781 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6905999999999998e-05 2024-05-08T18:31:04.781 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.781 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.781 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:04.781 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.231522+0000", 2024-05-08T18:31:04.781 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6470000000000006e-05 2024-05-08T18:31:04.782 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:04.782 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:04.782 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:04.782 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.782 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.782 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:798 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:04.782 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.232573+0000", 2024-05-08T18:31:04.782 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 72.480954077999996, 2024-05-08T18:31:04.782 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0030406690000000002, 2024-05-08T18:31:04.782 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:04.782 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:04.782 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:04.782 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:04.782 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:04.783 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:04.783 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 798 2024-05-08T18:31:04.783 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.783 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:04.783 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.783 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:04.783 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232573+0000", 2024-05-08T18:31:04.783 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:04.783 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.783 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.783 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:04.783 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232573+0000", 2024-05-08T18:31:04.783 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:04.783 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.784 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.784 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:04.784 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232574+0000", 2024-05-08T18:31:04.784 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.446e-06 2024-05-08T18:31:04.784 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.784 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.784 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:04.784 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232581+0000", 2024-05-08T18:31:04.784 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.0670000000000003e-06 2024-05-08T18:31:04.784 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.784 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.784 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:04.784 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232600+0000", 2024-05-08T18:31:04.784 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8822999999999999e-05 2024-05-08T18:31:04.785 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.785 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.785 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:04.785 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232611+0000", 2024-05-08T18:31:04.785 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1233000000000001e-05 2024-05-08T18:31:04.785 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.785 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.785 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:04.785 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232731+0000", 2024-05-08T18:31:04.785 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000120189 2024-05-08T18:31:04.785 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.785 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.785 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:04.785 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232963+0000", 2024-05-08T18:31:04.786 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023111900000000001 2024-05-08T18:31:04.786 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.786 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.786 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:31:04.786 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.233441+0000", 2024-05-08T18:31:04.786 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00047866899999999998 2024-05-08T18:31:04.786 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.786 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.786 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:04.786 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.234542+0000", 2024-05-08T18:31:04.786 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001101245 2024-05-08T18:31:04.786 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.786 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.786 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:04.786 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.235349+0000", 2024-05-08T18:31:04.787 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000806567 2024-05-08T18:31:04.787 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.787 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.787 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:04.787 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.235498+0000", 2024-05-08T18:31:04.787 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014907200000000001 2024-05-08T18:31:04.787 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.787 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.787 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:04.787 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.235613+0000", 2024-05-08T18:31:04.787 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115239 2024-05-08T18:31:04.787 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:04.787 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:04.787 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:04.787 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.788 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.788 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:04.788 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.248596+0000", 2024-05-08T18:31:04.788 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 72.464930272000004, 2024-05-08T18:31:04.788 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002919984, 2024-05-08T18:31:04.788 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:04.788 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:04.788 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:04.788 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:04.788 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:04.788 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:04.788 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 805 2024-05-08T18:31:04.788 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.789 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:04.789 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.789 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:04.789 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248596+0000", 2024-05-08T18:31:04.789 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:04.789 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.789 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.789 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:04.789 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248596+0000", 2024-05-08T18:31:04.789 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:04.789 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.789 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.789 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:04.789 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248599+0000", 2024-05-08T18:31:04.790 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3630000000000001e-06 2024-05-08T18:31:04.790 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.790 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.790 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:04.790 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248610+0000", 2024-05-08T18:31:04.790 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1267000000000001e-05 2024-05-08T18:31:04.790 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.790 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.790 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:04.790 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248641+0000", 2024-05-08T18:31:04.790 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1309999999999997e-05 2024-05-08T18:31:04.790 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.790 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.790 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:04.791 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248656+0000", 2024-05-08T18:31:04.791 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4449e-05 2024-05-08T18:31:04.791 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.791 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.791 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:04.791 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248781+0000", 2024-05-08T18:31:04.791 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012500900000000001 2024-05-08T18:31:04.791 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.791 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.791 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:04.791 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.249001+0000", 2024-05-08T18:31:04.791 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021963500000000001 2024-05-08T18:31:04.791 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.791 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.792 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:04.792 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.249341+0000", 2024-05-08T18:31:04.792 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00034004100000000002 2024-05-08T18:31:04.792 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.792 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.792 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:04.792 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.250473+0000", 2024-05-08T18:31:04.792 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0011324180000000001 2024-05-08T18:31:04.792 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.792 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.792 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:04.792 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.251230+0000", 2024-05-08T18:31:04.792 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00075751400000000004 2024-05-08T18:31:04.792 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.792 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.793 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:04.793 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.251394+0000", 2024-05-08T18:31:04.793 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016379200000000001 2024-05-08T18:31:04.793 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.793 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.793 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:04.793 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.251516+0000", 2024-05-08T18:31:04.793 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012218600000000001 2024-05-08T18:31:04.793 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:04.793 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:04.793 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:04.793 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.793 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.793 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:04.794 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.313184+0000", 2024-05-08T18:31:04.794 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 72.400342597000005, 2024-05-08T18:31:04.794 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003040016, 2024-05-08T18:31:04.794 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:04.794 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:04.794 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:04.794 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:04.794 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:04.794 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:04.794 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 832 2024-05-08T18:31:04.794 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.794 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:04.794 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.794 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:04.795 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313184+0000", 2024-05-08T18:31:04.795 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:04.795 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.795 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.795 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:04.795 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313184+0000", 2024-05-08T18:31:04.795 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:04.795 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.795 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.795 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:04.795 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313187+0000", 2024-05-08T18:31:04.795 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5100000000000001e-06 2024-05-08T18:31:04.795 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.795 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.796 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:04.796 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313199+0000", 2024-05-08T18:31:04.796 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.201e-05 2024-05-08T18:31:04.796 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.796 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.796 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:04.796 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313229+0000", 2024-05-08T18:31:04.796 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9839e-05 2024-05-08T18:31:04.796 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.796 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.796 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:04.796 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313243+0000", 2024-05-08T18:31:04.796 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4727e-05 2024-05-08T18:31:04.796 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.797 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.797 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:04.797 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313358+0000", 2024-05-08T18:31:04.797 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115016 2024-05-08T18:31:04.797 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.797 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.797 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:04.797 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313577+0000", 2024-05-08T18:31:04.797 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021897799999999999 2024-05-08T18:31:04.797 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.797 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.797 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:31:04.797 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313889+0000", 2024-05-08T18:31:04.797 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00031210400000000001 2024-05-08T18:31:04.798 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.798 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.798 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:04.798 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.315229+0000", 2024-05-08T18:31:04.798 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001339963 2024-05-08T18:31:04.798 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.798 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.798 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:04.798 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.315938+0000", 2024-05-08T18:31:04.798 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00070853400000000003 2024-05-08T18:31:04.798 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.798 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.798 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:04.798 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.316111+0000", 2024-05-08T18:31:04.799 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000173396 2024-05-08T18:31:04.799 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.799 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.799 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:04.799 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.316224+0000", 2024-05-08T18:31:04.799 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000112939 2024-05-08T18:31:04.799 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:04.799 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:04.799 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:04.799 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.799 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.799 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:834 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:04.799 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.317499+0000", 2024-05-08T18:31:04.799 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 72.396027798000006, 2024-05-08T18:31:04.800 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0033281109999999999, 2024-05-08T18:31:04.800 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:04.800 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:04.800 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:04.800 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:04.800 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:04.800 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:04.800 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 834 2024-05-08T18:31:04.800 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.800 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:04.800 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.800 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:04.800 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317499+0000", 2024-05-08T18:31:04.800 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:04.800 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.801 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.801 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:04.801 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317499+0000", 2024-05-08T18:31:04.801 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:04.801 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.801 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.801 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:04.801 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317501+0000", 2024-05-08T18:31:04.801 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9400000000000001e-06 2024-05-08T18:31:04.801 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.801 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.801 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:04.801 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317511+0000", 2024-05-08T18:31:04.801 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0297e-05 2024-05-08T18:31:04.802 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.802 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.802 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:04.802 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317532+0000", 2024-05-08T18:31:04.802 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1013e-05 2024-05-08T18:31:04.802 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.802 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.802 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:04.802 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317543+0000", 2024-05-08T18:31:04.802 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0757000000000001e-05 2024-05-08T18:31:04.802 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.802 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.802 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:04.802 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317658+0000", 2024-05-08T18:31:04.802 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115129 2024-05-08T18:31:04.803 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.803 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.803 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:04.803 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317887+0000", 2024-05-08T18:31:04.803 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00022880099999999999 2024-05-08T18:31:04.803 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.803 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.803 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:31:04.803 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.318378+0000", 2024-05-08T18:31:04.803 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00049129000000000002 2024-05-08T18:31:04.803 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.803 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.803 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:04.803 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.319597+0000", 2024-05-08T18:31:04.804 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012188469999999999 2024-05-08T18:31:04.804 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.804 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.804 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:04.804 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.320566+0000", 2024-05-08T18:31:04.804 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00096881599999999995 2024-05-08T18:31:04.804 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.804 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.804 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:04.804 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.320713+0000", 2024-05-08T18:31:04.804 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014691500000000001 2024-05-08T18:31:04.804 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.804 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.804 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:04.805 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.320827+0000", 2024-05-08T18:31:04.805 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000114306 2024-05-08T18:31:04.805 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:04.805 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:04.805 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:04.805 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.805 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.805 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:04.805 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.505569+0000", 2024-05-08T18:31:04.805 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 72.207957344999997, 2024-05-08T18:31:04.805 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028584309999999998, 2024-05-08T18:31:04.805 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:04.805 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:04.805 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:04.806 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:04.806 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:04.806 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:04.806 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 916 2024-05-08T18:31:04.806 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.806 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:04.806 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.806 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:04.806 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505569+0000", 2024-05-08T18:31:04.806 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:04.806 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.806 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.806 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:04.807 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505569+0000", 2024-05-08T18:31:04.807 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:04.807 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.807 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.807 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:04.807 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505572+0000", 2024-05-08T18:31:04.807 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3659999999999999e-06 2024-05-08T18:31:04.807 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.807 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.807 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:04.807 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505583+0000", 2024-05-08T18:31:04.807 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1574e-05 2024-05-08T18:31:04.807 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.807 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.807 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:04.808 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505614+0000", 2024-05-08T18:31:04.808 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0670000000000003e-05 2024-05-08T18:31:04.808 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.808 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.808 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:04.808 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505629+0000", 2024-05-08T18:31:04.808 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5063e-05 2024-05-08T18:31:04.808 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.808 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.808 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:04.808 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505754+0000", 2024-05-08T18:31:04.808 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012508899999999999 2024-05-08T18:31:04.808 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.808 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.809 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:04.809 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505988+0000", 2024-05-08T18:31:04.809 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023334699999999999 2024-05-08T18:31:04.809 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.809 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.809 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:04.809 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.506299+0000", 2024-05-08T18:31:04.809 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000311811 2024-05-08T18:31:04.809 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.809 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.809 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:04.809 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.507489+0000", 2024-05-08T18:31:04.809 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0011899510000000001 2024-05-08T18:31:04.809 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.809 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.810 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:04.810 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.508141+0000", 2024-05-08T18:31:04.810 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00065180200000000005 2024-05-08T18:31:04.810 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.810 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.810 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:04.810 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.508306+0000", 2024-05-08T18:31:04.810 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016450199999999999 2024-05-08T18:31:04.810 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.810 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.810 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:04.810 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.508428+0000", 2024-05-08T18:31:04.810 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000122256 2024-05-08T18:31:04.810 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:04.811 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:04.811 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:04.811 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.811 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.811 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:918 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:04.811 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.509337+0000", 2024-05-08T18:31:04.811 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 72.204189278000001, 2024-05-08T18:31:04.811 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002971787, 2024-05-08T18:31:04.811 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:04.811 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:04.811 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:04.811 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:04.811 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:04.811 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:04.812 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 918 2024-05-08T18:31:04.812 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.812 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:04.812 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.812 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:04.812 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509337+0000", 2024-05-08T18:31:04.812 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:04.812 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.812 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.812 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:04.812 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509337+0000", 2024-05-08T18:31:04.812 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:04.812 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.812 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.813 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:04.813 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509340+0000", 2024-05-08T18:31:04.813 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2570000000000002e-06 2024-05-08T18:31:04.813 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.813 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.813 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:04.813 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509351+0000", 2024-05-08T18:31:04.813 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0933e-05 2024-05-08T18:31:04.813 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.813 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.813 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:04.813 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509382+0000", 2024-05-08T18:31:04.813 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1198999999999997e-05 2024-05-08T18:31:04.813 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.813 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.814 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:04.814 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509400+0000", 2024-05-08T18:31:04.814 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8236999999999998e-05 2024-05-08T18:31:04.814 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.814 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.814 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:04.814 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509529+0000", 2024-05-08T18:31:04.814 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012905600000000001 2024-05-08T18:31:04.814 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.814 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.814 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:04.814 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509777+0000", 2024-05-08T18:31:04.814 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024786799999999999 2024-05-08T18:31:04.814 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.815 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.815 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:04.815 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.510284+0000", 2024-05-08T18:31:04.815 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000506796 2024-05-08T18:31:04.815 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.815 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.815 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:04.815 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.511453+0000", 2024-05-08T18:31:04.815 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001169575 2024-05-08T18:31:04.815 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.815 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.815 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:04.815 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.512051+0000", 2024-05-08T18:31:04.815 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00059743100000000005 2024-05-08T18:31:04.816 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.816 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.816 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:04.816 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.512199+0000", 2024-05-08T18:31:04.816 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000148486 2024-05-08T18:31:04.816 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.816 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.816 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:04.816 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.512309+0000", 2024-05-08T18:31:04.816 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000109949 2024-05-08T18:31:04.816 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:04.816 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:04.816 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:04.816 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.817 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.817 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:931 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:04.817 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.543277+0000", 2024-05-08T18:31:04.817 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 72.170250123000002, 2024-05-08T18:31:04.817 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028250710000000002, 2024-05-08T18:31:04.817 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:04.817 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:04.817 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:04.817 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:04.817 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:04.817 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:04.817 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 931 2024-05-08T18:31:04.817 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.817 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:04.817 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.818 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:04.818 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543277+0000", 2024-05-08T18:31:04.818 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:04.818 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.818 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.818 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:04.818 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543277+0000", 2024-05-08T18:31:04.818 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:04.818 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.818 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.818 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:04.818 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543279+0000", 2024-05-08T18:31:04.818 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.373e-06 2024-05-08T18:31:04.818 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.819 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.819 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:04.819 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543291+0000", 2024-05-08T18:31:04.819 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1517e-05 2024-05-08T18:31:04.819 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.819 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.819 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:04.819 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543323+0000", 2024-05-08T18:31:04.819 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2292000000000002e-05 2024-05-08T18:31:04.819 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.819 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.819 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:04.819 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543340+0000", 2024-05-08T18:31:04.819 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.749e-05 2024-05-08T18:31:04.819 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.820 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.820 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:04.820 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543462+0000", 2024-05-08T18:31:04.820 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000121413 2024-05-08T18:31:04.820 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.820 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.820 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:04.820 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543681+0000", 2024-05-08T18:31:04.820 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021974200000000001 2024-05-08T18:31:04.820 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.820 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.820 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:31:04.820 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.544004+0000", 2024-05-08T18:31:04.821 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00032268900000000003 2024-05-08T18:31:04.821 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.821 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.821 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:04.821 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.545158+0000", 2024-05-08T18:31:04.821 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0011540190000000001 2024-05-08T18:31:04.821 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.821 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.821 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:04.821 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.545970+0000", 2024-05-08T18:31:04.821 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00081224300000000004 2024-05-08T18:31:04.821 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.821 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.821 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:04.821 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.546043+0000", 2024-05-08T18:31:04.822 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.3067999999999999e-05 2024-05-08T18:31:04.822 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.822 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.822 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:04.822 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.546102+0000", 2024-05-08T18:31:04.822 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8224999999999999e-05 2024-05-08T18:31:04.822 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:04.822 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:04.822 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:04.822 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.822 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.822 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:04.822 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.578568+0000", 2024-05-08T18:31:04.823 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 72.134959215999999, 2024-05-08T18:31:04.823 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0030345839999999999, 2024-05-08T18:31:04.823 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:04.823 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:04.823 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:04.823 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:04.823 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:04.823 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:04.823 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 946 2024-05-08T18:31:04.823 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.823 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:04.823 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.823 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:04.823 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578568+0000", 2024-05-08T18:31:04.823 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:04.824 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.824 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.824 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:04.824 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578568+0000", 2024-05-08T18:31:04.824 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:04.824 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.824 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.824 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:04.824 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578570+0000", 2024-05-08T18:31:04.824 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3700000000000002e-06 2024-05-08T18:31:04.824 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.824 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.824 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:04.824 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578582+0000", 2024-05-08T18:31:04.825 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1627000000000001e-05 2024-05-08T18:31:04.825 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.825 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.825 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:04.825 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578612+0000", 2024-05-08T18:31:04.825 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0103e-05 2024-05-08T18:31:04.825 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.825 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.825 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:04.825 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578627+0000", 2024-05-08T18:31:04.825 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4949999999999999e-05 2024-05-08T18:31:04.825 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.825 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.825 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:04.825 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578750+0000", 2024-05-08T18:31:04.826 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012309899999999999 2024-05-08T18:31:04.826 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.826 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.826 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:04.826 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.579042+0000", 2024-05-08T18:31:04.826 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00029212500000000001 2024-05-08T18:31:04.826 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.826 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.826 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:04.826 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.579557+0000", 2024-05-08T18:31:04.826 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00051536900000000001 2024-05-08T18:31:04.826 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.826 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.826 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:04.827 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.580698+0000", 2024-05-08T18:31:04.827 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001140774 2024-05-08T18:31:04.827 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.827 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.827 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:04.827 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.581367+0000", 2024-05-08T18:31:04.827 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00066884799999999999 2024-05-08T18:31:04.827 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.827 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.827 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:04.827 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.581489+0000", 2024-05-08T18:31:04.827 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012265600000000001 2024-05-08T18:31:04.827 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:04.827 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:04.827 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:04.828 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.581602+0000", 2024-05-08T18:31:04.828 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000112663 2024-05-08T18:31:04.828 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:04.828 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:04.828 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:04.828 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:04.828 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:04.828 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:04.830 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-08T18:31:04.830 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:31:04.827+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:31:04.899 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-08T18:31:04.959 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:31:04.959+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:31:05.018 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:05.018 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:31:05.018 INFO:teuthology.orchestra.run.smithi097.stdout: "num_ops": 0 2024-05-08T18:31:05.018 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:05.031 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:31:05.031+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:31:05.034 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-08T18:31:05.070 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2024-05-08T18:31:05.071 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:31:05.100 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2024-05-08T18:31:05.101 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:31:05.117 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2024-05-08T18:31:05.117 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:31:05.132 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:31:05.131+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:31:05.134 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2024-05-08T18:31:05.135 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:31:05.167 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2024-05-08T18:31:05.168 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:31:05.200 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2024-05-08T18:31:05.200 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:31:05.219 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:05.219 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:05.232 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2024-05-08T18:31:05.232 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:31:05.233 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:31:05.231+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:31:05.235 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-08T18:31:05.254 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2024-05-08T18:31:05.255 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:31:05.334 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:31:05.331+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:31:05.387 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:05.388 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:05.405 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-08T18:31:05.451 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:31:05.451+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:31:05.515 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:05.515 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:05.529 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-08T18:31:05.571 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:31:05.571+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:31:05.636 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:31:05.635+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:31:05.683 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-08T18:31:05.705 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:05.705 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:05.725 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-08T18:31:05.737 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:31:05.735+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:31:05.838 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:31:05.835+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:31:05.929 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:05.929 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:05.939 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:31:05.939+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:31:05.947 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-08T18:31:06.040 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:31:06.035+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:31:06.078 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:06.078 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:06.091 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-08T18:31:06.177 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:31:06.175+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:31:06.241 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:31:06.239+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:31:06.257 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:06.257 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:06.272 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-08T18:31:06.343 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:31:06.343+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:31:06.437 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:06.438 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:06.443 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:31:06.443+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:31:06.452 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-08T18:31:06.544 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:31:06.543+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:31:06.576 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:06.576 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:06.591 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-08T18:31:06.645 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:31:06.643+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:31:06.676 INFO:teuthology.orchestra.run.smithi097.stderr:noscrub is unset 2024-05-08T18:31:06.715 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:06.716 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:06.729 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-08T18:31:06.773 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:31:06.771+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:31:06.847 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:31:06.847+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:31:06.899 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:06.899 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:06.913 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-08T18:31:06.961 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:31:06.959+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:31:07.035 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:07.035 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:07.050 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-08T18:31:07.051 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:31:07.047+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:31:07.150 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:31:07.147+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:31:07.214 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:07.215 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:07.228 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-08T18:31:07.273 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:31:07.271+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:31:07.277 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-08T18:31:07.351 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:31:07.351+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:31:07.398 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:07.398 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:07.412 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-08T18:31:07.427 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2024-05-08T18:31:07.428 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:31:07.445 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2024-05-08T18:31:07.446 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:31:07.457 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:31:07.455+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:31:07.465 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2024-05-08T18:31:07.465 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:31:07.482 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2024-05-08T18:31:07.482 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:31:07.499 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2024-05-08T18:31:07.499 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:31:07.530 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2024-05-08T18:31:07.530 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:31:07.531 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:07.531 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:07.546 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-08T18:31:07.557 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2024-05-08T18:31:07.557 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:31:07.577 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2024-05-08T18:31:07.577 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:31:07.589 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:31:07.587+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:31:07.654 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:31:07.651+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:31:07.706 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:31:07.707 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:31:07.707 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2024-05-08T18:31:07.707 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2024-05-08T18:31:07.707 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:31:07.721 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-08T18:31:07.756 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:31:07.755+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:31:07.847 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:31:07.847 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2024-05-08T18:31:07.847 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2024-05-08T18:31:07.847 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-05-08T18:31:07.847 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.847 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:24 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [write 262144~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:07.847 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.154193+0000", 2024-05-08T18:31:07.847 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 100.689958412, 2024-05-08T18:31:07.847 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0085494309999999997, 2024-05-08T18:31:07.848 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:07.848 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:07.848 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:07.848 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:07.848 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:07.848 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:07.848 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 24 2024-05-08T18:31:07.848 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.848 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:07.848 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.848 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:07.848 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154193+0000", 2024-05-08T18:31:07.848 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:07.849 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.849 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.849 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:07.849 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154193+0000", 2024-05-08T18:31:07.849 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:07.849 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.849 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.849 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:07.849 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154194+0000", 2024-05-08T18:31:07.849 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.44e-06 2024-05-08T18:31:07.849 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.849 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.849 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:07.849 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154394+0000", 2024-05-08T18:31:07.850 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00019972499999999999 2024-05-08T18:31:07.850 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.850 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.850 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:07.850 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154417+0000", 2024-05-08T18:31:07.850 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2713000000000001e-05 2024-05-08T18:31:07.850 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.850 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.850 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:07.850 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154437+0000", 2024-05-08T18:31:07.850 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0027e-05 2024-05-08T18:31:07.850 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.850 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.851 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:07.851 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.158438+0000", 2024-05-08T18:31:07.851 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0040011459999999997 2024-05-08T18:31:07.851 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.851 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.851 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:07.851 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.158567+0000", 2024-05-08T18:31:07.851 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012923899999999999 2024-05-08T18:31:07.851 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.851 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.851 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:07.851 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.158787+0000", 2024-05-08T18:31:07.851 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000219581 2024-05-08T18:31:07.852 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.852 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.852 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:07.852 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.162013+0000", 2024-05-08T18:31:07.852 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032261759999999999 2024-05-08T18:31:07.852 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.852 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.852 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:07.852 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.162568+0000", 2024-05-08T18:31:07.852 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00055576900000000001 2024-05-08T18:31:07.852 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.852 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.852 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:07.853 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.162644+0000", 2024-05-08T18:31:07.853 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5516e-05 2024-05-08T18:31:07.853 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.853 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.853 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:07.853 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.162742+0000", 2024-05-08T18:31:07.853 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8098999999999997e-05 2024-05-08T18:31:07.853 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:07.853 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:07.853 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:07.853 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.853 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.853 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:25 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:07.853 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.154495+0000", 2024-05-08T18:31:07.854 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 100.689656118, 2024-05-08T18:31:07.854 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010784396999999999, 2024-05-08T18:31:07.854 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:07.854 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:07.854 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:07.854 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:07.854 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:07.854 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:07.854 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 25 2024-05-08T18:31:07.854 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.854 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:07.854 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.855 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:07.855 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154495+0000", 2024-05-08T18:31:07.855 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:07.855 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.855 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.855 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:07.855 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154495+0000", 2024-05-08T18:31:07.855 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:07.855 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.855 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.855 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:07.855 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154496+0000", 2024-05-08T18:31:07.855 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.454e-06 2024-05-08T18:31:07.855 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.856 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.856 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:07.856 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154509+0000", 2024-05-08T18:31:07.856 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2496e-05 2024-05-08T18:31:07.856 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.856 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.856 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:07.856 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154531+0000", 2024-05-08T18:31:07.856 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1987000000000001e-05 2024-05-08T18:31:07.856 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.856 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.856 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:07.856 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154547+0000", 2024-05-08T18:31:07.856 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.577e-05 2024-05-08T18:31:07.857 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.857 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.857 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:07.857 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.160949+0000", 2024-05-08T18:31:07.857 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.006401917 2024-05-08T18:31:07.857 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.857 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.857 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:07.857 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.161102+0000", 2024-05-08T18:31:07.857 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000153826 2024-05-08T18:31:07.857 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.857 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.857 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:07.858 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.161332+0000", 2024-05-08T18:31:07.858 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022918099999999999 2024-05-08T18:31:07.858 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.858 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.858 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:07.858 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.163838+0000", 2024-05-08T18:31:07.858 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0025064079999999999 2024-05-08T18:31:07.858 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.858 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.858 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:07.858 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.165121+0000", 2024-05-08T18:31:07.858 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0012825200000000001 2024-05-08T18:31:07.858 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.859 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.859 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:07.859 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.165212+0000", 2024-05-08T18:31:07.859 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1121999999999999e-05 2024-05-08T18:31:07.859 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.859 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.859 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:07.859 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.165279+0000", 2024-05-08T18:31:07.859 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7716e-05 2024-05-08T18:31:07.859 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:07.859 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:07.859 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:07.859 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.859 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.860 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:41 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:07.860 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247174+0000", 2024-05-08T18:31:07.860 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 100.59697713600001, 2024-05-08T18:31:07.860 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010013393000000001, 2024-05-08T18:31:07.860 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:07.860 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:07.860 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:07.860 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:07.860 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:07.860 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:07.860 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 41 2024-05-08T18:31:07.860 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.860 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:07.861 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.861 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:07.861 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247174+0000", 2024-05-08T18:31:07.861 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:07.861 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.861 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.861 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:07.861 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247174+0000", 2024-05-08T18:31:07.861 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:07.861 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.861 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.861 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:07.861 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247175+0000", 2024-05-08T18:31:07.862 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.9999999999999995e-07 2024-05-08T18:31:07.862 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.862 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.862 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:07.862 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247277+0000", 2024-05-08T18:31:07.862 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010243600000000001 2024-05-08T18:31:07.862 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.862 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.862 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:07.862 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247291+0000", 2024-05-08T18:31:07.862 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4076999999999999e-05 2024-05-08T18:31:07.862 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.862 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.863 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:07.863 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247301+0000", 2024-05-08T18:31:07.863 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0010000000000001e-05 2024-05-08T18:31:07.863 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.863 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.863 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:07.863 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.249555+0000", 2024-05-08T18:31:07.863 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0022539050000000001 2024-05-08T18:31:07.863 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.863 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.863 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:07.863 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.249700+0000", 2024-05-08T18:31:07.863 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014484599999999999 2024-05-08T18:31:07.863 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.864 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.864 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:07.864 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.249929+0000", 2024-05-08T18:31:07.864 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022904499999999999 2024-05-08T18:31:07.864 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.864 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.864 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:07.864 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.253695+0000", 2024-05-08T18:31:07.864 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0037656640000000002 2024-05-08T18:31:07.864 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.864 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.864 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:07.864 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.256970+0000", 2024-05-08T18:31:07.865 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003274608 2024-05-08T18:31:07.865 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.865 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.865 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:07.865 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.257052+0000", 2024-05-08T18:31:07.865 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2223000000000002e-05 2024-05-08T18:31:07.865 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.865 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.865 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:07.865 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.257187+0000", 2024-05-08T18:31:07.865 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013557900000000001 2024-05-08T18:31:07.865 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:07.865 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:07.865 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:07.866 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.866 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.866 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:42 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:07.866 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247321+0000", 2024-05-08T18:31:07.866 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 100.596829817, 2024-05-08T18:31:07.866 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013168572, 2024-05-08T18:31:07.866 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:07.866 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:07.866 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:07.866 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:07.866 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:07.866 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:07.866 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 42 2024-05-08T18:31:07.867 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.867 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:07.867 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.867 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:07.867 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247321+0000", 2024-05-08T18:31:07.867 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:07.867 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.867 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.867 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:07.867 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247321+0000", 2024-05-08T18:31:07.867 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:07.867 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.867 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.867 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:07.868 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247323+0000", 2024-05-08T18:31:07.868 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.24e-06 2024-05-08T18:31:07.868 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.868 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.868 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:07.868 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247329+0000", 2024-05-08T18:31:07.868 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1530000000000002e-06 2024-05-08T18:31:07.868 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.868 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.868 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:07.868 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247339+0000", 2024-05-08T18:31:07.868 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0387000000000001e-05 2024-05-08T18:31:07.868 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.869 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.869 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:07.869 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247347+0000", 2024-05-08T18:31:07.869 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9829999999999996e-06 2024-05-08T18:31:07.869 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.869 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.869 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:07.869 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.251488+0000", 2024-05-08T18:31:07.869 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0041412849999999998 2024-05-08T18:31:07.869 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.869 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.869 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:07.869 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.251672+0000", 2024-05-08T18:31:07.869 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00018354499999999999 2024-05-08T18:31:07.870 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.870 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.870 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:07.870 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.251949+0000", 2024-05-08T18:31:07.870 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00027695399999999999 2024-05-08T18:31:07.870 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.870 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.870 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:07.870 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.253810+0000", 2024-05-08T18:31:07.870 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001860806 2024-05-08T18:31:07.870 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.870 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.871 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:07.871 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260244+0000", 2024-05-08T18:31:07.871 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0064347939999999998 2024-05-08T18:31:07.871 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.871 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.871 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:07.871 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260376+0000", 2024-05-08T18:31:07.871 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000131829 2024-05-08T18:31:07.871 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.871 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.871 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:07.871 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260490+0000", 2024-05-08T18:31:07.871 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000113596 2024-05-08T18:31:07.871 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:07.871 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:07.872 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:07.872 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.872 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.872 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:43 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:07.872 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247367+0000", 2024-05-08T18:31:07.872 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 100.59678390400001, 2024-05-08T18:31:07.872 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013449025999999999, 2024-05-08T18:31:07.872 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:07.872 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:07.872 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:07.872 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:07.872 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:07.872 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:07.872 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 43 2024-05-08T18:31:07.872 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.873 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:07.873 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.873 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:07.873 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247367+0000", 2024-05-08T18:31:07.873 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:07.873 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.873 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.873 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:07.873 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247367+0000", 2024-05-08T18:31:07.873 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:07.873 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.873 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.873 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:07.873 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247368+0000", 2024-05-08T18:31:07.874 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1999999999999999e-07 2024-05-08T18:31:07.874 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.874 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.874 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:07.874 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247374+0000", 2024-05-08T18:31:07.874 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.19e-06 2024-05-08T18:31:07.874 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.874 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.874 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:07.874 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247384+0000", 2024-05-08T18:31:07.874 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0173000000000001e-05 2024-05-08T18:31:07.874 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.874 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.875 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:07.875 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247392+0000", 2024-05-08T18:31:07.875 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1869999999999997e-06 2024-05-08T18:31:07.875 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.875 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.875 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:07.875 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.252515+0000", 2024-05-08T18:31:07.875 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0051221399999999999 2024-05-08T18:31:07.875 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.875 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.875 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:07.875 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.252641+0000", 2024-05-08T18:31:07.875 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012609200000000001 2024-05-08T18:31:07.876 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.876 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.876 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:07.876 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.252842+0000", 2024-05-08T18:31:07.876 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000201619 2024-05-08T18:31:07.876 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.876 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.876 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:07.876 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.256828+0000", 2024-05-08T18:31:07.876 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039853989999999997 2024-05-08T18:31:07.876 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.876 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.876 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:07.877 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260515+0000", 2024-05-08T18:31:07.877 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0036875419999999998 2024-05-08T18:31:07.877 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.877 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.877 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:07.877 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260718+0000", 2024-05-08T18:31:07.877 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020229499999999999 2024-05-08T18:31:07.877 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.877 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.877 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:07.877 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260816+0000", 2024-05-08T18:31:07.877 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8669e-05 2024-05-08T18:31:07.877 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:07.878 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:07.878 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:07.878 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.878 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.878 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:07.878 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247466+0000", 2024-05-08T18:31:07.878 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 100.596685318, 2024-05-08T18:31:07.878 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013491806, 2024-05-08T18:31:07.878 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:07.878 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:07.878 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:07.878 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:07.878 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:07.879 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:07.879 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 44 2024-05-08T18:31:07.879 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.879 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:07.879 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.879 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:07.879 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247466+0000", 2024-05-08T18:31:07.879 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:07.879 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.879 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.879 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:07.879 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247466+0000", 2024-05-08T18:31:07.879 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:07.879 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.880 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.880 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:07.880 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247467+0000", 2024-05-08T18:31:07.880 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.263e-06 2024-05-08T18:31:07.880 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.880 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.880 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:07.880 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247585+0000", 2024-05-08T18:31:07.880 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011756600000000001 2024-05-08T18:31:07.880 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.880 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.880 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:07.880 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247598+0000", 2024-05-08T18:31:07.880 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3766e-05 2024-05-08T18:31:07.881 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.881 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.881 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:07.881 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247609+0000", 2024-05-08T18:31:07.881 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0604e-05 2024-05-08T18:31:07.881 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.881 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.881 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:07.881 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.253890+0000", 2024-05-08T18:31:07.881 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0062810440000000004 2024-05-08T18:31:07.881 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.881 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.881 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:07.882 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.254068+0000", 2024-05-08T18:31:07.882 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017848199999999999 2024-05-08T18:31:07.882 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.882 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.882 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:07.882 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.254488+0000", 2024-05-08T18:31:07.882 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00041965399999999999 2024-05-08T18:31:07.882 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.882 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.882 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:07.882 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.256949+0000", 2024-05-08T18:31:07.882 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002461254 2024-05-08T18:31:07.882 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.882 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.883 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:07.883 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260832+0000", 2024-05-08T18:31:07.883 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0038830539999999999 2024-05-08T18:31:07.883 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.883 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.883 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:07.883 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260906+0000", 2024-05-08T18:31:07.883 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3455999999999996e-05 2024-05-08T18:31:07.883 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.883 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.883 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:07.883 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260958+0000", 2024-05-08T18:31:07.883 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1663000000000003e-05 2024-05-08T18:31:07.883 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:07.884 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:07.884 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:07.884 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.884 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.884 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:07.884 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247630+0000", 2024-05-08T18:31:07.884 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 100.59652091300001, 2024-05-08T18:31:07.884 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013478753, 2024-05-08T18:31:07.884 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:07.884 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:07.884 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:07.884 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:07.884 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:07.884 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:07.885 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 45 2024-05-08T18:31:07.885 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.885 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:07.886 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.886 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:07.886 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247630+0000", 2024-05-08T18:31:07.886 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:07.886 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.886 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.886 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:07.887 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247630+0000", 2024-05-08T18:31:07.887 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:07.887 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.887 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.887 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:07.887 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247631+0000", 2024-05-08T18:31:07.887 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7399999999999991e-07 2024-05-08T18:31:07.888 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.888 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.888 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:07.888 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247637+0000", 2024-05-08T18:31:07.888 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.93e-06 2024-05-08T18:31:07.888 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.888 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.888 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:07.889 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247647+0000", 2024-05-08T18:31:07.889 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7459999999999995e-06 2024-05-08T18:31:07.889 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.889 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.889 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:07.889 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247654+0000", 2024-05-08T18:31:07.889 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4039999999999998e-06 2024-05-08T18:31:07.889 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.889 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.889 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:07.890 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.255829+0000", 2024-05-08T18:31:07.890 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0081749059999999991 2024-05-08T18:31:07.890 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.890 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.890 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:07.890 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.255979+0000", 2024-05-08T18:31:07.890 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015027899999999999 2024-05-08T18:31:07.890 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.890 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.890 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:07.890 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.256185+0000", 2024-05-08T18:31:07.891 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020583900000000001 2024-05-08T18:31:07.891 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.891 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.891 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:07.891 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260097+0000", 2024-05-08T18:31:07.891 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039121929999999996 2024-05-08T18:31:07.891 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.891 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.891 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:07.891 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260973+0000", 2024-05-08T18:31:07.891 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00087591999999999998 2024-05-08T18:31:07.892 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.892 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.892 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:07.892 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261056+0000", 2024-05-08T18:31:07.892 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3104999999999998e-05 2024-05-08T18:31:07.892 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.892 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.892 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:07.892 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261109+0000", 2024-05-08T18:31:07.892 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2457000000000003e-05 2024-05-08T18:31:07.892 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:07.893 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:07.893 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:07.893 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.893 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.893 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:07.893 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247667+0000", 2024-05-08T18:31:07.893 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 100.59648363300001, 2024-05-08T18:31:07.893 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013569098999999999, 2024-05-08T18:31:07.893 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:07.893 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:07.894 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:07.894 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:07.894 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:07.894 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:07.894 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 46 2024-05-08T18:31:07.894 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.894 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:07.894 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.894 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:07.895 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247667+0000", 2024-05-08T18:31:07.895 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:07.895 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.895 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.895 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:07.895 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247667+0000", 2024-05-08T18:31:07.895 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:07.895 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.895 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.895 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:07.895 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247668+0000", 2024-05-08T18:31:07.895 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7999999999999995e-07 2024-05-08T18:31:07.896 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.896 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.896 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:07.896 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247674+0000", 2024-05-08T18:31:07.896 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4369999999999998e-06 2024-05-08T18:31:07.896 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.896 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.896 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:07.896 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247683+0000", 2024-05-08T18:31:07.896 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4360000000000008e-06 2024-05-08T18:31:07.896 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.896 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.896 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:07.897 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247690+0000", 2024-05-08T18:31:07.897 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.43e-06 2024-05-08T18:31:07.897 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.897 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.897 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:07.897 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.257358+0000", 2024-05-08T18:31:07.897 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0096676890000000001 2024-05-08T18:31:07.897 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.897 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.897 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:07.897 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.257626+0000", 2024-05-08T18:31:07.897 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00026819099999999998 2024-05-08T18:31:07.898 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.898 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.898 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:07.898 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.258041+0000", 2024-05-08T18:31:07.898 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00041438400000000001 2024-05-08T18:31:07.898 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.898 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.898 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:07.898 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260224+0000", 2024-05-08T18:31:07.899 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0021830700000000001 2024-05-08T18:31:07.899 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.899 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.899 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:07.899 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261127+0000", 2024-05-08T18:31:07.899 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00090292300000000003 2024-05-08T18:31:07.899 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.899 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.899 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:07.899 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261191+0000", 2024-05-08T18:31:07.899 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4342000000000002e-05 2024-05-08T18:31:07.899 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.900 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.900 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:07.900 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261237+0000", 2024-05-08T18:31:07.900 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.5516999999999998e-05 2024-05-08T18:31:07.900 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:07.900 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:07.900 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:07.900 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.900 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.900 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:07.900 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247703+0000", 2024-05-08T18:31:07.900 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 100.59644815, 2024-05-08T18:31:07.900 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015020204000000001, 2024-05-08T18:31:07.901 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:07.901 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:07.901 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:07.901 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:07.901 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:07.901 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:07.901 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 47 2024-05-08T18:31:07.901 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.901 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:07.901 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.901 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:07.902 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247703+0000", 2024-05-08T18:31:07.902 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:07.902 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.902 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.902 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:07.902 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247703+0000", 2024-05-08T18:31:07.902 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:07.902 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.902 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.902 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:07.902 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247704+0000", 2024-05-08T18:31:07.903 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8299999999999996e-07 2024-05-08T18:31:07.903 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.903 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.903 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:07.903 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247877+0000", 2024-05-08T18:31:07.903 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000172979 2024-05-08T18:31:07.903 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.903 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.903 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:07.903 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247894+0000", 2024-05-08T18:31:07.903 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6912999999999999e-05 2024-05-08T18:31:07.903 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.903 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.904 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:07.904 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247903+0000", 2024-05-08T18:31:07.904 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1770000000000004e-06 2024-05-08T18:31:07.904 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.904 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.904 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:07.904 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.258767+0000", 2024-05-08T18:31:07.904 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010864409 2024-05-08T18:31:07.904 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.905 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.905 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:07.905 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.258898+0000", 2024-05-08T18:31:07.905 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000131199 2024-05-08T18:31:07.905 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.905 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.905 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:07.905 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.259117+0000", 2024-05-08T18:31:07.905 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000218889 2024-05-08T18:31:07.905 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.905 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.905 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:07.906 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.262372+0000", 2024-05-08T18:31:07.906 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032545679999999998 2024-05-08T18:31:07.906 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.906 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.906 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:07.906 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.262432+0000", 2024-05-08T18:31:07.906 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9913e-05 2024-05-08T18:31:07.906 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.906 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.906 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:07.906 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.262585+0000", 2024-05-08T18:31:07.906 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015361800000000001 2024-05-08T18:31:07.907 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.907 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.907 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:07.907 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.262723+0000", 2024-05-08T18:31:07.907 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000137856 2024-05-08T18:31:07.907 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:07.907 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:07.907 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:07.907 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.907 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.907 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:07.908 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247927+0000", 2024-05-08T18:31:07.908 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 100.596224112, 2024-05-08T18:31:07.908 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018387718000000001, 2024-05-08T18:31:07.908 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:07.908 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:07.908 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:07.908 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:07.908 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:07.908 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:07.908 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 48 2024-05-08T18:31:07.908 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.909 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:07.909 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.909 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:07.909 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247927+0000", 2024-05-08T18:31:07.909 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:07.909 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.909 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.909 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:07.909 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247927+0000", 2024-05-08T18:31:07.910 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:07.910 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.910 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.910 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:07.910 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247928+0000", 2024-05-08T18:31:07.910 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8400000000000003e-07 2024-05-08T18:31:07.910 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.910 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.910 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:07.910 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247935+0000", 2024-05-08T18:31:07.910 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1230000000000002e-06 2024-05-08T18:31:07.911 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.911 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.911 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:07.911 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247945+0000", 2024-05-08T18:31:07.911 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0346000000000001e-05 2024-05-08T18:31:07.911 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.911 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.911 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:07.911 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247953+0000", 2024-05-08T18:31:07.911 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8040000000000002e-06 2024-05-08T18:31:07.911 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.911 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.911 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:07.912 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261292+0000", 2024-05-08T18:31:07.912 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013339337 2024-05-08T18:31:07.912 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.912 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.912 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:07.912 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261424+0000", 2024-05-08T18:31:07.912 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013201900000000001 2024-05-08T18:31:07.912 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.912 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.912 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:07.912 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261628+0000", 2024-05-08T18:31:07.912 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020327499999999999 2024-05-08T18:31:07.912 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.912 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.913 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:07.913 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.263849+0000", 2024-05-08T18:31:07.913 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0022209759999999999 2024-05-08T18:31:07.913 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.913 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.913 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:07.913 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266167+0000", 2024-05-08T18:31:07.913 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002317979 2024-05-08T18:31:07.913 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.913 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.913 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:07.913 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266249+0000", 2024-05-08T18:31:07.914 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1996000000000006e-05 2024-05-08T18:31:07.914 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.914 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.914 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:07.914 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266315+0000", 2024-05-08T18:31:07.914 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5979e-05 2024-05-08T18:31:07.914 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:07.914 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:07.915 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:07.915 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.915 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.915 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:07.915 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247966+0000", 2024-05-08T18:31:07.915 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 100.596185179, 2024-05-08T18:31:07.915 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0194153, 2024-05-08T18:31:07.915 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:07.915 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:07.915 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:07.916 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:07.916 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:07.916 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:07.916 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 49 2024-05-08T18:31:07.916 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.916 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:07.916 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.916 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:07.916 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247966+0000", 2024-05-08T18:31:07.917 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:07.917 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.917 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.917 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:07.917 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247966+0000", 2024-05-08T18:31:07.917 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:07.917 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.917 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.917 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:07.917 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247967+0000", 2024-05-08T18:31:07.917 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0299999999999998e-07 2024-05-08T18:31:07.917 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.917 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.918 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:07.918 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247972+0000", 2024-05-08T18:31:07.918 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3600000000000004e-06 2024-05-08T18:31:07.918 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.918 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.918 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:07.918 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247981+0000", 2024-05-08T18:31:07.918 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.234e-06 2024-05-08T18:31:07.918 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.918 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.919 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:07.919 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247989+0000", 2024-05-08T18:31:07.919 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5159999999999997e-06 2024-05-08T18:31:07.919 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.919 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.919 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:07.919 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.262816+0000", 2024-05-08T18:31:07.919 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.014827399999999999 2024-05-08T18:31:07.919 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.919 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.920 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:07.920 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.262948+0000", 2024-05-08T18:31:07.920 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013166799999999999 2024-05-08T18:31:07.920 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.920 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.920 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:07.920 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.263153+0000", 2024-05-08T18:31:07.920 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000205272 2024-05-08T18:31:07.920 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.921 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.921 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:07.921 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266144+0000", 2024-05-08T18:31:07.921 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029912300000000001 2024-05-08T18:31:07.921 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.921 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.921 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:07.921 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.267226+0000", 2024-05-08T18:31:07.921 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010820580000000001 2024-05-08T18:31:07.921 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.921 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.921 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:07.921 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.267315+0000", 2024-05-08T18:31:07.922 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8793000000000002e-05 2024-05-08T18:31:07.922 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.922 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.922 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:07.922 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.267381+0000", 2024-05-08T18:31:07.922 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6066000000000001e-05 2024-05-08T18:31:07.922 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:07.922 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:07.922 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:07.922 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.922 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.922 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:07.923 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.248003+0000", 2024-05-08T18:31:07.923 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 100.596147879, 2024-05-08T18:31:07.923 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.020859638999999999, 2024-05-08T18:31:07.923 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:07.923 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:07.923 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:07.923 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:07.923 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:07.923 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:07.923 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 50 2024-05-08T18:31:07.923 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.923 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:07.924 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.924 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:07.924 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248003+0000", 2024-05-08T18:31:07.924 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:07.924 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.924 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.924 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:07.924 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248003+0000", 2024-05-08T18:31:07.924 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:07.924 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.924 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.924 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:07.924 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248004+0000", 2024-05-08T18:31:07.925 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5300000000000003e-07 2024-05-08T18:31:07.925 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.925 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.925 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:07.925 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248139+0000", 2024-05-08T18:31:07.925 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000135193 2024-05-08T18:31:07.925 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.925 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.925 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:07.925 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248151+0000", 2024-05-08T18:31:07.926 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.19e-05 2024-05-08T18:31:07.926 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.926 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.926 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:07.926 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248161+0000", 2024-05-08T18:31:07.926 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4599999999999992e-06 2024-05-08T18:31:07.926 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.926 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.926 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:07.926 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.263961+0000", 2024-05-08T18:31:07.926 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015800844000000001 2024-05-08T18:31:07.926 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.927 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.927 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:07.927 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.264091+0000", 2024-05-08T18:31:07.927 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012952300000000001 2024-05-08T18:31:07.927 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.927 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.927 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:07.927 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.264306+0000", 2024-05-08T18:31:07.927 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000215541 2024-05-08T18:31:07.927 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.927 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.928 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:07.928 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.267205+0000", 2024-05-08T18:31:07.928 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0028989910000000001 2024-05-08T18:31:07.928 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.928 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.928 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:07.928 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.268631+0000", 2024-05-08T18:31:07.928 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0014257320000000001 2024-05-08T18:31:07.928 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.928 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.928 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:07.928 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.268781+0000", 2024-05-08T18:31:07.928 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000149939 2024-05-08T18:31:07.928 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.929 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.929 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:07.929 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.268863+0000", 2024-05-08T18:31:07.929 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1762999999999996e-05 2024-05-08T18:31:07.929 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:07.929 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:07.929 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:07.929 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.929 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.929 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:07.929 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.248201+0000", 2024-05-08T18:31:07.929 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 100.595950124, 2024-05-08T18:31:07.929 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.022909783, 2024-05-08T18:31:07.929 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:07.930 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:07.930 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:07.930 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:07.930 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:07.930 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:07.930 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 51 2024-05-08T18:31:07.930 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.930 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:07.930 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.931 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:07.931 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248201+0000", 2024-05-08T18:31:07.931 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:07.931 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.931 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.931 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:07.931 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248201+0000", 2024-05-08T18:31:07.931 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:07.931 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.931 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.931 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:07.931 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248202+0000", 2024-05-08T18:31:07.932 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2999999999999999e-07 2024-05-08T18:31:07.932 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.932 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.932 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:07.932 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248209+0000", 2024-05-08T18:31:07.932 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5769999999999996e-06 2024-05-08T18:31:07.932 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.932 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.932 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:07.932 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248221+0000", 2024-05-08T18:31:07.932 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1165999999999999e-05 2024-05-08T18:31:07.932 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.933 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.933 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:07.933 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248229+0000", 2024-05-08T18:31:07.933 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1529999999999997e-06 2024-05-08T18:31:07.933 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.933 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.933 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:07.933 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.265146+0000", 2024-05-08T18:31:07.933 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016917492999999999 2024-05-08T18:31:07.933 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.933 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.933 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:07.934 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.265282+0000", 2024-05-08T18:31:07.934 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013597199999999999 2024-05-08T18:31:07.934 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.934 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.934 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:07.934 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.265488+0000", 2024-05-08T18:31:07.934 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000206212 2024-05-08T18:31:07.934 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.934 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.934 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:07.934 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.268442+0000", 2024-05-08T18:31:07.935 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002953841 2024-05-08T18:31:07.935 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.935 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.935 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:07.935 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.270951+0000", 2024-05-08T18:31:07.935 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0025085670000000002 2024-05-08T18:31:07.935 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.935 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.935 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:07.935 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.271042+0000", 2024-05-08T18:31:07.936 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1485999999999998e-05 2024-05-08T18:31:07.936 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.936 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.936 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:07.936 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.271111+0000", 2024-05-08T18:31:07.936 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8386000000000006e-05 2024-05-08T18:31:07.936 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:07.936 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:07.936 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:07.936 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.937 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.937 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:07.937 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.248244+0000", 2024-05-08T18:31:07.937 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 100.595907568, 2024-05-08T18:31:07.937 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.023010806000000002, 2024-05-08T18:31:07.937 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:07.937 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:07.937 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:07.937 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:07.937 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:07.937 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:07.937 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 52 2024-05-08T18:31:07.937 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.938 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:07.938 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.938 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:07.938 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248244+0000", 2024-05-08T18:31:07.938 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:07.938 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.938 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.938 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:07.938 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248244+0000", 2024-05-08T18:31:07.938 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:07.938 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.938 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.939 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:07.939 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248244+0000", 2024-05-08T18:31:07.939 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0999999999999998e-07 2024-05-08T18:31:07.939 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.939 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.939 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:07.939 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248251+0000", 2024-05-08T18:31:07.939 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9639999999999997e-06 2024-05-08T18:31:07.939 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.939 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.939 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:07.939 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248266+0000", 2024-05-08T18:31:07.940 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4996e-05 2024-05-08T18:31:07.940 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.940 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.940 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:07.940 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248274+0000", 2024-05-08T18:31:07.940 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8299999999999996e-06 2024-05-08T18:31:07.940 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.940 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.940 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:07.941 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266367+0000", 2024-05-08T18:31:07.941 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018092607 2024-05-08T18:31:07.941 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.941 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.941 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:07.941 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266532+0000", 2024-05-08T18:31:07.941 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016569600000000001 2024-05-08T18:31:07.941 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.941 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.941 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:07.942 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266729+0000", 2024-05-08T18:31:07.942 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00019630099999999999 2024-05-08T18:31:07.942 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.942 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.942 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:07.942 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.268574+0000", 2024-05-08T18:31:07.942 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0018452329999999999 2024-05-08T18:31:07.942 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.942 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.942 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:07.942 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.271128+0000", 2024-05-08T18:31:07.943 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00255369 2024-05-08T18:31:07.943 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.943 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.943 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:07.943 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.271199+0000", 2024-05-08T18:31:07.943 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1712999999999996e-05 2024-05-08T18:31:07.943 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.943 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.943 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:07.943 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.271254+0000", 2024-05-08T18:31:07.943 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5065999999999998e-05 2024-05-08T18:31:07.944 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:07.944 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:07.944 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:07.944 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.944 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.944 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:07.944 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.486052+0000", 2024-05-08T18:31:07.944 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 100.35809912400001, 2024-05-08T18:31:07.945 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0098898389999999992, 2024-05-08T18:31:07.945 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:07.945 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:07.945 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:07.945 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:07.945 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:07.945 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:07.945 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 72 2024-05-08T18:31:07.945 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.945 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:07.945 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.945 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:07.945 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486052+0000", 2024-05-08T18:31:07.946 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:07.946 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.946 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.946 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:07.946 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486052+0000", 2024-05-08T18:31:07.946 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:07.946 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.946 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.946 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:07.947 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486053+0000", 2024-05-08T18:31:07.947 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1200000000000001e-07 2024-05-08T18:31:07.947 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.947 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.947 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:07.947 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486188+0000", 2024-05-08T18:31:07.947 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013526200000000001 2024-05-08T18:31:07.947 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.947 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.947 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:07.947 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486205+0000", 2024-05-08T18:31:07.947 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6742e-05 2024-05-08T18:31:07.947 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.948 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.948 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:07.948 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486215+0000", 2024-05-08T18:31:07.948 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8290000000000003e-06 2024-05-08T18:31:07.948 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.948 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.948 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:07.948 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.491930+0000", 2024-05-08T18:31:07.948 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0057153660000000004 2024-05-08T18:31:07.948 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.948 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.948 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:07.949 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.491995+0000", 2024-05-08T18:31:07.949 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5289000000000005e-05 2024-05-08T18:31:07.949 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.949 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.949 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:07.949 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.492096+0000", 2024-05-08T18:31:07.949 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010101400000000001 2024-05-08T18:31:07.949 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.949 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.949 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:07.949 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.494152+0000", 2024-05-08T18:31:07.949 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0020560740000000002 2024-05-08T18:31:07.949 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.950 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.950 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:07.950 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.495860+0000", 2024-05-08T18:31:07.950 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0017076159999999999 2024-05-08T18:31:07.950 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.950 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.950 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:07.950 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.495903+0000", 2024-05-08T18:31:07.950 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3009000000000001e-05 2024-05-08T18:31:07.950 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.950 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.950 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:07.951 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.495942+0000", 2024-05-08T18:31:07.951 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8726000000000002e-05 2024-05-08T18:31:07.951 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:07.951 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:07.951 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:07.951 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.951 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.951 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:07.952 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.486234+0000", 2024-05-08T18:31:07.952 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 100.35791705600001, 2024-05-08T18:31:07.952 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0099742340000000002, 2024-05-08T18:31:07.952 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:07.952 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:07.952 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:07.952 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:07.952 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:07.952 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:07.952 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 73 2024-05-08T18:31:07.952 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.952 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:07.952 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.953 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:07.953 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486234+0000", 2024-05-08T18:31:07.953 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:07.953 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.953 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.953 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:07.953 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486234+0000", 2024-05-08T18:31:07.953 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:07.953 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.953 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.953 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:07.953 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486235+0000", 2024-05-08T18:31:07.954 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.108e-06 2024-05-08T18:31:07.954 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.954 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.954 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:07.954 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486241+0000", 2024-05-08T18:31:07.954 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4e-06 2024-05-08T18:31:07.954 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.954 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.954 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:07.954 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486251+0000", 2024-05-08T18:31:07.954 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0209e-05 2024-05-08T18:31:07.954 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.955 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.955 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:07.955 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486260+0000", 2024-05-08T18:31:07.955 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2709999999999998e-06 2024-05-08T18:31:07.955 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.955 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.955 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:07.955 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.493294+0000", 2024-05-08T18:31:07.955 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0070341070000000004 2024-05-08T18:31:07.955 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.955 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.955 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:07.955 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.493370+0000", 2024-05-08T18:31:07.956 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5846999999999994e-05 2024-05-08T18:31:07.956 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.956 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.956 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:07.956 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.493479+0000", 2024-05-08T18:31:07.956 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010905500000000001 2024-05-08T18:31:07.956 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.956 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.956 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:07.956 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.495950+0000", 2024-05-08T18:31:07.956 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0024709749999999998 2024-05-08T18:31:07.957 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.957 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.957 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:07.957 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496023+0000", 2024-05-08T18:31:07.957 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3071999999999994e-05 2024-05-08T18:31:07.957 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.957 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.957 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:07.957 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496091+0000", 2024-05-08T18:31:07.957 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7646999999999998e-05 2024-05-08T18:31:07.957 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.958 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.958 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:07.958 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496208+0000", 2024-05-08T18:31:07.958 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000117543 2024-05-08T18:31:07.958 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:07.958 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:07.958 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:07.958 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.958 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.958 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:07.958 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.486276+0000", 2024-05-08T18:31:07.958 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 100.357874731, 2024-05-08T18:31:07.959 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010822577, 2024-05-08T18:31:07.959 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:07.959 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:07.959 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:07.959 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:07.959 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:07.959 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:07.959 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 74 2024-05-08T18:31:07.959 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.959 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:07.959 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.959 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:07.960 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486276+0000", 2024-05-08T18:31:07.960 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:07.960 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.960 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.960 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:07.960 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486276+0000", 2024-05-08T18:31:07.960 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:07.960 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.960 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.961 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:07.961 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486277+0000", 2024-05-08T18:31:07.961 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1699999999999997e-07 2024-05-08T18:31:07.961 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.961 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.961 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:07.961 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486282+0000", 2024-05-08T18:31:07.961 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0429999999999998e-06 2024-05-08T18:31:07.961 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.962 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.962 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:07.962 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486294+0000", 2024-05-08T18:31:07.962 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1717e-05 2024-05-08T18:31:07.962 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.962 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.962 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:07.962 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486303+0000", 2024-05-08T18:31:07.962 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.3999999999999998e-06 2024-05-08T18:31:07.962 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.963 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.963 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:07.963 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.494424+0000", 2024-05-08T18:31:07.963 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0081205960000000008 2024-05-08T18:31:07.963 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.963 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.963 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:07.963 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.494539+0000", 2024-05-08T18:31:07.963 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000115661 2024-05-08T18:31:07.963 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.963 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.963 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:07.964 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.494704+0000", 2024-05-08T18:31:07.964 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016422999999999999 2024-05-08T18:31:07.964 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.964 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.964 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:07.964 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496800+0000", 2024-05-08T18:31:07.964 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002096508 2024-05-08T18:31:07.964 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.964 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.964 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:07.964 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496889+0000", 2024-05-08T18:31:07.964 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8349000000000004e-05 2024-05-08T18:31:07.964 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.964 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.965 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:07.965 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496983+0000", 2024-05-08T18:31:07.965 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4882000000000004e-05 2024-05-08T18:31:07.965 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.965 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.965 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:07.965 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.497099+0000", 2024-05-08T18:31:07.965 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000115474 2024-05-08T18:31:07.965 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:07.965 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:07.965 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:07.965 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.966 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.966 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:07.966 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.486324+0000", 2024-05-08T18:31:07.966 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 100.357826711, 2024-05-08T18:31:07.966 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010949207000000001, 2024-05-08T18:31:07.966 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:07.966 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:07.966 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:07.966 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:07.966 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:07.966 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:07.966 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 75 2024-05-08T18:31:07.967 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.967 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:07.967 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.967 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:07.967 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486324+0000", 2024-05-08T18:31:07.967 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:07.967 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.967 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.967 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:07.967 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486324+0000", 2024-05-08T18:31:07.967 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:07.968 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.968 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.968 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:07.968 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486325+0000", 2024-05-08T18:31:07.968 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6200000000000006e-07 2024-05-08T18:31:07.968 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.968 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.968 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:07.968 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486439+0000", 2024-05-08T18:31:07.968 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000113391 2024-05-08T18:31:07.968 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.968 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.968 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:07.968 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486455+0000", 2024-05-08T18:31:07.969 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5823000000000001e-05 2024-05-08T18:31:07.969 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.969 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.969 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:07.969 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486465+0000", 2024-05-08T18:31:07.969 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0879999999999999e-05 2024-05-08T18:31:07.969 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.969 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.969 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:07.969 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.495149+0000", 2024-05-08T18:31:07.969 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0086833589999999999 2024-05-08T18:31:07.969 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.970 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.970 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:07.970 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.495213+0000", 2024-05-08T18:31:07.970 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4176000000000004e-05 2024-05-08T18:31:07.970 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.970 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.970 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:07.970 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.495350+0000", 2024-05-08T18:31:07.970 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013709099999999999 2024-05-08T18:31:07.970 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.970 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.970 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:07.970 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496809+0000", 2024-05-08T18:31:07.971 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001458953 2024-05-08T18:31:07.971 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.971 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.971 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:07.971 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.497199+0000", 2024-05-08T18:31:07.971 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00039045200000000001 2024-05-08T18:31:07.971 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.971 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.971 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:07.971 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.497241+0000", 2024-05-08T18:31:07.971 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1378999999999998e-05 2024-05-08T18:31:07.971 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.971 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.972 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:07.972 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.497274+0000", 2024-05-08T18:31:07.972 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2740999999999997e-05 2024-05-08T18:31:07.972 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:07.972 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:07.972 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:07.972 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.973 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.973 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:07.973 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.486483+0000", 2024-05-08T18:31:07.973 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 100.35766853600001, 2024-05-08T18:31:07.973 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011783448, 2024-05-08T18:31:07.973 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:07.973 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:07.973 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:07.973 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:07.973 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:07.973 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:07.974 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 76 2024-05-08T18:31:07.974 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.974 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:07.974 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.974 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:07.974 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486483+0000", 2024-05-08T18:31:07.974 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:07.974 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.974 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.974 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:07.974 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486483+0000", 2024-05-08T18:31:07.974 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:07.974 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.975 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.975 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:07.975 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486483+0000", 2024-05-08T18:31:07.975 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6599999999999995e-07 2024-05-08T18:31:07.975 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.975 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.975 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:07.975 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486491+0000", 2024-05-08T18:31:07.975 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.2520000000000002e-06 2024-05-08T18:31:07.975 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.975 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.975 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:07.975 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486500+0000", 2024-05-08T18:31:07.976 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4420000000000004e-06 2024-05-08T18:31:07.976 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.976 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.976 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:07.976 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486507+0000", 2024-05-08T18:31:07.976 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3549999999999999e-06 2024-05-08T18:31:07.976 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.976 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.976 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:07.976 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496319+0000", 2024-05-08T18:31:07.976 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0098120529999999994 2024-05-08T18:31:07.976 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.976 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.976 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:07.977 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496391+0000", 2024-05-08T18:31:07.977 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1433000000000005e-05 2024-05-08T18:31:07.977 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.977 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.977 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:07.977 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496508+0000", 2024-05-08T18:31:07.977 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000116778 2024-05-08T18:31:07.977 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.977 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.977 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:07.977 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.497284+0000", 2024-05-08T18:31:07.977 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00077609100000000002 2024-05-08T18:31:07.978 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.978 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.978 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:07.978 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.498204+0000", 2024-05-08T18:31:07.978 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00092027299999999999 2024-05-08T18:31:07.978 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.978 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.978 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:07.978 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.498240+0000", 2024-05-08T18:31:07.978 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5979999999999998e-05 2024-05-08T18:31:07.978 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.979 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.979 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:07.979 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.498266+0000", 2024-05-08T18:31:07.979 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6024999999999999e-05 2024-05-08T18:31:07.979 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:07.979 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:07.979 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:07.979 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.979 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.979 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:94 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:07.979 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.842580+0000", 2024-05-08T18:31:07.979 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 100.001571235, 2024-05-08T18:31:07.980 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0085315870000000002, 2024-05-08T18:31:07.980 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:07.980 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:07.980 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:07.980 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:07.980 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:07.980 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:07.980 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 94 2024-05-08T18:31:07.980 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.980 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:07.980 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.980 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:07.981 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.842580+0000", 2024-05-08T18:31:07.981 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:07.981 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.981 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.981 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:07.981 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.842580+0000", 2024-05-08T18:31:07.981 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:07.981 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.981 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.981 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:07.981 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.842581+0000", 2024-05-08T18:31:07.981 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.11e-06 2024-05-08T18:31:07.981 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.982 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.982 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:07.982 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.842587+0000", 2024-05-08T18:31:07.982 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2899999999999999e-06 2024-05-08T18:31:07.982 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.982 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.982 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:07.982 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.842597+0000", 2024-05-08T18:31:07.982 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.007e-05 2024-05-08T18:31:07.982 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.982 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.982 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:07.983 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.842605+0000", 2024-05-08T18:31:07.983 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1270000000000003e-06 2024-05-08T18:31:07.983 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.983 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.983 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:07.983 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.848358+0000", 2024-05-08T18:31:07.983 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0057525140000000002 2024-05-08T18:31:07.983 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.984 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.984 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:07.984 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.848481+0000", 2024-05-08T18:31:07.984 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000123239 2024-05-08T18:31:07.984 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.984 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.984 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:07.984 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.848695+0000", 2024-05-08T18:31:07.984 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000213387 2024-05-08T18:31:07.984 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.984 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.984 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:07.984 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.849781+0000", 2024-05-08T18:31:07.985 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010868 2024-05-08T18:31:07.985 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.985 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.985 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:07.985 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.850990+0000", 2024-05-08T18:31:07.985 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0012084769999999999 2024-05-08T18:31:07.985 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.985 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.985 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:07.985 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.851059+0000", 2024-05-08T18:31:07.985 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9130999999999999e-05 2024-05-08T18:31:07.985 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:07.985 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:07.985 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:07.985 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.851111+0000", 2024-05-08T18:31:07.986 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2441999999999997e-05 2024-05-08T18:31:07.986 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:07.986 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:07.986 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:07.986 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:07.986 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:07.986 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:31:07.988 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:31:07.983+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:31:07.988 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-08T18:31:08.089 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:31:08.087+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:31:08.107 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:08.108 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:31:08.108 INFO:teuthology.orchestra.run.smithi097.stdout: "num_ops": 0 2024-05-08T18:31:08.108 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:08.120 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-08T18:31:08.215 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:31:08.215+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:31:08.291 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:31:08.291+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:31:08.314 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:08.314 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:31:08.314 INFO:teuthology.orchestra.run.smithi097.stdout: "complaint_time": 30, 2024-05-08T18:31:08.314 INFO:teuthology.orchestra.run.smithi097.stdout: "num_blocked_ops": 0 2024-05-08T18:31:08.314 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:08.327 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-08T18:31:08.392 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:31:08.387+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:31:08.493 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:31:08.491+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:31:08.510 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:08.510 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2024-05-08T18:31:08.510 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2024-05-08T18:31:08.510 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-05-08T18:31:08.510 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.510 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4206.0:24 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'14, mlcod=16'9)", 2024-05-08T18:31:08.510 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:27.162224+0000", 2024-05-08T18:31:08.510 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 101.34871036, 2024-05-08T18:31:08.510 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032712890000000001, 2024-05-08T18:31:08.511 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:08.511 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:08.511 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:08.511 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:08.511 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.511 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:08.511 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162224+0000", 2024-05-08T18:31:08.511 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:08.511 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.511 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.511 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:08.512 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162224+0000", 2024-05-08T18:31:08.512 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:08.512 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.512 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.512 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:08.512 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162225+0000", 2024-05-08T18:31:08.512 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4899999999999999e-06 2024-05-08T18:31:08.512 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.512 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.512 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:08.512 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162306+0000", 2024-05-08T18:31:08.513 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.0589999999999999e-05 2024-05-08T18:31:08.513 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.513 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.513 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:08.513 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162332+0000", 2024-05-08T18:31:08.513 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5658999999999999e-05 2024-05-08T18:31:08.513 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.513 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.513 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:08.513 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162345+0000", 2024-05-08T18:31:08.513 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3512999999999999e-05 2024-05-08T18:31:08.513 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.513 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.514 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:08.514 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162465+0000", 2024-05-08T18:31:08.514 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000119577 2024-05-08T18:31:08.514 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.514 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.514 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:08.514 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162513+0000", 2024-05-08T18:31:08.514 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8773999999999998e-05 2024-05-08T18:31:08.514 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.514 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.514 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:08.514 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.165405+0000", 2024-05-08T18:31:08.514 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028919200000000001 2024-05-08T18:31:08.515 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.515 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.515 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:08.515 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.165495+0000", 2024-05-08T18:31:08.515 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9765999999999994e-05 2024-05-08T18:31:08.515 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:08.515 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:08.515 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:08.515 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.515 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.515 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4206.0:25 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'15, mlcod=16'10)", 2024-05-08T18:31:08.515 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:27.164793+0000", 2024-05-08T18:31:08.515 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 101.34614123199999, 2024-05-08T18:31:08.516 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032285249999999999, 2024-05-08T18:31:08.516 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:08.516 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:08.516 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:08.516 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:08.516 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.516 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:08.516 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164793+0000", 2024-05-08T18:31:08.516 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:08.516 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.516 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.516 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:08.516 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164793+0000", 2024-05-08T18:31:08.516 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:08.516 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.516 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.517 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:08.517 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164795+0000", 2024-05-08T18:31:08.517 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0999999999999998e-06 2024-05-08T18:31:08.517 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.517 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.517 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:08.517 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164811+0000", 2024-05-08T18:31:08.517 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5722999999999998e-05 2024-05-08T18:31:08.517 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.517 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.517 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:08.517 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164841+0000", 2024-05-08T18:31:08.517 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0355999999999999e-05 2024-05-08T18:31:08.518 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.518 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.518 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:08.518 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164861+0000", 2024-05-08T18:31:08.518 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9533000000000001e-05 2024-05-08T18:31:08.518 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.518 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.518 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:08.518 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164984+0000", 2024-05-08T18:31:08.518 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000123146 2024-05-08T18:31:08.518 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.518 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.518 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:08.519 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.165024+0000", 2024-05-08T18:31:08.519 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9690000000000001e-05 2024-05-08T18:31:08.519 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.519 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.519 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:08.519 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.167935+0000", 2024-05-08T18:31:08.519 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0029113300000000002 2024-05-08T18:31:08.519 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.519 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.519 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:08.519 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.168021+0000", 2024-05-08T18:31:08.519 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6646999999999999e-05 2024-05-08T18:31:08.519 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:08.519 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:08.519 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:08.520 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.520 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.520 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:31:08.520 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:48.674737+0000", 2024-05-08T18:31:08.520 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 79.836197314000003, 2024-05-08T18:31:08.520 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0035019780000000002, 2024-05-08T18:31:08.520 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:08.520 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:08.520 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:08.520 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:08.520 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:08.520 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:08.520 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 60 2024-05-08T18:31:08.521 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.521 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:08.521 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.521 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:08.521 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674737+0000", 2024-05-08T18:31:08.521 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:08.521 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.521 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.521 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:08.521 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674737+0000", 2024-05-08T18:31:08.521 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:08.521 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.521 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.521 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:08.522 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674740+0000", 2024-05-08T18:31:08.522 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.36e-06 2024-05-08T18:31:08.522 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.522 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.522 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:08.522 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674753+0000", 2024-05-08T18:31:08.522 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3151e-05 2024-05-08T18:31:08.522 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.522 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.522 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:08.522 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674789+0000", 2024-05-08T18:31:08.523 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5929000000000001e-05 2024-05-08T18:31:08.523 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.523 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.523 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:08.523 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674813+0000", 2024-05-08T18:31:08.523 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3325000000000001e-05 2024-05-08T18:31:08.523 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.523 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.523 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:08.523 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674981+0000", 2024-05-08T18:31:08.523 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016879899999999999 2024-05-08T18:31:08.523 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.523 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.523 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:08.524 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.675304+0000", 2024-05-08T18:31:08.524 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00032214400000000001 2024-05-08T18:31:08.524 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.524 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.524 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-05-08T18:31:08.524 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.675639+0000", 2024-05-08T18:31:08.524 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00033494699999999999 2024-05-08T18:31:08.524 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.524 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.524 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:08.524 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.676901+0000", 2024-05-08T18:31:08.524 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001262167 2024-05-08T18:31:08.524 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.524 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.525 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:08.525 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678078+0000", 2024-05-08T18:31:08.525 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001177588 2024-05-08T18:31:08.525 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.525 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.525 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:08.525 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678171+0000", 2024-05-08T18:31:08.525 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.2331999999999996e-05 2024-05-08T18:31:08.525 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.525 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.525 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:08.526 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678239+0000", 2024-05-08T18:31:08.526 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8236000000000002e-05 2024-05-08T18:31:08.526 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:08.526 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:08.526 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:08.526 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.526 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.526 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:61 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94069412632064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:31:08.526 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:48.678410+0000", 2024-05-08T18:31:08.526 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 79.832523922000007, 2024-05-08T18:31:08.526 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0026001800000000001, 2024-05-08T18:31:08.526 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:08.526 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:08.527 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:08.527 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:08.527 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:08.527 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:08.527 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 61 2024-05-08T18:31:08.527 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.527 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:08.527 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.527 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:08.527 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678410+0000", 2024-05-08T18:31:08.527 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:08.527 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.527 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.528 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:08.528 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678410+0000", 2024-05-08T18:31:08.528 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:08.528 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.528 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.528 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:08.528 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678413+0000", 2024-05-08T18:31:08.528 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.34e-06 2024-05-08T18:31:08.528 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.528 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.528 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:08.528 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678421+0000", 2024-05-08T18:31:08.528 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6910000000000003e-06 2024-05-08T18:31:08.528 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.529 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.529 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:08.529 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678447+0000", 2024-05-08T18:31:08.529 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6010999999999999e-05 2024-05-08T18:31:08.529 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.529 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.529 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:08.529 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678461+0000", 2024-05-08T18:31:08.529 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3900000000000001e-05 2024-05-08T18:31:08.529 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.529 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.529 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:08.530 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678560+0000", 2024-05-08T18:31:08.530 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.8834999999999998e-05 2024-05-08T18:31:08.530 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.530 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.530 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:08.530 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678704+0000", 2024-05-08T18:31:08.530 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000143769 2024-05-08T18:31:08.530 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.530 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.530 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-05-08T18:31:08.530 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678942+0000", 2024-05-08T18:31:08.530 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023861800000000001 2024-05-08T18:31:08.530 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.531 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.531 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:08.531 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.680269+0000", 2024-05-08T18:31:08.531 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001326484 2024-05-08T18:31:08.531 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.531 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.531 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:08.531 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.680823+0000", 2024-05-08T18:31:08.531 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00055455900000000004 2024-05-08T18:31:08.531 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.531 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.531 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:08.531 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.680908+0000", 2024-05-08T18:31:08.531 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.4073999999999995e-05 2024-05-08T18:31:08.531 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.532 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.532 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:08.532 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.681010+0000", 2024-05-08T18:31:08.532 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010289900000000001 2024-05-08T18:31:08.532 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:08.532 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:08.532 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:08.532 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.532 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.532 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:31:08.533 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.671896+0000", 2024-05-08T18:31:08.533 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 76.839038036999995, 2024-05-08T18:31:08.533 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032352349999999999, 2024-05-08T18:31:08.533 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:08.533 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:08.533 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:08.533 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:08.533 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:08.533 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:08.533 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 206 2024-05-08T18:31:08.533 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.533 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:08.533 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.533 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:08.533 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671896+0000", 2024-05-08T18:31:08.534 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:08.534 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.534 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.534 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:08.534 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671896+0000", 2024-05-08T18:31:08.534 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:08.534 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.534 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.534 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:08.534 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671901+0000", 2024-05-08T18:31:08.534 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.763e-06 2024-05-08T18:31:08.534 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.534 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.535 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:08.535 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671920+0000", 2024-05-08T18:31:08.535 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9403e-05 2024-05-08T18:31:08.535 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.535 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.535 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:08.535 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671969+0000", 2024-05-08T18:31:08.535 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8343000000000001e-05 2024-05-08T18:31:08.535 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.535 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.535 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:08.535 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671996+0000", 2024-05-08T18:31:08.535 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7307000000000001e-05 2024-05-08T18:31:08.535 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.535 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.536 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:08.536 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.672149+0000", 2024-05-08T18:31:08.536 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015336500000000001 2024-05-08T18:31:08.536 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.536 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.536 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:08.536 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.672393+0000", 2024-05-08T18:31:08.536 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024380800000000001 2024-05-08T18:31:08.536 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.536 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.536 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-05-08T18:31:08.536 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.672838+0000", 2024-05-08T18:31:08.536 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00044472700000000001 2024-05-08T18:31:08.537 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.537 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.537 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:08.537 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.674218+0000", 2024-05-08T18:31:08.537 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001380243 2024-05-08T18:31:08.537 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.537 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.537 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:08.537 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.674963+0000", 2024-05-08T18:31:08.537 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00074534999999999998 2024-05-08T18:31:08.537 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.537 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.537 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:08.537 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675057+0000", 2024-05-08T18:31:08.538 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.3633000000000003e-05 2024-05-08T18:31:08.538 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.538 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.538 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:08.538 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675131+0000", 2024-05-08T18:31:08.538 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.4293000000000002e-05 2024-05-08T18:31:08.538 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:08.538 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:08.538 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:08.538 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.538 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.538 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:08.538 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.694194+0000", 2024-05-08T18:31:08.539 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 76.816740639000002, 2024-05-08T18:31:08.539 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0087385129999999998, 2024-05-08T18:31:08.539 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:08.539 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:08.539 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:08.539 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:08.539 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:08.539 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:08.539 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 210 2024-05-08T18:31:08.539 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.539 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:08.539 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.540 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:08.540 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694194+0000", 2024-05-08T18:31:08.540 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:08.540 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.540 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.540 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:08.540 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694194+0000", 2024-05-08T18:31:08.540 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:08.540 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.540 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.540 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:08.541 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694196+0000", 2024-05-08T18:31:08.541 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6299999999999998e-06 2024-05-08T18:31:08.541 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.541 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.541 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:08.541 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694208+0000", 2024-05-08T18:31:08.541 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.187e-05 2024-05-08T18:31:08.541 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.541 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.541 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:08.541 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694240+0000", 2024-05-08T18:31:08.541 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1673e-05 2024-05-08T18:31:08.542 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.542 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.542 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:08.542 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694255+0000", 2024-05-08T18:31:08.542 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5573000000000002e-05 2024-05-08T18:31:08.542 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.542 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.542 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:08.542 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694394+0000", 2024-05-08T18:31:08.542 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000138536 2024-05-08T18:31:08.542 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.542 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.542 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-05-08T18:31:08.542 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694405+0000", 2024-05-08T18:31:08.543 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0883000000000001e-05 2024-05-08T18:31:08.543 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.543 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.543 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:08.543 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.699491+0000", 2024-05-08T18:31:08.543 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0050861939999999996 2024-05-08T18:31:08.543 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.543 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.543 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:08.543 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.699829+0000", 2024-05-08T18:31:08.544 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000338191 2024-05-08T18:31:08.544 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.544 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.544 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:08.544 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.700504+0000", 2024-05-08T18:31:08.544 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000674481 2024-05-08T18:31:08.544 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.544 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.544 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:08.544 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.702152+0000", 2024-05-08T18:31:08.544 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0016487450000000001 2024-05-08T18:31:08.544 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.544 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.544 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:08.544 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.702792+0000", 2024-05-08T18:31:08.545 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00063962800000000005 2024-05-08T18:31:08.545 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.545 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.545 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:08.545 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.702874+0000", 2024-05-08T18:31:08.545 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.2091999999999999e-05 2024-05-08T18:31:08.545 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.545 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.545 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:08.545 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.702932+0000", 2024-05-08T18:31:08.545 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8016999999999997e-05 2024-05-08T18:31:08.545 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:08.545 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:08.545 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:08.546 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.546 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.546 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:08.546 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.728239+0000", 2024-05-08T18:31:08.546 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 76.782694778000007, 2024-05-08T18:31:08.546 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0035376119999999999, 2024-05-08T18:31:08.546 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:08.546 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:08.546 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:08.546 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:08.546 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:08.546 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:08.546 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 218 2024-05-08T18:31:08.547 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.547 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:08.547 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.547 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:08.547 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728239+0000", 2024-05-08T18:31:08.547 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:08.547 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.547 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.547 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:08.547 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728239+0000", 2024-05-08T18:31:08.547 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:08.547 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.548 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.548 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:08.548 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728242+0000", 2024-05-08T18:31:08.548 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0130000000000002e-06 2024-05-08T18:31:08.548 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.548 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.548 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:08.548 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728254+0000", 2024-05-08T18:31:08.548 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.172e-05 2024-05-08T18:31:08.548 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.548 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.548 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:08.548 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728285+0000", 2024-05-08T18:31:08.549 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0703000000000001e-05 2024-05-08T18:31:08.549 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.549 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.549 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:08.549 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728301+0000", 2024-05-08T18:31:08.549 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5656999999999999e-05 2024-05-08T18:31:08.549 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.549 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.549 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:08.549 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728460+0000", 2024-05-08T18:31:08.549 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015934200000000001 2024-05-08T18:31:08.549 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.549 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.549 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:08.549 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728803+0000", 2024-05-08T18:31:08.550 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00034267400000000001 2024-05-08T18:31:08.550 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.550 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.550 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:08.550 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.729485+0000", 2024-05-08T18:31:08.550 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00068206799999999998 2024-05-08T18:31:08.550 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.550 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.550 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:08.550 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731218+0000", 2024-05-08T18:31:08.550 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0017332630000000001 2024-05-08T18:31:08.550 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.551 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.551 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:08.551 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731615+0000", 2024-05-08T18:31:08.551 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00039671699999999999 2024-05-08T18:31:08.551 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.551 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.551 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:08.551 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731709+0000", 2024-05-08T18:31:08.551 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.4740000000000004e-05 2024-05-08T18:31:08.551 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.551 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.551 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:08.551 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731777+0000", 2024-05-08T18:31:08.551 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7714999999999998e-05 2024-05-08T18:31:08.551 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:08.552 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:08.552 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:08.552 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.552 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.552 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:08.552 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.743331+0000", 2024-05-08T18:31:08.552 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 76.767602795000002, 2024-05-08T18:31:08.552 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031193229999999998, 2024-05-08T18:31:08.552 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:08.552 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:08.552 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:08.552 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:08.552 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:08.553 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:08.553 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 222 2024-05-08T18:31:08.553 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.553 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:08.553 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.553 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:08.553 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743331+0000", 2024-05-08T18:31:08.553 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:08.553 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.553 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.553 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:08.553 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743331+0000", 2024-05-08T18:31:08.553 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:08.554 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.554 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.554 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:08.554 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743334+0000", 2024-05-08T18:31:08.554 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2900000000000001e-06 2024-05-08T18:31:08.554 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.554 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.554 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:08.554 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743345+0000", 2024-05-08T18:31:08.554 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0947e-05 2024-05-08T18:31:08.554 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.554 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.554 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:08.554 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743375+0000", 2024-05-08T18:31:08.555 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0298999999999999e-05 2024-05-08T18:31:08.555 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.555 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.555 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:08.555 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743390+0000", 2024-05-08T18:31:08.555 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4606999999999999e-05 2024-05-08T18:31:08.555 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.555 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.555 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:08.555 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743524+0000", 2024-05-08T18:31:08.555 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000134105 2024-05-08T18:31:08.555 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.555 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.555 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:08.556 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743738+0000", 2024-05-08T18:31:08.556 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000214222 2024-05-08T18:31:08.556 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.556 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.556 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:08.556 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.744159+0000", 2024-05-08T18:31:08.556 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00042102300000000002 2024-05-08T18:31:08.556 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.556 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.556 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:08.556 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.745399+0000", 2024-05-08T18:31:08.556 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012400309999999999 2024-05-08T18:31:08.556 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.556 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.557 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:08.557 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.746296+0000", 2024-05-08T18:31:08.557 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00089682 2024-05-08T18:31:08.557 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.557 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.557 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:08.557 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.746385+0000", 2024-05-08T18:31:08.557 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9289000000000005e-05 2024-05-08T18:31:08.557 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.557 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.557 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:08.558 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.746451+0000", 2024-05-08T18:31:08.558 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5690000000000003e-05 2024-05-08T18:31:08.558 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:08.558 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:08.558 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:08.558 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.558 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.558 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:08.558 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.772338+0000", 2024-05-08T18:31:08.558 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 76.738596595000004, 2024-05-08T18:31:08.558 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0035084059999999999, 2024-05-08T18:31:08.558 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:08.558 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:08.559 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:08.559 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:08.559 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:08.559 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:08.559 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 230 2024-05-08T18:31:08.559 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.559 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:08.559 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.559 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:08.559 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772338+0000", 2024-05-08T18:31:08.559 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:08.559 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.559 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.559 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:08.559 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772338+0000", 2024-05-08T18:31:08.560 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:08.560 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.560 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.560 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:08.560 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772340+0000", 2024-05-08T18:31:08.560 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3460000000000001e-06 2024-05-08T18:31:08.560 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.560 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.560 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:08.560 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772352+0000", 2024-05-08T18:31:08.560 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2284e-05 2024-05-08T18:31:08.560 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.561 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.561 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:08.561 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772382+0000", 2024-05-08T18:31:08.561 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0083e-05 2024-05-08T18:31:08.561 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.561 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.561 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:08.561 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772397+0000", 2024-05-08T18:31:08.561 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4963000000000001e-05 2024-05-08T18:31:08.561 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.561 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.561 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:08.561 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772508+0000", 2024-05-08T18:31:08.561 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000110402 2024-05-08T18:31:08.562 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.562 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.562 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:08.562 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772742+0000", 2024-05-08T18:31:08.562 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023428899999999999 2024-05-08T18:31:08.562 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.562 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.562 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:08.562 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.773183+0000", 2024-05-08T18:31:08.562 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00044107899999999998 2024-05-08T18:31:08.562 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.562 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.562 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:08.563 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.774488+0000", 2024-05-08T18:31:08.563 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0013053940000000001 2024-05-08T18:31:08.563 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.563 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.563 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:08.563 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.775689+0000", 2024-05-08T18:31:08.563 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012004699999999999 2024-05-08T18:31:08.563 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.563 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.563 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:08.563 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.775777+0000", 2024-05-08T18:31:08.563 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8483e-05 2024-05-08T18:31:08.564 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.564 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.564 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:08.564 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.775846+0000", 2024-05-08T18:31:08.564 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8613000000000002e-05 2024-05-08T18:31:08.564 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:08.564 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:08.564 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:08.564 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.564 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.564 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:08.564 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.790921+0000", 2024-05-08T18:31:08.565 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 76.720013249000004, 2024-05-08T18:31:08.565 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003116869, 2024-05-08T18:31:08.565 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:08.565 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:08.565 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:08.565 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:08.565 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:08.565 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:08.565 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 235 2024-05-08T18:31:08.565 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.566 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:08.566 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.566 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:08.566 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790921+0000", 2024-05-08T18:31:08.566 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:08.566 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.566 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.566 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:08.566 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790921+0000", 2024-05-08T18:31:08.566 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:08.567 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.567 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.567 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:08.567 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790923+0000", 2024-05-08T18:31:08.567 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3199999999999998e-06 2024-05-08T18:31:08.567 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.567 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.567 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:08.567 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790934+0000", 2024-05-08T18:31:08.567 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.117e-05 2024-05-08T18:31:08.567 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.567 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.568 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:08.568 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790965+0000", 2024-05-08T18:31:08.568 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0392999999999999e-05 2024-05-08T18:31:08.568 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.568 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.568 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:08.568 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790981+0000", 2024-05-08T18:31:08.568 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5699999999999999e-05 2024-05-08T18:31:08.568 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.568 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.568 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:08.568 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.791093+0000", 2024-05-08T18:31:08.568 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000112062 2024-05-08T18:31:08.568 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.569 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.569 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:08.569 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.791324+0000", 2024-05-08T18:31:08.569 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023142200000000001 2024-05-08T18:31:08.569 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.569 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.569 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:08.569 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.791761+0000", 2024-05-08T18:31:08.569 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00043669999999999999 2024-05-08T18:31:08.569 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.570 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.570 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:08.570 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.792996+0000", 2024-05-08T18:31:08.570 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001235713 2024-05-08T18:31:08.570 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.570 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.570 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:08.570 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.793850+0000", 2024-05-08T18:31:08.570 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00085392400000000005 2024-05-08T18:31:08.570 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.570 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.570 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:08.570 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.793971+0000", 2024-05-08T18:31:08.570 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000120516 2024-05-08T18:31:08.571 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.571 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.571 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:08.571 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794038+0000", 2024-05-08T18:31:08.571 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6948999999999999e-05 2024-05-08T18:31:08.571 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:08.571 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:08.571 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:08.571 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.571 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.571 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:349 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:08.571 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.817315+0000", 2024-05-08T18:31:08.572 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 76.693619377999994, 2024-05-08T18:31:08.572 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0036888580000000002, 2024-05-08T18:31:08.572 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:08.572 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:08.572 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:08.572 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:08.572 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:08.572 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:08.572 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 349 2024-05-08T18:31:08.572 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.572 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:08.572 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.572 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:08.572 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817315+0000", 2024-05-08T18:31:08.573 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:08.573 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.573 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.573 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:08.573 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817315+0000", 2024-05-08T18:31:08.573 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:08.573 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.573 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.573 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:08.573 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817316+0000", 2024-05-08T18:31:08.573 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3370000000000001e-06 2024-05-08T18:31:08.573 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.573 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.573 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:08.574 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817323+0000", 2024-05-08T18:31:08.574 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.4300000000000003e-06 2024-05-08T18:31:08.574 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.574 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.574 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:08.574 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817337+0000", 2024-05-08T18:31:08.574 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4025999999999999e-05 2024-05-08T18:31:08.574 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.574 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.574 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:08.575 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817345+0000", 2024-05-08T18:31:08.575 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5669999999999995e-06 2024-05-08T18:31:08.575 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.575 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.575 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:08.575 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817407+0000", 2024-05-08T18:31:08.575 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1882000000000001e-05 2024-05-08T18:31:08.575 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.575 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.575 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:08.575 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817508+0000", 2024-05-08T18:31:08.575 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000100585 2024-05-08T18:31:08.575 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.575 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.575 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:08.576 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817673+0000", 2024-05-08T18:31:08.576 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000165802 2024-05-08T18:31:08.576 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.576 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.576 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:08.576 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.818715+0000", 2024-05-08T18:31:08.576 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0010417720000000001 2024-05-08T18:31:08.576 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.576 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.576 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:08.576 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.820892+0000", 2024-05-08T18:31:08.576 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0021771859999999998 2024-05-08T18:31:08.576 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.576 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.577 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:08.577 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.820950+0000", 2024-05-08T18:31:08.577 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7636000000000002e-05 2024-05-08T18:31:08.577 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.577 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.577 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:08.577 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.821004+0000", 2024-05-08T18:31:08.577 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3634999999999997e-05 2024-05-08T18:31:08.577 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:08.577 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:08.577 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:08.577 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.577 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.578 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:406 6.16 6:6dc3b799:reshard::reshard.0000000006:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:08.578 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.840465+0000", 2024-05-08T18:31:08.578 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 76.670469212, 2024-05-08T18:31:08.578 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003613032, 2024-05-08T18:31:08.578 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:08.578 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:08.578 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:08.578 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:08.578 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:08.578 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:08.578 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 406 2024-05-08T18:31:08.578 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.579 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:08.579 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.579 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:08.579 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840465+0000", 2024-05-08T18:31:08.579 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:08.579 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.579 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.579 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:08.579 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840465+0000", 2024-05-08T18:31:08.579 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:08.579 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.579 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.579 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:08.580 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840466+0000", 2024-05-08T18:31:08.580 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7499999999999999e-07 2024-05-08T18:31:08.580 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.580 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.580 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:08.580 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840471+0000", 2024-05-08T18:31:08.580 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9699999999999998e-06 2024-05-08T18:31:08.580 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.580 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.580 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:08.580 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840484+0000", 2024-05-08T18:31:08.580 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2717999999999999e-05 2024-05-08T18:31:08.580 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.580 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.581 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:08.581 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840490+0000", 2024-05-08T18:31:08.581 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.472e-06 2024-05-08T18:31:08.581 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.581 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.581 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:08.581 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840536+0000", 2024-05-08T18:31:08.581 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6409000000000002e-05 2024-05-08T18:31:08.581 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.581 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.581 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:08.581 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840591+0000", 2024-05-08T18:31:08.581 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4911000000000003e-05 2024-05-08T18:31:08.581 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.582 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.582 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:08.582 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840745+0000", 2024-05-08T18:31:08.582 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015394900000000001 2024-05-08T18:31:08.582 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.582 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.582 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:08.582 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.841269+0000", 2024-05-08T18:31:08.582 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00052347299999999999 2024-05-08T18:31:08.582 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.582 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.583 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:08.583 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.843997+0000", 2024-05-08T18:31:08.583 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0027285080000000001 2024-05-08T18:31:08.583 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.583 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.583 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:08.583 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844033+0000", 2024-05-08T18:31:08.583 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6038000000000003e-05 2024-05-08T18:31:08.583 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.583 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.583 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:08.583 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844078+0000", 2024-05-08T18:31:08.583 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4709000000000002e-05 2024-05-08T18:31:08.583 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:08.584 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:08.584 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:08.584 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.584 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.584 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:413 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:08.584 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.844187+0000", 2024-05-08T18:31:08.584 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 76.666747634999993, 2024-05-08T18:31:08.584 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0024835069999999998, 2024-05-08T18:31:08.584 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:08.584 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:08.584 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:08.584 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:08.584 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:08.584 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:08.585 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 413 2024-05-08T18:31:08.585 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.585 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:08.585 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.585 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:08.585 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844187+0000", 2024-05-08T18:31:08.585 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:08.585 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.585 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.585 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:08.585 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844187+0000", 2024-05-08T18:31:08.585 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:08.585 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.586 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.586 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:08.586 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844187+0000", 2024-05-08T18:31:08.586 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9999999999999996e-07 2024-05-08T18:31:08.586 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.586 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.586 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:08.586 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844192+0000", 2024-05-08T18:31:08.586 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7899999999999999e-06 2024-05-08T18:31:08.586 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.586 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.587 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:08.587 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844203+0000", 2024-05-08T18:31:08.587 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1002000000000001e-05 2024-05-08T18:31:08.587 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.587 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.587 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:08.587 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844209+0000", 2024-05-08T18:31:08.587 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6570000000000002e-06 2024-05-08T18:31:08.587 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.587 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.587 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:08.587 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844270+0000", 2024-05-08T18:31:08.588 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0810999999999998e-05 2024-05-08T18:31:08.588 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.588 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.588 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:08.588 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844419+0000", 2024-05-08T18:31:08.588 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000149097 2024-05-08T18:31:08.588 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.588 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.588 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:08.588 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844611+0000", 2024-05-08T18:31:08.588 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00019247900000000001 2024-05-08T18:31:08.588 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.588 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.589 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:08.589 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.845287+0000", 2024-05-08T18:31:08.589 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00067526000000000001 2024-05-08T18:31:08.589 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.589 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.589 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:08.589 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.846609+0000", 2024-05-08T18:31:08.589 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001322124 2024-05-08T18:31:08.589 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.589 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.589 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:08.589 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.846642+0000", 2024-05-08T18:31:08.590 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3654e-05 2024-05-08T18:31:08.590 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.590 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.590 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:08.590 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.846670+0000", 2024-05-08T18:31:08.590 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7733e-05 2024-05-08T18:31:08.590 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:08.590 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:08.590 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:08.590 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.590 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.591 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:420 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:08.591 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.847096+0000", 2024-05-08T18:31:08.591 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 76.663838341000002, 2024-05-08T18:31:08.591 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0026261589999999999, 2024-05-08T18:31:08.591 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:08.591 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:08.591 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:08.591 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:08.591 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:08.591 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:08.591 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 420 2024-05-08T18:31:08.591 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.591 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:08.591 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.592 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:08.592 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847096+0000", 2024-05-08T18:31:08.592 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:08.592 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.592 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.592 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:08.592 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847096+0000", 2024-05-08T18:31:08.592 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:08.592 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.592 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.592 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:08.592 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847097+0000", 2024-05-08T18:31:08.592 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.5499999999999996e-07 2024-05-08T18:31:08.593 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.593 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.593 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:08.593 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847103+0000", 2024-05-08T18:31:08.593 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8969999999999996e-06 2024-05-08T18:31:08.593 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.593 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.593 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:08.593 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847114+0000", 2024-05-08T18:31:08.593 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1549000000000001e-05 2024-05-08T18:31:08.593 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.593 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.594 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:08.594 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847120+0000", 2024-05-08T18:31:08.594 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5509999999999999e-06 2024-05-08T18:31:08.594 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.594 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.594 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:08.594 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847166+0000", 2024-05-08T18:31:08.594 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6683e-05 2024-05-08T18:31:08.594 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.594 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.594 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:08.594 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847213+0000", 2024-05-08T18:31:08.594 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6659000000000002e-05 2024-05-08T18:31:08.594 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.595 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.595 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:08.595 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847315+0000", 2024-05-08T18:31:08.595 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000102336 2024-05-08T18:31:08.595 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.595 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.595 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:08.595 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847840+0000", 2024-05-08T18:31:08.595 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00052475000000000004 2024-05-08T18:31:08.595 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.595 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.595 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:08.595 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.849660+0000", 2024-05-08T18:31:08.596 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001819563 2024-05-08T18:31:08.596 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.596 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.596 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:08.596 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.849695+0000", 2024-05-08T18:31:08.596 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4761000000000001e-05 2024-05-08T18:31:08.596 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.596 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.596 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:08.596 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.849722+0000", 2024-05-08T18:31:08.596 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7455000000000001e-05 2024-05-08T18:31:08.596 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:08.597 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:08.597 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:08.597 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.597 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.597 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:532 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:08.597 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.908603+0000", 2024-05-08T18:31:08.597 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 76.602330791, 2024-05-08T18:31:08.597 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0038838950000000001, 2024-05-08T18:31:08.597 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:08.597 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:08.597 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:08.597 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:08.598 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:08.598 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:08.598 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 532 2024-05-08T18:31:08.598 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.598 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:08.598 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.598 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:08.598 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908603+0000", 2024-05-08T18:31:08.598 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:08.598 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.598 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.598 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:08.598 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908603+0000", 2024-05-08T18:31:08.599 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:08.599 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.599 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.599 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:08.599 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908605+0000", 2024-05-08T18:31:08.599 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1179999999999999e-06 2024-05-08T18:31:08.599 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.599 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.599 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:08.599 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908608+0000", 2024-05-08T18:31:08.599 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7419999999999999e-06 2024-05-08T18:31:08.599 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.600 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.600 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:08.600 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908618+0000", 2024-05-08T18:31:08.600 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.6889999999999999e-06 2024-05-08T18:31:08.600 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.600 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.600 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:08.600 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908625+0000", 2024-05-08T18:31:08.600 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1300000000000003e-06 2024-05-08T18:31:08.600 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.600 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.600 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:08.601 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908669+0000", 2024-05-08T18:31:08.601 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3832000000000003e-05 2024-05-08T18:31:08.601 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.601 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.601 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:08.601 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908724+0000", 2024-05-08T18:31:08.601 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5222000000000001e-05 2024-05-08T18:31:08.601 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.601 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.601 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:08.601 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908854+0000", 2024-05-08T18:31:08.601 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012953500000000001 2024-05-08T18:31:08.601 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.601 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.602 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:08.602 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.909511+0000", 2024-05-08T18:31:08.602 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00065768399999999996 2024-05-08T18:31:08.602 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.602 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.602 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:08.602 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912426+0000", 2024-05-08T18:31:08.602 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0029146599999999999 2024-05-08T18:31:08.602 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.602 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.602 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:08.602 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912461+0000", 2024-05-08T18:31:08.603 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4934999999999997e-05 2024-05-08T18:31:08.603 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.603 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.603 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:08.603 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912487+0000", 2024-05-08T18:31:08.603 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6347999999999999e-05 2024-05-08T18:31:08.603 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:08.603 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:08.603 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:08.603 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.603 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.603 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:534 6.9 6:9268b73e:::obj_delete_at_hint.0000000019:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:08.604 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.910153+0000", 2024-05-08T18:31:08.604 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 76.600781334000004, 2024-05-08T18:31:08.604 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0051089680000000002, 2024-05-08T18:31:08.604 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:08.604 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:08.604 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:08.604 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:08.604 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:08.604 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:08.604 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 534 2024-05-08T18:31:08.604 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.604 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:08.604 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.604 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:08.604 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910153+0000", 2024-05-08T18:31:08.605 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:08.605 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.605 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.605 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:08.605 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910153+0000", 2024-05-08T18:31:08.605 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:08.605 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.605 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.605 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:08.605 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910154+0000", 2024-05-08T18:31:08.605 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1039999999999999e-06 2024-05-08T18:31:08.605 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.605 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.606 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:08.606 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910158+0000", 2024-05-08T18:31:08.606 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7400000000000002e-06 2024-05-08T18:31:08.606 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.606 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.606 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:08.606 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910167+0000", 2024-05-08T18:31:08.606 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8880000000000003e-06 2024-05-08T18:31:08.606 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.606 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.606 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:08.606 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910173+0000", 2024-05-08T18:31:08.606 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.844e-06 2024-05-08T18:31:08.606 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.607 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.607 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:08.607 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910220+0000", 2024-05-08T18:31:08.607 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6582000000000002e-05 2024-05-08T18:31:08.607 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.607 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.607 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:08.607 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910287+0000", 2024-05-08T18:31:08.607 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7271e-05 2024-05-08T18:31:08.607 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.607 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.608 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:08.608 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910402+0000", 2024-05-08T18:31:08.608 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115127 2024-05-08T18:31:08.608 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.608 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.608 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:08.608 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910881+0000", 2024-05-08T18:31:08.608 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000479025 2024-05-08T18:31:08.608 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.608 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.608 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:08.608 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.915206+0000", 2024-05-08T18:31:08.608 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.004324357 2024-05-08T18:31:08.608 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.609 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.609 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:08.609 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.915237+0000", 2024-05-08T18:31:08.609 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1590000000000001e-05 2024-05-08T18:31:08.609 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.609 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.609 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:08.609 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.915262+0000", 2024-05-08T18:31:08.609 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.444e-05 2024-05-08T18:31:08.609 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:08.609 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:08.609 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:08.609 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.609 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.610 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:583 6.0 6:03bbb29a:::obj_delete_at_hint.0000000026:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:08.610 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.947199+0000", 2024-05-08T18:31:08.610 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 76.563735136999995, 2024-05-08T18:31:08.610 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0025081510000000001, 2024-05-08T18:31:08.610 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:08.610 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:08.610 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:08.610 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:08.610 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:08.610 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:08.610 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 583 2024-05-08T18:31:08.610 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.610 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:08.610 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.611 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:08.611 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947199+0000", 2024-05-08T18:31:08.611 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:08.611 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.611 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.611 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:08.611 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947199+0000", 2024-05-08T18:31:08.611 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:08.611 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.611 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.611 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:08.611 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947200+0000", 2024-05-08T18:31:08.612 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3799999999999997e-07 2024-05-08T18:31:08.612 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.612 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.612 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:08.612 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947207+0000", 2024-05-08T18:31:08.612 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2030000000000003e-06 2024-05-08T18:31:08.612 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.612 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.612 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:08.612 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947217+0000", 2024-05-08T18:31:08.612 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0138e-05 2024-05-08T18:31:08.612 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.612 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.612 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:08.612 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947224+0000", 2024-05-08T18:31:08.613 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5289999999999997e-06 2024-05-08T18:31:08.613 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.613 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.613 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:08.613 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.948039+0000", 2024-05-08T18:31:08.613 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00081500599999999996 2024-05-08T18:31:08.613 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.613 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.613 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:08.613 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.948230+0000", 2024-05-08T18:31:08.613 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000191838 2024-05-08T18:31:08.613 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.613 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.614 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:08.614 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.948606+0000", 2024-05-08T18:31:08.614 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00037547900000000001 2024-05-08T18:31:08.614 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.614 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.614 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:08.614 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.949406+0000", 2024-05-08T18:31:08.614 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000799674 2024-05-08T18:31:08.614 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.614 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.614 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:08.614 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.949630+0000", 2024-05-08T18:31:08.615 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00022474699999999999 2024-05-08T18:31:08.615 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.615 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.615 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:08.615 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.949664+0000", 2024-05-08T18:31:08.615 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3535999999999999e-05 2024-05-08T18:31:08.615 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.615 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.615 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:08.615 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.949707+0000", 2024-05-08T18:31:08.615 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3362999999999998e-05 2024-05-08T18:31:08.615 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:08.615 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:08.616 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:08.616 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.616 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.616 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:08.616 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.263796+0000", 2024-05-08T18:31:08.616 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 76.247137868999999, 2024-05-08T18:31:08.616 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0027788019999999999, 2024-05-08T18:31:08.616 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:08.616 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:08.616 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:08.616 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:08.616 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:08.617 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:08.617 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 811 2024-05-08T18:31:08.617 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.617 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:08.617 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.617 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:08.617 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263796+0000", 2024-05-08T18:31:08.617 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:08.617 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.617 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.617 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:08.617 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263796+0000", 2024-05-08T18:31:08.618 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:08.618 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.618 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.618 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:08.618 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263799+0000", 2024-05-08T18:31:08.618 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5569999999999998e-06 2024-05-08T18:31:08.618 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.618 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.618 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:08.618 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263812+0000", 2024-05-08T18:31:08.618 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3145999999999999e-05 2024-05-08T18:31:08.618 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.619 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.619 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:08.619 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263842+0000", 2024-05-08T18:31:08.619 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0193e-05 2024-05-08T18:31:08.619 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.619 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.619 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:08.619 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263860+0000", 2024-05-08T18:31:08.619 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7880000000000002e-05 2024-05-08T18:31:08.619 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.619 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.619 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:08.619 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263979+0000", 2024-05-08T18:31:08.620 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011919899999999999 2024-05-08T18:31:08.620 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.620 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.620 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:08.620 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.264222+0000", 2024-05-08T18:31:08.620 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024290800000000001 2024-05-08T18:31:08.620 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.620 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.620 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:08.620 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.264545+0000", 2024-05-08T18:31:08.620 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00032300200000000002 2024-05-08T18:31:08.620 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.620 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.621 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:08.621 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.265682+0000", 2024-05-08T18:31:08.621 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001136464 2024-05-08T18:31:08.621 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.621 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.621 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:08.621 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.266397+0000", 2024-05-08T18:31:08.621 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00071512799999999999 2024-05-08T18:31:08.621 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.621 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.621 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:08.621 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.266504+0000", 2024-05-08T18:31:08.621 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000107019 2024-05-08T18:31:08.622 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.622 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.622 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:08.622 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.266575+0000", 2024-05-08T18:31:08.622 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1305999999999998e-05 2024-05-08T18:31:08.622 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:08.622 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:08.622 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:08.622 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.622 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.622 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:08.622 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.445706+0000", 2024-05-08T18:31:08.622 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 76.065228153000007, 2024-05-08T18:31:08.622 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0026820630000000002, 2024-05-08T18:31:08.623 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:08.623 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:08.623 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:08.623 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:08.623 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:08.623 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:08.623 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 889 2024-05-08T18:31:08.623 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.623 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:08.623 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.623 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:08.623 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445706+0000", 2024-05-08T18:31:08.623 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:08.624 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.624 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.624 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:08.624 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445706+0000", 2024-05-08T18:31:08.624 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:08.624 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.624 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.624 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:08.624 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445709+0000", 2024-05-08T18:31:08.624 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0299999999999998e-06 2024-05-08T18:31:08.624 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.624 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.624 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:08.624 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445721+0000", 2024-05-08T18:31:08.625 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2366e-05 2024-05-08T18:31:08.625 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.625 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.625 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:08.625 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445752+0000", 2024-05-08T18:31:08.625 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0287e-05 2024-05-08T18:31:08.625 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.625 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.625 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:08.625 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445773+0000", 2024-05-08T18:31:08.625 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1367000000000001e-05 2024-05-08T18:31:08.626 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.626 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.626 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:08.626 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445892+0000", 2024-05-08T18:31:08.626 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000119311 2024-05-08T18:31:08.626 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.626 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.626 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:08.626 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.446158+0000", 2024-05-08T18:31:08.626 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000265441 2024-05-08T18:31:08.626 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.626 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.626 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:08.627 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.446465+0000", 2024-05-08T18:31:08.627 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00030754300000000002 2024-05-08T18:31:08.627 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.627 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.627 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:08.627 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.447511+0000", 2024-05-08T18:31:08.627 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001045975 2024-05-08T18:31:08.627 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.627 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.627 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:08.627 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.448171+0000", 2024-05-08T18:31:08.627 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00065971200000000002 2024-05-08T18:31:08.627 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.627 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.628 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:08.628 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.448273+0000", 2024-05-08T18:31:08.628 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000101592 2024-05-08T18:31:08.628 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.628 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.628 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:08.628 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.448388+0000", 2024-05-08T18:31:08.628 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115439 2024-05-08T18:31:08.628 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:08.628 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:08.628 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:08.628 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.629 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.629 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1020 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_add in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-05-08T18:31:08.629 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:30:21.842276+0000", 2024-05-08T18:31:08.629 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 46.668658612000002, 2024-05-08T18:31:08.629 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0025898760000000001, 2024-05-08T18:31:08.629 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:08.629 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:08.629 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:08.629 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:08.629 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:08.629 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:08.629 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1020 2024-05-08T18:31:08.629 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.629 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:08.629 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.630 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:08.630 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842276+0000", 2024-05-08T18:31:08.630 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:08.630 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.630 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.630 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:08.630 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842276+0000", 2024-05-08T18:31:08.630 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:08.630 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.630 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.630 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:08.630 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842278+0000", 2024-05-08T18:31:08.630 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6129999999999998e-06 2024-05-08T18:31:08.630 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.631 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.631 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:08.631 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842290+0000", 2024-05-08T18:31:08.631 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2187999999999999e-05 2024-05-08T18:31:08.631 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.631 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.631 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:08.631 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842319+0000", 2024-05-08T18:31:08.631 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8782e-05 2024-05-08T18:31:08.631 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.631 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.631 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:08.631 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842336+0000", 2024-05-08T18:31:08.631 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6826000000000001e-05 2024-05-08T18:31:08.631 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.632 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.632 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:08.632 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842450+0000", 2024-05-08T18:31:08.632 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000113829 2024-05-08T18:31:08.632 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.632 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.632 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:08.632 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842627+0000", 2024-05-08T18:31:08.632 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00017756599999999999 2024-05-08T18:31:08.632 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.632 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.632 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:08.632 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842794+0000", 2024-05-08T18:31:08.633 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000166866 2024-05-08T18:31:08.633 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.633 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.633 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:08.633 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.843540+0000", 2024-05-08T18:31:08.633 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00074611700000000003 2024-05-08T18:31:08.633 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.633 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.633 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:08.633 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.844762+0000", 2024-05-08T18:31:08.633 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012220309999999999 2024-05-08T18:31:08.633 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.633 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.634 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:08.634 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.844806+0000", 2024-05-08T18:31:08.634 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3414000000000001e-05 2024-05-08T18:31:08.634 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:08.634 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:08.634 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:08.634 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.844865+0000", 2024-05-08T18:31:08.634 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9644e-05 2024-05-08T18:31:08.634 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:08.634 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:08.634 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:08.634 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:08.634 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:08.634 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:08.636 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-08T18:31:08.636 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:31:08.635+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:31:08.693 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-08T18:31:08.736 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:31:08.735+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:31:08.827 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:08.827 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:31:08.827 INFO:teuthology.orchestra.run.smithi097.stdout: "num_ops": 0 2024-05-08T18:31:08.827 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:08.837 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:31:08.835+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:31:08.846 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-08T18:31:08.938 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:31:08.935+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:31:09.040 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:31:09.039+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:31:09.052 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:09.052 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:31:09.052 INFO:teuthology.orchestra.run.smithi097.stdout: "complaint_time": 30, 2024-05-08T18:31:09.052 INFO:teuthology.orchestra.run.smithi097.stdout: "num_blocked_ops": 0 2024-05-08T18:31:09.052 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:09.069 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-08T18:31:09.141 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:31:09.139+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:31:09.234 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:09.234 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2024-05-08T18:31:09.234 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2024-05-08T18:31:09.234 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-05-08T18:31:09.234 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.234 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4479.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-05-08T18:31:09.234 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:44.576320+0000", 2024-05-08T18:31:09.234 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 84.657978994999993, 2024-05-08T18:31:09.235 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019751892, 2024-05-08T18:31:09.235 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:09.235 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:09.235 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "reached pg", 2024-05-08T18:31:09.235 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:09.235 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4479", 2024-05-08T18:31:09.235 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3577501689", 2024-05-08T18:31:09.235 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 2 2024-05-08T18:31:09.235 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.235 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:09.235 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.235 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:09.235 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576320+0000", 2024-05-08T18:31:09.236 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:09.236 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.236 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.236 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:09.236 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576320+0000", 2024-05-08T18:31:09.236 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:09.236 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.236 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.236 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:09.236 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576323+0000", 2024-05-08T18:31:09.237 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.813e-06 2024-05-08T18:31:09.237 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.237 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.237 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:09.237 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576335+0000", 2024-05-08T18:31:09.237 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2330000000000001e-05 2024-05-08T18:31:09.237 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.237 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.238 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:09.238 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576367+0000", 2024-05-08T18:31:09.238 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2036999999999998e-05 2024-05-08T18:31:09.238 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.238 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.238 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:09.238 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576394+0000", 2024-05-08T18:31:09.238 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6529e-05 2024-05-08T18:31:09.238 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.238 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.238 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:09.239 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576550+0000", 2024-05-08T18:31:09.239 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000156718 2024-05-08T18:31:09.239 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.239 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.239 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-05-08T18:31:09.239 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576560+0000", 2024-05-08T18:31:09.239 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0040999999999999e-05 2024-05-08T18:31:09.239 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.239 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.239 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:09.239 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.587240+0000", 2024-05-08T18:31:09.239 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010679266999999999 2024-05-08T18:31:09.239 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.239 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.240 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2024-05-08T18:31:09.240 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.587266+0000", 2024-05-08T18:31:09.240 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6642e-05 2024-05-08T18:31:09.240 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.240 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.240 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:09.240 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.595882+0000", 2024-05-08T18:31:09.240 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0086159600000000006 2024-05-08T18:31:09.240 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.240 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.240 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:09.240 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.596072+0000", 2024-05-08T18:31:09.240 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000189555 2024-05-08T18:31:09.240 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:09.241 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:09.241 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:09.241 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.241 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.241 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:31:09.241 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:48.766182+0000", 2024-05-08T18:31:09.241 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 80.468116968000004, 2024-05-08T18:31:09.241 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031881209999999999, 2024-05-08T18:31:09.242 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:09.242 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:09.242 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:09.242 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:09.242 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:09.242 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:09.242 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 193 2024-05-08T18:31:09.242 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.242 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:09.242 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.242 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:09.242 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766182+0000", 2024-05-08T18:31:09.242 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:09.243 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.243 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.243 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:09.243 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766182+0000", 2024-05-08T18:31:09.243 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:09.243 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.243 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.243 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:09.243 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766184+0000", 2024-05-08T18:31:09.243 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4159999999999998e-06 2024-05-08T18:31:09.243 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.243 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.243 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:09.244 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766196+0000", 2024-05-08T18:31:09.244 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1814000000000001e-05 2024-05-08T18:31:09.244 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.244 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.244 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:09.244 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766227+0000", 2024-05-08T18:31:09.244 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0676000000000002e-05 2024-05-08T18:31:09.244 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.244 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.244 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:09.244 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766242+0000", 2024-05-08T18:31:09.244 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5497000000000001e-05 2024-05-08T18:31:09.245 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.245 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.245 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:09.245 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766354+0000", 2024-05-08T18:31:09.245 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000111579 2024-05-08T18:31:09.245 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.245 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.245 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:09.245 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766569+0000", 2024-05-08T18:31:09.245 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000214978 2024-05-08T18:31:09.246 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.246 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.246 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:09.246 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766834+0000", 2024-05-08T18:31:09.246 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00026551500000000002 2024-05-08T18:31:09.246 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.246 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.246 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:09.246 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.768577+0000", 2024-05-08T18:31:09.246 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001742513 2024-05-08T18:31:09.246 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.246 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.247 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:09.247 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.769150+0000", 2024-05-08T18:31:09.247 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00057320500000000003 2024-05-08T18:31:09.247 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.247 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.247 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:09.247 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.769250+0000", 2024-05-08T18:31:09.247 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.9846000000000006e-05 2024-05-08T18:31:09.247 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.247 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.247 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:09.247 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.769370+0000", 2024-05-08T18:31:09.247 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012008200000000001 2024-05-08T18:31:09.248 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:09.248 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:09.248 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:09.248 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.248 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.248 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:09.248 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.679562+0000", 2024-05-08T18:31:09.248 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 77.554737263999996, 2024-05-08T18:31:09.248 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0086320800000000003, 2024-05-08T18:31:09.249 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:09.249 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:09.249 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:09.249 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:09.249 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:09.249 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:09.249 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 208 2024-05-08T18:31:09.249 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.249 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:09.249 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.249 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:09.249 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679562+0000", 2024-05-08T18:31:09.249 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:09.249 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.250 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.250 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:09.250 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679562+0000", 2024-05-08T18:31:09.250 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:09.250 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.250 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.250 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:09.250 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679565+0000", 2024-05-08T18:31:09.250 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0800000000000002e-06 2024-05-08T18:31:09.250 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.250 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.250 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:09.251 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679578+0000", 2024-05-08T18:31:09.251 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3217000000000001e-05 2024-05-08T18:31:09.251 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.251 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.251 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:09.251 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679610+0000", 2024-05-08T18:31:09.251 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1696000000000003e-05 2024-05-08T18:31:09.251 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.251 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.251 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:09.251 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679625+0000", 2024-05-08T18:31:09.252 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5824e-05 2024-05-08T18:31:09.252 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.252 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.252 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:09.252 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679758+0000", 2024-05-08T18:31:09.252 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013231199999999999 2024-05-08T18:31:09.252 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.252 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.253 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-05-08T18:31:09.253 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679770+0000", 2024-05-08T18:31:09.253 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1800000000000001e-05 2024-05-08T18:31:09.253 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.253 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.253 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:09.253 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.685241+0000", 2024-05-08T18:31:09.253 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0054710169999999999 2024-05-08T18:31:09.253 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.253 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.253 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:09.253 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.685444+0000", 2024-05-08T18:31:09.253 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000203835 2024-05-08T18:31:09.253 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.254 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.254 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:09.254 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.685842+0000", 2024-05-08T18:31:09.254 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00039773 2024-05-08T18:31:09.254 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.254 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.254 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:09.254 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.687232+0000", 2024-05-08T18:31:09.254 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00139011 2024-05-08T18:31:09.254 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.254 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.254 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:09.254 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.688049+0000", 2024-05-08T18:31:09.255 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00081667000000000003 2024-05-08T18:31:09.255 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.255 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.255 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:09.255 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.688135+0000", 2024-05-08T18:31:09.255 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6299999999999997e-05 2024-05-08T18:31:09.255 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.255 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.255 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:09.255 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.688194+0000", 2024-05-08T18:31:09.256 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8489000000000002e-05 2024-05-08T18:31:09.256 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:09.256 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:09.256 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:09.256 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.256 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.256 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:09.256 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.707114+0000", 2024-05-08T18:31:09.256 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 77.527185250000002, 2024-05-08T18:31:09.256 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031802990000000001, 2024-05-08T18:31:09.256 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:09.256 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:09.257 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:09.257 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:09.257 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:09.257 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:09.257 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 212 2024-05-08T18:31:09.257 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.257 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:09.257 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.257 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:09.257 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707114+0000", 2024-05-08T18:31:09.257 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:09.257 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.257 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.257 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:09.258 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707114+0000", 2024-05-08T18:31:09.258 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:09.258 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.258 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.258 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:09.258 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707117+0000", 2024-05-08T18:31:09.258 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8629999999999999e-06 2024-05-08T18:31:09.258 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.258 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.258 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:09.258 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707129+0000", 2024-05-08T18:31:09.258 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2150000000000001e-05 2024-05-08T18:31:09.258 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.259 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.259 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:09.259 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707158+0000", 2024-05-08T18:31:09.259 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9513999999999999e-05 2024-05-08T18:31:09.259 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.259 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.259 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:09.259 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707173+0000", 2024-05-08T18:31:09.260 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5136e-05 2024-05-08T18:31:09.260 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.260 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.260 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:09.260 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707309+0000", 2024-05-08T18:31:09.260 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000135609 2024-05-08T18:31:09.260 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.260 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.260 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:09.260 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707523+0000", 2024-05-08T18:31:09.260 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021362200000000001 2024-05-08T18:31:09.260 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.260 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.260 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:09.261 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707918+0000", 2024-05-08T18:31:09.261 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00039556299999999998 2024-05-08T18:31:09.261 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.261 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.261 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:09.261 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.709166+0000", 2024-05-08T18:31:09.261 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012476410000000001 2024-05-08T18:31:09.261 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.261 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.261 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:09.261 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.710145+0000", 2024-05-08T18:31:09.261 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00097909899999999998 2024-05-08T18:31:09.261 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.261 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.261 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:09.262 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.710231+0000", 2024-05-08T18:31:09.262 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5625999999999996e-05 2024-05-08T18:31:09.262 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.262 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.262 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:09.262 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.710294+0000", 2024-05-08T18:31:09.262 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3476e-05 2024-05-08T18:31:09.262 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:09.262 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:09.262 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:09.262 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.263 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.263 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:09.263 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.731985+0000", 2024-05-08T18:31:09.263 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 77.502314025000004, 2024-05-08T18:31:09.263 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0039250600000000002, 2024-05-08T18:31:09.263 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:09.266 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:09.266 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:09.266 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:09.266 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:09.266 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:09.266 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 219 2024-05-08T18:31:09.266 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.267 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:09.267 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.267 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:09.267 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731985+0000", 2024-05-08T18:31:09.267 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:09.267 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.267 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.267 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:09.267 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731985+0000", 2024-05-08T18:31:09.267 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:09.267 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.267 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.267 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:09.268 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731988+0000", 2024-05-08T18:31:09.268 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6599999999999999e-06 2024-05-08T18:31:09.268 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.268 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.268 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:09.268 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.732017+0000", 2024-05-08T18:31:09.268 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9692999999999998e-05 2024-05-08T18:31:09.268 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.268 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.268 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:09.268 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.732048+0000", 2024-05-08T18:31:09.268 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1066999999999999e-05 2024-05-08T18:31:09.268 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.268 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.269 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:09.269 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.732064+0000", 2024-05-08T18:31:09.269 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5786000000000001e-05 2024-05-08T18:31:09.269 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.269 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.269 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:09.269 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.732213+0000", 2024-05-08T18:31:09.269 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014895899999999999 2024-05-08T18:31:09.269 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.269 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.269 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:09.270 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.732572+0000", 2024-05-08T18:31:09.270 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000358904 2024-05-08T18:31:09.270 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.270 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.270 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:09.270 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.733349+0000", 2024-05-08T18:31:09.270 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00077657699999999997 2024-05-08T18:31:09.270 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.270 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.271 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:09.271 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.734899+0000", 2024-05-08T18:31:09.271 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001550652 2024-05-08T18:31:09.271 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.271 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.271 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:09.271 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.735641+0000", 2024-05-08T18:31:09.271 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00074222000000000003 2024-05-08T18:31:09.271 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.271 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.271 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:09.271 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.735801+0000", 2024-05-08T18:31:09.271 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015913599999999999 2024-05-08T18:31:09.271 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.271 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.272 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:09.272 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.735910+0000", 2024-05-08T18:31:09.272 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000109406 2024-05-08T18:31:09.272 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:09.272 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:09.272 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:09.272 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.272 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.272 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:09.272 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.750251+0000", 2024-05-08T18:31:09.272 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 77.484048092999998, 2024-05-08T18:31:09.272 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0038408600000000002, 2024-05-08T18:31:09.272 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:09.272 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:09.273 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:09.273 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:09.273 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:09.273 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:09.273 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 224 2024-05-08T18:31:09.273 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.273 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:09.273 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.273 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:09.274 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750251+0000", 2024-05-08T18:31:09.274 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:09.274 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.274 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.274 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:09.274 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750251+0000", 2024-05-08T18:31:09.274 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:09.274 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.274 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.274 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:09.275 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750253+0000", 2024-05-08T18:31:09.275 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2129999999999998e-06 2024-05-08T18:31:09.275 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.275 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.275 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:09.275 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750265+0000", 2024-05-08T18:31:09.275 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1484000000000001e-05 2024-05-08T18:31:09.275 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.275 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.275 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:09.275 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750293+0000", 2024-05-08T18:31:09.275 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8673000000000001e-05 2024-05-08T18:31:09.275 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.275 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.276 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:09.276 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750308+0000", 2024-05-08T18:31:09.276 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4620000000000001e-05 2024-05-08T18:31:09.276 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.276 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.276 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:09.276 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750459+0000", 2024-05-08T18:31:09.276 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000151619 2024-05-08T18:31:09.276 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.276 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.277 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:09.277 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750822+0000", 2024-05-08T18:31:09.277 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000362467 2024-05-08T18:31:09.277 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.277 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.277 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:09.277 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.751591+0000", 2024-05-08T18:31:09.277 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00076934699999999998 2024-05-08T18:31:09.278 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.278 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.278 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:09.278 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.753042+0000", 2024-05-08T18:31:09.278 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001450652 2024-05-08T18:31:09.278 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.278 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.278 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:09.278 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.753792+0000", 2024-05-08T18:31:09.278 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00075045500000000002 2024-05-08T18:31:09.278 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.278 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.278 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:09.279 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.753977+0000", 2024-05-08T18:31:09.279 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000184511 2024-05-08T18:31:09.279 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.279 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.279 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:09.279 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.754092+0000", 2024-05-08T18:31:09.279 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000114819 2024-05-08T18:31:09.279 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:09.279 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:09.279 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:09.280 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.280 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.280 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:09.280 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.783902+0000", 2024-05-08T18:31:09.280 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 77.450397362000004, 2024-05-08T18:31:09.280 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003120046, 2024-05-08T18:31:09.280 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:09.280 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:09.280 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:09.280 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:09.280 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:09.280 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:09.281 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 233 2024-05-08T18:31:09.281 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.281 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:09.281 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.281 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:09.281 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.783902+0000", 2024-05-08T18:31:09.281 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:09.281 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.281 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.281 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:09.281 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.783902+0000", 2024-05-08T18:31:09.282 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:09.282 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.282 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.282 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:09.282 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.783904+0000", 2024-05-08T18:31:09.282 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5229999999999998e-06 2024-05-08T18:31:09.282 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.282 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.282 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:09.282 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.783916+0000", 2024-05-08T18:31:09.282 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1513e-05 2024-05-08T18:31:09.282 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.282 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.283 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:09.283 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.783947+0000", 2024-05-08T18:31:09.283 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1353000000000003e-05 2024-05-08T18:31:09.283 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.283 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.283 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:09.283 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.783964+0000", 2024-05-08T18:31:09.283 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6643e-05 2024-05-08T18:31:09.283 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.283 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.283 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:09.284 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.784110+0000", 2024-05-08T18:31:09.284 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014627299999999999 2024-05-08T18:31:09.284 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.284 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.284 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:09.284 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.784329+0000", 2024-05-08T18:31:09.284 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021892099999999999 2024-05-08T18:31:09.284 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.284 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.284 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:09.285 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.784752+0000", 2024-05-08T18:31:09.285 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00042336700000000001 2024-05-08T18:31:09.285 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.285 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.285 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:09.285 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.786093+0000", 2024-05-08T18:31:09.285 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00134107 2024-05-08T18:31:09.285 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.285 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.285 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:09.285 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.786863+0000", 2024-05-08T18:31:09.285 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00076949099999999997 2024-05-08T18:31:09.286 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.286 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.286 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:09.286 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.786955+0000", 2024-05-08T18:31:09.286 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.2478999999999993e-05 2024-05-08T18:31:09.286 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.286 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.286 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:09.286 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.787022+0000", 2024-05-08T18:31:09.286 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6413000000000003e-05 2024-05-08T18:31:09.286 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:09.286 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:09.286 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:09.287 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.287 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.287 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:341 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:09.287 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.816045+0000", 2024-05-08T18:31:09.287 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 77.418254024999996, 2024-05-08T18:31:09.287 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002875154, 2024-05-08T18:31:09.287 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:09.287 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:09.287 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:09.287 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:09.287 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:09.288 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:09.288 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 341 2024-05-08T18:31:09.288 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.288 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:09.288 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.288 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:09.288 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816045+0000", 2024-05-08T18:31:09.288 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:09.289 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.289 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.289 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:09.289 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816045+0000", 2024-05-08T18:31:09.289 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:09.289 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.289 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.289 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:09.289 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816046+0000", 2024-05-08T18:31:09.289 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9199999999999999e-07 2024-05-08T18:31:09.289 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.289 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.289 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:09.290 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816050+0000", 2024-05-08T18:31:09.290 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0260000000000001e-06 2024-05-08T18:31:09.290 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.290 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.290 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:09.290 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816060+0000", 2024-05-08T18:31:09.290 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0297e-05 2024-05-08T18:31:09.290 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.290 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.290 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:09.290 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816065+0000", 2024-05-08T18:31:09.290 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.237e-06 2024-05-08T18:31:09.290 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.291 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.291 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:09.291 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816122+0000", 2024-05-08T18:31:09.291 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6168000000000002e-05 2024-05-08T18:31:09.291 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.291 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.291 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:09.291 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816198+0000", 2024-05-08T18:31:09.291 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6511e-05 2024-05-08T18:31:09.292 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.292 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.292 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:31:09.292 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816305+0000", 2024-05-08T18:31:09.292 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000106487 2024-05-08T18:31:09.292 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.292 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.292 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:09.292 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816886+0000", 2024-05-08T18:31:09.292 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00058187199999999999 2024-05-08T18:31:09.292 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.292 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.293 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:09.293 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.818821+0000", 2024-05-08T18:31:09.293 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001934362 2024-05-08T18:31:09.293 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.293 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.293 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:09.293 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.818880+0000", 2024-05-08T18:31:09.293 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9210999999999999e-05 2024-05-08T18:31:09.293 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.293 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.293 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:09.293 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.818920+0000", 2024-05-08T18:31:09.293 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0091e-05 2024-05-08T18:31:09.293 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:09.294 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:09.294 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:09.294 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.294 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.294 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:09.294 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.086431+0000", 2024-05-08T18:31:09.294 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 77.147868204999995, 2024-05-08T18:31:09.294 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028335959999999999, 2024-05-08T18:31:09.294 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:09.294 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:09.294 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:09.294 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:09.294 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:09.295 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:09.295 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 733 2024-05-08T18:31:09.295 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.295 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:09.295 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.295 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:09.295 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086431+0000", 2024-05-08T18:31:09.295 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:09.295 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.295 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.296 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:09.296 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086431+0000", 2024-05-08T18:31:09.296 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:09.296 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.296 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.296 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:09.296 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086433+0000", 2024-05-08T18:31:09.296 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8899999999999999e-06 2024-05-08T18:31:09.296 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.296 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.296 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:09.296 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086441+0000", 2024-05-08T18:31:09.296 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.3100000000000001e-06 2024-05-08T18:31:09.297 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.297 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.297 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:09.297 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086460+0000", 2024-05-08T18:31:09.297 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8703999999999999e-05 2024-05-08T18:31:09.297 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.297 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.297 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:09.297 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086471+0000", 2024-05-08T18:31:09.297 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1324e-05 2024-05-08T18:31:09.297 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.297 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.297 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:09.297 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086590+0000", 2024-05-08T18:31:09.298 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000118625 2024-05-08T18:31:09.298 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.298 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.298 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:09.298 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086817+0000", 2024-05-08T18:31:09.298 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000226958 2024-05-08T18:31:09.298 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.298 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.298 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:09.298 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.087131+0000", 2024-05-08T18:31:09.298 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00031478799999999998 2024-05-08T18:31:09.298 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.298 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.298 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:09.299 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.088025+0000", 2024-05-08T18:31:09.299 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00089402999999999998 2024-05-08T18:31:09.299 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.299 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.299 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:09.299 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.089123+0000", 2024-05-08T18:31:09.299 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001097598 2024-05-08T18:31:09.299 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.300 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.300 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:09.300 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.089200+0000", 2024-05-08T18:31:09.300 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7333e-05 2024-05-08T18:31:09.300 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.300 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.300 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:09.300 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.089264+0000", 2024-05-08T18:31:09.300 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.4035999999999995e-05 2024-05-08T18:31:09.300 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:09.300 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:09.300 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:09.300 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.300 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.301 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:751 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:09.301 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.125611+0000", 2024-05-08T18:31:09.301 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 77.108687513000007, 2024-05-08T18:31:09.301 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032716749999999999, 2024-05-08T18:31:09.301 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:09.301 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:09.301 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:09.301 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:09.301 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:09.301 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:09.301 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 751 2024-05-08T18:31:09.301 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.301 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:09.302 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.302 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:09.302 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125611+0000", 2024-05-08T18:31:09.302 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:09.302 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.302 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.302 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:09.302 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125611+0000", 2024-05-08T18:31:09.303 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:09.303 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.303 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.303 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:09.303 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125614+0000", 2024-05-08T18:31:09.303 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.12e-06 2024-05-08T18:31:09.303 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.303 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.303 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:09.303 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125624+0000", 2024-05-08T18:31:09.304 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0492999999999999e-05 2024-05-08T18:31:09.304 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.304 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.304 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:09.304 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125650+0000", 2024-05-08T18:31:09.304 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5907000000000001e-05 2024-05-08T18:31:09.304 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.304 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.304 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:09.304 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125667+0000", 2024-05-08T18:31:09.304 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.694e-05 2024-05-08T18:31:09.304 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.304 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.304 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:09.305 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125801+0000", 2024-05-08T18:31:09.305 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000134482 2024-05-08T18:31:09.305 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.305 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.305 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:09.305 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.126174+0000", 2024-05-08T18:31:09.305 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00037294999999999999 2024-05-08T18:31:09.305 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.305 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.305 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:09.305 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.126750+0000", 2024-05-08T18:31:09.305 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00057538900000000004 2024-05-08T18:31:09.305 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.305 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.306 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:09.306 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.127997+0000", 2024-05-08T18:31:09.306 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001247761 2024-05-08T18:31:09.306 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.306 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.306 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:09.306 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.128731+0000", 2024-05-08T18:31:09.306 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00073338099999999996 2024-05-08T18:31:09.306 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.306 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.306 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:09.306 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.128817+0000", 2024-05-08T18:31:09.306 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5993000000000002e-05 2024-05-08T18:31:09.307 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.307 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.307 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:09.307 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.128883+0000", 2024-05-08T18:31:09.307 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6259000000000004e-05 2024-05-08T18:31:09.307 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:09.307 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:09.307 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:09.307 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.307 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.308 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:753 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:09.308 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.129809+0000", 2024-05-08T18:31:09.308 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 77.104489975000007, 2024-05-08T18:31:09.308 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0033775440000000001, 2024-05-08T18:31:09.308 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:09.308 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:09.309 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:09.309 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:09.309 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:09.309 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:09.309 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 753 2024-05-08T18:31:09.309 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.310 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:09.310 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.310 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:09.310 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129809+0000", 2024-05-08T18:31:09.310 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:09.310 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.310 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.310 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:09.310 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129809+0000", 2024-05-08T18:31:09.310 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:09.311 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.311 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.311 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:09.311 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129811+0000", 2024-05-08T18:31:09.311 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1730000000000002e-06 2024-05-08T18:31:09.311 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.311 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.311 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:09.311 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129822+0000", 2024-05-08T18:31:09.311 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0583e-05 2024-05-08T18:31:09.311 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.311 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.311 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:09.311 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129852+0000", 2024-05-08T18:31:09.312 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0744000000000002e-05 2024-05-08T18:31:09.312 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.312 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.312 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:09.312 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129870+0000", 2024-05-08T18:31:09.312 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7955999999999999e-05 2024-05-08T18:31:09.312 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.312 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.312 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:09.312 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.130018+0000", 2024-05-08T18:31:09.312 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014747600000000001 2024-05-08T18:31:09.312 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.312 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.312 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:09.312 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.130259+0000", 2024-05-08T18:31:09.313 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024079099999999999 2024-05-08T18:31:09.313 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.313 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.313 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:09.313 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.130734+0000", 2024-05-08T18:31:09.313 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00047562 2024-05-08T18:31:09.313 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.313 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.313 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:09.313 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.131997+0000", 2024-05-08T18:31:09.313 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012626429999999999 2024-05-08T18:31:09.313 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.313 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.314 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:09.314 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.132923+0000", 2024-05-08T18:31:09.314 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00092627599999999997 2024-05-08T18:31:09.314 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.314 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.314 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:09.314 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.133076+0000", 2024-05-08T18:31:09.314 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000152989 2024-05-08T18:31:09.314 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.314 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.314 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:09.314 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.133187+0000", 2024-05-08T18:31:09.314 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000110293 2024-05-08T18:31:09.314 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:09.315 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:09.315 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:09.315 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.315 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.315 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:09.315 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.228247+0000", 2024-05-08T18:31:09.315 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 77.006052365000002, 2024-05-08T18:31:09.315 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032753449999999998, 2024-05-08T18:31:09.315 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:09.315 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:09.315 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:09.315 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:09.315 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:09.315 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:09.316 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 796 2024-05-08T18:31:09.316 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.316 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:09.316 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.316 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:09.316 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228247+0000", 2024-05-08T18:31:09.316 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:09.316 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.316 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.316 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:09.316 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228247+0000", 2024-05-08T18:31:09.316 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:09.316 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.316 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.317 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:09.317 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228249+0000", 2024-05-08T18:31:09.317 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3800000000000001e-06 2024-05-08T18:31:09.317 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.317 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.317 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:09.317 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228260+0000", 2024-05-08T18:31:09.317 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1496e-05 2024-05-08T18:31:09.317 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.317 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.317 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:09.317 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228292+0000", 2024-05-08T18:31:09.317 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1294000000000002e-05 2024-05-08T18:31:09.317 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.318 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.318 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:09.318 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228306+0000", 2024-05-08T18:31:09.318 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4606e-05 2024-05-08T18:31:09.318 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.318 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.319 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:09.319 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228443+0000", 2024-05-08T18:31:09.319 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013672599999999999 2024-05-08T18:31:09.319 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.319 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.319 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:09.319 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228813+0000", 2024-05-08T18:31:09.319 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00036987000000000001 2024-05-08T18:31:09.319 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.319 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.319 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:31:09.319 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.229365+0000", 2024-05-08T18:31:09.319 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00055210600000000002 2024-05-08T18:31:09.319 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.320 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.320 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:09.320 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.230800+0000", 2024-05-08T18:31:09.320 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001435006 2024-05-08T18:31:09.320 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.320 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.320 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:09.320 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.231369+0000", 2024-05-08T18:31:09.320 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00056848499999999998 2024-05-08T18:31:09.320 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.321 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.321 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:09.321 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.231455+0000", 2024-05-08T18:31:09.321 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6905999999999998e-05 2024-05-08T18:31:09.321 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.321 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.322 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:09.322 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.231522+0000", 2024-05-08T18:31:09.322 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6470000000000006e-05 2024-05-08T18:31:09.322 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:09.322 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:09.322 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:09.322 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.322 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.322 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:798 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:09.322 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.232573+0000", 2024-05-08T18:31:09.322 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 77.001726258000005, 2024-05-08T18:31:09.322 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0030406690000000002, 2024-05-08T18:31:09.322 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:09.323 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:09.323 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:09.323 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:09.323 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:09.323 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:09.323 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 798 2024-05-08T18:31:09.323 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.323 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:09.323 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.323 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:09.323 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232573+0000", 2024-05-08T18:31:09.323 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:09.323 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.323 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.324 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:09.324 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232573+0000", 2024-05-08T18:31:09.324 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:09.324 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.324 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.324 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:09.324 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232574+0000", 2024-05-08T18:31:09.324 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.446e-06 2024-05-08T18:31:09.324 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.324 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.324 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:09.324 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232581+0000", 2024-05-08T18:31:09.324 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.0670000000000003e-06 2024-05-08T18:31:09.324 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.325 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.325 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:09.325 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232600+0000", 2024-05-08T18:31:09.325 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8822999999999999e-05 2024-05-08T18:31:09.325 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.325 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.325 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:09.325 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232611+0000", 2024-05-08T18:31:09.325 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1233000000000001e-05 2024-05-08T18:31:09.325 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.325 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.325 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:09.325 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232731+0000", 2024-05-08T18:31:09.325 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000120189 2024-05-08T18:31:09.326 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.326 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.326 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:09.326 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232963+0000", 2024-05-08T18:31:09.326 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023111900000000001 2024-05-08T18:31:09.326 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.326 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.326 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:31:09.326 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.233441+0000", 2024-05-08T18:31:09.326 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00047866899999999998 2024-05-08T18:31:09.326 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.326 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.326 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:09.327 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.234542+0000", 2024-05-08T18:31:09.327 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001101245 2024-05-08T18:31:09.327 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.327 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.327 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:09.327 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.235349+0000", 2024-05-08T18:31:09.327 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000806567 2024-05-08T18:31:09.327 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.327 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.327 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:09.327 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.235498+0000", 2024-05-08T18:31:09.327 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014907200000000001 2024-05-08T18:31:09.327 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.327 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.327 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:09.328 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.235613+0000", 2024-05-08T18:31:09.328 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115239 2024-05-08T18:31:09.328 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:09.328 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:09.328 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:09.328 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.328 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.328 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:09.328 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.248596+0000", 2024-05-08T18:31:09.328 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 76.985702451999998, 2024-05-08T18:31:09.328 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002919984, 2024-05-08T18:31:09.328 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:09.328 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:09.328 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:09.329 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:09.329 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:09.329 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:09.329 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 805 2024-05-08T18:31:09.329 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.329 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:09.329 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.329 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:09.329 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248596+0000", 2024-05-08T18:31:09.329 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:09.329 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.329 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.329 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:09.329 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248596+0000", 2024-05-08T18:31:09.330 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:09.330 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.330 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.330 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:09.330 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248599+0000", 2024-05-08T18:31:09.330 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3630000000000001e-06 2024-05-08T18:31:09.330 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.330 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.330 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:09.330 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248610+0000", 2024-05-08T18:31:09.330 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1267000000000001e-05 2024-05-08T18:31:09.330 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.330 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.330 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:09.331 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248641+0000", 2024-05-08T18:31:09.331 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1309999999999997e-05 2024-05-08T18:31:09.331 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.331 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.331 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:09.331 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248656+0000", 2024-05-08T18:31:09.331 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4449e-05 2024-05-08T18:31:09.331 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.331 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.331 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:09.331 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248781+0000", 2024-05-08T18:31:09.331 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012500900000000001 2024-05-08T18:31:09.331 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.331 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.332 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:09.332 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.249001+0000", 2024-05-08T18:31:09.332 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021963500000000001 2024-05-08T18:31:09.332 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.332 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.332 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:09.332 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.249341+0000", 2024-05-08T18:31:09.332 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00034004100000000002 2024-05-08T18:31:09.332 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.332 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.332 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:09.332 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.250473+0000", 2024-05-08T18:31:09.332 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0011324180000000001 2024-05-08T18:31:09.332 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.333 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.333 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:09.333 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.251230+0000", 2024-05-08T18:31:09.333 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00075751400000000004 2024-05-08T18:31:09.333 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.333 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.333 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:09.333 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.251394+0000", 2024-05-08T18:31:09.333 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016379200000000001 2024-05-08T18:31:09.333 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.333 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.333 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:09.333 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.251516+0000", 2024-05-08T18:31:09.333 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012218600000000001 2024-05-08T18:31:09.334 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:09.334 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:09.334 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:09.334 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.334 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.334 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:09.334 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.313184+0000", 2024-05-08T18:31:09.334 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 76.921114777, 2024-05-08T18:31:09.334 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003040016, 2024-05-08T18:31:09.334 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:09.334 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:09.334 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:09.334 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:09.335 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:09.335 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:09.335 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 832 2024-05-08T18:31:09.335 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.335 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:09.335 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.335 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:09.335 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313184+0000", 2024-05-08T18:31:09.335 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:09.335 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.335 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.335 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:09.335 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313184+0000", 2024-05-08T18:31:09.335 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:09.336 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.336 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.336 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:09.336 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313187+0000", 2024-05-08T18:31:09.336 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5100000000000001e-06 2024-05-08T18:31:09.336 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.336 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.336 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:09.336 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313199+0000", 2024-05-08T18:31:09.336 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.201e-05 2024-05-08T18:31:09.336 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.336 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.336 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:09.336 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313229+0000", 2024-05-08T18:31:09.337 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9839e-05 2024-05-08T18:31:09.337 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.337 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.337 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:09.337 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313243+0000", 2024-05-08T18:31:09.337 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4727e-05 2024-05-08T18:31:09.337 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.337 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.337 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:09.337 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313358+0000", 2024-05-08T18:31:09.337 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115016 2024-05-08T18:31:09.337 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.337 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.337 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:09.338 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313577+0000", 2024-05-08T18:31:09.338 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021897799999999999 2024-05-08T18:31:09.338 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.338 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.338 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:31:09.338 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313889+0000", 2024-05-08T18:31:09.338 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00031210400000000001 2024-05-08T18:31:09.338 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.338 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.338 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:09.338 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.315229+0000", 2024-05-08T18:31:09.338 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001339963 2024-05-08T18:31:09.338 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.339 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.339 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:09.339 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.315938+0000", 2024-05-08T18:31:09.339 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00070853400000000003 2024-05-08T18:31:09.339 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.339 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.339 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:09.339 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.316111+0000", 2024-05-08T18:31:09.339 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000173396 2024-05-08T18:31:09.339 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.339 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.339 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:09.339 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.316224+0000", 2024-05-08T18:31:09.339 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000112939 2024-05-08T18:31:09.340 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:09.340 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:09.340 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:09.340 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.340 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.340 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:834 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:09.340 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.317499+0000", 2024-05-08T18:31:09.340 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 76.916799978, 2024-05-08T18:31:09.340 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0033281109999999999, 2024-05-08T18:31:09.340 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:09.340 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:09.340 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:09.340 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:09.340 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:09.341 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:09.341 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 834 2024-05-08T18:31:09.341 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.341 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:09.341 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.341 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:09.341 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317499+0000", 2024-05-08T18:31:09.341 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:09.341 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.341 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.341 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:09.341 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317499+0000", 2024-05-08T18:31:09.341 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:09.341 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.342 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.342 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:09.342 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317501+0000", 2024-05-08T18:31:09.342 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9400000000000001e-06 2024-05-08T18:31:09.342 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.342 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.342 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:09.342 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317511+0000", 2024-05-08T18:31:09.342 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0297e-05 2024-05-08T18:31:09.342 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.342 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.342 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:09.342 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317532+0000", 2024-05-08T18:31:09.343 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1013e-05 2024-05-08T18:31:09.343 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.343 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.343 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:09.343 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317543+0000", 2024-05-08T18:31:09.343 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0757000000000001e-05 2024-05-08T18:31:09.343 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.343 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.343 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:09.343 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317658+0000", 2024-05-08T18:31:09.343 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115129 2024-05-08T18:31:09.343 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.343 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.343 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:09.344 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317887+0000", 2024-05-08T18:31:09.344 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00022880099999999999 2024-05-08T18:31:09.344 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.344 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.344 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:31:09.344 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.318378+0000", 2024-05-08T18:31:09.344 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00049129000000000002 2024-05-08T18:31:09.344 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.344 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.344 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:09.344 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.319597+0000", 2024-05-08T18:31:09.344 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012188469999999999 2024-05-08T18:31:09.344 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.344 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.345 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:09.345 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.320566+0000", 2024-05-08T18:31:09.345 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00096881599999999995 2024-05-08T18:31:09.345 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.345 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.345 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:09.345 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.320713+0000", 2024-05-08T18:31:09.345 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014691500000000001 2024-05-08T18:31:09.345 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.345 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.345 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:09.345 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.320827+0000", 2024-05-08T18:31:09.345 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000114306 2024-05-08T18:31:09.345 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:09.346 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:09.346 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:09.346 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.346 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.346 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:09.346 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.505569+0000", 2024-05-08T18:31:09.346 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 76.728729525000006, 2024-05-08T18:31:09.346 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028584309999999998, 2024-05-08T18:31:09.346 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:09.346 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:09.346 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:09.346 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:09.346 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:09.346 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:09.347 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 916 2024-05-08T18:31:09.347 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.347 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:09.347 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.347 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:09.347 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505569+0000", 2024-05-08T18:31:09.347 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:09.347 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.347 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.347 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:09.347 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505569+0000", 2024-05-08T18:31:09.347 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:09.347 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.347 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.348 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:09.348 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505572+0000", 2024-05-08T18:31:09.348 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3659999999999999e-06 2024-05-08T18:31:09.348 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.348 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.348 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:09.348 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505583+0000", 2024-05-08T18:31:09.348 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1574e-05 2024-05-08T18:31:09.348 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.348 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.348 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:09.348 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505614+0000", 2024-05-08T18:31:09.348 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0670000000000003e-05 2024-05-08T18:31:09.348 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.349 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.349 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:09.349 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505629+0000", 2024-05-08T18:31:09.349 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5063e-05 2024-05-08T18:31:09.349 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.349 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.349 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:09.349 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505754+0000", 2024-05-08T18:31:09.349 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012508899999999999 2024-05-08T18:31:09.349 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.349 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.349 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:09.349 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505988+0000", 2024-05-08T18:31:09.349 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023334699999999999 2024-05-08T18:31:09.350 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.350 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.350 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:09.350 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.506299+0000", 2024-05-08T18:31:09.350 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000311811 2024-05-08T18:31:09.350 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.350 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.350 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:09.350 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.507489+0000", 2024-05-08T18:31:09.350 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0011899510000000001 2024-05-08T18:31:09.350 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.350 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.350 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:09.351 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.508141+0000", 2024-05-08T18:31:09.351 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00065180200000000005 2024-05-08T18:31:09.351 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.351 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.351 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:09.351 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.508306+0000", 2024-05-08T18:31:09.351 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016450199999999999 2024-05-08T18:31:09.351 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.351 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.351 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:09.351 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.508428+0000", 2024-05-08T18:31:09.351 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000122256 2024-05-08T18:31:09.351 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:09.351 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:09.352 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:09.352 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.352 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.352 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:918 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:09.352 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.509337+0000", 2024-05-08T18:31:09.352 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 76.724961457999996, 2024-05-08T18:31:09.352 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002971787, 2024-05-08T18:31:09.352 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:09.352 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:09.352 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:09.352 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:09.352 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:09.353 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:09.353 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 918 2024-05-08T18:31:09.353 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.353 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:09.353 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.353 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:09.353 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509337+0000", 2024-05-08T18:31:09.353 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:09.353 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.353 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.353 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:09.353 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509337+0000", 2024-05-08T18:31:09.353 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:09.353 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.354 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.354 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:09.354 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509340+0000", 2024-05-08T18:31:09.354 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2570000000000002e-06 2024-05-08T18:31:09.354 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.354 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.354 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:09.354 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509351+0000", 2024-05-08T18:31:09.354 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0933e-05 2024-05-08T18:31:09.354 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.354 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.354 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:09.354 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509382+0000", 2024-05-08T18:31:09.354 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1198999999999997e-05 2024-05-08T18:31:09.355 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.355 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.355 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:09.355 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509400+0000", 2024-05-08T18:31:09.355 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8236999999999998e-05 2024-05-08T18:31:09.355 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.355 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.355 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:09.355 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509529+0000", 2024-05-08T18:31:09.355 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012905600000000001 2024-05-08T18:31:09.355 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.355 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.355 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:09.355 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509777+0000", 2024-05-08T18:31:09.356 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024786799999999999 2024-05-08T18:31:09.356 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.356 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.356 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:09.356 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.510284+0000", 2024-05-08T18:31:09.356 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000506796 2024-05-08T18:31:09.356 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.356 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.356 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:09.356 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.511453+0000", 2024-05-08T18:31:09.356 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001169575 2024-05-08T18:31:09.356 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.356 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.356 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:09.356 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.512051+0000", 2024-05-08T18:31:09.357 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00059743100000000005 2024-05-08T18:31:09.357 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.357 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.357 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:09.357 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.512199+0000", 2024-05-08T18:31:09.357 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000148486 2024-05-08T18:31:09.357 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.357 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.357 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:09.357 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.512309+0000", 2024-05-08T18:31:09.357 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000109949 2024-05-08T18:31:09.357 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:09.357 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:09.357 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:09.358 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.358 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.358 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:931 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:09.358 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.543277+0000", 2024-05-08T18:31:09.358 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 76.691022302999997, 2024-05-08T18:31:09.358 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028250710000000002, 2024-05-08T18:31:09.358 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:09.358 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:09.358 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:09.358 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:09.358 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:09.358 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:09.358 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 931 2024-05-08T18:31:09.358 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.359 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:09.359 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.359 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:09.359 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543277+0000", 2024-05-08T18:31:09.359 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:09.359 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.359 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.359 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:09.359 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543277+0000", 2024-05-08T18:31:09.359 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:09.359 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.359 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.359 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:09.359 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543279+0000", 2024-05-08T18:31:09.360 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.373e-06 2024-05-08T18:31:09.360 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.360 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.360 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:09.360 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543291+0000", 2024-05-08T18:31:09.360 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1517e-05 2024-05-08T18:31:09.360 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.360 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.360 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:09.360 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543323+0000", 2024-05-08T18:31:09.360 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2292000000000002e-05 2024-05-08T18:31:09.360 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.360 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.360 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:09.360 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543340+0000", 2024-05-08T18:31:09.361 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.749e-05 2024-05-08T18:31:09.361 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.361 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.361 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:09.361 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543462+0000", 2024-05-08T18:31:09.361 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000121413 2024-05-08T18:31:09.361 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.361 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.361 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:09.361 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543681+0000", 2024-05-08T18:31:09.361 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021974200000000001 2024-05-08T18:31:09.361 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.361 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.361 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:31:09.362 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.544004+0000", 2024-05-08T18:31:09.362 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00032268900000000003 2024-05-08T18:31:09.362 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.362 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.362 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:09.362 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.545158+0000", 2024-05-08T18:31:09.362 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0011540190000000001 2024-05-08T18:31:09.362 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.362 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.362 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:09.362 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.545970+0000", 2024-05-08T18:31:09.362 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00081224300000000004 2024-05-08T18:31:09.362 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.363 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.363 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:09.363 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.546043+0000", 2024-05-08T18:31:09.363 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.3067999999999999e-05 2024-05-08T18:31:09.363 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.363 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.363 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:09.363 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.546102+0000", 2024-05-08T18:31:09.363 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8224999999999999e-05 2024-05-08T18:31:09.363 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:09.363 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:09.363 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:09.363 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.363 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.363 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:09.364 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.578568+0000", 2024-05-08T18:31:09.364 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 76.655731395999993, 2024-05-08T18:31:09.364 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0030345839999999999, 2024-05-08T18:31:09.364 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:09.364 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:09.364 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:09.364 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:09.364 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:09.364 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:09.364 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 946 2024-05-08T18:31:09.364 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.364 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:09.364 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.364 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:09.365 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578568+0000", 2024-05-08T18:31:09.365 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:09.365 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.365 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.365 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:09.365 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578568+0000", 2024-05-08T18:31:09.365 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:09.365 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.365 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.365 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:09.365 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578570+0000", 2024-05-08T18:31:09.365 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3700000000000002e-06 2024-05-08T18:31:09.365 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.365 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.366 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:09.366 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578582+0000", 2024-05-08T18:31:09.366 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1627000000000001e-05 2024-05-08T18:31:09.366 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.366 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.366 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:09.366 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578612+0000", 2024-05-08T18:31:09.366 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0103e-05 2024-05-08T18:31:09.366 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.366 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.366 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:09.366 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578627+0000", 2024-05-08T18:31:09.366 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4949999999999999e-05 2024-05-08T18:31:09.366 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.367 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.367 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:09.367 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578750+0000", 2024-05-08T18:31:09.367 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012309899999999999 2024-05-08T18:31:09.367 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.367 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.367 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:09.367 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.579042+0000", 2024-05-08T18:31:09.367 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00029212500000000001 2024-05-08T18:31:09.367 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.367 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.367 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:09.367 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.579557+0000", 2024-05-08T18:31:09.367 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00051536900000000001 2024-05-08T18:31:09.367 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.368 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.368 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:09.368 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.580698+0000", 2024-05-08T18:31:09.368 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001140774 2024-05-08T18:31:09.368 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.368 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.368 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:09.368 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.581367+0000", 2024-05-08T18:31:09.368 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00066884799999999999 2024-05-08T18:31:09.368 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.368 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.368 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:09.368 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.581489+0000", 2024-05-08T18:31:09.369 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012265600000000001 2024-05-08T18:31:09.369 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.369 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.369 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:09.369 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.581602+0000", 2024-05-08T18:31:09.369 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000112663 2024-05-08T18:31:09.369 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:09.369 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:09.369 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:09.369 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:09.369 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:09.369 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:09.371 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-08T18:31:09.371 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:31:09.371+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:31:09.472 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:31:09.471+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:31:09.529 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:09.529 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:31:09.529 INFO:teuthology.orchestra.run.smithi097.stdout: "num_ops": 0 2024-05-08T18:31:09.529 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:09.542 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-08T18:31:09.572 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:31:09.571+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:31:09.593 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-08T18:31:09.651 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:09.651 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:31:09.652 INFO:teuthology.orchestra.run.smithi097.stdout: "complaint_time": 30, 2024-05-08T18:31:09.652 INFO:teuthology.orchestra.run.smithi097.stdout: "num_blocked_ops": 0 2024-05-08T18:31:09.652 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:09.664 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-08T18:31:09.694 INFO:teuthology.orchestra.run.smithi097.stderr:nodeep-scrub is unset 2024-05-08T18:31:09.695 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:31:09.695+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:31:09.776 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:31:09.775+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:31:09.801 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2024-05-08T18:31:09.801 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:31:09.803 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:09.803 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2024-05-08T18:31:09.803 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2024-05-08T18:31:09.803 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-05-08T18:31:09.804 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.804 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4479.0:40 5.b 5:d797044f:::zonegroup_info.ea3b680f-900d-4805-81ec-055811625780:head [create,call version.set in=10b,writefull 0~436] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-05-08T18:31:09.804 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:44.637551+0000", 2024-05-08T18:31:09.804 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 85.166492848000004, 2024-05-08T18:31:09.804 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003054013, 2024-05-08T18:31:09.804 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:09.804 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:09.804 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:09.804 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:09.804 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4479", 2024-05-08T18:31:09.804 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3577501689", 2024-05-08T18:31:09.805 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 40 2024-05-08T18:31:09.805 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.805 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:09.805 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.805 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:09.805 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.637551+0000", 2024-05-08T18:31:09.805 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:09.805 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.805 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.805 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:09.805 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.637551+0000", 2024-05-08T18:31:09.806 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:09.806 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.806 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.806 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:09.806 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.637554+0000", 2024-05-08T18:31:09.806 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6599999999999999e-06 2024-05-08T18:31:09.806 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.806 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.806 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:09.806 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.637576+0000", 2024-05-08T18:31:09.806 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1965999999999999e-05 2024-05-08T18:31:09.806 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.807 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.807 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:09.807 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.637603+0000", 2024-05-08T18:31:09.807 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7257e-05 2024-05-08T18:31:09.807 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.807 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.807 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:09.807 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.637623+0000", 2024-05-08T18:31:09.807 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9570000000000001e-05 2024-05-08T18:31:09.807 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.807 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.807 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:09.808 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.637766+0000", 2024-05-08T18:31:09.808 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000143435 2024-05-08T18:31:09.808 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.808 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.808 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:09.808 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.638167+0000", 2024-05-08T18:31:09.808 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00040082399999999998 2024-05-08T18:31:09.808 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.808 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.808 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:09.808 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.638627+0000", 2024-05-08T18:31:09.808 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00046019300000000002 2024-05-08T18:31:09.808 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.809 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.809 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:09.809 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.640399+0000", 2024-05-08T18:31:09.809 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0017714199999999999 2024-05-08T18:31:09.809 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.809 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.809 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:09.809 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.640447+0000", 2024-05-08T18:31:09.809 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8383000000000001e-05 2024-05-08T18:31:09.809 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.809 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.809 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:09.809 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.640534+0000", 2024-05-08T18:31:09.809 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7078999999999998e-05 2024-05-08T18:31:09.810 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.810 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.810 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:09.810 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.640606+0000", 2024-05-08T18:31:09.810 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1225999999999999e-05 2024-05-08T18:31:09.810 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:09.810 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:09.810 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:09.810 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.810 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.810 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4479.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-05-08T18:31:09.810 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:44.643918+0000", 2024-05-08T18:31:09.810 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 85.160126572999999, 2024-05-08T18:31:09.811 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002986004, 2024-05-08T18:31:09.811 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:09.811 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:09.811 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:09.811 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:09.811 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4479", 2024-05-08T18:31:09.811 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3577501689", 2024-05-08T18:31:09.811 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 42 2024-05-08T18:31:09.811 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.811 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:09.811 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.811 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:09.812 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.643918+0000", 2024-05-08T18:31:09.812 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:09.812 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.812 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.812 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:09.812 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.643918+0000", 2024-05-08T18:31:09.812 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:09.812 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.812 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.812 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:09.812 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.643919+0000", 2024-05-08T18:31:09.812 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4729999999999999e-06 2024-05-08T18:31:09.812 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.812 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.813 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:09.813 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.643927+0000", 2024-05-08T18:31:09.813 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6389999999999992e-06 2024-05-08T18:31:09.813 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.813 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.813 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:09.813 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.643945+0000", 2024-05-08T18:31:09.813 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8195000000000001e-05 2024-05-08T18:31:09.813 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.813 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.813 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:09.813 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.643954+0000", 2024-05-08T18:31:09.813 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5210000000000002e-06 2024-05-08T18:31:09.813 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.814 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.814 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:09.814 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.644123+0000", 2024-05-08T18:31:09.814 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016904999999999999 2024-05-08T18:31:09.814 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.814 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.814 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:09.814 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.644315+0000", 2024-05-08T18:31:09.814 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00019202800000000001 2024-05-08T18:31:09.814 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.814 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.814 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:09.814 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.644505+0000", 2024-05-08T18:31:09.815 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000190552 2024-05-08T18:31:09.815 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.815 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.815 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:09.815 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.645877+0000", 2024-05-08T18:31:09.815 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001371702 2024-05-08T18:31:09.815 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.815 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.815 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:09.815 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.646778+0000", 2024-05-08T18:31:09.815 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00090065700000000002 2024-05-08T18:31:09.815 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.815 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.816 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:09.816 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.646843+0000", 2024-05-08T18:31:09.817 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5504000000000002e-05 2024-05-08T18:31:09.817 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.817 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.817 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:09.817 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.646904+0000", 2024-05-08T18:31:09.817 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0683000000000002e-05 2024-05-08T18:31:09.817 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:09.817 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:09.817 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:09.817 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.817 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.817 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:57 7.3 e30/29 7:c609908c:::notify.5:head v 30'2, mlcod=0'0)", 2024-05-08T18:31:09.817 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:48.669376+0000", 2024-05-08T18:31:09.818 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 81.134668465000004, 2024-05-08T18:31:09.818 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0041509479999999998, 2024-05-08T18:31:09.818 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:09.818 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:09.818 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:09.818 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:09.818 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.818 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:09.818 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669376+0000", 2024-05-08T18:31:09.818 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:09.818 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.818 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.819 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:09.819 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669376+0000", 2024-05-08T18:31:09.819 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:09.819 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.819 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.819 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:09.819 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669378+0000", 2024-05-08T18:31:09.819 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.79e-06 2024-05-08T18:31:09.819 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.819 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.819 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:09.819 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669393+0000", 2024-05-08T18:31:09.819 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5053e-05 2024-05-08T18:31:09.820 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.820 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.820 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:09.820 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669427+0000", 2024-05-08T18:31:09.820 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4326999999999998e-05 2024-05-08T18:31:09.820 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.820 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.820 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:09.820 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669451+0000", 2024-05-08T18:31:09.820 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3629e-05 2024-05-08T18:31:09.820 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.820 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.820 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:09.821 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669563+0000", 2024-05-08T18:31:09.821 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011251099999999999 2024-05-08T18:31:09.821 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.821 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.821 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:09.821 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669607+0000", 2024-05-08T18:31:09.821 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3877e-05 2024-05-08T18:31:09.821 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.821 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.821 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:09.821 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.673401+0000", 2024-05-08T18:31:09.821 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0037942819999999999 2024-05-08T18:31:09.821 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.822 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.822 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:09.822 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.673527+0000", 2024-05-08T18:31:09.822 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012547900000000001 2024-05-08T18:31:09.822 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:09.822 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:09.822 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:09.822 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.822 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.822 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:58 7.14 e30/29 7:2b04a3e9:::notify.6:head v 30'1, mlcod=0'0)", 2024-05-08T18:31:09.822 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:48.669496+0000", 2024-05-08T18:31:09.822 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 81.134548093000006, 2024-05-08T18:31:09.822 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0046805609999999997, 2024-05-08T18:31:09.823 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:09.823 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:09.823 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:09.823 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:09.823 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.823 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:09.823 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669496+0000", 2024-05-08T18:31:09.823 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:09.823 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.823 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.823 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:09.823 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669496+0000", 2024-05-08T18:31:09.823 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:09.823 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.824 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.824 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:09.824 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669497+0000", 2024-05-08T18:31:09.824 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0100000000000001e-06 2024-05-08T18:31:09.824 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.824 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.824 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:09.824 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669507+0000", 2024-05-08T18:31:09.824 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.7540000000000001e-06 2024-05-08T18:31:09.824 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.824 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.824 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:09.824 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669528+0000", 2024-05-08T18:31:09.825 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.05e-05 2024-05-08T18:31:09.825 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.825 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.825 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:09.825 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669544+0000", 2024-05-08T18:31:09.825 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6716000000000001e-05 2024-05-08T18:31:09.825 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.825 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.825 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:09.825 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669667+0000", 2024-05-08T18:31:09.825 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012275799999999999 2024-05-08T18:31:09.825 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.825 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.825 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:09.826 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669706+0000", 2024-05-08T18:31:09.826 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8764999999999999e-05 2024-05-08T18:31:09.826 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.826 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.826 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:09.826 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674100+0000", 2024-05-08T18:31:09.826 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.004394528 2024-05-08T18:31:09.826 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.826 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.826 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:09.826 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674177+0000", 2024-05-08T18:31:09.826 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6530000000000001e-05 2024-05-08T18:31:09.826 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:09.827 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:09.827 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:09.827 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.827 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.827 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:09.827 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.794231+0000", 2024-05-08T18:31:09.827 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 78.009813702000002, 2024-05-08T18:31:09.827 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031872810000000001, 2024-05-08T18:31:09.827 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:09.827 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:09.827 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:09.827 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:09.828 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:09.828 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:09.828 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 236 2024-05-08T18:31:09.828 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.828 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:09.828 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.828 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:09.828 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794231+0000", 2024-05-08T18:31:09.828 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:09.828 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.829 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.829 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:09.829 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794231+0000", 2024-05-08T18:31:09.829 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:09.829 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.829 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.829 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:09.829 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794234+0000", 2024-05-08T18:31:09.829 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.36e-06 2024-05-08T18:31:09.829 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.829 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.829 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:09.829 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794248+0000", 2024-05-08T18:31:09.829 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4372999999999999e-05 2024-05-08T18:31:09.830 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.830 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.830 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:09.830 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794279+0000", 2024-05-08T18:31:09.830 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1075999999999999e-05 2024-05-08T18:31:09.830 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.830 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.830 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:09.830 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794295+0000", 2024-05-08T18:31:09.830 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5386000000000001e-05 2024-05-08T18:31:09.830 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.830 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.831 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:09.831 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794416+0000", 2024-05-08T18:31:09.831 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012071899999999999 2024-05-08T18:31:09.831 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.831 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.831 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:09.831 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794638+0000", 2024-05-08T18:31:09.831 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00022262599999999999 2024-05-08T18:31:09.831 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.831 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.831 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:09.831 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.795061+0000", 2024-05-08T18:31:09.831 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00042248900000000001 2024-05-08T18:31:09.832 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.832 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.832 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:09.832 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.796477+0000", 2024-05-08T18:31:09.832 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0014162230000000001 2024-05-08T18:31:09.832 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.832 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.832 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:09.832 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.797258+0000", 2024-05-08T18:31:09.832 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00078159400000000004 2024-05-08T18:31:09.832 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.832 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.832 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:09.833 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.797349+0000", 2024-05-08T18:31:09.833 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0462000000000002e-05 2024-05-08T18:31:09.833 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.833 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.833 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:09.833 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.797418+0000", 2024-05-08T18:31:09.833 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8973000000000005e-05 2024-05-08T18:31:09.833 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:09.833 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:09.833 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:09.833 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.833 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.834 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:281 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:09.834 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.806063+0000", 2024-05-08T18:31:09.834 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 77.997981568, 2024-05-08T18:31:09.834 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002923761, 2024-05-08T18:31:09.834 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:09.834 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:09.834 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:09.834 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:09.834 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:09.834 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:09.834 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 281 2024-05-08T18:31:09.834 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.834 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:09.835 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.835 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:09.835 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.806063+0000", 2024-05-08T18:31:09.835 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:09.835 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.835 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.835 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:09.835 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.806063+0000", 2024-05-08T18:31:09.835 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:09.835 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.835 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.835 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:09.835 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.806064+0000", 2024-05-08T18:31:09.836 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.204e-06 2024-05-08T18:31:09.836 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.836 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.836 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:09.836 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.806073+0000", 2024-05-08T18:31:09.836 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5609999999999999e-06 2024-05-08T18:31:09.836 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.836 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.836 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:09.836 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.806089+0000", 2024-05-08T18:31:09.836 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6673000000000001e-05 2024-05-08T18:31:09.836 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.836 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.836 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:09.837 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.806098+0000", 2024-05-08T18:31:09.837 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8899999999999996e-06 2024-05-08T18:31:09.837 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.837 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.837 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:09.837 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.806165+0000", 2024-05-08T18:31:09.837 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6927999999999993e-05 2024-05-08T18:31:09.837 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.837 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.837 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:09.837 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.806298+0000", 2024-05-08T18:31:09.837 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000132886 2024-05-08T18:31:09.837 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.837 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.838 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:31:09.838 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.806453+0000", 2024-05-08T18:31:09.838 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000155339 2024-05-08T18:31:09.838 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.838 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.838 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:09.838 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.807157+0000", 2024-05-08T18:31:09.838 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00070363900000000004 2024-05-08T18:31:09.838 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.838 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.838 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:09.838 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.808880+0000", 2024-05-08T18:31:09.839 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0017227130000000001 2024-05-08T18:31:09.839 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.839 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.839 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:09.839 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.808938+0000", 2024-05-08T18:31:09.839 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8814999999999998e-05 2024-05-08T18:31:09.839 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.839 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.839 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:09.839 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.808987+0000", 2024-05-08T18:31:09.839 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8112999999999998e-05 2024-05-08T18:31:09.839 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:09.840 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:09.840 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:09.840 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.840 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.840 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:304 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:09.840 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.809645+0000", 2024-05-08T18:31:09.840 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 77.994399729999998, 2024-05-08T18:31:09.840 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031633579999999998, 2024-05-08T18:31:09.840 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:09.840 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:09.841 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:09.841 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:09.841 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:09.841 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:09.841 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 304 2024-05-08T18:31:09.841 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.841 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:09.841 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.841 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:09.841 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809645+0000", 2024-05-08T18:31:09.841 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:09.841 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.841 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.842 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:09.842 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809645+0000", 2024-05-08T18:31:09.842 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:09.842 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.842 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.842 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:09.842 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809646+0000", 2024-05-08T18:31:09.842 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.113e-06 2024-05-08T18:31:09.842 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.842 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.842 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:09.842 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809652+0000", 2024-05-08T18:31:09.842 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1650000000000003e-06 2024-05-08T18:31:09.843 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.843 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.843 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:09.843 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809668+0000", 2024-05-08T18:31:09.843 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6025e-05 2024-05-08T18:31:09.843 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.843 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.843 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:09.843 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809678+0000", 2024-05-08T18:31:09.843 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0456e-05 2024-05-08T18:31:09.843 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.843 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.843 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:09.844 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809745+0000", 2024-05-08T18:31:09.844 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7088000000000005e-05 2024-05-08T18:31:09.844 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.844 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.844 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:09.844 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809803+0000", 2024-05-08T18:31:09.844 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7405999999999999e-05 2024-05-08T18:31:09.844 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.844 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.844 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:31:09.844 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809951+0000", 2024-05-08T18:31:09.844 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014775500000000001 2024-05-08T18:31:09.845 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.845 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.845 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:09.845 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.810564+0000", 2024-05-08T18:31:09.845 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00061324899999999996 2024-05-08T18:31:09.845 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.845 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.845 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:09.845 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.812744+0000", 2024-05-08T18:31:09.845 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0021804509999999999 2024-05-08T18:31:09.845 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.845 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.845 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:09.845 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.812781+0000", 2024-05-08T18:31:09.846 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6554999999999998e-05 2024-05-08T18:31:09.846 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.846 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.846 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:09.846 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.812808+0000", 2024-05-08T18:31:09.846 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7095000000000001e-05 2024-05-08T18:31:09.846 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:09.846 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:09.846 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:09.846 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.846 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.846 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:09.847 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.105553+0000", 2024-05-08T18:31:09.847 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 77.698491719000003, 2024-05-08T18:31:09.847 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028754850000000001, 2024-05-08T18:31:09.847 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:09.847 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:09.847 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:09.847 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:09.847 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:09.847 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:09.847 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 742 2024-05-08T18:31:09.847 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.847 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:09.847 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.848 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:09.848 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.105553+0000", 2024-05-08T18:31:09.848 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:09.848 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.848 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.848 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:09.848 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.105553+0000", 2024-05-08T18:31:09.848 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:09.848 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.848 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.848 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:09.848 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.105556+0000", 2024-05-08T18:31:09.848 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3100000000000001e-06 2024-05-08T18:31:09.849 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.849 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.849 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:09.849 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.105569+0000", 2024-05-08T18:31:09.849 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2754e-05 2024-05-08T18:31:09.849 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.849 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.849 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:09.849 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.105601+0000", 2024-05-08T18:31:09.849 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2435999999999999e-05 2024-05-08T18:31:09.849 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.849 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.849 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:09.850 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.105616+0000", 2024-05-08T18:31:09.850 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4657e-05 2024-05-08T18:31:09.850 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.850 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.850 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:09.850 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.105804+0000", 2024-05-08T18:31:09.850 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00018861799999999999 2024-05-08T18:31:09.850 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.850 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.850 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:09.850 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.106054+0000", 2024-05-08T18:31:09.850 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024948499999999997 2024-05-08T18:31:09.851 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.851 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.851 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:09.851 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.106390+0000", 2024-05-08T18:31:09.851 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00033640100000000001 2024-05-08T18:31:09.851 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.851 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.851 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:09.851 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.107527+0000", 2024-05-08T18:31:09.851 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001136871 2024-05-08T18:31:09.851 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.851 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.851 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:09.852 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.108265+0000", 2024-05-08T18:31:09.852 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00073753100000000004 2024-05-08T18:31:09.852 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.852 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.852 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:09.852 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.108353+0000", 2024-05-08T18:31:09.852 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8232999999999994e-05 2024-05-08T18:31:09.852 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.852 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.852 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:09.852 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.108428+0000", 2024-05-08T18:31:09.852 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.5189000000000001e-05 2024-05-08T18:31:09.852 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:09.853 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:09.853 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:09.853 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.853 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.853 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:09.853 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.148015+0000", 2024-05-08T18:31:09.853 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 77.656029775999997, 2024-05-08T18:31:09.853 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032297409999999999, 2024-05-08T18:31:09.853 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:09.853 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:09.853 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:09.853 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:09.853 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:09.853 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:09.854 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 760 2024-05-08T18:31:09.854 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.854 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:09.854 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.854 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:09.854 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.148015+0000", 2024-05-08T18:31:09.854 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:09.854 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.854 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.854 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:09.854 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.148015+0000", 2024-05-08T18:31:09.854 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:09.855 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.855 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.855 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:09.855 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.148017+0000", 2024-05-08T18:31:09.855 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1830000000000001e-06 2024-05-08T18:31:09.855 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.855 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.855 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:09.855 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.148030+0000", 2024-05-08T18:31:09.855 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2893e-05 2024-05-08T18:31:09.855 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.855 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.855 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:09.855 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.148061+0000", 2024-05-08T18:31:09.856 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0953e-05 2024-05-08T18:31:09.856 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.856 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.856 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:09.856 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.148077+0000", 2024-05-08T18:31:09.856 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6554000000000001e-05 2024-05-08T18:31:09.856 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.856 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.856 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:09.856 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.148230+0000", 2024-05-08T18:31:09.856 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015263899999999999 2024-05-08T18:31:09.856 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.856 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.857 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:09.857 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.148592+0000", 2024-05-08T18:31:09.857 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00036219699999999997 2024-05-08T18:31:09.857 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.857 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.857 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:09.857 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.149139+0000", 2024-05-08T18:31:09.857 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00054734599999999999 2024-05-08T18:31:09.857 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.857 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.857 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:09.857 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.150505+0000", 2024-05-08T18:31:09.857 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001365479 2024-05-08T18:31:09.858 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.858 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.858 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:09.858 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.151087+0000", 2024-05-08T18:31:09.858 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00058201200000000002 2024-05-08T18:31:09.858 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.858 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.858 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:09.858 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.151175+0000", 2024-05-08T18:31:09.858 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8199e-05 2024-05-08T18:31:09.858 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.858 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.858 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:09.858 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.151244+0000", 2024-05-08T18:31:09.859 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9286e-05 2024-05-08T18:31:09.859 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:09.859 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:09.859 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:09.859 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.859 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.859 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:09.859 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.277376+0000", 2024-05-08T18:31:09.859 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 77.526667857999996, 2024-05-08T18:31:09.859 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032022190000000001, 2024-05-08T18:31:09.859 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:09.859 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:09.859 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:09.860 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:09.860 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:09.860 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:09.860 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 817 2024-05-08T18:31:09.860 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.860 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:09.860 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.860 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:09.860 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.277376+0000", 2024-05-08T18:31:09.860 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:09.860 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.860 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.860 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:09.860 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.277376+0000", 2024-05-08T18:31:09.861 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:09.861 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.861 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.861 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:09.861 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.277379+0000", 2024-05-08T18:31:09.861 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4430000000000002e-06 2024-05-08T18:31:09.861 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.861 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.861 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:09.861 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.277391+0000", 2024-05-08T18:31:09.861 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1634000000000001e-05 2024-05-08T18:31:09.861 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.861 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.862 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:09.862 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.277421+0000", 2024-05-08T18:31:09.862 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0691999999999997e-05 2024-05-08T18:31:09.862 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.862 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.862 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:09.862 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.277438+0000", 2024-05-08T18:31:09.862 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7102999999999999e-05 2024-05-08T18:31:09.862 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.862 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.862 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:09.862 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.277602+0000", 2024-05-08T18:31:09.862 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016345300000000001 2024-05-08T18:31:09.863 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.863 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.863 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:09.863 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.278019+0000", 2024-05-08T18:31:09.863 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00041724699999999998 2024-05-08T18:31:09.863 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.863 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.863 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:31:09.863 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.278573+0000", 2024-05-08T18:31:09.863 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00055391900000000005 2024-05-08T18:31:09.863 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.863 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.863 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:09.863 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.279973+0000", 2024-05-08T18:31:09.864 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0013995819999999999 2024-05-08T18:31:09.864 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.864 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.864 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:09.864 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.280422+0000", 2024-05-08T18:31:09.864 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00044940699999999997 2024-05-08T18:31:09.864 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.864 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.864 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:09.864 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.280509+0000", 2024-05-08T18:31:09.864 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7455999999999997e-05 2024-05-08T18:31:09.864 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.864 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.865 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:09.865 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.280579+0000", 2024-05-08T18:31:09.865 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9282999999999994e-05 2024-05-08T18:31:09.865 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:09.865 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:09.865 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:09.865 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.865 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.865 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:09.865 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.281716+0000", 2024-05-08T18:31:09.865 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 77.522328490999996, 2024-05-08T18:31:09.865 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003275881, 2024-05-08T18:31:09.865 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:09.866 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:09.866 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:09.866 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:09.866 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:09.866 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:09.866 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 819 2024-05-08T18:31:09.866 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.866 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:09.866 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.866 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:09.866 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.281716+0000", 2024-05-08T18:31:09.867 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:09.867 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.867 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.867 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:09.867 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.281716+0000", 2024-05-08T18:31:09.867 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:09.867 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.867 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.867 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:09.867 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.281718+0000", 2024-05-08T18:31:09.867 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.863e-06 2024-05-08T18:31:09.867 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.867 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.868 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:09.868 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.281728+0000", 2024-05-08T18:31:09.868 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0550000000000001e-05 2024-05-08T18:31:09.868 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.868 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.868 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:09.868 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.281760+0000", 2024-05-08T18:31:09.868 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2150000000000002e-05 2024-05-08T18:31:09.868 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.868 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.868 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:09.868 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.281776+0000", 2024-05-08T18:31:09.868 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6005999999999999e-05 2024-05-08T18:31:09.869 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.869 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.869 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:09.869 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.281917+0000", 2024-05-08T18:31:09.869 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014070200000000001 2024-05-08T18:31:09.869 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.869 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.869 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:09.869 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.282148+0000", 2024-05-08T18:31:09.869 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023095200000000001 2024-05-08T18:31:09.869 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.869 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.869 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:31:09.870 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.282641+0000", 2024-05-08T18:31:09.870 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00049337999999999997 2024-05-08T18:31:09.870 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.870 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.870 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:09.870 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.284070+0000", 2024-05-08T18:31:09.870 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0014287950000000001 2024-05-08T18:31:09.870 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.870 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.870 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:09.870 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.284837+0000", 2024-05-08T18:31:09.870 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00076679799999999996 2024-05-08T18:31:09.870 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.871 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.871 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:09.871 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.284925+0000", 2024-05-08T18:31:09.871 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8165999999999996e-05 2024-05-08T18:31:09.871 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.871 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.871 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:09.871 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.284992+0000", 2024-05-08T18:31:09.871 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6519000000000005e-05 2024-05-08T18:31:09.871 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:09.871 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:09.871 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:09.871 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.872 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.872 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:09.872 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.334745+0000", 2024-05-08T18:31:09.872 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 77.469299581000001, 2024-05-08T18:31:09.872 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032404719999999999, 2024-05-08T18:31:09.872 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:09.872 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:09.872 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:09.872 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:09.872 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:09.872 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:09.872 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 841 2024-05-08T18:31:09.873 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.873 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:09.873 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.873 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:09.873 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.334745+0000", 2024-05-08T18:31:09.873 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:09.873 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.873 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.873 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:09.873 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.334745+0000", 2024-05-08T18:31:09.873 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:09.873 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.873 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.873 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:09.874 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.334747+0000", 2024-05-08T18:31:09.874 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.407e-06 2024-05-08T18:31:09.874 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.874 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.874 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:09.874 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.334759+0000", 2024-05-08T18:31:09.874 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1883e-05 2024-05-08T18:31:09.874 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.874 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.878 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:09.878 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.334789+0000", 2024-05-08T18:31:09.878 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9957000000000001e-05 2024-05-08T18:31:09.878 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.878 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.878 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:09.878 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.334804+0000", 2024-05-08T18:31:09.878 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4713e-05 2024-05-08T18:31:09.878 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.878 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.878 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:09.878 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.334951+0000", 2024-05-08T18:31:09.879 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000147675 2024-05-08T18:31:09.879 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.879 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.879 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:09.879 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.335304+0000", 2024-05-08T18:31:09.879 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00035214099999999999 2024-05-08T18:31:09.879 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.879 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.879 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:31:09.879 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.335859+0000", 2024-05-08T18:31:09.879 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00055546899999999995 2024-05-08T18:31:09.879 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.879 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.879 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:09.880 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.337168+0000", 2024-05-08T18:31:09.880 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0013087299999999999 2024-05-08T18:31:09.880 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.880 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.880 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:09.880 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.337808+0000", 2024-05-08T18:31:09.880 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00064005500000000005 2024-05-08T18:31:09.880 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.880 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.880 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:09.880 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.337894+0000", 2024-05-08T18:31:09.880 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6593000000000003e-05 2024-05-08T18:31:09.880 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.881 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.881 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:09.881 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.337985+0000", 2024-05-08T18:31:09.881 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0848999999999997e-05 2024-05-08T18:31:09.881 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:09.881 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:09.881 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:09.881 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.881 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.881 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:09.881 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.338870+0000", 2024-05-08T18:31:09.881 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 77.465174832000002, 2024-05-08T18:31:09.881 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002862121, 2024-05-08T18:31:09.881 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:09.882 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:09.882 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:09.882 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:09.882 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:09.882 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:09.882 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 843 2024-05-08T18:31:09.882 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.882 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:09.882 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.882 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:09.882 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.338870+0000", 2024-05-08T18:31:09.882 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:09.883 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.883 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.883 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:09.883 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.338870+0000", 2024-05-08T18:31:09.883 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:09.883 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.883 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.883 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:09.883 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.338872+0000", 2024-05-08T18:31:09.883 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3429999999999998e-06 2024-05-08T18:31:09.883 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.883 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.883 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:09.884 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.338883+0000", 2024-05-08T18:31:09.884 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1447000000000001e-05 2024-05-08T18:31:09.884 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.884 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.884 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:09.884 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.338914+0000", 2024-05-08T18:31:09.884 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1052e-05 2024-05-08T18:31:09.884 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.884 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.884 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:09.884 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.338932+0000", 2024-05-08T18:31:09.884 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7604e-05 2024-05-08T18:31:09.884 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.885 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.885 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:09.885 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.339019+0000", 2024-05-08T18:31:09.885 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6982000000000002e-05 2024-05-08T18:31:09.885 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.885 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.885 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:09.885 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.339139+0000", 2024-05-08T18:31:09.885 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011978599999999999 2024-05-08T18:31:09.885 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.885 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.885 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:31:09.885 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.339415+0000", 2024-05-08T18:31:09.886 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00027644799999999999 2024-05-08T18:31:09.886 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.886 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.886 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:09.886 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.340619+0000", 2024-05-08T18:31:09.886 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012043010000000001 2024-05-08T18:31:09.886 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.886 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.886 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:09.886 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.341454+0000", 2024-05-08T18:31:09.886 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00083464300000000004 2024-05-08T18:31:09.886 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.886 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.887 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:09.887 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.341609+0000", 2024-05-08T18:31:09.887 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000154752 2024-05-08T18:31:09.887 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.887 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.887 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:09.887 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.341732+0000", 2024-05-08T18:31:09.887 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012276299999999999 2024-05-08T18:31:09.887 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:09.887 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:09.887 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:09.887 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.887 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.888 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:09.888 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.349287+0000", 2024-05-08T18:31:09.888 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 77.454757002999997, 2024-05-08T18:31:09.888 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032683220000000002, 2024-05-08T18:31:09.888 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:09.888 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:09.888 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:09.888 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:09.888 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:09.888 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:09.888 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 847 2024-05-08T18:31:09.888 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.888 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:09.889 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.889 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:09.889 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.349287+0000", 2024-05-08T18:31:09.889 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:09.889 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.889 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.889 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:09.889 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.349287+0000", 2024-05-08T18:31:09.889 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:09.889 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.889 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.889 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:09.889 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.349290+0000", 2024-05-08T18:31:09.890 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3369999999999998e-06 2024-05-08T18:31:09.890 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.890 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.890 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:09.890 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.349318+0000", 2024-05-08T18:31:09.890 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8419999999999999e-05 2024-05-08T18:31:09.890 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.890 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.890 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:09.890 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.349348+0000", 2024-05-08T18:31:09.890 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0260000000000002e-05 2024-05-08T18:31:09.890 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.890 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.891 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:09.891 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.349364+0000", 2024-05-08T18:31:09.891 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5359999999999999e-05 2024-05-08T18:31:09.891 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.891 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.891 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:09.891 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.349511+0000", 2024-05-08T18:31:09.891 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014760199999999999 2024-05-08T18:31:09.891 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.891 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.891 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:09.891 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.349872+0000", 2024-05-08T18:31:09.891 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00036035 2024-05-08T18:31:09.891 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.892 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.892 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:31:09.892 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.350432+0000", 2024-05-08T18:31:09.892 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00056059600000000001 2024-05-08T18:31:09.892 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.892 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.892 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:09.892 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.351817+0000", 2024-05-08T18:31:09.892 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001385063 2024-05-08T18:31:09.892 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.892 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.892 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:09.893 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.352402+0000", 2024-05-08T18:31:09.893 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00058490500000000004 2024-05-08T18:31:09.893 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.893 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.893 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:09.893 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.352488+0000", 2024-05-08T18:31:09.893 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6032999999999994e-05 2024-05-08T18:31:09.893 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.893 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.893 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:09.893 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.352556+0000", 2024-05-08T18:31:09.893 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7396000000000003e-05 2024-05-08T18:31:09.893 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:09.894 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:09.894 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:09.894 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.894 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.894 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:09.894 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.353786+0000", 2024-05-08T18:31:09.894 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 77.450258168000005, 2024-05-08T18:31:09.894 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0029130850000000002, 2024-05-08T18:31:09.894 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:09.894 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:09.894 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:09.894 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:09.894 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:09.895 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:09.895 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 849 2024-05-08T18:31:09.895 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.895 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:09.895 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.895 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:09.895 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.353786+0000", 2024-05-08T18:31:09.895 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:09.895 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.895 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.895 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:09.895 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.353786+0000", 2024-05-08T18:31:09.895 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:09.896 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.896 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.896 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:09.896 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.353788+0000", 2024-05-08T18:31:09.896 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0370000000000001e-06 2024-05-08T18:31:09.896 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.896 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.896 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:09.896 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.353799+0000", 2024-05-08T18:31:09.896 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0686000000000001e-05 2024-05-08T18:31:09.896 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.896 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.896 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:09.897 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.353832+0000", 2024-05-08T18:31:09.897 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.341e-05 2024-05-08T18:31:09.897 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.897 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.897 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:09.897 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.353851+0000", 2024-05-08T18:31:09.897 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8343999999999999e-05 2024-05-08T18:31:09.897 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.897 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.897 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:09.897 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.353980+0000", 2024-05-08T18:31:09.897 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012914900000000001 2024-05-08T18:31:09.898 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.898 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.898 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:09.898 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.354123+0000", 2024-05-08T18:31:09.898 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000142912 2024-05-08T18:31:09.898 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.898 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.898 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:31:09.898 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.354393+0000", 2024-05-08T18:31:09.898 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00027009799999999997 2024-05-08T18:31:09.898 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.898 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.899 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:09.899 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.355769+0000", 2024-05-08T18:31:09.899 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001375839 2024-05-08T18:31:09.899 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.899 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.899 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:09.899 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.356421+0000", 2024-05-08T18:31:09.899 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00065227799999999995 2024-05-08T18:31:09.899 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.899 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.899 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:09.899 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.356592+0000", 2024-05-08T18:31:09.899 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000170586 2024-05-08T18:31:09.900 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.900 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.900 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:09.900 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.356699+0000", 2024-05-08T18:31:09.900 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010774599999999999 2024-05-08T18:31:09.900 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:09.900 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:09.900 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:09.900 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.900 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.900 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:09.900 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.402673+0000", 2024-05-08T18:31:09.900 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 77.401371495000006, 2024-05-08T18:31:09.901 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002928295, 2024-05-08T18:31:09.901 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:09.901 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:09.901 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:09.901 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:09.901 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:09.901 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:09.901 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 870 2024-05-08T18:31:09.901 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.901 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:09.901 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.901 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:09.901 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.402673+0000", 2024-05-08T18:31:09.902 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:09.902 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.902 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.902 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:09.902 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.402673+0000", 2024-05-08T18:31:09.902 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:09.902 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.902 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.902 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:09.902 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.402675+0000", 2024-05-08T18:31:09.902 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0030000000000001e-06 2024-05-08T18:31:09.902 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.902 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.903 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:09.903 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.402685+0000", 2024-05-08T18:31:09.903 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0566e-05 2024-05-08T18:31:09.903 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.903 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.903 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:09.903 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.402714+0000", 2024-05-08T18:31:09.903 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8804999999999999e-05 2024-05-08T18:31:09.903 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.903 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.903 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:09.903 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.402731+0000", 2024-05-08T18:31:09.903 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6731e-05 2024-05-08T18:31:09.904 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.904 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.904 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:09.904 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.402863+0000", 2024-05-08T18:31:09.904 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013194199999999999 2024-05-08T18:31:09.904 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.904 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.904 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:09.904 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.403096+0000", 2024-05-08T18:31:09.904 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023309900000000001 2024-05-08T18:31:09.904 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.904 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.904 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:09.904 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.403553+0000", 2024-05-08T18:31:09.905 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00045738700000000002 2024-05-08T18:31:09.905 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.905 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.905 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:09.905 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.404843+0000", 2024-05-08T18:31:09.905 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012894650000000001 2024-05-08T18:31:09.905 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.905 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.905 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:09.905 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.405348+0000", 2024-05-08T18:31:09.905 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00050483600000000004 2024-05-08T18:31:09.905 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.905 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.905 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:09.906 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.405491+0000", 2024-05-08T18:31:09.906 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014349299999999999 2024-05-08T18:31:09.906 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.906 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.906 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:09.906 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.405601+0000", 2024-05-08T18:31:09.906 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000109968 2024-05-08T18:31:09.906 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:09.906 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:09.906 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:09.906 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.906 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.906 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:09.907 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.484247+0000", 2024-05-08T18:31:09.907 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 77.319797295000001, 2024-05-08T18:31:09.907 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028903679999999999, 2024-05-08T18:31:09.907 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:09.907 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:09.907 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:09.907 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:09.907 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:09.907 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:09.907 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 907 2024-05-08T18:31:09.907 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.907 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:09.907 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.908 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:09.908 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.484247+0000", 2024-05-08T18:31:09.908 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:09.908 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.908 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.908 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:09.908 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.484247+0000", 2024-05-08T18:31:09.908 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:09.908 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.908 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.908 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:09.908 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.484250+0000", 2024-05-08T18:31:09.908 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6900000000000001e-06 2024-05-08T18:31:09.908 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.909 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.909 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:09.909 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.484263+0000", 2024-05-08T18:31:09.909 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2967e-05 2024-05-08T18:31:09.909 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.909 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.909 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:09.909 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.484294+0000", 2024-05-08T18:31:09.909 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1016000000000003e-05 2024-05-08T18:31:09.909 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.909 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.909 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:09.909 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.484309+0000", 2024-05-08T18:31:09.910 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5187e-05 2024-05-08T18:31:09.910 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.910 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.910 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:09.910 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.484467+0000", 2024-05-08T18:31:09.910 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015810499999999999 2024-05-08T18:31:09.910 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.910 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.910 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:09.910 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.484698+0000", 2024-05-08T18:31:09.910 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000230852 2024-05-08T18:31:09.910 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.910 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.910 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:31:09.911 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.485026+0000", 2024-05-08T18:31:09.911 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00032833 2024-05-08T18:31:09.911 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.911 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.911 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:09.911 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.486177+0000", 2024-05-08T18:31:09.911 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0011504309999999999 2024-05-08T18:31:09.911 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.911 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.911 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:09.911 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.486978+0000", 2024-05-08T18:31:09.911 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000801161 2024-05-08T18:31:09.911 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.911 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.912 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:09.912 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.487068+0000", 2024-05-08T18:31:09.912 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0435999999999999e-05 2024-05-08T18:31:09.912 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.912 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.912 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:09.912 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.487137+0000", 2024-05-08T18:31:09.912 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9193e-05 2024-05-08T18:31:09.912 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:09.912 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:09.912 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:09.912 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.912 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.913 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:09.913 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.585363+0000", 2024-05-08T18:31:09.913 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 77.218681451999998, 2024-05-08T18:31:09.913 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028400080000000002, 2024-05-08T18:31:09.913 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:09.913 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:09.913 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:09.913 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:09.913 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:09.913 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:09.913 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 949 2024-05-08T18:31:09.913 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.913 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:09.913 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.914 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:09.914 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.585363+0000", 2024-05-08T18:31:09.914 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:09.914 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.914 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.914 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:09.914 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.585363+0000", 2024-05-08T18:31:09.914 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:09.914 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.914 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.914 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:09.914 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.585366+0000", 2024-05-08T18:31:09.914 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7099999999999999e-06 2024-05-08T18:31:09.914 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.915 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.915 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:09.915 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.585378+0000", 2024-05-08T18:31:09.915 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1970000000000001e-05 2024-05-08T18:31:09.915 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.915 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.915 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:09.915 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.585408+0000", 2024-05-08T18:31:09.915 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0389999999999999e-05 2024-05-08T18:31:09.915 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.915 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.915 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:09.915 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.585423+0000", 2024-05-08T18:31:09.916 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4929999999999999e-05 2024-05-08T18:31:09.916 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.916 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.916 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:09.916 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.585559+0000", 2024-05-08T18:31:09.916 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013563599999999999 2024-05-08T18:31:09.916 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.916 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.916 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:09.916 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.585780+0000", 2024-05-08T18:31:09.916 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000221828 2024-05-08T18:31:09.916 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.916 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.916 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:09.917 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.586121+0000", 2024-05-08T18:31:09.917 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000340181 2024-05-08T18:31:09.917 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.917 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.917 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:09.917 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.587268+0000", 2024-05-08T18:31:09.917 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001146984 2024-05-08T18:31:09.917 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.917 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.917 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:09.917 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.588047+0000", 2024-05-08T18:31:09.917 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000779877 2024-05-08T18:31:09.917 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.917 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.918 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:09.918 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.588136+0000", 2024-05-08T18:31:09.918 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8483e-05 2024-05-08T18:31:09.918 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.918 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.918 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:09.918 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.588203+0000", 2024-05-08T18:31:09.918 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7019000000000003e-05 2024-05-08T18:31:09.918 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:09.918 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:09.918 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:09.918 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.918 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.919 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:951 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:09.919 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.589044+0000", 2024-05-08T18:31:09.919 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 77.215000029999999, 2024-05-08T18:31:09.919 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002802672, 2024-05-08T18:31:09.919 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:09.919 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:09.919 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:09.919 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:09.919 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:09.919 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:09.919 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 951 2024-05-08T18:31:09.919 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.919 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:09.919 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.920 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:09.920 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.589044+0000", 2024-05-08T18:31:09.920 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:09.920 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.920 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.920 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:09.920 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.589044+0000", 2024-05-08T18:31:09.920 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:09.920 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.920 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.920 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:09.920 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.589046+0000", 2024-05-08T18:31:09.920 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6670000000000001e-06 2024-05-08T18:31:09.921 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.921 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.921 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:09.921 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.589054+0000", 2024-05-08T18:31:09.921 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.2600000000000005e-06 2024-05-08T18:31:09.921 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.921 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.921 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:09.921 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.589076+0000", 2024-05-08T18:31:09.921 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1373e-05 2024-05-08T18:31:09.921 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.921 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.921 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:09.922 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.589088+0000", 2024-05-08T18:31:09.922 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2768999999999999e-05 2024-05-08T18:31:09.922 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.922 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.922 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:09.922 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.589220+0000", 2024-05-08T18:31:09.922 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013146300000000001 2024-05-08T18:31:09.922 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.922 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.922 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:09.922 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.589462+0000", 2024-05-08T18:31:09.922 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024250500000000001 2024-05-08T18:31:09.922 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.923 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.923 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:09.923 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.589956+0000", 2024-05-08T18:31:09.923 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00049331600000000005 2024-05-08T18:31:09.923 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.923 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.923 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:09.923 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.591337+0000", 2024-05-08T18:31:09.923 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0013816290000000001 2024-05-08T18:31:09.923 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.923 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.923 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:09.923 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.591688+0000", 2024-05-08T18:31:09.923 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00035083400000000001 2024-05-08T18:31:09.924 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.924 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.924 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:09.924 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.591780+0000", 2024-05-08T18:31:09.924 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.2312999999999995e-05 2024-05-08T18:31:09.924 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.924 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.924 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:09.924 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.591847+0000", 2024-05-08T18:31:09.924 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6543000000000003e-05 2024-05-08T18:31:09.924 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:09.924 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:09.925 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:09.925 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.925 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.925 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:09.925 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.599312+0000", 2024-05-08T18:31:09.925 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 77.204732566000004, 2024-05-08T18:31:09.925 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0027928190000000002, 2024-05-08T18:31:09.925 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:09.925 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:09.925 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:09.925 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:09.925 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:09.925 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:09.925 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 955 2024-05-08T18:31:09.926 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.926 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:09.926 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.926 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:09.926 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.599312+0000", 2024-05-08T18:31:09.926 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:09.926 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.926 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.926 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:09.926 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.599312+0000", 2024-05-08T18:31:09.926 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:09.926 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.927 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.927 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:09.927 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.599314+0000", 2024-05-08T18:31:09.927 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.396e-06 2024-05-08T18:31:09.927 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.927 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.927 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:09.927 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.599325+0000", 2024-05-08T18:31:09.927 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1063999999999999e-05 2024-05-08T18:31:09.927 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.927 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.927 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:09.927 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.599354+0000", 2024-05-08T18:31:09.927 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8462999999999998e-05 2024-05-08T18:31:09.928 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.928 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.928 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:09.928 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.599369+0000", 2024-05-08T18:31:09.928 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4963000000000001e-05 2024-05-08T18:31:09.928 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.928 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.928 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:09.928 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.599503+0000", 2024-05-08T18:31:09.928 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013385299999999999 2024-05-08T18:31:09.928 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.928 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.928 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:09.929 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.599744+0000", 2024-05-08T18:31:09.929 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024137400000000001 2024-05-08T18:31:09.929 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.929 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.929 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:09.929 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.600084+0000", 2024-05-08T18:31:09.929 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00033999399999999998 2024-05-08T18:31:09.929 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.929 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.929 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:09.929 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.601319+0000", 2024-05-08T18:31:09.929 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012348140000000001 2024-05-08T18:31:09.929 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.929 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.930 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:09.930 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.601956+0000", 2024-05-08T18:31:09.930 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00063721199999999996 2024-05-08T18:31:09.930 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.930 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.930 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:09.930 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.602038+0000", 2024-05-08T18:31:09.930 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.1705999999999993e-05 2024-05-08T18:31:09.930 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:09.930 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:09.930 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:09.930 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.602105+0000", 2024-05-08T18:31:09.931 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6979999999999999e-05 2024-05-08T18:31:09.931 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:09.931 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:09.931 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:09.931 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:09.931 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:09.931 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:09.934 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-08T18:31:09.934 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2024-05-08T18:31:09.935 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:31:09.935 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2024-05-08T18:31:09.935 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:31:09.935 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2024-05-08T18:31:09.936 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:31:09.936 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2024-05-08T18:31:09.936 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:31:09.937 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2024-05-08T18:31:09.937 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:31:09.937 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2024-05-08T18:31:09.938 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:31:09.938 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:31:09.931+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:31:09.954 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2024-05-08T18:31:09.954 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:31:10.033 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:31:10.031+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:31:10.107 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:10.107 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:10.124 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-08T18:31:10.135 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:31:10.131+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:31:10.226 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-05-08T18:31:10.226 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-05-08T18:31:10.271 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:31:10.271+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:31:10.335 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:31:10.335+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:31:10.338 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:10.338 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:10.358 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-08T18:31:10.443 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:31:10.443+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:31:10.538 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:31:10.535+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:31:10.572 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:10.572 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:10.592 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-08T18:31:10.639 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:31:10.635+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:31:10.689 INFO:teuthology.orchestra.run.smithi097.stderr:reweighted osd.0 to 1 (10000) 2024-05-08T18:31:10.721 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-05-08T18:31:10.726 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:10.727 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:10.740 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:31:10.735+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:31:10.742 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-08T18:31:10.840 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:31:10.839+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:31:10.904 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:10.904 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:10.918 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-08T18:31:10.960 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:31:10.959+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:31:11.043 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:31:11.039+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:31:11.084 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:11.085 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:11.099 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-08T18:31:11.143 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:31:11.143+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:31:11.243 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:31:11.243+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:31:11.265 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:11.265 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:11.279 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-08T18:31:11.344 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:31:11.343+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:31:11.401 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:11.402 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:11.416 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-08T18:31:11.461 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:31:11.459+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:31:11.532 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:11.532 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:11.547 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-08T18:31:11.547 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:31:11.543+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:31:11.648 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:31:11.647+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:31:11.700 INFO:teuthology.orchestra.run.smithi097.stderr:reweighted osd.1 to 1 (10000) 2024-05-08T18:31:11.716 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:11.717 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:11.724 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-08T18:31:11.728 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-05-08T18:31:11.731 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-08T18:31:11.776 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:31:11.775+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:31:11.849 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:31:11.847+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:31:11.852 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:11.852 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:11.867 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-08T18:31:11.953 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:31:11.951+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:31:11.977 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-08T18:31:12.035 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:12.036 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:12.051 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-08T18:31:12.052 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:31:12.051+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:31:12.152 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:31:12.151+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:31:12.175 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2024-05-08T18:31:12.175 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:31:12.205 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2024-05-08T18:31:12.206 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:31:12.216 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:12.216 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:12.230 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-08T18:31:12.238 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2024-05-08T18:31:12.238 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:31:12.252 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:31:12.251+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:31:12.268 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2024-05-08T18:31:12.269 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:31:12.300 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2024-05-08T18:31:12.300 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:31:12.332 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2024-05-08T18:31:12.333 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:31:12.354 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:12.354 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:12.354 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:31:12.351+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:31:12.363 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2024-05-08T18:31:12.363 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:31:12.369 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-08T18:31:12.393 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2024-05-08T18:31:12.393 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:31:12.463 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:31:12.463+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:31:12.542 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:31:12.542 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2024-05-08T18:31:12.542 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2024-05-08T18:31:12.542 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-05-08T18:31:12.542 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.542 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:24 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [write 262144~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:12.542 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.154193+0000", 2024-05-08T18:31:12.542 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 105.385023915, 2024-05-08T18:31:12.542 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0085494309999999997, 2024-05-08T18:31:12.542 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:12.543 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:12.543 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:12.543 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:12.543 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:12.543 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:12.543 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 24 2024-05-08T18:31:12.543 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.543 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:12.543 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.543 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:12.543 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154193+0000", 2024-05-08T18:31:12.543 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:12.544 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.544 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.544 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:12.544 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154193+0000", 2024-05-08T18:31:12.544 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:12.544 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.544 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.544 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:12.544 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154194+0000", 2024-05-08T18:31:12.544 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.44e-06 2024-05-08T18:31:12.544 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.544 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.544 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:12.545 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154394+0000", 2024-05-08T18:31:12.545 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00019972499999999999 2024-05-08T18:31:12.545 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.545 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.545 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:12.545 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154417+0000", 2024-05-08T18:31:12.545 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2713000000000001e-05 2024-05-08T18:31:12.545 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.545 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.545 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:12.545 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154437+0000", 2024-05-08T18:31:12.545 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0027e-05 2024-05-08T18:31:12.545 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.545 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.546 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:12.546 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.158438+0000", 2024-05-08T18:31:12.546 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0040011459999999997 2024-05-08T18:31:12.546 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.546 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.546 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:12.546 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.158567+0000", 2024-05-08T18:31:12.546 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012923899999999999 2024-05-08T18:31:12.546 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.546 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.546 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:12.546 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.158787+0000", 2024-05-08T18:31:12.547 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000219581 2024-05-08T18:31:12.547 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.547 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.547 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:12.547 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.162013+0000", 2024-05-08T18:31:12.547 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032261759999999999 2024-05-08T18:31:12.547 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.547 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.547 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:12.547 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.162568+0000", 2024-05-08T18:31:12.547 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00055576900000000001 2024-05-08T18:31:12.547 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.548 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.548 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:12.548 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.162644+0000", 2024-05-08T18:31:12.548 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5516e-05 2024-05-08T18:31:12.548 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.548 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.548 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:12.548 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.162742+0000", 2024-05-08T18:31:12.548 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8098999999999997e-05 2024-05-08T18:31:12.548 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:12.548 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:12.548 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:12.548 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.548 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.549 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:25 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:12.549 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.154495+0000", 2024-05-08T18:31:12.549 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 105.384721621, 2024-05-08T18:31:12.549 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010784396999999999, 2024-05-08T18:31:12.549 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:12.549 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:12.549 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:12.549 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:12.549 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:12.549 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:12.549 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 25 2024-05-08T18:31:12.549 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.549 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:12.549 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.550 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:12.550 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154495+0000", 2024-05-08T18:31:12.550 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:12.550 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.550 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.550 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:12.550 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154495+0000", 2024-05-08T18:31:12.550 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:12.550 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.550 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.550 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:12.550 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154496+0000", 2024-05-08T18:31:12.551 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.454e-06 2024-05-08T18:31:12.551 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.551 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.551 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:12.551 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154509+0000", 2024-05-08T18:31:12.551 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2496e-05 2024-05-08T18:31:12.551 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.551 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.551 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:12.551 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154531+0000", 2024-05-08T18:31:12.551 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1987000000000001e-05 2024-05-08T18:31:12.551 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.551 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.552 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:12.552 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154547+0000", 2024-05-08T18:31:12.552 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.577e-05 2024-05-08T18:31:12.552 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.552 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.552 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:12.552 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.160949+0000", 2024-05-08T18:31:12.552 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.006401917 2024-05-08T18:31:12.552 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.552 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.552 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:12.552 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.161102+0000", 2024-05-08T18:31:12.552 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000153826 2024-05-08T18:31:12.553 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.553 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.553 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:12.553 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.161332+0000", 2024-05-08T18:31:12.553 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022918099999999999 2024-05-08T18:31:12.553 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.553 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.553 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:12.553 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.163838+0000", 2024-05-08T18:31:12.553 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0025064079999999999 2024-05-08T18:31:12.553 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.554 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.554 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:12.554 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.165121+0000", 2024-05-08T18:31:12.554 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0012825200000000001 2024-05-08T18:31:12.554 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.554 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.554 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:12.554 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.165212+0000", 2024-05-08T18:31:12.554 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1121999999999999e-05 2024-05-08T18:31:12.554 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.554 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.554 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:12.555 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.165279+0000", 2024-05-08T18:31:12.555 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7716e-05 2024-05-08T18:31:12.555 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:12.555 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:12.555 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:12.555 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.555 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.555 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:41 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:12.555 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247174+0000", 2024-05-08T18:31:12.555 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 105.292042639, 2024-05-08T18:31:12.555 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010013393000000001, 2024-05-08T18:31:12.555 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:12.555 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:12.555 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:12.556 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:12.556 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:12.556 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:12.556 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 41 2024-05-08T18:31:12.556 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.556 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:12.556 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.556 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:12.556 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247174+0000", 2024-05-08T18:31:12.556 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:12.556 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.556 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.556 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:12.557 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247174+0000", 2024-05-08T18:31:12.557 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:12.557 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.557 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.557 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:12.557 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247175+0000", 2024-05-08T18:31:12.557 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.9999999999999995e-07 2024-05-08T18:31:12.557 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.557 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.557 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:12.557 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247277+0000", 2024-05-08T18:31:12.557 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010243600000000001 2024-05-08T18:31:12.557 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.557 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.558 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:12.558 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247291+0000", 2024-05-08T18:31:12.558 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4076999999999999e-05 2024-05-08T18:31:12.558 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.558 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.558 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:12.558 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247301+0000", 2024-05-08T18:31:12.558 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0010000000000001e-05 2024-05-08T18:31:12.558 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.558 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.558 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:12.558 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.249555+0000", 2024-05-08T18:31:12.559 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0022539050000000001 2024-05-08T18:31:12.559 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.559 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.559 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:12.559 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.249700+0000", 2024-05-08T18:31:12.560 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014484599999999999 2024-05-08T18:31:12.560 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.560 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.560 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:12.560 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.249929+0000", 2024-05-08T18:31:12.560 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022904499999999999 2024-05-08T18:31:12.560 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.560 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.560 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:12.560 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.253695+0000", 2024-05-08T18:31:12.560 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0037656640000000002 2024-05-08T18:31:12.560 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.561 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.561 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:12.561 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.256970+0000", 2024-05-08T18:31:12.561 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003274608 2024-05-08T18:31:12.561 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.561 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.561 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:12.561 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.257052+0000", 2024-05-08T18:31:12.561 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2223000000000002e-05 2024-05-08T18:31:12.561 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.561 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.561 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:12.562 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.257187+0000", 2024-05-08T18:31:12.562 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013557900000000001 2024-05-08T18:31:12.562 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:12.562 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:12.562 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:12.562 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.562 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.562 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:42 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:12.562 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247321+0000", 2024-05-08T18:31:12.562 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 105.29189531999999, 2024-05-08T18:31:12.562 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013168572, 2024-05-08T18:31:12.562 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:12.562 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:12.562 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:12.563 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:12.563 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:12.563 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:12.563 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 42 2024-05-08T18:31:12.563 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.563 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:12.563 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.563 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:12.563 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247321+0000", 2024-05-08T18:31:12.563 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:12.563 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.563 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.563 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:12.563 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247321+0000", 2024-05-08T18:31:12.564 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:12.564 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.564 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.564 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:12.564 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247323+0000", 2024-05-08T18:31:12.564 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.24e-06 2024-05-08T18:31:12.564 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.564 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.564 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:12.564 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247329+0000", 2024-05-08T18:31:12.564 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1530000000000002e-06 2024-05-08T18:31:12.564 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.564 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.565 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:12.565 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247339+0000", 2024-05-08T18:31:12.565 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0387000000000001e-05 2024-05-08T18:31:12.565 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.565 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.565 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:12.565 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247347+0000", 2024-05-08T18:31:12.565 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9829999999999996e-06 2024-05-08T18:31:12.565 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.565 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.565 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:12.565 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.251488+0000", 2024-05-08T18:31:12.565 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0041412849999999998 2024-05-08T18:31:12.565 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.566 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.566 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:12.566 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.251672+0000", 2024-05-08T18:31:12.566 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00018354499999999999 2024-05-08T18:31:12.566 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.566 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.566 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:12.566 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.251949+0000", 2024-05-08T18:31:12.566 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00027695399999999999 2024-05-08T18:31:12.566 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.566 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.566 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:12.566 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.253810+0000", 2024-05-08T18:31:12.567 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001860806 2024-05-08T18:31:12.567 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.567 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.567 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:12.567 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260244+0000", 2024-05-08T18:31:12.567 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0064347939999999998 2024-05-08T18:31:12.567 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.567 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.567 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:12.567 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260376+0000", 2024-05-08T18:31:12.567 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000131829 2024-05-08T18:31:12.567 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.567 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.567 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:12.568 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260490+0000", 2024-05-08T18:31:12.568 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000113596 2024-05-08T18:31:12.568 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:12.568 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:12.568 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:12.568 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.568 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.568 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:43 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:12.568 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247367+0000", 2024-05-08T18:31:12.568 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 105.291849407, 2024-05-08T18:31:12.569 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013449025999999999, 2024-05-08T18:31:12.569 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:12.569 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:12.569 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:12.569 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:12.569 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:12.569 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:12.569 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 43 2024-05-08T18:31:12.569 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.569 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:12.569 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.569 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:12.569 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247367+0000", 2024-05-08T18:31:12.569 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:12.570 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.570 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.570 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:12.570 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247367+0000", 2024-05-08T18:31:12.570 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:12.570 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.570 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.570 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:12.570 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247368+0000", 2024-05-08T18:31:12.570 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1999999999999999e-07 2024-05-08T18:31:12.570 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.570 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.570 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:12.571 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247374+0000", 2024-05-08T18:31:12.571 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.19e-06 2024-05-08T18:31:12.571 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.571 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.571 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:12.571 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247384+0000", 2024-05-08T18:31:12.571 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0173000000000001e-05 2024-05-08T18:31:12.571 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.571 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.571 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:12.571 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247392+0000", 2024-05-08T18:31:12.571 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1869999999999997e-06 2024-05-08T18:31:12.572 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.572 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.572 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:12.572 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.252515+0000", 2024-05-08T18:31:12.572 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0051221399999999999 2024-05-08T18:31:12.572 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.572 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.572 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:12.572 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.252641+0000", 2024-05-08T18:31:12.572 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012609200000000001 2024-05-08T18:31:12.572 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.572 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.572 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:12.572 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.252842+0000", 2024-05-08T18:31:12.573 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000201619 2024-05-08T18:31:12.573 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.573 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.573 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:12.573 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.256828+0000", 2024-05-08T18:31:12.573 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039853989999999997 2024-05-08T18:31:12.573 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.573 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.573 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:12.573 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260515+0000", 2024-05-08T18:31:12.573 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0036875419999999998 2024-05-08T18:31:12.573 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.573 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.574 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:12.574 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260718+0000", 2024-05-08T18:31:12.574 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020229499999999999 2024-05-08T18:31:12.574 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.574 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.574 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:12.574 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260816+0000", 2024-05-08T18:31:12.574 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8669e-05 2024-05-08T18:31:12.574 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:12.574 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:12.574 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:12.574 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.574 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.575 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:12.575 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247466+0000", 2024-05-08T18:31:12.575 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 105.29175082099999, 2024-05-08T18:31:12.575 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013491806, 2024-05-08T18:31:12.575 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:12.575 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:12.575 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:12.575 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:12.575 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:12.575 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:12.575 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 44 2024-05-08T18:31:12.575 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.575 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:12.576 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.576 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:12.576 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247466+0000", 2024-05-08T18:31:12.576 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:12.576 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.576 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.576 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:12.576 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247466+0000", 2024-05-08T18:31:12.576 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:12.576 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.576 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.576 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:12.576 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247467+0000", 2024-05-08T18:31:12.577 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.263e-06 2024-05-08T18:31:12.577 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.577 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.577 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:12.577 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247585+0000", 2024-05-08T18:31:12.577 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011756600000000001 2024-05-08T18:31:12.577 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.577 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.577 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:12.577 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247598+0000", 2024-05-08T18:31:12.577 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3766e-05 2024-05-08T18:31:12.577 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.577 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.577 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:12.578 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247609+0000", 2024-05-08T18:31:12.578 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0604e-05 2024-05-08T18:31:12.578 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.578 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.578 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:12.578 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.253890+0000", 2024-05-08T18:31:12.578 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0062810440000000004 2024-05-08T18:31:12.578 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.579 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.579 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:12.579 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.254068+0000", 2024-05-08T18:31:12.579 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017848199999999999 2024-05-08T18:31:12.579 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.579 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.580 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:12.580 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.254488+0000", 2024-05-08T18:31:12.580 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00041965399999999999 2024-05-08T18:31:12.580 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.580 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.580 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:12.580 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.256949+0000", 2024-05-08T18:31:12.581 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002461254 2024-05-08T18:31:12.581 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.581 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.581 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:12.581 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260832+0000", 2024-05-08T18:31:12.581 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0038830539999999999 2024-05-08T18:31:12.582 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.582 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.582 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:12.582 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260906+0000", 2024-05-08T18:31:12.582 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3455999999999996e-05 2024-05-08T18:31:12.582 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.583 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.583 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:12.583 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260958+0000", 2024-05-08T18:31:12.583 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1663000000000003e-05 2024-05-08T18:31:12.583 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:12.583 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:12.584 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:12.584 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.584 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.584 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:12.584 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247630+0000", 2024-05-08T18:31:12.584 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 105.291586416, 2024-05-08T18:31:12.585 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013478753, 2024-05-08T18:31:12.585 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:12.585 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:12.585 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:12.585 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:12.585 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:12.586 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:12.586 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 45 2024-05-08T18:31:12.586 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.586 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:12.586 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.586 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:12.587 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247630+0000", 2024-05-08T18:31:12.587 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:12.587 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.587 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.587 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:12.588 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247630+0000", 2024-05-08T18:31:12.588 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:12.588 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.588 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.588 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:12.588 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247631+0000", 2024-05-08T18:31:12.588 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7399999999999991e-07 2024-05-08T18:31:12.588 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.588 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.588 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:12.589 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247637+0000", 2024-05-08T18:31:12.589 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.93e-06 2024-05-08T18:31:12.589 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.589 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.589 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:12.589 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247647+0000", 2024-05-08T18:31:12.590 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7459999999999995e-06 2024-05-08T18:31:12.590 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.590 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.590 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:12.590 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247654+0000", 2024-05-08T18:31:12.590 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4039999999999998e-06 2024-05-08T18:31:12.591 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.591 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.591 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:12.591 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.255829+0000", 2024-05-08T18:31:12.591 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0081749059999999991 2024-05-08T18:31:12.591 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.592 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.592 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:12.592 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.255979+0000", 2024-05-08T18:31:12.592 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015027899999999999 2024-05-08T18:31:12.592 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.592 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.593 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:12.593 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.256185+0000", 2024-05-08T18:31:12.593 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020583900000000001 2024-05-08T18:31:12.593 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.593 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.593 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:12.594 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260097+0000", 2024-05-08T18:31:12.594 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039121929999999996 2024-05-08T18:31:12.594 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.594 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.594 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:12.595 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260973+0000", 2024-05-08T18:31:12.595 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00087591999999999998 2024-05-08T18:31:12.595 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.595 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.595 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:12.595 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261056+0000", 2024-05-08T18:31:12.596 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3104999999999998e-05 2024-05-08T18:31:12.596 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.596 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.596 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:12.596 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261109+0000", 2024-05-08T18:31:12.596 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2457000000000003e-05 2024-05-08T18:31:12.597 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:12.597 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:12.597 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:12.597 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.597 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.598 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:12.598 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247667+0000", 2024-05-08T18:31:12.598 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 105.291549136, 2024-05-08T18:31:12.598 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013569098999999999, 2024-05-08T18:31:12.598 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:12.598 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:12.599 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:12.599 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:12.599 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:12.599 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:12.599 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 46 2024-05-08T18:31:12.600 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.600 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:12.600 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.600 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:12.600 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247667+0000", 2024-05-08T18:31:12.601 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:12.601 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.601 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.601 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:12.601 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247667+0000", 2024-05-08T18:31:12.601 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:12.602 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.602 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.602 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:12.602 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247668+0000", 2024-05-08T18:31:12.602 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7999999999999995e-07 2024-05-08T18:31:12.602 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.603 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.603 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:12.603 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247674+0000", 2024-05-08T18:31:12.603 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4369999999999998e-06 2024-05-08T18:31:12.603 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.603 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.604 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:12.604 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247683+0000", 2024-05-08T18:31:12.604 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4360000000000008e-06 2024-05-08T18:31:12.604 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.604 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.605 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:12.605 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247690+0000", 2024-05-08T18:31:12.605 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.43e-06 2024-05-08T18:31:12.605 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.605 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.605 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:12.606 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.257358+0000", 2024-05-08T18:31:12.606 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0096676890000000001 2024-05-08T18:31:12.606 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.606 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.606 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:12.606 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.257626+0000", 2024-05-08T18:31:12.607 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00026819099999999998 2024-05-08T18:31:12.607 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.607 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.607 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:12.607 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.258041+0000", 2024-05-08T18:31:12.607 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00041438400000000001 2024-05-08T18:31:12.608 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.608 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.608 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:12.608 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260224+0000", 2024-05-08T18:31:12.608 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0021830700000000001 2024-05-08T18:31:12.609 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.609 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.609 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:12.609 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261127+0000", 2024-05-08T18:31:12.609 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00090292300000000003 2024-05-08T18:31:12.609 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.609 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.609 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:12.610 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261191+0000", 2024-05-08T18:31:12.610 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4342000000000002e-05 2024-05-08T18:31:12.610 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.610 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.610 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:12.610 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261237+0000", 2024-05-08T18:31:12.610 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.5516999999999998e-05 2024-05-08T18:31:12.610 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:12.611 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:12.611 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:12.611 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.611 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.611 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:12.611 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247703+0000", 2024-05-08T18:31:12.611 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 105.291513653, 2024-05-08T18:31:12.611 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015020204000000001, 2024-05-08T18:31:12.612 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:12.612 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:12.612 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:12.612 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:12.612 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:12.612 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:12.612 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 47 2024-05-08T18:31:12.613 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.613 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:12.613 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.613 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:12.613 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247703+0000", 2024-05-08T18:31:12.613 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:12.613 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.614 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.614 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:12.614 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247703+0000", 2024-05-08T18:31:12.614 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:12.614 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.614 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.614 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:12.614 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247704+0000", 2024-05-08T18:31:12.614 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8299999999999996e-07 2024-05-08T18:31:12.614 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.614 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.615 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:12.615 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247877+0000", 2024-05-08T18:31:12.615 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000172979 2024-05-08T18:31:12.615 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.615 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.615 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:12.615 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247894+0000", 2024-05-08T18:31:12.615 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6912999999999999e-05 2024-05-08T18:31:12.615 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.615 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.615 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:12.615 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247903+0000", 2024-05-08T18:31:12.615 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1770000000000004e-06 2024-05-08T18:31:12.616 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.616 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.616 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:12.616 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.258767+0000", 2024-05-08T18:31:12.616 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010864409 2024-05-08T18:31:12.616 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.616 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.616 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:12.616 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.258898+0000", 2024-05-08T18:31:12.616 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000131199 2024-05-08T18:31:12.616 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.616 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.617 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:12.617 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.259117+0000", 2024-05-08T18:31:12.617 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000218889 2024-05-08T18:31:12.617 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.617 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.617 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:12.617 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.262372+0000", 2024-05-08T18:31:12.617 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032545679999999998 2024-05-08T18:31:12.617 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.617 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.617 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:12.617 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.262432+0000", 2024-05-08T18:31:12.618 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9913e-05 2024-05-08T18:31:12.618 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.618 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.618 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:12.618 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.262585+0000", 2024-05-08T18:31:12.618 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015361800000000001 2024-05-08T18:31:12.618 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.618 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.618 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:12.618 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.262723+0000", 2024-05-08T18:31:12.618 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000137856 2024-05-08T18:31:12.618 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:12.618 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:12.619 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:12.619 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.619 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.619 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:12.619 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247927+0000", 2024-05-08T18:31:12.619 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 105.291289615, 2024-05-08T18:31:12.619 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018387718000000001, 2024-05-08T18:31:12.619 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:12.619 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:12.619 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:12.619 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:12.619 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:12.619 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:12.620 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 48 2024-05-08T18:31:12.620 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.620 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:12.620 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.620 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:12.620 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247927+0000", 2024-05-08T18:31:12.620 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:12.620 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.620 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.620 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:12.620 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247927+0000", 2024-05-08T18:31:12.620 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:12.621 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.621 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.621 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:12.621 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247928+0000", 2024-05-08T18:31:12.621 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8400000000000003e-07 2024-05-08T18:31:12.621 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.621 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.621 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:12.621 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247935+0000", 2024-05-08T18:31:12.621 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1230000000000002e-06 2024-05-08T18:31:12.621 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.621 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.621 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:12.622 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247945+0000", 2024-05-08T18:31:12.622 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0346000000000001e-05 2024-05-08T18:31:12.622 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.622 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.622 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:12.622 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247953+0000", 2024-05-08T18:31:12.622 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8040000000000002e-06 2024-05-08T18:31:12.622 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.622 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.622 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:12.622 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261292+0000", 2024-05-08T18:31:12.622 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013339337 2024-05-08T18:31:12.623 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.623 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.623 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:12.623 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261424+0000", 2024-05-08T18:31:12.623 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013201900000000001 2024-05-08T18:31:12.623 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.623 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.623 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:12.623 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261628+0000", 2024-05-08T18:31:12.623 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020327499999999999 2024-05-08T18:31:12.623 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.623 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.623 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:12.623 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.263849+0000", 2024-05-08T18:31:12.623 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0022209759999999999 2024-05-08T18:31:12.624 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.624 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.624 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:12.624 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266167+0000", 2024-05-08T18:31:12.624 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002317979 2024-05-08T18:31:12.624 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.624 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.624 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:12.624 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266249+0000", 2024-05-08T18:31:12.624 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1996000000000006e-05 2024-05-08T18:31:12.624 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.624 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.625 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:12.625 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266315+0000", 2024-05-08T18:31:12.625 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5979e-05 2024-05-08T18:31:12.625 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:12.625 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:12.625 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:12.625 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.625 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.625 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:12.625 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247966+0000", 2024-05-08T18:31:12.625 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 105.291250682, 2024-05-08T18:31:12.625 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0194153, 2024-05-08T18:31:12.626 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:12.626 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:12.626 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:12.626 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:12.626 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:12.626 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:12.626 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 49 2024-05-08T18:31:12.626 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.626 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:12.626 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.626 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:12.626 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247966+0000", 2024-05-08T18:31:12.626 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:12.627 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.627 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.627 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:12.627 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247966+0000", 2024-05-08T18:31:12.627 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:12.627 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.627 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.627 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:12.627 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247967+0000", 2024-05-08T18:31:12.627 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0299999999999998e-07 2024-05-08T18:31:12.627 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.627 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.627 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:12.628 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247972+0000", 2024-05-08T18:31:12.628 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3600000000000004e-06 2024-05-08T18:31:12.628 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.628 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.628 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:12.628 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247981+0000", 2024-05-08T18:31:12.628 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.234e-06 2024-05-08T18:31:12.628 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.628 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.628 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:12.628 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247989+0000", 2024-05-08T18:31:12.628 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5159999999999997e-06 2024-05-08T18:31:12.628 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.628 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.629 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:12.629 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.262816+0000", 2024-05-08T18:31:12.629 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.014827399999999999 2024-05-08T18:31:12.629 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.629 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.629 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:12.629 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.262948+0000", 2024-05-08T18:31:12.629 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013166799999999999 2024-05-08T18:31:12.629 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.629 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.629 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:12.629 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.263153+0000", 2024-05-08T18:31:12.629 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000205272 2024-05-08T18:31:12.630 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.630 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.630 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:12.630 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266144+0000", 2024-05-08T18:31:12.630 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029912300000000001 2024-05-08T18:31:12.630 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.630 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.630 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:12.630 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.267226+0000", 2024-05-08T18:31:12.630 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010820580000000001 2024-05-08T18:31:12.630 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.630 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.630 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:12.631 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.267315+0000", 2024-05-08T18:31:12.631 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8793000000000002e-05 2024-05-08T18:31:12.631 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.631 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.631 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:12.631 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.267381+0000", 2024-05-08T18:31:12.631 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6066000000000001e-05 2024-05-08T18:31:12.631 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:12.631 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:12.631 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:12.631 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.631 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.631 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:12.631 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.248003+0000", 2024-05-08T18:31:12.632 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 105.291213382, 2024-05-08T18:31:12.632 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.020859638999999999, 2024-05-08T18:31:12.632 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:12.632 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:12.632 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:12.632 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:12.632 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:12.632 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:12.632 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 50 2024-05-08T18:31:12.632 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.632 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:12.632 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.632 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:12.633 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248003+0000", 2024-05-08T18:31:12.633 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:12.633 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.633 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.633 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:12.633 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248003+0000", 2024-05-08T18:31:12.633 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:12.633 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.633 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.633 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:12.633 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248004+0000", 2024-05-08T18:31:12.633 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5300000000000003e-07 2024-05-08T18:31:12.633 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.634 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.634 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:12.634 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248139+0000", 2024-05-08T18:31:12.634 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000135193 2024-05-08T18:31:12.634 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.634 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.634 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:12.634 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248151+0000", 2024-05-08T18:31:12.634 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.19e-05 2024-05-08T18:31:12.634 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.634 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.634 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:12.634 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248161+0000", 2024-05-08T18:31:12.635 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4599999999999992e-06 2024-05-08T18:31:12.635 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.635 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.635 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:12.635 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.263961+0000", 2024-05-08T18:31:12.635 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015800844000000001 2024-05-08T18:31:12.635 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.635 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.635 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:12.635 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.264091+0000", 2024-05-08T18:31:12.635 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012952300000000001 2024-05-08T18:31:12.635 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.636 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.636 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:12.636 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.264306+0000", 2024-05-08T18:31:12.636 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000215541 2024-05-08T18:31:12.636 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.636 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.636 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:12.636 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.267205+0000", 2024-05-08T18:31:12.636 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0028989910000000001 2024-05-08T18:31:12.636 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.636 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.636 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:12.637 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.268631+0000", 2024-05-08T18:31:12.637 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0014257320000000001 2024-05-08T18:31:12.637 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.637 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.637 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:12.637 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.268781+0000", 2024-05-08T18:31:12.637 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000149939 2024-05-08T18:31:12.637 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.637 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.637 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:12.637 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.268863+0000", 2024-05-08T18:31:12.637 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1762999999999996e-05 2024-05-08T18:31:12.637 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:12.638 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:12.638 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:12.638 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.638 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.638 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:12.638 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.248201+0000", 2024-05-08T18:31:12.638 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 105.29101562699999, 2024-05-08T18:31:12.638 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.022909783, 2024-05-08T18:31:12.638 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:12.638 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:12.638 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:12.638 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:12.639 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:12.639 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:12.639 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 51 2024-05-08T18:31:12.639 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.639 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:12.639 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.639 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:12.639 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248201+0000", 2024-05-08T18:31:12.639 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:12.639 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.639 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.639 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:12.639 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248201+0000", 2024-05-08T18:31:12.640 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:12.640 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.640 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.640 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:12.640 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248202+0000", 2024-05-08T18:31:12.640 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2999999999999999e-07 2024-05-08T18:31:12.640 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.640 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.640 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:12.640 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248209+0000", 2024-05-08T18:31:12.640 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5769999999999996e-06 2024-05-08T18:31:12.640 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.640 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.640 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:12.641 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248221+0000", 2024-05-08T18:31:12.641 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1165999999999999e-05 2024-05-08T18:31:12.641 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.641 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.641 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:12.641 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248229+0000", 2024-05-08T18:31:12.641 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1529999999999997e-06 2024-05-08T18:31:12.641 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.641 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.641 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:12.641 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.265146+0000", 2024-05-08T18:31:12.641 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016917492999999999 2024-05-08T18:31:12.641 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.642 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.642 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:12.642 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.265282+0000", 2024-05-08T18:31:12.642 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013597199999999999 2024-05-08T18:31:12.642 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.642 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.642 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:12.642 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.265488+0000", 2024-05-08T18:31:12.642 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000206212 2024-05-08T18:31:12.642 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.642 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.642 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:12.642 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.268442+0000", 2024-05-08T18:31:12.643 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002953841 2024-05-08T18:31:12.643 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.643 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.643 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:12.643 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.270951+0000", 2024-05-08T18:31:12.643 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0025085670000000002 2024-05-08T18:31:12.643 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.643 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.643 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:12.643 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.271042+0000", 2024-05-08T18:31:12.643 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1485999999999998e-05 2024-05-08T18:31:12.643 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.643 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.644 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:12.644 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.271111+0000", 2024-05-08T18:31:12.644 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8386000000000006e-05 2024-05-08T18:31:12.644 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:12.644 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:12.644 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:12.644 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.644 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.644 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:12.644 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.248244+0000", 2024-05-08T18:31:12.644 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 105.290973071, 2024-05-08T18:31:12.644 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.023010806000000002, 2024-05-08T18:31:12.644 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:12.644 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:12.645 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:12.645 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:12.645 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:12.645 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:12.645 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 52 2024-05-08T18:31:12.645 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.645 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:12.645 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.645 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:12.645 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248244+0000", 2024-05-08T18:31:12.645 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:12.645 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.645 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.646 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:12.646 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248244+0000", 2024-05-08T18:31:12.646 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:12.646 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.646 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.646 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:12.646 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248244+0000", 2024-05-08T18:31:12.646 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0999999999999998e-07 2024-05-08T18:31:12.646 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.646 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.646 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:12.646 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248251+0000", 2024-05-08T18:31:12.646 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9639999999999997e-06 2024-05-08T18:31:12.647 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.647 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.647 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:12.647 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248266+0000", 2024-05-08T18:31:12.647 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4996e-05 2024-05-08T18:31:12.647 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.647 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.647 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:12.647 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248274+0000", 2024-05-08T18:31:12.647 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8299999999999996e-06 2024-05-08T18:31:12.647 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.647 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.647 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:12.648 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266367+0000", 2024-05-08T18:31:12.648 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018092607 2024-05-08T18:31:12.648 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.648 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.648 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:12.648 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266532+0000", 2024-05-08T18:31:12.648 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016569600000000001 2024-05-08T18:31:12.648 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.648 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.648 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:12.648 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266729+0000", 2024-05-08T18:31:12.648 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00019630099999999999 2024-05-08T18:31:12.648 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.648 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.649 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:12.649 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.268574+0000", 2024-05-08T18:31:12.649 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0018452329999999999 2024-05-08T18:31:12.649 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.649 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.649 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:12.649 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.271128+0000", 2024-05-08T18:31:12.649 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00255369 2024-05-08T18:31:12.649 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.649 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.649 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:12.649 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.271199+0000", 2024-05-08T18:31:12.649 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1712999999999996e-05 2024-05-08T18:31:12.650 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.650 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.650 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:12.650 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.271254+0000", 2024-05-08T18:31:12.650 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5065999999999998e-05 2024-05-08T18:31:12.650 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:12.650 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:12.650 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:12.650 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.650 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.650 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:12.650 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.486052+0000", 2024-05-08T18:31:12.651 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 105.053164627, 2024-05-08T18:31:12.651 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0098898389999999992, 2024-05-08T18:31:12.651 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:12.651 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:12.651 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:12.651 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:12.651 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:12.651 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:12.651 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 72 2024-05-08T18:31:12.651 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.651 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:12.651 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.651 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:12.652 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486052+0000", 2024-05-08T18:31:12.652 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:12.652 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.652 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.652 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:12.652 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486052+0000", 2024-05-08T18:31:12.652 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:12.652 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.652 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.652 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:12.652 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486053+0000", 2024-05-08T18:31:12.652 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1200000000000001e-07 2024-05-08T18:31:12.652 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.652 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.653 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:12.653 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486188+0000", 2024-05-08T18:31:12.653 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013526200000000001 2024-05-08T18:31:12.653 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.653 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.653 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:12.653 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486205+0000", 2024-05-08T18:31:12.653 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6742e-05 2024-05-08T18:31:12.653 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.653 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.653 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:12.653 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486215+0000", 2024-05-08T18:31:12.653 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8290000000000003e-06 2024-05-08T18:31:12.654 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.654 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.654 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:12.654 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.491930+0000", 2024-05-08T18:31:12.654 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0057153660000000004 2024-05-08T18:31:12.654 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.654 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.654 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:12.654 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.491995+0000", 2024-05-08T18:31:12.654 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5289000000000005e-05 2024-05-08T18:31:12.654 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.654 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.654 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:12.655 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.492096+0000", 2024-05-08T18:31:12.655 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010101400000000001 2024-05-08T18:31:12.655 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.655 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.655 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:12.655 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.494152+0000", 2024-05-08T18:31:12.655 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0020560740000000002 2024-05-08T18:31:12.655 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.655 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.655 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:12.655 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.495860+0000", 2024-05-08T18:31:12.655 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0017076159999999999 2024-05-08T18:31:12.655 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.656 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.656 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:12.656 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.495903+0000", 2024-05-08T18:31:12.656 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3009000000000001e-05 2024-05-08T18:31:12.656 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.656 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.656 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:12.656 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.495942+0000", 2024-05-08T18:31:12.656 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8726000000000002e-05 2024-05-08T18:31:12.656 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:12.656 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:12.656 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:12.656 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.657 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.657 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:12.657 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.486234+0000", 2024-05-08T18:31:12.657 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 105.052982559, 2024-05-08T18:31:12.657 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0099742340000000002, 2024-05-08T18:31:12.657 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:12.657 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:12.657 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:12.657 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:12.657 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:12.657 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:12.657 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 73 2024-05-08T18:31:12.657 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.658 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:12.658 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.658 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:12.658 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486234+0000", 2024-05-08T18:31:12.658 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:12.658 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.658 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.658 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:12.658 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486234+0000", 2024-05-08T18:31:12.658 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:12.658 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.658 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.658 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:12.658 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486235+0000", 2024-05-08T18:31:12.659 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.108e-06 2024-05-08T18:31:12.659 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.659 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.659 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:12.659 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486241+0000", 2024-05-08T18:31:12.659 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4e-06 2024-05-08T18:31:12.659 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.659 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.659 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:12.659 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486251+0000", 2024-05-08T18:31:12.659 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0209e-05 2024-05-08T18:31:12.659 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.659 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.660 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:12.660 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486260+0000", 2024-05-08T18:31:12.660 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2709999999999998e-06 2024-05-08T18:31:12.660 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.660 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.660 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:12.660 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.493294+0000", 2024-05-08T18:31:12.660 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0070341070000000004 2024-05-08T18:31:12.660 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.660 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.660 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:12.660 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.493370+0000", 2024-05-08T18:31:12.661 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5846999999999994e-05 2024-05-08T18:31:12.661 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.661 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.661 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:12.661 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.493479+0000", 2024-05-08T18:31:12.661 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010905500000000001 2024-05-08T18:31:12.661 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.661 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.661 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:12.661 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.495950+0000", 2024-05-08T18:31:12.661 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0024709749999999998 2024-05-08T18:31:12.661 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.661 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.661 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:12.662 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496023+0000", 2024-05-08T18:31:12.662 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3071999999999994e-05 2024-05-08T18:31:12.662 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.662 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.662 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:12.662 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496091+0000", 2024-05-08T18:31:12.662 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7646999999999998e-05 2024-05-08T18:31:12.662 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.662 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.662 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:12.662 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496208+0000", 2024-05-08T18:31:12.662 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000117543 2024-05-08T18:31:12.662 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:12.663 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:12.663 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:12.663 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.663 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.663 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:12.663 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.486276+0000", 2024-05-08T18:31:12.663 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 105.052940234, 2024-05-08T18:31:12.663 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010822577, 2024-05-08T18:31:12.663 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:12.663 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:12.663 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:12.663 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:12.663 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:12.663 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:12.664 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 74 2024-05-08T18:31:12.664 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.664 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:12.664 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.664 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:12.664 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486276+0000", 2024-05-08T18:31:12.664 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:12.664 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.664 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.664 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:12.664 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486276+0000", 2024-05-08T18:31:12.664 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:12.664 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.665 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.665 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:12.665 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486277+0000", 2024-05-08T18:31:12.665 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1699999999999997e-07 2024-05-08T18:31:12.665 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.665 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.665 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:12.665 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486282+0000", 2024-05-08T18:31:12.665 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0429999999999998e-06 2024-05-08T18:31:12.665 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.665 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.665 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:12.665 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486294+0000", 2024-05-08T18:31:12.665 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1717e-05 2024-05-08T18:31:12.666 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.666 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.666 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:12.666 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486303+0000", 2024-05-08T18:31:12.666 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.3999999999999998e-06 2024-05-08T18:31:12.666 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.666 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.666 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:12.666 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.494424+0000", 2024-05-08T18:31:12.666 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0081205960000000008 2024-05-08T18:31:12.666 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.666 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.666 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:12.667 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.494539+0000", 2024-05-08T18:31:12.667 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000115661 2024-05-08T18:31:12.667 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.667 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.667 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:12.667 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.494704+0000", 2024-05-08T18:31:12.667 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016422999999999999 2024-05-08T18:31:12.667 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.667 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.667 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:12.667 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496800+0000", 2024-05-08T18:31:12.667 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002096508 2024-05-08T18:31:12.668 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.668 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.668 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:12.668 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496889+0000", 2024-05-08T18:31:12.668 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8349000000000004e-05 2024-05-08T18:31:12.668 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.668 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.668 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:12.668 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496983+0000", 2024-05-08T18:31:12.668 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4882000000000004e-05 2024-05-08T18:31:12.668 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.668 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.668 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:12.668 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.497099+0000", 2024-05-08T18:31:12.669 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000115474 2024-05-08T18:31:12.669 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:12.669 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:12.669 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:12.669 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.669 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.669 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:12.669 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.486324+0000", 2024-05-08T18:31:12.669 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 105.052892214, 2024-05-08T18:31:12.669 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010949207000000001, 2024-05-08T18:31:12.669 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:12.669 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:12.669 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:12.670 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:12.670 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:12.670 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:12.670 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 75 2024-05-08T18:31:12.670 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.670 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:12.670 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.670 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:12.670 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486324+0000", 2024-05-08T18:31:12.670 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:12.670 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.670 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.671 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:12.671 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486324+0000", 2024-05-08T18:31:12.671 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:12.671 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.671 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.671 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:12.671 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486325+0000", 2024-05-08T18:31:12.671 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6200000000000006e-07 2024-05-08T18:31:12.671 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.671 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.671 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:12.671 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486439+0000", 2024-05-08T18:31:12.671 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000113391 2024-05-08T18:31:12.671 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.671 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.672 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:12.672 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486455+0000", 2024-05-08T18:31:12.672 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5823000000000001e-05 2024-05-08T18:31:12.672 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.672 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.672 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:12.672 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486465+0000", 2024-05-08T18:31:12.672 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0879999999999999e-05 2024-05-08T18:31:12.672 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.672 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.672 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:12.672 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.495149+0000", 2024-05-08T18:31:12.673 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0086833589999999999 2024-05-08T18:31:12.673 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.673 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.673 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:12.673 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.495213+0000", 2024-05-08T18:31:12.673 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4176000000000004e-05 2024-05-08T18:31:12.673 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.673 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.673 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:12.673 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.495350+0000", 2024-05-08T18:31:12.673 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013709099999999999 2024-05-08T18:31:12.673 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.673 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.673 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:12.673 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496809+0000", 2024-05-08T18:31:12.674 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001458953 2024-05-08T18:31:12.674 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.674 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.674 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:12.674 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.497199+0000", 2024-05-08T18:31:12.674 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00039045200000000001 2024-05-08T18:31:12.674 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.674 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.674 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:12.674 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.497241+0000", 2024-05-08T18:31:12.674 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1378999999999998e-05 2024-05-08T18:31:12.674 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.675 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.675 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:12.675 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.497274+0000", 2024-05-08T18:31:12.675 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2740999999999997e-05 2024-05-08T18:31:12.675 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:12.675 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:12.675 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:12.675 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.675 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.675 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:12.675 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.486483+0000", 2024-05-08T18:31:12.675 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 105.052734039, 2024-05-08T18:31:12.675 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011783448, 2024-05-08T18:31:12.676 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:12.676 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:12.676 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:12.676 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:12.676 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:12.676 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:12.676 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 76 2024-05-08T18:31:12.676 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.676 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:12.676 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.676 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:12.676 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486483+0000", 2024-05-08T18:31:12.676 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:12.677 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.677 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.677 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:12.677 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486483+0000", 2024-05-08T18:31:12.677 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:12.677 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.677 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.677 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:12.677 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486483+0000", 2024-05-08T18:31:12.677 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6599999999999995e-07 2024-05-08T18:31:12.677 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.677 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.677 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:12.678 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486491+0000", 2024-05-08T18:31:12.678 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.2520000000000002e-06 2024-05-08T18:31:12.678 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.678 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.678 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:12.678 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486500+0000", 2024-05-08T18:31:12.678 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4420000000000004e-06 2024-05-08T18:31:12.678 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.678 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.678 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:12.678 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486507+0000", 2024-05-08T18:31:12.678 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3549999999999999e-06 2024-05-08T18:31:12.678 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.678 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.679 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:12.679 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496319+0000", 2024-05-08T18:31:12.679 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0098120529999999994 2024-05-08T18:31:12.679 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.679 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.679 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:12.679 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496391+0000", 2024-05-08T18:31:12.679 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1433000000000005e-05 2024-05-08T18:31:12.679 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.679 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.679 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:12.679 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496508+0000", 2024-05-08T18:31:12.679 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000116778 2024-05-08T18:31:12.680 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.680 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.680 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:12.680 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.497284+0000", 2024-05-08T18:31:12.680 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00077609100000000002 2024-05-08T18:31:12.680 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.680 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.680 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:12.680 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.498204+0000", 2024-05-08T18:31:12.680 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00092027299999999999 2024-05-08T18:31:12.680 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.680 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.680 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:12.681 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.498240+0000", 2024-05-08T18:31:12.681 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5979999999999998e-05 2024-05-08T18:31:12.681 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.681 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.681 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:12.681 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.498266+0000", 2024-05-08T18:31:12.681 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6024999999999999e-05 2024-05-08T18:31:12.681 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:12.681 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:12.681 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:12.681 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.681 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.681 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:94 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:12.681 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.842580+0000", 2024-05-08T18:31:12.682 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 104.696636738, 2024-05-08T18:31:12.682 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0085315870000000002, 2024-05-08T18:31:12.682 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:12.682 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:12.682 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:12.682 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:12.682 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:12.682 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:12.682 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 94 2024-05-08T18:31:12.682 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.682 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:12.682 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.682 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:12.683 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.842580+0000", 2024-05-08T18:31:12.683 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:12.683 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.683 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.683 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:12.683 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.842580+0000", 2024-05-08T18:31:12.683 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:12.683 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.683 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.683 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:12.683 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.842581+0000", 2024-05-08T18:31:12.683 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.11e-06 2024-05-08T18:31:12.683 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.684 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.684 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:12.684 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.842587+0000", 2024-05-08T18:31:12.684 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2899999999999999e-06 2024-05-08T18:31:12.684 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.684 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.684 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:12.684 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.842597+0000", 2024-05-08T18:31:12.684 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.007e-05 2024-05-08T18:31:12.684 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.684 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.684 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:12.684 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.842605+0000", 2024-05-08T18:31:12.684 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1270000000000003e-06 2024-05-08T18:31:12.684 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.685 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.685 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:12.685 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.848358+0000", 2024-05-08T18:31:12.685 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0057525140000000002 2024-05-08T18:31:12.685 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.685 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.685 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:12.685 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.848481+0000", 2024-05-08T18:31:12.685 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000123239 2024-05-08T18:31:12.685 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.685 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.685 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:12.686 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.848695+0000", 2024-05-08T18:31:12.686 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000213387 2024-05-08T18:31:12.686 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.686 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.686 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:12.686 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.849781+0000", 2024-05-08T18:31:12.686 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010868 2024-05-08T18:31:12.686 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.686 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.686 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:12.686 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.850990+0000", 2024-05-08T18:31:12.686 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0012084769999999999 2024-05-08T18:31:12.686 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.687 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.687 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:12.687 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.851059+0000", 2024-05-08T18:31:12.687 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9130999999999999e-05 2024-05-08T18:31:12.687 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:12.687 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:12.687 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:12.687 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.851111+0000", 2024-05-08T18:31:12.687 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2441999999999997e-05 2024-05-08T18:31:12.687 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:12.687 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:12.687 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:12.687 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:12.687 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:12.688 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:31:12.689 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-08T18:31:12.690 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:31:12.687+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:31:12.710 INFO:teuthology.orchestra.run.smithi097.stderr:reweighted osd.2 to 1 (10000) 2024-05-08T18:31:12.728 INFO:teuthology.orchestra.run.smithi097.stderr:noscrub is set 2024-05-08T18:31:12.752 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-05-08T18:31:12.804 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:31:12.803+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:31:12.870 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:12.870 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:31:12.870 INFO:teuthology.orchestra.run.smithi097.stdout: "num_ops": 0 2024-05-08T18:31:12.870 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:12.890 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-08T18:31:12.891 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:31:12.887+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:31:12.993 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:31:12.991+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:31:13.063 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:13.064 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:31:13.064 INFO:teuthology.orchestra.run.smithi097.stdout: "complaint_time": 30, 2024-05-08T18:31:13.064 INFO:teuthology.orchestra.run.smithi097.stdout: "num_blocked_ops": 0 2024-05-08T18:31:13.064 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:13.081 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-08T18:31:13.093 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:31:13.095+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:31:13.194 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:31:13.195+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:31:13.252 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:13.253 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2024-05-08T18:31:13.253 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2024-05-08T18:31:13.253 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-05-08T18:31:13.253 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.253 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4206.0:24 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'14, mlcod=16'9)", 2024-05-08T18:31:13.253 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:27.162224+0000", 2024-05-08T18:31:13.253 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 106.089994479, 2024-05-08T18:31:13.253 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032712890000000001, 2024-05-08T18:31:13.253 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:13.253 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:13.254 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:13.254 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:13.254 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.254 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:13.254 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162224+0000", 2024-05-08T18:31:13.254 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:13.254 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.254 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.254 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:13.255 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162224+0000", 2024-05-08T18:31:13.255 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:13.255 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.255 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.255 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:13.255 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162225+0000", 2024-05-08T18:31:13.255 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4899999999999999e-06 2024-05-08T18:31:13.255 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.255 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.255 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:13.255 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162306+0000", 2024-05-08T18:31:13.256 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.0589999999999999e-05 2024-05-08T18:31:13.256 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.256 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.256 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:13.256 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162332+0000", 2024-05-08T18:31:13.256 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5658999999999999e-05 2024-05-08T18:31:13.256 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.256 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.256 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:13.256 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162345+0000", 2024-05-08T18:31:13.256 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3512999999999999e-05 2024-05-08T18:31:13.256 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.256 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.256 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:13.257 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162465+0000", 2024-05-08T18:31:13.257 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000119577 2024-05-08T18:31:13.257 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.257 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.257 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:13.257 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162513+0000", 2024-05-08T18:31:13.257 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8773999999999998e-05 2024-05-08T18:31:13.257 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.257 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.257 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:13.257 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.165405+0000", 2024-05-08T18:31:13.257 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028919200000000001 2024-05-08T18:31:13.257 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.257 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.258 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:13.258 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.165495+0000", 2024-05-08T18:31:13.258 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9765999999999994e-05 2024-05-08T18:31:13.258 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:13.258 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:13.258 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:13.258 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.258 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.258 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4206.0:25 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'15, mlcod=16'10)", 2024-05-08T18:31:13.258 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:27.164793+0000", 2024-05-08T18:31:13.258 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 106.08742535099999, 2024-05-08T18:31:13.258 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032285249999999999, 2024-05-08T18:31:13.258 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:13.258 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:13.259 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:13.259 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:13.259 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.259 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:13.259 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164793+0000", 2024-05-08T18:31:13.259 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:13.259 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.259 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.259 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:13.259 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164793+0000", 2024-05-08T18:31:13.259 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:13.259 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.259 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.259 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:13.259 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164795+0000", 2024-05-08T18:31:13.260 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0999999999999998e-06 2024-05-08T18:31:13.260 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.260 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.260 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:13.260 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164811+0000", 2024-05-08T18:31:13.260 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5722999999999998e-05 2024-05-08T18:31:13.260 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.260 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.260 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:13.260 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164841+0000", 2024-05-08T18:31:13.260 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0355999999999999e-05 2024-05-08T18:31:13.260 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.260 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.260 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:13.261 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164861+0000", 2024-05-08T18:31:13.261 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9533000000000001e-05 2024-05-08T18:31:13.261 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.261 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.261 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:13.261 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164984+0000", 2024-05-08T18:31:13.261 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000123146 2024-05-08T18:31:13.261 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.261 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.261 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:13.261 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.165024+0000", 2024-05-08T18:31:13.261 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9690000000000001e-05 2024-05-08T18:31:13.261 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.262 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.262 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:13.262 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.167935+0000", 2024-05-08T18:31:13.262 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0029113300000000002 2024-05-08T18:31:13.262 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.262 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.262 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:13.262 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.168021+0000", 2024-05-08T18:31:13.262 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6646999999999999e-05 2024-05-08T18:31:13.262 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:13.262 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:13.262 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:13.262 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.263 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.263 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:31:13.263 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:48.674737+0000", 2024-05-08T18:31:13.263 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 84.577481433000003, 2024-05-08T18:31:13.263 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0035019780000000002, 2024-05-08T18:31:13.263 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:13.263 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:13.263 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:13.263 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:13.263 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:13.263 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:13.263 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 60 2024-05-08T18:31:13.263 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.263 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:13.264 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.264 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:13.264 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674737+0000", 2024-05-08T18:31:13.264 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:13.264 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.264 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.264 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:13.264 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674737+0000", 2024-05-08T18:31:13.264 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:13.264 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.264 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.264 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:13.264 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674740+0000", 2024-05-08T18:31:13.264 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.36e-06 2024-05-08T18:31:13.265 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.265 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.265 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:13.265 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674753+0000", 2024-05-08T18:31:13.265 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3151e-05 2024-05-08T18:31:13.265 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.265 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.266 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:13.266 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674789+0000", 2024-05-08T18:31:13.266 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5929000000000001e-05 2024-05-08T18:31:13.266 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.266 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.266 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:13.266 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674813+0000", 2024-05-08T18:31:13.266 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3325000000000001e-05 2024-05-08T18:31:13.266 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.266 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.266 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:13.266 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674981+0000", 2024-05-08T18:31:13.267 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016879899999999999 2024-05-08T18:31:13.267 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.267 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.267 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:13.267 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.675304+0000", 2024-05-08T18:31:13.267 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00032214400000000001 2024-05-08T18:31:13.267 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.267 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.267 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-05-08T18:31:13.267 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.675639+0000", 2024-05-08T18:31:13.267 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00033494699999999999 2024-05-08T18:31:13.267 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.267 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.267 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:13.268 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.676901+0000", 2024-05-08T18:31:13.268 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001262167 2024-05-08T18:31:13.268 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.268 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.268 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:13.268 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678078+0000", 2024-05-08T18:31:13.268 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001177588 2024-05-08T18:31:13.268 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.268 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.268 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:13.268 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678171+0000", 2024-05-08T18:31:13.268 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.2331999999999996e-05 2024-05-08T18:31:13.269 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.269 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.269 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:13.269 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678239+0000", 2024-05-08T18:31:13.269 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8236000000000002e-05 2024-05-08T18:31:13.269 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:13.269 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:13.269 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:13.269 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.269 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.269 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:61 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94069412632064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:31:13.269 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:48.678410+0000", 2024-05-08T18:31:13.269 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 84.573808041000007, 2024-05-08T18:31:13.270 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0026001800000000001, 2024-05-08T18:31:13.270 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:13.270 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:13.270 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:13.270 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:13.270 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:13.270 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:13.270 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 61 2024-05-08T18:31:13.270 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.270 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:13.270 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.271 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:13.271 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678410+0000", 2024-05-08T18:31:13.271 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:13.271 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.271 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.271 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:13.271 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678410+0000", 2024-05-08T18:31:13.271 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:13.271 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.271 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.271 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:13.271 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678413+0000", 2024-05-08T18:31:13.271 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.34e-06 2024-05-08T18:31:13.271 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.272 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.272 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:13.272 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678421+0000", 2024-05-08T18:31:13.272 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6910000000000003e-06 2024-05-08T18:31:13.272 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.272 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.272 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:13.272 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678447+0000", 2024-05-08T18:31:13.272 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6010999999999999e-05 2024-05-08T18:31:13.272 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.272 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.272 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:13.272 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678461+0000", 2024-05-08T18:31:13.273 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3900000000000001e-05 2024-05-08T18:31:13.273 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.273 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.273 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:13.273 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678560+0000", 2024-05-08T18:31:13.273 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.8834999999999998e-05 2024-05-08T18:31:13.273 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.273 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.273 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:13.273 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678704+0000", 2024-05-08T18:31:13.273 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000143769 2024-05-08T18:31:13.274 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.274 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.274 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-05-08T18:31:13.274 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678942+0000", 2024-05-08T18:31:13.274 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023861800000000001 2024-05-08T18:31:13.274 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.274 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.274 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:13.274 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.680269+0000", 2024-05-08T18:31:13.274 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001326484 2024-05-08T18:31:13.275 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.275 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.275 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:13.275 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.680823+0000", 2024-05-08T18:31:13.275 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00055455900000000004 2024-05-08T18:31:13.275 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.275 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.275 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:13.275 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.680908+0000", 2024-05-08T18:31:13.275 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.4073999999999995e-05 2024-05-08T18:31:13.275 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.276 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.276 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:13.276 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.681010+0000", 2024-05-08T18:31:13.276 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010289900000000001 2024-05-08T18:31:13.276 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:13.276 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:13.276 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:13.276 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.276 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.276 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:31:13.277 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.671896+0000", 2024-05-08T18:31:13.277 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 81.580322155999994, 2024-05-08T18:31:13.277 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032352349999999999, 2024-05-08T18:31:13.277 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:13.277 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:13.277 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:13.277 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:13.277 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:13.277 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:13.277 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 206 2024-05-08T18:31:13.277 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.277 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:13.277 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.277 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:13.278 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671896+0000", 2024-05-08T18:31:13.278 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:13.278 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.278 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.278 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:13.278 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671896+0000", 2024-05-08T18:31:13.278 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:13.278 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.278 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.278 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:13.278 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671901+0000", 2024-05-08T18:31:13.279 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.763e-06 2024-05-08T18:31:13.279 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.279 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.279 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:13.279 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671920+0000", 2024-05-08T18:31:13.279 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9403e-05 2024-05-08T18:31:13.279 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.279 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.279 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:13.280 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671969+0000", 2024-05-08T18:31:13.280 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8343000000000001e-05 2024-05-08T18:31:13.280 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.280 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.280 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:13.280 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671996+0000", 2024-05-08T18:31:13.280 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7307000000000001e-05 2024-05-08T18:31:13.280 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.280 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.280 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:13.280 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.672149+0000", 2024-05-08T18:31:13.280 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015336500000000001 2024-05-08T18:31:13.281 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.281 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.281 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:13.281 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.672393+0000", 2024-05-08T18:31:13.281 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024380800000000001 2024-05-08T18:31:13.281 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.281 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.281 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-05-08T18:31:13.281 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.672838+0000", 2024-05-08T18:31:13.281 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00044472700000000001 2024-05-08T18:31:13.281 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.281 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.281 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:13.281 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.674218+0000", 2024-05-08T18:31:13.282 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001380243 2024-05-08T18:31:13.282 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.282 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.282 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:13.282 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.674963+0000", 2024-05-08T18:31:13.282 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00074534999999999998 2024-05-08T18:31:13.282 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.282 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.282 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:13.282 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675057+0000", 2024-05-08T18:31:13.282 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.3633000000000003e-05 2024-05-08T18:31:13.282 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.282 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.283 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:13.283 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675131+0000", 2024-05-08T18:31:13.283 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.4293000000000002e-05 2024-05-08T18:31:13.283 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:13.283 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:13.283 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:13.283 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.283 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.283 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:13.283 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.694194+0000", 2024-05-08T18:31:13.283 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 81.558024758000002, 2024-05-08T18:31:13.283 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0087385129999999998, 2024-05-08T18:31:13.283 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:13.283 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:13.284 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:13.284 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:13.284 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:13.284 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:13.284 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 210 2024-05-08T18:31:13.284 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.284 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:13.284 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.284 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:13.284 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694194+0000", 2024-05-08T18:31:13.284 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:13.284 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.284 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.284 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:13.285 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694194+0000", 2024-05-08T18:31:13.285 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:13.285 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.285 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.285 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:13.285 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694196+0000", 2024-05-08T18:31:13.285 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6299999999999998e-06 2024-05-08T18:31:13.285 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.285 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.285 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:13.285 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694208+0000", 2024-05-08T18:31:13.285 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.187e-05 2024-05-08T18:31:13.285 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.286 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.286 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:13.286 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694240+0000", 2024-05-08T18:31:13.286 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1673e-05 2024-05-08T18:31:13.286 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.286 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.286 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:13.287 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694255+0000", 2024-05-08T18:31:13.287 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5573000000000002e-05 2024-05-08T18:31:13.287 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.287 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.287 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:13.287 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694394+0000", 2024-05-08T18:31:13.287 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000138536 2024-05-08T18:31:13.287 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.287 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.288 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-05-08T18:31:13.288 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694405+0000", 2024-05-08T18:31:13.288 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0883000000000001e-05 2024-05-08T18:31:13.288 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.288 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.288 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:13.288 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.699491+0000", 2024-05-08T18:31:13.288 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0050861939999999996 2024-05-08T18:31:13.288 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.288 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.288 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:13.289 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.699829+0000", 2024-05-08T18:31:13.289 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000338191 2024-05-08T18:31:13.289 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.289 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.289 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:13.289 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.700504+0000", 2024-05-08T18:31:13.289 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000674481 2024-05-08T18:31:13.289 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.289 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.289 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:13.289 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.702152+0000", 2024-05-08T18:31:13.289 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0016487450000000001 2024-05-08T18:31:13.289 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.289 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.290 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:13.290 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.702792+0000", 2024-05-08T18:31:13.290 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00063962800000000005 2024-05-08T18:31:13.290 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.290 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.290 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:13.290 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.702874+0000", 2024-05-08T18:31:13.290 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.2091999999999999e-05 2024-05-08T18:31:13.290 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.290 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.290 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:13.291 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.702932+0000", 2024-05-08T18:31:13.291 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8016999999999997e-05 2024-05-08T18:31:13.291 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:13.291 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:13.291 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:13.291 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.291 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.291 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:13.291 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.728239+0000", 2024-05-08T18:31:13.291 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 81.523978897000006, 2024-05-08T18:31:13.291 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0035376119999999999, 2024-05-08T18:31:13.291 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:13.291 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:13.291 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:13.291 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:13.292 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:13.292 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:13.292 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 218 2024-05-08T18:31:13.292 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.292 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:13.292 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.292 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:13.292 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728239+0000", 2024-05-08T18:31:13.292 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:13.292 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.292 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.292 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:13.292 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728239+0000", 2024-05-08T18:31:13.292 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:13.293 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.293 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.293 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:13.293 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728242+0000", 2024-05-08T18:31:13.293 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0130000000000002e-06 2024-05-08T18:31:13.293 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.293 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.293 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:13.293 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728254+0000", 2024-05-08T18:31:13.293 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.172e-05 2024-05-08T18:31:13.293 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.293 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.293 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:13.294 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728285+0000", 2024-05-08T18:31:13.294 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0703000000000001e-05 2024-05-08T18:31:13.294 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.294 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.294 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:13.294 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728301+0000", 2024-05-08T18:31:13.294 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5656999999999999e-05 2024-05-08T18:31:13.294 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.294 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.294 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:13.294 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728460+0000", 2024-05-08T18:31:13.294 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015934200000000001 2024-05-08T18:31:13.294 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.294 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.295 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:13.295 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728803+0000", 2024-05-08T18:31:13.295 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00034267400000000001 2024-05-08T18:31:13.295 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.295 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.295 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:13.295 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.729485+0000", 2024-05-08T18:31:13.295 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00068206799999999998 2024-05-08T18:31:13.295 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.295 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.295 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:13.295 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731218+0000", 2024-05-08T18:31:13.295 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0017332630000000001 2024-05-08T18:31:13.295 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.296 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.296 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:13.296 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731615+0000", 2024-05-08T18:31:13.296 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00039671699999999999 2024-05-08T18:31:13.296 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.296 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.296 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:13.296 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731709+0000", 2024-05-08T18:31:13.296 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.4740000000000004e-05 2024-05-08T18:31:13.296 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.296 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.296 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:13.296 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731777+0000", 2024-05-08T18:31:13.296 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7714999999999998e-05 2024-05-08T18:31:13.296 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:13.297 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:13.297 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:13.297 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.297 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.297 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:13.297 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.743331+0000", 2024-05-08T18:31:13.297 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 81.508886914000001, 2024-05-08T18:31:13.297 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031193229999999998, 2024-05-08T18:31:13.297 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:13.297 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:13.297 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:13.297 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:13.298 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:13.298 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:13.298 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 222 2024-05-08T18:31:13.298 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.298 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:13.298 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.298 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:13.298 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743331+0000", 2024-05-08T18:31:13.298 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:13.298 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.298 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.299 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:13.299 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743331+0000", 2024-05-08T18:31:13.299 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:13.299 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.299 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.299 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:13.299 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743334+0000", 2024-05-08T18:31:13.299 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2900000000000001e-06 2024-05-08T18:31:13.299 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.299 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.299 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:13.299 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743345+0000", 2024-05-08T18:31:13.300 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0947e-05 2024-05-08T18:31:13.300 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.300 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.300 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:13.300 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743375+0000", 2024-05-08T18:31:13.300 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0298999999999999e-05 2024-05-08T18:31:13.300 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.300 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.300 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:13.300 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743390+0000", 2024-05-08T18:31:13.300 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4606999999999999e-05 2024-05-08T18:31:13.300 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.300 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.300 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:13.301 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743524+0000", 2024-05-08T18:31:13.301 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000134105 2024-05-08T18:31:13.301 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.301 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.301 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:13.301 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743738+0000", 2024-05-08T18:31:13.301 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000214222 2024-05-08T18:31:13.301 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.301 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.301 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:13.301 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.744159+0000", 2024-05-08T18:31:13.301 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00042102300000000002 2024-05-08T18:31:13.301 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.301 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.302 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:13.302 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.745399+0000", 2024-05-08T18:31:13.302 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012400309999999999 2024-05-08T18:31:13.302 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.302 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.302 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:13.302 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.746296+0000", 2024-05-08T18:31:13.302 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00089682 2024-05-08T18:31:13.302 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.302 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.302 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:13.302 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.746385+0000", 2024-05-08T18:31:13.302 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9289000000000005e-05 2024-05-08T18:31:13.302 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.303 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.303 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:13.303 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.746451+0000", 2024-05-08T18:31:13.303 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5690000000000003e-05 2024-05-08T18:31:13.303 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:13.303 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:13.303 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:13.303 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.303 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.303 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:13.303 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.772338+0000", 2024-05-08T18:31:13.304 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 81.479880714000004, 2024-05-08T18:31:13.304 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0035084059999999999, 2024-05-08T18:31:13.304 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:13.304 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:13.304 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:13.304 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:13.304 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:13.304 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:13.304 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 230 2024-05-08T18:31:13.304 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.304 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:13.304 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.304 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:13.304 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772338+0000", 2024-05-08T18:31:13.305 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:13.305 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.305 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.305 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:13.305 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772338+0000", 2024-05-08T18:31:13.305 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:13.305 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.305 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.305 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:13.305 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772340+0000", 2024-05-08T18:31:13.305 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3460000000000001e-06 2024-05-08T18:31:13.305 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.305 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.305 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:13.306 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772352+0000", 2024-05-08T18:31:13.306 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2284e-05 2024-05-08T18:31:13.306 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.306 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.306 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:13.306 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772382+0000", 2024-05-08T18:31:13.306 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0083e-05 2024-05-08T18:31:13.306 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.306 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.306 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:13.306 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772397+0000", 2024-05-08T18:31:13.306 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4963000000000001e-05 2024-05-08T18:31:13.306 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.307 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.307 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:13.307 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772508+0000", 2024-05-08T18:31:13.307 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000110402 2024-05-08T18:31:13.307 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.307 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.307 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:13.307 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772742+0000", 2024-05-08T18:31:13.307 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023428899999999999 2024-05-08T18:31:13.307 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.307 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.307 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:13.307 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.773183+0000", 2024-05-08T18:31:13.307 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00044107899999999998 2024-05-08T18:31:13.307 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.308 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.308 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:13.308 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.774488+0000", 2024-05-08T18:31:13.308 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0013053940000000001 2024-05-08T18:31:13.308 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.308 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.308 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:13.308 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.775689+0000", 2024-05-08T18:31:13.308 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012004699999999999 2024-05-08T18:31:13.308 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.308 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.308 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:13.308 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.775777+0000", 2024-05-08T18:31:13.309 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8483e-05 2024-05-08T18:31:13.309 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.309 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.309 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:13.309 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.775846+0000", 2024-05-08T18:31:13.309 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8613000000000002e-05 2024-05-08T18:31:13.309 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:13.309 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:13.309 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:13.309 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.309 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.309 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:13.310 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.790921+0000", 2024-05-08T18:31:13.310 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 81.461297368000004, 2024-05-08T18:31:13.310 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003116869, 2024-05-08T18:31:13.310 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:13.310 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:13.310 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:13.310 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:13.310 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:13.310 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:13.310 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 235 2024-05-08T18:31:13.310 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.310 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:13.311 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.311 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:13.311 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790921+0000", 2024-05-08T18:31:13.311 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:13.311 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.311 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.312 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:13.312 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790921+0000", 2024-05-08T18:31:13.312 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:13.312 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.312 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.312 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:13.312 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790923+0000", 2024-05-08T18:31:13.313 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3199999999999998e-06 2024-05-08T18:31:13.313 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.313 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.313 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:13.313 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790934+0000", 2024-05-08T18:31:13.313 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.117e-05 2024-05-08T18:31:13.313 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.314 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.314 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:13.314 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790965+0000", 2024-05-08T18:31:13.314 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0392999999999999e-05 2024-05-08T18:31:13.314 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.314 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.315 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:13.315 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790981+0000", 2024-05-08T18:31:13.315 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5699999999999999e-05 2024-05-08T18:31:13.315 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.315 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.315 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:13.315 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.791093+0000", 2024-05-08T18:31:13.316 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000112062 2024-05-08T18:31:13.316 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.316 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.316 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:13.316 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.791324+0000", 2024-05-08T18:31:13.316 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023142200000000001 2024-05-08T18:31:13.317 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.317 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.317 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:13.317 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.791761+0000", 2024-05-08T18:31:13.317 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00043669999999999999 2024-05-08T18:31:13.317 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.317 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.318 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:13.318 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.792996+0000", 2024-05-08T18:31:13.318 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001235713 2024-05-08T18:31:13.318 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.318 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.318 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:13.319 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.793850+0000", 2024-05-08T18:31:13.319 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00085392400000000005 2024-05-08T18:31:13.319 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.319 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.319 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:13.319 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.793971+0000", 2024-05-08T18:31:13.319 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000120516 2024-05-08T18:31:13.320 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.320 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.320 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:13.320 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794038+0000", 2024-05-08T18:31:13.320 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6948999999999999e-05 2024-05-08T18:31:13.320 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:13.320 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:13.321 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:13.321 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.321 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.321 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:349 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:13.321 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.817315+0000", 2024-05-08T18:31:13.321 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 81.434903496999993, 2024-05-08T18:31:13.321 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0036888580000000002, 2024-05-08T18:31:13.321 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:13.321 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:13.321 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:13.321 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:13.322 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:13.322 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:13.322 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 349 2024-05-08T18:31:13.322 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.322 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:13.322 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.322 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:13.322 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817315+0000", 2024-05-08T18:31:13.322 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:13.322 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.323 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.323 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:13.323 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817315+0000", 2024-05-08T18:31:13.323 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:13.323 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.323 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.323 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:13.323 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817316+0000", 2024-05-08T18:31:13.323 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3370000000000001e-06 2024-05-08T18:31:13.323 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.323 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.323 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:13.323 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817323+0000", 2024-05-08T18:31:13.323 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.4300000000000003e-06 2024-05-08T18:31:13.324 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.324 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.324 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:13.324 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817337+0000", 2024-05-08T18:31:13.324 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4025999999999999e-05 2024-05-08T18:31:13.324 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.324 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.324 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:13.324 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817345+0000", 2024-05-08T18:31:13.324 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5669999999999995e-06 2024-05-08T18:31:13.324 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.324 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.324 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:13.324 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817407+0000", 2024-05-08T18:31:13.325 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1882000000000001e-05 2024-05-08T18:31:13.325 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.325 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.325 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:13.325 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817508+0000", 2024-05-08T18:31:13.325 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000100585 2024-05-08T18:31:13.325 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.325 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.325 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:13.325 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817673+0000", 2024-05-08T18:31:13.325 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000165802 2024-05-08T18:31:13.325 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.325 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.326 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:13.326 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.818715+0000", 2024-05-08T18:31:13.326 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0010417720000000001 2024-05-08T18:31:13.326 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.326 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.326 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:13.326 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.820892+0000", 2024-05-08T18:31:13.326 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0021771859999999998 2024-05-08T18:31:13.326 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.326 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.326 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:13.326 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.820950+0000", 2024-05-08T18:31:13.326 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7636000000000002e-05 2024-05-08T18:31:13.326 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.327 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.327 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:13.327 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.821004+0000", 2024-05-08T18:31:13.327 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3634999999999997e-05 2024-05-08T18:31:13.327 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:13.327 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:13.327 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:13.327 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.327 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.327 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:406 6.16 6:6dc3b799:reshard::reshard.0000000006:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:13.328 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.840465+0000", 2024-05-08T18:31:13.328 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 81.411753331, 2024-05-08T18:31:13.328 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003613032, 2024-05-08T18:31:13.328 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:13.328 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:13.328 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:13.328 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:13.328 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:13.328 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:13.329 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 406 2024-05-08T18:31:13.329 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.329 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:13.329 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.329 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:13.329 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840465+0000", 2024-05-08T18:31:13.329 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:13.329 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.329 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.329 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:13.329 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840465+0000", 2024-05-08T18:31:13.329 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:13.329 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.329 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.330 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:13.330 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840466+0000", 2024-05-08T18:31:13.330 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7499999999999999e-07 2024-05-08T18:31:13.330 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.330 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.330 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:13.330 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840471+0000", 2024-05-08T18:31:13.330 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9699999999999998e-06 2024-05-08T18:31:13.330 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.331 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.331 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:13.331 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840484+0000", 2024-05-08T18:31:13.331 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2717999999999999e-05 2024-05-08T18:31:13.331 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.331 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.332 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:13.332 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840490+0000", 2024-05-08T18:31:13.332 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.472e-06 2024-05-08T18:31:13.332 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.332 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.332 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:13.332 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840536+0000", 2024-05-08T18:31:13.332 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6409000000000002e-05 2024-05-08T18:31:13.333 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.333 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.333 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:13.333 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840591+0000", 2024-05-08T18:31:13.333 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4911000000000003e-05 2024-05-08T18:31:13.333 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.333 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.333 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:13.333 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840745+0000", 2024-05-08T18:31:13.333 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015394900000000001 2024-05-08T18:31:13.333 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.333 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.333 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:13.333 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.841269+0000", 2024-05-08T18:31:13.334 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00052347299999999999 2024-05-08T18:31:13.334 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.334 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.334 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:13.334 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.843997+0000", 2024-05-08T18:31:13.334 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0027285080000000001 2024-05-08T18:31:13.334 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.334 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.334 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:13.334 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844033+0000", 2024-05-08T18:31:13.334 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6038000000000003e-05 2024-05-08T18:31:13.334 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.334 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.335 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:13.335 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844078+0000", 2024-05-08T18:31:13.335 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4709000000000002e-05 2024-05-08T18:31:13.335 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:13.335 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:13.335 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:13.335 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.335 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.335 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:413 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:13.335 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.844187+0000", 2024-05-08T18:31:13.335 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 81.408031754000007, 2024-05-08T18:31:13.336 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0024835069999999998, 2024-05-08T18:31:13.336 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:13.336 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:13.336 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:13.336 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:13.336 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:13.336 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:13.336 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 413 2024-05-08T18:31:13.336 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.336 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:13.336 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.336 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:13.336 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844187+0000", 2024-05-08T18:31:13.336 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:13.337 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.337 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.337 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:13.337 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844187+0000", 2024-05-08T18:31:13.337 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:13.337 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.337 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.337 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:13.337 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844187+0000", 2024-05-08T18:31:13.337 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9999999999999996e-07 2024-05-08T18:31:13.337 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.338 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.338 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:13.338 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844192+0000", 2024-05-08T18:31:13.338 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7899999999999999e-06 2024-05-08T18:31:13.338 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.338 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.338 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:13.338 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844203+0000", 2024-05-08T18:31:13.338 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1002000000000001e-05 2024-05-08T18:31:13.339 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.339 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.339 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:13.339 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844209+0000", 2024-05-08T18:31:13.339 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6570000000000002e-06 2024-05-08T18:31:13.339 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.339 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.339 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:13.339 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844270+0000", 2024-05-08T18:31:13.339 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0810999999999998e-05 2024-05-08T18:31:13.339 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.339 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.339 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:13.340 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844419+0000", 2024-05-08T18:31:13.340 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000149097 2024-05-08T18:31:13.340 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.340 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.340 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:13.340 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844611+0000", 2024-05-08T18:31:13.340 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00019247900000000001 2024-05-08T18:31:13.340 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.341 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.341 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:13.341 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.845287+0000", 2024-05-08T18:31:13.341 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00067526000000000001 2024-05-08T18:31:13.341 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.341 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.341 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:13.341 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.846609+0000", 2024-05-08T18:31:13.341 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001322124 2024-05-08T18:31:13.341 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.341 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.341 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:13.341 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.846642+0000", 2024-05-08T18:31:13.342 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3654e-05 2024-05-08T18:31:13.342 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.342 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.342 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:13.342 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.846670+0000", 2024-05-08T18:31:13.342 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7733e-05 2024-05-08T18:31:13.342 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:13.342 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:13.342 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:13.342 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.342 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.342 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:420 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:13.343 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.847096+0000", 2024-05-08T18:31:13.343 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 81.405122460000001, 2024-05-08T18:31:13.343 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0026261589999999999, 2024-05-08T18:31:13.343 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:13.343 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:13.343 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:13.343 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:13.343 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:13.343 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:13.343 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 420 2024-05-08T18:31:13.343 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.343 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:13.343 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.343 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:13.344 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847096+0000", 2024-05-08T18:31:13.344 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:13.344 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.344 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.344 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:13.344 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847096+0000", 2024-05-08T18:31:13.344 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:13.344 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.344 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.344 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:13.344 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847097+0000", 2024-05-08T18:31:13.344 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.5499999999999996e-07 2024-05-08T18:31:13.344 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.344 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.344 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:13.345 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847103+0000", 2024-05-08T18:31:13.345 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8969999999999996e-06 2024-05-08T18:31:13.345 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.345 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.345 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:13.345 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847114+0000", 2024-05-08T18:31:13.345 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1549000000000001e-05 2024-05-08T18:31:13.345 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.345 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.345 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:13.345 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847120+0000", 2024-05-08T18:31:13.345 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5509999999999999e-06 2024-05-08T18:31:13.345 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.345 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.346 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:13.346 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847166+0000", 2024-05-08T18:31:13.346 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6683e-05 2024-05-08T18:31:13.346 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.346 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.346 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:13.346 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847213+0000", 2024-05-08T18:31:13.346 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6659000000000002e-05 2024-05-08T18:31:13.346 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.346 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.346 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:13.347 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847315+0000", 2024-05-08T18:31:13.347 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000102336 2024-05-08T18:31:13.347 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.347 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.347 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:13.347 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847840+0000", 2024-05-08T18:31:13.347 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00052475000000000004 2024-05-08T18:31:13.347 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.347 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.347 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:13.347 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.849660+0000", 2024-05-08T18:31:13.347 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001819563 2024-05-08T18:31:13.347 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.347 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.348 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:13.348 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.849695+0000", 2024-05-08T18:31:13.348 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4761000000000001e-05 2024-05-08T18:31:13.348 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.348 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.348 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:13.348 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.849722+0000", 2024-05-08T18:31:13.348 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7455000000000001e-05 2024-05-08T18:31:13.348 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:13.348 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:13.348 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:13.348 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.348 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.348 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:532 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:13.348 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.908603+0000", 2024-05-08T18:31:13.349 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 81.343614909999999, 2024-05-08T18:31:13.349 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0038838950000000001, 2024-05-08T18:31:13.349 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:13.349 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:13.349 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:13.349 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:13.349 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:13.349 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:13.349 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 532 2024-05-08T18:31:13.349 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.349 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:13.349 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.349 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:13.349 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908603+0000", 2024-05-08T18:31:13.350 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:13.350 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.350 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.350 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:13.350 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908603+0000", 2024-05-08T18:31:13.350 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:13.350 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.350 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.350 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:13.350 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908605+0000", 2024-05-08T18:31:13.350 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1179999999999999e-06 2024-05-08T18:31:13.350 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.351 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.351 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:13.351 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908608+0000", 2024-05-08T18:31:13.351 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7419999999999999e-06 2024-05-08T18:31:13.351 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.351 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.351 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:13.351 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908618+0000", 2024-05-08T18:31:13.351 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.6889999999999999e-06 2024-05-08T18:31:13.351 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.351 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.351 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:13.351 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908625+0000", 2024-05-08T18:31:13.352 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1300000000000003e-06 2024-05-08T18:31:13.352 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.352 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.352 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:13.352 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908669+0000", 2024-05-08T18:31:13.352 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3832000000000003e-05 2024-05-08T18:31:13.352 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.352 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.352 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:13.352 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908724+0000", 2024-05-08T18:31:13.352 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5222000000000001e-05 2024-05-08T18:31:13.352 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.352 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.352 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:13.353 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908854+0000", 2024-05-08T18:31:13.353 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012953500000000001 2024-05-08T18:31:13.353 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.353 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.353 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:13.353 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.909511+0000", 2024-05-08T18:31:13.353 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00065768399999999996 2024-05-08T18:31:13.353 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.353 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.353 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:13.353 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912426+0000", 2024-05-08T18:31:13.353 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0029146599999999999 2024-05-08T18:31:13.353 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.353 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.354 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:13.354 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912461+0000", 2024-05-08T18:31:13.354 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4934999999999997e-05 2024-05-08T18:31:13.354 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.354 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.354 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:13.354 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912487+0000", 2024-05-08T18:31:13.354 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6347999999999999e-05 2024-05-08T18:31:13.354 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:13.354 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:13.354 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:13.354 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.354 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.355 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:534 6.9 6:9268b73e:::obj_delete_at_hint.0000000019:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:13.355 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.910153+0000", 2024-05-08T18:31:13.355 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 81.342065453000004, 2024-05-08T18:31:13.355 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0051089680000000002, 2024-05-08T18:31:13.355 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:13.355 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:13.355 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:13.355 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:13.355 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:13.355 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:13.355 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 534 2024-05-08T18:31:13.355 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.355 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:13.355 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.356 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:13.356 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910153+0000", 2024-05-08T18:31:13.356 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:13.356 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.356 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.356 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:13.356 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910153+0000", 2024-05-08T18:31:13.356 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:13.356 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.356 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.356 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:13.356 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910154+0000", 2024-05-08T18:31:13.356 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1039999999999999e-06 2024-05-08T18:31:13.356 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.357 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.357 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:13.357 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910158+0000", 2024-05-08T18:31:13.357 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7400000000000002e-06 2024-05-08T18:31:13.357 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.357 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.357 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:13.357 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910167+0000", 2024-05-08T18:31:13.357 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8880000000000003e-06 2024-05-08T18:31:13.357 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.357 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.357 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:13.357 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910173+0000", 2024-05-08T18:31:13.357 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.844e-06 2024-05-08T18:31:13.358 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.358 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.358 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:13.358 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910220+0000", 2024-05-08T18:31:13.358 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6582000000000002e-05 2024-05-08T18:31:13.358 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.358 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.358 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:13.358 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910287+0000", 2024-05-08T18:31:13.358 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7271e-05 2024-05-08T18:31:13.358 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.358 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.359 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:13.359 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910402+0000", 2024-05-08T18:31:13.359 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115127 2024-05-08T18:31:13.359 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.359 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.359 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:13.359 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910881+0000", 2024-05-08T18:31:13.359 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000479025 2024-05-08T18:31:13.359 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.359 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.359 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:13.359 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.915206+0000", 2024-05-08T18:31:13.359 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.004324357 2024-05-08T18:31:13.360 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.360 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.360 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:13.360 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.915237+0000", 2024-05-08T18:31:13.360 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1590000000000001e-05 2024-05-08T18:31:13.360 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.360 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.360 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:13.360 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.915262+0000", 2024-05-08T18:31:13.360 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.444e-05 2024-05-08T18:31:13.360 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:13.360 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:13.360 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:13.361 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.361 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.361 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:583 6.0 6:03bbb29a:::obj_delete_at_hint.0000000026:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:13.361 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.947199+0000", 2024-05-08T18:31:13.361 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 81.305019255999994, 2024-05-08T18:31:13.361 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0025081510000000001, 2024-05-08T18:31:13.361 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:13.361 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:13.361 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:13.361 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:13.361 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:13.362 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:13.362 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 583 2024-05-08T18:31:13.362 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.362 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:13.362 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.362 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:13.362 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947199+0000", 2024-05-08T18:31:13.362 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:13.362 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.363 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.363 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:13.363 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947199+0000", 2024-05-08T18:31:13.363 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:13.363 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.363 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.363 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:13.363 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947200+0000", 2024-05-08T18:31:13.363 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3799999999999997e-07 2024-05-08T18:31:13.363 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.363 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.363 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:13.364 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947207+0000", 2024-05-08T18:31:13.364 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2030000000000003e-06 2024-05-08T18:31:13.364 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.364 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.364 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:13.364 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947217+0000", 2024-05-08T18:31:13.364 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0138e-05 2024-05-08T18:31:13.364 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.364 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.364 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:13.364 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947224+0000", 2024-05-08T18:31:13.364 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5289999999999997e-06 2024-05-08T18:31:13.364 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.365 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.365 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:13.365 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.948039+0000", 2024-05-08T18:31:13.365 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00081500599999999996 2024-05-08T18:31:13.365 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.365 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.365 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:13.365 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.948230+0000", 2024-05-08T18:31:13.365 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000191838 2024-05-08T18:31:13.365 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.365 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.365 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:13.365 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.948606+0000", 2024-05-08T18:31:13.366 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00037547900000000001 2024-05-08T18:31:13.366 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.366 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.366 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:13.366 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.949406+0000", 2024-05-08T18:31:13.366 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000799674 2024-05-08T18:31:13.366 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.366 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.366 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:13.366 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.949630+0000", 2024-05-08T18:31:13.366 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00022474699999999999 2024-05-08T18:31:13.366 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.367 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.367 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:13.367 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.949664+0000", 2024-05-08T18:31:13.367 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3535999999999999e-05 2024-05-08T18:31:13.367 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.367 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.367 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:13.367 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.949707+0000", 2024-05-08T18:31:13.367 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3362999999999998e-05 2024-05-08T18:31:13.367 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:13.367 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:13.367 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:13.367 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.368 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.368 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:13.368 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.263796+0000", 2024-05-08T18:31:13.368 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 80.988421987999999, 2024-05-08T18:31:13.368 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0027788019999999999, 2024-05-08T18:31:13.368 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:13.368 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:13.368 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:13.368 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:13.368 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:13.368 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:13.368 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 811 2024-05-08T18:31:13.368 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.368 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:13.369 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.369 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:13.369 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263796+0000", 2024-05-08T18:31:13.369 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:13.369 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.369 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.369 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:13.369 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263796+0000", 2024-05-08T18:31:13.369 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:13.369 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.370 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.370 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:13.370 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263799+0000", 2024-05-08T18:31:13.370 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5569999999999998e-06 2024-05-08T18:31:13.370 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.370 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.370 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:13.370 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263812+0000", 2024-05-08T18:31:13.370 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3145999999999999e-05 2024-05-08T18:31:13.370 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.370 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.371 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:13.371 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263842+0000", 2024-05-08T18:31:13.371 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0193e-05 2024-05-08T18:31:13.371 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.371 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.371 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:13.371 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263860+0000", 2024-05-08T18:31:13.371 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7880000000000002e-05 2024-05-08T18:31:13.371 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.371 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.371 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:13.371 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263979+0000", 2024-05-08T18:31:13.371 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011919899999999999 2024-05-08T18:31:13.372 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.372 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.372 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:13.372 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.264222+0000", 2024-05-08T18:31:13.372 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024290800000000001 2024-05-08T18:31:13.372 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.372 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.373 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:13.373 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.264545+0000", 2024-05-08T18:31:13.373 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00032300200000000002 2024-05-08T18:31:13.373 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.373 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.373 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:13.373 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.265682+0000", 2024-05-08T18:31:13.373 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001136464 2024-05-08T18:31:13.373 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.373 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.373 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:13.373 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.266397+0000", 2024-05-08T18:31:13.374 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00071512799999999999 2024-05-08T18:31:13.374 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.374 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.374 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:13.374 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.266504+0000", 2024-05-08T18:31:13.374 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000107019 2024-05-08T18:31:13.375 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.375 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.375 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:13.375 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.266575+0000", 2024-05-08T18:31:13.375 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1305999999999998e-05 2024-05-08T18:31:13.375 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:13.375 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:13.375 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:13.375 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.375 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.375 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:13.375 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.445706+0000", 2024-05-08T18:31:13.375 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 80.806512272000006, 2024-05-08T18:31:13.375 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0026820630000000002, 2024-05-08T18:31:13.376 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:13.376 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:13.376 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:13.376 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:13.376 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:13.376 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:13.376 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 889 2024-05-08T18:31:13.376 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.376 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:13.376 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.376 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:13.376 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445706+0000", 2024-05-08T18:31:13.376 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:13.376 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.377 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.377 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:13.377 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445706+0000", 2024-05-08T18:31:13.377 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:13.377 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.377 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.377 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:13.377 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445709+0000", 2024-05-08T18:31:13.377 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0299999999999998e-06 2024-05-08T18:31:13.377 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.377 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.377 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:13.377 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445721+0000", 2024-05-08T18:31:13.377 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2366e-05 2024-05-08T18:31:13.378 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.378 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.378 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:13.378 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445752+0000", 2024-05-08T18:31:13.378 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0287e-05 2024-05-08T18:31:13.378 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.378 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.378 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:13.378 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445773+0000", 2024-05-08T18:31:13.378 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1367000000000001e-05 2024-05-08T18:31:13.378 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.378 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.378 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:13.379 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445892+0000", 2024-05-08T18:31:13.379 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000119311 2024-05-08T18:31:13.379 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.379 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.379 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:13.379 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.446158+0000", 2024-05-08T18:31:13.379 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000265441 2024-05-08T18:31:13.379 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.379 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.379 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:13.379 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.446465+0000", 2024-05-08T18:31:13.379 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00030754300000000002 2024-05-08T18:31:13.379 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.380 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.380 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:13.380 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.447511+0000", 2024-05-08T18:31:13.380 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001045975 2024-05-08T18:31:13.380 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.380 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.380 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:13.380 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.448171+0000", 2024-05-08T18:31:13.380 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00065971200000000002 2024-05-08T18:31:13.380 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.380 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.380 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:13.380 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.448273+0000", 2024-05-08T18:31:13.380 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000101592 2024-05-08T18:31:13.380 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.381 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.381 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:13.381 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.448388+0000", 2024-05-08T18:31:13.381 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115439 2024-05-08T18:31:13.381 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:13.381 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:13.381 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:13.381 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.381 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.381 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1020 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_add in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-05-08T18:31:13.381 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:30:21.842276+0000", 2024-05-08T18:31:13.381 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 51.409942731000001, 2024-05-08T18:31:13.382 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0025898760000000001, 2024-05-08T18:31:13.382 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:13.382 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:13.382 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:13.382 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:13.382 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:13.382 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:13.382 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1020 2024-05-08T18:31:13.382 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.382 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:13.382 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.382 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:13.383 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842276+0000", 2024-05-08T18:31:13.383 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:13.383 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.383 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.383 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:13.383 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842276+0000", 2024-05-08T18:31:13.383 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:13.383 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.383 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.383 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:13.384 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842278+0000", 2024-05-08T18:31:13.384 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6129999999999998e-06 2024-05-08T18:31:13.384 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.384 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.384 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:13.384 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842290+0000", 2024-05-08T18:31:13.384 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2187999999999999e-05 2024-05-08T18:31:13.384 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.384 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.384 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:13.384 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842319+0000", 2024-05-08T18:31:13.384 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8782e-05 2024-05-08T18:31:13.384 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.384 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.384 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:13.385 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842336+0000", 2024-05-08T18:31:13.385 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6826000000000001e-05 2024-05-08T18:31:13.385 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.385 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.385 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:13.385 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842450+0000", 2024-05-08T18:31:13.385 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000113829 2024-05-08T18:31:13.385 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.385 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.385 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:13.385 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842627+0000", 2024-05-08T18:31:13.385 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00017756599999999999 2024-05-08T18:31:13.385 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.385 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.386 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:13.386 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842794+0000", 2024-05-08T18:31:13.386 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000166866 2024-05-08T18:31:13.386 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.386 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.386 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:13.386 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.843540+0000", 2024-05-08T18:31:13.386 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00074611700000000003 2024-05-08T18:31:13.386 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.386 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.386 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:13.386 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.844762+0000", 2024-05-08T18:31:13.386 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012220309999999999 2024-05-08T18:31:13.387 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.387 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.387 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:13.387 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.844806+0000", 2024-05-08T18:31:13.387 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3414000000000001e-05 2024-05-08T18:31:13.387 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:13.387 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:13.387 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:13.387 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.844865+0000", 2024-05-08T18:31:13.387 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9644e-05 2024-05-08T18:31:13.387 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:13.387 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:13.387 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:13.387 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:13.387 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:13.388 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:13.389 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-08T18:31:13.389 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:31:13.387+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:31:13.490 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:31:13.487+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:31:13.591 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:31:13.587+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:31:13.598 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:13.598 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:31:13.599 INFO:teuthology.orchestra.run.smithi097.stdout: "num_ops": 0 2024-05-08T18:31:13.599 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:13.615 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-08T18:31:13.703 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:31:13.703+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:31:13.727 INFO:teuthology.orchestra.run.smithi097.stderr:reweighted osd.3 to 1 (10000) 2024-05-08T18:31:13.755 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-05-08T18:31:13.803 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:31:13.803+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:31:13.830 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:13.830 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:31:13.830 INFO:teuthology.orchestra.run.smithi097.stdout: "complaint_time": 30, 2024-05-08T18:31:13.830 INFO:teuthology.orchestra.run.smithi097.stdout: "num_blocked_ops": 0 2024-05-08T18:31:13.830 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:13.850 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-08T18:31:13.893 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:31:13.891+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:31:13.994 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:31:13.990+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:31:14.064 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:14.064 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2024-05-08T18:31:14.064 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2024-05-08T18:31:14.064 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-05-08T18:31:14.064 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.064 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4479.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-05-08T18:31:14.064 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:44.576320+0000", 2024-05-08T18:31:14.064 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 89.486638494999994, 2024-05-08T18:31:14.064 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019751892, 2024-05-08T18:31:14.064 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:14.065 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:14.065 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "reached pg", 2024-05-08T18:31:14.065 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:14.065 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4479", 2024-05-08T18:31:14.065 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3577501689", 2024-05-08T18:31:14.065 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 2 2024-05-08T18:31:14.065 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.065 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:14.065 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.065 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:14.065 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576320+0000", 2024-05-08T18:31:14.065 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:14.065 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.065 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.066 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:14.066 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576320+0000", 2024-05-08T18:31:14.066 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:14.066 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.066 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.066 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:14.066 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576323+0000", 2024-05-08T18:31:14.066 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.813e-06 2024-05-08T18:31:14.066 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.066 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.066 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:14.066 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576335+0000", 2024-05-08T18:31:14.066 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2330000000000001e-05 2024-05-08T18:31:14.066 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.067 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.067 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:14.067 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576367+0000", 2024-05-08T18:31:14.067 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2036999999999998e-05 2024-05-08T18:31:14.067 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.067 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.067 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:14.067 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576394+0000", 2024-05-08T18:31:14.067 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6529e-05 2024-05-08T18:31:14.067 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.067 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.067 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:14.067 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576550+0000", 2024-05-08T18:31:14.068 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000156718 2024-05-08T18:31:14.068 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.068 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.068 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-05-08T18:31:14.068 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576560+0000", 2024-05-08T18:31:14.068 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0040999999999999e-05 2024-05-08T18:31:14.068 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.068 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.068 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:14.068 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.587240+0000", 2024-05-08T18:31:14.068 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010679266999999999 2024-05-08T18:31:14.068 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.068 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.069 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2024-05-08T18:31:14.069 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.587266+0000", 2024-05-08T18:31:14.069 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6642e-05 2024-05-08T18:31:14.069 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.069 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.069 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:14.069 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.595882+0000", 2024-05-08T18:31:14.069 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0086159600000000006 2024-05-08T18:31:14.069 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.069 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.069 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:14.069 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.596072+0000", 2024-05-08T18:31:14.069 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000189555 2024-05-08T18:31:14.070 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:14.070 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:14.070 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:14.070 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.070 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.070 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:31:14.070 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:48.766182+0000", 2024-05-08T18:31:14.070 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 85.296776468000004, 2024-05-08T18:31:14.070 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031881209999999999, 2024-05-08T18:31:14.070 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:14.070 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:14.070 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:14.070 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:14.071 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:14.071 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:14.071 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 193 2024-05-08T18:31:14.071 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.071 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:14.071 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.071 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:14.071 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766182+0000", 2024-05-08T18:31:14.071 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:14.071 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.071 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.071 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:14.071 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766182+0000", 2024-05-08T18:31:14.072 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:14.072 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.072 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.072 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:14.072 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766184+0000", 2024-05-08T18:31:14.072 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4159999999999998e-06 2024-05-08T18:31:14.072 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.072 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.072 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:14.072 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766196+0000", 2024-05-08T18:31:14.072 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1814000000000001e-05 2024-05-08T18:31:14.072 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.072 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.072 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:14.072 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766227+0000", 2024-05-08T18:31:14.073 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0676000000000002e-05 2024-05-08T18:31:14.073 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.073 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.073 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:14.073 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766242+0000", 2024-05-08T18:31:14.073 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5497000000000001e-05 2024-05-08T18:31:14.073 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.073 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.073 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:14.073 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766354+0000", 2024-05-08T18:31:14.074 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000111579 2024-05-08T18:31:14.074 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.074 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.074 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:14.074 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766569+0000", 2024-05-08T18:31:14.074 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000214978 2024-05-08T18:31:14.074 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.074 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.074 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:14.075 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766834+0000", 2024-05-08T18:31:14.075 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00026551500000000002 2024-05-08T18:31:14.075 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.075 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.075 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:14.075 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.768577+0000", 2024-05-08T18:31:14.075 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001742513 2024-05-08T18:31:14.075 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.075 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.075 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:14.075 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.769150+0000", 2024-05-08T18:31:14.075 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00057320500000000003 2024-05-08T18:31:14.075 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.075 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.076 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:14.076 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.769250+0000", 2024-05-08T18:31:14.076 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.9846000000000006e-05 2024-05-08T18:31:14.076 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.076 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.076 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:14.076 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.769370+0000", 2024-05-08T18:31:14.076 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012008200000000001 2024-05-08T18:31:14.076 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:14.076 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:14.076 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:14.076 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.076 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.076 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:14.076 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.679562+0000", 2024-05-08T18:31:14.077 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 82.383396763999997, 2024-05-08T18:31:14.077 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0086320800000000003, 2024-05-08T18:31:14.077 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:14.077 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:14.077 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:14.077 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:14.077 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:14.077 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:14.077 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 208 2024-05-08T18:31:14.077 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.077 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:14.077 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.077 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:14.078 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679562+0000", 2024-05-08T18:31:14.078 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:14.078 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.078 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.078 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:14.078 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679562+0000", 2024-05-08T18:31:14.078 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:14.078 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.078 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.078 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:14.078 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679565+0000", 2024-05-08T18:31:14.078 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0800000000000002e-06 2024-05-08T18:31:14.078 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.078 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.079 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:14.079 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679578+0000", 2024-05-08T18:31:14.079 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3217000000000001e-05 2024-05-08T18:31:14.079 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.079 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.079 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:14.079 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679610+0000", 2024-05-08T18:31:14.079 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1696000000000003e-05 2024-05-08T18:31:14.079 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.079 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.079 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:14.079 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679625+0000", 2024-05-08T18:31:14.079 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5824e-05 2024-05-08T18:31:14.080 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.080 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.080 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:14.080 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679758+0000", 2024-05-08T18:31:14.080 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013231199999999999 2024-05-08T18:31:14.080 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.080 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.080 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-05-08T18:31:14.080 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679770+0000", 2024-05-08T18:31:14.080 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1800000000000001e-05 2024-05-08T18:31:14.080 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.080 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.080 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:14.081 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.685241+0000", 2024-05-08T18:31:14.081 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0054710169999999999 2024-05-08T18:31:14.081 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.081 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.081 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:14.081 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.685444+0000", 2024-05-08T18:31:14.081 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000203835 2024-05-08T18:31:14.081 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.081 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.081 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:14.081 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.685842+0000", 2024-05-08T18:31:14.081 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00039773 2024-05-08T18:31:14.081 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.082 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.082 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:14.082 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.687232+0000", 2024-05-08T18:31:14.082 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00139011 2024-05-08T18:31:14.082 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.082 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.082 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:14.082 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.688049+0000", 2024-05-08T18:31:14.082 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00081667000000000003 2024-05-08T18:31:14.082 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.082 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.082 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:14.082 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.688135+0000", 2024-05-08T18:31:14.083 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6299999999999997e-05 2024-05-08T18:31:14.083 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.083 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.083 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:14.083 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.688194+0000", 2024-05-08T18:31:14.083 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8489000000000002e-05 2024-05-08T18:31:14.083 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:14.083 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:14.083 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:14.083 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.083 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.083 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:14.083 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.707114+0000", 2024-05-08T18:31:14.084 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 82.355844750000003, 2024-05-08T18:31:14.084 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031802990000000001, 2024-05-08T18:31:14.084 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:14.084 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:14.084 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:14.084 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:14.084 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:14.084 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:14.084 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 212 2024-05-08T18:31:14.085 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.085 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:14.085 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.085 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:14.085 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707114+0000", 2024-05-08T18:31:14.085 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:14.085 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.085 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.085 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:14.085 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707114+0000", 2024-05-08T18:31:14.085 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:14.085 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.085 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.086 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:14.086 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707117+0000", 2024-05-08T18:31:14.086 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8629999999999999e-06 2024-05-08T18:31:14.086 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.086 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.086 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:14.086 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707129+0000", 2024-05-08T18:31:14.086 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2150000000000001e-05 2024-05-08T18:31:14.086 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.086 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.086 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:14.086 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707158+0000", 2024-05-08T18:31:14.086 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9513999999999999e-05 2024-05-08T18:31:14.087 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.087 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.087 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:14.087 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707173+0000", 2024-05-08T18:31:14.087 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5136e-05 2024-05-08T18:31:14.087 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.087 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.087 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:14.087 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707309+0000", 2024-05-08T18:31:14.087 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000135609 2024-05-08T18:31:14.087 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.087 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.087 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:14.087 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707523+0000", 2024-05-08T18:31:14.087 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021362200000000001 2024-05-08T18:31:14.088 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.088 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.088 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:14.088 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707918+0000", 2024-05-08T18:31:14.088 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00039556299999999998 2024-05-08T18:31:14.088 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.088 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.088 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:14.088 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.709166+0000", 2024-05-08T18:31:14.088 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012476410000000001 2024-05-08T18:31:14.088 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.088 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.088 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:14.089 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.710145+0000", 2024-05-08T18:31:14.089 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00097909899999999998 2024-05-08T18:31:14.089 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.089 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.089 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:14.089 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.710231+0000", 2024-05-08T18:31:14.089 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5625999999999996e-05 2024-05-08T18:31:14.089 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.089 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.089 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:14.089 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.710294+0000", 2024-05-08T18:31:14.089 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3476e-05 2024-05-08T18:31:14.089 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:14.089 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:14.090 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:14.090 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.090 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.090 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:14.090 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.731985+0000", 2024-05-08T18:31:14.090 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 82.330973525000005, 2024-05-08T18:31:14.090 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0039250600000000002, 2024-05-08T18:31:14.090 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:14.090 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:14.090 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:14.090 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:14.090 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:14.090 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:14.090 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 219 2024-05-08T18:31:14.091 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.091 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:14.091 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.091 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:14.091 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731985+0000", 2024-05-08T18:31:14.091 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:14.091 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.091 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.091 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:14.091 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731985+0000", 2024-05-08T18:31:14.091 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:14.091 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.091 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.091 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:14.091 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731988+0000", 2024-05-08T18:31:14.092 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6599999999999999e-06 2024-05-08T18:31:14.092 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.092 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.092 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:14.092 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.732017+0000", 2024-05-08T18:31:14.092 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9692999999999998e-05 2024-05-08T18:31:14.092 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.092 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.092 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:14.092 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.732048+0000", 2024-05-08T18:31:14.092 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1066999999999999e-05 2024-05-08T18:31:14.092 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.092 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.092 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:14.092 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.732064+0000", 2024-05-08T18:31:14.093 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5786000000000001e-05 2024-05-08T18:31:14.093 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.093 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.093 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:14.093 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.732213+0000", 2024-05-08T18:31:14.093 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014895899999999999 2024-05-08T18:31:14.093 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.093 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.093 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:14.093 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.732572+0000", 2024-05-08T18:31:14.093 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000358904 2024-05-08T18:31:14.093 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.093 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.093 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:14.094 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.733349+0000", 2024-05-08T18:31:14.094 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00077657699999999997 2024-05-08T18:31:14.094 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.094 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.094 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:14.094 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.734899+0000", 2024-05-08T18:31:14.094 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001550652 2024-05-08T18:31:14.094 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.094 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.094 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:14.094 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.735641+0000", 2024-05-08T18:31:14.095 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00074222000000000003 2024-05-08T18:31:14.095 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.095 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.095 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:14.095 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.735801+0000", 2024-05-08T18:31:14.096 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015913599999999999 2024-05-08T18:31:14.096 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.096 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.096 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:14.096 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.735910+0000", 2024-05-08T18:31:14.096 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000109406 2024-05-08T18:31:14.097 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:14.097 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:14.097 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:14.097 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.097 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.098 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:14.098 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.750251+0000", 2024-05-08T18:31:14.098 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 82.312707592999999, 2024-05-08T18:31:14.098 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0038408600000000002, 2024-05-08T18:31:14.098 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:14.099 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:14.099 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:14.099 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:14.099 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:14.099 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:14.099 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 224 2024-05-08T18:31:14.100 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.100 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:14.100 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.100 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:14.100 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750251+0000", 2024-05-08T18:31:14.100 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:14.101 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.101 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.101 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:14.101 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750251+0000", 2024-05-08T18:31:14.101 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:14.101 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.101 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.101 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:14.101 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750253+0000", 2024-05-08T18:31:14.101 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2129999999999998e-06 2024-05-08T18:31:14.101 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.101 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.101 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:14.102 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750265+0000", 2024-05-08T18:31:14.102 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1484000000000001e-05 2024-05-08T18:31:14.102 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.102 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.102 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:14.102 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750293+0000", 2024-05-08T18:31:14.102 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8673000000000001e-05 2024-05-08T18:31:14.103 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.103 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.103 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:14.103 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750308+0000", 2024-05-08T18:31:14.103 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4620000000000001e-05 2024-05-08T18:31:14.103 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.103 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.103 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:14.103 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750459+0000", 2024-05-08T18:31:14.103 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000151619 2024-05-08T18:31:14.103 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.104 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.104 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:14.104 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750822+0000", 2024-05-08T18:31:14.104 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000362467 2024-05-08T18:31:14.104 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.104 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.105 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:14.105 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.751591+0000", 2024-05-08T18:31:14.105 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00076934699999999998 2024-05-08T18:31:14.105 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.105 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.105 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:14.105 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.753042+0000", 2024-05-08T18:31:14.105 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001450652 2024-05-08T18:31:14.106 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.106 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.106 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:14.106 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.753792+0000", 2024-05-08T18:31:14.106 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00075045500000000002 2024-05-08T18:31:14.106 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.106 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.106 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:14.106 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.753977+0000", 2024-05-08T18:31:14.107 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000184511 2024-05-08T18:31:14.107 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.107 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.107 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:14.107 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.754092+0000", 2024-05-08T18:31:14.107 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000114819 2024-05-08T18:31:14.107 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:14.107 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:14.107 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:14.107 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.107 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.107 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:14.107 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.783902+0000", 2024-05-08T18:31:14.107 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 82.279056862000004, 2024-05-08T18:31:14.108 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003120046, 2024-05-08T18:31:14.108 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:14.108 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:14.108 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:14.108 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:14.108 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:14.108 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:14.108 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 233 2024-05-08T18:31:14.108 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.108 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:14.108 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.108 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:14.108 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.783902+0000", 2024-05-08T18:31:14.108 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:14.108 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.109 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.109 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:14.109 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.783902+0000", 2024-05-08T18:31:14.109 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:14.109 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.109 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.109 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:14.109 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.783904+0000", 2024-05-08T18:31:14.109 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5229999999999998e-06 2024-05-08T18:31:14.109 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.109 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.109 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:14.110 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.783916+0000", 2024-05-08T18:31:14.110 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1513e-05 2024-05-08T18:31:14.110 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.110 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.110 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:14.110 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.783947+0000", 2024-05-08T18:31:14.110 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1353000000000003e-05 2024-05-08T18:31:14.110 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.110 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.110 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:14.110 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.783964+0000", 2024-05-08T18:31:14.110 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6643e-05 2024-05-08T18:31:14.110 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.111 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.111 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:14.111 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.784110+0000", 2024-05-08T18:31:14.111 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014627299999999999 2024-05-08T18:31:14.111 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.111 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.111 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:14.111 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.784329+0000", 2024-05-08T18:31:14.111 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021892099999999999 2024-05-08T18:31:14.111 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.111 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.111 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:14.111 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.784752+0000", 2024-05-08T18:31:14.111 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00042336700000000001 2024-05-08T18:31:14.111 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.112 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.112 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:14.112 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.786093+0000", 2024-05-08T18:31:14.112 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00134107 2024-05-08T18:31:14.112 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.112 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.112 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:14.112 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.786863+0000", 2024-05-08T18:31:14.112 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00076949099999999997 2024-05-08T18:31:14.112 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.112 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.112 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:14.112 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.786955+0000", 2024-05-08T18:31:14.113 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.2478999999999993e-05 2024-05-08T18:31:14.113 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.113 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.113 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:14.113 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.787022+0000", 2024-05-08T18:31:14.113 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6413000000000003e-05 2024-05-08T18:31:14.113 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:14.113 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:14.113 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:14.113 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.113 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.113 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:341 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:14.113 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.816045+0000", 2024-05-08T18:31:14.113 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 82.246913524999997, 2024-05-08T18:31:14.114 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002875154, 2024-05-08T18:31:14.114 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:14.114 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:14.114 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:14.114 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:14.114 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:14.114 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:14.114 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 341 2024-05-08T18:31:14.114 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.114 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:14.114 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.114 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:14.114 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816045+0000", 2024-05-08T18:31:14.115 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:14.115 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.115 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.115 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:14.115 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816045+0000", 2024-05-08T18:31:14.115 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:14.115 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.115 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.115 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:14.115 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816046+0000", 2024-05-08T18:31:14.115 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9199999999999999e-07 2024-05-08T18:31:14.115 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.115 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.116 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:14.116 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816050+0000", 2024-05-08T18:31:14.116 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0260000000000001e-06 2024-05-08T18:31:14.116 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.116 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.116 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:14.116 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816060+0000", 2024-05-08T18:31:14.116 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0297e-05 2024-05-08T18:31:14.116 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.116 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.116 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:14.116 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816065+0000", 2024-05-08T18:31:14.116 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.237e-06 2024-05-08T18:31:14.116 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.117 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.117 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:14.117 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816122+0000", 2024-05-08T18:31:14.117 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6168000000000002e-05 2024-05-08T18:31:14.117 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.117 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.117 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:14.117 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816198+0000", 2024-05-08T18:31:14.117 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6511e-05 2024-05-08T18:31:14.117 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.117 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.117 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:31:14.117 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816305+0000", 2024-05-08T18:31:14.118 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000106487 2024-05-08T18:31:14.118 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.118 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.118 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:14.118 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816886+0000", 2024-05-08T18:31:14.118 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00058187199999999999 2024-05-08T18:31:14.118 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.118 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.118 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:14.118 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.818821+0000", 2024-05-08T18:31:14.118 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001934362 2024-05-08T18:31:14.118 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.118 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.118 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:14.119 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.818880+0000", 2024-05-08T18:31:14.119 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9210999999999999e-05 2024-05-08T18:31:14.119 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.119 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.119 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:14.119 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.818920+0000", 2024-05-08T18:31:14.119 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0091e-05 2024-05-08T18:31:14.119 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:14.119 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:14.119 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:14.119 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.119 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.119 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:14.120 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.086431+0000", 2024-05-08T18:31:14.120 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 81.976527704999995, 2024-05-08T18:31:14.120 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028335959999999999, 2024-05-08T18:31:14.120 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:14.120 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:14.120 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:14.120 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:14.120 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:14.120 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:14.120 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 733 2024-05-08T18:31:14.120 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.120 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:14.120 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.121 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:14.121 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086431+0000", 2024-05-08T18:31:14.121 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:14.121 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.121 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.121 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:14.121 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086431+0000", 2024-05-08T18:31:14.121 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:14.121 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.121 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.121 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:14.121 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086433+0000", 2024-05-08T18:31:14.121 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8899999999999999e-06 2024-05-08T18:31:14.121 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.122 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.122 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:14.122 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086441+0000", 2024-05-08T18:31:14.122 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.3100000000000001e-06 2024-05-08T18:31:14.122 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.122 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.122 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:14.122 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086460+0000", 2024-05-08T18:31:14.122 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8703999999999999e-05 2024-05-08T18:31:14.122 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.122 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.122 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:14.122 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086471+0000", 2024-05-08T18:31:14.122 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1324e-05 2024-05-08T18:31:14.123 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.123 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.123 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:14.123 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086590+0000", 2024-05-08T18:31:14.123 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000118625 2024-05-08T18:31:14.123 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.123 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.123 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:14.123 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086817+0000", 2024-05-08T18:31:14.123 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000226958 2024-05-08T18:31:14.123 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.123 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.123 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:14.123 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.087131+0000", 2024-05-08T18:31:14.124 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00031478799999999998 2024-05-08T18:31:14.124 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.124 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.124 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:14.124 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.088025+0000", 2024-05-08T18:31:14.124 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00089402999999999998 2024-05-08T18:31:14.124 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.124 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.124 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:14.124 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.089123+0000", 2024-05-08T18:31:14.124 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001097598 2024-05-08T18:31:14.125 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.125 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.125 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:14.125 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.089200+0000", 2024-05-08T18:31:14.125 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7333e-05 2024-05-08T18:31:14.125 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.125 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.125 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:14.125 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.089264+0000", 2024-05-08T18:31:14.125 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.4035999999999995e-05 2024-05-08T18:31:14.125 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:14.125 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:14.125 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:14.125 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.126 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.126 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:751 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:14.126 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.125611+0000", 2024-05-08T18:31:14.126 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 81.937347012999993, 2024-05-08T18:31:14.126 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032716749999999999, 2024-05-08T18:31:14.126 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:14.126 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:14.126 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:14.126 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:14.126 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:14.126 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:14.126 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 751 2024-05-08T18:31:14.126 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.127 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:14.127 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.127 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:14.127 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125611+0000", 2024-05-08T18:31:14.127 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:14.127 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.127 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.127 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:14.127 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125611+0000", 2024-05-08T18:31:14.127 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:14.127 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.127 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.127 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:14.127 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125614+0000", 2024-05-08T18:31:14.128 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.12e-06 2024-05-08T18:31:14.128 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.128 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.128 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:14.128 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125624+0000", 2024-05-08T18:31:14.128 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0492999999999999e-05 2024-05-08T18:31:14.128 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.128 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.128 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:14.128 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125650+0000", 2024-05-08T18:31:14.128 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5907000000000001e-05 2024-05-08T18:31:14.128 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.128 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.128 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:14.129 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125667+0000", 2024-05-08T18:31:14.129 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.694e-05 2024-05-08T18:31:14.129 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.129 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.129 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:14.129 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125801+0000", 2024-05-08T18:31:14.129 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000134482 2024-05-08T18:31:14.129 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.129 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.129 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:14.129 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.126174+0000", 2024-05-08T18:31:14.129 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00037294999999999999 2024-05-08T18:31:14.129 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.129 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.130 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:14.130 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.126750+0000", 2024-05-08T18:31:14.130 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00057538900000000004 2024-05-08T18:31:14.130 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.130 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.130 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:14.130 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.127997+0000", 2024-05-08T18:31:14.130 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001247761 2024-05-08T18:31:14.130 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.130 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.130 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:14.130 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.128731+0000", 2024-05-08T18:31:14.130 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00073338099999999996 2024-05-08T18:31:14.131 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.131 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.131 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:14.131 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.128817+0000", 2024-05-08T18:31:14.131 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5993000000000002e-05 2024-05-08T18:31:14.131 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.131 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.131 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:14.131 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.128883+0000", 2024-05-08T18:31:14.131 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6259000000000004e-05 2024-05-08T18:31:14.131 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:14.131 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:14.131 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:14.131 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.132 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.132 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:753 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:14.132 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.129809+0000", 2024-05-08T18:31:14.132 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 81.933149474999993, 2024-05-08T18:31:14.132 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0033775440000000001, 2024-05-08T18:31:14.132 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:14.132 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:14.132 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:14.132 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:14.132 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:14.132 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:14.132 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 753 2024-05-08T18:31:14.132 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.133 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:14.133 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.133 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:14.133 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129809+0000", 2024-05-08T18:31:14.133 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:14.133 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.133 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.133 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:14.133 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129809+0000", 2024-05-08T18:31:14.133 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:14.133 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.133 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.133 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:14.133 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129811+0000", 2024-05-08T18:31:14.134 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1730000000000002e-06 2024-05-08T18:31:14.134 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.134 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.134 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:14.134 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129822+0000", 2024-05-08T18:31:14.134 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0583e-05 2024-05-08T18:31:14.134 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.134 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.134 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:14.134 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129852+0000", 2024-05-08T18:31:14.134 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0744000000000002e-05 2024-05-08T18:31:14.134 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.134 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.134 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:14.135 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129870+0000", 2024-05-08T18:31:14.135 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7955999999999999e-05 2024-05-08T18:31:14.135 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.135 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.135 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:14.135 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.130018+0000", 2024-05-08T18:31:14.135 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014747600000000001 2024-05-08T18:31:14.135 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.135 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.135 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:14.135 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.130259+0000", 2024-05-08T18:31:14.135 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024079099999999999 2024-05-08T18:31:14.135 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.135 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.136 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:14.136 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.130734+0000", 2024-05-08T18:31:14.136 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00047562 2024-05-08T18:31:14.136 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.136 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.136 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:14.136 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.131997+0000", 2024-05-08T18:31:14.136 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012626429999999999 2024-05-08T18:31:14.136 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.136 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.136 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:14.136 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.132923+0000", 2024-05-08T18:31:14.137 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00092627599999999997 2024-05-08T18:31:14.137 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.137 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.137 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:14.137 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.133076+0000", 2024-05-08T18:31:14.137 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000152989 2024-05-08T18:31:14.137 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.137 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.137 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:14.137 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.133187+0000", 2024-05-08T18:31:14.137 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000110293 2024-05-08T18:31:14.137 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:14.137 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:14.137 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:14.137 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.138 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.138 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:14.138 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.228247+0000", 2024-05-08T18:31:14.138 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 81.834711865000003, 2024-05-08T18:31:14.138 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032753449999999998, 2024-05-08T18:31:14.138 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:14.138 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:14.138 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:14.138 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:14.138 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:14.138 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:14.138 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 796 2024-05-08T18:31:14.138 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.139 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:14.139 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.139 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:14.139 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228247+0000", 2024-05-08T18:31:14.139 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:14.139 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.139 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.139 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:14.139 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228247+0000", 2024-05-08T18:31:14.139 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:14.139 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.139 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.139 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:14.139 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228249+0000", 2024-05-08T18:31:14.140 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3800000000000001e-06 2024-05-08T18:31:14.140 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.140 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.140 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:14.140 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228260+0000", 2024-05-08T18:31:14.140 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1496e-05 2024-05-08T18:31:14.140 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.140 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.140 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:14.140 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228292+0000", 2024-05-08T18:31:14.140 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1294000000000002e-05 2024-05-08T18:31:14.140 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.140 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.140 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:14.141 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228306+0000", 2024-05-08T18:31:14.141 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4606e-05 2024-05-08T18:31:14.141 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.141 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.141 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:14.141 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228443+0000", 2024-05-08T18:31:14.141 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013672599999999999 2024-05-08T18:31:14.141 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.141 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.141 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:14.141 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228813+0000", 2024-05-08T18:31:14.141 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00036987000000000001 2024-05-08T18:31:14.142 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.142 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.142 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:31:14.142 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.229365+0000", 2024-05-08T18:31:14.142 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00055210600000000002 2024-05-08T18:31:14.142 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.142 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.142 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:14.142 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.230800+0000", 2024-05-08T18:31:14.142 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001435006 2024-05-08T18:31:14.142 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.142 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.142 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:14.143 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.231369+0000", 2024-05-08T18:31:14.143 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00056848499999999998 2024-05-08T18:31:14.143 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.143 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.143 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:14.143 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.231455+0000", 2024-05-08T18:31:14.143 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6905999999999998e-05 2024-05-08T18:31:14.143 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.143 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.143 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:14.143 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.231522+0000", 2024-05-08T18:31:14.143 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6470000000000006e-05 2024-05-08T18:31:14.143 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:14.144 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:14.144 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:14.144 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.144 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.144 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:798 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:14.144 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.232573+0000", 2024-05-08T18:31:14.144 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 81.830385758000006, 2024-05-08T18:31:14.144 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0030406690000000002, 2024-05-08T18:31:14.144 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:14.144 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:14.144 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:14.144 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:14.144 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:14.144 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:14.145 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 798 2024-05-08T18:31:14.145 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.145 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:14.145 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.145 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:14.145 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232573+0000", 2024-05-08T18:31:14.145 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:14.145 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.145 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.145 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:14.145 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232573+0000", 2024-05-08T18:31:14.145 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:14.145 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.145 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.146 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:14.146 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232574+0000", 2024-05-08T18:31:14.146 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.446e-06 2024-05-08T18:31:14.146 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.146 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.146 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:14.146 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232581+0000", 2024-05-08T18:31:14.146 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.0670000000000003e-06 2024-05-08T18:31:14.146 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.146 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.146 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:14.146 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232600+0000", 2024-05-08T18:31:14.146 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8822999999999999e-05 2024-05-08T18:31:14.147 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.147 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.147 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:14.147 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232611+0000", 2024-05-08T18:31:14.147 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1233000000000001e-05 2024-05-08T18:31:14.147 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.147 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.147 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:14.147 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232731+0000", 2024-05-08T18:31:14.147 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000120189 2024-05-08T18:31:14.147 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.147 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.147 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:14.147 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232963+0000", 2024-05-08T18:31:14.148 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023111900000000001 2024-05-08T18:31:14.148 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.148 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.148 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:31:14.148 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.233441+0000", 2024-05-08T18:31:14.148 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00047866899999999998 2024-05-08T18:31:14.148 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.148 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.148 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:14.148 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.234542+0000", 2024-05-08T18:31:14.148 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001101245 2024-05-08T18:31:14.148 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.148 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.148 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:14.148 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.235349+0000", 2024-05-08T18:31:14.149 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000806567 2024-05-08T18:31:14.149 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.149 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.149 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:14.149 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.235498+0000", 2024-05-08T18:31:14.149 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014907200000000001 2024-05-08T18:31:14.149 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.149 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.149 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:14.149 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.235613+0000", 2024-05-08T18:31:14.149 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115239 2024-05-08T18:31:14.149 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:14.149 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:14.149 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:14.150 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.150 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.150 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:14.150 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.248596+0000", 2024-05-08T18:31:14.150 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 81.814361951999999, 2024-05-08T18:31:14.150 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002919984, 2024-05-08T18:31:14.150 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:14.150 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:14.150 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:14.150 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:14.150 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:14.150 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:14.150 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 805 2024-05-08T18:31:14.150 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.151 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:14.151 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.151 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:14.151 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248596+0000", 2024-05-08T18:31:14.151 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:14.151 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.151 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.151 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:14.151 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248596+0000", 2024-05-08T18:31:14.151 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:14.151 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.151 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.151 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:14.151 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248599+0000", 2024-05-08T18:31:14.151 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3630000000000001e-06 2024-05-08T18:31:14.152 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.152 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.152 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:14.152 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248610+0000", 2024-05-08T18:31:14.152 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1267000000000001e-05 2024-05-08T18:31:14.152 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.152 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.152 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:14.152 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248641+0000", 2024-05-08T18:31:14.152 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1309999999999997e-05 2024-05-08T18:31:14.152 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.152 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.152 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:14.152 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248656+0000", 2024-05-08T18:31:14.153 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4449e-05 2024-05-08T18:31:14.153 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.153 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.153 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:14.153 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248781+0000", 2024-05-08T18:31:14.153 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012500900000000001 2024-05-08T18:31:14.153 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.153 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.153 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:14.153 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.249001+0000", 2024-05-08T18:31:14.153 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021963500000000001 2024-05-08T18:31:14.153 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.153 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.153 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:14.154 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.249341+0000", 2024-05-08T18:31:14.154 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00034004100000000002 2024-05-08T18:31:14.154 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.154 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.154 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:14.154 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.250473+0000", 2024-05-08T18:31:14.154 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0011324180000000001 2024-05-08T18:31:14.154 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.154 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.154 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:14.154 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.251230+0000", 2024-05-08T18:31:14.154 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00075751400000000004 2024-05-08T18:31:14.154 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.154 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.154 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:14.155 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.251394+0000", 2024-05-08T18:31:14.155 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016379200000000001 2024-05-08T18:31:14.155 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.155 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.155 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:14.155 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.251516+0000", 2024-05-08T18:31:14.155 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012218600000000001 2024-05-08T18:31:14.155 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:14.155 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:14.155 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:14.155 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.155 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.155 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:14.156 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.313184+0000", 2024-05-08T18:31:14.156 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 81.749774277, 2024-05-08T18:31:14.156 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003040016, 2024-05-08T18:31:14.156 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:14.156 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:14.156 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:14.156 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:14.156 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:14.156 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:14.156 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 832 2024-05-08T18:31:14.156 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.156 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:14.156 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.156 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:14.157 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313184+0000", 2024-05-08T18:31:14.157 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:14.157 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.157 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.157 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:14.157 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313184+0000", 2024-05-08T18:31:14.157 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:14.157 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.157 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.157 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:14.157 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313187+0000", 2024-05-08T18:31:14.157 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5100000000000001e-06 2024-05-08T18:31:14.157 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.158 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.158 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:14.158 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313199+0000", 2024-05-08T18:31:14.158 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.201e-05 2024-05-08T18:31:14.158 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.158 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.158 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:14.158 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313229+0000", 2024-05-08T18:31:14.158 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9839e-05 2024-05-08T18:31:14.158 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.158 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.158 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:14.158 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313243+0000", 2024-05-08T18:31:14.158 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4727e-05 2024-05-08T18:31:14.159 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.159 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.159 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:14.159 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313358+0000", 2024-05-08T18:31:14.159 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115016 2024-05-08T18:31:14.159 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.159 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.159 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:14.159 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313577+0000", 2024-05-08T18:31:14.159 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021897799999999999 2024-05-08T18:31:14.159 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.159 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.159 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:31:14.159 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313889+0000", 2024-05-08T18:31:14.160 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00031210400000000001 2024-05-08T18:31:14.160 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.160 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.160 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:14.160 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.315229+0000", 2024-05-08T18:31:14.160 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001339963 2024-05-08T18:31:14.160 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.160 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.160 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:14.160 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.315938+0000", 2024-05-08T18:31:14.160 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00070853400000000003 2024-05-08T18:31:14.160 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.160 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.160 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:14.161 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.316111+0000", 2024-05-08T18:31:14.161 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000173396 2024-05-08T18:31:14.161 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.161 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.161 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:14.161 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.316224+0000", 2024-05-08T18:31:14.161 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000112939 2024-05-08T18:31:14.161 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:14.161 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:14.161 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:14.161 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.161 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.161 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:834 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:14.161 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.317499+0000", 2024-05-08T18:31:14.162 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 81.745459478000001, 2024-05-08T18:31:14.162 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0033281109999999999, 2024-05-08T18:31:14.162 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:14.162 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:14.162 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:14.162 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:14.162 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:14.162 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:14.162 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 834 2024-05-08T18:31:14.162 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.162 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:14.162 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.162 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:14.162 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317499+0000", 2024-05-08T18:31:14.163 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:14.163 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.163 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.163 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:14.163 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317499+0000", 2024-05-08T18:31:14.163 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:14.163 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.163 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.163 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:14.163 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317501+0000", 2024-05-08T18:31:14.163 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9400000000000001e-06 2024-05-08T18:31:14.164 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.164 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.164 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:14.164 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317511+0000", 2024-05-08T18:31:14.164 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0297e-05 2024-05-08T18:31:14.164 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.164 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.164 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:14.164 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317532+0000", 2024-05-08T18:31:14.164 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1013e-05 2024-05-08T18:31:14.164 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.164 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.164 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:14.164 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317543+0000", 2024-05-08T18:31:14.164 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0757000000000001e-05 2024-05-08T18:31:14.165 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.165 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.165 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:14.165 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317658+0000", 2024-05-08T18:31:14.165 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115129 2024-05-08T18:31:14.165 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.165 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.165 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:14.165 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317887+0000", 2024-05-08T18:31:14.165 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00022880099999999999 2024-05-08T18:31:14.165 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.165 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.165 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:31:14.165 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.318378+0000", 2024-05-08T18:31:14.166 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00049129000000000002 2024-05-08T18:31:14.166 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.166 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.166 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:14.166 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.319597+0000", 2024-05-08T18:31:14.166 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012188469999999999 2024-05-08T18:31:14.166 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.166 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.166 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:14.166 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.320566+0000", 2024-05-08T18:31:14.166 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00096881599999999995 2024-05-08T18:31:14.166 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.166 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.166 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:14.167 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.320713+0000", 2024-05-08T18:31:14.167 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014691500000000001 2024-05-08T18:31:14.167 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.167 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.167 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:14.167 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.320827+0000", 2024-05-08T18:31:14.167 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000114306 2024-05-08T18:31:14.167 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:14.167 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:14.167 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:14.167 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.167 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.167 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:14.167 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.505569+0000", 2024-05-08T18:31:14.168 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 81.557389025000006, 2024-05-08T18:31:14.168 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028584309999999998, 2024-05-08T18:31:14.168 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:14.168 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:14.168 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:14.168 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:14.168 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:14.168 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:14.168 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 916 2024-05-08T18:31:14.168 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.168 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:14.168 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.168 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:14.168 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505569+0000", 2024-05-08T18:31:14.168 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:14.169 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.169 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.169 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:14.169 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505569+0000", 2024-05-08T18:31:14.169 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:14.169 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.169 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.169 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:14.169 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505572+0000", 2024-05-08T18:31:14.169 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3659999999999999e-06 2024-05-08T18:31:14.169 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.169 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.169 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:14.169 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505583+0000", 2024-05-08T18:31:14.170 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1574e-05 2024-05-08T18:31:14.170 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.170 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.170 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:14.170 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505614+0000", 2024-05-08T18:31:14.170 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0670000000000003e-05 2024-05-08T18:31:14.170 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.170 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.170 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:14.170 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505629+0000", 2024-05-08T18:31:14.170 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5063e-05 2024-05-08T18:31:14.170 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.170 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.171 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:14.171 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505754+0000", 2024-05-08T18:31:14.171 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012508899999999999 2024-05-08T18:31:14.171 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.171 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.171 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:14.171 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505988+0000", 2024-05-08T18:31:14.171 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023334699999999999 2024-05-08T18:31:14.171 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.171 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.171 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:14.171 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.506299+0000", 2024-05-08T18:31:14.171 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000311811 2024-05-08T18:31:14.172 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.172 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.172 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:14.172 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.507489+0000", 2024-05-08T18:31:14.172 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0011899510000000001 2024-05-08T18:31:14.172 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.172 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.172 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:14.172 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.508141+0000", 2024-05-08T18:31:14.172 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00065180200000000005 2024-05-08T18:31:14.172 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.172 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.172 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:14.172 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.508306+0000", 2024-05-08T18:31:14.173 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016450199999999999 2024-05-08T18:31:14.173 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.173 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.173 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:14.173 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.508428+0000", 2024-05-08T18:31:14.173 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000122256 2024-05-08T18:31:14.173 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:14.173 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:14.173 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:14.173 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.173 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.173 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:918 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:14.173 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.509337+0000", 2024-05-08T18:31:14.174 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 81.553620957999996, 2024-05-08T18:31:14.174 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002971787, 2024-05-08T18:31:14.174 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:14.174 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:14.174 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:14.174 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:14.174 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:14.174 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:14.174 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 918 2024-05-08T18:31:14.174 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.174 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:14.174 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.174 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:14.175 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509337+0000", 2024-05-08T18:31:14.175 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:14.175 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.175 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.175 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:14.175 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509337+0000", 2024-05-08T18:31:14.175 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:14.175 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.175 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.175 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:14.175 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509340+0000", 2024-05-08T18:31:14.175 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2570000000000002e-06 2024-05-08T18:31:14.175 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.175 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.176 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:14.176 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509351+0000", 2024-05-08T18:31:14.176 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0933e-05 2024-05-08T18:31:14.176 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.176 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.176 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:14.176 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509382+0000", 2024-05-08T18:31:14.176 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1198999999999997e-05 2024-05-08T18:31:14.176 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.176 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.176 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:14.176 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509400+0000", 2024-05-08T18:31:14.176 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8236999999999998e-05 2024-05-08T18:31:14.176 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.177 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.177 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:14.177 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509529+0000", 2024-05-08T18:31:14.177 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012905600000000001 2024-05-08T18:31:14.177 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.177 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.177 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:14.177 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509777+0000", 2024-05-08T18:31:14.177 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024786799999999999 2024-05-08T18:31:14.177 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.177 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.177 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:14.177 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.510284+0000", 2024-05-08T18:31:14.178 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000506796 2024-05-08T18:31:14.178 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.178 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.178 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:14.178 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.511453+0000", 2024-05-08T18:31:14.178 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001169575 2024-05-08T18:31:14.178 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.178 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.178 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:14.178 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.512051+0000", 2024-05-08T18:31:14.178 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00059743100000000005 2024-05-08T18:31:14.178 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.178 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.178 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:14.178 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.512199+0000", 2024-05-08T18:31:14.179 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000148486 2024-05-08T18:31:14.179 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.179 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.179 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:14.179 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.512309+0000", 2024-05-08T18:31:14.179 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000109949 2024-05-08T18:31:14.179 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:14.179 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:14.179 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:14.179 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.179 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.179 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:931 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:14.179 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.543277+0000", 2024-05-08T18:31:14.179 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 81.519681802999997, 2024-05-08T18:31:14.180 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028250710000000002, 2024-05-08T18:31:14.180 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:14.180 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:14.180 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:14.180 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:14.180 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:14.180 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:14.180 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 931 2024-05-08T18:31:14.180 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.180 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:14.180 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.180 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:14.180 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543277+0000", 2024-05-08T18:31:14.180 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:14.180 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.181 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.181 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:14.181 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543277+0000", 2024-05-08T18:31:14.181 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:14.181 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.181 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.181 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:14.181 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543279+0000", 2024-05-08T18:31:14.181 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.373e-06 2024-05-08T18:31:14.181 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.181 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.181 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:14.181 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543291+0000", 2024-05-08T18:31:14.182 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1517e-05 2024-05-08T18:31:14.182 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.182 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.182 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:14.182 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543323+0000", 2024-05-08T18:31:14.182 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2292000000000002e-05 2024-05-08T18:31:14.182 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.182 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.182 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:14.182 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543340+0000", 2024-05-08T18:31:14.182 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.749e-05 2024-05-08T18:31:14.182 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.182 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.182 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:14.183 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543462+0000", 2024-05-08T18:31:14.183 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000121413 2024-05-08T18:31:14.183 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.183 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.183 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:14.183 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543681+0000", 2024-05-08T18:31:14.183 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021974200000000001 2024-05-08T18:31:14.183 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.183 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.183 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:31:14.183 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.544004+0000", 2024-05-08T18:31:14.183 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00032268900000000003 2024-05-08T18:31:14.183 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.183 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.184 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:14.184 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.545158+0000", 2024-05-08T18:31:14.184 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0011540190000000001 2024-05-08T18:31:14.184 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.184 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.184 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:14.184 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.545970+0000", 2024-05-08T18:31:14.184 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00081224300000000004 2024-05-08T18:31:14.184 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.184 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.184 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:14.184 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.546043+0000", 2024-05-08T18:31:14.184 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.3067999999999999e-05 2024-05-08T18:31:14.184 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.185 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.185 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:14.185 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.546102+0000", 2024-05-08T18:31:14.185 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8224999999999999e-05 2024-05-08T18:31:14.185 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:14.185 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:14.185 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:14.185 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.185 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.185 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:14.185 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.578568+0000", 2024-05-08T18:31:14.185 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 81.484390895999994, 2024-05-08T18:31:14.185 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0030345839999999999, 2024-05-08T18:31:14.185 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:14.185 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:14.186 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:14.186 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:14.186 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:14.186 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:14.186 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 946 2024-05-08T18:31:14.186 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.186 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:14.186 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.186 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:14.186 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578568+0000", 2024-05-08T18:31:14.186 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:14.186 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.186 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.186 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:14.187 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578568+0000", 2024-05-08T18:31:14.187 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:14.187 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.187 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.187 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:14.187 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578570+0000", 2024-05-08T18:31:14.187 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3700000000000002e-06 2024-05-08T18:31:14.187 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.187 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.187 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:14.187 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578582+0000", 2024-05-08T18:31:14.187 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1627000000000001e-05 2024-05-08T18:31:14.187 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.187 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.188 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:14.188 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578612+0000", 2024-05-08T18:31:14.188 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0103e-05 2024-05-08T18:31:14.188 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.188 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.188 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:14.188 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578627+0000", 2024-05-08T18:31:14.188 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4949999999999999e-05 2024-05-08T18:31:14.188 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.188 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.188 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:14.188 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578750+0000", 2024-05-08T18:31:14.188 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012309899999999999 2024-05-08T18:31:14.188 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.189 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.189 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:14.189 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.579042+0000", 2024-05-08T18:31:14.189 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00029212500000000001 2024-05-08T18:31:14.189 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.189 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.189 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:14.189 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.579557+0000", 2024-05-08T18:31:14.189 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00051536900000000001 2024-05-08T18:31:14.189 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.189 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.189 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:14.189 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.580698+0000", 2024-05-08T18:31:14.189 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001140774 2024-05-08T18:31:14.190 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.190 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.190 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:14.190 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.581367+0000", 2024-05-08T18:31:14.190 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00066884799999999999 2024-05-08T18:31:14.190 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.190 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.190 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:14.190 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.581489+0000", 2024-05-08T18:31:14.190 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012265600000000001 2024-05-08T18:31:14.190 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:14.190 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:14.190 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:14.191 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.581602+0000", 2024-05-08T18:31:14.191 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000112663 2024-05-08T18:31:14.191 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:14.191 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:14.191 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:14.191 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:14.191 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:14.191 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:14.193 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-08T18:31:14.193 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:31:14.190+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:31:14.293 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:31:14.290+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:31:14.363 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:14.363 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:31:14.364 INFO:teuthology.orchestra.run.smithi097.stdout: "num_ops": 0 2024-05-08T18:31:14.364 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:14.380 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-08T18:31:14.395 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:31:14.390+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:31:14.416 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-08T18:31:14.496 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:31:14.494+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:31:14.592 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:14.593 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:31:14.593 INFO:teuthology.orchestra.run.smithi097.stdout: "complaint_time": 30, 2024-05-08T18:31:14.593 INFO:teuthology.orchestra.run.smithi097.stdout: "num_blocked_ops": 0 2024-05-08T18:31:14.593 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:14.596 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:31:14.594+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:31:14.612 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-08T18:31:14.622 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2024-05-08T18:31:14.623 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:31:14.653 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2024-05-08T18:31:14.653 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:31:14.684 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2024-05-08T18:31:14.684 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:31:14.697 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:31:14.694+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:31:14.715 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2024-05-08T18:31:14.715 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:31:14.731 INFO:teuthology.orchestra.run.smithi097.stderr:reweighted osd.4 to 1 (10000) 2024-05-08T18:31:14.801 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-08T18:31:14.802 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2024-05-08T18:31:14.803 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:31:14.804 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-05-08T18:31:14.804 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:14.804 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:14.805 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2024-05-08T18:31:14.805 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:31:14.806 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-08T18:31:14.806 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:31:14.802+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:31:14.822 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2024-05-08T18:31:14.822 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:31:14.856 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2024-05-08T18:31:14.856 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:31:14.931 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:31:14.930+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:31:14.998 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:14.998 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:15.004 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:31:15.002+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:31:15.019 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-08T18:31:15.111 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:31:15.110+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:31:15.207 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:31:15.202+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:31:15.237 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:15.237 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:15.256 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-08T18:31:15.308 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:31:15.302+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:31:15.409 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:31:15.406+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:31:15.468 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:15.468 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:15.485 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-08T18:31:15.527 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:31:15.526+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:31:15.611 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:31:15.610+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:31:15.617 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:15.617 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:15.633 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-08T18:31:15.712 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:31:15.706+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:31:15.736 INFO:teuthology.orchestra.run.smithi097.stderr:reweighted osd.5 to 1 (10000) 2024-05-08T18:31:15.745 INFO:teuthology.orchestra.run.smithi097.stderr:nodeep-scrub is set 2024-05-08T18:31:15.753 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:15.753 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:15.767 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-08T18:31:15.770 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-05-08T18:31:15.820 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:31:15.818+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:31:15.914 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:31:15.910+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:31:15.931 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:15.931 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:15.945 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-08T18:31:16.036 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:31:16.034+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:31:16.115 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:16.116 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:16.116 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:31:16.110+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:31:16.129 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-08T18:31:16.220 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:31:16.218+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:31:16.300 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:16.300 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:16.314 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-08T18:31:16.317 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:31:16.314+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:31:16.418 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:31:16.414+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:31:16.477 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:16.477 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:16.491 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-08T18:31:16.519 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:31:16.518+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:31:16.611 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:16.611 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:16.620 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:31:16.618+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:31:16.625 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-08T18:31:16.722 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:31:16.718+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:31:16.740 INFO:teuthology.orchestra.run.smithi097.stderr:reweighted osd.6 to 1 (10000) 2024-05-08T18:31:16.748 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:16.748 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:16.763 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-08T18:31:16.770 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-05-08T18:31:16.852 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:31:16.850+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:31:16.888 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-08T18:31:16.923 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:31:16.918+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:31:16.932 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:16.932 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:16.946 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-08T18:31:17.032 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:31:17.030+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:31:17.056 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2024-05-08T18:31:17.056 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:31:17.073 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2024-05-08T18:31:17.073 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:31:17.088 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2024-05-08T18:31:17.089 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:31:17.104 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2024-05-08T18:31:17.105 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:31:17.111 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:17.111 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:17.124 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2024-05-08T18:31:17.125 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:31:17.125 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:31:17.122+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:31:17.126 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-08T18:31:17.141 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2024-05-08T18:31:17.141 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:31:17.160 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2024-05-08T18:31:17.161 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:31:17.180 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2024-05-08T18:31:17.180 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:31:17.226 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:31:17.222+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:31:17.290 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:31:17.290 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:31:17.290 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2024-05-08T18:31:17.290 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2024-05-08T18:31:17.290 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:31:17.304 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-08T18:31:17.326 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:31:17.322+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:31:17.428 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:31:17.422+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:31:17.468 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:31:17.469 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2024-05-08T18:31:17.469 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2024-05-08T18:31:17.469 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-05-08T18:31:17.469 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.469 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:24 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [write 262144~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:17.469 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.154193+0000", 2024-05-08T18:31:17.469 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 110.31160226900001, 2024-05-08T18:31:17.469 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0085494309999999997, 2024-05-08T18:31:17.469 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:17.469 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:17.470 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:17.470 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:17.470 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:17.470 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:17.470 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 24 2024-05-08T18:31:17.470 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.470 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:17.470 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.470 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:17.470 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154193+0000", 2024-05-08T18:31:17.470 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:17.470 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.471 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.471 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:17.471 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154193+0000", 2024-05-08T18:31:17.471 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:17.471 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.471 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.472 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:17.472 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154194+0000", 2024-05-08T18:31:17.472 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.44e-06 2024-05-08T18:31:17.472 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.472 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.472 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:17.472 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154394+0000", 2024-05-08T18:31:17.472 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00019972499999999999 2024-05-08T18:31:17.472 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.472 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.472 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:17.472 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154417+0000", 2024-05-08T18:31:17.473 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2713000000000001e-05 2024-05-08T18:31:17.473 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.473 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.473 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:17.473 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154437+0000", 2024-05-08T18:31:17.473 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0027e-05 2024-05-08T18:31:17.473 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.473 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.473 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:17.473 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.158438+0000", 2024-05-08T18:31:17.473 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0040011459999999997 2024-05-08T18:31:17.473 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.473 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.474 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:17.474 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.158567+0000", 2024-05-08T18:31:17.474 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012923899999999999 2024-05-08T18:31:17.474 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.474 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.474 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:17.474 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.158787+0000", 2024-05-08T18:31:17.474 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000219581 2024-05-08T18:31:17.474 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.474 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.474 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:17.474 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.162013+0000", 2024-05-08T18:31:17.474 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032261759999999999 2024-05-08T18:31:17.475 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.475 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.475 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:17.475 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.162568+0000", 2024-05-08T18:31:17.475 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00055576900000000001 2024-05-08T18:31:17.475 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.475 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.475 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:17.475 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.162644+0000", 2024-05-08T18:31:17.475 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5516e-05 2024-05-08T18:31:17.475 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.475 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.475 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:17.476 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.162742+0000", 2024-05-08T18:31:17.476 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8098999999999997e-05 2024-05-08T18:31:17.476 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:17.476 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:17.476 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:17.476 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.476 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.476 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:25 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:17.476 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.154495+0000", 2024-05-08T18:31:17.476 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 110.311299975, 2024-05-08T18:31:17.476 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010784396999999999, 2024-05-08T18:31:17.476 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:17.476 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:17.477 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:17.477 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:17.477 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:17.477 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:17.477 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 25 2024-05-08T18:31:17.477 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.477 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:17.477 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.477 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:17.477 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154495+0000", 2024-05-08T18:31:17.477 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:17.477 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.477 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.477 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:17.478 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154495+0000", 2024-05-08T18:31:17.478 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:17.478 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.478 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.478 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:17.478 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154496+0000", 2024-05-08T18:31:17.478 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.454e-06 2024-05-08T18:31:17.478 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.478 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.478 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:17.478 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154509+0000", 2024-05-08T18:31:17.478 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2496e-05 2024-05-08T18:31:17.479 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.479 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.479 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:17.479 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154531+0000", 2024-05-08T18:31:17.479 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1987000000000001e-05 2024-05-08T18:31:17.479 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.479 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.479 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:17.479 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154547+0000", 2024-05-08T18:31:17.479 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.577e-05 2024-05-08T18:31:17.479 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.479 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.479 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:17.479 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.160949+0000", 2024-05-08T18:31:17.480 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.006401917 2024-05-08T18:31:17.480 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.480 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.480 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:17.480 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.161102+0000", 2024-05-08T18:31:17.480 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000153826 2024-05-08T18:31:17.480 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.480 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.480 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:17.480 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.161332+0000", 2024-05-08T18:31:17.480 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022918099999999999 2024-05-08T18:31:17.480 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.480 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.480 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:17.481 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.163838+0000", 2024-05-08T18:31:17.481 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0025064079999999999 2024-05-08T18:31:17.481 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.481 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.481 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:17.481 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.165121+0000", 2024-05-08T18:31:17.481 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0012825200000000001 2024-05-08T18:31:17.481 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.481 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.481 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:17.481 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.165212+0000", 2024-05-08T18:31:17.481 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1121999999999999e-05 2024-05-08T18:31:17.481 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.482 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.482 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:17.482 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.165279+0000", 2024-05-08T18:31:17.482 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7716e-05 2024-05-08T18:31:17.482 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:17.482 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:17.482 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:17.482 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.483 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.483 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:41 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:17.483 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247174+0000", 2024-05-08T18:31:17.483 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 110.218620993, 2024-05-08T18:31:17.483 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010013393000000001, 2024-05-08T18:31:17.483 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:17.483 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:17.483 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:17.483 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:17.483 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:17.483 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:17.483 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 41 2024-05-08T18:31:17.483 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.483 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:17.484 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.484 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:17.484 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247174+0000", 2024-05-08T18:31:17.484 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:17.484 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.484 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.484 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:17.484 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247174+0000", 2024-05-08T18:31:17.484 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:17.484 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.485 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.485 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:17.485 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247175+0000", 2024-05-08T18:31:17.485 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.9999999999999995e-07 2024-05-08T18:31:17.485 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.485 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.485 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:17.485 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247277+0000", 2024-05-08T18:31:17.485 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010243600000000001 2024-05-08T18:31:17.485 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.485 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.485 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:17.486 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247291+0000", 2024-05-08T18:31:17.486 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4076999999999999e-05 2024-05-08T18:31:17.486 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.486 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.486 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:17.486 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247301+0000", 2024-05-08T18:31:17.486 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0010000000000001e-05 2024-05-08T18:31:17.486 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.486 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.486 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:17.486 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.249555+0000", 2024-05-08T18:31:17.487 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0022539050000000001 2024-05-08T18:31:17.487 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.487 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.487 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:17.487 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.249700+0000", 2024-05-08T18:31:17.487 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014484599999999999 2024-05-08T18:31:17.487 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.487 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.487 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:17.487 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.249929+0000", 2024-05-08T18:31:17.487 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022904499999999999 2024-05-08T18:31:17.487 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.487 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.488 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:17.488 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.253695+0000", 2024-05-08T18:31:17.488 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0037656640000000002 2024-05-08T18:31:17.488 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.488 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.488 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:17.488 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.256970+0000", 2024-05-08T18:31:17.488 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003274608 2024-05-08T18:31:17.488 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.488 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.488 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:17.488 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.257052+0000", 2024-05-08T18:31:17.488 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2223000000000002e-05 2024-05-08T18:31:17.489 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.489 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.489 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:17.489 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.257187+0000", 2024-05-08T18:31:17.489 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013557900000000001 2024-05-08T18:31:17.489 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:17.489 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:17.489 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:17.489 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.489 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.489 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:42 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:17.489 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247321+0000", 2024-05-08T18:31:17.489 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 110.21847367399999, 2024-05-08T18:31:17.489 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013168572, 2024-05-08T18:31:17.490 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:17.490 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:17.490 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:17.490 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:17.490 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:17.490 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:17.490 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 42 2024-05-08T18:31:17.490 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.490 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:17.490 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.490 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:17.490 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247321+0000", 2024-05-08T18:31:17.491 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:17.491 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.491 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.491 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:17.491 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247321+0000", 2024-05-08T18:31:17.491 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:17.491 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.491 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.491 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:17.491 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247323+0000", 2024-05-08T18:31:17.491 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.24e-06 2024-05-08T18:31:17.491 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.491 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.492 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:17.492 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247329+0000", 2024-05-08T18:31:17.492 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1530000000000002e-06 2024-05-08T18:31:17.492 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.492 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.492 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:17.492 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247339+0000", 2024-05-08T18:31:17.492 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0387000000000001e-05 2024-05-08T18:31:17.492 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.492 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.493 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:17.493 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247347+0000", 2024-05-08T18:31:17.493 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9829999999999996e-06 2024-05-08T18:31:17.493 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.493 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.493 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:17.493 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.251488+0000", 2024-05-08T18:31:17.493 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0041412849999999998 2024-05-08T18:31:17.493 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.493 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.493 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:17.493 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.251672+0000", 2024-05-08T18:31:17.493 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00018354499999999999 2024-05-08T18:31:17.493 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.493 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.494 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:17.494 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.251949+0000", 2024-05-08T18:31:17.494 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00027695399999999999 2024-05-08T18:31:17.494 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.494 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.494 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:17.494 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.253810+0000", 2024-05-08T18:31:17.494 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001860806 2024-05-08T18:31:17.494 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.495 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.495 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:17.495 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260244+0000", 2024-05-08T18:31:17.495 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0064347939999999998 2024-05-08T18:31:17.495 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.495 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.495 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:17.495 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260376+0000", 2024-05-08T18:31:17.495 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000131829 2024-05-08T18:31:17.495 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.495 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.495 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:17.495 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260490+0000", 2024-05-08T18:31:17.495 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000113596 2024-05-08T18:31:17.496 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:17.496 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:17.496 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:17.496 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.496 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.496 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:43 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:17.496 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247367+0000", 2024-05-08T18:31:17.496 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 110.218427761, 2024-05-08T18:31:17.496 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013449025999999999, 2024-05-08T18:31:17.496 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:17.496 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:17.496 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:17.496 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:17.496 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:17.496 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:17.497 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 43 2024-05-08T18:31:17.497 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.497 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:17.497 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.497 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:17.497 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247367+0000", 2024-05-08T18:31:17.497 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:17.497 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.497 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.497 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:17.497 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247367+0000", 2024-05-08T18:31:17.497 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:17.497 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.497 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.497 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:17.498 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247368+0000", 2024-05-08T18:31:17.498 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1999999999999999e-07 2024-05-08T18:31:17.498 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.498 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.498 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:17.498 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247374+0000", 2024-05-08T18:31:17.498 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.19e-06 2024-05-08T18:31:17.498 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.498 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.498 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:17.498 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247384+0000", 2024-05-08T18:31:17.498 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0173000000000001e-05 2024-05-08T18:31:17.498 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.499 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.499 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:17.499 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247392+0000", 2024-05-08T18:31:17.499 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1869999999999997e-06 2024-05-08T18:31:17.499 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.499 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.499 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:17.499 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.252515+0000", 2024-05-08T18:31:17.499 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0051221399999999999 2024-05-08T18:31:17.499 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.499 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.499 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:17.499 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.252641+0000", 2024-05-08T18:31:17.499 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012609200000000001 2024-05-08T18:31:17.500 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.500 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.500 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:17.500 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.252842+0000", 2024-05-08T18:31:17.500 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000201619 2024-05-08T18:31:17.500 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.500 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.500 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:17.500 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.256828+0000", 2024-05-08T18:31:17.500 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039853989999999997 2024-05-08T18:31:17.500 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.500 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.500 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:17.501 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260515+0000", 2024-05-08T18:31:17.501 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0036875419999999998 2024-05-08T18:31:17.501 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.501 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.501 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:17.501 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260718+0000", 2024-05-08T18:31:17.501 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020229499999999999 2024-05-08T18:31:17.501 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.501 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.501 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:17.501 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260816+0000", 2024-05-08T18:31:17.501 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8669e-05 2024-05-08T18:31:17.501 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:17.502 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:17.502 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:17.502 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.502 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.502 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:17.502 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247466+0000", 2024-05-08T18:31:17.502 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 110.21832917499999, 2024-05-08T18:31:17.502 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013491806, 2024-05-08T18:31:17.502 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:17.502 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:17.502 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:17.502 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:17.503 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:17.503 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:17.503 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 44 2024-05-08T18:31:17.503 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.503 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:17.503 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.503 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:17.503 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247466+0000", 2024-05-08T18:31:17.503 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:17.503 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.503 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.503 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:17.503 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247466+0000", 2024-05-08T18:31:17.503 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:17.504 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.504 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.504 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:17.504 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247467+0000", 2024-05-08T18:31:17.504 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.263e-06 2024-05-08T18:31:17.504 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.504 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.504 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:17.504 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247585+0000", 2024-05-08T18:31:17.504 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011756600000000001 2024-05-08T18:31:17.504 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.504 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.504 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:17.504 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247598+0000", 2024-05-08T18:31:17.504 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3766e-05 2024-05-08T18:31:17.505 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.505 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.505 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:17.505 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247609+0000", 2024-05-08T18:31:17.505 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0604e-05 2024-05-08T18:31:17.505 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.505 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.505 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:17.505 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.253890+0000", 2024-05-08T18:31:17.505 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0062810440000000004 2024-05-08T18:31:17.505 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.505 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.505 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:17.505 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.254068+0000", 2024-05-08T18:31:17.506 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017848199999999999 2024-05-08T18:31:17.506 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.506 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.506 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:17.506 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.254488+0000", 2024-05-08T18:31:17.506 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00041965399999999999 2024-05-08T18:31:17.506 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.506 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.506 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:17.506 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.256949+0000", 2024-05-08T18:31:17.506 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002461254 2024-05-08T18:31:17.506 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.507 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.507 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:17.507 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260832+0000", 2024-05-08T18:31:17.507 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0038830539999999999 2024-05-08T18:31:17.507 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.507 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.507 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:17.507 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260906+0000", 2024-05-08T18:31:17.507 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3455999999999996e-05 2024-05-08T18:31:17.507 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.508 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.508 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:17.508 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260958+0000", 2024-05-08T18:31:17.508 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1663000000000003e-05 2024-05-08T18:31:17.508 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:17.508 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:17.508 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:17.508 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.508 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.508 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:17.508 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247630+0000", 2024-05-08T18:31:17.508 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 110.21816477, 2024-05-08T18:31:17.508 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013478753, 2024-05-08T18:31:17.508 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:17.509 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:17.509 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:17.509 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:17.509 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:17.509 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:17.509 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 45 2024-05-08T18:31:17.509 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.509 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:17.509 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.509 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:17.509 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247630+0000", 2024-05-08T18:31:17.509 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:17.509 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.510 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.510 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:17.510 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247630+0000", 2024-05-08T18:31:17.510 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:17.510 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.510 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.510 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:17.510 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247631+0000", 2024-05-08T18:31:17.510 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7399999999999991e-07 2024-05-08T18:31:17.510 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.510 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.510 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:17.510 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247637+0000", 2024-05-08T18:31:17.511 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.93e-06 2024-05-08T18:31:17.511 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.511 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.511 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:17.511 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247647+0000", 2024-05-08T18:31:17.511 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7459999999999995e-06 2024-05-08T18:31:17.511 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.511 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.511 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:17.511 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247654+0000", 2024-05-08T18:31:17.511 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4039999999999998e-06 2024-05-08T18:31:17.511 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.511 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.511 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:17.512 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.255829+0000", 2024-05-08T18:31:17.512 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0081749059999999991 2024-05-08T18:31:17.512 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.512 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.512 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:17.512 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.255979+0000", 2024-05-08T18:31:17.512 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015027899999999999 2024-05-08T18:31:17.512 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.512 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.512 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:17.512 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.256185+0000", 2024-05-08T18:31:17.512 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020583900000000001 2024-05-08T18:31:17.512 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.512 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.513 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:17.513 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260097+0000", 2024-05-08T18:31:17.513 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039121929999999996 2024-05-08T18:31:17.513 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.513 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.513 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:17.513 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260973+0000", 2024-05-08T18:31:17.513 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00087591999999999998 2024-05-08T18:31:17.513 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.513 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.513 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:17.513 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261056+0000", 2024-05-08T18:31:17.513 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3104999999999998e-05 2024-05-08T18:31:17.513 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.513 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.514 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:17.514 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261109+0000", 2024-05-08T18:31:17.514 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2457000000000003e-05 2024-05-08T18:31:17.514 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:17.514 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:17.514 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:17.514 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.514 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.514 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:17.514 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247667+0000", 2024-05-08T18:31:17.514 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 110.21812749, 2024-05-08T18:31:17.514 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013569098999999999, 2024-05-08T18:31:17.514 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:17.515 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:17.515 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:17.515 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:17.515 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:17.515 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:17.515 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 46 2024-05-08T18:31:17.515 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.515 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:17.515 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.515 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:17.515 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247667+0000", 2024-05-08T18:31:17.515 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:17.515 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.516 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.516 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:17.516 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247667+0000", 2024-05-08T18:31:17.516 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:17.516 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.516 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.516 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:17.516 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247668+0000", 2024-05-08T18:31:17.516 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7999999999999995e-07 2024-05-08T18:31:17.516 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.517 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.517 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:17.517 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247674+0000", 2024-05-08T18:31:17.517 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4369999999999998e-06 2024-05-08T18:31:17.517 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.517 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.517 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:17.517 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247683+0000", 2024-05-08T18:31:17.517 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4360000000000008e-06 2024-05-08T18:31:17.517 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.517 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.517 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:17.517 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247690+0000", 2024-05-08T18:31:17.518 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.43e-06 2024-05-08T18:31:17.518 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.518 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.518 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:17.518 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.257358+0000", 2024-05-08T18:31:17.518 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0096676890000000001 2024-05-08T18:31:17.518 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.518 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.518 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:17.518 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.257626+0000", 2024-05-08T18:31:17.518 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00026819099999999998 2024-05-08T18:31:17.518 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.518 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.518 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:17.519 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.258041+0000", 2024-05-08T18:31:17.519 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00041438400000000001 2024-05-08T18:31:17.519 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.519 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.519 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:17.519 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260224+0000", 2024-05-08T18:31:17.519 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0021830700000000001 2024-05-08T18:31:17.519 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.519 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.519 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:17.519 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261127+0000", 2024-05-08T18:31:17.519 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00090292300000000003 2024-05-08T18:31:17.519 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.520 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.520 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:17.520 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261191+0000", 2024-05-08T18:31:17.520 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4342000000000002e-05 2024-05-08T18:31:17.520 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.520 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.520 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:17.520 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261237+0000", 2024-05-08T18:31:17.520 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.5516999999999998e-05 2024-05-08T18:31:17.520 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:17.520 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:17.520 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:17.520 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.520 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.521 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:17.521 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247703+0000", 2024-05-08T18:31:17.521 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 110.218092007, 2024-05-08T18:31:17.521 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015020204000000001, 2024-05-08T18:31:17.521 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:17.521 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:17.521 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:17.521 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:17.521 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:17.521 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:17.521 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 47 2024-05-08T18:31:17.521 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.521 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:17.521 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.522 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:17.522 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247703+0000", 2024-05-08T18:31:17.522 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:17.522 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.522 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.522 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:17.522 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247703+0000", 2024-05-08T18:31:17.522 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:17.523 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.523 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.523 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:17.523 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247704+0000", 2024-05-08T18:31:17.523 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8299999999999996e-07 2024-05-08T18:31:17.523 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.524 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.524 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:17.524 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247877+0000", 2024-05-08T18:31:17.524 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000172979 2024-05-08T18:31:17.524 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.524 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.524 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:17.524 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247894+0000", 2024-05-08T18:31:17.524 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6912999999999999e-05 2024-05-08T18:31:17.524 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.524 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.524 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:17.524 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247903+0000", 2024-05-08T18:31:17.524 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1770000000000004e-06 2024-05-08T18:31:17.525 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.525 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.525 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:17.525 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.258767+0000", 2024-05-08T18:31:17.525 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010864409 2024-05-08T18:31:17.525 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.525 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.525 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:17.525 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.258898+0000", 2024-05-08T18:31:17.525 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000131199 2024-05-08T18:31:17.525 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.525 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.526 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:17.526 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.259117+0000", 2024-05-08T18:31:17.526 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000218889 2024-05-08T18:31:17.526 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.526 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.526 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:17.526 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.262372+0000", 2024-05-08T18:31:17.526 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032545679999999998 2024-05-08T18:31:17.526 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.526 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.526 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:17.526 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.262432+0000", 2024-05-08T18:31:17.526 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9913e-05 2024-05-08T18:31:17.527 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.527 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.527 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:17.527 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.262585+0000", 2024-05-08T18:31:17.527 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015361800000000001 2024-05-08T18:31:17.527 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.527 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.527 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:17.527 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.262723+0000", 2024-05-08T18:31:17.527 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000137856 2024-05-08T18:31:17.527 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:17.528 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:17.528 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:17.528 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.528 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.528 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:17.528 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247927+0000", 2024-05-08T18:31:17.528 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 110.217867969, 2024-05-08T18:31:17.528 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018387718000000001, 2024-05-08T18:31:17.528 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:17.528 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:17.528 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:17.528 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:17.528 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:17.529 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:17.529 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 48 2024-05-08T18:31:17.529 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.529 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:17.529 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.529 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:17.529 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247927+0000", 2024-05-08T18:31:17.529 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:17.529 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.529 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.529 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:17.529 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247927+0000", 2024-05-08T18:31:17.529 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:17.529 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.530 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.530 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:17.530 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247928+0000", 2024-05-08T18:31:17.530 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8400000000000003e-07 2024-05-08T18:31:17.530 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.530 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.530 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:17.530 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247935+0000", 2024-05-08T18:31:17.530 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1230000000000002e-06 2024-05-08T18:31:17.530 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.530 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.530 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:17.530 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247945+0000", 2024-05-08T18:31:17.531 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0346000000000001e-05 2024-05-08T18:31:17.531 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.531 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.531 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:17.531 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247953+0000", 2024-05-08T18:31:17.531 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8040000000000002e-06 2024-05-08T18:31:17.531 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.531 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.531 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:17.531 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261292+0000", 2024-05-08T18:31:17.531 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013339337 2024-05-08T18:31:17.531 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.531 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.532 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:17.532 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261424+0000", 2024-05-08T18:31:17.532 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013201900000000001 2024-05-08T18:31:17.532 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.532 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.532 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:17.532 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261628+0000", 2024-05-08T18:31:17.532 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020327499999999999 2024-05-08T18:31:17.532 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.532 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.532 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:17.532 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.263849+0000", 2024-05-08T18:31:17.532 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0022209759999999999 2024-05-08T18:31:17.533 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.533 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.533 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:17.533 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266167+0000", 2024-05-08T18:31:17.533 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002317979 2024-05-08T18:31:17.533 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.533 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.533 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:17.533 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266249+0000", 2024-05-08T18:31:17.533 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1996000000000006e-05 2024-05-08T18:31:17.533 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.533 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.533 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:17.533 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266315+0000", 2024-05-08T18:31:17.534 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5979e-05 2024-05-08T18:31:17.534 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:17.534 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:17.534 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:17.534 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.534 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.534 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:17.534 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247966+0000", 2024-05-08T18:31:17.534 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 110.217829036, 2024-05-08T18:31:17.534 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0194153, 2024-05-08T18:31:17.534 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:17.534 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:17.534 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:17.535 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:17.535 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:17.535 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:17.535 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 49 2024-05-08T18:31:17.535 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.535 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:17.535 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.535 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:17.535 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247966+0000", 2024-05-08T18:31:17.535 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:17.535 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.535 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.535 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:17.535 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247966+0000", 2024-05-08T18:31:17.536 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:17.536 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.536 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.536 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:17.536 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247967+0000", 2024-05-08T18:31:17.536 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0299999999999998e-07 2024-05-08T18:31:17.536 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.536 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.536 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:17.536 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247972+0000", 2024-05-08T18:31:17.536 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3600000000000004e-06 2024-05-08T18:31:17.536 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.536 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.536 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:17.536 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247981+0000", 2024-05-08T18:31:17.537 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.234e-06 2024-05-08T18:31:17.537 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.537 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.537 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:17.537 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247989+0000", 2024-05-08T18:31:17.537 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5159999999999997e-06 2024-05-08T18:31:17.537 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.537 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.537 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:17.537 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.262816+0000", 2024-05-08T18:31:17.537 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.014827399999999999 2024-05-08T18:31:17.538 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.538 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.538 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:17.538 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.262948+0000", 2024-05-08T18:31:17.538 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013166799999999999 2024-05-08T18:31:17.538 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.538 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.538 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:17.538 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.263153+0000", 2024-05-08T18:31:17.538 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000205272 2024-05-08T18:31:17.538 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.538 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.538 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:17.539 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266144+0000", 2024-05-08T18:31:17.539 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029912300000000001 2024-05-08T18:31:17.539 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.539 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.539 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:17.539 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.267226+0000", 2024-05-08T18:31:17.539 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010820580000000001 2024-05-08T18:31:17.539 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.539 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.539 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:17.539 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.267315+0000", 2024-05-08T18:31:17.539 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8793000000000002e-05 2024-05-08T18:31:17.539 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.539 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.540 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:17.540 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.267381+0000", 2024-05-08T18:31:17.540 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6066000000000001e-05 2024-05-08T18:31:17.540 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:17.540 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:17.540 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:17.540 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.540 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.540 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:17.540 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.248003+0000", 2024-05-08T18:31:17.540 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 110.217791736, 2024-05-08T18:31:17.540 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.020859638999999999, 2024-05-08T18:31:17.540 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:17.540 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:17.541 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:17.541 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:17.541 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:17.541 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:17.541 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 50 2024-05-08T18:31:17.541 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.541 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:17.541 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.541 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:17.541 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248003+0000", 2024-05-08T18:31:17.541 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:17.541 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.541 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.541 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:17.542 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248003+0000", 2024-05-08T18:31:17.542 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:17.542 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.542 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.542 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:17.542 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248004+0000", 2024-05-08T18:31:17.542 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5300000000000003e-07 2024-05-08T18:31:17.542 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.542 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.542 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:17.542 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248139+0000", 2024-05-08T18:31:17.542 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000135193 2024-05-08T18:31:17.542 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.542 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.543 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:17.543 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248151+0000", 2024-05-08T18:31:17.543 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.19e-05 2024-05-08T18:31:17.543 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.543 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.543 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:17.543 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248161+0000", 2024-05-08T18:31:17.543 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4599999999999992e-06 2024-05-08T18:31:17.543 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.543 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.543 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:17.543 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.263961+0000", 2024-05-08T18:31:17.543 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015800844000000001 2024-05-08T18:31:17.544 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.544 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.544 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:17.544 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.264091+0000", 2024-05-08T18:31:17.544 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012952300000000001 2024-05-08T18:31:17.544 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.544 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.544 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:17.544 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.264306+0000", 2024-05-08T18:31:17.544 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000215541 2024-05-08T18:31:17.544 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.544 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.544 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:17.545 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.267205+0000", 2024-05-08T18:31:17.545 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0028989910000000001 2024-05-08T18:31:17.545 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.545 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.545 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:17.545 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.268631+0000", 2024-05-08T18:31:17.545 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0014257320000000001 2024-05-08T18:31:17.545 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.545 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.545 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:17.545 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.268781+0000", 2024-05-08T18:31:17.545 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000149939 2024-05-08T18:31:17.545 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.545 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.545 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:17.546 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.268863+0000", 2024-05-08T18:31:17.546 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1762999999999996e-05 2024-05-08T18:31:17.546 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:17.546 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:17.546 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:17.546 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.546 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.546 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:17.546 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.248201+0000", 2024-05-08T18:31:17.546 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 110.21759398099999, 2024-05-08T18:31:17.546 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.022909783, 2024-05-08T18:31:17.546 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:17.547 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:17.547 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:17.547 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:17.547 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:17.547 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:17.547 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 51 2024-05-08T18:31:17.547 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.547 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:17.547 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.547 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:17.547 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248201+0000", 2024-05-08T18:31:17.548 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:17.548 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.548 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.548 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:17.548 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248201+0000", 2024-05-08T18:31:17.548 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:17.548 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.548 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.548 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:17.548 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248202+0000", 2024-05-08T18:31:17.548 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2999999999999999e-07 2024-05-08T18:31:17.548 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.548 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.549 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:17.549 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248209+0000", 2024-05-08T18:31:17.549 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5769999999999996e-06 2024-05-08T18:31:17.549 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.549 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.549 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:17.549 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248221+0000", 2024-05-08T18:31:17.549 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1165999999999999e-05 2024-05-08T18:31:17.549 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.549 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.549 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:17.549 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248229+0000", 2024-05-08T18:31:17.549 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1529999999999997e-06 2024-05-08T18:31:17.549 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.549 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.550 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:17.550 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.265146+0000", 2024-05-08T18:31:17.550 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016917492999999999 2024-05-08T18:31:17.550 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.550 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.550 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:17.550 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.265282+0000", 2024-05-08T18:31:17.550 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013597199999999999 2024-05-08T18:31:17.550 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.550 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.551 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:17.551 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.265488+0000", 2024-05-08T18:31:17.551 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000206212 2024-05-08T18:31:17.551 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.551 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.551 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:17.551 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.268442+0000", 2024-05-08T18:31:17.551 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002953841 2024-05-08T18:31:17.551 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.551 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.551 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:17.551 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.270951+0000", 2024-05-08T18:31:17.551 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0025085670000000002 2024-05-08T18:31:17.552 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.552 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.552 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:17.552 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.271042+0000", 2024-05-08T18:31:17.552 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1485999999999998e-05 2024-05-08T18:31:17.552 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.552 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.552 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:17.552 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.271111+0000", 2024-05-08T18:31:17.552 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8386000000000006e-05 2024-05-08T18:31:17.552 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:17.552 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:17.552 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:17.552 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.553 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.553 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:17.553 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.248244+0000", 2024-05-08T18:31:17.553 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 110.217551425, 2024-05-08T18:31:17.553 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.023010806000000002, 2024-05-08T18:31:17.553 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:17.553 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:17.553 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:17.553 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:17.553 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:17.553 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:17.553 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 52 2024-05-08T18:31:17.553 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.553 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:17.554 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.554 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:17.554 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248244+0000", 2024-05-08T18:31:17.554 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:17.554 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.554 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.554 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:17.554 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248244+0000", 2024-05-08T18:31:17.554 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:17.554 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.554 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.555 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:17.555 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248244+0000", 2024-05-08T18:31:17.555 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0999999999999998e-07 2024-05-08T18:31:17.555 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.555 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.555 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:17.555 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248251+0000", 2024-05-08T18:31:17.555 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9639999999999997e-06 2024-05-08T18:31:17.555 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.555 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.555 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:17.555 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248266+0000", 2024-05-08T18:31:17.555 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4996e-05 2024-05-08T18:31:17.555 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.556 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.556 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:17.556 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248274+0000", 2024-05-08T18:31:17.556 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8299999999999996e-06 2024-05-08T18:31:17.556 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.556 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.556 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:17.556 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266367+0000", 2024-05-08T18:31:17.556 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018092607 2024-05-08T18:31:17.556 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.556 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.556 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:17.556 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266532+0000", 2024-05-08T18:31:17.556 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016569600000000001 2024-05-08T18:31:17.556 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.557 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.557 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:17.557 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266729+0000", 2024-05-08T18:31:17.557 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00019630099999999999 2024-05-08T18:31:17.557 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.557 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.557 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:17.557 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.268574+0000", 2024-05-08T18:31:17.557 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0018452329999999999 2024-05-08T18:31:17.557 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.557 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.557 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:17.557 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.271128+0000", 2024-05-08T18:31:17.557 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00255369 2024-05-08T18:31:17.558 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.558 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.558 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:17.558 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.271199+0000", 2024-05-08T18:31:17.558 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1712999999999996e-05 2024-05-08T18:31:17.558 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.558 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.558 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:17.558 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.271254+0000", 2024-05-08T18:31:17.558 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5065999999999998e-05 2024-05-08T18:31:17.558 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:17.558 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:17.559 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:17.559 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.559 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.559 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:17.559 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.486052+0000", 2024-05-08T18:31:17.559 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 109.979742981, 2024-05-08T18:31:17.559 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0098898389999999992, 2024-05-08T18:31:17.559 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:17.559 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:17.559 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:17.559 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:17.559 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:17.559 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:17.559 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 72 2024-05-08T18:31:17.560 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.560 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:17.560 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.560 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:17.560 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486052+0000", 2024-05-08T18:31:17.560 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:17.560 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.560 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.560 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:17.560 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486052+0000", 2024-05-08T18:31:17.560 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:17.560 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.560 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.561 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:17.561 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486053+0000", 2024-05-08T18:31:17.561 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1200000000000001e-07 2024-05-08T18:31:17.561 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.561 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.561 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:17.561 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486188+0000", 2024-05-08T18:31:17.561 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013526200000000001 2024-05-08T18:31:17.561 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.561 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.561 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:17.561 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486205+0000", 2024-05-08T18:31:17.561 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6742e-05 2024-05-08T18:31:17.562 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.562 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.562 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:17.562 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486215+0000", 2024-05-08T18:31:17.562 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8290000000000003e-06 2024-05-08T18:31:17.562 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.562 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.562 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:17.562 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.491930+0000", 2024-05-08T18:31:17.562 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0057153660000000004 2024-05-08T18:31:17.562 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.562 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.562 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:17.562 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.491995+0000", 2024-05-08T18:31:17.563 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5289000000000005e-05 2024-05-08T18:31:17.563 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.563 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.563 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:17.563 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.492096+0000", 2024-05-08T18:31:17.563 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010101400000000001 2024-05-08T18:31:17.563 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.563 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.563 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:17.563 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.494152+0000", 2024-05-08T18:31:17.563 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0020560740000000002 2024-05-08T18:31:17.563 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.563 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.564 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:17.564 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.495860+0000", 2024-05-08T18:31:17.564 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0017076159999999999 2024-05-08T18:31:17.564 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.564 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.564 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:17.564 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.495903+0000", 2024-05-08T18:31:17.564 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3009000000000001e-05 2024-05-08T18:31:17.564 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.564 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.564 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:17.564 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.495942+0000", 2024-05-08T18:31:17.565 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8726000000000002e-05 2024-05-08T18:31:17.565 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:17.565 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:17.565 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:17.565 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.565 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.565 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:17.565 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.486234+0000", 2024-05-08T18:31:17.565 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 109.979560913, 2024-05-08T18:31:17.565 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0099742340000000002, 2024-05-08T18:31:17.565 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:17.565 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:17.565 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:17.566 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:17.566 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:17.566 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:17.566 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 73 2024-05-08T18:31:17.566 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.566 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:17.566 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.566 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:17.566 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486234+0000", 2024-05-08T18:31:17.566 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:17.566 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.566 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.567 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:17.567 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486234+0000", 2024-05-08T18:31:17.567 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:17.567 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.567 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.567 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:17.567 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486235+0000", 2024-05-08T18:31:17.567 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.108e-06 2024-05-08T18:31:17.567 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.567 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.567 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:17.567 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486241+0000", 2024-05-08T18:31:17.567 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4e-06 2024-05-08T18:31:17.567 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.568 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.568 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:17.568 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486251+0000", 2024-05-08T18:31:17.568 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0209e-05 2024-05-08T18:31:17.568 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.568 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.568 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:17.568 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486260+0000", 2024-05-08T18:31:17.568 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2709999999999998e-06 2024-05-08T18:31:17.568 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.568 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.568 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:17.569 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.493294+0000", 2024-05-08T18:31:17.569 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0070341070000000004 2024-05-08T18:31:17.569 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.569 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.569 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:17.569 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.493370+0000", 2024-05-08T18:31:17.569 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5846999999999994e-05 2024-05-08T18:31:17.569 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.569 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.569 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:17.570 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.493479+0000", 2024-05-08T18:31:17.570 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010905500000000001 2024-05-08T18:31:17.570 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.570 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.570 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:17.570 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.495950+0000", 2024-05-08T18:31:17.570 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0024709749999999998 2024-05-08T18:31:17.570 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.570 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.570 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:17.570 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496023+0000", 2024-05-08T18:31:17.570 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3071999999999994e-05 2024-05-08T18:31:17.570 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.571 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.571 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:17.571 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496091+0000", 2024-05-08T18:31:17.571 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7646999999999998e-05 2024-05-08T18:31:17.571 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.571 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.571 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:17.571 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496208+0000", 2024-05-08T18:31:17.571 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000117543 2024-05-08T18:31:17.571 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:17.571 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:17.571 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:17.572 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.572 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.572 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:17.572 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.486276+0000", 2024-05-08T18:31:17.572 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 109.979518588, 2024-05-08T18:31:17.572 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010822577, 2024-05-08T18:31:17.572 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:17.572 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:17.572 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:17.572 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:17.572 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:17.572 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:17.572 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 74 2024-05-08T18:31:17.572 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.573 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:17.573 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.573 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:17.573 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486276+0000", 2024-05-08T18:31:17.573 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:17.573 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.573 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.573 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:17.573 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486276+0000", 2024-05-08T18:31:17.573 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:17.573 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.573 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.573 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:17.574 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486277+0000", 2024-05-08T18:31:17.574 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1699999999999997e-07 2024-05-08T18:31:17.574 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.574 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.574 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:17.574 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486282+0000", 2024-05-08T18:31:17.574 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0429999999999998e-06 2024-05-08T18:31:17.574 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.574 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.574 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:17.574 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486294+0000", 2024-05-08T18:31:17.574 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1717e-05 2024-05-08T18:31:17.574 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.575 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.575 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:17.575 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486303+0000", 2024-05-08T18:31:17.575 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.3999999999999998e-06 2024-05-08T18:31:17.575 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.575 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.575 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:17.575 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.494424+0000", 2024-05-08T18:31:17.575 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0081205960000000008 2024-05-08T18:31:17.575 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.575 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.575 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:17.575 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.494539+0000", 2024-05-08T18:31:17.575 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000115661 2024-05-08T18:31:17.576 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.576 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.576 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:17.576 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.494704+0000", 2024-05-08T18:31:17.576 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016422999999999999 2024-05-08T18:31:17.576 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.576 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.576 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:17.576 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496800+0000", 2024-05-08T18:31:17.576 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002096508 2024-05-08T18:31:17.576 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.576 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.576 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:17.577 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496889+0000", 2024-05-08T18:31:17.577 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8349000000000004e-05 2024-05-08T18:31:17.577 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.577 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.577 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:17.577 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496983+0000", 2024-05-08T18:31:17.577 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4882000000000004e-05 2024-05-08T18:31:17.577 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.577 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.577 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:17.577 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.497099+0000", 2024-05-08T18:31:17.577 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000115474 2024-05-08T18:31:17.577 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:17.577 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:17.578 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:17.578 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.578 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.578 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:17.578 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.486324+0000", 2024-05-08T18:31:17.578 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 109.979470568, 2024-05-08T18:31:17.578 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010949207000000001, 2024-05-08T18:31:17.578 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:17.578 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:17.578 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:17.578 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:17.578 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:17.579 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:17.579 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 75 2024-05-08T18:31:17.579 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.579 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:17.579 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.579 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:17.579 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486324+0000", 2024-05-08T18:31:17.579 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:17.579 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.579 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.579 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:17.579 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486324+0000", 2024-05-08T18:31:17.579 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:17.579 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.580 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.580 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:17.580 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486325+0000", 2024-05-08T18:31:17.580 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6200000000000006e-07 2024-05-08T18:31:17.580 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.580 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.580 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:17.580 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486439+0000", 2024-05-08T18:31:17.580 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000113391 2024-05-08T18:31:17.580 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.580 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.580 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:17.580 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486455+0000", 2024-05-08T18:31:17.580 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5823000000000001e-05 2024-05-08T18:31:17.581 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.581 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.581 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:17.581 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486465+0000", 2024-05-08T18:31:17.581 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0879999999999999e-05 2024-05-08T18:31:17.581 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.581 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.581 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:17.581 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.495149+0000", 2024-05-08T18:31:17.581 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0086833589999999999 2024-05-08T18:31:17.581 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.581 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.581 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:17.581 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.495213+0000", 2024-05-08T18:31:17.582 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4176000000000004e-05 2024-05-08T18:31:17.582 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.582 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.582 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:17.582 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.495350+0000", 2024-05-08T18:31:17.582 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013709099999999999 2024-05-08T18:31:17.582 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.582 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.582 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:17.582 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496809+0000", 2024-05-08T18:31:17.582 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001458953 2024-05-08T18:31:17.582 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.583 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.583 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:17.583 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.497199+0000", 2024-05-08T18:31:17.583 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00039045200000000001 2024-05-08T18:31:17.583 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.583 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.583 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:17.583 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.497241+0000", 2024-05-08T18:31:17.583 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1378999999999998e-05 2024-05-08T18:31:17.583 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.583 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.583 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:17.583 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.497274+0000", 2024-05-08T18:31:17.583 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2740999999999997e-05 2024-05-08T18:31:17.584 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:17.584 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:17.584 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:17.584 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.584 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.584 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:17.584 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.486483+0000", 2024-05-08T18:31:17.584 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 109.979312393, 2024-05-08T18:31:17.584 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011783448, 2024-05-08T18:31:17.584 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:17.584 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:17.585 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:17.585 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:17.585 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:17.585 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:17.585 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 76 2024-05-08T18:31:17.585 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.585 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:17.585 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.585 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:17.585 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486483+0000", 2024-05-08T18:31:17.585 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:17.585 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.585 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.586 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:17.586 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486483+0000", 2024-05-08T18:31:17.586 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:17.586 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.586 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.586 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:17.586 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486483+0000", 2024-05-08T18:31:17.586 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6599999999999995e-07 2024-05-08T18:31:17.586 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.586 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.586 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:17.586 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486491+0000", 2024-05-08T18:31:17.587 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.2520000000000002e-06 2024-05-08T18:31:17.587 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.587 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.587 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:17.587 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486500+0000", 2024-05-08T18:31:17.587 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4420000000000004e-06 2024-05-08T18:31:17.587 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.587 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.587 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:17.587 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486507+0000", 2024-05-08T18:31:17.587 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3549999999999999e-06 2024-05-08T18:31:17.587 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.587 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.588 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:17.588 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496319+0000", 2024-05-08T18:31:17.588 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0098120529999999994 2024-05-08T18:31:17.588 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.588 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.588 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:17.588 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496391+0000", 2024-05-08T18:31:17.588 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1433000000000005e-05 2024-05-08T18:31:17.588 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.588 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.588 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:17.588 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496508+0000", 2024-05-08T18:31:17.588 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000116778 2024-05-08T18:31:17.588 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.589 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.589 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:17.589 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.497284+0000", 2024-05-08T18:31:17.589 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00077609100000000002 2024-05-08T18:31:17.589 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.589 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.589 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:17.589 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.498204+0000", 2024-05-08T18:31:17.589 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00092027299999999999 2024-05-08T18:31:17.589 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.589 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.589 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:17.589 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.498240+0000", 2024-05-08T18:31:17.589 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5979999999999998e-05 2024-05-08T18:31:17.590 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.590 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.590 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:17.590 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.498266+0000", 2024-05-08T18:31:17.590 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6024999999999999e-05 2024-05-08T18:31:17.590 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:17.590 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:17.590 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:17.590 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.590 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.590 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:94 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:17.590 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.842580+0000", 2024-05-08T18:31:17.591 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 109.623215092, 2024-05-08T18:31:17.591 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0085315870000000002, 2024-05-08T18:31:17.591 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:17.591 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:17.591 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:17.591 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:17.591 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:17.591 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:17.591 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 94 2024-05-08T18:31:17.591 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.591 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:17.591 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.591 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:17.591 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.842580+0000", 2024-05-08T18:31:17.592 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:17.592 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.592 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.592 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:17.592 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.842580+0000", 2024-05-08T18:31:17.592 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:17.592 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.592 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.592 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:17.592 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.842581+0000", 2024-05-08T18:31:17.592 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.11e-06 2024-05-08T18:31:17.592 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.592 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.592 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:17.593 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.842587+0000", 2024-05-08T18:31:17.593 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2899999999999999e-06 2024-05-08T18:31:17.593 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.593 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.593 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:17.593 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.842597+0000", 2024-05-08T18:31:17.593 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.007e-05 2024-05-08T18:31:17.593 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.593 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.593 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:17.593 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.842605+0000", 2024-05-08T18:31:17.594 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1270000000000003e-06 2024-05-08T18:31:17.594 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.594 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.594 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:17.594 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.848358+0000", 2024-05-08T18:31:17.594 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0057525140000000002 2024-05-08T18:31:17.594 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.594 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.594 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:17.594 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.848481+0000", 2024-05-08T18:31:17.594 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000123239 2024-05-08T18:31:17.595 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.595 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.595 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:17.595 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.848695+0000", 2024-05-08T18:31:17.595 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000213387 2024-05-08T18:31:17.595 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.595 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.595 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:17.595 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.849781+0000", 2024-05-08T18:31:17.595 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010868 2024-05-08T18:31:17.595 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.596 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.596 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:17.596 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.850990+0000", 2024-05-08T18:31:17.596 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0012084769999999999 2024-05-08T18:31:17.596 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.596 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.596 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:17.596 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.851059+0000", 2024-05-08T18:31:17.596 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9130999999999999e-05 2024-05-08T18:31:17.596 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:17.596 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:17.596 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:17.596 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.851111+0000", 2024-05-08T18:31:17.596 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2441999999999997e-05 2024-05-08T18:31:17.596 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:17.597 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:17.597 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:17.597 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:17.597 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:17.597 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:31:17.598 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-08T18:31:17.599 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:31:17.594+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:31:17.699 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:31:17.694+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:31:17.763 INFO:teuthology.orchestra.run.smithi097.stderr:reweighted osd.7 to 1 (10000) 2024-05-08T18:31:17.776 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-08T18:31:17.783 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:17.783 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:31:17.783 INFO:teuthology.orchestra.run.smithi097.stdout: "num_ops": 0 2024-05-08T18:31:17.783 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:17.790 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-05-08T18:31:17.790 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T18:31:17.805 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-08T18:31:17.805 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:31:17.802+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:31:17.900 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:31:17.898+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:31:18.001 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:31:17.998+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:31:18.025 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:18.025 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:31:18.025 INFO:teuthology.orchestra.run.smithi097.stdout: "complaint_time": 30, 2024-05-08T18:31:18.025 INFO:teuthology.orchestra.run.smithi097.stdout: "num_blocked_ops": 0 2024-05-08T18:31:18.025 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:18.044 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-08T18:31:18.131 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:31:18.130+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:31:18.202 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:31:18.198+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:31:18.259 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:18.259 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2024-05-08T18:31:18.259 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2024-05-08T18:31:18.259 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-05-08T18:31:18.259 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.259 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4206.0:24 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'14, mlcod=16'9)", 2024-05-08T18:31:18.259 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:27.162224+0000", 2024-05-08T18:31:18.259 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 111.096023565, 2024-05-08T18:31:18.259 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032712890000000001, 2024-05-08T18:31:18.259 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:18.260 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:18.260 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:18.260 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:18.260 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.260 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:18.260 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162224+0000", 2024-05-08T18:31:18.260 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:18.260 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.260 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.260 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:18.260 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162224+0000", 2024-05-08T18:31:18.260 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:18.260 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.260 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.261 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:18.261 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162225+0000", 2024-05-08T18:31:18.261 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4899999999999999e-06 2024-05-08T18:31:18.261 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.261 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.261 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:18.261 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162306+0000", 2024-05-08T18:31:18.261 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.0589999999999999e-05 2024-05-08T18:31:18.261 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.261 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.261 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:18.261 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162332+0000", 2024-05-08T18:31:18.261 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5658999999999999e-05 2024-05-08T18:31:18.262 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.262 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.262 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:18.262 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162345+0000", 2024-05-08T18:31:18.262 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3512999999999999e-05 2024-05-08T18:31:18.262 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.262 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.262 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:18.262 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162465+0000", 2024-05-08T18:31:18.262 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000119577 2024-05-08T18:31:18.262 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.262 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.262 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:18.263 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162513+0000", 2024-05-08T18:31:18.263 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8773999999999998e-05 2024-05-08T18:31:18.263 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.263 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.263 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:18.263 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.165405+0000", 2024-05-08T18:31:18.263 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028919200000000001 2024-05-08T18:31:18.263 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.263 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.263 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:18.263 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.165495+0000", 2024-05-08T18:31:18.263 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9765999999999994e-05 2024-05-08T18:31:18.263 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:18.263 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:18.264 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:18.265 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.265 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.265 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4206.0:25 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'15, mlcod=16'10)", 2024-05-08T18:31:18.265 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:27.164793+0000", 2024-05-08T18:31:18.265 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 111.09345443700001, 2024-05-08T18:31:18.265 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032285249999999999, 2024-05-08T18:31:18.265 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:18.266 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:18.266 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:18.266 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:18.266 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.266 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:18.266 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164793+0000", 2024-05-08T18:31:18.266 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:18.266 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.266 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.266 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:18.266 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164793+0000", 2024-05-08T18:31:18.266 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:18.267 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.267 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.267 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:18.267 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164795+0000", 2024-05-08T18:31:18.267 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0999999999999998e-06 2024-05-08T18:31:18.267 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.267 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.267 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:18.267 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164811+0000", 2024-05-08T18:31:18.267 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5722999999999998e-05 2024-05-08T18:31:18.267 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.267 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.267 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:18.267 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164841+0000", 2024-05-08T18:31:18.268 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0355999999999999e-05 2024-05-08T18:31:18.268 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.268 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.268 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:18.268 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164861+0000", 2024-05-08T18:31:18.268 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9533000000000001e-05 2024-05-08T18:31:18.268 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.268 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.268 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:18.268 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164984+0000", 2024-05-08T18:31:18.268 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000123146 2024-05-08T18:31:18.268 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.268 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.268 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:18.269 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.165024+0000", 2024-05-08T18:31:18.269 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9690000000000001e-05 2024-05-08T18:31:18.269 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.269 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.269 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:18.269 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.167935+0000", 2024-05-08T18:31:18.269 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0029113300000000002 2024-05-08T18:31:18.269 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.269 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.269 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:18.269 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.168021+0000", 2024-05-08T18:31:18.269 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6646999999999999e-05 2024-05-08T18:31:18.269 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:18.269 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:18.270 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:18.270 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.270 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.270 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:31:18.270 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:48.674737+0000", 2024-05-08T18:31:18.270 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 89.583510519000001, 2024-05-08T18:31:18.270 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0035019780000000002, 2024-05-08T18:31:18.270 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:18.270 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:18.270 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:18.270 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:18.270 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:18.270 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:18.271 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 60 2024-05-08T18:31:18.271 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.271 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:18.271 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.271 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:18.271 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674737+0000", 2024-05-08T18:31:18.271 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:18.271 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.271 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.271 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:18.271 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674737+0000", 2024-05-08T18:31:18.271 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:18.271 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.271 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.272 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:18.272 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674740+0000", 2024-05-08T18:31:18.272 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.36e-06 2024-05-08T18:31:18.272 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.272 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.272 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:18.272 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674753+0000", 2024-05-08T18:31:18.272 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3151e-05 2024-05-08T18:31:18.272 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.272 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.272 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:18.272 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674789+0000", 2024-05-08T18:31:18.272 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5929000000000001e-05 2024-05-08T18:31:18.272 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.273 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.273 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:18.273 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674813+0000", 2024-05-08T18:31:18.273 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3325000000000001e-05 2024-05-08T18:31:18.273 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.273 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.273 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:18.273 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674981+0000", 2024-05-08T18:31:18.273 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016879899999999999 2024-05-08T18:31:18.273 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.273 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.273 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:18.273 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.675304+0000", 2024-05-08T18:31:18.273 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00032214400000000001 2024-05-08T18:31:18.274 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.274 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.274 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-05-08T18:31:18.274 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.675639+0000", 2024-05-08T18:31:18.274 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00033494699999999999 2024-05-08T18:31:18.274 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.274 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.274 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:18.274 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.676901+0000", 2024-05-08T18:31:18.274 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001262167 2024-05-08T18:31:18.274 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.274 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.274 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:18.274 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678078+0000", 2024-05-08T18:31:18.275 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001177588 2024-05-08T18:31:18.275 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.275 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.275 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:18.275 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678171+0000", 2024-05-08T18:31:18.275 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.2331999999999996e-05 2024-05-08T18:31:18.275 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.275 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.275 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:18.275 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678239+0000", 2024-05-08T18:31:18.275 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8236000000000002e-05 2024-05-08T18:31:18.275 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:18.275 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:18.276 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:18.276 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.276 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.276 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:61 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94069412632064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:31:18.276 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:48.678410+0000", 2024-05-08T18:31:18.276 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 89.579837127000005, 2024-05-08T18:31:18.276 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0026001800000000001, 2024-05-08T18:31:18.276 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:18.276 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:18.276 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:18.276 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:18.276 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:18.276 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:18.276 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 61 2024-05-08T18:31:18.277 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.277 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:18.277 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.277 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:18.277 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678410+0000", 2024-05-08T18:31:18.277 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:18.277 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.277 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.277 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:18.277 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678410+0000", 2024-05-08T18:31:18.277 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:18.277 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.277 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.278 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:18.278 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678413+0000", 2024-05-08T18:31:18.278 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.34e-06 2024-05-08T18:31:18.278 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.278 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.278 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:18.278 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678421+0000", 2024-05-08T18:31:18.278 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6910000000000003e-06 2024-05-08T18:31:18.278 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.278 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.278 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:18.278 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678447+0000", 2024-05-08T18:31:18.278 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6010999999999999e-05 2024-05-08T18:31:18.278 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.279 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.279 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:18.279 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678461+0000", 2024-05-08T18:31:18.279 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3900000000000001e-05 2024-05-08T18:31:18.279 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.279 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.279 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:18.279 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678560+0000", 2024-05-08T18:31:18.279 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.8834999999999998e-05 2024-05-08T18:31:18.279 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.279 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.279 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:18.279 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678704+0000", 2024-05-08T18:31:18.279 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000143769 2024-05-08T18:31:18.280 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.280 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.280 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-05-08T18:31:18.280 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678942+0000", 2024-05-08T18:31:18.280 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023861800000000001 2024-05-08T18:31:18.280 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.280 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.280 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:18.280 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.680269+0000", 2024-05-08T18:31:18.280 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001326484 2024-05-08T18:31:18.280 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.280 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.280 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:18.280 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.680823+0000", 2024-05-08T18:31:18.281 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00055455900000000004 2024-05-08T18:31:18.281 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.281 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.281 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:18.281 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.680908+0000", 2024-05-08T18:31:18.281 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.4073999999999995e-05 2024-05-08T18:31:18.281 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.281 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.281 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:18.281 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.681010+0000", 2024-05-08T18:31:18.281 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010289900000000001 2024-05-08T18:31:18.281 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:18.281 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:18.282 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:18.282 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.282 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.282 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:31:18.282 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.671896+0000", 2024-05-08T18:31:18.282 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 86.586351242000006, 2024-05-08T18:31:18.282 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032352349999999999, 2024-05-08T18:31:18.282 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:18.282 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:18.282 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:18.282 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:18.282 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:18.282 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:18.283 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 206 2024-05-08T18:31:18.283 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.283 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:18.283 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.283 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:18.283 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671896+0000", 2024-05-08T18:31:18.283 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:18.283 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.283 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.283 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:18.283 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671896+0000", 2024-05-08T18:31:18.283 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:18.283 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.283 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.284 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:18.284 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671901+0000", 2024-05-08T18:31:18.284 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.763e-06 2024-05-08T18:31:18.284 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.284 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.284 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:18.284 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671920+0000", 2024-05-08T18:31:18.284 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9403e-05 2024-05-08T18:31:18.284 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.284 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.284 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:18.284 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671969+0000", 2024-05-08T18:31:18.284 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8343000000000001e-05 2024-05-08T18:31:18.284 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.285 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.285 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:18.285 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671996+0000", 2024-05-08T18:31:18.285 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7307000000000001e-05 2024-05-08T18:31:18.285 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.285 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.285 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:18.285 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.672149+0000", 2024-05-08T18:31:18.285 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015336500000000001 2024-05-08T18:31:18.285 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.285 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.285 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:18.285 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.672393+0000", 2024-05-08T18:31:18.285 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024380800000000001 2024-05-08T18:31:18.286 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.286 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.286 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-05-08T18:31:18.286 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.672838+0000", 2024-05-08T18:31:18.286 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00044472700000000001 2024-05-08T18:31:18.286 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.286 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.286 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:18.286 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.674218+0000", 2024-05-08T18:31:18.286 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001380243 2024-05-08T18:31:18.286 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.286 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.286 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:18.287 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.674963+0000", 2024-05-08T18:31:18.287 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00074534999999999998 2024-05-08T18:31:18.287 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.287 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.287 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:18.287 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675057+0000", 2024-05-08T18:31:18.287 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.3633000000000003e-05 2024-05-08T18:31:18.287 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.287 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.287 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:18.287 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675131+0000", 2024-05-08T18:31:18.287 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.4293000000000002e-05 2024-05-08T18:31:18.287 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:18.287 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:18.287 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:18.288 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.288 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.288 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:18.288 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.694194+0000", 2024-05-08T18:31:18.288 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 86.564053844, 2024-05-08T18:31:18.288 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0087385129999999998, 2024-05-08T18:31:18.288 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:18.288 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:18.288 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:18.288 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:18.288 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:18.288 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:18.288 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 210 2024-05-08T18:31:18.289 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.289 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:18.289 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.289 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:18.289 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694194+0000", 2024-05-08T18:31:18.289 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:18.289 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.289 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.289 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:18.289 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694194+0000", 2024-05-08T18:31:18.289 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:18.289 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.289 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.290 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:18.290 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694196+0000", 2024-05-08T18:31:18.290 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6299999999999998e-06 2024-05-08T18:31:18.290 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.290 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.290 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:18.290 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694208+0000", 2024-05-08T18:31:18.290 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.187e-05 2024-05-08T18:31:18.290 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.290 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.290 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:18.290 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694240+0000", 2024-05-08T18:31:18.290 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1673e-05 2024-05-08T18:31:18.291 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.291 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.291 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:18.291 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694255+0000", 2024-05-08T18:31:18.291 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5573000000000002e-05 2024-05-08T18:31:18.291 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.291 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.291 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:18.291 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694394+0000", 2024-05-08T18:31:18.291 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000138536 2024-05-08T18:31:18.291 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.291 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.291 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-05-08T18:31:18.291 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694405+0000", 2024-05-08T18:31:18.292 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0883000000000001e-05 2024-05-08T18:31:18.292 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.292 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.292 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:18.292 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.699491+0000", 2024-05-08T18:31:18.292 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0050861939999999996 2024-05-08T18:31:18.292 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.292 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.292 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:18.292 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.699829+0000", 2024-05-08T18:31:18.292 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000338191 2024-05-08T18:31:18.292 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.292 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.292 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:18.293 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.700504+0000", 2024-05-08T18:31:18.293 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000674481 2024-05-08T18:31:18.293 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.293 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.293 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:18.293 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.702152+0000", 2024-05-08T18:31:18.293 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0016487450000000001 2024-05-08T18:31:18.293 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.293 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.293 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:18.293 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.702792+0000", 2024-05-08T18:31:18.293 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00063962800000000005 2024-05-08T18:31:18.293 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.294 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.294 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:18.294 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.702874+0000", 2024-05-08T18:31:18.294 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.2091999999999999e-05 2024-05-08T18:31:18.294 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.294 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.294 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:18.294 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.702932+0000", 2024-05-08T18:31:18.294 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8016999999999997e-05 2024-05-08T18:31:18.294 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:18.294 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:18.294 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:18.294 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.294 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.295 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:18.295 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.728239+0000", 2024-05-08T18:31:18.295 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 86.530007983000004, 2024-05-08T18:31:18.295 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0035376119999999999, 2024-05-08T18:31:18.295 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:18.295 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:18.295 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:18.295 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:18.295 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:18.295 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:18.295 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 218 2024-05-08T18:31:18.295 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.295 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:18.295 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.296 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:18.296 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728239+0000", 2024-05-08T18:31:18.296 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:18.296 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.296 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.296 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:18.296 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728239+0000", 2024-05-08T18:31:18.296 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:18.296 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.296 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.296 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:18.296 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728242+0000", 2024-05-08T18:31:18.296 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0130000000000002e-06 2024-05-08T18:31:18.296 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.296 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.297 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:18.297 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728254+0000", 2024-05-08T18:31:18.297 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.172e-05 2024-05-08T18:31:18.297 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.297 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.297 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:18.297 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728285+0000", 2024-05-08T18:31:18.297 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0703000000000001e-05 2024-05-08T18:31:18.297 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.297 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.297 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:18.297 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728301+0000", 2024-05-08T18:31:18.297 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5656999999999999e-05 2024-05-08T18:31:18.297 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.298 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.298 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:18.298 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728460+0000", 2024-05-08T18:31:18.298 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015934200000000001 2024-05-08T18:31:18.298 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.298 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.298 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:18.298 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728803+0000", 2024-05-08T18:31:18.298 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00034267400000000001 2024-05-08T18:31:18.298 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.298 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.298 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:18.298 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.729485+0000", 2024-05-08T18:31:18.298 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00068206799999999998 2024-05-08T18:31:18.299 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.299 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.299 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:18.299 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731218+0000", 2024-05-08T18:31:18.299 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0017332630000000001 2024-05-08T18:31:18.299 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.299 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.299 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:18.299 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731615+0000", 2024-05-08T18:31:18.299 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00039671699999999999 2024-05-08T18:31:18.299 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.299 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.299 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:18.299 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731709+0000", 2024-05-08T18:31:18.300 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.4740000000000004e-05 2024-05-08T18:31:18.300 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.300 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.300 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:18.300 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731777+0000", 2024-05-08T18:31:18.300 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7714999999999998e-05 2024-05-08T18:31:18.300 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:18.300 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:18.300 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:18.300 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.300 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.300 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:18.300 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.743331+0000", 2024-05-08T18:31:18.300 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 86.514915999999999, 2024-05-08T18:31:18.301 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031193229999999998, 2024-05-08T18:31:18.301 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:18.301 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:18.301 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:18.301 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:18.301 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:18.301 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:18.301 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 222 2024-05-08T18:31:18.301 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.301 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:18.301 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.301 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:18.301 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743331+0000", 2024-05-08T18:31:18.301 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:18.301 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.302 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.302 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:18.302 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743331+0000", 2024-05-08T18:31:18.302 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:18.302 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.302 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.302 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:18.302 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743334+0000", 2024-05-08T18:31:18.302 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2900000000000001e-06 2024-05-08T18:31:18.302 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.302 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.302 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:18.302 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743345+0000", 2024-05-08T18:31:18.303 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0947e-05 2024-05-08T18:31:18.303 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.303 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.303 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:18.303 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743375+0000", 2024-05-08T18:31:18.303 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0298999999999999e-05 2024-05-08T18:31:18.303 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.303 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.303 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:18.303 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743390+0000", 2024-05-08T18:31:18.303 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4606999999999999e-05 2024-05-08T18:31:18.303 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.303 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.303 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:18.303 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743524+0000", 2024-05-08T18:31:18.304 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000134105 2024-05-08T18:31:18.304 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.304 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.304 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:18.304 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743738+0000", 2024-05-08T18:31:18.304 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000214222 2024-05-08T18:31:18.304 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.304 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.304 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:18.304 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.744159+0000", 2024-05-08T18:31:18.304 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00042102300000000002 2024-05-08T18:31:18.304 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.304 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.304 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:18.305 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.745399+0000", 2024-05-08T18:31:18.305 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012400309999999999 2024-05-08T18:31:18.305 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.305 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.305 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:18.305 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.746296+0000", 2024-05-08T18:31:18.305 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00089682 2024-05-08T18:31:18.305 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.305 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.305 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:18.305 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.746385+0000", 2024-05-08T18:31:18.305 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9289000000000005e-05 2024-05-08T18:31:18.305 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.306 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.306 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:18.306 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.746451+0000", 2024-05-08T18:31:18.306 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5690000000000003e-05 2024-05-08T18:31:18.306 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:18.306 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:18.306 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:18.306 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.306 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.306 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:18.306 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.772338+0000", 2024-05-08T18:31:18.306 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 86.485909800000002, 2024-05-08T18:31:18.306 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0035084059999999999, 2024-05-08T18:31:18.307 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:18.307 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:18.307 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:18.307 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:18.307 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:18.307 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:18.307 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 230 2024-05-08T18:31:18.307 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.307 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:18.307 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.307 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:18.307 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772338+0000", 2024-05-08T18:31:18.307 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:18.307 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.308 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.308 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:18.308 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772338+0000", 2024-05-08T18:31:18.308 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:18.308 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.308 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.308 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:18.308 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772340+0000", 2024-05-08T18:31:18.308 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3460000000000001e-06 2024-05-08T18:31:18.308 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.308 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.308 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:18.308 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772352+0000", 2024-05-08T18:31:18.308 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2284e-05 2024-05-08T18:31:18.308 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.309 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.309 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:18.309 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772382+0000", 2024-05-08T18:31:18.309 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0083e-05 2024-05-08T18:31:18.309 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.309 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.309 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:18.309 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772397+0000", 2024-05-08T18:31:18.309 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4963000000000001e-05 2024-05-08T18:31:18.309 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.309 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.309 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:18.309 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772508+0000", 2024-05-08T18:31:18.309 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000110402 2024-05-08T18:31:18.310 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.310 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.310 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:18.310 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772742+0000", 2024-05-08T18:31:18.310 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023428899999999999 2024-05-08T18:31:18.310 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.310 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.310 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:18.310 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.773183+0000", 2024-05-08T18:31:18.310 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00044107899999999998 2024-05-08T18:31:18.310 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.310 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.310 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:18.311 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.774488+0000", 2024-05-08T18:31:18.311 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0013053940000000001 2024-05-08T18:31:18.311 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.311 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.311 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:18.311 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.775689+0000", 2024-05-08T18:31:18.311 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012004699999999999 2024-05-08T18:31:18.311 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.311 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.311 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:18.311 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.775777+0000", 2024-05-08T18:31:18.311 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8483e-05 2024-05-08T18:31:18.311 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.311 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.312 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:18.312 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.775846+0000", 2024-05-08T18:31:18.312 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8613000000000002e-05 2024-05-08T18:31:18.312 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:18.312 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:18.312 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:18.312 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.312 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.312 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:18.312 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.790921+0000", 2024-05-08T18:31:18.312 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 86.467326454000002, 2024-05-08T18:31:18.312 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003116869, 2024-05-08T18:31:18.312 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:18.312 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:18.313 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:18.313 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:18.313 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:18.313 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:18.313 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 235 2024-05-08T18:31:18.313 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.313 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:18.313 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.313 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:18.313 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790921+0000", 2024-05-08T18:31:18.313 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:18.313 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.313 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.313 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:18.314 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790921+0000", 2024-05-08T18:31:18.314 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:18.314 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.314 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.314 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:18.314 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790923+0000", 2024-05-08T18:31:18.314 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3199999999999998e-06 2024-05-08T18:31:18.314 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.314 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.314 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:18.314 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790934+0000", 2024-05-08T18:31:18.314 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.117e-05 2024-05-08T18:31:18.314 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.314 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.315 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:18.315 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790965+0000", 2024-05-08T18:31:18.315 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0392999999999999e-05 2024-05-08T18:31:18.315 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.315 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.315 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:18.315 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790981+0000", 2024-05-08T18:31:18.315 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5699999999999999e-05 2024-05-08T18:31:18.315 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.315 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.315 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:18.315 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.791093+0000", 2024-05-08T18:31:18.315 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000112062 2024-05-08T18:31:18.315 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.316 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.316 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:18.316 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.791324+0000", 2024-05-08T18:31:18.316 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023142200000000001 2024-05-08T18:31:18.316 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.316 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.316 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:18.316 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.791761+0000", 2024-05-08T18:31:18.316 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00043669999999999999 2024-05-08T18:31:18.316 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.316 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.316 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:18.317 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.792996+0000", 2024-05-08T18:31:18.317 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001235713 2024-05-08T18:31:18.317 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.317 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.317 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:18.317 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.793850+0000", 2024-05-08T18:31:18.317 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00085392400000000005 2024-05-08T18:31:18.317 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.317 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.317 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:18.317 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.793971+0000", 2024-05-08T18:31:18.317 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000120516 2024-05-08T18:31:18.317 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.317 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.317 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:18.318 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794038+0000", 2024-05-08T18:31:18.318 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6948999999999999e-05 2024-05-08T18:31:18.318 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:18.318 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:18.318 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:18.318 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.318 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.318 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:349 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:18.318 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.817315+0000", 2024-05-08T18:31:18.318 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 86.440932583000006, 2024-05-08T18:31:18.318 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0036888580000000002, 2024-05-08T18:31:18.318 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:18.319 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:18.319 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:18.319 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:18.319 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:18.319 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:18.319 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 349 2024-05-08T18:31:18.319 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.319 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:18.319 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.319 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:18.319 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817315+0000", 2024-05-08T18:31:18.319 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:18.319 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.319 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.320 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:18.320 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817315+0000", 2024-05-08T18:31:18.320 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:18.320 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.320 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.320 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:18.320 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817316+0000", 2024-05-08T18:31:18.320 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3370000000000001e-06 2024-05-08T18:31:18.320 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.321 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.321 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:18.321 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817323+0000", 2024-05-08T18:31:18.321 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.4300000000000003e-06 2024-05-08T18:31:18.321 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.321 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.321 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:18.321 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817337+0000", 2024-05-08T18:31:18.321 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4025999999999999e-05 2024-05-08T18:31:18.321 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.321 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.321 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:18.321 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817345+0000", 2024-05-08T18:31:18.321 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5669999999999995e-06 2024-05-08T18:31:18.322 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.322 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.322 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:18.322 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817407+0000", 2024-05-08T18:31:18.322 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1882000000000001e-05 2024-05-08T18:31:18.322 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.322 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.322 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:18.322 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817508+0000", 2024-05-08T18:31:18.322 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000100585 2024-05-08T18:31:18.322 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.322 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.322 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:18.323 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817673+0000", 2024-05-08T18:31:18.323 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000165802 2024-05-08T18:31:18.323 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.323 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.323 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:18.323 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.818715+0000", 2024-05-08T18:31:18.323 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0010417720000000001 2024-05-08T18:31:18.323 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.323 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.323 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:18.323 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.820892+0000", 2024-05-08T18:31:18.323 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0021771859999999998 2024-05-08T18:31:18.323 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.323 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.324 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:18.324 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.820950+0000", 2024-05-08T18:31:18.324 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7636000000000002e-05 2024-05-08T18:31:18.324 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.324 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.324 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:18.324 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.821004+0000", 2024-05-08T18:31:18.324 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3634999999999997e-05 2024-05-08T18:31:18.324 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:18.324 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:18.324 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:18.324 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.324 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.324 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:406 6.16 6:6dc3b799:reshard::reshard.0000000006:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:18.325 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.840465+0000", 2024-05-08T18:31:18.325 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 86.417782416999998, 2024-05-08T18:31:18.325 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003613032, 2024-05-08T18:31:18.325 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:18.325 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:18.325 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:18.325 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:18.325 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:18.325 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:18.325 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 406 2024-05-08T18:31:18.325 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.325 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:18.325 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.325 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:18.326 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840465+0000", 2024-05-08T18:31:18.326 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:18.326 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.326 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.326 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:18.326 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840465+0000", 2024-05-08T18:31:18.326 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:18.326 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.326 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.326 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:18.326 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840466+0000", 2024-05-08T18:31:18.327 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7499999999999999e-07 2024-05-08T18:31:18.327 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.327 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.327 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:18.327 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840471+0000", 2024-05-08T18:31:18.327 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9699999999999998e-06 2024-05-08T18:31:18.327 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.327 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.327 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:18.327 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840484+0000", 2024-05-08T18:31:18.327 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2717999999999999e-05 2024-05-08T18:31:18.328 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.328 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.328 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:18.328 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840490+0000", 2024-05-08T18:31:18.328 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.472e-06 2024-05-08T18:31:18.328 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.328 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.328 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:18.328 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840536+0000", 2024-05-08T18:31:18.328 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6409000000000002e-05 2024-05-08T18:31:18.328 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.328 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.328 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:18.328 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840591+0000", 2024-05-08T18:31:18.329 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4911000000000003e-05 2024-05-08T18:31:18.329 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.329 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.329 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:18.329 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840745+0000", 2024-05-08T18:31:18.329 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015394900000000001 2024-05-08T18:31:18.329 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.329 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.329 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:18.329 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.841269+0000", 2024-05-08T18:31:18.329 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00052347299999999999 2024-05-08T18:31:18.329 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.329 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.330 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:18.330 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.843997+0000", 2024-05-08T18:31:18.330 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0027285080000000001 2024-05-08T18:31:18.330 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.330 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.330 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:18.330 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844033+0000", 2024-05-08T18:31:18.330 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6038000000000003e-05 2024-05-08T18:31:18.330 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.330 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.330 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:18.330 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844078+0000", 2024-05-08T18:31:18.330 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4709000000000002e-05 2024-05-08T18:31:18.331 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:18.331 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:18.331 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:18.331 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.331 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.331 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:413 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:18.331 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.844187+0000", 2024-05-08T18:31:18.331 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 86.414060840000005, 2024-05-08T18:31:18.331 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0024835069999999998, 2024-05-08T18:31:18.331 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:18.331 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:18.331 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:18.332 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:18.332 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:18.332 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:18.332 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 413 2024-05-08T18:31:18.332 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.332 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:18.332 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.332 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:18.332 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844187+0000", 2024-05-08T18:31:18.332 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:18.332 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.332 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.332 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:18.332 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844187+0000", 2024-05-08T18:31:18.332 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:18.333 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.333 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.333 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:18.333 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844187+0000", 2024-05-08T18:31:18.333 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9999999999999996e-07 2024-05-08T18:31:18.333 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.333 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.333 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:18.333 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844192+0000", 2024-05-08T18:31:18.333 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7899999999999999e-06 2024-05-08T18:31:18.333 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.333 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.333 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:18.333 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844203+0000", 2024-05-08T18:31:18.334 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1002000000000001e-05 2024-05-08T18:31:18.334 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.334 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.334 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:18.334 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844209+0000", 2024-05-08T18:31:18.334 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6570000000000002e-06 2024-05-08T18:31:18.334 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.334 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.334 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:18.334 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844270+0000", 2024-05-08T18:31:18.334 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0810999999999998e-05 2024-05-08T18:31:18.334 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.334 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.334 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:18.335 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844419+0000", 2024-05-08T18:31:18.335 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000149097 2024-05-08T18:31:18.335 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.335 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.335 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:18.335 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844611+0000", 2024-05-08T18:31:18.335 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00019247900000000001 2024-05-08T18:31:18.335 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.335 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.335 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:18.335 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.845287+0000", 2024-05-08T18:31:18.335 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00067526000000000001 2024-05-08T18:31:18.335 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.336 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.336 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:18.336 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.846609+0000", 2024-05-08T18:31:18.336 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001322124 2024-05-08T18:31:18.336 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.336 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.336 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:18.336 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.846642+0000", 2024-05-08T18:31:18.336 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3654e-05 2024-05-08T18:31:18.336 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.336 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.336 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:18.336 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.846670+0000", 2024-05-08T18:31:18.336 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7733e-05 2024-05-08T18:31:18.337 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:18.337 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:18.337 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:18.337 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.337 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.337 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:420 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:18.337 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.847096+0000", 2024-05-08T18:31:18.337 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 86.411151545999999, 2024-05-08T18:31:18.337 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0026261589999999999, 2024-05-08T18:31:18.337 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:18.337 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:18.337 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:18.337 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:18.337 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:18.338 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:18.338 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 420 2024-05-08T18:31:18.338 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.338 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:18.338 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.338 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:18.338 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847096+0000", 2024-05-08T18:31:18.338 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:18.338 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.338 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.338 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:18.338 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847096+0000", 2024-05-08T18:31:18.338 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:18.338 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.339 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.339 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:18.339 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847097+0000", 2024-05-08T18:31:18.339 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.5499999999999996e-07 2024-05-08T18:31:18.339 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.339 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.339 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:18.339 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847103+0000", 2024-05-08T18:31:18.339 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8969999999999996e-06 2024-05-08T18:31:18.339 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.339 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.340 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:18.340 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847114+0000", 2024-05-08T18:31:18.340 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1549000000000001e-05 2024-05-08T18:31:18.340 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.340 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.340 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:18.340 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847120+0000", 2024-05-08T18:31:18.340 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5509999999999999e-06 2024-05-08T18:31:18.340 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.340 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.340 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:18.341 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847166+0000", 2024-05-08T18:31:18.341 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6683e-05 2024-05-08T18:31:18.341 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.341 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.341 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:18.341 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847213+0000", 2024-05-08T18:31:18.341 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6659000000000002e-05 2024-05-08T18:31:18.341 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.341 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.341 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:18.341 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847315+0000", 2024-05-08T18:31:18.341 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000102336 2024-05-08T18:31:18.341 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.342 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.342 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:18.342 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847840+0000", 2024-05-08T18:31:18.342 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00052475000000000004 2024-05-08T18:31:18.342 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.342 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.342 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:18.342 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.849660+0000", 2024-05-08T18:31:18.342 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001819563 2024-05-08T18:31:18.342 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.342 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.342 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:18.342 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.849695+0000", 2024-05-08T18:31:18.342 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4761000000000001e-05 2024-05-08T18:31:18.343 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.343 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.343 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:18.343 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.849722+0000", 2024-05-08T18:31:18.343 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7455000000000001e-05 2024-05-08T18:31:18.343 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:18.343 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:18.343 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:18.343 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.343 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.343 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:532 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:18.343 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.908603+0000", 2024-05-08T18:31:18.343 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 86.349643995999998, 2024-05-08T18:31:18.343 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0038838950000000001, 2024-05-08T18:31:18.344 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:18.344 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:18.344 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:18.344 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:18.344 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:18.344 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:18.344 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 532 2024-05-08T18:31:18.344 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.344 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:18.344 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.344 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:18.344 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908603+0000", 2024-05-08T18:31:18.344 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:18.344 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.345 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.345 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:18.345 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908603+0000", 2024-05-08T18:31:18.345 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:18.345 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.345 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.345 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:18.345 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908605+0000", 2024-05-08T18:31:18.345 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1179999999999999e-06 2024-05-08T18:31:18.345 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.345 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.345 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:18.345 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908608+0000", 2024-05-08T18:31:18.346 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7419999999999999e-06 2024-05-08T18:31:18.346 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.346 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.346 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:18.346 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908618+0000", 2024-05-08T18:31:18.346 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.6889999999999999e-06 2024-05-08T18:31:18.346 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.346 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.346 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:18.346 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908625+0000", 2024-05-08T18:31:18.346 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1300000000000003e-06 2024-05-08T18:31:18.346 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.346 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.347 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:18.347 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908669+0000", 2024-05-08T18:31:18.347 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3832000000000003e-05 2024-05-08T18:31:18.347 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.347 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.347 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:18.347 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908724+0000", 2024-05-08T18:31:18.347 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5222000000000001e-05 2024-05-08T18:31:18.347 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.347 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.347 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:18.347 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908854+0000", 2024-05-08T18:31:18.347 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012953500000000001 2024-05-08T18:31:18.347 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.348 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.348 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:18.348 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.909511+0000", 2024-05-08T18:31:18.348 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00065768399999999996 2024-05-08T18:31:18.348 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.348 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.348 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:18.348 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912426+0000", 2024-05-08T18:31:18.348 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0029146599999999999 2024-05-08T18:31:18.348 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.348 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.348 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:18.348 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912461+0000", 2024-05-08T18:31:18.348 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4934999999999997e-05 2024-05-08T18:31:18.348 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.349 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.349 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:18.349 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912487+0000", 2024-05-08T18:31:18.349 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6347999999999999e-05 2024-05-08T18:31:18.349 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:18.349 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:18.349 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:18.349 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.349 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.349 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:534 6.9 6:9268b73e:::obj_delete_at_hint.0000000019:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:18.349 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.910153+0000", 2024-05-08T18:31:18.349 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 86.348094539000002, 2024-05-08T18:31:18.349 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0051089680000000002, 2024-05-08T18:31:18.349 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:18.350 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:18.350 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:18.350 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:18.350 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:18.350 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:18.350 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 534 2024-05-08T18:31:18.350 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.350 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:18.350 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.350 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:18.350 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910153+0000", 2024-05-08T18:31:18.350 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:18.350 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.351 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.351 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:18.351 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910153+0000", 2024-05-08T18:31:18.351 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:18.351 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.351 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.351 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:18.351 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910154+0000", 2024-05-08T18:31:18.351 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1039999999999999e-06 2024-05-08T18:31:18.351 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.351 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.351 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:18.351 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910158+0000", 2024-05-08T18:31:18.351 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7400000000000002e-06 2024-05-08T18:31:18.352 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.352 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.352 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:18.352 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910167+0000", 2024-05-08T18:31:18.352 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8880000000000003e-06 2024-05-08T18:31:18.352 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.352 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.352 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:18.352 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910173+0000", 2024-05-08T18:31:18.352 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.844e-06 2024-05-08T18:31:18.352 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.352 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.352 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:18.353 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910220+0000", 2024-05-08T18:31:18.353 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6582000000000002e-05 2024-05-08T18:31:18.353 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.353 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.353 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:18.353 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910287+0000", 2024-05-08T18:31:18.353 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7271e-05 2024-05-08T18:31:18.353 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.353 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.353 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:18.353 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910402+0000", 2024-05-08T18:31:18.353 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115127 2024-05-08T18:31:18.353 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.353 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.354 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:18.354 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910881+0000", 2024-05-08T18:31:18.354 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000479025 2024-05-08T18:31:18.354 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.354 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.354 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:18.354 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.915206+0000", 2024-05-08T18:31:18.354 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.004324357 2024-05-08T18:31:18.354 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.354 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.354 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:18.354 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.915237+0000", 2024-05-08T18:31:18.354 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1590000000000001e-05 2024-05-08T18:31:18.354 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.355 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.355 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:18.355 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.915262+0000", 2024-05-08T18:31:18.355 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.444e-05 2024-05-08T18:31:18.355 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:18.355 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:18.355 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:18.355 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.355 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.355 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:583 6.0 6:03bbb29a:::obj_delete_at_hint.0000000026:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:18.355 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.947199+0000", 2024-05-08T18:31:18.355 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 86.311048342000007, 2024-05-08T18:31:18.355 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0025081510000000001, 2024-05-08T18:31:18.356 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:18.356 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:18.356 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:18.356 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:18.356 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:18.356 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:18.356 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 583 2024-05-08T18:31:18.356 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.356 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:18.356 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.356 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:18.356 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947199+0000", 2024-05-08T18:31:18.356 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:18.356 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.356 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.357 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:18.357 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947199+0000", 2024-05-08T18:31:18.357 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:18.357 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.357 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.357 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:18.357 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947200+0000", 2024-05-08T18:31:18.357 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3799999999999997e-07 2024-05-08T18:31:18.357 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.357 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.357 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:18.357 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947207+0000", 2024-05-08T18:31:18.357 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2030000000000003e-06 2024-05-08T18:31:18.357 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.358 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.358 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:18.358 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947217+0000", 2024-05-08T18:31:18.358 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0138e-05 2024-05-08T18:31:18.358 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.358 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.358 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:18.358 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947224+0000", 2024-05-08T18:31:18.358 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5289999999999997e-06 2024-05-08T18:31:18.358 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.358 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.358 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:18.358 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.948039+0000", 2024-05-08T18:31:18.359 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00081500599999999996 2024-05-08T18:31:18.359 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.359 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.359 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:18.359 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.948230+0000", 2024-05-08T18:31:18.359 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000191838 2024-05-08T18:31:18.359 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.359 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.359 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:18.359 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.948606+0000", 2024-05-08T18:31:18.359 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00037547900000000001 2024-05-08T18:31:18.359 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.359 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.360 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:18.360 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.949406+0000", 2024-05-08T18:31:18.360 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000799674 2024-05-08T18:31:18.360 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.360 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.360 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:18.360 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.949630+0000", 2024-05-08T18:31:18.360 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00022474699999999999 2024-05-08T18:31:18.360 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.360 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.360 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:18.360 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.949664+0000", 2024-05-08T18:31:18.360 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3535999999999999e-05 2024-05-08T18:31:18.361 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.361 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.361 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:18.361 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.949707+0000", 2024-05-08T18:31:18.361 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3362999999999998e-05 2024-05-08T18:31:18.361 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:18.361 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:18.361 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:18.361 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.361 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.361 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:18.361 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.263796+0000", 2024-05-08T18:31:18.361 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 85.994451073999997, 2024-05-08T18:31:18.361 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0027788019999999999, 2024-05-08T18:31:18.362 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:18.362 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:18.362 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:18.362 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:18.362 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:18.362 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:18.362 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 811 2024-05-08T18:31:18.362 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.362 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:18.362 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.362 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:18.362 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263796+0000", 2024-05-08T18:31:18.362 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:18.363 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.363 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.363 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:18.363 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263796+0000", 2024-05-08T18:31:18.363 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:18.363 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.363 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.363 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:18.363 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263799+0000", 2024-05-08T18:31:18.363 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5569999999999998e-06 2024-05-08T18:31:18.363 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.363 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.363 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:18.363 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263812+0000", 2024-05-08T18:31:18.364 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3145999999999999e-05 2024-05-08T18:31:18.364 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.364 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.364 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:18.364 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263842+0000", 2024-05-08T18:31:18.364 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0193e-05 2024-05-08T18:31:18.364 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.364 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.364 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:18.364 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263860+0000", 2024-05-08T18:31:18.364 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7880000000000002e-05 2024-05-08T18:31:18.364 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.364 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.364 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:18.364 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263979+0000", 2024-05-08T18:31:18.365 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011919899999999999 2024-05-08T18:31:18.365 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.365 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.365 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:18.365 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.264222+0000", 2024-05-08T18:31:18.365 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024290800000000001 2024-05-08T18:31:18.365 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.365 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.365 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:18.365 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.264545+0000", 2024-05-08T18:31:18.365 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00032300200000000002 2024-05-08T18:31:18.365 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.365 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.365 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:18.366 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.265682+0000", 2024-05-08T18:31:18.366 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001136464 2024-05-08T18:31:18.366 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.366 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.366 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:18.366 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.266397+0000", 2024-05-08T18:31:18.366 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00071512799999999999 2024-05-08T18:31:18.366 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.366 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.366 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:18.366 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.266504+0000", 2024-05-08T18:31:18.366 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000107019 2024-05-08T18:31:18.366 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.367 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.367 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:18.367 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.266575+0000", 2024-05-08T18:31:18.367 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1305999999999998e-05 2024-05-08T18:31:18.367 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:18.367 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:18.367 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:18.367 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.367 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.367 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:18.367 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.445706+0000", 2024-05-08T18:31:18.367 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 85.812541358000004, 2024-05-08T18:31:18.367 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0026820630000000002, 2024-05-08T18:31:18.367 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:18.368 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:18.368 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:18.368 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:18.368 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:18.368 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:18.368 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 889 2024-05-08T18:31:18.368 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.368 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:18.368 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.368 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:18.368 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445706+0000", 2024-05-08T18:31:18.368 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:18.368 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.369 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.369 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:18.369 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445706+0000", 2024-05-08T18:31:18.369 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:18.369 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.369 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.369 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:18.369 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445709+0000", 2024-05-08T18:31:18.369 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0299999999999998e-06 2024-05-08T18:31:18.369 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.369 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.369 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:18.369 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445721+0000", 2024-05-08T18:31:18.369 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2366e-05 2024-05-08T18:31:18.370 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.370 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.370 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:18.370 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445752+0000", 2024-05-08T18:31:18.370 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0287e-05 2024-05-08T18:31:18.370 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.370 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.370 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:18.370 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445773+0000", 2024-05-08T18:31:18.370 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1367000000000001e-05 2024-05-08T18:31:18.370 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.370 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.370 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:18.371 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445892+0000", 2024-05-08T18:31:18.371 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000119311 2024-05-08T18:31:18.371 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.371 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.371 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:18.371 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.446158+0000", 2024-05-08T18:31:18.371 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000265441 2024-05-08T18:31:18.371 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.371 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.371 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:18.371 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.446465+0000", 2024-05-08T18:31:18.371 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00030754300000000002 2024-05-08T18:31:18.371 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.371 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.372 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:18.372 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.447511+0000", 2024-05-08T18:31:18.372 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001045975 2024-05-08T18:31:18.372 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.372 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.372 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:18.372 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.448171+0000", 2024-05-08T18:31:18.372 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00065971200000000002 2024-05-08T18:31:18.372 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.372 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.372 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:18.372 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.448273+0000", 2024-05-08T18:31:18.372 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000101592 2024-05-08T18:31:18.372 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.373 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.373 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:18.373 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.448388+0000", 2024-05-08T18:31:18.373 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115439 2024-05-08T18:31:18.373 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:18.373 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:18.373 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:18.373 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.373 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.373 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1020 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_add in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-05-08T18:31:18.373 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:30:21.842276+0000", 2024-05-08T18:31:18.373 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 56.415971816999999, 2024-05-08T18:31:18.373 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0025898760000000001, 2024-05-08T18:31:18.373 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:18.374 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:18.374 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:18.374 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:18.374 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:18.374 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:18.374 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1020 2024-05-08T18:31:18.374 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.374 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:18.374 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.374 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:18.374 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842276+0000", 2024-05-08T18:31:18.374 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:18.374 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.375 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.375 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:18.375 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842276+0000", 2024-05-08T18:31:18.375 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:18.375 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.375 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.375 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:18.375 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842278+0000", 2024-05-08T18:31:18.375 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6129999999999998e-06 2024-05-08T18:31:18.375 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.375 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.375 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:18.375 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842290+0000", 2024-05-08T18:31:18.375 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2187999999999999e-05 2024-05-08T18:31:18.376 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.376 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.376 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:18.376 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842319+0000", 2024-05-08T18:31:18.376 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8782e-05 2024-05-08T18:31:18.376 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.376 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.376 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:18.376 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842336+0000", 2024-05-08T18:31:18.376 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6826000000000001e-05 2024-05-08T18:31:18.376 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.376 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.376 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:18.376 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842450+0000", 2024-05-08T18:31:18.377 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000113829 2024-05-08T18:31:18.377 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.377 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.377 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:18.377 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842627+0000", 2024-05-08T18:31:18.377 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00017756599999999999 2024-05-08T18:31:18.377 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.377 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.377 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:18.377 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842794+0000", 2024-05-08T18:31:18.377 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000166866 2024-05-08T18:31:18.377 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.377 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.377 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:18.378 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.843540+0000", 2024-05-08T18:31:18.378 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00074611700000000003 2024-05-08T18:31:18.378 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.378 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.378 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:18.378 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.844762+0000", 2024-05-08T18:31:18.378 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012220309999999999 2024-05-08T18:31:18.378 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.378 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.378 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:18.378 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.844806+0000", 2024-05-08T18:31:18.378 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3414000000000001e-05 2024-05-08T18:31:18.378 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:18.378 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:18.379 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:18.379 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.844865+0000", 2024-05-08T18:31:18.379 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9644e-05 2024-05-08T18:31:18.379 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:18.379 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:18.379 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:18.379 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:18.379 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:18.379 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:18.381 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-08T18:31:18.385 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-05-08T18:31:18.388 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2024-05-08T18:31:18.390 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:31:18.378+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:31:18.402 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":121,"stamp":"2024-05-08T18:31:17.761948+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595683,"num_objects":195,"num_object_clones":0,"num_object_copies":390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":195,"num_whiteouts":0,"num_read":759,"num_read_kb":507,"num_write":530,"num_write_kb":1670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":482,"ondisk_log_size":482,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":232176,"kb_used_data":7660,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754742544,"statfs":{"total":773094113280,"available":772856365056,"internally_reserved":0,"allocated":7843840,"data_stored":4661542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":229756465},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.045231"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":105,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.262030+0000","last_change":"2024-05-08T18:29:40.574221+0000","last_active":"2024-05-08T18:31:16.262030+0000","last_peered":"2024-05-08T18:31:16.262030+0000","last_clean":"2024-05-08T18:31:16.262030+0000","last_became_active":"2024-05-08T18:29:40.573543+0000","last_became_peered":"2024-05-08T18:29:40.573543+0000","last_unstale":"2024-05-08T18:31:16.262030+0000","last_undegraded":"2024-05-08T18:31:16.262030+0000","last_fullsized":"2024-05-08T18:31:16.262030+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:57.223609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.631643+0000","last_change":"2024-05-08T18:29:42.563773+0000","last_active":"2024-05-08T18:31:15.631643+0000","last_peered":"2024-05-08T18:31:15.631643+0000","last_clean":"2024-05-08T18:31:15.631643+0000","last_became_active":"2024-05-08T18:29:42.561201+0000","last_became_peered":"2024-05-08T18:29:42.561201+0000","last_unstale":"2024-05-08T18:31:15.631643+0000","last_undegraded":"2024-05-08T18:31:15.631643+0000","last_fullsized":"2024-05-08T18:31:15.631643+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:55.055481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":102,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.723479+0000","last_change":"2024-05-08T18:29:40.549299+0000","last_active":"2024-05-08T18:31:13.723479+0000","last_peered":"2024-05-08T18:31:13.723479+0000","last_clean":"2024-05-08T18:31:13.723479+0000","last_became_active":"2024-05-08T18:29:40.548930+0000","last_became_peered":"2024-05-08T18:29:40.548930+0000","last_unstale":"2024-05-08T18:31:13.723479+0000","last_undegraded":"2024-05-08T18:31:13.723479+0000","last_fullsized":"2024-05-08T18:31:13.723479+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:06:36.198647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":101,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.261259+0000","last_change":"2024-05-08T18:29:42.572074+0000","last_active":"2024-05-08T18:31:16.261259+0000","last_peered":"2024-05-08T18:31:16.261259+0000","last_clean":"2024-05-08T18:31:16.261259+0000","last_became_active":"2024-05-08T18:29:42.571344+0000","last_became_peered":"2024-05-08T18:29:42.571344+0000","last_unstale":"2024-05-08T18:31:16.261259+0000","last_undegraded":"2024-05-08T18:31:16.261259+0000","last_fullsized":"2024-05-08T18:31:16.261259+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:36.890277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":102,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.723035+0000","last_change":"2024-05-08T18:29:40.539048+0000","last_active":"2024-05-08T18:31:13.723035+0000","last_peered":"2024-05-08T18:31:13.723035+0000","last_clean":"2024-05-08T18:31:13.723035+0000","last_became_active":"2024-05-08T18:29:40.538458+0000","last_became_peered":"2024-05-08T18:29:40.538458+0000","last_unstale":"2024-05-08T18:31:13.723035+0000","last_undegraded":"2024-05-08T18:31:13.723035+0000","last_fullsized":"2024-05-08T18:31:13.723035+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:36:37.796095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":102,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.743519+0000","last_change":"2024-05-08T18:29:42.569718+0000","last_active":"2024-05-08T18:31:15.743519+0000","last_peered":"2024-05-08T18:31:15.743519+0000","last_clean":"2024-05-08T18:31:15.743519+0000","last_became_active":"2024-05-08T18:29:42.569026+0000","last_became_peered":"2024-05-08T18:29:42.569026+0000","last_unstale":"2024-05-08T18:31:15.743519+0000","last_undegraded":"2024-05-08T18:31:15.743519+0000","last_fullsized":"2024-05-08T18:31:15.743519+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:42.045615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.632513+0000","last_change":"2024-05-08T18:29:40.557700+0000","last_active":"2024-05-08T18:31:15.632513+0000","last_peered":"2024-05-08T18:31:15.632513+0000","last_clean":"2024-05-08T18:31:15.632513+0000","last_became_active":"2024-05-08T18:29:40.556884+0000","last_became_peered":"2024-05-08T18:29:40.556884+0000","last_unstale":"2024-05-08T18:31:15.632513+0000","last_undegraded":"2024-05-08T18:31:15.632513+0000","last_fullsized":"2024-05-08T18:31:15.632513+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:21:38.354933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":98,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.722036+0000","last_change":"2024-05-08T18:29:42.566448+0000","last_active":"2024-05-08T18:31:13.722036+0000","last_peered":"2024-05-08T18:31:13.722036+0000","last_clean":"2024-05-08T18:31:13.722036+0000","last_became_active":"2024-05-08T18:29:42.566058+0000","last_became_peered":"2024-05-08T18:29:42.566058+0000","last_unstale":"2024-05-08T18:31:13.722036+0000","last_undegraded":"2024-05-08T18:31:13.722036+0000","last_fullsized":"2024-05-08T18:31:13.722036+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:53:03.097704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":105,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.262209+0000","last_change":"2024-05-08T18:29:40.571195+0000","last_active":"2024-05-08T18:31:16.262209+0000","last_peered":"2024-05-08T18:31:16.262209+0000","last_clean":"2024-05-08T18:31:16.262209+0000","last_became_active":"2024-05-08T18:29:40.570467+0000","last_became_peered":"2024-05-08T18:29:40.570467+0000","last_unstale":"2024-05-08T18:31:16.262209+0000","last_undegraded":"2024-05-08T18:31:16.262209+0000","last_fullsized":"2024-05-08T18:31:16.262209+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:39.986094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.737238+0000","last_change":"2024-05-08T18:29:42.566506+0000","last_active":"2024-05-08T18:31:14.737238+0000","last_peered":"2024-05-08T18:31:14.737238+0000","last_clean":"2024-05-08T18:31:14.737238+0000","last_became_active":"2024-05-08T18:29:42.565740+0000","last_became_peered":"2024-05-08T18:29:42.565740+0000","last_unstale":"2024-05-08T18:31:14.737238+0000","last_undegraded":"2024-05-08T18:31:14.737238+0000","last_fullsized":"2024-05-08T18:31:14.737238+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:58.320701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.631711+0000","last_change":"2024-05-08T18:29:40.538314+0000","last_active":"2024-05-08T18:31:15.631711+0000","last_peered":"2024-05-08T18:31:15.631711+0000","last_clean":"2024-05-08T18:31:15.631711+0000","last_became_active":"2024-05-08T18:29:40.537458+0000","last_became_peered":"2024-05-08T18:29:40.537458+0000","last_unstale":"2024-05-08T18:31:15.631711+0000","last_undegraded":"2024-05-08T18:31:15.631711+0000","last_fullsized":"2024-05-08T18:31:15.631711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:56.300986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":102,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.743024+0000","last_change":"2024-05-08T18:29:42.570054+0000","last_active":"2024-05-08T18:31:15.743024+0000","last_peered":"2024-05-08T18:31:15.743024+0000","last_clean":"2024-05-08T18:31:15.743024+0000","last_became_active":"2024-05-08T18:29:42.569255+0000","last_became_peered":"2024-05-08T18:29:42.569255+0000","last_unstale":"2024-05-08T18:31:15.743024+0000","last_undegraded":"2024-05-08T18:31:15.743024+0000","last_fullsized":"2024-05-08T18:31:15.743024+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:11:01.702482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":53,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.737972+0000","last_change":"2024-05-08T18:30:21.210397+0000","last_active":"2024-05-08T18:31:14.737972+0000","last_peered":"2024-05-08T18:31:14.737972+0000","last_clean":"2024-05-08T18:31:14.737972+0000","last_became_active":"2024-05-08T18:30:21.210052+0000","last_became_peered":"2024-05-08T18:30:21.210052+0000","last_unstale":"2024-05-08T18:31:14.737972+0000","last_undegraded":"2024-05-08T18:31:14.737972+0000","last_fullsized":"2024-05-08T18:31:14.737972+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:51:05.355593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.632484+0000","last_change":"2024-05-08T18:29:42.562084+0000","last_active":"2024-05-08T18:31:15.632484+0000","last_peered":"2024-05-08T18:31:15.632484+0000","last_clean":"2024-05-08T18:31:15.632484+0000","last_became_active":"2024-05-08T18:29:42.560699+0000","last_became_peered":"2024-05-08T18:29:42.560699+0000","last_unstale":"2024-05-08T18:31:15.632484+0000","last_undegraded":"2024-05-08T18:31:15.632484+0000","last_fullsized":"2024-05-08T18:31:15.632484+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:09.787597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.745083+0000","last_change":"2024-05-08T18:29:40.564339+0000","last_active":"2024-05-08T18:31:14.745083+0000","last_peered":"2024-05-08T18:31:14.745083+0000","last_clean":"2024-05-08T18:31:14.745083+0000","last_became_active":"2024-05-08T18:29:40.564038+0000","last_became_peered":"2024-05-08T18:29:40.564038+0000","last_unstale":"2024-05-08T18:31:14.745083+0000","last_undegraded":"2024-05-08T18:31:14.745083+0000","last_fullsized":"2024-05-08T18:31:14.745083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:40:23.287885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.740657+0000","last_change":"2024-05-08T18:29:42.570253+0000","last_active":"2024-05-08T18:31:14.740657+0000","last_peered":"2024-05-08T18:31:14.740657+0000","last_clean":"2024-05-08T18:31:14.740657+0000","last_became_active":"2024-05-08T18:29:42.569917+0000","last_became_peered":"2024-05-08T18:29:42.569917+0000","last_unstale":"2024-05-08T18:31:14.740657+0000","last_undegraded":"2024-05-08T18:31:14.740657+0000","last_fullsized":"2024-05-08T18:31:14.740657+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:14:45.575219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":102,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.742047+0000","last_change":"2024-05-08T18:29:42.568116+0000","last_active":"2024-05-08T18:31:15.742047+0000","last_peered":"2024-05-08T18:31:15.742047+0000","last_clean":"2024-05-08T18:31:15.742047+0000","last_became_active":"2024-05-08T18:29:42.567399+0000","last_became_peered":"2024-05-08T18:29:42.567399+0000","last_unstale":"2024-05-08T18:31:15.742047+0000","last_undegraded":"2024-05-08T18:31:15.742047+0000","last_fullsized":"2024-05-08T18:31:15.742047+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:35.037465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":105,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.262175+0000","last_change":"2024-05-08T18:29:40.571982+0000","last_active":"2024-05-08T18:31:16.262175+0000","last_peered":"2024-05-08T18:31:16.262175+0000","last_clean":"2024-05-08T18:31:16.262175+0000","last_became_active":"2024-05-08T18:29:40.570600+0000","last_became_peered":"2024-05-08T18:29:40.570600+0000","last_unstale":"2024-05-08T18:31:16.262175+0000","last_undegraded":"2024-05-08T18:31:16.262175+0000","last_fullsized":"2024-05-08T18:31:16.262175+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:54:14.520118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":101,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.261503+0000","last_change":"2024-05-08T18:29:42.578449+0000","last_active":"2024-05-08T18:31:16.261503+0000","last_peered":"2024-05-08T18:31:16.261503+0000","last_clean":"2024-05-08T18:31:16.261503+0000","last_became_active":"2024-05-08T18:29:42.577789+0000","last_became_peered":"2024-05-08T18:29:42.577789+0000","last_unstale":"2024-05-08T18:31:16.261503+0000","last_undegraded":"2024-05-08T18:31:16.261503+0000","last_fullsized":"2024-05-08T18:31:16.261503+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:09.787597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.737655+0000","last_change":"2024-05-08T18:29:40.570618+0000","last_active":"2024-05-08T18:31:14.737655+0000","last_peered":"2024-05-08T18:31:14.737655+0000","last_clean":"2024-05-08T18:31:14.737655+0000","last_became_active":"2024-05-08T18:29:40.569519+0000","last_became_peered":"2024-05-08T18:29:40.569519+0000","last_unstale":"2024-05-08T18:31:14.737655+0000","last_undegraded":"2024-05-08T18:31:14.737655+0000","last_fullsized":"2024-05-08T18:31:14.737655+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:09:42.581976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.632125+0000","last_change":"2024-05-08T18:29:42.563056+0000","last_active":"2024-05-08T18:31:15.632125+0000","last_peered":"2024-05-08T18:31:15.632125+0000","last_clean":"2024-05-08T18:31:15.632125+0000","last_became_active":"2024-05-08T18:29:42.562296+0000","last_became_peered":"2024-05-08T18:29:42.562296+0000","last_unstale":"2024-05-08T18:31:15.632125+0000","last_undegraded":"2024-05-08T18:31:15.632125+0000","last_fullsized":"2024-05-08T18:31:15.632125+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:36.890277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.738207+0000","last_change":"2024-05-08T18:29:40.564353+0000","last_active":"2024-05-08T18:31:14.738207+0000","last_peered":"2024-05-08T18:31:14.738207+0000","last_clean":"2024-05-08T18:31:14.738207+0000","last_became_active":"2024-05-08T18:29:40.563516+0000","last_became_peered":"2024-05-08T18:29:40.563516+0000","last_unstale":"2024-05-08T18:31:14.738207+0000","last_undegraded":"2024-05-08T18:31:14.738207+0000","last_fullsized":"2024-05-08T18:31:14.738207+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:06:36.198647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.739805+0000","last_change":"2024-05-08T18:29:42.567006+0000","last_active":"2024-05-08T18:31:14.739805+0000","last_peered":"2024-05-08T18:31:14.739805+0000","last_clean":"2024-05-08T18:31:14.739805+0000","last_became_active":"2024-05-08T18:29:42.566256+0000","last_became_peered":"2024-05-08T18:29:42.566256+0000","last_unstale":"2024-05-08T18:31:14.739805+0000","last_undegraded":"2024-05-08T18:31:14.739805+0000","last_fullsized":"2024-05-08T18:31:14.739805+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:09:44.601690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":106,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.742388+0000","last_change":"2024-05-08T18:29:40.573212+0000","last_active":"2024-05-08T18:31:15.742388+0000","last_peered":"2024-05-08T18:31:15.742388+0000","last_clean":"2024-05-08T18:31:15.742388+0000","last_became_active":"2024-05-08T18:29:40.572250+0000","last_became_peered":"2024-05-08T18:29:40.572250+0000","last_unstale":"2024-05-08T18:31:15.742388+0000","last_undegraded":"2024-05-08T18:31:15.742388+0000","last_fullsized":"2024-05-08T18:31:15.742388+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:25:01.595224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.739542+0000","last_change":"2024-05-08T18:29:42.570847+0000","last_active":"2024-05-08T18:31:14.739542+0000","last_peered":"2024-05-08T18:31:14.739542+0000","last_clean":"2024-05-08T18:31:14.739542+0000","last_became_active":"2024-05-08T18:29:42.570435+0000","last_became_peered":"2024-05-08T18:29:42.570435+0000","last_unstale":"2024-05-08T18:31:14.739542+0000","last_undegraded":"2024-05-08T18:31:14.739542+0000","last_fullsized":"2024-05-08T18:31:14.739542+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:21:40.374647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.745834+0000","last_change":"2024-05-08T18:29:40.566815+0000","last_active":"2024-05-08T18:31:14.745834+0000","last_peered":"2024-05-08T18:31:14.745834+0000","last_clean":"2024-05-08T18:31:14.745834+0000","last_became_active":"2024-05-08T18:29:40.566531+0000","last_became_peered":"2024-05-08T18:29:40.566531+0000","last_unstale":"2024-05-08T18:31:14.745834+0000","last_undegraded":"2024-05-08T18:31:14.745834+0000","last_fullsized":"2024-05-08T18:31:14.745834+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:52.462279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":102,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.743255+0000","last_change":"2024-05-08T18:29:42.554846+0000","last_active":"2024-05-08T18:31:15.743255+0000","last_peered":"2024-05-08T18:31:15.743255+0000","last_clean":"2024-05-08T18:31:15.743255+0000","last_became_active":"2024-05-08T18:29:42.554115+0000","last_became_peered":"2024-05-08T18:29:42.554115+0000","last_unstale":"2024-05-08T18:31:15.743255+0000","last_undegraded":"2024-05-08T18:31:15.743255+0000","last_fullsized":"2024-05-08T18:31:15.743255+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:22:14.793035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":102,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.721533+0000","last_change":"2024-05-08T18:29:40.547776+0000","last_active":"2024-05-08T18:31:13.721533+0000","last_peered":"2024-05-08T18:31:13.721533+0000","last_clean":"2024-05-08T18:31:13.721533+0000","last_became_active":"2024-05-08T18:29:40.547384+0000","last_became_peered":"2024-05-08T18:29:40.547384+0000","last_unstale":"2024-05-08T18:31:13.721533+0000","last_undegraded":"2024-05-08T18:31:13.721533+0000","last_fullsized":"2024-05-08T18:31:13.721533+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:14:26.628603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":86,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.741568+0000","last_change":"2024-05-08T18:29:50.685390+0000","last_active":"2024-05-08T18:31:15.741568+0000","last_peered":"2024-05-08T18:31:15.741568+0000","last_clean":"2024-05-08T18:31:15.741568+0000","last_became_active":"2024-05-08T18:29:50.684644+0000","last_became_peered":"2024-05-08T18:29:50.684644+0000","last_unstale":"2024-05-08T18:31:15.741568+0000","last_undegraded":"2024-05-08T18:31:15.741568+0000","last_fullsized":"2024-05-08T18:31:15.741568+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:10:38.951662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.746330+0000","last_change":"2024-05-08T18:29:42.573805+0000","last_active":"2024-05-08T18:31:14.746330+0000","last_peered":"2024-05-08T18:31:14.746330+0000","last_clean":"2024-05-08T18:31:14.746330+0000","last_became_active":"2024-05-08T18:29:42.573296+0000","last_became_peered":"2024-05-08T18:29:42.573296+0000","last_unstale":"2024-05-08T18:31:14.746330+0000","last_undegraded":"2024-05-08T18:31:14.746330+0000","last_fullsized":"2024-05-08T18:31:14.746330+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:21.935293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":105,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.262645+0000","last_change":"2024-05-08T18:29:40.570733+0000","last_active":"2024-05-08T18:31:16.262645+0000","last_peered":"2024-05-08T18:31:16.262645+0000","last_clean":"2024-05-08T18:31:16.262645+0000","last_became_active":"2024-05-08T18:29:40.569711+0000","last_became_peered":"2024-05-08T18:29:40.569711+0000","last_unstale":"2024-05-08T18:31:16.262645+0000","last_undegraded":"2024-05-08T18:31:16.262645+0000","last_fullsized":"2024-05-08T18:31:16.262645+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:18:08.784274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":95,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.632525+0000","last_change":"2024-05-08T18:29:44.594185+0000","last_active":"2024-05-08T18:31:15.632525+0000","last_peered":"2024-05-08T18:31:15.632525+0000","last_clean":"2024-05-08T18:31:15.632525+0000","last_became_active":"2024-05-08T18:29:44.593442+0000","last_became_peered":"2024-05-08T18:29:44.593442+0000","last_unstale":"2024-05-08T18:31:15.632525+0000","last_undegraded":"2024-05-08T18:31:15.632525+0000","last_fullsized":"2024-05-08T18:31:15.632525+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:52:25.736491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"33'9","reported_seq":106,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.723194+0000","last_change":"2024-05-08T18:29:46.594652+0000","last_active":"2024-05-08T18:31:13.723194+0000","last_peered":"2024-05-08T18:31:13.723194+0000","last_clean":"2024-05-08T18:31:13.723194+0000","last_became_active":"2024-05-08T18:29:46.593656+0000","last_became_peered":"2024-05-08T18:29:46.593656+0000","last_unstale":"2024-05-08T18:31:13.723194+0000","last_undegraded":"2024-05-08T18:31:13.723194+0000","last_fullsized":"2024-05-08T18:31:13.723194+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:50:27.608888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":89,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.261759+0000","last_change":"2024-05-08T18:29:48.639834+0000","last_active":"2024-05-08T18:31:16.261759+0000","last_peered":"2024-05-08T18:31:16.261759+0000","last_clean":"2024-05-08T18:31:16.261759+0000","last_became_active":"2024-05-08T18:29:48.639122+0000","last_became_peered":"2024-05-08T18:29:48.639122+0000","last_unstale":"2024-05-08T18:31:16.261759+0000","last_undegraded":"2024-05-08T18:31:16.261759+0000","last_fullsized":"2024-05-08T18:31:16.261759+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:14:22.304773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":83,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.631156+0000","last_change":"2024-05-08T18:29:50.672303+0000","last_active":"2024-05-08T18:31:15.631156+0000","last_peered":"2024-05-08T18:31:15.631156+0000","last_clean":"2024-05-08T18:31:15.631156+0000","last_became_active":"2024-05-08T18:29:50.671513+0000","last_became_peered":"2024-05-08T18:29:50.671513+0000","last_unstale":"2024-05-08T18:31:15.631156+0000","last_undegraded":"2024-05-08T18:31:15.631156+0000","last_fullsized":"2024-05-08T18:31:15.631156+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:12:05.780786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.633369+0000","last_change":"2024-05-08T18:29:42.565462+0000","last_active":"2024-05-08T18:31:15.633369+0000","last_peered":"2024-05-08T18:31:15.633369+0000","last_clean":"2024-05-08T18:31:15.633369+0000","last_became_active":"2024-05-08T18:29:42.564741+0000","last_became_peered":"2024-05-08T18:29:42.564741+0000","last_unstale":"2024-05-08T18:31:15.633369+0000","last_undegraded":"2024-05-08T18:31:15.633369+0000","last_fullsized":"2024-05-08T18:31:15.633369+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:25:56.129785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":102,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.721619+0000","last_change":"2024-05-08T18:29:40.564796+0000","last_active":"2024-05-08T18:31:13.721619+0000","last_peered":"2024-05-08T18:31:13.721619+0000","last_clean":"2024-05-08T18:31:13.721619+0000","last_became_active":"2024-05-08T18:29:40.564401+0000","last_became_peered":"2024-05-08T18:29:40.564401+0000","last_unstale":"2024-05-08T18:31:13.721619+0000","last_undegraded":"2024-05-08T18:31:13.721619+0000","last_fullsized":"2024-05-08T18:31:13.721619+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:19:11.492397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":96,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.746203+0000","last_change":"2024-05-08T18:29:44.587689+0000","last_active":"2024-05-08T18:31:14.746203+0000","last_peered":"2024-05-08T18:31:14.746203+0000","last_clean":"2024-05-08T18:31:14.746203+0000","last_became_active":"2024-05-08T18:29:44.586975+0000","last_became_peered":"2024-05-08T18:29:44.586975+0000","last_unstale":"2024-05-08T18:31:14.746203+0000","last_undegraded":"2024-05-08T18:31:14.746203+0000","last_fullsized":"2024-05-08T18:31:14.746203+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:04:49.020450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"33'6","reported_seq":103,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.743522+0000","last_change":"2024-05-08T18:29:46.600906+0000","last_active":"2024-05-08T18:31:15.743522+0000","last_peered":"2024-05-08T18:31:15.743522+0000","last_clean":"2024-05-08T18:31:15.743522+0000","last_became_active":"2024-05-08T18:29:46.599894+0000","last_became_peered":"2024-05-08T18:29:46.599894+0000","last_unstale":"2024-05-08T18:31:15.743522+0000","last_undegraded":"2024-05-08T18:31:15.743522+0000","last_fullsized":"2024-05-08T18:31:15.743522+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:24:13.568294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":90,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.743076+0000","last_change":"2024-05-08T18:29:48.614324+0000","last_active":"2024-05-08T18:31:15.743076+0000","last_peered":"2024-05-08T18:31:15.743076+0000","last_clean":"2024-05-08T18:31:15.743076+0000","last_became_active":"2024-05-08T18:29:48.613591+0000","last_became_peered":"2024-05-08T18:29:48.613591+0000","last_unstale":"2024-05-08T18:31:15.743076+0000","last_undegraded":"2024-05-08T18:31:15.743076+0000","last_fullsized":"2024-05-08T18:31:15.743076+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:47:54.034851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":82,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.721301+0000","last_change":"2024-05-08T18:29:50.684773+0000","last_active":"2024-05-08T18:31:13.721301+0000","last_peered":"2024-05-08T18:31:13.721301+0000","last_clean":"2024-05-08T18:31:13.721301+0000","last_became_active":"2024-05-08T18:29:50.683931+0000","last_became_peered":"2024-05-08T18:29:50.683931+0000","last_unstale":"2024-05-08T18:31:13.721301+0000","last_undegraded":"2024-05-08T18:31:13.721301+0000","last_fullsized":"2024-05-08T18:31:13.721301+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:17:10.582636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":98,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.725942+0000","last_change":"2024-05-08T18:29:42.574437+0000","last_active":"2024-05-08T18:31:13.725942+0000","last_peered":"2024-05-08T18:31:13.725942+0000","last_clean":"2024-05-08T18:31:13.725942+0000","last_became_active":"2024-05-08T18:29:42.574146+0000","last_became_peered":"2024-05-08T18:29:42.574146+0000","last_unstale":"2024-05-08T18:31:13.725942+0000","last_undegraded":"2024-05-08T18:31:13.725942+0000","last_fullsized":"2024-05-08T18:31:13.725942+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:55:30.468069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":105,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.261751+0000","last_change":"2024-05-08T18:29:40.559677+0000","last_active":"2024-05-08T18:31:16.261751+0000","last_peered":"2024-05-08T18:31:16.261751+0000","last_clean":"2024-05-08T18:31:16.261751+0000","last_became_active":"2024-05-08T18:29:40.558819+0000","last_became_peered":"2024-05-08T18:29:40.558819+0000","last_unstale":"2024-05-08T18:31:16.261751+0000","last_undegraded":"2024-05-08T18:31:16.261751+0000","last_fullsized":"2024-05-08T18:31:16.261751+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:28.426657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":96,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.749101+0000","last_change":"2024-05-08T18:29:44.596801+0000","last_active":"2024-05-08T18:31:14.749101+0000","last_peered":"2024-05-08T18:31:14.749101+0000","last_clean":"2024-05-08T18:31:14.749101+0000","last_became_active":"2024-05-08T18:29:44.596111+0000","last_became_peered":"2024-05-08T18:29:44.596111+0000","last_unstale":"2024-05-08T18:31:14.749101+0000","last_undegraded":"2024-05-08T18:31:14.749101+0000","last_fullsized":"2024-05-08T18:31:14.749101+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:04.423266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"33'10","reported_seq":106,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.736543+0000","last_change":"2024-05-08T18:29:46.608330+0000","last_active":"2024-05-08T18:31:14.736543+0000","last_peered":"2024-05-08T18:31:14.736543+0000","last_clean":"2024-05-08T18:31:14.736543+0000","last_became_active":"2024-05-08T18:29:46.607580+0000","last_became_peered":"2024-05-08T18:29:46.607580+0000","last_unstale":"2024-05-08T18:31:14.736543+0000","last_undegraded":"2024-05-08T18:31:14.736543+0000","last_fullsized":"2024-05-08T18:31:14.736543+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:22:18.837103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"30'2","reported_seq":109,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.261493+0000","last_change":"2024-05-08T18:29:48.642718+0000","last_active":"2024-05-08T18:31:16.261493+0000","last_peered":"2024-05-08T18:31:16.261493+0000","last_clean":"2024-05-08T18:31:16.261493+0000","last_became_active":"2024-05-08T18:29:48.641950+0000","last_became_peered":"2024-05-08T18:29:48.641950+0000","last_unstale":"2024-05-08T18:31:16.261493+0000","last_undegraded":"2024-05-08T18:31:16.261493+0000","last_fullsized":"2024-05-08T18:31:16.261493+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:00:11.720096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":86,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.742233+0000","last_change":"2024-05-08T18:29:50.660378+0000","last_active":"2024-05-08T18:31:15.742233+0000","last_peered":"2024-05-08T18:31:15.742233+0000","last_clean":"2024-05-08T18:31:15.742233+0000","last_became_active":"2024-05-08T18:29:50.659649+0000","last_became_peered":"2024-05-08T18:29:50.659649+0000","last_unstale":"2024-05-08T18:31:15.742233+0000","last_undegraded":"2024-05-08T18:31:15.742233+0000","last_fullsized":"2024-05-08T18:31:15.742233+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:34:14.488295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.746142+0000","last_change":"2024-05-08T18:29:42.577267+0000","last_active":"2024-05-08T18:31:14.746142+0000","last_peered":"2024-05-08T18:31:14.746142+0000","last_clean":"2024-05-08T18:31:14.746142+0000","last_became_active":"2024-05-08T18:29:42.576740+0000","last_became_peered":"2024-05-08T18:29:42.576740+0000","last_unstale":"2024-05-08T18:31:14.746142+0000","last_undegraded":"2024-05-08T18:31:14.746142+0000","last_fullsized":"2024-05-08T18:31:14.746142+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:57:14.869860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.736395+0000","last_change":"2024-05-08T18:29:40.547524+0000","last_active":"2024-05-08T18:31:14.736395+0000","last_peered":"2024-05-08T18:31:14.736395+0000","last_clean":"2024-05-08T18:31:14.736395+0000","last_became_active":"2024-05-08T18:29:40.545749+0000","last_became_peered":"2024-05-08T18:29:40.545749+0000","last_unstale":"2024-05-08T18:31:14.736395+0000","last_undegraded":"2024-05-08T18:31:14.736395+0000","last_fullsized":"2024-05-08T18:31:14.736395+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:12:59.146887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":95,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.632246+0000","last_change":"2024-05-08T18:29:44.579839+0000","last_active":"2024-05-08T18:31:15.632246+0000","last_peered":"2024-05-08T18:31:15.632246+0000","last_clean":"2024-05-08T18:31:15.632246+0000","last_became_active":"2024-05-08T18:29:44.578142+0000","last_became_peered":"2024-05-08T18:29:44.578142+0000","last_unstale":"2024-05-08T18:31:15.632246+0000","last_undegraded":"2024-05-08T18:31:15.632246+0000","last_fullsized":"2024-05-08T18:31:15.632246+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:51:09.413191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"33'9","reported_seq":109,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.261959+0000","last_change":"2024-05-08T18:29:46.607288+0000","last_active":"2024-05-08T18:31:16.261959+0000","last_peered":"2024-05-08T18:31:16.261959+0000","last_clean":"2024-05-08T18:31:16.261959+0000","last_became_active":"2024-05-08T18:29:46.605154+0000","last_became_peered":"2024-05-08T18:29:46.605154+0000","last_unstale":"2024-05-08T18:31:16.261959+0000","last_undegraded":"2024-05-08T18:31:16.261959+0000","last_fullsized":"2024-05-08T18:31:16.261959+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:23.940519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"30'2","reported_seq":108,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.745965+0000","last_change":"2024-05-08T18:29:48.634956+0000","last_active":"2024-05-08T18:31:14.745965+0000","last_peered":"2024-05-08T18:31:14.745965+0000","last_clean":"2024-05-08T18:31:14.745965+0000","last_became_active":"2024-05-08T18:29:48.633858+0000","last_became_peered":"2024-05-08T18:29:48.633858+0000","last_unstale":"2024-05-08T18:31:14.745965+0000","last_undegraded":"2024-05-08T18:31:14.745965+0000","last_fullsized":"2024-05-08T18:31:14.745965+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:50:48.169666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.632416+0000","last_change":"2024-05-08T18:29:42.567744+0000","last_active":"2024-05-08T18:31:15.632416+0000","last_peered":"2024-05-08T18:31:15.632416+0000","last_clean":"2024-05-08T18:31:15.632416+0000","last_became_active":"2024-05-08T18:29:42.566974+0000","last_became_peered":"2024-05-08T18:29:42.566974+0000","last_unstale":"2024-05-08T18:31:15.632416+0000","last_undegraded":"2024-05-08T18:31:15.632416+0000","last_fullsized":"2024-05-08T18:31:15.632416+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:42.045615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":105,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.262287+0000","last_change":"2024-05-08T18:29:40.572499+0000","last_active":"2024-05-08T18:31:16.262287+0000","last_peered":"2024-05-08T18:31:16.262287+0000","last_clean":"2024-05-08T18:31:16.262287+0000","last_became_active":"2024-05-08T18:29:40.571322+0000","last_became_peered":"2024-05-08T18:29:40.571322+0000","last_unstale":"2024-05-08T18:31:16.262287+0000","last_undegraded":"2024-05-08T18:31:16.262287+0000","last_fullsized":"2024-05-08T18:31:16.262287+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:31.119374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":97,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.260932+0000","last_change":"2024-05-08T18:29:44.597045+0000","last_active":"2024-05-08T18:31:16.260932+0000","last_peered":"2024-05-08T18:31:16.260932+0000","last_clean":"2024-05-08T18:31:16.260932+0000","last_became_active":"2024-05-08T18:29:44.596282+0000","last_became_peered":"2024-05-08T18:29:44.596282+0000","last_unstale":"2024-05-08T18:31:16.260932+0000","last_undegraded":"2024-05-08T18:31:16.260932+0000","last_fullsized":"2024-05-08T18:31:16.260932+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:35:51.288126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"33'19","reported_seq":122,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.631240+0000","last_change":"2024-05-08T18:29:46.590633+0000","last_active":"2024-05-08T18:31:15.631240+0000","last_peered":"2024-05-08T18:31:15.631240+0000","last_clean":"2024-05-08T18:31:15.631240+0000","last_became_active":"2024-05-08T18:29:46.589600+0000","last_became_peered":"2024-05-08T18:29:46.589600+0000","last_unstale":"2024-05-08T18:31:15.631240+0000","last_undegraded":"2024-05-08T18:31:15.631240+0000","last_fullsized":"2024-05-08T18:31:15.631240+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:23.940519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":86,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.720461+0000","last_change":"2024-05-08T18:29:48.630758+0000","last_active":"2024-05-08T18:31:13.720461+0000","last_peered":"2024-05-08T18:31:13.720461+0000","last_clean":"2024-05-08T18:31:13.720461+0000","last_became_active":"2024-05-08T18:29:48.630017+0000","last_became_peered":"2024-05-08T18:29:48.630017+0000","last_unstale":"2024-05-08T18:31:13.720461+0000","last_undegraded":"2024-05-08T18:31:13.720461+0000","last_fullsized":"2024-05-08T18:31:13.720461+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:39.879384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":83,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.631915+0000","last_change":"2024-05-08T18:29:50.672682+0000","last_active":"2024-05-08T18:31:15.631915+0000","last_peered":"2024-05-08T18:31:15.631915+0000","last_clean":"2024-05-08T18:31:15.631915+0000","last_became_active":"2024-05-08T18:29:50.671923+0000","last_became_peered":"2024-05-08T18:29:50.671923+0000","last_unstale":"2024-05-08T18:31:15.631915+0000","last_undegraded":"2024-05-08T18:31:15.631915+0000","last_fullsized":"2024-05-08T18:31:15.631915+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:38.318890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":102,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.741981+0000","last_change":"2024-05-08T18:29:42.554289+0000","last_active":"2024-05-08T18:31:15.741981+0000","last_peered":"2024-05-08T18:31:15.741981+0000","last_clean":"2024-05-08T18:31:15.741981+0000","last_became_active":"2024-05-08T18:29:42.553574+0000","last_became_peered":"2024-05-08T18:29:42.553574+0000","last_unstale":"2024-05-08T18:31:15.741981+0000","last_undegraded":"2024-05-08T18:31:15.741981+0000","last_fullsized":"2024-05-08T18:31:15.741981+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:42.005809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":105,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.263237+0000","last_change":"2024-05-08T18:29:40.570169+0000","last_active":"2024-05-08T18:31:16.263237+0000","last_peered":"2024-05-08T18:31:16.263237+0000","last_clean":"2024-05-08T18:31:16.263237+0000","last_became_active":"2024-05-08T18:29:40.569542+0000","last_became_peered":"2024-05-08T18:29:40.569542+0000","last_unstale":"2024-05-08T18:31:16.263237+0000","last_undegraded":"2024-05-08T18:31:16.263237+0000","last_fullsized":"2024-05-08T18:31:16.263237+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:08:13.006752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"26'1","reported_seq":97,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.737649+0000","last_change":"2024-05-08T18:29:44.579659+0000","last_active":"2024-05-08T18:31:14.737649+0000","last_peered":"2024-05-08T18:31:14.737649+0000","last_clean":"2024-05-08T18:31:14.737649+0000","last_became_active":"2024-05-08T18:29:44.579152+0000","last_became_peered":"2024-05-08T18:29:44.579152+0000","last_unstale":"2024-05-08T18:31:14.737649+0000","last_undegraded":"2024-05-08T18:31:14.737649+0000","last_fullsized":"2024-05-08T18:31:14.737649+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:15:00.358583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"33'9","reported_seq":108,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.748385+0000","last_change":"2024-05-08T18:29:46.600224+0000","last_active":"2024-05-08T18:31:14.748385+0000","last_peered":"2024-05-08T18:31:14.748385+0000","last_clean":"2024-05-08T18:31:14.748385+0000","last_became_active":"2024-05-08T18:29:46.599464+0000","last_became_peered":"2024-05-08T18:29:46.599464+0000","last_unstale":"2024-05-08T18:31:14.748385+0000","last_undegraded":"2024-05-08T18:31:14.748385+0000","last_fullsized":"2024-05-08T18:31:14.748385+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:26:40.238188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":88,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.745432+0000","last_change":"2024-05-08T18:29:48.637939+0000","last_active":"2024-05-08T18:31:14.745432+0000","last_peered":"2024-05-08T18:31:14.745432+0000","last_clean":"2024-05-08T18:31:14.745432+0000","last_became_active":"2024-05-08T18:29:48.637231+0000","last_became_peered":"2024-05-08T18:29:48.637231+0000","last_unstale":"2024-05-08T18:31:14.745432+0000","last_undegraded":"2024-05-08T18:31:14.745432+0000","last_fullsized":"2024-05-08T18:31:14.745432+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:04.571608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":84,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.737287+0000","last_change":"2024-05-08T18:29:50.681831+0000","last_active":"2024-05-08T18:31:14.737287+0000","last_peered":"2024-05-08T18:31:14.737287+0000","last_clean":"2024-05-08T18:31:14.737287+0000","last_became_active":"2024-05-08T18:29:50.681287+0000","last_became_peered":"2024-05-08T18:29:50.681287+0000","last_unstale":"2024-05-08T18:31:14.737287+0000","last_undegraded":"2024-05-08T18:31:14.737287+0000","last_fullsized":"2024-05-08T18:31:14.737287+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:30:24.111488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.737114+0000","last_change":"2024-05-08T18:29:42.562975+0000","last_active":"2024-05-08T18:31:14.737114+0000","last_peered":"2024-05-08T18:31:14.737114+0000","last_clean":"2024-05-08T18:31:14.737114+0000","last_became_active":"2024-05-08T18:29:42.562267+0000","last_became_peered":"2024-05-08T18:29:42.562267+0000","last_unstale":"2024-05-08T18:31:14.737114+0000","last_undegraded":"2024-05-08T18:31:14.737114+0000","last_fullsized":"2024-05-08T18:31:14.737114+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:30.446371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":105,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.262330+0000","last_change":"2024-05-08T18:29:40.570736+0000","last_active":"2024-05-08T18:31:16.262330+0000","last_peered":"2024-05-08T18:31:16.262330+0000","last_clean":"2024-05-08T18:31:16.262330+0000","last_became_active":"2024-05-08T18:29:40.569626+0000","last_became_peered":"2024-05-08T18:29:40.569626+0000","last_unstale":"2024-05-08T18:31:16.262330+0000","last_undegraded":"2024-05-08T18:31:16.262330+0000","last_fullsized":"2024-05-08T18:31:16.262330+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:56.300986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"26'1","reported_seq":97,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.739172+0000","last_change":"2024-05-08T18:29:44.581748+0000","last_active":"2024-05-08T18:31:14.739172+0000","last_peered":"2024-05-08T18:31:14.739172+0000","last_clean":"2024-05-08T18:31:14.739172+0000","last_became_active":"2024-05-08T18:29:44.581067+0000","last_became_peered":"2024-05-08T18:29:44.581067+0000","last_unstale":"2024-05-08T18:31:14.739172+0000","last_undegraded":"2024-05-08T18:31:14.739172+0000","last_fullsized":"2024-05-08T18:31:14.739172+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:44.043691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"33'15","reported_seq":118,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.261097+0000","last_change":"2024-05-08T18:29:46.605887+0000","last_active":"2024-05-08T18:31:16.261097+0000","last_peered":"2024-05-08T18:31:16.261097+0000","last_clean":"2024-05-08T18:31:16.261097+0000","last_became_active":"2024-05-08T18:29:46.604966+0000","last_became_peered":"2024-05-08T18:29:46.604966+0000","last_unstale":"2024-05-08T18:31:16.261097+0000","last_undegraded":"2024-05-08T18:31:16.261097+0000","last_fullsized":"2024-05-08T18:31:16.261097+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:07:54.654205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"30'2","reported_seq":106,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.721885+0000","last_change":"2024-05-08T18:29:48.638657+0000","last_active":"2024-05-08T18:31:13.721885+0000","last_peered":"2024-05-08T18:31:13.721885+0000","last_clean":"2024-05-08T18:31:13.721885+0000","last_became_active":"2024-05-08T18:29:48.637758+0000","last_became_peered":"2024-05-08T18:29:48.637758+0000","last_unstale":"2024-05-08T18:31:13.721885+0000","last_undegraded":"2024-05-08T18:31:13.721885+0000","last_fullsized":"2024-05-08T18:31:13.721885+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:45:24.153991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":82,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.723305+0000","last_change":"2024-05-08T18:29:50.684501+0000","last_active":"2024-05-08T18:31:13.723305+0000","last_peered":"2024-05-08T18:31:13.723305+0000","last_clean":"2024-05-08T18:31:13.723305+0000","last_became_active":"2024-05-08T18:29:50.683738+0000","last_became_peered":"2024-05-08T18:29:50.683738+0000","last_unstale":"2024-05-08T18:31:13.723305+0000","last_undegraded":"2024-05-08T18:31:13.723305+0000","last_fullsized":"2024-05-08T18:31:13.723305+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:22.834262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":98,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.722596+0000","last_change":"2024-05-08T18:29:42.569401+0000","last_active":"2024-05-08T18:31:13.722596+0000","last_peered":"2024-05-08T18:31:13.722596+0000","last_clean":"2024-05-08T18:31:13.722596+0000","last_became_active":"2024-05-08T18:29:42.568659+0000","last_became_peered":"2024-05-08T18:29:42.568659+0000","last_unstale":"2024-05-08T18:31:13.722596+0000","last_undegraded":"2024-05-08T18:31:13.722596+0000","last_fullsized":"2024-05-08T18:31:13.722596+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:35:23.016110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.632782+0000","last_change":"2024-05-08T18:29:40.557076+0000","last_active":"2024-05-08T18:31:15.632782+0000","last_peered":"2024-05-08T18:31:15.632782+0000","last_clean":"2024-05-08T18:31:15.632782+0000","last_became_active":"2024-05-08T18:29:40.555805+0000","last_became_peered":"2024-05-08T18:29:40.555805+0000","last_unstale":"2024-05-08T18:31:15.632782+0000","last_undegraded":"2024-05-08T18:31:15.632782+0000","last_fullsized":"2024-05-08T18:31:15.632782+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:13.946346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":95,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.739353+0000","last_change":"2024-05-08T18:29:44.573892+0000","last_active":"2024-05-08T18:31:14.739353+0000","last_peered":"2024-05-08T18:31:14.739353+0000","last_clean":"2024-05-08T18:31:14.739353+0000","last_became_active":"2024-05-08T18:29:44.573308+0000","last_became_peered":"2024-05-08T18:29:44.573308+0000","last_unstale":"2024-05-08T18:31:14.739353+0000","last_undegraded":"2024-05-08T18:31:14.739353+0000","last_fullsized":"2024-05-08T18:31:14.739353+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:37.075348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"33'12","reported_seq":113,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.722836+0000","last_change":"2024-05-08T18:29:46.595585+0000","last_active":"2024-05-08T18:31:13.722836+0000","last_peered":"2024-05-08T18:31:13.722836+0000","last_clean":"2024-05-08T18:31:13.722836+0000","last_became_active":"2024-05-08T18:29:46.594930+0000","last_became_peered":"2024-05-08T18:29:46.594930+0000","last_unstale":"2024-05-08T18:31:13.722836+0000","last_undegraded":"2024-05-08T18:31:13.722836+0000","last_fullsized":"2024-05-08T18:31:13.722836+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:11.768269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":87,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.737466+0000","last_change":"2024-05-08T18:29:48.638137+0000","last_active":"2024-05-08T18:31:14.737466+0000","last_peered":"2024-05-08T18:31:14.737466+0000","last_clean":"2024-05-08T18:31:14.737466+0000","last_became_active":"2024-05-08T18:29:48.637370+0000","last_became_peered":"2024-05-08T18:29:48.637370+0000","last_unstale":"2024-05-08T18:31:14.737466+0000","last_undegraded":"2024-05-08T18:31:14.737466+0000","last_fullsized":"2024-05-08T18:31:14.737466+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:15.859849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":82,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.722744+0000","last_change":"2024-05-08T18:29:50.688760+0000","last_active":"2024-05-08T18:31:13.722744+0000","last_peered":"2024-05-08T18:31:13.722744+0000","last_clean":"2024-05-08T18:31:13.722744+0000","last_became_active":"2024-05-08T18:29:50.687960+0000","last_became_peered":"2024-05-08T18:29:50.687960+0000","last_unstale":"2024-05-08T18:31:13.722744+0000","last_undegraded":"2024-05-08T18:31:13.722744+0000","last_fullsized":"2024-05-08T18:31:13.722744+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:21:19.624895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":102,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.742749+0000","last_change":"2024-05-08T18:29:42.557850+0000","last_active":"2024-05-08T18:31:15.742749+0000","last_peered":"2024-05-08T18:31:15.742749+0000","last_clean":"2024-05-08T18:31:15.742749+0000","last_became_active":"2024-05-08T18:29:42.557119+0000","last_became_peered":"2024-05-08T18:29:42.557119+0000","last_unstale":"2024-05-08T18:31:15.742749+0000","last_undegraded":"2024-05-08T18:31:15.742749+0000","last_fullsized":"2024-05-08T18:31:15.742749+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:25:56.129785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.745576+0000","last_change":"2024-05-08T18:29:40.544530+0000","last_active":"2024-05-08T18:31:14.745576+0000","last_peered":"2024-05-08T18:31:14.745576+0000","last_clean":"2024-05-08T18:31:14.745576+0000","last_became_active":"2024-05-08T18:29:40.544215+0000","last_became_peered":"2024-05-08T18:29:40.544215+0000","last_unstale":"2024-05-08T18:31:14.745576+0000","last_undegraded":"2024-05-08T18:31:14.745576+0000","last_fullsized":"2024-05-08T18:31:14.745576+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:14:26.628603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":95,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.738866+0000","last_change":"2024-05-08T18:29:44.588227+0000","last_active":"2024-05-08T18:31:14.738866+0000","last_peered":"2024-05-08T18:31:14.738866+0000","last_clean":"2024-05-08T18:31:14.738866+0000","last_became_active":"2024-05-08T18:29:44.587822+0000","last_became_peered":"2024-05-08T18:29:44.587822+0000","last_unstale":"2024-05-08T18:31:14.738866+0000","last_undegraded":"2024-05-08T18:31:14.738866+0000","last_fullsized":"2024-05-08T18:31:14.738866+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:18:12.841872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"33'11","reported_seq":113,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.743323+0000","last_change":"2024-05-08T18:29:46.603563+0000","last_active":"2024-05-08T18:31:15.743323+0000","last_peered":"2024-05-08T18:31:15.743323+0000","last_clean":"2024-05-08T18:31:15.743323+0000","last_became_active":"2024-05-08T18:29:46.602801+0000","last_became_peered":"2024-05-08T18:29:46.602801+0000","last_unstale":"2024-05-08T18:31:15.743323+0000","last_undegraded":"2024-05-08T18:31:15.743323+0000","last_fullsized":"2024-05-08T18:31:15.743323+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:22:36.338527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":86,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.723285+0000","last_change":"2024-05-08T18:29:48.642806+0000","last_active":"2024-05-08T18:31:13.723285+0000","last_peered":"2024-05-08T18:31:13.723285+0000","last_clean":"2024-05-08T18:31:13.723285+0000","last_became_active":"2024-05-08T18:29:48.641813+0000","last_became_peered":"2024-05-08T18:29:48.641813+0000","last_unstale":"2024-05-08T18:31:13.723285+0000","last_undegraded":"2024-05-08T18:31:13.723285+0000","last_fullsized":"2024-05-08T18:31:13.723285+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:50:48.169666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":84,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.744630+0000","last_change":"2024-05-08T18:29:50.689819+0000","last_active":"2024-05-08T18:31:14.744630+0000","last_peered":"2024-05-08T18:31:14.744630+0000","last_clean":"2024-05-08T18:31:14.744630+0000","last_became_active":"2024-05-08T18:29:50.686739+0000","last_became_peered":"2024-05-08T18:29:50.686739+0000","last_unstale":"2024-05-08T18:31:14.744630+0000","last_undegraded":"2024-05-08T18:31:14.744630+0000","last_fullsized":"2024-05-08T18:31:14.744630+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:45:34.171402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":102,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.743481+0000","last_change":"2024-05-08T18:29:42.552388+0000","last_active":"2024-05-08T18:31:15.743481+0000","last_peered":"2024-05-08T18:31:15.743481+0000","last_clean":"2024-05-08T18:31:15.743481+0000","last_became_active":"2024-05-08T18:29:42.551647+0000","last_became_peered":"2024-05-08T18:29:42.551647+0000","last_unstale":"2024-05-08T18:31:15.743481+0000","last_undegraded":"2024-05-08T18:31:15.743481+0000","last_fullsized":"2024-05-08T18:31:15.743481+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:55.055481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.737356+0000","last_change":"2024-05-08T18:29:40.562946+0000","last_active":"2024-05-08T18:31:14.737356+0000","last_peered":"2024-05-08T18:31:14.737356+0000","last_clean":"2024-05-08T18:31:14.737356+0000","last_became_active":"2024-05-08T18:29:40.550942+0000","last_became_peered":"2024-05-08T18:29:40.550942+0000","last_unstale":"2024-05-08T18:31:14.737356+0000","last_undegraded":"2024-05-08T18:31:14.737356+0000","last_fullsized":"2024-05-08T18:31:14.737356+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:22.579629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":94,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.720111+0000","last_change":"2024-05-08T18:29:44.593681+0000","last_active":"2024-05-08T18:31:13.720111+0000","last_peered":"2024-05-08T18:31:13.720111+0000","last_clean":"2024-05-08T18:31:13.720111+0000","last_became_active":"2024-05-08T18:29:44.593242+0000","last_became_peered":"2024-05-08T18:29:44.593242+0000","last_unstale":"2024-05-08T18:31:13.720111+0000","last_undegraded":"2024-05-08T18:31:13.720111+0000","last_fullsized":"2024-05-08T18:31:13.720111+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:57.093364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"33'15","reported_seq":116,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.740550+0000","last_change":"2024-05-08T18:29:46.589514+0000","last_active":"2024-05-08T18:31:14.740550+0000","last_peered":"2024-05-08T18:31:14.740550+0000","last_clean":"2024-05-08T18:31:14.740550+0000","last_became_active":"2024-05-08T18:29:46.588784+0000","last_became_peered":"2024-05-08T18:29:46.588784+0000","last_unstale":"2024-05-08T18:31:14.740550+0000","last_undegraded":"2024-05-08T18:31:14.740550+0000","last_fullsized":"2024-05-08T18:31:14.740550+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:02:30.355168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"30'2","reported_seq":107,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.738812+0000","last_change":"2024-05-08T18:29:48.631007+0000","last_active":"2024-05-08T18:31:14.738812+0000","last_peered":"2024-05-08T18:31:14.738812+0000","last_clean":"2024-05-08T18:31:14.738812+0000","last_became_active":"2024-05-08T18:29:48.630229+0000","last_became_peered":"2024-05-08T18:29:48.630229+0000","last_unstale":"2024-05-08T18:31:14.738812+0000","last_undegraded":"2024-05-08T18:31:14.738812+0000","last_fullsized":"2024-05-08T18:31:14.738812+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:44:03.778419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":82,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.719607+0000","last_change":"2024-05-08T18:29:50.675105+0000","last_active":"2024-05-08T18:31:13.719607+0000","last_peered":"2024-05-08T18:31:13.719607+0000","last_clean":"2024-05-08T18:31:13.719607+0000","last_became_active":"2024-05-08T18:29:50.674292+0000","last_became_peered":"2024-05-08T18:29:50.674292+0000","last_unstale":"2024-05-08T18:31:13.719607+0000","last_undegraded":"2024-05-08T18:31:13.719607+0000","last_fullsized":"2024-05-08T18:31:13.719607+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:47:15.423647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":102,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.743524+0000","last_change":"2024-05-08T18:29:42.579707+0000","last_active":"2024-05-08T18:31:15.743524+0000","last_peered":"2024-05-08T18:31:15.743524+0000","last_clean":"2024-05-08T18:31:15.743524+0000","last_became_active":"2024-05-08T18:29:42.579059+0000","last_became_peered":"2024-05-08T18:29:42.579059+0000","last_unstale":"2024-05-08T18:31:15.743524+0000","last_undegraded":"2024-05-08T18:31:15.743524+0000","last_fullsized":"2024-05-08T18:31:15.743524+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:09.787597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":106,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.742713+0000","last_change":"2024-05-08T18:29:40.555327+0000","last_active":"2024-05-08T18:31:15.742713+0000","last_peered":"2024-05-08T18:31:15.742713+0000","last_clean":"2024-05-08T18:31:15.742713+0000","last_became_active":"2024-05-08T18:29:40.554594+0000","last_became_peered":"2024-05-08T18:29:40.554594+0000","last_unstale":"2024-05-08T18:31:15.742713+0000","last_undegraded":"2024-05-08T18:31:15.742713+0000","last_fullsized":"2024-05-08T18:31:15.742713+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:19.841114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"26'2","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.631618+0000","last_change":"2024-05-08T18:29:44.582434+0000","last_active":"2024-05-08T18:31:15.631618+0000","last_peered":"2024-05-08T18:31:15.631618+0000","last_clean":"2024-05-08T18:31:15.631618+0000","last_became_active":"2024-05-08T18:29:44.581699+0000","last_became_peered":"2024-05-08T18:29:44.581699+0000","last_unstale":"2024-05-08T18:31:15.631618+0000","last_undegraded":"2024-05-08T18:31:15.631618+0000","last_fullsized":"2024-05-08T18:31:15.631618+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:19:29.113643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"33'10","reported_seq":107,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.746013+0000","last_change":"2024-05-08T18:29:46.590860+0000","last_active":"2024-05-08T18:31:14.746013+0000","last_peered":"2024-05-08T18:31:14.746013+0000","last_clean":"2024-05-08T18:31:14.746013+0000","last_became_active":"2024-05-08T18:29:46.590087+0000","last_became_peered":"2024-05-08T18:29:46.590087+0000","last_unstale":"2024-05-08T18:31:14.746013+0000","last_undegraded":"2024-05-08T18:31:14.746013+0000","last_fullsized":"2024-05-08T18:31:14.746013+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:19:58.358449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"30'2","reported_seq":108,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.737851+0000","last_change":"2024-05-08T18:29:48.635548+0000","last_active":"2024-05-08T18:31:14.737851+0000","last_peered":"2024-05-08T18:31:14.737851+0000","last_clean":"2024-05-08T18:31:14.737851+0000","last_became_active":"2024-05-08T18:29:48.634801+0000","last_became_peered":"2024-05-08T18:29:48.634801+0000","last_unstale":"2024-05-08T18:31:14.737851+0000","last_undegraded":"2024-05-08T18:31:14.737851+0000","last_fullsized":"2024-05-08T18:31:14.737851+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:04:20.128031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":86,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.743282+0000","last_change":"2024-05-08T18:29:50.668279+0000","last_active":"2024-05-08T18:31:15.743282+0000","last_peered":"2024-05-08T18:31:15.743282+0000","last_clean":"2024-05-08T18:31:15.743282+0000","last_became_active":"2024-05-08T18:29:50.667536+0000","last_became_peered":"2024-05-08T18:29:50.667536+0000","last_unstale":"2024-05-08T18:31:15.743282+0000","last_undegraded":"2024-05-08T18:31:15.743282+0000","last_fullsized":"2024-05-08T18:31:15.743282+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:12:05.780786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":98,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.722987+0000","last_change":"2024-05-08T18:29:42.563807+0000","last_active":"2024-05-08T18:31:13.722987+0000","last_peered":"2024-05-08T18:31:13.722987+0000","last_clean":"2024-05-08T18:31:13.722987+0000","last_became_active":"2024-05-08T18:29:42.563416+0000","last_became_peered":"2024-05-08T18:29:42.563416+0000","last_unstale":"2024-05-08T18:31:13.722987+0000","last_undegraded":"2024-05-08T18:31:13.722987+0000","last_fullsized":"2024-05-08T18:31:13.722987+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:18:10.803989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.745233+0000","last_change":"2024-05-08T18:29:40.548898+0000","last_active":"2024-05-08T18:31:14.745233+0000","last_peered":"2024-05-08T18:31:14.745233+0000","last_clean":"2024-05-08T18:31:14.745233+0000","last_became_active":"2024-05-08T18:29:40.548591+0000","last_became_peered":"2024-05-08T18:29:40.548591+0000","last_unstale":"2024-05-08T18:31:14.745233+0000","last_undegraded":"2024-05-08T18:31:14.745233+0000","last_fullsized":"2024-05-08T18:31:14.745233+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:27:41.414153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":98,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.743425+0000","last_change":"2024-05-08T18:29:44.582578+0000","last_active":"2024-05-08T18:31:15.743425+0000","last_peered":"2024-05-08T18:31:15.743425+0000","last_clean":"2024-05-08T18:31:15.743425+0000","last_became_active":"2024-05-08T18:29:44.581832+0000","last_became_peered":"2024-05-08T18:29:44.581832+0000","last_unstale":"2024-05-08T18:31:15.743425+0000","last_undegraded":"2024-05-08T18:31:15.743425+0000","last_fullsized":"2024-05-08T18:31:15.743425+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:52:25.736491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"33'17","reported_seq":119,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.632258+0000","last_change":"2024-05-08T18:29:46.602459+0000","last_active":"2024-05-08T18:31:15.632258+0000","last_peered":"2024-05-08T18:31:15.632258+0000","last_clean":"2024-05-08T18:31:15.632258+0000","last_became_active":"2024-05-08T18:29:46.601740+0000","last_became_peered":"2024-05-08T18:29:46.601740+0000","last_unstale":"2024-05-08T18:31:15.632258+0000","last_undegraded":"2024-05-08T18:31:15.632258+0000","last_fullsized":"2024-05-08T18:31:15.632258+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:58:31.293922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":88,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.736929+0000","last_change":"2024-05-08T18:29:48.640046+0000","last_active":"2024-05-08T18:31:14.736929+0000","last_peered":"2024-05-08T18:31:14.736929+0000","last_clean":"2024-05-08T18:31:14.736929+0000","last_became_active":"2024-05-08T18:29:48.639309+0000","last_became_peered":"2024-05-08T18:29:48.639309+0000","last_unstale":"2024-05-08T18:31:14.736929+0000","last_undegraded":"2024-05-08T18:31:14.736929+0000","last_fullsized":"2024-05-08T18:31:14.736929+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:10.533065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":82,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.720364+0000","last_change":"2024-05-08T18:29:50.668361+0000","last_active":"2024-05-08T18:31:13.720364+0000","last_peered":"2024-05-08T18:31:13.720364+0000","last_clean":"2024-05-08T18:31:13.720364+0000","last_became_active":"2024-05-08T18:29:50.667636+0000","last_became_peered":"2024-05-08T18:29:50.667636+0000","last_unstale":"2024-05-08T18:31:13.720364+0000","last_undegraded":"2024-05-08T18:31:13.720364+0000","last_fullsized":"2024-05-08T18:31:13.720364+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:58:35.356885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.738122+0000","last_change":"2024-05-08T18:29:42.584098+0000","last_active":"2024-05-08T18:31:14.738122+0000","last_peered":"2024-05-08T18:31:14.738122+0000","last_clean":"2024-05-08T18:31:14.738122+0000","last_became_active":"2024-05-08T18:29:42.583639+0000","last_became_peered":"2024-05-08T18:29:42.583639+0000","last_unstale":"2024-05-08T18:31:14.738122+0000","last_undegraded":"2024-05-08T18:31:14.738122+0000","last_fullsized":"2024-05-08T18:31:14.738122+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:08:15.026467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":207,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.260941+0000","last_change":"2024-05-08T18:29:27.115522+0000","last_active":"2024-05-08T18:31:16.260941+0000","last_peered":"2024-05-08T18:31:16.260941+0000","last_clean":"2024-05-08T18:31:16.260941+0000","last_became_active":"2024-05-08T18:29:27.112960+0000","last_became_peered":"2024-05-08T18:29:27.112960+0000","last_unstale":"2024-05-08T18:31:16.260941+0000","last_undegraded":"2024-05-08T18:31:16.260941+0000","last_fullsized":"2024-05-08T18:31:16.260941+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:26.091102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:26.091102+0000","last_clean_scrub_stamp":"2024-05-08T18:29:26.091102+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:09:50.296961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":109,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.632174+0000","last_change":"2024-05-08T18:29:34.496467+0000","last_active":"2024-05-08T18:31:15.632174+0000","last_peered":"2024-05-08T18:31:15.632174+0000","last_clean":"2024-05-08T18:31:15.632174+0000","last_became_active":"2024-05-08T18:29:34.495632+0000","last_became_peered":"2024-05-08T18:29:34.495632+0000","last_unstale":"2024-05-08T18:31:15.632174+0000","last_undegraded":"2024-05-08T18:31:15.632174+0000","last_fullsized":"2024-05-08T18:31:15.632174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:35.917391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":109,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.745790+0000","last_change":"2024-05-08T18:30:20.849562+0000","last_active":"2024-05-08T18:31:14.745790+0000","last_peered":"2024-05-08T18:31:14.745790+0000","last_clean":"2024-05-08T18:31:14.745790+0000","last_became_active":"2024-05-08T18:30:20.849160+0000","last_became_peered":"2024-05-08T18:30:20.849160+0000","last_unstale":"2024-05-08T18:31:14.745790+0000","last_undegraded":"2024-05-08T18:31:14.745790+0000","last_fullsized":"2024-05-08T18:31:14.745790+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:29:13.478886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":97,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.261983+0000","last_change":"2024-05-08T18:29:44.592445+0000","last_active":"2024-05-08T18:31:16.261983+0000","last_peered":"2024-05-08T18:31:16.261983+0000","last_clean":"2024-05-08T18:31:16.261983+0000","last_became_active":"2024-05-08T18:29:44.587855+0000","last_became_peered":"2024-05-08T18:29:44.587855+0000","last_unstale":"2024-05-08T18:31:16.261983+0000","last_undegraded":"2024-05-08T18:31:16.261983+0000","last_fullsized":"2024-05-08T18:31:16.261983+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:06:05.355648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"33'13","reported_seq":118,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.632992+0000","last_change":"2024-05-08T18:29:46.595394+0000","last_active":"2024-05-08T18:31:15.632992+0000","last_peered":"2024-05-08T18:31:15.632992+0000","last_clean":"2024-05-08T18:31:15.632992+0000","last_became_active":"2024-05-08T18:29:46.594573+0000","last_became_peered":"2024-05-08T18:29:46.594573+0000","last_unstale":"2024-05-08T18:31:15.632992+0000","last_undegraded":"2024-05-08T18:31:15.632992+0000","last_fullsized":"2024-05-08T18:31:15.632992+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:47:11.360684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":86,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.723389+0000","last_change":"2024-05-08T18:29:48.632178+0000","last_active":"2024-05-08T18:31:13.723389+0000","last_peered":"2024-05-08T18:31:13.723389+0000","last_clean":"2024-05-08T18:31:13.723389+0000","last_became_active":"2024-05-08T18:29:48.631481+0000","last_became_peered":"2024-05-08T18:29:48.631481+0000","last_unstale":"2024-05-08T18:31:13.723389+0000","last_undegraded":"2024-05-08T18:31:13.723389+0000","last_fullsized":"2024-05-08T18:31:13.723389+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:34.806539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":84,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.736104+0000","last_change":"2024-05-08T18:29:50.675319+0000","last_active":"2024-05-08T18:31:14.736104+0000","last_peered":"2024-05-08T18:31:14.736104+0000","last_clean":"2024-05-08T18:31:14.736104+0000","last_became_active":"2024-05-08T18:29:50.674526+0000","last_became_peered":"2024-05-08T18:29:50.674526+0000","last_unstale":"2024-05-08T18:31:14.736104+0000","last_undegraded":"2024-05-08T18:31:14.736104+0000","last_fullsized":"2024-05-08T18:31:14.736104+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:59:06.404586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":98,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.725806+0000","last_change":"2024-05-08T18:29:42.568584+0000","last_active":"2024-05-08T18:31:13.725806+0000","last_peered":"2024-05-08T18:31:13.725806+0000","last_clean":"2024-05-08T18:31:13.725806+0000","last_became_active":"2024-05-08T18:29:42.568244+0000","last_became_peered":"2024-05-08T18:29:42.568244+0000","last_unstale":"2024-05-08T18:31:13.725806+0000","last_undegraded":"2024-05-08T18:31:13.725806+0000","last_fullsized":"2024-05-08T18:31:13.725806+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:20.397730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":111,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.260769+0000","last_change":"2024-05-08T18:29:34.497654+0000","last_active":"2024-05-08T18:31:16.260769+0000","last_peered":"2024-05-08T18:31:16.260769+0000","last_clean":"2024-05-08T18:31:16.260769+0000","last_became_active":"2024-05-08T18:29:34.495812+0000","last_became_peered":"2024-05-08T18:29:34.495812+0000","last_unstale":"2024-05-08T18:31:16.260769+0000","last_undegraded":"2024-05-08T18:31:16.260769+0000","last_fullsized":"2024-05-08T18:31:16.260769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:37:02.202613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":102,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.722926+0000","last_change":"2024-05-08T18:29:40.560653+0000","last_active":"2024-05-08T18:31:13.722926+0000","last_peered":"2024-05-08T18:31:13.722926+0000","last_clean":"2024-05-08T18:31:13.722926+0000","last_became_active":"2024-05-08T18:29:40.560296+0000","last_became_peered":"2024-05-08T18:29:40.560296+0000","last_unstale":"2024-05-08T18:31:13.722926+0000","last_undegraded":"2024-05-08T18:31:13.722926+0000","last_fullsized":"2024-05-08T18:31:13.722926+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:52.462279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":95,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.633414+0000","last_change":"2024-05-08T18:29:44.594681+0000","last_active":"2024-05-08T18:31:15.633414+0000","last_peered":"2024-05-08T18:31:15.633414+0000","last_clean":"2024-05-08T18:31:15.633414+0000","last_became_active":"2024-05-08T18:29:44.593917+0000","last_became_peered":"2024-05-08T18:29:44.593917+0000","last_unstale":"2024-05-08T18:31:15.633414+0000","last_undegraded":"2024-05-08T18:31:15.633414+0000","last_fullsized":"2024-05-08T18:31:15.633414+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:59:00.335437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"33'23","reported_seq":149,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.720066+0000","last_change":"2024-05-08T18:29:46.599932+0000","last_active":"2024-05-08T18:31:13.720066+0000","last_peered":"2024-05-08T18:31:13.720066+0000","last_clean":"2024-05-08T18:31:13.720066+0000","last_became_active":"2024-05-08T18:29:46.594789+0000","last_became_peered":"2024-05-08T18:29:46.594789+0000","last_unstale":"2024-05-08T18:31:13.720066+0000","last_undegraded":"2024-05-08T18:31:13.720066+0000","last_fullsized":"2024-05-08T18:31:13.720066+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:04:18.099848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":42,"num_read_kb":27,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":89,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.261780+0000","last_change":"2024-05-08T18:29:48.634661+0000","last_active":"2024-05-08T18:31:16.261780+0000","last_peered":"2024-05-08T18:31:16.261780+0000","last_clean":"2024-05-08T18:31:16.261780+0000","last_became_active":"2024-05-08T18:29:48.634044+0000","last_became_peered":"2024-05-08T18:29:48.634044+0000","last_unstale":"2024-05-08T18:31:16.261780+0000","last_undegraded":"2024-05-08T18:31:16.261780+0000","last_fullsized":"2024-05-08T18:31:16.261780+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:01:46.238076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":82,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.719668+0000","last_change":"2024-05-08T18:29:50.676536+0000","last_active":"2024-05-08T18:31:13.719668+0000","last_peered":"2024-05-08T18:31:13.719668+0000","last_clean":"2024-05-08T18:31:13.719668+0000","last_became_active":"2024-05-08T18:29:50.675770+0000","last_became_peered":"2024-05-08T18:29:50.675770+0000","last_unstale":"2024-05-08T18:31:13.719668+0000","last_undegraded":"2024-05-08T18:31:13.719668+0000","last_fullsized":"2024-05-08T18:31:13.719668+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:28.003482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":98,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.723025+0000","last_change":"2024-05-08T18:29:42.575253+0000","last_active":"2024-05-08T18:31:13.723025+0000","last_peered":"2024-05-08T18:31:13.723025+0000","last_clean":"2024-05-08T18:31:13.723025+0000","last_became_active":"2024-05-08T18:29:42.573621+0000","last_became_peered":"2024-05-08T18:29:42.573621+0000","last_unstale":"2024-05-08T18:31:13.723025+0000","last_undegraded":"2024-05-08T18:31:13.723025+0000","last_fullsized":"2024-05-08T18:31:13.723025+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:59.243324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":109,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.738304+0000","last_change":"2024-05-08T18:29:34.491071+0000","last_active":"2024-05-08T18:31:14.738304+0000","last_peered":"2024-05-08T18:31:14.738304+0000","last_clean":"2024-05-08T18:31:14.738304+0000","last_became_active":"2024-05-08T18:29:34.490717+0000","last_became_peered":"2024-05-08T18:29:34.490717+0000","last_unstale":"2024-05-08T18:31:14.738304+0000","last_undegraded":"2024-05-08T18:31:14.738304+0000","last_fullsized":"2024-05-08T18:31:14.738304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:55.793312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":102,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.718585+0000","last_change":"2024-05-08T18:29:40.530634+0000","last_active":"2024-05-08T18:31:13.718585+0000","last_peered":"2024-05-08T18:31:13.718585+0000","last_clean":"2024-05-08T18:31:13.718585+0000","last_became_active":"2024-05-08T18:29:40.529804+0000","last_became_peered":"2024-05-08T18:29:40.529804+0000","last_unstale":"2024-05-08T18:31:13.718585+0000","last_undegraded":"2024-05-08T18:31:13.718585+0000","last_fullsized":"2024-05-08T18:31:13.718585+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:59:25.840149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"26'1","reported_seq":96,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.740581+0000","last_change":"2024-05-08T18:29:44.584678+0000","last_active":"2024-05-08T18:31:14.740581+0000","last_peered":"2024-05-08T18:31:14.740581+0000","last_clean":"2024-05-08T18:31:14.740581+0000","last_became_active":"2024-05-08T18:29:44.584227+0000","last_became_peered":"2024-05-08T18:29:44.584227+0000","last_unstale":"2024-05-08T18:31:14.740581+0000","last_undegraded":"2024-05-08T18:31:14.740581+0000","last_fullsized":"2024-05-08T18:31:14.740581+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:04:01.281207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'15","reported_seq":132,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.262088+0000","last_change":"2024-05-08T18:29:46.608720+0000","last_active":"2024-05-08T18:31:16.262088+0000","last_peered":"2024-05-08T18:31:16.262088+0000","last_clean":"2024-05-08T18:31:16.262088+0000","last_became_active":"2024-05-08T18:29:46.607989+0000","last_became_peered":"2024-05-08T18:29:46.607989+0000","last_unstale":"2024-05-08T18:31:16.262088+0000","last_undegraded":"2024-05-08T18:31:16.262088+0000","last_fullsized":"2024-05-08T18:31:16.262088+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:58:31.293922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":86,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.722122+0000","last_change":"2024-05-08T18:29:48.625269+0000","last_active":"2024-05-08T18:31:13.722122+0000","last_peered":"2024-05-08T18:31:13.722122+0000","last_clean":"2024-05-08T18:31:13.722122+0000","last_became_active":"2024-05-08T18:29:48.624545+0000","last_became_peered":"2024-05-08T18:29:48.624545+0000","last_unstale":"2024-05-08T18:31:13.722122+0000","last_undegraded":"2024-05-08T18:31:13.722122+0000","last_fullsized":"2024-05-08T18:31:13.722122+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:16:42.799734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":84,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.748205+0000","last_change":"2024-05-08T18:29:50.688851+0000","last_active":"2024-05-08T18:31:14.748205+0000","last_peered":"2024-05-08T18:31:14.748205+0000","last_clean":"2024-05-08T18:31:14.748205+0000","last_became_active":"2024-05-08T18:29:50.687978+0000","last_became_peered":"2024-05-08T18:29:50.687978+0000","last_unstale":"2024-05-08T18:31:14.748205+0000","last_undegraded":"2024-05-08T18:31:14.748205+0000","last_fullsized":"2024-05-08T18:31:14.748205+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:28:29.836446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":98,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.720237+0000","last_change":"2024-05-08T18:29:42.574606+0000","last_active":"2024-05-08T18:31:13.720237+0000","last_peered":"2024-05-08T18:31:13.720237+0000","last_clean":"2024-05-08T18:31:13.720237+0000","last_became_active":"2024-05-08T18:29:42.573656+0000","last_became_peered":"2024-05-08T18:29:42.573656+0000","last_unstale":"2024-05-08T18:31:13.720237+0000","last_undegraded":"2024-05-08T18:31:13.720237+0000","last_fullsized":"2024-05-08T18:31:13.720237+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:54:16.539832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":109,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.632766+0000","last_change":"2024-05-08T18:29:34.496942+0000","last_active":"2024-05-08T18:31:15.632766+0000","last_peered":"2024-05-08T18:31:15.632766+0000","last_clean":"2024-05-08T18:31:15.632766+0000","last_became_active":"2024-05-08T18:29:34.495882+0000","last_became_peered":"2024-05-08T18:29:34.495882+0000","last_unstale":"2024-05-08T18:31:15.632766+0000","last_undegraded":"2024-05-08T18:31:15.632766+0000","last_fullsized":"2024-05-08T18:31:15.632766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:55.793312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":106,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.742878+0000","last_change":"2024-05-08T18:29:40.554353+0000","last_active":"2024-05-08T18:31:15.742878+0000","last_peered":"2024-05-08T18:31:15.742878+0000","last_clean":"2024-05-08T18:31:15.742878+0000","last_became_active":"2024-05-08T18:29:40.553527+0000","last_became_peered":"2024-05-08T18:29:40.553527+0000","last_unstale":"2024-05-08T18:31:15.742878+0000","last_undegraded":"2024-05-08T18:31:15.742878+0000","last_fullsized":"2024-05-08T18:31:15.742878+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:03:42.148647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":94,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.722912+0000","last_change":"2024-05-08T18:29:44.597411+0000","last_active":"2024-05-08T18:31:13.722912+0000","last_peered":"2024-05-08T18:31:13.722912+0000","last_clean":"2024-05-08T18:31:13.722912+0000","last_became_active":"2024-05-08T18:29:44.596678+0000","last_became_peered":"2024-05-08T18:29:44.596678+0000","last_unstale":"2024-05-08T18:31:13.722912+0000","last_undegraded":"2024-05-08T18:31:13.722912+0000","last_fullsized":"2024-05-08T18:31:13.722912+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:37:23.674968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'12","reported_seq":110,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.748348+0000","last_change":"2024-05-08T18:29:46.607040+0000","last_active":"2024-05-08T18:31:14.748348+0000","last_peered":"2024-05-08T18:31:14.748348+0000","last_clean":"2024-05-08T18:31:14.748348+0000","last_became_active":"2024-05-08T18:29:46.606367+0000","last_became_peered":"2024-05-08T18:29:46.606367+0000","last_unstale":"2024-05-08T18:31:14.748348+0000","last_undegraded":"2024-05-08T18:31:14.748348+0000","last_fullsized":"2024-05-08T18:31:14.748348+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:59:26.650126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":88,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.737779+0000","last_change":"2024-05-08T18:29:48.632665+0000","last_active":"2024-05-08T18:31:14.737779+0000","last_peered":"2024-05-08T18:31:14.737779+0000","last_clean":"2024-05-08T18:31:14.737779+0000","last_became_active":"2024-05-08T18:29:48.631874+0000","last_became_peered":"2024-05-08T18:29:48.631874+0000","last_unstale":"2024-05-08T18:31:14.737779+0000","last_undegraded":"2024-05-08T18:31:14.737779+0000","last_fullsized":"2024-05-08T18:31:14.737779+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:06:09.390017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":83,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.631156+0000","last_change":"2024-05-08T18:29:50.683443+0000","last_active":"2024-05-08T18:31:15.631156+0000","last_peered":"2024-05-08T18:31:15.631156+0000","last_clean":"2024-05-08T18:31:15.631156+0000","last_became_active":"2024-05-08T18:29:50.682634+0000","last_became_peered":"2024-05-08T18:29:50.682634+0000","last_unstale":"2024-05-08T18:31:15.631156+0000","last_undegraded":"2024-05-08T18:31:15.631156+0000","last_fullsized":"2024-05-08T18:31:15.631156+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:10:38.951662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":98,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.720037+0000","last_change":"2024-05-08T18:29:42.574593+0000","last_active":"2024-05-08T18:31:13.720037+0000","last_peered":"2024-05-08T18:31:13.720037+0000","last_clean":"2024-05-08T18:31:13.720037+0000","last_became_active":"2024-05-08T18:29:42.574288+0000","last_became_peered":"2024-05-08T18:29:42.574288+0000","last_unstale":"2024-05-08T18:31:13.720037+0000","last_undegraded":"2024-05-08T18:31:13.720037+0000","last_fullsized":"2024-05-08T18:31:13.720037+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:58.320701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":53,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.738757+0000","last_change":"2024-05-08T18:30:20.850805+0000","last_active":"2024-05-08T18:31:14.738757+0000","last_peered":"2024-05-08T18:31:14.738757+0000","last_clean":"2024-05-08T18:31:14.738757+0000","last_became_active":"2024-05-08T18:30:20.850365+0000","last_became_peered":"2024-05-08T18:30:20.850365+0000","last_unstale":"2024-05-08T18:31:14.738757+0000","last_undegraded":"2024-05-08T18:31:14.738757+0000","last_fullsized":"2024-05-08T18:31:14.738757+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:52:21.678894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":108,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.720367+0000","last_change":"2024-05-08T18:29:34.606393+0000","last_active":"2024-05-08T18:31:13.720367+0000","last_peered":"2024-05-08T18:31:13.720367+0000","last_clean":"2024-05-08T18:31:13.720367+0000","last_became_active":"2024-05-08T18:29:34.605574+0000","last_became_peered":"2024-05-08T18:29:34.605574+0000","last_unstale":"2024-05-08T18:31:13.720367+0000","last_undegraded":"2024-05-08T18:31:13.720367+0000","last_fullsized":"2024-05-08T18:31:13.720367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:55.793312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":94,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.722198+0000","last_change":"2024-05-08T18:29:44.595127+0000","last_active":"2024-05-08T18:31:13.722198+0000","last_peered":"2024-05-08T18:31:13.722198+0000","last_clean":"2024-05-08T18:31:13.722198+0000","last_became_active":"2024-05-08T18:29:44.594642+0000","last_became_peered":"2024-05-08T18:29:44.594642+0000","last_unstale":"2024-05-08T18:31:13.722198+0000","last_undegraded":"2024-05-08T18:31:13.722198+0000","last_fullsized":"2024-05-08T18:31:13.722198+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:04:49.020450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"33'18","reported_seq":122,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.721722+0000","last_change":"2024-05-08T18:29:46.602279+0000","last_active":"2024-05-08T18:31:13.721722+0000","last_peered":"2024-05-08T18:31:13.721722+0000","last_clean":"2024-05-08T18:31:13.721722+0000","last_became_active":"2024-05-08T18:29:46.599707+0000","last_became_peered":"2024-05-08T18:29:46.599707+0000","last_unstale":"2024-05-08T18:31:13.721722+0000","last_undegraded":"2024-05-08T18:31:13.721722+0000","last_fullsized":"2024-05-08T18:31:13.721722+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:54:48.654215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":90,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.741708+0000","last_change":"2024-05-08T18:29:48.639458+0000","last_active":"2024-05-08T18:31:15.741708+0000","last_peered":"2024-05-08T18:31:15.741708+0000","last_clean":"2024-05-08T18:31:15.741708+0000","last_became_active":"2024-05-08T18:29:48.638709+0000","last_became_peered":"2024-05-08T18:29:48.638709+0000","last_unstale":"2024-05-08T18:31:15.741708+0000","last_undegraded":"2024-05-08T18:31:15.741708+0000","last_fullsized":"2024-05-08T18:31:15.741708+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:19:58.182291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":82,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.723086+0000","last_change":"2024-05-08T18:29:50.681077+0000","last_active":"2024-05-08T18:31:13.723086+0000","last_peered":"2024-05-08T18:31:13.723086+0000","last_clean":"2024-05-08T18:31:13.723086+0000","last_became_active":"2024-05-08T18:29:50.675766+0000","last_became_peered":"2024-05-08T18:29:50.675766+0000","last_unstale":"2024-05-08T18:31:13.723086+0000","last_undegraded":"2024-05-08T18:31:13.723086+0000","last_fullsized":"2024-05-08T18:31:13.723086+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:09:29.641515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":98,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.722515+0000","last_change":"2024-05-08T18:29:42.571265+0000","last_active":"2024-05-08T18:31:13.722515+0000","last_peered":"2024-05-08T18:31:13.722515+0000","last_clean":"2024-05-08T18:31:13.722515+0000","last_became_active":"2024-05-08T18:29:42.570645+0000","last_became_peered":"2024-05-08T18:29:42.570645+0000","last_unstale":"2024-05-08T18:31:13.722515+0000","last_undegraded":"2024-05-08T18:31:13.722515+0000","last_fullsized":"2024-05-08T18:31:13.722515+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:30:29.452640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":102,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.720282+0000","last_change":"2024-05-08T18:29:40.531079+0000","last_active":"2024-05-08T18:31:13.720282+0000","last_peered":"2024-05-08T18:31:13.720282+0000","last_clean":"2024-05-08T18:31:13.720282+0000","last_became_active":"2024-05-08T18:29:40.530256+0000","last_became_peered":"2024-05-08T18:29:40.530256+0000","last_unstale":"2024-05-08T18:31:13.720282+0000","last_undegraded":"2024-05-08T18:31:13.720282+0000","last_fullsized":"2024-05-08T18:31:13.720282+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:09:42.581976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":111,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.262613+0000","last_change":"2024-05-08T18:29:34.603292+0000","last_active":"2024-05-08T18:31:16.262613+0000","last_peered":"2024-05-08T18:31:16.262613+0000","last_clean":"2024-05-08T18:31:16.262613+0000","last_became_active":"2024-05-08T18:29:34.602547+0000","last_became_peered":"2024-05-08T18:29:34.602547+0000","last_unstale":"2024-05-08T18:31:16.262613+0000","last_undegraded":"2024-05-08T18:31:16.262613+0000","last_fullsized":"2024-05-08T18:31:16.262613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:24:55.555475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":96,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.736741+0000","last_change":"2024-05-08T18:29:44.593275+0000","last_active":"2024-05-08T18:31:14.736741+0000","last_peered":"2024-05-08T18:31:14.736741+0000","last_clean":"2024-05-08T18:31:14.736741+0000","last_became_active":"2024-05-08T18:29:44.591870+0000","last_became_peered":"2024-05-08T18:29:44.591870+0000","last_unstale":"2024-05-08T18:31:14.736741+0000","last_undegraded":"2024-05-08T18:31:14.736741+0000","last_fullsized":"2024-05-08T18:31:14.736741+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:35.176971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"33'14","reported_seq":111,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.718464+0000","last_change":"2024-05-08T18:29:46.603499+0000","last_active":"2024-05-08T18:31:13.718464+0000","last_peered":"2024-05-08T18:31:13.718464+0000","last_clean":"2024-05-08T18:31:13.718464+0000","last_became_active":"2024-05-08T18:29:46.602920+0000","last_became_peered":"2024-05-08T18:29:46.602920+0000","last_unstale":"2024-05-08T18:31:13.718464+0000","last_undegraded":"2024-05-08T18:31:13.718464+0000","last_fullsized":"2024-05-08T18:31:13.718464+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:08.504882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"30'2","reported_seq":107,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.631973+0000","last_change":"2024-05-08T18:29:48.634915+0000","last_active":"2024-05-08T18:31:15.631973+0000","last_peered":"2024-05-08T18:31:15.631973+0000","last_clean":"2024-05-08T18:31:15.631973+0000","last_became_active":"2024-05-08T18:29:48.634280+0000","last_became_peered":"2024-05-08T18:29:48.634280+0000","last_unstale":"2024-05-08T18:31:15.631973+0000","last_undegraded":"2024-05-08T18:31:15.631973+0000","last_fullsized":"2024-05-08T18:31:15.631973+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:19:58.182291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":84,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.748900+0000","last_change":"2024-05-08T18:29:50.688742+0000","last_active":"2024-05-08T18:31:14.748900+0000","last_peered":"2024-05-08T18:31:14.748900+0000","last_clean":"2024-05-08T18:31:14.748900+0000","last_became_active":"2024-05-08T18:29:50.687135+0000","last_became_peered":"2024-05-08T18:29:50.687135+0000","last_unstale":"2024-05-08T18:31:14.748900+0000","last_undegraded":"2024-05-08T18:31:14.748900+0000","last_fullsized":"2024-05-08T18:31:14.748900+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:12:49.040807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":53,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.737358+0000","last_change":"2024-05-08T18:30:21.220561+0000","last_active":"2024-05-08T18:31:14.737358+0000","last_peered":"2024-05-08T18:31:14.737358+0000","last_clean":"2024-05-08T18:31:14.737358+0000","last_became_active":"2024-05-08T18:30:21.220196+0000","last_became_peered":"2024-05-08T18:30:21.220196+0000","last_unstale":"2024-05-08T18:31:14.737358+0000","last_undegraded":"2024-05-08T18:31:14.737358+0000","last_fullsized":"2024-05-08T18:31:14.737358+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:19:27.075761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.746011+0000","last_change":"2024-05-08T18:29:40.565872+0000","last_active":"2024-05-08T18:31:14.746011+0000","last_peered":"2024-05-08T18:31:14.746011+0000","last_clean":"2024-05-08T18:31:14.746011+0000","last_became_active":"2024-05-08T18:29:40.565655+0000","last_became_peered":"2024-05-08T18:29:40.565655+0000","last_unstale":"2024-05-08T18:31:14.746011+0000","last_undegraded":"2024-05-08T18:31:14.746011+0000","last_fullsized":"2024-05-08T18:31:14.746011+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:16:16.521258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":108,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.723560+0000","last_change":"2024-05-08T18:29:34.501273+0000","last_active":"2024-05-08T18:31:13.723560+0000","last_peered":"2024-05-08T18:31:13.723560+0000","last_clean":"2024-05-08T18:31:13.723560+0000","last_became_active":"2024-05-08T18:29:34.500933+0000","last_became_peered":"2024-05-08T18:29:34.500933+0000","last_unstale":"2024-05-08T18:31:13.723560+0000","last_undegraded":"2024-05-08T18:31:13.723560+0000","last_fullsized":"2024-05-08T18:31:13.723560+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:35.917391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":98,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.741966+0000","last_change":"2024-05-08T18:29:44.576227+0000","last_active":"2024-05-08T18:31:15.741966+0000","last_peered":"2024-05-08T18:31:15.741966+0000","last_clean":"2024-05-08T18:31:15.741966+0000","last_became_active":"2024-05-08T18:29:44.575454+0000","last_became_peered":"2024-05-08T18:29:44.575454+0000","last_unstale":"2024-05-08T18:31:15.741966+0000","last_undegraded":"2024-05-08T18:31:15.741966+0000","last_fullsized":"2024-05-08T18:31:15.741966+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:06:05.355648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"33'10","reported_seq":109,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.743668+0000","last_change":"2024-05-08T18:29:46.609633+0000","last_active":"2024-05-08T18:31:15.743668+0000","last_peered":"2024-05-08T18:31:15.743668+0000","last_clean":"2024-05-08T18:31:15.743668+0000","last_became_active":"2024-05-08T18:29:46.603455+0000","last_became_peered":"2024-05-08T18:29:46.603455+0000","last_unstale":"2024-05-08T18:31:15.743668+0000","last_undegraded":"2024-05-08T18:31:15.743668+0000","last_fullsized":"2024-05-08T18:31:15.743668+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:07:54.654205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"30'2","reported_seq":108,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.748725+0000","last_change":"2024-05-08T18:29:48.637898+0000","last_active":"2024-05-08T18:31:14.748725+0000","last_peered":"2024-05-08T18:31:14.748725+0000","last_clean":"2024-05-08T18:31:14.748725+0000","last_became_active":"2024-05-08T18:29:48.637070+0000","last_became_peered":"2024-05-08T18:29:48.637070+0000","last_unstale":"2024-05-08T18:31:14.748725+0000","last_undegraded":"2024-05-08T18:31:14.748725+0000","last_fullsized":"2024-05-08T18:31:14.748725+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:03:46.392864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":82,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.722211+0000","last_change":"2024-05-08T18:29:50.691526+0000","last_active":"2024-05-08T18:31:13.722211+0000","last_peered":"2024-05-08T18:31:13.722211+0000","last_clean":"2024-05-08T18:31:13.722211+0000","last_became_active":"2024-05-08T18:29:50.690767+0000","last_became_peered":"2024-05-08T18:29:50.690767+0000","last_unstale":"2024-05-08T18:31:13.722211+0000","last_undegraded":"2024-05-08T18:31:13.722211+0000","last_fullsized":"2024-05-08T18:31:13.722211+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:32:29.972139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":102,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.742191+0000","last_change":"2024-05-08T18:29:42.562006+0000","last_active":"2024-05-08T18:31:15.742191+0000","last_peered":"2024-05-08T18:31:15.742191+0000","last_clean":"2024-05-08T18:31:15.742191+0000","last_became_active":"2024-05-08T18:29:42.560861+0000","last_became_peered":"2024-05-08T18:29:42.560861+0000","last_unstale":"2024-05-08T18:31:15.742191+0000","last_undegraded":"2024-05-08T18:31:15.742191+0000","last_fullsized":"2024-05-08T18:31:15.742191+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:36.890277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":102,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.726017+0000","last_change":"2024-05-08T18:29:40.550529+0000","last_active":"2024-05-08T18:31:13.726017+0000","last_peered":"2024-05-08T18:31:13.726017+0000","last_clean":"2024-05-08T18:31:13.726017+0000","last_became_active":"2024-05-08T18:29:40.550241+0000","last_became_peered":"2024-05-08T18:29:40.550241+0000","last_unstale":"2024-05-08T18:31:13.726017+0000","last_undegraded":"2024-05-08T18:31:13.726017+0000","last_fullsized":"2024-05-08T18:31:13.726017+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:48.294532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":110,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.738403+0000","last_change":"2024-05-08T18:29:34.493537+0000","last_active":"2024-05-08T18:31:14.738403+0000","last_peered":"2024-05-08T18:31:14.738403+0000","last_clean":"2024-05-08T18:31:14.738403+0000","last_became_active":"2024-05-08T18:29:34.492891+0000","last_became_peered":"2024-05-08T18:29:34.492891+0000","last_unstale":"2024-05-08T18:31:14.738403+0000","last_undegraded":"2024-05-08T18:31:14.738403+0000","last_fullsized":"2024-05-08T18:31:14.738403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:09:07.992256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":96,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.744847+0000","last_change":"2024-05-08T18:29:44.590102+0000","last_active":"2024-05-08T18:31:14.744847+0000","last_peered":"2024-05-08T18:31:14.744847+0000","last_clean":"2024-05-08T18:31:14.744847+0000","last_became_active":"2024-05-08T18:29:44.589471+0000","last_became_peered":"2024-05-08T18:29:44.589471+0000","last_unstale":"2024-05-08T18:31:14.744847+0000","last_undegraded":"2024-05-08T18:31:14.744847+0000","last_fullsized":"2024-05-08T18:31:14.744847+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:14:04.085401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"33'19","reported_seq":129,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.261498+0000","last_change":"2024-05-08T18:29:46.606967+0000","last_active":"2024-05-08T18:31:16.261498+0000","last_peered":"2024-05-08T18:31:16.261498+0000","last_clean":"2024-05-08T18:31:16.261498+0000","last_became_active":"2024-05-08T18:29:46.605693+0000","last_became_peered":"2024-05-08T18:29:46.605693+0000","last_unstale":"2024-05-08T18:31:16.261498+0000","last_undegraded":"2024-05-08T18:31:16.261498+0000","last_fullsized":"2024-05-08T18:31:16.261498+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:24:13.568294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":88,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.745500+0000","last_change":"2024-05-08T18:29:48.634271+0000","last_active":"2024-05-08T18:31:14.745500+0000","last_peered":"2024-05-08T18:31:14.745500+0000","last_clean":"2024-05-08T18:31:14.745500+0000","last_became_active":"2024-05-08T18:29:48.633607+0000","last_became_peered":"2024-05-08T18:29:48.633607+0000","last_unstale":"2024-05-08T18:31:14.745500+0000","last_undegraded":"2024-05-08T18:31:14.745500+0000","last_fullsized":"2024-05-08T18:31:14.745500+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:34.806539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":83,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.631978+0000","last_change":"2024-05-08T18:29:50.685494+0000","last_active":"2024-05-08T18:31:15.631978+0000","last_peered":"2024-05-08T18:31:15.631978+0000","last_clean":"2024-05-08T18:31:15.631978+0000","last_became_active":"2024-05-08T18:29:50.684818+0000","last_became_peered":"2024-05-08T18:29:50.684818+0000","last_unstale":"2024-05-08T18:31:15.631978+0000","last_undegraded":"2024-05-08T18:31:15.631978+0000","last_fullsized":"2024-05-08T18:31:15.631978+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:22.220842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":82,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.723200+0000","last_change":"2024-05-08T18:29:50.682937+0000","last_active":"2024-05-08T18:31:13.723200+0000","last_peered":"2024-05-08T18:31:13.723200+0000","last_clean":"2024-05-08T18:31:13.723200+0000","last_became_active":"2024-05-08T18:29:50.681771+0000","last_became_peered":"2024-05-08T18:29:50.681771+0000","last_unstale":"2024-05-08T18:31:13.723200+0000","last_undegraded":"2024-05-08T18:31:13.723200+0000","last_fullsized":"2024-05-08T18:31:13.723200+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:28:29.836446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":102,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.742504+0000","last_change":"2024-05-08T18:29:42.575909+0000","last_active":"2024-05-08T18:31:15.742504+0000","last_peered":"2024-05-08T18:31:15.742504+0000","last_clean":"2024-05-08T18:31:15.742504+0000","last_became_active":"2024-05-08T18:29:42.574877+0000","last_became_peered":"2024-05-08T18:29:42.574877+0000","last_unstale":"2024-05-08T18:31:15.742504+0000","last_undegraded":"2024-05-08T18:31:15.742504+0000","last_fullsized":"2024-05-08T18:31:15.742504+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:33.139089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":106,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.742264+0000","last_change":"2024-05-08T18:29:40.566496+0000","last_active":"2024-05-08T18:31:15.742264+0000","last_peered":"2024-05-08T18:31:15.742264+0000","last_clean":"2024-05-08T18:31:15.742264+0000","last_became_active":"2024-05-08T18:29:40.565874+0000","last_became_peered":"2024-05-08T18:29:40.565874+0000","last_unstale":"2024-05-08T18:31:15.742264+0000","last_undegraded":"2024-05-08T18:31:15.742264+0000","last_fullsized":"2024-05-08T18:31:15.742264+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:07.239963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":94,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.720168+0000","last_change":"2024-05-08T18:29:44.595410+0000","last_active":"2024-05-08T18:31:13.720168+0000","last_peered":"2024-05-08T18:31:13.720168+0000","last_clean":"2024-05-08T18:31:13.720168+0000","last_became_active":"2024-05-08T18:29:44.594286+0000","last_became_peered":"2024-05-08T18:29:44.594286+0000","last_unstale":"2024-05-08T18:31:13.720168+0000","last_undegraded":"2024-05-08T18:31:13.720168+0000","last_fullsized":"2024-05-08T18:31:13.720168+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:38.928160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"33'11","reported_seq":111,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.745393+0000","last_change":"2024-05-08T18:29:46.591009+0000","last_active":"2024-05-08T18:31:14.745393+0000","last_peered":"2024-05-08T18:31:14.745393+0000","last_clean":"2024-05-08T18:31:14.745393+0000","last_became_active":"2024-05-08T18:29:46.588810+0000","last_became_peered":"2024-05-08T18:29:46.588810+0000","last_unstale":"2024-05-08T18:31:14.745393+0000","last_undegraded":"2024-05-08T18:31:14.745393+0000","last_fullsized":"2024-05-08T18:31:14.745393+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:34:45.745300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":88,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.744717+0000","last_change":"2024-05-08T18:29:48.634986+0000","last_active":"2024-05-08T18:31:14.744717+0000","last_peered":"2024-05-08T18:31:14.744717+0000","last_clean":"2024-05-08T18:31:14.744717+0000","last_became_active":"2024-05-08T18:29:48.633866+0000","last_became_peered":"2024-05-08T18:29:48.633866+0000","last_unstale":"2024-05-08T18:31:14.744717+0000","last_undegraded":"2024-05-08T18:31:14.744717+0000","last_fullsized":"2024-05-08T18:31:14.744717+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:46.539830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":84,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.746135+0000","last_change":"2024-05-08T18:29:50.693408+0000","last_active":"2024-05-08T18:31:14.746135+0000","last_peered":"2024-05-08T18:31:14.746135+0000","last_clean":"2024-05-08T18:31:14.746135+0000","last_became_active":"2024-05-08T18:29:50.692687+0000","last_became_peered":"2024-05-08T18:29:50.692687+0000","last_unstale":"2024-05-08T18:31:14.746135+0000","last_undegraded":"2024-05-08T18:31:14.746135+0000","last_fullsized":"2024-05-08T18:31:14.746135+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:22.834262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":98,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.719956+0000","last_change":"2024-05-08T18:29:42.581368+0000","last_active":"2024-05-08T18:31:13.719956+0000","last_peered":"2024-05-08T18:31:13.719956+0000","last_clean":"2024-05-08T18:31:13.719956+0000","last_became_active":"2024-05-08T18:29:42.580887+0000","last_became_peered":"2024-05-08T18:29:42.580887+0000","last_unstale":"2024-05-08T18:31:13.719956+0000","last_undegraded":"2024-05-08T18:31:13.719956+0000","last_fullsized":"2024-05-08T18:31:13.719956+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:08:15.026467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":105,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.262343+0000","last_change":"2024-05-08T18:29:40.572770+0000","last_active":"2024-05-08T18:31:16.262343+0000","last_peered":"2024-05-08T18:31:16.262343+0000","last_clean":"2024-05-08T18:31:16.262343+0000","last_became_active":"2024-05-08T18:29:40.572079+0000","last_became_peered":"2024-05-08T18:29:40.572079+0000","last_unstale":"2024-05-08T18:31:16.262343+0000","last_undegraded":"2024-05-08T18:31:16.262343+0000","last_fullsized":"2024-05-08T18:31:16.262343+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:05.929806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":96,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.748089+0000","last_change":"2024-05-08T18:29:44.581323+0000","last_active":"2024-05-08T18:31:14.748089+0000","last_peered":"2024-05-08T18:31:14.748089+0000","last_clean":"2024-05-08T18:31:14.748089+0000","last_became_active":"2024-05-08T18:29:44.580805+0000","last_became_peered":"2024-05-08T18:29:44.580805+0000","last_unstale":"2024-05-08T18:31:14.748089+0000","last_undegraded":"2024-05-08T18:31:14.748089+0000","last_fullsized":"2024-05-08T18:31:14.748089+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:35:25.591140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"47'5","reported_seq":97,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.721567+0000","last_change":"2024-05-08T18:29:46.602495+0000","last_active":"2024-05-08T18:31:13.721567+0000","last_peered":"2024-05-08T18:31:13.721567+0000","last_clean":"2024-05-08T18:31:13.721567+0000","last_became_active":"2024-05-08T18:29:46.599789+0000","last_became_peered":"2024-05-08T18:29:46.599789+0000","last_unstale":"2024-05-08T18:31:13.721567+0000","last_undegraded":"2024-05-08T18:31:13.721567+0000","last_fullsized":"2024-05-08T18:31:13.721567+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:18:16.375808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":89,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.261028+0000","last_change":"2024-05-08T18:29:48.642994+0000","last_active":"2024-05-08T18:31:16.261028+0000","last_peered":"2024-05-08T18:31:16.261028+0000","last_clean":"2024-05-08T18:31:16.261028+0000","last_became_active":"2024-05-08T18:29:48.642056+0000","last_became_peered":"2024-05-08T18:29:48.642056+0000","last_unstale":"2024-05-08T18:31:16.261028+0000","last_undegraded":"2024-05-08T18:31:16.261028+0000","last_fullsized":"2024-05-08T18:31:16.261028+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:47:54.034851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":82,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.722073+0000","last_change":"2024-05-08T18:29:50.672513+0000","last_active":"2024-05-08T18:31:13.722073+0000","last_peered":"2024-05-08T18:31:13.722073+0000","last_clean":"2024-05-08T18:31:13.722073+0000","last_became_active":"2024-05-08T18:29:50.671781+0000","last_became_peered":"2024-05-08T18:29:50.671781+0000","last_unstale":"2024-05-08T18:31:13.722073+0000","last_undegraded":"2024-05-08T18:31:13.722073+0000","last_fullsized":"2024-05-08T18:31:13.722073+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:45:34.171402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.745742+0000","last_change":"2024-05-08T18:29:42.576843+0000","last_active":"2024-05-08T18:31:14.745742+0000","last_peered":"2024-05-08T18:31:14.745742+0000","last_clean":"2024-05-08T18:31:14.745742+0000","last_became_active":"2024-05-08T18:29:42.576379+0000","last_became_peered":"2024-05-08T18:29:42.576379+0000","last_unstale":"2024-05-08T18:31:14.745742+0000","last_undegraded":"2024-05-08T18:31:14.745742+0000","last_fullsized":"2024-05-08T18:31:14.745742+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:20.471010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.633032+0000","last_change":"2024-05-08T18:29:40.542997+0000","last_active":"2024-05-08T18:31:15.633032+0000","last_peered":"2024-05-08T18:31:15.633032+0000","last_clean":"2024-05-08T18:31:15.633032+0000","last_became_active":"2024-05-08T18:29:40.542239+0000","last_became_peered":"2024-05-08T18:29:40.542239+0000","last_unstale":"2024-05-08T18:31:15.633032+0000","last_undegraded":"2024-05-08T18:31:15.633032+0000","last_fullsized":"2024-05-08T18:31:15.633032+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:14:43.555504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":97,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.260475+0000","last_change":"2024-05-08T18:29:44.594178+0000","last_active":"2024-05-08T18:31:16.260475+0000","last_peered":"2024-05-08T18:31:16.260475+0000","last_clean":"2024-05-08T18:31:16.260475+0000","last_became_active":"2024-05-08T18:29:44.592476+0000","last_became_peered":"2024-05-08T18:29:44.592476+0000","last_unstale":"2024-05-08T18:31:16.260475+0000","last_undegraded":"2024-05-08T18:31:16.260475+0000","last_fullsized":"2024-05-08T18:31:16.260475+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:04:16.093662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"33'11","reported_seq":111,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.745728+0000","last_change":"2024-05-08T18:29:46.597288+0000","last_active":"2024-05-08T18:31:14.745728+0000","last_peered":"2024-05-08T18:31:14.745728+0000","last_clean":"2024-05-08T18:31:14.745728+0000","last_became_active":"2024-05-08T18:29:46.596452+0000","last_became_peered":"2024-05-08T18:29:46.596452+0000","last_unstale":"2024-05-08T18:31:14.745728+0000","last_undegraded":"2024-05-08T18:31:14.745728+0000","last_fullsized":"2024-05-08T18:31:14.745728+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:32:43.245753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":88,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.736656+0000","last_change":"2024-05-08T18:29:48.635436+0000","last_active":"2024-05-08T18:31:14.736656+0000","last_peered":"2024-05-08T18:31:14.736656+0000","last_clean":"2024-05-08T18:31:14.736656+0000","last_became_active":"2024-05-08T18:29:48.634704+0000","last_became_peered":"2024-05-08T18:29:48.634704+0000","last_unstale":"2024-05-08T18:31:14.736656+0000","last_undegraded":"2024-05-08T18:31:14.736656+0000","last_fullsized":"2024-05-08T18:31:14.736656+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:55:52.238481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":83,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.631667+0000","last_change":"2024-05-08T18:29:50.687974+0000","last_active":"2024-05-08T18:31:15.631667+0000","last_peered":"2024-05-08T18:31:15.631667+0000","last_clean":"2024-05-08T18:31:15.631667+0000","last_became_active":"2024-05-08T18:29:50.687045+0000","last_became_peered":"2024-05-08T18:29:50.687045+0000","last_unstale":"2024-05-08T18:31:15.631667+0000","last_undegraded":"2024-05-08T18:31:15.631667+0000","last_fullsized":"2024-05-08T18:31:15.631667+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:55:01.894779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":105,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.745008+0000","last_change":"2024-05-08T18:30:20.850226+0000","last_active":"2024-05-08T18:31:14.745008+0000","last_peered":"2024-05-08T18:31:14.745008+0000","last_clean":"2024-05-08T18:31:14.745008+0000","last_became_active":"2024-05-08T18:30:20.849751+0000","last_became_peered":"2024-05-08T18:30:20.849751+0000","last_unstale":"2024-05-08T18:31:14.745008+0000","last_undegraded":"2024-05-08T18:31:14.745008+0000","last_fullsized":"2024-05-08T18:31:14.745008+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:33:31.550958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":102,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.725705+0000","last_change":"2024-05-08T18:29:40.541112+0000","last_active":"2024-05-08T18:31:13.725705+0000","last_peered":"2024-05-08T18:31:13.725705+0000","last_clean":"2024-05-08T18:31:13.725705+0000","last_became_active":"2024-05-08T18:29:40.540835+0000","last_became_peered":"2024-05-08T18:29:40.540835+0000","last_unstale":"2024-05-08T18:31:13.725705+0000","last_undegraded":"2024-05-08T18:31:13.725705+0000","last_fullsized":"2024-05-08T18:31:13.725705+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:43:14.995191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":96,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.736618+0000","last_change":"2024-05-08T18:29:44.592033+0000","last_active":"2024-05-08T18:31:14.736618+0000","last_peered":"2024-05-08T18:31:14.736618+0000","last_clean":"2024-05-08T18:31:14.736618+0000","last_became_active":"2024-05-08T18:29:44.590454+0000","last_became_peered":"2024-05-08T18:29:44.590454+0000","last_unstale":"2024-05-08T18:31:14.736618+0000","last_undegraded":"2024-05-08T18:31:14.736618+0000","last_fullsized":"2024-05-08T18:31:14.736618+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:11:03.740365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"33'9","reported_seq":109,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.260988+0000","last_change":"2024-05-08T18:29:46.607002+0000","last_active":"2024-05-08T18:31:16.260988+0000","last_peered":"2024-05-08T18:31:16.260988+0000","last_clean":"2024-05-08T18:31:16.260988+0000","last_became_active":"2024-05-08T18:29:46.606172+0000","last_became_peered":"2024-05-08T18:29:46.606172+0000","last_unstale":"2024-05-08T18:31:16.260988+0000","last_undegraded":"2024-05-08T18:31:16.260988+0000","last_fullsized":"2024-05-08T18:31:16.260988+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:37:35.850414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":86,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.721204+0000","last_change":"2024-05-08T18:29:48.632948+0000","last_active":"2024-05-08T18:31:13.721204+0000","last_peered":"2024-05-08T18:31:13.721204+0000","last_clean":"2024-05-08T18:31:13.721204+0000","last_became_active":"2024-05-08T18:29:48.631219+0000","last_became_peered":"2024-05-08T18:29:48.631219+0000","last_unstale":"2024-05-08T18:31:13.721204+0000","last_undegraded":"2024-05-08T18:31:13.721204+0000","last_fullsized":"2024-05-08T18:31:13.721204+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:19:01.454355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.738247+0000","last_change":"2024-05-08T18:29:42.570180+0000","last_active":"2024-05-08T18:31:14.738247+0000","last_peered":"2024-05-08T18:31:14.738247+0000","last_clean":"2024-05-08T18:31:14.738247+0000","last_became_active":"2024-05-08T18:29:42.569425+0000","last_became_peered":"2024-05-08T18:29:42.569425+0000","last_unstale":"2024-05-08T18:31:14.738247+0000","last_undegraded":"2024-05-08T18:31:14.738247+0000","last_fullsized":"2024-05-08T18:31:14.738247+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:35.037465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.745158+0000","last_change":"2024-05-08T18:29:40.547711+0000","last_active":"2024-05-08T18:31:14.745158+0000","last_peered":"2024-05-08T18:31:14.745158+0000","last_clean":"2024-05-08T18:31:14.745158+0000","last_became_active":"2024-05-08T18:29:40.547479+0000","last_became_peered":"2024-05-08T18:29:40.547479+0000","last_unstale":"2024-05-08T18:31:14.745158+0000","last_undegraded":"2024-05-08T18:31:14.745158+0000","last_fullsized":"2024-05-08T18:31:14.745158+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:12:40.901620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":94,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.723393+0000","last_change":"2024-05-08T18:29:44.591547+0000","last_active":"2024-05-08T18:31:13.723393+0000","last_peered":"2024-05-08T18:31:13.723393+0000","last_clean":"2024-05-08T18:31:13.723393+0000","last_became_active":"2024-05-08T18:29:44.590498+0000","last_became_peered":"2024-05-08T18:29:44.590498+0000","last_unstale":"2024-05-08T18:31:13.723393+0000","last_undegraded":"2024-05-08T18:31:13.723393+0000","last_fullsized":"2024-05-08T18:31:13.723393+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:14:04.085401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"33'12","reported_seq":113,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.720480+0000","last_change":"2024-05-08T18:29:46.600437+0000","last_active":"2024-05-08T18:31:13.720480+0000","last_peered":"2024-05-08T18:31:13.720480+0000","last_clean":"2024-05-08T18:31:13.720480+0000","last_became_active":"2024-05-08T18:29:46.594672+0000","last_became_peered":"2024-05-08T18:29:46.594672+0000","last_unstale":"2024-05-08T18:31:13.720480+0000","last_undegraded":"2024-05-08T18:31:13.720480+0000","last_fullsized":"2024-05-08T18:31:13.720480+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:35:53.294312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":87,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.632181+0000","last_change":"2024-05-08T18:29:48.639840+0000","last_active":"2024-05-08T18:31:15.632181+0000","last_peered":"2024-05-08T18:31:15.632181+0000","last_clean":"2024-05-08T18:31:15.632181+0000","last_became_active":"2024-05-08T18:29:48.639120+0000","last_became_peered":"2024-05-08T18:29:48.639120+0000","last_unstale":"2024-05-08T18:31:15.632181+0000","last_undegraded":"2024-05-08T18:31:15.632181+0000","last_fullsized":"2024-05-08T18:31:15.632181+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:13:50.865474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":84,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.748089+0000","last_change":"2024-05-08T18:29:50.684843+0000","last_active":"2024-05-08T18:31:14.748089+0000","last_peered":"2024-05-08T18:31:14.748089+0000","last_clean":"2024-05-08T18:31:14.748089+0000","last_became_active":"2024-05-08T18:29:50.684119+0000","last_became_peered":"2024-05-08T18:29:50.684119+0000","last_unstale":"2024-05-08T18:31:14.748089+0000","last_undegraded":"2024-05-08T18:31:14.748089+0000","last_fullsized":"2024-05-08T18:31:14.748089+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:09:29.641515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":98,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.725717+0000","last_change":"2024-05-08T18:29:42.575763+0000","last_active":"2024-05-08T18:31:13.725717+0000","last_peered":"2024-05-08T18:31:13.725717+0000","last_clean":"2024-05-08T18:31:13.725717+0000","last_became_active":"2024-05-08T18:29:42.575450+0000","last_became_peered":"2024-05-08T18:29:42.575450+0000","last_unstale":"2024-05-08T18:31:13.725717+0000","last_undegraded":"2024-05-08T18:31:13.725717+0000","last_fullsized":"2024-05-08T18:31:13.725717+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:20.471010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":102,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.719930+0000","last_change":"2024-05-08T18:29:40.546101+0000","last_active":"2024-05-08T18:31:13.719930+0000","last_peered":"2024-05-08T18:31:13.719930+0000","last_clean":"2024-05-08T18:31:13.719930+0000","last_became_active":"2024-05-08T18:29:40.545814+0000","last_became_peered":"2024-05-08T18:29:40.545814+0000","last_unstale":"2024-05-08T18:31:13.719930+0000","last_undegraded":"2024-05-08T18:31:13.719930+0000","last_fullsized":"2024-05-08T18:31:13.719930+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:22.579629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":96,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.738020+0000","last_change":"2024-05-08T18:29:44.591310+0000","last_active":"2024-05-08T18:31:14.738020+0000","last_peered":"2024-05-08T18:31:14.738020+0000","last_clean":"2024-05-08T18:31:14.738020+0000","last_became_active":"2024-05-08T18:29:44.590394+0000","last_became_peered":"2024-05-08T18:29:44.590394+0000","last_unstale":"2024-05-08T18:31:14.738020+0000","last_undegraded":"2024-05-08T18:31:14.738020+0000","last_fullsized":"2024-05-08T18:31:14.738020+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:02:28.348982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"33'15","reported_seq":118,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.261535+0000","last_change":"2024-05-08T18:29:46.605887+0000","last_active":"2024-05-08T18:31:16.261535+0000","last_peered":"2024-05-08T18:31:16.261535+0000","last_clean":"2024-05-08T18:31:16.261535+0000","last_became_active":"2024-05-08T18:29:46.604917+0000","last_became_peered":"2024-05-08T18:29:46.604917+0000","last_unstale":"2024-05-08T18:31:16.261535+0000","last_undegraded":"2024-05-08T18:31:16.261535+0000","last_fullsized":"2024-05-08T18:31:16.261535+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:22:36.338527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":86,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.720587+0000","last_change":"2024-05-08T18:29:48.644420+0000","last_active":"2024-05-08T18:31:13.720587+0000","last_peered":"2024-05-08T18:31:13.720587+0000","last_clean":"2024-05-08T18:31:13.720587+0000","last_became_active":"2024-05-08T18:29:48.643493+0000","last_became_peered":"2024-05-08T18:29:48.643493+0000","last_unstale":"2024-05-08T18:31:13.720587+0000","last_undegraded":"2024-05-08T18:31:13.720587+0000","last_fullsized":"2024-05-08T18:31:13.720587+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:19:33.148012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":84,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.736566+0000","last_change":"2024-05-08T18:29:50.687485+0000","last_active":"2024-05-08T18:31:14.736566+0000","last_peered":"2024-05-08T18:31:14.736566+0000","last_clean":"2024-05-08T18:31:14.736566+0000","last_became_active":"2024-05-08T18:29:50.686750+0000","last_became_peered":"2024-05-08T18:29:50.686750+0000","last_unstale":"2024-05-08T18:31:14.736566+0000","last_undegraded":"2024-05-08T18:31:14.736566+0000","last_fullsized":"2024-05-08T18:31:14.736566+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:41.914164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.746032+0000","last_change":"2024-05-08T18:29:42.566571+0000","last_active":"2024-05-08T18:31:14.746032+0000","last_peered":"2024-05-08T18:31:14.746032+0000","last_clean":"2024-05-08T18:31:14.746032+0000","last_became_active":"2024-05-08T18:29:42.563695+0000","last_became_peered":"2024-05-08T18:29:42.563695+0000","last_unstale":"2024-05-08T18:31:14.746032+0000","last_undegraded":"2024-05-08T18:31:14.746032+0000","last_fullsized":"2024-05-08T18:31:14.746032+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:46.887628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":106,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.744024+0000","last_change":"2024-05-08T18:29:40.545512+0000","last_active":"2024-05-08T18:31:15.744024+0000","last_peered":"2024-05-08T18:31:15.744024+0000","last_clean":"2024-05-08T18:31:15.744024+0000","last_became_active":"2024-05-08T18:29:40.544216+0000","last_became_peered":"2024-05-08T18:29:40.544216+0000","last_unstale":"2024-05-08T18:31:15.744024+0000","last_undegraded":"2024-05-08T18:31:15.744024+0000","last_fullsized":"2024-05-08T18:31:15.744024+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:37:08.242362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":98,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.743045+0000","last_change":"2024-05-08T18:29:44.576107+0000","last_active":"2024-05-08T18:31:15.743045+0000","last_peered":"2024-05-08T18:31:15.743045+0000","last_clean":"2024-05-08T18:31:15.743045+0000","last_became_active":"2024-05-08T18:29:44.575344+0000","last_became_peered":"2024-05-08T18:29:44.575344+0000","last_unstale":"2024-05-08T18:31:15.743045+0000","last_undegraded":"2024-05-08T18:31:15.743045+0000","last_fullsized":"2024-05-08T18:31:15.743045+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:19.731003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"33'11","reported_seq":111,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.749020+0000","last_change":"2024-05-08T18:29:46.584785+0000","last_active":"2024-05-08T18:31:14.749020+0000","last_peered":"2024-05-08T18:31:14.749020+0000","last_clean":"2024-05-08T18:31:14.749020+0000","last_became_active":"2024-05-08T18:29:46.583390+0000","last_became_peered":"2024-05-08T18:29:46.583390+0000","last_unstale":"2024-05-08T18:31:14.749020+0000","last_undegraded":"2024-05-08T18:31:14.749020+0000","last_fullsized":"2024-05-08T18:31:14.749020+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:27:01.747339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":86,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.719664+0000","last_change":"2024-05-08T18:29:48.643558+0000","last_active":"2024-05-08T18:31:13.719664+0000","last_peered":"2024-05-08T18:31:13.719664+0000","last_clean":"2024-05-08T18:31:13.719664+0000","last_became_active":"2024-05-08T18:29:48.642773+0000","last_became_peered":"2024-05-08T18:29:48.642773+0000","last_unstale":"2024-05-08T18:31:13.719664+0000","last_undegraded":"2024-05-08T18:31:13.719664+0000","last_fullsized":"2024-05-08T18:31:13.719664+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:59:04.369806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":83,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.631314+0000","last_change":"2024-05-08T18:29:50.674796+0000","last_active":"2024-05-08T18:31:15.631314+0000","last_peered":"2024-05-08T18:31:15.631314+0000","last_clean":"2024-05-08T18:31:15.631314+0000","last_became_active":"2024-05-08T18:29:50.674057+0000","last_became_peered":"2024-05-08T18:29:50.674057+0000","last_unstale":"2024-05-08T18:31:15.631314+0000","last_undegraded":"2024-05-08T18:31:15.631314+0000","last_fullsized":"2024-05-08T18:31:15.631314+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:34:14.488295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.739651+0000","last_change":"2024-05-08T18:29:42.577642+0000","last_active":"2024-05-08T18:31:14.739651+0000","last_peered":"2024-05-08T18:31:14.739651+0000","last_clean":"2024-05-08T18:31:14.739651+0000","last_became_active":"2024-05-08T18:29:42.577275+0000","last_became_peered":"2024-05-08T18:29:42.577275+0000","last_unstale":"2024-05-08T18:31:14.739651+0000","last_undegraded":"2024-05-08T18:31:14.739651+0000","last_fullsized":"2024-05-08T18:31:14.739651+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:51:45.155037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":102,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.721945+0000","last_change":"2024-05-08T18:29:40.562873+0000","last_active":"2024-05-08T18:31:13.721945+0000","last_peered":"2024-05-08T18:31:13.721945+0000","last_clean":"2024-05-08T18:31:13.721945+0000","last_became_active":"2024-05-08T18:29:40.562594+0000","last_became_peered":"2024-05-08T18:29:40.562594+0000","last_unstale":"2024-05-08T18:31:13.721945+0000","last_undegraded":"2024-05-08T18:31:13.721945+0000","last_fullsized":"2024-05-08T18:31:13.721945+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:16:16.521258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":94,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.720676+0000","last_change":"2024-05-08T18:29:44.594152+0000","last_active":"2024-05-08T18:31:13.720676+0000","last_peered":"2024-05-08T18:31:13.720676+0000","last_clean":"2024-05-08T18:31:13.720676+0000","last_became_active":"2024-05-08T18:29:44.593398+0000","last_became_peered":"2024-05-08T18:29:44.593398+0000","last_unstale":"2024-05-08T18:31:13.720676+0000","last_undegraded":"2024-05-08T18:31:13.720676+0000","last_fullsized":"2024-05-08T18:31:13.720676+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:11.825480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"33'10","reported_seq":109,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.743318+0000","last_change":"2024-05-08T18:29:46.602137+0000","last_active":"2024-05-08T18:31:15.743318+0000","last_peered":"2024-05-08T18:31:15.743318+0000","last_clean":"2024-05-08T18:31:15.743318+0000","last_became_active":"2024-05-08T18:29:46.601402+0000","last_became_peered":"2024-05-08T18:29:46.601402+0000","last_unstale":"2024-05-08T18:31:15.743318+0000","last_undegraded":"2024-05-08T18:31:15.743318+0000","last_fullsized":"2024-05-08T18:31:15.743318+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:23.940519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"30'2","reported_seq":108,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.737958+0000","last_change":"2024-05-08T18:29:48.635696+0000","last_active":"2024-05-08T18:31:14.737958+0000","last_peered":"2024-05-08T18:31:14.737958+0000","last_clean":"2024-05-08T18:31:14.737958+0000","last_became_active":"2024-05-08T18:29:48.634859+0000","last_became_peered":"2024-05-08T18:29:48.634859+0000","last_unstale":"2024-05-08T18:31:14.737958+0000","last_undegraded":"2024-05-08T18:31:14.737958+0000","last_fullsized":"2024-05-08T18:31:14.737958+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:35:55.322495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":85,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.260443+0000","last_change":"2024-05-08T18:29:50.679757+0000","last_active":"2024-05-08T18:31:16.260443+0000","last_peered":"2024-05-08T18:31:16.260443+0000","last_clean":"2024-05-08T18:31:16.260443+0000","last_became_active":"2024-05-08T18:29:50.679011+0000","last_became_peered":"2024-05-08T18:29:50.679011+0000","last_unstale":"2024-05-08T18:31:16.260443+0000","last_undegraded":"2024-05-08T18:31:16.260443+0000","last_fullsized":"2024-05-08T18:31:16.260443+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:34:14.488295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":102,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.742383+0000","last_change":"2024-05-08T18:29:42.560354+0000","last_active":"2024-05-08T18:31:15.742383+0000","last_peered":"2024-05-08T18:31:15.742383+0000","last_clean":"2024-05-08T18:31:15.742383+0000","last_became_active":"2024-05-08T18:29:42.559647+0000","last_became_peered":"2024-05-08T18:29:42.559647+0000","last_unstale":"2024-05-08T18:31:15.742383+0000","last_undegraded":"2024-05-08T18:31:15.742383+0000","last_fullsized":"2024-05-08T18:31:15.742383+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:18:10.803989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.632603+0000","last_change":"2024-05-08T18:29:40.557683+0000","last_active":"2024-05-08T18:31:15.632603+0000","last_peered":"2024-05-08T18:31:15.632603+0000","last_clean":"2024-05-08T18:31:15.632603+0000","last_became_active":"2024-05-08T18:29:40.556254+0000","last_became_peered":"2024-05-08T18:29:40.556254+0000","last_unstale":"2024-05-08T18:31:15.632603+0000","last_undegraded":"2024-05-08T18:31:15.632603+0000","last_fullsized":"2024-05-08T18:31:15.632603+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:51:43.135322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":97,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.261072+0000","last_change":"2024-05-08T18:29:44.594068+0000","last_active":"2024-05-08T18:31:16.261072+0000","last_peered":"2024-05-08T18:31:16.261072+0000","last_clean":"2024-05-08T18:31:16.261072+0000","last_became_active":"2024-05-08T18:29:44.593322+0000","last_became_peered":"2024-05-08T18:29:44.593322+0000","last_unstale":"2024-05-08T18:31:16.261072+0000","last_undegraded":"2024-05-08T18:31:16.261072+0000","last_fullsized":"2024-05-08T18:31:16.261072+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:19.731003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"33'15","reported_seq":116,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.632445+0000","last_change":"2024-05-08T18:29:46.604700+0000","last_active":"2024-05-08T18:31:15.632445+0000","last_peered":"2024-05-08T18:31:15.632445+0000","last_clean":"2024-05-08T18:31:15.632445+0000","last_became_active":"2024-05-08T18:29:46.603885+0000","last_became_peered":"2024-05-08T18:29:46.603885+0000","last_unstale":"2024-05-08T18:31:15.632445+0000","last_undegraded":"2024-05-08T18:31:15.632445+0000","last_fullsized":"2024-05-08T18:31:15.632445+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:22:36.338527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":86,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.721285+0000","last_change":"2024-05-08T18:29:48.640814+0000","last_active":"2024-05-08T18:31:13.721285+0000","last_peered":"2024-05-08T18:31:13.721285+0000","last_clean":"2024-05-08T18:31:13.721285+0000","last_became_active":"2024-05-08T18:29:48.640046+0000","last_became_peered":"2024-05-08T18:29:48.640046+0000","last_unstale":"2024-05-08T18:31:13.721285+0000","last_undegraded":"2024-05-08T18:31:13.721285+0000","last_fullsized":"2024-05-08T18:31:13.721285+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:53:21.219706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":85,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.262435+0000","last_change":"2024-05-08T18:29:50.692688+0000","last_active":"2024-05-08T18:31:16.262435+0000","last_peered":"2024-05-08T18:31:16.262435+0000","last_clean":"2024-05-08T18:31:16.262435+0000","last_became_active":"2024-05-08T18:29:50.692123+0000","last_became_peered":"2024-05-08T18:29:50.692123+0000","last_unstale":"2024-05-08T18:31:16.262435+0000","last_undegraded":"2024-05-08T18:31:16.262435+0000","last_fullsized":"2024-05-08T18:31:16.262435+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:38.318890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":102,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.743798+0000","last_change":"2024-05-08T18:29:42.558336+0000","last_active":"2024-05-08T18:31:15.743798+0000","last_peered":"2024-05-08T18:31:15.743798+0000","last_clean":"2024-05-08T18:31:15.743798+0000","last_became_active":"2024-05-08T18:29:42.557570+0000","last_became_peered":"2024-05-08T18:29:42.557570+0000","last_unstale":"2024-05-08T18:31:15.743798+0000","last_undegraded":"2024-05-08T18:31:15.743798+0000","last_fullsized":"2024-05-08T18:31:15.743798+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:54:16.539832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.633369+0000","last_change":"2024-05-08T18:29:40.537090+0000","last_active":"2024-05-08T18:31:15.633369+0000","last_peered":"2024-05-08T18:31:15.633369+0000","last_clean":"2024-05-08T18:31:15.633369+0000","last_became_active":"2024-05-08T18:29:40.536188+0000","last_became_peered":"2024-05-08T18:29:40.536188+0000","last_unstale":"2024-05-08T18:31:15.633369+0000","last_undegraded":"2024-05-08T18:31:15.633369+0000","last_fullsized":"2024-05-08T18:31:15.633369+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:22:48.880581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":95,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.631974+0000","last_change":"2024-05-08T18:29:44.578901+0000","last_active":"2024-05-08T18:31:15.631974+0000","last_peered":"2024-05-08T18:31:15.631974+0000","last_clean":"2024-05-08T18:31:15.631974+0000","last_became_active":"2024-05-08T18:29:44.578171+0000","last_became_peered":"2024-05-08T18:29:44.578171+0000","last_unstale":"2024-05-08T18:31:15.631974+0000","last_undegraded":"2024-05-08T18:31:15.631974+0000","last_fullsized":"2024-05-08T18:31:15.631974+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:19.731003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"33'9","reported_seq":106,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.721373+0000","last_change":"2024-05-08T18:29:46.604539+0000","last_active":"2024-05-08T18:31:13.721373+0000","last_peered":"2024-05-08T18:31:13.721373+0000","last_clean":"2024-05-08T18:31:13.721373+0000","last_became_active":"2024-05-08T18:29:46.603728+0000","last_became_peered":"2024-05-08T18:29:46.603728+0000","last_unstale":"2024-05-08T18:31:13.721373+0000","last_undegraded":"2024-05-08T18:31:13.721373+0000","last_fullsized":"2024-05-08T18:31:13.721373+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:12:41.226788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":88,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.736294+0000","last_change":"2024-05-08T18:29:48.635813+0000","last_active":"2024-05-08T18:31:14.736294+0000","last_peered":"2024-05-08T18:31:14.736294+0000","last_clean":"2024-05-08T18:31:14.736294+0000","last_became_active":"2024-05-08T18:29:48.634664+0000","last_became_peered":"2024-05-08T18:29:48.634664+0000","last_unstale":"2024-05-08T18:31:14.736294+0000","last_undegraded":"2024-05-08T18:31:14.736294+0000","last_fullsized":"2024-05-08T18:31:14.736294+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:27:23.427365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":84,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.748621+0000","last_change":"2024-05-08T18:29:50.687517+0000","last_active":"2024-05-08T18:31:14.748621+0000","last_peered":"2024-05-08T18:31:14.748621+0000","last_clean":"2024-05-08T18:31:14.748621+0000","last_became_active":"2024-05-08T18:29:50.686662+0000","last_became_peered":"2024-05-08T18:29:50.686662+0000","last_unstale":"2024-05-08T18:31:14.748621+0000","last_undegraded":"2024-05-08T18:31:14.748621+0000","last_fullsized":"2024-05-08T18:31:14.748621+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:58:00.455559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.748322+0000","last_change":"2024-05-08T18:29:42.558848+0000","last_active":"2024-05-08T18:31:14.748322+0000","last_peered":"2024-05-08T18:31:14.748322+0000","last_clean":"2024-05-08T18:31:14.748322+0000","last_became_active":"2024-05-08T18:29:42.558390+0000","last_became_peered":"2024-05-08T18:29:42.558390+0000","last_unstale":"2024-05-08T18:31:14.748322+0000","last_undegraded":"2024-05-08T18:31:14.748322+0000","last_fullsized":"2024-05-08T18:31:14.748322+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:55:30.468069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.748541+0000","last_change":"2024-05-08T18:29:40.567772+0000","last_active":"2024-05-08T18:31:14.748541+0000","last_peered":"2024-05-08T18:31:14.748541+0000","last_clean":"2024-05-08T18:31:14.748541+0000","last_became_active":"2024-05-08T18:29:40.567482+0000","last_became_peered":"2024-05-08T18:29:40.567482+0000","last_unstale":"2024-05-08T18:31:14.748541+0000","last_undegraded":"2024-05-08T18:31:14.748541+0000","last_fullsized":"2024-05-08T18:31:14.748541+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:36:37.796095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":98,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.741568+0000","last_change":"2024-05-08T18:29:44.596876+0000","last_active":"2024-05-08T18:31:15.741568+0000","last_peered":"2024-05-08T18:31:15.741568+0000","last_clean":"2024-05-08T18:31:15.741568+0000","last_became_active":"2024-05-08T18:29:44.595712+0000","last_became_peered":"2024-05-08T18:29:44.595712+0000","last_unstale":"2024-05-08T18:31:15.741568+0000","last_undegraded":"2024-05-08T18:31:15.741568+0000","last_fullsized":"2024-05-08T18:31:15.741568+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:35:51.288126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"33'5","reported_seq":102,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.748589+0000","last_change":"2024-05-08T18:29:46.598637+0000","last_active":"2024-05-08T18:31:14.748589+0000","last_peered":"2024-05-08T18:31:14.748589+0000","last_clean":"2024-05-08T18:31:14.748589+0000","last_became_active":"2024-05-08T18:29:46.597394+0000","last_became_peered":"2024-05-08T18:29:46.597394+0000","last_unstale":"2024-05-08T18:31:14.748589+0000","last_undegraded":"2024-05-08T18:31:14.748589+0000","last_fullsized":"2024-05-08T18:31:14.748589+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:52:22.540814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":90,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.741955+0000","last_change":"2024-05-08T18:29:48.642251+0000","last_active":"2024-05-08T18:31:15.741955+0000","last_peered":"2024-05-08T18:31:15.741955+0000","last_clean":"2024-05-08T18:31:15.741955+0000","last_became_active":"2024-05-08T18:29:48.641666+0000","last_became_peered":"2024-05-08T18:29:48.641666+0000","last_unstale":"2024-05-08T18:31:15.741955+0000","last_undegraded":"2024-05-08T18:31:15.741955+0000","last_fullsized":"2024-05-08T18:31:15.741955+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:13:50.865474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":85,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.262027+0000","last_change":"2024-05-08T18:29:50.685668+0000","last_active":"2024-05-08T18:31:16.262027+0000","last_peered":"2024-05-08T18:31:16.262027+0000","last_clean":"2024-05-08T18:31:16.262027+0000","last_became_active":"2024-05-08T18:29:50.684958+0000","last_became_peered":"2024-05-08T18:29:50.684958+0000","last_unstale":"2024-05-08T18:31:16.262027+0000","last_undegraded":"2024-05-08T18:31:16.262027+0000","last_fullsized":"2024-05-08T18:31:16.262027+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:55:01.894779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":102,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.742297+0000","last_change":"2024-05-08T18:29:42.562063+0000","last_active":"2024-05-08T18:31:15.742297+0000","last_peered":"2024-05-08T18:31:15.742297+0000","last_clean":"2024-05-08T18:31:15.742297+0000","last_became_active":"2024-05-08T18:29:42.558871+0000","last_became_peered":"2024-05-08T18:29:42.558871+0000","last_unstale":"2024-05-08T18:31:15.742297+0000","last_undegraded":"2024-05-08T18:31:15.742297+0000","last_fullsized":"2024-05-08T18:31:15.742297+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:59.243324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":102,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.725791+0000","last_change":"2024-05-08T18:29:40.541070+0000","last_active":"2024-05-08T18:31:13.725791+0000","last_peered":"2024-05-08T18:31:13.725791+0000","last_clean":"2024-05-08T18:31:13.725791+0000","last_became_active":"2024-05-08T18:29:40.540767+0000","last_became_peered":"2024-05-08T18:29:40.540767+0000","last_unstale":"2024-05-08T18:31:13.725791+0000","last_undegraded":"2024-05-08T18:31:13.725791+0000","last_fullsized":"2024-05-08T18:31:13.725791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:09:39.835826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"26'1","reported_seq":95,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.719407+0000","last_change":"2024-05-08T18:29:44.592737+0000","last_active":"2024-05-08T18:31:13.719407+0000","last_peered":"2024-05-08T18:31:13.719407+0000","last_clean":"2024-05-08T18:31:13.719407+0000","last_became_active":"2024-05-08T18:29:44.592243+0000","last_became_peered":"2024-05-08T18:29:44.592243+0000","last_unstale":"2024-05-08T18:31:13.719407+0000","last_undegraded":"2024-05-08T18:31:13.719407+0000","last_fullsized":"2024-05-08T18:31:13.719407+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:59.744050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"33'9","reported_seq":110,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.742897+0000","last_change":"2024-05-08T18:29:46.610835+0000","last_active":"2024-05-08T18:31:15.742897+0000","last_peered":"2024-05-08T18:31:15.742897+0000","last_clean":"2024-05-08T18:31:15.742897+0000","last_became_active":"2024-05-08T18:29:46.609903+0000","last_became_peered":"2024-05-08T18:29:46.609903+0000","last_unstale":"2024-05-08T18:31:15.742897+0000","last_undegraded":"2024-05-08T18:31:15.742897+0000","last_fullsized":"2024-05-08T18:31:15.742897+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:37:35.850414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":86,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.721105+0000","last_change":"2024-05-08T18:29:48.629822+0000","last_active":"2024-05-08T18:31:13.721105+0000","last_peered":"2024-05-08T18:31:13.721105+0000","last_clean":"2024-05-08T18:31:13.721105+0000","last_became_active":"2024-05-08T18:29:48.629204+0000","last_became_peered":"2024-05-08T18:29:48.629204+0000","last_unstale":"2024-05-08T18:31:13.721105+0000","last_undegraded":"2024-05-08T18:31:13.721105+0000","last_fullsized":"2024-05-08T18:31:13.721105+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:04.571608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":86,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.743139+0000","last_change":"2024-05-08T18:29:50.668101+0000","last_active":"2024-05-08T18:31:15.743139+0000","last_peered":"2024-05-08T18:31:15.743139+0000","last_clean":"2024-05-08T18:31:15.743139+0000","last_became_active":"2024-05-08T18:29:50.667357+0000","last_became_peered":"2024-05-08T18:29:50.667357+0000","last_unstale":"2024-05-08T18:31:15.743139+0000","last_undegraded":"2024-05-08T18:31:15.743139+0000","last_fullsized":"2024-05-08T18:31:15.743139+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:55:01.894779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":98,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.722914+0000","last_change":"2024-05-08T18:29:42.581366+0000","last_active":"2024-05-08T18:31:13.722914+0000","last_peered":"2024-05-08T18:31:13.722914+0000","last_clean":"2024-05-08T18:31:13.722914+0000","last_became_active":"2024-05-08T18:29:42.580988+0000","last_became_peered":"2024-05-08T18:29:42.580988+0000","last_unstale":"2024-05-08T18:31:13.722914+0000","last_undegraded":"2024-05-08T18:31:13.722914+0000","last_fullsized":"2024-05-08T18:31:13.722914+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:42.005809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.736314+0000","last_change":"2024-05-08T18:29:40.562025+0000","last_active":"2024-05-08T18:31:14.736314+0000","last_peered":"2024-05-08T18:31:14.736314+0000","last_clean":"2024-05-08T18:31:14.736314+0000","last_became_active":"2024-05-08T18:29:40.561277+0000","last_became_peered":"2024-05-08T18:29:40.561277+0000","last_unstale":"2024-05-08T18:31:14.736314+0000","last_undegraded":"2024-05-08T18:31:14.736314+0000","last_fullsized":"2024-05-08T18:31:14.736314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:59:25.840149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":98,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.720087+0000","last_change":"2024-05-08T18:29:42.573832+0000","last_active":"2024-05-08T18:31:13.720087+0000","last_peered":"2024-05-08T18:31:13.720087+0000","last_clean":"2024-05-08T18:31:13.720087+0000","last_became_active":"2024-05-08T18:29:42.573502+0000","last_became_peered":"2024-05-08T18:29:42.573502+0000","last_unstale":"2024-05-08T18:31:13.720087+0000","last_undegraded":"2024-05-08T18:31:13.720087+0000","last_fullsized":"2024-05-08T18:31:13.720087+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:35.037465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.738141+0000","last_change":"2024-05-08T18:29:40.533094+0000","last_active":"2024-05-08T18:31:14.738141+0000","last_peered":"2024-05-08T18:31:14.738141+0000","last_clean":"2024-05-08T18:31:14.738141+0000","last_became_active":"2024-05-08T18:29:40.532246+0000","last_became_peered":"2024-05-08T18:29:40.532246+0000","last_unstale":"2024-05-08T18:31:14.738141+0000","last_undegraded":"2024-05-08T18:31:14.738141+0000","last_fullsized":"2024-05-08T18:31:14.738141+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:37:08.242362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.632795+0000","last_change":"2024-05-08T18:29:42.565298+0000","last_active":"2024-05-08T18:31:15.632795+0000","last_peered":"2024-05-08T18:31:15.632795+0000","last_clean":"2024-05-08T18:31:15.632795+0000","last_became_active":"2024-05-08T18:29:42.564542+0000","last_became_peered":"2024-05-08T18:29:42.564542+0000","last_unstale":"2024-05-08T18:31:15.632795+0000","last_undegraded":"2024-05-08T18:31:15.632795+0000","last_fullsized":"2024-05-08T18:31:15.632795+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:57.706167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.632572+0000","last_change":"2024-05-08T18:29:40.556958+0000","last_active":"2024-05-08T18:31:15.632572+0000","last_peered":"2024-05-08T18:31:15.632572+0000","last_clean":"2024-05-08T18:31:15.632572+0000","last_became_active":"2024-05-08T18:29:40.556091+0000","last_became_peered":"2024-05-08T18:29:40.556091+0000","last_unstale":"2024-05-08T18:31:15.632572+0000","last_undegraded":"2024-05-08T18:31:15.632572+0000","last_fullsized":"2024-05-08T18:31:15.632572+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:39.986094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":98,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.720324+0000","last_change":"2024-05-08T18:29:42.574619+0000","last_active":"2024-05-08T18:31:13.720324+0000","last_peered":"2024-05-08T18:31:13.720324+0000","last_clean":"2024-05-08T18:31:13.720324+0000","last_became_active":"2024-05-08T18:29:42.573178+0000","last_became_peered":"2024-05-08T18:29:42.573178+0000","last_unstale":"2024-05-08T18:31:13.720324+0000","last_undegraded":"2024-05-08T18:31:13.720324+0000","last_fullsized":"2024-05-08T18:31:13.720324+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:33.139089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":102,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.722117+0000","last_change":"2024-05-08T18:29:40.544338+0000","last_active":"2024-05-08T18:31:13.722117+0000","last_peered":"2024-05-08T18:31:13.722117+0000","last_clean":"2024-05-08T18:31:13.722117+0000","last_became_active":"2024-05-08T18:29:40.544107+0000","last_became_peered":"2024-05-08T18:29:40.544107+0000","last_unstale":"2024-05-08T18:31:13.722117+0000","last_undegraded":"2024-05-08T18:31:13.722117+0000","last_fullsized":"2024-05-08T18:31:13.722117+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:54.200883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.748300+0000","last_change":"2024-05-08T18:29:42.576979+0000","last_active":"2024-05-08T18:31:14.748300+0000","last_peered":"2024-05-08T18:31:14.748300+0000","last_clean":"2024-05-08T18:31:14.748300+0000","last_became_active":"2024-05-08T18:29:42.576395+0000","last_became_peered":"2024-05-08T18:29:42.576395+0000","last_unstale":"2024-05-08T18:31:14.748300+0000","last_undegraded":"2024-05-08T18:31:14.748300+0000","last_fullsized":"2024-05-08T18:31:14.748300+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:53:03.097704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.746535+0000","last_change":"2024-05-08T18:29:40.558142+0000","last_active":"2024-05-08T18:31:14.746535+0000","last_peered":"2024-05-08T18:31:14.746535+0000","last_clean":"2024-05-08T18:31:14.746535+0000","last_became_active":"2024-05-08T18:29:40.557874+0000","last_became_peered":"2024-05-08T18:29:40.557874+0000","last_unstale":"2024-05-08T18:31:14.746535+0000","last_undegraded":"2024-05-08T18:31:14.746535+0000","last_fullsized":"2024-05-08T18:31:14.746535+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:54.200883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":102,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.743913+0000","last_change":"2024-05-08T18:29:42.558324+0000","last_active":"2024-05-08T18:31:15.743913+0000","last_peered":"2024-05-08T18:31:15.743913+0000","last_clean":"2024-05-08T18:31:15.743913+0000","last_became_active":"2024-05-08T18:29:42.556774+0000","last_became_peered":"2024-05-08T18:29:42.556774+0000","last_unstale":"2024-05-08T18:31:15.743913+0000","last_undegraded":"2024-05-08T18:31:15.743913+0000","last_fullsized":"2024-05-08T18:31:15.743913+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:02:26.311100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":107,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.720928+0000","last_change":"2024-05-08T18:30:20.858467+0000","last_active":"2024-05-08T18:31:13.720928+0000","last_peered":"2024-05-08T18:31:13.720928+0000","last_clean":"2024-05-08T18:31:13.720928+0000","last_became_active":"2024-05-08T18:30:20.858016+0000","last_became_peered":"2024-05-08T18:30:20.858016+0000","last_unstale":"2024-05-08T18:31:13.720928+0000","last_undegraded":"2024-05-08T18:31:13.720928+0000","last_fullsized":"2024-05-08T18:31:13.720928+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:10:28.824915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.745649+0000","last_change":"2024-05-08T18:29:42.562772+0000","last_active":"2024-05-08T18:31:14.745649+0000","last_peered":"2024-05-08T18:31:14.745649+0000","last_clean":"2024-05-08T18:31:14.745649+0000","last_became_active":"2024-05-08T18:29:42.562420+0000","last_became_peered":"2024-05-08T18:29:42.562420+0000","last_unstale":"2024-05-08T18:31:14.745649+0000","last_undegraded":"2024-05-08T18:31:14.745649+0000","last_fullsized":"2024-05-08T18:31:14.745649+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:30:29.452640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.737804+0000","last_change":"2024-05-08T18:29:40.562024+0000","last_active":"2024-05-08T18:31:14.737804+0000","last_peered":"2024-05-08T18:31:14.737804+0000","last_clean":"2024-05-08T18:31:14.737804+0000","last_became_active":"2024-05-08T18:29:40.561326+0000","last_became_peered":"2024-05-08T18:29:40.561326+0000","last_unstale":"2024-05-08T18:31:14.737804+0000","last_undegraded":"2024-05-08T18:31:14.737804+0000","last_fullsized":"2024-05-08T18:31:14.737804+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:21:38.354933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.736186+0000","last_change":"2024-05-08T18:29:42.561419+0000","last_active":"2024-05-08T18:31:14.736186+0000","last_peered":"2024-05-08T18:31:14.736186+0000","last_clean":"2024-05-08T18:31:14.736186+0000","last_became_active":"2024-05-08T18:29:42.560520+0000","last_became_peered":"2024-05-08T18:29:42.560520+0000","last_unstale":"2024-05-08T18:31:14.736186+0000","last_undegraded":"2024-05-08T18:31:14.736186+0000","last_fullsized":"2024-05-08T18:31:14.736186+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:07.949520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.748826+0000","last_change":"2024-05-08T18:29:40.554884+0000","last_active":"2024-05-08T18:31:14.748826+0000","last_peered":"2024-05-08T18:31:14.748826+0000","last_clean":"2024-05-08T18:31:14.748826+0000","last_became_active":"2024-05-08T18:29:40.554603+0000","last_became_peered":"2024-05-08T18:29:40.554603+0000","last_unstale":"2024-05-08T18:31:14.748826+0000","last_undegraded":"2024-05-08T18:31:14.748826+0000","last_fullsized":"2024-05-08T18:31:14.748826+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:09:39.835826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":98,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.723375+0000","last_change":"2024-05-08T18:29:42.574689+0000","last_active":"2024-05-08T18:31:13.723375+0000","last_peered":"2024-05-08T18:31:13.723375+0000","last_clean":"2024-05-08T18:31:13.723375+0000","last_became_active":"2024-05-08T18:29:42.573947+0000","last_became_peered":"2024-05-08T18:29:42.573947+0000","last_unstale":"2024-05-08T18:31:13.723375+0000","last_undegraded":"2024-05-08T18:31:13.723375+0000","last_fullsized":"2024-05-08T18:31:13.723375+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:57:14.869860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.633077+0000","last_change":"2024-05-08T18:29:40.554005+0000","last_active":"2024-05-08T18:31:15.633077+0000","last_peered":"2024-05-08T18:31:15.633077+0000","last_clean":"2024-05-08T18:31:15.633077+0000","last_became_active":"2024-05-08T18:29:40.553356+0000","last_became_peered":"2024-05-08T18:29:40.553356+0000","last_unstale":"2024-05-08T18:31:15.633077+0000","last_undegraded":"2024-05-08T18:31:15.633077+0000","last_fullsized":"2024-05-08T18:31:15.633077+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:08:13.006752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":102,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.743476+0000","last_change":"2024-05-08T18:29:42.566487+0000","last_active":"2024-05-08T18:31:15.743476+0000","last_peered":"2024-05-08T18:31:15.743476+0000","last_clean":"2024-05-08T18:31:15.743476+0000","last_became_active":"2024-05-08T18:29:42.565760+0000","last_became_peered":"2024-05-08T18:29:42.565760+0000","last_unstale":"2024-05-08T18:31:15.743476+0000","last_undegraded":"2024-05-08T18:31:15.743476+0000","last_fullsized":"2024-05-08T18:31:15.743476+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:57.706167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.748401+0000","last_change":"2024-05-08T18:29:40.552543+0000","last_active":"2024-05-08T18:31:14.748401+0000","last_peered":"2024-05-08T18:31:14.748401+0000","last_clean":"2024-05-08T18:31:14.748401+0000","last_became_active":"2024-05-08T18:29:40.552307+0000","last_became_peered":"2024-05-08T18:29:40.552307+0000","last_unstale":"2024-05-08T18:31:14.748401+0000","last_undegraded":"2024-05-08T18:31:14.748401+0000","last_fullsized":"2024-05-08T18:31:14.748401+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:48.294532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.739096+0000","last_change":"2024-05-08T18:29:42.561658+0000","last_active":"2024-05-08T18:31:14.739096+0000","last_peered":"2024-05-08T18:31:14.739096+0000","last_clean":"2024-05-08T18:31:14.739096+0000","last_became_active":"2024-05-08T18:29:42.561171+0000","last_became_peered":"2024-05-08T18:29:42.561171+0000","last_unstale":"2024-05-08T18:31:14.739096+0000","last_undegraded":"2024-05-08T18:31:14.739096+0000","last_fullsized":"2024-05-08T18:31:14.739096+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:15.966061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.632355+0000","last_change":"2024-05-08T18:29:40.543041+0000","last_active":"2024-05-08T18:31:15.632355+0000","last_peered":"2024-05-08T18:31:15.632355+0000","last_clean":"2024-05-08T18:31:15.632355+0000","last_became_active":"2024-05-08T18:29:40.542398+0000","last_became_peered":"2024-05-08T18:29:40.542398+0000","last_unstale":"2024-05-08T18:31:15.632355+0000","last_undegraded":"2024-05-08T18:31:15.632355+0000","last_fullsized":"2024-05-08T18:31:15.632355+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:33.017750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":102,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.742849+0000","last_change":"2024-05-08T18:29:42.579690+0000","last_active":"2024-05-08T18:31:15.742849+0000","last_peered":"2024-05-08T18:31:15.742849+0000","last_clean":"2024-05-08T18:31:15.742849+0000","last_became_active":"2024-05-08T18:29:42.578981+0000","last_became_peered":"2024-05-08T18:29:42.578981+0000","last_unstale":"2024-05-08T18:31:15.742849+0000","last_undegraded":"2024-05-08T18:31:15.742849+0000","last_fullsized":"2024-05-08T18:31:15.742849+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:36:03.084561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":102,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.722273+0000","last_change":"2024-05-08T18:29:40.548499+0000","last_active":"2024-05-08T18:31:13.722273+0000","last_peered":"2024-05-08T18:31:13.722273+0000","last_clean":"2024-05-08T18:31:13.722273+0000","last_became_active":"2024-05-08T18:29:40.548177+0000","last_became_peered":"2024-05-08T18:29:40.548177+0000","last_unstale":"2024-05-08T18:31:13.722273+0000","last_undegraded":"2024-05-08T18:31:13.722273+0000","last_fullsized":"2024-05-08T18:31:13.722273+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:27:41.414153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":101,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.261799+0000","last_change":"2024-05-08T18:29:42.575892+0000","last_active":"2024-05-08T18:31:16.261799+0000","last_peered":"2024-05-08T18:31:16.261799+0000","last_clean":"2024-05-08T18:31:16.261799+0000","last_became_active":"2024-05-08T18:29:42.573384+0000","last_became_peered":"2024-05-08T18:29:42.573384+0000","last_unstale":"2024-05-08T18:31:16.261799+0000","last_undegraded":"2024-05-08T18:31:16.261799+0000","last_fullsized":"2024-05-08T18:31:16.261799+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:55.055481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.737601+0000","last_change":"2024-05-08T18:29:40.565068+0000","last_active":"2024-05-08T18:31:14.737601+0000","last_peered":"2024-05-08T18:31:14.737601+0000","last_clean":"2024-05-08T18:31:14.737601+0000","last_became_active":"2024-05-08T18:29:40.563231+0000","last_became_peered":"2024-05-08T18:29:40.563231+0000","last_unstale":"2024-05-08T18:31:14.737601+0000","last_undegraded":"2024-05-08T18:31:14.737601+0000","last_fullsized":"2024-05-08T18:31:14.737601+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:17:47.828990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":98,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.721217+0000","last_change":"2024-05-08T18:29:42.564338+0000","last_active":"2024-05-08T18:31:13.721217+0000","last_peered":"2024-05-08T18:31:13.721217+0000","last_clean":"2024-05-08T18:31:13.721217+0000","last_became_active":"2024-05-08T18:29:42.563822+0000","last_became_peered":"2024-05-08T18:29:42.563822+0000","last_unstale":"2024-05-08T18:31:13.721217+0000","last_undegraded":"2024-05-08T18:31:13.721217+0000","last_fullsized":"2024-05-08T18:31:13.721217+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:23.397435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":105,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.262510+0000","last_change":"2024-05-08T18:29:40.573333+0000","last_active":"2024-05-08T18:31:16.262510+0000","last_peered":"2024-05-08T18:31:16.262510+0000","last_clean":"2024-05-08T18:31:16.262510+0000","last_became_active":"2024-05-08T18:29:40.571195+0000","last_became_peered":"2024-05-08T18:29:40.571195+0000","last_unstale":"2024-05-08T18:31:16.262510+0000","last_undegraded":"2024-05-08T18:31:16.262510+0000","last_fullsized":"2024-05-08T18:31:16.262510+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:33.017750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.745591+0000","last_change":"2024-05-08T18:29:42.563085+0000","last_active":"2024-05-08T18:31:14.745591+0000","last_peered":"2024-05-08T18:31:14.745591+0000","last_clean":"2024-05-08T18:31:14.745591+0000","last_became_active":"2024-05-08T18:29:42.560419+0000","last_became_peered":"2024-05-08T18:29:42.560419+0000","last_unstale":"2024-05-08T18:31:14.745591+0000","last_undegraded":"2024-05-08T18:31:14.745591+0000","last_fullsized":"2024-05-08T18:31:14.745591+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:20.397730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.740840+0000","last_change":"2024-05-08T18:29:40.568890+0000","last_active":"2024-05-08T18:31:14.740840+0000","last_peered":"2024-05-08T18:31:14.740840+0000","last_clean":"2024-05-08T18:31:14.740840+0000","last_became_active":"2024-05-08T18:29:40.568584+0000","last_became_peered":"2024-05-08T18:29:40.568584+0000","last_unstale":"2024-05-08T18:31:14.740840+0000","last_undegraded":"2024-05-08T18:31:14.740840+0000","last_fullsized":"2024-05-08T18:31:14.740840+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:25:01.595224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":101,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.260720+0000","last_change":"2024-05-08T18:29:42.574277+0000","last_active":"2024-05-08T18:31:16.260720+0000","last_peered":"2024-05-08T18:31:16.260720+0000","last_clean":"2024-05-08T18:31:16.260720+0000","last_became_active":"2024-05-08T18:29:42.573563+0000","last_became_peered":"2024-05-08T18:29:42.573563+0000","last_unstale":"2024-05-08T18:31:16.260720+0000","last_undegraded":"2024-05-08T18:31:16.260720+0000","last_fullsized":"2024-05-08T18:31:16.260720+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:57.706167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.633538+0000","last_change":"2024-05-08T18:29:40.562058+0000","last_active":"2024-05-08T18:31:15.633538+0000","last_peered":"2024-05-08T18:31:15.633538+0000","last_clean":"2024-05-08T18:31:15.633538+0000","last_became_active":"2024-05-08T18:29:40.561360+0000","last_became_peered":"2024-05-08T18:29:40.561360+0000","last_unstale":"2024-05-08T18:31:15.633538+0000","last_undegraded":"2024-05-08T18:31:15.633538+0000","last_fullsized":"2024-05-08T18:31:15.633538+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:05.929806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.633064+0000","last_change":"2024-05-08T18:29:40.538728+0000","last_active":"2024-05-08T18:31:15.633064+0000","last_peered":"2024-05-08T18:31:15.633064+0000","last_clean":"2024-05-08T18:31:15.633064+0000","last_became_active":"2024-05-08T18:29:40.537925+0000","last_became_peered":"2024-05-08T18:29:40.537925+0000","last_unstale":"2024-05-08T18:31:15.633064+0000","last_undegraded":"2024-05-08T18:31:15.633064+0000","last_fullsized":"2024-05-08T18:31:15.633064+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:28.426657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":98,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.723287+0000","last_change":"2024-05-08T18:29:42.574941+0000","last_active":"2024-05-08T18:31:13.723287+0000","last_peered":"2024-05-08T18:31:13.723287+0000","last_clean":"2024-05-08T18:31:13.723287+0000","last_became_active":"2024-05-08T18:29:42.574351+0000","last_became_peered":"2024-05-08T18:29:42.574351+0000","last_unstale":"2024-05-08T18:31:13.723287+0000","last_undegraded":"2024-05-08T18:31:13.723287+0000","last_fullsized":"2024-05-08T18:31:13.723287+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:21.935293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":102,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.719801+0000","last_change":"2024-05-08T18:29:40.543714+0000","last_active":"2024-05-08T18:31:13.719801+0000","last_peered":"2024-05-08T18:31:13.719801+0000","last_clean":"2024-05-08T18:31:13.719801+0000","last_became_active":"2024-05-08T18:29:40.542965+0000","last_became_peered":"2024-05-08T18:29:40.542965+0000","last_unstale":"2024-05-08T18:31:13.719801+0000","last_undegraded":"2024-05-08T18:31:13.719801+0000","last_fullsized":"2024-05-08T18:31:13.719801+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:12:59.146887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.632772+0000","last_change":"2024-05-08T18:29:42.560007+0000","last_active":"2024-05-08T18:31:15.632772+0000","last_peered":"2024-05-08T18:31:15.632772+0000","last_clean":"2024-05-08T18:31:15.632772+0000","last_became_active":"2024-05-08T18:29:42.559028+0000","last_became_peered":"2024-05-08T18:29:42.559028+0000","last_unstale":"2024-05-08T18:31:15.632772+0000","last_undegraded":"2024-05-08T18:31:15.632772+0000","last_fullsized":"2024-05-08T18:31:15.632772+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:36:03.084561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":689,"num_read_kb":448,"num_write":419,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":388,"ondisk_log_size":388,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509467,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32576,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339264,"statfs":{"total":96636764160,"available":96603406336,"internally_reserved":0,"allocated":1421312,"data_stored":1014867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509467,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":827392,"data_stored":439471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509465,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":872448,"data_stored":440299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509465,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":827392,"data_stored":446785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542170,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":819200,"data_stored":424235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542170,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":823296,"data_stored":440462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542168,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":831488,"data_stored":431905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542170,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28408,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343432,"statfs":{"total":96636764160,"available":96607674368,"internally_reserved":0,"allocated":1421312,"data_stored":1023518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T18:31:18.413 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T18:31:18.482 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:31:18.478+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:31:18.571 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:18.571 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:31:18.571 INFO:teuthology.orchestra.run.smithi097.stdout: "num_ops": 0 2024-05-08T18:31:18.571 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:18.582 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:31:18.578+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:31:18.590 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-08T18:31:18.683 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:31:18.678+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:31:18.764 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:18.764 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:31:18.764 INFO:teuthology.orchestra.run.smithi097.stdout: "complaint_time": 30, 2024-05-08T18:31:18.764 INFO:teuthology.orchestra.run.smithi097.stdout: "num_blocked_ops": 0 2024-05-08T18:31:18.764 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:18.776 INFO:teuthology.orchestra.run.smithi097.stderr:noscrub is unset 2024-05-08T18:31:18.784 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:31:18.782+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:31:18.786 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-08T18:31:18.903 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:31:18.902+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:31:18.969 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-05-08T18:31:18.975 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2024-05-08T18:31:18.986 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:31:18.982+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:31:18.992 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":122,"stamp":"2024-05-08T18:31:18.777813+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595683,"num_objects":195,"num_object_clones":0,"num_object_copies":390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":195,"num_whiteouts":0,"num_read":759,"num_read_kb":507,"num_write":530,"num_write_kb":1670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":482,"ondisk_log_size":482,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":232176,"kb_used_data":7660,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754742544,"statfs":{"total":773094113280,"available":772856365056,"internally_reserved":0,"allocated":7843840,"data_stored":4661542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":229756465},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.035295"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":105,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.262030+0000","last_change":"2024-05-08T18:29:40.574221+0000","last_active":"2024-05-08T18:31:16.262030+0000","last_peered":"2024-05-08T18:31:16.262030+0000","last_clean":"2024-05-08T18:31:16.262030+0000","last_became_active":"2024-05-08T18:29:40.573543+0000","last_became_peered":"2024-05-08T18:29:40.573543+0000","last_unstale":"2024-05-08T18:31:16.262030+0000","last_undegraded":"2024-05-08T18:31:16.262030+0000","last_fullsized":"2024-05-08T18:31:16.262030+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:57.223609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.631643+0000","last_change":"2024-05-08T18:29:42.563773+0000","last_active":"2024-05-08T18:31:15.631643+0000","last_peered":"2024-05-08T18:31:15.631643+0000","last_clean":"2024-05-08T18:31:15.631643+0000","last_became_active":"2024-05-08T18:29:42.561201+0000","last_became_peered":"2024-05-08T18:29:42.561201+0000","last_unstale":"2024-05-08T18:31:15.631643+0000","last_undegraded":"2024-05-08T18:31:15.631643+0000","last_fullsized":"2024-05-08T18:31:15.631643+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:55.055481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":102,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.723479+0000","last_change":"2024-05-08T18:29:40.549299+0000","last_active":"2024-05-08T18:31:13.723479+0000","last_peered":"2024-05-08T18:31:13.723479+0000","last_clean":"2024-05-08T18:31:13.723479+0000","last_became_active":"2024-05-08T18:29:40.548930+0000","last_became_peered":"2024-05-08T18:29:40.548930+0000","last_unstale":"2024-05-08T18:31:13.723479+0000","last_undegraded":"2024-05-08T18:31:13.723479+0000","last_fullsized":"2024-05-08T18:31:13.723479+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:06:36.198647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":101,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.261259+0000","last_change":"2024-05-08T18:29:42.572074+0000","last_active":"2024-05-08T18:31:16.261259+0000","last_peered":"2024-05-08T18:31:16.261259+0000","last_clean":"2024-05-08T18:31:16.261259+0000","last_became_active":"2024-05-08T18:29:42.571344+0000","last_became_peered":"2024-05-08T18:29:42.571344+0000","last_unstale":"2024-05-08T18:31:16.261259+0000","last_undegraded":"2024-05-08T18:31:16.261259+0000","last_fullsized":"2024-05-08T18:31:16.261259+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:36.890277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":102,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.723035+0000","last_change":"2024-05-08T18:29:40.539048+0000","last_active":"2024-05-08T18:31:13.723035+0000","last_peered":"2024-05-08T18:31:13.723035+0000","last_clean":"2024-05-08T18:31:13.723035+0000","last_became_active":"2024-05-08T18:29:40.538458+0000","last_became_peered":"2024-05-08T18:29:40.538458+0000","last_unstale":"2024-05-08T18:31:13.723035+0000","last_undegraded":"2024-05-08T18:31:13.723035+0000","last_fullsized":"2024-05-08T18:31:13.723035+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:36:37.796095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":102,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.743519+0000","last_change":"2024-05-08T18:29:42.569718+0000","last_active":"2024-05-08T18:31:15.743519+0000","last_peered":"2024-05-08T18:31:15.743519+0000","last_clean":"2024-05-08T18:31:15.743519+0000","last_became_active":"2024-05-08T18:29:42.569026+0000","last_became_peered":"2024-05-08T18:29:42.569026+0000","last_unstale":"2024-05-08T18:31:15.743519+0000","last_undegraded":"2024-05-08T18:31:15.743519+0000","last_fullsized":"2024-05-08T18:31:15.743519+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:42.045615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.632513+0000","last_change":"2024-05-08T18:29:40.557700+0000","last_active":"2024-05-08T18:31:15.632513+0000","last_peered":"2024-05-08T18:31:15.632513+0000","last_clean":"2024-05-08T18:31:15.632513+0000","last_became_active":"2024-05-08T18:29:40.556884+0000","last_became_peered":"2024-05-08T18:29:40.556884+0000","last_unstale":"2024-05-08T18:31:15.632513+0000","last_undegraded":"2024-05-08T18:31:15.632513+0000","last_fullsized":"2024-05-08T18:31:15.632513+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:21:38.354933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":98,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.722036+0000","last_change":"2024-05-08T18:29:42.566448+0000","last_active":"2024-05-08T18:31:13.722036+0000","last_peered":"2024-05-08T18:31:13.722036+0000","last_clean":"2024-05-08T18:31:13.722036+0000","last_became_active":"2024-05-08T18:29:42.566058+0000","last_became_peered":"2024-05-08T18:29:42.566058+0000","last_unstale":"2024-05-08T18:31:13.722036+0000","last_undegraded":"2024-05-08T18:31:13.722036+0000","last_fullsized":"2024-05-08T18:31:13.722036+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:53:03.097704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":105,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.262209+0000","last_change":"2024-05-08T18:29:40.571195+0000","last_active":"2024-05-08T18:31:16.262209+0000","last_peered":"2024-05-08T18:31:16.262209+0000","last_clean":"2024-05-08T18:31:16.262209+0000","last_became_active":"2024-05-08T18:29:40.570467+0000","last_became_peered":"2024-05-08T18:29:40.570467+0000","last_unstale":"2024-05-08T18:31:16.262209+0000","last_undegraded":"2024-05-08T18:31:16.262209+0000","last_fullsized":"2024-05-08T18:31:16.262209+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:39.986094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.737238+0000","last_change":"2024-05-08T18:29:42.566506+0000","last_active":"2024-05-08T18:31:14.737238+0000","last_peered":"2024-05-08T18:31:14.737238+0000","last_clean":"2024-05-08T18:31:14.737238+0000","last_became_active":"2024-05-08T18:29:42.565740+0000","last_became_peered":"2024-05-08T18:29:42.565740+0000","last_unstale":"2024-05-08T18:31:14.737238+0000","last_undegraded":"2024-05-08T18:31:14.737238+0000","last_fullsized":"2024-05-08T18:31:14.737238+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:58.320701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.631711+0000","last_change":"2024-05-08T18:29:40.538314+0000","last_active":"2024-05-08T18:31:15.631711+0000","last_peered":"2024-05-08T18:31:15.631711+0000","last_clean":"2024-05-08T18:31:15.631711+0000","last_became_active":"2024-05-08T18:29:40.537458+0000","last_became_peered":"2024-05-08T18:29:40.537458+0000","last_unstale":"2024-05-08T18:31:15.631711+0000","last_undegraded":"2024-05-08T18:31:15.631711+0000","last_fullsized":"2024-05-08T18:31:15.631711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:56.300986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":102,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.743024+0000","last_change":"2024-05-08T18:29:42.570054+0000","last_active":"2024-05-08T18:31:15.743024+0000","last_peered":"2024-05-08T18:31:15.743024+0000","last_clean":"2024-05-08T18:31:15.743024+0000","last_became_active":"2024-05-08T18:29:42.569255+0000","last_became_peered":"2024-05-08T18:29:42.569255+0000","last_unstale":"2024-05-08T18:31:15.743024+0000","last_undegraded":"2024-05-08T18:31:15.743024+0000","last_fullsized":"2024-05-08T18:31:15.743024+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:11:01.702482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":53,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.737972+0000","last_change":"2024-05-08T18:30:21.210397+0000","last_active":"2024-05-08T18:31:14.737972+0000","last_peered":"2024-05-08T18:31:14.737972+0000","last_clean":"2024-05-08T18:31:14.737972+0000","last_became_active":"2024-05-08T18:30:21.210052+0000","last_became_peered":"2024-05-08T18:30:21.210052+0000","last_unstale":"2024-05-08T18:31:14.737972+0000","last_undegraded":"2024-05-08T18:31:14.737972+0000","last_fullsized":"2024-05-08T18:31:14.737972+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:51:05.355593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.632484+0000","last_change":"2024-05-08T18:29:42.562084+0000","last_active":"2024-05-08T18:31:15.632484+0000","last_peered":"2024-05-08T18:31:15.632484+0000","last_clean":"2024-05-08T18:31:15.632484+0000","last_became_active":"2024-05-08T18:29:42.560699+0000","last_became_peered":"2024-05-08T18:29:42.560699+0000","last_unstale":"2024-05-08T18:31:15.632484+0000","last_undegraded":"2024-05-08T18:31:15.632484+0000","last_fullsized":"2024-05-08T18:31:15.632484+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:09.787597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.745083+0000","last_change":"2024-05-08T18:29:40.564339+0000","last_active":"2024-05-08T18:31:14.745083+0000","last_peered":"2024-05-08T18:31:14.745083+0000","last_clean":"2024-05-08T18:31:14.745083+0000","last_became_active":"2024-05-08T18:29:40.564038+0000","last_became_peered":"2024-05-08T18:29:40.564038+0000","last_unstale":"2024-05-08T18:31:14.745083+0000","last_undegraded":"2024-05-08T18:31:14.745083+0000","last_fullsized":"2024-05-08T18:31:14.745083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:40:23.287885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.740657+0000","last_change":"2024-05-08T18:29:42.570253+0000","last_active":"2024-05-08T18:31:14.740657+0000","last_peered":"2024-05-08T18:31:14.740657+0000","last_clean":"2024-05-08T18:31:14.740657+0000","last_became_active":"2024-05-08T18:29:42.569917+0000","last_became_peered":"2024-05-08T18:29:42.569917+0000","last_unstale":"2024-05-08T18:31:14.740657+0000","last_undegraded":"2024-05-08T18:31:14.740657+0000","last_fullsized":"2024-05-08T18:31:14.740657+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:14:45.575219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":102,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.742047+0000","last_change":"2024-05-08T18:29:42.568116+0000","last_active":"2024-05-08T18:31:15.742047+0000","last_peered":"2024-05-08T18:31:15.742047+0000","last_clean":"2024-05-08T18:31:15.742047+0000","last_became_active":"2024-05-08T18:29:42.567399+0000","last_became_peered":"2024-05-08T18:29:42.567399+0000","last_unstale":"2024-05-08T18:31:15.742047+0000","last_undegraded":"2024-05-08T18:31:15.742047+0000","last_fullsized":"2024-05-08T18:31:15.742047+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:35.037465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":105,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.262175+0000","last_change":"2024-05-08T18:29:40.571982+0000","last_active":"2024-05-08T18:31:16.262175+0000","last_peered":"2024-05-08T18:31:16.262175+0000","last_clean":"2024-05-08T18:31:16.262175+0000","last_became_active":"2024-05-08T18:29:40.570600+0000","last_became_peered":"2024-05-08T18:29:40.570600+0000","last_unstale":"2024-05-08T18:31:16.262175+0000","last_undegraded":"2024-05-08T18:31:16.262175+0000","last_fullsized":"2024-05-08T18:31:16.262175+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:54:14.520118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":101,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.261503+0000","last_change":"2024-05-08T18:29:42.578449+0000","last_active":"2024-05-08T18:31:16.261503+0000","last_peered":"2024-05-08T18:31:16.261503+0000","last_clean":"2024-05-08T18:31:16.261503+0000","last_became_active":"2024-05-08T18:29:42.577789+0000","last_became_peered":"2024-05-08T18:29:42.577789+0000","last_unstale":"2024-05-08T18:31:16.261503+0000","last_undegraded":"2024-05-08T18:31:16.261503+0000","last_fullsized":"2024-05-08T18:31:16.261503+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:09.787597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.737655+0000","last_change":"2024-05-08T18:29:40.570618+0000","last_active":"2024-05-08T18:31:14.737655+0000","last_peered":"2024-05-08T18:31:14.737655+0000","last_clean":"2024-05-08T18:31:14.737655+0000","last_became_active":"2024-05-08T18:29:40.569519+0000","last_became_peered":"2024-05-08T18:29:40.569519+0000","last_unstale":"2024-05-08T18:31:14.737655+0000","last_undegraded":"2024-05-08T18:31:14.737655+0000","last_fullsized":"2024-05-08T18:31:14.737655+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:09:42.581976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.632125+0000","last_change":"2024-05-08T18:29:42.563056+0000","last_active":"2024-05-08T18:31:15.632125+0000","last_peered":"2024-05-08T18:31:15.632125+0000","last_clean":"2024-05-08T18:31:15.632125+0000","last_became_active":"2024-05-08T18:29:42.562296+0000","last_became_peered":"2024-05-08T18:29:42.562296+0000","last_unstale":"2024-05-08T18:31:15.632125+0000","last_undegraded":"2024-05-08T18:31:15.632125+0000","last_fullsized":"2024-05-08T18:31:15.632125+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:36.890277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.738207+0000","last_change":"2024-05-08T18:29:40.564353+0000","last_active":"2024-05-08T18:31:14.738207+0000","last_peered":"2024-05-08T18:31:14.738207+0000","last_clean":"2024-05-08T18:31:14.738207+0000","last_became_active":"2024-05-08T18:29:40.563516+0000","last_became_peered":"2024-05-08T18:29:40.563516+0000","last_unstale":"2024-05-08T18:31:14.738207+0000","last_undegraded":"2024-05-08T18:31:14.738207+0000","last_fullsized":"2024-05-08T18:31:14.738207+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:06:36.198647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.739805+0000","last_change":"2024-05-08T18:29:42.567006+0000","last_active":"2024-05-08T18:31:14.739805+0000","last_peered":"2024-05-08T18:31:14.739805+0000","last_clean":"2024-05-08T18:31:14.739805+0000","last_became_active":"2024-05-08T18:29:42.566256+0000","last_became_peered":"2024-05-08T18:29:42.566256+0000","last_unstale":"2024-05-08T18:31:14.739805+0000","last_undegraded":"2024-05-08T18:31:14.739805+0000","last_fullsized":"2024-05-08T18:31:14.739805+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:09:44.601690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":106,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.742388+0000","last_change":"2024-05-08T18:29:40.573212+0000","last_active":"2024-05-08T18:31:15.742388+0000","last_peered":"2024-05-08T18:31:15.742388+0000","last_clean":"2024-05-08T18:31:15.742388+0000","last_became_active":"2024-05-08T18:29:40.572250+0000","last_became_peered":"2024-05-08T18:29:40.572250+0000","last_unstale":"2024-05-08T18:31:15.742388+0000","last_undegraded":"2024-05-08T18:31:15.742388+0000","last_fullsized":"2024-05-08T18:31:15.742388+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:25:01.595224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.739542+0000","last_change":"2024-05-08T18:29:42.570847+0000","last_active":"2024-05-08T18:31:14.739542+0000","last_peered":"2024-05-08T18:31:14.739542+0000","last_clean":"2024-05-08T18:31:14.739542+0000","last_became_active":"2024-05-08T18:29:42.570435+0000","last_became_peered":"2024-05-08T18:29:42.570435+0000","last_unstale":"2024-05-08T18:31:14.739542+0000","last_undegraded":"2024-05-08T18:31:14.739542+0000","last_fullsized":"2024-05-08T18:31:14.739542+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:21:40.374647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.745834+0000","last_change":"2024-05-08T18:29:40.566815+0000","last_active":"2024-05-08T18:31:14.745834+0000","last_peered":"2024-05-08T18:31:14.745834+0000","last_clean":"2024-05-08T18:31:14.745834+0000","last_became_active":"2024-05-08T18:29:40.566531+0000","last_became_peered":"2024-05-08T18:29:40.566531+0000","last_unstale":"2024-05-08T18:31:14.745834+0000","last_undegraded":"2024-05-08T18:31:14.745834+0000","last_fullsized":"2024-05-08T18:31:14.745834+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:52.462279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":102,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.743255+0000","last_change":"2024-05-08T18:29:42.554846+0000","last_active":"2024-05-08T18:31:15.743255+0000","last_peered":"2024-05-08T18:31:15.743255+0000","last_clean":"2024-05-08T18:31:15.743255+0000","last_became_active":"2024-05-08T18:29:42.554115+0000","last_became_peered":"2024-05-08T18:29:42.554115+0000","last_unstale":"2024-05-08T18:31:15.743255+0000","last_undegraded":"2024-05-08T18:31:15.743255+0000","last_fullsized":"2024-05-08T18:31:15.743255+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:22:14.793035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":102,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.721533+0000","last_change":"2024-05-08T18:29:40.547776+0000","last_active":"2024-05-08T18:31:13.721533+0000","last_peered":"2024-05-08T18:31:13.721533+0000","last_clean":"2024-05-08T18:31:13.721533+0000","last_became_active":"2024-05-08T18:29:40.547384+0000","last_became_peered":"2024-05-08T18:29:40.547384+0000","last_unstale":"2024-05-08T18:31:13.721533+0000","last_undegraded":"2024-05-08T18:31:13.721533+0000","last_fullsized":"2024-05-08T18:31:13.721533+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:14:26.628603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":86,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.741568+0000","last_change":"2024-05-08T18:29:50.685390+0000","last_active":"2024-05-08T18:31:15.741568+0000","last_peered":"2024-05-08T18:31:15.741568+0000","last_clean":"2024-05-08T18:31:15.741568+0000","last_became_active":"2024-05-08T18:29:50.684644+0000","last_became_peered":"2024-05-08T18:29:50.684644+0000","last_unstale":"2024-05-08T18:31:15.741568+0000","last_undegraded":"2024-05-08T18:31:15.741568+0000","last_fullsized":"2024-05-08T18:31:15.741568+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:10:38.951662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.746330+0000","last_change":"2024-05-08T18:29:42.573805+0000","last_active":"2024-05-08T18:31:14.746330+0000","last_peered":"2024-05-08T18:31:14.746330+0000","last_clean":"2024-05-08T18:31:14.746330+0000","last_became_active":"2024-05-08T18:29:42.573296+0000","last_became_peered":"2024-05-08T18:29:42.573296+0000","last_unstale":"2024-05-08T18:31:14.746330+0000","last_undegraded":"2024-05-08T18:31:14.746330+0000","last_fullsized":"2024-05-08T18:31:14.746330+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:21.935293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":105,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.262645+0000","last_change":"2024-05-08T18:29:40.570733+0000","last_active":"2024-05-08T18:31:16.262645+0000","last_peered":"2024-05-08T18:31:16.262645+0000","last_clean":"2024-05-08T18:31:16.262645+0000","last_became_active":"2024-05-08T18:29:40.569711+0000","last_became_peered":"2024-05-08T18:29:40.569711+0000","last_unstale":"2024-05-08T18:31:16.262645+0000","last_undegraded":"2024-05-08T18:31:16.262645+0000","last_fullsized":"2024-05-08T18:31:16.262645+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:18:08.784274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":95,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.632525+0000","last_change":"2024-05-08T18:29:44.594185+0000","last_active":"2024-05-08T18:31:15.632525+0000","last_peered":"2024-05-08T18:31:15.632525+0000","last_clean":"2024-05-08T18:31:15.632525+0000","last_became_active":"2024-05-08T18:29:44.593442+0000","last_became_peered":"2024-05-08T18:29:44.593442+0000","last_unstale":"2024-05-08T18:31:15.632525+0000","last_undegraded":"2024-05-08T18:31:15.632525+0000","last_fullsized":"2024-05-08T18:31:15.632525+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:52:25.736491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"33'9","reported_seq":106,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.723194+0000","last_change":"2024-05-08T18:29:46.594652+0000","last_active":"2024-05-08T18:31:13.723194+0000","last_peered":"2024-05-08T18:31:13.723194+0000","last_clean":"2024-05-08T18:31:13.723194+0000","last_became_active":"2024-05-08T18:29:46.593656+0000","last_became_peered":"2024-05-08T18:29:46.593656+0000","last_unstale":"2024-05-08T18:31:13.723194+0000","last_undegraded":"2024-05-08T18:31:13.723194+0000","last_fullsized":"2024-05-08T18:31:13.723194+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:50:27.608888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":89,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.261759+0000","last_change":"2024-05-08T18:29:48.639834+0000","last_active":"2024-05-08T18:31:16.261759+0000","last_peered":"2024-05-08T18:31:16.261759+0000","last_clean":"2024-05-08T18:31:16.261759+0000","last_became_active":"2024-05-08T18:29:48.639122+0000","last_became_peered":"2024-05-08T18:29:48.639122+0000","last_unstale":"2024-05-08T18:31:16.261759+0000","last_undegraded":"2024-05-08T18:31:16.261759+0000","last_fullsized":"2024-05-08T18:31:16.261759+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:14:22.304773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":83,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.631156+0000","last_change":"2024-05-08T18:29:50.672303+0000","last_active":"2024-05-08T18:31:15.631156+0000","last_peered":"2024-05-08T18:31:15.631156+0000","last_clean":"2024-05-08T18:31:15.631156+0000","last_became_active":"2024-05-08T18:29:50.671513+0000","last_became_peered":"2024-05-08T18:29:50.671513+0000","last_unstale":"2024-05-08T18:31:15.631156+0000","last_undegraded":"2024-05-08T18:31:15.631156+0000","last_fullsized":"2024-05-08T18:31:15.631156+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:12:05.780786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.633369+0000","last_change":"2024-05-08T18:29:42.565462+0000","last_active":"2024-05-08T18:31:15.633369+0000","last_peered":"2024-05-08T18:31:15.633369+0000","last_clean":"2024-05-08T18:31:15.633369+0000","last_became_active":"2024-05-08T18:29:42.564741+0000","last_became_peered":"2024-05-08T18:29:42.564741+0000","last_unstale":"2024-05-08T18:31:15.633369+0000","last_undegraded":"2024-05-08T18:31:15.633369+0000","last_fullsized":"2024-05-08T18:31:15.633369+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:25:56.129785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":102,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.721619+0000","last_change":"2024-05-08T18:29:40.564796+0000","last_active":"2024-05-08T18:31:13.721619+0000","last_peered":"2024-05-08T18:31:13.721619+0000","last_clean":"2024-05-08T18:31:13.721619+0000","last_became_active":"2024-05-08T18:29:40.564401+0000","last_became_peered":"2024-05-08T18:29:40.564401+0000","last_unstale":"2024-05-08T18:31:13.721619+0000","last_undegraded":"2024-05-08T18:31:13.721619+0000","last_fullsized":"2024-05-08T18:31:13.721619+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:19:11.492397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":96,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.746203+0000","last_change":"2024-05-08T18:29:44.587689+0000","last_active":"2024-05-08T18:31:14.746203+0000","last_peered":"2024-05-08T18:31:14.746203+0000","last_clean":"2024-05-08T18:31:14.746203+0000","last_became_active":"2024-05-08T18:29:44.586975+0000","last_became_peered":"2024-05-08T18:29:44.586975+0000","last_unstale":"2024-05-08T18:31:14.746203+0000","last_undegraded":"2024-05-08T18:31:14.746203+0000","last_fullsized":"2024-05-08T18:31:14.746203+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:04:49.020450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"33'6","reported_seq":103,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.743522+0000","last_change":"2024-05-08T18:29:46.600906+0000","last_active":"2024-05-08T18:31:15.743522+0000","last_peered":"2024-05-08T18:31:15.743522+0000","last_clean":"2024-05-08T18:31:15.743522+0000","last_became_active":"2024-05-08T18:29:46.599894+0000","last_became_peered":"2024-05-08T18:29:46.599894+0000","last_unstale":"2024-05-08T18:31:15.743522+0000","last_undegraded":"2024-05-08T18:31:15.743522+0000","last_fullsized":"2024-05-08T18:31:15.743522+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:24:13.568294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":90,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.743076+0000","last_change":"2024-05-08T18:29:48.614324+0000","last_active":"2024-05-08T18:31:15.743076+0000","last_peered":"2024-05-08T18:31:15.743076+0000","last_clean":"2024-05-08T18:31:15.743076+0000","last_became_active":"2024-05-08T18:29:48.613591+0000","last_became_peered":"2024-05-08T18:29:48.613591+0000","last_unstale":"2024-05-08T18:31:15.743076+0000","last_undegraded":"2024-05-08T18:31:15.743076+0000","last_fullsized":"2024-05-08T18:31:15.743076+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:47:54.034851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":82,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.721301+0000","last_change":"2024-05-08T18:29:50.684773+0000","last_active":"2024-05-08T18:31:13.721301+0000","last_peered":"2024-05-08T18:31:13.721301+0000","last_clean":"2024-05-08T18:31:13.721301+0000","last_became_active":"2024-05-08T18:29:50.683931+0000","last_became_peered":"2024-05-08T18:29:50.683931+0000","last_unstale":"2024-05-08T18:31:13.721301+0000","last_undegraded":"2024-05-08T18:31:13.721301+0000","last_fullsized":"2024-05-08T18:31:13.721301+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:17:10.582636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":98,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.725942+0000","last_change":"2024-05-08T18:29:42.574437+0000","last_active":"2024-05-08T18:31:13.725942+0000","last_peered":"2024-05-08T18:31:13.725942+0000","last_clean":"2024-05-08T18:31:13.725942+0000","last_became_active":"2024-05-08T18:29:42.574146+0000","last_became_peered":"2024-05-08T18:29:42.574146+0000","last_unstale":"2024-05-08T18:31:13.725942+0000","last_undegraded":"2024-05-08T18:31:13.725942+0000","last_fullsized":"2024-05-08T18:31:13.725942+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:55:30.468069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":105,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.261751+0000","last_change":"2024-05-08T18:29:40.559677+0000","last_active":"2024-05-08T18:31:16.261751+0000","last_peered":"2024-05-08T18:31:16.261751+0000","last_clean":"2024-05-08T18:31:16.261751+0000","last_became_active":"2024-05-08T18:29:40.558819+0000","last_became_peered":"2024-05-08T18:29:40.558819+0000","last_unstale":"2024-05-08T18:31:16.261751+0000","last_undegraded":"2024-05-08T18:31:16.261751+0000","last_fullsized":"2024-05-08T18:31:16.261751+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:28.426657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":96,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.749101+0000","last_change":"2024-05-08T18:29:44.596801+0000","last_active":"2024-05-08T18:31:14.749101+0000","last_peered":"2024-05-08T18:31:14.749101+0000","last_clean":"2024-05-08T18:31:14.749101+0000","last_became_active":"2024-05-08T18:29:44.596111+0000","last_became_peered":"2024-05-08T18:29:44.596111+0000","last_unstale":"2024-05-08T18:31:14.749101+0000","last_undegraded":"2024-05-08T18:31:14.749101+0000","last_fullsized":"2024-05-08T18:31:14.749101+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:04.423266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"33'10","reported_seq":106,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.736543+0000","last_change":"2024-05-08T18:29:46.608330+0000","last_active":"2024-05-08T18:31:14.736543+0000","last_peered":"2024-05-08T18:31:14.736543+0000","last_clean":"2024-05-08T18:31:14.736543+0000","last_became_active":"2024-05-08T18:29:46.607580+0000","last_became_peered":"2024-05-08T18:29:46.607580+0000","last_unstale":"2024-05-08T18:31:14.736543+0000","last_undegraded":"2024-05-08T18:31:14.736543+0000","last_fullsized":"2024-05-08T18:31:14.736543+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:22:18.837103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"30'2","reported_seq":109,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.261493+0000","last_change":"2024-05-08T18:29:48.642718+0000","last_active":"2024-05-08T18:31:16.261493+0000","last_peered":"2024-05-08T18:31:16.261493+0000","last_clean":"2024-05-08T18:31:16.261493+0000","last_became_active":"2024-05-08T18:29:48.641950+0000","last_became_peered":"2024-05-08T18:29:48.641950+0000","last_unstale":"2024-05-08T18:31:16.261493+0000","last_undegraded":"2024-05-08T18:31:16.261493+0000","last_fullsized":"2024-05-08T18:31:16.261493+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:00:11.720096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":86,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.742233+0000","last_change":"2024-05-08T18:29:50.660378+0000","last_active":"2024-05-08T18:31:15.742233+0000","last_peered":"2024-05-08T18:31:15.742233+0000","last_clean":"2024-05-08T18:31:15.742233+0000","last_became_active":"2024-05-08T18:29:50.659649+0000","last_became_peered":"2024-05-08T18:29:50.659649+0000","last_unstale":"2024-05-08T18:31:15.742233+0000","last_undegraded":"2024-05-08T18:31:15.742233+0000","last_fullsized":"2024-05-08T18:31:15.742233+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:34:14.488295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.746142+0000","last_change":"2024-05-08T18:29:42.577267+0000","last_active":"2024-05-08T18:31:14.746142+0000","last_peered":"2024-05-08T18:31:14.746142+0000","last_clean":"2024-05-08T18:31:14.746142+0000","last_became_active":"2024-05-08T18:29:42.576740+0000","last_became_peered":"2024-05-08T18:29:42.576740+0000","last_unstale":"2024-05-08T18:31:14.746142+0000","last_undegraded":"2024-05-08T18:31:14.746142+0000","last_fullsized":"2024-05-08T18:31:14.746142+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:57:14.869860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.736395+0000","last_change":"2024-05-08T18:29:40.547524+0000","last_active":"2024-05-08T18:31:14.736395+0000","last_peered":"2024-05-08T18:31:14.736395+0000","last_clean":"2024-05-08T18:31:14.736395+0000","last_became_active":"2024-05-08T18:29:40.545749+0000","last_became_peered":"2024-05-08T18:29:40.545749+0000","last_unstale":"2024-05-08T18:31:14.736395+0000","last_undegraded":"2024-05-08T18:31:14.736395+0000","last_fullsized":"2024-05-08T18:31:14.736395+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:12:59.146887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":95,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.632246+0000","last_change":"2024-05-08T18:29:44.579839+0000","last_active":"2024-05-08T18:31:15.632246+0000","last_peered":"2024-05-08T18:31:15.632246+0000","last_clean":"2024-05-08T18:31:15.632246+0000","last_became_active":"2024-05-08T18:29:44.578142+0000","last_became_peered":"2024-05-08T18:29:44.578142+0000","last_unstale":"2024-05-08T18:31:15.632246+0000","last_undegraded":"2024-05-08T18:31:15.632246+0000","last_fullsized":"2024-05-08T18:31:15.632246+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:51:09.413191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"33'9","reported_seq":109,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.261959+0000","last_change":"2024-05-08T18:29:46.607288+0000","last_active":"2024-05-08T18:31:16.261959+0000","last_peered":"2024-05-08T18:31:16.261959+0000","last_clean":"2024-05-08T18:31:16.261959+0000","last_became_active":"2024-05-08T18:29:46.605154+0000","last_became_peered":"2024-05-08T18:29:46.605154+0000","last_unstale":"2024-05-08T18:31:16.261959+0000","last_undegraded":"2024-05-08T18:31:16.261959+0000","last_fullsized":"2024-05-08T18:31:16.261959+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:23.940519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"30'2","reported_seq":108,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.745965+0000","last_change":"2024-05-08T18:29:48.634956+0000","last_active":"2024-05-08T18:31:14.745965+0000","last_peered":"2024-05-08T18:31:14.745965+0000","last_clean":"2024-05-08T18:31:14.745965+0000","last_became_active":"2024-05-08T18:29:48.633858+0000","last_became_peered":"2024-05-08T18:29:48.633858+0000","last_unstale":"2024-05-08T18:31:14.745965+0000","last_undegraded":"2024-05-08T18:31:14.745965+0000","last_fullsized":"2024-05-08T18:31:14.745965+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:50:48.169666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.632416+0000","last_change":"2024-05-08T18:29:42.567744+0000","last_active":"2024-05-08T18:31:15.632416+0000","last_peered":"2024-05-08T18:31:15.632416+0000","last_clean":"2024-05-08T18:31:15.632416+0000","last_became_active":"2024-05-08T18:29:42.566974+0000","last_became_peered":"2024-05-08T18:29:42.566974+0000","last_unstale":"2024-05-08T18:31:15.632416+0000","last_undegraded":"2024-05-08T18:31:15.632416+0000","last_fullsized":"2024-05-08T18:31:15.632416+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:42.045615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":105,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.262287+0000","last_change":"2024-05-08T18:29:40.572499+0000","last_active":"2024-05-08T18:31:16.262287+0000","last_peered":"2024-05-08T18:31:16.262287+0000","last_clean":"2024-05-08T18:31:16.262287+0000","last_became_active":"2024-05-08T18:29:40.571322+0000","last_became_peered":"2024-05-08T18:29:40.571322+0000","last_unstale":"2024-05-08T18:31:16.262287+0000","last_undegraded":"2024-05-08T18:31:16.262287+0000","last_fullsized":"2024-05-08T18:31:16.262287+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:31.119374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":97,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.260932+0000","last_change":"2024-05-08T18:29:44.597045+0000","last_active":"2024-05-08T18:31:16.260932+0000","last_peered":"2024-05-08T18:31:16.260932+0000","last_clean":"2024-05-08T18:31:16.260932+0000","last_became_active":"2024-05-08T18:29:44.596282+0000","last_became_peered":"2024-05-08T18:29:44.596282+0000","last_unstale":"2024-05-08T18:31:16.260932+0000","last_undegraded":"2024-05-08T18:31:16.260932+0000","last_fullsized":"2024-05-08T18:31:16.260932+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:35:51.288126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"33'19","reported_seq":122,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.631240+0000","last_change":"2024-05-08T18:29:46.590633+0000","last_active":"2024-05-08T18:31:15.631240+0000","last_peered":"2024-05-08T18:31:15.631240+0000","last_clean":"2024-05-08T18:31:15.631240+0000","last_became_active":"2024-05-08T18:29:46.589600+0000","last_became_peered":"2024-05-08T18:29:46.589600+0000","last_unstale":"2024-05-08T18:31:15.631240+0000","last_undegraded":"2024-05-08T18:31:15.631240+0000","last_fullsized":"2024-05-08T18:31:15.631240+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:23.940519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":86,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.720461+0000","last_change":"2024-05-08T18:29:48.630758+0000","last_active":"2024-05-08T18:31:13.720461+0000","last_peered":"2024-05-08T18:31:13.720461+0000","last_clean":"2024-05-08T18:31:13.720461+0000","last_became_active":"2024-05-08T18:29:48.630017+0000","last_became_peered":"2024-05-08T18:29:48.630017+0000","last_unstale":"2024-05-08T18:31:13.720461+0000","last_undegraded":"2024-05-08T18:31:13.720461+0000","last_fullsized":"2024-05-08T18:31:13.720461+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:39.879384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":83,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.631915+0000","last_change":"2024-05-08T18:29:50.672682+0000","last_active":"2024-05-08T18:31:15.631915+0000","last_peered":"2024-05-08T18:31:15.631915+0000","last_clean":"2024-05-08T18:31:15.631915+0000","last_became_active":"2024-05-08T18:29:50.671923+0000","last_became_peered":"2024-05-08T18:29:50.671923+0000","last_unstale":"2024-05-08T18:31:15.631915+0000","last_undegraded":"2024-05-08T18:31:15.631915+0000","last_fullsized":"2024-05-08T18:31:15.631915+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:38.318890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":102,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.741981+0000","last_change":"2024-05-08T18:29:42.554289+0000","last_active":"2024-05-08T18:31:15.741981+0000","last_peered":"2024-05-08T18:31:15.741981+0000","last_clean":"2024-05-08T18:31:15.741981+0000","last_became_active":"2024-05-08T18:29:42.553574+0000","last_became_peered":"2024-05-08T18:29:42.553574+0000","last_unstale":"2024-05-08T18:31:15.741981+0000","last_undegraded":"2024-05-08T18:31:15.741981+0000","last_fullsized":"2024-05-08T18:31:15.741981+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:42.005809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":105,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.263237+0000","last_change":"2024-05-08T18:29:40.570169+0000","last_active":"2024-05-08T18:31:16.263237+0000","last_peered":"2024-05-08T18:31:16.263237+0000","last_clean":"2024-05-08T18:31:16.263237+0000","last_became_active":"2024-05-08T18:29:40.569542+0000","last_became_peered":"2024-05-08T18:29:40.569542+0000","last_unstale":"2024-05-08T18:31:16.263237+0000","last_undegraded":"2024-05-08T18:31:16.263237+0000","last_fullsized":"2024-05-08T18:31:16.263237+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:08:13.006752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"26'1","reported_seq":97,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.737649+0000","last_change":"2024-05-08T18:29:44.579659+0000","last_active":"2024-05-08T18:31:14.737649+0000","last_peered":"2024-05-08T18:31:14.737649+0000","last_clean":"2024-05-08T18:31:14.737649+0000","last_became_active":"2024-05-08T18:29:44.579152+0000","last_became_peered":"2024-05-08T18:29:44.579152+0000","last_unstale":"2024-05-08T18:31:14.737649+0000","last_undegraded":"2024-05-08T18:31:14.737649+0000","last_fullsized":"2024-05-08T18:31:14.737649+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:15:00.358583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"33'9","reported_seq":108,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.748385+0000","last_change":"2024-05-08T18:29:46.600224+0000","last_active":"2024-05-08T18:31:14.748385+0000","last_peered":"2024-05-08T18:31:14.748385+0000","last_clean":"2024-05-08T18:31:14.748385+0000","last_became_active":"2024-05-08T18:29:46.599464+0000","last_became_peered":"2024-05-08T18:29:46.599464+0000","last_unstale":"2024-05-08T18:31:14.748385+0000","last_undegraded":"2024-05-08T18:31:14.748385+0000","last_fullsized":"2024-05-08T18:31:14.748385+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:26:40.238188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":88,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.745432+0000","last_change":"2024-05-08T18:29:48.637939+0000","last_active":"2024-05-08T18:31:14.745432+0000","last_peered":"2024-05-08T18:31:14.745432+0000","last_clean":"2024-05-08T18:31:14.745432+0000","last_became_active":"2024-05-08T18:29:48.637231+0000","last_became_peered":"2024-05-08T18:29:48.637231+0000","last_unstale":"2024-05-08T18:31:14.745432+0000","last_undegraded":"2024-05-08T18:31:14.745432+0000","last_fullsized":"2024-05-08T18:31:14.745432+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:04.571608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":84,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.737287+0000","last_change":"2024-05-08T18:29:50.681831+0000","last_active":"2024-05-08T18:31:14.737287+0000","last_peered":"2024-05-08T18:31:14.737287+0000","last_clean":"2024-05-08T18:31:14.737287+0000","last_became_active":"2024-05-08T18:29:50.681287+0000","last_became_peered":"2024-05-08T18:29:50.681287+0000","last_unstale":"2024-05-08T18:31:14.737287+0000","last_undegraded":"2024-05-08T18:31:14.737287+0000","last_fullsized":"2024-05-08T18:31:14.737287+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:30:24.111488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.737114+0000","last_change":"2024-05-08T18:29:42.562975+0000","last_active":"2024-05-08T18:31:14.737114+0000","last_peered":"2024-05-08T18:31:14.737114+0000","last_clean":"2024-05-08T18:31:14.737114+0000","last_became_active":"2024-05-08T18:29:42.562267+0000","last_became_peered":"2024-05-08T18:29:42.562267+0000","last_unstale":"2024-05-08T18:31:14.737114+0000","last_undegraded":"2024-05-08T18:31:14.737114+0000","last_fullsized":"2024-05-08T18:31:14.737114+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:30.446371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":105,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.262330+0000","last_change":"2024-05-08T18:29:40.570736+0000","last_active":"2024-05-08T18:31:16.262330+0000","last_peered":"2024-05-08T18:31:16.262330+0000","last_clean":"2024-05-08T18:31:16.262330+0000","last_became_active":"2024-05-08T18:29:40.569626+0000","last_became_peered":"2024-05-08T18:29:40.569626+0000","last_unstale":"2024-05-08T18:31:16.262330+0000","last_undegraded":"2024-05-08T18:31:16.262330+0000","last_fullsized":"2024-05-08T18:31:16.262330+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:56.300986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"26'1","reported_seq":97,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.739172+0000","last_change":"2024-05-08T18:29:44.581748+0000","last_active":"2024-05-08T18:31:14.739172+0000","last_peered":"2024-05-08T18:31:14.739172+0000","last_clean":"2024-05-08T18:31:14.739172+0000","last_became_active":"2024-05-08T18:29:44.581067+0000","last_became_peered":"2024-05-08T18:29:44.581067+0000","last_unstale":"2024-05-08T18:31:14.739172+0000","last_undegraded":"2024-05-08T18:31:14.739172+0000","last_fullsized":"2024-05-08T18:31:14.739172+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:44.043691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"33'15","reported_seq":118,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.261097+0000","last_change":"2024-05-08T18:29:46.605887+0000","last_active":"2024-05-08T18:31:16.261097+0000","last_peered":"2024-05-08T18:31:16.261097+0000","last_clean":"2024-05-08T18:31:16.261097+0000","last_became_active":"2024-05-08T18:29:46.604966+0000","last_became_peered":"2024-05-08T18:29:46.604966+0000","last_unstale":"2024-05-08T18:31:16.261097+0000","last_undegraded":"2024-05-08T18:31:16.261097+0000","last_fullsized":"2024-05-08T18:31:16.261097+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:07:54.654205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"30'2","reported_seq":106,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.721885+0000","last_change":"2024-05-08T18:29:48.638657+0000","last_active":"2024-05-08T18:31:13.721885+0000","last_peered":"2024-05-08T18:31:13.721885+0000","last_clean":"2024-05-08T18:31:13.721885+0000","last_became_active":"2024-05-08T18:29:48.637758+0000","last_became_peered":"2024-05-08T18:29:48.637758+0000","last_unstale":"2024-05-08T18:31:13.721885+0000","last_undegraded":"2024-05-08T18:31:13.721885+0000","last_fullsized":"2024-05-08T18:31:13.721885+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:45:24.153991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":82,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.723305+0000","last_change":"2024-05-08T18:29:50.684501+0000","last_active":"2024-05-08T18:31:13.723305+0000","last_peered":"2024-05-08T18:31:13.723305+0000","last_clean":"2024-05-08T18:31:13.723305+0000","last_became_active":"2024-05-08T18:29:50.683738+0000","last_became_peered":"2024-05-08T18:29:50.683738+0000","last_unstale":"2024-05-08T18:31:13.723305+0000","last_undegraded":"2024-05-08T18:31:13.723305+0000","last_fullsized":"2024-05-08T18:31:13.723305+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:22.834262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":98,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.722596+0000","last_change":"2024-05-08T18:29:42.569401+0000","last_active":"2024-05-08T18:31:13.722596+0000","last_peered":"2024-05-08T18:31:13.722596+0000","last_clean":"2024-05-08T18:31:13.722596+0000","last_became_active":"2024-05-08T18:29:42.568659+0000","last_became_peered":"2024-05-08T18:29:42.568659+0000","last_unstale":"2024-05-08T18:31:13.722596+0000","last_undegraded":"2024-05-08T18:31:13.722596+0000","last_fullsized":"2024-05-08T18:31:13.722596+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:35:23.016110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.632782+0000","last_change":"2024-05-08T18:29:40.557076+0000","last_active":"2024-05-08T18:31:15.632782+0000","last_peered":"2024-05-08T18:31:15.632782+0000","last_clean":"2024-05-08T18:31:15.632782+0000","last_became_active":"2024-05-08T18:29:40.555805+0000","last_became_peered":"2024-05-08T18:29:40.555805+0000","last_unstale":"2024-05-08T18:31:15.632782+0000","last_undegraded":"2024-05-08T18:31:15.632782+0000","last_fullsized":"2024-05-08T18:31:15.632782+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:13.946346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":95,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.739353+0000","last_change":"2024-05-08T18:29:44.573892+0000","last_active":"2024-05-08T18:31:14.739353+0000","last_peered":"2024-05-08T18:31:14.739353+0000","last_clean":"2024-05-08T18:31:14.739353+0000","last_became_active":"2024-05-08T18:29:44.573308+0000","last_became_peered":"2024-05-08T18:29:44.573308+0000","last_unstale":"2024-05-08T18:31:14.739353+0000","last_undegraded":"2024-05-08T18:31:14.739353+0000","last_fullsized":"2024-05-08T18:31:14.739353+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:37.075348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"33'12","reported_seq":113,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.722836+0000","last_change":"2024-05-08T18:29:46.595585+0000","last_active":"2024-05-08T18:31:13.722836+0000","last_peered":"2024-05-08T18:31:13.722836+0000","last_clean":"2024-05-08T18:31:13.722836+0000","last_became_active":"2024-05-08T18:29:46.594930+0000","last_became_peered":"2024-05-08T18:29:46.594930+0000","last_unstale":"2024-05-08T18:31:13.722836+0000","last_undegraded":"2024-05-08T18:31:13.722836+0000","last_fullsized":"2024-05-08T18:31:13.722836+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:11.768269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":87,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.737466+0000","last_change":"2024-05-08T18:29:48.638137+0000","last_active":"2024-05-08T18:31:14.737466+0000","last_peered":"2024-05-08T18:31:14.737466+0000","last_clean":"2024-05-08T18:31:14.737466+0000","last_became_active":"2024-05-08T18:29:48.637370+0000","last_became_peered":"2024-05-08T18:29:48.637370+0000","last_unstale":"2024-05-08T18:31:14.737466+0000","last_undegraded":"2024-05-08T18:31:14.737466+0000","last_fullsized":"2024-05-08T18:31:14.737466+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:15.859849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":82,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.722744+0000","last_change":"2024-05-08T18:29:50.688760+0000","last_active":"2024-05-08T18:31:13.722744+0000","last_peered":"2024-05-08T18:31:13.722744+0000","last_clean":"2024-05-08T18:31:13.722744+0000","last_became_active":"2024-05-08T18:29:50.687960+0000","last_became_peered":"2024-05-08T18:29:50.687960+0000","last_unstale":"2024-05-08T18:31:13.722744+0000","last_undegraded":"2024-05-08T18:31:13.722744+0000","last_fullsized":"2024-05-08T18:31:13.722744+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:21:19.624895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":102,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.742749+0000","last_change":"2024-05-08T18:29:42.557850+0000","last_active":"2024-05-08T18:31:15.742749+0000","last_peered":"2024-05-08T18:31:15.742749+0000","last_clean":"2024-05-08T18:31:15.742749+0000","last_became_active":"2024-05-08T18:29:42.557119+0000","last_became_peered":"2024-05-08T18:29:42.557119+0000","last_unstale":"2024-05-08T18:31:15.742749+0000","last_undegraded":"2024-05-08T18:31:15.742749+0000","last_fullsized":"2024-05-08T18:31:15.742749+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:25:56.129785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.745576+0000","last_change":"2024-05-08T18:29:40.544530+0000","last_active":"2024-05-08T18:31:14.745576+0000","last_peered":"2024-05-08T18:31:14.745576+0000","last_clean":"2024-05-08T18:31:14.745576+0000","last_became_active":"2024-05-08T18:29:40.544215+0000","last_became_peered":"2024-05-08T18:29:40.544215+0000","last_unstale":"2024-05-08T18:31:14.745576+0000","last_undegraded":"2024-05-08T18:31:14.745576+0000","last_fullsized":"2024-05-08T18:31:14.745576+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:14:26.628603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":95,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.738866+0000","last_change":"2024-05-08T18:29:44.588227+0000","last_active":"2024-05-08T18:31:14.738866+0000","last_peered":"2024-05-08T18:31:14.738866+0000","last_clean":"2024-05-08T18:31:14.738866+0000","last_became_active":"2024-05-08T18:29:44.587822+0000","last_became_peered":"2024-05-08T18:29:44.587822+0000","last_unstale":"2024-05-08T18:31:14.738866+0000","last_undegraded":"2024-05-08T18:31:14.738866+0000","last_fullsized":"2024-05-08T18:31:14.738866+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:18:12.841872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"33'11","reported_seq":113,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.743323+0000","last_change":"2024-05-08T18:29:46.603563+0000","last_active":"2024-05-08T18:31:15.743323+0000","last_peered":"2024-05-08T18:31:15.743323+0000","last_clean":"2024-05-08T18:31:15.743323+0000","last_became_active":"2024-05-08T18:29:46.602801+0000","last_became_peered":"2024-05-08T18:29:46.602801+0000","last_unstale":"2024-05-08T18:31:15.743323+0000","last_undegraded":"2024-05-08T18:31:15.743323+0000","last_fullsized":"2024-05-08T18:31:15.743323+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:22:36.338527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":86,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.723285+0000","last_change":"2024-05-08T18:29:48.642806+0000","last_active":"2024-05-08T18:31:13.723285+0000","last_peered":"2024-05-08T18:31:13.723285+0000","last_clean":"2024-05-08T18:31:13.723285+0000","last_became_active":"2024-05-08T18:29:48.641813+0000","last_became_peered":"2024-05-08T18:29:48.641813+0000","last_unstale":"2024-05-08T18:31:13.723285+0000","last_undegraded":"2024-05-08T18:31:13.723285+0000","last_fullsized":"2024-05-08T18:31:13.723285+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:50:48.169666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":84,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.744630+0000","last_change":"2024-05-08T18:29:50.689819+0000","last_active":"2024-05-08T18:31:14.744630+0000","last_peered":"2024-05-08T18:31:14.744630+0000","last_clean":"2024-05-08T18:31:14.744630+0000","last_became_active":"2024-05-08T18:29:50.686739+0000","last_became_peered":"2024-05-08T18:29:50.686739+0000","last_unstale":"2024-05-08T18:31:14.744630+0000","last_undegraded":"2024-05-08T18:31:14.744630+0000","last_fullsized":"2024-05-08T18:31:14.744630+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:45:34.171402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":102,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.743481+0000","last_change":"2024-05-08T18:29:42.552388+0000","last_active":"2024-05-08T18:31:15.743481+0000","last_peered":"2024-05-08T18:31:15.743481+0000","last_clean":"2024-05-08T18:31:15.743481+0000","last_became_active":"2024-05-08T18:29:42.551647+0000","last_became_peered":"2024-05-08T18:29:42.551647+0000","last_unstale":"2024-05-08T18:31:15.743481+0000","last_undegraded":"2024-05-08T18:31:15.743481+0000","last_fullsized":"2024-05-08T18:31:15.743481+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:55.055481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.737356+0000","last_change":"2024-05-08T18:29:40.562946+0000","last_active":"2024-05-08T18:31:14.737356+0000","last_peered":"2024-05-08T18:31:14.737356+0000","last_clean":"2024-05-08T18:31:14.737356+0000","last_became_active":"2024-05-08T18:29:40.550942+0000","last_became_peered":"2024-05-08T18:29:40.550942+0000","last_unstale":"2024-05-08T18:31:14.737356+0000","last_undegraded":"2024-05-08T18:31:14.737356+0000","last_fullsized":"2024-05-08T18:31:14.737356+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:22.579629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":94,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.720111+0000","last_change":"2024-05-08T18:29:44.593681+0000","last_active":"2024-05-08T18:31:13.720111+0000","last_peered":"2024-05-08T18:31:13.720111+0000","last_clean":"2024-05-08T18:31:13.720111+0000","last_became_active":"2024-05-08T18:29:44.593242+0000","last_became_peered":"2024-05-08T18:29:44.593242+0000","last_unstale":"2024-05-08T18:31:13.720111+0000","last_undegraded":"2024-05-08T18:31:13.720111+0000","last_fullsized":"2024-05-08T18:31:13.720111+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:57.093364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"33'15","reported_seq":116,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.740550+0000","last_change":"2024-05-08T18:29:46.589514+0000","last_active":"2024-05-08T18:31:14.740550+0000","last_peered":"2024-05-08T18:31:14.740550+0000","last_clean":"2024-05-08T18:31:14.740550+0000","last_became_active":"2024-05-08T18:29:46.588784+0000","last_became_peered":"2024-05-08T18:29:46.588784+0000","last_unstale":"2024-05-08T18:31:14.740550+0000","last_undegraded":"2024-05-08T18:31:14.740550+0000","last_fullsized":"2024-05-08T18:31:14.740550+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:02:30.355168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"30'2","reported_seq":107,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.738812+0000","last_change":"2024-05-08T18:29:48.631007+0000","last_active":"2024-05-08T18:31:14.738812+0000","last_peered":"2024-05-08T18:31:14.738812+0000","last_clean":"2024-05-08T18:31:14.738812+0000","last_became_active":"2024-05-08T18:29:48.630229+0000","last_became_peered":"2024-05-08T18:29:48.630229+0000","last_unstale":"2024-05-08T18:31:14.738812+0000","last_undegraded":"2024-05-08T18:31:14.738812+0000","last_fullsized":"2024-05-08T18:31:14.738812+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:44:03.778419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":82,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.719607+0000","last_change":"2024-05-08T18:29:50.675105+0000","last_active":"2024-05-08T18:31:13.719607+0000","last_peered":"2024-05-08T18:31:13.719607+0000","last_clean":"2024-05-08T18:31:13.719607+0000","last_became_active":"2024-05-08T18:29:50.674292+0000","last_became_peered":"2024-05-08T18:29:50.674292+0000","last_unstale":"2024-05-08T18:31:13.719607+0000","last_undegraded":"2024-05-08T18:31:13.719607+0000","last_fullsized":"2024-05-08T18:31:13.719607+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:47:15.423647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":102,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.743524+0000","last_change":"2024-05-08T18:29:42.579707+0000","last_active":"2024-05-08T18:31:15.743524+0000","last_peered":"2024-05-08T18:31:15.743524+0000","last_clean":"2024-05-08T18:31:15.743524+0000","last_became_active":"2024-05-08T18:29:42.579059+0000","last_became_peered":"2024-05-08T18:29:42.579059+0000","last_unstale":"2024-05-08T18:31:15.743524+0000","last_undegraded":"2024-05-08T18:31:15.743524+0000","last_fullsized":"2024-05-08T18:31:15.743524+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:09.787597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":106,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.742713+0000","last_change":"2024-05-08T18:29:40.555327+0000","last_active":"2024-05-08T18:31:15.742713+0000","last_peered":"2024-05-08T18:31:15.742713+0000","last_clean":"2024-05-08T18:31:15.742713+0000","last_became_active":"2024-05-08T18:29:40.554594+0000","last_became_peered":"2024-05-08T18:29:40.554594+0000","last_unstale":"2024-05-08T18:31:15.742713+0000","last_undegraded":"2024-05-08T18:31:15.742713+0000","last_fullsized":"2024-05-08T18:31:15.742713+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:19.841114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"26'2","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.631618+0000","last_change":"2024-05-08T18:29:44.582434+0000","last_active":"2024-05-08T18:31:15.631618+0000","last_peered":"2024-05-08T18:31:15.631618+0000","last_clean":"2024-05-08T18:31:15.631618+0000","last_became_active":"2024-05-08T18:29:44.581699+0000","last_became_peered":"2024-05-08T18:29:44.581699+0000","last_unstale":"2024-05-08T18:31:15.631618+0000","last_undegraded":"2024-05-08T18:31:15.631618+0000","last_fullsized":"2024-05-08T18:31:15.631618+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:19:29.113643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"33'10","reported_seq":107,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.746013+0000","last_change":"2024-05-08T18:29:46.590860+0000","last_active":"2024-05-08T18:31:14.746013+0000","last_peered":"2024-05-08T18:31:14.746013+0000","last_clean":"2024-05-08T18:31:14.746013+0000","last_became_active":"2024-05-08T18:29:46.590087+0000","last_became_peered":"2024-05-08T18:29:46.590087+0000","last_unstale":"2024-05-08T18:31:14.746013+0000","last_undegraded":"2024-05-08T18:31:14.746013+0000","last_fullsized":"2024-05-08T18:31:14.746013+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:19:58.358449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"30'2","reported_seq":108,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.737851+0000","last_change":"2024-05-08T18:29:48.635548+0000","last_active":"2024-05-08T18:31:14.737851+0000","last_peered":"2024-05-08T18:31:14.737851+0000","last_clean":"2024-05-08T18:31:14.737851+0000","last_became_active":"2024-05-08T18:29:48.634801+0000","last_became_peered":"2024-05-08T18:29:48.634801+0000","last_unstale":"2024-05-08T18:31:14.737851+0000","last_undegraded":"2024-05-08T18:31:14.737851+0000","last_fullsized":"2024-05-08T18:31:14.737851+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:04:20.128031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":86,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.743282+0000","last_change":"2024-05-08T18:29:50.668279+0000","last_active":"2024-05-08T18:31:15.743282+0000","last_peered":"2024-05-08T18:31:15.743282+0000","last_clean":"2024-05-08T18:31:15.743282+0000","last_became_active":"2024-05-08T18:29:50.667536+0000","last_became_peered":"2024-05-08T18:29:50.667536+0000","last_unstale":"2024-05-08T18:31:15.743282+0000","last_undegraded":"2024-05-08T18:31:15.743282+0000","last_fullsized":"2024-05-08T18:31:15.743282+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:12:05.780786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":98,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.722987+0000","last_change":"2024-05-08T18:29:42.563807+0000","last_active":"2024-05-08T18:31:13.722987+0000","last_peered":"2024-05-08T18:31:13.722987+0000","last_clean":"2024-05-08T18:31:13.722987+0000","last_became_active":"2024-05-08T18:29:42.563416+0000","last_became_peered":"2024-05-08T18:29:42.563416+0000","last_unstale":"2024-05-08T18:31:13.722987+0000","last_undegraded":"2024-05-08T18:31:13.722987+0000","last_fullsized":"2024-05-08T18:31:13.722987+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:18:10.803989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.745233+0000","last_change":"2024-05-08T18:29:40.548898+0000","last_active":"2024-05-08T18:31:14.745233+0000","last_peered":"2024-05-08T18:31:14.745233+0000","last_clean":"2024-05-08T18:31:14.745233+0000","last_became_active":"2024-05-08T18:29:40.548591+0000","last_became_peered":"2024-05-08T18:29:40.548591+0000","last_unstale":"2024-05-08T18:31:14.745233+0000","last_undegraded":"2024-05-08T18:31:14.745233+0000","last_fullsized":"2024-05-08T18:31:14.745233+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:27:41.414153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":98,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.743425+0000","last_change":"2024-05-08T18:29:44.582578+0000","last_active":"2024-05-08T18:31:15.743425+0000","last_peered":"2024-05-08T18:31:15.743425+0000","last_clean":"2024-05-08T18:31:15.743425+0000","last_became_active":"2024-05-08T18:29:44.581832+0000","last_became_peered":"2024-05-08T18:29:44.581832+0000","last_unstale":"2024-05-08T18:31:15.743425+0000","last_undegraded":"2024-05-08T18:31:15.743425+0000","last_fullsized":"2024-05-08T18:31:15.743425+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:52:25.736491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"33'17","reported_seq":119,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.632258+0000","last_change":"2024-05-08T18:29:46.602459+0000","last_active":"2024-05-08T18:31:15.632258+0000","last_peered":"2024-05-08T18:31:15.632258+0000","last_clean":"2024-05-08T18:31:15.632258+0000","last_became_active":"2024-05-08T18:29:46.601740+0000","last_became_peered":"2024-05-08T18:29:46.601740+0000","last_unstale":"2024-05-08T18:31:15.632258+0000","last_undegraded":"2024-05-08T18:31:15.632258+0000","last_fullsized":"2024-05-08T18:31:15.632258+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:58:31.293922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":88,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.736929+0000","last_change":"2024-05-08T18:29:48.640046+0000","last_active":"2024-05-08T18:31:14.736929+0000","last_peered":"2024-05-08T18:31:14.736929+0000","last_clean":"2024-05-08T18:31:14.736929+0000","last_became_active":"2024-05-08T18:29:48.639309+0000","last_became_peered":"2024-05-08T18:29:48.639309+0000","last_unstale":"2024-05-08T18:31:14.736929+0000","last_undegraded":"2024-05-08T18:31:14.736929+0000","last_fullsized":"2024-05-08T18:31:14.736929+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:10.533065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":82,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.720364+0000","last_change":"2024-05-08T18:29:50.668361+0000","last_active":"2024-05-08T18:31:13.720364+0000","last_peered":"2024-05-08T18:31:13.720364+0000","last_clean":"2024-05-08T18:31:13.720364+0000","last_became_active":"2024-05-08T18:29:50.667636+0000","last_became_peered":"2024-05-08T18:29:50.667636+0000","last_unstale":"2024-05-08T18:31:13.720364+0000","last_undegraded":"2024-05-08T18:31:13.720364+0000","last_fullsized":"2024-05-08T18:31:13.720364+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:58:35.356885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.738122+0000","last_change":"2024-05-08T18:29:42.584098+0000","last_active":"2024-05-08T18:31:14.738122+0000","last_peered":"2024-05-08T18:31:14.738122+0000","last_clean":"2024-05-08T18:31:14.738122+0000","last_became_active":"2024-05-08T18:29:42.583639+0000","last_became_peered":"2024-05-08T18:29:42.583639+0000","last_unstale":"2024-05-08T18:31:14.738122+0000","last_undegraded":"2024-05-08T18:31:14.738122+0000","last_fullsized":"2024-05-08T18:31:14.738122+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:08:15.026467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":207,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.260941+0000","last_change":"2024-05-08T18:29:27.115522+0000","last_active":"2024-05-08T18:31:16.260941+0000","last_peered":"2024-05-08T18:31:16.260941+0000","last_clean":"2024-05-08T18:31:16.260941+0000","last_became_active":"2024-05-08T18:29:27.112960+0000","last_became_peered":"2024-05-08T18:29:27.112960+0000","last_unstale":"2024-05-08T18:31:16.260941+0000","last_undegraded":"2024-05-08T18:31:16.260941+0000","last_fullsized":"2024-05-08T18:31:16.260941+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:26.091102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:26.091102+0000","last_clean_scrub_stamp":"2024-05-08T18:29:26.091102+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:09:50.296961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":109,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.632174+0000","last_change":"2024-05-08T18:29:34.496467+0000","last_active":"2024-05-08T18:31:15.632174+0000","last_peered":"2024-05-08T18:31:15.632174+0000","last_clean":"2024-05-08T18:31:15.632174+0000","last_became_active":"2024-05-08T18:29:34.495632+0000","last_became_peered":"2024-05-08T18:29:34.495632+0000","last_unstale":"2024-05-08T18:31:15.632174+0000","last_undegraded":"2024-05-08T18:31:15.632174+0000","last_fullsized":"2024-05-08T18:31:15.632174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:35.917391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":109,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.745790+0000","last_change":"2024-05-08T18:30:20.849562+0000","last_active":"2024-05-08T18:31:14.745790+0000","last_peered":"2024-05-08T18:31:14.745790+0000","last_clean":"2024-05-08T18:31:14.745790+0000","last_became_active":"2024-05-08T18:30:20.849160+0000","last_became_peered":"2024-05-08T18:30:20.849160+0000","last_unstale":"2024-05-08T18:31:14.745790+0000","last_undegraded":"2024-05-08T18:31:14.745790+0000","last_fullsized":"2024-05-08T18:31:14.745790+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:29:13.478886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":97,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.261983+0000","last_change":"2024-05-08T18:29:44.592445+0000","last_active":"2024-05-08T18:31:16.261983+0000","last_peered":"2024-05-08T18:31:16.261983+0000","last_clean":"2024-05-08T18:31:16.261983+0000","last_became_active":"2024-05-08T18:29:44.587855+0000","last_became_peered":"2024-05-08T18:29:44.587855+0000","last_unstale":"2024-05-08T18:31:16.261983+0000","last_undegraded":"2024-05-08T18:31:16.261983+0000","last_fullsized":"2024-05-08T18:31:16.261983+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:06:05.355648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"33'13","reported_seq":118,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.632992+0000","last_change":"2024-05-08T18:29:46.595394+0000","last_active":"2024-05-08T18:31:15.632992+0000","last_peered":"2024-05-08T18:31:15.632992+0000","last_clean":"2024-05-08T18:31:15.632992+0000","last_became_active":"2024-05-08T18:29:46.594573+0000","last_became_peered":"2024-05-08T18:29:46.594573+0000","last_unstale":"2024-05-08T18:31:15.632992+0000","last_undegraded":"2024-05-08T18:31:15.632992+0000","last_fullsized":"2024-05-08T18:31:15.632992+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:47:11.360684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":86,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.723389+0000","last_change":"2024-05-08T18:29:48.632178+0000","last_active":"2024-05-08T18:31:13.723389+0000","last_peered":"2024-05-08T18:31:13.723389+0000","last_clean":"2024-05-08T18:31:13.723389+0000","last_became_active":"2024-05-08T18:29:48.631481+0000","last_became_peered":"2024-05-08T18:29:48.631481+0000","last_unstale":"2024-05-08T18:31:13.723389+0000","last_undegraded":"2024-05-08T18:31:13.723389+0000","last_fullsized":"2024-05-08T18:31:13.723389+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:34.806539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":84,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.736104+0000","last_change":"2024-05-08T18:29:50.675319+0000","last_active":"2024-05-08T18:31:14.736104+0000","last_peered":"2024-05-08T18:31:14.736104+0000","last_clean":"2024-05-08T18:31:14.736104+0000","last_became_active":"2024-05-08T18:29:50.674526+0000","last_became_peered":"2024-05-08T18:29:50.674526+0000","last_unstale":"2024-05-08T18:31:14.736104+0000","last_undegraded":"2024-05-08T18:31:14.736104+0000","last_fullsized":"2024-05-08T18:31:14.736104+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:59:06.404586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":98,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.725806+0000","last_change":"2024-05-08T18:29:42.568584+0000","last_active":"2024-05-08T18:31:13.725806+0000","last_peered":"2024-05-08T18:31:13.725806+0000","last_clean":"2024-05-08T18:31:13.725806+0000","last_became_active":"2024-05-08T18:29:42.568244+0000","last_became_peered":"2024-05-08T18:29:42.568244+0000","last_unstale":"2024-05-08T18:31:13.725806+0000","last_undegraded":"2024-05-08T18:31:13.725806+0000","last_fullsized":"2024-05-08T18:31:13.725806+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:20.397730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":111,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.260769+0000","last_change":"2024-05-08T18:29:34.497654+0000","last_active":"2024-05-08T18:31:16.260769+0000","last_peered":"2024-05-08T18:31:16.260769+0000","last_clean":"2024-05-08T18:31:16.260769+0000","last_became_active":"2024-05-08T18:29:34.495812+0000","last_became_peered":"2024-05-08T18:29:34.495812+0000","last_unstale":"2024-05-08T18:31:16.260769+0000","last_undegraded":"2024-05-08T18:31:16.260769+0000","last_fullsized":"2024-05-08T18:31:16.260769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:37:02.202613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":102,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.722926+0000","last_change":"2024-05-08T18:29:40.560653+0000","last_active":"2024-05-08T18:31:13.722926+0000","last_peered":"2024-05-08T18:31:13.722926+0000","last_clean":"2024-05-08T18:31:13.722926+0000","last_became_active":"2024-05-08T18:29:40.560296+0000","last_became_peered":"2024-05-08T18:29:40.560296+0000","last_unstale":"2024-05-08T18:31:13.722926+0000","last_undegraded":"2024-05-08T18:31:13.722926+0000","last_fullsized":"2024-05-08T18:31:13.722926+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:52.462279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":95,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.633414+0000","last_change":"2024-05-08T18:29:44.594681+0000","last_active":"2024-05-08T18:31:15.633414+0000","last_peered":"2024-05-08T18:31:15.633414+0000","last_clean":"2024-05-08T18:31:15.633414+0000","last_became_active":"2024-05-08T18:29:44.593917+0000","last_became_peered":"2024-05-08T18:29:44.593917+0000","last_unstale":"2024-05-08T18:31:15.633414+0000","last_undegraded":"2024-05-08T18:31:15.633414+0000","last_fullsized":"2024-05-08T18:31:15.633414+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:59:00.335437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"33'23","reported_seq":149,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.720066+0000","last_change":"2024-05-08T18:29:46.599932+0000","last_active":"2024-05-08T18:31:13.720066+0000","last_peered":"2024-05-08T18:31:13.720066+0000","last_clean":"2024-05-08T18:31:13.720066+0000","last_became_active":"2024-05-08T18:29:46.594789+0000","last_became_peered":"2024-05-08T18:29:46.594789+0000","last_unstale":"2024-05-08T18:31:13.720066+0000","last_undegraded":"2024-05-08T18:31:13.720066+0000","last_fullsized":"2024-05-08T18:31:13.720066+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:04:18.099848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":42,"num_read_kb":27,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":89,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.261780+0000","last_change":"2024-05-08T18:29:48.634661+0000","last_active":"2024-05-08T18:31:16.261780+0000","last_peered":"2024-05-08T18:31:16.261780+0000","last_clean":"2024-05-08T18:31:16.261780+0000","last_became_active":"2024-05-08T18:29:48.634044+0000","last_became_peered":"2024-05-08T18:29:48.634044+0000","last_unstale":"2024-05-08T18:31:16.261780+0000","last_undegraded":"2024-05-08T18:31:16.261780+0000","last_fullsized":"2024-05-08T18:31:16.261780+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:01:46.238076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":82,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.719668+0000","last_change":"2024-05-08T18:29:50.676536+0000","last_active":"2024-05-08T18:31:13.719668+0000","last_peered":"2024-05-08T18:31:13.719668+0000","last_clean":"2024-05-08T18:31:13.719668+0000","last_became_active":"2024-05-08T18:29:50.675770+0000","last_became_peered":"2024-05-08T18:29:50.675770+0000","last_unstale":"2024-05-08T18:31:13.719668+0000","last_undegraded":"2024-05-08T18:31:13.719668+0000","last_fullsized":"2024-05-08T18:31:13.719668+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:28.003482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":98,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.723025+0000","last_change":"2024-05-08T18:29:42.575253+0000","last_active":"2024-05-08T18:31:13.723025+0000","last_peered":"2024-05-08T18:31:13.723025+0000","last_clean":"2024-05-08T18:31:13.723025+0000","last_became_active":"2024-05-08T18:29:42.573621+0000","last_became_peered":"2024-05-08T18:29:42.573621+0000","last_unstale":"2024-05-08T18:31:13.723025+0000","last_undegraded":"2024-05-08T18:31:13.723025+0000","last_fullsized":"2024-05-08T18:31:13.723025+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:59.243324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":109,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.738304+0000","last_change":"2024-05-08T18:29:34.491071+0000","last_active":"2024-05-08T18:31:14.738304+0000","last_peered":"2024-05-08T18:31:14.738304+0000","last_clean":"2024-05-08T18:31:14.738304+0000","last_became_active":"2024-05-08T18:29:34.490717+0000","last_became_peered":"2024-05-08T18:29:34.490717+0000","last_unstale":"2024-05-08T18:31:14.738304+0000","last_undegraded":"2024-05-08T18:31:14.738304+0000","last_fullsized":"2024-05-08T18:31:14.738304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:55.793312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":102,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.718585+0000","last_change":"2024-05-08T18:29:40.530634+0000","last_active":"2024-05-08T18:31:13.718585+0000","last_peered":"2024-05-08T18:31:13.718585+0000","last_clean":"2024-05-08T18:31:13.718585+0000","last_became_active":"2024-05-08T18:29:40.529804+0000","last_became_peered":"2024-05-08T18:29:40.529804+0000","last_unstale":"2024-05-08T18:31:13.718585+0000","last_undegraded":"2024-05-08T18:31:13.718585+0000","last_fullsized":"2024-05-08T18:31:13.718585+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:59:25.840149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"26'1","reported_seq":96,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.740581+0000","last_change":"2024-05-08T18:29:44.584678+0000","last_active":"2024-05-08T18:31:14.740581+0000","last_peered":"2024-05-08T18:31:14.740581+0000","last_clean":"2024-05-08T18:31:14.740581+0000","last_became_active":"2024-05-08T18:29:44.584227+0000","last_became_peered":"2024-05-08T18:29:44.584227+0000","last_unstale":"2024-05-08T18:31:14.740581+0000","last_undegraded":"2024-05-08T18:31:14.740581+0000","last_fullsized":"2024-05-08T18:31:14.740581+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:04:01.281207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'15","reported_seq":132,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.262088+0000","last_change":"2024-05-08T18:29:46.608720+0000","last_active":"2024-05-08T18:31:16.262088+0000","last_peered":"2024-05-08T18:31:16.262088+0000","last_clean":"2024-05-08T18:31:16.262088+0000","last_became_active":"2024-05-08T18:29:46.607989+0000","last_became_peered":"2024-05-08T18:29:46.607989+0000","last_unstale":"2024-05-08T18:31:16.262088+0000","last_undegraded":"2024-05-08T18:31:16.262088+0000","last_fullsized":"2024-05-08T18:31:16.262088+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:58:31.293922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":86,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.722122+0000","last_change":"2024-05-08T18:29:48.625269+0000","last_active":"2024-05-08T18:31:13.722122+0000","last_peered":"2024-05-08T18:31:13.722122+0000","last_clean":"2024-05-08T18:31:13.722122+0000","last_became_active":"2024-05-08T18:29:48.624545+0000","last_became_peered":"2024-05-08T18:29:48.624545+0000","last_unstale":"2024-05-08T18:31:13.722122+0000","last_undegraded":"2024-05-08T18:31:13.722122+0000","last_fullsized":"2024-05-08T18:31:13.722122+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:16:42.799734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":84,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.748205+0000","last_change":"2024-05-08T18:29:50.688851+0000","last_active":"2024-05-08T18:31:14.748205+0000","last_peered":"2024-05-08T18:31:14.748205+0000","last_clean":"2024-05-08T18:31:14.748205+0000","last_became_active":"2024-05-08T18:29:50.687978+0000","last_became_peered":"2024-05-08T18:29:50.687978+0000","last_unstale":"2024-05-08T18:31:14.748205+0000","last_undegraded":"2024-05-08T18:31:14.748205+0000","last_fullsized":"2024-05-08T18:31:14.748205+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:28:29.836446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":98,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.720237+0000","last_change":"2024-05-08T18:29:42.574606+0000","last_active":"2024-05-08T18:31:13.720237+0000","last_peered":"2024-05-08T18:31:13.720237+0000","last_clean":"2024-05-08T18:31:13.720237+0000","last_became_active":"2024-05-08T18:29:42.573656+0000","last_became_peered":"2024-05-08T18:29:42.573656+0000","last_unstale":"2024-05-08T18:31:13.720237+0000","last_undegraded":"2024-05-08T18:31:13.720237+0000","last_fullsized":"2024-05-08T18:31:13.720237+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:54:16.539832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":109,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.632766+0000","last_change":"2024-05-08T18:29:34.496942+0000","last_active":"2024-05-08T18:31:15.632766+0000","last_peered":"2024-05-08T18:31:15.632766+0000","last_clean":"2024-05-08T18:31:15.632766+0000","last_became_active":"2024-05-08T18:29:34.495882+0000","last_became_peered":"2024-05-08T18:29:34.495882+0000","last_unstale":"2024-05-08T18:31:15.632766+0000","last_undegraded":"2024-05-08T18:31:15.632766+0000","last_fullsized":"2024-05-08T18:31:15.632766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:55.793312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":106,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.742878+0000","last_change":"2024-05-08T18:29:40.554353+0000","last_active":"2024-05-08T18:31:15.742878+0000","last_peered":"2024-05-08T18:31:15.742878+0000","last_clean":"2024-05-08T18:31:15.742878+0000","last_became_active":"2024-05-08T18:29:40.553527+0000","last_became_peered":"2024-05-08T18:29:40.553527+0000","last_unstale":"2024-05-08T18:31:15.742878+0000","last_undegraded":"2024-05-08T18:31:15.742878+0000","last_fullsized":"2024-05-08T18:31:15.742878+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:03:42.148647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":94,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.722912+0000","last_change":"2024-05-08T18:29:44.597411+0000","last_active":"2024-05-08T18:31:13.722912+0000","last_peered":"2024-05-08T18:31:13.722912+0000","last_clean":"2024-05-08T18:31:13.722912+0000","last_became_active":"2024-05-08T18:29:44.596678+0000","last_became_peered":"2024-05-08T18:29:44.596678+0000","last_unstale":"2024-05-08T18:31:13.722912+0000","last_undegraded":"2024-05-08T18:31:13.722912+0000","last_fullsized":"2024-05-08T18:31:13.722912+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:37:23.674968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'12","reported_seq":110,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.748348+0000","last_change":"2024-05-08T18:29:46.607040+0000","last_active":"2024-05-08T18:31:14.748348+0000","last_peered":"2024-05-08T18:31:14.748348+0000","last_clean":"2024-05-08T18:31:14.748348+0000","last_became_active":"2024-05-08T18:29:46.606367+0000","last_became_peered":"2024-05-08T18:29:46.606367+0000","last_unstale":"2024-05-08T18:31:14.748348+0000","last_undegraded":"2024-05-08T18:31:14.748348+0000","last_fullsized":"2024-05-08T18:31:14.748348+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:59:26.650126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":88,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.737779+0000","last_change":"2024-05-08T18:29:48.632665+0000","last_active":"2024-05-08T18:31:14.737779+0000","last_peered":"2024-05-08T18:31:14.737779+0000","last_clean":"2024-05-08T18:31:14.737779+0000","last_became_active":"2024-05-08T18:29:48.631874+0000","last_became_peered":"2024-05-08T18:29:48.631874+0000","last_unstale":"2024-05-08T18:31:14.737779+0000","last_undegraded":"2024-05-08T18:31:14.737779+0000","last_fullsized":"2024-05-08T18:31:14.737779+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:06:09.390017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":83,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.631156+0000","last_change":"2024-05-08T18:29:50.683443+0000","last_active":"2024-05-08T18:31:15.631156+0000","last_peered":"2024-05-08T18:31:15.631156+0000","last_clean":"2024-05-08T18:31:15.631156+0000","last_became_active":"2024-05-08T18:29:50.682634+0000","last_became_peered":"2024-05-08T18:29:50.682634+0000","last_unstale":"2024-05-08T18:31:15.631156+0000","last_undegraded":"2024-05-08T18:31:15.631156+0000","last_fullsized":"2024-05-08T18:31:15.631156+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:10:38.951662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":98,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.720037+0000","last_change":"2024-05-08T18:29:42.574593+0000","last_active":"2024-05-08T18:31:13.720037+0000","last_peered":"2024-05-08T18:31:13.720037+0000","last_clean":"2024-05-08T18:31:13.720037+0000","last_became_active":"2024-05-08T18:29:42.574288+0000","last_became_peered":"2024-05-08T18:29:42.574288+0000","last_unstale":"2024-05-08T18:31:13.720037+0000","last_undegraded":"2024-05-08T18:31:13.720037+0000","last_fullsized":"2024-05-08T18:31:13.720037+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:58.320701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":53,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.738757+0000","last_change":"2024-05-08T18:30:20.850805+0000","last_active":"2024-05-08T18:31:14.738757+0000","last_peered":"2024-05-08T18:31:14.738757+0000","last_clean":"2024-05-08T18:31:14.738757+0000","last_became_active":"2024-05-08T18:30:20.850365+0000","last_became_peered":"2024-05-08T18:30:20.850365+0000","last_unstale":"2024-05-08T18:31:14.738757+0000","last_undegraded":"2024-05-08T18:31:14.738757+0000","last_fullsized":"2024-05-08T18:31:14.738757+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:52:21.678894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":108,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.720367+0000","last_change":"2024-05-08T18:29:34.606393+0000","last_active":"2024-05-08T18:31:13.720367+0000","last_peered":"2024-05-08T18:31:13.720367+0000","last_clean":"2024-05-08T18:31:13.720367+0000","last_became_active":"2024-05-08T18:29:34.605574+0000","last_became_peered":"2024-05-08T18:29:34.605574+0000","last_unstale":"2024-05-08T18:31:13.720367+0000","last_undegraded":"2024-05-08T18:31:13.720367+0000","last_fullsized":"2024-05-08T18:31:13.720367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:55.793312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":94,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.722198+0000","last_change":"2024-05-08T18:29:44.595127+0000","last_active":"2024-05-08T18:31:13.722198+0000","last_peered":"2024-05-08T18:31:13.722198+0000","last_clean":"2024-05-08T18:31:13.722198+0000","last_became_active":"2024-05-08T18:29:44.594642+0000","last_became_peered":"2024-05-08T18:29:44.594642+0000","last_unstale":"2024-05-08T18:31:13.722198+0000","last_undegraded":"2024-05-08T18:31:13.722198+0000","last_fullsized":"2024-05-08T18:31:13.722198+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:04:49.020450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"33'18","reported_seq":122,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.721722+0000","last_change":"2024-05-08T18:29:46.602279+0000","last_active":"2024-05-08T18:31:13.721722+0000","last_peered":"2024-05-08T18:31:13.721722+0000","last_clean":"2024-05-08T18:31:13.721722+0000","last_became_active":"2024-05-08T18:29:46.599707+0000","last_became_peered":"2024-05-08T18:29:46.599707+0000","last_unstale":"2024-05-08T18:31:13.721722+0000","last_undegraded":"2024-05-08T18:31:13.721722+0000","last_fullsized":"2024-05-08T18:31:13.721722+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:54:48.654215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":90,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.741708+0000","last_change":"2024-05-08T18:29:48.639458+0000","last_active":"2024-05-08T18:31:15.741708+0000","last_peered":"2024-05-08T18:31:15.741708+0000","last_clean":"2024-05-08T18:31:15.741708+0000","last_became_active":"2024-05-08T18:29:48.638709+0000","last_became_peered":"2024-05-08T18:29:48.638709+0000","last_unstale":"2024-05-08T18:31:15.741708+0000","last_undegraded":"2024-05-08T18:31:15.741708+0000","last_fullsized":"2024-05-08T18:31:15.741708+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:19:58.182291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":82,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.723086+0000","last_change":"2024-05-08T18:29:50.681077+0000","last_active":"2024-05-08T18:31:13.723086+0000","last_peered":"2024-05-08T18:31:13.723086+0000","last_clean":"2024-05-08T18:31:13.723086+0000","last_became_active":"2024-05-08T18:29:50.675766+0000","last_became_peered":"2024-05-08T18:29:50.675766+0000","last_unstale":"2024-05-08T18:31:13.723086+0000","last_undegraded":"2024-05-08T18:31:13.723086+0000","last_fullsized":"2024-05-08T18:31:13.723086+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:09:29.641515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":98,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.722515+0000","last_change":"2024-05-08T18:29:42.571265+0000","last_active":"2024-05-08T18:31:13.722515+0000","last_peered":"2024-05-08T18:31:13.722515+0000","last_clean":"2024-05-08T18:31:13.722515+0000","last_became_active":"2024-05-08T18:29:42.570645+0000","last_became_peered":"2024-05-08T18:29:42.570645+0000","last_unstale":"2024-05-08T18:31:13.722515+0000","last_undegraded":"2024-05-08T18:31:13.722515+0000","last_fullsized":"2024-05-08T18:31:13.722515+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:30:29.452640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":102,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.720282+0000","last_change":"2024-05-08T18:29:40.531079+0000","last_active":"2024-05-08T18:31:13.720282+0000","last_peered":"2024-05-08T18:31:13.720282+0000","last_clean":"2024-05-08T18:31:13.720282+0000","last_became_active":"2024-05-08T18:29:40.530256+0000","last_became_peered":"2024-05-08T18:29:40.530256+0000","last_unstale":"2024-05-08T18:31:13.720282+0000","last_undegraded":"2024-05-08T18:31:13.720282+0000","last_fullsized":"2024-05-08T18:31:13.720282+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:09:42.581976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":111,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.262613+0000","last_change":"2024-05-08T18:29:34.603292+0000","last_active":"2024-05-08T18:31:16.262613+0000","last_peered":"2024-05-08T18:31:16.262613+0000","last_clean":"2024-05-08T18:31:16.262613+0000","last_became_active":"2024-05-08T18:29:34.602547+0000","last_became_peered":"2024-05-08T18:29:34.602547+0000","last_unstale":"2024-05-08T18:31:16.262613+0000","last_undegraded":"2024-05-08T18:31:16.262613+0000","last_fullsized":"2024-05-08T18:31:16.262613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:24:55.555475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":96,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.736741+0000","last_change":"2024-05-08T18:29:44.593275+0000","last_active":"2024-05-08T18:31:14.736741+0000","last_peered":"2024-05-08T18:31:14.736741+0000","last_clean":"2024-05-08T18:31:14.736741+0000","last_became_active":"2024-05-08T18:29:44.591870+0000","last_became_peered":"2024-05-08T18:29:44.591870+0000","last_unstale":"2024-05-08T18:31:14.736741+0000","last_undegraded":"2024-05-08T18:31:14.736741+0000","last_fullsized":"2024-05-08T18:31:14.736741+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:35.176971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"33'14","reported_seq":111,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.718464+0000","last_change":"2024-05-08T18:29:46.603499+0000","last_active":"2024-05-08T18:31:13.718464+0000","last_peered":"2024-05-08T18:31:13.718464+0000","last_clean":"2024-05-08T18:31:13.718464+0000","last_became_active":"2024-05-08T18:29:46.602920+0000","last_became_peered":"2024-05-08T18:29:46.602920+0000","last_unstale":"2024-05-08T18:31:13.718464+0000","last_undegraded":"2024-05-08T18:31:13.718464+0000","last_fullsized":"2024-05-08T18:31:13.718464+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:08.504882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"30'2","reported_seq":107,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.631973+0000","last_change":"2024-05-08T18:29:48.634915+0000","last_active":"2024-05-08T18:31:15.631973+0000","last_peered":"2024-05-08T18:31:15.631973+0000","last_clean":"2024-05-08T18:31:15.631973+0000","last_became_active":"2024-05-08T18:29:48.634280+0000","last_became_peered":"2024-05-08T18:29:48.634280+0000","last_unstale":"2024-05-08T18:31:15.631973+0000","last_undegraded":"2024-05-08T18:31:15.631973+0000","last_fullsized":"2024-05-08T18:31:15.631973+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:19:58.182291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":84,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.748900+0000","last_change":"2024-05-08T18:29:50.688742+0000","last_active":"2024-05-08T18:31:14.748900+0000","last_peered":"2024-05-08T18:31:14.748900+0000","last_clean":"2024-05-08T18:31:14.748900+0000","last_became_active":"2024-05-08T18:29:50.687135+0000","last_became_peered":"2024-05-08T18:29:50.687135+0000","last_unstale":"2024-05-08T18:31:14.748900+0000","last_undegraded":"2024-05-08T18:31:14.748900+0000","last_fullsized":"2024-05-08T18:31:14.748900+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:12:49.040807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":53,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.737358+0000","last_change":"2024-05-08T18:30:21.220561+0000","last_active":"2024-05-08T18:31:14.737358+0000","last_peered":"2024-05-08T18:31:14.737358+0000","last_clean":"2024-05-08T18:31:14.737358+0000","last_became_active":"2024-05-08T18:30:21.220196+0000","last_became_peered":"2024-05-08T18:30:21.220196+0000","last_unstale":"2024-05-08T18:31:14.737358+0000","last_undegraded":"2024-05-08T18:31:14.737358+0000","last_fullsized":"2024-05-08T18:31:14.737358+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:19:27.075761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.746011+0000","last_change":"2024-05-08T18:29:40.565872+0000","last_active":"2024-05-08T18:31:14.746011+0000","last_peered":"2024-05-08T18:31:14.746011+0000","last_clean":"2024-05-08T18:31:14.746011+0000","last_became_active":"2024-05-08T18:29:40.565655+0000","last_became_peered":"2024-05-08T18:29:40.565655+0000","last_unstale":"2024-05-08T18:31:14.746011+0000","last_undegraded":"2024-05-08T18:31:14.746011+0000","last_fullsized":"2024-05-08T18:31:14.746011+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:16:16.521258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":108,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.723560+0000","last_change":"2024-05-08T18:29:34.501273+0000","last_active":"2024-05-08T18:31:13.723560+0000","last_peered":"2024-05-08T18:31:13.723560+0000","last_clean":"2024-05-08T18:31:13.723560+0000","last_became_active":"2024-05-08T18:29:34.500933+0000","last_became_peered":"2024-05-08T18:29:34.500933+0000","last_unstale":"2024-05-08T18:31:13.723560+0000","last_undegraded":"2024-05-08T18:31:13.723560+0000","last_fullsized":"2024-05-08T18:31:13.723560+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:35.917391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":98,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.741966+0000","last_change":"2024-05-08T18:29:44.576227+0000","last_active":"2024-05-08T18:31:15.741966+0000","last_peered":"2024-05-08T18:31:15.741966+0000","last_clean":"2024-05-08T18:31:15.741966+0000","last_became_active":"2024-05-08T18:29:44.575454+0000","last_became_peered":"2024-05-08T18:29:44.575454+0000","last_unstale":"2024-05-08T18:31:15.741966+0000","last_undegraded":"2024-05-08T18:31:15.741966+0000","last_fullsized":"2024-05-08T18:31:15.741966+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:06:05.355648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"33'10","reported_seq":109,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.743668+0000","last_change":"2024-05-08T18:29:46.609633+0000","last_active":"2024-05-08T18:31:15.743668+0000","last_peered":"2024-05-08T18:31:15.743668+0000","last_clean":"2024-05-08T18:31:15.743668+0000","last_became_active":"2024-05-08T18:29:46.603455+0000","last_became_peered":"2024-05-08T18:29:46.603455+0000","last_unstale":"2024-05-08T18:31:15.743668+0000","last_undegraded":"2024-05-08T18:31:15.743668+0000","last_fullsized":"2024-05-08T18:31:15.743668+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:07:54.654205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"30'2","reported_seq":108,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.748725+0000","last_change":"2024-05-08T18:29:48.637898+0000","last_active":"2024-05-08T18:31:14.748725+0000","last_peered":"2024-05-08T18:31:14.748725+0000","last_clean":"2024-05-08T18:31:14.748725+0000","last_became_active":"2024-05-08T18:29:48.637070+0000","last_became_peered":"2024-05-08T18:29:48.637070+0000","last_unstale":"2024-05-08T18:31:14.748725+0000","last_undegraded":"2024-05-08T18:31:14.748725+0000","last_fullsized":"2024-05-08T18:31:14.748725+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:03:46.392864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":82,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.722211+0000","last_change":"2024-05-08T18:29:50.691526+0000","last_active":"2024-05-08T18:31:13.722211+0000","last_peered":"2024-05-08T18:31:13.722211+0000","last_clean":"2024-05-08T18:31:13.722211+0000","last_became_active":"2024-05-08T18:29:50.690767+0000","last_became_peered":"2024-05-08T18:29:50.690767+0000","last_unstale":"2024-05-08T18:31:13.722211+0000","last_undegraded":"2024-05-08T18:31:13.722211+0000","last_fullsized":"2024-05-08T18:31:13.722211+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:32:29.972139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":102,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.742191+0000","last_change":"2024-05-08T18:29:42.562006+0000","last_active":"2024-05-08T18:31:15.742191+0000","last_peered":"2024-05-08T18:31:15.742191+0000","last_clean":"2024-05-08T18:31:15.742191+0000","last_became_active":"2024-05-08T18:29:42.560861+0000","last_became_peered":"2024-05-08T18:29:42.560861+0000","last_unstale":"2024-05-08T18:31:15.742191+0000","last_undegraded":"2024-05-08T18:31:15.742191+0000","last_fullsized":"2024-05-08T18:31:15.742191+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:36.890277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":102,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.726017+0000","last_change":"2024-05-08T18:29:40.550529+0000","last_active":"2024-05-08T18:31:13.726017+0000","last_peered":"2024-05-08T18:31:13.726017+0000","last_clean":"2024-05-08T18:31:13.726017+0000","last_became_active":"2024-05-08T18:29:40.550241+0000","last_became_peered":"2024-05-08T18:29:40.550241+0000","last_unstale":"2024-05-08T18:31:13.726017+0000","last_undegraded":"2024-05-08T18:31:13.726017+0000","last_fullsized":"2024-05-08T18:31:13.726017+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:48.294532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":110,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.738403+0000","last_change":"2024-05-08T18:29:34.493537+0000","last_active":"2024-05-08T18:31:14.738403+0000","last_peered":"2024-05-08T18:31:14.738403+0000","last_clean":"2024-05-08T18:31:14.738403+0000","last_became_active":"2024-05-08T18:29:34.492891+0000","last_became_peered":"2024-05-08T18:29:34.492891+0000","last_unstale":"2024-05-08T18:31:14.738403+0000","last_undegraded":"2024-05-08T18:31:14.738403+0000","last_fullsized":"2024-05-08T18:31:14.738403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:09:07.992256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":96,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.744847+0000","last_change":"2024-05-08T18:29:44.590102+0000","last_active":"2024-05-08T18:31:14.744847+0000","last_peered":"2024-05-08T18:31:14.744847+0000","last_clean":"2024-05-08T18:31:14.744847+0000","last_became_active":"2024-05-08T18:29:44.589471+0000","last_became_peered":"2024-05-08T18:29:44.589471+0000","last_unstale":"2024-05-08T18:31:14.744847+0000","last_undegraded":"2024-05-08T18:31:14.744847+0000","last_fullsized":"2024-05-08T18:31:14.744847+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:14:04.085401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"33'19","reported_seq":129,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.261498+0000","last_change":"2024-05-08T18:29:46.606967+0000","last_active":"2024-05-08T18:31:16.261498+0000","last_peered":"2024-05-08T18:31:16.261498+0000","last_clean":"2024-05-08T18:31:16.261498+0000","last_became_active":"2024-05-08T18:29:46.605693+0000","last_became_peered":"2024-05-08T18:29:46.605693+0000","last_unstale":"2024-05-08T18:31:16.261498+0000","last_undegraded":"2024-05-08T18:31:16.261498+0000","last_fullsized":"2024-05-08T18:31:16.261498+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:24:13.568294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":88,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.745500+0000","last_change":"2024-05-08T18:29:48.634271+0000","last_active":"2024-05-08T18:31:14.745500+0000","last_peered":"2024-05-08T18:31:14.745500+0000","last_clean":"2024-05-08T18:31:14.745500+0000","last_became_active":"2024-05-08T18:29:48.633607+0000","last_became_peered":"2024-05-08T18:29:48.633607+0000","last_unstale":"2024-05-08T18:31:14.745500+0000","last_undegraded":"2024-05-08T18:31:14.745500+0000","last_fullsized":"2024-05-08T18:31:14.745500+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:34.806539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":83,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.631978+0000","last_change":"2024-05-08T18:29:50.685494+0000","last_active":"2024-05-08T18:31:15.631978+0000","last_peered":"2024-05-08T18:31:15.631978+0000","last_clean":"2024-05-08T18:31:15.631978+0000","last_became_active":"2024-05-08T18:29:50.684818+0000","last_became_peered":"2024-05-08T18:29:50.684818+0000","last_unstale":"2024-05-08T18:31:15.631978+0000","last_undegraded":"2024-05-08T18:31:15.631978+0000","last_fullsized":"2024-05-08T18:31:15.631978+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:22.220842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":82,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.723200+0000","last_change":"2024-05-08T18:29:50.682937+0000","last_active":"2024-05-08T18:31:13.723200+0000","last_peered":"2024-05-08T18:31:13.723200+0000","last_clean":"2024-05-08T18:31:13.723200+0000","last_became_active":"2024-05-08T18:29:50.681771+0000","last_became_peered":"2024-05-08T18:29:50.681771+0000","last_unstale":"2024-05-08T18:31:13.723200+0000","last_undegraded":"2024-05-08T18:31:13.723200+0000","last_fullsized":"2024-05-08T18:31:13.723200+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:28:29.836446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":102,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.742504+0000","last_change":"2024-05-08T18:29:42.575909+0000","last_active":"2024-05-08T18:31:15.742504+0000","last_peered":"2024-05-08T18:31:15.742504+0000","last_clean":"2024-05-08T18:31:15.742504+0000","last_became_active":"2024-05-08T18:29:42.574877+0000","last_became_peered":"2024-05-08T18:29:42.574877+0000","last_unstale":"2024-05-08T18:31:15.742504+0000","last_undegraded":"2024-05-08T18:31:15.742504+0000","last_fullsized":"2024-05-08T18:31:15.742504+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:33.139089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":106,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.742264+0000","last_change":"2024-05-08T18:29:40.566496+0000","last_active":"2024-05-08T18:31:15.742264+0000","last_peered":"2024-05-08T18:31:15.742264+0000","last_clean":"2024-05-08T18:31:15.742264+0000","last_became_active":"2024-05-08T18:29:40.565874+0000","last_became_peered":"2024-05-08T18:29:40.565874+0000","last_unstale":"2024-05-08T18:31:15.742264+0000","last_undegraded":"2024-05-08T18:31:15.742264+0000","last_fullsized":"2024-05-08T18:31:15.742264+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:07.239963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":94,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.720168+0000","last_change":"2024-05-08T18:29:44.595410+0000","last_active":"2024-05-08T18:31:13.720168+0000","last_peered":"2024-05-08T18:31:13.720168+0000","last_clean":"2024-05-08T18:31:13.720168+0000","last_became_active":"2024-05-08T18:29:44.594286+0000","last_became_peered":"2024-05-08T18:29:44.594286+0000","last_unstale":"2024-05-08T18:31:13.720168+0000","last_undegraded":"2024-05-08T18:31:13.720168+0000","last_fullsized":"2024-05-08T18:31:13.720168+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:38.928160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"33'11","reported_seq":111,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.745393+0000","last_change":"2024-05-08T18:29:46.591009+0000","last_active":"2024-05-08T18:31:14.745393+0000","last_peered":"2024-05-08T18:31:14.745393+0000","last_clean":"2024-05-08T18:31:14.745393+0000","last_became_active":"2024-05-08T18:29:46.588810+0000","last_became_peered":"2024-05-08T18:29:46.588810+0000","last_unstale":"2024-05-08T18:31:14.745393+0000","last_undegraded":"2024-05-08T18:31:14.745393+0000","last_fullsized":"2024-05-08T18:31:14.745393+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:34:45.745300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":88,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.744717+0000","last_change":"2024-05-08T18:29:48.634986+0000","last_active":"2024-05-08T18:31:14.744717+0000","last_peered":"2024-05-08T18:31:14.744717+0000","last_clean":"2024-05-08T18:31:14.744717+0000","last_became_active":"2024-05-08T18:29:48.633866+0000","last_became_peered":"2024-05-08T18:29:48.633866+0000","last_unstale":"2024-05-08T18:31:14.744717+0000","last_undegraded":"2024-05-08T18:31:14.744717+0000","last_fullsized":"2024-05-08T18:31:14.744717+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:46.539830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":84,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.746135+0000","last_change":"2024-05-08T18:29:50.693408+0000","last_active":"2024-05-08T18:31:14.746135+0000","last_peered":"2024-05-08T18:31:14.746135+0000","last_clean":"2024-05-08T18:31:14.746135+0000","last_became_active":"2024-05-08T18:29:50.692687+0000","last_became_peered":"2024-05-08T18:29:50.692687+0000","last_unstale":"2024-05-08T18:31:14.746135+0000","last_undegraded":"2024-05-08T18:31:14.746135+0000","last_fullsized":"2024-05-08T18:31:14.746135+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:22.834262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":98,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.719956+0000","last_change":"2024-05-08T18:29:42.581368+0000","last_active":"2024-05-08T18:31:13.719956+0000","last_peered":"2024-05-08T18:31:13.719956+0000","last_clean":"2024-05-08T18:31:13.719956+0000","last_became_active":"2024-05-08T18:29:42.580887+0000","last_became_peered":"2024-05-08T18:29:42.580887+0000","last_unstale":"2024-05-08T18:31:13.719956+0000","last_undegraded":"2024-05-08T18:31:13.719956+0000","last_fullsized":"2024-05-08T18:31:13.719956+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:08:15.026467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":105,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.262343+0000","last_change":"2024-05-08T18:29:40.572770+0000","last_active":"2024-05-08T18:31:16.262343+0000","last_peered":"2024-05-08T18:31:16.262343+0000","last_clean":"2024-05-08T18:31:16.262343+0000","last_became_active":"2024-05-08T18:29:40.572079+0000","last_became_peered":"2024-05-08T18:29:40.572079+0000","last_unstale":"2024-05-08T18:31:16.262343+0000","last_undegraded":"2024-05-08T18:31:16.262343+0000","last_fullsized":"2024-05-08T18:31:16.262343+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:05.929806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":96,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.748089+0000","last_change":"2024-05-08T18:29:44.581323+0000","last_active":"2024-05-08T18:31:14.748089+0000","last_peered":"2024-05-08T18:31:14.748089+0000","last_clean":"2024-05-08T18:31:14.748089+0000","last_became_active":"2024-05-08T18:29:44.580805+0000","last_became_peered":"2024-05-08T18:29:44.580805+0000","last_unstale":"2024-05-08T18:31:14.748089+0000","last_undegraded":"2024-05-08T18:31:14.748089+0000","last_fullsized":"2024-05-08T18:31:14.748089+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:35:25.591140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"47'5","reported_seq":97,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.721567+0000","last_change":"2024-05-08T18:29:46.602495+0000","last_active":"2024-05-08T18:31:13.721567+0000","last_peered":"2024-05-08T18:31:13.721567+0000","last_clean":"2024-05-08T18:31:13.721567+0000","last_became_active":"2024-05-08T18:29:46.599789+0000","last_became_peered":"2024-05-08T18:29:46.599789+0000","last_unstale":"2024-05-08T18:31:13.721567+0000","last_undegraded":"2024-05-08T18:31:13.721567+0000","last_fullsized":"2024-05-08T18:31:13.721567+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:18:16.375808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":89,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.261028+0000","last_change":"2024-05-08T18:29:48.642994+0000","last_active":"2024-05-08T18:31:16.261028+0000","last_peered":"2024-05-08T18:31:16.261028+0000","last_clean":"2024-05-08T18:31:16.261028+0000","last_became_active":"2024-05-08T18:29:48.642056+0000","last_became_peered":"2024-05-08T18:29:48.642056+0000","last_unstale":"2024-05-08T18:31:16.261028+0000","last_undegraded":"2024-05-08T18:31:16.261028+0000","last_fullsized":"2024-05-08T18:31:16.261028+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:47:54.034851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":82,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.722073+0000","last_change":"2024-05-08T18:29:50.672513+0000","last_active":"2024-05-08T18:31:13.722073+0000","last_peered":"2024-05-08T18:31:13.722073+0000","last_clean":"2024-05-08T18:31:13.722073+0000","last_became_active":"2024-05-08T18:29:50.671781+0000","last_became_peered":"2024-05-08T18:29:50.671781+0000","last_unstale":"2024-05-08T18:31:13.722073+0000","last_undegraded":"2024-05-08T18:31:13.722073+0000","last_fullsized":"2024-05-08T18:31:13.722073+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:45:34.171402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.745742+0000","last_change":"2024-05-08T18:29:42.576843+0000","last_active":"2024-05-08T18:31:14.745742+0000","last_peered":"2024-05-08T18:31:14.745742+0000","last_clean":"2024-05-08T18:31:14.745742+0000","last_became_active":"2024-05-08T18:29:42.576379+0000","last_became_peered":"2024-05-08T18:29:42.576379+0000","last_unstale":"2024-05-08T18:31:14.745742+0000","last_undegraded":"2024-05-08T18:31:14.745742+0000","last_fullsized":"2024-05-08T18:31:14.745742+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:20.471010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.633032+0000","last_change":"2024-05-08T18:29:40.542997+0000","last_active":"2024-05-08T18:31:15.633032+0000","last_peered":"2024-05-08T18:31:15.633032+0000","last_clean":"2024-05-08T18:31:15.633032+0000","last_became_active":"2024-05-08T18:29:40.542239+0000","last_became_peered":"2024-05-08T18:29:40.542239+0000","last_unstale":"2024-05-08T18:31:15.633032+0000","last_undegraded":"2024-05-08T18:31:15.633032+0000","last_fullsized":"2024-05-08T18:31:15.633032+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:14:43.555504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":97,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.260475+0000","last_change":"2024-05-08T18:29:44.594178+0000","last_active":"2024-05-08T18:31:16.260475+0000","last_peered":"2024-05-08T18:31:16.260475+0000","last_clean":"2024-05-08T18:31:16.260475+0000","last_became_active":"2024-05-08T18:29:44.592476+0000","last_became_peered":"2024-05-08T18:29:44.592476+0000","last_unstale":"2024-05-08T18:31:16.260475+0000","last_undegraded":"2024-05-08T18:31:16.260475+0000","last_fullsized":"2024-05-08T18:31:16.260475+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:04:16.093662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"33'11","reported_seq":111,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.745728+0000","last_change":"2024-05-08T18:29:46.597288+0000","last_active":"2024-05-08T18:31:14.745728+0000","last_peered":"2024-05-08T18:31:14.745728+0000","last_clean":"2024-05-08T18:31:14.745728+0000","last_became_active":"2024-05-08T18:29:46.596452+0000","last_became_peered":"2024-05-08T18:29:46.596452+0000","last_unstale":"2024-05-08T18:31:14.745728+0000","last_undegraded":"2024-05-08T18:31:14.745728+0000","last_fullsized":"2024-05-08T18:31:14.745728+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:32:43.245753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":88,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.736656+0000","last_change":"2024-05-08T18:29:48.635436+0000","last_active":"2024-05-08T18:31:14.736656+0000","last_peered":"2024-05-08T18:31:14.736656+0000","last_clean":"2024-05-08T18:31:14.736656+0000","last_became_active":"2024-05-08T18:29:48.634704+0000","last_became_peered":"2024-05-08T18:29:48.634704+0000","last_unstale":"2024-05-08T18:31:14.736656+0000","last_undegraded":"2024-05-08T18:31:14.736656+0000","last_fullsized":"2024-05-08T18:31:14.736656+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:55:52.238481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":83,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.631667+0000","last_change":"2024-05-08T18:29:50.687974+0000","last_active":"2024-05-08T18:31:15.631667+0000","last_peered":"2024-05-08T18:31:15.631667+0000","last_clean":"2024-05-08T18:31:15.631667+0000","last_became_active":"2024-05-08T18:29:50.687045+0000","last_became_peered":"2024-05-08T18:29:50.687045+0000","last_unstale":"2024-05-08T18:31:15.631667+0000","last_undegraded":"2024-05-08T18:31:15.631667+0000","last_fullsized":"2024-05-08T18:31:15.631667+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:55:01.894779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":105,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.745008+0000","last_change":"2024-05-08T18:30:20.850226+0000","last_active":"2024-05-08T18:31:14.745008+0000","last_peered":"2024-05-08T18:31:14.745008+0000","last_clean":"2024-05-08T18:31:14.745008+0000","last_became_active":"2024-05-08T18:30:20.849751+0000","last_became_peered":"2024-05-08T18:30:20.849751+0000","last_unstale":"2024-05-08T18:31:14.745008+0000","last_undegraded":"2024-05-08T18:31:14.745008+0000","last_fullsized":"2024-05-08T18:31:14.745008+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:33:31.550958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":102,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.725705+0000","last_change":"2024-05-08T18:29:40.541112+0000","last_active":"2024-05-08T18:31:13.725705+0000","last_peered":"2024-05-08T18:31:13.725705+0000","last_clean":"2024-05-08T18:31:13.725705+0000","last_became_active":"2024-05-08T18:29:40.540835+0000","last_became_peered":"2024-05-08T18:29:40.540835+0000","last_unstale":"2024-05-08T18:31:13.725705+0000","last_undegraded":"2024-05-08T18:31:13.725705+0000","last_fullsized":"2024-05-08T18:31:13.725705+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:43:14.995191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":96,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.736618+0000","last_change":"2024-05-08T18:29:44.592033+0000","last_active":"2024-05-08T18:31:14.736618+0000","last_peered":"2024-05-08T18:31:14.736618+0000","last_clean":"2024-05-08T18:31:14.736618+0000","last_became_active":"2024-05-08T18:29:44.590454+0000","last_became_peered":"2024-05-08T18:29:44.590454+0000","last_unstale":"2024-05-08T18:31:14.736618+0000","last_undegraded":"2024-05-08T18:31:14.736618+0000","last_fullsized":"2024-05-08T18:31:14.736618+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:11:03.740365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"33'9","reported_seq":109,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.260988+0000","last_change":"2024-05-08T18:29:46.607002+0000","last_active":"2024-05-08T18:31:16.260988+0000","last_peered":"2024-05-08T18:31:16.260988+0000","last_clean":"2024-05-08T18:31:16.260988+0000","last_became_active":"2024-05-08T18:29:46.606172+0000","last_became_peered":"2024-05-08T18:29:46.606172+0000","last_unstale":"2024-05-08T18:31:16.260988+0000","last_undegraded":"2024-05-08T18:31:16.260988+0000","last_fullsized":"2024-05-08T18:31:16.260988+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:37:35.850414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":86,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.721204+0000","last_change":"2024-05-08T18:29:48.632948+0000","last_active":"2024-05-08T18:31:13.721204+0000","last_peered":"2024-05-08T18:31:13.721204+0000","last_clean":"2024-05-08T18:31:13.721204+0000","last_became_active":"2024-05-08T18:29:48.631219+0000","last_became_peered":"2024-05-08T18:29:48.631219+0000","last_unstale":"2024-05-08T18:31:13.721204+0000","last_undegraded":"2024-05-08T18:31:13.721204+0000","last_fullsized":"2024-05-08T18:31:13.721204+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:19:01.454355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.738247+0000","last_change":"2024-05-08T18:29:42.570180+0000","last_active":"2024-05-08T18:31:14.738247+0000","last_peered":"2024-05-08T18:31:14.738247+0000","last_clean":"2024-05-08T18:31:14.738247+0000","last_became_active":"2024-05-08T18:29:42.569425+0000","last_became_peered":"2024-05-08T18:29:42.569425+0000","last_unstale":"2024-05-08T18:31:14.738247+0000","last_undegraded":"2024-05-08T18:31:14.738247+0000","last_fullsized":"2024-05-08T18:31:14.738247+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:35.037465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.745158+0000","last_change":"2024-05-08T18:29:40.547711+0000","last_active":"2024-05-08T18:31:14.745158+0000","last_peered":"2024-05-08T18:31:14.745158+0000","last_clean":"2024-05-08T18:31:14.745158+0000","last_became_active":"2024-05-08T18:29:40.547479+0000","last_became_peered":"2024-05-08T18:29:40.547479+0000","last_unstale":"2024-05-08T18:31:14.745158+0000","last_undegraded":"2024-05-08T18:31:14.745158+0000","last_fullsized":"2024-05-08T18:31:14.745158+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:12:40.901620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":94,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.723393+0000","last_change":"2024-05-08T18:29:44.591547+0000","last_active":"2024-05-08T18:31:13.723393+0000","last_peered":"2024-05-08T18:31:13.723393+0000","last_clean":"2024-05-08T18:31:13.723393+0000","last_became_active":"2024-05-08T18:29:44.590498+0000","last_became_peered":"2024-05-08T18:29:44.590498+0000","last_unstale":"2024-05-08T18:31:13.723393+0000","last_undegraded":"2024-05-08T18:31:13.723393+0000","last_fullsized":"2024-05-08T18:31:13.723393+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:14:04.085401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"33'12","reported_seq":113,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.720480+0000","last_change":"2024-05-08T18:29:46.600437+0000","last_active":"2024-05-08T18:31:13.720480+0000","last_peered":"2024-05-08T18:31:13.720480+0000","last_clean":"2024-05-08T18:31:13.720480+0000","last_became_active":"2024-05-08T18:29:46.594672+0000","last_became_peered":"2024-05-08T18:29:46.594672+0000","last_unstale":"2024-05-08T18:31:13.720480+0000","last_undegraded":"2024-05-08T18:31:13.720480+0000","last_fullsized":"2024-05-08T18:31:13.720480+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:35:53.294312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":87,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.632181+0000","last_change":"2024-05-08T18:29:48.639840+0000","last_active":"2024-05-08T18:31:15.632181+0000","last_peered":"2024-05-08T18:31:15.632181+0000","last_clean":"2024-05-08T18:31:15.632181+0000","last_became_active":"2024-05-08T18:29:48.639120+0000","last_became_peered":"2024-05-08T18:29:48.639120+0000","last_unstale":"2024-05-08T18:31:15.632181+0000","last_undegraded":"2024-05-08T18:31:15.632181+0000","last_fullsized":"2024-05-08T18:31:15.632181+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:13:50.865474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":84,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.748089+0000","last_change":"2024-05-08T18:29:50.684843+0000","last_active":"2024-05-08T18:31:14.748089+0000","last_peered":"2024-05-08T18:31:14.748089+0000","last_clean":"2024-05-08T18:31:14.748089+0000","last_became_active":"2024-05-08T18:29:50.684119+0000","last_became_peered":"2024-05-08T18:29:50.684119+0000","last_unstale":"2024-05-08T18:31:14.748089+0000","last_undegraded":"2024-05-08T18:31:14.748089+0000","last_fullsized":"2024-05-08T18:31:14.748089+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:09:29.641515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":98,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.725717+0000","last_change":"2024-05-08T18:29:42.575763+0000","last_active":"2024-05-08T18:31:13.725717+0000","last_peered":"2024-05-08T18:31:13.725717+0000","last_clean":"2024-05-08T18:31:13.725717+0000","last_became_active":"2024-05-08T18:29:42.575450+0000","last_became_peered":"2024-05-08T18:29:42.575450+0000","last_unstale":"2024-05-08T18:31:13.725717+0000","last_undegraded":"2024-05-08T18:31:13.725717+0000","last_fullsized":"2024-05-08T18:31:13.725717+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:20.471010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":102,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.719930+0000","last_change":"2024-05-08T18:29:40.546101+0000","last_active":"2024-05-08T18:31:13.719930+0000","last_peered":"2024-05-08T18:31:13.719930+0000","last_clean":"2024-05-08T18:31:13.719930+0000","last_became_active":"2024-05-08T18:29:40.545814+0000","last_became_peered":"2024-05-08T18:29:40.545814+0000","last_unstale":"2024-05-08T18:31:13.719930+0000","last_undegraded":"2024-05-08T18:31:13.719930+0000","last_fullsized":"2024-05-08T18:31:13.719930+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:22.579629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":96,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.738020+0000","last_change":"2024-05-08T18:29:44.591310+0000","last_active":"2024-05-08T18:31:14.738020+0000","last_peered":"2024-05-08T18:31:14.738020+0000","last_clean":"2024-05-08T18:31:14.738020+0000","last_became_active":"2024-05-08T18:29:44.590394+0000","last_became_peered":"2024-05-08T18:29:44.590394+0000","last_unstale":"2024-05-08T18:31:14.738020+0000","last_undegraded":"2024-05-08T18:31:14.738020+0000","last_fullsized":"2024-05-08T18:31:14.738020+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:02:28.348982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"33'15","reported_seq":118,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.261535+0000","last_change":"2024-05-08T18:29:46.605887+0000","last_active":"2024-05-08T18:31:16.261535+0000","last_peered":"2024-05-08T18:31:16.261535+0000","last_clean":"2024-05-08T18:31:16.261535+0000","last_became_active":"2024-05-08T18:29:46.604917+0000","last_became_peered":"2024-05-08T18:29:46.604917+0000","last_unstale":"2024-05-08T18:31:16.261535+0000","last_undegraded":"2024-05-08T18:31:16.261535+0000","last_fullsized":"2024-05-08T18:31:16.261535+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:22:36.338527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":86,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.720587+0000","last_change":"2024-05-08T18:29:48.644420+0000","last_active":"2024-05-08T18:31:13.720587+0000","last_peered":"2024-05-08T18:31:13.720587+0000","last_clean":"2024-05-08T18:31:13.720587+0000","last_became_active":"2024-05-08T18:29:48.643493+0000","last_became_peered":"2024-05-08T18:29:48.643493+0000","last_unstale":"2024-05-08T18:31:13.720587+0000","last_undegraded":"2024-05-08T18:31:13.720587+0000","last_fullsized":"2024-05-08T18:31:13.720587+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:19:33.148012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":84,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.736566+0000","last_change":"2024-05-08T18:29:50.687485+0000","last_active":"2024-05-08T18:31:14.736566+0000","last_peered":"2024-05-08T18:31:14.736566+0000","last_clean":"2024-05-08T18:31:14.736566+0000","last_became_active":"2024-05-08T18:29:50.686750+0000","last_became_peered":"2024-05-08T18:29:50.686750+0000","last_unstale":"2024-05-08T18:31:14.736566+0000","last_undegraded":"2024-05-08T18:31:14.736566+0000","last_fullsized":"2024-05-08T18:31:14.736566+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:41.914164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.746032+0000","last_change":"2024-05-08T18:29:42.566571+0000","last_active":"2024-05-08T18:31:14.746032+0000","last_peered":"2024-05-08T18:31:14.746032+0000","last_clean":"2024-05-08T18:31:14.746032+0000","last_became_active":"2024-05-08T18:29:42.563695+0000","last_became_peered":"2024-05-08T18:29:42.563695+0000","last_unstale":"2024-05-08T18:31:14.746032+0000","last_undegraded":"2024-05-08T18:31:14.746032+0000","last_fullsized":"2024-05-08T18:31:14.746032+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:46.887628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":106,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.744024+0000","last_change":"2024-05-08T18:29:40.545512+0000","last_active":"2024-05-08T18:31:15.744024+0000","last_peered":"2024-05-08T18:31:15.744024+0000","last_clean":"2024-05-08T18:31:15.744024+0000","last_became_active":"2024-05-08T18:29:40.544216+0000","last_became_peered":"2024-05-08T18:29:40.544216+0000","last_unstale":"2024-05-08T18:31:15.744024+0000","last_undegraded":"2024-05-08T18:31:15.744024+0000","last_fullsized":"2024-05-08T18:31:15.744024+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:37:08.242362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":98,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.743045+0000","last_change":"2024-05-08T18:29:44.576107+0000","last_active":"2024-05-08T18:31:15.743045+0000","last_peered":"2024-05-08T18:31:15.743045+0000","last_clean":"2024-05-08T18:31:15.743045+0000","last_became_active":"2024-05-08T18:29:44.575344+0000","last_became_peered":"2024-05-08T18:29:44.575344+0000","last_unstale":"2024-05-08T18:31:15.743045+0000","last_undegraded":"2024-05-08T18:31:15.743045+0000","last_fullsized":"2024-05-08T18:31:15.743045+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:19.731003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"33'11","reported_seq":111,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.749020+0000","last_change":"2024-05-08T18:29:46.584785+0000","last_active":"2024-05-08T18:31:14.749020+0000","last_peered":"2024-05-08T18:31:14.749020+0000","last_clean":"2024-05-08T18:31:14.749020+0000","last_became_active":"2024-05-08T18:29:46.583390+0000","last_became_peered":"2024-05-08T18:29:46.583390+0000","last_unstale":"2024-05-08T18:31:14.749020+0000","last_undegraded":"2024-05-08T18:31:14.749020+0000","last_fullsized":"2024-05-08T18:31:14.749020+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:27:01.747339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":86,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.719664+0000","last_change":"2024-05-08T18:29:48.643558+0000","last_active":"2024-05-08T18:31:13.719664+0000","last_peered":"2024-05-08T18:31:13.719664+0000","last_clean":"2024-05-08T18:31:13.719664+0000","last_became_active":"2024-05-08T18:29:48.642773+0000","last_became_peered":"2024-05-08T18:29:48.642773+0000","last_unstale":"2024-05-08T18:31:13.719664+0000","last_undegraded":"2024-05-08T18:31:13.719664+0000","last_fullsized":"2024-05-08T18:31:13.719664+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:59:04.369806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":83,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.631314+0000","last_change":"2024-05-08T18:29:50.674796+0000","last_active":"2024-05-08T18:31:15.631314+0000","last_peered":"2024-05-08T18:31:15.631314+0000","last_clean":"2024-05-08T18:31:15.631314+0000","last_became_active":"2024-05-08T18:29:50.674057+0000","last_became_peered":"2024-05-08T18:29:50.674057+0000","last_unstale":"2024-05-08T18:31:15.631314+0000","last_undegraded":"2024-05-08T18:31:15.631314+0000","last_fullsized":"2024-05-08T18:31:15.631314+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:34:14.488295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.739651+0000","last_change":"2024-05-08T18:29:42.577642+0000","last_active":"2024-05-08T18:31:14.739651+0000","last_peered":"2024-05-08T18:31:14.739651+0000","last_clean":"2024-05-08T18:31:14.739651+0000","last_became_active":"2024-05-08T18:29:42.577275+0000","last_became_peered":"2024-05-08T18:29:42.577275+0000","last_unstale":"2024-05-08T18:31:14.739651+0000","last_undegraded":"2024-05-08T18:31:14.739651+0000","last_fullsized":"2024-05-08T18:31:14.739651+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:51:45.155037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":102,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.721945+0000","last_change":"2024-05-08T18:29:40.562873+0000","last_active":"2024-05-08T18:31:13.721945+0000","last_peered":"2024-05-08T18:31:13.721945+0000","last_clean":"2024-05-08T18:31:13.721945+0000","last_became_active":"2024-05-08T18:29:40.562594+0000","last_became_peered":"2024-05-08T18:29:40.562594+0000","last_unstale":"2024-05-08T18:31:13.721945+0000","last_undegraded":"2024-05-08T18:31:13.721945+0000","last_fullsized":"2024-05-08T18:31:13.721945+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:16:16.521258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":94,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.720676+0000","last_change":"2024-05-08T18:29:44.594152+0000","last_active":"2024-05-08T18:31:13.720676+0000","last_peered":"2024-05-08T18:31:13.720676+0000","last_clean":"2024-05-08T18:31:13.720676+0000","last_became_active":"2024-05-08T18:29:44.593398+0000","last_became_peered":"2024-05-08T18:29:44.593398+0000","last_unstale":"2024-05-08T18:31:13.720676+0000","last_undegraded":"2024-05-08T18:31:13.720676+0000","last_fullsized":"2024-05-08T18:31:13.720676+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:11.825480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"33'10","reported_seq":109,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.743318+0000","last_change":"2024-05-08T18:29:46.602137+0000","last_active":"2024-05-08T18:31:15.743318+0000","last_peered":"2024-05-08T18:31:15.743318+0000","last_clean":"2024-05-08T18:31:15.743318+0000","last_became_active":"2024-05-08T18:29:46.601402+0000","last_became_peered":"2024-05-08T18:29:46.601402+0000","last_unstale":"2024-05-08T18:31:15.743318+0000","last_undegraded":"2024-05-08T18:31:15.743318+0000","last_fullsized":"2024-05-08T18:31:15.743318+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:23.940519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"30'2","reported_seq":108,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.737958+0000","last_change":"2024-05-08T18:29:48.635696+0000","last_active":"2024-05-08T18:31:14.737958+0000","last_peered":"2024-05-08T18:31:14.737958+0000","last_clean":"2024-05-08T18:31:14.737958+0000","last_became_active":"2024-05-08T18:29:48.634859+0000","last_became_peered":"2024-05-08T18:29:48.634859+0000","last_unstale":"2024-05-08T18:31:14.737958+0000","last_undegraded":"2024-05-08T18:31:14.737958+0000","last_fullsized":"2024-05-08T18:31:14.737958+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:35:55.322495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":85,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.260443+0000","last_change":"2024-05-08T18:29:50.679757+0000","last_active":"2024-05-08T18:31:16.260443+0000","last_peered":"2024-05-08T18:31:16.260443+0000","last_clean":"2024-05-08T18:31:16.260443+0000","last_became_active":"2024-05-08T18:29:50.679011+0000","last_became_peered":"2024-05-08T18:29:50.679011+0000","last_unstale":"2024-05-08T18:31:16.260443+0000","last_undegraded":"2024-05-08T18:31:16.260443+0000","last_fullsized":"2024-05-08T18:31:16.260443+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:34:14.488295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":102,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.742383+0000","last_change":"2024-05-08T18:29:42.560354+0000","last_active":"2024-05-08T18:31:15.742383+0000","last_peered":"2024-05-08T18:31:15.742383+0000","last_clean":"2024-05-08T18:31:15.742383+0000","last_became_active":"2024-05-08T18:29:42.559647+0000","last_became_peered":"2024-05-08T18:29:42.559647+0000","last_unstale":"2024-05-08T18:31:15.742383+0000","last_undegraded":"2024-05-08T18:31:15.742383+0000","last_fullsized":"2024-05-08T18:31:15.742383+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:18:10.803989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.632603+0000","last_change":"2024-05-08T18:29:40.557683+0000","last_active":"2024-05-08T18:31:15.632603+0000","last_peered":"2024-05-08T18:31:15.632603+0000","last_clean":"2024-05-08T18:31:15.632603+0000","last_became_active":"2024-05-08T18:29:40.556254+0000","last_became_peered":"2024-05-08T18:29:40.556254+0000","last_unstale":"2024-05-08T18:31:15.632603+0000","last_undegraded":"2024-05-08T18:31:15.632603+0000","last_fullsized":"2024-05-08T18:31:15.632603+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:51:43.135322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":97,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.261072+0000","last_change":"2024-05-08T18:29:44.594068+0000","last_active":"2024-05-08T18:31:16.261072+0000","last_peered":"2024-05-08T18:31:16.261072+0000","last_clean":"2024-05-08T18:31:16.261072+0000","last_became_active":"2024-05-08T18:29:44.593322+0000","last_became_peered":"2024-05-08T18:29:44.593322+0000","last_unstale":"2024-05-08T18:31:16.261072+0000","last_undegraded":"2024-05-08T18:31:16.261072+0000","last_fullsized":"2024-05-08T18:31:16.261072+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:19.731003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"33'15","reported_seq":116,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.632445+0000","last_change":"2024-05-08T18:29:46.604700+0000","last_active":"2024-05-08T18:31:15.632445+0000","last_peered":"2024-05-08T18:31:15.632445+0000","last_clean":"2024-05-08T18:31:15.632445+0000","last_became_active":"2024-05-08T18:29:46.603885+0000","last_became_peered":"2024-05-08T18:29:46.603885+0000","last_unstale":"2024-05-08T18:31:15.632445+0000","last_undegraded":"2024-05-08T18:31:15.632445+0000","last_fullsized":"2024-05-08T18:31:15.632445+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:22:36.338527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":86,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.721285+0000","last_change":"2024-05-08T18:29:48.640814+0000","last_active":"2024-05-08T18:31:13.721285+0000","last_peered":"2024-05-08T18:31:13.721285+0000","last_clean":"2024-05-08T18:31:13.721285+0000","last_became_active":"2024-05-08T18:29:48.640046+0000","last_became_peered":"2024-05-08T18:29:48.640046+0000","last_unstale":"2024-05-08T18:31:13.721285+0000","last_undegraded":"2024-05-08T18:31:13.721285+0000","last_fullsized":"2024-05-08T18:31:13.721285+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:53:21.219706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":85,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.262435+0000","last_change":"2024-05-08T18:29:50.692688+0000","last_active":"2024-05-08T18:31:16.262435+0000","last_peered":"2024-05-08T18:31:16.262435+0000","last_clean":"2024-05-08T18:31:16.262435+0000","last_became_active":"2024-05-08T18:29:50.692123+0000","last_became_peered":"2024-05-08T18:29:50.692123+0000","last_unstale":"2024-05-08T18:31:16.262435+0000","last_undegraded":"2024-05-08T18:31:16.262435+0000","last_fullsized":"2024-05-08T18:31:16.262435+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:38.318890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":102,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.743798+0000","last_change":"2024-05-08T18:29:42.558336+0000","last_active":"2024-05-08T18:31:15.743798+0000","last_peered":"2024-05-08T18:31:15.743798+0000","last_clean":"2024-05-08T18:31:15.743798+0000","last_became_active":"2024-05-08T18:29:42.557570+0000","last_became_peered":"2024-05-08T18:29:42.557570+0000","last_unstale":"2024-05-08T18:31:15.743798+0000","last_undegraded":"2024-05-08T18:31:15.743798+0000","last_fullsized":"2024-05-08T18:31:15.743798+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:54:16.539832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.633369+0000","last_change":"2024-05-08T18:29:40.537090+0000","last_active":"2024-05-08T18:31:15.633369+0000","last_peered":"2024-05-08T18:31:15.633369+0000","last_clean":"2024-05-08T18:31:15.633369+0000","last_became_active":"2024-05-08T18:29:40.536188+0000","last_became_peered":"2024-05-08T18:29:40.536188+0000","last_unstale":"2024-05-08T18:31:15.633369+0000","last_undegraded":"2024-05-08T18:31:15.633369+0000","last_fullsized":"2024-05-08T18:31:15.633369+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:22:48.880581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":95,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.631974+0000","last_change":"2024-05-08T18:29:44.578901+0000","last_active":"2024-05-08T18:31:15.631974+0000","last_peered":"2024-05-08T18:31:15.631974+0000","last_clean":"2024-05-08T18:31:15.631974+0000","last_became_active":"2024-05-08T18:29:44.578171+0000","last_became_peered":"2024-05-08T18:29:44.578171+0000","last_unstale":"2024-05-08T18:31:15.631974+0000","last_undegraded":"2024-05-08T18:31:15.631974+0000","last_fullsized":"2024-05-08T18:31:15.631974+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:19.731003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"33'9","reported_seq":106,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.721373+0000","last_change":"2024-05-08T18:29:46.604539+0000","last_active":"2024-05-08T18:31:13.721373+0000","last_peered":"2024-05-08T18:31:13.721373+0000","last_clean":"2024-05-08T18:31:13.721373+0000","last_became_active":"2024-05-08T18:29:46.603728+0000","last_became_peered":"2024-05-08T18:29:46.603728+0000","last_unstale":"2024-05-08T18:31:13.721373+0000","last_undegraded":"2024-05-08T18:31:13.721373+0000","last_fullsized":"2024-05-08T18:31:13.721373+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:12:41.226788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":88,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.736294+0000","last_change":"2024-05-08T18:29:48.635813+0000","last_active":"2024-05-08T18:31:14.736294+0000","last_peered":"2024-05-08T18:31:14.736294+0000","last_clean":"2024-05-08T18:31:14.736294+0000","last_became_active":"2024-05-08T18:29:48.634664+0000","last_became_peered":"2024-05-08T18:29:48.634664+0000","last_unstale":"2024-05-08T18:31:14.736294+0000","last_undegraded":"2024-05-08T18:31:14.736294+0000","last_fullsized":"2024-05-08T18:31:14.736294+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:27:23.427365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":84,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.748621+0000","last_change":"2024-05-08T18:29:50.687517+0000","last_active":"2024-05-08T18:31:14.748621+0000","last_peered":"2024-05-08T18:31:14.748621+0000","last_clean":"2024-05-08T18:31:14.748621+0000","last_became_active":"2024-05-08T18:29:50.686662+0000","last_became_peered":"2024-05-08T18:29:50.686662+0000","last_unstale":"2024-05-08T18:31:14.748621+0000","last_undegraded":"2024-05-08T18:31:14.748621+0000","last_fullsized":"2024-05-08T18:31:14.748621+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:58:00.455559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.748322+0000","last_change":"2024-05-08T18:29:42.558848+0000","last_active":"2024-05-08T18:31:14.748322+0000","last_peered":"2024-05-08T18:31:14.748322+0000","last_clean":"2024-05-08T18:31:14.748322+0000","last_became_active":"2024-05-08T18:29:42.558390+0000","last_became_peered":"2024-05-08T18:29:42.558390+0000","last_unstale":"2024-05-08T18:31:14.748322+0000","last_undegraded":"2024-05-08T18:31:14.748322+0000","last_fullsized":"2024-05-08T18:31:14.748322+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:55:30.468069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.748541+0000","last_change":"2024-05-08T18:29:40.567772+0000","last_active":"2024-05-08T18:31:14.748541+0000","last_peered":"2024-05-08T18:31:14.748541+0000","last_clean":"2024-05-08T18:31:14.748541+0000","last_became_active":"2024-05-08T18:29:40.567482+0000","last_became_peered":"2024-05-08T18:29:40.567482+0000","last_unstale":"2024-05-08T18:31:14.748541+0000","last_undegraded":"2024-05-08T18:31:14.748541+0000","last_fullsized":"2024-05-08T18:31:14.748541+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:36:37.796095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":98,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.741568+0000","last_change":"2024-05-08T18:29:44.596876+0000","last_active":"2024-05-08T18:31:15.741568+0000","last_peered":"2024-05-08T18:31:15.741568+0000","last_clean":"2024-05-08T18:31:15.741568+0000","last_became_active":"2024-05-08T18:29:44.595712+0000","last_became_peered":"2024-05-08T18:29:44.595712+0000","last_unstale":"2024-05-08T18:31:15.741568+0000","last_undegraded":"2024-05-08T18:31:15.741568+0000","last_fullsized":"2024-05-08T18:31:15.741568+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:35:51.288126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"33'5","reported_seq":102,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.748589+0000","last_change":"2024-05-08T18:29:46.598637+0000","last_active":"2024-05-08T18:31:14.748589+0000","last_peered":"2024-05-08T18:31:14.748589+0000","last_clean":"2024-05-08T18:31:14.748589+0000","last_became_active":"2024-05-08T18:29:46.597394+0000","last_became_peered":"2024-05-08T18:29:46.597394+0000","last_unstale":"2024-05-08T18:31:14.748589+0000","last_undegraded":"2024-05-08T18:31:14.748589+0000","last_fullsized":"2024-05-08T18:31:14.748589+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:52:22.540814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":90,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.741955+0000","last_change":"2024-05-08T18:29:48.642251+0000","last_active":"2024-05-08T18:31:15.741955+0000","last_peered":"2024-05-08T18:31:15.741955+0000","last_clean":"2024-05-08T18:31:15.741955+0000","last_became_active":"2024-05-08T18:29:48.641666+0000","last_became_peered":"2024-05-08T18:29:48.641666+0000","last_unstale":"2024-05-08T18:31:15.741955+0000","last_undegraded":"2024-05-08T18:31:15.741955+0000","last_fullsized":"2024-05-08T18:31:15.741955+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:13:50.865474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":85,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.262027+0000","last_change":"2024-05-08T18:29:50.685668+0000","last_active":"2024-05-08T18:31:16.262027+0000","last_peered":"2024-05-08T18:31:16.262027+0000","last_clean":"2024-05-08T18:31:16.262027+0000","last_became_active":"2024-05-08T18:29:50.684958+0000","last_became_peered":"2024-05-08T18:29:50.684958+0000","last_unstale":"2024-05-08T18:31:16.262027+0000","last_undegraded":"2024-05-08T18:31:16.262027+0000","last_fullsized":"2024-05-08T18:31:16.262027+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:55:01.894779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":102,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.742297+0000","last_change":"2024-05-08T18:29:42.562063+0000","last_active":"2024-05-08T18:31:15.742297+0000","last_peered":"2024-05-08T18:31:15.742297+0000","last_clean":"2024-05-08T18:31:15.742297+0000","last_became_active":"2024-05-08T18:29:42.558871+0000","last_became_peered":"2024-05-08T18:29:42.558871+0000","last_unstale":"2024-05-08T18:31:15.742297+0000","last_undegraded":"2024-05-08T18:31:15.742297+0000","last_fullsized":"2024-05-08T18:31:15.742297+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:59.243324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":102,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.725791+0000","last_change":"2024-05-08T18:29:40.541070+0000","last_active":"2024-05-08T18:31:13.725791+0000","last_peered":"2024-05-08T18:31:13.725791+0000","last_clean":"2024-05-08T18:31:13.725791+0000","last_became_active":"2024-05-08T18:29:40.540767+0000","last_became_peered":"2024-05-08T18:29:40.540767+0000","last_unstale":"2024-05-08T18:31:13.725791+0000","last_undegraded":"2024-05-08T18:31:13.725791+0000","last_fullsized":"2024-05-08T18:31:13.725791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:09:39.835826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"26'1","reported_seq":95,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.719407+0000","last_change":"2024-05-08T18:29:44.592737+0000","last_active":"2024-05-08T18:31:13.719407+0000","last_peered":"2024-05-08T18:31:13.719407+0000","last_clean":"2024-05-08T18:31:13.719407+0000","last_became_active":"2024-05-08T18:29:44.592243+0000","last_became_peered":"2024-05-08T18:29:44.592243+0000","last_unstale":"2024-05-08T18:31:13.719407+0000","last_undegraded":"2024-05-08T18:31:13.719407+0000","last_fullsized":"2024-05-08T18:31:13.719407+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:59.744050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"33'9","reported_seq":110,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.742897+0000","last_change":"2024-05-08T18:29:46.610835+0000","last_active":"2024-05-08T18:31:15.742897+0000","last_peered":"2024-05-08T18:31:15.742897+0000","last_clean":"2024-05-08T18:31:15.742897+0000","last_became_active":"2024-05-08T18:29:46.609903+0000","last_became_peered":"2024-05-08T18:29:46.609903+0000","last_unstale":"2024-05-08T18:31:15.742897+0000","last_undegraded":"2024-05-08T18:31:15.742897+0000","last_fullsized":"2024-05-08T18:31:15.742897+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:37:35.850414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":86,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.721105+0000","last_change":"2024-05-08T18:29:48.629822+0000","last_active":"2024-05-08T18:31:13.721105+0000","last_peered":"2024-05-08T18:31:13.721105+0000","last_clean":"2024-05-08T18:31:13.721105+0000","last_became_active":"2024-05-08T18:29:48.629204+0000","last_became_peered":"2024-05-08T18:29:48.629204+0000","last_unstale":"2024-05-08T18:31:13.721105+0000","last_undegraded":"2024-05-08T18:31:13.721105+0000","last_fullsized":"2024-05-08T18:31:13.721105+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:04.571608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":86,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.743139+0000","last_change":"2024-05-08T18:29:50.668101+0000","last_active":"2024-05-08T18:31:15.743139+0000","last_peered":"2024-05-08T18:31:15.743139+0000","last_clean":"2024-05-08T18:31:15.743139+0000","last_became_active":"2024-05-08T18:29:50.667357+0000","last_became_peered":"2024-05-08T18:29:50.667357+0000","last_unstale":"2024-05-08T18:31:15.743139+0000","last_undegraded":"2024-05-08T18:31:15.743139+0000","last_fullsized":"2024-05-08T18:31:15.743139+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:55:01.894779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":98,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.722914+0000","last_change":"2024-05-08T18:29:42.581366+0000","last_active":"2024-05-08T18:31:13.722914+0000","last_peered":"2024-05-08T18:31:13.722914+0000","last_clean":"2024-05-08T18:31:13.722914+0000","last_became_active":"2024-05-08T18:29:42.580988+0000","last_became_peered":"2024-05-08T18:29:42.580988+0000","last_unstale":"2024-05-08T18:31:13.722914+0000","last_undegraded":"2024-05-08T18:31:13.722914+0000","last_fullsized":"2024-05-08T18:31:13.722914+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:42.005809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.736314+0000","last_change":"2024-05-08T18:29:40.562025+0000","last_active":"2024-05-08T18:31:14.736314+0000","last_peered":"2024-05-08T18:31:14.736314+0000","last_clean":"2024-05-08T18:31:14.736314+0000","last_became_active":"2024-05-08T18:29:40.561277+0000","last_became_peered":"2024-05-08T18:29:40.561277+0000","last_unstale":"2024-05-08T18:31:14.736314+0000","last_undegraded":"2024-05-08T18:31:14.736314+0000","last_fullsized":"2024-05-08T18:31:14.736314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:59:25.840149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":98,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.720087+0000","last_change":"2024-05-08T18:29:42.573832+0000","last_active":"2024-05-08T18:31:13.720087+0000","last_peered":"2024-05-08T18:31:13.720087+0000","last_clean":"2024-05-08T18:31:13.720087+0000","last_became_active":"2024-05-08T18:29:42.573502+0000","last_became_peered":"2024-05-08T18:29:42.573502+0000","last_unstale":"2024-05-08T18:31:13.720087+0000","last_undegraded":"2024-05-08T18:31:13.720087+0000","last_fullsized":"2024-05-08T18:31:13.720087+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:35.037465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.738141+0000","last_change":"2024-05-08T18:29:40.533094+0000","last_active":"2024-05-08T18:31:14.738141+0000","last_peered":"2024-05-08T18:31:14.738141+0000","last_clean":"2024-05-08T18:31:14.738141+0000","last_became_active":"2024-05-08T18:29:40.532246+0000","last_became_peered":"2024-05-08T18:29:40.532246+0000","last_unstale":"2024-05-08T18:31:14.738141+0000","last_undegraded":"2024-05-08T18:31:14.738141+0000","last_fullsized":"2024-05-08T18:31:14.738141+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:37:08.242362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.632795+0000","last_change":"2024-05-08T18:29:42.565298+0000","last_active":"2024-05-08T18:31:15.632795+0000","last_peered":"2024-05-08T18:31:15.632795+0000","last_clean":"2024-05-08T18:31:15.632795+0000","last_became_active":"2024-05-08T18:29:42.564542+0000","last_became_peered":"2024-05-08T18:29:42.564542+0000","last_unstale":"2024-05-08T18:31:15.632795+0000","last_undegraded":"2024-05-08T18:31:15.632795+0000","last_fullsized":"2024-05-08T18:31:15.632795+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:57.706167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.632572+0000","last_change":"2024-05-08T18:29:40.556958+0000","last_active":"2024-05-08T18:31:15.632572+0000","last_peered":"2024-05-08T18:31:15.632572+0000","last_clean":"2024-05-08T18:31:15.632572+0000","last_became_active":"2024-05-08T18:29:40.556091+0000","last_became_peered":"2024-05-08T18:29:40.556091+0000","last_unstale":"2024-05-08T18:31:15.632572+0000","last_undegraded":"2024-05-08T18:31:15.632572+0000","last_fullsized":"2024-05-08T18:31:15.632572+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:39.986094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":98,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.720324+0000","last_change":"2024-05-08T18:29:42.574619+0000","last_active":"2024-05-08T18:31:13.720324+0000","last_peered":"2024-05-08T18:31:13.720324+0000","last_clean":"2024-05-08T18:31:13.720324+0000","last_became_active":"2024-05-08T18:29:42.573178+0000","last_became_peered":"2024-05-08T18:29:42.573178+0000","last_unstale":"2024-05-08T18:31:13.720324+0000","last_undegraded":"2024-05-08T18:31:13.720324+0000","last_fullsized":"2024-05-08T18:31:13.720324+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:33.139089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":102,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.722117+0000","last_change":"2024-05-08T18:29:40.544338+0000","last_active":"2024-05-08T18:31:13.722117+0000","last_peered":"2024-05-08T18:31:13.722117+0000","last_clean":"2024-05-08T18:31:13.722117+0000","last_became_active":"2024-05-08T18:29:40.544107+0000","last_became_peered":"2024-05-08T18:29:40.544107+0000","last_unstale":"2024-05-08T18:31:13.722117+0000","last_undegraded":"2024-05-08T18:31:13.722117+0000","last_fullsized":"2024-05-08T18:31:13.722117+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:54.200883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.748300+0000","last_change":"2024-05-08T18:29:42.576979+0000","last_active":"2024-05-08T18:31:14.748300+0000","last_peered":"2024-05-08T18:31:14.748300+0000","last_clean":"2024-05-08T18:31:14.748300+0000","last_became_active":"2024-05-08T18:29:42.576395+0000","last_became_peered":"2024-05-08T18:29:42.576395+0000","last_unstale":"2024-05-08T18:31:14.748300+0000","last_undegraded":"2024-05-08T18:31:14.748300+0000","last_fullsized":"2024-05-08T18:31:14.748300+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:53:03.097704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.746535+0000","last_change":"2024-05-08T18:29:40.558142+0000","last_active":"2024-05-08T18:31:14.746535+0000","last_peered":"2024-05-08T18:31:14.746535+0000","last_clean":"2024-05-08T18:31:14.746535+0000","last_became_active":"2024-05-08T18:29:40.557874+0000","last_became_peered":"2024-05-08T18:29:40.557874+0000","last_unstale":"2024-05-08T18:31:14.746535+0000","last_undegraded":"2024-05-08T18:31:14.746535+0000","last_fullsized":"2024-05-08T18:31:14.746535+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:54.200883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":102,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.743913+0000","last_change":"2024-05-08T18:29:42.558324+0000","last_active":"2024-05-08T18:31:15.743913+0000","last_peered":"2024-05-08T18:31:15.743913+0000","last_clean":"2024-05-08T18:31:15.743913+0000","last_became_active":"2024-05-08T18:29:42.556774+0000","last_became_peered":"2024-05-08T18:29:42.556774+0000","last_unstale":"2024-05-08T18:31:15.743913+0000","last_undegraded":"2024-05-08T18:31:15.743913+0000","last_fullsized":"2024-05-08T18:31:15.743913+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:02:26.311100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":107,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.720928+0000","last_change":"2024-05-08T18:30:20.858467+0000","last_active":"2024-05-08T18:31:13.720928+0000","last_peered":"2024-05-08T18:31:13.720928+0000","last_clean":"2024-05-08T18:31:13.720928+0000","last_became_active":"2024-05-08T18:30:20.858016+0000","last_became_peered":"2024-05-08T18:30:20.858016+0000","last_unstale":"2024-05-08T18:31:13.720928+0000","last_undegraded":"2024-05-08T18:31:13.720928+0000","last_fullsized":"2024-05-08T18:31:13.720928+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:10:28.824915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.745649+0000","last_change":"2024-05-08T18:29:42.562772+0000","last_active":"2024-05-08T18:31:14.745649+0000","last_peered":"2024-05-08T18:31:14.745649+0000","last_clean":"2024-05-08T18:31:14.745649+0000","last_became_active":"2024-05-08T18:29:42.562420+0000","last_became_peered":"2024-05-08T18:29:42.562420+0000","last_unstale":"2024-05-08T18:31:14.745649+0000","last_undegraded":"2024-05-08T18:31:14.745649+0000","last_fullsized":"2024-05-08T18:31:14.745649+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:30:29.452640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.737804+0000","last_change":"2024-05-08T18:29:40.562024+0000","last_active":"2024-05-08T18:31:14.737804+0000","last_peered":"2024-05-08T18:31:14.737804+0000","last_clean":"2024-05-08T18:31:14.737804+0000","last_became_active":"2024-05-08T18:29:40.561326+0000","last_became_peered":"2024-05-08T18:29:40.561326+0000","last_unstale":"2024-05-08T18:31:14.737804+0000","last_undegraded":"2024-05-08T18:31:14.737804+0000","last_fullsized":"2024-05-08T18:31:14.737804+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:21:38.354933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.736186+0000","last_change":"2024-05-08T18:29:42.561419+0000","last_active":"2024-05-08T18:31:14.736186+0000","last_peered":"2024-05-08T18:31:14.736186+0000","last_clean":"2024-05-08T18:31:14.736186+0000","last_became_active":"2024-05-08T18:29:42.560520+0000","last_became_peered":"2024-05-08T18:29:42.560520+0000","last_unstale":"2024-05-08T18:31:14.736186+0000","last_undegraded":"2024-05-08T18:31:14.736186+0000","last_fullsized":"2024-05-08T18:31:14.736186+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:07.949520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.748826+0000","last_change":"2024-05-08T18:29:40.554884+0000","last_active":"2024-05-08T18:31:14.748826+0000","last_peered":"2024-05-08T18:31:14.748826+0000","last_clean":"2024-05-08T18:31:14.748826+0000","last_became_active":"2024-05-08T18:29:40.554603+0000","last_became_peered":"2024-05-08T18:29:40.554603+0000","last_unstale":"2024-05-08T18:31:14.748826+0000","last_undegraded":"2024-05-08T18:31:14.748826+0000","last_fullsized":"2024-05-08T18:31:14.748826+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:09:39.835826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":98,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.723375+0000","last_change":"2024-05-08T18:29:42.574689+0000","last_active":"2024-05-08T18:31:13.723375+0000","last_peered":"2024-05-08T18:31:13.723375+0000","last_clean":"2024-05-08T18:31:13.723375+0000","last_became_active":"2024-05-08T18:29:42.573947+0000","last_became_peered":"2024-05-08T18:29:42.573947+0000","last_unstale":"2024-05-08T18:31:13.723375+0000","last_undegraded":"2024-05-08T18:31:13.723375+0000","last_fullsized":"2024-05-08T18:31:13.723375+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:57:14.869860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.633077+0000","last_change":"2024-05-08T18:29:40.554005+0000","last_active":"2024-05-08T18:31:15.633077+0000","last_peered":"2024-05-08T18:31:15.633077+0000","last_clean":"2024-05-08T18:31:15.633077+0000","last_became_active":"2024-05-08T18:29:40.553356+0000","last_became_peered":"2024-05-08T18:29:40.553356+0000","last_unstale":"2024-05-08T18:31:15.633077+0000","last_undegraded":"2024-05-08T18:31:15.633077+0000","last_fullsized":"2024-05-08T18:31:15.633077+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:08:13.006752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":102,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.743476+0000","last_change":"2024-05-08T18:29:42.566487+0000","last_active":"2024-05-08T18:31:15.743476+0000","last_peered":"2024-05-08T18:31:15.743476+0000","last_clean":"2024-05-08T18:31:15.743476+0000","last_became_active":"2024-05-08T18:29:42.565760+0000","last_became_peered":"2024-05-08T18:29:42.565760+0000","last_unstale":"2024-05-08T18:31:15.743476+0000","last_undegraded":"2024-05-08T18:31:15.743476+0000","last_fullsized":"2024-05-08T18:31:15.743476+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:57.706167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.748401+0000","last_change":"2024-05-08T18:29:40.552543+0000","last_active":"2024-05-08T18:31:14.748401+0000","last_peered":"2024-05-08T18:31:14.748401+0000","last_clean":"2024-05-08T18:31:14.748401+0000","last_became_active":"2024-05-08T18:29:40.552307+0000","last_became_peered":"2024-05-08T18:29:40.552307+0000","last_unstale":"2024-05-08T18:31:14.748401+0000","last_undegraded":"2024-05-08T18:31:14.748401+0000","last_fullsized":"2024-05-08T18:31:14.748401+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:48.294532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.739096+0000","last_change":"2024-05-08T18:29:42.561658+0000","last_active":"2024-05-08T18:31:14.739096+0000","last_peered":"2024-05-08T18:31:14.739096+0000","last_clean":"2024-05-08T18:31:14.739096+0000","last_became_active":"2024-05-08T18:29:42.561171+0000","last_became_peered":"2024-05-08T18:29:42.561171+0000","last_unstale":"2024-05-08T18:31:14.739096+0000","last_undegraded":"2024-05-08T18:31:14.739096+0000","last_fullsized":"2024-05-08T18:31:14.739096+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:15.966061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.632355+0000","last_change":"2024-05-08T18:29:40.543041+0000","last_active":"2024-05-08T18:31:15.632355+0000","last_peered":"2024-05-08T18:31:15.632355+0000","last_clean":"2024-05-08T18:31:15.632355+0000","last_became_active":"2024-05-08T18:29:40.542398+0000","last_became_peered":"2024-05-08T18:29:40.542398+0000","last_unstale":"2024-05-08T18:31:15.632355+0000","last_undegraded":"2024-05-08T18:31:15.632355+0000","last_fullsized":"2024-05-08T18:31:15.632355+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:33.017750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":102,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.742849+0000","last_change":"2024-05-08T18:29:42.579690+0000","last_active":"2024-05-08T18:31:15.742849+0000","last_peered":"2024-05-08T18:31:15.742849+0000","last_clean":"2024-05-08T18:31:15.742849+0000","last_became_active":"2024-05-08T18:29:42.578981+0000","last_became_peered":"2024-05-08T18:29:42.578981+0000","last_unstale":"2024-05-08T18:31:15.742849+0000","last_undegraded":"2024-05-08T18:31:15.742849+0000","last_fullsized":"2024-05-08T18:31:15.742849+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:36:03.084561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":102,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.722273+0000","last_change":"2024-05-08T18:29:40.548499+0000","last_active":"2024-05-08T18:31:13.722273+0000","last_peered":"2024-05-08T18:31:13.722273+0000","last_clean":"2024-05-08T18:31:13.722273+0000","last_became_active":"2024-05-08T18:29:40.548177+0000","last_became_peered":"2024-05-08T18:29:40.548177+0000","last_unstale":"2024-05-08T18:31:13.722273+0000","last_undegraded":"2024-05-08T18:31:13.722273+0000","last_fullsized":"2024-05-08T18:31:13.722273+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:27:41.414153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":101,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.261799+0000","last_change":"2024-05-08T18:29:42.575892+0000","last_active":"2024-05-08T18:31:16.261799+0000","last_peered":"2024-05-08T18:31:16.261799+0000","last_clean":"2024-05-08T18:31:16.261799+0000","last_became_active":"2024-05-08T18:29:42.573384+0000","last_became_peered":"2024-05-08T18:29:42.573384+0000","last_unstale":"2024-05-08T18:31:16.261799+0000","last_undegraded":"2024-05-08T18:31:16.261799+0000","last_fullsized":"2024-05-08T18:31:16.261799+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:55.055481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.737601+0000","last_change":"2024-05-08T18:29:40.565068+0000","last_active":"2024-05-08T18:31:14.737601+0000","last_peered":"2024-05-08T18:31:14.737601+0000","last_clean":"2024-05-08T18:31:14.737601+0000","last_became_active":"2024-05-08T18:29:40.563231+0000","last_became_peered":"2024-05-08T18:29:40.563231+0000","last_unstale":"2024-05-08T18:31:14.737601+0000","last_undegraded":"2024-05-08T18:31:14.737601+0000","last_fullsized":"2024-05-08T18:31:14.737601+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:17:47.828990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":98,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.721217+0000","last_change":"2024-05-08T18:29:42.564338+0000","last_active":"2024-05-08T18:31:13.721217+0000","last_peered":"2024-05-08T18:31:13.721217+0000","last_clean":"2024-05-08T18:31:13.721217+0000","last_became_active":"2024-05-08T18:29:42.563822+0000","last_became_peered":"2024-05-08T18:29:42.563822+0000","last_unstale":"2024-05-08T18:31:13.721217+0000","last_undegraded":"2024-05-08T18:31:13.721217+0000","last_fullsized":"2024-05-08T18:31:13.721217+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:23.397435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":105,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.262510+0000","last_change":"2024-05-08T18:29:40.573333+0000","last_active":"2024-05-08T18:31:16.262510+0000","last_peered":"2024-05-08T18:31:16.262510+0000","last_clean":"2024-05-08T18:31:16.262510+0000","last_became_active":"2024-05-08T18:29:40.571195+0000","last_became_peered":"2024-05-08T18:29:40.571195+0000","last_unstale":"2024-05-08T18:31:16.262510+0000","last_undegraded":"2024-05-08T18:31:16.262510+0000","last_fullsized":"2024-05-08T18:31:16.262510+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:33.017750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.745591+0000","last_change":"2024-05-08T18:29:42.563085+0000","last_active":"2024-05-08T18:31:14.745591+0000","last_peered":"2024-05-08T18:31:14.745591+0000","last_clean":"2024-05-08T18:31:14.745591+0000","last_became_active":"2024-05-08T18:29:42.560419+0000","last_became_peered":"2024-05-08T18:29:42.560419+0000","last_unstale":"2024-05-08T18:31:14.745591+0000","last_undegraded":"2024-05-08T18:31:14.745591+0000","last_fullsized":"2024-05-08T18:31:14.745591+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:20.397730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.740840+0000","last_change":"2024-05-08T18:29:40.568890+0000","last_active":"2024-05-08T18:31:14.740840+0000","last_peered":"2024-05-08T18:31:14.740840+0000","last_clean":"2024-05-08T18:31:14.740840+0000","last_became_active":"2024-05-08T18:29:40.568584+0000","last_became_peered":"2024-05-08T18:29:40.568584+0000","last_unstale":"2024-05-08T18:31:14.740840+0000","last_undegraded":"2024-05-08T18:31:14.740840+0000","last_fullsized":"2024-05-08T18:31:14.740840+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:25:01.595224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":101,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.260720+0000","last_change":"2024-05-08T18:29:42.574277+0000","last_active":"2024-05-08T18:31:16.260720+0000","last_peered":"2024-05-08T18:31:16.260720+0000","last_clean":"2024-05-08T18:31:16.260720+0000","last_became_active":"2024-05-08T18:29:42.573563+0000","last_became_peered":"2024-05-08T18:29:42.573563+0000","last_unstale":"2024-05-08T18:31:16.260720+0000","last_undegraded":"2024-05-08T18:31:16.260720+0000","last_fullsized":"2024-05-08T18:31:16.260720+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:57.706167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.633538+0000","last_change":"2024-05-08T18:29:40.562058+0000","last_active":"2024-05-08T18:31:15.633538+0000","last_peered":"2024-05-08T18:31:15.633538+0000","last_clean":"2024-05-08T18:31:15.633538+0000","last_became_active":"2024-05-08T18:29:40.561360+0000","last_became_peered":"2024-05-08T18:29:40.561360+0000","last_unstale":"2024-05-08T18:31:15.633538+0000","last_undegraded":"2024-05-08T18:31:15.633538+0000","last_fullsized":"2024-05-08T18:31:15.633538+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:05.929806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.633064+0000","last_change":"2024-05-08T18:29:40.538728+0000","last_active":"2024-05-08T18:31:15.633064+0000","last_peered":"2024-05-08T18:31:15.633064+0000","last_clean":"2024-05-08T18:31:15.633064+0000","last_became_active":"2024-05-08T18:29:40.537925+0000","last_became_peered":"2024-05-08T18:29:40.537925+0000","last_unstale":"2024-05-08T18:31:15.633064+0000","last_undegraded":"2024-05-08T18:31:15.633064+0000","last_fullsized":"2024-05-08T18:31:15.633064+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:28.426657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":98,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.723287+0000","last_change":"2024-05-08T18:29:42.574941+0000","last_active":"2024-05-08T18:31:13.723287+0000","last_peered":"2024-05-08T18:31:13.723287+0000","last_clean":"2024-05-08T18:31:13.723287+0000","last_became_active":"2024-05-08T18:29:42.574351+0000","last_became_peered":"2024-05-08T18:29:42.574351+0000","last_unstale":"2024-05-08T18:31:13.723287+0000","last_undegraded":"2024-05-08T18:31:13.723287+0000","last_fullsized":"2024-05-08T18:31:13.723287+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:21.935293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":102,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.719801+0000","last_change":"2024-05-08T18:29:40.543714+0000","last_active":"2024-05-08T18:31:13.719801+0000","last_peered":"2024-05-08T18:31:13.719801+0000","last_clean":"2024-05-08T18:31:13.719801+0000","last_became_active":"2024-05-08T18:29:40.542965+0000","last_became_peered":"2024-05-08T18:29:40.542965+0000","last_unstale":"2024-05-08T18:31:13.719801+0000","last_undegraded":"2024-05-08T18:31:13.719801+0000","last_fullsized":"2024-05-08T18:31:13.719801+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:12:59.146887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.632772+0000","last_change":"2024-05-08T18:29:42.560007+0000","last_active":"2024-05-08T18:31:15.632772+0000","last_peered":"2024-05-08T18:31:15.632772+0000","last_clean":"2024-05-08T18:31:15.632772+0000","last_became_active":"2024-05-08T18:29:42.559028+0000","last_became_peered":"2024-05-08T18:29:42.559028+0000","last_unstale":"2024-05-08T18:31:15.632772+0000","last_undegraded":"2024-05-08T18:31:15.632772+0000","last_fullsized":"2024-05-08T18:31:15.632772+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:36:03.084561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":689,"num_read_kb":448,"num_write":419,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":388,"ondisk_log_size":388,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509467,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32576,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339264,"statfs":{"total":96636764160,"available":96603406336,"internally_reserved":0,"allocated":1421312,"data_stored":1014867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509467,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":827392,"data_stored":439471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509465,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":872448,"data_stored":440299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509465,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":827392,"data_stored":446785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542170,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":819200,"data_stored":424235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542170,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":823296,"data_stored":440462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542168,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":831488,"data_stored":431905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542170,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28408,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343432,"statfs":{"total":96636764160,"available":96607674368,"internally_reserved":0,"allocated":1421312,"data_stored":1023518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T18:31:19.002 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-05-08T18:31:19.002 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-05-08T18:31:19.002 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-05-08T18:31:19.003 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-05-08T18:31:19.033 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:19.033 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2024-05-08T18:31:19.033 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2024-05-08T18:31:19.034 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-05-08T18:31:19.034 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.034 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4479.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-05-08T18:31:19.034 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:44.576320+0000", 2024-05-08T18:31:19.034 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 94.456132889000003, 2024-05-08T18:31:19.034 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019751892, 2024-05-08T18:31:19.034 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:19.034 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:19.034 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "reached pg", 2024-05-08T18:31:19.034 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:19.034 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4479", 2024-05-08T18:31:19.034 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3577501689", 2024-05-08T18:31:19.034 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 2 2024-05-08T18:31:19.035 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.035 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:19.035 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.035 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:19.035 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576320+0000", 2024-05-08T18:31:19.035 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:19.035 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.035 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.035 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:19.035 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576320+0000", 2024-05-08T18:31:19.035 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:19.035 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.035 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.035 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:19.035 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576323+0000", 2024-05-08T18:31:19.036 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.813e-06 2024-05-08T18:31:19.036 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.036 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.036 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:19.036 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576335+0000", 2024-05-08T18:31:19.036 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2330000000000001e-05 2024-05-08T18:31:19.036 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.036 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.036 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:19.036 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576367+0000", 2024-05-08T18:31:19.036 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2036999999999998e-05 2024-05-08T18:31:19.036 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.036 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.036 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:19.037 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576394+0000", 2024-05-08T18:31:19.037 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6529e-05 2024-05-08T18:31:19.037 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.037 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.037 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:19.037 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576550+0000", 2024-05-08T18:31:19.037 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000156718 2024-05-08T18:31:19.037 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.037 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.037 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-05-08T18:31:19.037 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576560+0000", 2024-05-08T18:31:19.037 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0040999999999999e-05 2024-05-08T18:31:19.037 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.037 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.038 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:19.038 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.587240+0000", 2024-05-08T18:31:19.038 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010679266999999999 2024-05-08T18:31:19.038 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.038 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.038 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2024-05-08T18:31:19.038 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.587266+0000", 2024-05-08T18:31:19.038 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6642e-05 2024-05-08T18:31:19.038 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.038 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.038 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:19.038 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.595882+0000", 2024-05-08T18:31:19.038 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0086159600000000006 2024-05-08T18:31:19.038 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.039 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.039 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:19.039 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.596072+0000", 2024-05-08T18:31:19.039 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000189555 2024-05-08T18:31:19.039 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.039 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:19.039 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.039 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.039 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.039 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:31:19.039 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:48.766182+0000", 2024-05-08T18:31:19.039 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 90.266270861999999, 2024-05-08T18:31:19.039 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031881209999999999, 2024-05-08T18:31:19.039 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:19.040 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:19.040 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:19.040 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:19.040 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:19.040 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:19.040 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 193 2024-05-08T18:31:19.040 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.040 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:19.040 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.040 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:19.040 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766182+0000", 2024-05-08T18:31:19.040 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:19.040 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.040 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.041 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:19.041 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766182+0000", 2024-05-08T18:31:19.041 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:19.041 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.041 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.041 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:19.041 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766184+0000", 2024-05-08T18:31:19.041 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4159999999999998e-06 2024-05-08T18:31:19.041 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.041 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.041 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:19.041 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766196+0000", 2024-05-08T18:31:19.041 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1814000000000001e-05 2024-05-08T18:31:19.041 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.042 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.042 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:19.042 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766227+0000", 2024-05-08T18:31:19.042 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0676000000000002e-05 2024-05-08T18:31:19.042 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.042 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.042 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:19.042 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766242+0000", 2024-05-08T18:31:19.042 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5497000000000001e-05 2024-05-08T18:31:19.042 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.042 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.042 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:19.042 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766354+0000", 2024-05-08T18:31:19.042 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000111579 2024-05-08T18:31:19.043 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.043 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.043 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:19.043 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766569+0000", 2024-05-08T18:31:19.043 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000214978 2024-05-08T18:31:19.043 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.043 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.043 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:19.043 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766834+0000", 2024-05-08T18:31:19.043 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00026551500000000002 2024-05-08T18:31:19.043 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.043 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.043 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:19.043 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.768577+0000", 2024-05-08T18:31:19.044 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001742513 2024-05-08T18:31:19.044 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.044 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.044 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:19.044 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.769150+0000", 2024-05-08T18:31:19.044 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00057320500000000003 2024-05-08T18:31:19.044 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.044 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.044 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:19.044 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.769250+0000", 2024-05-08T18:31:19.044 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.9846000000000006e-05 2024-05-08T18:31:19.044 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.044 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.044 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:19.044 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.769370+0000", 2024-05-08T18:31:19.045 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012008200000000001 2024-05-08T18:31:19.045 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.045 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:19.045 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.045 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.045 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.045 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:19.045 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.679562+0000", 2024-05-08T18:31:19.045 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 87.352891158000006, 2024-05-08T18:31:19.045 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0086320800000000003, 2024-05-08T18:31:19.045 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:19.045 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:19.045 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:19.045 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:19.046 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:19.046 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:19.046 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 208 2024-05-08T18:31:19.046 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.046 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:19.046 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.046 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:19.046 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679562+0000", 2024-05-08T18:31:19.046 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:19.046 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.046 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.046 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:19.046 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679562+0000", 2024-05-08T18:31:19.046 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:19.047 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.047 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.047 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:19.047 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679565+0000", 2024-05-08T18:31:19.047 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0800000000000002e-06 2024-05-08T18:31:19.047 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.047 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.047 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:19.047 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679578+0000", 2024-05-08T18:31:19.047 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3217000000000001e-05 2024-05-08T18:31:19.047 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.047 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.047 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:19.048 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679610+0000", 2024-05-08T18:31:19.048 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1696000000000003e-05 2024-05-08T18:31:19.048 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.048 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.048 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:19.048 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679625+0000", 2024-05-08T18:31:19.048 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5824e-05 2024-05-08T18:31:19.048 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.048 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.048 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:19.048 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679758+0000", 2024-05-08T18:31:19.048 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013231199999999999 2024-05-08T18:31:19.048 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.048 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.049 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-05-08T18:31:19.049 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679770+0000", 2024-05-08T18:31:19.049 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1800000000000001e-05 2024-05-08T18:31:19.049 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.049 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.049 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:19.049 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.685241+0000", 2024-05-08T18:31:19.049 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0054710169999999999 2024-05-08T18:31:19.049 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.049 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.049 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:19.049 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.685444+0000", 2024-05-08T18:31:19.049 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000203835 2024-05-08T18:31:19.049 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.049 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.050 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:19.050 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.685842+0000", 2024-05-08T18:31:19.050 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00039773 2024-05-08T18:31:19.050 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.050 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.050 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:19.050 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.687232+0000", 2024-05-08T18:31:19.050 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00139011 2024-05-08T18:31:19.050 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.050 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.050 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:19.050 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.688049+0000", 2024-05-08T18:31:19.050 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00081667000000000003 2024-05-08T18:31:19.050 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.051 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.051 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:19.051 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.688135+0000", 2024-05-08T18:31:19.051 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6299999999999997e-05 2024-05-08T18:31:19.051 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.051 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.051 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:19.051 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.688194+0000", 2024-05-08T18:31:19.051 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8489000000000002e-05 2024-05-08T18:31:19.051 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.051 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:19.051 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.051 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.051 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.052 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:19.052 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.707114+0000", 2024-05-08T18:31:19.052 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 87.325339143999997, 2024-05-08T18:31:19.052 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031802990000000001, 2024-05-08T18:31:19.052 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:19.052 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:19.052 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:19.052 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:19.052 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:19.052 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:19.052 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 212 2024-05-08T18:31:19.052 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.052 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:19.052 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.053 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:19.053 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707114+0000", 2024-05-08T18:31:19.053 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:19.053 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.053 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.053 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:19.053 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707114+0000", 2024-05-08T18:31:19.053 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:19.053 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.053 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.053 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:19.053 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707117+0000", 2024-05-08T18:31:19.053 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8629999999999999e-06 2024-05-08T18:31:19.053 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.054 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.054 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:19.054 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707129+0000", 2024-05-08T18:31:19.054 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2150000000000001e-05 2024-05-08T18:31:19.054 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.054 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.054 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:19.054 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707158+0000", 2024-05-08T18:31:19.054 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9513999999999999e-05 2024-05-08T18:31:19.054 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.054 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.054 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:19.054 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707173+0000", 2024-05-08T18:31:19.054 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5136e-05 2024-05-08T18:31:19.055 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.055 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.055 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:19.055 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707309+0000", 2024-05-08T18:31:19.055 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000135609 2024-05-08T18:31:19.055 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.055 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.055 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:19.055 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707523+0000", 2024-05-08T18:31:19.055 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021362200000000001 2024-05-08T18:31:19.055 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.055 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.056 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:19.056 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707918+0000", 2024-05-08T18:31:19.056 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00039556299999999998 2024-05-08T18:31:19.056 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.056 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.056 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:19.056 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.709166+0000", 2024-05-08T18:31:19.056 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012476410000000001 2024-05-08T18:31:19.056 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.056 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.056 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:19.056 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.710145+0000", 2024-05-08T18:31:19.057 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00097909899999999998 2024-05-08T18:31:19.057 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.057 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.057 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:19.057 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.710231+0000", 2024-05-08T18:31:19.057 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5625999999999996e-05 2024-05-08T18:31:19.057 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.057 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.057 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:19.057 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.710294+0000", 2024-05-08T18:31:19.057 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3476e-05 2024-05-08T18:31:19.057 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.057 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:19.057 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.058 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.058 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.058 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:19.058 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.731985+0000", 2024-05-08T18:31:19.058 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 87.300467918999999, 2024-05-08T18:31:19.058 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0039250600000000002, 2024-05-08T18:31:19.058 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:19.058 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:19.058 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:19.058 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:19.058 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:19.058 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:19.058 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 219 2024-05-08T18:31:19.058 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.059 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:19.059 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.059 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:19.059 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731985+0000", 2024-05-08T18:31:19.059 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:19.059 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.059 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.059 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:19.059 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731985+0000", 2024-05-08T18:31:19.059 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:19.060 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.060 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.060 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:19.060 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731988+0000", 2024-05-08T18:31:19.060 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6599999999999999e-06 2024-05-08T18:31:19.060 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.060 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.060 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:19.060 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.732017+0000", 2024-05-08T18:31:19.060 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9692999999999998e-05 2024-05-08T18:31:19.060 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.060 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.060 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:19.060 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.732048+0000", 2024-05-08T18:31:19.060 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1066999999999999e-05 2024-05-08T18:31:19.061 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.061 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.061 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:19.061 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.732064+0000", 2024-05-08T18:31:19.061 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5786000000000001e-05 2024-05-08T18:31:19.061 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.061 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.061 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:19.061 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.732213+0000", 2024-05-08T18:31:19.061 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014895899999999999 2024-05-08T18:31:19.061 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.061 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.061 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:19.062 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.732572+0000", 2024-05-08T18:31:19.062 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000358904 2024-05-08T18:31:19.062 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.062 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.062 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:19.062 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.733349+0000", 2024-05-08T18:31:19.062 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00077657699999999997 2024-05-08T18:31:19.062 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.062 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.062 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:19.062 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.734899+0000", 2024-05-08T18:31:19.062 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001550652 2024-05-08T18:31:19.062 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.062 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.063 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:19.063 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.735641+0000", 2024-05-08T18:31:19.063 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00074222000000000003 2024-05-08T18:31:19.063 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.063 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.063 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:19.063 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.735801+0000", 2024-05-08T18:31:19.063 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015913599999999999 2024-05-08T18:31:19.063 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.063 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.063 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:19.063 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.735910+0000", 2024-05-08T18:31:19.063 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000109406 2024-05-08T18:31:19.063 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.064 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:19.064 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.064 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.064 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.064 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:19.064 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.750251+0000", 2024-05-08T18:31:19.064 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 87.282201986999993, 2024-05-08T18:31:19.064 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0038408600000000002, 2024-05-08T18:31:19.064 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:19.064 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:19.064 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:19.064 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:19.064 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:19.065 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:19.065 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 224 2024-05-08T18:31:19.065 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.065 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:19.065 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.065 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:19.065 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750251+0000", 2024-05-08T18:31:19.065 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:19.065 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.065 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.065 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:19.065 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750251+0000", 2024-05-08T18:31:19.065 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:19.065 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.065 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.066 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:19.066 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750253+0000", 2024-05-08T18:31:19.066 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2129999999999998e-06 2024-05-08T18:31:19.066 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.066 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.066 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:19.066 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750265+0000", 2024-05-08T18:31:19.066 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1484000000000001e-05 2024-05-08T18:31:19.066 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.066 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.066 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:19.066 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750293+0000", 2024-05-08T18:31:19.066 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8673000000000001e-05 2024-05-08T18:31:19.067 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.067 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.067 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:19.067 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750308+0000", 2024-05-08T18:31:19.067 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4620000000000001e-05 2024-05-08T18:31:19.067 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.067 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.067 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:19.067 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750459+0000", 2024-05-08T18:31:19.067 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000151619 2024-05-08T18:31:19.067 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.067 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.067 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:19.067 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750822+0000", 2024-05-08T18:31:19.068 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000362467 2024-05-08T18:31:19.068 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.068 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.068 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:19.068 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.751591+0000", 2024-05-08T18:31:19.068 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00076934699999999998 2024-05-08T18:31:19.068 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.068 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.068 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:19.068 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.753042+0000", 2024-05-08T18:31:19.068 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001450652 2024-05-08T18:31:19.068 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.068 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.068 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:19.069 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.753792+0000", 2024-05-08T18:31:19.069 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00075045500000000002 2024-05-08T18:31:19.069 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.069 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.069 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:19.069 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.753977+0000", 2024-05-08T18:31:19.069 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000184511 2024-05-08T18:31:19.069 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.069 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.069 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:19.069 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.754092+0000", 2024-05-08T18:31:19.069 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000114819 2024-05-08T18:31:19.069 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.069 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:19.069 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.070 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.070 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.070 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:19.070 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.783902+0000", 2024-05-08T18:31:19.070 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 87.248551255999999, 2024-05-08T18:31:19.070 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003120046, 2024-05-08T18:31:19.070 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:19.070 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:19.070 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:19.070 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:19.070 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:19.070 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:19.070 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 233 2024-05-08T18:31:19.070 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.071 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:19.071 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.071 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:19.071 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.783902+0000", 2024-05-08T18:31:19.071 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:19.071 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.071 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.071 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:19.071 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.783902+0000", 2024-05-08T18:31:19.071 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:19.071 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.071 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.071 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:19.071 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.783904+0000", 2024-05-08T18:31:19.072 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5229999999999998e-06 2024-05-08T18:31:19.072 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.072 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.072 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:19.072 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.783916+0000", 2024-05-08T18:31:19.072 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1513e-05 2024-05-08T18:31:19.072 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.072 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.072 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:19.072 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.783947+0000", 2024-05-08T18:31:19.072 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1353000000000003e-05 2024-05-08T18:31:19.072 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.072 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.072 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:19.072 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.783964+0000", 2024-05-08T18:31:19.073 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6643e-05 2024-05-08T18:31:19.073 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.073 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.073 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:19.073 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.784110+0000", 2024-05-08T18:31:19.073 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014627299999999999 2024-05-08T18:31:19.073 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.073 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.073 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:19.073 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.784329+0000", 2024-05-08T18:31:19.073 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021892099999999999 2024-05-08T18:31:19.073 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.073 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.073 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:19.074 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.784752+0000", 2024-05-08T18:31:19.074 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00042336700000000001 2024-05-08T18:31:19.074 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.074 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.074 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:19.074 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.786093+0000", 2024-05-08T18:31:19.074 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00134107 2024-05-08T18:31:19.074 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.074 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.074 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:19.074 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.786863+0000", 2024-05-08T18:31:19.074 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00076949099999999997 2024-05-08T18:31:19.074 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.075 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.075 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:19.075 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.786955+0000", 2024-05-08T18:31:19.075 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.2478999999999993e-05 2024-05-08T18:31:19.075 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.075 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.075 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:19.075 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.787022+0000", 2024-05-08T18:31:19.075 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6413000000000003e-05 2024-05-08T18:31:19.075 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.075 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:19.075 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.075 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.075 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.076 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:341 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:19.076 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.816045+0000", 2024-05-08T18:31:19.076 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 87.216407919000005, 2024-05-08T18:31:19.076 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002875154, 2024-05-08T18:31:19.076 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:19.076 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:19.076 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:19.076 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:19.076 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:19.076 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:19.076 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 341 2024-05-08T18:31:19.076 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.076 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:19.076 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.077 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:19.077 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816045+0000", 2024-05-08T18:31:19.077 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:19.077 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.077 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.077 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:19.077 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816045+0000", 2024-05-08T18:31:19.077 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:19.077 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.077 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.077 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:19.077 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816046+0000", 2024-05-08T18:31:19.077 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9199999999999999e-07 2024-05-08T18:31:19.077 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.078 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.078 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:19.078 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816050+0000", 2024-05-08T18:31:19.078 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0260000000000001e-06 2024-05-08T18:31:19.078 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.078 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.078 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:19.078 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816060+0000", 2024-05-08T18:31:19.078 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0297e-05 2024-05-08T18:31:19.078 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.078 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.078 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:19.078 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816065+0000", 2024-05-08T18:31:19.078 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.237e-06 2024-05-08T18:31:19.079 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.079 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.079 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:19.079 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816122+0000", 2024-05-08T18:31:19.079 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6168000000000002e-05 2024-05-08T18:31:19.079 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.079 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.079 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:19.079 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816198+0000", 2024-05-08T18:31:19.079 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6511e-05 2024-05-08T18:31:19.079 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.079 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.079 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:31:19.079 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816305+0000", 2024-05-08T18:31:19.080 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000106487 2024-05-08T18:31:19.080 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.080 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.080 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:19.080 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816886+0000", 2024-05-08T18:31:19.080 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00058187199999999999 2024-05-08T18:31:19.080 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.080 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.080 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:19.080 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.818821+0000", 2024-05-08T18:31:19.080 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001934362 2024-05-08T18:31:19.080 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.080 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.080 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:19.081 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.818880+0000", 2024-05-08T18:31:19.081 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9210999999999999e-05 2024-05-08T18:31:19.081 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.081 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.081 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:19.081 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.818920+0000", 2024-05-08T18:31:19.081 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0091e-05 2024-05-08T18:31:19.081 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.081 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:19.081 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.081 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.081 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.081 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:19.081 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.086431+0000", 2024-05-08T18:31:19.081 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 86.946022099000004, 2024-05-08T18:31:19.082 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028335959999999999, 2024-05-08T18:31:19.082 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:19.082 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:19.082 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:19.082 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:19.082 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:19.082 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:19.082 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 733 2024-05-08T18:31:19.082 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.082 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:19.082 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.082 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:19.082 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086431+0000", 2024-05-08T18:31:19.082 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:19.083 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.083 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.083 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:19.083 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086431+0000", 2024-05-08T18:31:19.083 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:19.083 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.083 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.083 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:19.083 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086433+0000", 2024-05-08T18:31:19.083 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8899999999999999e-06 2024-05-08T18:31:19.083 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.083 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.083 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:19.083 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086441+0000", 2024-05-08T18:31:19.084 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.3100000000000001e-06 2024-05-08T18:31:19.084 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.084 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.084 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:19.084 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086460+0000", 2024-05-08T18:31:19.084 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8703999999999999e-05 2024-05-08T18:31:19.084 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.084 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.084 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:19.084 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086471+0000", 2024-05-08T18:31:19.084 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1324e-05 2024-05-08T18:31:19.084 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.084 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.084 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:19.084 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086590+0000", 2024-05-08T18:31:19.085 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000118625 2024-05-08T18:31:19.085 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.085 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.085 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:19.085 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086817+0000", 2024-05-08T18:31:19.085 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000226958 2024-05-08T18:31:19.085 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.085 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.085 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:19.085 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.087131+0000", 2024-05-08T18:31:19.085 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00031478799999999998 2024-05-08T18:31:19.085 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.085 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.085 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:19.086 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.088025+0000", 2024-05-08T18:31:19.086 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00089402999999999998 2024-05-08T18:31:19.086 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.086 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.086 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:19.086 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.089123+0000", 2024-05-08T18:31:19.086 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001097598 2024-05-08T18:31:19.086 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.086 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.086 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:19.086 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.089200+0000", 2024-05-08T18:31:19.086 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7333e-05 2024-05-08T18:31:19.086 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.086 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.087 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:19.087 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.089264+0000", 2024-05-08T18:31:19.087 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.4035999999999995e-05 2024-05-08T18:31:19.087 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.087 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:19.087 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.087 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.087 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.087 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:751 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:19.087 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.125611+0000", 2024-05-08T18:31:19.087 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 86.906841407000002, 2024-05-08T18:31:19.087 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032716749999999999, 2024-05-08T18:31:19.087 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:19.087 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:19.087 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:19.088 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:19.088 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:19.088 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:19.088 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 751 2024-05-08T18:31:19.088 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.088 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:19.088 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.088 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:19.088 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125611+0000", 2024-05-08T18:31:19.088 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:19.088 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.088 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.088 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:19.089 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125611+0000", 2024-05-08T18:31:19.089 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:19.089 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.089 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.089 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:19.089 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125614+0000", 2024-05-08T18:31:19.089 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.12e-06 2024-05-08T18:31:19.089 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.089 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.089 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:19.089 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125624+0000", 2024-05-08T18:31:19.089 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0492999999999999e-05 2024-05-08T18:31:19.089 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.089 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.089 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:19.090 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125650+0000", 2024-05-08T18:31:19.090 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5907000000000001e-05 2024-05-08T18:31:19.090 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.090 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.090 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:19.090 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125667+0000", 2024-05-08T18:31:19.090 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.694e-05 2024-05-08T18:31:19.090 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.090 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.090 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:19.090 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125801+0000", 2024-05-08T18:31:19.090 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000134482 2024-05-08T18:31:19.090 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.090 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.091 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:19.091 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.126174+0000", 2024-05-08T18:31:19.091 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00037294999999999999 2024-05-08T18:31:19.091 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.091 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.091 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:19.091 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.126750+0000", 2024-05-08T18:31:19.091 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00057538900000000004 2024-05-08T18:31:19.091 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.091 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.091 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:19.091 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.127997+0000", 2024-05-08T18:31:19.091 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001247761 2024-05-08T18:31:19.091 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.092 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.092 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:19.092 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.128731+0000", 2024-05-08T18:31:19.092 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00073338099999999996 2024-05-08T18:31:19.092 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.092 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.092 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:19.092 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.128817+0000", 2024-05-08T18:31:19.092 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5993000000000002e-05 2024-05-08T18:31:19.092 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.092 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.092 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:19.092 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.128883+0000", 2024-05-08T18:31:19.093 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6259000000000004e-05 2024-05-08T18:31:19.093 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.093 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:19.093 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.093 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.093 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.093 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:753 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:19.093 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.129809+0000", 2024-05-08T18:31:19.093 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 86.902643869000002, 2024-05-08T18:31:19.093 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0033775440000000001, 2024-05-08T18:31:19.093 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:19.093 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:19.093 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:19.093 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:19.094 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:19.094 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:19.094 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 753 2024-05-08T18:31:19.094 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.094 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:19.094 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.094 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:19.094 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129809+0000", 2024-05-08T18:31:19.094 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:19.094 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.094 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.094 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:19.094 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129809+0000", 2024-05-08T18:31:19.095 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:19.095 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.095 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.095 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:19.095 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129811+0000", 2024-05-08T18:31:19.095 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1730000000000002e-06 2024-05-08T18:31:19.095 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.095 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.095 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:19.095 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129822+0000", 2024-05-08T18:31:19.095 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0583e-05 2024-05-08T18:31:19.095 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.095 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.095 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:19.096 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129852+0000", 2024-05-08T18:31:19.096 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0744000000000002e-05 2024-05-08T18:31:19.096 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.096 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.096 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:19.096 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129870+0000", 2024-05-08T18:31:19.096 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7955999999999999e-05 2024-05-08T18:31:19.096 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.096 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.096 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:19.096 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.130018+0000", 2024-05-08T18:31:19.096 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014747600000000001 2024-05-08T18:31:19.096 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.096 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.096 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:19.097 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.130259+0000", 2024-05-08T18:31:19.097 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024079099999999999 2024-05-08T18:31:19.097 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.097 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.097 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:19.097 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.130734+0000", 2024-05-08T18:31:19.097 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00047562 2024-05-08T18:31:19.097 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.097 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.097 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:19.097 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.131997+0000", 2024-05-08T18:31:19.097 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012626429999999999 2024-05-08T18:31:19.097 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.097 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.098 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:19.098 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.132923+0000", 2024-05-08T18:31:19.098 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00092627599999999997 2024-05-08T18:31:19.098 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.098 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.098 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:19.098 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.133076+0000", 2024-05-08T18:31:19.098 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000152989 2024-05-08T18:31:19.098 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.098 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.098 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:19.098 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.133187+0000", 2024-05-08T18:31:19.098 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000110293 2024-05-08T18:31:19.098 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.099 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:19.099 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.099 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.099 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.099 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:19.099 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.228247+0000", 2024-05-08T18:31:19.099 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 86.804206258999997, 2024-05-08T18:31:19.099 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032753449999999998, 2024-05-08T18:31:19.099 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:19.099 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:19.099 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:19.099 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:19.099 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:19.099 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:19.100 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 796 2024-05-08T18:31:19.100 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.100 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:19.100 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.100 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:19.100 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228247+0000", 2024-05-08T18:31:19.100 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:19.100 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.100 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.100 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:19.100 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228247+0000", 2024-05-08T18:31:19.100 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:19.100 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.100 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.101 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:19.101 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228249+0000", 2024-05-08T18:31:19.101 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3800000000000001e-06 2024-05-08T18:31:19.101 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.101 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.101 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:19.101 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228260+0000", 2024-05-08T18:31:19.101 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1496e-05 2024-05-08T18:31:19.101 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.101 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.101 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:19.101 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228292+0000", 2024-05-08T18:31:19.101 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1294000000000002e-05 2024-05-08T18:31:19.101 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.101 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.102 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:19.102 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228306+0000", 2024-05-08T18:31:19.102 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4606e-05 2024-05-08T18:31:19.102 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.102 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.102 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:19.102 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228443+0000", 2024-05-08T18:31:19.102 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013672599999999999 2024-05-08T18:31:19.102 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.102 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.102 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:19.102 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228813+0000", 2024-05-08T18:31:19.102 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00036987000000000001 2024-05-08T18:31:19.103 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.103 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.103 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:31:19.103 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.229365+0000", 2024-05-08T18:31:19.103 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00055210600000000002 2024-05-08T18:31:19.103 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.103 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.103 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:19.103 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.230800+0000", 2024-05-08T18:31:19.103 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001435006 2024-05-08T18:31:19.103 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.103 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.103 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:19.103 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.231369+0000", 2024-05-08T18:31:19.104 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00056848499999999998 2024-05-08T18:31:19.104 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.104 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.104 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:19.104 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.231455+0000", 2024-05-08T18:31:19.104 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6905999999999998e-05 2024-05-08T18:31:19.104 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.104 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.104 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:19.104 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.231522+0000", 2024-05-08T18:31:19.104 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6470000000000006e-05 2024-05-08T18:31:19.104 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.104 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:19.104 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.105 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.105 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.105 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:798 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:19.105 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.232573+0000", 2024-05-08T18:31:19.105 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 86.799880152, 2024-05-08T18:31:19.105 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0030406690000000002, 2024-05-08T18:31:19.105 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:19.105 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:19.105 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:19.105 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:19.105 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:19.105 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:19.105 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 798 2024-05-08T18:31:19.106 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.106 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:19.106 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.106 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:19.106 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232573+0000", 2024-05-08T18:31:19.106 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:19.106 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.106 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.106 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:19.106 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232573+0000", 2024-05-08T18:31:19.106 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:19.106 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.106 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.107 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:19.107 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232574+0000", 2024-05-08T18:31:19.107 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.446e-06 2024-05-08T18:31:19.107 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.107 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.107 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:19.107 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232581+0000", 2024-05-08T18:31:19.107 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.0670000000000003e-06 2024-05-08T18:31:19.107 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.107 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.107 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:19.107 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232600+0000", 2024-05-08T18:31:19.107 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8822999999999999e-05 2024-05-08T18:31:19.107 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.107 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.108 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:19.108 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232611+0000", 2024-05-08T18:31:19.108 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1233000000000001e-05 2024-05-08T18:31:19.108 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.108 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.108 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:19.108 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232731+0000", 2024-05-08T18:31:19.108 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000120189 2024-05-08T18:31:19.108 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.108 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.108 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:19.108 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232963+0000", 2024-05-08T18:31:19.108 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023111900000000001 2024-05-08T18:31:19.108 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.109 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.109 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:31:19.109 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.233441+0000", 2024-05-08T18:31:19.109 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00047866899999999998 2024-05-08T18:31:19.109 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.109 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.109 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:19.109 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.234542+0000", 2024-05-08T18:31:19.109 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001101245 2024-05-08T18:31:19.109 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.109 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.109 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:19.109 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.235349+0000", 2024-05-08T18:31:19.109 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000806567 2024-05-08T18:31:19.110 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.110 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.110 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:19.110 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.235498+0000", 2024-05-08T18:31:19.110 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014907200000000001 2024-05-08T18:31:19.110 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.110 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.110 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:19.110 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.235613+0000", 2024-05-08T18:31:19.110 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115239 2024-05-08T18:31:19.110 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.110 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:19.110 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.111 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.111 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.111 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:19.111 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.248596+0000", 2024-05-08T18:31:19.111 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 86.783856345999993, 2024-05-08T18:31:19.111 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002919984, 2024-05-08T18:31:19.111 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:19.111 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:19.111 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:19.111 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:19.111 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:19.111 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:19.111 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 805 2024-05-08T18:31:19.111 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.112 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:19.112 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.112 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:19.112 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248596+0000", 2024-05-08T18:31:19.112 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:19.112 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.112 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.112 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:19.112 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248596+0000", 2024-05-08T18:31:19.112 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:19.112 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.112 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.112 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:19.112 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248599+0000", 2024-05-08T18:31:19.112 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3630000000000001e-06 2024-05-08T18:31:19.113 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.113 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.113 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:19.113 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248610+0000", 2024-05-08T18:31:19.113 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1267000000000001e-05 2024-05-08T18:31:19.113 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.113 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.113 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:19.113 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248641+0000", 2024-05-08T18:31:19.113 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1309999999999997e-05 2024-05-08T18:31:19.113 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.113 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.113 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:19.113 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248656+0000", 2024-05-08T18:31:19.114 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4449e-05 2024-05-08T18:31:19.114 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.114 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.114 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:19.114 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248781+0000", 2024-05-08T18:31:19.114 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012500900000000001 2024-05-08T18:31:19.114 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.114 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.114 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:19.114 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.249001+0000", 2024-05-08T18:31:19.114 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021963500000000001 2024-05-08T18:31:19.114 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.114 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.114 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:19.115 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.249341+0000", 2024-05-08T18:31:19.115 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00034004100000000002 2024-05-08T18:31:19.115 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.115 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.115 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:19.115 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.250473+0000", 2024-05-08T18:31:19.115 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0011324180000000001 2024-05-08T18:31:19.115 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.115 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.115 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:19.116 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.251230+0000", 2024-05-08T18:31:19.116 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00075751400000000004 2024-05-08T18:31:19.116 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.116 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.116 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:19.116 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.251394+0000", 2024-05-08T18:31:19.116 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016379200000000001 2024-05-08T18:31:19.116 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.116 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.116 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:19.116 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.251516+0000", 2024-05-08T18:31:19.116 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012218600000000001 2024-05-08T18:31:19.116 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.116 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:19.117 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.117 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.117 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.117 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:19.117 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.313184+0000", 2024-05-08T18:31:19.117 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 86.719268670999995, 2024-05-08T18:31:19.117 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003040016, 2024-05-08T18:31:19.117 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:19.117 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:19.117 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:19.117 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:19.117 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:19.117 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:19.118 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 832 2024-05-08T18:31:19.118 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.118 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:19.118 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.118 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:19.118 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313184+0000", 2024-05-08T18:31:19.118 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:19.118 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.118 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.118 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:19.118 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313184+0000", 2024-05-08T18:31:19.118 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:19.118 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.118 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.119 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:19.119 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313187+0000", 2024-05-08T18:31:19.119 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5100000000000001e-06 2024-05-08T18:31:19.119 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.119 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.119 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:19.119 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313199+0000", 2024-05-08T18:31:19.119 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.201e-05 2024-05-08T18:31:19.119 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.119 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.119 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:19.119 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313229+0000", 2024-05-08T18:31:19.119 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9839e-05 2024-05-08T18:31:19.119 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.120 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.120 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:19.120 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313243+0000", 2024-05-08T18:31:19.120 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4727e-05 2024-05-08T18:31:19.120 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.120 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.120 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:19.120 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313358+0000", 2024-05-08T18:31:19.120 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115016 2024-05-08T18:31:19.120 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.120 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.120 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:19.120 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313577+0000", 2024-05-08T18:31:19.120 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021897799999999999 2024-05-08T18:31:19.121 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.121 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.121 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:31:19.121 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313889+0000", 2024-05-08T18:31:19.121 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00031210400000000001 2024-05-08T18:31:19.121 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.121 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.121 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:19.121 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.315229+0000", 2024-05-08T18:31:19.121 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001339963 2024-05-08T18:31:19.121 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.121 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.121 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:19.121 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.315938+0000", 2024-05-08T18:31:19.122 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00070853400000000003 2024-05-08T18:31:19.122 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.122 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.122 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:19.122 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.316111+0000", 2024-05-08T18:31:19.122 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000173396 2024-05-08T18:31:19.122 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.122 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.122 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:19.122 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.316224+0000", 2024-05-08T18:31:19.122 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000112939 2024-05-08T18:31:19.122 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.122 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:19.123 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.123 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.123 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.123 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:834 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:19.123 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.317499+0000", 2024-05-08T18:31:19.123 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 86.714953871999995, 2024-05-08T18:31:19.123 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0033281109999999999, 2024-05-08T18:31:19.123 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:19.123 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:19.123 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:19.123 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:19.123 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:19.123 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:19.123 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 834 2024-05-08T18:31:19.123 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.124 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:19.124 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.124 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:19.124 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317499+0000", 2024-05-08T18:31:19.124 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:19.124 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.124 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.124 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:19.124 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317499+0000", 2024-05-08T18:31:19.124 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:19.124 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.124 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.124 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:19.124 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317501+0000", 2024-05-08T18:31:19.125 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9400000000000001e-06 2024-05-08T18:31:19.125 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.125 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.125 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:19.125 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317511+0000", 2024-05-08T18:31:19.125 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0297e-05 2024-05-08T18:31:19.125 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.125 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.125 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:19.125 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317532+0000", 2024-05-08T18:31:19.125 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1013e-05 2024-05-08T18:31:19.125 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.125 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.126 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:19.126 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317543+0000", 2024-05-08T18:31:19.126 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0757000000000001e-05 2024-05-08T18:31:19.126 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.126 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.126 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:19.126 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317658+0000", 2024-05-08T18:31:19.126 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115129 2024-05-08T18:31:19.126 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.126 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.126 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:19.126 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317887+0000", 2024-05-08T18:31:19.126 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00022880099999999999 2024-05-08T18:31:19.126 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.127 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.127 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:31:19.127 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.318378+0000", 2024-05-08T18:31:19.127 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00049129000000000002 2024-05-08T18:31:19.127 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.127 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.127 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:19.127 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.319597+0000", 2024-05-08T18:31:19.127 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012188469999999999 2024-05-08T18:31:19.127 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.127 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.127 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:19.127 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.320566+0000", 2024-05-08T18:31:19.127 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00096881599999999995 2024-05-08T18:31:19.128 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.128 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.128 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:19.128 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.320713+0000", 2024-05-08T18:31:19.128 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014691500000000001 2024-05-08T18:31:19.128 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.128 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.128 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:19.128 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.320827+0000", 2024-05-08T18:31:19.128 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000114306 2024-05-08T18:31:19.128 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.128 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:19.128 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.128 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.129 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.129 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:19.129 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.505569+0000", 2024-05-08T18:31:19.129 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 86.526883419000001, 2024-05-08T18:31:19.129 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028584309999999998, 2024-05-08T18:31:19.129 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:19.129 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:19.129 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:19.129 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:19.129 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:19.129 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:19.129 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 916 2024-05-08T18:31:19.129 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.129 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:19.130 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.130 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:19.130 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505569+0000", 2024-05-08T18:31:19.130 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:19.130 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.130 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.130 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:19.130 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505569+0000", 2024-05-08T18:31:19.130 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:19.130 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.130 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.130 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:19.130 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505572+0000", 2024-05-08T18:31:19.131 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3659999999999999e-06 2024-05-08T18:31:19.131 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.131 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.131 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:19.131 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505583+0000", 2024-05-08T18:31:19.131 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1574e-05 2024-05-08T18:31:19.131 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.131 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.131 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:19.131 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505614+0000", 2024-05-08T18:31:19.131 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0670000000000003e-05 2024-05-08T18:31:19.131 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.131 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.131 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:19.132 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505629+0000", 2024-05-08T18:31:19.132 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5063e-05 2024-05-08T18:31:19.132 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.132 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.132 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:19.132 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505754+0000", 2024-05-08T18:31:19.132 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012508899999999999 2024-05-08T18:31:19.132 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.132 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.132 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:19.132 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505988+0000", 2024-05-08T18:31:19.132 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023334699999999999 2024-05-08T18:31:19.132 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.133 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.133 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:19.133 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.506299+0000", 2024-05-08T18:31:19.133 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000311811 2024-05-08T18:31:19.133 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.133 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.133 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:19.133 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.507489+0000", 2024-05-08T18:31:19.133 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0011899510000000001 2024-05-08T18:31:19.133 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.133 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.133 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:19.133 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.508141+0000", 2024-05-08T18:31:19.134 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00065180200000000005 2024-05-08T18:31:19.134 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.134 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.134 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:19.134 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.508306+0000", 2024-05-08T18:31:19.134 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016450199999999999 2024-05-08T18:31:19.134 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.134 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.134 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:19.134 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.508428+0000", 2024-05-08T18:31:19.134 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000122256 2024-05-08T18:31:19.134 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.134 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:19.135 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.135 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.135 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.135 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:918 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:19.135 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.509337+0000", 2024-05-08T18:31:19.135 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 86.523115352000005, 2024-05-08T18:31:19.135 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002971787, 2024-05-08T18:31:19.135 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:19.135 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:19.135 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:19.135 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:19.135 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:19.135 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:19.136 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 918 2024-05-08T18:31:19.136 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.136 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:19.136 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.136 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:19.136 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509337+0000", 2024-05-08T18:31:19.136 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:19.136 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.136 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.136 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:19.136 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509337+0000", 2024-05-08T18:31:19.136 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:19.136 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.136 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.137 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:19.137 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509340+0000", 2024-05-08T18:31:19.137 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2570000000000002e-06 2024-05-08T18:31:19.137 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.137 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.137 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:19.137 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509351+0000", 2024-05-08T18:31:19.137 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0933e-05 2024-05-08T18:31:19.137 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.137 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.137 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:19.137 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509382+0000", 2024-05-08T18:31:19.137 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1198999999999997e-05 2024-05-08T18:31:19.137 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.138 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.138 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:19.138 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509400+0000", 2024-05-08T18:31:19.138 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8236999999999998e-05 2024-05-08T18:31:19.138 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.138 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.138 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:19.138 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509529+0000", 2024-05-08T18:31:19.138 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012905600000000001 2024-05-08T18:31:19.138 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.138 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.138 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:19.138 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509777+0000", 2024-05-08T18:31:19.138 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024786799999999999 2024-05-08T18:31:19.139 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.139 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.139 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:19.139 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.510284+0000", 2024-05-08T18:31:19.139 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000506796 2024-05-08T18:31:19.139 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.139 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.139 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:19.139 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.511453+0000", 2024-05-08T18:31:19.139 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001169575 2024-05-08T18:31:19.139 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.139 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.139 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:19.139 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.512051+0000", 2024-05-08T18:31:19.139 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00059743100000000005 2024-05-08T18:31:19.140 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.140 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.140 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:19.140 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.512199+0000", 2024-05-08T18:31:19.140 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000148486 2024-05-08T18:31:19.140 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.140 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.140 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:19.140 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.512309+0000", 2024-05-08T18:31:19.140 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000109949 2024-05-08T18:31:19.140 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.140 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:19.140 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.141 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.141 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.141 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:931 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:19.141 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.543277+0000", 2024-05-08T18:31:19.141 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 86.489176197000006, 2024-05-08T18:31:19.141 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028250710000000002, 2024-05-08T18:31:19.141 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:19.141 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:19.141 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:19.141 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:19.141 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:19.141 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:19.141 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 931 2024-05-08T18:31:19.141 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.142 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:19.142 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.142 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:19.142 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543277+0000", 2024-05-08T18:31:19.142 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:19.142 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.142 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.142 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:19.142 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543277+0000", 2024-05-08T18:31:19.142 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:19.142 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.142 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.142 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:19.142 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543279+0000", 2024-05-08T18:31:19.143 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.373e-06 2024-05-08T18:31:19.143 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.143 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.143 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:19.143 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543291+0000", 2024-05-08T18:31:19.143 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1517e-05 2024-05-08T18:31:19.143 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.143 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.143 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:19.143 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543323+0000", 2024-05-08T18:31:19.143 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2292000000000002e-05 2024-05-08T18:31:19.143 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.143 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.143 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:19.144 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543340+0000", 2024-05-08T18:31:19.144 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.749e-05 2024-05-08T18:31:19.144 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.144 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.144 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:19.144 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543462+0000", 2024-05-08T18:31:19.144 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000121413 2024-05-08T18:31:19.144 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.144 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.144 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:19.144 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543681+0000", 2024-05-08T18:31:19.144 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021974200000000001 2024-05-08T18:31:19.144 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.144 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.145 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:31:19.145 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.544004+0000", 2024-05-08T18:31:19.145 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00032268900000000003 2024-05-08T18:31:19.145 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.145 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.145 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:19.145 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.545158+0000", 2024-05-08T18:31:19.145 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0011540190000000001 2024-05-08T18:31:19.145 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.145 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.145 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:19.145 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.545970+0000", 2024-05-08T18:31:19.145 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00081224300000000004 2024-05-08T18:31:19.146 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.146 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.146 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:19.146 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.546043+0000", 2024-05-08T18:31:19.146 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.3067999999999999e-05 2024-05-08T18:31:19.146 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.146 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.146 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:19.146 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.546102+0000", 2024-05-08T18:31:19.146 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8224999999999999e-05 2024-05-08T18:31:19.146 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.146 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:19.146 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.147 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.147 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.147 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:19.147 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.578568+0000", 2024-05-08T18:31:19.147 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 86.453885290000002, 2024-05-08T18:31:19.147 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0030345839999999999, 2024-05-08T18:31:19.147 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:19.147 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:19.147 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:19.147 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:19.147 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:19.147 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:19.147 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 946 2024-05-08T18:31:19.147 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.148 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:19.148 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.148 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:19.148 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578568+0000", 2024-05-08T18:31:19.148 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:19.148 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.148 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.148 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:19.148 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578568+0000", 2024-05-08T18:31:19.148 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:19.148 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.148 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.148 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:19.148 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578570+0000", 2024-05-08T18:31:19.149 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3700000000000002e-06 2024-05-08T18:31:19.149 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.149 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.149 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:19.149 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578582+0000", 2024-05-08T18:31:19.149 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1627000000000001e-05 2024-05-08T18:31:19.149 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.149 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.149 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:19.149 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578612+0000", 2024-05-08T18:31:19.149 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0103e-05 2024-05-08T18:31:19.149 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.149 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.150 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:19.150 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578627+0000", 2024-05-08T18:31:19.150 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4949999999999999e-05 2024-05-08T18:31:19.150 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.150 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.150 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:19.150 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578750+0000", 2024-05-08T18:31:19.150 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012309899999999999 2024-05-08T18:31:19.150 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.150 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.150 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:19.150 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.579042+0000", 2024-05-08T18:31:19.150 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00029212500000000001 2024-05-08T18:31:19.150 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.151 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.151 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:19.151 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.579557+0000", 2024-05-08T18:31:19.151 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00051536900000000001 2024-05-08T18:31:19.151 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.151 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.151 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:19.151 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.580698+0000", 2024-05-08T18:31:19.151 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001140774 2024-05-08T18:31:19.151 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.151 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.151 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:19.151 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.581367+0000", 2024-05-08T18:31:19.151 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00066884799999999999 2024-05-08T18:31:19.152 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.152 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.152 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:19.152 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.581489+0000", 2024-05-08T18:31:19.152 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012265600000000001 2024-05-08T18:31:19.152 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.152 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.152 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:19.152 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.581602+0000", 2024-05-08T18:31:19.152 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000112663 2024-05-08T18:31:19.152 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.152 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:19.152 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.152 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.153 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:19.153 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:19.154 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-08T18:31:19.155 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:31:19.150+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:31:19.198 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-08T18:31:19.283 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:31:19.282+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:31:19.356 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:31:19.354+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:31:19.366 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:19.366 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:31:19.366 INFO:teuthology.orchestra.run.smithi097.stdout: "num_ops": 0 2024-05-08T18:31:19.366 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:19.384 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-08T18:31:19.449 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2024-05-08T18:31:19.449 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:31:19.457 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:31:19.454+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:31:19.494 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2024-05-08T18:31:19.494 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:31:19.524 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2024-05-08T18:31:19.525 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:31:19.555 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2024-05-08T18:31:19.555 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:31:19.557 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:31:19.554+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:31:19.588 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2024-05-08T18:31:19.588 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:31:19.599 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:19.600 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:19.616 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-08T18:31:19.621 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2024-05-08T18:31:19.621 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:31:19.654 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2024-05-08T18:31:19.655 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:31:19.658 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-05-08T18:31:19.659 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:19.659 INFO:teuthology.orchestra.run.smithi097.stdout: "epoch": 73, 2024-05-08T18:31:19.659 INFO:teuthology.orchestra.run.smithi097.stdout: "fsid": "f135278e-f589-4ad6-a830-fa767ff99171", 2024-05-08T18:31:19.659 INFO:teuthology.orchestra.run.smithi097.stdout: "created": "2024-05-08T18:29:14.813384+0000", 2024-05-08T18:31:19.659 INFO:teuthology.orchestra.run.smithi097.stdout: "modified": "2024-05-08T18:31:18.771678+0000", 2024-05-08T18:31:19.659 INFO:teuthology.orchestra.run.smithi097.stdout: "last_up_change": "2024-05-08T18:29:26.091102+0000", 2024-05-08T18:31:19.659 INFO:teuthology.orchestra.run.smithi097.stdout: "last_in_change": "2024-05-08T18:29:17.082151+0000", 2024-05-08T18:31:19.659 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-05-08T18:31:19.659 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_num": 5804032, 2024-05-08T18:31:19.659 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_set": [ 2024-05-08T18:31:19.660 INFO:teuthology.orchestra.run.smithi097.stdout: "nodeep-scrub", 2024-05-08T18:31:19.660 INFO:teuthology.orchestra.run.smithi097.stdout: "pglog_hardlimit", 2024-05-08T18:31:19.660 INFO:teuthology.orchestra.run.smithi097.stdout: "purged_snapdirs", 2024-05-08T18:31:19.660 INFO:teuthology.orchestra.run.smithi097.stdout: "recovery_deletes", 2024-05-08T18:31:19.660 INFO:teuthology.orchestra.run.smithi097.stdout: "sortbitwise" 2024-05-08T18:31:19.660 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2024-05-08T18:31:19.660 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_version": 5, 2024-05-08T18:31:19.660 INFO:teuthology.orchestra.run.smithi097.stdout: "full_ratio": 0.94999998807907104, 2024-05-08T18:31:19.660 INFO:teuthology.orchestra.run.smithi097.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-05-08T18:31:19.660 INFO:teuthology.orchestra.run.smithi097.stdout: "nearfull_ratio": 0.85000002384185791, 2024-05-08T18:31:19.660 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_snapshot": "", 2024-05-08T18:31:19.660 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_max": 8, 2024-05-08T18:31:19.660 INFO:teuthology.orchestra.run.smithi097.stdout: "max_osd": 8, 2024-05-08T18:31:19.660 INFO:teuthology.orchestra.run.smithi097.stdout: "require_min_compat_client": "luminous", 2024-05-08T18:31:19.661 INFO:teuthology.orchestra.run.smithi097.stdout: "min_compat_client": "luminous", 2024-05-08T18:31:19.661 INFO:teuthology.orchestra.run.smithi097.stdout: "require_osd_release": "squid", 2024-05-08T18:31:19.661 INFO:teuthology.orchestra.run.smithi097.stdout: "allow_crimson": false, 2024-05-08T18:31:19.661 INFO:teuthology.orchestra.run.smithi097.stdout: "pools": [ 2024-05-08T18:31:19.661 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.661 INFO:teuthology.orchestra.run.smithi097.stdout: "pool": 1, 2024-05-08T18:31:19.661 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_name": ".mgr", 2024-05-08T18:31:19.661 INFO:teuthology.orchestra.run.smithi097.stdout: "create_time": "2024-05-08T18:29:25.443461+0000", 2024-05-08T18:31:19.661 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2024-05-08T18:31:19.661 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_names": "hashpspool", 2024-05-08T18:31:19.661 INFO:teuthology.orchestra.run.smithi097.stdout: "type": 1, 2024-05-08T18:31:19.662 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 2, 2024-05-08T18:31:19.662 INFO:teuthology.orchestra.run.smithi097.stdout: "min_size": 1, 2024-05-08T18:31:19.662 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_rule": 0, 2024-05-08T18:31:19.662 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_count": 0, 2024-05-08T18:31:19.662 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_target": 0, 2024-05-08T18:31:19.663 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_barrier": 0, 2024-05-08T18:31:19.663 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-05-08T18:31:19.663 INFO:teuthology.orchestra.run.smithi097.stdout: "object_hash": 2, 2024-05-08T18:31:19.663 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_mode": "off", 2024-05-08T18:31:19.663 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num": 1, 2024-05-08T18:31:19.663 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num": 1, 2024-05-08T18:31:19.663 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num_target": 1, 2024-05-08T18:31:19.663 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_target": 1, 2024-05-08T18:31:19.663 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_pending": 1, 2024-05-08T18:31:19.663 INFO:teuthology.orchestra.run.smithi097.stdout: "last_pg_merge_meta": { 2024-05-08T18:31:19.663 INFO:teuthology.orchestra.run.smithi097.stdout: "source_pgid": "0.0", 2024-05-08T18:31:19.663 INFO:teuthology.orchestra.run.smithi097.stdout: "ready_epoch": 0, 2024-05-08T18:31:19.663 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_started": 0, 2024-05-08T18:31:19.664 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_clean": 0, 2024-05-08T18:31:19.664 INFO:teuthology.orchestra.run.smithi097.stdout: "source_version": "0'0", 2024-05-08T18:31:19.664 INFO:teuthology.orchestra.run.smithi097.stdout: "target_version": "0'0" 2024-05-08T18:31:19.664 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.664 INFO:teuthology.orchestra.run.smithi097.stdout: "last_change": "17", 2024-05-08T18:31:19.664 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend": "0", 2024-05-08T18:31:19.664 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_prenautilus": "0", 2024-05-08T18:31:19.664 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_preluminous": "0", 2024-05-08T18:31:19.664 INFO:teuthology.orchestra.run.smithi097.stdout: "auid": 0, 2024-05-08T18:31:19.664 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_mode": "selfmanaged", 2024-05-08T18:31:19.664 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_seq": 0, 2024-05-08T18:31:19.664 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_epoch": 0, 2024-05-08T18:31:19.664 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_snaps": [], 2024-05-08T18:31:19.664 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps": "[]", 2024-05-08T18:31:19.665 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_bytes": 0, 2024-05-08T18:31:19.665 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_objects": 0, 2024-05-08T18:31:19.665 INFO:teuthology.orchestra.run.smithi097.stdout: "tiers": [], 2024-05-08T18:31:19.665 INFO:teuthology.orchestra.run.smithi097.stdout: "tier_of": -1, 2024-05-08T18:31:19.665 INFO:teuthology.orchestra.run.smithi097.stdout: "read_tier": -1, 2024-05-08T18:31:19.665 INFO:teuthology.orchestra.run.smithi097.stdout: "write_tier": -1, 2024-05-08T18:31:19.665 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_mode": "none", 2024-05-08T18:31:19.666 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_bytes": 0, 2024-05-08T18:31:19.666 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_objects": 0, 2024-05-08T18:31:19.666 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-05-08T18:31:19.666 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-05-08T18:31:19.666 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_full_ratio_micro": 800000, 2024-05-08T18:31:19.666 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_flush_age": 0, 2024-05-08T18:31:19.666 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_evict_age": 0, 2024-05-08T18:31:19.666 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profile": "", 2024-05-08T18:31:19.666 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_params": { 2024-05-08T18:31:19.667 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "none" 2024-05-08T18:31:19.667 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.667 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_period": 0, 2024-05-08T18:31:19.667 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_count": 0, 2024-05-08T18:31:19.667 INFO:teuthology.orchestra.run.smithi097.stdout: "use_gmt_hitset": true, 2024-05-08T18:31:19.667 INFO:teuthology.orchestra.run.smithi097.stdout: "min_read_recency_for_promote": 0, 2024-05-08T18:31:19.667 INFO:teuthology.orchestra.run.smithi097.stdout: "min_write_recency_for_promote": 0, 2024-05-08T18:31:19.667 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_grade_decay_rate": 0, 2024-05-08T18:31:19.667 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_search_last_n": 0, 2024-05-08T18:31:19.667 INFO:teuthology.orchestra.run.smithi097.stdout: "grade_table": [], 2024-05-08T18:31:19.667 INFO:teuthology.orchestra.run.smithi097.stdout: "stripe_width": 0, 2024-05-08T18:31:19.667 INFO:teuthology.orchestra.run.smithi097.stdout: "expected_num_objects": 0, 2024-05-08T18:31:19.667 INFO:teuthology.orchestra.run.smithi097.stdout: "fast_read": false, 2024-05-08T18:31:19.667 INFO:teuthology.orchestra.run.smithi097.stdout: "options": { 2024-05-08T18:31:19.667 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_max": 32, 2024-05-08T18:31:19.668 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_min": 1 2024-05-08T18:31:19.668 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.668 INFO:teuthology.orchestra.run.smithi097.stdout: "application_metadata": { 2024-05-08T18:31:19.668 INFO:teuthology.orchestra.run.smithi097.stdout: "mgr": {} 2024-05-08T18:31:19.668 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.668 INFO:teuthology.orchestra.run.smithi097.stdout: "read_balance": { 2024-05-08T18:31:19.668 INFO:teuthology.orchestra.run.smithi097.stdout: "score_type": "Fair distribution", 2024-05-08T18:31:19.668 INFO:teuthology.orchestra.run.smithi097.stdout: "score_acting": 8, 2024-05-08T18:31:19.668 INFO:teuthology.orchestra.run.smithi097.stdout: "score_stable": 8, 2024-05-08T18:31:19.668 INFO:teuthology.orchestra.run.smithi097.stdout: "optimal_score": 0.25, 2024-05-08T18:31:19.668 INFO:teuthology.orchestra.run.smithi097.stdout: "raw_score_acting": 2, 2024-05-08T18:31:19.669 INFO:teuthology.orchestra.run.smithi097.stdout: "raw_score_stable": 2, 2024-05-08T18:31:19.669 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity_weighted": 1, 2024-05-08T18:31:19.669 INFO:teuthology.orchestra.run.smithi097.stdout: "average_primary_affinity": 1, 2024-05-08T18:31:19.669 INFO:teuthology.orchestra.run.smithi097.stdout: "average_primary_affinity_weighted": 1 2024-05-08T18:31:19.669 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.669 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.669 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.669 INFO:teuthology.orchestra.run.smithi097.stdout: "pool": 2, 2024-05-08T18:31:19.669 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_name": "rbd", 2024-05-08T18:31:19.669 INFO:teuthology.orchestra.run.smithi097.stdout: "create_time": "2024-05-08T18:29:32.943859+0000", 2024-05-08T18:31:19.670 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2024-05-08T18:31:19.670 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_names": "hashpspool", 2024-05-08T18:31:19.670 INFO:teuthology.orchestra.run.smithi097.stdout: "type": 1, 2024-05-08T18:31:19.670 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 2, 2024-05-08T18:31:19.670 INFO:teuthology.orchestra.run.smithi097.stdout: "min_size": 1, 2024-05-08T18:31:19.670 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_rule": 0, 2024-05-08T18:31:19.670 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_count": 0, 2024-05-08T18:31:19.670 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_target": 0, 2024-05-08T18:31:19.670 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_barrier": 0, 2024-05-08T18:31:19.670 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-05-08T18:31:19.670 INFO:teuthology.orchestra.run.smithi097.stdout: "object_hash": 2, 2024-05-08T18:31:19.670 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_mode": "off", 2024-05-08T18:31:19.670 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num": 8, 2024-05-08T18:31:19.670 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num": 8, 2024-05-08T18:31:19.671 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num_target": 8, 2024-05-08T18:31:19.671 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_target": 8, 2024-05-08T18:31:19.671 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_pending": 8, 2024-05-08T18:31:19.671 INFO:teuthology.orchestra.run.smithi097.stdout: "last_pg_merge_meta": { 2024-05-08T18:31:19.671 INFO:teuthology.orchestra.run.smithi097.stdout: "source_pgid": "0.0", 2024-05-08T18:31:19.671 INFO:teuthology.orchestra.run.smithi097.stdout: "ready_epoch": 0, 2024-05-08T18:31:19.671 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_started": 0, 2024-05-08T18:31:19.671 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_clean": 0, 2024-05-08T18:31:19.671 INFO:teuthology.orchestra.run.smithi097.stdout: "source_version": "0'0", 2024-05-08T18:31:19.671 INFO:teuthology.orchestra.run.smithi097.stdout: "target_version": "0'0" 2024-05-08T18:31:19.671 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.671 INFO:teuthology.orchestra.run.smithi097.stdout: "last_change": "20", 2024-05-08T18:31:19.671 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend": "0", 2024-05-08T18:31:19.671 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_prenautilus": "0", 2024-05-08T18:31:19.671 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_preluminous": "0", 2024-05-08T18:31:19.672 INFO:teuthology.orchestra.run.smithi097.stdout: "auid": 0, 2024-05-08T18:31:19.672 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_mode": "selfmanaged", 2024-05-08T18:31:19.672 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_seq": 0, 2024-05-08T18:31:19.672 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_epoch": 0, 2024-05-08T18:31:19.672 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_snaps": [], 2024-05-08T18:31:19.672 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps": "[]", 2024-05-08T18:31:19.672 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_bytes": 0, 2024-05-08T18:31:19.672 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_objects": 0, 2024-05-08T18:31:19.672 INFO:teuthology.orchestra.run.smithi097.stdout: "tiers": [], 2024-05-08T18:31:19.672 INFO:teuthology.orchestra.run.smithi097.stdout: "tier_of": -1, 2024-05-08T18:31:19.672 INFO:teuthology.orchestra.run.smithi097.stdout: "read_tier": -1, 2024-05-08T18:31:19.672 INFO:teuthology.orchestra.run.smithi097.stdout: "write_tier": -1, 2024-05-08T18:31:19.672 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_mode": "none", 2024-05-08T18:31:19.672 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_bytes": 0, 2024-05-08T18:31:19.673 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_objects": 0, 2024-05-08T18:31:19.673 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-05-08T18:31:19.673 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-05-08T18:31:19.673 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_full_ratio_micro": 800000, 2024-05-08T18:31:19.673 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_flush_age": 0, 2024-05-08T18:31:19.673 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_evict_age": 0, 2024-05-08T18:31:19.673 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profile": "", 2024-05-08T18:31:19.673 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_params": { 2024-05-08T18:31:19.673 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "none" 2024-05-08T18:31:19.673 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.673 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_period": 0, 2024-05-08T18:31:19.673 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_count": 0, 2024-05-08T18:31:19.673 INFO:teuthology.orchestra.run.smithi097.stdout: "use_gmt_hitset": true, 2024-05-08T18:31:19.673 INFO:teuthology.orchestra.run.smithi097.stdout: "min_read_recency_for_promote": 0, 2024-05-08T18:31:19.673 INFO:teuthology.orchestra.run.smithi097.stdout: "min_write_recency_for_promote": 0, 2024-05-08T18:31:19.674 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_grade_decay_rate": 0, 2024-05-08T18:31:19.674 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_search_last_n": 0, 2024-05-08T18:31:19.674 INFO:teuthology.orchestra.run.smithi097.stdout: "grade_table": [], 2024-05-08T18:31:19.674 INFO:teuthology.orchestra.run.smithi097.stdout: "stripe_width": 0, 2024-05-08T18:31:19.674 INFO:teuthology.orchestra.run.smithi097.stdout: "expected_num_objects": 0, 2024-05-08T18:31:19.674 INFO:teuthology.orchestra.run.smithi097.stdout: "fast_read": false, 2024-05-08T18:31:19.674 INFO:teuthology.orchestra.run.smithi097.stdout: "options": {}, 2024-05-08T18:31:19.674 INFO:teuthology.orchestra.run.smithi097.stdout: "application_metadata": { 2024-05-08T18:31:19.674 INFO:teuthology.orchestra.run.smithi097.stdout: "rbd": {} 2024-05-08T18:31:19.674 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.674 INFO:teuthology.orchestra.run.smithi097.stdout: "read_balance": { 2024-05-08T18:31:19.674 INFO:teuthology.orchestra.run.smithi097.stdout: "score_type": "Fair distribution", 2024-05-08T18:31:19.674 INFO:teuthology.orchestra.run.smithi097.stdout: "score_acting": 1.9900000095367432, 2024-05-08T18:31:19.674 INFO:teuthology.orchestra.run.smithi097.stdout: "score_stable": 1.9900000095367432, 2024-05-08T18:31:19.675 INFO:teuthology.orchestra.run.smithi097.stdout: "optimal_score": 0.87999999523162842, 2024-05-08T18:31:19.675 INFO:teuthology.orchestra.run.smithi097.stdout: "raw_score_acting": 1.75, 2024-05-08T18:31:19.675 INFO:teuthology.orchestra.run.smithi097.stdout: "raw_score_stable": 1.75, 2024-05-08T18:31:19.675 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity_weighted": 1, 2024-05-08T18:31:19.675 INFO:teuthology.orchestra.run.smithi097.stdout: "average_primary_affinity": 1, 2024-05-08T18:31:19.675 INFO:teuthology.orchestra.run.smithi097.stdout: "average_primary_affinity_weighted": 1 2024-05-08T18:31:19.675 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.675 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.675 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.675 INFO:teuthology.orchestra.run.smithi097.stdout: "pool": 3, 2024-05-08T18:31:19.675 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_name": "default.rgw.buckets.data", 2024-05-08T18:31:19.675 INFO:teuthology.orchestra.run.smithi097.stdout: "create_time": "2024-05-08T18:29:39.147224+0000", 2024-05-08T18:31:19.675 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2024-05-08T18:31:19.675 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_names": "hashpspool", 2024-05-08T18:31:19.676 INFO:teuthology.orchestra.run.smithi097.stdout: "type": 1, 2024-05-08T18:31:19.676 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 2, 2024-05-08T18:31:19.676 INFO:teuthology.orchestra.run.smithi097.stdout: "min_size": 1, 2024-05-08T18:31:19.676 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_rule": 0, 2024-05-08T18:31:19.676 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_count": 0, 2024-05-08T18:31:19.676 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_target": 0, 2024-05-08T18:31:19.676 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_barrier": 0, 2024-05-08T18:31:19.676 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-05-08T18:31:19.676 INFO:teuthology.orchestra.run.smithi097.stdout: "object_hash": 2, 2024-05-08T18:31:19.677 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_mode": "off", 2024-05-08T18:31:19.677 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num": 64, 2024-05-08T18:31:19.677 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num": 64, 2024-05-08T18:31:19.677 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num_target": 64, 2024-05-08T18:31:19.677 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_target": 64, 2024-05-08T18:31:19.677 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_pending": 64, 2024-05-08T18:31:19.677 INFO:teuthology.orchestra.run.smithi097.stdout: "last_pg_merge_meta": { 2024-05-08T18:31:19.677 INFO:teuthology.orchestra.run.smithi097.stdout: "source_pgid": "0.0", 2024-05-08T18:31:19.677 INFO:teuthology.orchestra.run.smithi097.stdout: "ready_epoch": 0, 2024-05-08T18:31:19.677 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_started": 0, 2024-05-08T18:31:19.677 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_clean": 0, 2024-05-08T18:31:19.677 INFO:teuthology.orchestra.run.smithi097.stdout: "source_version": "0'0", 2024-05-08T18:31:19.677 INFO:teuthology.orchestra.run.smithi097.stdout: "target_version": "0'0" 2024-05-08T18:31:19.677 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.677 INFO:teuthology.orchestra.run.smithi097.stdout: "last_change": "23", 2024-05-08T18:31:19.678 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend": "0", 2024-05-08T18:31:19.678 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_prenautilus": "0", 2024-05-08T18:31:19.678 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_preluminous": "0", 2024-05-08T18:31:19.678 INFO:teuthology.orchestra.run.smithi097.stdout: "auid": 0, 2024-05-08T18:31:19.678 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_mode": "selfmanaged", 2024-05-08T18:31:19.678 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_seq": 0, 2024-05-08T18:31:19.678 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_epoch": 0, 2024-05-08T18:31:19.678 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_snaps": [], 2024-05-08T18:31:19.678 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps": "[]", 2024-05-08T18:31:19.678 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_bytes": 0, 2024-05-08T18:31:19.678 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_objects": 0, 2024-05-08T18:31:19.678 INFO:teuthology.orchestra.run.smithi097.stdout: "tiers": [], 2024-05-08T18:31:19.678 INFO:teuthology.orchestra.run.smithi097.stdout: "tier_of": -1, 2024-05-08T18:31:19.679 INFO:teuthology.orchestra.run.smithi097.stdout: "read_tier": -1, 2024-05-08T18:31:19.679 INFO:teuthology.orchestra.run.smithi097.stdout: "write_tier": -1, 2024-05-08T18:31:19.679 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_mode": "none", 2024-05-08T18:31:19.679 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_bytes": 0, 2024-05-08T18:31:19.679 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_objects": 0, 2024-05-08T18:31:19.679 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-05-08T18:31:19.679 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-05-08T18:31:19.679 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_full_ratio_micro": 800000, 2024-05-08T18:31:19.679 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_flush_age": 0, 2024-05-08T18:31:19.679 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_evict_age": 0, 2024-05-08T18:31:19.679 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profile": "", 2024-05-08T18:31:19.679 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_params": { 2024-05-08T18:31:19.679 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "none" 2024-05-08T18:31:19.680 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.680 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_period": 0, 2024-05-08T18:31:19.680 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_count": 0, 2024-05-08T18:31:19.680 INFO:teuthology.orchestra.run.smithi097.stdout: "use_gmt_hitset": true, 2024-05-08T18:31:19.680 INFO:teuthology.orchestra.run.smithi097.stdout: "min_read_recency_for_promote": 0, 2024-05-08T18:31:19.680 INFO:teuthology.orchestra.run.smithi097.stdout: "min_write_recency_for_promote": 0, 2024-05-08T18:31:19.680 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_grade_decay_rate": 0, 2024-05-08T18:31:19.680 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_search_last_n": 0, 2024-05-08T18:31:19.680 INFO:teuthology.orchestra.run.smithi097.stdout: "grade_table": [], 2024-05-08T18:31:19.680 INFO:teuthology.orchestra.run.smithi097.stdout: "stripe_width": 0, 2024-05-08T18:31:19.680 INFO:teuthology.orchestra.run.smithi097.stdout: "expected_num_objects": 0, 2024-05-08T18:31:19.680 INFO:teuthology.orchestra.run.smithi097.stdout: "fast_read": false, 2024-05-08T18:31:19.680 INFO:teuthology.orchestra.run.smithi097.stdout: "options": {}, 2024-05-08T18:31:19.680 INFO:teuthology.orchestra.run.smithi097.stdout: "application_metadata": { 2024-05-08T18:31:19.681 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw": {} 2024-05-08T18:31:19.681 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.681 INFO:teuthology.orchestra.run.smithi097.stdout: "read_balance": { 2024-05-08T18:31:19.681 INFO:teuthology.orchestra.run.smithi097.stdout: "score_type": "Fair distribution", 2024-05-08T18:31:19.681 INFO:teuthology.orchestra.run.smithi097.stdout: "score_acting": 1.3799999952316284, 2024-05-08T18:31:19.681 INFO:teuthology.orchestra.run.smithi097.stdout: "score_stable": 1.3799999952316284, 2024-05-08T18:31:19.681 INFO:teuthology.orchestra.run.smithi097.stdout: "optimal_score": 1, 2024-05-08T18:31:19.681 INFO:teuthology.orchestra.run.smithi097.stdout: "raw_score_acting": 1.3799999952316284, 2024-05-08T18:31:19.681 INFO:teuthology.orchestra.run.smithi097.stdout: "raw_score_stable": 1.3799999952316284, 2024-05-08T18:31:19.681 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity_weighted": 1, 2024-05-08T18:31:19.681 INFO:teuthology.orchestra.run.smithi097.stdout: "average_primary_affinity": 1, 2024-05-08T18:31:19.681 INFO:teuthology.orchestra.run.smithi097.stdout: "average_primary_affinity_weighted": 1 2024-05-08T18:31:19.681 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.681 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.682 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.682 INFO:teuthology.orchestra.run.smithi097.stdout: "pool": 4, 2024-05-08T18:31:19.682 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_name": "default.rgw.buckets.index", 2024-05-08T18:31:19.682 INFO:teuthology.orchestra.run.smithi097.stdout: "create_time": "2024-05-08T18:29:40.891936+0000", 2024-05-08T18:31:19.682 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2024-05-08T18:31:19.682 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_names": "hashpspool", 2024-05-08T18:31:19.682 INFO:teuthology.orchestra.run.smithi097.stdout: "type": 1, 2024-05-08T18:31:19.682 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 2, 2024-05-08T18:31:19.682 INFO:teuthology.orchestra.run.smithi097.stdout: "min_size": 1, 2024-05-08T18:31:19.682 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_rule": 0, 2024-05-08T18:31:19.682 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_count": 0, 2024-05-08T18:31:19.682 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_target": 0, 2024-05-08T18:31:19.682 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_barrier": 0, 2024-05-08T18:31:19.682 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-05-08T18:31:19.683 INFO:teuthology.orchestra.run.smithi097.stdout: "object_hash": 2, 2024-05-08T18:31:19.683 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_mode": "off", 2024-05-08T18:31:19.683 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num": 64, 2024-05-08T18:31:19.683 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num": 64, 2024-05-08T18:31:19.683 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num_target": 64, 2024-05-08T18:31:19.683 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_target": 64, 2024-05-08T18:31:19.683 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_pending": 64, 2024-05-08T18:31:19.683 INFO:teuthology.orchestra.run.smithi097.stdout: "last_pg_merge_meta": { 2024-05-08T18:31:19.683 INFO:teuthology.orchestra.run.smithi097.stdout: "source_pgid": "0.0", 2024-05-08T18:31:19.683 INFO:teuthology.orchestra.run.smithi097.stdout: "ready_epoch": 0, 2024-05-08T18:31:19.683 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_started": 0, 2024-05-08T18:31:19.683 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_clean": 0, 2024-05-08T18:31:19.683 INFO:teuthology.orchestra.run.smithi097.stdout: "source_version": "0'0", 2024-05-08T18:31:19.683 INFO:teuthology.orchestra.run.smithi097.stdout: "target_version": "0'0" 2024-05-08T18:31:19.684 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.684 INFO:teuthology.orchestra.run.smithi097.stdout: "last_change": "25", 2024-05-08T18:31:19.684 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend": "0", 2024-05-08T18:31:19.684 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_prenautilus": "0", 2024-05-08T18:31:19.684 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_preluminous": "0", 2024-05-08T18:31:19.684 INFO:teuthology.orchestra.run.smithi097.stdout: "auid": 0, 2024-05-08T18:31:19.684 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_mode": "selfmanaged", 2024-05-08T18:31:19.684 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_seq": 0, 2024-05-08T18:31:19.684 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_epoch": 0, 2024-05-08T18:31:19.684 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_snaps": [], 2024-05-08T18:31:19.684 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps": "[]", 2024-05-08T18:31:19.684 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_bytes": 0, 2024-05-08T18:31:19.684 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_objects": 0, 2024-05-08T18:31:19.684 INFO:teuthology.orchestra.run.smithi097.stdout: "tiers": [], 2024-05-08T18:31:19.684 INFO:teuthology.orchestra.run.smithi097.stdout: "tier_of": -1, 2024-05-08T18:31:19.685 INFO:teuthology.orchestra.run.smithi097.stdout: "read_tier": -1, 2024-05-08T18:31:19.685 INFO:teuthology.orchestra.run.smithi097.stdout: "write_tier": -1, 2024-05-08T18:31:19.685 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_mode": "none", 2024-05-08T18:31:19.685 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_bytes": 0, 2024-05-08T18:31:19.685 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_objects": 0, 2024-05-08T18:31:19.685 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-05-08T18:31:19.685 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-05-08T18:31:19.685 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_full_ratio_micro": 800000, 2024-05-08T18:31:19.685 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_flush_age": 0, 2024-05-08T18:31:19.685 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_evict_age": 0, 2024-05-08T18:31:19.685 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profile": "", 2024-05-08T18:31:19.685 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_params": { 2024-05-08T18:31:19.685 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "none" 2024-05-08T18:31:19.685 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.685 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_period": 0, 2024-05-08T18:31:19.686 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_count": 0, 2024-05-08T18:31:19.686 INFO:teuthology.orchestra.run.smithi097.stdout: "use_gmt_hitset": true, 2024-05-08T18:31:19.686 INFO:teuthology.orchestra.run.smithi097.stdout: "min_read_recency_for_promote": 0, 2024-05-08T18:31:19.686 INFO:teuthology.orchestra.run.smithi097.stdout: "min_write_recency_for_promote": 0, 2024-05-08T18:31:19.686 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_grade_decay_rate": 0, 2024-05-08T18:31:19.686 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_search_last_n": 0, 2024-05-08T18:31:19.686 INFO:teuthology.orchestra.run.smithi097.stdout: "grade_table": [], 2024-05-08T18:31:19.686 INFO:teuthology.orchestra.run.smithi097.stdout: "stripe_width": 0, 2024-05-08T18:31:19.686 INFO:teuthology.orchestra.run.smithi097.stdout: "expected_num_objects": 0, 2024-05-08T18:31:19.686 INFO:teuthology.orchestra.run.smithi097.stdout: "fast_read": false, 2024-05-08T18:31:19.686 INFO:teuthology.orchestra.run.smithi097.stdout: "options": {}, 2024-05-08T18:31:19.686 INFO:teuthology.orchestra.run.smithi097.stdout: "application_metadata": { 2024-05-08T18:31:19.686 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw": {} 2024-05-08T18:31:19.687 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.687 INFO:teuthology.orchestra.run.smithi097.stdout: "read_balance": { 2024-05-08T18:31:19.687 INFO:teuthology.orchestra.run.smithi097.stdout: "score_type": "Fair distribution", 2024-05-08T18:31:19.687 INFO:teuthology.orchestra.run.smithi097.stdout: "score_acting": 2, 2024-05-08T18:31:19.687 INFO:teuthology.orchestra.run.smithi097.stdout: "score_stable": 2, 2024-05-08T18:31:19.687 INFO:teuthology.orchestra.run.smithi097.stdout: "optimal_score": 1, 2024-05-08T18:31:19.687 INFO:teuthology.orchestra.run.smithi097.stdout: "raw_score_acting": 2, 2024-05-08T18:31:19.687 INFO:teuthology.orchestra.run.smithi097.stdout: "raw_score_stable": 2, 2024-05-08T18:31:19.687 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity_weighted": 1, 2024-05-08T18:31:19.687 INFO:teuthology.orchestra.run.smithi097.stdout: "average_primary_affinity": 1, 2024-05-08T18:31:19.687 INFO:teuthology.orchestra.run.smithi097.stdout: "average_primary_affinity_weighted": 1 2024-05-08T18:31:19.687 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.687 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.687 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.687 INFO:teuthology.orchestra.run.smithi097.stdout: "pool": 5, 2024-05-08T18:31:19.688 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_name": ".rgw.root", 2024-05-08T18:31:19.688 INFO:teuthology.orchestra.run.smithi097.stdout: "create_time": "2024-05-08T18:29:42.925519+0000", 2024-05-08T18:31:19.688 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2024-05-08T18:31:19.688 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_names": "hashpspool", 2024-05-08T18:31:19.688 INFO:teuthology.orchestra.run.smithi097.stdout: "type": 1, 2024-05-08T18:31:19.688 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 2, 2024-05-08T18:31:19.688 INFO:teuthology.orchestra.run.smithi097.stdout: "min_size": 1, 2024-05-08T18:31:19.688 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_rule": 0, 2024-05-08T18:31:19.688 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_count": 0, 2024-05-08T18:31:19.688 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_target": 0, 2024-05-08T18:31:19.688 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_barrier": 0, 2024-05-08T18:31:19.688 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-05-08T18:31:19.688 INFO:teuthology.orchestra.run.smithi097.stdout: "object_hash": 2, 2024-05-08T18:31:19.688 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_mode": "off", 2024-05-08T18:31:19.688 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num": 32, 2024-05-08T18:31:19.689 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num": 32, 2024-05-08T18:31:19.689 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num_target": 32, 2024-05-08T18:31:19.689 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_target": 32, 2024-05-08T18:31:19.689 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_pending": 32, 2024-05-08T18:31:19.689 INFO:teuthology.orchestra.run.smithi097.stdout: "last_pg_merge_meta": { 2024-05-08T18:31:19.689 INFO:teuthology.orchestra.run.smithi097.stdout: "source_pgid": "0.0", 2024-05-08T18:31:19.689 INFO:teuthology.orchestra.run.smithi097.stdout: "ready_epoch": 0, 2024-05-08T18:31:19.689 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_started": 0, 2024-05-08T18:31:19.689 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_clean": 0, 2024-05-08T18:31:19.689 INFO:teuthology.orchestra.run.smithi097.stdout: "source_version": "0'0", 2024-05-08T18:31:19.689 INFO:teuthology.orchestra.run.smithi097.stdout: "target_version": "0'0" 2024-05-08T18:31:19.689 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.689 INFO:teuthology.orchestra.run.smithi097.stdout: "last_change": "27", 2024-05-08T18:31:19.689 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend": "0", 2024-05-08T18:31:19.690 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_prenautilus": "0", 2024-05-08T18:31:19.690 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_preluminous": "0", 2024-05-08T18:31:19.690 INFO:teuthology.orchestra.run.smithi097.stdout: "auid": 0, 2024-05-08T18:31:19.690 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_mode": "selfmanaged", 2024-05-08T18:31:19.690 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_seq": 0, 2024-05-08T18:31:19.690 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_epoch": 0, 2024-05-08T18:31:19.690 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_snaps": [], 2024-05-08T18:31:19.690 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps": "[]", 2024-05-08T18:31:19.690 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_bytes": 0, 2024-05-08T18:31:19.690 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_objects": 0, 2024-05-08T18:31:19.690 INFO:teuthology.orchestra.run.smithi097.stdout: "tiers": [], 2024-05-08T18:31:19.690 INFO:teuthology.orchestra.run.smithi097.stdout: "tier_of": -1, 2024-05-08T18:31:19.690 INFO:teuthology.orchestra.run.smithi097.stdout: "read_tier": -1, 2024-05-08T18:31:19.690 INFO:teuthology.orchestra.run.smithi097.stdout: "write_tier": -1, 2024-05-08T18:31:19.690 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_mode": "none", 2024-05-08T18:31:19.691 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_bytes": 0, 2024-05-08T18:31:19.691 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_objects": 0, 2024-05-08T18:31:19.691 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-05-08T18:31:19.691 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-05-08T18:31:19.691 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_full_ratio_micro": 800000, 2024-05-08T18:31:19.691 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_flush_age": 0, 2024-05-08T18:31:19.691 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_evict_age": 0, 2024-05-08T18:31:19.691 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profile": "", 2024-05-08T18:31:19.691 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_params": { 2024-05-08T18:31:19.691 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "none" 2024-05-08T18:31:19.691 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.691 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_period": 0, 2024-05-08T18:31:19.691 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_count": 0, 2024-05-08T18:31:19.691 INFO:teuthology.orchestra.run.smithi097.stdout: "use_gmt_hitset": true, 2024-05-08T18:31:19.692 INFO:teuthology.orchestra.run.smithi097.stdout: "min_read_recency_for_promote": 0, 2024-05-08T18:31:19.692 INFO:teuthology.orchestra.run.smithi097.stdout: "min_write_recency_for_promote": 0, 2024-05-08T18:31:19.692 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_grade_decay_rate": 0, 2024-05-08T18:31:19.692 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_search_last_n": 0, 2024-05-08T18:31:19.692 INFO:teuthology.orchestra.run.smithi097.stdout: "grade_table": [], 2024-05-08T18:31:19.692 INFO:teuthology.orchestra.run.smithi097.stdout: "stripe_width": 0, 2024-05-08T18:31:19.692 INFO:teuthology.orchestra.run.smithi097.stdout: "expected_num_objects": 0, 2024-05-08T18:31:19.692 INFO:teuthology.orchestra.run.smithi097.stdout: "fast_read": false, 2024-05-08T18:31:19.692 INFO:teuthology.orchestra.run.smithi097.stdout: "options": {}, 2024-05-08T18:31:19.692 INFO:teuthology.orchestra.run.smithi097.stdout: "application_metadata": { 2024-05-08T18:31:19.692 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw": {} 2024-05-08T18:31:19.692 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.692 INFO:teuthology.orchestra.run.smithi097.stdout: "read_balance": { 2024-05-08T18:31:19.692 INFO:teuthology.orchestra.run.smithi097.stdout: "score_type": "Fair distribution", 2024-05-08T18:31:19.692 INFO:teuthology.orchestra.run.smithi097.stdout: "score_acting": 1.25, 2024-05-08T18:31:19.693 INFO:teuthology.orchestra.run.smithi097.stdout: "score_stable": 1.25, 2024-05-08T18:31:19.693 INFO:teuthology.orchestra.run.smithi097.stdout: "optimal_score": 1, 2024-05-08T18:31:19.693 INFO:teuthology.orchestra.run.smithi097.stdout: "raw_score_acting": 1.25, 2024-05-08T18:31:19.693 INFO:teuthology.orchestra.run.smithi097.stdout: "raw_score_stable": 1.25, 2024-05-08T18:31:19.693 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity_weighted": 1, 2024-05-08T18:31:19.693 INFO:teuthology.orchestra.run.smithi097.stdout: "average_primary_affinity": 1, 2024-05-08T18:31:19.693 INFO:teuthology.orchestra.run.smithi097.stdout: "average_primary_affinity_weighted": 1 2024-05-08T18:31:19.693 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.693 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.693 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.693 INFO:teuthology.orchestra.run.smithi097.stdout: "pool": 6, 2024-05-08T18:31:19.693 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_name": "default.rgw.log", 2024-05-08T18:31:19.693 INFO:teuthology.orchestra.run.smithi097.stdout: "create_time": "2024-05-08T18:29:44.727411+0000", 2024-05-08T18:31:19.693 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2024-05-08T18:31:19.693 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_names": "hashpspool", 2024-05-08T18:31:19.694 INFO:teuthology.orchestra.run.smithi097.stdout: "type": 1, 2024-05-08T18:31:19.694 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 2, 2024-05-08T18:31:19.694 INFO:teuthology.orchestra.run.smithi097.stdout: "min_size": 1, 2024-05-08T18:31:19.694 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_rule": 0, 2024-05-08T18:31:19.694 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_count": 0, 2024-05-08T18:31:19.694 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_target": 0, 2024-05-08T18:31:19.694 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_barrier": 0, 2024-05-08T18:31:19.694 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-05-08T18:31:19.694 INFO:teuthology.orchestra.run.smithi097.stdout: "object_hash": 2, 2024-05-08T18:31:19.694 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_mode": "off", 2024-05-08T18:31:19.694 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num": 32, 2024-05-08T18:31:19.694 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num": 32, 2024-05-08T18:31:19.694 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num_target": 32, 2024-05-08T18:31:19.695 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_target": 32, 2024-05-08T18:31:19.695 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_pending": 32, 2024-05-08T18:31:19.695 INFO:teuthology.orchestra.run.smithi097.stdout: "last_pg_merge_meta": { 2024-05-08T18:31:19.695 INFO:teuthology.orchestra.run.smithi097.stdout: "source_pgid": "0.0", 2024-05-08T18:31:19.695 INFO:teuthology.orchestra.run.smithi097.stdout: "ready_epoch": 0, 2024-05-08T18:31:19.695 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_started": 0, 2024-05-08T18:31:19.695 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_clean": 0, 2024-05-08T18:31:19.695 INFO:teuthology.orchestra.run.smithi097.stdout: "source_version": "0'0", 2024-05-08T18:31:19.695 INFO:teuthology.orchestra.run.smithi097.stdout: "target_version": "0'0" 2024-05-08T18:31:19.695 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.696 INFO:teuthology.orchestra.run.smithi097.stdout: "last_change": "29", 2024-05-08T18:31:19.696 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend": "0", 2024-05-08T18:31:19.696 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_prenautilus": "0", 2024-05-08T18:31:19.696 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_preluminous": "0", 2024-05-08T18:31:19.696 INFO:teuthology.orchestra.run.smithi097.stdout: "auid": 0, 2024-05-08T18:31:19.696 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_mode": "selfmanaged", 2024-05-08T18:31:19.696 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_seq": 0, 2024-05-08T18:31:19.696 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_epoch": 0, 2024-05-08T18:31:19.696 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_snaps": [], 2024-05-08T18:31:19.696 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps": "[]", 2024-05-08T18:31:19.696 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_bytes": 0, 2024-05-08T18:31:19.696 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_objects": 0, 2024-05-08T18:31:19.696 INFO:teuthology.orchestra.run.smithi097.stdout: "tiers": [], 2024-05-08T18:31:19.696 INFO:teuthology.orchestra.run.smithi097.stdout: "tier_of": -1, 2024-05-08T18:31:19.696 INFO:teuthology.orchestra.run.smithi097.stdout: "read_tier": -1, 2024-05-08T18:31:19.697 INFO:teuthology.orchestra.run.smithi097.stdout: "write_tier": -1, 2024-05-08T18:31:19.697 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_mode": "none", 2024-05-08T18:31:19.697 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_bytes": 0, 2024-05-08T18:31:19.697 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_objects": 0, 2024-05-08T18:31:19.697 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-05-08T18:31:19.697 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-05-08T18:31:19.697 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_full_ratio_micro": 800000, 2024-05-08T18:31:19.697 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_flush_age": 0, 2024-05-08T18:31:19.697 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_evict_age": 0, 2024-05-08T18:31:19.697 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profile": "", 2024-05-08T18:31:19.697 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_params": { 2024-05-08T18:31:19.697 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "none" 2024-05-08T18:31:19.697 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.697 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_period": 0, 2024-05-08T18:31:19.698 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_count": 0, 2024-05-08T18:31:19.698 INFO:teuthology.orchestra.run.smithi097.stdout: "use_gmt_hitset": true, 2024-05-08T18:31:19.698 INFO:teuthology.orchestra.run.smithi097.stdout: "min_read_recency_for_promote": 0, 2024-05-08T18:31:19.698 INFO:teuthology.orchestra.run.smithi097.stdout: "min_write_recency_for_promote": 0, 2024-05-08T18:31:19.698 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_grade_decay_rate": 0, 2024-05-08T18:31:19.698 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_search_last_n": 0, 2024-05-08T18:31:19.698 INFO:teuthology.orchestra.run.smithi097.stdout: "grade_table": [], 2024-05-08T18:31:19.698 INFO:teuthology.orchestra.run.smithi097.stdout: "stripe_width": 0, 2024-05-08T18:31:19.698 INFO:teuthology.orchestra.run.smithi097.stdout: "expected_num_objects": 0, 2024-05-08T18:31:19.698 INFO:teuthology.orchestra.run.smithi097.stdout: "fast_read": false, 2024-05-08T18:31:19.698 INFO:teuthology.orchestra.run.smithi097.stdout: "options": {}, 2024-05-08T18:31:19.698 INFO:teuthology.orchestra.run.smithi097.stdout: "application_metadata": { 2024-05-08T18:31:19.698 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw": {} 2024-05-08T18:31:19.698 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.699 INFO:teuthology.orchestra.run.smithi097.stdout: "read_balance": { 2024-05-08T18:31:19.699 INFO:teuthology.orchestra.run.smithi097.stdout: "score_type": "Fair distribution", 2024-05-08T18:31:19.699 INFO:teuthology.orchestra.run.smithi097.stdout: "score_acting": 1.75, 2024-05-08T18:31:19.699 INFO:teuthology.orchestra.run.smithi097.stdout: "score_stable": 1.75, 2024-05-08T18:31:19.699 INFO:teuthology.orchestra.run.smithi097.stdout: "optimal_score": 1, 2024-05-08T18:31:19.699 INFO:teuthology.orchestra.run.smithi097.stdout: "raw_score_acting": 1.75, 2024-05-08T18:31:19.699 INFO:teuthology.orchestra.run.smithi097.stdout: "raw_score_stable": 1.75, 2024-05-08T18:31:19.699 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity_weighted": 1, 2024-05-08T18:31:19.699 INFO:teuthology.orchestra.run.smithi097.stdout: "average_primary_affinity": 1, 2024-05-08T18:31:19.699 INFO:teuthology.orchestra.run.smithi097.stdout: "average_primary_affinity_weighted": 1 2024-05-08T18:31:19.699 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.699 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.699 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.699 INFO:teuthology.orchestra.run.smithi097.stdout: "pool": 7, 2024-05-08T18:31:19.700 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_name": "default.rgw.control", 2024-05-08T18:31:19.700 INFO:teuthology.orchestra.run.smithi097.stdout: "create_time": "2024-05-08T18:29:46.621438+0000", 2024-05-08T18:31:19.700 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2024-05-08T18:31:19.700 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_names": "hashpspool", 2024-05-08T18:31:19.700 INFO:teuthology.orchestra.run.smithi097.stdout: "type": 1, 2024-05-08T18:31:19.700 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 2, 2024-05-08T18:31:19.700 INFO:teuthology.orchestra.run.smithi097.stdout: "min_size": 1, 2024-05-08T18:31:19.700 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_rule": 0, 2024-05-08T18:31:19.700 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_count": 0, 2024-05-08T18:31:19.700 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_target": 0, 2024-05-08T18:31:19.700 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_barrier": 0, 2024-05-08T18:31:19.700 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-05-08T18:31:19.700 INFO:teuthology.orchestra.run.smithi097.stdout: "object_hash": 2, 2024-05-08T18:31:19.700 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_mode": "off", 2024-05-08T18:31:19.701 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num": 32, 2024-05-08T18:31:19.701 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num": 32, 2024-05-08T18:31:19.701 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num_target": 32, 2024-05-08T18:31:19.701 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_target": 32, 2024-05-08T18:31:19.701 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_pending": 32, 2024-05-08T18:31:19.701 INFO:teuthology.orchestra.run.smithi097.stdout: "last_pg_merge_meta": { 2024-05-08T18:31:19.701 INFO:teuthology.orchestra.run.smithi097.stdout: "source_pgid": "0.0", 2024-05-08T18:31:19.701 INFO:teuthology.orchestra.run.smithi097.stdout: "ready_epoch": 0, 2024-05-08T18:31:19.701 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_started": 0, 2024-05-08T18:31:19.701 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_clean": 0, 2024-05-08T18:31:19.701 INFO:teuthology.orchestra.run.smithi097.stdout: "source_version": "0'0", 2024-05-08T18:31:19.701 INFO:teuthology.orchestra.run.smithi097.stdout: "target_version": "0'0" 2024-05-08T18:31:19.701 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.701 INFO:teuthology.orchestra.run.smithi097.stdout: "last_change": "31", 2024-05-08T18:31:19.702 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend": "0", 2024-05-08T18:31:19.702 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_prenautilus": "0", 2024-05-08T18:31:19.702 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_preluminous": "0", 2024-05-08T18:31:19.702 INFO:teuthology.orchestra.run.smithi097.stdout: "auid": 0, 2024-05-08T18:31:19.702 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_mode": "selfmanaged", 2024-05-08T18:31:19.702 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_seq": 0, 2024-05-08T18:31:19.702 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_epoch": 0, 2024-05-08T18:31:19.702 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_snaps": [], 2024-05-08T18:31:19.702 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps": "[]", 2024-05-08T18:31:19.702 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_bytes": 0, 2024-05-08T18:31:19.702 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_objects": 0, 2024-05-08T18:31:19.702 INFO:teuthology.orchestra.run.smithi097.stdout: "tiers": [], 2024-05-08T18:31:19.702 INFO:teuthology.orchestra.run.smithi097.stdout: "tier_of": -1, 2024-05-08T18:31:19.702 INFO:teuthology.orchestra.run.smithi097.stdout: "read_tier": -1, 2024-05-08T18:31:19.703 INFO:teuthology.orchestra.run.smithi097.stdout: "write_tier": -1, 2024-05-08T18:31:19.703 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_mode": "none", 2024-05-08T18:31:19.703 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_bytes": 0, 2024-05-08T18:31:19.703 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_objects": 0, 2024-05-08T18:31:19.703 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-05-08T18:31:19.703 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-05-08T18:31:19.703 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_full_ratio_micro": 800000, 2024-05-08T18:31:19.703 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_flush_age": 0, 2024-05-08T18:31:19.703 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_evict_age": 0, 2024-05-08T18:31:19.703 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profile": "", 2024-05-08T18:31:19.703 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_params": { 2024-05-08T18:31:19.703 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "none" 2024-05-08T18:31:19.703 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.703 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_period": 0, 2024-05-08T18:31:19.703 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_count": 0, 2024-05-08T18:31:19.704 INFO:teuthology.orchestra.run.smithi097.stdout: "use_gmt_hitset": true, 2024-05-08T18:31:19.704 INFO:teuthology.orchestra.run.smithi097.stdout: "min_read_recency_for_promote": 0, 2024-05-08T18:31:19.704 INFO:teuthology.orchestra.run.smithi097.stdout: "min_write_recency_for_promote": 0, 2024-05-08T18:31:19.704 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_grade_decay_rate": 0, 2024-05-08T18:31:19.704 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_search_last_n": 0, 2024-05-08T18:31:19.704 INFO:teuthology.orchestra.run.smithi097.stdout: "grade_table": [], 2024-05-08T18:31:19.704 INFO:teuthology.orchestra.run.smithi097.stdout: "stripe_width": 0, 2024-05-08T18:31:19.704 INFO:teuthology.orchestra.run.smithi097.stdout: "expected_num_objects": 0, 2024-05-08T18:31:19.704 INFO:teuthology.orchestra.run.smithi097.stdout: "fast_read": false, 2024-05-08T18:31:19.704 INFO:teuthology.orchestra.run.smithi097.stdout: "options": {}, 2024-05-08T18:31:19.704 INFO:teuthology.orchestra.run.smithi097.stdout: "application_metadata": { 2024-05-08T18:31:19.704 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw": {} 2024-05-08T18:31:19.704 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.704 INFO:teuthology.orchestra.run.smithi097.stdout: "read_balance": { 2024-05-08T18:31:19.705 INFO:teuthology.orchestra.run.smithi097.stdout: "score_type": "Fair distribution", 2024-05-08T18:31:19.705 INFO:teuthology.orchestra.run.smithi097.stdout: "score_acting": 1.75, 2024-05-08T18:31:19.705 INFO:teuthology.orchestra.run.smithi097.stdout: "score_stable": 1.75, 2024-05-08T18:31:19.705 INFO:teuthology.orchestra.run.smithi097.stdout: "optimal_score": 1, 2024-05-08T18:31:19.705 INFO:teuthology.orchestra.run.smithi097.stdout: "raw_score_acting": 1.75, 2024-05-08T18:31:19.705 INFO:teuthology.orchestra.run.smithi097.stdout: "raw_score_stable": 1.75, 2024-05-08T18:31:19.705 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity_weighted": 1, 2024-05-08T18:31:19.705 INFO:teuthology.orchestra.run.smithi097.stdout: "average_primary_affinity": 1, 2024-05-08T18:31:19.705 INFO:teuthology.orchestra.run.smithi097.stdout: "average_primary_affinity_weighted": 1 2024-05-08T18:31:19.705 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.705 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.705 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.705 INFO:teuthology.orchestra.run.smithi097.stdout: "pool": 8, 2024-05-08T18:31:19.705 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_name": "default.rgw.meta", 2024-05-08T18:31:19.705 INFO:teuthology.orchestra.run.smithi097.stdout: "create_time": "2024-05-08T18:29:48.780230+0000", 2024-05-08T18:31:19.706 INFO:teuthology.orchestra.run.smithi097.stdout: "flags": 1, 2024-05-08T18:31:19.706 INFO:teuthology.orchestra.run.smithi097.stdout: "flags_names": "hashpspool", 2024-05-08T18:31:19.706 INFO:teuthology.orchestra.run.smithi097.stdout: "type": 1, 2024-05-08T18:31:19.706 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 2, 2024-05-08T18:31:19.706 INFO:teuthology.orchestra.run.smithi097.stdout: "min_size": 1, 2024-05-08T18:31:19.706 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_rule": 0, 2024-05-08T18:31:19.706 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_count": 0, 2024-05-08T18:31:19.706 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_target": 0, 2024-05-08T18:31:19.706 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_barrier": 0, 2024-05-08T18:31:19.706 INFO:teuthology.orchestra.run.smithi097.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-05-08T18:31:19.706 INFO:teuthology.orchestra.run.smithi097.stdout: "object_hash": 2, 2024-05-08T18:31:19.706 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_mode": "off", 2024-05-08T18:31:19.706 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num": 32, 2024-05-08T18:31:19.706 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num": 32, 2024-05-08T18:31:19.707 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_placement_num_target": 32, 2024-05-08T18:31:19.707 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_target": 32, 2024-05-08T18:31:19.707 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_num_pending": 32, 2024-05-08T18:31:19.707 INFO:teuthology.orchestra.run.smithi097.stdout: "last_pg_merge_meta": { 2024-05-08T18:31:19.707 INFO:teuthology.orchestra.run.smithi097.stdout: "source_pgid": "0.0", 2024-05-08T18:31:19.707 INFO:teuthology.orchestra.run.smithi097.stdout: "ready_epoch": 0, 2024-05-08T18:31:19.707 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_started": 0, 2024-05-08T18:31:19.707 INFO:teuthology.orchestra.run.smithi097.stdout: "last_epoch_clean": 0, 2024-05-08T18:31:19.707 INFO:teuthology.orchestra.run.smithi097.stdout: "source_version": "0'0", 2024-05-08T18:31:19.707 INFO:teuthology.orchestra.run.smithi097.stdout: "target_version": "0'0" 2024-05-08T18:31:19.707 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.707 INFO:teuthology.orchestra.run.smithi097.stdout: "last_change": "33", 2024-05-08T18:31:19.707 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend": "0", 2024-05-08T18:31:19.707 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_prenautilus": "0", 2024-05-08T18:31:19.707 INFO:teuthology.orchestra.run.smithi097.stdout: "last_force_op_resend_preluminous": "0", 2024-05-08T18:31:19.708 INFO:teuthology.orchestra.run.smithi097.stdout: "auid": 0, 2024-05-08T18:31:19.709 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_mode": "selfmanaged", 2024-05-08T18:31:19.709 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_seq": 0, 2024-05-08T18:31:19.709 INFO:teuthology.orchestra.run.smithi097.stdout: "snap_epoch": 0, 2024-05-08T18:31:19.709 INFO:teuthology.orchestra.run.smithi097.stdout: "pool_snaps": [], 2024-05-08T18:31:19.709 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps": "[]", 2024-05-08T18:31:19.709 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_bytes": 0, 2024-05-08T18:31:19.709 INFO:teuthology.orchestra.run.smithi097.stdout: "quota_max_objects": 0, 2024-05-08T18:31:19.710 INFO:teuthology.orchestra.run.smithi097.stdout: "tiers": [], 2024-05-08T18:31:19.710 INFO:teuthology.orchestra.run.smithi097.stdout: "tier_of": -1, 2024-05-08T18:31:19.710 INFO:teuthology.orchestra.run.smithi097.stdout: "read_tier": -1, 2024-05-08T18:31:19.710 INFO:teuthology.orchestra.run.smithi097.stdout: "write_tier": -1, 2024-05-08T18:31:19.710 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_mode": "none", 2024-05-08T18:31:19.710 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_bytes": 0, 2024-05-08T18:31:19.710 INFO:teuthology.orchestra.run.smithi097.stdout: "target_max_objects": 0, 2024-05-08T18:31:19.710 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-05-08T18:31:19.710 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-05-08T18:31:19.710 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_target_full_ratio_micro": 800000, 2024-05-08T18:31:19.710 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_flush_age": 0, 2024-05-08T18:31:19.710 INFO:teuthology.orchestra.run.smithi097.stdout: "cache_min_evict_age": 0, 2024-05-08T18:31:19.710 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profile": "", 2024-05-08T18:31:19.710 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_params": { 2024-05-08T18:31:19.711 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "none" 2024-05-08T18:31:19.711 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.711 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_period": 0, 2024-05-08T18:31:19.711 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_count": 0, 2024-05-08T18:31:19.711 INFO:teuthology.orchestra.run.smithi097.stdout: "use_gmt_hitset": true, 2024-05-08T18:31:19.711 INFO:teuthology.orchestra.run.smithi097.stdout: "min_read_recency_for_promote": 0, 2024-05-08T18:31:19.711 INFO:teuthology.orchestra.run.smithi097.stdout: "min_write_recency_for_promote": 0, 2024-05-08T18:31:19.711 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_grade_decay_rate": 0, 2024-05-08T18:31:19.711 INFO:teuthology.orchestra.run.smithi097.stdout: "hit_set_search_last_n": 0, 2024-05-08T18:31:19.711 INFO:teuthology.orchestra.run.smithi097.stdout: "grade_table": [], 2024-05-08T18:31:19.711 INFO:teuthology.orchestra.run.smithi097.stdout: "stripe_width": 0, 2024-05-08T18:31:19.711 INFO:teuthology.orchestra.run.smithi097.stdout: "expected_num_objects": 0, 2024-05-08T18:31:19.711 INFO:teuthology.orchestra.run.smithi097.stdout: "fast_read": false, 2024-05-08T18:31:19.711 INFO:teuthology.orchestra.run.smithi097.stdout: "options": { 2024-05-08T18:31:19.712 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_autoscale_bias": 4 2024-05-08T18:31:19.712 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.712 INFO:teuthology.orchestra.run.smithi097.stdout: "application_metadata": { 2024-05-08T18:31:19.712 INFO:teuthology.orchestra.run.smithi097.stdout: "rgw": {} 2024-05-08T18:31:19.712 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.712 INFO:teuthology.orchestra.run.smithi097.stdout: "read_balance": { 2024-05-08T18:31:19.712 INFO:teuthology.orchestra.run.smithi097.stdout: "score_type": "Fair distribution", 2024-05-08T18:31:19.712 INFO:teuthology.orchestra.run.smithi097.stdout: "score_acting": 1.5, 2024-05-08T18:31:19.712 INFO:teuthology.orchestra.run.smithi097.stdout: "score_stable": 1.5, 2024-05-08T18:31:19.712 INFO:teuthology.orchestra.run.smithi097.stdout: "optimal_score": 1, 2024-05-08T18:31:19.712 INFO:teuthology.orchestra.run.smithi097.stdout: "raw_score_acting": 1.5, 2024-05-08T18:31:19.712 INFO:teuthology.orchestra.run.smithi097.stdout: "raw_score_stable": 1.5, 2024-05-08T18:31:19.712 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity_weighted": 1, 2024-05-08T18:31:19.712 INFO:teuthology.orchestra.run.smithi097.stdout: "average_primary_affinity": 1, 2024-05-08T18:31:19.713 INFO:teuthology.orchestra.run.smithi097.stdout: "average_primary_affinity_weighted": 1 2024-05-08T18:31:19.713 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.713 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.713 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2024-05-08T18:31:19.713 INFO:teuthology.orchestra.run.smithi097.stdout: "osds": [ 2024-05-08T18:31:19.713 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.713 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 0, 2024-05-08T18:31:19.713 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "f135796c-f80c-43a8-889d-e0927bcc3d0a", 2024-05-08T18:31:19.713 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2024-05-08T18:31:19.713 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2024-05-08T18:31:19.713 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2024-05-08T18:31:19.713 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2024-05-08T18:31:19.713 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2024-05-08T18:31:19.713 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2024-05-08T18:31:19.714 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 14, 2024-05-08T18:31:19.714 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 31, 2024-05-08T18:31:19.714 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2024-05-08T18:31:19.714 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2024-05-08T18:31:19.714 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2024-05-08T18:31:19.714 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2024-05-08T18:31:19.714 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.714 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v2", 2024-05-08T18:31:19.714 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6800", 2024-05-08T18:31:19.714 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2064534873 2024-05-08T18:31:19.714 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.714 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.714 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2024-05-08T18:31:19.715 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6801", 2024-05-08T18:31:19.715 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2064534873 2024-05-08T18:31:19.715 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.715 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:19.715 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.715 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2024-05-08T18:31:19.715 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2024-05-08T18:31:19.715 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.715 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v2", 2024-05-08T18:31:19.715 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6802", 2024-05-08T18:31:19.715 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2064534873 2024-05-08T18:31:19.715 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.715 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.716 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2024-05-08T18:31:19.716 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6803", 2024-05-08T18:31:19.716 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2064534873 2024-05-08T18:31:19.716 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.716 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:19.716 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.716 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2024-05-08T18:31:19.716 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2024-05-08T18:31:19.716 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.716 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v2", 2024-05-08T18:31:19.716 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6806", 2024-05-08T18:31:19.716 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2064534873 2024-05-08T18:31:19.716 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.716 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.717 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2024-05-08T18:31:19.717 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6807", 2024-05-08T18:31:19.717 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2064534873 2024-05-08T18:31:19.717 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.717 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:19.717 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.717 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2024-05-08T18:31:19.717 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2024-05-08T18:31:19.717 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.717 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v2", 2024-05-08T18:31:19.717 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6804", 2024-05-08T18:31:19.717 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2064534873 2024-05-08T18:31:19.717 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.717 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.718 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2024-05-08T18:31:19.718 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6805", 2024-05-08T18:31:19.718 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2064534873 2024-05-08T18:31:19.718 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.718 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:19.718 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.718 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.97:6801/2064534873", 2024-05-08T18:31:19.718 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.97:6803/2064534873", 2024-05-08T18:31:19.718 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.97:6807/2064534873", 2024-05-08T18:31:19.718 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.97:6805/2064534873", 2024-05-08T18:31:19.718 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2024-05-08T18:31:19.718 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2024-05-08T18:31:19.718 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2024-05-08T18:31:19.719 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:19.719 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.719 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.719 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 1, 2024-05-08T18:31:19.719 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "b91d895a-2b40-45c1-b355-52dba17032cb", 2024-05-08T18:31:19.719 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2024-05-08T18:31:19.719 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2024-05-08T18:31:19.719 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2024-05-08T18:31:19.719 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2024-05-08T18:31:19.719 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2024-05-08T18:31:19.719 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2024-05-08T18:31:19.719 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 14, 2024-05-08T18:31:19.720 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 46, 2024-05-08T18:31:19.720 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2024-05-08T18:31:19.720 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2024-05-08T18:31:19.720 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2024-05-08T18:31:19.720 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2024-05-08T18:31:19.720 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.720 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v2", 2024-05-08T18:31:19.720 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6813", 2024-05-08T18:31:19.720 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 34364184 2024-05-08T18:31:19.720 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.720 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.720 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2024-05-08T18:31:19.721 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6815", 2024-05-08T18:31:19.721 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 34364184 2024-05-08T18:31:19.721 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.721 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:19.721 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.721 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2024-05-08T18:31:19.721 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2024-05-08T18:31:19.721 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.721 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v2", 2024-05-08T18:31:19.721 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6818", 2024-05-08T18:31:19.721 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 34364184 2024-05-08T18:31:19.721 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.721 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.722 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2024-05-08T18:31:19.722 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6819", 2024-05-08T18:31:19.722 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 34364184 2024-05-08T18:31:19.722 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.722 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:19.722 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.722 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2024-05-08T18:31:19.722 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2024-05-08T18:31:19.722 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.722 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v2", 2024-05-08T18:31:19.722 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6822", 2024-05-08T18:31:19.722 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 34364184 2024-05-08T18:31:19.722 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.722 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.723 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2024-05-08T18:31:19.723 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6823", 2024-05-08T18:31:19.723 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 34364184 2024-05-08T18:31:19.723 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.723 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:19.723 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.723 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2024-05-08T18:31:19.723 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2024-05-08T18:31:19.723 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.723 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v2", 2024-05-08T18:31:19.723 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6820", 2024-05-08T18:31:19.723 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 34364184 2024-05-08T18:31:19.723 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.723 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.724 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2024-05-08T18:31:19.724 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6821", 2024-05-08T18:31:19.724 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 34364184 2024-05-08T18:31:19.724 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.724 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:19.724 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.724 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.97:6815/34364184", 2024-05-08T18:31:19.724 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.97:6819/34364184", 2024-05-08T18:31:19.724 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.97:6823/34364184", 2024-05-08T18:31:19.724 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.97:6821/34364184", 2024-05-08T18:31:19.724 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2024-05-08T18:31:19.724 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2024-05-08T18:31:19.724 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2024-05-08T18:31:19.724 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:19.725 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.725 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.725 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 2, 2024-05-08T18:31:19.725 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "35f12106-8d9a-4dcb-a8bc-38e08c81bd5e", 2024-05-08T18:31:19.725 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2024-05-08T18:31:19.725 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2024-05-08T18:31:19.725 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2024-05-08T18:31:19.725 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2024-05-08T18:31:19.725 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2024-05-08T18:31:19.725 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2024-05-08T18:31:19.725 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 14, 2024-05-08T18:31:19.725 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 46, 2024-05-08T18:31:19.725 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2024-05-08T18:31:19.725 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2024-05-08T18:31:19.726 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2024-05-08T18:31:19.726 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2024-05-08T18:31:19.726 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.726 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v2", 2024-05-08T18:31:19.726 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6808", 2024-05-08T18:31:19.726 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3004545111 2024-05-08T18:31:19.726 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.726 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.726 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2024-05-08T18:31:19.726 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6809", 2024-05-08T18:31:19.726 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3004545111 2024-05-08T18:31:19.726 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.726 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:19.727 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.727 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2024-05-08T18:31:19.727 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2024-05-08T18:31:19.727 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.727 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v2", 2024-05-08T18:31:19.727 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6810", 2024-05-08T18:31:19.727 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3004545111 2024-05-08T18:31:19.727 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.727 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.727 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2024-05-08T18:31:19.727 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6811", 2024-05-08T18:31:19.727 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3004545111 2024-05-08T18:31:19.727 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.727 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:19.728 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.728 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2024-05-08T18:31:19.728 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2024-05-08T18:31:19.728 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.728 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v2", 2024-05-08T18:31:19.728 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6816", 2024-05-08T18:31:19.728 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3004545111 2024-05-08T18:31:19.728 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.728 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.728 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2024-05-08T18:31:19.728 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6817", 2024-05-08T18:31:19.728 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3004545111 2024-05-08T18:31:19.728 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.728 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:19.729 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.729 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2024-05-08T18:31:19.729 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2024-05-08T18:31:19.729 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.729 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v2", 2024-05-08T18:31:19.729 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6812", 2024-05-08T18:31:19.729 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3004545111 2024-05-08T18:31:19.729 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.729 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.729 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2024-05-08T18:31:19.729 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6814", 2024-05-08T18:31:19.729 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 3004545111 2024-05-08T18:31:19.729 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.730 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:19.730 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.730 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.97:6809/3004545111", 2024-05-08T18:31:19.730 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.97:6811/3004545111", 2024-05-08T18:31:19.730 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.97:6817/3004545111", 2024-05-08T18:31:19.730 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.97:6814/3004545111", 2024-05-08T18:31:19.730 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2024-05-08T18:31:19.730 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2024-05-08T18:31:19.730 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2024-05-08T18:31:19.730 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:19.730 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.730 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.730 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 3, 2024-05-08T18:31:19.731 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "cd78d341-ec40-457e-a713-555b03bc9f16", 2024-05-08T18:31:19.731 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2024-05-08T18:31:19.731 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2024-05-08T18:31:19.731 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2024-05-08T18:31:19.731 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2024-05-08T18:31:19.731 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2024-05-08T18:31:19.731 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2024-05-08T18:31:19.731 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 14, 2024-05-08T18:31:19.731 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 46, 2024-05-08T18:31:19.731 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2024-05-08T18:31:19.731 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2024-05-08T18:31:19.731 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2024-05-08T18:31:19.731 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2024-05-08T18:31:19.731 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.732 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v2", 2024-05-08T18:31:19.732 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6824", 2024-05-08T18:31:19.732 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 1855786157 2024-05-08T18:31:19.732 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.732 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.732 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2024-05-08T18:31:19.732 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6825", 2024-05-08T18:31:19.732 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 1855786157 2024-05-08T18:31:19.732 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.732 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:19.732 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.732 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2024-05-08T18:31:19.732 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2024-05-08T18:31:19.733 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.733 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v2", 2024-05-08T18:31:19.733 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6826", 2024-05-08T18:31:19.733 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 1855786157 2024-05-08T18:31:19.733 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.733 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.733 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2024-05-08T18:31:19.733 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6827", 2024-05-08T18:31:19.733 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 1855786157 2024-05-08T18:31:19.733 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.733 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:19.733 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.733 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2024-05-08T18:31:19.734 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2024-05-08T18:31:19.734 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.734 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v2", 2024-05-08T18:31:19.734 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6830", 2024-05-08T18:31:19.734 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 1855786157 2024-05-08T18:31:19.734 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.734 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.734 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2024-05-08T18:31:19.734 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6831", 2024-05-08T18:31:19.734 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 1855786157 2024-05-08T18:31:19.734 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.734 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:19.734 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.734 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2024-05-08T18:31:19.735 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2024-05-08T18:31:19.735 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.735 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v2", 2024-05-08T18:31:19.735 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6828", 2024-05-08T18:31:19.735 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 1855786157 2024-05-08T18:31:19.735 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.735 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.735 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2024-05-08T18:31:19.735 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.97:6829", 2024-05-08T18:31:19.735 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 1855786157 2024-05-08T18:31:19.735 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.735 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:19.735 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.736 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.97:6825/1855786157", 2024-05-08T18:31:19.736 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.97:6827/1855786157", 2024-05-08T18:31:19.736 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.97:6831/1855786157", 2024-05-08T18:31:19.736 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.97:6829/1855786157", 2024-05-08T18:31:19.736 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2024-05-08T18:31:19.736 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2024-05-08T18:31:19.736 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2024-05-08T18:31:19.736 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:19.736 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.736 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.736 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 4, 2024-05-08T18:31:19.736 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "469d890e-5e0c-41cd-ac5b-ef987b70abd0", 2024-05-08T18:31:19.736 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2024-05-08T18:31:19.736 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2024-05-08T18:31:19.737 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2024-05-08T18:31:19.737 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2024-05-08T18:31:19.737 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2024-05-08T18:31:19.737 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2024-05-08T18:31:19.737 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 15, 2024-05-08T18:31:19.737 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 31, 2024-05-08T18:31:19.737 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2024-05-08T18:31:19.737 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2024-05-08T18:31:19.737 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2024-05-08T18:31:19.737 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2024-05-08T18:31:19.737 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.737 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v2", 2024-05-08T18:31:19.737 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.151:6808", 2024-05-08T18:31:19.737 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 1246653692 2024-05-08T18:31:19.738 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.738 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.738 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2024-05-08T18:31:19.738 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.151:6810", 2024-05-08T18:31:19.738 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 1246653692 2024-05-08T18:31:19.738 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.738 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:19.738 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.738 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2024-05-08T18:31:19.738 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2024-05-08T18:31:19.738 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.738 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v2", 2024-05-08T18:31:19.738 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.151:6812", 2024-05-08T18:31:19.739 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 1246653692 2024-05-08T18:31:19.739 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.739 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.739 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2024-05-08T18:31:19.739 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.151:6814", 2024-05-08T18:31:19.739 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 1246653692 2024-05-08T18:31:19.739 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.739 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:19.739 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.739 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2024-05-08T18:31:19.739 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2024-05-08T18:31:19.739 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.739 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v2", 2024-05-08T18:31:19.739 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.151:6820", 2024-05-08T18:31:19.740 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 1246653692 2024-05-08T18:31:19.740 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.740 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.740 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2024-05-08T18:31:19.740 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.151:6822", 2024-05-08T18:31:19.740 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 1246653692 2024-05-08T18:31:19.740 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.740 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:19.740 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.740 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2024-05-08T18:31:19.740 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2024-05-08T18:31:19.740 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.740 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v2", 2024-05-08T18:31:19.740 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.151:6816", 2024-05-08T18:31:19.741 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 1246653692 2024-05-08T18:31:19.741 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.741 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.741 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2024-05-08T18:31:19.741 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.151:6818", 2024-05-08T18:31:19.741 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 1246653692 2024-05-08T18:31:19.741 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.741 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:19.741 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.741 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.151:6810/1246653692", 2024-05-08T18:31:19.741 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.151:6814/1246653692", 2024-05-08T18:31:19.741 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.151:6822/1246653692", 2024-05-08T18:31:19.741 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.151:6818/1246653692", 2024-05-08T18:31:19.742 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2024-05-08T18:31:19.742 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2024-05-08T18:31:19.742 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2024-05-08T18:31:19.742 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:19.742 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.742 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.742 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 5, 2024-05-08T18:31:19.742 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "dcb25c08-802c-4140-a3d2-929960319860", 2024-05-08T18:31:19.742 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2024-05-08T18:31:19.742 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2024-05-08T18:31:19.742 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2024-05-08T18:31:19.742 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2024-05-08T18:31:19.742 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2024-05-08T18:31:19.743 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2024-05-08T18:31:19.743 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 15, 2024-05-08T18:31:19.743 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 31, 2024-05-08T18:31:19.743 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2024-05-08T18:31:19.743 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2024-05-08T18:31:19.743 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2024-05-08T18:31:19.743 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2024-05-08T18:31:19.743 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.743 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v2", 2024-05-08T18:31:19.743 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.151:6809", 2024-05-08T18:31:19.743 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 4257184226 2024-05-08T18:31:19.743 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.743 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.743 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2024-05-08T18:31:19.744 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.151:6811", 2024-05-08T18:31:19.744 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 4257184226 2024-05-08T18:31:19.744 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.744 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:19.744 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.744 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2024-05-08T18:31:19.744 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2024-05-08T18:31:19.744 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.744 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v2", 2024-05-08T18:31:19.744 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.151:6813", 2024-05-08T18:31:19.744 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 4257184226 2024-05-08T18:31:19.744 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.744 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.745 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2024-05-08T18:31:19.745 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.151:6815", 2024-05-08T18:31:19.745 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 4257184226 2024-05-08T18:31:19.745 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.745 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:19.745 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.745 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2024-05-08T18:31:19.745 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2024-05-08T18:31:19.745 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.745 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v2", 2024-05-08T18:31:19.745 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.151:6821", 2024-05-08T18:31:19.745 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 4257184226 2024-05-08T18:31:19.745 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.745 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.745 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2024-05-08T18:31:19.746 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.151:6823", 2024-05-08T18:31:19.746 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 4257184226 2024-05-08T18:31:19.746 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.746 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:19.746 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.746 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2024-05-08T18:31:19.746 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2024-05-08T18:31:19.746 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.746 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v2", 2024-05-08T18:31:19.746 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.151:6817", 2024-05-08T18:31:19.746 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 4257184226 2024-05-08T18:31:19.746 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.746 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.746 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2024-05-08T18:31:19.747 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.151:6819", 2024-05-08T18:31:19.747 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 4257184226 2024-05-08T18:31:19.747 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.747 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:19.747 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.747 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.151:6811/4257184226", 2024-05-08T18:31:19.747 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.151:6815/4257184226", 2024-05-08T18:31:19.747 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.151:6823/4257184226", 2024-05-08T18:31:19.747 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.151:6819/4257184226", 2024-05-08T18:31:19.747 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2024-05-08T18:31:19.747 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2024-05-08T18:31:19.747 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2024-05-08T18:31:19.747 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:19.747 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.748 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.748 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 6, 2024-05-08T18:31:19.748 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "598ab572-7049-4600-9e91-1792360421d2", 2024-05-08T18:31:19.748 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2024-05-08T18:31:19.748 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2024-05-08T18:31:19.748 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2024-05-08T18:31:19.748 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2024-05-08T18:31:19.748 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2024-05-08T18:31:19.748 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2024-05-08T18:31:19.748 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 15, 2024-05-08T18:31:19.748 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 31, 2024-05-08T18:31:19.748 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2024-05-08T18:31:19.748 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2024-05-08T18:31:19.748 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2024-05-08T18:31:19.749 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2024-05-08T18:31:19.749 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.749 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v2", 2024-05-08T18:31:19.749 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.151:6800", 2024-05-08T18:31:19.749 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 974202886 2024-05-08T18:31:19.749 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.749 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.749 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2024-05-08T18:31:19.749 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.151:6801", 2024-05-08T18:31:19.749 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 974202886 2024-05-08T18:31:19.749 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.749 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:19.749 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.750 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2024-05-08T18:31:19.750 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2024-05-08T18:31:19.750 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.750 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v2", 2024-05-08T18:31:19.750 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.151:6802", 2024-05-08T18:31:19.750 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 974202886 2024-05-08T18:31:19.750 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.750 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.750 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2024-05-08T18:31:19.750 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.151:6803", 2024-05-08T18:31:19.750 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 974202886 2024-05-08T18:31:19.750 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.750 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:19.751 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.751 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2024-05-08T18:31:19.751 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2024-05-08T18:31:19.751 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.751 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v2", 2024-05-08T18:31:19.751 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.151:6806", 2024-05-08T18:31:19.751 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 974202886 2024-05-08T18:31:19.751 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.751 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.751 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2024-05-08T18:31:19.751 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.151:6807", 2024-05-08T18:31:19.751 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 974202886 2024-05-08T18:31:19.751 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.751 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:19.752 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.752 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2024-05-08T18:31:19.752 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2024-05-08T18:31:19.752 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.752 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v2", 2024-05-08T18:31:19.752 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.151:6804", 2024-05-08T18:31:19.752 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 974202886 2024-05-08T18:31:19.752 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.752 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.752 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2024-05-08T18:31:19.752 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.151:6805", 2024-05-08T18:31:19.752 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 974202886 2024-05-08T18:31:19.752 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.752 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:19.752 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.753 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.151:6801/974202886", 2024-05-08T18:31:19.753 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.151:6803/974202886", 2024-05-08T18:31:19.753 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.151:6807/974202886", 2024-05-08T18:31:19.753 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.151:6805/974202886", 2024-05-08T18:31:19.753 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2024-05-08T18:31:19.753 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2024-05-08T18:31:19.753 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2024-05-08T18:31:19.753 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:19.753 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.753 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.753 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 7, 2024-05-08T18:31:19.753 INFO:teuthology.orchestra.run.smithi097.stdout: "uuid": "c21805e0-4945-4efe-8e65-68bb92d30b69", 2024-05-08T18:31:19.754 INFO:teuthology.orchestra.run.smithi097.stdout: "up": 1, 2024-05-08T18:31:19.754 INFO:teuthology.orchestra.run.smithi097.stdout: "in": 1, 2024-05-08T18:31:19.754 INFO:teuthology.orchestra.run.smithi097.stdout: "weight": 1, 2024-05-08T18:31:19.754 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_affinity": 1, 2024-05-08T18:31:19.754 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_begin": 0, 2024-05-08T18:31:19.754 INFO:teuthology.orchestra.run.smithi097.stdout: "last_clean_end": 0, 2024-05-08T18:31:19.754 INFO:teuthology.orchestra.run.smithi097.stdout: "up_from": 15, 2024-05-08T18:31:19.754 INFO:teuthology.orchestra.run.smithi097.stdout: "up_thru": 31, 2024-05-08T18:31:19.754 INFO:teuthology.orchestra.run.smithi097.stdout: "down_at": 0, 2024-05-08T18:31:19.754 INFO:teuthology.orchestra.run.smithi097.stdout: "lost_at": 0, 2024-05-08T18:31:19.754 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addrs": { 2024-05-08T18:31:19.754 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2024-05-08T18:31:19.754 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.755 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v2", 2024-05-08T18:31:19.755 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.151:6824", 2024-05-08T18:31:19.755 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2584927373 2024-05-08T18:31:19.755 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.755 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.755 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2024-05-08T18:31:19.755 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.151:6825", 2024-05-08T18:31:19.755 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2584927373 2024-05-08T18:31:19.755 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.755 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:19.756 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.756 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addrs": { 2024-05-08T18:31:19.756 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2024-05-08T18:31:19.756 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.756 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v2", 2024-05-08T18:31:19.756 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.151:6826", 2024-05-08T18:31:19.756 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2584927373 2024-05-08T18:31:19.756 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.756 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.756 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2024-05-08T18:31:19.756 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.151:6827", 2024-05-08T18:31:19.756 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2584927373 2024-05-08T18:31:19.756 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.756 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:19.757 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.757 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addrs": { 2024-05-08T18:31:19.757 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2024-05-08T18:31:19.757 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.757 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v2", 2024-05-08T18:31:19.757 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.151:6830", 2024-05-08T18:31:19.757 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2584927373 2024-05-08T18:31:19.757 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.757 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.757 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2024-05-08T18:31:19.757 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.151:6831", 2024-05-08T18:31:19.757 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2584927373 2024-05-08T18:31:19.757 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.758 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:19.758 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.758 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addrs": { 2024-05-08T18:31:19.758 INFO:teuthology.orchestra.run.smithi097.stdout: "addrvec": [ 2024-05-08T18:31:19.758 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.758 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v2", 2024-05-08T18:31:19.758 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.151:6828", 2024-05-08T18:31:19.758 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2584927373 2024-05-08T18:31:19.758 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.758 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.758 INFO:teuthology.orchestra.run.smithi097.stdout: "type": "v1", 2024-05-08T18:31:19.758 INFO:teuthology.orchestra.run.smithi097.stdout: "addr": "172.21.15.151:6829", 2024-05-08T18:31:19.758 INFO:teuthology.orchestra.run.smithi097.stdout: "nonce": 2584927373 2024-05-08T18:31:19.759 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.759 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:19.759 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.759 INFO:teuthology.orchestra.run.smithi097.stdout: "public_addr": "172.21.15.151:6825/2584927373", 2024-05-08T18:31:19.759 INFO:teuthology.orchestra.run.smithi097.stdout: "cluster_addr": "172.21.15.151:6827/2584927373", 2024-05-08T18:31:19.759 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_back_addr": "172.21.15.151:6831/2584927373", 2024-05-08T18:31:19.759 INFO:teuthology.orchestra.run.smithi097.stdout: "heartbeat_front_addr": "172.21.15.151:6829/2584927373", 2024-05-08T18:31:19.759 INFO:teuthology.orchestra.run.smithi097.stdout: "state": [ 2024-05-08T18:31:19.759 INFO:teuthology.orchestra.run.smithi097.stdout: "exists", 2024-05-08T18:31:19.759 INFO:teuthology.orchestra.run.smithi097.stdout: "up" 2024-05-08T18:31:19.759 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:19.759 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.759 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2024-05-08T18:31:19.759 INFO:teuthology.orchestra.run.smithi097.stdout: "osd_xinfo": [ 2024-05-08T18:31:19.759 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.760 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 0, 2024-05-08T18:31:19.760 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2024-05-08T18:31:19.760 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2024-05-08T18:31:19.760 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2024-05-08T18:31:19.760 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540701547738038271, 2024-05-08T18:31:19.760 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2024-05-08T18:31:19.760 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2024-05-08T18:29:22.299407+0000", 2024-05-08T18:31:19.760 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2024-05-08T18:31:19.760 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.760 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.760 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 1, 2024-05-08T18:31:19.760 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2024-05-08T18:31:19.760 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2024-05-08T18:31:19.760 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2024-05-08T18:31:19.761 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540701547738038271, 2024-05-08T18:31:19.761 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2024-05-08T18:31:19.761 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2024-05-08T18:29:22.487701+0000", 2024-05-08T18:31:19.761 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2024-05-08T18:31:19.761 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.761 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.761 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 2, 2024-05-08T18:31:19.761 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2024-05-08T18:31:19.761 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2024-05-08T18:31:19.761 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2024-05-08T18:31:19.761 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540701547738038271, 2024-05-08T18:31:19.761 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2024-05-08T18:31:19.761 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2024-05-08T18:29:22.371789+0000", 2024-05-08T18:31:19.761 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2024-05-08T18:31:19.762 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.762 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.762 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 3, 2024-05-08T18:31:19.762 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2024-05-08T18:31:19.762 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2024-05-08T18:31:19.762 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2024-05-08T18:31:19.762 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540701547738038271, 2024-05-08T18:31:19.762 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2024-05-08T18:31:19.762 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2024-05-08T18:29:22.160484+0000", 2024-05-08T18:31:19.762 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2024-05-08T18:31:19.762 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.762 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.762 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 4, 2024-05-08T18:31:19.763 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2024-05-08T18:31:19.763 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2024-05-08T18:31:19.763 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2024-05-08T18:31:19.763 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540701547738038271, 2024-05-08T18:31:19.763 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2024-05-08T18:31:19.763 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2024-05-08T18:29:22.674077+0000", 2024-05-08T18:31:19.763 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2024-05-08T18:31:19.763 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.763 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.763 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 5, 2024-05-08T18:31:19.763 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2024-05-08T18:31:19.763 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2024-05-08T18:31:19.763 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2024-05-08T18:31:19.763 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540701547738038271, 2024-05-08T18:31:19.763 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2024-05-08T18:31:19.764 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2024-05-08T18:29:22.713456+0000", 2024-05-08T18:31:19.764 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2024-05-08T18:31:19.764 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.764 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.764 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 6, 2024-05-08T18:31:19.764 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2024-05-08T18:31:19.764 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2024-05-08T18:31:19.764 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2024-05-08T18:31:19.764 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540701547738038271, 2024-05-08T18:31:19.764 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2024-05-08T18:31:19.764 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2024-05-08T18:29:22.587563+0000", 2024-05-08T18:31:19.764 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2024-05-08T18:31:19.764 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.764 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.765 INFO:teuthology.orchestra.run.smithi097.stdout: "osd": 7, 2024-05-08T18:31:19.765 INFO:teuthology.orchestra.run.smithi097.stdout: "down_stamp": "0.000000", 2024-05-08T18:31:19.765 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_probability": 0, 2024-05-08T18:31:19.765 INFO:teuthology.orchestra.run.smithi097.stdout: "laggy_interval": 0, 2024-05-08T18:31:19.765 INFO:teuthology.orchestra.run.smithi097.stdout: "features": 4540701547738038271, 2024-05-08T18:31:19.765 INFO:teuthology.orchestra.run.smithi097.stdout: "old_weight": 0, 2024-05-08T18:31:19.765 INFO:teuthology.orchestra.run.smithi097.stdout: "last_purged_snaps_scrub": "2024-05-08T18:29:22.751830+0000", 2024-05-08T18:31:19.765 INFO:teuthology.orchestra.run.smithi097.stdout: "dead_epoch": 0 2024-05-08T18:31:19.765 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.765 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2024-05-08T18:31:19.765 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_upmap": [], 2024-05-08T18:31:19.765 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_upmap_items": [ 2024-05-08T18:31:19.765 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.765 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "3.2", 2024-05-08T18:31:19.766 INFO:teuthology.orchestra.run.smithi097.stdout: "mappings": [ 2024-05-08T18:31:19.766 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.766 INFO:teuthology.orchestra.run.smithi097.stdout: "from": 5, 2024-05-08T18:31:19.766 INFO:teuthology.orchestra.run.smithi097.stdout: "to": 1 2024-05-08T18:31:19.766 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.766 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:19.766 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.766 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.766 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "3.5", 2024-05-08T18:31:19.766 INFO:teuthology.orchestra.run.smithi097.stdout: "mappings": [ 2024-05-08T18:31:19.766 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.766 INFO:teuthology.orchestra.run.smithi097.stdout: "from": 5, 2024-05-08T18:31:19.766 INFO:teuthology.orchestra.run.smithi097.stdout: "to": 2 2024-05-08T18:31:19.767 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.767 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:19.767 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.767 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.767 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "3.25", 2024-05-08T18:31:19.767 INFO:teuthology.orchestra.run.smithi097.stdout: "mappings": [ 2024-05-08T18:31:19.767 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.767 INFO:teuthology.orchestra.run.smithi097.stdout: "from": 3, 2024-05-08T18:31:19.767 INFO:teuthology.orchestra.run.smithi097.stdout: "to": 2 2024-05-08T18:31:19.767 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.767 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:19.767 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.767 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.767 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "3.39", 2024-05-08T18:31:19.768 INFO:teuthology.orchestra.run.smithi097.stdout: "mappings": [ 2024-05-08T18:31:19.768 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.768 INFO:teuthology.orchestra.run.smithi097.stdout: "from": 7, 2024-05-08T18:31:19.768 INFO:teuthology.orchestra.run.smithi097.stdout: "to": 2 2024-05-08T18:31:19.768 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.768 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:19.768 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.768 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.768 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "4.0", 2024-05-08T18:31:19.768 INFO:teuthology.orchestra.run.smithi097.stdout: "mappings": [ 2024-05-08T18:31:19.768 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.768 INFO:teuthology.orchestra.run.smithi097.stdout: "from": 3, 2024-05-08T18:31:19.768 INFO:teuthology.orchestra.run.smithi097.stdout: "to": 2 2024-05-08T18:31:19.768 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.769 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:19.769 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.769 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.769 INFO:teuthology.orchestra.run.smithi097.stdout: "pgid": "4.10", 2024-05-08T18:31:19.769 INFO:teuthology.orchestra.run.smithi097.stdout: "mappings": [ 2024-05-08T18:31:19.769 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:19.769 INFO:teuthology.orchestra.run.smithi097.stdout: "from": 1, 2024-05-08T18:31:19.769 INFO:teuthology.orchestra.run.smithi097.stdout: "to": 5 2024-05-08T18:31:19.769 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.769 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:19.769 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.769 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2024-05-08T18:31:19.769 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_upmap_primaries": [], 2024-05-08T18:31:19.769 INFO:teuthology.orchestra.run.smithi097.stdout: "pg_temp": [], 2024-05-08T18:31:19.770 INFO:teuthology.orchestra.run.smithi097.stdout: "primary_temp": [], 2024-05-08T18:31:19.770 INFO:teuthology.orchestra.run.smithi097.stdout: "blocklist": {}, 2024-05-08T18:31:19.770 INFO:teuthology.orchestra.run.smithi097.stdout: "range_blocklist": {}, 2024-05-08T18:31:19.770 INFO:teuthology.orchestra.run.smithi097.stdout: "erasure_code_profiles": { 2024-05-08T18:31:19.770 INFO:teuthology.orchestra.run.smithi097.stdout: "default": { 2024-05-08T18:31:19.770 INFO:teuthology.orchestra.run.smithi097.stdout: "crush-failure-domain": "osd", 2024-05-08T18:31:19.770 INFO:teuthology.orchestra.run.smithi097.stdout: "k": "2", 2024-05-08T18:31:19.770 INFO:teuthology.orchestra.run.smithi097.stdout: "m": "1", 2024-05-08T18:31:19.770 INFO:teuthology.orchestra.run.smithi097.stdout: "plugin": "jerasure", 2024-05-08T18:31:19.770 INFO:teuthology.orchestra.run.smithi097.stdout: "technique": "reed_sol_van" 2024-05-08T18:31:19.770 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.770 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:19.770 INFO:teuthology.orchestra.run.smithi097.stdout: "removed_snaps_queue": [], 2024-05-08T18:31:19.770 INFO:teuthology.orchestra.run.smithi097.stdout: "new_removed_snaps": [], 2024-05-08T18:31:19.771 INFO:teuthology.orchestra.run.smithi097.stdout: "new_purged_snaps": [], 2024-05-08T18:31:19.771 INFO:teuthology.orchestra.run.smithi097.stdout: "crush_node_flags": {}, 2024-05-08T18:31:19.771 INFO:teuthology.orchestra.run.smithi097.stdout: "device_class_flags": {}, 2024-05-08T18:31:19.771 INFO:teuthology.orchestra.run.smithi097.stdout: "stretch_mode": { 2024-05-08T18:31:19.771 INFO:teuthology.orchestra.run.smithi097.stdout: "stretch_mode_enabled": false, 2024-05-08T18:31:19.771 INFO:teuthology.orchestra.run.smithi097.stdout: "stretch_bucket_count": 0, 2024-05-08T18:31:19.771 INFO:teuthology.orchestra.run.smithi097.stdout: "degraded_stretch_mode": 0, 2024-05-08T18:31:19.771 INFO:teuthology.orchestra.run.smithi097.stdout: "recovering_stretch_mode": 0, 2024-05-08T18:31:19.771 INFO:teuthology.orchestra.run.smithi097.stdout: "stretch_mode_bucket": 0 2024-05-08T18:31:19.771 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:19.771 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:19.772 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:31:19.654+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:31:19.773 INFO:tasks.thrashosds.thrasher:j is {'epoch': 73, 'fsid': 'f135278e-f589-4ad6-a830-fa767ff99171', 'created': '2024-05-08T18:29:14.813384+0000', 'modified': '2024-05-08T18:31:18.771678+0000', 'last_up_change': '2024-05-08T18:29:26.091102+0000', 'last_in_change': '2024-05-08T18:29:17.082151+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 8, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T18:29:25.443461+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-05-08T18:29:32.943859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'default.rgw.buckets.data', 'create_time': '2024-05-08T18:29:39.147224+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'default.rgw.buckets.index', 'create_time': '2024-05-08T18:29:40.891936+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': '.rgw.root', 'create_time': '2024-05-08T18:29:42.925519+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'default.rgw.log', 'create_time': '2024-05-08T18:29:44.727411+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'default.rgw.control', 'create_time': '2024-05-08T18:29:46.621438+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'default.rgw.meta', 'create_time': '2024-05-08T18:29:48.780230+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': 'f135796c-f80c-43a8-889d-e0927bcc3d0a', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 31, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.97:6800', 'nonce': 2064534873}, {'type': 'v1', 'addr': '172.21.15.97:6801', 'nonce': 2064534873}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.97:6802', 'nonce': 2064534873}, {'type': 'v1', 'addr': '172.21.15.97:6803', 'nonce': 2064534873}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.97:6806', 'nonce': 2064534873}, {'type': 'v1', 'addr': '172.21.15.97:6807', 'nonce': 2064534873}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.97:6804', 'nonce': 2064534873}, {'type': 'v1', 'addr': '172.21.15.97:6805', 'nonce': 2064534873}]}, 'public_addr': '172.21.15.97:6801/2064534873', 'cluster_addr': '172.21.15.97:6803/2064534873', 'heartbeat_back_addr': '172.21.15.97:6807/2064534873', 'heartbeat_front_addr': '172.21.15.97:6805/2064534873', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'b91d895a-2b40-45c1-b355-52dba17032cb', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 46, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.97:6813', 'nonce': 34364184}, {'type': 'v1', 'addr': '172.21.15.97:6815', 'nonce': 34364184}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.97:6818', 'nonce': 34364184}, {'type': 'v1', 'addr': '172.21.15.97:6819', 'nonce': 34364184}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.97:6822', 'nonce': 34364184}, {'type': 'v1', 'addr': '172.21.15.97:6823', 'nonce': 34364184}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.97:6820', 'nonce': 34364184}, {'type': 'v1', 'addr': '172.21.15.97:6821', 'nonce': 34364184}]}, 'public_addr': '172.21.15.97:6815/34364184', 'cluster_addr': '172.21.15.97:6819/34364184', 'heartbeat_back_addr': '172.21.15.97:6823/34364184', 'heartbeat_front_addr': '172.21.15.97:6821/34364184', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '35f12106-8d9a-4dcb-a8bc-38e08c81bd5e', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 46, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.97:6808', 'nonce': 3004545111}, {'type': 'v1', 'addr': '172.21.15.97:6809', 'nonce': 3004545111}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.97:6810', 'nonce': 3004545111}, {'type': 'v1', 'addr': '172.21.15.97:6811', 'nonce': 3004545111}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.97:6816', 'nonce': 3004545111}, {'type': 'v1', 'addr': '172.21.15.97:6817', 'nonce': 3004545111}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.97:6812', 'nonce': 3004545111}, {'type': 'v1', 'addr': '172.21.15.97:6814', 'nonce': 3004545111}]}, 'public_addr': '172.21.15.97:6809/3004545111', 'cluster_addr': '172.21.15.97:6811/3004545111', 'heartbeat_back_addr': '172.21.15.97:6817/3004545111', 'heartbeat_front_addr': '172.21.15.97:6814/3004545111', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': 'cd78d341-ec40-457e-a713-555b03bc9f16', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 46, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.97:6824', 'nonce': 1855786157}, {'type': 'v1', 'addr': '172.21.15.97:6825', 'nonce': 1855786157}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.97:6826', 'nonce': 1855786157}, {'type': 'v1', 'addr': '172.21.15.97:6827', 'nonce': 1855786157}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.97:6830', 'nonce': 1855786157}, {'type': 'v1', 'addr': '172.21.15.97:6831', 'nonce': 1855786157}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.97:6828', 'nonce': 1855786157}, {'type': 'v1', 'addr': '172.21.15.97:6829', 'nonce': 1855786157}]}, 'public_addr': '172.21.15.97:6825/1855786157', 'cluster_addr': '172.21.15.97:6827/1855786157', 'heartbeat_back_addr': '172.21.15.97:6831/1855786157', 'heartbeat_front_addr': '172.21.15.97:6829/1855786157', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '469d890e-5e0c-41cd-ac5b-ef987b70abd0', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 31, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6808', 'nonce': 1246653692}, {'type': 'v1', 'addr': '172.21.15.151:6810', 'nonce': 1246653692}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6812', 'nonce': 1246653692}, {'type': 'v1', 'addr': '172.21.15.151:6814', 'nonce': 1246653692}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6820', 'nonce': 1246653692}, {'type': 'v1', 'addr': '172.21.15.151:6822', 'nonce': 1246653692}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6816', 'nonce': 1246653692}, {'type': 'v1', 'addr': '172.21.15.151:6818', 'nonce': 1246653692}]}, 'public_addr': '172.21.15.151:6810/1246653692', 'cluster_addr': '172.21.15.151:6814/1246653692', 'heartbeat_back_addr': '172.21.15.151:6822/1246653692', 'heartbeat_front_addr': '172.21.15.151:6818/1246653692', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': 'dcb25c08-802c-4140-a3d2-929960319860', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 31, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6809', 'nonce': 4257184226}, {'type': 'v1', 'addr': '172.21.15.151:6811', 'nonce': 4257184226}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6813', 'nonce': 4257184226}, {'type': 'v1', 'addr': '172.21.15.151:6815', 'nonce': 4257184226}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6821', 'nonce': 4257184226}, {'type': 'v1', 'addr': '172.21.15.151:6823', 'nonce': 4257184226}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6817', 'nonce': 4257184226}, {'type': 'v1', 'addr': '172.21.15.151:6819', 'nonce': 4257184226}]}, 'public_addr': '172.21.15.151:6811/4257184226', 'cluster_addr': '172.21.15.151:6815/4257184226', 'heartbeat_back_addr': '172.21.15.151:6823/4257184226', 'heartbeat_front_addr': '172.21.15.151:6819/4257184226', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '598ab572-7049-4600-9e91-1792360421d2', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 31, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6800', 'nonce': 974202886}, {'type': 'v1', 'addr': '172.21.15.151:6801', 'nonce': 974202886}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6802', 'nonce': 974202886}, {'type': 'v1', 'addr': '172.21.15.151:6803', 'nonce': 974202886}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6806', 'nonce': 974202886}, {'type': 'v1', 'addr': '172.21.15.151:6807', 'nonce': 974202886}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6804', 'nonce': 974202886}, {'type': 'v1', 'addr': '172.21.15.151:6805', 'nonce': 974202886}]}, 'public_addr': '172.21.15.151:6801/974202886', 'cluster_addr': '172.21.15.151:6803/974202886', 'heartbeat_back_addr': '172.21.15.151:6807/974202886', 'heartbeat_front_addr': '172.21.15.151:6805/974202886', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': 'c21805e0-4945-4efe-8e65-68bb92d30b69', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 15, 'up_thru': 31, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6824', 'nonce': 2584927373}, {'type': 'v1', 'addr': '172.21.15.151:6825', 'nonce': 2584927373}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6826', 'nonce': 2584927373}, {'type': 'v1', 'addr': '172.21.15.151:6827', 'nonce': 2584927373}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6830', 'nonce': 2584927373}, {'type': 'v1', 'addr': '172.21.15.151:6831', 'nonce': 2584927373}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6828', 'nonce': 2584927373}, {'type': 'v1', 'addr': '172.21.15.151:6829', 'nonce': 2584927373}]}, 'public_addr': '172.21.15.151:6825/2584927373', 'cluster_addr': '172.21.15.151:6827/2584927373', 'heartbeat_back_addr': '172.21.15.151:6831/2584927373', 'heartbeat_front_addr': '172.21.15.151:6829/2584927373', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-05-08T18:29:22.299407+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-05-08T18:29:22.487701+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-05-08T18:29:22.371789+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-05-08T18:29:22.160484+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-05-08T18:29:22.674077+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-05-08T18:29:22.713456+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-05-08T18:29:22.587563+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-05-08T18:29:22.751830+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [{'pgid': '3.2', 'mappings': [{'from': 5, 'to': 1}]}, {'pgid': '3.5', 'mappings': [{'from': 5, 'to': 2}]}, {'pgid': '3.25', 'mappings': [{'from': 3, 'to': 2}]}, {'pgid': '3.39', 'mappings': [{'from': 7, 'to': 2}]}, {'pgid': '4.0', 'mappings': [{'from': 3, 'to': 2}]}, {'pgid': '4.10', 'mappings': [{'from': 1, 'to': 5}]}], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-05-08T18:31:19.774 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T18:31:19.774 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2024-05-08T18:31:19.775 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:31:19.793 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:19.793 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:19.793 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:31:19.790+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:31:19.814 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-08T18:31:19.877 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:31:19.874+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:31:19.978 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:31:19.974+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:31:20.046 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:20.046 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:20.065 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-08T18:31:20.107 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:31:20.106+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:31:20.179 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:31:20.178+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:31:20.275 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:20.275 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:20.280 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:31:20.278+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:31:20.294 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-08T18:31:20.316 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-05-08T18:31:20.324 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2024-05-08T18:31:20.343 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":123,"stamp":"2024-05-08T18:31:19.438101+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595683,"num_objects":195,"num_object_clones":0,"num_object_copies":390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":195,"num_whiteouts":0,"num_read":759,"num_read_kb":507,"num_write":530,"num_write_kb":1670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":482,"ondisk_log_size":482,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":232176,"kb_used_data":7660,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754742544,"statfs":{"total":773094113280,"available":772856365056,"internally_reserved":0,"allocated":7843840,"data_stored":4661542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":229756465},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000883"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":105,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.262030+0000","last_change":"2024-05-08T18:29:40.574221+0000","last_active":"2024-05-08T18:31:16.262030+0000","last_peered":"2024-05-08T18:31:16.262030+0000","last_clean":"2024-05-08T18:31:16.262030+0000","last_became_active":"2024-05-08T18:29:40.573543+0000","last_became_peered":"2024-05-08T18:29:40.573543+0000","last_unstale":"2024-05-08T18:31:16.262030+0000","last_undegraded":"2024-05-08T18:31:16.262030+0000","last_fullsized":"2024-05-08T18:31:16.262030+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:57.223609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.631643+0000","last_change":"2024-05-08T18:29:42.563773+0000","last_active":"2024-05-08T18:31:15.631643+0000","last_peered":"2024-05-08T18:31:15.631643+0000","last_clean":"2024-05-08T18:31:15.631643+0000","last_became_active":"2024-05-08T18:29:42.561201+0000","last_became_peered":"2024-05-08T18:29:42.561201+0000","last_unstale":"2024-05-08T18:31:15.631643+0000","last_undegraded":"2024-05-08T18:31:15.631643+0000","last_fullsized":"2024-05-08T18:31:15.631643+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:55.055481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":102,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.723479+0000","last_change":"2024-05-08T18:29:40.549299+0000","last_active":"2024-05-08T18:31:13.723479+0000","last_peered":"2024-05-08T18:31:13.723479+0000","last_clean":"2024-05-08T18:31:13.723479+0000","last_became_active":"2024-05-08T18:29:40.548930+0000","last_became_peered":"2024-05-08T18:29:40.548930+0000","last_unstale":"2024-05-08T18:31:13.723479+0000","last_undegraded":"2024-05-08T18:31:13.723479+0000","last_fullsized":"2024-05-08T18:31:13.723479+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:06:36.198647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":101,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.261259+0000","last_change":"2024-05-08T18:29:42.572074+0000","last_active":"2024-05-08T18:31:16.261259+0000","last_peered":"2024-05-08T18:31:16.261259+0000","last_clean":"2024-05-08T18:31:16.261259+0000","last_became_active":"2024-05-08T18:29:42.571344+0000","last_became_peered":"2024-05-08T18:29:42.571344+0000","last_unstale":"2024-05-08T18:31:16.261259+0000","last_undegraded":"2024-05-08T18:31:16.261259+0000","last_fullsized":"2024-05-08T18:31:16.261259+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:36.890277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":102,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.723035+0000","last_change":"2024-05-08T18:29:40.539048+0000","last_active":"2024-05-08T18:31:13.723035+0000","last_peered":"2024-05-08T18:31:13.723035+0000","last_clean":"2024-05-08T18:31:13.723035+0000","last_became_active":"2024-05-08T18:29:40.538458+0000","last_became_peered":"2024-05-08T18:29:40.538458+0000","last_unstale":"2024-05-08T18:31:13.723035+0000","last_undegraded":"2024-05-08T18:31:13.723035+0000","last_fullsized":"2024-05-08T18:31:13.723035+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:36:37.796095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":102,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.743519+0000","last_change":"2024-05-08T18:29:42.569718+0000","last_active":"2024-05-08T18:31:15.743519+0000","last_peered":"2024-05-08T18:31:15.743519+0000","last_clean":"2024-05-08T18:31:15.743519+0000","last_became_active":"2024-05-08T18:29:42.569026+0000","last_became_peered":"2024-05-08T18:29:42.569026+0000","last_unstale":"2024-05-08T18:31:15.743519+0000","last_undegraded":"2024-05-08T18:31:15.743519+0000","last_fullsized":"2024-05-08T18:31:15.743519+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:42.045615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.632513+0000","last_change":"2024-05-08T18:29:40.557700+0000","last_active":"2024-05-08T18:31:15.632513+0000","last_peered":"2024-05-08T18:31:15.632513+0000","last_clean":"2024-05-08T18:31:15.632513+0000","last_became_active":"2024-05-08T18:29:40.556884+0000","last_became_peered":"2024-05-08T18:29:40.556884+0000","last_unstale":"2024-05-08T18:31:15.632513+0000","last_undegraded":"2024-05-08T18:31:15.632513+0000","last_fullsized":"2024-05-08T18:31:15.632513+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:21:38.354933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":98,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.722036+0000","last_change":"2024-05-08T18:29:42.566448+0000","last_active":"2024-05-08T18:31:13.722036+0000","last_peered":"2024-05-08T18:31:13.722036+0000","last_clean":"2024-05-08T18:31:13.722036+0000","last_became_active":"2024-05-08T18:29:42.566058+0000","last_became_peered":"2024-05-08T18:29:42.566058+0000","last_unstale":"2024-05-08T18:31:13.722036+0000","last_undegraded":"2024-05-08T18:31:13.722036+0000","last_fullsized":"2024-05-08T18:31:13.722036+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:53:03.097704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":105,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.262209+0000","last_change":"2024-05-08T18:29:40.571195+0000","last_active":"2024-05-08T18:31:16.262209+0000","last_peered":"2024-05-08T18:31:16.262209+0000","last_clean":"2024-05-08T18:31:16.262209+0000","last_became_active":"2024-05-08T18:29:40.570467+0000","last_became_peered":"2024-05-08T18:29:40.570467+0000","last_unstale":"2024-05-08T18:31:16.262209+0000","last_undegraded":"2024-05-08T18:31:16.262209+0000","last_fullsized":"2024-05-08T18:31:16.262209+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:39.986094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.737238+0000","last_change":"2024-05-08T18:29:42.566506+0000","last_active":"2024-05-08T18:31:14.737238+0000","last_peered":"2024-05-08T18:31:14.737238+0000","last_clean":"2024-05-08T18:31:14.737238+0000","last_became_active":"2024-05-08T18:29:42.565740+0000","last_became_peered":"2024-05-08T18:29:42.565740+0000","last_unstale":"2024-05-08T18:31:14.737238+0000","last_undegraded":"2024-05-08T18:31:14.737238+0000","last_fullsized":"2024-05-08T18:31:14.737238+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:58.320701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.631711+0000","last_change":"2024-05-08T18:29:40.538314+0000","last_active":"2024-05-08T18:31:15.631711+0000","last_peered":"2024-05-08T18:31:15.631711+0000","last_clean":"2024-05-08T18:31:15.631711+0000","last_became_active":"2024-05-08T18:29:40.537458+0000","last_became_peered":"2024-05-08T18:29:40.537458+0000","last_unstale":"2024-05-08T18:31:15.631711+0000","last_undegraded":"2024-05-08T18:31:15.631711+0000","last_fullsized":"2024-05-08T18:31:15.631711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:56.300986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":102,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.743024+0000","last_change":"2024-05-08T18:29:42.570054+0000","last_active":"2024-05-08T18:31:15.743024+0000","last_peered":"2024-05-08T18:31:15.743024+0000","last_clean":"2024-05-08T18:31:15.743024+0000","last_became_active":"2024-05-08T18:29:42.569255+0000","last_became_peered":"2024-05-08T18:29:42.569255+0000","last_unstale":"2024-05-08T18:31:15.743024+0000","last_undegraded":"2024-05-08T18:31:15.743024+0000","last_fullsized":"2024-05-08T18:31:15.743024+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:11:01.702482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":53,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.737972+0000","last_change":"2024-05-08T18:30:21.210397+0000","last_active":"2024-05-08T18:31:14.737972+0000","last_peered":"2024-05-08T18:31:14.737972+0000","last_clean":"2024-05-08T18:31:14.737972+0000","last_became_active":"2024-05-08T18:30:21.210052+0000","last_became_peered":"2024-05-08T18:30:21.210052+0000","last_unstale":"2024-05-08T18:31:14.737972+0000","last_undegraded":"2024-05-08T18:31:14.737972+0000","last_fullsized":"2024-05-08T18:31:14.737972+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:51:05.355593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.632484+0000","last_change":"2024-05-08T18:29:42.562084+0000","last_active":"2024-05-08T18:31:15.632484+0000","last_peered":"2024-05-08T18:31:15.632484+0000","last_clean":"2024-05-08T18:31:15.632484+0000","last_became_active":"2024-05-08T18:29:42.560699+0000","last_became_peered":"2024-05-08T18:29:42.560699+0000","last_unstale":"2024-05-08T18:31:15.632484+0000","last_undegraded":"2024-05-08T18:31:15.632484+0000","last_fullsized":"2024-05-08T18:31:15.632484+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:09.787597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.745083+0000","last_change":"2024-05-08T18:29:40.564339+0000","last_active":"2024-05-08T18:31:14.745083+0000","last_peered":"2024-05-08T18:31:14.745083+0000","last_clean":"2024-05-08T18:31:14.745083+0000","last_became_active":"2024-05-08T18:29:40.564038+0000","last_became_peered":"2024-05-08T18:29:40.564038+0000","last_unstale":"2024-05-08T18:31:14.745083+0000","last_undegraded":"2024-05-08T18:31:14.745083+0000","last_fullsized":"2024-05-08T18:31:14.745083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:40:23.287885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.740657+0000","last_change":"2024-05-08T18:29:42.570253+0000","last_active":"2024-05-08T18:31:14.740657+0000","last_peered":"2024-05-08T18:31:14.740657+0000","last_clean":"2024-05-08T18:31:14.740657+0000","last_became_active":"2024-05-08T18:29:42.569917+0000","last_became_peered":"2024-05-08T18:29:42.569917+0000","last_unstale":"2024-05-08T18:31:14.740657+0000","last_undegraded":"2024-05-08T18:31:14.740657+0000","last_fullsized":"2024-05-08T18:31:14.740657+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:14:45.575219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":102,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.742047+0000","last_change":"2024-05-08T18:29:42.568116+0000","last_active":"2024-05-08T18:31:15.742047+0000","last_peered":"2024-05-08T18:31:15.742047+0000","last_clean":"2024-05-08T18:31:15.742047+0000","last_became_active":"2024-05-08T18:29:42.567399+0000","last_became_peered":"2024-05-08T18:29:42.567399+0000","last_unstale":"2024-05-08T18:31:15.742047+0000","last_undegraded":"2024-05-08T18:31:15.742047+0000","last_fullsized":"2024-05-08T18:31:15.742047+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:35.037465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":105,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.262175+0000","last_change":"2024-05-08T18:29:40.571982+0000","last_active":"2024-05-08T18:31:16.262175+0000","last_peered":"2024-05-08T18:31:16.262175+0000","last_clean":"2024-05-08T18:31:16.262175+0000","last_became_active":"2024-05-08T18:29:40.570600+0000","last_became_peered":"2024-05-08T18:29:40.570600+0000","last_unstale":"2024-05-08T18:31:16.262175+0000","last_undegraded":"2024-05-08T18:31:16.262175+0000","last_fullsized":"2024-05-08T18:31:16.262175+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:54:14.520118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":101,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.261503+0000","last_change":"2024-05-08T18:29:42.578449+0000","last_active":"2024-05-08T18:31:16.261503+0000","last_peered":"2024-05-08T18:31:16.261503+0000","last_clean":"2024-05-08T18:31:16.261503+0000","last_became_active":"2024-05-08T18:29:42.577789+0000","last_became_peered":"2024-05-08T18:29:42.577789+0000","last_unstale":"2024-05-08T18:31:16.261503+0000","last_undegraded":"2024-05-08T18:31:16.261503+0000","last_fullsized":"2024-05-08T18:31:16.261503+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:09.787597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.737655+0000","last_change":"2024-05-08T18:29:40.570618+0000","last_active":"2024-05-08T18:31:14.737655+0000","last_peered":"2024-05-08T18:31:14.737655+0000","last_clean":"2024-05-08T18:31:14.737655+0000","last_became_active":"2024-05-08T18:29:40.569519+0000","last_became_peered":"2024-05-08T18:29:40.569519+0000","last_unstale":"2024-05-08T18:31:14.737655+0000","last_undegraded":"2024-05-08T18:31:14.737655+0000","last_fullsized":"2024-05-08T18:31:14.737655+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:09:42.581976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.632125+0000","last_change":"2024-05-08T18:29:42.563056+0000","last_active":"2024-05-08T18:31:15.632125+0000","last_peered":"2024-05-08T18:31:15.632125+0000","last_clean":"2024-05-08T18:31:15.632125+0000","last_became_active":"2024-05-08T18:29:42.562296+0000","last_became_peered":"2024-05-08T18:29:42.562296+0000","last_unstale":"2024-05-08T18:31:15.632125+0000","last_undegraded":"2024-05-08T18:31:15.632125+0000","last_fullsized":"2024-05-08T18:31:15.632125+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:36.890277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.738207+0000","last_change":"2024-05-08T18:29:40.564353+0000","last_active":"2024-05-08T18:31:14.738207+0000","last_peered":"2024-05-08T18:31:14.738207+0000","last_clean":"2024-05-08T18:31:14.738207+0000","last_became_active":"2024-05-08T18:29:40.563516+0000","last_became_peered":"2024-05-08T18:29:40.563516+0000","last_unstale":"2024-05-08T18:31:14.738207+0000","last_undegraded":"2024-05-08T18:31:14.738207+0000","last_fullsized":"2024-05-08T18:31:14.738207+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:06:36.198647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.739805+0000","last_change":"2024-05-08T18:29:42.567006+0000","last_active":"2024-05-08T18:31:14.739805+0000","last_peered":"2024-05-08T18:31:14.739805+0000","last_clean":"2024-05-08T18:31:14.739805+0000","last_became_active":"2024-05-08T18:29:42.566256+0000","last_became_peered":"2024-05-08T18:29:42.566256+0000","last_unstale":"2024-05-08T18:31:14.739805+0000","last_undegraded":"2024-05-08T18:31:14.739805+0000","last_fullsized":"2024-05-08T18:31:14.739805+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:09:44.601690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":106,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.742388+0000","last_change":"2024-05-08T18:29:40.573212+0000","last_active":"2024-05-08T18:31:15.742388+0000","last_peered":"2024-05-08T18:31:15.742388+0000","last_clean":"2024-05-08T18:31:15.742388+0000","last_became_active":"2024-05-08T18:29:40.572250+0000","last_became_peered":"2024-05-08T18:29:40.572250+0000","last_unstale":"2024-05-08T18:31:15.742388+0000","last_undegraded":"2024-05-08T18:31:15.742388+0000","last_fullsized":"2024-05-08T18:31:15.742388+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:25:01.595224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.739542+0000","last_change":"2024-05-08T18:29:42.570847+0000","last_active":"2024-05-08T18:31:14.739542+0000","last_peered":"2024-05-08T18:31:14.739542+0000","last_clean":"2024-05-08T18:31:14.739542+0000","last_became_active":"2024-05-08T18:29:42.570435+0000","last_became_peered":"2024-05-08T18:29:42.570435+0000","last_unstale":"2024-05-08T18:31:14.739542+0000","last_undegraded":"2024-05-08T18:31:14.739542+0000","last_fullsized":"2024-05-08T18:31:14.739542+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:21:40.374647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.745834+0000","last_change":"2024-05-08T18:29:40.566815+0000","last_active":"2024-05-08T18:31:14.745834+0000","last_peered":"2024-05-08T18:31:14.745834+0000","last_clean":"2024-05-08T18:31:14.745834+0000","last_became_active":"2024-05-08T18:29:40.566531+0000","last_became_peered":"2024-05-08T18:29:40.566531+0000","last_unstale":"2024-05-08T18:31:14.745834+0000","last_undegraded":"2024-05-08T18:31:14.745834+0000","last_fullsized":"2024-05-08T18:31:14.745834+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:52.462279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":102,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.743255+0000","last_change":"2024-05-08T18:29:42.554846+0000","last_active":"2024-05-08T18:31:15.743255+0000","last_peered":"2024-05-08T18:31:15.743255+0000","last_clean":"2024-05-08T18:31:15.743255+0000","last_became_active":"2024-05-08T18:29:42.554115+0000","last_became_peered":"2024-05-08T18:29:42.554115+0000","last_unstale":"2024-05-08T18:31:15.743255+0000","last_undegraded":"2024-05-08T18:31:15.743255+0000","last_fullsized":"2024-05-08T18:31:15.743255+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:22:14.793035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":102,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.721533+0000","last_change":"2024-05-08T18:29:40.547776+0000","last_active":"2024-05-08T18:31:13.721533+0000","last_peered":"2024-05-08T18:31:13.721533+0000","last_clean":"2024-05-08T18:31:13.721533+0000","last_became_active":"2024-05-08T18:29:40.547384+0000","last_became_peered":"2024-05-08T18:29:40.547384+0000","last_unstale":"2024-05-08T18:31:13.721533+0000","last_undegraded":"2024-05-08T18:31:13.721533+0000","last_fullsized":"2024-05-08T18:31:13.721533+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:14:26.628603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":86,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.741568+0000","last_change":"2024-05-08T18:29:50.685390+0000","last_active":"2024-05-08T18:31:15.741568+0000","last_peered":"2024-05-08T18:31:15.741568+0000","last_clean":"2024-05-08T18:31:15.741568+0000","last_became_active":"2024-05-08T18:29:50.684644+0000","last_became_peered":"2024-05-08T18:29:50.684644+0000","last_unstale":"2024-05-08T18:31:15.741568+0000","last_undegraded":"2024-05-08T18:31:15.741568+0000","last_fullsized":"2024-05-08T18:31:15.741568+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:10:38.951662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.746330+0000","last_change":"2024-05-08T18:29:42.573805+0000","last_active":"2024-05-08T18:31:14.746330+0000","last_peered":"2024-05-08T18:31:14.746330+0000","last_clean":"2024-05-08T18:31:14.746330+0000","last_became_active":"2024-05-08T18:29:42.573296+0000","last_became_peered":"2024-05-08T18:29:42.573296+0000","last_unstale":"2024-05-08T18:31:14.746330+0000","last_undegraded":"2024-05-08T18:31:14.746330+0000","last_fullsized":"2024-05-08T18:31:14.746330+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:21.935293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":105,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.262645+0000","last_change":"2024-05-08T18:29:40.570733+0000","last_active":"2024-05-08T18:31:16.262645+0000","last_peered":"2024-05-08T18:31:16.262645+0000","last_clean":"2024-05-08T18:31:16.262645+0000","last_became_active":"2024-05-08T18:29:40.569711+0000","last_became_peered":"2024-05-08T18:29:40.569711+0000","last_unstale":"2024-05-08T18:31:16.262645+0000","last_undegraded":"2024-05-08T18:31:16.262645+0000","last_fullsized":"2024-05-08T18:31:16.262645+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:18:08.784274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":95,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.632525+0000","last_change":"2024-05-08T18:29:44.594185+0000","last_active":"2024-05-08T18:31:15.632525+0000","last_peered":"2024-05-08T18:31:15.632525+0000","last_clean":"2024-05-08T18:31:15.632525+0000","last_became_active":"2024-05-08T18:29:44.593442+0000","last_became_peered":"2024-05-08T18:29:44.593442+0000","last_unstale":"2024-05-08T18:31:15.632525+0000","last_undegraded":"2024-05-08T18:31:15.632525+0000","last_fullsized":"2024-05-08T18:31:15.632525+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:52:25.736491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"33'9","reported_seq":106,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.723194+0000","last_change":"2024-05-08T18:29:46.594652+0000","last_active":"2024-05-08T18:31:13.723194+0000","last_peered":"2024-05-08T18:31:13.723194+0000","last_clean":"2024-05-08T18:31:13.723194+0000","last_became_active":"2024-05-08T18:29:46.593656+0000","last_became_peered":"2024-05-08T18:29:46.593656+0000","last_unstale":"2024-05-08T18:31:13.723194+0000","last_undegraded":"2024-05-08T18:31:13.723194+0000","last_fullsized":"2024-05-08T18:31:13.723194+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:50:27.608888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":89,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.261759+0000","last_change":"2024-05-08T18:29:48.639834+0000","last_active":"2024-05-08T18:31:16.261759+0000","last_peered":"2024-05-08T18:31:16.261759+0000","last_clean":"2024-05-08T18:31:16.261759+0000","last_became_active":"2024-05-08T18:29:48.639122+0000","last_became_peered":"2024-05-08T18:29:48.639122+0000","last_unstale":"2024-05-08T18:31:16.261759+0000","last_undegraded":"2024-05-08T18:31:16.261759+0000","last_fullsized":"2024-05-08T18:31:16.261759+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:14:22.304773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":83,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.631156+0000","last_change":"2024-05-08T18:29:50.672303+0000","last_active":"2024-05-08T18:31:15.631156+0000","last_peered":"2024-05-08T18:31:15.631156+0000","last_clean":"2024-05-08T18:31:15.631156+0000","last_became_active":"2024-05-08T18:29:50.671513+0000","last_became_peered":"2024-05-08T18:29:50.671513+0000","last_unstale":"2024-05-08T18:31:15.631156+0000","last_undegraded":"2024-05-08T18:31:15.631156+0000","last_fullsized":"2024-05-08T18:31:15.631156+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:12:05.780786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.633369+0000","last_change":"2024-05-08T18:29:42.565462+0000","last_active":"2024-05-08T18:31:15.633369+0000","last_peered":"2024-05-08T18:31:15.633369+0000","last_clean":"2024-05-08T18:31:15.633369+0000","last_became_active":"2024-05-08T18:29:42.564741+0000","last_became_peered":"2024-05-08T18:29:42.564741+0000","last_unstale":"2024-05-08T18:31:15.633369+0000","last_undegraded":"2024-05-08T18:31:15.633369+0000","last_fullsized":"2024-05-08T18:31:15.633369+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:25:56.129785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":102,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.721619+0000","last_change":"2024-05-08T18:29:40.564796+0000","last_active":"2024-05-08T18:31:13.721619+0000","last_peered":"2024-05-08T18:31:13.721619+0000","last_clean":"2024-05-08T18:31:13.721619+0000","last_became_active":"2024-05-08T18:29:40.564401+0000","last_became_peered":"2024-05-08T18:29:40.564401+0000","last_unstale":"2024-05-08T18:31:13.721619+0000","last_undegraded":"2024-05-08T18:31:13.721619+0000","last_fullsized":"2024-05-08T18:31:13.721619+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:19:11.492397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":96,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.746203+0000","last_change":"2024-05-08T18:29:44.587689+0000","last_active":"2024-05-08T18:31:14.746203+0000","last_peered":"2024-05-08T18:31:14.746203+0000","last_clean":"2024-05-08T18:31:14.746203+0000","last_became_active":"2024-05-08T18:29:44.586975+0000","last_became_peered":"2024-05-08T18:29:44.586975+0000","last_unstale":"2024-05-08T18:31:14.746203+0000","last_undegraded":"2024-05-08T18:31:14.746203+0000","last_fullsized":"2024-05-08T18:31:14.746203+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:04:49.020450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"33'6","reported_seq":103,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.743522+0000","last_change":"2024-05-08T18:29:46.600906+0000","last_active":"2024-05-08T18:31:15.743522+0000","last_peered":"2024-05-08T18:31:15.743522+0000","last_clean":"2024-05-08T18:31:15.743522+0000","last_became_active":"2024-05-08T18:29:46.599894+0000","last_became_peered":"2024-05-08T18:29:46.599894+0000","last_unstale":"2024-05-08T18:31:15.743522+0000","last_undegraded":"2024-05-08T18:31:15.743522+0000","last_fullsized":"2024-05-08T18:31:15.743522+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:24:13.568294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":90,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.743076+0000","last_change":"2024-05-08T18:29:48.614324+0000","last_active":"2024-05-08T18:31:15.743076+0000","last_peered":"2024-05-08T18:31:15.743076+0000","last_clean":"2024-05-08T18:31:15.743076+0000","last_became_active":"2024-05-08T18:29:48.613591+0000","last_became_peered":"2024-05-08T18:29:48.613591+0000","last_unstale":"2024-05-08T18:31:15.743076+0000","last_undegraded":"2024-05-08T18:31:15.743076+0000","last_fullsized":"2024-05-08T18:31:15.743076+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:47:54.034851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":82,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.721301+0000","last_change":"2024-05-08T18:29:50.684773+0000","last_active":"2024-05-08T18:31:13.721301+0000","last_peered":"2024-05-08T18:31:13.721301+0000","last_clean":"2024-05-08T18:31:13.721301+0000","last_became_active":"2024-05-08T18:29:50.683931+0000","last_became_peered":"2024-05-08T18:29:50.683931+0000","last_unstale":"2024-05-08T18:31:13.721301+0000","last_undegraded":"2024-05-08T18:31:13.721301+0000","last_fullsized":"2024-05-08T18:31:13.721301+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:17:10.582636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":98,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.725942+0000","last_change":"2024-05-08T18:29:42.574437+0000","last_active":"2024-05-08T18:31:13.725942+0000","last_peered":"2024-05-08T18:31:13.725942+0000","last_clean":"2024-05-08T18:31:13.725942+0000","last_became_active":"2024-05-08T18:29:42.574146+0000","last_became_peered":"2024-05-08T18:29:42.574146+0000","last_unstale":"2024-05-08T18:31:13.725942+0000","last_undegraded":"2024-05-08T18:31:13.725942+0000","last_fullsized":"2024-05-08T18:31:13.725942+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:55:30.468069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":105,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.261751+0000","last_change":"2024-05-08T18:29:40.559677+0000","last_active":"2024-05-08T18:31:16.261751+0000","last_peered":"2024-05-08T18:31:16.261751+0000","last_clean":"2024-05-08T18:31:16.261751+0000","last_became_active":"2024-05-08T18:29:40.558819+0000","last_became_peered":"2024-05-08T18:29:40.558819+0000","last_unstale":"2024-05-08T18:31:16.261751+0000","last_undegraded":"2024-05-08T18:31:16.261751+0000","last_fullsized":"2024-05-08T18:31:16.261751+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:28.426657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":96,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.749101+0000","last_change":"2024-05-08T18:29:44.596801+0000","last_active":"2024-05-08T18:31:14.749101+0000","last_peered":"2024-05-08T18:31:14.749101+0000","last_clean":"2024-05-08T18:31:14.749101+0000","last_became_active":"2024-05-08T18:29:44.596111+0000","last_became_peered":"2024-05-08T18:29:44.596111+0000","last_unstale":"2024-05-08T18:31:14.749101+0000","last_undegraded":"2024-05-08T18:31:14.749101+0000","last_fullsized":"2024-05-08T18:31:14.749101+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:04.423266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"33'10","reported_seq":106,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.736543+0000","last_change":"2024-05-08T18:29:46.608330+0000","last_active":"2024-05-08T18:31:14.736543+0000","last_peered":"2024-05-08T18:31:14.736543+0000","last_clean":"2024-05-08T18:31:14.736543+0000","last_became_active":"2024-05-08T18:29:46.607580+0000","last_became_peered":"2024-05-08T18:29:46.607580+0000","last_unstale":"2024-05-08T18:31:14.736543+0000","last_undegraded":"2024-05-08T18:31:14.736543+0000","last_fullsized":"2024-05-08T18:31:14.736543+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:22:18.837103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"30'2","reported_seq":109,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.261493+0000","last_change":"2024-05-08T18:29:48.642718+0000","last_active":"2024-05-08T18:31:16.261493+0000","last_peered":"2024-05-08T18:31:16.261493+0000","last_clean":"2024-05-08T18:31:16.261493+0000","last_became_active":"2024-05-08T18:29:48.641950+0000","last_became_peered":"2024-05-08T18:29:48.641950+0000","last_unstale":"2024-05-08T18:31:16.261493+0000","last_undegraded":"2024-05-08T18:31:16.261493+0000","last_fullsized":"2024-05-08T18:31:16.261493+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:00:11.720096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":86,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.742233+0000","last_change":"2024-05-08T18:29:50.660378+0000","last_active":"2024-05-08T18:31:15.742233+0000","last_peered":"2024-05-08T18:31:15.742233+0000","last_clean":"2024-05-08T18:31:15.742233+0000","last_became_active":"2024-05-08T18:29:50.659649+0000","last_became_peered":"2024-05-08T18:29:50.659649+0000","last_unstale":"2024-05-08T18:31:15.742233+0000","last_undegraded":"2024-05-08T18:31:15.742233+0000","last_fullsized":"2024-05-08T18:31:15.742233+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:34:14.488295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.746142+0000","last_change":"2024-05-08T18:29:42.577267+0000","last_active":"2024-05-08T18:31:14.746142+0000","last_peered":"2024-05-08T18:31:14.746142+0000","last_clean":"2024-05-08T18:31:14.746142+0000","last_became_active":"2024-05-08T18:29:42.576740+0000","last_became_peered":"2024-05-08T18:29:42.576740+0000","last_unstale":"2024-05-08T18:31:14.746142+0000","last_undegraded":"2024-05-08T18:31:14.746142+0000","last_fullsized":"2024-05-08T18:31:14.746142+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:57:14.869860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.736395+0000","last_change":"2024-05-08T18:29:40.547524+0000","last_active":"2024-05-08T18:31:14.736395+0000","last_peered":"2024-05-08T18:31:14.736395+0000","last_clean":"2024-05-08T18:31:14.736395+0000","last_became_active":"2024-05-08T18:29:40.545749+0000","last_became_peered":"2024-05-08T18:29:40.545749+0000","last_unstale":"2024-05-08T18:31:14.736395+0000","last_undegraded":"2024-05-08T18:31:14.736395+0000","last_fullsized":"2024-05-08T18:31:14.736395+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:12:59.146887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":95,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.632246+0000","last_change":"2024-05-08T18:29:44.579839+0000","last_active":"2024-05-08T18:31:15.632246+0000","last_peered":"2024-05-08T18:31:15.632246+0000","last_clean":"2024-05-08T18:31:15.632246+0000","last_became_active":"2024-05-08T18:29:44.578142+0000","last_became_peered":"2024-05-08T18:29:44.578142+0000","last_unstale":"2024-05-08T18:31:15.632246+0000","last_undegraded":"2024-05-08T18:31:15.632246+0000","last_fullsized":"2024-05-08T18:31:15.632246+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:51:09.413191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"33'9","reported_seq":109,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.261959+0000","last_change":"2024-05-08T18:29:46.607288+0000","last_active":"2024-05-08T18:31:16.261959+0000","last_peered":"2024-05-08T18:31:16.261959+0000","last_clean":"2024-05-08T18:31:16.261959+0000","last_became_active":"2024-05-08T18:29:46.605154+0000","last_became_peered":"2024-05-08T18:29:46.605154+0000","last_unstale":"2024-05-08T18:31:16.261959+0000","last_undegraded":"2024-05-08T18:31:16.261959+0000","last_fullsized":"2024-05-08T18:31:16.261959+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:23.940519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"30'2","reported_seq":108,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.745965+0000","last_change":"2024-05-08T18:29:48.634956+0000","last_active":"2024-05-08T18:31:14.745965+0000","last_peered":"2024-05-08T18:31:14.745965+0000","last_clean":"2024-05-08T18:31:14.745965+0000","last_became_active":"2024-05-08T18:29:48.633858+0000","last_became_peered":"2024-05-08T18:29:48.633858+0000","last_unstale":"2024-05-08T18:31:14.745965+0000","last_undegraded":"2024-05-08T18:31:14.745965+0000","last_fullsized":"2024-05-08T18:31:14.745965+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:50:48.169666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.632416+0000","last_change":"2024-05-08T18:29:42.567744+0000","last_active":"2024-05-08T18:31:15.632416+0000","last_peered":"2024-05-08T18:31:15.632416+0000","last_clean":"2024-05-08T18:31:15.632416+0000","last_became_active":"2024-05-08T18:29:42.566974+0000","last_became_peered":"2024-05-08T18:29:42.566974+0000","last_unstale":"2024-05-08T18:31:15.632416+0000","last_undegraded":"2024-05-08T18:31:15.632416+0000","last_fullsized":"2024-05-08T18:31:15.632416+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:42.045615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":105,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.262287+0000","last_change":"2024-05-08T18:29:40.572499+0000","last_active":"2024-05-08T18:31:16.262287+0000","last_peered":"2024-05-08T18:31:16.262287+0000","last_clean":"2024-05-08T18:31:16.262287+0000","last_became_active":"2024-05-08T18:29:40.571322+0000","last_became_peered":"2024-05-08T18:29:40.571322+0000","last_unstale":"2024-05-08T18:31:16.262287+0000","last_undegraded":"2024-05-08T18:31:16.262287+0000","last_fullsized":"2024-05-08T18:31:16.262287+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:31.119374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":97,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.260932+0000","last_change":"2024-05-08T18:29:44.597045+0000","last_active":"2024-05-08T18:31:16.260932+0000","last_peered":"2024-05-08T18:31:16.260932+0000","last_clean":"2024-05-08T18:31:16.260932+0000","last_became_active":"2024-05-08T18:29:44.596282+0000","last_became_peered":"2024-05-08T18:29:44.596282+0000","last_unstale":"2024-05-08T18:31:16.260932+0000","last_undegraded":"2024-05-08T18:31:16.260932+0000","last_fullsized":"2024-05-08T18:31:16.260932+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:35:51.288126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"33'19","reported_seq":122,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.631240+0000","last_change":"2024-05-08T18:29:46.590633+0000","last_active":"2024-05-08T18:31:15.631240+0000","last_peered":"2024-05-08T18:31:15.631240+0000","last_clean":"2024-05-08T18:31:15.631240+0000","last_became_active":"2024-05-08T18:29:46.589600+0000","last_became_peered":"2024-05-08T18:29:46.589600+0000","last_unstale":"2024-05-08T18:31:15.631240+0000","last_undegraded":"2024-05-08T18:31:15.631240+0000","last_fullsized":"2024-05-08T18:31:15.631240+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:23.940519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":86,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.720461+0000","last_change":"2024-05-08T18:29:48.630758+0000","last_active":"2024-05-08T18:31:13.720461+0000","last_peered":"2024-05-08T18:31:13.720461+0000","last_clean":"2024-05-08T18:31:13.720461+0000","last_became_active":"2024-05-08T18:29:48.630017+0000","last_became_peered":"2024-05-08T18:29:48.630017+0000","last_unstale":"2024-05-08T18:31:13.720461+0000","last_undegraded":"2024-05-08T18:31:13.720461+0000","last_fullsized":"2024-05-08T18:31:13.720461+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:39.879384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":83,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.631915+0000","last_change":"2024-05-08T18:29:50.672682+0000","last_active":"2024-05-08T18:31:15.631915+0000","last_peered":"2024-05-08T18:31:15.631915+0000","last_clean":"2024-05-08T18:31:15.631915+0000","last_became_active":"2024-05-08T18:29:50.671923+0000","last_became_peered":"2024-05-08T18:29:50.671923+0000","last_unstale":"2024-05-08T18:31:15.631915+0000","last_undegraded":"2024-05-08T18:31:15.631915+0000","last_fullsized":"2024-05-08T18:31:15.631915+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:38.318890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":102,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.741981+0000","last_change":"2024-05-08T18:29:42.554289+0000","last_active":"2024-05-08T18:31:15.741981+0000","last_peered":"2024-05-08T18:31:15.741981+0000","last_clean":"2024-05-08T18:31:15.741981+0000","last_became_active":"2024-05-08T18:29:42.553574+0000","last_became_peered":"2024-05-08T18:29:42.553574+0000","last_unstale":"2024-05-08T18:31:15.741981+0000","last_undegraded":"2024-05-08T18:31:15.741981+0000","last_fullsized":"2024-05-08T18:31:15.741981+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:42.005809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":105,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.263237+0000","last_change":"2024-05-08T18:29:40.570169+0000","last_active":"2024-05-08T18:31:16.263237+0000","last_peered":"2024-05-08T18:31:16.263237+0000","last_clean":"2024-05-08T18:31:16.263237+0000","last_became_active":"2024-05-08T18:29:40.569542+0000","last_became_peered":"2024-05-08T18:29:40.569542+0000","last_unstale":"2024-05-08T18:31:16.263237+0000","last_undegraded":"2024-05-08T18:31:16.263237+0000","last_fullsized":"2024-05-08T18:31:16.263237+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:08:13.006752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"26'1","reported_seq":97,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.737649+0000","last_change":"2024-05-08T18:29:44.579659+0000","last_active":"2024-05-08T18:31:14.737649+0000","last_peered":"2024-05-08T18:31:14.737649+0000","last_clean":"2024-05-08T18:31:14.737649+0000","last_became_active":"2024-05-08T18:29:44.579152+0000","last_became_peered":"2024-05-08T18:29:44.579152+0000","last_unstale":"2024-05-08T18:31:14.737649+0000","last_undegraded":"2024-05-08T18:31:14.737649+0000","last_fullsized":"2024-05-08T18:31:14.737649+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:15:00.358583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"33'9","reported_seq":108,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.748385+0000","last_change":"2024-05-08T18:29:46.600224+0000","last_active":"2024-05-08T18:31:14.748385+0000","last_peered":"2024-05-08T18:31:14.748385+0000","last_clean":"2024-05-08T18:31:14.748385+0000","last_became_active":"2024-05-08T18:29:46.599464+0000","last_became_peered":"2024-05-08T18:29:46.599464+0000","last_unstale":"2024-05-08T18:31:14.748385+0000","last_undegraded":"2024-05-08T18:31:14.748385+0000","last_fullsized":"2024-05-08T18:31:14.748385+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:26:40.238188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":88,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.745432+0000","last_change":"2024-05-08T18:29:48.637939+0000","last_active":"2024-05-08T18:31:14.745432+0000","last_peered":"2024-05-08T18:31:14.745432+0000","last_clean":"2024-05-08T18:31:14.745432+0000","last_became_active":"2024-05-08T18:29:48.637231+0000","last_became_peered":"2024-05-08T18:29:48.637231+0000","last_unstale":"2024-05-08T18:31:14.745432+0000","last_undegraded":"2024-05-08T18:31:14.745432+0000","last_fullsized":"2024-05-08T18:31:14.745432+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:04.571608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":84,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.737287+0000","last_change":"2024-05-08T18:29:50.681831+0000","last_active":"2024-05-08T18:31:14.737287+0000","last_peered":"2024-05-08T18:31:14.737287+0000","last_clean":"2024-05-08T18:31:14.737287+0000","last_became_active":"2024-05-08T18:29:50.681287+0000","last_became_peered":"2024-05-08T18:29:50.681287+0000","last_unstale":"2024-05-08T18:31:14.737287+0000","last_undegraded":"2024-05-08T18:31:14.737287+0000","last_fullsized":"2024-05-08T18:31:14.737287+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:30:24.111488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.737114+0000","last_change":"2024-05-08T18:29:42.562975+0000","last_active":"2024-05-08T18:31:14.737114+0000","last_peered":"2024-05-08T18:31:14.737114+0000","last_clean":"2024-05-08T18:31:14.737114+0000","last_became_active":"2024-05-08T18:29:42.562267+0000","last_became_peered":"2024-05-08T18:29:42.562267+0000","last_unstale":"2024-05-08T18:31:14.737114+0000","last_undegraded":"2024-05-08T18:31:14.737114+0000","last_fullsized":"2024-05-08T18:31:14.737114+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:30.446371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":105,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.262330+0000","last_change":"2024-05-08T18:29:40.570736+0000","last_active":"2024-05-08T18:31:16.262330+0000","last_peered":"2024-05-08T18:31:16.262330+0000","last_clean":"2024-05-08T18:31:16.262330+0000","last_became_active":"2024-05-08T18:29:40.569626+0000","last_became_peered":"2024-05-08T18:29:40.569626+0000","last_unstale":"2024-05-08T18:31:16.262330+0000","last_undegraded":"2024-05-08T18:31:16.262330+0000","last_fullsized":"2024-05-08T18:31:16.262330+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:56.300986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"26'1","reported_seq":97,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.739172+0000","last_change":"2024-05-08T18:29:44.581748+0000","last_active":"2024-05-08T18:31:14.739172+0000","last_peered":"2024-05-08T18:31:14.739172+0000","last_clean":"2024-05-08T18:31:14.739172+0000","last_became_active":"2024-05-08T18:29:44.581067+0000","last_became_peered":"2024-05-08T18:29:44.581067+0000","last_unstale":"2024-05-08T18:31:14.739172+0000","last_undegraded":"2024-05-08T18:31:14.739172+0000","last_fullsized":"2024-05-08T18:31:14.739172+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:44.043691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"33'15","reported_seq":118,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.261097+0000","last_change":"2024-05-08T18:29:46.605887+0000","last_active":"2024-05-08T18:31:16.261097+0000","last_peered":"2024-05-08T18:31:16.261097+0000","last_clean":"2024-05-08T18:31:16.261097+0000","last_became_active":"2024-05-08T18:29:46.604966+0000","last_became_peered":"2024-05-08T18:29:46.604966+0000","last_unstale":"2024-05-08T18:31:16.261097+0000","last_undegraded":"2024-05-08T18:31:16.261097+0000","last_fullsized":"2024-05-08T18:31:16.261097+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:07:54.654205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"30'2","reported_seq":106,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.721885+0000","last_change":"2024-05-08T18:29:48.638657+0000","last_active":"2024-05-08T18:31:13.721885+0000","last_peered":"2024-05-08T18:31:13.721885+0000","last_clean":"2024-05-08T18:31:13.721885+0000","last_became_active":"2024-05-08T18:29:48.637758+0000","last_became_peered":"2024-05-08T18:29:48.637758+0000","last_unstale":"2024-05-08T18:31:13.721885+0000","last_undegraded":"2024-05-08T18:31:13.721885+0000","last_fullsized":"2024-05-08T18:31:13.721885+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:45:24.153991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":82,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.723305+0000","last_change":"2024-05-08T18:29:50.684501+0000","last_active":"2024-05-08T18:31:13.723305+0000","last_peered":"2024-05-08T18:31:13.723305+0000","last_clean":"2024-05-08T18:31:13.723305+0000","last_became_active":"2024-05-08T18:29:50.683738+0000","last_became_peered":"2024-05-08T18:29:50.683738+0000","last_unstale":"2024-05-08T18:31:13.723305+0000","last_undegraded":"2024-05-08T18:31:13.723305+0000","last_fullsized":"2024-05-08T18:31:13.723305+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:22.834262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":98,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.722596+0000","last_change":"2024-05-08T18:29:42.569401+0000","last_active":"2024-05-08T18:31:13.722596+0000","last_peered":"2024-05-08T18:31:13.722596+0000","last_clean":"2024-05-08T18:31:13.722596+0000","last_became_active":"2024-05-08T18:29:42.568659+0000","last_became_peered":"2024-05-08T18:29:42.568659+0000","last_unstale":"2024-05-08T18:31:13.722596+0000","last_undegraded":"2024-05-08T18:31:13.722596+0000","last_fullsized":"2024-05-08T18:31:13.722596+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:35:23.016110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.632782+0000","last_change":"2024-05-08T18:29:40.557076+0000","last_active":"2024-05-08T18:31:15.632782+0000","last_peered":"2024-05-08T18:31:15.632782+0000","last_clean":"2024-05-08T18:31:15.632782+0000","last_became_active":"2024-05-08T18:29:40.555805+0000","last_became_peered":"2024-05-08T18:29:40.555805+0000","last_unstale":"2024-05-08T18:31:15.632782+0000","last_undegraded":"2024-05-08T18:31:15.632782+0000","last_fullsized":"2024-05-08T18:31:15.632782+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:13.946346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":95,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.739353+0000","last_change":"2024-05-08T18:29:44.573892+0000","last_active":"2024-05-08T18:31:14.739353+0000","last_peered":"2024-05-08T18:31:14.739353+0000","last_clean":"2024-05-08T18:31:14.739353+0000","last_became_active":"2024-05-08T18:29:44.573308+0000","last_became_peered":"2024-05-08T18:29:44.573308+0000","last_unstale":"2024-05-08T18:31:14.739353+0000","last_undegraded":"2024-05-08T18:31:14.739353+0000","last_fullsized":"2024-05-08T18:31:14.739353+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:37.075348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"33'12","reported_seq":113,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.722836+0000","last_change":"2024-05-08T18:29:46.595585+0000","last_active":"2024-05-08T18:31:13.722836+0000","last_peered":"2024-05-08T18:31:13.722836+0000","last_clean":"2024-05-08T18:31:13.722836+0000","last_became_active":"2024-05-08T18:29:46.594930+0000","last_became_peered":"2024-05-08T18:29:46.594930+0000","last_unstale":"2024-05-08T18:31:13.722836+0000","last_undegraded":"2024-05-08T18:31:13.722836+0000","last_fullsized":"2024-05-08T18:31:13.722836+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:11.768269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":87,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.737466+0000","last_change":"2024-05-08T18:29:48.638137+0000","last_active":"2024-05-08T18:31:14.737466+0000","last_peered":"2024-05-08T18:31:14.737466+0000","last_clean":"2024-05-08T18:31:14.737466+0000","last_became_active":"2024-05-08T18:29:48.637370+0000","last_became_peered":"2024-05-08T18:29:48.637370+0000","last_unstale":"2024-05-08T18:31:14.737466+0000","last_undegraded":"2024-05-08T18:31:14.737466+0000","last_fullsized":"2024-05-08T18:31:14.737466+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:15.859849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":82,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.722744+0000","last_change":"2024-05-08T18:29:50.688760+0000","last_active":"2024-05-08T18:31:13.722744+0000","last_peered":"2024-05-08T18:31:13.722744+0000","last_clean":"2024-05-08T18:31:13.722744+0000","last_became_active":"2024-05-08T18:29:50.687960+0000","last_became_peered":"2024-05-08T18:29:50.687960+0000","last_unstale":"2024-05-08T18:31:13.722744+0000","last_undegraded":"2024-05-08T18:31:13.722744+0000","last_fullsized":"2024-05-08T18:31:13.722744+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:21:19.624895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":102,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.742749+0000","last_change":"2024-05-08T18:29:42.557850+0000","last_active":"2024-05-08T18:31:15.742749+0000","last_peered":"2024-05-08T18:31:15.742749+0000","last_clean":"2024-05-08T18:31:15.742749+0000","last_became_active":"2024-05-08T18:29:42.557119+0000","last_became_peered":"2024-05-08T18:29:42.557119+0000","last_unstale":"2024-05-08T18:31:15.742749+0000","last_undegraded":"2024-05-08T18:31:15.742749+0000","last_fullsized":"2024-05-08T18:31:15.742749+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:25:56.129785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.745576+0000","last_change":"2024-05-08T18:29:40.544530+0000","last_active":"2024-05-08T18:31:14.745576+0000","last_peered":"2024-05-08T18:31:14.745576+0000","last_clean":"2024-05-08T18:31:14.745576+0000","last_became_active":"2024-05-08T18:29:40.544215+0000","last_became_peered":"2024-05-08T18:29:40.544215+0000","last_unstale":"2024-05-08T18:31:14.745576+0000","last_undegraded":"2024-05-08T18:31:14.745576+0000","last_fullsized":"2024-05-08T18:31:14.745576+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:14:26.628603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":95,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.738866+0000","last_change":"2024-05-08T18:29:44.588227+0000","last_active":"2024-05-08T18:31:14.738866+0000","last_peered":"2024-05-08T18:31:14.738866+0000","last_clean":"2024-05-08T18:31:14.738866+0000","last_became_active":"2024-05-08T18:29:44.587822+0000","last_became_peered":"2024-05-08T18:29:44.587822+0000","last_unstale":"2024-05-08T18:31:14.738866+0000","last_undegraded":"2024-05-08T18:31:14.738866+0000","last_fullsized":"2024-05-08T18:31:14.738866+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:18:12.841872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"33'11","reported_seq":113,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.743323+0000","last_change":"2024-05-08T18:29:46.603563+0000","last_active":"2024-05-08T18:31:15.743323+0000","last_peered":"2024-05-08T18:31:15.743323+0000","last_clean":"2024-05-08T18:31:15.743323+0000","last_became_active":"2024-05-08T18:29:46.602801+0000","last_became_peered":"2024-05-08T18:29:46.602801+0000","last_unstale":"2024-05-08T18:31:15.743323+0000","last_undegraded":"2024-05-08T18:31:15.743323+0000","last_fullsized":"2024-05-08T18:31:15.743323+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:22:36.338527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":86,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.723285+0000","last_change":"2024-05-08T18:29:48.642806+0000","last_active":"2024-05-08T18:31:13.723285+0000","last_peered":"2024-05-08T18:31:13.723285+0000","last_clean":"2024-05-08T18:31:13.723285+0000","last_became_active":"2024-05-08T18:29:48.641813+0000","last_became_peered":"2024-05-08T18:29:48.641813+0000","last_unstale":"2024-05-08T18:31:13.723285+0000","last_undegraded":"2024-05-08T18:31:13.723285+0000","last_fullsized":"2024-05-08T18:31:13.723285+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:50:48.169666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":84,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.744630+0000","last_change":"2024-05-08T18:29:50.689819+0000","last_active":"2024-05-08T18:31:14.744630+0000","last_peered":"2024-05-08T18:31:14.744630+0000","last_clean":"2024-05-08T18:31:14.744630+0000","last_became_active":"2024-05-08T18:29:50.686739+0000","last_became_peered":"2024-05-08T18:29:50.686739+0000","last_unstale":"2024-05-08T18:31:14.744630+0000","last_undegraded":"2024-05-08T18:31:14.744630+0000","last_fullsized":"2024-05-08T18:31:14.744630+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:45:34.171402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":102,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.743481+0000","last_change":"2024-05-08T18:29:42.552388+0000","last_active":"2024-05-08T18:31:15.743481+0000","last_peered":"2024-05-08T18:31:15.743481+0000","last_clean":"2024-05-08T18:31:15.743481+0000","last_became_active":"2024-05-08T18:29:42.551647+0000","last_became_peered":"2024-05-08T18:29:42.551647+0000","last_unstale":"2024-05-08T18:31:15.743481+0000","last_undegraded":"2024-05-08T18:31:15.743481+0000","last_fullsized":"2024-05-08T18:31:15.743481+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:55.055481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.737356+0000","last_change":"2024-05-08T18:29:40.562946+0000","last_active":"2024-05-08T18:31:14.737356+0000","last_peered":"2024-05-08T18:31:14.737356+0000","last_clean":"2024-05-08T18:31:14.737356+0000","last_became_active":"2024-05-08T18:29:40.550942+0000","last_became_peered":"2024-05-08T18:29:40.550942+0000","last_unstale":"2024-05-08T18:31:14.737356+0000","last_undegraded":"2024-05-08T18:31:14.737356+0000","last_fullsized":"2024-05-08T18:31:14.737356+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:22.579629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":94,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.720111+0000","last_change":"2024-05-08T18:29:44.593681+0000","last_active":"2024-05-08T18:31:13.720111+0000","last_peered":"2024-05-08T18:31:13.720111+0000","last_clean":"2024-05-08T18:31:13.720111+0000","last_became_active":"2024-05-08T18:29:44.593242+0000","last_became_peered":"2024-05-08T18:29:44.593242+0000","last_unstale":"2024-05-08T18:31:13.720111+0000","last_undegraded":"2024-05-08T18:31:13.720111+0000","last_fullsized":"2024-05-08T18:31:13.720111+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:57.093364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"33'15","reported_seq":116,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.740550+0000","last_change":"2024-05-08T18:29:46.589514+0000","last_active":"2024-05-08T18:31:14.740550+0000","last_peered":"2024-05-08T18:31:14.740550+0000","last_clean":"2024-05-08T18:31:14.740550+0000","last_became_active":"2024-05-08T18:29:46.588784+0000","last_became_peered":"2024-05-08T18:29:46.588784+0000","last_unstale":"2024-05-08T18:31:14.740550+0000","last_undegraded":"2024-05-08T18:31:14.740550+0000","last_fullsized":"2024-05-08T18:31:14.740550+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:02:30.355168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"30'2","reported_seq":107,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.738812+0000","last_change":"2024-05-08T18:29:48.631007+0000","last_active":"2024-05-08T18:31:14.738812+0000","last_peered":"2024-05-08T18:31:14.738812+0000","last_clean":"2024-05-08T18:31:14.738812+0000","last_became_active":"2024-05-08T18:29:48.630229+0000","last_became_peered":"2024-05-08T18:29:48.630229+0000","last_unstale":"2024-05-08T18:31:14.738812+0000","last_undegraded":"2024-05-08T18:31:14.738812+0000","last_fullsized":"2024-05-08T18:31:14.738812+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:44:03.778419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":82,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.719607+0000","last_change":"2024-05-08T18:29:50.675105+0000","last_active":"2024-05-08T18:31:13.719607+0000","last_peered":"2024-05-08T18:31:13.719607+0000","last_clean":"2024-05-08T18:31:13.719607+0000","last_became_active":"2024-05-08T18:29:50.674292+0000","last_became_peered":"2024-05-08T18:29:50.674292+0000","last_unstale":"2024-05-08T18:31:13.719607+0000","last_undegraded":"2024-05-08T18:31:13.719607+0000","last_fullsized":"2024-05-08T18:31:13.719607+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:47:15.423647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":102,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.743524+0000","last_change":"2024-05-08T18:29:42.579707+0000","last_active":"2024-05-08T18:31:15.743524+0000","last_peered":"2024-05-08T18:31:15.743524+0000","last_clean":"2024-05-08T18:31:15.743524+0000","last_became_active":"2024-05-08T18:29:42.579059+0000","last_became_peered":"2024-05-08T18:29:42.579059+0000","last_unstale":"2024-05-08T18:31:15.743524+0000","last_undegraded":"2024-05-08T18:31:15.743524+0000","last_fullsized":"2024-05-08T18:31:15.743524+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:09.787597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":106,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.742713+0000","last_change":"2024-05-08T18:29:40.555327+0000","last_active":"2024-05-08T18:31:15.742713+0000","last_peered":"2024-05-08T18:31:15.742713+0000","last_clean":"2024-05-08T18:31:15.742713+0000","last_became_active":"2024-05-08T18:29:40.554594+0000","last_became_peered":"2024-05-08T18:29:40.554594+0000","last_unstale":"2024-05-08T18:31:15.742713+0000","last_undegraded":"2024-05-08T18:31:15.742713+0000","last_fullsized":"2024-05-08T18:31:15.742713+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:19.841114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"26'2","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.631618+0000","last_change":"2024-05-08T18:29:44.582434+0000","last_active":"2024-05-08T18:31:15.631618+0000","last_peered":"2024-05-08T18:31:15.631618+0000","last_clean":"2024-05-08T18:31:15.631618+0000","last_became_active":"2024-05-08T18:29:44.581699+0000","last_became_peered":"2024-05-08T18:29:44.581699+0000","last_unstale":"2024-05-08T18:31:15.631618+0000","last_undegraded":"2024-05-08T18:31:15.631618+0000","last_fullsized":"2024-05-08T18:31:15.631618+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:19:29.113643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"33'10","reported_seq":107,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.746013+0000","last_change":"2024-05-08T18:29:46.590860+0000","last_active":"2024-05-08T18:31:14.746013+0000","last_peered":"2024-05-08T18:31:14.746013+0000","last_clean":"2024-05-08T18:31:14.746013+0000","last_became_active":"2024-05-08T18:29:46.590087+0000","last_became_peered":"2024-05-08T18:29:46.590087+0000","last_unstale":"2024-05-08T18:31:14.746013+0000","last_undegraded":"2024-05-08T18:31:14.746013+0000","last_fullsized":"2024-05-08T18:31:14.746013+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:19:58.358449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"30'2","reported_seq":108,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.737851+0000","last_change":"2024-05-08T18:29:48.635548+0000","last_active":"2024-05-08T18:31:14.737851+0000","last_peered":"2024-05-08T18:31:14.737851+0000","last_clean":"2024-05-08T18:31:14.737851+0000","last_became_active":"2024-05-08T18:29:48.634801+0000","last_became_peered":"2024-05-08T18:29:48.634801+0000","last_unstale":"2024-05-08T18:31:14.737851+0000","last_undegraded":"2024-05-08T18:31:14.737851+0000","last_fullsized":"2024-05-08T18:31:14.737851+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:04:20.128031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":86,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.743282+0000","last_change":"2024-05-08T18:29:50.668279+0000","last_active":"2024-05-08T18:31:15.743282+0000","last_peered":"2024-05-08T18:31:15.743282+0000","last_clean":"2024-05-08T18:31:15.743282+0000","last_became_active":"2024-05-08T18:29:50.667536+0000","last_became_peered":"2024-05-08T18:29:50.667536+0000","last_unstale":"2024-05-08T18:31:15.743282+0000","last_undegraded":"2024-05-08T18:31:15.743282+0000","last_fullsized":"2024-05-08T18:31:15.743282+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:12:05.780786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":98,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.722987+0000","last_change":"2024-05-08T18:29:42.563807+0000","last_active":"2024-05-08T18:31:13.722987+0000","last_peered":"2024-05-08T18:31:13.722987+0000","last_clean":"2024-05-08T18:31:13.722987+0000","last_became_active":"2024-05-08T18:29:42.563416+0000","last_became_peered":"2024-05-08T18:29:42.563416+0000","last_unstale":"2024-05-08T18:31:13.722987+0000","last_undegraded":"2024-05-08T18:31:13.722987+0000","last_fullsized":"2024-05-08T18:31:13.722987+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:18:10.803989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.745233+0000","last_change":"2024-05-08T18:29:40.548898+0000","last_active":"2024-05-08T18:31:14.745233+0000","last_peered":"2024-05-08T18:31:14.745233+0000","last_clean":"2024-05-08T18:31:14.745233+0000","last_became_active":"2024-05-08T18:29:40.548591+0000","last_became_peered":"2024-05-08T18:29:40.548591+0000","last_unstale":"2024-05-08T18:31:14.745233+0000","last_undegraded":"2024-05-08T18:31:14.745233+0000","last_fullsized":"2024-05-08T18:31:14.745233+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:27:41.414153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":98,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.743425+0000","last_change":"2024-05-08T18:29:44.582578+0000","last_active":"2024-05-08T18:31:15.743425+0000","last_peered":"2024-05-08T18:31:15.743425+0000","last_clean":"2024-05-08T18:31:15.743425+0000","last_became_active":"2024-05-08T18:29:44.581832+0000","last_became_peered":"2024-05-08T18:29:44.581832+0000","last_unstale":"2024-05-08T18:31:15.743425+0000","last_undegraded":"2024-05-08T18:31:15.743425+0000","last_fullsized":"2024-05-08T18:31:15.743425+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:52:25.736491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"33'17","reported_seq":119,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.632258+0000","last_change":"2024-05-08T18:29:46.602459+0000","last_active":"2024-05-08T18:31:15.632258+0000","last_peered":"2024-05-08T18:31:15.632258+0000","last_clean":"2024-05-08T18:31:15.632258+0000","last_became_active":"2024-05-08T18:29:46.601740+0000","last_became_peered":"2024-05-08T18:29:46.601740+0000","last_unstale":"2024-05-08T18:31:15.632258+0000","last_undegraded":"2024-05-08T18:31:15.632258+0000","last_fullsized":"2024-05-08T18:31:15.632258+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:58:31.293922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":88,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.736929+0000","last_change":"2024-05-08T18:29:48.640046+0000","last_active":"2024-05-08T18:31:14.736929+0000","last_peered":"2024-05-08T18:31:14.736929+0000","last_clean":"2024-05-08T18:31:14.736929+0000","last_became_active":"2024-05-08T18:29:48.639309+0000","last_became_peered":"2024-05-08T18:29:48.639309+0000","last_unstale":"2024-05-08T18:31:14.736929+0000","last_undegraded":"2024-05-08T18:31:14.736929+0000","last_fullsized":"2024-05-08T18:31:14.736929+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:10.533065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":82,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.720364+0000","last_change":"2024-05-08T18:29:50.668361+0000","last_active":"2024-05-08T18:31:13.720364+0000","last_peered":"2024-05-08T18:31:13.720364+0000","last_clean":"2024-05-08T18:31:13.720364+0000","last_became_active":"2024-05-08T18:29:50.667636+0000","last_became_peered":"2024-05-08T18:29:50.667636+0000","last_unstale":"2024-05-08T18:31:13.720364+0000","last_undegraded":"2024-05-08T18:31:13.720364+0000","last_fullsized":"2024-05-08T18:31:13.720364+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:58:35.356885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.738122+0000","last_change":"2024-05-08T18:29:42.584098+0000","last_active":"2024-05-08T18:31:14.738122+0000","last_peered":"2024-05-08T18:31:14.738122+0000","last_clean":"2024-05-08T18:31:14.738122+0000","last_became_active":"2024-05-08T18:29:42.583639+0000","last_became_peered":"2024-05-08T18:29:42.583639+0000","last_unstale":"2024-05-08T18:31:14.738122+0000","last_undegraded":"2024-05-08T18:31:14.738122+0000","last_fullsized":"2024-05-08T18:31:14.738122+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:08:15.026467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":207,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.260941+0000","last_change":"2024-05-08T18:29:27.115522+0000","last_active":"2024-05-08T18:31:16.260941+0000","last_peered":"2024-05-08T18:31:16.260941+0000","last_clean":"2024-05-08T18:31:16.260941+0000","last_became_active":"2024-05-08T18:29:27.112960+0000","last_became_peered":"2024-05-08T18:29:27.112960+0000","last_unstale":"2024-05-08T18:31:16.260941+0000","last_undegraded":"2024-05-08T18:31:16.260941+0000","last_fullsized":"2024-05-08T18:31:16.260941+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:26.091102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:26.091102+0000","last_clean_scrub_stamp":"2024-05-08T18:29:26.091102+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:09:50.296961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":109,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.632174+0000","last_change":"2024-05-08T18:29:34.496467+0000","last_active":"2024-05-08T18:31:15.632174+0000","last_peered":"2024-05-08T18:31:15.632174+0000","last_clean":"2024-05-08T18:31:15.632174+0000","last_became_active":"2024-05-08T18:29:34.495632+0000","last_became_peered":"2024-05-08T18:29:34.495632+0000","last_unstale":"2024-05-08T18:31:15.632174+0000","last_undegraded":"2024-05-08T18:31:15.632174+0000","last_fullsized":"2024-05-08T18:31:15.632174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:35.917391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":109,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.745790+0000","last_change":"2024-05-08T18:30:20.849562+0000","last_active":"2024-05-08T18:31:14.745790+0000","last_peered":"2024-05-08T18:31:14.745790+0000","last_clean":"2024-05-08T18:31:14.745790+0000","last_became_active":"2024-05-08T18:30:20.849160+0000","last_became_peered":"2024-05-08T18:30:20.849160+0000","last_unstale":"2024-05-08T18:31:14.745790+0000","last_undegraded":"2024-05-08T18:31:14.745790+0000","last_fullsized":"2024-05-08T18:31:14.745790+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:29:13.478886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":97,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.261983+0000","last_change":"2024-05-08T18:29:44.592445+0000","last_active":"2024-05-08T18:31:16.261983+0000","last_peered":"2024-05-08T18:31:16.261983+0000","last_clean":"2024-05-08T18:31:16.261983+0000","last_became_active":"2024-05-08T18:29:44.587855+0000","last_became_peered":"2024-05-08T18:29:44.587855+0000","last_unstale":"2024-05-08T18:31:16.261983+0000","last_undegraded":"2024-05-08T18:31:16.261983+0000","last_fullsized":"2024-05-08T18:31:16.261983+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:06:05.355648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"33'13","reported_seq":118,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.632992+0000","last_change":"2024-05-08T18:29:46.595394+0000","last_active":"2024-05-08T18:31:15.632992+0000","last_peered":"2024-05-08T18:31:15.632992+0000","last_clean":"2024-05-08T18:31:15.632992+0000","last_became_active":"2024-05-08T18:29:46.594573+0000","last_became_peered":"2024-05-08T18:29:46.594573+0000","last_unstale":"2024-05-08T18:31:15.632992+0000","last_undegraded":"2024-05-08T18:31:15.632992+0000","last_fullsized":"2024-05-08T18:31:15.632992+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:47:11.360684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":86,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.723389+0000","last_change":"2024-05-08T18:29:48.632178+0000","last_active":"2024-05-08T18:31:13.723389+0000","last_peered":"2024-05-08T18:31:13.723389+0000","last_clean":"2024-05-08T18:31:13.723389+0000","last_became_active":"2024-05-08T18:29:48.631481+0000","last_became_peered":"2024-05-08T18:29:48.631481+0000","last_unstale":"2024-05-08T18:31:13.723389+0000","last_undegraded":"2024-05-08T18:31:13.723389+0000","last_fullsized":"2024-05-08T18:31:13.723389+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:34.806539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":84,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.736104+0000","last_change":"2024-05-08T18:29:50.675319+0000","last_active":"2024-05-08T18:31:14.736104+0000","last_peered":"2024-05-08T18:31:14.736104+0000","last_clean":"2024-05-08T18:31:14.736104+0000","last_became_active":"2024-05-08T18:29:50.674526+0000","last_became_peered":"2024-05-08T18:29:50.674526+0000","last_unstale":"2024-05-08T18:31:14.736104+0000","last_undegraded":"2024-05-08T18:31:14.736104+0000","last_fullsized":"2024-05-08T18:31:14.736104+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:59:06.404586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":98,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.725806+0000","last_change":"2024-05-08T18:29:42.568584+0000","last_active":"2024-05-08T18:31:13.725806+0000","last_peered":"2024-05-08T18:31:13.725806+0000","last_clean":"2024-05-08T18:31:13.725806+0000","last_became_active":"2024-05-08T18:29:42.568244+0000","last_became_peered":"2024-05-08T18:29:42.568244+0000","last_unstale":"2024-05-08T18:31:13.725806+0000","last_undegraded":"2024-05-08T18:31:13.725806+0000","last_fullsized":"2024-05-08T18:31:13.725806+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:20.397730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":111,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.260769+0000","last_change":"2024-05-08T18:29:34.497654+0000","last_active":"2024-05-08T18:31:16.260769+0000","last_peered":"2024-05-08T18:31:16.260769+0000","last_clean":"2024-05-08T18:31:16.260769+0000","last_became_active":"2024-05-08T18:29:34.495812+0000","last_became_peered":"2024-05-08T18:29:34.495812+0000","last_unstale":"2024-05-08T18:31:16.260769+0000","last_undegraded":"2024-05-08T18:31:16.260769+0000","last_fullsized":"2024-05-08T18:31:16.260769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:37:02.202613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":102,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.722926+0000","last_change":"2024-05-08T18:29:40.560653+0000","last_active":"2024-05-08T18:31:13.722926+0000","last_peered":"2024-05-08T18:31:13.722926+0000","last_clean":"2024-05-08T18:31:13.722926+0000","last_became_active":"2024-05-08T18:29:40.560296+0000","last_became_peered":"2024-05-08T18:29:40.560296+0000","last_unstale":"2024-05-08T18:31:13.722926+0000","last_undegraded":"2024-05-08T18:31:13.722926+0000","last_fullsized":"2024-05-08T18:31:13.722926+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:52.462279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":95,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.633414+0000","last_change":"2024-05-08T18:29:44.594681+0000","last_active":"2024-05-08T18:31:15.633414+0000","last_peered":"2024-05-08T18:31:15.633414+0000","last_clean":"2024-05-08T18:31:15.633414+0000","last_became_active":"2024-05-08T18:29:44.593917+0000","last_became_peered":"2024-05-08T18:29:44.593917+0000","last_unstale":"2024-05-08T18:31:15.633414+0000","last_undegraded":"2024-05-08T18:31:15.633414+0000","last_fullsized":"2024-05-08T18:31:15.633414+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:59:00.335437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"33'23","reported_seq":149,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.720066+0000","last_change":"2024-05-08T18:29:46.599932+0000","last_active":"2024-05-08T18:31:13.720066+0000","last_peered":"2024-05-08T18:31:13.720066+0000","last_clean":"2024-05-08T18:31:13.720066+0000","last_became_active":"2024-05-08T18:29:46.594789+0000","last_became_peered":"2024-05-08T18:29:46.594789+0000","last_unstale":"2024-05-08T18:31:13.720066+0000","last_undegraded":"2024-05-08T18:31:13.720066+0000","last_fullsized":"2024-05-08T18:31:13.720066+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:04:18.099848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":42,"num_read_kb":27,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":89,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.261780+0000","last_change":"2024-05-08T18:29:48.634661+0000","last_active":"2024-05-08T18:31:16.261780+0000","last_peered":"2024-05-08T18:31:16.261780+0000","last_clean":"2024-05-08T18:31:16.261780+0000","last_became_active":"2024-05-08T18:29:48.634044+0000","last_became_peered":"2024-05-08T18:29:48.634044+0000","last_unstale":"2024-05-08T18:31:16.261780+0000","last_undegraded":"2024-05-08T18:31:16.261780+0000","last_fullsized":"2024-05-08T18:31:16.261780+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:01:46.238076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":82,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.719668+0000","last_change":"2024-05-08T18:29:50.676536+0000","last_active":"2024-05-08T18:31:13.719668+0000","last_peered":"2024-05-08T18:31:13.719668+0000","last_clean":"2024-05-08T18:31:13.719668+0000","last_became_active":"2024-05-08T18:29:50.675770+0000","last_became_peered":"2024-05-08T18:29:50.675770+0000","last_unstale":"2024-05-08T18:31:13.719668+0000","last_undegraded":"2024-05-08T18:31:13.719668+0000","last_fullsized":"2024-05-08T18:31:13.719668+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:28.003482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":98,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.723025+0000","last_change":"2024-05-08T18:29:42.575253+0000","last_active":"2024-05-08T18:31:13.723025+0000","last_peered":"2024-05-08T18:31:13.723025+0000","last_clean":"2024-05-08T18:31:13.723025+0000","last_became_active":"2024-05-08T18:29:42.573621+0000","last_became_peered":"2024-05-08T18:29:42.573621+0000","last_unstale":"2024-05-08T18:31:13.723025+0000","last_undegraded":"2024-05-08T18:31:13.723025+0000","last_fullsized":"2024-05-08T18:31:13.723025+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:59.243324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":109,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.738304+0000","last_change":"2024-05-08T18:29:34.491071+0000","last_active":"2024-05-08T18:31:14.738304+0000","last_peered":"2024-05-08T18:31:14.738304+0000","last_clean":"2024-05-08T18:31:14.738304+0000","last_became_active":"2024-05-08T18:29:34.490717+0000","last_became_peered":"2024-05-08T18:29:34.490717+0000","last_unstale":"2024-05-08T18:31:14.738304+0000","last_undegraded":"2024-05-08T18:31:14.738304+0000","last_fullsized":"2024-05-08T18:31:14.738304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:55.793312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":102,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.718585+0000","last_change":"2024-05-08T18:29:40.530634+0000","last_active":"2024-05-08T18:31:13.718585+0000","last_peered":"2024-05-08T18:31:13.718585+0000","last_clean":"2024-05-08T18:31:13.718585+0000","last_became_active":"2024-05-08T18:29:40.529804+0000","last_became_peered":"2024-05-08T18:29:40.529804+0000","last_unstale":"2024-05-08T18:31:13.718585+0000","last_undegraded":"2024-05-08T18:31:13.718585+0000","last_fullsized":"2024-05-08T18:31:13.718585+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:59:25.840149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"26'1","reported_seq":96,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.740581+0000","last_change":"2024-05-08T18:29:44.584678+0000","last_active":"2024-05-08T18:31:14.740581+0000","last_peered":"2024-05-08T18:31:14.740581+0000","last_clean":"2024-05-08T18:31:14.740581+0000","last_became_active":"2024-05-08T18:29:44.584227+0000","last_became_peered":"2024-05-08T18:29:44.584227+0000","last_unstale":"2024-05-08T18:31:14.740581+0000","last_undegraded":"2024-05-08T18:31:14.740581+0000","last_fullsized":"2024-05-08T18:31:14.740581+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:04:01.281207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'15","reported_seq":132,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.262088+0000","last_change":"2024-05-08T18:29:46.608720+0000","last_active":"2024-05-08T18:31:16.262088+0000","last_peered":"2024-05-08T18:31:16.262088+0000","last_clean":"2024-05-08T18:31:16.262088+0000","last_became_active":"2024-05-08T18:29:46.607989+0000","last_became_peered":"2024-05-08T18:29:46.607989+0000","last_unstale":"2024-05-08T18:31:16.262088+0000","last_undegraded":"2024-05-08T18:31:16.262088+0000","last_fullsized":"2024-05-08T18:31:16.262088+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:58:31.293922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":86,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.722122+0000","last_change":"2024-05-08T18:29:48.625269+0000","last_active":"2024-05-08T18:31:13.722122+0000","last_peered":"2024-05-08T18:31:13.722122+0000","last_clean":"2024-05-08T18:31:13.722122+0000","last_became_active":"2024-05-08T18:29:48.624545+0000","last_became_peered":"2024-05-08T18:29:48.624545+0000","last_unstale":"2024-05-08T18:31:13.722122+0000","last_undegraded":"2024-05-08T18:31:13.722122+0000","last_fullsized":"2024-05-08T18:31:13.722122+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:16:42.799734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":84,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.748205+0000","last_change":"2024-05-08T18:29:50.688851+0000","last_active":"2024-05-08T18:31:14.748205+0000","last_peered":"2024-05-08T18:31:14.748205+0000","last_clean":"2024-05-08T18:31:14.748205+0000","last_became_active":"2024-05-08T18:29:50.687978+0000","last_became_peered":"2024-05-08T18:29:50.687978+0000","last_unstale":"2024-05-08T18:31:14.748205+0000","last_undegraded":"2024-05-08T18:31:14.748205+0000","last_fullsized":"2024-05-08T18:31:14.748205+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:28:29.836446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":98,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.720237+0000","last_change":"2024-05-08T18:29:42.574606+0000","last_active":"2024-05-08T18:31:13.720237+0000","last_peered":"2024-05-08T18:31:13.720237+0000","last_clean":"2024-05-08T18:31:13.720237+0000","last_became_active":"2024-05-08T18:29:42.573656+0000","last_became_peered":"2024-05-08T18:29:42.573656+0000","last_unstale":"2024-05-08T18:31:13.720237+0000","last_undegraded":"2024-05-08T18:31:13.720237+0000","last_fullsized":"2024-05-08T18:31:13.720237+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:54:16.539832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":109,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.632766+0000","last_change":"2024-05-08T18:29:34.496942+0000","last_active":"2024-05-08T18:31:15.632766+0000","last_peered":"2024-05-08T18:31:15.632766+0000","last_clean":"2024-05-08T18:31:15.632766+0000","last_became_active":"2024-05-08T18:29:34.495882+0000","last_became_peered":"2024-05-08T18:29:34.495882+0000","last_unstale":"2024-05-08T18:31:15.632766+0000","last_undegraded":"2024-05-08T18:31:15.632766+0000","last_fullsized":"2024-05-08T18:31:15.632766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:55.793312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":106,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.742878+0000","last_change":"2024-05-08T18:29:40.554353+0000","last_active":"2024-05-08T18:31:15.742878+0000","last_peered":"2024-05-08T18:31:15.742878+0000","last_clean":"2024-05-08T18:31:15.742878+0000","last_became_active":"2024-05-08T18:29:40.553527+0000","last_became_peered":"2024-05-08T18:29:40.553527+0000","last_unstale":"2024-05-08T18:31:15.742878+0000","last_undegraded":"2024-05-08T18:31:15.742878+0000","last_fullsized":"2024-05-08T18:31:15.742878+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:03:42.148647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":94,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.722912+0000","last_change":"2024-05-08T18:29:44.597411+0000","last_active":"2024-05-08T18:31:13.722912+0000","last_peered":"2024-05-08T18:31:13.722912+0000","last_clean":"2024-05-08T18:31:13.722912+0000","last_became_active":"2024-05-08T18:29:44.596678+0000","last_became_peered":"2024-05-08T18:29:44.596678+0000","last_unstale":"2024-05-08T18:31:13.722912+0000","last_undegraded":"2024-05-08T18:31:13.722912+0000","last_fullsized":"2024-05-08T18:31:13.722912+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:37:23.674968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'12","reported_seq":110,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.748348+0000","last_change":"2024-05-08T18:29:46.607040+0000","last_active":"2024-05-08T18:31:14.748348+0000","last_peered":"2024-05-08T18:31:14.748348+0000","last_clean":"2024-05-08T18:31:14.748348+0000","last_became_active":"2024-05-08T18:29:46.606367+0000","last_became_peered":"2024-05-08T18:29:46.606367+0000","last_unstale":"2024-05-08T18:31:14.748348+0000","last_undegraded":"2024-05-08T18:31:14.748348+0000","last_fullsized":"2024-05-08T18:31:14.748348+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:59:26.650126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":88,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.737779+0000","last_change":"2024-05-08T18:29:48.632665+0000","last_active":"2024-05-08T18:31:14.737779+0000","last_peered":"2024-05-08T18:31:14.737779+0000","last_clean":"2024-05-08T18:31:14.737779+0000","last_became_active":"2024-05-08T18:29:48.631874+0000","last_became_peered":"2024-05-08T18:29:48.631874+0000","last_unstale":"2024-05-08T18:31:14.737779+0000","last_undegraded":"2024-05-08T18:31:14.737779+0000","last_fullsized":"2024-05-08T18:31:14.737779+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:06:09.390017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":83,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.631156+0000","last_change":"2024-05-08T18:29:50.683443+0000","last_active":"2024-05-08T18:31:15.631156+0000","last_peered":"2024-05-08T18:31:15.631156+0000","last_clean":"2024-05-08T18:31:15.631156+0000","last_became_active":"2024-05-08T18:29:50.682634+0000","last_became_peered":"2024-05-08T18:29:50.682634+0000","last_unstale":"2024-05-08T18:31:15.631156+0000","last_undegraded":"2024-05-08T18:31:15.631156+0000","last_fullsized":"2024-05-08T18:31:15.631156+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:10:38.951662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":98,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.720037+0000","last_change":"2024-05-08T18:29:42.574593+0000","last_active":"2024-05-08T18:31:13.720037+0000","last_peered":"2024-05-08T18:31:13.720037+0000","last_clean":"2024-05-08T18:31:13.720037+0000","last_became_active":"2024-05-08T18:29:42.574288+0000","last_became_peered":"2024-05-08T18:29:42.574288+0000","last_unstale":"2024-05-08T18:31:13.720037+0000","last_undegraded":"2024-05-08T18:31:13.720037+0000","last_fullsized":"2024-05-08T18:31:13.720037+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:58.320701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":53,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.738757+0000","last_change":"2024-05-08T18:30:20.850805+0000","last_active":"2024-05-08T18:31:14.738757+0000","last_peered":"2024-05-08T18:31:14.738757+0000","last_clean":"2024-05-08T18:31:14.738757+0000","last_became_active":"2024-05-08T18:30:20.850365+0000","last_became_peered":"2024-05-08T18:30:20.850365+0000","last_unstale":"2024-05-08T18:31:14.738757+0000","last_undegraded":"2024-05-08T18:31:14.738757+0000","last_fullsized":"2024-05-08T18:31:14.738757+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:52:21.678894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":108,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.720367+0000","last_change":"2024-05-08T18:29:34.606393+0000","last_active":"2024-05-08T18:31:13.720367+0000","last_peered":"2024-05-08T18:31:13.720367+0000","last_clean":"2024-05-08T18:31:13.720367+0000","last_became_active":"2024-05-08T18:29:34.605574+0000","last_became_peered":"2024-05-08T18:29:34.605574+0000","last_unstale":"2024-05-08T18:31:13.720367+0000","last_undegraded":"2024-05-08T18:31:13.720367+0000","last_fullsized":"2024-05-08T18:31:13.720367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:55.793312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":94,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.722198+0000","last_change":"2024-05-08T18:29:44.595127+0000","last_active":"2024-05-08T18:31:13.722198+0000","last_peered":"2024-05-08T18:31:13.722198+0000","last_clean":"2024-05-08T18:31:13.722198+0000","last_became_active":"2024-05-08T18:29:44.594642+0000","last_became_peered":"2024-05-08T18:29:44.594642+0000","last_unstale":"2024-05-08T18:31:13.722198+0000","last_undegraded":"2024-05-08T18:31:13.722198+0000","last_fullsized":"2024-05-08T18:31:13.722198+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:04:49.020450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"33'18","reported_seq":122,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.721722+0000","last_change":"2024-05-08T18:29:46.602279+0000","last_active":"2024-05-08T18:31:13.721722+0000","last_peered":"2024-05-08T18:31:13.721722+0000","last_clean":"2024-05-08T18:31:13.721722+0000","last_became_active":"2024-05-08T18:29:46.599707+0000","last_became_peered":"2024-05-08T18:29:46.599707+0000","last_unstale":"2024-05-08T18:31:13.721722+0000","last_undegraded":"2024-05-08T18:31:13.721722+0000","last_fullsized":"2024-05-08T18:31:13.721722+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:54:48.654215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":90,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.741708+0000","last_change":"2024-05-08T18:29:48.639458+0000","last_active":"2024-05-08T18:31:15.741708+0000","last_peered":"2024-05-08T18:31:15.741708+0000","last_clean":"2024-05-08T18:31:15.741708+0000","last_became_active":"2024-05-08T18:29:48.638709+0000","last_became_peered":"2024-05-08T18:29:48.638709+0000","last_unstale":"2024-05-08T18:31:15.741708+0000","last_undegraded":"2024-05-08T18:31:15.741708+0000","last_fullsized":"2024-05-08T18:31:15.741708+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:19:58.182291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":82,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.723086+0000","last_change":"2024-05-08T18:29:50.681077+0000","last_active":"2024-05-08T18:31:13.723086+0000","last_peered":"2024-05-08T18:31:13.723086+0000","last_clean":"2024-05-08T18:31:13.723086+0000","last_became_active":"2024-05-08T18:29:50.675766+0000","last_became_peered":"2024-05-08T18:29:50.675766+0000","last_unstale":"2024-05-08T18:31:13.723086+0000","last_undegraded":"2024-05-08T18:31:13.723086+0000","last_fullsized":"2024-05-08T18:31:13.723086+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:09:29.641515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":98,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.722515+0000","last_change":"2024-05-08T18:29:42.571265+0000","last_active":"2024-05-08T18:31:13.722515+0000","last_peered":"2024-05-08T18:31:13.722515+0000","last_clean":"2024-05-08T18:31:13.722515+0000","last_became_active":"2024-05-08T18:29:42.570645+0000","last_became_peered":"2024-05-08T18:29:42.570645+0000","last_unstale":"2024-05-08T18:31:13.722515+0000","last_undegraded":"2024-05-08T18:31:13.722515+0000","last_fullsized":"2024-05-08T18:31:13.722515+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:30:29.452640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":102,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.720282+0000","last_change":"2024-05-08T18:29:40.531079+0000","last_active":"2024-05-08T18:31:13.720282+0000","last_peered":"2024-05-08T18:31:13.720282+0000","last_clean":"2024-05-08T18:31:13.720282+0000","last_became_active":"2024-05-08T18:29:40.530256+0000","last_became_peered":"2024-05-08T18:29:40.530256+0000","last_unstale":"2024-05-08T18:31:13.720282+0000","last_undegraded":"2024-05-08T18:31:13.720282+0000","last_fullsized":"2024-05-08T18:31:13.720282+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:09:42.581976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":111,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.262613+0000","last_change":"2024-05-08T18:29:34.603292+0000","last_active":"2024-05-08T18:31:16.262613+0000","last_peered":"2024-05-08T18:31:16.262613+0000","last_clean":"2024-05-08T18:31:16.262613+0000","last_became_active":"2024-05-08T18:29:34.602547+0000","last_became_peered":"2024-05-08T18:29:34.602547+0000","last_unstale":"2024-05-08T18:31:16.262613+0000","last_undegraded":"2024-05-08T18:31:16.262613+0000","last_fullsized":"2024-05-08T18:31:16.262613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:24:55.555475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":96,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.736741+0000","last_change":"2024-05-08T18:29:44.593275+0000","last_active":"2024-05-08T18:31:14.736741+0000","last_peered":"2024-05-08T18:31:14.736741+0000","last_clean":"2024-05-08T18:31:14.736741+0000","last_became_active":"2024-05-08T18:29:44.591870+0000","last_became_peered":"2024-05-08T18:29:44.591870+0000","last_unstale":"2024-05-08T18:31:14.736741+0000","last_undegraded":"2024-05-08T18:31:14.736741+0000","last_fullsized":"2024-05-08T18:31:14.736741+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:35.176971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"33'14","reported_seq":111,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.718464+0000","last_change":"2024-05-08T18:29:46.603499+0000","last_active":"2024-05-08T18:31:13.718464+0000","last_peered":"2024-05-08T18:31:13.718464+0000","last_clean":"2024-05-08T18:31:13.718464+0000","last_became_active":"2024-05-08T18:29:46.602920+0000","last_became_peered":"2024-05-08T18:29:46.602920+0000","last_unstale":"2024-05-08T18:31:13.718464+0000","last_undegraded":"2024-05-08T18:31:13.718464+0000","last_fullsized":"2024-05-08T18:31:13.718464+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:08.504882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"30'2","reported_seq":107,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.631973+0000","last_change":"2024-05-08T18:29:48.634915+0000","last_active":"2024-05-08T18:31:15.631973+0000","last_peered":"2024-05-08T18:31:15.631973+0000","last_clean":"2024-05-08T18:31:15.631973+0000","last_became_active":"2024-05-08T18:29:48.634280+0000","last_became_peered":"2024-05-08T18:29:48.634280+0000","last_unstale":"2024-05-08T18:31:15.631973+0000","last_undegraded":"2024-05-08T18:31:15.631973+0000","last_fullsized":"2024-05-08T18:31:15.631973+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:19:58.182291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":84,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.748900+0000","last_change":"2024-05-08T18:29:50.688742+0000","last_active":"2024-05-08T18:31:14.748900+0000","last_peered":"2024-05-08T18:31:14.748900+0000","last_clean":"2024-05-08T18:31:14.748900+0000","last_became_active":"2024-05-08T18:29:50.687135+0000","last_became_peered":"2024-05-08T18:29:50.687135+0000","last_unstale":"2024-05-08T18:31:14.748900+0000","last_undegraded":"2024-05-08T18:31:14.748900+0000","last_fullsized":"2024-05-08T18:31:14.748900+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:12:49.040807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":53,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.737358+0000","last_change":"2024-05-08T18:30:21.220561+0000","last_active":"2024-05-08T18:31:14.737358+0000","last_peered":"2024-05-08T18:31:14.737358+0000","last_clean":"2024-05-08T18:31:14.737358+0000","last_became_active":"2024-05-08T18:30:21.220196+0000","last_became_peered":"2024-05-08T18:30:21.220196+0000","last_unstale":"2024-05-08T18:31:14.737358+0000","last_undegraded":"2024-05-08T18:31:14.737358+0000","last_fullsized":"2024-05-08T18:31:14.737358+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:19:27.075761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.746011+0000","last_change":"2024-05-08T18:29:40.565872+0000","last_active":"2024-05-08T18:31:14.746011+0000","last_peered":"2024-05-08T18:31:14.746011+0000","last_clean":"2024-05-08T18:31:14.746011+0000","last_became_active":"2024-05-08T18:29:40.565655+0000","last_became_peered":"2024-05-08T18:29:40.565655+0000","last_unstale":"2024-05-08T18:31:14.746011+0000","last_undegraded":"2024-05-08T18:31:14.746011+0000","last_fullsized":"2024-05-08T18:31:14.746011+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:16:16.521258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":108,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.723560+0000","last_change":"2024-05-08T18:29:34.501273+0000","last_active":"2024-05-08T18:31:13.723560+0000","last_peered":"2024-05-08T18:31:13.723560+0000","last_clean":"2024-05-08T18:31:13.723560+0000","last_became_active":"2024-05-08T18:29:34.500933+0000","last_became_peered":"2024-05-08T18:29:34.500933+0000","last_unstale":"2024-05-08T18:31:13.723560+0000","last_undegraded":"2024-05-08T18:31:13.723560+0000","last_fullsized":"2024-05-08T18:31:13.723560+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:35.917391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":98,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.741966+0000","last_change":"2024-05-08T18:29:44.576227+0000","last_active":"2024-05-08T18:31:15.741966+0000","last_peered":"2024-05-08T18:31:15.741966+0000","last_clean":"2024-05-08T18:31:15.741966+0000","last_became_active":"2024-05-08T18:29:44.575454+0000","last_became_peered":"2024-05-08T18:29:44.575454+0000","last_unstale":"2024-05-08T18:31:15.741966+0000","last_undegraded":"2024-05-08T18:31:15.741966+0000","last_fullsized":"2024-05-08T18:31:15.741966+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:06:05.355648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"33'10","reported_seq":109,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.743668+0000","last_change":"2024-05-08T18:29:46.609633+0000","last_active":"2024-05-08T18:31:15.743668+0000","last_peered":"2024-05-08T18:31:15.743668+0000","last_clean":"2024-05-08T18:31:15.743668+0000","last_became_active":"2024-05-08T18:29:46.603455+0000","last_became_peered":"2024-05-08T18:29:46.603455+0000","last_unstale":"2024-05-08T18:31:15.743668+0000","last_undegraded":"2024-05-08T18:31:15.743668+0000","last_fullsized":"2024-05-08T18:31:15.743668+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:07:54.654205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"30'2","reported_seq":108,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.748725+0000","last_change":"2024-05-08T18:29:48.637898+0000","last_active":"2024-05-08T18:31:14.748725+0000","last_peered":"2024-05-08T18:31:14.748725+0000","last_clean":"2024-05-08T18:31:14.748725+0000","last_became_active":"2024-05-08T18:29:48.637070+0000","last_became_peered":"2024-05-08T18:29:48.637070+0000","last_unstale":"2024-05-08T18:31:14.748725+0000","last_undegraded":"2024-05-08T18:31:14.748725+0000","last_fullsized":"2024-05-08T18:31:14.748725+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:03:46.392864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":82,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.722211+0000","last_change":"2024-05-08T18:29:50.691526+0000","last_active":"2024-05-08T18:31:13.722211+0000","last_peered":"2024-05-08T18:31:13.722211+0000","last_clean":"2024-05-08T18:31:13.722211+0000","last_became_active":"2024-05-08T18:29:50.690767+0000","last_became_peered":"2024-05-08T18:29:50.690767+0000","last_unstale":"2024-05-08T18:31:13.722211+0000","last_undegraded":"2024-05-08T18:31:13.722211+0000","last_fullsized":"2024-05-08T18:31:13.722211+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:32:29.972139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":102,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.742191+0000","last_change":"2024-05-08T18:29:42.562006+0000","last_active":"2024-05-08T18:31:15.742191+0000","last_peered":"2024-05-08T18:31:15.742191+0000","last_clean":"2024-05-08T18:31:15.742191+0000","last_became_active":"2024-05-08T18:29:42.560861+0000","last_became_peered":"2024-05-08T18:29:42.560861+0000","last_unstale":"2024-05-08T18:31:15.742191+0000","last_undegraded":"2024-05-08T18:31:15.742191+0000","last_fullsized":"2024-05-08T18:31:15.742191+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:36.890277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":102,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.726017+0000","last_change":"2024-05-08T18:29:40.550529+0000","last_active":"2024-05-08T18:31:13.726017+0000","last_peered":"2024-05-08T18:31:13.726017+0000","last_clean":"2024-05-08T18:31:13.726017+0000","last_became_active":"2024-05-08T18:29:40.550241+0000","last_became_peered":"2024-05-08T18:29:40.550241+0000","last_unstale":"2024-05-08T18:31:13.726017+0000","last_undegraded":"2024-05-08T18:31:13.726017+0000","last_fullsized":"2024-05-08T18:31:13.726017+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:48.294532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":110,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.738403+0000","last_change":"2024-05-08T18:29:34.493537+0000","last_active":"2024-05-08T18:31:14.738403+0000","last_peered":"2024-05-08T18:31:14.738403+0000","last_clean":"2024-05-08T18:31:14.738403+0000","last_became_active":"2024-05-08T18:29:34.492891+0000","last_became_peered":"2024-05-08T18:29:34.492891+0000","last_unstale":"2024-05-08T18:31:14.738403+0000","last_undegraded":"2024-05-08T18:31:14.738403+0000","last_fullsized":"2024-05-08T18:31:14.738403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:09:07.992256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":96,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.744847+0000","last_change":"2024-05-08T18:29:44.590102+0000","last_active":"2024-05-08T18:31:14.744847+0000","last_peered":"2024-05-08T18:31:14.744847+0000","last_clean":"2024-05-08T18:31:14.744847+0000","last_became_active":"2024-05-08T18:29:44.589471+0000","last_became_peered":"2024-05-08T18:29:44.589471+0000","last_unstale":"2024-05-08T18:31:14.744847+0000","last_undegraded":"2024-05-08T18:31:14.744847+0000","last_fullsized":"2024-05-08T18:31:14.744847+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:14:04.085401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"33'19","reported_seq":129,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.261498+0000","last_change":"2024-05-08T18:29:46.606967+0000","last_active":"2024-05-08T18:31:16.261498+0000","last_peered":"2024-05-08T18:31:16.261498+0000","last_clean":"2024-05-08T18:31:16.261498+0000","last_became_active":"2024-05-08T18:29:46.605693+0000","last_became_peered":"2024-05-08T18:29:46.605693+0000","last_unstale":"2024-05-08T18:31:16.261498+0000","last_undegraded":"2024-05-08T18:31:16.261498+0000","last_fullsized":"2024-05-08T18:31:16.261498+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:24:13.568294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":88,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.745500+0000","last_change":"2024-05-08T18:29:48.634271+0000","last_active":"2024-05-08T18:31:14.745500+0000","last_peered":"2024-05-08T18:31:14.745500+0000","last_clean":"2024-05-08T18:31:14.745500+0000","last_became_active":"2024-05-08T18:29:48.633607+0000","last_became_peered":"2024-05-08T18:29:48.633607+0000","last_unstale":"2024-05-08T18:31:14.745500+0000","last_undegraded":"2024-05-08T18:31:14.745500+0000","last_fullsized":"2024-05-08T18:31:14.745500+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:34.806539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":83,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.631978+0000","last_change":"2024-05-08T18:29:50.685494+0000","last_active":"2024-05-08T18:31:15.631978+0000","last_peered":"2024-05-08T18:31:15.631978+0000","last_clean":"2024-05-08T18:31:15.631978+0000","last_became_active":"2024-05-08T18:29:50.684818+0000","last_became_peered":"2024-05-08T18:29:50.684818+0000","last_unstale":"2024-05-08T18:31:15.631978+0000","last_undegraded":"2024-05-08T18:31:15.631978+0000","last_fullsized":"2024-05-08T18:31:15.631978+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:22.220842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":82,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.723200+0000","last_change":"2024-05-08T18:29:50.682937+0000","last_active":"2024-05-08T18:31:13.723200+0000","last_peered":"2024-05-08T18:31:13.723200+0000","last_clean":"2024-05-08T18:31:13.723200+0000","last_became_active":"2024-05-08T18:29:50.681771+0000","last_became_peered":"2024-05-08T18:29:50.681771+0000","last_unstale":"2024-05-08T18:31:13.723200+0000","last_undegraded":"2024-05-08T18:31:13.723200+0000","last_fullsized":"2024-05-08T18:31:13.723200+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:28:29.836446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":102,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.742504+0000","last_change":"2024-05-08T18:29:42.575909+0000","last_active":"2024-05-08T18:31:15.742504+0000","last_peered":"2024-05-08T18:31:15.742504+0000","last_clean":"2024-05-08T18:31:15.742504+0000","last_became_active":"2024-05-08T18:29:42.574877+0000","last_became_peered":"2024-05-08T18:29:42.574877+0000","last_unstale":"2024-05-08T18:31:15.742504+0000","last_undegraded":"2024-05-08T18:31:15.742504+0000","last_fullsized":"2024-05-08T18:31:15.742504+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:33.139089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":106,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.742264+0000","last_change":"2024-05-08T18:29:40.566496+0000","last_active":"2024-05-08T18:31:15.742264+0000","last_peered":"2024-05-08T18:31:15.742264+0000","last_clean":"2024-05-08T18:31:15.742264+0000","last_became_active":"2024-05-08T18:29:40.565874+0000","last_became_peered":"2024-05-08T18:29:40.565874+0000","last_unstale":"2024-05-08T18:31:15.742264+0000","last_undegraded":"2024-05-08T18:31:15.742264+0000","last_fullsized":"2024-05-08T18:31:15.742264+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:07.239963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":94,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.720168+0000","last_change":"2024-05-08T18:29:44.595410+0000","last_active":"2024-05-08T18:31:13.720168+0000","last_peered":"2024-05-08T18:31:13.720168+0000","last_clean":"2024-05-08T18:31:13.720168+0000","last_became_active":"2024-05-08T18:29:44.594286+0000","last_became_peered":"2024-05-08T18:29:44.594286+0000","last_unstale":"2024-05-08T18:31:13.720168+0000","last_undegraded":"2024-05-08T18:31:13.720168+0000","last_fullsized":"2024-05-08T18:31:13.720168+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:38.928160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"33'11","reported_seq":111,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.745393+0000","last_change":"2024-05-08T18:29:46.591009+0000","last_active":"2024-05-08T18:31:14.745393+0000","last_peered":"2024-05-08T18:31:14.745393+0000","last_clean":"2024-05-08T18:31:14.745393+0000","last_became_active":"2024-05-08T18:29:46.588810+0000","last_became_peered":"2024-05-08T18:29:46.588810+0000","last_unstale":"2024-05-08T18:31:14.745393+0000","last_undegraded":"2024-05-08T18:31:14.745393+0000","last_fullsized":"2024-05-08T18:31:14.745393+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:34:45.745300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":88,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.744717+0000","last_change":"2024-05-08T18:29:48.634986+0000","last_active":"2024-05-08T18:31:14.744717+0000","last_peered":"2024-05-08T18:31:14.744717+0000","last_clean":"2024-05-08T18:31:14.744717+0000","last_became_active":"2024-05-08T18:29:48.633866+0000","last_became_peered":"2024-05-08T18:29:48.633866+0000","last_unstale":"2024-05-08T18:31:14.744717+0000","last_undegraded":"2024-05-08T18:31:14.744717+0000","last_fullsized":"2024-05-08T18:31:14.744717+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:46.539830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":84,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.746135+0000","last_change":"2024-05-08T18:29:50.693408+0000","last_active":"2024-05-08T18:31:14.746135+0000","last_peered":"2024-05-08T18:31:14.746135+0000","last_clean":"2024-05-08T18:31:14.746135+0000","last_became_active":"2024-05-08T18:29:50.692687+0000","last_became_peered":"2024-05-08T18:29:50.692687+0000","last_unstale":"2024-05-08T18:31:14.746135+0000","last_undegraded":"2024-05-08T18:31:14.746135+0000","last_fullsized":"2024-05-08T18:31:14.746135+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:22.834262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":98,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.719956+0000","last_change":"2024-05-08T18:29:42.581368+0000","last_active":"2024-05-08T18:31:13.719956+0000","last_peered":"2024-05-08T18:31:13.719956+0000","last_clean":"2024-05-08T18:31:13.719956+0000","last_became_active":"2024-05-08T18:29:42.580887+0000","last_became_peered":"2024-05-08T18:29:42.580887+0000","last_unstale":"2024-05-08T18:31:13.719956+0000","last_undegraded":"2024-05-08T18:31:13.719956+0000","last_fullsized":"2024-05-08T18:31:13.719956+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:08:15.026467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":105,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.262343+0000","last_change":"2024-05-08T18:29:40.572770+0000","last_active":"2024-05-08T18:31:16.262343+0000","last_peered":"2024-05-08T18:31:16.262343+0000","last_clean":"2024-05-08T18:31:16.262343+0000","last_became_active":"2024-05-08T18:29:40.572079+0000","last_became_peered":"2024-05-08T18:29:40.572079+0000","last_unstale":"2024-05-08T18:31:16.262343+0000","last_undegraded":"2024-05-08T18:31:16.262343+0000","last_fullsized":"2024-05-08T18:31:16.262343+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:05.929806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":96,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.748089+0000","last_change":"2024-05-08T18:29:44.581323+0000","last_active":"2024-05-08T18:31:14.748089+0000","last_peered":"2024-05-08T18:31:14.748089+0000","last_clean":"2024-05-08T18:31:14.748089+0000","last_became_active":"2024-05-08T18:29:44.580805+0000","last_became_peered":"2024-05-08T18:29:44.580805+0000","last_unstale":"2024-05-08T18:31:14.748089+0000","last_undegraded":"2024-05-08T18:31:14.748089+0000","last_fullsized":"2024-05-08T18:31:14.748089+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:35:25.591140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"47'5","reported_seq":97,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.721567+0000","last_change":"2024-05-08T18:29:46.602495+0000","last_active":"2024-05-08T18:31:13.721567+0000","last_peered":"2024-05-08T18:31:13.721567+0000","last_clean":"2024-05-08T18:31:13.721567+0000","last_became_active":"2024-05-08T18:29:46.599789+0000","last_became_peered":"2024-05-08T18:29:46.599789+0000","last_unstale":"2024-05-08T18:31:13.721567+0000","last_undegraded":"2024-05-08T18:31:13.721567+0000","last_fullsized":"2024-05-08T18:31:13.721567+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:18:16.375808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":89,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.261028+0000","last_change":"2024-05-08T18:29:48.642994+0000","last_active":"2024-05-08T18:31:16.261028+0000","last_peered":"2024-05-08T18:31:16.261028+0000","last_clean":"2024-05-08T18:31:16.261028+0000","last_became_active":"2024-05-08T18:29:48.642056+0000","last_became_peered":"2024-05-08T18:29:48.642056+0000","last_unstale":"2024-05-08T18:31:16.261028+0000","last_undegraded":"2024-05-08T18:31:16.261028+0000","last_fullsized":"2024-05-08T18:31:16.261028+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:47:54.034851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":82,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.722073+0000","last_change":"2024-05-08T18:29:50.672513+0000","last_active":"2024-05-08T18:31:13.722073+0000","last_peered":"2024-05-08T18:31:13.722073+0000","last_clean":"2024-05-08T18:31:13.722073+0000","last_became_active":"2024-05-08T18:29:50.671781+0000","last_became_peered":"2024-05-08T18:29:50.671781+0000","last_unstale":"2024-05-08T18:31:13.722073+0000","last_undegraded":"2024-05-08T18:31:13.722073+0000","last_fullsized":"2024-05-08T18:31:13.722073+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:45:34.171402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.745742+0000","last_change":"2024-05-08T18:29:42.576843+0000","last_active":"2024-05-08T18:31:14.745742+0000","last_peered":"2024-05-08T18:31:14.745742+0000","last_clean":"2024-05-08T18:31:14.745742+0000","last_became_active":"2024-05-08T18:29:42.576379+0000","last_became_peered":"2024-05-08T18:29:42.576379+0000","last_unstale":"2024-05-08T18:31:14.745742+0000","last_undegraded":"2024-05-08T18:31:14.745742+0000","last_fullsized":"2024-05-08T18:31:14.745742+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:20.471010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.633032+0000","last_change":"2024-05-08T18:29:40.542997+0000","last_active":"2024-05-08T18:31:15.633032+0000","last_peered":"2024-05-08T18:31:15.633032+0000","last_clean":"2024-05-08T18:31:15.633032+0000","last_became_active":"2024-05-08T18:29:40.542239+0000","last_became_peered":"2024-05-08T18:29:40.542239+0000","last_unstale":"2024-05-08T18:31:15.633032+0000","last_undegraded":"2024-05-08T18:31:15.633032+0000","last_fullsized":"2024-05-08T18:31:15.633032+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:14:43.555504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":97,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.260475+0000","last_change":"2024-05-08T18:29:44.594178+0000","last_active":"2024-05-08T18:31:16.260475+0000","last_peered":"2024-05-08T18:31:16.260475+0000","last_clean":"2024-05-08T18:31:16.260475+0000","last_became_active":"2024-05-08T18:29:44.592476+0000","last_became_peered":"2024-05-08T18:29:44.592476+0000","last_unstale":"2024-05-08T18:31:16.260475+0000","last_undegraded":"2024-05-08T18:31:16.260475+0000","last_fullsized":"2024-05-08T18:31:16.260475+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:04:16.093662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"33'11","reported_seq":111,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.745728+0000","last_change":"2024-05-08T18:29:46.597288+0000","last_active":"2024-05-08T18:31:14.745728+0000","last_peered":"2024-05-08T18:31:14.745728+0000","last_clean":"2024-05-08T18:31:14.745728+0000","last_became_active":"2024-05-08T18:29:46.596452+0000","last_became_peered":"2024-05-08T18:29:46.596452+0000","last_unstale":"2024-05-08T18:31:14.745728+0000","last_undegraded":"2024-05-08T18:31:14.745728+0000","last_fullsized":"2024-05-08T18:31:14.745728+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:32:43.245753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":88,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.736656+0000","last_change":"2024-05-08T18:29:48.635436+0000","last_active":"2024-05-08T18:31:14.736656+0000","last_peered":"2024-05-08T18:31:14.736656+0000","last_clean":"2024-05-08T18:31:14.736656+0000","last_became_active":"2024-05-08T18:29:48.634704+0000","last_became_peered":"2024-05-08T18:29:48.634704+0000","last_unstale":"2024-05-08T18:31:14.736656+0000","last_undegraded":"2024-05-08T18:31:14.736656+0000","last_fullsized":"2024-05-08T18:31:14.736656+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:55:52.238481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":83,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.631667+0000","last_change":"2024-05-08T18:29:50.687974+0000","last_active":"2024-05-08T18:31:15.631667+0000","last_peered":"2024-05-08T18:31:15.631667+0000","last_clean":"2024-05-08T18:31:15.631667+0000","last_became_active":"2024-05-08T18:29:50.687045+0000","last_became_peered":"2024-05-08T18:29:50.687045+0000","last_unstale":"2024-05-08T18:31:15.631667+0000","last_undegraded":"2024-05-08T18:31:15.631667+0000","last_fullsized":"2024-05-08T18:31:15.631667+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:55:01.894779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":105,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.745008+0000","last_change":"2024-05-08T18:30:20.850226+0000","last_active":"2024-05-08T18:31:14.745008+0000","last_peered":"2024-05-08T18:31:14.745008+0000","last_clean":"2024-05-08T18:31:14.745008+0000","last_became_active":"2024-05-08T18:30:20.849751+0000","last_became_peered":"2024-05-08T18:30:20.849751+0000","last_unstale":"2024-05-08T18:31:14.745008+0000","last_undegraded":"2024-05-08T18:31:14.745008+0000","last_fullsized":"2024-05-08T18:31:14.745008+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:33:31.550958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":102,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.725705+0000","last_change":"2024-05-08T18:29:40.541112+0000","last_active":"2024-05-08T18:31:13.725705+0000","last_peered":"2024-05-08T18:31:13.725705+0000","last_clean":"2024-05-08T18:31:13.725705+0000","last_became_active":"2024-05-08T18:29:40.540835+0000","last_became_peered":"2024-05-08T18:29:40.540835+0000","last_unstale":"2024-05-08T18:31:13.725705+0000","last_undegraded":"2024-05-08T18:31:13.725705+0000","last_fullsized":"2024-05-08T18:31:13.725705+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:43:14.995191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":96,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.736618+0000","last_change":"2024-05-08T18:29:44.592033+0000","last_active":"2024-05-08T18:31:14.736618+0000","last_peered":"2024-05-08T18:31:14.736618+0000","last_clean":"2024-05-08T18:31:14.736618+0000","last_became_active":"2024-05-08T18:29:44.590454+0000","last_became_peered":"2024-05-08T18:29:44.590454+0000","last_unstale":"2024-05-08T18:31:14.736618+0000","last_undegraded":"2024-05-08T18:31:14.736618+0000","last_fullsized":"2024-05-08T18:31:14.736618+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:11:03.740365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"33'9","reported_seq":109,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.260988+0000","last_change":"2024-05-08T18:29:46.607002+0000","last_active":"2024-05-08T18:31:16.260988+0000","last_peered":"2024-05-08T18:31:16.260988+0000","last_clean":"2024-05-08T18:31:16.260988+0000","last_became_active":"2024-05-08T18:29:46.606172+0000","last_became_peered":"2024-05-08T18:29:46.606172+0000","last_unstale":"2024-05-08T18:31:16.260988+0000","last_undegraded":"2024-05-08T18:31:16.260988+0000","last_fullsized":"2024-05-08T18:31:16.260988+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:37:35.850414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":86,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.721204+0000","last_change":"2024-05-08T18:29:48.632948+0000","last_active":"2024-05-08T18:31:13.721204+0000","last_peered":"2024-05-08T18:31:13.721204+0000","last_clean":"2024-05-08T18:31:13.721204+0000","last_became_active":"2024-05-08T18:29:48.631219+0000","last_became_peered":"2024-05-08T18:29:48.631219+0000","last_unstale":"2024-05-08T18:31:13.721204+0000","last_undegraded":"2024-05-08T18:31:13.721204+0000","last_fullsized":"2024-05-08T18:31:13.721204+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:19:01.454355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.738247+0000","last_change":"2024-05-08T18:29:42.570180+0000","last_active":"2024-05-08T18:31:14.738247+0000","last_peered":"2024-05-08T18:31:14.738247+0000","last_clean":"2024-05-08T18:31:14.738247+0000","last_became_active":"2024-05-08T18:29:42.569425+0000","last_became_peered":"2024-05-08T18:29:42.569425+0000","last_unstale":"2024-05-08T18:31:14.738247+0000","last_undegraded":"2024-05-08T18:31:14.738247+0000","last_fullsized":"2024-05-08T18:31:14.738247+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:35.037465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.745158+0000","last_change":"2024-05-08T18:29:40.547711+0000","last_active":"2024-05-08T18:31:14.745158+0000","last_peered":"2024-05-08T18:31:14.745158+0000","last_clean":"2024-05-08T18:31:14.745158+0000","last_became_active":"2024-05-08T18:29:40.547479+0000","last_became_peered":"2024-05-08T18:29:40.547479+0000","last_unstale":"2024-05-08T18:31:14.745158+0000","last_undegraded":"2024-05-08T18:31:14.745158+0000","last_fullsized":"2024-05-08T18:31:14.745158+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:12:40.901620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":94,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.723393+0000","last_change":"2024-05-08T18:29:44.591547+0000","last_active":"2024-05-08T18:31:13.723393+0000","last_peered":"2024-05-08T18:31:13.723393+0000","last_clean":"2024-05-08T18:31:13.723393+0000","last_became_active":"2024-05-08T18:29:44.590498+0000","last_became_peered":"2024-05-08T18:29:44.590498+0000","last_unstale":"2024-05-08T18:31:13.723393+0000","last_undegraded":"2024-05-08T18:31:13.723393+0000","last_fullsized":"2024-05-08T18:31:13.723393+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:14:04.085401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"33'12","reported_seq":113,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.720480+0000","last_change":"2024-05-08T18:29:46.600437+0000","last_active":"2024-05-08T18:31:13.720480+0000","last_peered":"2024-05-08T18:31:13.720480+0000","last_clean":"2024-05-08T18:31:13.720480+0000","last_became_active":"2024-05-08T18:29:46.594672+0000","last_became_peered":"2024-05-08T18:29:46.594672+0000","last_unstale":"2024-05-08T18:31:13.720480+0000","last_undegraded":"2024-05-08T18:31:13.720480+0000","last_fullsized":"2024-05-08T18:31:13.720480+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:35:53.294312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":87,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.632181+0000","last_change":"2024-05-08T18:29:48.639840+0000","last_active":"2024-05-08T18:31:15.632181+0000","last_peered":"2024-05-08T18:31:15.632181+0000","last_clean":"2024-05-08T18:31:15.632181+0000","last_became_active":"2024-05-08T18:29:48.639120+0000","last_became_peered":"2024-05-08T18:29:48.639120+0000","last_unstale":"2024-05-08T18:31:15.632181+0000","last_undegraded":"2024-05-08T18:31:15.632181+0000","last_fullsized":"2024-05-08T18:31:15.632181+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:13:50.865474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":84,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.748089+0000","last_change":"2024-05-08T18:29:50.684843+0000","last_active":"2024-05-08T18:31:14.748089+0000","last_peered":"2024-05-08T18:31:14.748089+0000","last_clean":"2024-05-08T18:31:14.748089+0000","last_became_active":"2024-05-08T18:29:50.684119+0000","last_became_peered":"2024-05-08T18:29:50.684119+0000","last_unstale":"2024-05-08T18:31:14.748089+0000","last_undegraded":"2024-05-08T18:31:14.748089+0000","last_fullsized":"2024-05-08T18:31:14.748089+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:09:29.641515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":98,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.725717+0000","last_change":"2024-05-08T18:29:42.575763+0000","last_active":"2024-05-08T18:31:13.725717+0000","last_peered":"2024-05-08T18:31:13.725717+0000","last_clean":"2024-05-08T18:31:13.725717+0000","last_became_active":"2024-05-08T18:29:42.575450+0000","last_became_peered":"2024-05-08T18:29:42.575450+0000","last_unstale":"2024-05-08T18:31:13.725717+0000","last_undegraded":"2024-05-08T18:31:13.725717+0000","last_fullsized":"2024-05-08T18:31:13.725717+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:20.471010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":102,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.719930+0000","last_change":"2024-05-08T18:29:40.546101+0000","last_active":"2024-05-08T18:31:13.719930+0000","last_peered":"2024-05-08T18:31:13.719930+0000","last_clean":"2024-05-08T18:31:13.719930+0000","last_became_active":"2024-05-08T18:29:40.545814+0000","last_became_peered":"2024-05-08T18:29:40.545814+0000","last_unstale":"2024-05-08T18:31:13.719930+0000","last_undegraded":"2024-05-08T18:31:13.719930+0000","last_fullsized":"2024-05-08T18:31:13.719930+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:22.579629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":96,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.738020+0000","last_change":"2024-05-08T18:29:44.591310+0000","last_active":"2024-05-08T18:31:14.738020+0000","last_peered":"2024-05-08T18:31:14.738020+0000","last_clean":"2024-05-08T18:31:14.738020+0000","last_became_active":"2024-05-08T18:29:44.590394+0000","last_became_peered":"2024-05-08T18:29:44.590394+0000","last_unstale":"2024-05-08T18:31:14.738020+0000","last_undegraded":"2024-05-08T18:31:14.738020+0000","last_fullsized":"2024-05-08T18:31:14.738020+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:02:28.348982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"33'15","reported_seq":118,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.261535+0000","last_change":"2024-05-08T18:29:46.605887+0000","last_active":"2024-05-08T18:31:16.261535+0000","last_peered":"2024-05-08T18:31:16.261535+0000","last_clean":"2024-05-08T18:31:16.261535+0000","last_became_active":"2024-05-08T18:29:46.604917+0000","last_became_peered":"2024-05-08T18:29:46.604917+0000","last_unstale":"2024-05-08T18:31:16.261535+0000","last_undegraded":"2024-05-08T18:31:16.261535+0000","last_fullsized":"2024-05-08T18:31:16.261535+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:22:36.338527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":86,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.720587+0000","last_change":"2024-05-08T18:29:48.644420+0000","last_active":"2024-05-08T18:31:13.720587+0000","last_peered":"2024-05-08T18:31:13.720587+0000","last_clean":"2024-05-08T18:31:13.720587+0000","last_became_active":"2024-05-08T18:29:48.643493+0000","last_became_peered":"2024-05-08T18:29:48.643493+0000","last_unstale":"2024-05-08T18:31:13.720587+0000","last_undegraded":"2024-05-08T18:31:13.720587+0000","last_fullsized":"2024-05-08T18:31:13.720587+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:19:33.148012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":84,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.736566+0000","last_change":"2024-05-08T18:29:50.687485+0000","last_active":"2024-05-08T18:31:14.736566+0000","last_peered":"2024-05-08T18:31:14.736566+0000","last_clean":"2024-05-08T18:31:14.736566+0000","last_became_active":"2024-05-08T18:29:50.686750+0000","last_became_peered":"2024-05-08T18:29:50.686750+0000","last_unstale":"2024-05-08T18:31:14.736566+0000","last_undegraded":"2024-05-08T18:31:14.736566+0000","last_fullsized":"2024-05-08T18:31:14.736566+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:41.914164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.746032+0000","last_change":"2024-05-08T18:29:42.566571+0000","last_active":"2024-05-08T18:31:14.746032+0000","last_peered":"2024-05-08T18:31:14.746032+0000","last_clean":"2024-05-08T18:31:14.746032+0000","last_became_active":"2024-05-08T18:29:42.563695+0000","last_became_peered":"2024-05-08T18:29:42.563695+0000","last_unstale":"2024-05-08T18:31:14.746032+0000","last_undegraded":"2024-05-08T18:31:14.746032+0000","last_fullsized":"2024-05-08T18:31:14.746032+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:46.887628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":106,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.744024+0000","last_change":"2024-05-08T18:29:40.545512+0000","last_active":"2024-05-08T18:31:15.744024+0000","last_peered":"2024-05-08T18:31:15.744024+0000","last_clean":"2024-05-08T18:31:15.744024+0000","last_became_active":"2024-05-08T18:29:40.544216+0000","last_became_peered":"2024-05-08T18:29:40.544216+0000","last_unstale":"2024-05-08T18:31:15.744024+0000","last_undegraded":"2024-05-08T18:31:15.744024+0000","last_fullsized":"2024-05-08T18:31:15.744024+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:37:08.242362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":98,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.743045+0000","last_change":"2024-05-08T18:29:44.576107+0000","last_active":"2024-05-08T18:31:15.743045+0000","last_peered":"2024-05-08T18:31:15.743045+0000","last_clean":"2024-05-08T18:31:15.743045+0000","last_became_active":"2024-05-08T18:29:44.575344+0000","last_became_peered":"2024-05-08T18:29:44.575344+0000","last_unstale":"2024-05-08T18:31:15.743045+0000","last_undegraded":"2024-05-08T18:31:15.743045+0000","last_fullsized":"2024-05-08T18:31:15.743045+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:19.731003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"33'11","reported_seq":111,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.749020+0000","last_change":"2024-05-08T18:29:46.584785+0000","last_active":"2024-05-08T18:31:14.749020+0000","last_peered":"2024-05-08T18:31:14.749020+0000","last_clean":"2024-05-08T18:31:14.749020+0000","last_became_active":"2024-05-08T18:29:46.583390+0000","last_became_peered":"2024-05-08T18:29:46.583390+0000","last_unstale":"2024-05-08T18:31:14.749020+0000","last_undegraded":"2024-05-08T18:31:14.749020+0000","last_fullsized":"2024-05-08T18:31:14.749020+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:27:01.747339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":86,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.719664+0000","last_change":"2024-05-08T18:29:48.643558+0000","last_active":"2024-05-08T18:31:13.719664+0000","last_peered":"2024-05-08T18:31:13.719664+0000","last_clean":"2024-05-08T18:31:13.719664+0000","last_became_active":"2024-05-08T18:29:48.642773+0000","last_became_peered":"2024-05-08T18:29:48.642773+0000","last_unstale":"2024-05-08T18:31:13.719664+0000","last_undegraded":"2024-05-08T18:31:13.719664+0000","last_fullsized":"2024-05-08T18:31:13.719664+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:59:04.369806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":83,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.631314+0000","last_change":"2024-05-08T18:29:50.674796+0000","last_active":"2024-05-08T18:31:15.631314+0000","last_peered":"2024-05-08T18:31:15.631314+0000","last_clean":"2024-05-08T18:31:15.631314+0000","last_became_active":"2024-05-08T18:29:50.674057+0000","last_became_peered":"2024-05-08T18:29:50.674057+0000","last_unstale":"2024-05-08T18:31:15.631314+0000","last_undegraded":"2024-05-08T18:31:15.631314+0000","last_fullsized":"2024-05-08T18:31:15.631314+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:34:14.488295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.739651+0000","last_change":"2024-05-08T18:29:42.577642+0000","last_active":"2024-05-08T18:31:14.739651+0000","last_peered":"2024-05-08T18:31:14.739651+0000","last_clean":"2024-05-08T18:31:14.739651+0000","last_became_active":"2024-05-08T18:29:42.577275+0000","last_became_peered":"2024-05-08T18:29:42.577275+0000","last_unstale":"2024-05-08T18:31:14.739651+0000","last_undegraded":"2024-05-08T18:31:14.739651+0000","last_fullsized":"2024-05-08T18:31:14.739651+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:51:45.155037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":102,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.721945+0000","last_change":"2024-05-08T18:29:40.562873+0000","last_active":"2024-05-08T18:31:13.721945+0000","last_peered":"2024-05-08T18:31:13.721945+0000","last_clean":"2024-05-08T18:31:13.721945+0000","last_became_active":"2024-05-08T18:29:40.562594+0000","last_became_peered":"2024-05-08T18:29:40.562594+0000","last_unstale":"2024-05-08T18:31:13.721945+0000","last_undegraded":"2024-05-08T18:31:13.721945+0000","last_fullsized":"2024-05-08T18:31:13.721945+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:16:16.521258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":94,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.720676+0000","last_change":"2024-05-08T18:29:44.594152+0000","last_active":"2024-05-08T18:31:13.720676+0000","last_peered":"2024-05-08T18:31:13.720676+0000","last_clean":"2024-05-08T18:31:13.720676+0000","last_became_active":"2024-05-08T18:29:44.593398+0000","last_became_peered":"2024-05-08T18:29:44.593398+0000","last_unstale":"2024-05-08T18:31:13.720676+0000","last_undegraded":"2024-05-08T18:31:13.720676+0000","last_fullsized":"2024-05-08T18:31:13.720676+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:11.825480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"33'10","reported_seq":109,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.743318+0000","last_change":"2024-05-08T18:29:46.602137+0000","last_active":"2024-05-08T18:31:15.743318+0000","last_peered":"2024-05-08T18:31:15.743318+0000","last_clean":"2024-05-08T18:31:15.743318+0000","last_became_active":"2024-05-08T18:29:46.601402+0000","last_became_peered":"2024-05-08T18:29:46.601402+0000","last_unstale":"2024-05-08T18:31:15.743318+0000","last_undegraded":"2024-05-08T18:31:15.743318+0000","last_fullsized":"2024-05-08T18:31:15.743318+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:23.940519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"30'2","reported_seq":108,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.737958+0000","last_change":"2024-05-08T18:29:48.635696+0000","last_active":"2024-05-08T18:31:14.737958+0000","last_peered":"2024-05-08T18:31:14.737958+0000","last_clean":"2024-05-08T18:31:14.737958+0000","last_became_active":"2024-05-08T18:29:48.634859+0000","last_became_peered":"2024-05-08T18:29:48.634859+0000","last_unstale":"2024-05-08T18:31:14.737958+0000","last_undegraded":"2024-05-08T18:31:14.737958+0000","last_fullsized":"2024-05-08T18:31:14.737958+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:35:55.322495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":85,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.260443+0000","last_change":"2024-05-08T18:29:50.679757+0000","last_active":"2024-05-08T18:31:16.260443+0000","last_peered":"2024-05-08T18:31:16.260443+0000","last_clean":"2024-05-08T18:31:16.260443+0000","last_became_active":"2024-05-08T18:29:50.679011+0000","last_became_peered":"2024-05-08T18:29:50.679011+0000","last_unstale":"2024-05-08T18:31:16.260443+0000","last_undegraded":"2024-05-08T18:31:16.260443+0000","last_fullsized":"2024-05-08T18:31:16.260443+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:34:14.488295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":102,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.742383+0000","last_change":"2024-05-08T18:29:42.560354+0000","last_active":"2024-05-08T18:31:15.742383+0000","last_peered":"2024-05-08T18:31:15.742383+0000","last_clean":"2024-05-08T18:31:15.742383+0000","last_became_active":"2024-05-08T18:29:42.559647+0000","last_became_peered":"2024-05-08T18:29:42.559647+0000","last_unstale":"2024-05-08T18:31:15.742383+0000","last_undegraded":"2024-05-08T18:31:15.742383+0000","last_fullsized":"2024-05-08T18:31:15.742383+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:18:10.803989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.632603+0000","last_change":"2024-05-08T18:29:40.557683+0000","last_active":"2024-05-08T18:31:15.632603+0000","last_peered":"2024-05-08T18:31:15.632603+0000","last_clean":"2024-05-08T18:31:15.632603+0000","last_became_active":"2024-05-08T18:29:40.556254+0000","last_became_peered":"2024-05-08T18:29:40.556254+0000","last_unstale":"2024-05-08T18:31:15.632603+0000","last_undegraded":"2024-05-08T18:31:15.632603+0000","last_fullsized":"2024-05-08T18:31:15.632603+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:51:43.135322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":97,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.261072+0000","last_change":"2024-05-08T18:29:44.594068+0000","last_active":"2024-05-08T18:31:16.261072+0000","last_peered":"2024-05-08T18:31:16.261072+0000","last_clean":"2024-05-08T18:31:16.261072+0000","last_became_active":"2024-05-08T18:29:44.593322+0000","last_became_peered":"2024-05-08T18:29:44.593322+0000","last_unstale":"2024-05-08T18:31:16.261072+0000","last_undegraded":"2024-05-08T18:31:16.261072+0000","last_fullsized":"2024-05-08T18:31:16.261072+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:19.731003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"33'15","reported_seq":116,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.632445+0000","last_change":"2024-05-08T18:29:46.604700+0000","last_active":"2024-05-08T18:31:15.632445+0000","last_peered":"2024-05-08T18:31:15.632445+0000","last_clean":"2024-05-08T18:31:15.632445+0000","last_became_active":"2024-05-08T18:29:46.603885+0000","last_became_peered":"2024-05-08T18:29:46.603885+0000","last_unstale":"2024-05-08T18:31:15.632445+0000","last_undegraded":"2024-05-08T18:31:15.632445+0000","last_fullsized":"2024-05-08T18:31:15.632445+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:22:36.338527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":86,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.721285+0000","last_change":"2024-05-08T18:29:48.640814+0000","last_active":"2024-05-08T18:31:13.721285+0000","last_peered":"2024-05-08T18:31:13.721285+0000","last_clean":"2024-05-08T18:31:13.721285+0000","last_became_active":"2024-05-08T18:29:48.640046+0000","last_became_peered":"2024-05-08T18:29:48.640046+0000","last_unstale":"2024-05-08T18:31:13.721285+0000","last_undegraded":"2024-05-08T18:31:13.721285+0000","last_fullsized":"2024-05-08T18:31:13.721285+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:53:21.219706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":85,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.262435+0000","last_change":"2024-05-08T18:29:50.692688+0000","last_active":"2024-05-08T18:31:16.262435+0000","last_peered":"2024-05-08T18:31:16.262435+0000","last_clean":"2024-05-08T18:31:16.262435+0000","last_became_active":"2024-05-08T18:29:50.692123+0000","last_became_peered":"2024-05-08T18:29:50.692123+0000","last_unstale":"2024-05-08T18:31:16.262435+0000","last_undegraded":"2024-05-08T18:31:16.262435+0000","last_fullsized":"2024-05-08T18:31:16.262435+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:38.318890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":102,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.743798+0000","last_change":"2024-05-08T18:29:42.558336+0000","last_active":"2024-05-08T18:31:15.743798+0000","last_peered":"2024-05-08T18:31:15.743798+0000","last_clean":"2024-05-08T18:31:15.743798+0000","last_became_active":"2024-05-08T18:29:42.557570+0000","last_became_peered":"2024-05-08T18:29:42.557570+0000","last_unstale":"2024-05-08T18:31:15.743798+0000","last_undegraded":"2024-05-08T18:31:15.743798+0000","last_fullsized":"2024-05-08T18:31:15.743798+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:54:16.539832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.633369+0000","last_change":"2024-05-08T18:29:40.537090+0000","last_active":"2024-05-08T18:31:15.633369+0000","last_peered":"2024-05-08T18:31:15.633369+0000","last_clean":"2024-05-08T18:31:15.633369+0000","last_became_active":"2024-05-08T18:29:40.536188+0000","last_became_peered":"2024-05-08T18:29:40.536188+0000","last_unstale":"2024-05-08T18:31:15.633369+0000","last_undegraded":"2024-05-08T18:31:15.633369+0000","last_fullsized":"2024-05-08T18:31:15.633369+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:22:48.880581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":95,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.631974+0000","last_change":"2024-05-08T18:29:44.578901+0000","last_active":"2024-05-08T18:31:15.631974+0000","last_peered":"2024-05-08T18:31:15.631974+0000","last_clean":"2024-05-08T18:31:15.631974+0000","last_became_active":"2024-05-08T18:29:44.578171+0000","last_became_peered":"2024-05-08T18:29:44.578171+0000","last_unstale":"2024-05-08T18:31:15.631974+0000","last_undegraded":"2024-05-08T18:31:15.631974+0000","last_fullsized":"2024-05-08T18:31:15.631974+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:19.731003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"33'9","reported_seq":106,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.721373+0000","last_change":"2024-05-08T18:29:46.604539+0000","last_active":"2024-05-08T18:31:13.721373+0000","last_peered":"2024-05-08T18:31:13.721373+0000","last_clean":"2024-05-08T18:31:13.721373+0000","last_became_active":"2024-05-08T18:29:46.603728+0000","last_became_peered":"2024-05-08T18:29:46.603728+0000","last_unstale":"2024-05-08T18:31:13.721373+0000","last_undegraded":"2024-05-08T18:31:13.721373+0000","last_fullsized":"2024-05-08T18:31:13.721373+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:12:41.226788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":88,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.736294+0000","last_change":"2024-05-08T18:29:48.635813+0000","last_active":"2024-05-08T18:31:14.736294+0000","last_peered":"2024-05-08T18:31:14.736294+0000","last_clean":"2024-05-08T18:31:14.736294+0000","last_became_active":"2024-05-08T18:29:48.634664+0000","last_became_peered":"2024-05-08T18:29:48.634664+0000","last_unstale":"2024-05-08T18:31:14.736294+0000","last_undegraded":"2024-05-08T18:31:14.736294+0000","last_fullsized":"2024-05-08T18:31:14.736294+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:27:23.427365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":84,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.748621+0000","last_change":"2024-05-08T18:29:50.687517+0000","last_active":"2024-05-08T18:31:14.748621+0000","last_peered":"2024-05-08T18:31:14.748621+0000","last_clean":"2024-05-08T18:31:14.748621+0000","last_became_active":"2024-05-08T18:29:50.686662+0000","last_became_peered":"2024-05-08T18:29:50.686662+0000","last_unstale":"2024-05-08T18:31:14.748621+0000","last_undegraded":"2024-05-08T18:31:14.748621+0000","last_fullsized":"2024-05-08T18:31:14.748621+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:58:00.455559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.748322+0000","last_change":"2024-05-08T18:29:42.558848+0000","last_active":"2024-05-08T18:31:14.748322+0000","last_peered":"2024-05-08T18:31:14.748322+0000","last_clean":"2024-05-08T18:31:14.748322+0000","last_became_active":"2024-05-08T18:29:42.558390+0000","last_became_peered":"2024-05-08T18:29:42.558390+0000","last_unstale":"2024-05-08T18:31:14.748322+0000","last_undegraded":"2024-05-08T18:31:14.748322+0000","last_fullsized":"2024-05-08T18:31:14.748322+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:55:30.468069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.748541+0000","last_change":"2024-05-08T18:29:40.567772+0000","last_active":"2024-05-08T18:31:14.748541+0000","last_peered":"2024-05-08T18:31:14.748541+0000","last_clean":"2024-05-08T18:31:14.748541+0000","last_became_active":"2024-05-08T18:29:40.567482+0000","last_became_peered":"2024-05-08T18:29:40.567482+0000","last_unstale":"2024-05-08T18:31:14.748541+0000","last_undegraded":"2024-05-08T18:31:14.748541+0000","last_fullsized":"2024-05-08T18:31:14.748541+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:36:37.796095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":98,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.741568+0000","last_change":"2024-05-08T18:29:44.596876+0000","last_active":"2024-05-08T18:31:15.741568+0000","last_peered":"2024-05-08T18:31:15.741568+0000","last_clean":"2024-05-08T18:31:15.741568+0000","last_became_active":"2024-05-08T18:29:44.595712+0000","last_became_peered":"2024-05-08T18:29:44.595712+0000","last_unstale":"2024-05-08T18:31:15.741568+0000","last_undegraded":"2024-05-08T18:31:15.741568+0000","last_fullsized":"2024-05-08T18:31:15.741568+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:35:51.288126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"33'5","reported_seq":102,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.748589+0000","last_change":"2024-05-08T18:29:46.598637+0000","last_active":"2024-05-08T18:31:14.748589+0000","last_peered":"2024-05-08T18:31:14.748589+0000","last_clean":"2024-05-08T18:31:14.748589+0000","last_became_active":"2024-05-08T18:29:46.597394+0000","last_became_peered":"2024-05-08T18:29:46.597394+0000","last_unstale":"2024-05-08T18:31:14.748589+0000","last_undegraded":"2024-05-08T18:31:14.748589+0000","last_fullsized":"2024-05-08T18:31:14.748589+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:52:22.540814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":90,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.741955+0000","last_change":"2024-05-08T18:29:48.642251+0000","last_active":"2024-05-08T18:31:15.741955+0000","last_peered":"2024-05-08T18:31:15.741955+0000","last_clean":"2024-05-08T18:31:15.741955+0000","last_became_active":"2024-05-08T18:29:48.641666+0000","last_became_peered":"2024-05-08T18:29:48.641666+0000","last_unstale":"2024-05-08T18:31:15.741955+0000","last_undegraded":"2024-05-08T18:31:15.741955+0000","last_fullsized":"2024-05-08T18:31:15.741955+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:13:50.865474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":85,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.262027+0000","last_change":"2024-05-08T18:29:50.685668+0000","last_active":"2024-05-08T18:31:16.262027+0000","last_peered":"2024-05-08T18:31:16.262027+0000","last_clean":"2024-05-08T18:31:16.262027+0000","last_became_active":"2024-05-08T18:29:50.684958+0000","last_became_peered":"2024-05-08T18:29:50.684958+0000","last_unstale":"2024-05-08T18:31:16.262027+0000","last_undegraded":"2024-05-08T18:31:16.262027+0000","last_fullsized":"2024-05-08T18:31:16.262027+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:55:01.894779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":102,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.742297+0000","last_change":"2024-05-08T18:29:42.562063+0000","last_active":"2024-05-08T18:31:15.742297+0000","last_peered":"2024-05-08T18:31:15.742297+0000","last_clean":"2024-05-08T18:31:15.742297+0000","last_became_active":"2024-05-08T18:29:42.558871+0000","last_became_peered":"2024-05-08T18:29:42.558871+0000","last_unstale":"2024-05-08T18:31:15.742297+0000","last_undegraded":"2024-05-08T18:31:15.742297+0000","last_fullsized":"2024-05-08T18:31:15.742297+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:59.243324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":102,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.725791+0000","last_change":"2024-05-08T18:29:40.541070+0000","last_active":"2024-05-08T18:31:13.725791+0000","last_peered":"2024-05-08T18:31:13.725791+0000","last_clean":"2024-05-08T18:31:13.725791+0000","last_became_active":"2024-05-08T18:29:40.540767+0000","last_became_peered":"2024-05-08T18:29:40.540767+0000","last_unstale":"2024-05-08T18:31:13.725791+0000","last_undegraded":"2024-05-08T18:31:13.725791+0000","last_fullsized":"2024-05-08T18:31:13.725791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:09:39.835826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"26'1","reported_seq":95,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.719407+0000","last_change":"2024-05-08T18:29:44.592737+0000","last_active":"2024-05-08T18:31:13.719407+0000","last_peered":"2024-05-08T18:31:13.719407+0000","last_clean":"2024-05-08T18:31:13.719407+0000","last_became_active":"2024-05-08T18:29:44.592243+0000","last_became_peered":"2024-05-08T18:29:44.592243+0000","last_unstale":"2024-05-08T18:31:13.719407+0000","last_undegraded":"2024-05-08T18:31:13.719407+0000","last_fullsized":"2024-05-08T18:31:13.719407+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:59.744050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"33'9","reported_seq":110,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.742897+0000","last_change":"2024-05-08T18:29:46.610835+0000","last_active":"2024-05-08T18:31:15.742897+0000","last_peered":"2024-05-08T18:31:15.742897+0000","last_clean":"2024-05-08T18:31:15.742897+0000","last_became_active":"2024-05-08T18:29:46.609903+0000","last_became_peered":"2024-05-08T18:29:46.609903+0000","last_unstale":"2024-05-08T18:31:15.742897+0000","last_undegraded":"2024-05-08T18:31:15.742897+0000","last_fullsized":"2024-05-08T18:31:15.742897+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:37:35.850414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":86,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.721105+0000","last_change":"2024-05-08T18:29:48.629822+0000","last_active":"2024-05-08T18:31:13.721105+0000","last_peered":"2024-05-08T18:31:13.721105+0000","last_clean":"2024-05-08T18:31:13.721105+0000","last_became_active":"2024-05-08T18:29:48.629204+0000","last_became_peered":"2024-05-08T18:29:48.629204+0000","last_unstale":"2024-05-08T18:31:13.721105+0000","last_undegraded":"2024-05-08T18:31:13.721105+0000","last_fullsized":"2024-05-08T18:31:13.721105+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:04.571608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":86,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.743139+0000","last_change":"2024-05-08T18:29:50.668101+0000","last_active":"2024-05-08T18:31:15.743139+0000","last_peered":"2024-05-08T18:31:15.743139+0000","last_clean":"2024-05-08T18:31:15.743139+0000","last_became_active":"2024-05-08T18:29:50.667357+0000","last_became_peered":"2024-05-08T18:29:50.667357+0000","last_unstale":"2024-05-08T18:31:15.743139+0000","last_undegraded":"2024-05-08T18:31:15.743139+0000","last_fullsized":"2024-05-08T18:31:15.743139+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:55:01.894779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":98,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.722914+0000","last_change":"2024-05-08T18:29:42.581366+0000","last_active":"2024-05-08T18:31:13.722914+0000","last_peered":"2024-05-08T18:31:13.722914+0000","last_clean":"2024-05-08T18:31:13.722914+0000","last_became_active":"2024-05-08T18:29:42.580988+0000","last_became_peered":"2024-05-08T18:29:42.580988+0000","last_unstale":"2024-05-08T18:31:13.722914+0000","last_undegraded":"2024-05-08T18:31:13.722914+0000","last_fullsized":"2024-05-08T18:31:13.722914+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:42.005809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.736314+0000","last_change":"2024-05-08T18:29:40.562025+0000","last_active":"2024-05-08T18:31:14.736314+0000","last_peered":"2024-05-08T18:31:14.736314+0000","last_clean":"2024-05-08T18:31:14.736314+0000","last_became_active":"2024-05-08T18:29:40.561277+0000","last_became_peered":"2024-05-08T18:29:40.561277+0000","last_unstale":"2024-05-08T18:31:14.736314+0000","last_undegraded":"2024-05-08T18:31:14.736314+0000","last_fullsized":"2024-05-08T18:31:14.736314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:59:25.840149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":98,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.720087+0000","last_change":"2024-05-08T18:29:42.573832+0000","last_active":"2024-05-08T18:31:13.720087+0000","last_peered":"2024-05-08T18:31:13.720087+0000","last_clean":"2024-05-08T18:31:13.720087+0000","last_became_active":"2024-05-08T18:29:42.573502+0000","last_became_peered":"2024-05-08T18:29:42.573502+0000","last_unstale":"2024-05-08T18:31:13.720087+0000","last_undegraded":"2024-05-08T18:31:13.720087+0000","last_fullsized":"2024-05-08T18:31:13.720087+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:35.037465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.738141+0000","last_change":"2024-05-08T18:29:40.533094+0000","last_active":"2024-05-08T18:31:14.738141+0000","last_peered":"2024-05-08T18:31:14.738141+0000","last_clean":"2024-05-08T18:31:14.738141+0000","last_became_active":"2024-05-08T18:29:40.532246+0000","last_became_peered":"2024-05-08T18:29:40.532246+0000","last_unstale":"2024-05-08T18:31:14.738141+0000","last_undegraded":"2024-05-08T18:31:14.738141+0000","last_fullsized":"2024-05-08T18:31:14.738141+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:37:08.242362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.632795+0000","last_change":"2024-05-08T18:29:42.565298+0000","last_active":"2024-05-08T18:31:15.632795+0000","last_peered":"2024-05-08T18:31:15.632795+0000","last_clean":"2024-05-08T18:31:15.632795+0000","last_became_active":"2024-05-08T18:29:42.564542+0000","last_became_peered":"2024-05-08T18:29:42.564542+0000","last_unstale":"2024-05-08T18:31:15.632795+0000","last_undegraded":"2024-05-08T18:31:15.632795+0000","last_fullsized":"2024-05-08T18:31:15.632795+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:57.706167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.632572+0000","last_change":"2024-05-08T18:29:40.556958+0000","last_active":"2024-05-08T18:31:15.632572+0000","last_peered":"2024-05-08T18:31:15.632572+0000","last_clean":"2024-05-08T18:31:15.632572+0000","last_became_active":"2024-05-08T18:29:40.556091+0000","last_became_peered":"2024-05-08T18:29:40.556091+0000","last_unstale":"2024-05-08T18:31:15.632572+0000","last_undegraded":"2024-05-08T18:31:15.632572+0000","last_fullsized":"2024-05-08T18:31:15.632572+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:39.986094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":98,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.720324+0000","last_change":"2024-05-08T18:29:42.574619+0000","last_active":"2024-05-08T18:31:13.720324+0000","last_peered":"2024-05-08T18:31:13.720324+0000","last_clean":"2024-05-08T18:31:13.720324+0000","last_became_active":"2024-05-08T18:29:42.573178+0000","last_became_peered":"2024-05-08T18:29:42.573178+0000","last_unstale":"2024-05-08T18:31:13.720324+0000","last_undegraded":"2024-05-08T18:31:13.720324+0000","last_fullsized":"2024-05-08T18:31:13.720324+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:33.139089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":102,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.722117+0000","last_change":"2024-05-08T18:29:40.544338+0000","last_active":"2024-05-08T18:31:13.722117+0000","last_peered":"2024-05-08T18:31:13.722117+0000","last_clean":"2024-05-08T18:31:13.722117+0000","last_became_active":"2024-05-08T18:29:40.544107+0000","last_became_peered":"2024-05-08T18:29:40.544107+0000","last_unstale":"2024-05-08T18:31:13.722117+0000","last_undegraded":"2024-05-08T18:31:13.722117+0000","last_fullsized":"2024-05-08T18:31:13.722117+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:54.200883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.748300+0000","last_change":"2024-05-08T18:29:42.576979+0000","last_active":"2024-05-08T18:31:14.748300+0000","last_peered":"2024-05-08T18:31:14.748300+0000","last_clean":"2024-05-08T18:31:14.748300+0000","last_became_active":"2024-05-08T18:29:42.576395+0000","last_became_peered":"2024-05-08T18:29:42.576395+0000","last_unstale":"2024-05-08T18:31:14.748300+0000","last_undegraded":"2024-05-08T18:31:14.748300+0000","last_fullsized":"2024-05-08T18:31:14.748300+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:53:03.097704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.746535+0000","last_change":"2024-05-08T18:29:40.558142+0000","last_active":"2024-05-08T18:31:14.746535+0000","last_peered":"2024-05-08T18:31:14.746535+0000","last_clean":"2024-05-08T18:31:14.746535+0000","last_became_active":"2024-05-08T18:29:40.557874+0000","last_became_peered":"2024-05-08T18:29:40.557874+0000","last_unstale":"2024-05-08T18:31:14.746535+0000","last_undegraded":"2024-05-08T18:31:14.746535+0000","last_fullsized":"2024-05-08T18:31:14.746535+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:54.200883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":102,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.743913+0000","last_change":"2024-05-08T18:29:42.558324+0000","last_active":"2024-05-08T18:31:15.743913+0000","last_peered":"2024-05-08T18:31:15.743913+0000","last_clean":"2024-05-08T18:31:15.743913+0000","last_became_active":"2024-05-08T18:29:42.556774+0000","last_became_peered":"2024-05-08T18:29:42.556774+0000","last_unstale":"2024-05-08T18:31:15.743913+0000","last_undegraded":"2024-05-08T18:31:15.743913+0000","last_fullsized":"2024-05-08T18:31:15.743913+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:02:26.311100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":107,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.720928+0000","last_change":"2024-05-08T18:30:20.858467+0000","last_active":"2024-05-08T18:31:13.720928+0000","last_peered":"2024-05-08T18:31:13.720928+0000","last_clean":"2024-05-08T18:31:13.720928+0000","last_became_active":"2024-05-08T18:30:20.858016+0000","last_became_peered":"2024-05-08T18:30:20.858016+0000","last_unstale":"2024-05-08T18:31:13.720928+0000","last_undegraded":"2024-05-08T18:31:13.720928+0000","last_fullsized":"2024-05-08T18:31:13.720928+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:10:28.824915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.745649+0000","last_change":"2024-05-08T18:29:42.562772+0000","last_active":"2024-05-08T18:31:14.745649+0000","last_peered":"2024-05-08T18:31:14.745649+0000","last_clean":"2024-05-08T18:31:14.745649+0000","last_became_active":"2024-05-08T18:29:42.562420+0000","last_became_peered":"2024-05-08T18:29:42.562420+0000","last_unstale":"2024-05-08T18:31:14.745649+0000","last_undegraded":"2024-05-08T18:31:14.745649+0000","last_fullsized":"2024-05-08T18:31:14.745649+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:30:29.452640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.737804+0000","last_change":"2024-05-08T18:29:40.562024+0000","last_active":"2024-05-08T18:31:14.737804+0000","last_peered":"2024-05-08T18:31:14.737804+0000","last_clean":"2024-05-08T18:31:14.737804+0000","last_became_active":"2024-05-08T18:29:40.561326+0000","last_became_peered":"2024-05-08T18:29:40.561326+0000","last_unstale":"2024-05-08T18:31:14.737804+0000","last_undegraded":"2024-05-08T18:31:14.737804+0000","last_fullsized":"2024-05-08T18:31:14.737804+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:21:38.354933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.736186+0000","last_change":"2024-05-08T18:29:42.561419+0000","last_active":"2024-05-08T18:31:14.736186+0000","last_peered":"2024-05-08T18:31:14.736186+0000","last_clean":"2024-05-08T18:31:14.736186+0000","last_became_active":"2024-05-08T18:29:42.560520+0000","last_became_peered":"2024-05-08T18:29:42.560520+0000","last_unstale":"2024-05-08T18:31:14.736186+0000","last_undegraded":"2024-05-08T18:31:14.736186+0000","last_fullsized":"2024-05-08T18:31:14.736186+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:07.949520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.748826+0000","last_change":"2024-05-08T18:29:40.554884+0000","last_active":"2024-05-08T18:31:14.748826+0000","last_peered":"2024-05-08T18:31:14.748826+0000","last_clean":"2024-05-08T18:31:14.748826+0000","last_became_active":"2024-05-08T18:29:40.554603+0000","last_became_peered":"2024-05-08T18:29:40.554603+0000","last_unstale":"2024-05-08T18:31:14.748826+0000","last_undegraded":"2024-05-08T18:31:14.748826+0000","last_fullsized":"2024-05-08T18:31:14.748826+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:09:39.835826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":98,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.723375+0000","last_change":"2024-05-08T18:29:42.574689+0000","last_active":"2024-05-08T18:31:13.723375+0000","last_peered":"2024-05-08T18:31:13.723375+0000","last_clean":"2024-05-08T18:31:13.723375+0000","last_became_active":"2024-05-08T18:29:42.573947+0000","last_became_peered":"2024-05-08T18:29:42.573947+0000","last_unstale":"2024-05-08T18:31:13.723375+0000","last_undegraded":"2024-05-08T18:31:13.723375+0000","last_fullsized":"2024-05-08T18:31:13.723375+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:57:14.869860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.633077+0000","last_change":"2024-05-08T18:29:40.554005+0000","last_active":"2024-05-08T18:31:15.633077+0000","last_peered":"2024-05-08T18:31:15.633077+0000","last_clean":"2024-05-08T18:31:15.633077+0000","last_became_active":"2024-05-08T18:29:40.553356+0000","last_became_peered":"2024-05-08T18:29:40.553356+0000","last_unstale":"2024-05-08T18:31:15.633077+0000","last_undegraded":"2024-05-08T18:31:15.633077+0000","last_fullsized":"2024-05-08T18:31:15.633077+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:08:13.006752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":102,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.743476+0000","last_change":"2024-05-08T18:29:42.566487+0000","last_active":"2024-05-08T18:31:15.743476+0000","last_peered":"2024-05-08T18:31:15.743476+0000","last_clean":"2024-05-08T18:31:15.743476+0000","last_became_active":"2024-05-08T18:29:42.565760+0000","last_became_peered":"2024-05-08T18:29:42.565760+0000","last_unstale":"2024-05-08T18:31:15.743476+0000","last_undegraded":"2024-05-08T18:31:15.743476+0000","last_fullsized":"2024-05-08T18:31:15.743476+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:57.706167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.748401+0000","last_change":"2024-05-08T18:29:40.552543+0000","last_active":"2024-05-08T18:31:14.748401+0000","last_peered":"2024-05-08T18:31:14.748401+0000","last_clean":"2024-05-08T18:31:14.748401+0000","last_became_active":"2024-05-08T18:29:40.552307+0000","last_became_peered":"2024-05-08T18:29:40.552307+0000","last_unstale":"2024-05-08T18:31:14.748401+0000","last_undegraded":"2024-05-08T18:31:14.748401+0000","last_fullsized":"2024-05-08T18:31:14.748401+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:48.294532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.739096+0000","last_change":"2024-05-08T18:29:42.561658+0000","last_active":"2024-05-08T18:31:14.739096+0000","last_peered":"2024-05-08T18:31:14.739096+0000","last_clean":"2024-05-08T18:31:14.739096+0000","last_became_active":"2024-05-08T18:29:42.561171+0000","last_became_peered":"2024-05-08T18:29:42.561171+0000","last_unstale":"2024-05-08T18:31:14.739096+0000","last_undegraded":"2024-05-08T18:31:14.739096+0000","last_fullsized":"2024-05-08T18:31:14.739096+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:15.966061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.632355+0000","last_change":"2024-05-08T18:29:40.543041+0000","last_active":"2024-05-08T18:31:15.632355+0000","last_peered":"2024-05-08T18:31:15.632355+0000","last_clean":"2024-05-08T18:31:15.632355+0000","last_became_active":"2024-05-08T18:29:40.542398+0000","last_became_peered":"2024-05-08T18:29:40.542398+0000","last_unstale":"2024-05-08T18:31:15.632355+0000","last_undegraded":"2024-05-08T18:31:15.632355+0000","last_fullsized":"2024-05-08T18:31:15.632355+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:33.017750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":102,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.742849+0000","last_change":"2024-05-08T18:29:42.579690+0000","last_active":"2024-05-08T18:31:15.742849+0000","last_peered":"2024-05-08T18:31:15.742849+0000","last_clean":"2024-05-08T18:31:15.742849+0000","last_became_active":"2024-05-08T18:29:42.578981+0000","last_became_peered":"2024-05-08T18:29:42.578981+0000","last_unstale":"2024-05-08T18:31:15.742849+0000","last_undegraded":"2024-05-08T18:31:15.742849+0000","last_fullsized":"2024-05-08T18:31:15.742849+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:36:03.084561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":102,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.722273+0000","last_change":"2024-05-08T18:29:40.548499+0000","last_active":"2024-05-08T18:31:13.722273+0000","last_peered":"2024-05-08T18:31:13.722273+0000","last_clean":"2024-05-08T18:31:13.722273+0000","last_became_active":"2024-05-08T18:29:40.548177+0000","last_became_peered":"2024-05-08T18:29:40.548177+0000","last_unstale":"2024-05-08T18:31:13.722273+0000","last_undegraded":"2024-05-08T18:31:13.722273+0000","last_fullsized":"2024-05-08T18:31:13.722273+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:27:41.414153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":101,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.261799+0000","last_change":"2024-05-08T18:29:42.575892+0000","last_active":"2024-05-08T18:31:16.261799+0000","last_peered":"2024-05-08T18:31:16.261799+0000","last_clean":"2024-05-08T18:31:16.261799+0000","last_became_active":"2024-05-08T18:29:42.573384+0000","last_became_peered":"2024-05-08T18:29:42.573384+0000","last_unstale":"2024-05-08T18:31:16.261799+0000","last_undegraded":"2024-05-08T18:31:16.261799+0000","last_fullsized":"2024-05-08T18:31:16.261799+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:55.055481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.737601+0000","last_change":"2024-05-08T18:29:40.565068+0000","last_active":"2024-05-08T18:31:14.737601+0000","last_peered":"2024-05-08T18:31:14.737601+0000","last_clean":"2024-05-08T18:31:14.737601+0000","last_became_active":"2024-05-08T18:29:40.563231+0000","last_became_peered":"2024-05-08T18:29:40.563231+0000","last_unstale":"2024-05-08T18:31:14.737601+0000","last_undegraded":"2024-05-08T18:31:14.737601+0000","last_fullsized":"2024-05-08T18:31:14.737601+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:17:47.828990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":98,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.721217+0000","last_change":"2024-05-08T18:29:42.564338+0000","last_active":"2024-05-08T18:31:13.721217+0000","last_peered":"2024-05-08T18:31:13.721217+0000","last_clean":"2024-05-08T18:31:13.721217+0000","last_became_active":"2024-05-08T18:29:42.563822+0000","last_became_peered":"2024-05-08T18:29:42.563822+0000","last_unstale":"2024-05-08T18:31:13.721217+0000","last_undegraded":"2024-05-08T18:31:13.721217+0000","last_fullsized":"2024-05-08T18:31:13.721217+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:23.397435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":105,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.262510+0000","last_change":"2024-05-08T18:29:40.573333+0000","last_active":"2024-05-08T18:31:16.262510+0000","last_peered":"2024-05-08T18:31:16.262510+0000","last_clean":"2024-05-08T18:31:16.262510+0000","last_became_active":"2024-05-08T18:29:40.571195+0000","last_became_peered":"2024-05-08T18:29:40.571195+0000","last_unstale":"2024-05-08T18:31:16.262510+0000","last_undegraded":"2024-05-08T18:31:16.262510+0000","last_fullsized":"2024-05-08T18:31:16.262510+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:33.017750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.745591+0000","last_change":"2024-05-08T18:29:42.563085+0000","last_active":"2024-05-08T18:31:14.745591+0000","last_peered":"2024-05-08T18:31:14.745591+0000","last_clean":"2024-05-08T18:31:14.745591+0000","last_became_active":"2024-05-08T18:29:42.560419+0000","last_became_peered":"2024-05-08T18:29:42.560419+0000","last_unstale":"2024-05-08T18:31:14.745591+0000","last_undegraded":"2024-05-08T18:31:14.745591+0000","last_fullsized":"2024-05-08T18:31:14.745591+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:20.397730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:14.740840+0000","last_change":"2024-05-08T18:29:40.568890+0000","last_active":"2024-05-08T18:31:14.740840+0000","last_peered":"2024-05-08T18:31:14.740840+0000","last_clean":"2024-05-08T18:31:14.740840+0000","last_became_active":"2024-05-08T18:29:40.568584+0000","last_became_peered":"2024-05-08T18:29:40.568584+0000","last_unstale":"2024-05-08T18:31:14.740840+0000","last_undegraded":"2024-05-08T18:31:14.740840+0000","last_fullsized":"2024-05-08T18:31:14.740840+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:25:01.595224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":101,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-05-08T18:31:16.260720+0000","last_change":"2024-05-08T18:29:42.574277+0000","last_active":"2024-05-08T18:31:16.260720+0000","last_peered":"2024-05-08T18:31:16.260720+0000","last_clean":"2024-05-08T18:31:16.260720+0000","last_became_active":"2024-05-08T18:29:42.573563+0000","last_became_peered":"2024-05-08T18:29:42.573563+0000","last_unstale":"2024-05-08T18:31:16.260720+0000","last_undegraded":"2024-05-08T18:31:16.260720+0000","last_fullsized":"2024-05-08T18:31:16.260720+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:57.706167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.633538+0000","last_change":"2024-05-08T18:29:40.562058+0000","last_active":"2024-05-08T18:31:15.633538+0000","last_peered":"2024-05-08T18:31:15.633538+0000","last_clean":"2024-05-08T18:31:15.633538+0000","last_became_active":"2024-05-08T18:29:40.561360+0000","last_became_peered":"2024-05-08T18:29:40.561360+0000","last_unstale":"2024-05-08T18:31:15.633538+0000","last_undegraded":"2024-05-08T18:31:15.633538+0000","last_fullsized":"2024-05-08T18:31:15.633538+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:05.929806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.633064+0000","last_change":"2024-05-08T18:29:40.538728+0000","last_active":"2024-05-08T18:31:15.633064+0000","last_peered":"2024-05-08T18:31:15.633064+0000","last_clean":"2024-05-08T18:31:15.633064+0000","last_became_active":"2024-05-08T18:29:40.537925+0000","last_became_peered":"2024-05-08T18:29:40.537925+0000","last_unstale":"2024-05-08T18:31:15.633064+0000","last_undegraded":"2024-05-08T18:31:15.633064+0000","last_fullsized":"2024-05-08T18:31:15.633064+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:28.426657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":98,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.723287+0000","last_change":"2024-05-08T18:29:42.574941+0000","last_active":"2024-05-08T18:31:13.723287+0000","last_peered":"2024-05-08T18:31:13.723287+0000","last_clean":"2024-05-08T18:31:13.723287+0000","last_became_active":"2024-05-08T18:29:42.574351+0000","last_became_peered":"2024-05-08T18:29:42.574351+0000","last_unstale":"2024-05-08T18:31:13.723287+0000","last_undegraded":"2024-05-08T18:31:13.723287+0000","last_fullsized":"2024-05-08T18:31:13.723287+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:21.935293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":102,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-05-08T18:31:13.719801+0000","last_change":"2024-05-08T18:29:40.543714+0000","last_active":"2024-05-08T18:31:13.719801+0000","last_peered":"2024-05-08T18:31:13.719801+0000","last_clean":"2024-05-08T18:31:13.719801+0000","last_became_active":"2024-05-08T18:29:40.542965+0000","last_became_peered":"2024-05-08T18:29:40.542965+0000","last_unstale":"2024-05-08T18:31:13.719801+0000","last_undegraded":"2024-05-08T18:31:13.719801+0000","last_fullsized":"2024-05-08T18:31:13.719801+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:12:59.146887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-08T18:31:15.632772+0000","last_change":"2024-05-08T18:29:42.560007+0000","last_active":"2024-05-08T18:31:15.632772+0000","last_peered":"2024-05-08T18:31:15.632772+0000","last_clean":"2024-05-08T18:31:15.632772+0000","last_became_active":"2024-05-08T18:29:42.559028+0000","last_became_peered":"2024-05-08T18:29:42.559028+0000","last_unstale":"2024-05-08T18:31:15.632772+0000","last_undegraded":"2024-05-08T18:31:15.632772+0000","last_fullsized":"2024-05-08T18:31:15.632772+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:36:03.084561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":689,"num_read_kb":448,"num_write":419,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":388,"ondisk_log_size":388,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509467,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32576,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339264,"statfs":{"total":96636764160,"available":96603406336,"internally_reserved":0,"allocated":1421312,"data_stored":1014867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509467,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":827392,"data_stored":439471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509465,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":872448,"data_stored":440299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509465,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":827392,"data_stored":446785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542170,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":819200,"data_stored":424235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542170,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":823296,"data_stored":440462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542168,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":831488,"data_stored":431905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542170,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28408,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343432,"statfs":{"total":96636764160,"available":96607674368,"internally_reserved":0,"allocated":1421312,"data_stored":1023518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T18:31:20.353 INFO:tasks.thrashosds.thrasher:Setting 4.4 to [1, 6] 2024-05-08T18:31:20.353 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '4.4', '1', '6'] 2024-05-08T18:31:20.353 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 4.4 1 6 2024-05-08T18:31:20.383 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:31:20.382+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:31:20.463 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:20.463 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:20.478 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-08T18:31:20.482 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:31:20.478+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:31:20.583 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:31:20.578+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:31:20.613 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:20.613 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:20.627 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-08T18:31:20.683 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:31:20.678+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:31:20.784 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:31:20.782+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:31:20.790 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:20.790 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:20.806 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-08T18:31:20.807 INFO:teuthology.orchestra.run.smithi097.stderr:set 4.4 pg_upmap mapping to [1,6] 2024-05-08T18:31:20.814 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-08T18:31:20.887 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:31:20.886+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:31:20.930 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:20.930 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:20.944 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-08T18:31:20.988 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:31:20.986+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:31:21.068 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:21.069 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:21.083 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-08T18:31:21.125 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:31:21.122+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:31:21.188 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:31:21.186+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:31:21.248 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:21.249 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:21.265 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-08T18:31:21.289 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:31:21.286+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:31:21.386 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:21.386 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:21.390 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:31:21.386+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:31:21.400 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-08T18:31:21.491 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:31:21.486+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:31:21.572 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:21.572 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:21.587 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-08T18:31:21.592 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:31:21.590+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:31:21.692 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:31:21.690+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:31:21.708 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:21.709 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:21.723 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-08T18:31:21.775 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-08T18:31:21.808 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:31:21.806+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:31:21.823 INFO:teuthology.orchestra.run.smithi097.stderr:nodeep-scrub is unset 2024-05-08T18:31:21.891 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:21.891 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:21.893 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:31:21.890+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:31:21.905 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-08T18:31:21.978 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2024-05-08T18:31:21.978 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:31:21.994 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:31:21.990+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:31:22.009 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2024-05-08T18:31:22.009 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:31:22.039 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2024-05-08T18:31:22.039 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:31:22.069 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2024-05-08T18:31:22.069 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:31:22.074 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:22.074 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:22.088 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-08T18:31:22.101 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2024-05-08T18:31:22.101 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:31:22.133 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2024-05-08T18:31:22.133 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:31:22.136 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:31:22.134+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:31:22.168 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2024-05-08T18:31:22.170 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:31:22.196 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:31:22.194+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:31:22.198 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2024-05-08T18:31:22.198 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:31:22.261 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:31:22.261 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:31:22.261 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2024-05-08T18:31:22.261 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2024-05-08T18:31:22.261 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:31:22.276 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-08T18:31:22.321 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:31:22.318+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:31:22.398 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:31:22.394+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:31:22.401 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:31:22.402 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2024-05-08T18:31:22.402 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2024-05-08T18:31:22.402 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-05-08T18:31:22.402 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.402 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:24 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [write 262144~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:22.402 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.154193+0000", 2024-05-08T18:31:22.402 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 115.24497878699999, 2024-05-08T18:31:22.402 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0085494309999999997, 2024-05-08T18:31:22.402 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:22.402 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:22.402 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:22.402 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:22.403 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:22.403 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:22.403 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 24 2024-05-08T18:31:22.403 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.403 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:22.403 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.403 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:22.403 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154193+0000", 2024-05-08T18:31:22.403 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:22.403 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.403 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.403 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:22.403 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154193+0000", 2024-05-08T18:31:22.403 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:22.403 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.404 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.404 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:22.404 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154194+0000", 2024-05-08T18:31:22.404 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.44e-06 2024-05-08T18:31:22.404 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.404 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.404 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:22.404 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154394+0000", 2024-05-08T18:31:22.404 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00019972499999999999 2024-05-08T18:31:22.404 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.404 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.404 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:22.404 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154417+0000", 2024-05-08T18:31:22.405 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2713000000000001e-05 2024-05-08T18:31:22.405 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.405 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.405 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:22.405 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154437+0000", 2024-05-08T18:31:22.405 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0027e-05 2024-05-08T18:31:22.405 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.405 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.405 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:22.405 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.158438+0000", 2024-05-08T18:31:22.405 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0040011459999999997 2024-05-08T18:31:22.405 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.405 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.405 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:22.405 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.158567+0000", 2024-05-08T18:31:22.406 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012923899999999999 2024-05-08T18:31:22.406 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.406 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.406 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:22.406 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.158787+0000", 2024-05-08T18:31:22.406 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000219581 2024-05-08T18:31:22.406 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.406 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.406 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:22.406 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.162013+0000", 2024-05-08T18:31:22.406 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032261759999999999 2024-05-08T18:31:22.406 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.407 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.407 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:22.407 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.162568+0000", 2024-05-08T18:31:22.407 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00055576900000000001 2024-05-08T18:31:22.407 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.407 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.407 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:22.407 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.162644+0000", 2024-05-08T18:31:22.407 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5516e-05 2024-05-08T18:31:22.407 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.407 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.407 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:22.407 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.162742+0000", 2024-05-08T18:31:22.407 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8098999999999997e-05 2024-05-08T18:31:22.408 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:22.408 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:22.408 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:22.408 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.408 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.408 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:25 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:22.408 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.154495+0000", 2024-05-08T18:31:22.408 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 115.244676493, 2024-05-08T18:31:22.408 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010784396999999999, 2024-05-08T18:31:22.408 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:22.408 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:22.408 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:22.408 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:22.408 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:22.409 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:22.409 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 25 2024-05-08T18:31:22.409 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.409 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:22.409 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.409 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:22.409 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154495+0000", 2024-05-08T18:31:22.409 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:22.409 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.409 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.409 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:22.409 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154495+0000", 2024-05-08T18:31:22.409 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:22.409 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.410 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.410 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:22.410 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154496+0000", 2024-05-08T18:31:22.410 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.454e-06 2024-05-08T18:31:22.410 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.410 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.410 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:22.410 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154509+0000", 2024-05-08T18:31:22.410 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2496e-05 2024-05-08T18:31:22.410 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.410 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.410 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:22.410 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154531+0000", 2024-05-08T18:31:22.411 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1987000000000001e-05 2024-05-08T18:31:22.411 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.411 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.411 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:22.411 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154547+0000", 2024-05-08T18:31:22.411 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.577e-05 2024-05-08T18:31:22.411 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.411 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.411 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:22.411 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.160949+0000", 2024-05-08T18:31:22.411 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.006401917 2024-05-08T18:31:22.411 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.411 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.411 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:22.411 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.161102+0000", 2024-05-08T18:31:22.412 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000153826 2024-05-08T18:31:22.412 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.412 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.412 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:22.412 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.161332+0000", 2024-05-08T18:31:22.412 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022918099999999999 2024-05-08T18:31:22.412 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.412 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.412 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:22.412 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.163838+0000", 2024-05-08T18:31:22.412 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0025064079999999999 2024-05-08T18:31:22.412 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.412 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.412 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:22.412 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.165121+0000", 2024-05-08T18:31:22.413 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0012825200000000001 2024-05-08T18:31:22.413 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.413 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.413 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:22.413 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.165212+0000", 2024-05-08T18:31:22.413 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1121999999999999e-05 2024-05-08T18:31:22.413 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.413 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.413 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:22.413 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.165279+0000", 2024-05-08T18:31:22.413 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7716e-05 2024-05-08T18:31:22.413 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:22.413 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:22.413 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:22.414 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.414 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.414 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:41 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:22.414 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247174+0000", 2024-05-08T18:31:22.414 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 115.151997511, 2024-05-08T18:31:22.414 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010013393000000001, 2024-05-08T18:31:22.414 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:22.414 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:22.414 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:22.414 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:22.414 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:22.414 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:22.414 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 41 2024-05-08T18:31:22.415 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.415 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:22.415 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.415 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:22.415 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247174+0000", 2024-05-08T18:31:22.415 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:22.415 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.415 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.415 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:22.415 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247174+0000", 2024-05-08T18:31:22.415 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:22.415 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.415 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.415 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:22.416 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247175+0000", 2024-05-08T18:31:22.416 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.9999999999999995e-07 2024-05-08T18:31:22.416 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.416 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.416 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:22.416 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247277+0000", 2024-05-08T18:31:22.416 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010243600000000001 2024-05-08T18:31:22.416 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.416 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.416 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:22.416 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247291+0000", 2024-05-08T18:31:22.416 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4076999999999999e-05 2024-05-08T18:31:22.416 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.417 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.417 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:22.417 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247301+0000", 2024-05-08T18:31:22.417 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0010000000000001e-05 2024-05-08T18:31:22.417 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.417 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.417 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:22.417 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.249555+0000", 2024-05-08T18:31:22.417 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0022539050000000001 2024-05-08T18:31:22.417 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.417 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.417 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:22.417 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.249700+0000", 2024-05-08T18:31:22.417 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014484599999999999 2024-05-08T18:31:22.418 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.418 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.418 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:22.418 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.249929+0000", 2024-05-08T18:31:22.418 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022904499999999999 2024-05-08T18:31:22.418 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.418 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.418 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:22.418 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.253695+0000", 2024-05-08T18:31:22.418 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0037656640000000002 2024-05-08T18:31:22.418 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.418 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.418 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:22.419 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.256970+0000", 2024-05-08T18:31:22.419 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003274608 2024-05-08T18:31:22.419 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.419 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.419 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:22.419 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.257052+0000", 2024-05-08T18:31:22.419 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2223000000000002e-05 2024-05-08T18:31:22.419 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.419 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.419 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:22.419 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.257187+0000", 2024-05-08T18:31:22.419 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013557900000000001 2024-05-08T18:31:22.419 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:22.419 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:22.420 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:22.420 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.420 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.420 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:42 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:22.420 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247321+0000", 2024-05-08T18:31:22.420 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 115.151850192, 2024-05-08T18:31:22.420 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013168572, 2024-05-08T18:31:22.420 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:22.420 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:22.420 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:22.420 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:22.420 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:22.420 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:22.420 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 42 2024-05-08T18:31:22.421 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.421 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:22.421 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.421 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:22.421 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247321+0000", 2024-05-08T18:31:22.421 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:22.421 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.421 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.421 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:22.421 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247321+0000", 2024-05-08T18:31:22.421 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:22.421 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.421 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.421 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:22.421 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247323+0000", 2024-05-08T18:31:22.422 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.24e-06 2024-05-08T18:31:22.422 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.422 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.422 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:22.422 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247329+0000", 2024-05-08T18:31:22.422 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1530000000000002e-06 2024-05-08T18:31:22.422 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.422 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.422 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:22.422 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247339+0000", 2024-05-08T18:31:22.422 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0387000000000001e-05 2024-05-08T18:31:22.422 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.422 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.423 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:22.423 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247347+0000", 2024-05-08T18:31:22.423 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9829999999999996e-06 2024-05-08T18:31:22.423 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.423 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.423 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:22.423 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.251488+0000", 2024-05-08T18:31:22.423 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0041412849999999998 2024-05-08T18:31:22.423 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.423 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.423 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:22.423 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.251672+0000", 2024-05-08T18:31:22.423 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00018354499999999999 2024-05-08T18:31:22.423 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.423 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.424 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:22.424 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.251949+0000", 2024-05-08T18:31:22.424 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00027695399999999999 2024-05-08T18:31:22.424 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.424 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.424 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:22.424 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.253810+0000", 2024-05-08T18:31:22.424 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001860806 2024-05-08T18:31:22.424 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.424 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.424 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:22.424 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260244+0000", 2024-05-08T18:31:22.424 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0064347939999999998 2024-05-08T18:31:22.425 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.425 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.425 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:22.425 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260376+0000", 2024-05-08T18:31:22.425 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000131829 2024-05-08T18:31:22.425 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.425 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.425 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:22.425 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260490+0000", 2024-05-08T18:31:22.425 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000113596 2024-05-08T18:31:22.425 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:22.425 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:22.425 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:22.425 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.425 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.426 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:43 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:22.426 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247367+0000", 2024-05-08T18:31:22.426 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 115.151804279, 2024-05-08T18:31:22.426 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013449025999999999, 2024-05-08T18:31:22.426 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:22.426 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:22.426 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:22.426 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:22.426 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:22.426 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:22.426 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 43 2024-05-08T18:31:22.426 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.426 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:22.427 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.427 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:22.427 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247367+0000", 2024-05-08T18:31:22.427 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:22.427 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.427 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.427 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:22.427 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247367+0000", 2024-05-08T18:31:22.427 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:22.427 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.427 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.427 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:22.427 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247368+0000", 2024-05-08T18:31:22.428 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1999999999999999e-07 2024-05-08T18:31:22.428 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.428 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.428 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:22.428 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247374+0000", 2024-05-08T18:31:22.428 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.19e-06 2024-05-08T18:31:22.428 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.428 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.428 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:22.428 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247384+0000", 2024-05-08T18:31:22.428 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0173000000000001e-05 2024-05-08T18:31:22.428 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.428 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.428 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:22.428 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247392+0000", 2024-05-08T18:31:22.429 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1869999999999997e-06 2024-05-08T18:31:22.429 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.429 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.429 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:22.429 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.252515+0000", 2024-05-08T18:31:22.429 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0051221399999999999 2024-05-08T18:31:22.429 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.429 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.429 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:22.429 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.252641+0000", 2024-05-08T18:31:22.429 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012609200000000001 2024-05-08T18:31:22.429 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.429 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.429 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:22.429 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.252842+0000", 2024-05-08T18:31:22.430 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000201619 2024-05-08T18:31:22.430 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.430 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.430 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:22.430 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.256828+0000", 2024-05-08T18:31:22.430 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039853989999999997 2024-05-08T18:31:22.430 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.430 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.430 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:22.430 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260515+0000", 2024-05-08T18:31:22.430 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0036875419999999998 2024-05-08T18:31:22.430 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.431 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.431 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:22.431 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260718+0000", 2024-05-08T18:31:22.431 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020229499999999999 2024-05-08T18:31:22.431 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.431 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.431 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:22.431 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260816+0000", 2024-05-08T18:31:22.431 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8669e-05 2024-05-08T18:31:22.431 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:22.431 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:22.431 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:22.431 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.431 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.432 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:22.432 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247466+0000", 2024-05-08T18:31:22.432 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 115.151705693, 2024-05-08T18:31:22.432 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013491806, 2024-05-08T18:31:22.432 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:22.432 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:22.432 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:22.432 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:22.432 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:22.432 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:22.432 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 44 2024-05-08T18:31:22.432 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.432 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:22.432 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.433 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:22.433 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247466+0000", 2024-05-08T18:31:22.433 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:22.433 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.433 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.433 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:22.433 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247466+0000", 2024-05-08T18:31:22.433 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:22.433 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.433 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.433 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:22.433 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247467+0000", 2024-05-08T18:31:22.433 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.263e-06 2024-05-08T18:31:22.433 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.434 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.434 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:22.434 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247585+0000", 2024-05-08T18:31:22.434 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011756600000000001 2024-05-08T18:31:22.434 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.434 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.434 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:22.434 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247598+0000", 2024-05-08T18:31:22.434 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3766e-05 2024-05-08T18:31:22.434 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.434 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.434 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:22.434 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247609+0000", 2024-05-08T18:31:22.435 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0604e-05 2024-05-08T18:31:22.435 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.435 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.435 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:22.435 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.253890+0000", 2024-05-08T18:31:22.435 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0062810440000000004 2024-05-08T18:31:22.435 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.435 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.435 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:22.435 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.254068+0000", 2024-05-08T18:31:22.435 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017848199999999999 2024-05-08T18:31:22.435 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.435 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.435 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:22.436 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.254488+0000", 2024-05-08T18:31:22.436 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00041965399999999999 2024-05-08T18:31:22.436 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.436 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.436 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:22.436 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.256949+0000", 2024-05-08T18:31:22.436 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002461254 2024-05-08T18:31:22.436 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.436 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.436 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:22.436 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260832+0000", 2024-05-08T18:31:22.436 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0038830539999999999 2024-05-08T18:31:22.436 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.436 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.437 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:22.437 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260906+0000", 2024-05-08T18:31:22.437 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3455999999999996e-05 2024-05-08T18:31:22.437 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.437 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.437 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:22.437 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260958+0000", 2024-05-08T18:31:22.437 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1663000000000003e-05 2024-05-08T18:31:22.437 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:22.437 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:22.437 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:22.438 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.438 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.438 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:22.438 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247630+0000", 2024-05-08T18:31:22.438 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 115.151541288, 2024-05-08T18:31:22.438 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013478753, 2024-05-08T18:31:22.438 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:22.438 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:22.438 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:22.438 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:22.438 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:22.438 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:22.438 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 45 2024-05-08T18:31:22.439 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.439 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:22.439 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.439 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:22.439 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247630+0000", 2024-05-08T18:31:22.439 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:22.439 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.439 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.439 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:22.439 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247630+0000", 2024-05-08T18:31:22.439 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:22.439 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.439 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.439 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:22.439 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247631+0000", 2024-05-08T18:31:22.440 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7399999999999991e-07 2024-05-08T18:31:22.440 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.440 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.440 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:22.440 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247637+0000", 2024-05-08T18:31:22.440 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.93e-06 2024-05-08T18:31:22.440 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.440 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.440 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:22.440 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247647+0000", 2024-05-08T18:31:22.440 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7459999999999995e-06 2024-05-08T18:31:22.440 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.440 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.440 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:22.441 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247654+0000", 2024-05-08T18:31:22.441 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4039999999999998e-06 2024-05-08T18:31:22.441 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.441 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.441 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:22.441 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.255829+0000", 2024-05-08T18:31:22.441 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0081749059999999991 2024-05-08T18:31:22.441 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.441 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.441 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:22.441 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.255979+0000", 2024-05-08T18:31:22.441 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015027899999999999 2024-05-08T18:31:22.441 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.441 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.442 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:22.442 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.256185+0000", 2024-05-08T18:31:22.442 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020583900000000001 2024-05-08T18:31:22.442 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.442 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.442 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:22.442 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260097+0000", 2024-05-08T18:31:22.442 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039121929999999996 2024-05-08T18:31:22.442 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.442 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.442 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:22.442 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260973+0000", 2024-05-08T18:31:22.442 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00087591999999999998 2024-05-08T18:31:22.443 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.443 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.443 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:22.443 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261056+0000", 2024-05-08T18:31:22.443 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3104999999999998e-05 2024-05-08T18:31:22.443 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.443 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.443 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:22.443 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261109+0000", 2024-05-08T18:31:22.443 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2457000000000003e-05 2024-05-08T18:31:22.443 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:22.443 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:22.443 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:22.443 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.444 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.444 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:22.444 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247667+0000", 2024-05-08T18:31:22.444 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 115.151504008, 2024-05-08T18:31:22.444 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013569098999999999, 2024-05-08T18:31:22.444 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:22.444 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:22.444 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:22.444 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:22.444 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:22.444 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:22.444 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 46 2024-05-08T18:31:22.444 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.445 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:22.445 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.445 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:22.445 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247667+0000", 2024-05-08T18:31:22.445 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:22.445 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.445 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.445 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:22.445 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247667+0000", 2024-05-08T18:31:22.445 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:22.445 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.445 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.445 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:22.446 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247668+0000", 2024-05-08T18:31:22.446 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7999999999999995e-07 2024-05-08T18:31:22.446 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.446 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.446 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:22.446 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247674+0000", 2024-05-08T18:31:22.446 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4369999999999998e-06 2024-05-08T18:31:22.446 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.446 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.446 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:22.446 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247683+0000", 2024-05-08T18:31:22.446 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4360000000000008e-06 2024-05-08T18:31:22.446 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.446 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.447 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:22.447 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247690+0000", 2024-05-08T18:31:22.447 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.43e-06 2024-05-08T18:31:22.447 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.447 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.447 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:22.447 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.257358+0000", 2024-05-08T18:31:22.447 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0096676890000000001 2024-05-08T18:31:22.447 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.447 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.448 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:22.448 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.257626+0000", 2024-05-08T18:31:22.448 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00026819099999999998 2024-05-08T18:31:22.448 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.448 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.448 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:22.448 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.258041+0000", 2024-05-08T18:31:22.448 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00041438400000000001 2024-05-08T18:31:22.448 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.448 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.448 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:22.448 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260224+0000", 2024-05-08T18:31:22.448 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0021830700000000001 2024-05-08T18:31:22.448 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.449 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.449 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:22.449 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261127+0000", 2024-05-08T18:31:22.449 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00090292300000000003 2024-05-08T18:31:22.449 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.449 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.449 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:22.449 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261191+0000", 2024-05-08T18:31:22.449 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4342000000000002e-05 2024-05-08T18:31:22.449 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.449 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.449 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:22.449 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261237+0000", 2024-05-08T18:31:22.449 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.5516999999999998e-05 2024-05-08T18:31:22.449 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:22.450 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:22.450 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:22.450 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.450 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.450 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:22.450 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247703+0000", 2024-05-08T18:31:22.450 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 115.151468525, 2024-05-08T18:31:22.450 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015020204000000001, 2024-05-08T18:31:22.450 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:22.450 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:22.450 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:22.450 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:22.450 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:22.451 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:22.451 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 47 2024-05-08T18:31:22.451 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.451 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:22.451 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.451 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:22.451 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247703+0000", 2024-05-08T18:31:22.451 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:22.451 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.451 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.451 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:22.451 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247703+0000", 2024-05-08T18:31:22.451 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:22.452 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.452 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.452 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:22.452 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247704+0000", 2024-05-08T18:31:22.452 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8299999999999996e-07 2024-05-08T18:31:22.452 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.452 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.452 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:22.452 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247877+0000", 2024-05-08T18:31:22.452 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000172979 2024-05-08T18:31:22.452 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.452 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.452 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:22.452 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247894+0000", 2024-05-08T18:31:22.453 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6912999999999999e-05 2024-05-08T18:31:22.453 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.453 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.453 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:22.453 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247903+0000", 2024-05-08T18:31:22.453 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1770000000000004e-06 2024-05-08T18:31:22.453 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.453 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.453 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:22.453 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.258767+0000", 2024-05-08T18:31:22.453 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010864409 2024-05-08T18:31:22.453 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.453 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.453 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:22.453 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.258898+0000", 2024-05-08T18:31:22.454 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000131199 2024-05-08T18:31:22.454 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.454 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.454 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:22.454 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.259117+0000", 2024-05-08T18:31:22.454 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000218889 2024-05-08T18:31:22.454 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.454 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.454 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:22.454 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.262372+0000", 2024-05-08T18:31:22.454 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032545679999999998 2024-05-08T18:31:22.454 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.454 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.454 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:22.455 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.262432+0000", 2024-05-08T18:31:22.455 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9913e-05 2024-05-08T18:31:22.455 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.455 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.455 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:22.455 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.262585+0000", 2024-05-08T18:31:22.455 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015361800000000001 2024-05-08T18:31:22.455 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.455 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.455 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:22.455 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.262723+0000", 2024-05-08T18:31:22.455 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000137856 2024-05-08T18:31:22.455 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:22.456 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:22.456 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:22.456 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.456 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.456 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:22.456 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247927+0000", 2024-05-08T18:31:22.456 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 115.151244487, 2024-05-08T18:31:22.456 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018387718000000001, 2024-05-08T18:31:22.456 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:22.456 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:22.456 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:22.456 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:22.456 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:22.457 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:22.457 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 48 2024-05-08T18:31:22.457 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.457 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:22.457 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.457 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:22.457 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247927+0000", 2024-05-08T18:31:22.457 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:22.457 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.457 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.457 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:22.457 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247927+0000", 2024-05-08T18:31:22.457 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:22.458 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.458 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.458 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:22.458 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247928+0000", 2024-05-08T18:31:22.458 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8400000000000003e-07 2024-05-08T18:31:22.458 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.458 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.458 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:22.458 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247935+0000", 2024-05-08T18:31:22.458 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1230000000000002e-06 2024-05-08T18:31:22.458 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.458 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.458 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:22.459 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247945+0000", 2024-05-08T18:31:22.459 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0346000000000001e-05 2024-05-08T18:31:22.459 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.459 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.459 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:22.459 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247953+0000", 2024-05-08T18:31:22.459 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8040000000000002e-06 2024-05-08T18:31:22.459 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.459 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.459 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:22.459 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261292+0000", 2024-05-08T18:31:22.459 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013339337 2024-05-08T18:31:22.459 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.459 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.460 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:22.460 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261424+0000", 2024-05-08T18:31:22.460 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013201900000000001 2024-05-08T18:31:22.460 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.460 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.460 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:22.460 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261628+0000", 2024-05-08T18:31:22.460 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020327499999999999 2024-05-08T18:31:22.460 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.460 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.460 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:22.460 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.263849+0000", 2024-05-08T18:31:22.460 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0022209759999999999 2024-05-08T18:31:22.460 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.461 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.461 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:22.461 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266167+0000", 2024-05-08T18:31:22.461 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002317979 2024-05-08T18:31:22.461 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.461 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.461 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:22.461 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266249+0000", 2024-05-08T18:31:22.461 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1996000000000006e-05 2024-05-08T18:31:22.461 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.461 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.461 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:22.461 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266315+0000", 2024-05-08T18:31:22.461 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5979e-05 2024-05-08T18:31:22.462 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:22.462 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:22.462 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:22.462 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.462 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.462 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:22.462 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247966+0000", 2024-05-08T18:31:22.462 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 115.151205554, 2024-05-08T18:31:22.462 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0194153, 2024-05-08T18:31:22.462 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:22.462 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:22.462 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:22.462 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:22.463 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:22.463 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:22.463 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 49 2024-05-08T18:31:22.463 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.463 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:22.463 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.463 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:22.463 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247966+0000", 2024-05-08T18:31:22.463 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:22.463 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.463 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.463 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:22.463 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247966+0000", 2024-05-08T18:31:22.464 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:22.464 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.464 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.464 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:22.464 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247967+0000", 2024-05-08T18:31:22.464 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0299999999999998e-07 2024-05-08T18:31:22.464 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.464 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.464 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:22.464 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247972+0000", 2024-05-08T18:31:22.464 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3600000000000004e-06 2024-05-08T18:31:22.464 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.464 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.464 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:22.464 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247981+0000", 2024-05-08T18:31:22.465 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.234e-06 2024-05-08T18:31:22.465 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.465 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.465 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:22.465 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247989+0000", 2024-05-08T18:31:22.465 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5159999999999997e-06 2024-05-08T18:31:22.465 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.465 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.465 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:22.465 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.262816+0000", 2024-05-08T18:31:22.465 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.014827399999999999 2024-05-08T18:31:22.465 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.465 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.465 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:22.466 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.262948+0000", 2024-05-08T18:31:22.466 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013166799999999999 2024-05-08T18:31:22.466 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.466 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.466 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:22.466 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.263153+0000", 2024-05-08T18:31:22.466 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000205272 2024-05-08T18:31:22.466 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.466 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.466 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:22.466 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266144+0000", 2024-05-08T18:31:22.466 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029912300000000001 2024-05-08T18:31:22.466 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.467 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.467 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:22.467 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.267226+0000", 2024-05-08T18:31:22.467 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010820580000000001 2024-05-08T18:31:22.467 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.467 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.467 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:22.467 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.267315+0000", 2024-05-08T18:31:22.467 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8793000000000002e-05 2024-05-08T18:31:22.467 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.467 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.467 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:22.468 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.267381+0000", 2024-05-08T18:31:22.468 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6066000000000001e-05 2024-05-08T18:31:22.468 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:22.468 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:22.468 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:22.468 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.468 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.468 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:22.468 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.248003+0000", 2024-05-08T18:31:22.468 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 115.151168254, 2024-05-08T18:31:22.468 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.020859638999999999, 2024-05-08T18:31:22.468 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:22.468 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:22.468 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:22.469 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:22.469 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:22.469 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:22.469 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 50 2024-05-08T18:31:22.469 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.469 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:22.469 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.469 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:22.469 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248003+0000", 2024-05-08T18:31:22.469 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:22.469 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.469 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.469 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:22.469 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248003+0000", 2024-05-08T18:31:22.469 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:22.470 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.470 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.470 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:22.470 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248004+0000", 2024-05-08T18:31:22.470 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5300000000000003e-07 2024-05-08T18:31:22.470 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.470 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.470 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:22.470 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248139+0000", 2024-05-08T18:31:22.470 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000135193 2024-05-08T18:31:22.470 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.470 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.470 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:22.471 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248151+0000", 2024-05-08T18:31:22.471 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.19e-05 2024-05-08T18:31:22.471 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.471 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.471 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:22.471 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248161+0000", 2024-05-08T18:31:22.471 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4599999999999992e-06 2024-05-08T18:31:22.471 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.471 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.471 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:22.471 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.263961+0000", 2024-05-08T18:31:22.471 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015800844000000001 2024-05-08T18:31:22.471 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.471 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.472 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:22.472 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.264091+0000", 2024-05-08T18:31:22.472 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012952300000000001 2024-05-08T18:31:22.472 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.472 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.472 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:22.472 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.264306+0000", 2024-05-08T18:31:22.472 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000215541 2024-05-08T18:31:22.472 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.472 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.472 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:22.472 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.267205+0000", 2024-05-08T18:31:22.472 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0028989910000000001 2024-05-08T18:31:22.472 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.472 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.473 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:22.473 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.268631+0000", 2024-05-08T18:31:22.473 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0014257320000000001 2024-05-08T18:31:22.473 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.473 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.473 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:22.473 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.268781+0000", 2024-05-08T18:31:22.473 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000149939 2024-05-08T18:31:22.473 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.473 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.473 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:22.473 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.268863+0000", 2024-05-08T18:31:22.473 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1762999999999996e-05 2024-05-08T18:31:22.474 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:22.474 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:22.474 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:22.474 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.474 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.474 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:22.474 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.248201+0000", 2024-05-08T18:31:22.474 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 115.150970499, 2024-05-08T18:31:22.474 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.022909783, 2024-05-08T18:31:22.474 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:22.474 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:22.474 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:22.475 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:22.475 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:22.475 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:22.475 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 51 2024-05-08T18:31:22.475 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.475 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:22.475 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.475 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:22.475 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248201+0000", 2024-05-08T18:31:22.475 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:22.475 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.475 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.475 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:22.475 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248201+0000", 2024-05-08T18:31:22.475 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:22.475 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.476 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.476 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:22.476 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248202+0000", 2024-05-08T18:31:22.476 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2999999999999999e-07 2024-05-08T18:31:22.476 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.476 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.476 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:22.476 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248209+0000", 2024-05-08T18:31:22.476 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5769999999999996e-06 2024-05-08T18:31:22.476 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.476 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.476 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:22.476 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248221+0000", 2024-05-08T18:31:22.476 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1165999999999999e-05 2024-05-08T18:31:22.476 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.477 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.477 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:22.477 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248229+0000", 2024-05-08T18:31:22.477 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1529999999999997e-06 2024-05-08T18:31:22.477 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.477 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.477 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:22.477 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.265146+0000", 2024-05-08T18:31:22.477 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016917492999999999 2024-05-08T18:31:22.477 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.477 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.477 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:22.477 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.265282+0000", 2024-05-08T18:31:22.478 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013597199999999999 2024-05-08T18:31:22.478 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.478 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.478 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:22.478 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.265488+0000", 2024-05-08T18:31:22.478 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000206212 2024-05-08T18:31:22.478 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.478 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.478 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:22.478 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.268442+0000", 2024-05-08T18:31:22.478 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002953841 2024-05-08T18:31:22.478 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.478 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.478 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:22.478 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.270951+0000", 2024-05-08T18:31:22.479 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0025085670000000002 2024-05-08T18:31:22.479 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.479 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.479 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:22.479 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.271042+0000", 2024-05-08T18:31:22.479 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1485999999999998e-05 2024-05-08T18:31:22.479 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.479 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.479 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:22.479 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.271111+0000", 2024-05-08T18:31:22.479 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8386000000000006e-05 2024-05-08T18:31:22.479 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:22.479 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:22.480 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:22.480 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.480 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.480 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:22.480 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.248244+0000", 2024-05-08T18:31:22.480 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 115.150927943, 2024-05-08T18:31:22.480 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.023010806000000002, 2024-05-08T18:31:22.480 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:22.480 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:22.480 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:22.480 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:22.480 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:22.480 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:22.480 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 52 2024-05-08T18:31:22.481 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.481 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:22.481 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.481 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:22.481 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248244+0000", 2024-05-08T18:31:22.481 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:22.481 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.481 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.481 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:22.481 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248244+0000", 2024-05-08T18:31:22.481 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:22.481 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.481 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.481 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:22.481 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248244+0000", 2024-05-08T18:31:22.482 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0999999999999998e-07 2024-05-08T18:31:22.482 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.482 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.482 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:22.482 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248251+0000", 2024-05-08T18:31:22.482 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9639999999999997e-06 2024-05-08T18:31:22.482 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.482 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.482 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:22.482 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248266+0000", 2024-05-08T18:31:22.482 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4996e-05 2024-05-08T18:31:22.482 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.482 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.482 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:22.483 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248274+0000", 2024-05-08T18:31:22.483 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8299999999999996e-06 2024-05-08T18:31:22.483 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.483 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.483 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:22.483 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266367+0000", 2024-05-08T18:31:22.483 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018092607 2024-05-08T18:31:22.483 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.483 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.483 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:22.483 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266532+0000", 2024-05-08T18:31:22.483 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016569600000000001 2024-05-08T18:31:22.483 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.484 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.484 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:22.484 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266729+0000", 2024-05-08T18:31:22.484 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00019630099999999999 2024-05-08T18:31:22.484 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.484 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.484 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:22.484 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.268574+0000", 2024-05-08T18:31:22.484 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0018452329999999999 2024-05-08T18:31:22.484 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.484 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.484 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:22.484 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.271128+0000", 2024-05-08T18:31:22.484 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00255369 2024-05-08T18:31:22.485 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.485 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.485 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:22.485 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.271199+0000", 2024-05-08T18:31:22.485 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1712999999999996e-05 2024-05-08T18:31:22.485 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.485 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.485 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:22.485 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.271254+0000", 2024-05-08T18:31:22.485 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5065999999999998e-05 2024-05-08T18:31:22.485 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:22.485 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:22.485 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:22.486 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.486 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.486 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:22.486 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.486052+0000", 2024-05-08T18:31:22.486 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 114.913119499, 2024-05-08T18:31:22.486 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0098898389999999992, 2024-05-08T18:31:22.486 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:22.486 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:22.486 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:22.486 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:22.486 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:22.486 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:22.486 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 72 2024-05-08T18:31:22.486 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.487 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:22.487 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.487 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:22.487 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486052+0000", 2024-05-08T18:31:22.487 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:22.487 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.487 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.487 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:22.487 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486052+0000", 2024-05-08T18:31:22.487 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:22.487 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.487 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.487 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:22.487 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486053+0000", 2024-05-08T18:31:22.488 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1200000000000001e-07 2024-05-08T18:31:22.488 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.488 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.488 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:22.488 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486188+0000", 2024-05-08T18:31:22.488 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013526200000000001 2024-05-08T18:31:22.488 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.488 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.488 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:22.488 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486205+0000", 2024-05-08T18:31:22.488 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6742e-05 2024-05-08T18:31:22.488 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.488 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.489 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:22.489 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486215+0000", 2024-05-08T18:31:22.489 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8290000000000003e-06 2024-05-08T18:31:22.489 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.489 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.489 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:22.489 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.491930+0000", 2024-05-08T18:31:22.489 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0057153660000000004 2024-05-08T18:31:22.489 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.489 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.489 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:22.489 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.491995+0000", 2024-05-08T18:31:22.489 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5289000000000005e-05 2024-05-08T18:31:22.489 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.490 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.490 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:22.490 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.492096+0000", 2024-05-08T18:31:22.490 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010101400000000001 2024-05-08T18:31:22.490 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.490 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.490 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:22.490 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.494152+0000", 2024-05-08T18:31:22.490 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0020560740000000002 2024-05-08T18:31:22.490 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.490 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.490 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:22.490 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.495860+0000", 2024-05-08T18:31:22.491 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0017076159999999999 2024-05-08T18:31:22.491 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.491 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.491 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:22.491 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.495903+0000", 2024-05-08T18:31:22.491 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3009000000000001e-05 2024-05-08T18:31:22.491 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.491 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.491 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:22.491 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.495942+0000", 2024-05-08T18:31:22.491 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8726000000000002e-05 2024-05-08T18:31:22.491 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:22.491 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:22.491 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:22.492 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.492 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.492 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:22.492 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.486234+0000", 2024-05-08T18:31:22.492 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 114.912937431, 2024-05-08T18:31:22.492 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0099742340000000002, 2024-05-08T18:31:22.492 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:22.492 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:22.492 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:22.492 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:22.492 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:22.492 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:22.492 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 73 2024-05-08T18:31:22.493 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.493 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:22.493 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.493 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:22.493 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486234+0000", 2024-05-08T18:31:22.493 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:22.493 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.493 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.493 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:22.493 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486234+0000", 2024-05-08T18:31:22.493 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:22.493 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.493 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.493 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:22.494 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486235+0000", 2024-05-08T18:31:22.494 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.108e-06 2024-05-08T18:31:22.494 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.494 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.494 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:22.494 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486241+0000", 2024-05-08T18:31:22.494 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4e-06 2024-05-08T18:31:22.494 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.494 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.494 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:22.494 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486251+0000", 2024-05-08T18:31:22.494 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0209e-05 2024-05-08T18:31:22.495 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.495 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.495 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:22.495 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486260+0000", 2024-05-08T18:31:22.495 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2709999999999998e-06 2024-05-08T18:31:22.495 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.495 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.495 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:22.495 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.493294+0000", 2024-05-08T18:31:22.495 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0070341070000000004 2024-05-08T18:31:22.495 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.495 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.495 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:22.495 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.493370+0000", 2024-05-08T18:31:22.495 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5846999999999994e-05 2024-05-08T18:31:22.496 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.496 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.496 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:22.496 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.493479+0000", 2024-05-08T18:31:22.496 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010905500000000001 2024-05-08T18:31:22.496 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.496 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.496 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:22.496 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.495950+0000", 2024-05-08T18:31:22.496 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0024709749999999998 2024-05-08T18:31:22.496 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.496 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.496 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:22.497 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496023+0000", 2024-05-08T18:31:22.497 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3071999999999994e-05 2024-05-08T18:31:22.497 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.497 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.497 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:22.497 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496091+0000", 2024-05-08T18:31:22.497 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7646999999999998e-05 2024-05-08T18:31:22.497 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.497 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.497 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:22.497 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496208+0000", 2024-05-08T18:31:22.497 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000117543 2024-05-08T18:31:22.497 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:22.497 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:22.497 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:22.498 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.498 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.498 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:22.498 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.486276+0000", 2024-05-08T18:31:22.498 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 114.91289510599999, 2024-05-08T18:31:22.498 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010822577, 2024-05-08T18:31:22.498 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:22.498 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:22.498 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:22.498 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:22.498 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:22.498 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:22.498 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 74 2024-05-08T18:31:22.499 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.499 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:22.499 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.499 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:22.499 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486276+0000", 2024-05-08T18:31:22.501 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:22.501 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.501 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.501 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:22.501 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486276+0000", 2024-05-08T18:31:22.501 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:22.501 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.501 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.501 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:22.501 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486277+0000", 2024-05-08T18:31:22.502 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1699999999999997e-07 2024-05-08T18:31:22.502 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.502 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.502 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:22.502 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486282+0000", 2024-05-08T18:31:22.502 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0429999999999998e-06 2024-05-08T18:31:22.502 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.502 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.502 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:22.502 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486294+0000", 2024-05-08T18:31:22.502 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1717e-05 2024-05-08T18:31:22.502 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.503 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.503 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:22.503 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486303+0000", 2024-05-08T18:31:22.503 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.3999999999999998e-06 2024-05-08T18:31:22.503 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.503 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.503 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:22.503 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.494424+0000", 2024-05-08T18:31:22.503 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0081205960000000008 2024-05-08T18:31:22.503 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.503 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.503 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:22.503 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.494539+0000", 2024-05-08T18:31:22.503 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000115661 2024-05-08T18:31:22.504 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.504 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.504 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:22.504 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.494704+0000", 2024-05-08T18:31:22.504 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016422999999999999 2024-05-08T18:31:22.504 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.504 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.504 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:22.504 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496800+0000", 2024-05-08T18:31:22.504 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002096508 2024-05-08T18:31:22.504 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.504 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.504 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:22.504 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496889+0000", 2024-05-08T18:31:22.505 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8349000000000004e-05 2024-05-08T18:31:22.505 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.505 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.505 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:22.505 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496983+0000", 2024-05-08T18:31:22.505 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4882000000000004e-05 2024-05-08T18:31:22.505 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.505 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.505 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:22.505 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.497099+0000", 2024-05-08T18:31:22.505 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000115474 2024-05-08T18:31:22.505 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:22.505 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:22.506 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:22.506 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.506 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.506 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:22.506 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.486324+0000", 2024-05-08T18:31:22.506 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 114.912847086, 2024-05-08T18:31:22.506 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010949207000000001, 2024-05-08T18:31:22.506 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:22.506 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:22.506 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:22.506 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:22.506 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:22.506 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:22.507 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 75 2024-05-08T18:31:22.507 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.507 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:22.507 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.507 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:22.507 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486324+0000", 2024-05-08T18:31:22.507 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:22.507 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.507 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.507 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:22.507 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486324+0000", 2024-05-08T18:31:22.507 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:22.507 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.507 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.507 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:22.508 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486325+0000", 2024-05-08T18:31:22.508 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6200000000000006e-07 2024-05-08T18:31:22.508 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.508 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.508 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:22.508 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486439+0000", 2024-05-08T18:31:22.508 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000113391 2024-05-08T18:31:22.508 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.508 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.508 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:22.508 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486455+0000", 2024-05-08T18:31:22.508 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5823000000000001e-05 2024-05-08T18:31:22.508 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.508 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.509 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:22.509 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486465+0000", 2024-05-08T18:31:22.509 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0879999999999999e-05 2024-05-08T18:31:22.509 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.509 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.509 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:22.509 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.495149+0000", 2024-05-08T18:31:22.509 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0086833589999999999 2024-05-08T18:31:22.509 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.509 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.509 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:22.509 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.495213+0000", 2024-05-08T18:31:22.509 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4176000000000004e-05 2024-05-08T18:31:22.509 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.510 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.510 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:22.510 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.495350+0000", 2024-05-08T18:31:22.510 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013709099999999999 2024-05-08T18:31:22.510 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.510 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.510 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:22.510 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496809+0000", 2024-05-08T18:31:22.510 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001458953 2024-05-08T18:31:22.510 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.510 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.510 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:22.510 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.497199+0000", 2024-05-08T18:31:22.511 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00039045200000000001 2024-05-08T18:31:22.511 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.511 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.511 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:22.511 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.497241+0000", 2024-05-08T18:31:22.511 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1378999999999998e-05 2024-05-08T18:31:22.511 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.511 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.511 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:22.511 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.497274+0000", 2024-05-08T18:31:22.511 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2740999999999997e-05 2024-05-08T18:31:22.511 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:22.511 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:22.511 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:22.512 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.512 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.512 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:22.512 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.486483+0000", 2024-05-08T18:31:22.512 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 114.912688911, 2024-05-08T18:31:22.512 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011783448, 2024-05-08T18:31:22.512 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:22.512 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:22.512 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:22.512 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:22.512 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:22.512 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:22.512 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 76 2024-05-08T18:31:22.513 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.513 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:22.513 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.513 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:22.513 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486483+0000", 2024-05-08T18:31:22.513 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:22.513 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.513 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.513 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:22.513 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486483+0000", 2024-05-08T18:31:22.513 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:22.513 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.513 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.513 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:22.514 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486483+0000", 2024-05-08T18:31:22.514 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6599999999999995e-07 2024-05-08T18:31:22.514 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.514 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.514 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:22.514 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486491+0000", 2024-05-08T18:31:22.514 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.2520000000000002e-06 2024-05-08T18:31:22.514 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.514 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.514 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:22.514 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486500+0000", 2024-05-08T18:31:22.514 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4420000000000004e-06 2024-05-08T18:31:22.514 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.515 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.515 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:22.515 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486507+0000", 2024-05-08T18:31:22.515 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3549999999999999e-06 2024-05-08T18:31:22.515 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.515 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.515 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:22.515 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496319+0000", 2024-05-08T18:31:22.515 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0098120529999999994 2024-05-08T18:31:22.515 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.515 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.515 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:22.515 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496391+0000", 2024-05-08T18:31:22.516 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1433000000000005e-05 2024-05-08T18:31:22.516 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.516 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.516 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:22.516 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496508+0000", 2024-05-08T18:31:22.516 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000116778 2024-05-08T18:31:22.516 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.516 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.516 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:22.516 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.497284+0000", 2024-05-08T18:31:22.516 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00077609100000000002 2024-05-08T18:31:22.516 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.516 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.517 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:22.517 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.498204+0000", 2024-05-08T18:31:22.517 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00092027299999999999 2024-05-08T18:31:22.517 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.517 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.517 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:22.517 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.498240+0000", 2024-05-08T18:31:22.517 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5979999999999998e-05 2024-05-08T18:31:22.517 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.517 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.517 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:22.517 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.498266+0000", 2024-05-08T18:31:22.517 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6024999999999999e-05 2024-05-08T18:31:22.517 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:22.518 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:22.518 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:22.518 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.518 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.518 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:94 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:22.518 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.842580+0000", 2024-05-08T18:31:22.518 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 114.55659161, 2024-05-08T18:31:22.518 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0085315870000000002, 2024-05-08T18:31:22.518 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:22.518 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:22.518 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:22.518 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:22.518 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:22.519 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:22.519 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 94 2024-05-08T18:31:22.519 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.519 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:22.519 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.519 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:22.519 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.842580+0000", 2024-05-08T18:31:22.519 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:22.519 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.519 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.519 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:22.519 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.842580+0000", 2024-05-08T18:31:22.519 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:22.519 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.519 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.520 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:22.520 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.842581+0000", 2024-05-08T18:31:22.520 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.11e-06 2024-05-08T18:31:22.520 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.520 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.520 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:22.520 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.842587+0000", 2024-05-08T18:31:22.520 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2899999999999999e-06 2024-05-08T18:31:22.520 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.520 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.520 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:22.520 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.842597+0000", 2024-05-08T18:31:22.520 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.007e-05 2024-05-08T18:31:22.520 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.521 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.521 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:22.521 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.842605+0000", 2024-05-08T18:31:22.521 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1270000000000003e-06 2024-05-08T18:31:22.521 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.521 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.521 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:22.521 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.848358+0000", 2024-05-08T18:31:22.521 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0057525140000000002 2024-05-08T18:31:22.521 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.521 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.521 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:22.521 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.848481+0000", 2024-05-08T18:31:22.521 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000123239 2024-05-08T18:31:22.522 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.522 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.522 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:22.522 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.848695+0000", 2024-05-08T18:31:22.522 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000213387 2024-05-08T18:31:22.522 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.522 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.522 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:22.522 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.849781+0000", 2024-05-08T18:31:22.522 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010868 2024-05-08T18:31:22.522 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.522 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.522 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:22.523 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.850990+0000", 2024-05-08T18:31:22.523 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0012084769999999999 2024-05-08T18:31:22.523 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.523 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.523 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:22.523 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.851059+0000", 2024-05-08T18:31:22.523 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9130999999999999e-05 2024-05-08T18:31:22.523 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:22.523 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:22.523 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:22.523 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.851111+0000", 2024-05-08T18:31:22.523 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2441999999999997e-05 2024-05-08T18:31:22.523 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:22.523 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:22.523 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:22.524 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:22.524 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:22.524 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:31:22.525 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-08T18:31:22.526 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:31:22.522+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:31:22.626 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:31:22.622+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:31:22.697 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:22.698 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:31:22.698 INFO:teuthology.orchestra.run.smithi097.stdout: "num_ops": 0 2024-05-08T18:31:22.698 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:22.715 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-08T18:31:22.727 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:31:22.722+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:31:22.827 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:31:22.826+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:31:22.882 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:22.882 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:31:22.883 INFO:teuthology.orchestra.run.smithi097.stdout: "complaint_time": 30, 2024-05-08T18:31:22.883 INFO:teuthology.orchestra.run.smithi097.stdout: "num_blocked_ops": 0 2024-05-08T18:31:22.883 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:22.900 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-08T18:31:22.928 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:31:22.926+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:31:23.029 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:31:23.030+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:31:23.118 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:23.118 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2024-05-08T18:31:23.118 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2024-05-08T18:31:23.119 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-05-08T18:31:23.119 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.119 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4206.0:24 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'14, mlcod=16'9)", 2024-05-08T18:31:23.119 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:27.162224+0000", 2024-05-08T18:31:23.119 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 115.955383377, 2024-05-08T18:31:23.119 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032712890000000001, 2024-05-08T18:31:23.119 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:23.119 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:23.119 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:23.119 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:23.119 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.119 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:23.119 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162224+0000", 2024-05-08T18:31:23.120 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:23.120 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.120 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.120 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:23.120 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162224+0000", 2024-05-08T18:31:23.120 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:23.120 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.120 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.120 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:23.120 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162225+0000", 2024-05-08T18:31:23.120 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4899999999999999e-06 2024-05-08T18:31:23.120 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.120 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.121 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:23.121 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162306+0000", 2024-05-08T18:31:23.121 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.0589999999999999e-05 2024-05-08T18:31:23.121 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.121 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.121 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:23.121 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162332+0000", 2024-05-08T18:31:23.121 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5658999999999999e-05 2024-05-08T18:31:23.121 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.121 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.121 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:23.121 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162345+0000", 2024-05-08T18:31:23.121 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3512999999999999e-05 2024-05-08T18:31:23.121 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.122 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.122 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:23.122 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162465+0000", 2024-05-08T18:31:23.122 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000119577 2024-05-08T18:31:23.122 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.122 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.122 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:23.122 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162513+0000", 2024-05-08T18:31:23.122 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8773999999999998e-05 2024-05-08T18:31:23.122 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.122 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.122 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:23.122 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.165405+0000", 2024-05-08T18:31:23.123 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028919200000000001 2024-05-08T18:31:23.123 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.123 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.123 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:23.123 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.165495+0000", 2024-05-08T18:31:23.123 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9765999999999994e-05 2024-05-08T18:31:23.123 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:23.123 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:23.123 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:23.123 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.123 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.123 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4206.0:25 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'15, mlcod=16'10)", 2024-05-08T18:31:23.123 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:27.164793+0000", 2024-05-08T18:31:23.124 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 115.952814249, 2024-05-08T18:31:23.124 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032285249999999999, 2024-05-08T18:31:23.124 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:23.124 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:23.124 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:23.124 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:23.124 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.124 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:23.124 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164793+0000", 2024-05-08T18:31:23.124 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:23.124 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.124 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.124 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:23.124 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164793+0000", 2024-05-08T18:31:23.124 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:23.125 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.125 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.125 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:23.125 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164795+0000", 2024-05-08T18:31:23.125 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0999999999999998e-06 2024-05-08T18:31:23.125 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.125 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.125 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:23.125 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164811+0000", 2024-05-08T18:31:23.125 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5722999999999998e-05 2024-05-08T18:31:23.126 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.126 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.126 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:23.126 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164841+0000", 2024-05-08T18:31:23.126 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0355999999999999e-05 2024-05-08T18:31:23.126 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.126 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.126 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:23.126 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164861+0000", 2024-05-08T18:31:23.126 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9533000000000001e-05 2024-05-08T18:31:23.126 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.126 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.126 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:23.126 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164984+0000", 2024-05-08T18:31:23.127 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000123146 2024-05-08T18:31:23.127 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.127 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.127 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:23.127 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.165024+0000", 2024-05-08T18:31:23.127 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9690000000000001e-05 2024-05-08T18:31:23.127 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.127 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.127 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:23.127 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.167935+0000", 2024-05-08T18:31:23.127 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0029113300000000002 2024-05-08T18:31:23.127 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.127 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.127 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:23.128 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.168021+0000", 2024-05-08T18:31:23.128 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6646999999999999e-05 2024-05-08T18:31:23.128 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:23.128 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:23.128 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:23.128 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.128 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.128 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:31:23.128 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:48.674737+0000", 2024-05-08T18:31:23.128 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 94.442870330999995, 2024-05-08T18:31:23.128 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0035019780000000002, 2024-05-08T18:31:23.128 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:23.128 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:23.128 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:23.129 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:23.129 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:23.129 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:23.129 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 60 2024-05-08T18:31:23.129 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.129 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:23.129 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.129 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:23.129 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674737+0000", 2024-05-08T18:31:23.129 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:23.129 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.129 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.129 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:23.129 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674737+0000", 2024-05-08T18:31:23.130 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:23.130 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.130 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.130 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:23.130 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674740+0000", 2024-05-08T18:31:23.130 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.36e-06 2024-05-08T18:31:23.130 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.130 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.130 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:23.130 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674753+0000", 2024-05-08T18:31:23.130 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3151e-05 2024-05-08T18:31:23.130 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.130 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.131 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:23.131 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674789+0000", 2024-05-08T18:31:23.131 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5929000000000001e-05 2024-05-08T18:31:23.131 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.131 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.131 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:23.131 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674813+0000", 2024-05-08T18:31:23.131 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3325000000000001e-05 2024-05-08T18:31:23.131 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.131 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.131 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:23.131 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674981+0000", 2024-05-08T18:31:23.131 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016879899999999999 2024-05-08T18:31:23.131 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.131 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.132 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:23.132 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.675304+0000", 2024-05-08T18:31:23.132 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00032214400000000001 2024-05-08T18:31:23.132 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.132 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.132 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-05-08T18:31:23.132 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.675639+0000", 2024-05-08T18:31:23.132 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00033494699999999999 2024-05-08T18:31:23.132 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.132 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.132 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:23.132 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.676901+0000", 2024-05-08T18:31:23.132 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001262167 2024-05-08T18:31:23.132 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.133 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.133 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:23.133 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678078+0000", 2024-05-08T18:31:23.133 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001177588 2024-05-08T18:31:23.133 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.133 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.133 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:23.133 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678171+0000", 2024-05-08T18:31:23.133 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.2331999999999996e-05 2024-05-08T18:31:23.133 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.133 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.133 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:23.133 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678239+0000", 2024-05-08T18:31:23.134 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8236000000000002e-05 2024-05-08T18:31:23.134 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:23.134 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:23.134 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:23.134 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.134 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.134 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:61 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94069412632064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:31:23.134 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:48.678410+0000", 2024-05-08T18:31:23.134 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 94.439196938999999, 2024-05-08T18:31:23.134 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0026001800000000001, 2024-05-08T18:31:23.134 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:23.134 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:23.134 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:23.135 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:23.135 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:23.135 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:23.135 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 61 2024-05-08T18:31:23.135 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.135 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:23.135 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.135 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:23.135 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678410+0000", 2024-05-08T18:31:23.135 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:23.135 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.135 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.135 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:23.135 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678410+0000", 2024-05-08T18:31:23.136 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:23.136 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.136 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.136 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:23.136 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678413+0000", 2024-05-08T18:31:23.136 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.34e-06 2024-05-08T18:31:23.136 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.136 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.136 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:23.136 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678421+0000", 2024-05-08T18:31:23.136 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6910000000000003e-06 2024-05-08T18:31:23.136 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.136 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.137 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:23.137 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678447+0000", 2024-05-08T18:31:23.137 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6010999999999999e-05 2024-05-08T18:31:23.137 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.137 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.137 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:23.137 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678461+0000", 2024-05-08T18:31:23.137 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3900000000000001e-05 2024-05-08T18:31:23.137 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.137 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.137 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:23.137 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678560+0000", 2024-05-08T18:31:23.137 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.8834999999999998e-05 2024-05-08T18:31:23.138 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.138 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.138 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:23.138 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678704+0000", 2024-05-08T18:31:23.138 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000143769 2024-05-08T18:31:23.138 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.138 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.138 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-05-08T18:31:23.138 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678942+0000", 2024-05-08T18:31:23.138 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023861800000000001 2024-05-08T18:31:23.138 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.139 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.139 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:23.139 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.680269+0000", 2024-05-08T18:31:23.139 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001326484 2024-05-08T18:31:23.139 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.139 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.139 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:23.139 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.680823+0000", 2024-05-08T18:31:23.139 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00055455900000000004 2024-05-08T18:31:23.139 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.139 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.139 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:23.139 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.680908+0000", 2024-05-08T18:31:23.140 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.4073999999999995e-05 2024-05-08T18:31:23.140 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.140 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.140 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:23.140 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.681010+0000", 2024-05-08T18:31:23.140 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010289900000000001 2024-05-08T18:31:23.140 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:23.140 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:23.140 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:23.140 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.140 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.140 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:31:23.140 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.671896+0000", 2024-05-08T18:31:23.140 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 91.445711054, 2024-05-08T18:31:23.141 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032352349999999999, 2024-05-08T18:31:23.141 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:23.141 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:23.141 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:23.141 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:23.141 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:23.141 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:23.141 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 206 2024-05-08T18:31:23.141 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.141 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:23.141 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.141 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:23.141 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671896+0000", 2024-05-08T18:31:23.141 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:23.142 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.142 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.142 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:23.142 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671896+0000", 2024-05-08T18:31:23.142 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:23.142 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.142 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.142 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:23.142 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671901+0000", 2024-05-08T18:31:23.142 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.763e-06 2024-05-08T18:31:23.142 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.142 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.142 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:23.142 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671920+0000", 2024-05-08T18:31:23.143 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9403e-05 2024-05-08T18:31:23.143 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.143 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.143 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:23.143 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671969+0000", 2024-05-08T18:31:23.143 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8343000000000001e-05 2024-05-08T18:31:23.143 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.143 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.143 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:23.143 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671996+0000", 2024-05-08T18:31:23.143 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7307000000000001e-05 2024-05-08T18:31:23.143 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.143 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.143 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:23.144 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.672149+0000", 2024-05-08T18:31:23.144 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015336500000000001 2024-05-08T18:31:23.144 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.144 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.144 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:23.144 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.672393+0000", 2024-05-08T18:31:23.144 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024380800000000001 2024-05-08T18:31:23.144 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.144 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.144 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-05-08T18:31:23.144 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.672838+0000", 2024-05-08T18:31:23.144 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00044472700000000001 2024-05-08T18:31:23.144 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.144 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.145 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:23.145 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.674218+0000", 2024-05-08T18:31:23.145 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001380243 2024-05-08T18:31:23.145 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.145 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.145 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:23.145 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.674963+0000", 2024-05-08T18:31:23.145 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00074534999999999998 2024-05-08T18:31:23.145 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.145 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.145 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:23.145 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675057+0000", 2024-05-08T18:31:23.145 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.3633000000000003e-05 2024-05-08T18:31:23.145 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.146 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.146 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:23.146 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675131+0000", 2024-05-08T18:31:23.146 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.4293000000000002e-05 2024-05-08T18:31:23.146 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:23.146 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:23.146 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:23.146 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.146 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.146 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:23.146 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.694194+0000", 2024-05-08T18:31:23.146 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 91.423413655999994, 2024-05-08T18:31:23.147 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0087385129999999998, 2024-05-08T18:31:23.147 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:23.147 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:23.147 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:23.147 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:23.147 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:23.147 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:23.147 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 210 2024-05-08T18:31:23.147 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.147 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:23.147 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.147 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:23.147 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694194+0000", 2024-05-08T18:31:23.147 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:23.147 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.148 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.148 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:23.148 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694194+0000", 2024-05-08T18:31:23.148 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:23.148 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.148 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.148 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:23.148 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694196+0000", 2024-05-08T18:31:23.148 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6299999999999998e-06 2024-05-08T18:31:23.148 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.148 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.148 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:23.148 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694208+0000", 2024-05-08T18:31:23.148 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.187e-05 2024-05-08T18:31:23.148 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.149 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.149 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:23.149 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694240+0000", 2024-05-08T18:31:23.149 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1673e-05 2024-05-08T18:31:23.149 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.149 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.149 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:23.149 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694255+0000", 2024-05-08T18:31:23.149 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5573000000000002e-05 2024-05-08T18:31:23.149 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.149 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.149 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:23.150 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694394+0000", 2024-05-08T18:31:23.150 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000138536 2024-05-08T18:31:23.150 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.150 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.150 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-05-08T18:31:23.150 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694405+0000", 2024-05-08T18:31:23.150 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0883000000000001e-05 2024-05-08T18:31:23.150 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.150 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.150 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:23.150 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.699491+0000", 2024-05-08T18:31:23.151 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0050861939999999996 2024-05-08T18:31:23.151 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.151 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.151 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:23.151 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.699829+0000", 2024-05-08T18:31:23.151 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000338191 2024-05-08T18:31:23.151 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.151 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.151 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:23.151 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.700504+0000", 2024-05-08T18:31:23.151 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000674481 2024-05-08T18:31:23.151 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.151 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.151 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:23.152 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.702152+0000", 2024-05-08T18:31:23.152 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0016487450000000001 2024-05-08T18:31:23.152 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.152 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.152 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:23.152 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.702792+0000", 2024-05-08T18:31:23.152 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00063962800000000005 2024-05-08T18:31:23.152 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.152 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.152 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:23.152 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.702874+0000", 2024-05-08T18:31:23.152 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.2091999999999999e-05 2024-05-08T18:31:23.152 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.153 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.153 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:23.153 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.702932+0000", 2024-05-08T18:31:23.153 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8016999999999997e-05 2024-05-08T18:31:23.153 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:23.153 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:23.153 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:23.153 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.153 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.153 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:23.153 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.728239+0000", 2024-05-08T18:31:23.153 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 91.389367794999998, 2024-05-08T18:31:23.153 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0035376119999999999, 2024-05-08T18:31:23.153 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:23.154 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:23.154 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:23.154 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:23.154 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:23.154 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:23.154 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 218 2024-05-08T18:31:23.154 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.154 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:23.154 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.154 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:23.154 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728239+0000", 2024-05-08T18:31:23.154 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:23.154 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.154 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.155 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:23.155 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728239+0000", 2024-05-08T18:31:23.155 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:23.155 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.155 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.155 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:23.155 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728242+0000", 2024-05-08T18:31:23.155 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0130000000000002e-06 2024-05-08T18:31:23.155 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.155 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.155 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:23.155 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728254+0000", 2024-05-08T18:31:23.155 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.172e-05 2024-05-08T18:31:23.155 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.156 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.156 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:23.156 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728285+0000", 2024-05-08T18:31:23.156 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0703000000000001e-05 2024-05-08T18:31:23.156 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.156 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.156 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:23.156 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728301+0000", 2024-05-08T18:31:23.156 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5656999999999999e-05 2024-05-08T18:31:23.156 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.156 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.156 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:23.156 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728460+0000", 2024-05-08T18:31:23.156 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015934200000000001 2024-05-08T18:31:23.156 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.157 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.157 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:23.157 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728803+0000", 2024-05-08T18:31:23.157 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00034267400000000001 2024-05-08T18:31:23.157 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.157 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.157 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:23.157 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.729485+0000", 2024-05-08T18:31:23.157 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00068206799999999998 2024-05-08T18:31:23.157 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.157 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.157 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:23.157 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731218+0000", 2024-05-08T18:31:23.157 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0017332630000000001 2024-05-08T18:31:23.158 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.158 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.158 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:23.158 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731615+0000", 2024-05-08T18:31:23.158 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00039671699999999999 2024-05-08T18:31:23.158 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.158 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.158 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:23.158 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731709+0000", 2024-05-08T18:31:23.158 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.4740000000000004e-05 2024-05-08T18:31:23.158 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.158 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.158 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:23.159 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731777+0000", 2024-05-08T18:31:23.159 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7714999999999998e-05 2024-05-08T18:31:23.159 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:23.159 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:23.159 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:23.159 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.159 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.159 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:23.159 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.743331+0000", 2024-05-08T18:31:23.159 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 91.374275811999993, 2024-05-08T18:31:23.159 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031193229999999998, 2024-05-08T18:31:23.160 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:23.160 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:23.160 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:23.160 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:23.160 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:23.160 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:23.160 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 222 2024-05-08T18:31:23.160 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.160 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:23.160 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.160 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:23.160 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743331+0000", 2024-05-08T18:31:23.160 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:23.160 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.161 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.161 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:23.161 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743331+0000", 2024-05-08T18:31:23.161 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:23.161 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.161 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.161 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:23.161 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743334+0000", 2024-05-08T18:31:23.161 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2900000000000001e-06 2024-05-08T18:31:23.161 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.161 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.161 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:23.161 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743345+0000", 2024-05-08T18:31:23.162 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0947e-05 2024-05-08T18:31:23.162 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.162 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.162 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:23.162 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743375+0000", 2024-05-08T18:31:23.162 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0298999999999999e-05 2024-05-08T18:31:23.162 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.162 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.162 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:23.162 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743390+0000", 2024-05-08T18:31:23.162 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4606999999999999e-05 2024-05-08T18:31:23.162 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.162 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.163 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:23.163 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743524+0000", 2024-05-08T18:31:23.163 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000134105 2024-05-08T18:31:23.163 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.163 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.163 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:23.163 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743738+0000", 2024-05-08T18:31:23.163 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000214222 2024-05-08T18:31:23.163 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.163 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.163 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:23.163 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.744159+0000", 2024-05-08T18:31:23.163 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00042102300000000002 2024-05-08T18:31:23.163 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.164 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.164 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:23.164 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.745399+0000", 2024-05-08T18:31:23.164 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012400309999999999 2024-05-08T18:31:23.164 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.164 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.164 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:23.164 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.746296+0000", 2024-05-08T18:31:23.164 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00089682 2024-05-08T18:31:23.164 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.164 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.164 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:23.164 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.746385+0000", 2024-05-08T18:31:23.164 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9289000000000005e-05 2024-05-08T18:31:23.165 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.165 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.165 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:23.165 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.746451+0000", 2024-05-08T18:31:23.165 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5690000000000003e-05 2024-05-08T18:31:23.165 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:23.165 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:23.165 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:23.165 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.165 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.165 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:23.165 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.772338+0000", 2024-05-08T18:31:23.165 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 91.345269611999996, 2024-05-08T18:31:23.165 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0035084059999999999, 2024-05-08T18:31:23.166 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:23.166 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:23.166 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:23.166 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:23.166 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:23.166 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:23.166 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 230 2024-05-08T18:31:23.166 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.166 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:23.166 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.166 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:23.166 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772338+0000", 2024-05-08T18:31:23.166 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:23.167 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.167 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.167 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:23.167 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772338+0000", 2024-05-08T18:31:23.167 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:23.167 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.167 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.167 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:23.167 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772340+0000", 2024-05-08T18:31:23.167 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3460000000000001e-06 2024-05-08T18:31:23.167 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.167 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.167 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:23.167 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772352+0000", 2024-05-08T18:31:23.168 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2284e-05 2024-05-08T18:31:23.168 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.168 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.168 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:23.168 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772382+0000", 2024-05-08T18:31:23.168 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0083e-05 2024-05-08T18:31:23.168 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.168 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.168 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:23.168 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772397+0000", 2024-05-08T18:31:23.168 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4963000000000001e-05 2024-05-08T18:31:23.168 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.168 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.168 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:23.168 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772508+0000", 2024-05-08T18:31:23.169 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000110402 2024-05-08T18:31:23.169 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.169 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.169 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:23.169 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772742+0000", 2024-05-08T18:31:23.169 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023428899999999999 2024-05-08T18:31:23.169 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.169 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.169 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:23.169 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.773183+0000", 2024-05-08T18:31:23.169 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00044107899999999998 2024-05-08T18:31:23.169 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.169 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.169 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:23.170 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.774488+0000", 2024-05-08T18:31:23.170 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0013053940000000001 2024-05-08T18:31:23.170 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.170 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.170 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:23.170 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.775689+0000", 2024-05-08T18:31:23.170 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012004699999999999 2024-05-08T18:31:23.170 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.170 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.170 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:23.170 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.775777+0000", 2024-05-08T18:31:23.170 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8483e-05 2024-05-08T18:31:23.170 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.170 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.171 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:23.171 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.775846+0000", 2024-05-08T18:31:23.171 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8613000000000002e-05 2024-05-08T18:31:23.171 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:23.171 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:23.171 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:23.171 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.171 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.171 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:23.171 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.790921+0000", 2024-05-08T18:31:23.171 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 91.326686265999996, 2024-05-08T18:31:23.171 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003116869, 2024-05-08T18:31:23.171 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:23.171 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:23.172 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:23.172 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:23.172 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:23.172 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:23.172 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 235 2024-05-08T18:31:23.172 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.172 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:23.172 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.172 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:23.172 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790921+0000", 2024-05-08T18:31:23.172 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:23.172 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.172 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.172 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:23.172 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790921+0000", 2024-05-08T18:31:23.173 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:23.173 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.173 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.173 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:23.173 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790923+0000", 2024-05-08T18:31:23.173 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3199999999999998e-06 2024-05-08T18:31:23.173 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.173 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.173 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:23.173 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790934+0000", 2024-05-08T18:31:23.173 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.117e-05 2024-05-08T18:31:23.173 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.173 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.173 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:23.174 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790965+0000", 2024-05-08T18:31:23.174 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0392999999999999e-05 2024-05-08T18:31:23.174 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.174 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.174 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:23.174 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790981+0000", 2024-05-08T18:31:23.174 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5699999999999999e-05 2024-05-08T18:31:23.174 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.174 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.174 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:23.174 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.791093+0000", 2024-05-08T18:31:23.174 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000112062 2024-05-08T18:31:23.174 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.174 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.175 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:23.175 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.791324+0000", 2024-05-08T18:31:23.175 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023142200000000001 2024-05-08T18:31:23.175 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.175 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.175 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:23.175 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.791761+0000", 2024-05-08T18:31:23.175 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00043669999999999999 2024-05-08T18:31:23.175 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.175 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.175 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:23.175 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.792996+0000", 2024-05-08T18:31:23.175 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001235713 2024-05-08T18:31:23.175 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.176 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.176 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:23.176 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.793850+0000", 2024-05-08T18:31:23.176 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00085392400000000005 2024-05-08T18:31:23.176 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.176 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.176 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:23.176 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.793971+0000", 2024-05-08T18:31:23.176 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000120516 2024-05-08T18:31:23.176 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.176 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.176 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:23.176 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794038+0000", 2024-05-08T18:31:23.176 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6948999999999999e-05 2024-05-08T18:31:23.177 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:23.177 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:23.177 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:23.177 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.177 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.177 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:349 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:23.177 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.817315+0000", 2024-05-08T18:31:23.177 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 91.300292395, 2024-05-08T18:31:23.177 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0036888580000000002, 2024-05-08T18:31:23.177 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:23.177 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:23.177 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:23.177 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:23.177 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:23.178 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:23.178 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 349 2024-05-08T18:31:23.178 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.178 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:23.178 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.178 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:23.178 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817315+0000", 2024-05-08T18:31:23.178 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:23.178 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.178 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.178 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:23.178 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817315+0000", 2024-05-08T18:31:23.178 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:23.178 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.179 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.179 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:23.179 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817316+0000", 2024-05-08T18:31:23.179 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3370000000000001e-06 2024-05-08T18:31:23.179 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.179 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.179 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:23.179 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817323+0000", 2024-05-08T18:31:23.179 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.4300000000000003e-06 2024-05-08T18:31:23.179 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.179 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.179 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:23.179 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817337+0000", 2024-05-08T18:31:23.179 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4025999999999999e-05 2024-05-08T18:31:23.179 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.180 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.180 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:23.180 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817345+0000", 2024-05-08T18:31:23.180 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5669999999999995e-06 2024-05-08T18:31:23.180 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.180 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.180 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:23.180 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817407+0000", 2024-05-08T18:31:23.180 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1882000000000001e-05 2024-05-08T18:31:23.180 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.180 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.180 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:23.180 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817508+0000", 2024-05-08T18:31:23.180 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000100585 2024-05-08T18:31:23.181 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.181 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.181 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:23.181 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817673+0000", 2024-05-08T18:31:23.181 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000165802 2024-05-08T18:31:23.181 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.181 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.181 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:23.181 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.818715+0000", 2024-05-08T18:31:23.181 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0010417720000000001 2024-05-08T18:31:23.181 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.181 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.181 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:23.181 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.820892+0000", 2024-05-08T18:31:23.181 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0021771859999999998 2024-05-08T18:31:23.182 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.182 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.182 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:23.182 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.820950+0000", 2024-05-08T18:31:23.182 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7636000000000002e-05 2024-05-08T18:31:23.182 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.182 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.182 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:23.182 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.821004+0000", 2024-05-08T18:31:23.182 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3634999999999997e-05 2024-05-08T18:31:23.182 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:23.182 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:23.182 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:23.182 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.183 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.183 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:406 6.16 6:6dc3b799:reshard::reshard.0000000006:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:23.183 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.840465+0000", 2024-05-08T18:31:23.183 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 91.277142229000006, 2024-05-08T18:31:23.183 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003613032, 2024-05-08T18:31:23.183 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:23.183 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:23.183 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:23.183 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:23.183 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:23.183 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:23.183 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 406 2024-05-08T18:31:23.183 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.183 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:23.183 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.184 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:23.184 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840465+0000", 2024-05-08T18:31:23.184 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:23.184 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.184 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.184 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:23.184 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840465+0000", 2024-05-08T18:31:23.184 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:23.184 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.184 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.184 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:23.184 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840466+0000", 2024-05-08T18:31:23.184 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7499999999999999e-07 2024-05-08T18:31:23.184 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.185 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.185 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:23.185 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840471+0000", 2024-05-08T18:31:23.185 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9699999999999998e-06 2024-05-08T18:31:23.185 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.185 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.185 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:23.185 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840484+0000", 2024-05-08T18:31:23.185 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2717999999999999e-05 2024-05-08T18:31:23.185 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.185 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.185 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:23.185 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840490+0000", 2024-05-08T18:31:23.185 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.472e-06 2024-05-08T18:31:23.186 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.186 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.186 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:23.186 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840536+0000", 2024-05-08T18:31:23.186 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6409000000000002e-05 2024-05-08T18:31:23.186 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.186 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.186 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:23.186 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840591+0000", 2024-05-08T18:31:23.186 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4911000000000003e-05 2024-05-08T18:31:23.186 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.186 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.187 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:23.187 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840745+0000", 2024-05-08T18:31:23.187 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015394900000000001 2024-05-08T18:31:23.187 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.187 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.187 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:23.187 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.841269+0000", 2024-05-08T18:31:23.187 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00052347299999999999 2024-05-08T18:31:23.187 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.187 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.187 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:23.187 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.843997+0000", 2024-05-08T18:31:23.187 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0027285080000000001 2024-05-08T18:31:23.187 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.187 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.188 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:23.188 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844033+0000", 2024-05-08T18:31:23.188 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6038000000000003e-05 2024-05-08T18:31:23.188 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.188 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.188 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:23.188 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844078+0000", 2024-05-08T18:31:23.188 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4709000000000002e-05 2024-05-08T18:31:23.188 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:23.188 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:23.188 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:23.188 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.188 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.188 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:413 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:23.189 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.844187+0000", 2024-05-08T18:31:23.189 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 91.273420651999999, 2024-05-08T18:31:23.189 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0024835069999999998, 2024-05-08T18:31:23.189 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:23.189 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:23.189 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:23.189 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:23.189 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:23.189 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:23.189 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 413 2024-05-08T18:31:23.189 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.189 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:23.189 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.189 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:23.190 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844187+0000", 2024-05-08T18:31:23.190 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:23.190 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.190 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.190 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:23.190 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844187+0000", 2024-05-08T18:31:23.190 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:23.190 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.190 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.190 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:23.190 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844187+0000", 2024-05-08T18:31:23.190 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9999999999999996e-07 2024-05-08T18:31:23.193 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.193 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.193 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:23.193 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844192+0000", 2024-05-08T18:31:23.194 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7899999999999999e-06 2024-05-08T18:31:23.194 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.194 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.194 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:23.194 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844203+0000", 2024-05-08T18:31:23.194 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1002000000000001e-05 2024-05-08T18:31:23.194 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.194 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.194 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:23.194 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844209+0000", 2024-05-08T18:31:23.194 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6570000000000002e-06 2024-05-08T18:31:23.194 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.195 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.195 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:23.195 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844270+0000", 2024-05-08T18:31:23.195 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0810999999999998e-05 2024-05-08T18:31:23.195 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.195 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.195 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:23.195 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844419+0000", 2024-05-08T18:31:23.195 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000149097 2024-05-08T18:31:23.195 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.195 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.195 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:23.195 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844611+0000", 2024-05-08T18:31:23.195 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00019247900000000001 2024-05-08T18:31:23.195 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.196 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.196 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:23.196 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.845287+0000", 2024-05-08T18:31:23.196 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00067526000000000001 2024-05-08T18:31:23.196 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.196 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.196 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:23.196 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.846609+0000", 2024-05-08T18:31:23.196 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001322124 2024-05-08T18:31:23.196 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.196 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.196 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:23.196 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.846642+0000", 2024-05-08T18:31:23.196 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3654e-05 2024-05-08T18:31:23.197 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.197 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.197 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:23.197 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.846670+0000", 2024-05-08T18:31:23.197 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7733e-05 2024-05-08T18:31:23.197 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:23.197 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:23.197 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:23.197 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.197 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.197 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:420 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:23.197 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.847096+0000", 2024-05-08T18:31:23.197 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 91.270511357999993, 2024-05-08T18:31:23.197 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0026261589999999999, 2024-05-08T18:31:23.198 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:23.198 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:23.198 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:23.198 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:23.198 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:23.198 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:23.198 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 420 2024-05-08T18:31:23.198 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.198 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:23.198 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.198 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:23.198 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847096+0000", 2024-05-08T18:31:23.198 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:23.198 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.198 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.199 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:23.199 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847096+0000", 2024-05-08T18:31:23.199 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:23.199 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.199 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.199 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:23.199 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847097+0000", 2024-05-08T18:31:23.199 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.5499999999999996e-07 2024-05-08T18:31:23.199 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.199 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.199 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:23.199 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847103+0000", 2024-05-08T18:31:23.199 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8969999999999996e-06 2024-05-08T18:31:23.199 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.200 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.200 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:23.200 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847114+0000", 2024-05-08T18:31:23.200 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1549000000000001e-05 2024-05-08T18:31:23.200 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.200 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.200 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:23.200 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847120+0000", 2024-05-08T18:31:23.200 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5509999999999999e-06 2024-05-08T18:31:23.200 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.200 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.200 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:23.200 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847166+0000", 2024-05-08T18:31:23.200 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6683e-05 2024-05-08T18:31:23.200 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.201 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.201 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:23.201 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847213+0000", 2024-05-08T18:31:23.201 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6659000000000002e-05 2024-05-08T18:31:23.201 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.201 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.201 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:23.201 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847315+0000", 2024-05-08T18:31:23.201 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000102336 2024-05-08T18:31:23.201 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.201 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.201 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:23.201 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847840+0000", 2024-05-08T18:31:23.201 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00052475000000000004 2024-05-08T18:31:23.202 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.202 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.202 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:23.202 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.849660+0000", 2024-05-08T18:31:23.202 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001819563 2024-05-08T18:31:23.202 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.202 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.202 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:23.202 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.849695+0000", 2024-05-08T18:31:23.202 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4761000000000001e-05 2024-05-08T18:31:23.202 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.202 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.202 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:23.202 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.849722+0000", 2024-05-08T18:31:23.203 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7455000000000001e-05 2024-05-08T18:31:23.203 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:23.203 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:23.203 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:23.203 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.203 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.203 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:532 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:23.203 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.908603+0000", 2024-05-08T18:31:23.203 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 91.209003808000006, 2024-05-08T18:31:23.203 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0038838950000000001, 2024-05-08T18:31:23.203 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:23.203 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:23.203 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:23.203 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:23.204 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:23.204 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:23.204 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 532 2024-05-08T18:31:23.204 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.204 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:23.204 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.204 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:23.204 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908603+0000", 2024-05-08T18:31:23.204 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:23.204 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.204 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.204 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:23.204 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908603+0000", 2024-05-08T18:31:23.204 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:23.205 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.205 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.205 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:23.205 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908605+0000", 2024-05-08T18:31:23.205 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1179999999999999e-06 2024-05-08T18:31:23.205 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.205 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.205 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:23.205 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908608+0000", 2024-05-08T18:31:23.205 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7419999999999999e-06 2024-05-08T18:31:23.205 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.205 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.205 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:23.206 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908618+0000", 2024-05-08T18:31:23.206 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.6889999999999999e-06 2024-05-08T18:31:23.206 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.206 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.206 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:23.206 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908625+0000", 2024-05-08T18:31:23.206 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1300000000000003e-06 2024-05-08T18:31:23.206 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.206 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.206 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:23.206 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908669+0000", 2024-05-08T18:31:23.206 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3832000000000003e-05 2024-05-08T18:31:23.206 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.206 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.207 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:23.207 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908724+0000", 2024-05-08T18:31:23.207 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5222000000000001e-05 2024-05-08T18:31:23.207 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.207 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.207 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:23.207 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908854+0000", 2024-05-08T18:31:23.207 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012953500000000001 2024-05-08T18:31:23.207 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.207 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.207 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:23.207 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.909511+0000", 2024-05-08T18:31:23.207 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00065768399999999996 2024-05-08T18:31:23.207 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.208 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.208 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:23.208 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912426+0000", 2024-05-08T18:31:23.208 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0029146599999999999 2024-05-08T18:31:23.208 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.208 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.208 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:23.208 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912461+0000", 2024-05-08T18:31:23.208 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4934999999999997e-05 2024-05-08T18:31:23.208 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.208 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.208 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:23.208 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912487+0000", 2024-05-08T18:31:23.208 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6347999999999999e-05 2024-05-08T18:31:23.209 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:23.209 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:23.209 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:23.209 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.209 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.209 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:534 6.9 6:9268b73e:::obj_delete_at_hint.0000000019:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:23.209 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.910153+0000", 2024-05-08T18:31:23.209 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 91.207454350999996, 2024-05-08T18:31:23.209 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0051089680000000002, 2024-05-08T18:31:23.209 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:23.209 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:23.209 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:23.209 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:23.209 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:23.210 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:23.210 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 534 2024-05-08T18:31:23.210 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.210 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:23.210 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.210 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:23.210 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910153+0000", 2024-05-08T18:31:23.210 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:23.210 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.210 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.210 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:23.210 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910153+0000", 2024-05-08T18:31:23.210 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:23.210 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.211 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.211 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:23.211 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910154+0000", 2024-05-08T18:31:23.211 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1039999999999999e-06 2024-05-08T18:31:23.211 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.211 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.211 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:23.211 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910158+0000", 2024-05-08T18:31:23.211 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7400000000000002e-06 2024-05-08T18:31:23.211 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.211 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.211 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:23.211 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910167+0000", 2024-05-08T18:31:23.212 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8880000000000003e-06 2024-05-08T18:31:23.212 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.212 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.212 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:23.212 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910173+0000", 2024-05-08T18:31:23.212 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.844e-06 2024-05-08T18:31:23.212 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.212 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.213 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:23.213 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910220+0000", 2024-05-08T18:31:23.213 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6582000000000002e-05 2024-05-08T18:31:23.213 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.213 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.213 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:23.213 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910287+0000", 2024-05-08T18:31:23.213 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7271e-05 2024-05-08T18:31:23.213 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.213 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.213 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:23.213 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910402+0000", 2024-05-08T18:31:23.213 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115127 2024-05-08T18:31:23.213 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.214 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.214 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:23.214 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910881+0000", 2024-05-08T18:31:23.214 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000479025 2024-05-08T18:31:23.214 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.214 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.214 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:23.214 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.915206+0000", 2024-05-08T18:31:23.214 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.004324357 2024-05-08T18:31:23.214 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.214 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.214 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:23.214 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.915237+0000", 2024-05-08T18:31:23.214 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1590000000000001e-05 2024-05-08T18:31:23.215 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.215 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.215 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:23.215 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.915262+0000", 2024-05-08T18:31:23.215 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.444e-05 2024-05-08T18:31:23.215 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:23.215 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:23.215 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:23.215 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.215 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.215 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:583 6.0 6:03bbb29a:::obj_delete_at_hint.0000000026:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:23.215 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.947199+0000", 2024-05-08T18:31:23.215 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 91.170408154, 2024-05-08T18:31:23.215 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0025081510000000001, 2024-05-08T18:31:23.216 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:23.216 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:23.216 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:23.216 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:23.216 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:23.216 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:23.216 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 583 2024-05-08T18:31:23.216 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.216 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:23.216 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.216 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:23.216 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947199+0000", 2024-05-08T18:31:23.216 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:23.216 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.217 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.217 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:23.217 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947199+0000", 2024-05-08T18:31:23.217 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:23.217 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.217 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.217 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:23.217 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947200+0000", 2024-05-08T18:31:23.217 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3799999999999997e-07 2024-05-08T18:31:23.217 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.217 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.217 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:23.217 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947207+0000", 2024-05-08T18:31:23.217 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2030000000000003e-06 2024-05-08T18:31:23.217 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.218 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.218 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:23.218 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947217+0000", 2024-05-08T18:31:23.218 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0138e-05 2024-05-08T18:31:23.218 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.218 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.218 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:23.218 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947224+0000", 2024-05-08T18:31:23.218 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5289999999999997e-06 2024-05-08T18:31:23.218 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.218 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.218 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:23.218 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.948039+0000", 2024-05-08T18:31:23.219 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00081500599999999996 2024-05-08T18:31:23.219 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.219 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.219 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:23.219 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.948230+0000", 2024-05-08T18:31:23.219 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000191838 2024-05-08T18:31:23.219 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.219 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.219 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:23.219 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.948606+0000", 2024-05-08T18:31:23.219 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00037547900000000001 2024-05-08T18:31:23.219 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.219 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.220 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:23.220 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.949406+0000", 2024-05-08T18:31:23.220 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000799674 2024-05-08T18:31:23.220 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.220 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.220 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:23.220 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.949630+0000", 2024-05-08T18:31:23.220 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00022474699999999999 2024-05-08T18:31:23.220 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.220 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.220 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:23.220 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.949664+0000", 2024-05-08T18:31:23.220 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3535999999999999e-05 2024-05-08T18:31:23.220 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.221 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.221 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:23.221 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.949707+0000", 2024-05-08T18:31:23.221 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3362999999999998e-05 2024-05-08T18:31:23.221 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:23.221 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:23.221 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:23.221 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.221 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.221 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:23.221 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.263796+0000", 2024-05-08T18:31:23.221 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 90.853810886000005, 2024-05-08T18:31:23.221 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0027788019999999999, 2024-05-08T18:31:23.221 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:23.222 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:23.222 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:23.222 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:23.222 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:23.222 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:23.222 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 811 2024-05-08T18:31:23.222 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.222 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:23.222 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.222 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:23.222 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263796+0000", 2024-05-08T18:31:23.222 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:23.222 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.223 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.223 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:23.223 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263796+0000", 2024-05-08T18:31:23.223 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:23.223 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.223 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.223 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:23.223 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263799+0000", 2024-05-08T18:31:23.223 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5569999999999998e-06 2024-05-08T18:31:23.223 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.223 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.223 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:23.223 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263812+0000", 2024-05-08T18:31:23.223 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3145999999999999e-05 2024-05-08T18:31:23.224 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.224 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.224 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:23.224 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263842+0000", 2024-05-08T18:31:23.224 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0193e-05 2024-05-08T18:31:23.224 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.224 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.224 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:23.224 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263860+0000", 2024-05-08T18:31:23.224 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7880000000000002e-05 2024-05-08T18:31:23.224 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.224 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.224 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:23.224 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263979+0000", 2024-05-08T18:31:23.225 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011919899999999999 2024-05-08T18:31:23.225 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.225 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.225 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:23.225 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.264222+0000", 2024-05-08T18:31:23.225 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024290800000000001 2024-05-08T18:31:23.225 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.225 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.225 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:23.225 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.264545+0000", 2024-05-08T18:31:23.225 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00032300200000000002 2024-05-08T18:31:23.225 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.225 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.225 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:23.226 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.265682+0000", 2024-05-08T18:31:23.226 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001136464 2024-05-08T18:31:23.226 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.226 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.226 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:23.226 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.266397+0000", 2024-05-08T18:31:23.226 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00071512799999999999 2024-05-08T18:31:23.226 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.226 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.226 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:23.226 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.266504+0000", 2024-05-08T18:31:23.226 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000107019 2024-05-08T18:31:23.226 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.226 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.227 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:23.227 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.266575+0000", 2024-05-08T18:31:23.227 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1305999999999998e-05 2024-05-08T18:31:23.227 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:23.227 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:23.227 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:23.227 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.227 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.228 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:23.228 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.445706+0000", 2024-05-08T18:31:23.228 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 90.671901169999998, 2024-05-08T18:31:23.228 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0026820630000000002, 2024-05-08T18:31:23.228 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:23.228 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:23.228 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:23.228 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:23.228 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:23.228 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:23.228 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 889 2024-05-08T18:31:23.228 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.228 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:23.228 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.229 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:23.229 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445706+0000", 2024-05-08T18:31:23.229 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:23.229 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.229 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.229 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:23.229 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445706+0000", 2024-05-08T18:31:23.229 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:23.229 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.229 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.229 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:23.229 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445709+0000", 2024-05-08T18:31:23.229 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0299999999999998e-06 2024-05-08T18:31:23.229 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.230 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.230 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:23.230 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445721+0000", 2024-05-08T18:31:23.230 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2366e-05 2024-05-08T18:31:23.230 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.230 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.230 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:23.230 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445752+0000", 2024-05-08T18:31:23.230 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0287e-05 2024-05-08T18:31:23.230 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.230 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.230 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:23.230 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445773+0000", 2024-05-08T18:31:23.231 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1367000000000001e-05 2024-05-08T18:31:23.231 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.231 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.231 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:23.231 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445892+0000", 2024-05-08T18:31:23.231 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000119311 2024-05-08T18:31:23.231 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.231 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.231 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:23.231 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.446158+0000", 2024-05-08T18:31:23.231 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000265441 2024-05-08T18:31:23.231 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.231 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.231 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:23.231 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.446465+0000", 2024-05-08T18:31:23.232 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00030754300000000002 2024-05-08T18:31:23.232 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.232 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.232 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:23.232 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.447511+0000", 2024-05-08T18:31:23.232 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001045975 2024-05-08T18:31:23.232 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.232 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.232 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:23.232 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.448171+0000", 2024-05-08T18:31:23.232 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00065971200000000002 2024-05-08T18:31:23.232 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.232 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.232 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:23.233 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.448273+0000", 2024-05-08T18:31:23.233 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000101592 2024-05-08T18:31:23.233 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.233 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.233 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:23.233 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.448388+0000", 2024-05-08T18:31:23.233 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115439 2024-05-08T18:31:23.233 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:23.233 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:23.233 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:23.233 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.233 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.233 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1020 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_add in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-05-08T18:31:23.233 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:30:21.842276+0000", 2024-05-08T18:31:23.234 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 61.275331629, 2024-05-08T18:31:23.234 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0025898760000000001, 2024-05-08T18:31:23.234 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:23.234 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:23.234 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:23.234 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:23.234 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:23.234 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:23.234 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1020 2024-05-08T18:31:23.234 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.234 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:23.234 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.234 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:23.235 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842276+0000", 2024-05-08T18:31:23.235 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:23.235 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.235 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.235 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:23.235 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842276+0000", 2024-05-08T18:31:23.235 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:23.235 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.235 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.235 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:23.235 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842278+0000", 2024-05-08T18:31:23.235 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6129999999999998e-06 2024-05-08T18:31:23.235 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.235 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.235 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:23.236 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842290+0000", 2024-05-08T18:31:23.236 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2187999999999999e-05 2024-05-08T18:31:23.236 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.236 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.236 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:23.236 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842319+0000", 2024-05-08T18:31:23.236 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8782e-05 2024-05-08T18:31:23.236 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.236 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.236 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:23.236 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842336+0000", 2024-05-08T18:31:23.236 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6826000000000001e-05 2024-05-08T18:31:23.236 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.236 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.237 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:23.237 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842450+0000", 2024-05-08T18:31:23.237 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000113829 2024-05-08T18:31:23.237 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.237 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.237 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:23.237 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842627+0000", 2024-05-08T18:31:23.237 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00017756599999999999 2024-05-08T18:31:23.237 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.237 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.237 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:23.237 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842794+0000", 2024-05-08T18:31:23.237 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000166866 2024-05-08T18:31:23.237 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.237 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.238 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:23.238 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.843540+0000", 2024-05-08T18:31:23.238 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00074611700000000003 2024-05-08T18:31:23.238 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.238 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.238 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:23.238 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.844762+0000", 2024-05-08T18:31:23.238 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012220309999999999 2024-05-08T18:31:23.238 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.238 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.238 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:23.238 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.844806+0000", 2024-05-08T18:31:23.238 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3414000000000001e-05 2024-05-08T18:31:23.238 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.239 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.239 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:23.239 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.844865+0000", 2024-05-08T18:31:23.239 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9644e-05 2024-05-08T18:31:23.239 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:23.239 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:23.239 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:23.239 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:23.239 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:23.239 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:23.241 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-08T18:31:23.241 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:31:23.238+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:31:23.341 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:31:23.338+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:31:23.410 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:23.410 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:31:23.410 INFO:teuthology.orchestra.run.smithi097.stdout: "num_ops": 0 2024-05-08T18:31:23.410 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:23.429 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-08T18:31:23.442 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:31:23.438+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:31:23.543 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:31:23.542+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:31:23.638 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:23.638 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:31:23.639 INFO:teuthology.orchestra.run.smithi097.stdout: "complaint_time": 30, 2024-05-08T18:31:23.639 INFO:teuthology.orchestra.run.smithi097.stdout: "num_blocked_ops": 0 2024-05-08T18:31:23.639 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:23.645 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:31:23.642+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:31:23.657 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-08T18:31:23.746 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:31:23.746+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:31:23.828 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:23.828 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2024-05-08T18:31:23.828 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2024-05-08T18:31:23.828 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-05-08T18:31:23.828 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.828 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4479.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-05-08T18:31:23.829 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:44.576320+0000", 2024-05-08T18:31:23.829 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 99.250737896999993, 2024-05-08T18:31:23.829 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019751892, 2024-05-08T18:31:23.829 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:23.829 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:23.829 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "reached pg", 2024-05-08T18:31:23.829 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:23.829 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4479", 2024-05-08T18:31:23.829 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3577501689", 2024-05-08T18:31:23.829 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 2 2024-05-08T18:31:23.829 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.830 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:23.830 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.830 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:23.830 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576320+0000", 2024-05-08T18:31:23.830 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:23.830 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.830 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.830 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:23.830 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576320+0000", 2024-05-08T18:31:23.830 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:23.830 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.831 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.831 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:23.831 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576323+0000", 2024-05-08T18:31:23.831 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.813e-06 2024-05-08T18:31:23.831 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.831 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.831 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:23.831 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576335+0000", 2024-05-08T18:31:23.831 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2330000000000001e-05 2024-05-08T18:31:23.831 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.831 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.832 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:23.832 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576367+0000", 2024-05-08T18:31:23.832 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2036999999999998e-05 2024-05-08T18:31:23.832 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.832 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.832 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:23.832 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576394+0000", 2024-05-08T18:31:23.832 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6529e-05 2024-05-08T18:31:23.832 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.832 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.832 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:23.832 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576550+0000", 2024-05-08T18:31:23.833 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000156718 2024-05-08T18:31:23.833 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.833 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.833 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-05-08T18:31:23.833 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576560+0000", 2024-05-08T18:31:23.833 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0040999999999999e-05 2024-05-08T18:31:23.833 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.833 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.833 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:23.833 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.587240+0000", 2024-05-08T18:31:23.833 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010679266999999999 2024-05-08T18:31:23.834 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.834 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.834 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2024-05-08T18:31:23.834 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.587266+0000", 2024-05-08T18:31:23.834 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6642e-05 2024-05-08T18:31:23.834 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.834 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.834 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:23.834 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.595882+0000", 2024-05-08T18:31:23.834 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0086159600000000006 2024-05-08T18:31:23.834 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.834 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.835 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:23.835 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.596072+0000", 2024-05-08T18:31:23.835 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000189555 2024-05-08T18:31:23.835 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:23.835 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:23.835 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:23.835 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.835 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.835 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:31:23.835 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:48.766182+0000", 2024-05-08T18:31:23.835 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 95.060875870000004, 2024-05-08T18:31:23.835 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031881209999999999, 2024-05-08T18:31:23.836 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:23.836 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:23.836 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:23.836 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:23.836 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:23.836 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:23.836 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 193 2024-05-08T18:31:23.836 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.836 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:23.836 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.836 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:23.836 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766182+0000", 2024-05-08T18:31:23.837 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:23.837 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.837 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.837 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:23.837 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766182+0000", 2024-05-08T18:31:23.837 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:23.837 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.837 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.837 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:23.837 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766184+0000", 2024-05-08T18:31:23.837 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4159999999999998e-06 2024-05-08T18:31:23.837 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.838 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.838 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:23.838 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766196+0000", 2024-05-08T18:31:23.838 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1814000000000001e-05 2024-05-08T18:31:23.838 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.838 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.838 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:23.838 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766227+0000", 2024-05-08T18:31:23.838 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0676000000000002e-05 2024-05-08T18:31:23.838 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.838 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.839 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:23.839 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766242+0000", 2024-05-08T18:31:23.839 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5497000000000001e-05 2024-05-08T18:31:23.839 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.839 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.839 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:23.839 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766354+0000", 2024-05-08T18:31:23.839 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000111579 2024-05-08T18:31:23.839 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.839 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.839 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:23.839 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766569+0000", 2024-05-08T18:31:23.840 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000214978 2024-05-08T18:31:23.840 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.840 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.840 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:23.840 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766834+0000", 2024-05-08T18:31:23.840 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00026551500000000002 2024-05-08T18:31:23.840 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.840 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.840 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:23.840 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.768577+0000", 2024-05-08T18:31:23.840 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001742513 2024-05-08T18:31:23.841 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.841 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.841 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:23.841 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.769150+0000", 2024-05-08T18:31:23.841 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00057320500000000003 2024-05-08T18:31:23.841 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.841 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.841 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:23.841 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.769250+0000", 2024-05-08T18:31:23.841 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.9846000000000006e-05 2024-05-08T18:31:23.841 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.841 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.842 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:23.842 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.769370+0000", 2024-05-08T18:31:23.842 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012008200000000001 2024-05-08T18:31:23.842 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:23.842 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:23.842 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:23.842 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.842 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.842 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:23.842 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.679562+0000", 2024-05-08T18:31:23.842 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 92.147496165999996, 2024-05-08T18:31:23.842 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0086320800000000003, 2024-05-08T18:31:23.843 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:23.843 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:23.843 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:23.843 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:23.843 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:23.843 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:23.843 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 208 2024-05-08T18:31:23.843 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.843 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:23.843 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.843 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:23.843 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679562+0000", 2024-05-08T18:31:23.844 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:23.844 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.844 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.844 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:23.844 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679562+0000", 2024-05-08T18:31:23.844 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:23.844 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.844 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.844 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:23.844 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679565+0000", 2024-05-08T18:31:23.844 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0800000000000002e-06 2024-05-08T18:31:23.844 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.845 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.845 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:23.845 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679578+0000", 2024-05-08T18:31:23.845 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3217000000000001e-05 2024-05-08T18:31:23.845 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.845 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.845 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:23.845 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679610+0000", 2024-05-08T18:31:23.845 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1696000000000003e-05 2024-05-08T18:31:23.845 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.845 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.846 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:23.846 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679625+0000", 2024-05-08T18:31:23.846 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5824e-05 2024-05-08T18:31:23.846 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.846 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.846 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:23.846 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679758+0000", 2024-05-08T18:31:23.846 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013231199999999999 2024-05-08T18:31:23.846 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.846 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.846 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-05-08T18:31:23.846 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679770+0000", 2024-05-08T18:31:23.847 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1800000000000001e-05 2024-05-08T18:31:23.847 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.847 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.847 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:23.847 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.685241+0000", 2024-05-08T18:31:23.847 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0054710169999999999 2024-05-08T18:31:23.847 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.847 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.847 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:23.847 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.685444+0000", 2024-05-08T18:31:23.847 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000203835 2024-05-08T18:31:23.847 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.848 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.848 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:23.848 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.685842+0000", 2024-05-08T18:31:23.848 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00039773 2024-05-08T18:31:23.848 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.848 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.848 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:23.848 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.687232+0000", 2024-05-08T18:31:23.848 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00139011 2024-05-08T18:31:23.848 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.848 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.848 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:23.849 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.688049+0000", 2024-05-08T18:31:23.849 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00081667000000000003 2024-05-08T18:31:23.849 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.849 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.849 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:23.849 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.688135+0000", 2024-05-08T18:31:23.849 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6299999999999997e-05 2024-05-08T18:31:23.849 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.849 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.849 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:23.849 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.688194+0000", 2024-05-08T18:31:23.849 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8489000000000002e-05 2024-05-08T18:31:23.850 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:23.850 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:23.850 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:23.850 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.850 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.850 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:23.850 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.707114+0000", 2024-05-08T18:31:23.850 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 92.119944152000002, 2024-05-08T18:31:23.850 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031802990000000001, 2024-05-08T18:31:23.850 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:23.850 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:23.851 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:23.851 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:23.851 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:23.851 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:23.851 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 212 2024-05-08T18:31:23.851 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.851 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:23.851 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.851 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:23.851 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707114+0000", 2024-05-08T18:31:23.851 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:23.851 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.852 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.852 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:23.852 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707114+0000", 2024-05-08T18:31:23.852 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:23.852 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.852 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.852 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:23.852 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707117+0000", 2024-05-08T18:31:23.852 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8629999999999999e-06 2024-05-08T18:31:23.852 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.852 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.852 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:23.853 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707129+0000", 2024-05-08T18:31:23.853 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2150000000000001e-05 2024-05-08T18:31:23.853 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.853 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.853 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:23.853 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707158+0000", 2024-05-08T18:31:23.853 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9513999999999999e-05 2024-05-08T18:31:23.853 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.853 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.853 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:23.853 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707173+0000", 2024-05-08T18:31:23.853 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5136e-05 2024-05-08T18:31:23.853 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.854 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.854 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:23.854 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707309+0000", 2024-05-08T18:31:23.854 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000135609 2024-05-08T18:31:23.854 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.854 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.854 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:23.854 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707523+0000", 2024-05-08T18:31:23.854 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021362200000000001 2024-05-08T18:31:23.854 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.854 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.855 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:23.855 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707918+0000", 2024-05-08T18:31:23.855 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00039556299999999998 2024-05-08T18:31:23.855 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.855 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.855 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:23.855 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.709166+0000", 2024-05-08T18:31:23.855 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012476410000000001 2024-05-08T18:31:23.855 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.855 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.855 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:23.855 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.710145+0000", 2024-05-08T18:31:23.855 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00097909899999999998 2024-05-08T18:31:23.856 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.856 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.856 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:23.856 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.710231+0000", 2024-05-08T18:31:23.856 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5625999999999996e-05 2024-05-08T18:31:23.856 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.856 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.856 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:23.856 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.710294+0000", 2024-05-08T18:31:23.856 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3476e-05 2024-05-08T18:31:23.856 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:23.856 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:23.857 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:23.857 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.857 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.857 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:23.857 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.731985+0000", 2024-05-08T18:31:23.857 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 92.095072927000004, 2024-05-08T18:31:23.857 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0039250600000000002, 2024-05-08T18:31:23.857 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:23.857 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:23.857 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:23.857 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:23.857 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:23.858 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:23.858 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 219 2024-05-08T18:31:23.858 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.858 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:23.858 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.858 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:23.858 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731985+0000", 2024-05-08T18:31:23.858 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:23.858 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.858 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.858 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:23.858 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731985+0000", 2024-05-08T18:31:23.859 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:23.859 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.859 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.859 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:23.859 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731988+0000", 2024-05-08T18:31:23.859 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6599999999999999e-06 2024-05-08T18:31:23.859 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.859 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.859 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:23.859 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.732017+0000", 2024-05-08T18:31:23.859 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9692999999999998e-05 2024-05-08T18:31:23.859 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.860 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.860 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:23.860 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.732048+0000", 2024-05-08T18:31:23.860 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1066999999999999e-05 2024-05-08T18:31:23.860 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.860 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.860 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:23.860 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.732064+0000", 2024-05-08T18:31:23.860 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5786000000000001e-05 2024-05-08T18:31:23.860 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.860 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.860 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:23.861 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.732213+0000", 2024-05-08T18:31:23.861 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014895899999999999 2024-05-08T18:31:23.861 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.861 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.861 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:23.861 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.732572+0000", 2024-05-08T18:31:23.861 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000358904 2024-05-08T18:31:23.861 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.861 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.861 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:23.861 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.733349+0000", 2024-05-08T18:31:23.861 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00077657699999999997 2024-05-08T18:31:23.862 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.862 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.862 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:23.862 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.734899+0000", 2024-05-08T18:31:23.862 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001550652 2024-05-08T18:31:23.862 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.862 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.862 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:23.862 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.735641+0000", 2024-05-08T18:31:23.862 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00074222000000000003 2024-05-08T18:31:23.862 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.863 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.863 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:23.863 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.735801+0000", 2024-05-08T18:31:23.863 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015913599999999999 2024-05-08T18:31:23.863 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.863 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.863 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:23.863 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.735910+0000", 2024-05-08T18:31:23.863 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000109406 2024-05-08T18:31:23.863 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:23.863 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:23.864 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:23.864 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.864 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.864 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:23.864 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.750251+0000", 2024-05-08T18:31:23.864 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 92.076806994999998, 2024-05-08T18:31:23.864 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0038408600000000002, 2024-05-08T18:31:23.864 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:23.864 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:23.864 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:23.864 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:23.864 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:23.865 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:23.865 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 224 2024-05-08T18:31:23.865 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.865 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:23.865 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.865 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:23.865 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750251+0000", 2024-05-08T18:31:23.865 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:23.865 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.865 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.865 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:23.865 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750251+0000", 2024-05-08T18:31:23.866 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:23.866 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.866 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.866 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:23.866 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750253+0000", 2024-05-08T18:31:23.866 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2129999999999998e-06 2024-05-08T18:31:23.866 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.866 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.866 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:23.866 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750265+0000", 2024-05-08T18:31:23.866 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1484000000000001e-05 2024-05-08T18:31:23.867 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.867 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.867 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:23.867 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750293+0000", 2024-05-08T18:31:23.867 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8673000000000001e-05 2024-05-08T18:31:23.867 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.867 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.867 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:23.867 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750308+0000", 2024-05-08T18:31:23.867 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4620000000000001e-05 2024-05-08T18:31:23.867 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.868 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.868 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:23.868 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750459+0000", 2024-05-08T18:31:23.868 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000151619 2024-05-08T18:31:23.868 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.868 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.868 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:23.868 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750822+0000", 2024-05-08T18:31:23.868 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000362467 2024-05-08T18:31:23.868 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.868 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.868 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:23.869 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.751591+0000", 2024-05-08T18:31:23.869 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00076934699999999998 2024-05-08T18:31:23.869 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.869 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.869 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:23.869 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.753042+0000", 2024-05-08T18:31:23.869 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001450652 2024-05-08T18:31:23.869 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.869 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.869 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:23.869 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.753792+0000", 2024-05-08T18:31:23.869 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00075045500000000002 2024-05-08T18:31:23.870 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.870 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.870 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:23.870 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.753977+0000", 2024-05-08T18:31:23.870 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000184511 2024-05-08T18:31:23.870 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.870 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.870 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:23.870 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.754092+0000", 2024-05-08T18:31:23.870 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000114819 2024-05-08T18:31:23.870 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:23.870 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:23.871 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:23.871 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.871 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.871 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:23.871 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.783902+0000", 2024-05-08T18:31:23.871 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 92.043156264000004, 2024-05-08T18:31:23.871 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003120046, 2024-05-08T18:31:23.871 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:23.871 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:23.871 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:23.871 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:23.871 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:23.872 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:23.872 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 233 2024-05-08T18:31:23.872 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.872 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:23.872 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.872 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:23.872 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.783902+0000", 2024-05-08T18:31:23.872 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:23.872 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.872 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.872 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:23.872 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.783902+0000", 2024-05-08T18:31:23.873 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:23.873 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.873 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.873 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:23.873 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.783904+0000", 2024-05-08T18:31:23.873 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5229999999999998e-06 2024-05-08T18:31:23.873 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.873 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.873 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:23.873 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.783916+0000", 2024-05-08T18:31:23.873 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1513e-05 2024-05-08T18:31:23.873 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.874 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.874 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:23.874 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.783947+0000", 2024-05-08T18:31:23.874 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1353000000000003e-05 2024-05-08T18:31:23.874 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.874 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.874 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:23.874 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.783964+0000", 2024-05-08T18:31:23.874 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6643e-05 2024-05-08T18:31:23.874 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.874 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.874 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:23.875 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.784110+0000", 2024-05-08T18:31:23.875 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014627299999999999 2024-05-08T18:31:23.875 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.875 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.875 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:23.875 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.784329+0000", 2024-05-08T18:31:23.875 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021892099999999999 2024-05-08T18:31:23.875 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.875 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.875 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:23.875 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.784752+0000", 2024-05-08T18:31:23.876 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00042336700000000001 2024-05-08T18:31:23.876 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.876 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.876 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:23.876 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.786093+0000", 2024-05-08T18:31:23.876 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00134107 2024-05-08T18:31:23.876 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.876 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.876 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:23.876 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.786863+0000", 2024-05-08T18:31:23.876 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00076949099999999997 2024-05-08T18:31:23.876 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.876 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.877 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:23.877 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.786955+0000", 2024-05-08T18:31:23.877 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.2478999999999993e-05 2024-05-08T18:31:23.877 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.877 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.877 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:23.877 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.787022+0000", 2024-05-08T18:31:23.877 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6413000000000003e-05 2024-05-08T18:31:23.877 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:23.877 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:23.877 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:23.878 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.878 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.878 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:341 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:23.878 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.816045+0000", 2024-05-08T18:31:23.878 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 92.011012926999996, 2024-05-08T18:31:23.878 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002875154, 2024-05-08T18:31:23.878 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:23.878 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:23.878 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:23.878 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:23.878 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:23.878 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:23.879 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 341 2024-05-08T18:31:23.879 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.879 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:23.879 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.879 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:23.879 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816045+0000", 2024-05-08T18:31:23.879 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:23.879 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.879 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.879 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:23.879 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816045+0000", 2024-05-08T18:31:23.879 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:23.880 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.880 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.880 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:23.880 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816046+0000", 2024-05-08T18:31:23.880 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9199999999999999e-07 2024-05-08T18:31:23.880 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.880 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.880 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:23.880 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816050+0000", 2024-05-08T18:31:23.880 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0260000000000001e-06 2024-05-08T18:31:23.880 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.881 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.881 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:23.881 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816060+0000", 2024-05-08T18:31:23.881 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0297e-05 2024-05-08T18:31:23.881 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.881 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.881 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:23.881 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816065+0000", 2024-05-08T18:31:23.881 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.237e-06 2024-05-08T18:31:23.881 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.881 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.881 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:23.882 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816122+0000", 2024-05-08T18:31:23.882 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6168000000000002e-05 2024-05-08T18:31:23.882 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.882 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.882 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:23.882 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816198+0000", 2024-05-08T18:31:23.882 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6511e-05 2024-05-08T18:31:23.882 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.882 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.882 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:31:23.882 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816305+0000", 2024-05-08T18:31:23.883 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000106487 2024-05-08T18:31:23.883 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.883 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.883 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:23.883 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816886+0000", 2024-05-08T18:31:23.883 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00058187199999999999 2024-05-08T18:31:23.883 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.883 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.883 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:23.883 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.818821+0000", 2024-05-08T18:31:23.883 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001934362 2024-05-08T18:31:23.883 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.884 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.884 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:23.884 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.818880+0000", 2024-05-08T18:31:23.884 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9210999999999999e-05 2024-05-08T18:31:23.884 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.884 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.884 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:23.884 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.818920+0000", 2024-05-08T18:31:23.884 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0091e-05 2024-05-08T18:31:23.884 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:23.884 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:23.884 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:23.885 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.885 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.885 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:23.885 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.086431+0000", 2024-05-08T18:31:23.885 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 91.740627106999995, 2024-05-08T18:31:23.885 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028335959999999999, 2024-05-08T18:31:23.885 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:23.885 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:23.885 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:23.885 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:23.885 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:23.885 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:23.886 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 733 2024-05-08T18:31:23.886 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.886 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:23.886 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.886 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:23.886 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086431+0000", 2024-05-08T18:31:23.886 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:23.886 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.886 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.886 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:23.886 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086431+0000", 2024-05-08T18:31:23.886 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:23.887 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.887 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.887 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:23.887 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086433+0000", 2024-05-08T18:31:23.887 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8899999999999999e-06 2024-05-08T18:31:23.887 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.887 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.887 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:23.887 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086441+0000", 2024-05-08T18:31:23.887 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.3100000000000001e-06 2024-05-08T18:31:23.887 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.888 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.888 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:23.888 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086460+0000", 2024-05-08T18:31:23.888 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8703999999999999e-05 2024-05-08T18:31:23.888 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.888 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.888 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:23.888 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086471+0000", 2024-05-08T18:31:23.888 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1324e-05 2024-05-08T18:31:23.889 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.889 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.889 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:23.889 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086590+0000", 2024-05-08T18:31:23.889 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000118625 2024-05-08T18:31:23.889 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.889 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.889 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:23.889 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086817+0000", 2024-05-08T18:31:23.889 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000226958 2024-05-08T18:31:23.889 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.889 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.890 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:23.890 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.087131+0000", 2024-05-08T18:31:23.890 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00031478799999999998 2024-05-08T18:31:23.890 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.890 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.890 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:23.890 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.088025+0000", 2024-05-08T18:31:23.890 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00089402999999999998 2024-05-08T18:31:23.890 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.890 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.890 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:23.891 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.089123+0000", 2024-05-08T18:31:23.891 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001097598 2024-05-08T18:31:23.891 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.891 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.891 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:23.891 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.089200+0000", 2024-05-08T18:31:23.891 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7333e-05 2024-05-08T18:31:23.891 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.891 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.891 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:23.891 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.089264+0000", 2024-05-08T18:31:23.891 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.4035999999999995e-05 2024-05-08T18:31:23.892 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:23.892 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:23.892 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:23.892 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.892 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.892 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:751 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:23.892 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.125611+0000", 2024-05-08T18:31:23.892 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 91.701446415000007, 2024-05-08T18:31:23.892 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032716749999999999, 2024-05-08T18:31:23.892 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:23.892 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:23.892 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:23.893 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:23.893 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:23.893 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:23.893 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 751 2024-05-08T18:31:23.893 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.893 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:23.893 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.893 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:23.893 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125611+0000", 2024-05-08T18:31:23.893 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:23.893 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.893 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.894 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:23.894 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125611+0000", 2024-05-08T18:31:23.894 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:23.894 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.894 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.894 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:23.894 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125614+0000", 2024-05-08T18:31:23.894 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.12e-06 2024-05-08T18:31:23.894 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.894 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.894 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:23.895 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125624+0000", 2024-05-08T18:31:23.895 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0492999999999999e-05 2024-05-08T18:31:23.895 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.895 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.895 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:23.895 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125650+0000", 2024-05-08T18:31:23.895 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5907000000000001e-05 2024-05-08T18:31:23.895 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.895 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.895 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:23.895 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125667+0000", 2024-05-08T18:31:23.895 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.694e-05 2024-05-08T18:31:23.896 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.896 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.896 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:23.896 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125801+0000", 2024-05-08T18:31:23.896 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000134482 2024-05-08T18:31:23.896 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.896 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.896 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:23.896 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.126174+0000", 2024-05-08T18:31:23.896 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00037294999999999999 2024-05-08T18:31:23.896 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.896 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.897 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:23.897 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.126750+0000", 2024-05-08T18:31:23.897 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00057538900000000004 2024-05-08T18:31:23.897 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.897 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.897 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:23.897 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.127997+0000", 2024-05-08T18:31:23.897 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001247761 2024-05-08T18:31:23.897 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.897 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.897 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:23.897 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.128731+0000", 2024-05-08T18:31:23.898 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00073338099999999996 2024-05-08T18:31:23.898 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.898 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.898 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:23.898 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.128817+0000", 2024-05-08T18:31:23.898 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5993000000000002e-05 2024-05-08T18:31:23.898 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.898 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.898 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:23.898 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.128883+0000", 2024-05-08T18:31:23.898 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6259000000000004e-05 2024-05-08T18:31:23.899 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:23.899 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:23.899 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:23.899 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.899 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.899 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:753 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:23.899 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.129809+0000", 2024-05-08T18:31:23.899 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 91.697248877000007, 2024-05-08T18:31:23.899 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0033775440000000001, 2024-05-08T18:31:23.899 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:23.899 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:23.899 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:23.900 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:23.900 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:23.900 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:23.900 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 753 2024-05-08T18:31:23.900 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.900 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:23.900 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.900 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:23.900 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129809+0000", 2024-05-08T18:31:23.900 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:23.900 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.901 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.901 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:23.901 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129809+0000", 2024-05-08T18:31:23.901 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:23.901 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.901 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.901 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:23.901 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129811+0000", 2024-05-08T18:31:23.901 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1730000000000002e-06 2024-05-08T18:31:23.901 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.901 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.901 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:23.902 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129822+0000", 2024-05-08T18:31:23.902 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0583e-05 2024-05-08T18:31:23.902 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.902 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.902 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:23.902 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129852+0000", 2024-05-08T18:31:23.902 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0744000000000002e-05 2024-05-08T18:31:23.902 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.902 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.902 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:23.902 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129870+0000", 2024-05-08T18:31:23.903 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7955999999999999e-05 2024-05-08T18:31:23.903 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.903 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.903 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:23.903 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.130018+0000", 2024-05-08T18:31:23.903 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014747600000000001 2024-05-08T18:31:23.903 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.903 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.903 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:23.903 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.130259+0000", 2024-05-08T18:31:23.903 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024079099999999999 2024-05-08T18:31:23.903 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.904 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.904 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:23.904 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.130734+0000", 2024-05-08T18:31:23.904 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00047562 2024-05-08T18:31:23.904 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.904 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.904 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:23.904 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.131997+0000", 2024-05-08T18:31:23.904 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012626429999999999 2024-05-08T18:31:23.904 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.904 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.904 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:23.905 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.132923+0000", 2024-05-08T18:31:23.905 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00092627599999999997 2024-05-08T18:31:23.905 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.905 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.905 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:23.905 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.133076+0000", 2024-05-08T18:31:23.905 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000152989 2024-05-08T18:31:23.905 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.905 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.905 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:23.905 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.133187+0000", 2024-05-08T18:31:23.906 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000110293 2024-05-08T18:31:23.906 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:23.906 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:23.906 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:23.906 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.906 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.906 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:23.906 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.228247+0000", 2024-05-08T18:31:23.906 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 91.598811267000002, 2024-05-08T18:31:23.906 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032753449999999998, 2024-05-08T18:31:23.906 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:23.906 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:23.907 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:23.907 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:23.907 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:23.907 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:23.907 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 796 2024-05-08T18:31:23.907 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.907 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:23.907 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.907 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:23.907 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228247+0000", 2024-05-08T18:31:23.907 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:23.908 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.908 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.908 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:23.908 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228247+0000", 2024-05-08T18:31:23.908 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:23.908 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.908 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.908 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:23.908 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228249+0000", 2024-05-08T18:31:23.908 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3800000000000001e-06 2024-05-08T18:31:23.908 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.908 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.909 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:23.909 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228260+0000", 2024-05-08T18:31:23.909 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1496e-05 2024-05-08T18:31:23.909 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.909 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.909 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:23.909 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228292+0000", 2024-05-08T18:31:23.909 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1294000000000002e-05 2024-05-08T18:31:23.909 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.909 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.909 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:23.910 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228306+0000", 2024-05-08T18:31:23.910 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4606e-05 2024-05-08T18:31:23.910 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.910 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.910 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:23.910 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228443+0000", 2024-05-08T18:31:23.910 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013672599999999999 2024-05-08T18:31:23.910 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.910 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.910 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:23.910 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228813+0000", 2024-05-08T18:31:23.910 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00036987000000000001 2024-05-08T18:31:23.911 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.911 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.911 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:31:23.911 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.229365+0000", 2024-05-08T18:31:23.911 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00055210600000000002 2024-05-08T18:31:23.911 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.911 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.911 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:23.911 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.230800+0000", 2024-05-08T18:31:23.911 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001435006 2024-05-08T18:31:23.911 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.911 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.912 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:23.912 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.231369+0000", 2024-05-08T18:31:23.912 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00056848499999999998 2024-05-08T18:31:23.912 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.912 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.912 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:23.912 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.231455+0000", 2024-05-08T18:31:23.912 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6905999999999998e-05 2024-05-08T18:31:23.912 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.912 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.912 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:23.913 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.231522+0000", 2024-05-08T18:31:23.913 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6470000000000006e-05 2024-05-08T18:31:23.913 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:23.913 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:23.913 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:23.913 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.913 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.913 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:798 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:23.913 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.232573+0000", 2024-05-08T18:31:23.913 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 91.594485160000005, 2024-05-08T18:31:23.913 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0030406690000000002, 2024-05-08T18:31:23.913 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:23.914 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:23.914 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:23.914 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:23.914 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:23.914 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:23.914 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 798 2024-05-08T18:31:23.914 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.914 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:23.914 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.914 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:23.914 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232573+0000", 2024-05-08T18:31:23.915 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:23.915 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.915 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.915 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:23.915 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232573+0000", 2024-05-08T18:31:23.915 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:23.915 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.915 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.915 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:23.915 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232574+0000", 2024-05-08T18:31:23.915 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.446e-06 2024-05-08T18:31:23.915 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.916 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.916 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:23.916 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232581+0000", 2024-05-08T18:31:23.916 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.0670000000000003e-06 2024-05-08T18:31:23.916 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.916 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.916 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:23.916 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232600+0000", 2024-05-08T18:31:23.916 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8822999999999999e-05 2024-05-08T18:31:23.916 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.916 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.916 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:23.917 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232611+0000", 2024-05-08T18:31:23.917 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1233000000000001e-05 2024-05-08T18:31:23.917 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.917 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.917 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:23.917 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232731+0000", 2024-05-08T18:31:23.917 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000120189 2024-05-08T18:31:23.917 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.917 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.917 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:23.917 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232963+0000", 2024-05-08T18:31:23.917 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023111900000000001 2024-05-08T18:31:23.917 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.918 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.918 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:31:23.918 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.233441+0000", 2024-05-08T18:31:23.918 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00047866899999999998 2024-05-08T18:31:23.918 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.918 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.918 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:23.918 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.234542+0000", 2024-05-08T18:31:23.918 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001101245 2024-05-08T18:31:23.918 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.918 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.918 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:23.919 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.235349+0000", 2024-05-08T18:31:23.919 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000806567 2024-05-08T18:31:23.919 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.919 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.919 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:23.919 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.235498+0000", 2024-05-08T18:31:23.919 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014907200000000001 2024-05-08T18:31:23.919 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.919 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.919 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:23.919 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.235613+0000", 2024-05-08T18:31:23.919 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115239 2024-05-08T18:31:23.920 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:23.920 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:23.920 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:23.920 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.920 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.920 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:23.920 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.248596+0000", 2024-05-08T18:31:23.920 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 91.578461353999998, 2024-05-08T18:31:23.920 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002919984, 2024-05-08T18:31:23.920 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:23.920 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:23.921 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:23.921 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:23.921 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:23.921 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:23.921 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 805 2024-05-08T18:31:23.921 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.921 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:23.921 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.921 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:23.921 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248596+0000", 2024-05-08T18:31:23.921 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:23.921 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.922 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.922 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:23.922 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248596+0000", 2024-05-08T18:31:23.922 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:23.922 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.922 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.922 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:23.922 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248599+0000", 2024-05-08T18:31:23.922 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3630000000000001e-06 2024-05-08T18:31:23.922 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.922 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.922 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:23.923 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248610+0000", 2024-05-08T18:31:23.923 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1267000000000001e-05 2024-05-08T18:31:23.923 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.923 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.923 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:23.923 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248641+0000", 2024-05-08T18:31:23.923 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1309999999999997e-05 2024-05-08T18:31:23.923 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.923 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.923 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:23.923 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248656+0000", 2024-05-08T18:31:23.923 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4449e-05 2024-05-08T18:31:23.924 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.924 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.924 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:23.924 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248781+0000", 2024-05-08T18:31:23.924 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012500900000000001 2024-05-08T18:31:23.924 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.924 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.924 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:23.924 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.249001+0000", 2024-05-08T18:31:23.924 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021963500000000001 2024-05-08T18:31:23.924 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.924 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.925 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:23.925 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.249341+0000", 2024-05-08T18:31:23.925 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00034004100000000002 2024-05-08T18:31:23.925 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.925 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.925 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:23.925 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.250473+0000", 2024-05-08T18:31:23.925 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0011324180000000001 2024-05-08T18:31:23.925 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.925 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.925 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:23.925 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.251230+0000", 2024-05-08T18:31:23.926 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00075751400000000004 2024-05-08T18:31:23.926 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.926 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.926 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:23.926 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.251394+0000", 2024-05-08T18:31:23.926 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016379200000000001 2024-05-08T18:31:23.926 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.926 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.926 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:23.926 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.251516+0000", 2024-05-08T18:31:23.926 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012218600000000001 2024-05-08T18:31:23.927 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:23.927 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:23.927 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:23.927 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.927 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.927 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:23.927 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.313184+0000", 2024-05-08T18:31:23.927 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 91.513873679, 2024-05-08T18:31:23.927 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003040016, 2024-05-08T18:31:23.927 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:23.927 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:23.927 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:23.928 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:23.928 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:23.928 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:23.928 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 832 2024-05-08T18:31:23.928 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.928 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:23.928 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.928 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:23.928 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313184+0000", 2024-05-08T18:31:23.928 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:23.928 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.928 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.929 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:23.929 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313184+0000", 2024-05-08T18:31:23.929 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:23.929 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.929 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.929 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:23.929 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313187+0000", 2024-05-08T18:31:23.929 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5100000000000001e-06 2024-05-08T18:31:23.929 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.929 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.929 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:23.930 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313199+0000", 2024-05-08T18:31:23.930 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.201e-05 2024-05-08T18:31:23.930 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.930 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.930 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:23.930 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313229+0000", 2024-05-08T18:31:23.930 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9839e-05 2024-05-08T18:31:23.930 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.930 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.930 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:23.930 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313243+0000", 2024-05-08T18:31:23.931 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4727e-05 2024-05-08T18:31:23.931 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.931 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.931 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:23.931 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313358+0000", 2024-05-08T18:31:23.931 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115016 2024-05-08T18:31:23.931 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.931 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.931 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:23.931 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313577+0000", 2024-05-08T18:31:23.931 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021897799999999999 2024-05-08T18:31:23.931 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.932 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.932 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:31:23.932 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313889+0000", 2024-05-08T18:31:23.932 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00031210400000000001 2024-05-08T18:31:23.932 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.932 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.932 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:23.932 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.315229+0000", 2024-05-08T18:31:23.932 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001339963 2024-05-08T18:31:23.932 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.932 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.933 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:23.933 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.315938+0000", 2024-05-08T18:31:23.933 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00070853400000000003 2024-05-08T18:31:23.933 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.933 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.933 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:23.933 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.316111+0000", 2024-05-08T18:31:23.933 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000173396 2024-05-08T18:31:23.933 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.933 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.933 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:23.933 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.316224+0000", 2024-05-08T18:31:23.933 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000112939 2024-05-08T18:31:23.934 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:23.934 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:23.934 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:23.934 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.934 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.934 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:834 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:23.934 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.317499+0000", 2024-05-08T18:31:23.934 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 91.50955888, 2024-05-08T18:31:23.934 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0033281109999999999, 2024-05-08T18:31:23.934 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:23.934 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:23.934 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:23.935 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:23.935 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:23.935 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:23.935 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 834 2024-05-08T18:31:23.935 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.935 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:23.935 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.935 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:23.935 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317499+0000", 2024-05-08T18:31:23.935 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:23.935 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.935 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.936 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:23.936 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317499+0000", 2024-05-08T18:31:23.936 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:23.936 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.936 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.936 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:23.936 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317501+0000", 2024-05-08T18:31:23.936 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9400000000000001e-06 2024-05-08T18:31:23.936 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.936 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.936 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:23.936 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317511+0000", 2024-05-08T18:31:23.937 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0297e-05 2024-05-08T18:31:23.937 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.937 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.937 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:23.937 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317532+0000", 2024-05-08T18:31:23.937 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1013e-05 2024-05-08T18:31:23.937 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.937 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.937 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:23.937 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317543+0000", 2024-05-08T18:31:23.937 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0757000000000001e-05 2024-05-08T18:31:23.938 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.938 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.938 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:23.938 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317658+0000", 2024-05-08T18:31:23.938 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115129 2024-05-08T18:31:23.938 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.938 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.938 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:23.938 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317887+0000", 2024-05-08T18:31:23.938 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00022880099999999999 2024-05-08T18:31:23.938 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.939 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.939 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:31:23.939 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.318378+0000", 2024-05-08T18:31:23.939 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00049129000000000002 2024-05-08T18:31:23.939 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.939 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.939 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:23.939 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.319597+0000", 2024-05-08T18:31:23.939 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012188469999999999 2024-05-08T18:31:23.939 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.939 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.940 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:23.940 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.320566+0000", 2024-05-08T18:31:23.940 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00096881599999999995 2024-05-08T18:31:23.940 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.940 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.940 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:23.940 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.320713+0000", 2024-05-08T18:31:23.940 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014691500000000001 2024-05-08T18:31:23.940 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.940 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.940 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:23.940 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.320827+0000", 2024-05-08T18:31:23.941 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000114306 2024-05-08T18:31:23.941 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:23.941 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:23.941 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:23.941 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.941 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.941 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:23.941 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.505569+0000", 2024-05-08T18:31:23.941 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 91.321488427000006, 2024-05-08T18:31:23.941 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028584309999999998, 2024-05-08T18:31:23.941 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:23.942 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:23.942 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:23.942 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:23.942 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:23.942 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:23.942 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 916 2024-05-08T18:31:23.942 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.942 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:23.942 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.942 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:23.942 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505569+0000", 2024-05-08T18:31:23.943 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:23.943 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.943 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.943 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:23.943 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505569+0000", 2024-05-08T18:31:23.943 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:23.943 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.943 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.943 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:23.943 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505572+0000", 2024-05-08T18:31:23.943 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3659999999999999e-06 2024-05-08T18:31:23.944 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.944 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.944 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:23.944 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505583+0000", 2024-05-08T18:31:23.944 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1574e-05 2024-05-08T18:31:23.944 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.944 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.944 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:23.944 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505614+0000", 2024-05-08T18:31:23.944 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0670000000000003e-05 2024-05-08T18:31:23.944 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.945 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.945 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:23.945 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505629+0000", 2024-05-08T18:31:23.945 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5063e-05 2024-05-08T18:31:23.945 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.945 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.945 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:23.945 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505754+0000", 2024-05-08T18:31:23.945 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012508899999999999 2024-05-08T18:31:23.945 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.945 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.945 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:23.945 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505988+0000", 2024-05-08T18:31:23.946 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023334699999999999 2024-05-08T18:31:23.946 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.946 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.946 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:23.946 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.506299+0000", 2024-05-08T18:31:23.946 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000311811 2024-05-08T18:31:23.946 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.946 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.946 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:23.946 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.507489+0000", 2024-05-08T18:31:23.946 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0011899510000000001 2024-05-08T18:31:23.947 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.947 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.947 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:23.947 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.508141+0000", 2024-05-08T18:31:23.947 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00065180200000000005 2024-05-08T18:31:23.947 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.947 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.947 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:23.947 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.508306+0000", 2024-05-08T18:31:23.947 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016450199999999999 2024-05-08T18:31:23.947 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.947 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.948 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:23.948 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.508428+0000", 2024-05-08T18:31:23.948 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000122256 2024-05-08T18:31:23.948 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:23.948 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:23.948 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:23.948 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.948 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.948 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:918 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:23.948 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.509337+0000", 2024-05-08T18:31:23.948 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 91.317720359999996, 2024-05-08T18:31:23.949 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002971787, 2024-05-08T18:31:23.949 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:23.949 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:23.949 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:23.949 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:23.949 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:23.949 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:23.949 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 918 2024-05-08T18:31:23.949 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.949 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:23.949 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.949 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:23.950 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509337+0000", 2024-05-08T18:31:23.950 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:23.950 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.950 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.950 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:23.950 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509337+0000", 2024-05-08T18:31:23.950 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:23.950 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.950 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.950 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:23.951 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509340+0000", 2024-05-08T18:31:23.951 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2570000000000002e-06 2024-05-08T18:31:23.951 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.951 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.951 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:23.951 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509351+0000", 2024-05-08T18:31:23.951 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0933e-05 2024-05-08T18:31:23.951 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.951 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.951 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:23.951 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509382+0000", 2024-05-08T18:31:23.952 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1198999999999997e-05 2024-05-08T18:31:23.952 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.952 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.952 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:23.952 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509400+0000", 2024-05-08T18:31:23.952 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8236999999999998e-05 2024-05-08T18:31:23.952 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.952 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.952 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:23.952 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509529+0000", 2024-05-08T18:31:23.952 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012905600000000001 2024-05-08T18:31:23.952 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.953 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.953 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:23.953 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509777+0000", 2024-05-08T18:31:23.953 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024786799999999999 2024-05-08T18:31:23.953 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.953 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.953 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:23.953 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.510284+0000", 2024-05-08T18:31:23.953 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000506796 2024-05-08T18:31:23.953 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.953 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.953 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:23.953 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.511453+0000", 2024-05-08T18:31:23.954 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001169575 2024-05-08T18:31:23.954 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.954 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.954 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:23.954 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.512051+0000", 2024-05-08T18:31:23.954 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00059743100000000005 2024-05-08T18:31:23.954 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.954 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.954 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:23.954 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.512199+0000", 2024-05-08T18:31:23.954 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000148486 2024-05-08T18:31:23.955 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.955 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.955 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:23.955 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.512309+0000", 2024-05-08T18:31:23.955 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000109949 2024-05-08T18:31:23.955 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:23.955 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:23.955 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:23.955 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.955 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.955 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:931 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:23.955 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.543277+0000", 2024-05-08T18:31:23.956 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 91.283781204999997, 2024-05-08T18:31:23.956 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028250710000000002, 2024-05-08T18:31:23.956 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:23.956 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:23.956 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:23.956 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:23.956 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:23.956 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:23.956 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 931 2024-05-08T18:31:23.956 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.956 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:23.956 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.957 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:23.957 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543277+0000", 2024-05-08T18:31:23.957 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:23.957 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.957 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.957 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:23.957 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543277+0000", 2024-05-08T18:31:23.957 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:23.957 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.957 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.958 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:23.958 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543279+0000", 2024-05-08T18:31:23.958 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.373e-06 2024-05-08T18:31:23.958 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.958 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.958 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:23.958 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543291+0000", 2024-05-08T18:31:23.958 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1517e-05 2024-05-08T18:31:23.958 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.958 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.959 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:23.959 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543323+0000", 2024-05-08T18:31:23.959 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2292000000000002e-05 2024-05-08T18:31:23.959 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.959 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.959 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:23.959 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543340+0000", 2024-05-08T18:31:23.959 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.749e-05 2024-05-08T18:31:23.959 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.959 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.959 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:23.959 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543462+0000", 2024-05-08T18:31:23.960 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000121413 2024-05-08T18:31:23.960 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.960 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.960 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:23.960 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543681+0000", 2024-05-08T18:31:23.960 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021974200000000001 2024-05-08T18:31:23.960 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.960 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.960 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:31:23.960 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.544004+0000", 2024-05-08T18:31:23.960 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00032268900000000003 2024-05-08T18:31:23.960 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.961 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.961 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:23.961 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.545158+0000", 2024-05-08T18:31:23.961 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0011540190000000001 2024-05-08T18:31:23.961 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.961 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.961 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:23.961 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.545970+0000", 2024-05-08T18:31:23.961 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00081224300000000004 2024-05-08T18:31:23.961 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.961 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.962 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:23.962 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.546043+0000", 2024-05-08T18:31:23.962 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.3067999999999999e-05 2024-05-08T18:31:23.962 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.962 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.962 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:23.962 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.546102+0000", 2024-05-08T18:31:23.962 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8224999999999999e-05 2024-05-08T18:31:23.962 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:23.962 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:23.963 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:23.963 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.963 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.963 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:23.963 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.578568+0000", 2024-05-08T18:31:23.963 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 91.248490297999993, 2024-05-08T18:31:23.963 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0030345839999999999, 2024-05-08T18:31:23.963 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:23.963 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:23.963 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:23.963 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:23.963 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:23.964 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:23.964 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 946 2024-05-08T18:31:23.964 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.964 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:23.964 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.964 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:23.964 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578568+0000", 2024-05-08T18:31:23.964 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:23.964 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.964 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.964 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:23.965 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578568+0000", 2024-05-08T18:31:23.965 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:23.965 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.965 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.965 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:23.965 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578570+0000", 2024-05-08T18:31:23.965 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3700000000000002e-06 2024-05-08T18:31:23.965 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.965 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.965 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:23.965 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578582+0000", 2024-05-08T18:31:23.965 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1627000000000001e-05 2024-05-08T18:31:23.966 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.966 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.966 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:23.966 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578612+0000", 2024-05-08T18:31:23.966 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0103e-05 2024-05-08T18:31:23.966 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.966 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.966 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:23.966 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578627+0000", 2024-05-08T18:31:23.966 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4949999999999999e-05 2024-05-08T18:31:23.966 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.967 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.967 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:23.967 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578750+0000", 2024-05-08T18:31:23.967 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012309899999999999 2024-05-08T18:31:23.967 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.967 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.967 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:23.967 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.579042+0000", 2024-05-08T18:31:23.967 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00029212500000000001 2024-05-08T18:31:23.967 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.967 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.967 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:23.968 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.579557+0000", 2024-05-08T18:31:23.968 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00051536900000000001 2024-05-08T18:31:23.968 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.968 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.968 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:23.968 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.580698+0000", 2024-05-08T18:31:23.968 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001140774 2024-05-08T18:31:23.968 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.968 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.968 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:23.968 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.581367+0000", 2024-05-08T18:31:23.969 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00066884799999999999 2024-05-08T18:31:23.969 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.969 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.969 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:23.969 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.581489+0000", 2024-05-08T18:31:23.969 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012265600000000001 2024-05-08T18:31:23.969 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:23.969 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:23.969 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:23.969 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.581602+0000", 2024-05-08T18:31:23.969 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000112663 2024-05-08T18:31:23.969 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:23.970 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:23.970 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:23.970 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:23.970 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:23.970 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:23.970 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-08T18:31:23.972 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:31:23.970+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:31:23.973 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-08T18:31:24.072 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:31:24.070+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:31:24.173 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:31:24.170+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:31:24.184 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:24.184 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:31:24.184 INFO:teuthology.orchestra.run.smithi097.stdout: "num_ops": 0 2024-05-08T18:31:24.184 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:24.203 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-08T18:31:24.220 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-08T18:31:24.274 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:31:24.270+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:31:24.374 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:31:24.370+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:31:24.421 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:24.421 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:31:24.421 INFO:teuthology.orchestra.run.smithi097.stdout: "complaint_time": 30, 2024-05-08T18:31:24.421 INFO:teuthology.orchestra.run.smithi097.stdout: "num_blocked_ops": 0 2024-05-08T18:31:24.421 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:24.425 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2024-05-08T18:31:24.425 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:31:24.441 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-08T18:31:24.442 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2024-05-08T18:31:24.443 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:31:24.464 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2024-05-08T18:31:24.464 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:31:24.476 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:31:24.474+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:31:24.480 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2024-05-08T18:31:24.480 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:31:24.501 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2024-05-08T18:31:24.501 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:31:24.522 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2024-05-08T18:31:24.522 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:31:24.543 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2024-05-08T18:31:24.543 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:31:24.567 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2024-05-08T18:31:24.567 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:31:24.576 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:31:24.574+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:31:24.615 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:24.615 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:24.634 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-08T18:31:24.677 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:31:24.674+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:31:24.778 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:31:24.774+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:31:24.828 INFO:teuthology.orchestra.run.smithi097.stderr:noscrub is set 2024-05-08T18:31:24.845 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:24.845 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:24.868 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-08T18:31:24.879 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:31:24.874+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:31:24.981 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:31:24.978+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:31:25.078 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:25.078 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:25.081 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:31:25.078+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:31:25.097 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-08T18:31:25.182 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:31:25.178+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:31:25.266 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:25.267 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:25.283 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:31:25.282+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:31:25.285 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-08T18:31:25.383 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:31:25.382+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:31:25.418 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:25.418 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:25.432 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-08T18:31:25.484 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:31:25.482+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:31:25.554 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:25.554 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:25.568 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-08T18:31:25.613 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:31:25.610+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:31:25.685 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:25.685 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:25.686 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:31:25.682+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:31:25.699 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-08T18:31:25.787 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:31:25.786+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:31:25.868 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:25.868 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:25.883 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-08T18:31:25.928 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:31:25.926+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:31:25.990 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:31:25.986+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:31:26.005 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:26.005 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:26.020 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-08T18:31:26.091 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:31:26.086+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:31:26.178 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:26.178 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:26.192 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-08T18:31:26.193 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:31:26.190+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:31:26.293 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:31:26.290+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:31:26.357 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:26.358 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:26.371 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-08T18:31:26.417 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:31:26.414+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:31:26.492 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:26.493 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:26.495 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:31:26.490+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:31:26.507 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-08T18:31:26.586 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-08T18:31:26.632 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:31:26.630+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:31:26.674 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:26.674 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:26.689 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-08T18:31:26.696 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:31:26.694+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:31:26.784 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2024-05-08T18:31:26.784 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:31:26.798 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:31:26.794+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:31:26.813 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:26.813 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:26.813 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2024-05-08T18:31:26.814 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:31:26.827 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-08T18:31:26.844 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2024-05-08T18:31:26.844 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:31:26.859 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-08T18:31:26.874 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2024-05-08T18:31:26.875 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:31:26.898 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:31:26.894+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:31:26.905 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2024-05-08T18:31:26.905 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:31:26.935 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2024-05-08T18:31:26.936 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:31:26.968 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2024-05-08T18:31:26.968 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:31:26.992 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:26.992 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:26.999 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:31:26.998+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:31:27.000 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2024-05-08T18:31:27.000 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:31:27.007 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-08T18:31:27.100 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:31:27.098+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:31:27.131 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:31:27.131 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2024-05-08T18:31:27.132 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2024-05-08T18:31:27.132 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-05-08T18:31:27.132 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.132 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:24 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [write 262144~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:27.132 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.154193+0000", 2024-05-08T18:31:27.132 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 119.976579868, 2024-05-08T18:31:27.132 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0085494309999999997, 2024-05-08T18:31:27.132 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:27.132 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:27.132 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:27.132 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:27.132 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:27.133 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:27.133 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 24 2024-05-08T18:31:27.133 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.133 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:27.133 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.133 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:27.133 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154193+0000", 2024-05-08T18:31:27.133 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:27.133 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.133 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.133 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:27.133 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154193+0000", 2024-05-08T18:31:27.133 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:27.133 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.134 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.134 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:27.134 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154194+0000", 2024-05-08T18:31:27.134 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.44e-06 2024-05-08T18:31:27.134 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.134 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.134 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:27.134 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154394+0000", 2024-05-08T18:31:27.134 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00019972499999999999 2024-05-08T18:31:27.134 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.134 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.135 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:27.135 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154417+0000", 2024-05-08T18:31:27.135 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2713000000000001e-05 2024-05-08T18:31:27.135 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.135 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.135 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:27.135 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154437+0000", 2024-05-08T18:31:27.135 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0027e-05 2024-05-08T18:31:27.135 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.135 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.135 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:27.135 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.158438+0000", 2024-05-08T18:31:27.135 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0040011459999999997 2024-05-08T18:31:27.136 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.136 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.136 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:27.136 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.158567+0000", 2024-05-08T18:31:27.136 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012923899999999999 2024-05-08T18:31:27.136 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.136 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.136 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:27.136 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.158787+0000", 2024-05-08T18:31:27.136 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000219581 2024-05-08T18:31:27.136 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.136 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.136 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:27.136 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.162013+0000", 2024-05-08T18:31:27.137 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032261759999999999 2024-05-08T18:31:27.137 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.137 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.137 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:27.137 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.162568+0000", 2024-05-08T18:31:27.137 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00055576900000000001 2024-05-08T18:31:27.137 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.137 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.138 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:27.138 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.162644+0000", 2024-05-08T18:31:27.138 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5516e-05 2024-05-08T18:31:27.138 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.138 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.138 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:27.138 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.162742+0000", 2024-05-08T18:31:27.138 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8098999999999997e-05 2024-05-08T18:31:27.138 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:27.138 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:27.138 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:27.138 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.139 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.139 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:25 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:27.139 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.154495+0000", 2024-05-08T18:31:27.139 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 119.97627757399999, 2024-05-08T18:31:27.139 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010784396999999999, 2024-05-08T18:31:27.139 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:27.139 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:27.139 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:27.139 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:27.139 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:27.139 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:27.140 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 25 2024-05-08T18:31:27.140 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.140 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:27.140 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.140 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:27.140 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154495+0000", 2024-05-08T18:31:27.140 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:27.140 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.140 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.140 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:27.140 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154495+0000", 2024-05-08T18:31:27.140 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:27.140 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.141 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.141 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:27.141 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154496+0000", 2024-05-08T18:31:27.141 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.454e-06 2024-05-08T18:31:27.141 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.141 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.141 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:27.141 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154509+0000", 2024-05-08T18:31:27.141 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2496e-05 2024-05-08T18:31:27.141 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.141 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.141 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:27.142 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154531+0000", 2024-05-08T18:31:27.142 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1987000000000001e-05 2024-05-08T18:31:27.142 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.142 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.142 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:27.142 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.154547+0000", 2024-05-08T18:31:27.142 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.577e-05 2024-05-08T18:31:27.142 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.142 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.142 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:27.142 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.160949+0000", 2024-05-08T18:31:27.142 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.006401917 2024-05-08T18:31:27.143 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.143 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.143 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:27.143 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.161102+0000", 2024-05-08T18:31:27.143 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000153826 2024-05-08T18:31:27.143 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.143 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.143 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:27.143 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.161332+0000", 2024-05-08T18:31:27.143 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022918099999999999 2024-05-08T18:31:27.143 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.143 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.143 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:27.144 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.163838+0000", 2024-05-08T18:31:27.144 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0025064079999999999 2024-05-08T18:31:27.144 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.144 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.144 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:27.144 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.165121+0000", 2024-05-08T18:31:27.144 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0012825200000000001 2024-05-08T18:31:27.144 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.144 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.144 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:27.144 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.165212+0000", 2024-05-08T18:31:27.144 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1121999999999999e-05 2024-05-08T18:31:27.144 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.145 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.145 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:27.145 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.165279+0000", 2024-05-08T18:31:27.145 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7716e-05 2024-05-08T18:31:27.145 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:27.145 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:27.145 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:27.145 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.145 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.145 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:41 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:27.145 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247174+0000", 2024-05-08T18:31:27.146 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 119.883598592, 2024-05-08T18:31:27.146 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010013393000000001, 2024-05-08T18:31:27.146 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:27.146 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:27.146 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:27.146 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:27.146 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:27.146 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:27.146 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 41 2024-05-08T18:31:27.146 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.147 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:27.147 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.147 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:27.147 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247174+0000", 2024-05-08T18:31:27.147 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:27.147 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.147 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.147 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:27.147 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247174+0000", 2024-05-08T18:31:27.147 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:27.148 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.148 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.148 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:27.148 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247175+0000", 2024-05-08T18:31:27.148 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.9999999999999995e-07 2024-05-08T18:31:27.148 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.148 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.148 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:27.148 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247277+0000", 2024-05-08T18:31:27.148 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010243600000000001 2024-05-08T18:31:27.148 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.148 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.149 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:27.149 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247291+0000", 2024-05-08T18:31:27.149 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4076999999999999e-05 2024-05-08T18:31:27.149 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.149 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.149 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:27.149 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247301+0000", 2024-05-08T18:31:27.149 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0010000000000001e-05 2024-05-08T18:31:27.149 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.149 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.149 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:27.149 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.249555+0000", 2024-05-08T18:31:27.149 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0022539050000000001 2024-05-08T18:31:27.150 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.150 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.150 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:27.150 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.249700+0000", 2024-05-08T18:31:27.150 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014484599999999999 2024-05-08T18:31:27.150 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.150 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.150 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:27.150 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.249929+0000", 2024-05-08T18:31:27.150 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022904499999999999 2024-05-08T18:31:27.150 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.150 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.151 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:27.151 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.253695+0000", 2024-05-08T18:31:27.151 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0037656640000000002 2024-05-08T18:31:27.151 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.151 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.151 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:27.151 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.256970+0000", 2024-05-08T18:31:27.151 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003274608 2024-05-08T18:31:27.151 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.151 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.151 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:27.151 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.257052+0000", 2024-05-08T18:31:27.151 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2223000000000002e-05 2024-05-08T18:31:27.152 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.152 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.152 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:27.152 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.257187+0000", 2024-05-08T18:31:27.152 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013557900000000001 2024-05-08T18:31:27.152 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:27.152 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:27.152 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:27.152 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.152 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.152 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:42 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:27.153 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247321+0000", 2024-05-08T18:31:27.153 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 119.88345127300001, 2024-05-08T18:31:27.153 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013168572, 2024-05-08T18:31:27.153 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:27.153 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:27.153 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:27.153 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:27.153 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:27.153 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:27.153 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 42 2024-05-08T18:31:27.153 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.153 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:27.153 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.154 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:27.154 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247321+0000", 2024-05-08T18:31:27.154 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:27.154 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.154 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.154 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:27.154 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247321+0000", 2024-05-08T18:31:27.154 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:27.154 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.154 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.154 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:27.155 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247323+0000", 2024-05-08T18:31:27.155 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.24e-06 2024-05-08T18:31:27.155 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.155 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.155 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:27.155 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247329+0000", 2024-05-08T18:31:27.155 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1530000000000002e-06 2024-05-08T18:31:27.155 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.155 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.155 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:27.155 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247339+0000", 2024-05-08T18:31:27.156 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0387000000000001e-05 2024-05-08T18:31:27.156 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.156 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.156 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:27.156 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247347+0000", 2024-05-08T18:31:27.156 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9829999999999996e-06 2024-05-08T18:31:27.156 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.156 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.156 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:27.156 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.251488+0000", 2024-05-08T18:31:27.157 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0041412849999999998 2024-05-08T18:31:27.157 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.157 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.157 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:27.157 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.251672+0000", 2024-05-08T18:31:27.157 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00018354499999999999 2024-05-08T18:31:27.157 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.157 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.157 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:27.157 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.251949+0000", 2024-05-08T18:31:27.157 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00027695399999999999 2024-05-08T18:31:27.157 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.158 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.158 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:27.158 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.253810+0000", 2024-05-08T18:31:27.158 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001860806 2024-05-08T18:31:27.158 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.158 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.158 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:27.158 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260244+0000", 2024-05-08T18:31:27.158 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0064347939999999998 2024-05-08T18:31:27.158 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.159 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.159 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:27.159 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260376+0000", 2024-05-08T18:31:27.159 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000131829 2024-05-08T18:31:27.159 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.159 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.159 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:27.159 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260490+0000", 2024-05-08T18:31:27.159 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000113596 2024-05-08T18:31:27.159 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:27.160 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:27.160 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:27.160 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.160 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.160 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:43 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:27.160 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247367+0000", 2024-05-08T18:31:27.160 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 119.88340536, 2024-05-08T18:31:27.160 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013449025999999999, 2024-05-08T18:31:27.160 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:27.161 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:27.161 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:27.161 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:27.161 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:27.161 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:27.161 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 43 2024-05-08T18:31:27.161 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.161 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:27.161 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.161 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:27.161 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247367+0000", 2024-05-08T18:31:27.161 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:27.161 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.162 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.162 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:27.162 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247367+0000", 2024-05-08T18:31:27.162 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:27.162 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.162 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.162 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:27.162 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247368+0000", 2024-05-08T18:31:27.162 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1999999999999999e-07 2024-05-08T18:31:27.162 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.162 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.162 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:27.162 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247374+0000", 2024-05-08T18:31:27.162 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.19e-06 2024-05-08T18:31:27.163 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.163 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.163 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:27.163 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247384+0000", 2024-05-08T18:31:27.163 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0173000000000001e-05 2024-05-08T18:31:27.163 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.163 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.163 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:27.163 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247392+0000", 2024-05-08T18:31:27.163 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1869999999999997e-06 2024-05-08T18:31:27.163 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.163 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.163 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:27.164 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.252515+0000", 2024-05-08T18:31:27.164 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0051221399999999999 2024-05-08T18:31:27.164 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.164 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.164 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:27.164 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.252641+0000", 2024-05-08T18:31:27.164 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012609200000000001 2024-05-08T18:31:27.164 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.164 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.164 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:27.164 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.252842+0000", 2024-05-08T18:31:27.164 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000201619 2024-05-08T18:31:27.165 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.165 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.165 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:27.165 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.256828+0000", 2024-05-08T18:31:27.165 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039853989999999997 2024-05-08T18:31:27.165 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.165 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.165 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:27.165 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260515+0000", 2024-05-08T18:31:27.165 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0036875419999999998 2024-05-08T18:31:27.165 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.165 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.165 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:27.166 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260718+0000", 2024-05-08T18:31:27.166 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020229499999999999 2024-05-08T18:31:27.166 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.166 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.166 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:27.166 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260816+0000", 2024-05-08T18:31:27.166 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8669e-05 2024-05-08T18:31:27.166 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:27.166 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:27.166 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:27.166 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.166 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.166 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:27.167 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247466+0000", 2024-05-08T18:31:27.167 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 119.883306774, 2024-05-08T18:31:27.167 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013491806, 2024-05-08T18:31:27.167 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:27.167 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:27.167 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:27.167 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:27.167 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:27.167 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:27.167 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 44 2024-05-08T18:31:27.167 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.167 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:27.167 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.167 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:27.168 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247466+0000", 2024-05-08T18:31:27.168 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:27.168 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.168 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.168 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:27.168 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247466+0000", 2024-05-08T18:31:27.168 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:27.168 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.168 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.168 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:27.168 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247467+0000", 2024-05-08T18:31:27.168 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.263e-06 2024-05-08T18:31:27.168 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.168 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.169 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:27.169 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247585+0000", 2024-05-08T18:31:27.169 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011756600000000001 2024-05-08T18:31:27.169 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.169 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.169 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:27.169 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247598+0000", 2024-05-08T18:31:27.169 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3766e-05 2024-05-08T18:31:27.169 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.169 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.169 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:27.169 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247609+0000", 2024-05-08T18:31:27.169 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0604e-05 2024-05-08T18:31:27.169 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.170 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.170 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:27.170 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.253890+0000", 2024-05-08T18:31:27.170 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0062810440000000004 2024-05-08T18:31:27.170 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.170 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.170 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:27.170 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.254068+0000", 2024-05-08T18:31:27.170 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017848199999999999 2024-05-08T18:31:27.170 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.170 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.170 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:27.170 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.254488+0000", 2024-05-08T18:31:27.171 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00041965399999999999 2024-05-08T18:31:27.171 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.171 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.171 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:27.171 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.256949+0000", 2024-05-08T18:31:27.171 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002461254 2024-05-08T18:31:27.171 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.171 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.171 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:27.171 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260832+0000", 2024-05-08T18:31:27.171 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0038830539999999999 2024-05-08T18:31:27.171 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.171 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.171 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:27.172 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260906+0000", 2024-05-08T18:31:27.172 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3455999999999996e-05 2024-05-08T18:31:27.172 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.172 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.172 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:27.172 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260958+0000", 2024-05-08T18:31:27.172 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1663000000000003e-05 2024-05-08T18:31:27.172 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:27.172 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:27.172 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:27.172 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.172 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.172 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:27.172 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247630+0000", 2024-05-08T18:31:27.173 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 119.883142369, 2024-05-08T18:31:27.173 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013478753, 2024-05-08T18:31:27.173 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:27.173 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:27.173 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:27.173 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:27.173 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:27.173 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:27.173 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 45 2024-05-08T18:31:27.173 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.173 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:27.174 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.174 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:27.174 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247630+0000", 2024-05-08T18:31:27.174 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:27.174 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.174 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.174 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:27.174 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247630+0000", 2024-05-08T18:31:27.174 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:27.174 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.174 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.174 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:27.175 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247631+0000", 2024-05-08T18:31:27.175 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7399999999999991e-07 2024-05-08T18:31:27.175 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.175 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.175 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:27.175 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247637+0000", 2024-05-08T18:31:27.175 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.93e-06 2024-05-08T18:31:27.175 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.175 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.175 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:27.175 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247647+0000", 2024-05-08T18:31:27.175 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7459999999999995e-06 2024-05-08T18:31:27.175 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.176 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.176 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:27.176 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247654+0000", 2024-05-08T18:31:27.176 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4039999999999998e-06 2024-05-08T18:31:27.176 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.176 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.176 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:27.176 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.255829+0000", 2024-05-08T18:31:27.176 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0081749059999999991 2024-05-08T18:31:27.176 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.176 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.176 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:27.176 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.255979+0000", 2024-05-08T18:31:27.177 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015027899999999999 2024-05-08T18:31:27.177 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.177 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.177 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:27.177 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.256185+0000", 2024-05-08T18:31:27.177 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020583900000000001 2024-05-08T18:31:27.177 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.177 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.177 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:27.177 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260097+0000", 2024-05-08T18:31:27.177 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039121929999999996 2024-05-08T18:31:27.177 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.178 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.178 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:27.178 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260973+0000", 2024-05-08T18:31:27.178 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00087591999999999998 2024-05-08T18:31:27.178 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.178 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.178 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:27.178 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261056+0000", 2024-05-08T18:31:27.178 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3104999999999998e-05 2024-05-08T18:31:27.178 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.179 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.179 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:27.179 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261109+0000", 2024-05-08T18:31:27.179 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2457000000000003e-05 2024-05-08T18:31:27.179 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:27.179 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:27.179 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:27.179 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.179 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.179 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:27.179 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247667+0000", 2024-05-08T18:31:27.179 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 119.883105089, 2024-05-08T18:31:27.180 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013569098999999999, 2024-05-08T18:31:27.180 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:27.180 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:27.180 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:27.180 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:27.180 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:27.180 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:27.180 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 46 2024-05-08T18:31:27.180 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.180 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:27.180 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.180 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:27.180 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247667+0000", 2024-05-08T18:31:27.181 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:27.181 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.181 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.181 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:27.181 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247667+0000", 2024-05-08T18:31:27.181 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:27.181 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.181 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.181 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:27.181 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247668+0000", 2024-05-08T18:31:27.181 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7999999999999995e-07 2024-05-08T18:31:27.181 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.181 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.182 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:27.182 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247674+0000", 2024-05-08T18:31:27.182 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4369999999999998e-06 2024-05-08T18:31:27.182 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.182 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.182 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:27.182 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247683+0000", 2024-05-08T18:31:27.182 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4360000000000008e-06 2024-05-08T18:31:27.182 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.182 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.182 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:27.182 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247690+0000", 2024-05-08T18:31:27.183 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.43e-06 2024-05-08T18:31:27.183 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.183 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.183 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:27.183 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.257358+0000", 2024-05-08T18:31:27.183 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0096676890000000001 2024-05-08T18:31:27.183 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.183 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.183 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:27.183 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.257626+0000", 2024-05-08T18:31:27.183 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00026819099999999998 2024-05-08T18:31:27.183 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.183 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.183 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:27.184 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.258041+0000", 2024-05-08T18:31:27.184 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00041438400000000001 2024-05-08T18:31:27.184 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.184 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.184 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:27.184 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.260224+0000", 2024-05-08T18:31:27.184 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0021830700000000001 2024-05-08T18:31:27.184 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.184 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.184 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:27.184 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261127+0000", 2024-05-08T18:31:27.184 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00090292300000000003 2024-05-08T18:31:27.185 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.185 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.185 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:27.185 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261191+0000", 2024-05-08T18:31:27.185 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4342000000000002e-05 2024-05-08T18:31:27.185 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.185 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.185 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:27.185 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261237+0000", 2024-05-08T18:31:27.185 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.5516999999999998e-05 2024-05-08T18:31:27.185 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:27.185 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:27.185 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:27.186 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.186 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.186 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:27.186 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247703+0000", 2024-05-08T18:31:27.186 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 119.88306960600001, 2024-05-08T18:31:27.186 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015020204000000001, 2024-05-08T18:31:27.186 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:27.186 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:27.186 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:27.186 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:27.186 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:27.186 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:27.187 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 47 2024-05-08T18:31:27.187 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.187 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:27.187 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.187 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:27.187 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247703+0000", 2024-05-08T18:31:27.187 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:27.187 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.187 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.187 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:27.187 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247703+0000", 2024-05-08T18:31:27.188 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:27.188 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.188 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.188 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:27.188 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247704+0000", 2024-05-08T18:31:27.188 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8299999999999996e-07 2024-05-08T18:31:27.188 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.188 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.188 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:27.188 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247877+0000", 2024-05-08T18:31:27.188 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000172979 2024-05-08T18:31:27.188 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.189 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.189 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:27.189 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247894+0000", 2024-05-08T18:31:27.189 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6912999999999999e-05 2024-05-08T18:31:27.189 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.189 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.189 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:27.189 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247903+0000", 2024-05-08T18:31:27.189 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1770000000000004e-06 2024-05-08T18:31:27.189 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.189 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.189 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:27.189 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.258767+0000", 2024-05-08T18:31:27.190 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010864409 2024-05-08T18:31:27.190 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.190 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.190 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:27.190 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.258898+0000", 2024-05-08T18:31:27.190 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000131199 2024-05-08T18:31:27.190 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.190 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.190 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:27.190 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.259117+0000", 2024-05-08T18:31:27.190 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000218889 2024-05-08T18:31:27.190 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.191 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.191 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:27.191 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.262372+0000", 2024-05-08T18:31:27.191 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032545679999999998 2024-05-08T18:31:27.191 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.191 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.191 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:27.191 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.262432+0000", 2024-05-08T18:31:27.191 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9913e-05 2024-05-08T18:31:27.191 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.191 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.191 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:27.191 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.262585+0000", 2024-05-08T18:31:27.191 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015361800000000001 2024-05-08T18:31:27.192 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.192 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.192 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:27.192 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.262723+0000", 2024-05-08T18:31:27.192 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000137856 2024-05-08T18:31:27.192 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:27.192 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:27.192 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:27.192 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.192 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.192 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:27.193 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247927+0000", 2024-05-08T18:31:27.193 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 119.88284556799999, 2024-05-08T18:31:27.193 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018387718000000001, 2024-05-08T18:31:27.193 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:27.193 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:27.193 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:27.193 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:27.193 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:27.193 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:27.193 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 48 2024-05-08T18:31:27.193 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.194 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:27.194 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.194 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:27.194 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247927+0000", 2024-05-08T18:31:27.194 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:27.194 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.194 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.194 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:27.194 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247927+0000", 2024-05-08T18:31:27.194 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:27.194 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.194 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.195 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:27.195 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247928+0000", 2024-05-08T18:31:27.195 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8400000000000003e-07 2024-05-08T18:31:27.195 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.195 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.195 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:27.195 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247935+0000", 2024-05-08T18:31:27.195 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1230000000000002e-06 2024-05-08T18:31:27.195 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.195 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.195 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:27.195 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247945+0000", 2024-05-08T18:31:27.195 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0346000000000001e-05 2024-05-08T18:31:27.196 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.196 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.196 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:27.196 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247953+0000", 2024-05-08T18:31:27.196 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8040000000000002e-06 2024-05-08T18:31:27.196 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.196 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.196 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:27.196 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261292+0000", 2024-05-08T18:31:27.196 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013339337 2024-05-08T18:31:27.196 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.196 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.196 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:27.197 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261424+0000", 2024-05-08T18:31:27.197 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013201900000000001 2024-05-08T18:31:27.197 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.197 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.197 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:27.197 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.261628+0000", 2024-05-08T18:31:27.197 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020327499999999999 2024-05-08T18:31:27.197 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.197 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.197 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:27.197 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.263849+0000", 2024-05-08T18:31:27.197 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0022209759999999999 2024-05-08T18:31:27.197 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.198 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.198 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:27.198 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266167+0000", 2024-05-08T18:31:27.198 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002317979 2024-05-08T18:31:27.198 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.198 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.198 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:27.198 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266249+0000", 2024-05-08T18:31:27.198 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1996000000000006e-05 2024-05-08T18:31:27.198 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.198 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.198 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:27.199 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266315+0000", 2024-05-08T18:31:27.199 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5979e-05 2024-05-08T18:31:27.199 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:27.199 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:27.199 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:27.199 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.199 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.199 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:27.199 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.247966+0000", 2024-05-08T18:31:27.199 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 119.88280663499999, 2024-05-08T18:31:27.199 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0194153, 2024-05-08T18:31:27.199 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:27.199 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:27.200 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:27.200 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:27.200 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:27.200 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:27.200 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 49 2024-05-08T18:31:27.200 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.200 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:27.200 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.200 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:27.200 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247966+0000", 2024-05-08T18:31:27.200 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:27.200 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.200 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.200 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:27.201 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247966+0000", 2024-05-08T18:31:27.201 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:27.201 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.201 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.201 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:27.201 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247967+0000", 2024-05-08T18:31:27.201 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0299999999999998e-07 2024-05-08T18:31:27.201 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.201 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.201 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:27.201 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247972+0000", 2024-05-08T18:31:27.201 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3600000000000004e-06 2024-05-08T18:31:27.202 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.202 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.202 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:27.202 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247981+0000", 2024-05-08T18:31:27.202 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.234e-06 2024-05-08T18:31:27.202 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.202 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.202 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:27.202 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.247989+0000", 2024-05-08T18:31:27.202 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5159999999999997e-06 2024-05-08T18:31:27.202 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.202 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.203 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:27.203 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.262816+0000", 2024-05-08T18:31:27.203 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.014827399999999999 2024-05-08T18:31:27.203 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.203 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.203 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:27.203 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.262948+0000", 2024-05-08T18:31:27.203 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013166799999999999 2024-05-08T18:31:27.203 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.203 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.203 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:27.203 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.263153+0000", 2024-05-08T18:31:27.203 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000205272 2024-05-08T18:31:27.203 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.204 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.204 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:27.204 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266144+0000", 2024-05-08T18:31:27.204 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0029912300000000001 2024-05-08T18:31:27.204 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.204 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.204 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:27.204 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.267226+0000", 2024-05-08T18:31:27.204 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010820580000000001 2024-05-08T18:31:27.204 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.204 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.204 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:27.204 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.267315+0000", 2024-05-08T18:31:27.205 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8793000000000002e-05 2024-05-08T18:31:27.205 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.205 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.205 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:27.205 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.267381+0000", 2024-05-08T18:31:27.205 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6066000000000001e-05 2024-05-08T18:31:27.205 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:27.205 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:27.205 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:27.205 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.205 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.205 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:27.205 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.248003+0000", 2024-05-08T18:31:27.205 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 119.88276933500001, 2024-05-08T18:31:27.206 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.020859638999999999, 2024-05-08T18:31:27.206 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:27.206 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:27.206 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:27.206 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:27.206 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:27.206 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:27.206 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 50 2024-05-08T18:31:27.206 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.206 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:27.206 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.206 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:27.206 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248003+0000", 2024-05-08T18:31:27.206 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:27.207 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.207 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.207 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:27.207 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248003+0000", 2024-05-08T18:31:27.207 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:27.207 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.207 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.207 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:27.207 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248004+0000", 2024-05-08T18:31:27.207 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5300000000000003e-07 2024-05-08T18:31:27.207 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.207 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.207 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:27.207 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248139+0000", 2024-05-08T18:31:27.208 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000135193 2024-05-08T18:31:27.208 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.208 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.208 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:27.208 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248151+0000", 2024-05-08T18:31:27.208 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.19e-05 2024-05-08T18:31:27.208 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.208 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.208 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:27.208 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248161+0000", 2024-05-08T18:31:27.208 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4599999999999992e-06 2024-05-08T18:31:27.208 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.208 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.208 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:27.209 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.263961+0000", 2024-05-08T18:31:27.209 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015800844000000001 2024-05-08T18:31:27.209 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.209 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.209 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:27.209 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.264091+0000", 2024-05-08T18:31:27.209 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012952300000000001 2024-05-08T18:31:27.209 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.209 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.209 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:27.209 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.264306+0000", 2024-05-08T18:31:27.209 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000215541 2024-05-08T18:31:27.209 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.210 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.210 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:27.210 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.267205+0000", 2024-05-08T18:31:27.210 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0028989910000000001 2024-05-08T18:31:27.210 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.210 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.210 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:27.210 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.268631+0000", 2024-05-08T18:31:27.210 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0014257320000000001 2024-05-08T18:31:27.210 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.210 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.210 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:27.210 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.268781+0000", 2024-05-08T18:31:27.211 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000149939 2024-05-08T18:31:27.211 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.211 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.211 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:27.211 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.268863+0000", 2024-05-08T18:31:27.211 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1762999999999996e-05 2024-05-08T18:31:27.211 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:27.211 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:27.211 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:27.211 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.211 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.211 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:27.211 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.248201+0000", 2024-05-08T18:31:27.212 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 119.88257158, 2024-05-08T18:31:27.212 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.022909783, 2024-05-08T18:31:27.212 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:27.212 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:27.212 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:27.212 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:27.212 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:27.212 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:27.212 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 51 2024-05-08T18:31:27.212 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.212 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:27.212 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.212 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:27.213 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248201+0000", 2024-05-08T18:31:27.213 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:27.213 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.213 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.213 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:27.213 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248201+0000", 2024-05-08T18:31:27.213 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:27.213 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.213 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.213 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:27.213 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248202+0000", 2024-05-08T18:31:27.213 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2999999999999999e-07 2024-05-08T18:31:27.213 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.214 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.214 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:27.214 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248209+0000", 2024-05-08T18:31:27.214 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5769999999999996e-06 2024-05-08T18:31:27.214 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.214 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.214 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:27.214 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248221+0000", 2024-05-08T18:31:27.214 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1165999999999999e-05 2024-05-08T18:31:27.214 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.214 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.214 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:27.214 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248229+0000", 2024-05-08T18:31:27.214 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1529999999999997e-06 2024-05-08T18:31:27.215 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.215 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.215 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:27.215 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.265146+0000", 2024-05-08T18:31:27.215 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016917492999999999 2024-05-08T18:31:27.215 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.215 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.215 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:27.215 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.265282+0000", 2024-05-08T18:31:27.215 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013597199999999999 2024-05-08T18:31:27.215 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.215 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.215 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:27.216 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.265488+0000", 2024-05-08T18:31:27.216 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000206212 2024-05-08T18:31:27.216 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.216 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.216 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:27.216 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.268442+0000", 2024-05-08T18:31:27.216 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002953841 2024-05-08T18:31:27.216 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.216 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.216 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:27.216 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.270951+0000", 2024-05-08T18:31:27.216 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0025085670000000002 2024-05-08T18:31:27.217 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.217 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.217 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:27.217 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.271042+0000", 2024-05-08T18:31:27.217 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1485999999999998e-05 2024-05-08T18:31:27.217 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.217 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.217 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:27.217 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.271111+0000", 2024-05-08T18:31:27.217 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8386000000000006e-05 2024-05-08T18:31:27.217 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:27.217 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:27.217 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:27.218 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.218 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.218 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:27.218 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.248244+0000", 2024-05-08T18:31:27.218 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 119.88252902399999, 2024-05-08T18:31:27.218 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.023010806000000002, 2024-05-08T18:31:27.218 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:27.218 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:27.218 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:27.218 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:27.219 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:27.219 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:27.219 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 52 2024-05-08T18:31:27.219 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.219 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:27.219 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.219 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:27.219 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248244+0000", 2024-05-08T18:31:27.219 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:27.219 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.219 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.219 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:27.219 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248244+0000", 2024-05-08T18:31:27.220 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:27.220 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.220 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.220 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:27.220 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248244+0000", 2024-05-08T18:31:27.220 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0999999999999998e-07 2024-05-08T18:31:27.220 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.220 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.220 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:27.220 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248251+0000", 2024-05-08T18:31:27.220 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9639999999999997e-06 2024-05-08T18:31:27.220 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.220 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.221 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:27.221 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248266+0000", 2024-05-08T18:31:27.221 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4996e-05 2024-05-08T18:31:27.221 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.221 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.221 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:27.221 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248274+0000", 2024-05-08T18:31:27.221 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8299999999999996e-06 2024-05-08T18:31:27.221 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.221 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.221 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:27.221 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266367+0000", 2024-05-08T18:31:27.222 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018092607 2024-05-08T18:31:27.222 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.222 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.222 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:27.222 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266532+0000", 2024-05-08T18:31:27.222 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016569600000000001 2024-05-08T18:31:27.222 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.222 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.222 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:27.222 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266729+0000", 2024-05-08T18:31:27.222 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00019630099999999999 2024-05-08T18:31:27.223 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.223 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.223 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:27.223 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.268574+0000", 2024-05-08T18:31:27.223 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0018452329999999999 2024-05-08T18:31:27.223 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.223 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.223 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:27.223 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.271128+0000", 2024-05-08T18:31:27.223 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00255369 2024-05-08T18:31:27.223 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.224 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.224 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:27.224 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.271199+0000", 2024-05-08T18:31:27.224 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1712999999999996e-05 2024-05-08T18:31:27.224 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.224 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.224 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:27.224 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.271254+0000", 2024-05-08T18:31:27.224 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5065999999999998e-05 2024-05-08T18:31:27.224 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:27.224 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:27.224 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:27.224 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.225 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.225 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:27.225 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.486052+0000", 2024-05-08T18:31:27.225 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 119.64472058, 2024-05-08T18:31:27.225 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0098898389999999992, 2024-05-08T18:31:27.225 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:27.225 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:27.225 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:27.225 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:27.225 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:27.225 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:27.225 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 72 2024-05-08T18:31:27.225 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.225 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:27.225 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.226 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:27.226 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486052+0000", 2024-05-08T18:31:27.226 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:27.226 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.226 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.226 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:27.226 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486052+0000", 2024-05-08T18:31:27.226 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:27.226 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.226 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.226 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:27.226 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486053+0000", 2024-05-08T18:31:27.226 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1200000000000001e-07 2024-05-08T18:31:27.227 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.227 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.227 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:27.227 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486188+0000", 2024-05-08T18:31:27.227 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013526200000000001 2024-05-08T18:31:27.227 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.227 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.227 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:27.227 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486205+0000", 2024-05-08T18:31:27.227 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6742e-05 2024-05-08T18:31:27.227 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.227 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.227 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:27.228 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486215+0000", 2024-05-08T18:31:27.228 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8290000000000003e-06 2024-05-08T18:31:27.228 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.228 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.228 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:27.228 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.491930+0000", 2024-05-08T18:31:27.228 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0057153660000000004 2024-05-08T18:31:27.228 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.228 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.228 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:27.228 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.491995+0000", 2024-05-08T18:31:27.228 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5289000000000005e-05 2024-05-08T18:31:27.228 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.228 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.229 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:27.229 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.492096+0000", 2024-05-08T18:31:27.229 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010101400000000001 2024-05-08T18:31:27.229 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.229 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.229 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:27.229 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.494152+0000", 2024-05-08T18:31:27.229 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0020560740000000002 2024-05-08T18:31:27.229 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.229 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.229 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:27.230 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.495860+0000", 2024-05-08T18:31:27.230 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0017076159999999999 2024-05-08T18:31:27.230 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.230 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.230 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:27.230 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.495903+0000", 2024-05-08T18:31:27.230 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3009000000000001e-05 2024-05-08T18:31:27.230 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.230 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.230 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:27.230 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.495942+0000", 2024-05-08T18:31:27.230 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8726000000000002e-05 2024-05-08T18:31:27.230 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:27.231 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:27.231 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:27.231 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.231 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.231 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:27.231 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.486234+0000", 2024-05-08T18:31:27.231 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 119.644538512, 2024-05-08T18:31:27.231 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0099742340000000002, 2024-05-08T18:31:27.231 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:27.231 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:27.231 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:27.231 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:27.231 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:27.231 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:27.232 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 73 2024-05-08T18:31:27.232 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.232 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:27.232 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.232 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:27.232 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486234+0000", 2024-05-08T18:31:27.232 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:27.232 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.232 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.232 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:27.232 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486234+0000", 2024-05-08T18:31:27.232 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:27.232 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.233 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.233 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:27.233 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486235+0000", 2024-05-08T18:31:27.233 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.108e-06 2024-05-08T18:31:27.233 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.233 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.233 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:27.233 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486241+0000", 2024-05-08T18:31:27.233 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4e-06 2024-05-08T18:31:27.233 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.233 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.233 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:27.233 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486251+0000", 2024-05-08T18:31:27.233 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0209e-05 2024-05-08T18:31:27.234 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.234 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.234 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:27.234 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486260+0000", 2024-05-08T18:31:27.234 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2709999999999998e-06 2024-05-08T18:31:27.234 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.234 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.234 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:27.234 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.493294+0000", 2024-05-08T18:31:27.234 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0070341070000000004 2024-05-08T18:31:27.234 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.234 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.234 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:27.234 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.493370+0000", 2024-05-08T18:31:27.235 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5846999999999994e-05 2024-05-08T18:31:27.235 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.235 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.235 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:27.235 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.493479+0000", 2024-05-08T18:31:27.235 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010905500000000001 2024-05-08T18:31:27.235 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.235 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.235 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:27.235 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.495950+0000", 2024-05-08T18:31:27.235 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0024709749999999998 2024-05-08T18:31:27.235 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.235 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.235 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:27.235 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496023+0000", 2024-05-08T18:31:27.236 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3071999999999994e-05 2024-05-08T18:31:27.236 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.236 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.236 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:27.236 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496091+0000", 2024-05-08T18:31:27.236 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7646999999999998e-05 2024-05-08T18:31:27.236 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.236 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.236 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:27.236 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496208+0000", 2024-05-08T18:31:27.236 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000117543 2024-05-08T18:31:27.236 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:27.236 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:27.236 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:27.236 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.236 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.237 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:27.237 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.486276+0000", 2024-05-08T18:31:27.237 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 119.644496187, 2024-05-08T18:31:27.237 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010822577, 2024-05-08T18:31:27.237 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:27.237 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:27.237 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:27.237 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:27.237 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:27.237 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:27.237 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 74 2024-05-08T18:31:27.237 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.237 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:27.237 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.237 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:27.238 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486276+0000", 2024-05-08T18:31:27.238 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:27.238 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.238 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.238 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:27.238 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486276+0000", 2024-05-08T18:31:27.238 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:27.238 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.238 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.238 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:27.238 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486277+0000", 2024-05-08T18:31:27.238 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1699999999999997e-07 2024-05-08T18:31:27.239 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.239 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.239 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:27.239 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486282+0000", 2024-05-08T18:31:27.239 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0429999999999998e-06 2024-05-08T18:31:27.239 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.239 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.239 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:27.239 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486294+0000", 2024-05-08T18:31:27.239 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1717e-05 2024-05-08T18:31:27.239 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.239 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.239 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:27.239 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486303+0000", 2024-05-08T18:31:27.240 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.3999999999999998e-06 2024-05-08T18:31:27.240 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.240 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.240 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:27.240 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.494424+0000", 2024-05-08T18:31:27.240 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0081205960000000008 2024-05-08T18:31:27.240 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.240 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.240 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:27.240 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.494539+0000", 2024-05-08T18:31:27.240 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000115661 2024-05-08T18:31:27.240 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.240 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.240 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:27.240 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.494704+0000", 2024-05-08T18:31:27.240 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016422999999999999 2024-05-08T18:31:27.241 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.241 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.241 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:27.241 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496800+0000", 2024-05-08T18:31:27.241 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002096508 2024-05-08T18:31:27.241 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.241 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.241 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:27.241 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496889+0000", 2024-05-08T18:31:27.241 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.8349000000000004e-05 2024-05-08T18:31:27.241 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.241 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.241 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:27.242 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496983+0000", 2024-05-08T18:31:27.242 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4882000000000004e-05 2024-05-08T18:31:27.242 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.242 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.242 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:27.242 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.497099+0000", 2024-05-08T18:31:27.242 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000115474 2024-05-08T18:31:27.242 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:27.242 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:27.242 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:27.242 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.242 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.242 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:27.243 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.486324+0000", 2024-05-08T18:31:27.243 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 119.64444816699999, 2024-05-08T18:31:27.243 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010949207000000001, 2024-05-08T18:31:27.243 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:27.243 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:27.243 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:27.243 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:27.243 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:27.243 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:27.243 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 75 2024-05-08T18:31:27.243 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.243 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:27.243 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.243 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:27.243 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486324+0000", 2024-05-08T18:31:27.243 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:27.244 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.244 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.244 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:27.244 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486324+0000", 2024-05-08T18:31:27.244 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:27.244 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.244 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.244 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:27.244 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486325+0000", 2024-05-08T18:31:27.244 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6200000000000006e-07 2024-05-08T18:31:27.244 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.244 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.245 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:27.245 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486439+0000", 2024-05-08T18:31:27.245 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000113391 2024-05-08T18:31:27.245 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.245 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.245 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:27.245 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486455+0000", 2024-05-08T18:31:27.245 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5823000000000001e-05 2024-05-08T18:31:27.245 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.245 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.245 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:27.245 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486465+0000", 2024-05-08T18:31:27.245 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.0879999999999999e-05 2024-05-08T18:31:27.245 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.245 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.246 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:27.246 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.495149+0000", 2024-05-08T18:31:27.246 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0086833589999999999 2024-05-08T18:31:27.246 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.246 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.246 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:27.246 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.495213+0000", 2024-05-08T18:31:27.246 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4176000000000004e-05 2024-05-08T18:31:27.246 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.246 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.246 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:27.246 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.495350+0000", 2024-05-08T18:31:27.246 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013709099999999999 2024-05-08T18:31:27.246 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.247 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.247 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:27.247 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496809+0000", 2024-05-08T18:31:27.247 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001458953 2024-05-08T18:31:27.247 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.247 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.247 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:27.247 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.497199+0000", 2024-05-08T18:31:27.247 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00039045200000000001 2024-05-08T18:31:27.247 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.247 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.247 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:27.247 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.497241+0000", 2024-05-08T18:31:27.248 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1378999999999998e-05 2024-05-08T18:31:27.248 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.248 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.248 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:27.248 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.497274+0000", 2024-05-08T18:31:27.248 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2740999999999997e-05 2024-05-08T18:31:27.248 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:27.248 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:27.248 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:27.248 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.248 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.248 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:27.248 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.486483+0000", 2024-05-08T18:31:27.248 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 119.644289992, 2024-05-08T18:31:27.248 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011783448, 2024-05-08T18:31:27.249 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:27.249 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:27.249 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:27.249 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:27.249 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:27.249 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:27.249 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 76 2024-05-08T18:31:27.249 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.249 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:27.249 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.249 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:27.249 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486483+0000", 2024-05-08T18:31:27.249 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:27.249 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.249 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.250 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:27.250 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486483+0000", 2024-05-08T18:31:27.250 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:27.250 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.250 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.250 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:27.250 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486483+0000", 2024-05-08T18:31:27.250 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6599999999999995e-07 2024-05-08T18:31:27.250 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.250 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.250 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:27.250 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486491+0000", 2024-05-08T18:31:27.250 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.2520000000000002e-06 2024-05-08T18:31:27.251 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.251 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.251 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:27.251 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486500+0000", 2024-05-08T18:31:27.251 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4420000000000004e-06 2024-05-08T18:31:27.251 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.251 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.251 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:27.251 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.486507+0000", 2024-05-08T18:31:27.251 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3549999999999999e-06 2024-05-08T18:31:27.251 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.251 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.251 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:27.251 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496319+0000", 2024-05-08T18:31:27.252 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0098120529999999994 2024-05-08T18:31:27.252 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.252 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.252 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:27.252 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496391+0000", 2024-05-08T18:31:27.252 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1433000000000005e-05 2024-05-08T18:31:27.252 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.252 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.252 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:27.252 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.496508+0000", 2024-05-08T18:31:27.252 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000116778 2024-05-08T18:31:27.252 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.253 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.253 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:27.253 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.497284+0000", 2024-05-08T18:31:27.253 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00077609100000000002 2024-05-08T18:31:27.253 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.253 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.253 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:27.253 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.498204+0000", 2024-05-08T18:31:27.253 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00092027299999999999 2024-05-08T18:31:27.253 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.253 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.253 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:27.253 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.498240+0000", 2024-05-08T18:31:27.253 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5979999999999998e-05 2024-05-08T18:31:27.254 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.254 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.254 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:27.254 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.498266+0000", 2024-05-08T18:31:27.254 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6024999999999999e-05 2024-05-08T18:31:27.254 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:27.254 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:27.254 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:27.254 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.254 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.254 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:94 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:31:27.254 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.842580+0000", 2024-05-08T18:31:27.254 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 119.28819269100001, 2024-05-08T18:31:27.255 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0085315870000000002, 2024-05-08T18:31:27.255 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:27.255 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:27.255 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:27.255 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:27.255 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:31:27.255 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:31:27.255 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 94 2024-05-08T18:31:27.255 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.255 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:27.255 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.255 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:27.255 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.842580+0000", 2024-05-08T18:31:27.255 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:27.255 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.255 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.256 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:27.256 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.842580+0000", 2024-05-08T18:31:27.256 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:27.256 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.256 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.256 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:27.256 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.842581+0000", 2024-05-08T18:31:27.256 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.11e-06 2024-05-08T18:31:27.256 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.256 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.256 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:27.256 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.842587+0000", 2024-05-08T18:31:27.256 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2899999999999999e-06 2024-05-08T18:31:27.256 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.256 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.256 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:27.257 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.842597+0000", 2024-05-08T18:31:27.257 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.007e-05 2024-05-08T18:31:27.257 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.257 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.257 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:27.257 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.842605+0000", 2024-05-08T18:31:27.257 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1270000000000003e-06 2024-05-08T18:31:27.257 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.257 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.257 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:27.257 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.848358+0000", 2024-05-08T18:31:27.257 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0057525140000000002 2024-05-08T18:31:27.257 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.257 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.257 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:27.258 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.848481+0000", 2024-05-08T18:31:27.258 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000123239 2024-05-08T18:31:27.258 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.258 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.258 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:27.258 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.848695+0000", 2024-05-08T18:31:27.258 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000213387 2024-05-08T18:31:27.258 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.258 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.258 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:27.258 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.849781+0000", 2024-05-08T18:31:27.258 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0010868 2024-05-08T18:31:27.259 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.259 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.259 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:27.259 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.850990+0000", 2024-05-08T18:31:27.259 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0012084769999999999 2024-05-08T18:31:27.259 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.259 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.259 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:27.259 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.851059+0000", 2024-05-08T18:31:27.259 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9130999999999999e-05 2024-05-08T18:31:27.259 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:27.259 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:27.260 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:27.260 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.851111+0000", 2024-05-08T18:31:27.260 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2441999999999997e-05 2024-05-08T18:31:27.260 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:27.260 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:27.260 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:27.260 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:27.260 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:27.260 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:31:27.262 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:31:27.262+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:31:27.262 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-08T18:31:27.362 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:31:27.358+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:31:27.430 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:27.430 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:31:27.430 INFO:teuthology.orchestra.run.smithi097.stdout: "num_ops": 0 2024-05-08T18:31:27.430 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:27.447 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-08T18:31:27.488 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:31:27.486+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:31:27.564 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:31:27.562+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:31:27.654 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:27.654 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:31:27.654 INFO:teuthology.orchestra.run.smithi097.stdout: "complaint_time": 30, 2024-05-08T18:31:27.654 INFO:teuthology.orchestra.run.smithi097.stdout: "num_blocked_ops": 0 2024-05-08T18:31:27.654 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:27.666 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:31:27.662+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:31:27.670 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-08T18:31:27.767 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:31:27.762+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:31:27.841 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:27.842 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2024-05-08T18:31:27.842 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2024-05-08T18:31:27.842 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-05-08T18:31:27.842 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.842 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4206.0:24 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'14, mlcod=16'9)", 2024-05-08T18:31:27.842 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:27.162224+0000", 2024-05-08T18:31:27.842 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 120.678474892, 2024-05-08T18:31:27.842 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032712890000000001, 2024-05-08T18:31:27.842 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:27.842 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:27.843 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:27.843 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:27.843 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.843 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:27.843 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162224+0000", 2024-05-08T18:31:27.843 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:27.843 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.843 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.843 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:27.843 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162224+0000", 2024-05-08T18:31:27.843 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:27.843 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.844 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.844 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:27.844 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162225+0000", 2024-05-08T18:31:27.844 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4899999999999999e-06 2024-05-08T18:31:27.844 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.844 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.844 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:27.844 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162306+0000", 2024-05-08T18:31:27.845 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.0589999999999999e-05 2024-05-08T18:31:27.845 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.845 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.845 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:27.845 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162332+0000", 2024-05-08T18:31:27.845 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5658999999999999e-05 2024-05-08T18:31:27.845 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.845 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.845 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:27.845 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162345+0000", 2024-05-08T18:31:27.845 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3512999999999999e-05 2024-05-08T18:31:27.846 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.846 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.846 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:27.846 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162465+0000", 2024-05-08T18:31:27.846 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000119577 2024-05-08T18:31:27.846 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.846 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.846 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:27.846 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162513+0000", 2024-05-08T18:31:27.846 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8773999999999998e-05 2024-05-08T18:31:27.846 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.847 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.847 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:27.847 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.165405+0000", 2024-05-08T18:31:27.847 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028919200000000001 2024-05-08T18:31:27.847 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.847 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.847 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:27.847 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.165495+0000", 2024-05-08T18:31:27.847 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9765999999999994e-05 2024-05-08T18:31:27.847 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:27.847 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:27.847 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:27.847 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.848 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.848 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4206.0:25 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'15, mlcod=16'10)", 2024-05-08T18:31:27.848 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:27.164793+0000", 2024-05-08T18:31:27.848 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 120.67590576400001, 2024-05-08T18:31:27.848 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032285249999999999, 2024-05-08T18:31:27.848 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:27.848 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:27.848 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:27.849 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:27.849 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.849 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:27.849 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164793+0000", 2024-05-08T18:31:27.849 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:27.849 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.849 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.849 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:27.849 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164793+0000", 2024-05-08T18:31:27.849 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:27.849 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.849 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.849 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:27.850 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164795+0000", 2024-05-08T18:31:27.850 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0999999999999998e-06 2024-05-08T18:31:27.850 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.850 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.850 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:27.850 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164811+0000", 2024-05-08T18:31:27.850 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5722999999999998e-05 2024-05-08T18:31:27.850 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.850 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.850 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:27.850 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164841+0000", 2024-05-08T18:31:27.850 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0355999999999999e-05 2024-05-08T18:31:27.851 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.851 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.851 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:27.851 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164861+0000", 2024-05-08T18:31:27.851 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9533000000000001e-05 2024-05-08T18:31:27.851 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.851 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.851 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:27.851 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164984+0000", 2024-05-08T18:31:27.851 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000123146 2024-05-08T18:31:27.851 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.852 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.852 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:27.852 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.165024+0000", 2024-05-08T18:31:27.852 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9690000000000001e-05 2024-05-08T18:31:27.852 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.852 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.852 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:27.852 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.167935+0000", 2024-05-08T18:31:27.852 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0029113300000000002 2024-05-08T18:31:27.852 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.852 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.853 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:27.853 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.168021+0000", 2024-05-08T18:31:27.853 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6646999999999999e-05 2024-05-08T18:31:27.853 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:27.853 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:27.853 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:27.853 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.853 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.853 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:31:27.853 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:48.674737+0000", 2024-05-08T18:31:27.853 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 99.165961846000002, 2024-05-08T18:31:27.853 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0035019780000000002, 2024-05-08T18:31:27.853 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:27.853 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:27.854 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:27.854 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:27.854 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:27.854 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:27.854 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 60 2024-05-08T18:31:27.854 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.854 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:27.854 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.854 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:27.854 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674737+0000", 2024-05-08T18:31:27.854 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:27.854 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.855 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.855 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:27.855 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674737+0000", 2024-05-08T18:31:27.855 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:27.855 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.855 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.855 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:27.855 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674740+0000", 2024-05-08T18:31:27.855 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.36e-06 2024-05-08T18:31:27.856 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.856 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.856 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:27.856 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674753+0000", 2024-05-08T18:31:27.856 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3151e-05 2024-05-08T18:31:27.856 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.856 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.856 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:27.856 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674789+0000", 2024-05-08T18:31:27.856 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5929000000000001e-05 2024-05-08T18:31:27.856 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.857 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.857 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:27.857 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674813+0000", 2024-05-08T18:31:27.857 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3325000000000001e-05 2024-05-08T18:31:27.857 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.857 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.857 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:27.857 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674981+0000", 2024-05-08T18:31:27.857 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016879899999999999 2024-05-08T18:31:27.857 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.857 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.857 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:27.857 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.675304+0000", 2024-05-08T18:31:27.858 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00032214400000000001 2024-05-08T18:31:27.858 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.858 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.858 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-05-08T18:31:27.858 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.675639+0000", 2024-05-08T18:31:27.858 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00033494699999999999 2024-05-08T18:31:27.858 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.858 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.858 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:27.858 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.676901+0000", 2024-05-08T18:31:27.858 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001262167 2024-05-08T18:31:27.858 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.859 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.859 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:27.859 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678078+0000", 2024-05-08T18:31:27.859 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001177588 2024-05-08T18:31:27.859 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.859 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.859 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:27.859 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678171+0000", 2024-05-08T18:31:27.859 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.2331999999999996e-05 2024-05-08T18:31:27.860 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.860 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.860 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:27.860 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678239+0000", 2024-05-08T18:31:27.860 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8236000000000002e-05 2024-05-08T18:31:27.860 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:27.860 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:27.860 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:27.860 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.860 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.860 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:61 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94069412632064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:31:27.860 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:48.678410+0000", 2024-05-08T18:31:27.860 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 99.162288454000006, 2024-05-08T18:31:27.860 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0026001800000000001, 2024-05-08T18:31:27.861 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:27.861 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:27.861 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:27.861 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:27.861 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:27.861 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:27.861 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 61 2024-05-08T18:31:27.861 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.861 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:27.861 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.861 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:27.862 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678410+0000", 2024-05-08T18:31:27.862 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:27.862 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.862 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.862 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:27.862 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678410+0000", 2024-05-08T18:31:27.862 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:27.862 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.862 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.862 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:27.862 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678413+0000", 2024-05-08T18:31:27.862 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.34e-06 2024-05-08T18:31:27.863 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.863 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.863 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:27.863 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678421+0000", 2024-05-08T18:31:27.863 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6910000000000003e-06 2024-05-08T18:31:27.863 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.863 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.863 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:27.863 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678447+0000", 2024-05-08T18:31:27.863 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6010999999999999e-05 2024-05-08T18:31:27.863 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.863 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.863 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:27.864 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678461+0000", 2024-05-08T18:31:27.864 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3900000000000001e-05 2024-05-08T18:31:27.864 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.864 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.864 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:27.864 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678560+0000", 2024-05-08T18:31:27.864 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.8834999999999998e-05 2024-05-08T18:31:27.864 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.864 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.864 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:27.864 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678704+0000", 2024-05-08T18:31:27.864 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000143769 2024-05-08T18:31:27.865 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.865 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.865 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-05-08T18:31:27.865 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678942+0000", 2024-05-08T18:31:27.865 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023861800000000001 2024-05-08T18:31:27.865 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.865 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.865 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:27.865 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.680269+0000", 2024-05-08T18:31:27.865 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001326484 2024-05-08T18:31:27.865 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.865 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.866 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:27.866 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.680823+0000", 2024-05-08T18:31:27.866 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00055455900000000004 2024-05-08T18:31:27.866 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.866 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.866 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:27.866 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.680908+0000", 2024-05-08T18:31:27.866 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.4073999999999995e-05 2024-05-08T18:31:27.866 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.866 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.866 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:27.866 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.681010+0000", 2024-05-08T18:31:27.866 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010289900000000001 2024-05-08T18:31:27.867 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:27.867 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:27.867 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:27.867 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.867 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.867 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:31:27.867 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.671896+0000", 2024-05-08T18:31:27.867 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 96.168802568999993, 2024-05-08T18:31:27.867 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032352349999999999, 2024-05-08T18:31:27.867 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:27.867 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:27.867 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:27.868 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:27.868 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:27.868 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:27.868 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 206 2024-05-08T18:31:27.868 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.868 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:27.868 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.868 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:27.868 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671896+0000", 2024-05-08T18:31:27.868 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:27.868 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.868 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.868 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:27.869 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671896+0000", 2024-05-08T18:31:27.869 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:27.869 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.869 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.869 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:27.869 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671901+0000", 2024-05-08T18:31:27.869 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.763e-06 2024-05-08T18:31:27.869 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.869 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.869 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:27.869 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671920+0000", 2024-05-08T18:31:27.869 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9403e-05 2024-05-08T18:31:27.870 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.870 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.870 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:27.870 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671969+0000", 2024-05-08T18:31:27.870 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8343000000000001e-05 2024-05-08T18:31:27.870 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.870 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.870 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:27.870 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671996+0000", 2024-05-08T18:31:27.870 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7307000000000001e-05 2024-05-08T18:31:27.870 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.870 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.870 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:27.871 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.672149+0000", 2024-05-08T18:31:27.871 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015336500000000001 2024-05-08T18:31:27.871 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.871 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.871 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:27.871 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.672393+0000", 2024-05-08T18:31:27.871 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024380800000000001 2024-05-08T18:31:27.871 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.871 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.871 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-05-08T18:31:27.871 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.672838+0000", 2024-05-08T18:31:27.871 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00044472700000000001 2024-05-08T18:31:27.872 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.872 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.872 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:27.872 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.674218+0000", 2024-05-08T18:31:27.872 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001380243 2024-05-08T18:31:27.872 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.872 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.872 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:27.872 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.674963+0000", 2024-05-08T18:31:27.872 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00074534999999999998 2024-05-08T18:31:27.872 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.873 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.873 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:27.873 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675057+0000", 2024-05-08T18:31:27.873 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.3633000000000003e-05 2024-05-08T18:31:27.873 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.873 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.873 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:27.873 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675131+0000", 2024-05-08T18:31:27.873 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.4293000000000002e-05 2024-05-08T18:31:27.873 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:27.873 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:27.873 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:27.873 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.874 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.874 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:27.874 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.694194+0000", 2024-05-08T18:31:27.874 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 96.146505171000001, 2024-05-08T18:31:27.874 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0087385129999999998, 2024-05-08T18:31:27.874 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:27.874 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:27.874 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:27.874 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:27.874 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:27.874 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:27.875 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 210 2024-05-08T18:31:27.875 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.875 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:27.875 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.875 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:27.875 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694194+0000", 2024-05-08T18:31:27.875 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:27.875 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.875 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.875 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:27.875 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694194+0000", 2024-05-08T18:31:27.875 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:27.875 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.876 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.876 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:27.876 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694196+0000", 2024-05-08T18:31:27.876 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6299999999999998e-06 2024-05-08T18:31:27.876 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.876 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.876 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:27.876 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694208+0000", 2024-05-08T18:31:27.876 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.187e-05 2024-05-08T18:31:27.876 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.876 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.877 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:27.877 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694240+0000", 2024-05-08T18:31:27.877 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1673e-05 2024-05-08T18:31:27.877 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.877 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.877 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:27.877 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694255+0000", 2024-05-08T18:31:27.877 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5573000000000002e-05 2024-05-08T18:31:27.877 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.877 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.877 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:27.877 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694394+0000", 2024-05-08T18:31:27.877 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000138536 2024-05-08T18:31:27.878 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.878 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.878 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-05-08T18:31:27.878 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694405+0000", 2024-05-08T18:31:27.878 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0883000000000001e-05 2024-05-08T18:31:27.878 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.878 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.878 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:27.878 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.699491+0000", 2024-05-08T18:31:27.878 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0050861939999999996 2024-05-08T18:31:27.878 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.878 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.879 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:27.879 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.699829+0000", 2024-05-08T18:31:27.879 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000338191 2024-05-08T18:31:27.879 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.879 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.879 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:27.879 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.700504+0000", 2024-05-08T18:31:27.879 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000674481 2024-05-08T18:31:27.879 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.879 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.879 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:27.880 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.702152+0000", 2024-05-08T18:31:27.880 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0016487450000000001 2024-05-08T18:31:27.880 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.880 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.880 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:27.880 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.702792+0000", 2024-05-08T18:31:27.880 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00063962800000000005 2024-05-08T18:31:27.880 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.880 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.880 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:27.880 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.702874+0000", 2024-05-08T18:31:27.880 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.2091999999999999e-05 2024-05-08T18:31:27.881 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.881 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.881 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:27.881 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.702932+0000", 2024-05-08T18:31:27.881 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8016999999999997e-05 2024-05-08T18:31:27.881 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:27.881 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:27.881 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:27.881 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.881 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.881 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:27.881 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.728239+0000", 2024-05-08T18:31:27.881 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 96.112459310000006, 2024-05-08T18:31:27.881 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0035376119999999999, 2024-05-08T18:31:27.882 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:27.882 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:27.882 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:27.882 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:27.882 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:27.882 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:27.882 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 218 2024-05-08T18:31:27.882 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.882 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:27.882 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.882 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:27.883 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728239+0000", 2024-05-08T18:31:27.883 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:27.883 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.883 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.883 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:27.883 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728239+0000", 2024-05-08T18:31:27.883 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:27.883 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.883 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.883 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:27.883 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728242+0000", 2024-05-08T18:31:27.883 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0130000000000002e-06 2024-05-08T18:31:27.883 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.884 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.884 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:27.884 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728254+0000", 2024-05-08T18:31:27.884 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.172e-05 2024-05-08T18:31:27.884 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.884 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.884 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:27.884 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728285+0000", 2024-05-08T18:31:27.884 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0703000000000001e-05 2024-05-08T18:31:27.884 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.884 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.884 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:27.884 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728301+0000", 2024-05-08T18:31:27.885 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5656999999999999e-05 2024-05-08T18:31:27.885 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.885 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.885 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:27.885 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728460+0000", 2024-05-08T18:31:27.885 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015934200000000001 2024-05-08T18:31:27.885 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.885 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.885 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:27.885 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728803+0000", 2024-05-08T18:31:27.885 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00034267400000000001 2024-05-08T18:31:27.886 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.886 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.886 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:27.886 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.729485+0000", 2024-05-08T18:31:27.886 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00068206799999999998 2024-05-08T18:31:27.886 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.886 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.886 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:27.886 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731218+0000", 2024-05-08T18:31:27.886 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0017332630000000001 2024-05-08T18:31:27.886 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.886 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.887 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:27.887 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731615+0000", 2024-05-08T18:31:27.887 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00039671699999999999 2024-05-08T18:31:27.887 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.887 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.887 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:27.887 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731709+0000", 2024-05-08T18:31:27.887 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.4740000000000004e-05 2024-05-08T18:31:27.887 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.887 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.887 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:27.887 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731777+0000", 2024-05-08T18:31:27.888 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7714999999999998e-05 2024-05-08T18:31:27.888 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:27.888 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:27.888 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:27.888 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.888 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.888 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:27.888 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.743331+0000", 2024-05-08T18:31:27.888 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 96.097367327000001, 2024-05-08T18:31:27.888 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031193229999999998, 2024-05-08T18:31:27.888 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:27.888 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:27.888 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:27.889 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:27.889 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:27.889 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:27.889 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 222 2024-05-08T18:31:27.889 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.889 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:27.889 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.889 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:27.889 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743331+0000", 2024-05-08T18:31:27.889 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:27.889 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.889 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.889 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:27.890 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743331+0000", 2024-05-08T18:31:27.890 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:27.890 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.890 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.890 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:27.890 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743334+0000", 2024-05-08T18:31:27.890 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2900000000000001e-06 2024-05-08T18:31:27.890 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.890 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.890 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:27.890 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743345+0000", 2024-05-08T18:31:27.890 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0947e-05 2024-05-08T18:31:27.890 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.891 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.891 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:27.891 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743375+0000", 2024-05-08T18:31:27.891 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0298999999999999e-05 2024-05-08T18:31:27.891 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.891 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.891 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:27.891 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743390+0000", 2024-05-08T18:31:27.891 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4606999999999999e-05 2024-05-08T18:31:27.891 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.891 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.891 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:27.892 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743524+0000", 2024-05-08T18:31:27.892 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000134105 2024-05-08T18:31:27.892 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.892 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.892 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:27.892 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743738+0000", 2024-05-08T18:31:27.892 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000214222 2024-05-08T18:31:27.892 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.892 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.892 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:27.892 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.744159+0000", 2024-05-08T18:31:27.892 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00042102300000000002 2024-05-08T18:31:27.892 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.893 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.893 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:27.893 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.745399+0000", 2024-05-08T18:31:27.893 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012400309999999999 2024-05-08T18:31:27.893 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.893 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.893 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:27.893 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.746296+0000", 2024-05-08T18:31:27.893 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00089682 2024-05-08T18:31:27.893 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.893 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.893 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:27.893 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.746385+0000", 2024-05-08T18:31:27.894 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9289000000000005e-05 2024-05-08T18:31:27.894 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.894 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.894 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:27.894 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.746451+0000", 2024-05-08T18:31:27.894 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5690000000000003e-05 2024-05-08T18:31:27.894 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:27.894 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:27.894 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:27.894 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.894 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.894 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:27.895 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.772338+0000", 2024-05-08T18:31:27.895 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 96.068361127000003, 2024-05-08T18:31:27.895 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0035084059999999999, 2024-05-08T18:31:27.895 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:27.895 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:27.895 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:27.895 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:27.895 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:27.895 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:27.895 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 230 2024-05-08T18:31:27.895 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.895 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:27.895 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.896 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:27.896 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772338+0000", 2024-05-08T18:31:27.896 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:27.896 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.896 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.896 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:27.896 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772338+0000", 2024-05-08T18:31:27.896 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:27.896 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.896 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.896 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:27.896 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772340+0000", 2024-05-08T18:31:27.896 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3460000000000001e-06 2024-05-08T18:31:27.897 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.897 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.897 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:27.897 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772352+0000", 2024-05-08T18:31:27.897 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2284e-05 2024-05-08T18:31:27.897 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.897 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.897 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:27.897 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772382+0000", 2024-05-08T18:31:27.897 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0083e-05 2024-05-08T18:31:27.897 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.897 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.897 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:27.898 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772397+0000", 2024-05-08T18:31:27.898 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4963000000000001e-05 2024-05-08T18:31:27.898 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.898 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.898 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:27.898 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772508+0000", 2024-05-08T18:31:27.898 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000110402 2024-05-08T18:31:27.898 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.898 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.898 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:27.898 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772742+0000", 2024-05-08T18:31:27.898 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023428899999999999 2024-05-08T18:31:27.899 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.899 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.899 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:27.899 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.773183+0000", 2024-05-08T18:31:27.899 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00044107899999999998 2024-05-08T18:31:27.899 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.899 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.899 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:27.899 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.774488+0000", 2024-05-08T18:31:27.899 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0013053940000000001 2024-05-08T18:31:27.899 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.899 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.899 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:27.900 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.775689+0000", 2024-05-08T18:31:27.900 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012004699999999999 2024-05-08T18:31:27.900 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.900 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.900 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:27.900 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.775777+0000", 2024-05-08T18:31:27.900 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8483e-05 2024-05-08T18:31:27.900 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.900 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.900 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:27.900 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.775846+0000", 2024-05-08T18:31:27.900 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8613000000000002e-05 2024-05-08T18:31:27.900 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:27.900 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:27.901 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:27.901 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.901 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.901 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:27.901 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.790921+0000", 2024-05-08T18:31:27.901 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 96.049777781000003, 2024-05-08T18:31:27.901 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003116869, 2024-05-08T18:31:27.901 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:27.901 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:27.901 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:27.901 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:27.901 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:27.901 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:27.902 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 235 2024-05-08T18:31:27.902 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.902 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:27.902 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.902 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:27.902 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790921+0000", 2024-05-08T18:31:27.902 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:27.902 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.902 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.902 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:27.902 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790921+0000", 2024-05-08T18:31:27.902 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:27.903 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.903 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.903 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:27.903 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790923+0000", 2024-05-08T18:31:27.903 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3199999999999998e-06 2024-05-08T18:31:27.903 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.903 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.903 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:27.903 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790934+0000", 2024-05-08T18:31:27.903 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.117e-05 2024-05-08T18:31:27.903 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.903 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.903 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:27.903 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790965+0000", 2024-05-08T18:31:27.904 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0392999999999999e-05 2024-05-08T18:31:27.904 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.904 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.904 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:27.904 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790981+0000", 2024-05-08T18:31:27.904 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5699999999999999e-05 2024-05-08T18:31:27.904 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.904 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.904 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:27.904 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.791093+0000", 2024-05-08T18:31:27.904 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000112062 2024-05-08T18:31:27.904 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.905 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.905 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:27.905 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.791324+0000", 2024-05-08T18:31:27.905 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023142200000000001 2024-05-08T18:31:27.905 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.905 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.905 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:27.905 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.791761+0000", 2024-05-08T18:31:27.905 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00043669999999999999 2024-05-08T18:31:27.905 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.905 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.905 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:27.906 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.792996+0000", 2024-05-08T18:31:27.906 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001235713 2024-05-08T18:31:27.906 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.906 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.906 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:27.906 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.793850+0000", 2024-05-08T18:31:27.906 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00085392400000000005 2024-05-08T18:31:27.906 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.906 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.906 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:27.906 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.793971+0000", 2024-05-08T18:31:27.907 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000120516 2024-05-08T18:31:27.907 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.907 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.907 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:27.907 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794038+0000", 2024-05-08T18:31:27.907 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6948999999999999e-05 2024-05-08T18:31:27.907 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:27.907 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:27.907 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:27.907 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.907 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.907 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:349 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:27.907 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.817315+0000", 2024-05-08T18:31:27.907 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 96.023383910000007, 2024-05-08T18:31:27.908 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0036888580000000002, 2024-05-08T18:31:27.908 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:27.908 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:27.908 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:27.908 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:27.908 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:27.908 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:27.908 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 349 2024-05-08T18:31:27.908 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.908 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:27.908 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.908 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:27.908 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817315+0000", 2024-05-08T18:31:27.909 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:27.909 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.909 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.909 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:27.909 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817315+0000", 2024-05-08T18:31:27.909 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:27.909 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.909 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.909 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:27.909 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817316+0000", 2024-05-08T18:31:27.909 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3370000000000001e-06 2024-05-08T18:31:27.909 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.910 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.910 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:27.910 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817323+0000", 2024-05-08T18:31:27.910 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.4300000000000003e-06 2024-05-08T18:31:27.910 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.910 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.910 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:27.910 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817337+0000", 2024-05-08T18:31:27.910 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4025999999999999e-05 2024-05-08T18:31:27.910 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.910 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.910 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:27.910 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817345+0000", 2024-05-08T18:31:27.911 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5669999999999995e-06 2024-05-08T18:31:27.911 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.911 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.911 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:27.911 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817407+0000", 2024-05-08T18:31:27.911 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1882000000000001e-05 2024-05-08T18:31:27.911 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.911 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.911 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:27.911 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817508+0000", 2024-05-08T18:31:27.911 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000100585 2024-05-08T18:31:27.911 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.911 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.912 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:27.912 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817673+0000", 2024-05-08T18:31:27.912 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000165802 2024-05-08T18:31:27.912 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.912 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.912 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:27.912 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.818715+0000", 2024-05-08T18:31:27.912 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0010417720000000001 2024-05-08T18:31:27.912 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.912 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.912 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:27.912 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.820892+0000", 2024-05-08T18:31:27.913 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0021771859999999998 2024-05-08T18:31:27.913 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.913 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.913 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:27.913 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.820950+0000", 2024-05-08T18:31:27.913 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7636000000000002e-05 2024-05-08T18:31:27.913 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.913 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.913 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:27.913 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.821004+0000", 2024-05-08T18:31:27.913 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3634999999999997e-05 2024-05-08T18:31:27.913 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:27.913 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:27.914 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:27.914 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.914 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.914 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:406 6.16 6:6dc3b799:reshard::reshard.0000000006:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:27.914 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.840465+0000", 2024-05-08T18:31:27.914 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 96.000233743999999, 2024-05-08T18:31:27.914 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003613032, 2024-05-08T18:31:27.914 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:27.914 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:27.914 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:27.914 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:27.914 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:27.914 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:27.915 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 406 2024-05-08T18:31:27.915 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.915 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:27.915 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.915 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:27.915 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840465+0000", 2024-05-08T18:31:27.915 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:27.915 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.915 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.915 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:27.915 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840465+0000", 2024-05-08T18:31:27.915 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:27.916 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.916 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.916 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:27.916 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840466+0000", 2024-05-08T18:31:27.916 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7499999999999999e-07 2024-05-08T18:31:27.916 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.916 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.916 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:27.916 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840471+0000", 2024-05-08T18:31:27.916 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9699999999999998e-06 2024-05-08T18:31:27.916 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.916 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.916 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:27.916 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840484+0000", 2024-05-08T18:31:27.916 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2717999999999999e-05 2024-05-08T18:31:27.917 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.917 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.917 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:27.917 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840490+0000", 2024-05-08T18:31:27.917 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.472e-06 2024-05-08T18:31:27.917 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.917 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.917 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:27.917 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840536+0000", 2024-05-08T18:31:27.917 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6409000000000002e-05 2024-05-08T18:31:27.917 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.917 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.917 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:27.917 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840591+0000", 2024-05-08T18:31:27.918 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4911000000000003e-05 2024-05-08T18:31:27.918 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.918 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.918 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:27.918 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840745+0000", 2024-05-08T18:31:27.918 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015394900000000001 2024-05-08T18:31:27.918 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.918 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.918 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:27.918 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.841269+0000", 2024-05-08T18:31:27.918 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00052347299999999999 2024-05-08T18:31:27.918 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.918 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.919 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:27.919 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.843997+0000", 2024-05-08T18:31:27.919 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0027285080000000001 2024-05-08T18:31:27.919 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.919 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.919 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:27.919 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844033+0000", 2024-05-08T18:31:27.919 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6038000000000003e-05 2024-05-08T18:31:27.919 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.919 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.919 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:27.919 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844078+0000", 2024-05-08T18:31:27.920 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4709000000000002e-05 2024-05-08T18:31:27.920 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:27.920 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:27.920 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:27.920 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.920 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.920 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:413 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:27.920 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.844187+0000", 2024-05-08T18:31:27.920 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 95.996512167000006, 2024-05-08T18:31:27.920 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0024835069999999998, 2024-05-08T18:31:27.920 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:27.921 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:27.921 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:27.921 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:27.921 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:27.921 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:27.921 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 413 2024-05-08T18:31:27.921 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.921 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:27.921 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.921 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:27.921 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844187+0000", 2024-05-08T18:31:27.921 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:27.921 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.922 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.922 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:27.922 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844187+0000", 2024-05-08T18:31:27.922 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:27.922 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.922 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.922 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:27.922 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844187+0000", 2024-05-08T18:31:27.922 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9999999999999996e-07 2024-05-08T18:31:27.922 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.922 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.923 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:27.923 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844192+0000", 2024-05-08T18:31:27.923 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7899999999999999e-06 2024-05-08T18:31:27.923 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.923 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.923 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:27.923 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844203+0000", 2024-05-08T18:31:27.923 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1002000000000001e-05 2024-05-08T18:31:27.923 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.923 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.923 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:27.923 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844209+0000", 2024-05-08T18:31:27.923 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6570000000000002e-06 2024-05-08T18:31:27.924 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.924 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.924 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:27.924 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844270+0000", 2024-05-08T18:31:27.924 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0810999999999998e-05 2024-05-08T18:31:27.924 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.924 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.924 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:27.924 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844419+0000", 2024-05-08T18:31:27.924 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000149097 2024-05-08T18:31:27.924 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.924 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.924 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:27.925 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844611+0000", 2024-05-08T18:31:27.925 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00019247900000000001 2024-05-08T18:31:27.925 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.925 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.925 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:27.925 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.845287+0000", 2024-05-08T18:31:27.925 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00067526000000000001 2024-05-08T18:31:27.925 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.925 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.925 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:27.925 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.846609+0000", 2024-05-08T18:31:27.925 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001322124 2024-05-08T18:31:27.925 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.926 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.926 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:27.926 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.846642+0000", 2024-05-08T18:31:27.926 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3654e-05 2024-05-08T18:31:27.926 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.926 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.926 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:27.926 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.846670+0000", 2024-05-08T18:31:27.926 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7733e-05 2024-05-08T18:31:27.926 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:27.926 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:27.926 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:27.926 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.927 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.927 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:420 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:27.927 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.847096+0000", 2024-05-08T18:31:27.927 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 95.993602873, 2024-05-08T18:31:27.927 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0026261589999999999, 2024-05-08T18:31:27.927 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:27.927 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:27.927 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:27.927 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:27.927 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:27.927 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:27.927 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 420 2024-05-08T18:31:27.927 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.928 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:27.928 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.928 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:27.928 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847096+0000", 2024-05-08T18:31:27.928 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:27.928 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.928 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.928 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:27.928 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847096+0000", 2024-05-08T18:31:27.928 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:27.928 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.928 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.928 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:27.929 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847097+0000", 2024-05-08T18:31:27.929 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.5499999999999996e-07 2024-05-08T18:31:27.929 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.929 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.929 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:27.929 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847103+0000", 2024-05-08T18:31:27.929 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8969999999999996e-06 2024-05-08T18:31:27.929 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.929 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.929 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:27.929 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847114+0000", 2024-05-08T18:31:27.929 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1549000000000001e-05 2024-05-08T18:31:27.929 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.930 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.930 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:27.930 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847120+0000", 2024-05-08T18:31:27.930 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5509999999999999e-06 2024-05-08T18:31:27.930 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.930 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.930 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:27.930 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847166+0000", 2024-05-08T18:31:27.930 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6683e-05 2024-05-08T18:31:27.930 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.930 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.930 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:27.931 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847213+0000", 2024-05-08T18:31:27.931 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6659000000000002e-05 2024-05-08T18:31:27.931 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.931 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.931 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:27.931 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847315+0000", 2024-05-08T18:31:27.931 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000102336 2024-05-08T18:31:27.931 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.931 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.931 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:27.931 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847840+0000", 2024-05-08T18:31:27.931 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00052475000000000004 2024-05-08T18:31:27.931 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.931 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.932 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:27.932 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.849660+0000", 2024-05-08T18:31:27.932 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001819563 2024-05-08T18:31:27.932 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.932 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.932 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:27.932 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.849695+0000", 2024-05-08T18:31:27.932 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4761000000000001e-05 2024-05-08T18:31:27.932 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.932 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.932 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:27.932 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.849722+0000", 2024-05-08T18:31:27.933 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7455000000000001e-05 2024-05-08T18:31:27.933 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:27.933 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:27.933 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:27.933 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.933 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.933 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:532 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:27.933 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.908603+0000", 2024-05-08T18:31:27.933 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 95.932095322999999, 2024-05-08T18:31:27.933 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0038838950000000001, 2024-05-08T18:31:27.933 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:27.933 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:27.933 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:27.934 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:27.934 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:27.934 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:27.934 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 532 2024-05-08T18:31:27.934 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.934 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:27.934 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.934 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:27.934 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908603+0000", 2024-05-08T18:31:27.934 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:27.934 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.934 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.935 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:27.935 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908603+0000", 2024-05-08T18:31:27.935 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:27.935 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.935 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.935 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:27.935 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908605+0000", 2024-05-08T18:31:27.935 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1179999999999999e-06 2024-05-08T18:31:27.935 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.935 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.935 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:27.935 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908608+0000", 2024-05-08T18:31:27.935 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7419999999999999e-06 2024-05-08T18:31:27.936 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.936 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.936 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:27.936 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908618+0000", 2024-05-08T18:31:27.936 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.6889999999999999e-06 2024-05-08T18:31:27.936 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.936 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.936 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:27.936 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908625+0000", 2024-05-08T18:31:27.936 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1300000000000003e-06 2024-05-08T18:31:27.936 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.936 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.937 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:27.937 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908669+0000", 2024-05-08T18:31:27.937 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3832000000000003e-05 2024-05-08T18:31:27.937 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.937 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.937 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:27.937 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908724+0000", 2024-05-08T18:31:27.937 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5222000000000001e-05 2024-05-08T18:31:27.937 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.937 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.937 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:27.937 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908854+0000", 2024-05-08T18:31:27.937 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012953500000000001 2024-05-08T18:31:27.938 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.938 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.938 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:27.938 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.909511+0000", 2024-05-08T18:31:27.938 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00065768399999999996 2024-05-08T18:31:27.938 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.938 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.938 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:27.938 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912426+0000", 2024-05-08T18:31:27.938 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0029146599999999999 2024-05-08T18:31:27.938 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.938 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.939 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:27.939 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912461+0000", 2024-05-08T18:31:27.939 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4934999999999997e-05 2024-05-08T18:31:27.939 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.939 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.939 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:27.939 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912487+0000", 2024-05-08T18:31:27.939 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6347999999999999e-05 2024-05-08T18:31:27.939 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:27.939 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:27.939 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:27.939 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.940 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.940 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:534 6.9 6:9268b73e:::obj_delete_at_hint.0000000019:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:27.940 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.910153+0000", 2024-05-08T18:31:27.940 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 95.930545866000003, 2024-05-08T18:31:27.940 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0051089680000000002, 2024-05-08T18:31:27.940 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:27.940 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:27.940 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:27.940 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:27.941 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:27.941 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:27.941 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 534 2024-05-08T18:31:27.941 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.941 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:27.941 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.941 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:27.941 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910153+0000", 2024-05-08T18:31:27.941 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:27.941 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.941 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.941 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:27.941 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910153+0000", 2024-05-08T18:31:27.942 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:27.942 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.942 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.942 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:27.942 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910154+0000", 2024-05-08T18:31:27.942 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1039999999999999e-06 2024-05-08T18:31:27.942 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.942 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.942 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:27.942 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910158+0000", 2024-05-08T18:31:27.942 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7400000000000002e-06 2024-05-08T18:31:27.942 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.942 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.943 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:27.943 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910167+0000", 2024-05-08T18:31:27.943 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8880000000000003e-06 2024-05-08T18:31:27.943 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.943 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.943 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:27.943 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910173+0000", 2024-05-08T18:31:27.943 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.844e-06 2024-05-08T18:31:27.943 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.943 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.943 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:27.943 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910220+0000", 2024-05-08T18:31:27.943 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6582000000000002e-05 2024-05-08T18:31:27.944 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.944 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.944 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:27.944 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910287+0000", 2024-05-08T18:31:27.944 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7271e-05 2024-05-08T18:31:27.944 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.944 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.944 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:27.944 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910402+0000", 2024-05-08T18:31:27.944 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115127 2024-05-08T18:31:27.944 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.944 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.945 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:27.945 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910881+0000", 2024-05-08T18:31:27.945 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000479025 2024-05-08T18:31:27.945 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.945 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.945 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:27.945 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.915206+0000", 2024-05-08T18:31:27.945 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.004324357 2024-05-08T18:31:27.945 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.945 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.945 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:27.945 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.915237+0000", 2024-05-08T18:31:27.946 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1590000000000001e-05 2024-05-08T18:31:27.946 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.946 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.946 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:27.946 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.915262+0000", 2024-05-08T18:31:27.946 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.444e-05 2024-05-08T18:31:27.946 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:27.946 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:27.946 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:27.946 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.946 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.947 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:583 6.0 6:03bbb29a:::obj_delete_at_hint.0000000026:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:27.947 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.947199+0000", 2024-05-08T18:31:27.947 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 95.893499668999993, 2024-05-08T18:31:27.947 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0025081510000000001, 2024-05-08T18:31:27.947 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:27.947 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:27.947 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:27.947 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:27.947 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:27.947 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:27.947 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 583 2024-05-08T18:31:27.947 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.947 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:27.948 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.948 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:27.948 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947199+0000", 2024-05-08T18:31:27.948 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:27.948 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.948 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.948 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:27.948 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947199+0000", 2024-05-08T18:31:27.948 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:27.948 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.948 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.948 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:27.949 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947200+0000", 2024-05-08T18:31:27.949 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3799999999999997e-07 2024-05-08T18:31:27.949 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.949 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.949 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:27.949 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947207+0000", 2024-05-08T18:31:27.949 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2030000000000003e-06 2024-05-08T18:31:27.949 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.949 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.949 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:27.949 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947217+0000", 2024-05-08T18:31:27.949 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0138e-05 2024-05-08T18:31:27.949 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.950 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.950 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:27.950 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947224+0000", 2024-05-08T18:31:27.950 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5289999999999997e-06 2024-05-08T18:31:27.950 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.950 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.950 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:27.950 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.948039+0000", 2024-05-08T18:31:27.950 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00081500599999999996 2024-05-08T18:31:27.950 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.950 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.951 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:27.951 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.948230+0000", 2024-05-08T18:31:27.951 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000191838 2024-05-08T18:31:27.951 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.951 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.951 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:27.951 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.948606+0000", 2024-05-08T18:31:27.951 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00037547900000000001 2024-05-08T18:31:27.951 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.951 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.951 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:27.952 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.949406+0000", 2024-05-08T18:31:27.952 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000799674 2024-05-08T18:31:27.952 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.952 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.952 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:27.952 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.949630+0000", 2024-05-08T18:31:27.952 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00022474699999999999 2024-05-08T18:31:27.952 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.952 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.952 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:27.952 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.949664+0000", 2024-05-08T18:31:27.952 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3535999999999999e-05 2024-05-08T18:31:27.952 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.953 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.953 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:27.953 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.949707+0000", 2024-05-08T18:31:27.953 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3362999999999998e-05 2024-05-08T18:31:27.953 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:27.953 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:27.953 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:27.953 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.953 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.953 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:27.953 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.263796+0000", 2024-05-08T18:31:27.953 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 95.576902400999998, 2024-05-08T18:31:27.954 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0027788019999999999, 2024-05-08T18:31:27.954 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:27.954 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:27.954 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:27.954 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:27.954 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:27.954 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:27.954 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 811 2024-05-08T18:31:27.954 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.954 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:27.954 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.955 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:27.955 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263796+0000", 2024-05-08T18:31:27.955 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:27.955 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.955 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.955 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:27.955 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263796+0000", 2024-05-08T18:31:27.955 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:27.955 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.955 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.955 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:27.955 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263799+0000", 2024-05-08T18:31:27.955 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5569999999999998e-06 2024-05-08T18:31:27.956 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.956 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.956 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:27.956 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263812+0000", 2024-05-08T18:31:27.956 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3145999999999999e-05 2024-05-08T18:31:27.956 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.956 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.956 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:27.956 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263842+0000", 2024-05-08T18:31:27.956 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0193e-05 2024-05-08T18:31:27.956 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.956 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.956 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:27.957 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263860+0000", 2024-05-08T18:31:27.957 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7880000000000002e-05 2024-05-08T18:31:27.957 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.957 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.957 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:27.957 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263979+0000", 2024-05-08T18:31:27.957 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011919899999999999 2024-05-08T18:31:27.957 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.957 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.957 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:27.957 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.264222+0000", 2024-05-08T18:31:27.957 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024290800000000001 2024-05-08T18:31:27.958 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.958 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.958 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:27.958 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.264545+0000", 2024-05-08T18:31:27.958 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00032300200000000002 2024-05-08T18:31:27.958 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.958 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.958 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:27.958 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.265682+0000", 2024-05-08T18:31:27.958 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001136464 2024-05-08T18:31:27.958 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.958 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.958 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:27.959 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.266397+0000", 2024-05-08T18:31:27.959 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00071512799999999999 2024-05-08T18:31:27.959 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.959 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.959 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:27.959 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.266504+0000", 2024-05-08T18:31:27.959 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000107019 2024-05-08T18:31:27.959 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.959 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.959 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:27.959 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.266575+0000", 2024-05-08T18:31:27.960 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1305999999999998e-05 2024-05-08T18:31:27.960 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:27.960 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:27.960 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:27.960 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.960 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.960 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:27.960 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.445706+0000", 2024-05-08T18:31:27.960 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 95.394992685000005, 2024-05-08T18:31:27.960 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0026820630000000002, 2024-05-08T18:31:27.960 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:27.960 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:27.960 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:27.961 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:27.961 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:27.961 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:27.961 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 889 2024-05-08T18:31:27.961 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.961 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:27.961 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.961 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:27.961 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445706+0000", 2024-05-08T18:31:27.961 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:27.961 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.961 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.962 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:27.962 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445706+0000", 2024-05-08T18:31:27.962 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:27.962 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.962 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.962 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:27.962 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445709+0000", 2024-05-08T18:31:27.962 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0299999999999998e-06 2024-05-08T18:31:27.962 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.962 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.962 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:27.962 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445721+0000", 2024-05-08T18:31:27.962 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2366e-05 2024-05-08T18:31:27.963 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.963 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.963 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:27.963 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445752+0000", 2024-05-08T18:31:27.963 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0287e-05 2024-05-08T18:31:27.963 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.963 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.963 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:27.963 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445773+0000", 2024-05-08T18:31:27.963 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1367000000000001e-05 2024-05-08T18:31:27.963 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.963 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.964 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:27.964 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445892+0000", 2024-05-08T18:31:27.964 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000119311 2024-05-08T18:31:27.964 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.964 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.964 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:27.964 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.446158+0000", 2024-05-08T18:31:27.964 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000265441 2024-05-08T18:31:27.964 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.964 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.964 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:27.964 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.446465+0000", 2024-05-08T18:31:27.965 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00030754300000000002 2024-05-08T18:31:27.965 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.965 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.965 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:27.965 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.447511+0000", 2024-05-08T18:31:27.965 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001045975 2024-05-08T18:31:27.965 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.965 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.965 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:27.965 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.448171+0000", 2024-05-08T18:31:27.965 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00065971200000000002 2024-05-08T18:31:27.965 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.965 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.966 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:27.966 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.448273+0000", 2024-05-08T18:31:27.966 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000101592 2024-05-08T18:31:27.966 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.966 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.966 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:27.966 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.448388+0000", 2024-05-08T18:31:27.966 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115439 2024-05-08T18:31:27.966 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:27.966 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:27.967 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:27.967 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.967 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.967 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1020 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_add in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-05-08T18:31:27.967 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:30:21.842276+0000", 2024-05-08T18:31:27.967 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 65.998423144, 2024-05-08T18:31:27.967 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0025898760000000001, 2024-05-08T18:31:27.967 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:27.967 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:27.967 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:27.967 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:27.967 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:27.968 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:27.968 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1020 2024-05-08T18:31:27.968 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.968 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:27.968 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.968 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:27.968 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842276+0000", 2024-05-08T18:31:27.968 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:27.968 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.968 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.968 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:27.968 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842276+0000", 2024-05-08T18:31:27.968 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:27.968 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.969 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.969 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:27.969 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842278+0000", 2024-05-08T18:31:27.969 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6129999999999998e-06 2024-05-08T18:31:27.969 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.969 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.969 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:27.969 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842290+0000", 2024-05-08T18:31:27.969 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2187999999999999e-05 2024-05-08T18:31:27.969 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.969 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.970 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:27.970 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842319+0000", 2024-05-08T18:31:27.970 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8782e-05 2024-05-08T18:31:27.970 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.970 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.970 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:27.970 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842336+0000", 2024-05-08T18:31:27.970 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6826000000000001e-05 2024-05-08T18:31:27.970 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.970 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.970 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:27.970 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842450+0000", 2024-05-08T18:31:27.971 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000113829 2024-05-08T18:31:27.971 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.971 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.971 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:27.971 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842627+0000", 2024-05-08T18:31:27.971 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00017756599999999999 2024-05-08T18:31:27.971 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.971 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.971 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:27.971 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842794+0000", 2024-05-08T18:31:27.971 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000166866 2024-05-08T18:31:27.971 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.971 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.971 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:27.972 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.843540+0000", 2024-05-08T18:31:27.972 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00074611700000000003 2024-05-08T18:31:27.972 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.972 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.972 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:27.972 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.844762+0000", 2024-05-08T18:31:27.972 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012220309999999999 2024-05-08T18:31:27.972 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.972 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.972 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:27.972 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.844806+0000", 2024-05-08T18:31:27.972 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3414000000000001e-05 2024-05-08T18:31:27.973 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:27.973 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:27.973 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:27.973 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.844865+0000", 2024-05-08T18:31:27.973 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9644e-05 2024-05-08T18:31:27.973 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:27.973 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:27.973 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:27.973 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:27.973 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:27.973 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:27.974 INFO:teuthology.orchestra.run.smithi097.stderr:nodeep-scrub is set 2024-05-08T18:31:27.975 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-08T18:31:27.976 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:31:27.970+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:31:28.076 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:31:28.074+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:31:28.177 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:31:28.174+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:31:28.191 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:28.191 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:31:28.191 INFO:teuthology.orchestra.run.smithi097.stdout: "num_ops": 0 2024-05-08T18:31:28.191 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:28.209 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-08T18:31:28.278 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:31:28.278+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:31:28.379 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:31:28.374+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:31:28.418 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:28.419 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:31:28.419 INFO:teuthology.orchestra.run.smithi097.stdout: "complaint_time": 30, 2024-05-08T18:31:28.419 INFO:teuthology.orchestra.run.smithi097.stdout: "num_blocked_ops": 0 2024-05-08T18:31:28.419 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:28.436 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-08T18:31:28.480 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:31:28.478+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:31:28.581 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:31:28.578+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:31:28.651 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:28.651 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2024-05-08T18:31:28.651 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2024-05-08T18:31:28.651 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-05-08T18:31:28.651 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.651 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4479.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-05-08T18:31:28.651 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:44.576320+0000", 2024-05-08T18:31:28.651 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 104.07341942399999, 2024-05-08T18:31:28.652 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019751892, 2024-05-08T18:31:28.652 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:28.652 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:28.652 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "reached pg", 2024-05-08T18:31:28.652 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:28.652 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4479", 2024-05-08T18:31:28.652 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3577501689", 2024-05-08T18:31:28.652 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 2 2024-05-08T18:31:28.652 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.652 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:28.652 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.653 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:28.653 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576320+0000", 2024-05-08T18:31:28.653 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:28.653 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.653 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.653 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:28.653 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576320+0000", 2024-05-08T18:31:28.653 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:28.653 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.653 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.654 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:28.654 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576323+0000", 2024-05-08T18:31:28.654 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.813e-06 2024-05-08T18:31:28.654 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.654 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.654 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:28.654 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576335+0000", 2024-05-08T18:31:28.654 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2330000000000001e-05 2024-05-08T18:31:28.654 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.655 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.655 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:28.655 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576367+0000", 2024-05-08T18:31:28.655 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2036999999999998e-05 2024-05-08T18:31:28.655 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.655 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.655 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:28.655 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576394+0000", 2024-05-08T18:31:28.655 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6529e-05 2024-05-08T18:31:28.655 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.655 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.656 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:28.656 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576550+0000", 2024-05-08T18:31:28.656 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000156718 2024-05-08T18:31:28.656 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.656 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.656 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-05-08T18:31:28.656 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576560+0000", 2024-05-08T18:31:28.656 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0040999999999999e-05 2024-05-08T18:31:28.656 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.656 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.657 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:28.657 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.587240+0000", 2024-05-08T18:31:28.657 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010679266999999999 2024-05-08T18:31:28.657 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.657 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.657 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2024-05-08T18:31:28.657 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.587266+0000", 2024-05-08T18:31:28.657 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6642e-05 2024-05-08T18:31:28.657 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.657 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.658 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:28.658 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.595882+0000", 2024-05-08T18:31:28.658 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0086159600000000006 2024-05-08T18:31:28.658 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.658 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.658 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:28.658 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.596072+0000", 2024-05-08T18:31:28.658 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000189555 2024-05-08T18:31:28.658 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:28.658 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:28.658 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:28.658 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.659 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.659 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:31:28.659 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:48.766182+0000", 2024-05-08T18:31:28.659 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 99.883557397000004, 2024-05-08T18:31:28.659 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031881209999999999, 2024-05-08T18:31:28.659 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:28.659 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:28.659 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:28.659 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:28.660 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:28.660 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:28.660 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 193 2024-05-08T18:31:28.660 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.660 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:28.660 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.660 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:28.660 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766182+0000", 2024-05-08T18:31:28.660 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:28.660 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.660 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.661 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:28.661 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766182+0000", 2024-05-08T18:31:28.661 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:28.661 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.661 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.661 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:28.661 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766184+0000", 2024-05-08T18:31:28.661 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4159999999999998e-06 2024-05-08T18:31:28.661 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.661 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.661 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:28.662 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766196+0000", 2024-05-08T18:31:28.662 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1814000000000001e-05 2024-05-08T18:31:28.662 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.662 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.662 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:28.662 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766227+0000", 2024-05-08T18:31:28.662 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0676000000000002e-05 2024-05-08T18:31:28.662 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.662 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.662 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:28.663 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766242+0000", 2024-05-08T18:31:28.663 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5497000000000001e-05 2024-05-08T18:31:28.663 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.663 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.663 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:28.663 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766354+0000", 2024-05-08T18:31:28.663 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000111579 2024-05-08T18:31:28.663 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.663 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.663 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:28.663 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766569+0000", 2024-05-08T18:31:28.664 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000214978 2024-05-08T18:31:28.664 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.664 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.664 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:28.664 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766834+0000", 2024-05-08T18:31:28.664 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00026551500000000002 2024-05-08T18:31:28.664 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.664 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.664 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:28.664 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.768577+0000", 2024-05-08T18:31:28.664 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001742513 2024-05-08T18:31:28.665 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.665 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.665 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:28.665 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.769150+0000", 2024-05-08T18:31:28.665 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00057320500000000003 2024-05-08T18:31:28.665 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.665 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.665 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:28.665 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.769250+0000", 2024-05-08T18:31:28.665 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.9846000000000006e-05 2024-05-08T18:31:28.665 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.666 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.666 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:28.666 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.769370+0000", 2024-05-08T18:31:28.666 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012008200000000001 2024-05-08T18:31:28.666 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:28.666 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:28.666 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:28.666 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.666 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.666 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:28.666 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.679562+0000", 2024-05-08T18:31:28.667 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 96.970177692999997, 2024-05-08T18:31:28.667 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0086320800000000003, 2024-05-08T18:31:28.667 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:28.667 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:28.667 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:28.667 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:28.667 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:28.667 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:28.667 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 208 2024-05-08T18:31:28.667 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.667 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:28.668 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.668 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:28.668 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679562+0000", 2024-05-08T18:31:28.668 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:28.668 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.668 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.668 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:28.668 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679562+0000", 2024-05-08T18:31:28.668 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:28.668 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.668 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.669 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:28.669 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679565+0000", 2024-05-08T18:31:28.669 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0800000000000002e-06 2024-05-08T18:31:28.669 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.669 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.669 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:28.669 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679578+0000", 2024-05-08T18:31:28.669 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3217000000000001e-05 2024-05-08T18:31:28.669 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.669 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.669 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:28.669 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679610+0000", 2024-05-08T18:31:28.670 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1696000000000003e-05 2024-05-08T18:31:28.670 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.670 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.670 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:28.670 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679625+0000", 2024-05-08T18:31:28.670 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5824e-05 2024-05-08T18:31:28.670 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.670 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.670 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:28.670 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679758+0000", 2024-05-08T18:31:28.670 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013231199999999999 2024-05-08T18:31:28.671 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.671 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.671 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-05-08T18:31:28.671 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679770+0000", 2024-05-08T18:31:28.671 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1800000000000001e-05 2024-05-08T18:31:28.671 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.671 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.671 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:28.671 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.685241+0000", 2024-05-08T18:31:28.671 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0054710169999999999 2024-05-08T18:31:28.672 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.672 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.672 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:28.672 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.685444+0000", 2024-05-08T18:31:28.672 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000203835 2024-05-08T18:31:28.672 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.672 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.672 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:28.672 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.685842+0000", 2024-05-08T18:31:28.672 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00039773 2024-05-08T18:31:28.673 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.673 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.673 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:28.673 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.687232+0000", 2024-05-08T18:31:28.673 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00139011 2024-05-08T18:31:28.673 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.673 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.673 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:28.673 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.688049+0000", 2024-05-08T18:31:28.673 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00081667000000000003 2024-05-08T18:31:28.673 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.673 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.674 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:28.674 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.688135+0000", 2024-05-08T18:31:28.674 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6299999999999997e-05 2024-05-08T18:31:28.674 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.674 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.674 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:28.674 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.688194+0000", 2024-05-08T18:31:28.674 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8489000000000002e-05 2024-05-08T18:31:28.674 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:28.674 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:28.674 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:28.675 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.675 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.675 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:28.675 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.707114+0000", 2024-05-08T18:31:28.675 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 96.942625679000002, 2024-05-08T18:31:28.675 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031802990000000001, 2024-05-08T18:31:28.675 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:28.675 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:28.675 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:28.675 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:28.676 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:28.676 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:28.676 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 212 2024-05-08T18:31:28.676 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.676 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:28.676 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.676 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:28.676 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707114+0000", 2024-05-08T18:31:28.676 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:28.676 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.676 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.677 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:28.677 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707114+0000", 2024-05-08T18:31:28.677 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:28.677 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.677 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.677 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:28.677 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707117+0000", 2024-05-08T18:31:28.677 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8629999999999999e-06 2024-05-08T18:31:28.677 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.677 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.677 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:28.678 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707129+0000", 2024-05-08T18:31:28.678 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2150000000000001e-05 2024-05-08T18:31:28.678 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.678 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.678 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:28.678 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707158+0000", 2024-05-08T18:31:28.678 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9513999999999999e-05 2024-05-08T18:31:28.678 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.678 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.678 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:28.679 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707173+0000", 2024-05-08T18:31:28.679 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5136e-05 2024-05-08T18:31:28.679 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.679 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.679 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:28.679 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707309+0000", 2024-05-08T18:31:28.679 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000135609 2024-05-08T18:31:28.679 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.679 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.679 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:28.679 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707523+0000", 2024-05-08T18:31:28.680 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021362200000000001 2024-05-08T18:31:28.680 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.680 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.680 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:28.680 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707918+0000", 2024-05-08T18:31:28.680 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00039556299999999998 2024-05-08T18:31:28.680 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.680 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.680 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:28.680 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.709166+0000", 2024-05-08T18:31:28.680 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012476410000000001 2024-05-08T18:31:28.681 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.681 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.681 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:28.681 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.710145+0000", 2024-05-08T18:31:28.681 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00097909899999999998 2024-05-08T18:31:28.681 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.681 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.681 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:28.681 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.710231+0000", 2024-05-08T18:31:28.681 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5625999999999996e-05 2024-05-08T18:31:28.681 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.682 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.682 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:28.682 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.710294+0000", 2024-05-08T18:31:28.682 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3476e-05 2024-05-08T18:31:28.682 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:28.682 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:28.682 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:28.682 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.682 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.682 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:28.682 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.731985+0000", 2024-05-08T18:31:28.683 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 96.917754454000004, 2024-05-08T18:31:28.683 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0039250600000000002, 2024-05-08T18:31:28.683 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:28.683 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:28.683 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:28.683 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:28.683 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:28.683 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:28.684 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 219 2024-05-08T18:31:28.684 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.684 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:28.684 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.684 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:28.684 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731985+0000", 2024-05-08T18:31:28.684 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:28.684 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.684 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.684 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:28.684 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731985+0000", 2024-05-08T18:31:28.685 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:28.685 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.685 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.685 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:28.685 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731988+0000", 2024-05-08T18:31:28.685 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6599999999999999e-06 2024-05-08T18:31:28.685 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.685 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.685 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:28.685 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.732017+0000", 2024-05-08T18:31:28.686 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9692999999999998e-05 2024-05-08T18:31:28.686 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.686 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.686 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:28.686 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.732048+0000", 2024-05-08T18:31:28.686 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1066999999999999e-05 2024-05-08T18:31:28.686 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.686 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.686 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:28.686 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.732064+0000", 2024-05-08T18:31:28.686 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5786000000000001e-05 2024-05-08T18:31:28.686 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.687 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.687 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:28.687 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.732213+0000", 2024-05-08T18:31:28.687 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014895899999999999 2024-05-08T18:31:28.687 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.687 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.687 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:28.687 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.732572+0000", 2024-05-08T18:31:28.687 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000358904 2024-05-08T18:31:28.687 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.688 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.688 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:28.688 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.733349+0000", 2024-05-08T18:31:28.688 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00077657699999999997 2024-05-08T18:31:28.688 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.688 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.688 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:28.688 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.734899+0000", 2024-05-08T18:31:28.688 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001550652 2024-05-08T18:31:28.688 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.688 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.688 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:28.689 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.735641+0000", 2024-05-08T18:31:28.689 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00074222000000000003 2024-05-08T18:31:28.689 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.689 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.689 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:28.689 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.735801+0000", 2024-05-08T18:31:28.689 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015913599999999999 2024-05-08T18:31:28.689 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.689 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.689 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:28.690 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.735910+0000", 2024-05-08T18:31:28.690 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000109406 2024-05-08T18:31:28.690 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:28.690 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:28.690 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:28.690 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.690 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.690 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:28.690 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.750251+0000", 2024-05-08T18:31:28.691 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 96.899488521999999, 2024-05-08T18:31:28.691 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0038408600000000002, 2024-05-08T18:31:28.691 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:28.691 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:28.691 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:28.691 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:28.691 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:28.691 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:28.691 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 224 2024-05-08T18:31:28.691 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.691 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:28.692 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.692 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:28.692 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750251+0000", 2024-05-08T18:31:28.692 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:28.692 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.692 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.692 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:28.692 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750251+0000", 2024-05-08T18:31:28.692 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:28.693 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.693 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.693 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:28.693 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750253+0000", 2024-05-08T18:31:28.693 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2129999999999998e-06 2024-05-08T18:31:28.693 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.693 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.693 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:28.693 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750265+0000", 2024-05-08T18:31:28.693 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1484000000000001e-05 2024-05-08T18:31:28.694 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.694 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.694 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:28.694 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750293+0000", 2024-05-08T18:31:28.694 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8673000000000001e-05 2024-05-08T18:31:28.694 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.694 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.694 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:28.694 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750308+0000", 2024-05-08T18:31:28.694 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4620000000000001e-05 2024-05-08T18:31:28.694 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.695 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.695 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:28.695 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750459+0000", 2024-05-08T18:31:28.695 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000151619 2024-05-08T18:31:28.695 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.695 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.695 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:28.695 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750822+0000", 2024-05-08T18:31:28.695 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000362467 2024-05-08T18:31:28.695 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.695 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.696 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:28.696 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.751591+0000", 2024-05-08T18:31:28.696 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00076934699999999998 2024-05-08T18:31:28.696 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.696 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.696 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:28.696 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.753042+0000", 2024-05-08T18:31:28.696 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001450652 2024-05-08T18:31:28.696 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.696 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.696 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:28.697 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.753792+0000", 2024-05-08T18:31:28.697 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00075045500000000002 2024-05-08T18:31:28.697 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.697 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.697 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:28.697 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.753977+0000", 2024-05-08T18:31:28.697 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000184511 2024-05-08T18:31:28.697 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.697 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.697 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:28.698 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.754092+0000", 2024-05-08T18:31:28.698 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000114819 2024-05-08T18:31:28.698 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:28.698 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:28.698 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:28.698 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.698 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.698 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:28.698 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.783902+0000", 2024-05-08T18:31:28.698 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 96.865837791000004, 2024-05-08T18:31:28.698 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003120046, 2024-05-08T18:31:28.699 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:28.699 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:28.699 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:28.699 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:28.699 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:28.699 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:28.699 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 233 2024-05-08T18:31:28.699 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.699 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:28.700 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.700 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:28.700 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.783902+0000", 2024-05-08T18:31:28.700 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:28.700 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.700 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.700 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:28.700 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.783902+0000", 2024-05-08T18:31:28.700 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:28.700 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.700 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.701 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:28.701 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.783904+0000", 2024-05-08T18:31:28.701 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5229999999999998e-06 2024-05-08T18:31:28.701 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.701 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.701 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:28.701 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.783916+0000", 2024-05-08T18:31:28.701 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1513e-05 2024-05-08T18:31:28.702 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.702 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.702 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:28.702 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.783947+0000", 2024-05-08T18:31:28.702 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1353000000000003e-05 2024-05-08T18:31:28.702 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.702 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.702 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:28.702 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.783964+0000", 2024-05-08T18:31:28.702 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6643e-05 2024-05-08T18:31:28.702 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.703 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.703 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:28.703 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.784110+0000", 2024-05-08T18:31:28.703 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014627299999999999 2024-05-08T18:31:28.703 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.703 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.703 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:28.703 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.784329+0000", 2024-05-08T18:31:28.703 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021892099999999999 2024-05-08T18:31:28.703 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.703 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.704 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:28.704 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.784752+0000", 2024-05-08T18:31:28.704 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00042336700000000001 2024-05-08T18:31:28.704 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.704 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.704 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:28.704 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.786093+0000", 2024-05-08T18:31:28.704 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00134107 2024-05-08T18:31:28.704 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.704 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.704 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:28.705 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.786863+0000", 2024-05-08T18:31:28.705 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00076949099999999997 2024-05-08T18:31:28.705 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.705 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.705 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:28.705 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.786955+0000", 2024-05-08T18:31:28.705 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.2478999999999993e-05 2024-05-08T18:31:28.705 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.705 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.705 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:28.706 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.787022+0000", 2024-05-08T18:31:28.706 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6413000000000003e-05 2024-05-08T18:31:28.706 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:28.706 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:28.706 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:28.706 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.706 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.706 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:341 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:28.706 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.816045+0000", 2024-05-08T18:31:28.706 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 96.833694453999996, 2024-05-08T18:31:28.707 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002875154, 2024-05-08T18:31:28.707 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:28.707 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:28.707 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:28.707 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:28.707 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:28.707 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:28.707 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 341 2024-05-08T18:31:28.707 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.707 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:28.707 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.708 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:28.708 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816045+0000", 2024-05-08T18:31:28.708 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:28.708 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.708 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.708 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:28.708 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816045+0000", 2024-05-08T18:31:28.708 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:28.708 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.708 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.709 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:28.709 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816046+0000", 2024-05-08T18:31:28.709 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9199999999999999e-07 2024-05-08T18:31:28.709 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.709 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.709 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:28.709 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816050+0000", 2024-05-08T18:31:28.709 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0260000000000001e-06 2024-05-08T18:31:28.709 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.709 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.710 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:28.710 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816060+0000", 2024-05-08T18:31:28.710 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0297e-05 2024-05-08T18:31:28.710 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.710 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.710 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:28.710 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816065+0000", 2024-05-08T18:31:28.710 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.237e-06 2024-05-08T18:31:28.710 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.710 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.710 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:28.711 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816122+0000", 2024-05-08T18:31:28.711 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6168000000000002e-05 2024-05-08T18:31:28.711 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.711 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.711 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:28.711 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816198+0000", 2024-05-08T18:31:28.711 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6511e-05 2024-05-08T18:31:28.711 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.711 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.711 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:31:28.711 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816305+0000", 2024-05-08T18:31:28.711 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000106487 2024-05-08T18:31:28.713 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.713 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.713 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:28.714 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816886+0000", 2024-05-08T18:31:28.714 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00058187199999999999 2024-05-08T18:31:28.714 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.714 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.714 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:28.714 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.818821+0000", 2024-05-08T18:31:28.714 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001934362 2024-05-08T18:31:28.714 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.714 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.714 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:28.715 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.818880+0000", 2024-05-08T18:31:28.715 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9210999999999999e-05 2024-05-08T18:31:28.715 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.715 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.715 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:28.715 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.818920+0000", 2024-05-08T18:31:28.715 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0091e-05 2024-05-08T18:31:28.715 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:28.715 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:28.715 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:28.715 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.715 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.716 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:28.716 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.086431+0000", 2024-05-08T18:31:28.716 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 96.563308633999995, 2024-05-08T18:31:28.716 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028335959999999999, 2024-05-08T18:31:28.716 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:28.716 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:28.716 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:28.716 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:28.716 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:28.716 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:28.716 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 733 2024-05-08T18:31:28.717 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.717 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:28.717 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.717 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:28.717 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086431+0000", 2024-05-08T18:31:28.717 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:28.717 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.717 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.717 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:28.717 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086431+0000", 2024-05-08T18:31:28.717 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:28.717 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.717 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.718 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:28.718 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086433+0000", 2024-05-08T18:31:28.718 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8899999999999999e-06 2024-05-08T18:31:28.718 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.718 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.718 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:28.718 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086441+0000", 2024-05-08T18:31:28.718 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.3100000000000001e-06 2024-05-08T18:31:28.718 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.718 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.719 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:28.719 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086460+0000", 2024-05-08T18:31:28.719 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8703999999999999e-05 2024-05-08T18:31:28.719 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.719 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.719 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:28.719 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086471+0000", 2024-05-08T18:31:28.719 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1324e-05 2024-05-08T18:31:28.719 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.719 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.720 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:28.720 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086590+0000", 2024-05-08T18:31:28.720 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000118625 2024-05-08T18:31:28.720 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.720 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.720 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:28.720 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086817+0000", 2024-05-08T18:31:28.720 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000226958 2024-05-08T18:31:28.720 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.720 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.720 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:28.720 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.087131+0000", 2024-05-08T18:31:28.721 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00031478799999999998 2024-05-08T18:31:28.721 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.721 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.721 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:28.721 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.088025+0000", 2024-05-08T18:31:28.721 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00089402999999999998 2024-05-08T18:31:28.721 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.721 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.721 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:28.721 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.089123+0000", 2024-05-08T18:31:28.721 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001097598 2024-05-08T18:31:28.722 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.722 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.722 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:28.722 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.089200+0000", 2024-05-08T18:31:28.722 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7333e-05 2024-05-08T18:31:28.722 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.722 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.722 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:28.722 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.089264+0000", 2024-05-08T18:31:28.722 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.4035999999999995e-05 2024-05-08T18:31:28.723 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:28.723 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:28.723 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:28.723 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.723 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.723 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:751 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:28.723 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.125611+0000", 2024-05-08T18:31:28.723 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 96.524127942000007, 2024-05-08T18:31:28.723 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032716749999999999, 2024-05-08T18:31:28.723 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:28.723 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:28.724 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:28.724 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:28.724 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:28.724 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:28.724 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 751 2024-05-08T18:31:28.724 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.724 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:28.724 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.724 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:28.724 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125611+0000", 2024-05-08T18:31:28.724 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:28.725 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.725 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.725 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:28.725 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125611+0000", 2024-05-08T18:31:28.725 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:28.725 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.725 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.725 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:28.725 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125614+0000", 2024-05-08T18:31:28.725 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.12e-06 2024-05-08T18:31:28.726 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.726 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.726 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:28.726 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125624+0000", 2024-05-08T18:31:28.726 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0492999999999999e-05 2024-05-08T18:31:28.726 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.726 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.726 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:28.726 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125650+0000", 2024-05-08T18:31:28.726 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5907000000000001e-05 2024-05-08T18:31:28.726 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.727 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.727 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:28.727 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125667+0000", 2024-05-08T18:31:28.727 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.694e-05 2024-05-08T18:31:28.727 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.727 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.727 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:28.727 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125801+0000", 2024-05-08T18:31:28.727 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000134482 2024-05-08T18:31:28.727 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.727 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.727 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:28.728 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.126174+0000", 2024-05-08T18:31:28.728 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00037294999999999999 2024-05-08T18:31:28.728 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.728 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.728 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:28.728 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.126750+0000", 2024-05-08T18:31:28.728 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00057538900000000004 2024-05-08T18:31:28.728 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.728 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.728 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:28.728 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.127997+0000", 2024-05-08T18:31:28.729 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001247761 2024-05-08T18:31:28.729 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.729 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.729 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:28.729 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.128731+0000", 2024-05-08T18:31:28.729 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00073338099999999996 2024-05-08T18:31:28.729 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.729 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.729 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:28.729 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.128817+0000", 2024-05-08T18:31:28.729 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5993000000000002e-05 2024-05-08T18:31:28.730 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.730 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.730 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:28.730 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.128883+0000", 2024-05-08T18:31:28.730 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6259000000000004e-05 2024-05-08T18:31:28.730 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:28.730 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:28.730 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:28.730 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.730 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.730 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:753 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:28.731 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.129809+0000", 2024-05-08T18:31:28.731 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 96.519930403999993, 2024-05-08T18:31:28.731 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0033775440000000001, 2024-05-08T18:31:28.731 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:28.731 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:28.731 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:28.731 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:28.731 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:28.731 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:28.731 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 753 2024-05-08T18:31:28.731 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.732 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:28.732 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.732 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:28.732 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129809+0000", 2024-05-08T18:31:28.732 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:28.732 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.732 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.732 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:28.732 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129809+0000", 2024-05-08T18:31:28.732 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:28.733 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.733 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.733 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:28.733 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129811+0000", 2024-05-08T18:31:28.733 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1730000000000002e-06 2024-05-08T18:31:28.733 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.733 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.733 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:28.733 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129822+0000", 2024-05-08T18:31:28.733 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0583e-05 2024-05-08T18:31:28.734 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.734 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.734 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:28.734 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129852+0000", 2024-05-08T18:31:28.734 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0744000000000002e-05 2024-05-08T18:31:28.734 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.734 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.734 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:28.734 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129870+0000", 2024-05-08T18:31:28.734 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7955999999999999e-05 2024-05-08T18:31:28.734 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.735 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.735 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:28.735 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.130018+0000", 2024-05-08T18:31:28.735 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014747600000000001 2024-05-08T18:31:28.735 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.735 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.735 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:28.735 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.130259+0000", 2024-05-08T18:31:28.735 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024079099999999999 2024-05-08T18:31:28.735 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.735 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.736 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:28.736 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.130734+0000", 2024-05-08T18:31:28.736 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00047562 2024-05-08T18:31:28.736 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.736 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.736 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:28.736 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.131997+0000", 2024-05-08T18:31:28.736 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012626429999999999 2024-05-08T18:31:28.736 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.736 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.737 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:28.737 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.132923+0000", 2024-05-08T18:31:28.737 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00092627599999999997 2024-05-08T18:31:28.737 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.737 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.737 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:28.737 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.133076+0000", 2024-05-08T18:31:28.737 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000152989 2024-05-08T18:31:28.737 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.737 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.738 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:28.738 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.133187+0000", 2024-05-08T18:31:28.738 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000110293 2024-05-08T18:31:28.738 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:28.738 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:28.738 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:28.738 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.738 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.738 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:28.738 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.228247+0000", 2024-05-08T18:31:28.739 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 96.421492794000002, 2024-05-08T18:31:28.739 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032753449999999998, 2024-05-08T18:31:28.739 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:28.739 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:28.739 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:28.739 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:28.739 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:28.739 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:28.739 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 796 2024-05-08T18:31:28.740 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.740 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:28.740 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.740 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:28.740 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228247+0000", 2024-05-08T18:31:28.740 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:28.740 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.740 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.740 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:28.740 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228247+0000", 2024-05-08T18:31:28.740 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:28.741 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.741 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.741 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:28.741 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228249+0000", 2024-05-08T18:31:28.741 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3800000000000001e-06 2024-05-08T18:31:28.741 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.741 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.741 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:28.742 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228260+0000", 2024-05-08T18:31:28.742 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1496e-05 2024-05-08T18:31:28.742 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.742 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.742 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:28.742 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228292+0000", 2024-05-08T18:31:28.742 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1294000000000002e-05 2024-05-08T18:31:28.742 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.743 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.743 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:28.743 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228306+0000", 2024-05-08T18:31:28.743 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4606e-05 2024-05-08T18:31:28.743 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.743 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.743 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:28.743 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228443+0000", 2024-05-08T18:31:28.743 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013672599999999999 2024-05-08T18:31:28.744 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.744 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.744 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:28.744 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228813+0000", 2024-05-08T18:31:28.744 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00036987000000000001 2024-05-08T18:31:28.744 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.744 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.744 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:31:28.744 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.229365+0000", 2024-05-08T18:31:28.744 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00055210600000000002 2024-05-08T18:31:28.745 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.745 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.745 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:28.745 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.230800+0000", 2024-05-08T18:31:28.745 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001435006 2024-05-08T18:31:28.745 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.745 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.745 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:28.745 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.231369+0000", 2024-05-08T18:31:28.745 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00056848499999999998 2024-05-08T18:31:28.745 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.746 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.746 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:28.746 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.231455+0000", 2024-05-08T18:31:28.746 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6905999999999998e-05 2024-05-08T18:31:28.746 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.746 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.746 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:28.746 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.231522+0000", 2024-05-08T18:31:28.747 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6470000000000006e-05 2024-05-08T18:31:28.747 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:28.747 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:28.747 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:28.747 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.747 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.747 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:798 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:28.747 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.232573+0000", 2024-05-08T18:31:28.747 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 96.417166687000005, 2024-05-08T18:31:28.747 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0030406690000000002, 2024-05-08T18:31:28.747 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:28.748 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:28.748 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:28.748 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:28.748 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:28.748 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:28.748 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 798 2024-05-08T18:31:28.748 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.748 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:28.748 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.748 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:28.748 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232573+0000", 2024-05-08T18:31:28.749 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:28.749 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.749 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.749 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:28.749 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232573+0000", 2024-05-08T18:31:28.749 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:28.749 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.749 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.749 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:28.749 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232574+0000", 2024-05-08T18:31:28.749 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.446e-06 2024-05-08T18:31:28.749 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.750 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.750 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:28.750 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232581+0000", 2024-05-08T18:31:28.750 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.0670000000000003e-06 2024-05-08T18:31:28.750 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.750 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.750 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:28.750 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232600+0000", 2024-05-08T18:31:28.750 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8822999999999999e-05 2024-05-08T18:31:28.751 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.751 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.751 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:28.751 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232611+0000", 2024-05-08T18:31:28.751 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1233000000000001e-05 2024-05-08T18:31:28.751 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.751 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.751 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:28.751 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232731+0000", 2024-05-08T18:31:28.751 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000120189 2024-05-08T18:31:28.752 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.752 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.752 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:28.752 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232963+0000", 2024-05-08T18:31:28.752 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023111900000000001 2024-05-08T18:31:28.752 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.752 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.752 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:31:28.752 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.233441+0000", 2024-05-08T18:31:28.752 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00047866899999999998 2024-05-08T18:31:28.752 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.753 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.753 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:28.753 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.234542+0000", 2024-05-08T18:31:28.753 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001101245 2024-05-08T18:31:28.753 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.753 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.753 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:28.753 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.235349+0000", 2024-05-08T18:31:28.753 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000806567 2024-05-08T18:31:28.753 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.753 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.754 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:28.754 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.235498+0000", 2024-05-08T18:31:28.754 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014907200000000001 2024-05-08T18:31:28.754 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.754 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.754 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:28.754 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.235613+0000", 2024-05-08T18:31:28.754 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115239 2024-05-08T18:31:28.754 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:28.754 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:28.754 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:28.755 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.755 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.755 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:28.755 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.248596+0000", 2024-05-08T18:31:28.755 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 96.401142880999998, 2024-05-08T18:31:28.755 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002919984, 2024-05-08T18:31:28.755 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:28.755 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:28.755 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:28.755 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:28.755 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:28.756 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:28.756 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 805 2024-05-08T18:31:28.756 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.756 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:28.756 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.756 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:28.756 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248596+0000", 2024-05-08T18:31:28.756 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:28.756 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.756 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.757 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:28.757 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248596+0000", 2024-05-08T18:31:28.757 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:28.757 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.757 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.757 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:28.757 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248599+0000", 2024-05-08T18:31:28.757 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3630000000000001e-06 2024-05-08T18:31:28.757 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.757 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.757 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:28.758 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248610+0000", 2024-05-08T18:31:28.758 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1267000000000001e-05 2024-05-08T18:31:28.758 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.758 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.758 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:28.758 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248641+0000", 2024-05-08T18:31:28.758 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1309999999999997e-05 2024-05-08T18:31:28.758 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.758 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.759 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:28.759 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248656+0000", 2024-05-08T18:31:28.759 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4449e-05 2024-05-08T18:31:28.759 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.759 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.759 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:28.759 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248781+0000", 2024-05-08T18:31:28.759 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012500900000000001 2024-05-08T18:31:28.759 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.759 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.759 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:28.760 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.249001+0000", 2024-05-08T18:31:28.760 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021963500000000001 2024-05-08T18:31:28.760 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.760 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.760 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:28.760 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.249341+0000", 2024-05-08T18:31:28.760 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00034004100000000002 2024-05-08T18:31:28.760 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.760 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.760 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:28.760 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.250473+0000", 2024-05-08T18:31:28.761 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0011324180000000001 2024-05-08T18:31:28.761 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.761 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.761 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:28.761 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.251230+0000", 2024-05-08T18:31:28.761 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00075751400000000004 2024-05-08T18:31:28.761 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.761 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.761 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:28.761 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.251394+0000", 2024-05-08T18:31:28.761 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016379200000000001 2024-05-08T18:31:28.762 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.762 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.762 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:28.762 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.251516+0000", 2024-05-08T18:31:28.762 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012218600000000001 2024-05-08T18:31:28.762 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:28.762 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:28.762 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:28.762 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.762 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.763 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:28.763 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.313184+0000", 2024-05-08T18:31:28.763 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 96.336555206, 2024-05-08T18:31:28.763 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003040016, 2024-05-08T18:31:28.763 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:28.763 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:28.763 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:28.763 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:28.763 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:28.763 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:28.764 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 832 2024-05-08T18:31:28.764 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.764 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:28.764 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.764 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:28.764 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313184+0000", 2024-05-08T18:31:28.764 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:28.764 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.764 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.764 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:28.764 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313184+0000", 2024-05-08T18:31:28.765 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:28.765 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.765 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.765 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:28.765 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313187+0000", 2024-05-08T18:31:28.765 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5100000000000001e-06 2024-05-08T18:31:28.765 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.765 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.765 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:28.766 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313199+0000", 2024-05-08T18:31:28.766 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.201e-05 2024-05-08T18:31:28.766 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.766 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.766 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:28.766 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313229+0000", 2024-05-08T18:31:28.766 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9839e-05 2024-05-08T18:31:28.766 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.766 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.766 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:28.766 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313243+0000", 2024-05-08T18:31:28.767 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4727e-05 2024-05-08T18:31:28.767 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.767 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.767 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:28.767 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313358+0000", 2024-05-08T18:31:28.767 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115016 2024-05-08T18:31:28.767 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.767 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.767 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:28.768 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313577+0000", 2024-05-08T18:31:28.768 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021897799999999999 2024-05-08T18:31:28.768 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.768 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.768 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:31:28.768 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313889+0000", 2024-05-08T18:31:28.768 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00031210400000000001 2024-05-08T18:31:28.768 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.768 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.768 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:28.769 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.315229+0000", 2024-05-08T18:31:28.769 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001339963 2024-05-08T18:31:28.769 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.769 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.769 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:28.769 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.315938+0000", 2024-05-08T18:31:28.769 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00070853400000000003 2024-05-08T18:31:28.769 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.769 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.769 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:28.770 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.316111+0000", 2024-05-08T18:31:28.770 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000173396 2024-05-08T18:31:28.770 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.770 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.770 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:28.770 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.316224+0000", 2024-05-08T18:31:28.770 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000112939 2024-05-08T18:31:28.770 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:28.770 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:28.771 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:28.771 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.771 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.771 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:834 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:28.771 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.317499+0000", 2024-05-08T18:31:28.771 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 96.332240407, 2024-05-08T18:31:28.771 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0033281109999999999, 2024-05-08T18:31:28.771 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:28.771 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:28.771 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:28.771 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:28.772 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:28.772 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:28.772 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 834 2024-05-08T18:31:28.772 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.772 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:28.772 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.772 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:28.772 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317499+0000", 2024-05-08T18:31:28.772 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:28.773 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.773 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.773 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:28.773 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317499+0000", 2024-05-08T18:31:28.773 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:28.773 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.773 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.773 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:28.773 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317501+0000", 2024-05-08T18:31:28.773 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9400000000000001e-06 2024-05-08T18:31:28.773 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.774 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.774 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:28.774 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317511+0000", 2024-05-08T18:31:28.774 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0297e-05 2024-05-08T18:31:28.774 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.774 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.774 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:28.774 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317532+0000", 2024-05-08T18:31:28.774 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1013e-05 2024-05-08T18:31:28.774 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.775 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.775 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:28.775 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317543+0000", 2024-05-08T18:31:28.775 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0757000000000001e-05 2024-05-08T18:31:28.775 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.775 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.775 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:28.775 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317658+0000", 2024-05-08T18:31:28.775 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115129 2024-05-08T18:31:28.775 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.775 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.775 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:28.776 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317887+0000", 2024-05-08T18:31:28.776 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00022880099999999999 2024-05-08T18:31:28.776 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.776 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.776 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:31:28.776 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.318378+0000", 2024-05-08T18:31:28.776 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00049129000000000002 2024-05-08T18:31:28.776 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.776 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.776 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:28.777 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.319597+0000", 2024-05-08T18:31:28.777 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012188469999999999 2024-05-08T18:31:28.777 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.777 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.777 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:28.777 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.320566+0000", 2024-05-08T18:31:28.777 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00096881599999999995 2024-05-08T18:31:28.777 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.777 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.777 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:28.778 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.320713+0000", 2024-05-08T18:31:28.778 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014691500000000001 2024-05-08T18:31:28.778 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.778 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.778 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:28.778 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.320827+0000", 2024-05-08T18:31:28.778 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000114306 2024-05-08T18:31:28.778 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:28.778 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:28.778 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:28.779 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.779 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.779 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:28.779 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.505569+0000", 2024-05-08T18:31:28.779 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 96.144169954000006, 2024-05-08T18:31:28.779 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028584309999999998, 2024-05-08T18:31:28.779 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:28.779 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:28.779 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:28.779 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:28.779 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:28.780 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:28.780 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 916 2024-05-08T18:31:28.780 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.780 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:28.780 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.780 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:28.780 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505569+0000", 2024-05-08T18:31:28.780 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:28.780 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.780 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.781 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:28.781 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505569+0000", 2024-05-08T18:31:28.781 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:28.781 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.781 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.781 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:28.781 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505572+0000", 2024-05-08T18:31:28.781 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3659999999999999e-06 2024-05-08T18:31:28.781 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.782 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.782 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:28.782 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505583+0000", 2024-05-08T18:31:28.782 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1574e-05 2024-05-08T18:31:28.782 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.782 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.782 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:28.782 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505614+0000", 2024-05-08T18:31:28.782 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0670000000000003e-05 2024-05-08T18:31:28.782 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.782 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.783 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:28.783 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505629+0000", 2024-05-08T18:31:28.783 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5063e-05 2024-05-08T18:31:28.783 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.783 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.783 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:28.783 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505754+0000", 2024-05-08T18:31:28.783 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012508899999999999 2024-05-08T18:31:28.783 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.783 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.783 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:28.784 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505988+0000", 2024-05-08T18:31:28.784 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023334699999999999 2024-05-08T18:31:28.784 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.784 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.784 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:28.784 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.506299+0000", 2024-05-08T18:31:28.784 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000311811 2024-05-08T18:31:28.784 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.784 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.784 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:28.784 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.507489+0000", 2024-05-08T18:31:28.785 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0011899510000000001 2024-05-08T18:31:28.785 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.785 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.785 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:28.785 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.508141+0000", 2024-05-08T18:31:28.785 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00065180200000000005 2024-05-08T18:31:28.785 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.785 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.785 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:28.785 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.508306+0000", 2024-05-08T18:31:28.786 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016450199999999999 2024-05-08T18:31:28.786 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.786 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.786 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:28.786 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.508428+0000", 2024-05-08T18:31:28.786 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000122256 2024-05-08T18:31:28.786 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:28.786 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:28.786 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:28.786 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.787 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.787 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:918 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:28.787 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.509337+0000", 2024-05-08T18:31:28.787 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 96.140401886999996, 2024-05-08T18:31:28.787 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002971787, 2024-05-08T18:31:28.787 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:28.787 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:28.787 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:28.787 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:28.787 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:28.787 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:28.787 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 918 2024-05-08T18:31:28.788 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.788 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:28.788 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.788 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:28.788 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509337+0000", 2024-05-08T18:31:28.788 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:28.788 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.788 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.788 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:28.789 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509337+0000", 2024-05-08T18:31:28.789 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:28.789 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.789 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.789 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:28.789 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509340+0000", 2024-05-08T18:31:28.789 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2570000000000002e-06 2024-05-08T18:31:28.789 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.789 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.789 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:28.789 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509351+0000", 2024-05-08T18:31:28.789 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0933e-05 2024-05-08T18:31:28.790 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.790 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.790 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:28.790 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509382+0000", 2024-05-08T18:31:28.790 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1198999999999997e-05 2024-05-08T18:31:28.790 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.790 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.790 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:28.790 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509400+0000", 2024-05-08T18:31:28.790 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8236999999999998e-05 2024-05-08T18:31:28.791 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.791 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.791 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:28.791 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509529+0000", 2024-05-08T18:31:28.791 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012905600000000001 2024-05-08T18:31:28.791 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.791 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.791 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:28.791 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509777+0000", 2024-05-08T18:31:28.791 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024786799999999999 2024-05-08T18:31:28.792 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.792 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.792 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:28.792 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.510284+0000", 2024-05-08T18:31:28.792 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000506796 2024-05-08T18:31:28.792 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.792 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.792 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:28.792 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.511453+0000", 2024-05-08T18:31:28.792 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001169575 2024-05-08T18:31:28.792 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.793 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.793 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:28.793 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.512051+0000", 2024-05-08T18:31:28.793 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00059743100000000005 2024-05-08T18:31:28.793 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.793 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.793 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:28.793 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.512199+0000", 2024-05-08T18:31:28.793 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000148486 2024-05-08T18:31:28.793 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.794 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.794 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:28.794 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.512309+0000", 2024-05-08T18:31:28.794 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000109949 2024-05-08T18:31:28.794 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:28.794 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:28.794 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:28.794 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.794 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.794 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:931 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:28.795 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.543277+0000", 2024-05-08T18:31:28.795 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 96.106462731999997, 2024-05-08T18:31:28.795 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028250710000000002, 2024-05-08T18:31:28.795 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:28.795 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:28.795 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:28.795 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:28.795 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:28.795 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:28.795 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 931 2024-05-08T18:31:28.796 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.796 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:28.796 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.796 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:28.796 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543277+0000", 2024-05-08T18:31:28.796 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:28.796 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.796 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.796 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:28.796 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543277+0000", 2024-05-08T18:31:28.796 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:28.797 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.797 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.797 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:28.797 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543279+0000", 2024-05-08T18:31:28.797 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.373e-06 2024-05-08T18:31:28.797 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.797 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.797 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:28.797 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543291+0000", 2024-05-08T18:31:28.797 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1517e-05 2024-05-08T18:31:28.797 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.797 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.797 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:28.798 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543323+0000", 2024-05-08T18:31:28.798 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2292000000000002e-05 2024-05-08T18:31:28.798 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.798 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.798 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:28.798 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543340+0000", 2024-05-08T18:31:28.798 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.749e-05 2024-05-08T18:31:28.798 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.798 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.799 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:28.799 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543462+0000", 2024-05-08T18:31:28.799 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000121413 2024-05-08T18:31:28.799 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.799 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.799 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:28.799 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543681+0000", 2024-05-08T18:31:28.799 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021974200000000001 2024-05-08T18:31:28.799 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.799 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.800 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:31:28.800 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.544004+0000", 2024-05-08T18:31:28.800 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00032268900000000003 2024-05-08T18:31:28.800 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.800 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.800 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:28.800 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.545158+0000", 2024-05-08T18:31:28.800 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0011540190000000001 2024-05-08T18:31:28.800 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.801 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.801 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:28.801 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.545970+0000", 2024-05-08T18:31:28.801 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00081224300000000004 2024-05-08T18:31:28.801 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.801 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.801 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:28.801 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.546043+0000", 2024-05-08T18:31:28.801 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.3067999999999999e-05 2024-05-08T18:31:28.801 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.801 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.802 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:28.802 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.546102+0000", 2024-05-08T18:31:28.802 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8224999999999999e-05 2024-05-08T18:31:28.802 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:28.802 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:28.802 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:28.802 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.802 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.802 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:28.802 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.578568+0000", 2024-05-08T18:31:28.802 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 96.071171824999993, 2024-05-08T18:31:28.803 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0030345839999999999, 2024-05-08T18:31:28.803 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:28.803 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:28.803 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:28.803 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:28.803 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:28.803 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:28.803 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 946 2024-05-08T18:31:28.803 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.803 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:28.803 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.804 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:28.804 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578568+0000", 2024-05-08T18:31:28.804 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:28.804 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.804 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.804 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:28.804 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578568+0000", 2024-05-08T18:31:28.804 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:28.804 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.804 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.804 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:28.805 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578570+0000", 2024-05-08T18:31:28.805 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3700000000000002e-06 2024-05-08T18:31:28.805 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.805 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.805 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:28.805 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578582+0000", 2024-05-08T18:31:28.805 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1627000000000001e-05 2024-05-08T18:31:28.805 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.805 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.805 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:28.805 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578612+0000", 2024-05-08T18:31:28.806 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0103e-05 2024-05-08T18:31:28.806 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.806 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.806 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:28.806 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578627+0000", 2024-05-08T18:31:28.806 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4949999999999999e-05 2024-05-08T18:31:28.806 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.806 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.806 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:28.806 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578750+0000", 2024-05-08T18:31:28.806 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012309899999999999 2024-05-08T18:31:28.806 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.807 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.807 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:28.807 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.579042+0000", 2024-05-08T18:31:28.807 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00029212500000000001 2024-05-08T18:31:28.807 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.807 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.807 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:28.807 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.579557+0000", 2024-05-08T18:31:28.807 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00051536900000000001 2024-05-08T18:31:28.808 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.808 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.808 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:28.808 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.580698+0000", 2024-05-08T18:31:28.808 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001140774 2024-05-08T18:31:28.808 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.808 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.808 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:28.808 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.581367+0000", 2024-05-08T18:31:28.809 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00066884799999999999 2024-05-08T18:31:28.809 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.809 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.809 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:28.809 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.581489+0000", 2024-05-08T18:31:28.809 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012265600000000001 2024-05-08T18:31:28.809 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:28.809 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:28.809 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:28.809 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.581602+0000", 2024-05-08T18:31:28.809 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000112663 2024-05-08T18:31:28.810 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:28.810 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:28.810 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:28.810 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:28.810 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:28.810 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:28.812 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-08T18:31:28.812 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:31:28.806+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:31:28.913 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:31:28.910+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:31:28.982 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:28.982 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:31:28.982 INFO:teuthology.orchestra.run.smithi097.stdout: "num_ops": 0 2024-05-08T18:31:28.982 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:29.001 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-08T18:31:29.013 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:31:29.010+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:31:29.023 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-08T18:31:29.114 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:31:29.114+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:31:29.212 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:29.212 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:31:29.212 INFO:teuthology.orchestra.run.smithi097.stdout: "complaint_time": 30, 2024-05-08T18:31:29.212 INFO:teuthology.orchestra.run.smithi097.stdout: "num_blocked_ops": 0 2024-05-08T18:31:29.213 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:29.215 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:31:29.210+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:31:29.231 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-08T18:31:29.242 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2024-05-08T18:31:29.242 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:31:29.272 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2024-05-08T18:31:29.273 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:31:29.303 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2024-05-08T18:31:29.303 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:31:29.316 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:31:29.314+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:31:29.333 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2024-05-08T18:31:29.334 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:31:29.366 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2024-05-08T18:31:29.367 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:31:29.399 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:29.399 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:29.400 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2024-05-08T18:31:29.400 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:31:29.417 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:31:29.414+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:31:29.418 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-08T18:31:29.432 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2024-05-08T18:31:29.433 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:31:29.466 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2024-05-08T18:31:29.466 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:31:29.517 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:31:29.514+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:31:29.604 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:29.604 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:29.618 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:31:29.614+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:31:29.621 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-08T18:31:29.719 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:31:29.714+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:31:29.789 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:29.789 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:29.807 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-08T18:31:29.856 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:31:29.854+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:31:29.921 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:31:29.918+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:31:29.975 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:29.975 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:29.977 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-08T18:31:29.994 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-08T18:31:30.036 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:31:30.034+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:31:30.123 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:31:30.118+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:31:30.125 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:30.125 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:30.139 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-08T18:31:30.225 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:31:30.222+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:31:30.301 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:30.301 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:30.315 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-08T18:31:30.365 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:31:30.362+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:31:30.426 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:31:30.422+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:31:30.436 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:30.436 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:30.452 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-08T18:31:30.540 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:31:30.538+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:31:30.620 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:30.620 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:30.627 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:31:30.626+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:31:30.635 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-08T18:31:30.729 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:31:30.726+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:31:30.801 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:30.801 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:30.815 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-08T18:31:30.830 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:31:30.826+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:31:30.892 INFO:teuthology.orchestra.run.smithi097.stderr:noscrub is unset 2024-05-08T18:31:30.941 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:30.941 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:30.957 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-08T18:31:30.960 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:31:30.958+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:31:31.032 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:31:31.030+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:31:31.075 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:31.075 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:31.089 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-08T18:31:31.136 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:31:31.134+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:31:31.207 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:31.207 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:31.221 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-08T18:31:31.233 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:31:31.230+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:31:31.335 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:31:31.330+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:31:31.375 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:31.375 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:31.387 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-08T18:31:31.473 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:31:31.470+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:31:31.489 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-08T18:31:31.536 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:31:31.534+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:31:31.548 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:31.549 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:31.563 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-08T18:31:31.637 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:31:31.634+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:31:31.685 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2024-05-08T18:31:31.686 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:31:31.716 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2024-05-08T18:31:31.716 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:31:31.723 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:31.723 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:31.737 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-08T18:31:31.739 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:31:31.734+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:31:31.746 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2024-05-08T18:31:31.746 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:31:31.778 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2024-05-08T18:31:31.778 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:31:31.805 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2024-05-08T18:31:31.806 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:31:31.835 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2024-05-08T18:31:31.836 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:31:31.839 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:31:31.834+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:31:31.860 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:31.860 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:31.868 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2024-05-08T18:31:31.868 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:31:31.873 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-08T18:31:31.901 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2024-05-08T18:31:31.901 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:31:31.940 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:31:31.938+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:31:32.042 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:31:32.038+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:31:32.043 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:32.043 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:31:32.043 INFO:teuthology.orchestra.run.smithi097.stdout: "num_ops": 0 2024-05-08T18:31:32.043 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:32.061 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-08T18:31:32.143 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:31:32.138+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:31:32.219 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:32.219 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:31:32.219 INFO:teuthology.orchestra.run.smithi097.stdout: "complaint_time": 30, 2024-05-08T18:31:32.219 INFO:teuthology.orchestra.run.smithi097.stdout: "num_blocked_ops": 0 2024-05-08T18:31:32.219 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:32.233 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-08T18:31:32.244 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:31:32.242+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:31:32.345 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:31:32.342+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:31:32.346 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:32.346 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2024-05-08T18:31:32.346 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2024-05-08T18:31:32.347 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-05-08T18:31:32.347 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.347 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4206.0:24 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'14, mlcod=16'9)", 2024-05-08T18:31:32.347 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:27.162224+0000", 2024-05-08T18:31:32.347 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 125.181873717, 2024-05-08T18:31:32.347 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032712890000000001, 2024-05-08T18:31:32.347 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:32.347 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:32.347 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:32.347 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:32.347 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.347 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:32.347 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162224+0000", 2024-05-08T18:31:32.347 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:32.348 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.348 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.348 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:32.348 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162224+0000", 2024-05-08T18:31:32.348 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:32.348 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.348 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.348 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:32.348 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162225+0000", 2024-05-08T18:31:32.348 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4899999999999999e-06 2024-05-08T18:31:32.348 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.348 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.348 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:32.349 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162306+0000", 2024-05-08T18:31:32.349 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.0589999999999999e-05 2024-05-08T18:31:32.349 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.349 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.349 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:32.349 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162332+0000", 2024-05-08T18:31:32.349 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5658999999999999e-05 2024-05-08T18:31:32.349 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.349 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.349 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:32.349 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162345+0000", 2024-05-08T18:31:32.349 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3512999999999999e-05 2024-05-08T18:31:32.349 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.349 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.350 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:32.350 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162465+0000", 2024-05-08T18:31:32.350 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000119577 2024-05-08T18:31:32.350 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.350 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.350 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:32.350 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162513+0000", 2024-05-08T18:31:32.350 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8773999999999998e-05 2024-05-08T18:31:32.350 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.350 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.350 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:32.350 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.165405+0000", 2024-05-08T18:31:32.351 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028919200000000001 2024-05-08T18:31:32.351 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.351 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.351 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:32.351 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.165495+0000", 2024-05-08T18:31:32.351 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9765999999999994e-05 2024-05-08T18:31:32.351 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:32.351 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:32.351 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:32.351 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.351 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.351 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4206.0:25 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'15, mlcod=16'10)", 2024-05-08T18:31:32.351 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:27.164793+0000", 2024-05-08T18:31:32.351 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 125.179304589, 2024-05-08T18:31:32.352 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032285249999999999, 2024-05-08T18:31:32.352 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:32.352 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:32.352 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:32.352 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:32.352 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.352 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:32.352 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164793+0000", 2024-05-08T18:31:32.352 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:32.352 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.352 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.352 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:32.352 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164793+0000", 2024-05-08T18:31:32.352 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:32.353 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.353 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.353 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:32.353 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164795+0000", 2024-05-08T18:31:32.353 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0999999999999998e-06 2024-05-08T18:31:32.353 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.353 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.353 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:32.353 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164811+0000", 2024-05-08T18:31:32.353 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5722999999999998e-05 2024-05-08T18:31:32.353 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.353 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.354 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:32.354 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164841+0000", 2024-05-08T18:31:32.354 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0355999999999999e-05 2024-05-08T18:31:32.354 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.354 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.354 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:32.354 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164861+0000", 2024-05-08T18:31:32.354 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9533000000000001e-05 2024-05-08T18:31:32.354 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.354 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.354 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:32.354 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164984+0000", 2024-05-08T18:31:32.354 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000123146 2024-05-08T18:31:32.354 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.355 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.355 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:32.355 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.165024+0000", 2024-05-08T18:31:32.355 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9690000000000001e-05 2024-05-08T18:31:32.355 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.355 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.355 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:32.355 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.167935+0000", 2024-05-08T18:31:32.355 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0029113300000000002 2024-05-08T18:31:32.355 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.355 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.355 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:32.355 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.168021+0000", 2024-05-08T18:31:32.355 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6646999999999999e-05 2024-05-08T18:31:32.356 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:32.356 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:32.356 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:32.356 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.356 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.356 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:31:32.356 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:48.674737+0000", 2024-05-08T18:31:32.356 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 103.66936067100001, 2024-05-08T18:31:32.356 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0035019780000000002, 2024-05-08T18:31:32.356 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:32.356 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:32.356 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:32.356 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:32.356 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:32.357 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:32.357 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 60 2024-05-08T18:31:32.357 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.357 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:32.357 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.357 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:32.357 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674737+0000", 2024-05-08T18:31:32.357 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:32.357 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.357 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.357 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:32.357 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674737+0000", 2024-05-08T18:31:32.357 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:32.357 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.357 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.358 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:32.358 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674740+0000", 2024-05-08T18:31:32.358 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.36e-06 2024-05-08T18:31:32.358 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.358 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.358 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:32.358 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674753+0000", 2024-05-08T18:31:32.358 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3151e-05 2024-05-08T18:31:32.358 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.358 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.358 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:32.358 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674789+0000", 2024-05-08T18:31:32.358 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5929000000000001e-05 2024-05-08T18:31:32.359 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.359 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.359 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:32.359 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674813+0000", 2024-05-08T18:31:32.359 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3325000000000001e-05 2024-05-08T18:31:32.359 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.359 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.359 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:32.359 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674981+0000", 2024-05-08T18:31:32.359 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016879899999999999 2024-05-08T18:31:32.359 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.359 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.359 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:32.359 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.675304+0000", 2024-05-08T18:31:32.359 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00032214400000000001 2024-05-08T18:31:32.360 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.360 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.360 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-05-08T18:31:32.360 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.675639+0000", 2024-05-08T18:31:32.360 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00033494699999999999 2024-05-08T18:31:32.360 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.360 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.360 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:32.360 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.676901+0000", 2024-05-08T18:31:32.360 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001262167 2024-05-08T18:31:32.360 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.360 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.360 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:32.360 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678078+0000", 2024-05-08T18:31:32.361 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001177588 2024-05-08T18:31:32.361 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.361 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.361 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:32.361 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678171+0000", 2024-05-08T18:31:32.361 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.2331999999999996e-05 2024-05-08T18:31:32.361 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.361 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.361 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:32.361 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678239+0000", 2024-05-08T18:31:32.361 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8236000000000002e-05 2024-05-08T18:31:32.361 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:32.361 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:32.362 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:32.362 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.362 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.362 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:61 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94069412632064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:31:32.362 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:48.678410+0000", 2024-05-08T18:31:32.362 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 103.665687279, 2024-05-08T18:31:32.362 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0026001800000000001, 2024-05-08T18:31:32.362 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:32.362 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:32.362 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:32.362 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:32.362 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:32.362 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:32.363 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 61 2024-05-08T18:31:32.363 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.363 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:32.363 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.363 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:32.363 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678410+0000", 2024-05-08T18:31:32.363 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:32.363 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.363 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.363 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:32.363 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678410+0000", 2024-05-08T18:31:32.363 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:32.363 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.364 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.364 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:32.364 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678413+0000", 2024-05-08T18:31:32.364 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.34e-06 2024-05-08T18:31:32.364 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.364 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.364 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:32.364 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678421+0000", 2024-05-08T18:31:32.364 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6910000000000003e-06 2024-05-08T18:31:32.364 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.364 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.364 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:32.364 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678447+0000", 2024-05-08T18:31:32.364 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6010999999999999e-05 2024-05-08T18:31:32.365 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.365 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.365 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:32.365 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678461+0000", 2024-05-08T18:31:32.365 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3900000000000001e-05 2024-05-08T18:31:32.365 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.365 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.365 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:32.365 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678560+0000", 2024-05-08T18:31:32.365 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.8834999999999998e-05 2024-05-08T18:31:32.366 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.366 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.366 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:32.366 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678704+0000", 2024-05-08T18:31:32.366 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000143769 2024-05-08T18:31:32.366 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.366 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.366 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-05-08T18:31:32.366 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678942+0000", 2024-05-08T18:31:32.366 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023861800000000001 2024-05-08T18:31:32.366 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.366 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.366 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:32.367 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.680269+0000", 2024-05-08T18:31:32.367 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001326484 2024-05-08T18:31:32.367 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.367 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.367 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:32.367 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.680823+0000", 2024-05-08T18:31:32.367 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00055455900000000004 2024-05-08T18:31:32.367 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.367 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.367 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:32.367 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.680908+0000", 2024-05-08T18:31:32.368 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.4073999999999995e-05 2024-05-08T18:31:32.368 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.368 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.368 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:32.368 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.681010+0000", 2024-05-08T18:31:32.368 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010289900000000001 2024-05-08T18:31:32.368 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:32.368 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:32.368 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:32.368 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.368 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.368 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:31:32.368 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.671896+0000", 2024-05-08T18:31:32.368 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 100.672201394, 2024-05-08T18:31:32.369 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032352349999999999, 2024-05-08T18:31:32.369 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:32.369 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:32.369 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:32.369 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:32.369 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:32.369 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:32.369 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 206 2024-05-08T18:31:32.369 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.369 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:32.369 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.369 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:32.369 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671896+0000", 2024-05-08T18:31:32.369 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:32.370 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.370 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.370 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:32.370 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671896+0000", 2024-05-08T18:31:32.370 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:32.370 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.370 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.370 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:32.370 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671901+0000", 2024-05-08T18:31:32.370 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.763e-06 2024-05-08T18:31:32.370 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.370 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.371 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:32.371 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671920+0000", 2024-05-08T18:31:32.371 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9403e-05 2024-05-08T18:31:32.371 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.371 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.371 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:32.371 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671969+0000", 2024-05-08T18:31:32.371 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8343000000000001e-05 2024-05-08T18:31:32.371 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.371 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.371 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:32.371 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671996+0000", 2024-05-08T18:31:32.371 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7307000000000001e-05 2024-05-08T18:31:32.371 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.372 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.372 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:32.372 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.672149+0000", 2024-05-08T18:31:32.372 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015336500000000001 2024-05-08T18:31:32.372 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.372 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.372 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:32.372 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.672393+0000", 2024-05-08T18:31:32.372 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024380800000000001 2024-05-08T18:31:32.372 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.372 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.372 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-05-08T18:31:32.372 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.672838+0000", 2024-05-08T18:31:32.372 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00044472700000000001 2024-05-08T18:31:32.373 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.373 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.373 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:32.373 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.674218+0000", 2024-05-08T18:31:32.373 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001380243 2024-05-08T18:31:32.373 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.373 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.373 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:32.373 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.674963+0000", 2024-05-08T18:31:32.373 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00074534999999999998 2024-05-08T18:31:32.373 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.373 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.373 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:32.373 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675057+0000", 2024-05-08T18:31:32.374 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.3633000000000003e-05 2024-05-08T18:31:32.374 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.374 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.374 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:32.374 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675131+0000", 2024-05-08T18:31:32.374 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.4293000000000002e-05 2024-05-08T18:31:32.374 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:32.374 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:32.374 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:32.374 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.374 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.374 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:32.374 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.694194+0000", 2024-05-08T18:31:32.375 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 100.64990399600001, 2024-05-08T18:31:32.375 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0087385129999999998, 2024-05-08T18:31:32.375 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:32.375 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:32.375 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:32.375 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:32.375 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:32.375 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:32.375 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 210 2024-05-08T18:31:32.375 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.375 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:32.375 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.376 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:32.376 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694194+0000", 2024-05-08T18:31:32.376 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:32.376 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.376 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.376 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:32.376 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694194+0000", 2024-05-08T18:31:32.376 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:32.376 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.376 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.376 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:32.376 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694196+0000", 2024-05-08T18:31:32.376 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6299999999999998e-06 2024-05-08T18:31:32.376 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.377 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.377 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:32.377 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694208+0000", 2024-05-08T18:31:32.377 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.187e-05 2024-05-08T18:31:32.377 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.377 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.377 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:32.377 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694240+0000", 2024-05-08T18:31:32.377 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1673e-05 2024-05-08T18:31:32.377 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.377 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.377 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:32.377 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694255+0000", 2024-05-08T18:31:32.377 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5573000000000002e-05 2024-05-08T18:31:32.378 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.378 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.378 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:32.378 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694394+0000", 2024-05-08T18:31:32.378 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000138536 2024-05-08T18:31:32.378 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.378 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.378 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-05-08T18:31:32.379 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694405+0000", 2024-05-08T18:31:32.379 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0883000000000001e-05 2024-05-08T18:31:32.379 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.379 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.379 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:32.379 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.699491+0000", 2024-05-08T18:31:32.379 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0050861939999999996 2024-05-08T18:31:32.379 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.379 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.379 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:32.380 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.699829+0000", 2024-05-08T18:31:32.380 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000338191 2024-05-08T18:31:32.380 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.380 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.380 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:32.380 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.700504+0000", 2024-05-08T18:31:32.380 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000674481 2024-05-08T18:31:32.380 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.380 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.380 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:32.380 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.702152+0000", 2024-05-08T18:31:32.380 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0016487450000000001 2024-05-08T18:31:32.380 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.380 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.381 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:32.381 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.702792+0000", 2024-05-08T18:31:32.381 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00063962800000000005 2024-05-08T18:31:32.381 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.381 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.381 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:32.381 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.702874+0000", 2024-05-08T18:31:32.381 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.2091999999999999e-05 2024-05-08T18:31:32.381 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.381 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.381 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:32.381 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.702932+0000", 2024-05-08T18:31:32.381 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8016999999999997e-05 2024-05-08T18:31:32.381 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:32.382 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:32.382 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:32.382 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.382 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.382 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:32.382 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.728239+0000", 2024-05-08T18:31:32.382 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 100.615858135, 2024-05-08T18:31:32.382 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0035376119999999999, 2024-05-08T18:31:32.382 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:32.382 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:32.382 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:32.382 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:32.382 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:32.383 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:32.383 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 218 2024-05-08T18:31:32.383 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.383 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:32.383 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.383 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:32.383 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728239+0000", 2024-05-08T18:31:32.383 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:32.383 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.383 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.383 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:32.383 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728239+0000", 2024-05-08T18:31:32.383 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:32.383 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.383 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.384 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:32.384 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728242+0000", 2024-05-08T18:31:32.384 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0130000000000002e-06 2024-05-08T18:31:32.384 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.384 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.384 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:32.384 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728254+0000", 2024-05-08T18:31:32.384 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.172e-05 2024-05-08T18:31:32.384 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.384 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.384 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:32.384 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728285+0000", 2024-05-08T18:31:32.384 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0703000000000001e-05 2024-05-08T18:31:32.385 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.385 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.385 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:32.385 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728301+0000", 2024-05-08T18:31:32.385 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5656999999999999e-05 2024-05-08T18:31:32.385 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.385 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.385 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:32.385 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728460+0000", 2024-05-08T18:31:32.385 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015934200000000001 2024-05-08T18:31:32.385 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.385 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.385 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:32.385 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728803+0000", 2024-05-08T18:31:32.385 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00034267400000000001 2024-05-08T18:31:32.386 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.386 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.386 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:32.386 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.729485+0000", 2024-05-08T18:31:32.386 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00068206799999999998 2024-05-08T18:31:32.386 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.386 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.386 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:32.386 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731218+0000", 2024-05-08T18:31:32.386 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0017332630000000001 2024-05-08T18:31:32.386 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.386 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.386 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:32.387 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731615+0000", 2024-05-08T18:31:32.387 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00039671699999999999 2024-05-08T18:31:32.387 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.387 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.387 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:32.387 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731709+0000", 2024-05-08T18:31:32.387 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.4740000000000004e-05 2024-05-08T18:31:32.387 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.387 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.387 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:32.387 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731777+0000", 2024-05-08T18:31:32.387 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7714999999999998e-05 2024-05-08T18:31:32.387 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:32.387 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:32.388 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:32.388 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.388 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.388 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:32.388 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.743331+0000", 2024-05-08T18:31:32.388 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 100.60076615200001, 2024-05-08T18:31:32.388 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031193229999999998, 2024-05-08T18:31:32.388 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:32.388 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:32.388 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:32.388 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:32.388 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:32.388 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:32.388 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 222 2024-05-08T18:31:32.388 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.389 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:32.389 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.389 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:32.389 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743331+0000", 2024-05-08T18:31:32.389 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:32.389 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.389 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.389 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:32.389 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743331+0000", 2024-05-08T18:31:32.389 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:32.389 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.389 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.389 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:32.390 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743334+0000", 2024-05-08T18:31:32.390 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2900000000000001e-06 2024-05-08T18:31:32.390 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.390 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.390 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:32.390 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743345+0000", 2024-05-08T18:31:32.390 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0947e-05 2024-05-08T18:31:32.390 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.390 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.390 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:32.390 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743375+0000", 2024-05-08T18:31:32.390 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0298999999999999e-05 2024-05-08T18:31:32.390 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.390 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.391 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:32.391 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743390+0000", 2024-05-08T18:31:32.391 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4606999999999999e-05 2024-05-08T18:31:32.391 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.391 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.391 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:32.391 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743524+0000", 2024-05-08T18:31:32.391 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000134105 2024-05-08T18:31:32.391 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.391 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.391 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:32.391 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743738+0000", 2024-05-08T18:31:32.391 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000214222 2024-05-08T18:31:32.392 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.392 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.392 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:32.392 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.744159+0000", 2024-05-08T18:31:32.392 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00042102300000000002 2024-05-08T18:31:32.392 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.392 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.392 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:32.392 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.745399+0000", 2024-05-08T18:31:32.392 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012400309999999999 2024-05-08T18:31:32.392 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.392 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.392 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:32.392 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.746296+0000", 2024-05-08T18:31:32.393 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00089682 2024-05-08T18:31:32.393 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.393 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.393 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:32.393 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.746385+0000", 2024-05-08T18:31:32.393 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9289000000000005e-05 2024-05-08T18:31:32.393 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.393 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.393 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:32.393 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.746451+0000", 2024-05-08T18:31:32.393 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5690000000000003e-05 2024-05-08T18:31:32.393 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:32.393 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:32.394 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:32.394 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.394 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.394 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:32.394 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.772338+0000", 2024-05-08T18:31:32.394 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 100.57175995199999, 2024-05-08T18:31:32.394 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0035084059999999999, 2024-05-08T18:31:32.394 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:32.394 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:32.394 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:32.394 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:32.394 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:32.394 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:32.394 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 230 2024-05-08T18:31:32.395 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.395 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:32.395 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.395 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:32.398 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772338+0000", 2024-05-08T18:31:32.398 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:32.398 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.398 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.398 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:32.398 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772338+0000", 2024-05-08T18:31:32.398 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:32.398 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.398 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.398 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:32.398 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772340+0000", 2024-05-08T18:31:32.398 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3460000000000001e-06 2024-05-08T18:31:32.398 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.399 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.399 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:32.399 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772352+0000", 2024-05-08T18:31:32.399 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2284e-05 2024-05-08T18:31:32.399 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.399 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.399 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:32.399 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772382+0000", 2024-05-08T18:31:32.399 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0083e-05 2024-05-08T18:31:32.399 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.399 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.399 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:32.399 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772397+0000", 2024-05-08T18:31:32.399 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4963000000000001e-05 2024-05-08T18:31:32.399 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.400 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.400 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:32.400 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772508+0000", 2024-05-08T18:31:32.400 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000110402 2024-05-08T18:31:32.400 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.400 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.400 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:32.400 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772742+0000", 2024-05-08T18:31:32.400 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023428899999999999 2024-05-08T18:31:32.400 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.400 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.400 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:32.400 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.773183+0000", 2024-05-08T18:31:32.400 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00044107899999999998 2024-05-08T18:31:32.401 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.401 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.401 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:32.401 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.774488+0000", 2024-05-08T18:31:32.401 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0013053940000000001 2024-05-08T18:31:32.401 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.401 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.401 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:32.401 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.775689+0000", 2024-05-08T18:31:32.401 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012004699999999999 2024-05-08T18:31:32.401 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.401 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.401 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:32.402 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.775777+0000", 2024-05-08T18:31:32.402 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8483e-05 2024-05-08T18:31:32.402 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.402 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.402 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:32.402 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.775846+0000", 2024-05-08T18:31:32.402 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8613000000000002e-05 2024-05-08T18:31:32.402 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:32.402 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:32.402 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:32.402 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.402 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.402 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:32.402 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.790921+0000", 2024-05-08T18:31:32.403 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 100.55317660599999, 2024-05-08T18:31:32.403 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003116869, 2024-05-08T18:31:32.403 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:32.403 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:32.403 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:32.403 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:32.403 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:32.403 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:32.403 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 235 2024-05-08T18:31:32.403 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.403 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:32.403 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.403 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:32.403 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790921+0000", 2024-05-08T18:31:32.404 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:32.404 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.404 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.404 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:32.404 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790921+0000", 2024-05-08T18:31:32.404 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:32.404 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.404 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.404 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:32.404 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790923+0000", 2024-05-08T18:31:32.404 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3199999999999998e-06 2024-05-08T18:31:32.404 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.404 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.404 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:32.404 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790934+0000", 2024-05-08T18:31:32.405 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.117e-05 2024-05-08T18:31:32.405 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.405 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.405 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:32.405 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790965+0000", 2024-05-08T18:31:32.405 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0392999999999999e-05 2024-05-08T18:31:32.405 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.405 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.405 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:32.405 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790981+0000", 2024-05-08T18:31:32.405 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5699999999999999e-05 2024-05-08T18:31:32.405 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.405 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.405 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:32.406 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.791093+0000", 2024-05-08T18:31:32.406 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000112062 2024-05-08T18:31:32.406 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.406 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.406 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:32.406 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.791324+0000", 2024-05-08T18:31:32.406 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023142200000000001 2024-05-08T18:31:32.406 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.406 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.406 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:32.406 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.791761+0000", 2024-05-08T18:31:32.406 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00043669999999999999 2024-05-08T18:31:32.406 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.407 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.407 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:32.407 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.792996+0000", 2024-05-08T18:31:32.407 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001235713 2024-05-08T18:31:32.407 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.407 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.407 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:32.407 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.793850+0000", 2024-05-08T18:31:32.407 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00085392400000000005 2024-05-08T18:31:32.407 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.408 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.408 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:32.408 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.793971+0000", 2024-05-08T18:31:32.408 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000120516 2024-05-08T18:31:32.408 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.408 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.408 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:32.408 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794038+0000", 2024-05-08T18:31:32.408 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6948999999999999e-05 2024-05-08T18:31:32.408 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:32.408 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:32.408 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:32.408 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.408 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.409 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:349 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:32.409 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.817315+0000", 2024-05-08T18:31:32.409 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 100.526782735, 2024-05-08T18:31:32.409 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0036888580000000002, 2024-05-08T18:31:32.409 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:32.409 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:32.409 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:32.409 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:32.409 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:32.409 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:32.409 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 349 2024-05-08T18:31:32.409 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.409 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:32.410 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.410 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:32.410 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817315+0000", 2024-05-08T18:31:32.410 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:32.410 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.410 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.410 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:32.410 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817315+0000", 2024-05-08T18:31:32.410 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:32.410 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.410 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.410 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:32.410 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817316+0000", 2024-05-08T18:31:32.410 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3370000000000001e-06 2024-05-08T18:31:32.411 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.411 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.411 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:32.411 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817323+0000", 2024-05-08T18:31:32.411 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.4300000000000003e-06 2024-05-08T18:31:32.411 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.411 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.411 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:32.411 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817337+0000", 2024-05-08T18:31:32.411 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4025999999999999e-05 2024-05-08T18:31:32.411 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.411 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.411 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:32.412 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817345+0000", 2024-05-08T18:31:32.412 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5669999999999995e-06 2024-05-08T18:31:32.412 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.412 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.412 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:32.412 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817407+0000", 2024-05-08T18:31:32.412 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1882000000000001e-05 2024-05-08T18:31:32.412 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.412 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.412 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:32.412 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817508+0000", 2024-05-08T18:31:32.412 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000100585 2024-05-08T18:31:32.412 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.412 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.413 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:32.413 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817673+0000", 2024-05-08T18:31:32.413 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000165802 2024-05-08T18:31:32.413 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.413 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.413 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:32.413 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.818715+0000", 2024-05-08T18:31:32.413 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0010417720000000001 2024-05-08T18:31:32.413 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.413 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.413 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:32.413 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.820892+0000", 2024-05-08T18:31:32.413 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0021771859999999998 2024-05-08T18:31:32.414 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.414 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.414 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:32.414 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.820950+0000", 2024-05-08T18:31:32.414 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7636000000000002e-05 2024-05-08T18:31:32.414 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.414 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.414 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:32.414 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.821004+0000", 2024-05-08T18:31:32.414 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3634999999999997e-05 2024-05-08T18:31:32.414 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:32.414 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:32.414 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:32.414 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.415 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.415 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:406 6.16 6:6dc3b799:reshard::reshard.0000000006:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:32.415 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.840465+0000", 2024-05-08T18:31:32.415 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 100.503632569, 2024-05-08T18:31:32.415 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003613032, 2024-05-08T18:31:32.415 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:32.415 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:32.415 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:32.415 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:32.415 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:32.415 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:32.415 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 406 2024-05-08T18:31:32.415 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.415 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:32.416 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.416 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:32.416 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840465+0000", 2024-05-08T18:31:32.416 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:32.416 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.416 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.416 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:32.416 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840465+0000", 2024-05-08T18:31:32.416 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:32.416 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.416 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.416 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:32.416 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840466+0000", 2024-05-08T18:31:32.416 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7499999999999999e-07 2024-05-08T18:31:32.416 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.417 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.417 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:32.417 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840471+0000", 2024-05-08T18:31:32.417 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9699999999999998e-06 2024-05-08T18:31:32.417 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.417 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.417 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:32.417 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840484+0000", 2024-05-08T18:31:32.417 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2717999999999999e-05 2024-05-08T18:31:32.417 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.417 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.417 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:32.417 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840490+0000", 2024-05-08T18:31:32.417 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.472e-06 2024-05-08T18:31:32.418 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.418 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.418 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:32.418 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840536+0000", 2024-05-08T18:31:32.418 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6409000000000002e-05 2024-05-08T18:31:32.418 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.418 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.418 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:32.418 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840591+0000", 2024-05-08T18:31:32.418 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4911000000000003e-05 2024-05-08T18:31:32.418 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.418 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.418 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:32.418 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840745+0000", 2024-05-08T18:31:32.419 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015394900000000001 2024-05-08T18:31:32.419 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.419 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.419 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:32.419 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.841269+0000", 2024-05-08T18:31:32.419 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00052347299999999999 2024-05-08T18:31:32.419 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.419 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.419 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:32.419 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.843997+0000", 2024-05-08T18:31:32.419 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0027285080000000001 2024-05-08T18:31:32.419 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.419 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.419 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:32.420 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844033+0000", 2024-05-08T18:31:32.420 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6038000000000003e-05 2024-05-08T18:31:32.420 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.420 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.420 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:32.420 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844078+0000", 2024-05-08T18:31:32.420 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4709000000000002e-05 2024-05-08T18:31:32.420 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:32.420 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:32.420 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:32.420 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.420 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.420 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:413 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:32.420 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.844187+0000", 2024-05-08T18:31:32.421 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 100.499910992, 2024-05-08T18:31:32.421 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0024835069999999998, 2024-05-08T18:31:32.421 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:32.421 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:32.421 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:32.421 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:32.421 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:32.421 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:32.421 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 413 2024-05-08T18:31:32.421 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.421 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:32.421 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.421 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:32.422 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844187+0000", 2024-05-08T18:31:32.422 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:32.422 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.422 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.422 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:32.422 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844187+0000", 2024-05-08T18:31:32.422 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:32.422 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.422 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.422 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:32.422 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844187+0000", 2024-05-08T18:31:32.422 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9999999999999996e-07 2024-05-08T18:31:32.422 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.422 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.423 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:32.423 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844192+0000", 2024-05-08T18:31:32.423 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7899999999999999e-06 2024-05-08T18:31:32.423 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.423 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.423 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:32.423 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844203+0000", 2024-05-08T18:31:32.423 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1002000000000001e-05 2024-05-08T18:31:32.423 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.423 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.423 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:32.423 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844209+0000", 2024-05-08T18:31:32.423 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6570000000000002e-06 2024-05-08T18:31:32.423 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.424 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.424 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:32.424 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844270+0000", 2024-05-08T18:31:32.424 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0810999999999998e-05 2024-05-08T18:31:32.424 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.424 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.424 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:32.424 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844419+0000", 2024-05-08T18:31:32.424 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000149097 2024-05-08T18:31:32.424 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.424 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.424 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:32.424 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844611+0000", 2024-05-08T18:31:32.424 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00019247900000000001 2024-05-08T18:31:32.425 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.425 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.425 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:32.425 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.845287+0000", 2024-05-08T18:31:32.425 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00067526000000000001 2024-05-08T18:31:32.425 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.425 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.425 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:32.425 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.846609+0000", 2024-05-08T18:31:32.425 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001322124 2024-05-08T18:31:32.425 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.425 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.425 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:32.426 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.846642+0000", 2024-05-08T18:31:32.426 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3654e-05 2024-05-08T18:31:32.426 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.426 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.426 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:32.426 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.846670+0000", 2024-05-08T18:31:32.426 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7733e-05 2024-05-08T18:31:32.426 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:32.426 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:32.426 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:32.426 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.426 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.426 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:420 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:32.426 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.847096+0000", 2024-05-08T18:31:32.427 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 100.49700169800001, 2024-05-08T18:31:32.427 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0026261589999999999, 2024-05-08T18:31:32.427 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:32.427 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:32.427 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:32.427 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:32.427 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:32.427 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:32.427 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 420 2024-05-08T18:31:32.427 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.427 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:32.427 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.427 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:32.427 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847096+0000", 2024-05-08T18:31:32.428 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:32.428 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.428 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.428 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:32.428 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847096+0000", 2024-05-08T18:31:32.428 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:32.428 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.428 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.428 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:32.428 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847097+0000", 2024-05-08T18:31:32.428 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.5499999999999996e-07 2024-05-08T18:31:32.428 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.428 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.428 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:32.429 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847103+0000", 2024-05-08T18:31:32.429 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8969999999999996e-06 2024-05-08T18:31:32.429 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.429 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.429 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:32.429 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847114+0000", 2024-05-08T18:31:32.429 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1549000000000001e-05 2024-05-08T18:31:32.429 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.429 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.429 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:32.429 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847120+0000", 2024-05-08T18:31:32.429 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5509999999999999e-06 2024-05-08T18:31:32.429 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.429 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.430 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:32.430 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847166+0000", 2024-05-08T18:31:32.430 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6683e-05 2024-05-08T18:31:32.430 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.430 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.430 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:32.430 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847213+0000", 2024-05-08T18:31:32.430 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6659000000000002e-05 2024-05-08T18:31:32.430 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.430 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.430 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:32.430 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847315+0000", 2024-05-08T18:31:32.430 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000102336 2024-05-08T18:31:32.430 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.431 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.431 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:32.431 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847840+0000", 2024-05-08T18:31:32.431 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00052475000000000004 2024-05-08T18:31:32.431 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.431 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.431 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:32.431 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.849660+0000", 2024-05-08T18:31:32.431 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001819563 2024-05-08T18:31:32.431 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.431 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.431 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:32.431 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.849695+0000", 2024-05-08T18:31:32.431 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4761000000000001e-05 2024-05-08T18:31:32.432 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.432 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.432 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:32.432 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.849722+0000", 2024-05-08T18:31:32.432 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7455000000000001e-05 2024-05-08T18:31:32.432 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:32.432 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:32.432 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:32.432 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.432 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.432 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:532 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:32.432 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.908603+0000", 2024-05-08T18:31:32.432 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 100.435494148, 2024-05-08T18:31:32.432 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0038838950000000001, 2024-05-08T18:31:32.432 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:32.433 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:32.433 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:32.433 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:32.433 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:32.433 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:32.433 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 532 2024-05-08T18:31:32.433 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.433 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:32.433 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.433 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:32.433 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908603+0000", 2024-05-08T18:31:32.433 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:32.433 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.433 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.434 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:32.434 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908603+0000", 2024-05-08T18:31:32.434 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:32.434 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.434 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.434 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:32.434 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908605+0000", 2024-05-08T18:31:32.434 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1179999999999999e-06 2024-05-08T18:31:32.434 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.434 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.434 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:32.434 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908608+0000", 2024-05-08T18:31:32.434 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7419999999999999e-06 2024-05-08T18:31:32.435 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.435 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.435 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:32.435 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908618+0000", 2024-05-08T18:31:32.435 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.6889999999999999e-06 2024-05-08T18:31:32.435 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.435 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.435 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:32.435 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908625+0000", 2024-05-08T18:31:32.435 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1300000000000003e-06 2024-05-08T18:31:32.435 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.435 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.435 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:32.435 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908669+0000", 2024-05-08T18:31:32.435 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3832000000000003e-05 2024-05-08T18:31:32.436 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.436 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.436 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:32.436 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908724+0000", 2024-05-08T18:31:32.436 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5222000000000001e-05 2024-05-08T18:31:32.436 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.436 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.436 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:32.436 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908854+0000", 2024-05-08T18:31:32.436 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012953500000000001 2024-05-08T18:31:32.436 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.436 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.436 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:32.436 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.909511+0000", 2024-05-08T18:31:32.437 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00065768399999999996 2024-05-08T18:31:32.437 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.437 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.437 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:32.437 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912426+0000", 2024-05-08T18:31:32.437 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0029146599999999999 2024-05-08T18:31:32.437 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.437 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.437 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:32.437 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912461+0000", 2024-05-08T18:31:32.437 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4934999999999997e-05 2024-05-08T18:31:32.437 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.437 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.437 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:32.438 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912487+0000", 2024-05-08T18:31:32.438 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6347999999999999e-05 2024-05-08T18:31:32.438 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:32.438 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:32.438 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:32.438 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.438 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.438 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:534 6.9 6:9268b73e:::obj_delete_at_hint.0000000019:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:32.438 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.910153+0000", 2024-05-08T18:31:32.438 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 100.43394469099999, 2024-05-08T18:31:32.438 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0051089680000000002, 2024-05-08T18:31:32.438 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:32.438 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:32.439 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:32.439 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:32.439 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:32.439 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:32.439 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 534 2024-05-08T18:31:32.439 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.439 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:32.439 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.439 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:32.439 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910153+0000", 2024-05-08T18:31:32.439 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:32.439 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.439 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.439 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:32.440 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910153+0000", 2024-05-08T18:31:32.440 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:32.440 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.440 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.440 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:32.440 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910154+0000", 2024-05-08T18:31:32.440 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1039999999999999e-06 2024-05-08T18:31:32.440 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.440 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.440 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:32.440 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910158+0000", 2024-05-08T18:31:32.440 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7400000000000002e-06 2024-05-08T18:31:32.440 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.440 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.440 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:32.441 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910167+0000", 2024-05-08T18:31:32.441 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8880000000000003e-06 2024-05-08T18:31:32.441 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.441 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.441 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:32.441 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910173+0000", 2024-05-08T18:31:32.441 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.844e-06 2024-05-08T18:31:32.441 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.441 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.441 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:32.441 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910220+0000", 2024-05-08T18:31:32.441 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6582000000000002e-05 2024-05-08T18:31:32.441 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.441 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.442 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:32.442 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910287+0000", 2024-05-08T18:31:32.442 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7271e-05 2024-05-08T18:31:32.442 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.442 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.442 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:32.442 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910402+0000", 2024-05-08T18:31:32.442 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115127 2024-05-08T18:31:32.442 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.442 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.443 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:32.443 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910881+0000", 2024-05-08T18:31:32.443 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000479025 2024-05-08T18:31:32.443 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.443 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.443 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:32.443 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.915206+0000", 2024-05-08T18:31:32.443 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.004324357 2024-05-08T18:31:32.443 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.443 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.443 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:32.443 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.915237+0000", 2024-05-08T18:31:32.443 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1590000000000001e-05 2024-05-08T18:31:32.443 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.443 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.444 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:32.444 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.915262+0000", 2024-05-08T18:31:32.444 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.444e-05 2024-05-08T18:31:32.444 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:32.444 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:32.444 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:32.444 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.444 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.444 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:583 6.0 6:03bbb29a:::obj_delete_at_hint.0000000026:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:32.444 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.947199+0000", 2024-05-08T18:31:32.444 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 100.396898494, 2024-05-08T18:31:32.444 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0025081510000000001, 2024-05-08T18:31:32.444 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:32.444 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:32.445 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:32.445 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:32.445 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:32.445 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:32.445 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 583 2024-05-08T18:31:32.445 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.445 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:32.445 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.445 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:32.445 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947199+0000", 2024-05-08T18:31:32.445 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:32.445 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.445 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.445 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:32.446 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947199+0000", 2024-05-08T18:31:32.446 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:32.446 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.446 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.446 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:32.446 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947200+0000", 2024-05-08T18:31:32.446 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3799999999999997e-07 2024-05-08T18:31:32.446 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.446 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.446 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:32.446 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947207+0000", 2024-05-08T18:31:32.446 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2030000000000003e-06 2024-05-08T18:31:32.446 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.446 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.447 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:32.447 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947217+0000", 2024-05-08T18:31:32.447 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0138e-05 2024-05-08T18:31:32.447 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.447 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.447 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:32.447 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947224+0000", 2024-05-08T18:31:32.447 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5289999999999997e-06 2024-05-08T18:31:32.447 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.447 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.447 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:32.447 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.948039+0000", 2024-05-08T18:31:32.447 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00081500599999999996 2024-05-08T18:31:32.447 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.448 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.448 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:32.448 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.948230+0000", 2024-05-08T18:31:32.448 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000191838 2024-05-08T18:31:32.448 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.448 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.448 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:32.448 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.948606+0000", 2024-05-08T18:31:32.448 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00037547900000000001 2024-05-08T18:31:32.448 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.448 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.448 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:32.448 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.949406+0000", 2024-05-08T18:31:32.449 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000799674 2024-05-08T18:31:32.449 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.449 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.449 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:32.449 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.949630+0000", 2024-05-08T18:31:32.449 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00022474699999999999 2024-05-08T18:31:32.449 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.449 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.449 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:32.449 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.949664+0000", 2024-05-08T18:31:32.449 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3535999999999999e-05 2024-05-08T18:31:32.449 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.449 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.449 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:32.449 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.949707+0000", 2024-05-08T18:31:32.450 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3362999999999998e-05 2024-05-08T18:31:32.450 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:32.450 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:32.450 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:32.450 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.450 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.450 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:32.450 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.263796+0000", 2024-05-08T18:31:32.450 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 100.080301226, 2024-05-08T18:31:32.450 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0027788019999999999, 2024-05-08T18:31:32.450 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:32.450 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:32.451 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:32.451 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:32.451 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:32.451 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:32.451 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 811 2024-05-08T18:31:32.451 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.451 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:32.451 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.451 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:32.451 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263796+0000", 2024-05-08T18:31:32.451 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:32.451 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.451 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.451 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:32.452 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263796+0000", 2024-05-08T18:31:32.452 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:32.452 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.452 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.452 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:32.452 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263799+0000", 2024-05-08T18:31:32.452 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5569999999999998e-06 2024-05-08T18:31:32.452 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.452 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.452 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:32.452 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263812+0000", 2024-05-08T18:31:32.452 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3145999999999999e-05 2024-05-08T18:31:32.452 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.453 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.453 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:32.453 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263842+0000", 2024-05-08T18:31:32.453 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0193e-05 2024-05-08T18:31:32.453 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.453 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.453 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:32.453 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263860+0000", 2024-05-08T18:31:32.453 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7880000000000002e-05 2024-05-08T18:31:32.453 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.453 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.453 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:32.453 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263979+0000", 2024-05-08T18:31:32.453 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011919899999999999 2024-05-08T18:31:32.453 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.454 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.454 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:32.454 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.264222+0000", 2024-05-08T18:31:32.454 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024290800000000001 2024-05-08T18:31:32.454 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.454 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.454 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:32.454 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.264545+0000", 2024-05-08T18:31:32.454 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00032300200000000002 2024-05-08T18:31:32.454 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.454 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.454 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:32.454 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.265682+0000", 2024-05-08T18:31:32.455 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001136464 2024-05-08T18:31:32.455 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.455 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.455 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:32.455 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.266397+0000", 2024-05-08T18:31:32.455 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00071512799999999999 2024-05-08T18:31:32.455 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.455 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.455 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:32.455 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.266504+0000", 2024-05-08T18:31:32.455 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000107019 2024-05-08T18:31:32.455 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.455 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.455 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:32.456 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.266575+0000", 2024-05-08T18:31:32.456 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1305999999999998e-05 2024-05-08T18:31:32.456 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:32.456 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:32.456 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:32.456 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.456 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.456 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:32.456 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.445706+0000", 2024-05-08T18:31:32.456 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 99.898391509999996, 2024-05-08T18:31:32.456 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0026820630000000002, 2024-05-08T18:31:32.456 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:32.456 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:32.456 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:32.456 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:32.457 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:32.457 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:32.457 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 889 2024-05-08T18:31:32.457 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.457 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:32.457 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.457 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:32.457 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445706+0000", 2024-05-08T18:31:32.457 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:32.457 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.457 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.457 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:32.458 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445706+0000", 2024-05-08T18:31:32.458 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:32.458 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.458 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.458 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:32.458 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445709+0000", 2024-05-08T18:31:32.458 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0299999999999998e-06 2024-05-08T18:31:32.458 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.458 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.458 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:32.458 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445721+0000", 2024-05-08T18:31:32.458 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2366e-05 2024-05-08T18:31:32.458 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.459 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.459 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:32.459 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445752+0000", 2024-05-08T18:31:32.459 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0287e-05 2024-05-08T18:31:32.459 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.459 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.459 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:32.459 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445773+0000", 2024-05-08T18:31:32.459 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1367000000000001e-05 2024-05-08T18:31:32.459 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.459 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.459 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:32.459 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445892+0000", 2024-05-08T18:31:32.459 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000119311 2024-05-08T18:31:32.460 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.460 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.460 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:32.460 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.446158+0000", 2024-05-08T18:31:32.460 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000265441 2024-05-08T18:31:32.460 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.460 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.460 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:32.460 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.446465+0000", 2024-05-08T18:31:32.460 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00030754300000000002 2024-05-08T18:31:32.460 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.460 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.460 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:32.460 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.447511+0000", 2024-05-08T18:31:32.460 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001045975 2024-05-08T18:31:32.461 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.461 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.461 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:32.461 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.448171+0000", 2024-05-08T18:31:32.461 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00065971200000000002 2024-05-08T18:31:32.461 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.461 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.461 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:32.461 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.448273+0000", 2024-05-08T18:31:32.461 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000101592 2024-05-08T18:31:32.461 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.461 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.461 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:32.462 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.448388+0000", 2024-05-08T18:31:32.462 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115439 2024-05-08T18:31:32.462 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:32.462 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:32.462 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:32.462 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.462 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.462 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1020 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_add in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-05-08T18:31:32.462 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:30:21.842276+0000", 2024-05-08T18:31:32.462 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 70.501821969000005, 2024-05-08T18:31:32.462 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0025898760000000001, 2024-05-08T18:31:32.462 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:32.462 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:32.462 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:32.463 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:32.463 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:32.463 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:32.463 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1020 2024-05-08T18:31:32.463 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.463 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:32.463 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.463 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:32.463 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842276+0000", 2024-05-08T18:31:32.463 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:32.463 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.463 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.463 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:32.463 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842276+0000", 2024-05-08T18:31:32.464 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:32.464 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.464 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.464 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:32.464 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842278+0000", 2024-05-08T18:31:32.464 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6129999999999998e-06 2024-05-08T18:31:32.464 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.464 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.464 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:32.464 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842290+0000", 2024-05-08T18:31:32.464 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2187999999999999e-05 2024-05-08T18:31:32.464 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.464 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.464 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:32.465 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842319+0000", 2024-05-08T18:31:32.465 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8782e-05 2024-05-08T18:31:32.465 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.465 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.465 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:32.465 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842336+0000", 2024-05-08T18:31:32.465 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6826000000000001e-05 2024-05-08T18:31:32.465 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.465 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.465 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:32.465 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842450+0000", 2024-05-08T18:31:32.465 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000113829 2024-05-08T18:31:32.465 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.466 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.466 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:32.466 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842627+0000", 2024-05-08T18:31:32.466 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00017756599999999999 2024-05-08T18:31:32.466 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.466 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.466 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:32.466 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842794+0000", 2024-05-08T18:31:32.466 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000166866 2024-05-08T18:31:32.466 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.466 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.466 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:32.466 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.843540+0000", 2024-05-08T18:31:32.466 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00074611700000000003 2024-05-08T18:31:32.467 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.467 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.467 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:32.467 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.844762+0000", 2024-05-08T18:31:32.467 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012220309999999999 2024-05-08T18:31:32.467 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.467 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.467 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:32.467 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.844806+0000", 2024-05-08T18:31:32.467 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3414000000000001e-05 2024-05-08T18:31:32.467 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.467 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.467 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:32.467 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.844865+0000", 2024-05-08T18:31:32.468 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9644e-05 2024-05-08T18:31:32.468 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:32.468 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:32.468 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:32.468 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:32.468 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:32.468 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:32.470 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-08T18:31:32.471 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:31:32.470+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:31:32.570 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:31:32.566+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:31:32.587 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:32.587 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:31:32.587 INFO:teuthology.orchestra.run.smithi097.stdout: "num_ops": 0 2024-05-08T18:31:32.588 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:32.602 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-08T18:31:32.672 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:31:32.666+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:31:32.719 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:32.720 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:31:32.720 INFO:teuthology.orchestra.run.smithi097.stdout: "complaint_time": 30, 2024-05-08T18:31:32.720 INFO:teuthology.orchestra.run.smithi097.stdout: "num_blocked_ops": 0 2024-05-08T18:31:32.720 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:32.734 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-08T18:31:32.780 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:31:32.778+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:31:32.851 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:32.852 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2024-05-08T18:31:32.852 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2024-05-08T18:31:32.852 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-05-08T18:31:32.852 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.852 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4479.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-05-08T18:31:32.852 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:44.576320+0000", 2024-05-08T18:31:32.852 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 108.272871232, 2024-05-08T18:31:32.852 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019751892, 2024-05-08T18:31:32.852 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:32.852 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:32.852 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "reached pg", 2024-05-08T18:31:32.853 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:32.853 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4479", 2024-05-08T18:31:32.853 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3577501689", 2024-05-08T18:31:32.853 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 2 2024-05-08T18:31:32.853 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.853 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:32.853 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.853 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:32.853 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576320+0000", 2024-05-08T18:31:32.853 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:32.853 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.853 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.853 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:32.853 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576320+0000", 2024-05-08T18:31:32.853 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:32.854 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.854 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.854 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:32.854 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576323+0000", 2024-05-08T18:31:32.854 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.813e-06 2024-05-08T18:31:32.854 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.854 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.854 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:32.854 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576335+0000", 2024-05-08T18:31:32.854 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2330000000000001e-05 2024-05-08T18:31:32.854 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.855 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.855 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:32.855 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576367+0000", 2024-05-08T18:31:32.855 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2036999999999998e-05 2024-05-08T18:31:32.855 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.855 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.855 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:32.855 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576394+0000", 2024-05-08T18:31:32.855 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6529e-05 2024-05-08T18:31:32.855 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.855 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.855 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:32.855 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576550+0000", 2024-05-08T18:31:32.855 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000156718 2024-05-08T18:31:32.856 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.856 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.856 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-05-08T18:31:32.856 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576560+0000", 2024-05-08T18:31:32.856 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0040999999999999e-05 2024-05-08T18:31:32.856 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.856 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.856 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:32.856 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.587240+0000", 2024-05-08T18:31:32.856 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010679266999999999 2024-05-08T18:31:32.856 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.856 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.856 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2024-05-08T18:31:32.857 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.587266+0000", 2024-05-08T18:31:32.857 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6642e-05 2024-05-08T18:31:32.857 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.857 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.857 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:32.857 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.595882+0000", 2024-05-08T18:31:32.857 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0086159600000000006 2024-05-08T18:31:32.857 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.857 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.857 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:32.857 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.596072+0000", 2024-05-08T18:31:32.857 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000189555 2024-05-08T18:31:32.857 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:32.858 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:32.858 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:32.858 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.858 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.858 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:31:32.858 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:48.766182+0000", 2024-05-08T18:31:32.858 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 104.083009205, 2024-05-08T18:31:32.858 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031881209999999999, 2024-05-08T18:31:32.858 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:32.858 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:32.858 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:32.858 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:32.858 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:32.859 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:32.859 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 193 2024-05-08T18:31:32.859 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.859 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:32.859 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.859 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:32.859 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766182+0000", 2024-05-08T18:31:32.859 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:32.859 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.859 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.859 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:32.859 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766182+0000", 2024-05-08T18:31:32.859 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:32.860 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.860 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.860 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:32.860 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766184+0000", 2024-05-08T18:31:32.860 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4159999999999998e-06 2024-05-08T18:31:32.860 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.860 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.860 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:32.860 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766196+0000", 2024-05-08T18:31:32.860 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1814000000000001e-05 2024-05-08T18:31:32.860 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.860 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.860 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:32.860 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766227+0000", 2024-05-08T18:31:32.861 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0676000000000002e-05 2024-05-08T18:31:32.861 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.861 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.861 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:32.861 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766242+0000", 2024-05-08T18:31:32.861 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5497000000000001e-05 2024-05-08T18:31:32.861 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.861 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.861 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:32.861 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766354+0000", 2024-05-08T18:31:32.861 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000111579 2024-05-08T18:31:32.861 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.861 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.861 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:32.862 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766569+0000", 2024-05-08T18:31:32.862 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000214978 2024-05-08T18:31:32.862 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.862 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.862 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:32.862 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766834+0000", 2024-05-08T18:31:32.862 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00026551500000000002 2024-05-08T18:31:32.862 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.862 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.862 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:32.862 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.768577+0000", 2024-05-08T18:31:32.862 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001742513 2024-05-08T18:31:32.862 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.862 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.863 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:32.863 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.769150+0000", 2024-05-08T18:31:32.863 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00057320500000000003 2024-05-08T18:31:32.863 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.863 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.863 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:32.863 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.769250+0000", 2024-05-08T18:31:32.863 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.9846000000000006e-05 2024-05-08T18:31:32.863 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.863 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.863 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:32.863 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.769370+0000", 2024-05-08T18:31:32.863 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012008200000000001 2024-05-08T18:31:32.863 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:32.863 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:32.864 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:32.864 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.864 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.864 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:32.864 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.679562+0000", 2024-05-08T18:31:32.864 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 101.169629501, 2024-05-08T18:31:32.864 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0086320800000000003, 2024-05-08T18:31:32.864 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:32.864 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:32.864 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:32.864 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:32.864 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:32.864 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:32.864 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 208 2024-05-08T18:31:32.865 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.865 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:32.865 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.865 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:32.865 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679562+0000", 2024-05-08T18:31:32.865 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:32.865 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.865 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.865 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:32.865 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679562+0000", 2024-05-08T18:31:32.865 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:32.865 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.865 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.866 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:32.866 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679565+0000", 2024-05-08T18:31:32.866 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0800000000000002e-06 2024-05-08T18:31:32.866 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.866 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.866 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:32.866 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679578+0000", 2024-05-08T18:31:32.866 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3217000000000001e-05 2024-05-08T18:31:32.866 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.866 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.866 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:32.866 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679610+0000", 2024-05-08T18:31:32.867 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1696000000000003e-05 2024-05-08T18:31:32.867 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.867 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.867 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:32.867 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679625+0000", 2024-05-08T18:31:32.867 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5824e-05 2024-05-08T18:31:32.867 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.867 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.867 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:32.867 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679758+0000", 2024-05-08T18:31:32.867 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013231199999999999 2024-05-08T18:31:32.867 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.867 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.868 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-05-08T18:31:32.868 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679770+0000", 2024-05-08T18:31:32.868 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1800000000000001e-05 2024-05-08T18:31:32.868 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.868 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.868 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:32.868 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.685241+0000", 2024-05-08T18:31:32.868 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0054710169999999999 2024-05-08T18:31:32.868 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.868 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.868 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:32.868 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.685444+0000", 2024-05-08T18:31:32.868 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000203835 2024-05-08T18:31:32.869 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.869 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.869 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:32.869 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.685842+0000", 2024-05-08T18:31:32.869 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00039773 2024-05-08T18:31:32.869 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.869 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.869 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:32.869 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.687232+0000", 2024-05-08T18:31:32.869 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00139011 2024-05-08T18:31:32.869 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.869 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.869 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:32.870 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.688049+0000", 2024-05-08T18:31:32.870 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00081667000000000003 2024-05-08T18:31:32.870 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.870 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.870 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:32.870 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.688135+0000", 2024-05-08T18:31:32.870 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6299999999999997e-05 2024-05-08T18:31:32.870 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.870 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.870 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:32.870 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.688194+0000", 2024-05-08T18:31:32.870 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8489000000000002e-05 2024-05-08T18:31:32.871 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:32.871 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:32.871 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:32.871 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.871 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.871 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:32.871 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.707114+0000", 2024-05-08T18:31:32.871 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 101.14207748699999, 2024-05-08T18:31:32.871 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031802990000000001, 2024-05-08T18:31:32.871 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:32.871 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:32.871 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:32.871 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:32.871 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:32.872 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:32.872 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 212 2024-05-08T18:31:32.872 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.872 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:32.872 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.872 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:32.872 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707114+0000", 2024-05-08T18:31:32.872 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:32.872 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.872 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.872 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:32.872 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707114+0000", 2024-05-08T18:31:32.872 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:32.873 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.873 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.873 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:32.873 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707117+0000", 2024-05-08T18:31:32.873 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8629999999999999e-06 2024-05-08T18:31:32.873 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.873 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.873 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:32.873 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707129+0000", 2024-05-08T18:31:32.873 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2150000000000001e-05 2024-05-08T18:31:32.873 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.873 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.873 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:32.873 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707158+0000", 2024-05-08T18:31:32.874 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9513999999999999e-05 2024-05-08T18:31:32.874 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.874 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.874 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:32.874 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707173+0000", 2024-05-08T18:31:32.874 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5136e-05 2024-05-08T18:31:32.874 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.874 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.874 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:32.874 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707309+0000", 2024-05-08T18:31:32.874 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000135609 2024-05-08T18:31:32.874 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.874 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.875 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:32.875 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707523+0000", 2024-05-08T18:31:32.875 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021362200000000001 2024-05-08T18:31:32.875 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.875 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.875 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:32.875 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707918+0000", 2024-05-08T18:31:32.875 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00039556299999999998 2024-05-08T18:31:32.875 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.875 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.875 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:32.875 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.709166+0000", 2024-05-08T18:31:32.875 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012476410000000001 2024-05-08T18:31:32.875 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.875 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.876 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:32.876 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.710145+0000", 2024-05-08T18:31:32.876 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00097909899999999998 2024-05-08T18:31:32.876 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.876 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.876 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:32.876 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.710231+0000", 2024-05-08T18:31:32.876 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5625999999999996e-05 2024-05-08T18:31:32.876 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.876 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.876 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:32.876 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.710294+0000", 2024-05-08T18:31:32.876 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3476e-05 2024-05-08T18:31:32.876 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:32.876 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:32.877 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:32.877 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.877 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.877 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:32.877 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.731985+0000", 2024-05-08T18:31:32.877 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 101.117206262, 2024-05-08T18:31:32.877 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0039250600000000002, 2024-05-08T18:31:32.877 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:32.877 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:32.877 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:32.877 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:32.877 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:32.877 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:32.877 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 219 2024-05-08T18:31:32.878 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.878 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:32.878 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.878 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:32.878 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731985+0000", 2024-05-08T18:31:32.878 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:32.878 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.878 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.878 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:32.878 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731985+0000", 2024-05-08T18:31:32.878 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:32.878 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.878 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.879 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:32.879 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731988+0000", 2024-05-08T18:31:32.879 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6599999999999999e-06 2024-05-08T18:31:32.879 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.879 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.879 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:32.879 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.732017+0000", 2024-05-08T18:31:32.879 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9692999999999998e-05 2024-05-08T18:31:32.879 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.879 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.879 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:32.879 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.732048+0000", 2024-05-08T18:31:32.879 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1066999999999999e-05 2024-05-08T18:31:32.879 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.880 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.880 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:32.880 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.732064+0000", 2024-05-08T18:31:32.880 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5786000000000001e-05 2024-05-08T18:31:32.880 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.880 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.880 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:32.880 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.732213+0000", 2024-05-08T18:31:32.880 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014895899999999999 2024-05-08T18:31:32.880 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.880 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.880 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:32.880 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.732572+0000", 2024-05-08T18:31:32.881 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000358904 2024-05-08T18:31:32.881 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.881 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.881 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:32.881 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.733349+0000", 2024-05-08T18:31:32.881 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00077657699999999997 2024-05-08T18:31:32.881 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.881 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.881 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:32.881 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.734899+0000", 2024-05-08T18:31:32.881 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001550652 2024-05-08T18:31:32.881 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.881 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.881 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:32.882 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.735641+0000", 2024-05-08T18:31:32.882 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00074222000000000003 2024-05-08T18:31:32.882 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.882 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.882 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:32.882 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.735801+0000", 2024-05-08T18:31:32.882 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015913599999999999 2024-05-08T18:31:32.882 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.882 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.882 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:32.882 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.735910+0000", 2024-05-08T18:31:32.882 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000109406 2024-05-08T18:31:32.882 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:32.883 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:32.883 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:32.883 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.883 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.883 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:32.883 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.750251+0000", 2024-05-08T18:31:32.883 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 101.09894033, 2024-05-08T18:31:32.883 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0038408600000000002, 2024-05-08T18:31:32.883 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:32.883 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:32.883 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:32.883 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:32.883 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:32.883 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:32.884 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 224 2024-05-08T18:31:32.884 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.884 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:32.884 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.884 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:32.884 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750251+0000", 2024-05-08T18:31:32.884 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:32.884 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.884 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.884 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:32.884 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750251+0000", 2024-05-08T18:31:32.884 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:32.884 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.884 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.885 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:32.885 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750253+0000", 2024-05-08T18:31:32.885 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2129999999999998e-06 2024-05-08T18:31:32.885 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.885 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.885 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:32.885 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750265+0000", 2024-05-08T18:31:32.885 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1484000000000001e-05 2024-05-08T18:31:32.885 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.885 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.885 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:32.885 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750293+0000", 2024-05-08T18:31:32.885 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8673000000000001e-05 2024-05-08T18:31:32.886 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.886 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.886 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:32.886 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750308+0000", 2024-05-08T18:31:32.886 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4620000000000001e-05 2024-05-08T18:31:32.886 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.886 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.886 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:32.886 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750459+0000", 2024-05-08T18:31:32.886 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000151619 2024-05-08T18:31:32.886 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.886 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.886 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:32.887 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750822+0000", 2024-05-08T18:31:32.887 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000362467 2024-05-08T18:31:32.887 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.887 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.887 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:32.887 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.751591+0000", 2024-05-08T18:31:32.887 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00076934699999999998 2024-05-08T18:31:32.887 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.887 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.887 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:32.887 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.753042+0000", 2024-05-08T18:31:32.887 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001450652 2024-05-08T18:31:32.887 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.888 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.888 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:32.888 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.753792+0000", 2024-05-08T18:31:32.888 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00075045500000000002 2024-05-08T18:31:32.888 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.888 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.888 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:32.888 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.753977+0000", 2024-05-08T18:31:32.888 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000184511 2024-05-08T18:31:32.888 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.888 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.888 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:32.888 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.754092+0000", 2024-05-08T18:31:32.889 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000114819 2024-05-08T18:31:32.889 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:32.889 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:32.889 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:32.889 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.889 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.889 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:32.889 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.783902+0000", 2024-05-08T18:31:32.889 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 101.065289599, 2024-05-08T18:31:32.889 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003120046, 2024-05-08T18:31:32.889 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:32.889 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:32.889 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:32.890 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:32.890 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:32.890 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:32.890 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 233 2024-05-08T18:31:32.890 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.890 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:32.890 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.890 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:32.890 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.783902+0000", 2024-05-08T18:31:32.890 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:32.890 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.890 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.890 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:32.891 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.783902+0000", 2024-05-08T18:31:32.891 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:32.891 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.891 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.891 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:32.891 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.783904+0000", 2024-05-08T18:31:32.891 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5229999999999998e-06 2024-05-08T18:31:32.891 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.891 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.891 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:32.891 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.783916+0000", 2024-05-08T18:31:32.891 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1513e-05 2024-05-08T18:31:32.891 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.891 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.892 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:32.892 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.783947+0000", 2024-05-08T18:31:32.892 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1353000000000003e-05 2024-05-08T18:31:32.892 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.892 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.892 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:32.892 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.783964+0000", 2024-05-08T18:31:32.892 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6643e-05 2024-05-08T18:31:32.892 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.892 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.892 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:32.892 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.784110+0000", 2024-05-08T18:31:32.892 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014627299999999999 2024-05-08T18:31:32.893 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.893 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.893 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:32.893 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.784329+0000", 2024-05-08T18:31:32.893 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021892099999999999 2024-05-08T18:31:32.893 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.893 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.893 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:32.893 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.784752+0000", 2024-05-08T18:31:32.893 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00042336700000000001 2024-05-08T18:31:32.893 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.893 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.893 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:32.894 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.786093+0000", 2024-05-08T18:31:32.894 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00134107 2024-05-08T18:31:32.894 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.894 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.894 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:32.894 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.786863+0000", 2024-05-08T18:31:32.894 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00076949099999999997 2024-05-08T18:31:32.894 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.894 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.894 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:32.894 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.786955+0000", 2024-05-08T18:31:32.894 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.2478999999999993e-05 2024-05-08T18:31:32.894 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.895 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.895 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:32.895 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.787022+0000", 2024-05-08T18:31:32.895 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6413000000000003e-05 2024-05-08T18:31:32.895 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:32.895 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:32.895 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:32.895 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.895 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.895 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:341 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:32.895 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.816045+0000", 2024-05-08T18:31:32.895 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 101.033146262, 2024-05-08T18:31:32.895 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002875154, 2024-05-08T18:31:32.896 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:32.896 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:32.896 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:32.896 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:32.896 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:32.896 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:32.896 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 341 2024-05-08T18:31:32.896 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.896 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:32.896 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.896 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:32.896 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816045+0000", 2024-05-08T18:31:32.896 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:32.897 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.897 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.897 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:32.897 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816045+0000", 2024-05-08T18:31:32.897 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:32.897 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.897 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.897 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:32.897 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816046+0000", 2024-05-08T18:31:32.897 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9199999999999999e-07 2024-05-08T18:31:32.897 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.897 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.897 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:32.897 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816050+0000", 2024-05-08T18:31:32.898 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0260000000000001e-06 2024-05-08T18:31:32.898 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.898 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.898 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:32.898 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816060+0000", 2024-05-08T18:31:32.898 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0297e-05 2024-05-08T18:31:32.898 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.898 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.898 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:32.898 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816065+0000", 2024-05-08T18:31:32.898 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.237e-06 2024-05-08T18:31:32.898 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.898 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.899 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:32.899 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816122+0000", 2024-05-08T18:31:32.899 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6168000000000002e-05 2024-05-08T18:31:32.899 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.899 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.899 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:32.899 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816198+0000", 2024-05-08T18:31:32.899 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6511e-05 2024-05-08T18:31:32.899 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.899 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.899 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:31:32.899 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816305+0000", 2024-05-08T18:31:32.899 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000106487 2024-05-08T18:31:32.900 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.900 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.900 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:32.900 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.816886+0000", 2024-05-08T18:31:32.900 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00058187199999999999 2024-05-08T18:31:32.900 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.900 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.900 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:32.900 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.818821+0000", 2024-05-08T18:31:32.900 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001934362 2024-05-08T18:31:32.900 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.900 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.900 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:32.900 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.818880+0000", 2024-05-08T18:31:32.901 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9210999999999999e-05 2024-05-08T18:31:32.901 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.901 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.901 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:32.901 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.818920+0000", 2024-05-08T18:31:32.901 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0091e-05 2024-05-08T18:31:32.901 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:32.901 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:32.901 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:32.901 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.901 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.901 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:32.901 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.086431+0000", 2024-05-08T18:31:32.902 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 100.762760442, 2024-05-08T18:31:32.902 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028335959999999999, 2024-05-08T18:31:32.902 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:32.902 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:32.902 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:32.902 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:32.902 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:32.902 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:32.902 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 733 2024-05-08T18:31:32.902 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.902 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:32.902 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.902 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:32.903 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086431+0000", 2024-05-08T18:31:32.903 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:32.903 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.903 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.903 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:32.903 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086431+0000", 2024-05-08T18:31:32.903 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:32.903 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.903 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.903 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:32.903 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086433+0000", 2024-05-08T18:31:32.903 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8899999999999999e-06 2024-05-08T18:31:32.903 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.904 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.904 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:32.904 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086441+0000", 2024-05-08T18:31:32.904 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.3100000000000001e-06 2024-05-08T18:31:32.904 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.904 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.904 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:32.904 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086460+0000", 2024-05-08T18:31:32.904 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8703999999999999e-05 2024-05-08T18:31:32.904 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.904 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.904 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:32.904 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086471+0000", 2024-05-08T18:31:32.904 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1324e-05 2024-05-08T18:31:32.905 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.905 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.905 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:32.905 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086590+0000", 2024-05-08T18:31:32.905 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000118625 2024-05-08T18:31:32.905 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.905 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.905 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:32.905 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.086817+0000", 2024-05-08T18:31:32.905 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000226958 2024-05-08T18:31:32.905 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.905 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.905 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:32.906 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.087131+0000", 2024-05-08T18:31:32.906 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00031478799999999998 2024-05-08T18:31:32.906 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.906 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.906 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:32.906 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.088025+0000", 2024-05-08T18:31:32.906 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00089402999999999998 2024-05-08T18:31:32.906 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.906 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.906 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:32.906 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.089123+0000", 2024-05-08T18:31:32.906 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001097598 2024-05-08T18:31:32.906 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.907 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.907 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:32.907 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.089200+0000", 2024-05-08T18:31:32.907 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7333e-05 2024-05-08T18:31:32.907 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.907 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.907 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:32.907 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.089264+0000", 2024-05-08T18:31:32.907 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.4035999999999995e-05 2024-05-08T18:31:32.907 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:32.907 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:32.907 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:32.907 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.908 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.908 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:751 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:32.908 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.125611+0000", 2024-05-08T18:31:32.908 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 100.72357975, 2024-05-08T18:31:32.908 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032716749999999999, 2024-05-08T18:31:32.908 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:32.908 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:32.908 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:32.908 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:32.908 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:32.908 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:32.908 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 751 2024-05-08T18:31:32.908 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.908 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:32.909 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.909 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:32.909 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125611+0000", 2024-05-08T18:31:32.909 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:32.909 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.909 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.909 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:32.909 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125611+0000", 2024-05-08T18:31:32.909 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:32.909 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.909 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.909 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:32.909 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125614+0000", 2024-05-08T18:31:32.910 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.12e-06 2024-05-08T18:31:32.910 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.910 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.910 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:32.910 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125624+0000", 2024-05-08T18:31:32.910 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0492999999999999e-05 2024-05-08T18:31:32.910 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.910 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.910 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:32.910 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125650+0000", 2024-05-08T18:31:32.910 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5907000000000001e-05 2024-05-08T18:31:32.910 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.910 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.911 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:32.911 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125667+0000", 2024-05-08T18:31:32.911 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.694e-05 2024-05-08T18:31:32.911 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.911 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.911 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:32.911 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125801+0000", 2024-05-08T18:31:32.911 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000134482 2024-05-08T18:31:32.911 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.911 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.911 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:32.911 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.126174+0000", 2024-05-08T18:31:32.911 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00037294999999999999 2024-05-08T18:31:32.912 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.912 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.912 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:32.912 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.126750+0000", 2024-05-08T18:31:32.912 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00057538900000000004 2024-05-08T18:31:32.912 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.912 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.912 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:32.912 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.127997+0000", 2024-05-08T18:31:32.912 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001247761 2024-05-08T18:31:32.912 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.912 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.912 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:32.913 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.128731+0000", 2024-05-08T18:31:32.913 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00073338099999999996 2024-05-08T18:31:32.913 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.913 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.913 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:32.913 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.128817+0000", 2024-05-08T18:31:32.913 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5993000000000002e-05 2024-05-08T18:31:32.913 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.913 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.913 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:32.913 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.128883+0000", 2024-05-08T18:31:32.913 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6259000000000004e-05 2024-05-08T18:31:32.913 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:32.913 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:32.914 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:32.914 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.914 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.914 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:753 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:32.914 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.129809+0000", 2024-05-08T18:31:32.914 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 100.719382212, 2024-05-08T18:31:32.914 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0033775440000000001, 2024-05-08T18:31:32.914 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:32.914 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:32.914 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:32.914 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:32.914 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:32.914 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:32.915 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 753 2024-05-08T18:31:32.915 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.915 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:32.915 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.915 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:32.915 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129809+0000", 2024-05-08T18:31:32.915 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:32.915 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.915 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.915 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:32.915 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129809+0000", 2024-05-08T18:31:32.915 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:32.915 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.915 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.915 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:32.916 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129811+0000", 2024-05-08T18:31:32.916 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1730000000000002e-06 2024-05-08T18:31:32.916 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.916 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.916 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:32.916 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129822+0000", 2024-05-08T18:31:32.916 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0583e-05 2024-05-08T18:31:32.916 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.916 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.916 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:32.916 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129852+0000", 2024-05-08T18:31:32.916 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0744000000000002e-05 2024-05-08T18:31:32.916 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.916 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.917 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:32.917 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129870+0000", 2024-05-08T18:31:32.917 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7955999999999999e-05 2024-05-08T18:31:32.917 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.917 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.917 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:32.917 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.130018+0000", 2024-05-08T18:31:32.917 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014747600000000001 2024-05-08T18:31:32.917 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.917 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.917 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:32.917 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.130259+0000", 2024-05-08T18:31:32.917 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024079099999999999 2024-05-08T18:31:32.918 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.918 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.918 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:32.918 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.130734+0000", 2024-05-08T18:31:32.918 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00047562 2024-05-08T18:31:32.918 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.918 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.918 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:32.918 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.131997+0000", 2024-05-08T18:31:32.918 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012626429999999999 2024-05-08T18:31:32.918 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.918 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.918 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:32.919 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.132923+0000", 2024-05-08T18:31:32.919 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00092627599999999997 2024-05-08T18:31:32.919 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.919 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.919 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:32.919 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.133076+0000", 2024-05-08T18:31:32.919 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000152989 2024-05-08T18:31:32.919 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.919 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.919 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:32.919 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.133187+0000", 2024-05-08T18:31:32.919 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000110293 2024-05-08T18:31:32.919 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:32.919 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:32.920 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:32.920 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.920 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.920 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:32.920 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.228247+0000", 2024-05-08T18:31:32.920 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 100.62094460199999, 2024-05-08T18:31:32.920 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032753449999999998, 2024-05-08T18:31:32.920 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:32.920 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:32.920 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:32.920 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:32.920 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:32.920 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:32.920 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 796 2024-05-08T18:31:32.921 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.921 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:32.921 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.921 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:32.921 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228247+0000", 2024-05-08T18:31:32.921 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:32.921 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.921 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.921 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:32.921 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228247+0000", 2024-05-08T18:31:32.921 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:32.921 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.921 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.921 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:32.922 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228249+0000", 2024-05-08T18:31:32.922 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3800000000000001e-06 2024-05-08T18:31:32.922 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.922 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.922 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:32.922 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228260+0000", 2024-05-08T18:31:32.922 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1496e-05 2024-05-08T18:31:32.922 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.922 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.922 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:32.922 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228292+0000", 2024-05-08T18:31:32.922 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1294000000000002e-05 2024-05-08T18:31:32.922 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.922 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.923 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:32.923 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228306+0000", 2024-05-08T18:31:32.923 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4606e-05 2024-05-08T18:31:32.923 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.923 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.923 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:32.923 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228443+0000", 2024-05-08T18:31:32.923 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013672599999999999 2024-05-08T18:31:32.923 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.923 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.923 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:32.923 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228813+0000", 2024-05-08T18:31:32.923 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00036987000000000001 2024-05-08T18:31:32.924 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.924 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.924 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:31:32.924 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.229365+0000", 2024-05-08T18:31:32.924 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00055210600000000002 2024-05-08T18:31:32.924 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.924 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.924 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:32.924 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.230800+0000", 2024-05-08T18:31:32.924 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001435006 2024-05-08T18:31:32.924 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.924 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.924 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:32.925 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.231369+0000", 2024-05-08T18:31:32.925 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00056848499999999998 2024-05-08T18:31:32.925 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.925 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.925 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:32.925 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.231455+0000", 2024-05-08T18:31:32.925 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6905999999999998e-05 2024-05-08T18:31:32.925 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.925 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.925 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:32.925 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.231522+0000", 2024-05-08T18:31:32.925 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6470000000000006e-05 2024-05-08T18:31:32.925 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:32.925 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:32.926 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:32.926 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.926 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.926 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:798 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:32.926 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.232573+0000", 2024-05-08T18:31:32.926 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 100.616618495, 2024-05-08T18:31:32.926 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0030406690000000002, 2024-05-08T18:31:32.926 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:32.926 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:32.926 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:32.926 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:32.926 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:32.926 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:32.926 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 798 2024-05-08T18:31:32.927 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.927 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:32.927 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.927 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:32.927 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232573+0000", 2024-05-08T18:31:32.927 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:32.927 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.927 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.927 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:32.927 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232573+0000", 2024-05-08T18:31:32.927 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:32.927 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.927 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.927 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:32.928 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232574+0000", 2024-05-08T18:31:32.928 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.446e-06 2024-05-08T18:31:32.928 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.928 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.928 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:32.928 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232581+0000", 2024-05-08T18:31:32.928 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.0670000000000003e-06 2024-05-08T18:31:32.928 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.928 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.928 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:32.928 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232600+0000", 2024-05-08T18:31:32.928 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8822999999999999e-05 2024-05-08T18:31:32.929 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.929 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.929 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:32.929 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232611+0000", 2024-05-08T18:31:32.929 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1233000000000001e-05 2024-05-08T18:31:32.929 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.929 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.929 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:32.929 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232731+0000", 2024-05-08T18:31:32.929 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000120189 2024-05-08T18:31:32.929 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.929 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.929 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:32.929 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232963+0000", 2024-05-08T18:31:32.930 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023111900000000001 2024-05-08T18:31:32.930 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.930 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.930 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:31:32.930 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.233441+0000", 2024-05-08T18:31:32.930 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00047866899999999998 2024-05-08T18:31:32.930 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.930 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.930 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:32.930 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.234542+0000", 2024-05-08T18:31:32.930 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001101245 2024-05-08T18:31:32.930 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.930 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.931 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:32.931 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.235349+0000", 2024-05-08T18:31:32.931 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000806567 2024-05-08T18:31:32.931 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.931 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.931 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:32.931 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.235498+0000", 2024-05-08T18:31:32.931 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014907200000000001 2024-05-08T18:31:32.931 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.931 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.931 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:32.931 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.235613+0000", 2024-05-08T18:31:32.931 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115239 2024-05-08T18:31:32.931 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:32.932 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:32.932 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:32.932 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.932 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.932 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:32.932 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.248596+0000", 2024-05-08T18:31:32.932 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 100.600594689, 2024-05-08T18:31:32.932 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002919984, 2024-05-08T18:31:32.932 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:32.932 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:32.932 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:32.932 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:32.932 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:32.933 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:32.933 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 805 2024-05-08T18:31:32.933 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.933 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:32.933 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.933 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:32.933 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248596+0000", 2024-05-08T18:31:32.933 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:32.933 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.933 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.933 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:32.933 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248596+0000", 2024-05-08T18:31:32.933 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:32.933 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.934 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.934 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:32.934 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248599+0000", 2024-05-08T18:31:32.934 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3630000000000001e-06 2024-05-08T18:31:32.934 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.934 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.934 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:32.934 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248610+0000", 2024-05-08T18:31:32.934 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1267000000000001e-05 2024-05-08T18:31:32.934 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.934 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.934 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:32.934 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248641+0000", 2024-05-08T18:31:32.935 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1309999999999997e-05 2024-05-08T18:31:32.935 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.935 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.935 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:32.935 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248656+0000", 2024-05-08T18:31:32.935 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4449e-05 2024-05-08T18:31:32.935 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.935 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.935 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:32.935 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248781+0000", 2024-05-08T18:31:32.935 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012500900000000001 2024-05-08T18:31:32.935 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.935 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.935 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:32.935 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.249001+0000", 2024-05-08T18:31:32.936 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021963500000000001 2024-05-08T18:31:32.936 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.936 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.936 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:32.936 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.249341+0000", 2024-05-08T18:31:32.936 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00034004100000000002 2024-05-08T18:31:32.936 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.936 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.936 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:32.936 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.250473+0000", 2024-05-08T18:31:32.936 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0011324180000000001 2024-05-08T18:31:32.936 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.936 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.936 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:32.937 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.251230+0000", 2024-05-08T18:31:32.937 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00075751400000000004 2024-05-08T18:31:32.937 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.937 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.937 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:32.937 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.251394+0000", 2024-05-08T18:31:32.937 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016379200000000001 2024-05-08T18:31:32.937 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.937 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.937 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:32.937 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.251516+0000", 2024-05-08T18:31:32.937 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012218600000000001 2024-05-08T18:31:32.937 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:32.938 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:32.938 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:32.938 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.938 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.938 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:32.938 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.313184+0000", 2024-05-08T18:31:32.938 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 100.53600701400001, 2024-05-08T18:31:32.938 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003040016, 2024-05-08T18:31:32.938 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:32.938 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:32.938 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:32.938 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:32.938 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:32.938 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:32.939 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 832 2024-05-08T18:31:32.939 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.939 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:32.939 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.939 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:32.939 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313184+0000", 2024-05-08T18:31:32.939 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:32.939 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.939 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.939 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:32.939 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313184+0000", 2024-05-08T18:31:32.939 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:32.939 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.940 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.940 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:32.940 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313187+0000", 2024-05-08T18:31:32.940 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5100000000000001e-06 2024-05-08T18:31:32.940 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.940 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.940 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:32.940 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313199+0000", 2024-05-08T18:31:32.940 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.201e-05 2024-05-08T18:31:32.940 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.940 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.940 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:32.940 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313229+0000", 2024-05-08T18:31:32.940 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9839e-05 2024-05-08T18:31:32.941 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.941 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.941 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:32.941 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313243+0000", 2024-05-08T18:31:32.941 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4727e-05 2024-05-08T18:31:32.941 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.941 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.941 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:32.941 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313358+0000", 2024-05-08T18:31:32.941 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115016 2024-05-08T18:31:32.941 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.941 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.941 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:32.942 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313577+0000", 2024-05-08T18:31:32.942 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021897799999999999 2024-05-08T18:31:32.942 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.942 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.942 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:31:32.942 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313889+0000", 2024-05-08T18:31:32.942 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00031210400000000001 2024-05-08T18:31:32.942 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.942 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.942 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:32.942 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.315229+0000", 2024-05-08T18:31:32.942 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001339963 2024-05-08T18:31:32.943 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.943 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.943 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:32.943 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.315938+0000", 2024-05-08T18:31:32.943 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00070853400000000003 2024-05-08T18:31:32.943 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.943 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.943 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:32.943 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.316111+0000", 2024-05-08T18:31:32.943 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000173396 2024-05-08T18:31:32.943 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.943 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.943 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:32.943 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.316224+0000", 2024-05-08T18:31:32.944 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000112939 2024-05-08T18:31:32.944 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:32.944 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:32.944 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:32.944 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.944 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.944 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:834 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:32.944 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.317499+0000", 2024-05-08T18:31:32.944 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 100.53169221500001, 2024-05-08T18:31:32.944 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0033281109999999999, 2024-05-08T18:31:32.944 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:32.944 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:32.944 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:32.944 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:32.945 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:32.945 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:32.945 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 834 2024-05-08T18:31:32.945 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.945 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:32.945 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.945 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:32.945 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317499+0000", 2024-05-08T18:31:32.945 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:32.945 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.945 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.945 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:32.945 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317499+0000", 2024-05-08T18:31:32.945 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:32.946 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.946 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.946 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:32.946 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317501+0000", 2024-05-08T18:31:32.946 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9400000000000001e-06 2024-05-08T18:31:32.946 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.946 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.946 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:32.946 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317511+0000", 2024-05-08T18:31:32.946 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0297e-05 2024-05-08T18:31:32.946 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.946 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.946 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:32.947 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317532+0000", 2024-05-08T18:31:32.947 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1013e-05 2024-05-08T18:31:32.947 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.947 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.947 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:32.947 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317543+0000", 2024-05-08T18:31:32.947 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0757000000000001e-05 2024-05-08T18:31:32.947 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.947 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.947 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:32.947 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317658+0000", 2024-05-08T18:31:32.947 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115129 2024-05-08T18:31:32.947 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.947 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.948 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:32.948 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317887+0000", 2024-05-08T18:31:32.948 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00022880099999999999 2024-05-08T18:31:32.948 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.948 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.948 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:31:32.948 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.318378+0000", 2024-05-08T18:31:32.948 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00049129000000000002 2024-05-08T18:31:32.948 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.948 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.948 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:32.948 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.319597+0000", 2024-05-08T18:31:32.948 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012188469999999999 2024-05-08T18:31:32.948 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.949 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.949 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:32.949 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.320566+0000", 2024-05-08T18:31:32.949 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00096881599999999995 2024-05-08T18:31:32.949 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.949 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.949 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:32.949 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.320713+0000", 2024-05-08T18:31:32.949 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014691500000000001 2024-05-08T18:31:32.949 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.949 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.949 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:32.949 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.320827+0000", 2024-05-08T18:31:32.949 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000114306 2024-05-08T18:31:32.950 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:32.950 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:32.950 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:32.950 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.950 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.950 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:32.950 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.505569+0000", 2024-05-08T18:31:32.950 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 100.343621762, 2024-05-08T18:31:32.950 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028584309999999998, 2024-05-08T18:31:32.950 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:32.950 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:32.950 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:32.950 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:32.950 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:32.951 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:32.951 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 916 2024-05-08T18:31:32.951 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.951 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:32.951 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.951 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:32.951 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505569+0000", 2024-05-08T18:31:32.951 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:32.951 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.951 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.951 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:32.951 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505569+0000", 2024-05-08T18:31:32.951 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:32.952 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.952 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.952 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:32.952 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505572+0000", 2024-05-08T18:31:32.952 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3659999999999999e-06 2024-05-08T18:31:32.952 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.952 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.952 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:32.952 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505583+0000", 2024-05-08T18:31:32.952 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1574e-05 2024-05-08T18:31:32.952 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.952 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.952 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:32.953 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505614+0000", 2024-05-08T18:31:32.953 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0670000000000003e-05 2024-05-08T18:31:32.953 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.953 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.953 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:32.953 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505629+0000", 2024-05-08T18:31:32.953 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5063e-05 2024-05-08T18:31:32.953 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.953 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.953 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:32.953 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505754+0000", 2024-05-08T18:31:32.953 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012508899999999999 2024-05-08T18:31:32.953 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.953 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.954 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:32.954 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.505988+0000", 2024-05-08T18:31:32.954 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023334699999999999 2024-05-08T18:31:32.954 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.954 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.954 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:32.954 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.506299+0000", 2024-05-08T18:31:32.954 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000311811 2024-05-08T18:31:32.954 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.954 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.954 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:32.954 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.507489+0000", 2024-05-08T18:31:32.954 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0011899510000000001 2024-05-08T18:31:32.954 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.955 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.955 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:32.955 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.508141+0000", 2024-05-08T18:31:32.955 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00065180200000000005 2024-05-08T18:31:32.955 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.955 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.955 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:32.955 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.508306+0000", 2024-05-08T18:31:32.955 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016450199999999999 2024-05-08T18:31:32.955 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.955 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.955 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:32.955 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.508428+0000", 2024-05-08T18:31:32.956 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000122256 2024-05-08T18:31:32.956 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:32.956 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:32.956 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:32.956 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.956 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.956 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:918 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:32.956 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.509337+0000", 2024-05-08T18:31:32.956 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 100.339853695, 2024-05-08T18:31:32.956 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002971787, 2024-05-08T18:31:32.956 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:32.956 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:32.956 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:32.956 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:32.957 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:32.957 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:32.957 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 918 2024-05-08T18:31:32.957 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.957 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:32.957 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.957 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:32.957 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509337+0000", 2024-05-08T18:31:32.957 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:32.957 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.957 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.957 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:32.957 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509337+0000", 2024-05-08T18:31:32.957 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:32.958 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.958 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.958 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:32.958 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509340+0000", 2024-05-08T18:31:32.958 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2570000000000002e-06 2024-05-08T18:31:32.958 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.958 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.958 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:32.958 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509351+0000", 2024-05-08T18:31:32.958 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0933e-05 2024-05-08T18:31:32.958 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.958 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.958 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:32.958 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509382+0000", 2024-05-08T18:31:32.959 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1198999999999997e-05 2024-05-08T18:31:32.959 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.959 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.959 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:32.959 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509400+0000", 2024-05-08T18:31:32.959 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8236999999999998e-05 2024-05-08T18:31:32.959 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.959 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.959 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:32.959 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509529+0000", 2024-05-08T18:31:32.959 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012905600000000001 2024-05-08T18:31:32.959 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.959 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.960 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:32.960 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509777+0000", 2024-05-08T18:31:32.960 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024786799999999999 2024-05-08T18:31:32.960 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.960 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.960 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:32.960 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.510284+0000", 2024-05-08T18:31:32.960 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000506796 2024-05-08T18:31:32.960 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.960 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.960 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:32.960 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.511453+0000", 2024-05-08T18:31:32.960 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001169575 2024-05-08T18:31:32.960 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.961 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.961 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:32.961 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.512051+0000", 2024-05-08T18:31:32.961 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00059743100000000005 2024-05-08T18:31:32.961 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.961 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.961 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:32.961 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.512199+0000", 2024-05-08T18:31:32.961 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000148486 2024-05-08T18:31:32.961 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.961 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.961 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:32.961 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.512309+0000", 2024-05-08T18:31:32.961 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000109949 2024-05-08T18:31:32.962 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:32.962 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:32.962 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:32.962 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.962 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.962 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:931 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:32.962 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.543277+0000", 2024-05-08T18:31:32.962 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 100.30591454, 2024-05-08T18:31:32.962 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028250710000000002, 2024-05-08T18:31:32.962 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:32.962 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:32.962 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:32.962 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:32.963 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:32.963 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:32.963 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 931 2024-05-08T18:31:32.963 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.963 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:32.963 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.963 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:32.963 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543277+0000", 2024-05-08T18:31:32.963 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:32.963 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.963 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.963 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:32.963 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543277+0000", 2024-05-08T18:31:32.963 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:32.964 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.964 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.964 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:32.964 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543279+0000", 2024-05-08T18:31:32.964 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.373e-06 2024-05-08T18:31:32.964 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.964 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.964 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:32.964 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543291+0000", 2024-05-08T18:31:32.964 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1517e-05 2024-05-08T18:31:32.964 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.964 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.964 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:32.964 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543323+0000", 2024-05-08T18:31:32.965 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2292000000000002e-05 2024-05-08T18:31:32.965 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.965 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.965 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:32.965 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543340+0000", 2024-05-08T18:31:32.965 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.749e-05 2024-05-08T18:31:32.965 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.965 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.965 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:32.965 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543462+0000", 2024-05-08T18:31:32.965 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000121413 2024-05-08T18:31:32.965 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.965 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.966 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:32.966 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.543681+0000", 2024-05-08T18:31:32.966 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021974200000000001 2024-05-08T18:31:32.966 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.966 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.966 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:31:32.966 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.544004+0000", 2024-05-08T18:31:32.966 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00032268900000000003 2024-05-08T18:31:32.966 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.966 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.966 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:32.966 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.545158+0000", 2024-05-08T18:31:32.966 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0011540190000000001 2024-05-08T18:31:32.967 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.967 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.967 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:32.967 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.545970+0000", 2024-05-08T18:31:32.967 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00081224300000000004 2024-05-08T18:31:32.967 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.967 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.967 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:32.967 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.546043+0000", 2024-05-08T18:31:32.967 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.3067999999999999e-05 2024-05-08T18:31:32.967 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.967 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.968 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:32.968 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.546102+0000", 2024-05-08T18:31:32.968 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8224999999999999e-05 2024-05-08T18:31:32.968 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:32.968 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:32.968 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:32.968 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.968 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.968 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:32.968 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.578568+0000", 2024-05-08T18:31:32.968 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 100.270623633, 2024-05-08T18:31:32.968 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0030345839999999999, 2024-05-08T18:31:32.968 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:32.969 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:32.969 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:32.969 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:32.969 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:32.969 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:32.969 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 946 2024-05-08T18:31:32.969 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.969 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:32.969 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.969 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:32.969 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578568+0000", 2024-05-08T18:31:32.969 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:32.969 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.969 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.969 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:32.970 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578568+0000", 2024-05-08T18:31:32.970 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:32.970 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.970 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.970 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:32.970 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578570+0000", 2024-05-08T18:31:32.970 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3700000000000002e-06 2024-05-08T18:31:32.970 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.970 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.970 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:32.970 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578582+0000", 2024-05-08T18:31:32.970 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1627000000000001e-05 2024-05-08T18:31:32.970 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.970 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.971 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:32.971 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578612+0000", 2024-05-08T18:31:32.971 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0103e-05 2024-05-08T18:31:32.971 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.971 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.971 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:32.971 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578627+0000", 2024-05-08T18:31:32.971 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4949999999999999e-05 2024-05-08T18:31:32.971 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.971 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.971 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:32.971 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578750+0000", 2024-05-08T18:31:32.971 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012309899999999999 2024-05-08T18:31:32.971 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.972 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.972 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:32.972 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.579042+0000", 2024-05-08T18:31:32.972 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00029212500000000001 2024-05-08T18:31:32.972 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.972 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.972 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:32.972 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.579557+0000", 2024-05-08T18:31:32.972 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00051536900000000001 2024-05-08T18:31:32.972 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.972 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.972 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:32.972 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.580698+0000", 2024-05-08T18:31:32.972 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001140774 2024-05-08T18:31:32.973 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.973 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.973 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:32.973 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.581367+0000", 2024-05-08T18:31:32.973 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00066884799999999999 2024-05-08T18:31:32.973 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.973 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.973 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:32.973 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.581489+0000", 2024-05-08T18:31:32.973 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012265600000000001 2024-05-08T18:31:32.973 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:32.973 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:32.973 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:32.974 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.581602+0000", 2024-05-08T18:31:32.974 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000112663 2024-05-08T18:31:32.974 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:32.974 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:32.974 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:32.974 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:32.974 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:32.974 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:32.975 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-08T18:31:32.976 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:31:32.970+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:31:32.977 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-08T18:31:33.077 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:31:33.074+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:31:33.134 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:33.134 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:31:33.134 INFO:teuthology.orchestra.run.smithi097.stdout: "num_ops": 0 2024-05-08T18:31:33.134 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:33.149 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-08T18:31:33.192 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:31:33.189+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:31:33.255 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:33.256 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:31:33.256 INFO:teuthology.orchestra.run.smithi097.stdout: "complaint_time": 30, 2024-05-08T18:31:33.256 INFO:teuthology.orchestra.run.smithi097.stdout: "num_blocked_ops": 0 2024-05-08T18:31:33.256 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:33.268 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-08T18:31:33.279 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:31:33.274+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:31:33.360 INFO:teuthology.orchestra.run.smithi097.stderr:nodeep-scrub is unset 2024-05-08T18:31:33.380 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:31:33.378+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:31:33.432 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:33.432 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2024-05-08T18:31:33.432 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2024-05-08T18:31:33.432 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-05-08T18:31:33.432 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.433 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4479.0:40 5.b 5:d797044f:::zonegroup_info.ea3b680f-900d-4805-81ec-055811625780:head [create,call version.set in=10b,writefull 0~436] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-05-08T18:31:33.433 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:44.637551+0000", 2024-05-08T18:31:33.433 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 108.79473265999999, 2024-05-08T18:31:33.433 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003054013, 2024-05-08T18:31:33.433 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:33.433 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:33.433 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:33.433 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:33.433 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4479", 2024-05-08T18:31:33.433 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3577501689", 2024-05-08T18:31:33.433 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 40 2024-05-08T18:31:33.433 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.433 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:33.433 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.434 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:33.434 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.637551+0000", 2024-05-08T18:31:33.434 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:33.434 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.434 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.434 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:33.434 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.637551+0000", 2024-05-08T18:31:33.434 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:33.434 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.434 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.434 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:33.434 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.637554+0000", 2024-05-08T18:31:33.435 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6599999999999999e-06 2024-05-08T18:31:33.435 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.435 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.435 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:33.435 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.637576+0000", 2024-05-08T18:31:33.435 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1965999999999999e-05 2024-05-08T18:31:33.435 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.435 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.435 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:33.435 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.637603+0000", 2024-05-08T18:31:33.435 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7257e-05 2024-05-08T18:31:33.435 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.436 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.436 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:33.436 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.637623+0000", 2024-05-08T18:31:33.436 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9570000000000001e-05 2024-05-08T18:31:33.436 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.436 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.436 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:33.436 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.637766+0000", 2024-05-08T18:31:33.436 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000143435 2024-05-08T18:31:33.436 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.436 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.436 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:33.436 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.638167+0000", 2024-05-08T18:31:33.436 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00040082399999999998 2024-05-08T18:31:33.437 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.437 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.437 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:33.437 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.638627+0000", 2024-05-08T18:31:33.437 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00046019300000000002 2024-05-08T18:31:33.437 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.437 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.437 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:33.437 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.640399+0000", 2024-05-08T18:31:33.437 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0017714199999999999 2024-05-08T18:31:33.437 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.437 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.437 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:33.438 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.640447+0000", 2024-05-08T18:31:33.438 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8383000000000001e-05 2024-05-08T18:31:33.438 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.438 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.438 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:33.438 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.640534+0000", 2024-05-08T18:31:33.438 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7078999999999998e-05 2024-05-08T18:31:33.438 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.438 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.438 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:33.438 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.640606+0000", 2024-05-08T18:31:33.438 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1225999999999999e-05 2024-05-08T18:31:33.439 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:33.439 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:33.439 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:33.439 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.439 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.439 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4479.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-05-08T18:31:33.439 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:44.643918+0000", 2024-05-08T18:31:33.439 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 108.788366385, 2024-05-08T18:31:33.439 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002986004, 2024-05-08T18:31:33.439 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:33.439 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:33.439 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:33.439 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:33.439 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4479", 2024-05-08T18:31:33.440 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3577501689", 2024-05-08T18:31:33.440 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 42 2024-05-08T18:31:33.440 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.440 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:33.440 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.440 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:33.440 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.643918+0000", 2024-05-08T18:31:33.440 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:33.440 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.440 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.440 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:33.440 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.643918+0000", 2024-05-08T18:31:33.440 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:33.440 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.441 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.441 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:33.441 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.643919+0000", 2024-05-08T18:31:33.441 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4729999999999999e-06 2024-05-08T18:31:33.441 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.441 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.441 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:33.441 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.643927+0000", 2024-05-08T18:31:33.441 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6389999999999992e-06 2024-05-08T18:31:33.441 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.441 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.441 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:33.441 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.643945+0000", 2024-05-08T18:31:33.441 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8195000000000001e-05 2024-05-08T18:31:33.442 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.442 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.442 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:33.442 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.643954+0000", 2024-05-08T18:31:33.442 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5210000000000002e-06 2024-05-08T18:31:33.442 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.442 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.442 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:33.442 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.644123+0000", 2024-05-08T18:31:33.442 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016904999999999999 2024-05-08T18:31:33.442 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.442 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.442 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:33.442 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.644315+0000", 2024-05-08T18:31:33.443 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00019202800000000001 2024-05-08T18:31:33.443 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.443 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.443 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:33.443 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.644505+0000", 2024-05-08T18:31:33.443 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000190552 2024-05-08T18:31:33.443 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.443 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.443 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:33.443 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.645877+0000", 2024-05-08T18:31:33.443 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001371702 2024-05-08T18:31:33.443 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.443 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.443 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:33.444 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.646778+0000", 2024-05-08T18:31:33.444 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00090065700000000002 2024-05-08T18:31:33.444 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.444 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.444 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:33.444 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.646843+0000", 2024-05-08T18:31:33.444 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5504000000000002e-05 2024-05-08T18:31:33.444 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.444 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.444 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:33.444 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.646904+0000", 2024-05-08T18:31:33.444 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0683000000000002e-05 2024-05-08T18:31:33.444 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:33.444 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:33.445 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:33.445 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.445 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.445 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:57 7.3 e30/29 7:c609908c:::notify.5:head v 30'2, mlcod=0'0)", 2024-05-08T18:31:33.445 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:48.669376+0000", 2024-05-08T18:31:33.445 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 104.76290827699999, 2024-05-08T18:31:33.445 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0041509479999999998, 2024-05-08T18:31:33.445 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:33.445 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:33.445 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:33.445 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:33.445 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.445 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:33.445 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669376+0000", 2024-05-08T18:31:33.446 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:33.446 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.446 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.446 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:33.446 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669376+0000", 2024-05-08T18:31:33.446 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:33.446 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.446 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.446 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:33.446 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669378+0000", 2024-05-08T18:31:33.446 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.79e-06 2024-05-08T18:31:33.446 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.446 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.446 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:33.447 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669393+0000", 2024-05-08T18:31:33.447 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5053e-05 2024-05-08T18:31:33.447 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.447 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.447 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:33.447 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669427+0000", 2024-05-08T18:31:33.447 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4326999999999998e-05 2024-05-08T18:31:33.447 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.447 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.447 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:33.447 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669451+0000", 2024-05-08T18:31:33.447 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3629e-05 2024-05-08T18:31:33.447 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.447 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.448 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:33.448 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669563+0000", 2024-05-08T18:31:33.448 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011251099999999999 2024-05-08T18:31:33.448 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.448 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.448 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:33.448 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669607+0000", 2024-05-08T18:31:33.448 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3877e-05 2024-05-08T18:31:33.448 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.448 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.448 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:33.448 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.673401+0000", 2024-05-08T18:31:33.448 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0037942819999999999 2024-05-08T18:31:33.449 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.449 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.449 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:33.449 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.673527+0000", 2024-05-08T18:31:33.449 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012547900000000001 2024-05-08T18:31:33.449 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:33.449 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:33.449 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:33.449 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.449 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.449 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:58 7.14 e30/29 7:2b04a3e9:::notify.6:head v 30'1, mlcod=0'0)", 2024-05-08T18:31:33.449 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:48.669496+0000", 2024-05-08T18:31:33.449 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 104.762787905, 2024-05-08T18:31:33.449 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0046805609999999997, 2024-05-08T18:31:33.450 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:33.450 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:33.450 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:33.450 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:33.450 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.450 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:33.450 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669496+0000", 2024-05-08T18:31:33.450 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:33.450 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.450 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.450 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:33.450 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669496+0000", 2024-05-08T18:31:33.451 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:33.451 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.451 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.451 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:33.451 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669497+0000", 2024-05-08T18:31:33.451 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0100000000000001e-06 2024-05-08T18:31:33.451 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.451 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.451 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:33.451 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669507+0000", 2024-05-08T18:31:33.451 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.7540000000000001e-06 2024-05-08T18:31:33.451 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.451 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.451 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:33.451 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669528+0000", 2024-05-08T18:31:33.452 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.05e-05 2024-05-08T18:31:33.452 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.452 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.452 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:33.452 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669544+0000", 2024-05-08T18:31:33.452 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6716000000000001e-05 2024-05-08T18:31:33.452 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.452 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.452 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:33.452 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669667+0000", 2024-05-08T18:31:33.452 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012275799999999999 2024-05-08T18:31:33.452 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.452 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.452 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:33.453 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669706+0000", 2024-05-08T18:31:33.453 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8764999999999999e-05 2024-05-08T18:31:33.453 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.453 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.453 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:33.453 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674100+0000", 2024-05-08T18:31:33.453 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.004394528 2024-05-08T18:31:33.453 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.453 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.453 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:33.453 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674177+0000", 2024-05-08T18:31:33.453 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6530000000000001e-05 2024-05-08T18:31:33.453 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:33.453 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:33.454 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:33.454 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.454 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.454 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:33.454 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.794231+0000", 2024-05-08T18:31:33.454 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 101.63805351400001, 2024-05-08T18:31:33.454 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031872810000000001, 2024-05-08T18:31:33.454 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:33.454 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:33.454 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:33.454 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:33.454 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:33.454 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:33.455 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 236 2024-05-08T18:31:33.455 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.455 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:33.455 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.455 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:33.455 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794231+0000", 2024-05-08T18:31:33.455 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:33.455 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.455 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.455 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:33.455 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794231+0000", 2024-05-08T18:31:33.455 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:33.455 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.455 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.456 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:33.456 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794234+0000", 2024-05-08T18:31:33.456 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.36e-06 2024-05-08T18:31:33.456 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.456 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.456 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:33.456 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794248+0000", 2024-05-08T18:31:33.456 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4372999999999999e-05 2024-05-08T18:31:33.456 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.456 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.456 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:33.456 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794279+0000", 2024-05-08T18:31:33.456 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1075999999999999e-05 2024-05-08T18:31:33.457 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.457 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.457 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:33.457 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794295+0000", 2024-05-08T18:31:33.457 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5386000000000001e-05 2024-05-08T18:31:33.457 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.457 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.457 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:33.457 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794416+0000", 2024-05-08T18:31:33.457 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012071899999999999 2024-05-08T18:31:33.457 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.457 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.457 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:33.457 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794638+0000", 2024-05-08T18:31:33.458 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00022262599999999999 2024-05-08T18:31:33.458 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.458 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.458 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:33.458 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.795061+0000", 2024-05-08T18:31:33.458 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00042248900000000001 2024-05-08T18:31:33.458 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.458 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.458 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:33.458 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.796477+0000", 2024-05-08T18:31:33.458 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0014162230000000001 2024-05-08T18:31:33.458 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.458 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.458 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:33.459 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.797258+0000", 2024-05-08T18:31:33.459 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00078159400000000004 2024-05-08T18:31:33.459 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.459 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.459 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:33.459 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.797349+0000", 2024-05-08T18:31:33.459 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0462000000000002e-05 2024-05-08T18:31:33.459 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.459 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.459 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:33.459 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.797418+0000", 2024-05-08T18:31:33.459 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8973000000000005e-05 2024-05-08T18:31:33.459 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:33.459 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:33.460 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:33.460 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.460 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.460 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:281 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:33.460 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.806063+0000", 2024-05-08T18:31:33.460 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 101.62622138, 2024-05-08T18:31:33.460 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002923761, 2024-05-08T18:31:33.460 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:33.460 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:33.460 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:33.460 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:33.460 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:33.460 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:33.460 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 281 2024-05-08T18:31:33.461 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.461 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:33.461 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.461 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:33.461 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.806063+0000", 2024-05-08T18:31:33.461 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:33.461 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.461 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.461 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:33.461 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.806063+0000", 2024-05-08T18:31:33.461 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:33.461 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.461 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.462 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:33.462 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.806064+0000", 2024-05-08T18:31:33.462 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.204e-06 2024-05-08T18:31:33.462 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.462 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.462 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:33.462 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.806073+0000", 2024-05-08T18:31:33.462 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5609999999999999e-06 2024-05-08T18:31:33.462 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.462 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.462 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:33.462 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.806089+0000", 2024-05-08T18:31:33.462 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6673000000000001e-05 2024-05-08T18:31:33.462 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.463 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.463 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:33.463 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.806098+0000", 2024-05-08T18:31:33.463 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8899999999999996e-06 2024-05-08T18:31:33.463 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.463 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.463 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:33.463 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.806165+0000", 2024-05-08T18:31:33.463 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6927999999999993e-05 2024-05-08T18:31:33.463 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.463 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.463 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:33.463 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.806298+0000", 2024-05-08T18:31:33.463 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000132886 2024-05-08T18:31:33.464 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.464 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.464 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:31:33.464 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.806453+0000", 2024-05-08T18:31:33.464 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000155339 2024-05-08T18:31:33.464 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.464 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.464 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:33.464 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.807157+0000", 2024-05-08T18:31:33.464 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00070363900000000004 2024-05-08T18:31:33.464 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.464 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.464 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:33.464 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.808880+0000", 2024-05-08T18:31:33.465 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0017227130000000001 2024-05-08T18:31:33.465 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.465 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.465 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:33.465 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.808938+0000", 2024-05-08T18:31:33.465 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8814999999999998e-05 2024-05-08T18:31:33.465 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.465 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.465 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:33.465 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.808987+0000", 2024-05-08T18:31:33.465 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8112999999999998e-05 2024-05-08T18:31:33.465 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:33.465 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:33.465 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:33.465 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.466 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.466 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:304 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:33.466 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.809645+0000", 2024-05-08T18:31:33.466 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 101.622639542, 2024-05-08T18:31:33.466 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031633579999999998, 2024-05-08T18:31:33.466 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:33.466 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:33.466 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:33.466 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:33.466 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:33.466 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:33.466 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 304 2024-05-08T18:31:33.466 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.467 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:33.467 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.467 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:33.467 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809645+0000", 2024-05-08T18:31:33.467 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:33.467 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.467 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.467 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:33.467 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809645+0000", 2024-05-08T18:31:33.467 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:33.467 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.467 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.467 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:33.467 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809646+0000", 2024-05-08T18:31:33.467 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.113e-06 2024-05-08T18:31:33.468 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.468 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.468 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:33.468 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809652+0000", 2024-05-08T18:31:33.468 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1650000000000003e-06 2024-05-08T18:31:33.468 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.468 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.468 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:33.468 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809668+0000", 2024-05-08T18:31:33.468 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6025e-05 2024-05-08T18:31:33.468 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.468 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.468 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:33.468 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809678+0000", 2024-05-08T18:31:33.469 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0456e-05 2024-05-08T18:31:33.469 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.469 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.469 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:33.469 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809745+0000", 2024-05-08T18:31:33.469 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7088000000000005e-05 2024-05-08T18:31:33.469 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.469 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.469 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:33.469 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809803+0000", 2024-05-08T18:31:33.469 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7405999999999999e-05 2024-05-08T18:31:33.469 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.469 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.469 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:31:33.470 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809951+0000", 2024-05-08T18:31:33.470 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014775500000000001 2024-05-08T18:31:33.470 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.470 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.470 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:33.470 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.810564+0000", 2024-05-08T18:31:33.470 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00061324899999999996 2024-05-08T18:31:33.470 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.470 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.470 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:33.470 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.812744+0000", 2024-05-08T18:31:33.470 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0021804509999999999 2024-05-08T18:31:33.470 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.470 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.471 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:33.471 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.812781+0000", 2024-05-08T18:31:33.471 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6554999999999998e-05 2024-05-08T18:31:33.471 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.471 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.471 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:33.471 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.812808+0000", 2024-05-08T18:31:33.471 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7095000000000001e-05 2024-05-08T18:31:33.471 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:33.471 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:33.471 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:33.471 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.471 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.471 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:33.471 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.105553+0000", 2024-05-08T18:31:33.472 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 101.32673153099999, 2024-05-08T18:31:33.472 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028754850000000001, 2024-05-08T18:31:33.472 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:33.472 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:33.472 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:33.472 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:33.472 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:33.472 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:33.472 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 742 2024-05-08T18:31:33.472 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.472 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:33.472 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.472 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:33.473 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.105553+0000", 2024-05-08T18:31:33.473 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:33.473 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.473 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.473 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:33.473 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.105553+0000", 2024-05-08T18:31:33.473 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:33.473 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.473 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.473 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:33.473 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.105556+0000", 2024-05-08T18:31:33.473 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3100000000000001e-06 2024-05-08T18:31:33.473 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.473 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.473 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:33.474 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.105569+0000", 2024-05-08T18:31:33.474 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2754e-05 2024-05-08T18:31:33.474 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.474 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.474 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:33.474 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.105601+0000", 2024-05-08T18:31:33.474 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2435999999999999e-05 2024-05-08T18:31:33.474 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.474 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.474 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:33.474 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.105616+0000", 2024-05-08T18:31:33.474 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4657e-05 2024-05-08T18:31:33.474 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.475 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.475 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:33.475 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.105804+0000", 2024-05-08T18:31:33.475 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00018861799999999999 2024-05-08T18:31:33.475 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.475 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.475 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:33.475 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.106054+0000", 2024-05-08T18:31:33.475 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024948499999999997 2024-05-08T18:31:33.475 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.475 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.475 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:33.475 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.106390+0000", 2024-05-08T18:31:33.475 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00033640100000000001 2024-05-08T18:31:33.476 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.476 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.476 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:33.476 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.107527+0000", 2024-05-08T18:31:33.476 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001136871 2024-05-08T18:31:33.476 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.476 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.476 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:33.476 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.108265+0000", 2024-05-08T18:31:33.476 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00073753100000000004 2024-05-08T18:31:33.476 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.476 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.476 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:33.476 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.108353+0000", 2024-05-08T18:31:33.477 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8232999999999994e-05 2024-05-08T18:31:33.477 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.477 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.477 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:33.477 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.108428+0000", 2024-05-08T18:31:33.477 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.5189000000000001e-05 2024-05-08T18:31:33.477 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:33.477 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:33.477 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:33.477 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.477 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.477 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:33.477 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.148015+0000", 2024-05-08T18:31:33.478 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 101.284269588, 2024-05-08T18:31:33.478 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032297409999999999, 2024-05-08T18:31:33.478 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:33.478 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:33.478 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:33.478 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:33.478 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:33.478 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:33.478 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 760 2024-05-08T18:31:33.478 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.478 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:33.478 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.478 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:33.479 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.148015+0000", 2024-05-08T18:31:33.479 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:33.479 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.479 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.479 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:33.479 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.148015+0000", 2024-05-08T18:31:33.479 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:33.479 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.479 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.479 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:33.479 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.148017+0000", 2024-05-08T18:31:33.479 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1830000000000001e-06 2024-05-08T18:31:33.479 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.479 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.480 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:33.480 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.148030+0000", 2024-05-08T18:31:33.480 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2893e-05 2024-05-08T18:31:33.480 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.480 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.480 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:33.480 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.148061+0000", 2024-05-08T18:31:33.480 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0953e-05 2024-05-08T18:31:33.480 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.480 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.480 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:33.480 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.148077+0000", 2024-05-08T18:31:33.480 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6554000000000001e-05 2024-05-08T18:31:33.480 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.481 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.481 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:33.481 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.148230+0000", 2024-05-08T18:31:33.481 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015263899999999999 2024-05-08T18:31:33.481 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.481 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.481 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:33.481 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.148592+0000", 2024-05-08T18:31:33.481 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00036219699999999997 2024-05-08T18:31:33.481 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.481 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.481 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:33.481 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.149139+0000", 2024-05-08T18:31:33.481 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00054734599999999999 2024-05-08T18:31:33.482 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.482 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.482 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:33.482 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.150505+0000", 2024-05-08T18:31:33.482 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001365479 2024-05-08T18:31:33.482 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.482 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.482 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:33.482 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.151087+0000", 2024-05-08T18:31:33.482 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00058201200000000002 2024-05-08T18:31:33.482 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.482 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.482 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:33.482 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.151175+0000", 2024-05-08T18:31:33.483 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8199e-05 2024-05-08T18:31:33.483 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.483 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.483 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:33.483 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.151244+0000", 2024-05-08T18:31:33.483 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9286e-05 2024-05-08T18:31:33.483 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:33.483 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:33.483 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:33.483 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.483 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.483 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:33.483 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.277376+0000", 2024-05-08T18:31:33.484 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 101.15490767, 2024-05-08T18:31:33.484 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032022190000000001, 2024-05-08T18:31:33.484 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:33.484 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:33.484 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:33.484 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:33.484 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:33.484 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:33.484 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 817 2024-05-08T18:31:33.484 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.484 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:33.484 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.484 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:33.484 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.277376+0000", 2024-05-08T18:31:33.485 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:33.485 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.485 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.485 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:33.485 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.277376+0000", 2024-05-08T18:31:33.485 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:33.485 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.485 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.485 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:33.485 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.277379+0000", 2024-05-08T18:31:33.485 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4430000000000002e-06 2024-05-08T18:31:33.485 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.485 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.485 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:33.485 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.277391+0000", 2024-05-08T18:31:33.486 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1634000000000001e-05 2024-05-08T18:31:33.486 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.486 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.486 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:33.486 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.277421+0000", 2024-05-08T18:31:33.486 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0691999999999997e-05 2024-05-08T18:31:33.486 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.486 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.486 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:33.486 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.277438+0000", 2024-05-08T18:31:33.486 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7102999999999999e-05 2024-05-08T18:31:33.486 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.486 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.487 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:33.487 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.277602+0000", 2024-05-08T18:31:33.487 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016345300000000001 2024-05-08T18:31:33.487 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.487 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.487 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:33.487 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.278019+0000", 2024-05-08T18:31:33.487 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00041724699999999998 2024-05-08T18:31:33.487 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.487 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.487 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:31:33.487 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.278573+0000", 2024-05-08T18:31:33.487 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00055391900000000005 2024-05-08T18:31:33.488 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.488 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.488 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:33.488 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.279973+0000", 2024-05-08T18:31:33.488 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0013995819999999999 2024-05-08T18:31:33.488 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.488 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.488 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:33.488 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.280422+0000", 2024-05-08T18:31:33.488 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00044940699999999997 2024-05-08T18:31:33.488 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.488 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.488 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:33.488 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.280509+0000", 2024-05-08T18:31:33.489 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7455999999999997e-05 2024-05-08T18:31:33.489 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.489 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.489 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:33.489 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.280579+0000", 2024-05-08T18:31:33.489 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9282999999999994e-05 2024-05-08T18:31:33.489 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:33.489 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:33.489 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:33.489 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.489 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.489 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:33.489 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.281716+0000", 2024-05-08T18:31:33.490 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 101.150568303, 2024-05-08T18:31:33.490 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003275881, 2024-05-08T18:31:33.490 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:33.490 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:33.490 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:33.490 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:33.490 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:33.490 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:33.490 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 819 2024-05-08T18:31:33.490 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.490 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:33.490 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.490 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:33.491 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.281716+0000", 2024-05-08T18:31:33.491 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:33.491 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.491 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.491 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:33.491 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.281716+0000", 2024-05-08T18:31:33.491 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:33.491 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.491 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.491 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:33.491 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.281718+0000", 2024-05-08T18:31:33.491 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.863e-06 2024-05-08T18:31:33.491 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.491 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.492 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:33.492 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.281728+0000", 2024-05-08T18:31:33.492 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0550000000000001e-05 2024-05-08T18:31:33.492 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.492 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.492 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:33.492 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.281760+0000", 2024-05-08T18:31:33.492 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2150000000000002e-05 2024-05-08T18:31:33.492 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.492 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.492 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:33.492 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.281776+0000", 2024-05-08T18:31:33.492 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6005999999999999e-05 2024-05-08T18:31:33.492 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.493 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.493 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:33.493 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.281917+0000", 2024-05-08T18:31:33.493 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014070200000000001 2024-05-08T18:31:33.493 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.493 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.493 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:33.493 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.282148+0000", 2024-05-08T18:31:33.493 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023095200000000001 2024-05-08T18:31:33.493 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.493 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.493 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:31:33.493 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.282641+0000", 2024-05-08T18:31:33.494 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00049337999999999997 2024-05-08T18:31:33.494 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.494 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.494 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:33.494 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.284070+0000", 2024-05-08T18:31:33.494 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0014287950000000001 2024-05-08T18:31:33.494 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.494 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.494 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:33.494 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.284837+0000", 2024-05-08T18:31:33.494 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00076679799999999996 2024-05-08T18:31:33.494 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.494 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.494 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:33.495 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.284925+0000", 2024-05-08T18:31:33.495 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8165999999999996e-05 2024-05-08T18:31:33.495 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.495 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.495 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:33.495 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.284992+0000", 2024-05-08T18:31:33.495 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6519000000000005e-05 2024-05-08T18:31:33.495 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:33.495 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:33.495 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:33.495 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.495 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.495 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:33.495 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.334745+0000", 2024-05-08T18:31:33.496 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 101.09753939300001, 2024-05-08T18:31:33.496 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032404719999999999, 2024-05-08T18:31:33.496 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:33.496 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:33.496 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:33.496 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:33.496 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:33.496 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:33.496 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 841 2024-05-08T18:31:33.496 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.496 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:33.496 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.496 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:33.496 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.334745+0000", 2024-05-08T18:31:33.496 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:33.497 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.497 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.497 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:33.497 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.334745+0000", 2024-05-08T18:31:33.497 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:33.497 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.497 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.497 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:33.497 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.334747+0000", 2024-05-08T18:31:33.497 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.407e-06 2024-05-08T18:31:33.497 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.497 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.497 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:33.497 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.334759+0000", 2024-05-08T18:31:33.498 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1883e-05 2024-05-08T18:31:33.498 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.498 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.498 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:33.498 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.334789+0000", 2024-05-08T18:31:33.498 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9957000000000001e-05 2024-05-08T18:31:33.498 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.498 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.498 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:33.498 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.334804+0000", 2024-05-08T18:31:33.498 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4713e-05 2024-05-08T18:31:33.498 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.498 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.498 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:33.499 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.334951+0000", 2024-05-08T18:31:33.499 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000147675 2024-05-08T18:31:33.499 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.499 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.499 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:33.499 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.335304+0000", 2024-05-08T18:31:33.499 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00035214099999999999 2024-05-08T18:31:33.499 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.499 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.499 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:31:33.499 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.335859+0000", 2024-05-08T18:31:33.499 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00055546899999999995 2024-05-08T18:31:33.499 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.499 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.499 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:33.500 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.337168+0000", 2024-05-08T18:31:33.500 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0013087299999999999 2024-05-08T18:31:33.500 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.500 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.500 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:33.500 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.337808+0000", 2024-05-08T18:31:33.500 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00064005500000000005 2024-05-08T18:31:33.500 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.500 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.500 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:33.500 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.337894+0000", 2024-05-08T18:31:33.500 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6593000000000003e-05 2024-05-08T18:31:33.500 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.501 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.501 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:33.501 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.337985+0000", 2024-05-08T18:31:33.501 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0848999999999997e-05 2024-05-08T18:31:33.501 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:33.501 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:33.501 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:33.501 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.501 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.501 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:33.501 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.338870+0000", 2024-05-08T18:31:33.501 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 101.09341464400001, 2024-05-08T18:31:33.501 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002862121, 2024-05-08T18:31:33.501 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:33.502 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:33.502 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:33.502 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:33.502 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:33.502 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:33.502 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 843 2024-05-08T18:31:33.502 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.502 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:33.502 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.502 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:33.502 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.338870+0000", 2024-05-08T18:31:33.502 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:33.502 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.502 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.503 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:33.503 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.338870+0000", 2024-05-08T18:31:33.503 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:33.503 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.503 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.503 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:33.503 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.338872+0000", 2024-05-08T18:31:33.503 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3429999999999998e-06 2024-05-08T18:31:33.503 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.503 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.503 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:33.503 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.338883+0000", 2024-05-08T18:31:33.503 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1447000000000001e-05 2024-05-08T18:31:33.503 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.504 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.504 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:33.504 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.338914+0000", 2024-05-08T18:31:33.504 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1052e-05 2024-05-08T18:31:33.504 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.504 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.504 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:33.504 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.338932+0000", 2024-05-08T18:31:33.504 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7604e-05 2024-05-08T18:31:33.504 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.504 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.504 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:33.504 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.339019+0000", 2024-05-08T18:31:33.504 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6982000000000002e-05 2024-05-08T18:31:33.505 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.505 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.505 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:33.505 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.339139+0000", 2024-05-08T18:31:33.505 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011978599999999999 2024-05-08T18:31:33.505 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.505 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.505 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:31:33.505 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.339415+0000", 2024-05-08T18:31:33.505 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00027644799999999999 2024-05-08T18:31:33.505 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.505 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.505 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:33.505 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.340619+0000", 2024-05-08T18:31:33.506 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012043010000000001 2024-05-08T18:31:33.506 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.506 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.506 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:33.506 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.341454+0000", 2024-05-08T18:31:33.506 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00083464300000000004 2024-05-08T18:31:33.506 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.506 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.506 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:33.506 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.341609+0000", 2024-05-08T18:31:33.506 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000154752 2024-05-08T18:31:33.506 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.506 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.506 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:33.507 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.341732+0000", 2024-05-08T18:31:33.507 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012276299999999999 2024-05-08T18:31:33.507 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:33.507 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:33.507 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:33.507 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.507 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.507 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:33.507 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.349287+0000", 2024-05-08T18:31:33.507 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 101.082996815, 2024-05-08T18:31:33.507 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032683220000000002, 2024-05-08T18:31:33.507 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:33.507 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:33.507 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:33.508 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:33.508 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:33.508 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:33.508 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 847 2024-05-08T18:31:33.508 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.508 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:33.508 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.508 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:33.508 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.349287+0000", 2024-05-08T18:31:33.508 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:33.508 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.508 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.508 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:33.508 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.349287+0000", 2024-05-08T18:31:33.509 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:33.509 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.509 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.509 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:33.509 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.349290+0000", 2024-05-08T18:31:33.509 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3369999999999998e-06 2024-05-08T18:31:33.509 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.509 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.509 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:33.509 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.349318+0000", 2024-05-08T18:31:33.509 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8419999999999999e-05 2024-05-08T18:31:33.509 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.509 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.510 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:33.510 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.349348+0000", 2024-05-08T18:31:33.510 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0260000000000002e-05 2024-05-08T18:31:33.510 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.510 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.510 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:33.510 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.349364+0000", 2024-05-08T18:31:33.510 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5359999999999999e-05 2024-05-08T18:31:33.510 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.510 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.510 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:33.510 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.349511+0000", 2024-05-08T18:31:33.510 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014760199999999999 2024-05-08T18:31:33.510 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.511 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.511 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:33.511 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.349872+0000", 2024-05-08T18:31:33.511 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00036035 2024-05-08T18:31:33.511 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.511 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.511 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:31:33.511 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.350432+0000", 2024-05-08T18:31:33.511 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00056059600000000001 2024-05-08T18:31:33.511 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.511 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.511 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:33.511 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.351817+0000", 2024-05-08T18:31:33.512 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001385063 2024-05-08T18:31:33.512 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.512 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.512 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:33.512 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.352402+0000", 2024-05-08T18:31:33.512 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00058490500000000004 2024-05-08T18:31:33.512 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.512 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.512 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:33.512 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.352488+0000", 2024-05-08T18:31:33.512 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6032999999999994e-05 2024-05-08T18:31:33.512 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.512 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.512 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:33.513 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.352556+0000", 2024-05-08T18:31:33.513 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7396000000000003e-05 2024-05-08T18:31:33.513 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:33.513 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:33.513 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:33.513 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.513 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.513 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:33.513 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.353786+0000", 2024-05-08T18:31:33.513 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 101.07849797999999, 2024-05-08T18:31:33.513 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0029130850000000002, 2024-05-08T18:31:33.513 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:33.513 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:33.513 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:33.514 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:33.514 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:33.514 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:33.514 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 849 2024-05-08T18:31:33.514 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.514 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:33.514 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.514 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:33.514 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.353786+0000", 2024-05-08T18:31:33.514 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:33.514 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.514 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.514 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:33.515 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.353786+0000", 2024-05-08T18:31:33.515 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:33.515 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.515 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.515 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:33.515 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.353788+0000", 2024-05-08T18:31:33.515 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0370000000000001e-06 2024-05-08T18:31:33.515 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.515 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.515 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:33.515 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.353799+0000", 2024-05-08T18:31:33.515 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0686000000000001e-05 2024-05-08T18:31:33.515 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.515 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.516 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:33.516 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.353832+0000", 2024-05-08T18:31:33.516 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.341e-05 2024-05-08T18:31:33.516 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.516 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.516 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:33.516 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.353851+0000", 2024-05-08T18:31:33.516 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8343999999999999e-05 2024-05-08T18:31:33.516 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.516 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.516 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:33.516 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.353980+0000", 2024-05-08T18:31:33.516 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012914900000000001 2024-05-08T18:31:33.517 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.517 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.517 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:33.517 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.354123+0000", 2024-05-08T18:31:33.517 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000142912 2024-05-08T18:31:33.517 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.517 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.517 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:31:33.517 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.354393+0000", 2024-05-08T18:31:33.517 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00027009799999999997 2024-05-08T18:31:33.517 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.517 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.517 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:33.517 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.355769+0000", 2024-05-08T18:31:33.517 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001375839 2024-05-08T18:31:33.518 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.518 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.518 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:33.518 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.356421+0000", 2024-05-08T18:31:33.518 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00065227799999999995 2024-05-08T18:31:33.518 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.518 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.518 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:33.518 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.356592+0000", 2024-05-08T18:31:33.518 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000170586 2024-05-08T18:31:33.518 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.518 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.518 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:33.519 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.356699+0000", 2024-05-08T18:31:33.519 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010774599999999999 2024-05-08T18:31:33.519 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:33.519 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:33.519 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:33.519 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.519 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.519 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:33.519 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.402673+0000", 2024-05-08T18:31:33.519 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 101.029611307, 2024-05-08T18:31:33.519 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002928295, 2024-05-08T18:31:33.519 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:33.519 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:33.520 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:33.520 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:33.520 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:33.520 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:33.520 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 870 2024-05-08T18:31:33.520 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.520 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:33.520 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.520 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:33.520 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.402673+0000", 2024-05-08T18:31:33.520 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:33.520 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.520 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.520 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:33.521 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.402673+0000", 2024-05-08T18:31:33.521 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:33.521 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.521 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.521 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:33.521 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.402675+0000", 2024-05-08T18:31:33.521 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0030000000000001e-06 2024-05-08T18:31:33.521 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.521 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.521 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:33.521 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.402685+0000", 2024-05-08T18:31:33.521 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0566e-05 2024-05-08T18:31:33.521 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.521 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.522 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:33.522 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.402714+0000", 2024-05-08T18:31:33.522 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8804999999999999e-05 2024-05-08T18:31:33.522 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.522 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.522 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:33.522 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.402731+0000", 2024-05-08T18:31:33.522 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6731e-05 2024-05-08T18:31:33.522 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.522 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.522 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:33.522 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.402863+0000", 2024-05-08T18:31:33.522 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013194199999999999 2024-05-08T18:31:33.522 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.523 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.523 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:33.523 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.403096+0000", 2024-05-08T18:31:33.523 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023309900000000001 2024-05-08T18:31:33.523 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.523 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.523 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:33.523 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.403553+0000", 2024-05-08T18:31:33.523 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00045738700000000002 2024-05-08T18:31:33.523 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.523 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.523 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:33.523 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.404843+0000", 2024-05-08T18:31:33.523 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012894650000000001 2024-05-08T18:31:33.524 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.524 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.524 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:33.524 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.405348+0000", 2024-05-08T18:31:33.524 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00050483600000000004 2024-05-08T18:31:33.524 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.524 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.524 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:33.524 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.405491+0000", 2024-05-08T18:31:33.524 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014349299999999999 2024-05-08T18:31:33.524 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.524 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.524 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:33.524 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.405601+0000", 2024-05-08T18:31:33.525 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000109968 2024-05-08T18:31:33.525 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:33.525 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:33.525 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:33.525 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.525 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.525 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:33.525 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.484247+0000", 2024-05-08T18:31:33.525 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 100.948037107, 2024-05-08T18:31:33.525 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028903679999999999, 2024-05-08T18:31:33.525 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:33.525 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:33.525 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:33.525 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:33.525 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:33.526 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:33.526 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 907 2024-05-08T18:31:33.526 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.526 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:33.526 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.526 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:33.526 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.484247+0000", 2024-05-08T18:31:33.526 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:33.526 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.526 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.526 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:33.526 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.484247+0000", 2024-05-08T18:31:33.526 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:33.527 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.527 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.527 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:33.527 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.484250+0000", 2024-05-08T18:31:33.527 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6900000000000001e-06 2024-05-08T18:31:33.527 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.527 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.527 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:33.527 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.484263+0000", 2024-05-08T18:31:33.527 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2967e-05 2024-05-08T18:31:33.527 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.527 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.527 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:33.527 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.484294+0000", 2024-05-08T18:31:33.528 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1016000000000003e-05 2024-05-08T18:31:33.528 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.528 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.528 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:33.528 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.484309+0000", 2024-05-08T18:31:33.528 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5187e-05 2024-05-08T18:31:33.528 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.528 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.528 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:33.528 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.484467+0000", 2024-05-08T18:31:33.528 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015810499999999999 2024-05-08T18:31:33.528 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.528 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.528 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:33.529 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.484698+0000", 2024-05-08T18:31:33.529 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000230852 2024-05-08T18:31:33.529 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.529 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.529 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:31:33.529 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.485026+0000", 2024-05-08T18:31:33.529 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00032833 2024-05-08T18:31:33.529 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.529 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.529 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:33.529 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.486177+0000", 2024-05-08T18:31:33.529 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0011504309999999999 2024-05-08T18:31:33.529 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.529 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.530 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:33.530 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.486978+0000", 2024-05-08T18:31:33.530 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000801161 2024-05-08T18:31:33.530 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.530 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.530 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:33.530 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.487068+0000", 2024-05-08T18:31:33.530 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0435999999999999e-05 2024-05-08T18:31:33.530 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.530 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.530 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:33.530 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.487137+0000", 2024-05-08T18:31:33.530 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9193e-05 2024-05-08T18:31:33.531 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:33.531 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:33.531 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:33.531 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.531 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.531 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:33.531 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.585363+0000", 2024-05-08T18:31:33.531 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 100.846921264, 2024-05-08T18:31:33.531 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028400080000000002, 2024-05-08T18:31:33.531 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:33.531 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:33.531 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:33.531 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:33.531 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:33.531 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:33.532 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 949 2024-05-08T18:31:33.532 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.532 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:33.532 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.532 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:33.532 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.585363+0000", 2024-05-08T18:31:33.532 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:33.532 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.532 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.532 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:33.532 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.585363+0000", 2024-05-08T18:31:33.532 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:33.532 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.533 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.533 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:33.533 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.585366+0000", 2024-05-08T18:31:33.533 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7099999999999999e-06 2024-05-08T18:31:33.533 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.533 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.533 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:33.533 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.585378+0000", 2024-05-08T18:31:33.533 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1970000000000001e-05 2024-05-08T18:31:33.533 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.533 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.533 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:33.533 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.585408+0000", 2024-05-08T18:31:33.533 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0389999999999999e-05 2024-05-08T18:31:33.534 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.534 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.534 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:33.534 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.585423+0000", 2024-05-08T18:31:33.534 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4929999999999999e-05 2024-05-08T18:31:33.534 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.534 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.534 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:33.534 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.585559+0000", 2024-05-08T18:31:33.534 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013563599999999999 2024-05-08T18:31:33.534 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.534 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.534 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:33.534 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.585780+0000", 2024-05-08T18:31:33.535 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000221828 2024-05-08T18:31:33.535 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.535 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.535 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:33.535 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.586121+0000", 2024-05-08T18:31:33.535 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000340181 2024-05-08T18:31:33.535 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.535 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.535 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:33.535 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.587268+0000", 2024-05-08T18:31:33.535 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001146984 2024-05-08T18:31:33.535 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.535 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.535 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:33.536 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.588047+0000", 2024-05-08T18:31:33.536 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000779877 2024-05-08T18:31:33.536 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.536 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.536 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:33.536 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.588136+0000", 2024-05-08T18:31:33.536 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8483e-05 2024-05-08T18:31:33.536 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.536 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.536 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:33.536 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.588203+0000", 2024-05-08T18:31:33.536 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7019000000000003e-05 2024-05-08T18:31:33.536 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:33.536 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:33.537 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:33.537 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.537 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.537 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:951 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:33.537 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.589044+0000", 2024-05-08T18:31:33.537 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 100.843239842, 2024-05-08T18:31:33.537 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002802672, 2024-05-08T18:31:33.537 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:33.537 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:33.537 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:33.537 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:33.537 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:33.537 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:33.537 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 951 2024-05-08T18:31:33.538 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.538 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:33.538 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.538 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:33.538 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.589044+0000", 2024-05-08T18:31:33.538 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:33.538 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.538 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.538 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:33.538 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.589044+0000", 2024-05-08T18:31:33.538 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:33.538 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.538 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.538 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:33.539 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.589046+0000", 2024-05-08T18:31:33.539 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6670000000000001e-06 2024-05-08T18:31:33.539 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.539 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.539 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:33.539 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.589054+0000", 2024-05-08T18:31:33.539 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.2600000000000005e-06 2024-05-08T18:31:33.539 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.539 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.539 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:33.539 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.589076+0000", 2024-05-08T18:31:33.539 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1373e-05 2024-05-08T18:31:33.539 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.539 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.540 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:33.540 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.589088+0000", 2024-05-08T18:31:33.540 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2768999999999999e-05 2024-05-08T18:31:33.540 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.540 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.540 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:33.540 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.589220+0000", 2024-05-08T18:31:33.540 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013146300000000001 2024-05-08T18:31:33.540 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.540 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.540 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:33.540 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.589462+0000", 2024-05-08T18:31:33.540 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024250500000000001 2024-05-08T18:31:33.541 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.541 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.541 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:33.541 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.589956+0000", 2024-05-08T18:31:33.541 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00049331600000000005 2024-05-08T18:31:33.541 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.541 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.541 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:33.541 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.591337+0000", 2024-05-08T18:31:33.541 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0013816290000000001 2024-05-08T18:31:33.541 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.541 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.541 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:33.541 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.591688+0000", 2024-05-08T18:31:33.541 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00035083400000000001 2024-05-08T18:31:33.542 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.542 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.542 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:33.542 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.591780+0000", 2024-05-08T18:31:33.542 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.2312999999999995e-05 2024-05-08T18:31:33.542 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.542 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.542 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:33.542 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.591847+0000", 2024-05-08T18:31:33.542 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6543000000000003e-05 2024-05-08T18:31:33.542 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:33.542 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:33.542 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:33.543 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.543 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.543 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:33.543 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.599312+0000", 2024-05-08T18:31:33.543 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 100.83297237799999, 2024-05-08T18:31:33.543 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0027928190000000002, 2024-05-08T18:31:33.543 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:33.543 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:33.543 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:33.543 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:33.543 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:33.543 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:33.543 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 955 2024-05-08T18:31:33.543 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.544 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:33.544 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.544 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:33.544 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.599312+0000", 2024-05-08T18:31:33.544 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:33.544 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.544 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.544 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:33.544 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.599312+0000", 2024-05-08T18:31:33.544 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:33.544 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.544 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.544 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:33.544 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.599314+0000", 2024-05-08T18:31:33.545 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.396e-06 2024-05-08T18:31:33.545 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.545 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.545 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:33.545 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.599325+0000", 2024-05-08T18:31:33.545 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1063999999999999e-05 2024-05-08T18:31:33.545 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.545 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.545 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:33.545 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.599354+0000", 2024-05-08T18:31:33.545 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8462999999999998e-05 2024-05-08T18:31:33.545 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.545 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.545 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:33.546 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.599369+0000", 2024-05-08T18:31:33.546 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4963000000000001e-05 2024-05-08T18:31:33.546 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.546 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.546 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:33.546 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.599503+0000", 2024-05-08T18:31:33.546 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013385299999999999 2024-05-08T18:31:33.546 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.546 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.546 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:33.546 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.599744+0000", 2024-05-08T18:31:33.546 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024137400000000001 2024-05-08T18:31:33.546 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.547 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.547 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:33.547 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.600084+0000", 2024-05-08T18:31:33.547 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00033999399999999998 2024-05-08T18:31:33.547 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.547 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.547 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:33.547 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.601319+0000", 2024-05-08T18:31:33.547 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012348140000000001 2024-05-08T18:31:33.547 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.547 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.547 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:33.547 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.601956+0000", 2024-05-08T18:31:33.548 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00063721199999999996 2024-05-08T18:31:33.548 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.548 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.548 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:33.548 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.602038+0000", 2024-05-08T18:31:33.548 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.1705999999999993e-05 2024-05-08T18:31:33.548 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:33.548 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:33.548 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:33.548 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.602105+0000", 2024-05-08T18:31:33.548 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6979999999999999e-05 2024-05-08T18:31:33.548 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:33.548 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:33.548 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:33.548 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:33.549 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:33.549 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:33.550 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-08T18:31:33.551 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:31:33.550+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:31:33.651 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:31:33.645+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:31:33.668 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:33.668 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:31:33.669 INFO:teuthology.orchestra.run.smithi097.stdout: "num_ops": 0 2024-05-08T18:31:33.669 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:33.682 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-08T18:31:33.752 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:31:33.746+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:31:33.843 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:33.843 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:31:33.843 INFO:teuthology.orchestra.run.smithi097.stdout: "complaint_time": 30, 2024-05-08T18:31:33.843 INFO:teuthology.orchestra.run.smithi097.stdout: "num_blocked_ops": 0 2024-05-08T18:31:33.843 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:33.852 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:31:33.849+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:31:33.856 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-08T18:31:33.924 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-08T18:31:33.953 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:31:33.950+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:31:34.022 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:34.022 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2024-05-08T18:31:34.022 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2024-05-08T18:31:34.022 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-05-08T18:31:34.022 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.022 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:57 7.3 7:c609908c:::notify.5:head [watch watch cookie 94069412621696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:31:34.022 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:48.668590+0000", 2024-05-08T18:31:34.023 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 105.352263358, 2024-05-08T18:31:34.023 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0054375830000000002, 2024-05-08T18:31:34.023 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:34.023 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:34.023 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:34.023 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:34.023 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:34.023 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:34.023 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 57 2024-05-08T18:31:34.023 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.023 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:34.023 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.023 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:34.024 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668590+0000", 2024-05-08T18:31:34.024 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:34.024 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.024 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.024 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:34.024 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668590+0000", 2024-05-08T18:31:34.024 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:34.024 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.024 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.024 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:34.024 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668592+0000", 2024-05-08T18:31:34.024 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0930000000000001e-06 2024-05-08T18:31:34.024 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.024 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.025 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:34.025 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668619+0000", 2024-05-08T18:31:34.025 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7396999999999999e-05 2024-05-08T18:31:34.025 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.025 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.025 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:34.025 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668650+0000", 2024-05-08T18:31:34.025 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0620000000000002e-05 2024-05-08T18:31:34.025 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.025 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.025 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:34.025 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668672+0000", 2024-05-08T18:31:34.025 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2093e-05 2024-05-08T18:31:34.025 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.026 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.026 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:34.026 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668782+0000", 2024-05-08T18:31:34.026 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011010600000000001 2024-05-08T18:31:34.026 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.026 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.026 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:34.026 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668934+0000", 2024-05-08T18:31:34.026 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000152268 2024-05-08T18:31:34.026 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.026 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.026 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-05-08T18:31:34.026 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669177+0000", 2024-05-08T18:31:34.026 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024286500000000001 2024-05-08T18:31:34.027 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.027 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.027 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:34.027 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.670404+0000", 2024-05-08T18:31:34.027 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001226932 2024-05-08T18:31:34.027 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.027 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.027 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:34.027 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.673822+0000", 2024-05-08T18:31:34.027 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003417776 2024-05-08T18:31:34.027 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.027 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.027 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:34.027 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.673924+0000", 2024-05-08T18:31:34.028 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000102379 2024-05-08T18:31:34.028 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.028 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.028 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:34.028 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674027+0000", 2024-05-08T18:31:34.028 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010305400000000001 2024-05-08T18:31:34.028 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:34.028 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:34.028 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:34.028 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.028 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.028 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:58 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:31:34.028 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:48.668750+0000", 2024-05-08T18:31:34.028 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 105.35210293199999, 2024-05-08T18:31:34.028 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0057687559999999999, 2024-05-08T18:31:34.029 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:34.029 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:34.029 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:34.029 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:34.029 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:34.029 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:34.029 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 58 2024-05-08T18:31:34.029 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.029 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:34.029 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.029 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:34.029 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668750+0000", 2024-05-08T18:31:34.029 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:34.030 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.030 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.030 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:34.030 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668750+0000", 2024-05-08T18:31:34.030 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:34.030 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.030 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.030 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:34.030 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668752+0000", 2024-05-08T18:31:34.030 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.64e-06 2024-05-08T18:31:34.030 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.030 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.030 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:34.030 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668760+0000", 2024-05-08T18:31:34.031 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5529999999999993e-06 2024-05-08T18:31:34.031 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.031 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.031 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:34.031 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668787+0000", 2024-05-08T18:31:34.031 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6475999999999999e-05 2024-05-08T18:31:34.031 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.031 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.031 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:34.031 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668804+0000", 2024-05-08T18:31:34.031 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7163000000000002e-05 2024-05-08T18:31:34.031 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.031 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.031 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:34.031 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668906+0000", 2024-05-08T18:31:34.032 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010241 2024-05-08T18:31:34.032 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.032 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.032 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:34.032 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669068+0000", 2024-05-08T18:31:34.032 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016144400000000001 2024-05-08T18:31:34.032 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.032 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.032 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-05-08T18:31:34.032 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669226+0000", 2024-05-08T18:31:34.032 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000158639 2024-05-08T18:31:34.032 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.032 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.032 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:34.033 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.670439+0000", 2024-05-08T18:31:34.033 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012124480000000001 2024-05-08T18:31:34.033 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.033 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.033 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:34.033 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674406+0000", 2024-05-08T18:31:34.033 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0039675259999999999 2024-05-08T18:31:34.033 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.033 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.033 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:34.033 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674469+0000", 2024-05-08T18:31:34.033 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.2903000000000004e-05 2024-05-08T18:31:34.033 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.033 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.033 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:34.034 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674519+0000", 2024-05-08T18:31:34.034 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9554e-05 2024-05-08T18:31:34.034 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:34.034 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:34.034 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:34.034 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.034 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.034 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:31:34.034 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.675404+0000", 2024-05-08T18:31:34.034 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 102.345449161, 2024-05-08T18:31:34.034 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003903147, 2024-05-08T18:31:34.034 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:34.034 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:34.034 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:34.035 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:34.035 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:34.035 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:34.035 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 207 2024-05-08T18:31:34.035 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.035 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:34.035 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.035 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:34.035 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675404+0000", 2024-05-08T18:31:34.035 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:34.035 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.037 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.037 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:34.037 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675404+0000", 2024-05-08T18:31:34.037 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:34.037 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.038 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.038 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:34.038 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675407+0000", 2024-05-08T18:31:34.038 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1729999999999999e-06 2024-05-08T18:31:34.038 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.038 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.038 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:34.038 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675422+0000", 2024-05-08T18:31:34.038 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.485e-05 2024-05-08T18:31:34.038 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.038 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.038 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:34.038 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675454+0000", 2024-05-08T18:31:34.038 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1656000000000003e-05 2024-05-08T18:31:34.039 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.039 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.039 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:34.039 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675470+0000", 2024-05-08T18:31:34.039 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.626e-05 2024-05-08T18:31:34.039 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.039 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.039 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:34.039 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675683+0000", 2024-05-08T18:31:34.039 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021312600000000001 2024-05-08T18:31:34.039 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.039 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.039 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:34.039 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675972+0000", 2024-05-08T18:31:34.040 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00028885100000000002 2024-05-08T18:31:34.040 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.040 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.040 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:34.040 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.676369+0000", 2024-05-08T18:31:34.040 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000397227 2024-05-08T18:31:34.040 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.040 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.040 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:34.040 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.677780+0000", 2024-05-08T18:31:34.040 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001411186 2024-05-08T18:31:34.040 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.040 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.040 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:34.041 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679153+0000", 2024-05-08T18:31:34.041 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0013725720000000001 2024-05-08T18:31:34.041 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.041 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.041 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:34.041 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679240+0000", 2024-05-08T18:31:34.041 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7412999999999998e-05 2024-05-08T18:31:34.041 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.041 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.041 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:34.041 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679307+0000", 2024-05-08T18:31:34.041 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6833000000000002e-05 2024-05-08T18:31:34.041 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:34.041 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:34.042 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:34.042 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.042 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.042 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:34.042 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.721317+0000", 2024-05-08T18:31:34.042 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 102.29953641500001, 2024-05-08T18:31:34.042 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032842140000000001, 2024-05-08T18:31:34.042 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:34.042 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:34.043 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:34.043 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:34.043 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:34.043 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:34.043 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 216 2024-05-08T18:31:34.043 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.043 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:34.043 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.043 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:34.043 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.721317+0000", 2024-05-08T18:31:34.043 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:34.043 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.043 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.043 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:34.044 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.721317+0000", 2024-05-08T18:31:34.044 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:34.044 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.044 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.044 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:34.044 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.721320+0000", 2024-05-08T18:31:34.044 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.303e-06 2024-05-08T18:31:34.044 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.044 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.044 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:34.044 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.721335+0000", 2024-05-08T18:31:34.044 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4543e-05 2024-05-08T18:31:34.044 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.044 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.045 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:34.045 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.721370+0000", 2024-05-08T18:31:34.045 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5336000000000002e-05 2024-05-08T18:31:34.045 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.045 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.045 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:34.045 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.721393+0000", 2024-05-08T18:31:34.045 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2710000000000001e-05 2024-05-08T18:31:34.045 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.045 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.045 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:34.045 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.721592+0000", 2024-05-08T18:31:34.045 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00019917900000000001 2024-05-08T18:31:34.045 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.046 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.046 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:34.046 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.721815+0000", 2024-05-08T18:31:34.046 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000223742 2024-05-08T18:31:34.046 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.046 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.046 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:34.046 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.722268+0000", 2024-05-08T18:31:34.046 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00045295900000000001 2024-05-08T18:31:34.046 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.046 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.046 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:34.046 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.723878+0000", 2024-05-08T18:31:34.046 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001609828 2024-05-08T18:31:34.047 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.047 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.047 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:34.047 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.724433+0000", 2024-05-08T18:31:34.047 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00055512499999999995 2024-05-08T18:31:34.047 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.047 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.047 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:34.047 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.724528+0000", 2024-05-08T18:31:34.047 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.4887000000000001e-05 2024-05-08T18:31:34.048 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.048 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.048 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:34.048 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.724601+0000", 2024-05-08T18:31:34.048 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2601999999999994e-05 2024-05-08T18:31:34.048 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:34.048 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:34.048 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:34.048 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.048 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.048 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:34.048 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.761586+0000", 2024-05-08T18:31:34.048 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 102.259267569, 2024-05-08T18:31:34.049 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031756979999999998, 2024-05-08T18:31:34.049 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:34.049 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:34.049 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:34.049 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:34.049 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:34.049 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:34.049 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 227 2024-05-08T18:31:34.049 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.049 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:34.049 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.049 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:34.049 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.761586+0000", 2024-05-08T18:31:34.049 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:34.049 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.050 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.050 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:34.050 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.761586+0000", 2024-05-08T18:31:34.050 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:34.050 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.050 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.050 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:34.050 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.761588+0000", 2024-05-08T18:31:34.050 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7499999999999999e-06 2024-05-08T18:31:34.050 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.050 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.050 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:34.050 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.761600+0000", 2024-05-08T18:31:34.050 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2003e-05 2024-05-08T18:31:34.051 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.051 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.051 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:34.051 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.761632+0000", 2024-05-08T18:31:34.051 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1933000000000001e-05 2024-05-08T18:31:34.051 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.051 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.051 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:34.051 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.761648+0000", 2024-05-08T18:31:34.051 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5339999999999999e-05 2024-05-08T18:31:34.051 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.051 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.051 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:34.051 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.761773+0000", 2024-05-08T18:31:34.052 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012576199999999999 2024-05-08T18:31:34.052 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.052 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.052 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:34.052 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.762037+0000", 2024-05-08T18:31:34.052 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00026385100000000001 2024-05-08T18:31:34.052 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.052 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.052 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:34.052 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.762455+0000", 2024-05-08T18:31:34.052 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00041760700000000002 2024-05-08T18:31:34.052 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.052 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.053 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:34.053 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.764035+0000", 2024-05-08T18:31:34.053 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001580318 2024-05-08T18:31:34.053 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.053 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.053 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:34.053 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.764602+0000", 2024-05-08T18:31:34.053 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00056661899999999998 2024-05-08T18:31:34.053 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.053 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.053 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:34.053 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.764685+0000", 2024-05-08T18:31:34.053 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.3562999999999999e-05 2024-05-08T18:31:34.053 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.054 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.054 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:34.054 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.764761+0000", 2024-05-08T18:31:34.054 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.5951999999999994e-05 2024-05-08T18:31:34.054 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:34.054 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:34.054 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:34.054 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.054 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.054 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:34.054 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.768858+0000", 2024-05-08T18:31:34.055 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 102.251994986, 2024-05-08T18:31:34.055 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031906619999999999, 2024-05-08T18:31:34.055 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:34.055 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:34.055 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:34.055 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:34.055 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:34.055 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:34.055 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 229 2024-05-08T18:31:34.055 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.055 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:34.055 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.055 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:34.055 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.768858+0000", 2024-05-08T18:31:34.056 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:34.056 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.056 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.056 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:34.056 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.768858+0000", 2024-05-08T18:31:34.056 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:34.056 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.056 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.056 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:34.056 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.768861+0000", 2024-05-08T18:31:34.056 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5469999999999999e-06 2024-05-08T18:31:34.056 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.056 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.056 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:34.056 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.768872+0000", 2024-05-08T18:31:34.057 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1712999999999999e-05 2024-05-08T18:31:34.057 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.057 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.057 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:34.057 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.768903+0000", 2024-05-08T18:31:34.057 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0636000000000003e-05 2024-05-08T18:31:34.057 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.057 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.057 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:34.057 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.768918+0000", 2024-05-08T18:31:34.057 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4977000000000001e-05 2024-05-08T18:31:34.057 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.057 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.058 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:34.058 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.769037+0000", 2024-05-08T18:31:34.058 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011918599999999999 2024-05-08T18:31:34.058 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.058 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.058 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:34.058 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.769256+0000", 2024-05-08T18:31:34.058 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021839400000000001 2024-05-08T18:31:34.058 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.058 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.058 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:34.058 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.769656+0000", 2024-05-08T18:31:34.058 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00040066400000000001 2024-05-08T18:31:34.058 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.059 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.059 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:34.059 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.771116+0000", 2024-05-08T18:31:34.059 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001459389 2024-05-08T18:31:34.059 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.059 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.059 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:34.059 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.771896+0000", 2024-05-08T18:31:34.059 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00077997400000000001 2024-05-08T18:31:34.059 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.059 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.059 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:34.059 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.771984+0000", 2024-05-08T18:31:34.059 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8483e-05 2024-05-08T18:31:34.060 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.060 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.060 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:34.060 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772049+0000", 2024-05-08T18:31:34.060 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.4698999999999998e-05 2024-05-08T18:31:34.060 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:34.060 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:34.060 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:34.060 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.060 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.060 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:34.060 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.776086+0000", 2024-05-08T18:31:34.060 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 102.24476699500001, 2024-05-08T18:31:34.060 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0037528710000000001, 2024-05-08T18:31:34.060 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:34.061 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:34.061 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:34.061 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:34.061 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:34.061 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:34.061 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 231 2024-05-08T18:31:34.061 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.061 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:34.061 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.061 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:34.061 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.776086+0000", 2024-05-08T18:31:34.061 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:34.061 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.061 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.062 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:34.062 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.776086+0000", 2024-05-08T18:31:34.062 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:34.062 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.062 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.062 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:34.062 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.776089+0000", 2024-05-08T18:31:34.062 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8870000000000001e-06 2024-05-08T18:31:34.062 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.062 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.062 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:34.062 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.776102+0000", 2024-05-08T18:31:34.062 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.294e-05 2024-05-08T18:31:34.063 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.063 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.063 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:34.063 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.776132+0000", 2024-05-08T18:31:34.063 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0113000000000001e-05 2024-05-08T18:31:34.063 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.063 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.063 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:34.063 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.776150+0000", 2024-05-08T18:31:34.063 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8216999999999999e-05 2024-05-08T18:31:34.063 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.063 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.063 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:34.064 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.776268+0000", 2024-05-08T18:31:34.064 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000117395 2024-05-08T18:31:34.064 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.064 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.064 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:34.064 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.776514+0000", 2024-05-08T18:31:34.064 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024602899999999999 2024-05-08T18:31:34.064 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.064 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.064 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:31:34.064 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.776920+0000", 2024-05-08T18:31:34.064 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000406723 2024-05-08T18:31:34.064 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.064 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.064 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:34.065 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.778360+0000", 2024-05-08T18:31:34.065 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0014393279999999999 2024-05-08T18:31:34.065 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.065 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.065 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:34.065 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.779687+0000", 2024-05-08T18:31:34.065 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001327674 2024-05-08T18:31:34.065 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.065 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.065 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:34.065 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.779777+0000", 2024-05-08T18:31:34.065 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9152000000000003e-05 2024-05-08T18:31:34.065 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.066 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.066 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:34.066 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.779839+0000", 2024-05-08T18:31:34.066 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.2413e-05 2024-05-08T18:31:34.066 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:34.066 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:34.066 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:34.066 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.066 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.066 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:257 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:34.066 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.802295+0000", 2024-05-08T18:31:34.066 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 102.218557855, 2024-05-08T18:31:34.066 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0030517880000000002, 2024-05-08T18:31:34.066 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:34.067 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:34.067 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:34.067 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:34.067 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:34.067 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:34.067 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 257 2024-05-08T18:31:34.067 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.067 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:34.067 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.067 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:34.067 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.802295+0000", 2024-05-08T18:31:34.067 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:34.067 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.068 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.068 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:34.068 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.802295+0000", 2024-05-08T18:31:34.068 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:34.068 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.068 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.068 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:34.068 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.802296+0000", 2024-05-08T18:31:34.068 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.6700000000000002e-07 2024-05-08T18:31:34.068 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.068 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.068 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:34.068 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.802301+0000", 2024-05-08T18:31:34.068 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.0250000000000002e-06 2024-05-08T18:31:34.069 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.069 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.069 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:34.069 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.802321+0000", 2024-05-08T18:31:34.069 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9521000000000002e-05 2024-05-08T18:31:34.069 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.069 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.069 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:34.069 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.802330+0000", 2024-05-08T18:31:34.069 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.4259999999999992e-06 2024-05-08T18:31:34.069 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.069 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.069 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:34.069 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.802386+0000", 2024-05-08T18:31:34.070 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5974999999999999e-05 2024-05-08T18:31:34.070 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.070 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.070 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:34.070 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.802463+0000", 2024-05-08T18:31:34.070 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6582999999999995e-05 2024-05-08T18:31:34.070 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.070 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.070 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:34.070 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.802613+0000", 2024-05-08T18:31:34.070 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000150715 2024-05-08T18:31:34.070 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.070 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.071 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:34.071 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.803223+0000", 2024-05-08T18:31:34.071 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00060949799999999998 2024-05-08T18:31:34.071 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.071 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.071 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:34.071 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.805250+0000", 2024-05-08T18:31:34.071 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0020268339999999999 2024-05-08T18:31:34.071 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.071 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.071 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:34.071 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.805303+0000", 2024-05-08T18:31:34.071 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3562e-05 2024-05-08T18:31:34.071 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.072 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.072 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:34.072 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.805347+0000", 2024-05-08T18:31:34.072 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3682e-05 2024-05-08T18:31:34.072 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:34.072 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:34.072 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:34.072 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.072 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.072 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:422 6.c 6:338eb7e9:::obj_delete_at_hint.0000000008:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:34.072 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.847436+0000", 2024-05-08T18:31:34.072 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 102.173416792, 2024-05-08T18:31:34.072 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0029413439999999998, 2024-05-08T18:31:34.072 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:34.073 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:34.073 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:34.073 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:34.073 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:34.073 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:34.073 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 422 2024-05-08T18:31:34.073 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.073 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:34.073 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.073 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:34.073 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847436+0000", 2024-05-08T18:31:34.073 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:34.073 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.073 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.074 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:34.074 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847436+0000", 2024-05-08T18:31:34.074 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:34.074 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.074 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.074 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:34.074 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847437+0000", 2024-05-08T18:31:34.074 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.009e-06 2024-05-08T18:31:34.074 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.074 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.074 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:34.074 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847442+0000", 2024-05-08T18:31:34.074 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9049999999999996e-06 2024-05-08T18:31:34.075 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.075 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.075 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:34.075 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847454+0000", 2024-05-08T18:31:34.075 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1358e-05 2024-05-08T18:31:34.075 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.075 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.075 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:34.075 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847459+0000", 2024-05-08T18:31:34.075 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7180000000000001e-06 2024-05-08T18:31:34.075 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.075 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.075 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:34.075 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847516+0000", 2024-05-08T18:31:34.075 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6558999999999998e-05 2024-05-08T18:31:34.076 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.076 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.076 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:34.076 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847582+0000", 2024-05-08T18:31:34.076 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5772000000000007e-05 2024-05-08T18:31:34.076 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.076 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.076 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:31:34.076 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847718+0000", 2024-05-08T18:31:34.076 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013664100000000001 2024-05-08T18:31:34.076 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.076 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.076 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:34.076 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.848257+0000", 2024-05-08T18:31:34.077 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00053853699999999996 2024-05-08T18:31:34.077 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.077 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.077 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:34.077 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.850320+0000", 2024-05-08T18:31:34.077 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0020627530000000001 2024-05-08T18:31:34.077 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.077 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.077 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:34.077 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.850351+0000", 2024-05-08T18:31:34.077 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1501000000000002e-05 2024-05-08T18:31:34.077 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.077 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.077 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:34.077 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.850378+0000", 2024-05-08T18:31:34.078 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6591e-05 2024-05-08T18:31:34.078 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:34.078 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:34.078 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:34.078 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.078 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.078 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:535 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:34.078 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.912581+0000", 2024-05-08T18:31:34.078 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 102.10827173200001, 2024-05-08T18:31:34.078 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002943775, 2024-05-08T18:31:34.078 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:34.078 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:34.079 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:34.079 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:34.079 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:34.079 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:34.079 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 535 2024-05-08T18:31:34.079 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.079 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:34.079 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.079 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:34.079 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912581+0000", 2024-05-08T18:31:34.079 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:34.079 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.079 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.079 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:34.080 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912581+0000", 2024-05-08T18:31:34.080 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:34.080 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.080 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.080 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:34.080 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912582+0000", 2024-05-08T18:31:34.080 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.093e-06 2024-05-08T18:31:34.080 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.080 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.080 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:34.080 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912588+0000", 2024-05-08T18:31:34.080 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3920000000000002e-06 2024-05-08T18:31:34.080 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.081 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.081 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:34.081 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912601+0000", 2024-05-08T18:31:34.081 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2911000000000001e-05 2024-05-08T18:31:34.081 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.081 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.081 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:34.081 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912607+0000", 2024-05-08T18:31:34.081 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3960000000000003e-06 2024-05-08T18:31:34.081 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.081 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.081 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:34.082 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912664+0000", 2024-05-08T18:31:34.082 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6410999999999999e-05 2024-05-08T18:31:34.082 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.082 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.082 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:34.082 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912721+0000", 2024-05-08T18:31:34.082 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7141000000000001e-05 2024-05-08T18:31:34.082 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.082 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.082 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:31:34.082 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912842+0000", 2024-05-08T18:31:34.082 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000120868 2024-05-08T18:31:34.082 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.083 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.083 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:34.083 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.913333+0000", 2024-05-08T18:31:34.083 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00049123600000000004 2024-05-08T18:31:34.083 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.083 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.083 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:34.083 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.915446+0000", 2024-05-08T18:31:34.083 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0021135020000000002 2024-05-08T18:31:34.083 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.083 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.083 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:34.083 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.915481+0000", 2024-05-08T18:31:34.083 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4304999999999998e-05 2024-05-08T18:31:34.084 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.084 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.084 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:34.084 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.915525+0000", 2024-05-08T18:31:34.084 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4520000000000001e-05 2024-05-08T18:31:34.084 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:34.084 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:34.084 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:34.084 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.084 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.084 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:541 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:34.084 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.916718+0000", 2024-05-08T18:31:34.084 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 102.10413489699999, 2024-05-08T18:31:34.084 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0041779829999999997, 2024-05-08T18:31:34.085 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:34.085 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:34.085 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:34.085 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:34.085 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:34.085 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:34.085 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 541 2024-05-08T18:31:34.085 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.085 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:34.085 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.085 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:34.085 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.916718+0000", 2024-05-08T18:31:34.085 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:34.085 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.086 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.086 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:34.086 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.916718+0000", 2024-05-08T18:31:34.086 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:34.086 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.086 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.086 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:34.086 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.916719+0000", 2024-05-08T18:31:34.086 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0100000000000005e-07 2024-05-08T18:31:34.086 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.086 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.086 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:34.086 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.916722+0000", 2024-05-08T18:31:34.087 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7760000000000002e-06 2024-05-08T18:31:34.087 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.087 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.087 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:34.087 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.916729+0000", 2024-05-08T18:31:34.087 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.8290000000000008e-06 2024-05-08T18:31:34.087 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.087 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.087 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:34.087 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.916734+0000", 2024-05-08T18:31:34.087 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3109999999999999e-06 2024-05-08T18:31:34.087 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.087 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.087 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:34.088 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.916776+0000", 2024-05-08T18:31:34.088 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.2086999999999999e-05 2024-05-08T18:31:34.088 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.088 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.088 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:34.088 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.916824+0000", 2024-05-08T18:31:34.088 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8412999999999999e-05 2024-05-08T18:31:34.088 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.088 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.088 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:31:34.088 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.916929+0000", 2024-05-08T18:31:34.088 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010480900000000001 2024-05-08T18:31:34.088 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.088 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.089 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:34.089 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.917428+0000", 2024-05-08T18:31:34.089 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00049889599999999997 2024-05-08T18:31:34.089 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.089 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.089 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:34.089 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.920833+0000", 2024-05-08T18:31:34.089 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0034047140000000001 2024-05-08T18:31:34.089 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.089 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.089 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:34.089 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.920868+0000", 2024-05-08T18:31:34.089 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5750999999999997e-05 2024-05-08T18:31:34.089 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.090 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.090 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:34.090 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.920896+0000", 2024-05-08T18:31:34.090 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7796e-05 2024-05-08T18:31:34.090 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:34.090 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:34.090 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:34.090 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.090 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.090 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:778 6.1b 6:dc490aaa:::obj_delete_at_hint.0000000067:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:34.090 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.191226+0000", 2024-05-08T18:31:34.090 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 101.82962662200001, 2024-05-08T18:31:34.090 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0029603540000000001, 2024-05-08T18:31:34.090 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:34.091 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:34.091 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:34.091 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:34.091 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:34.091 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:34.091 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 778 2024-05-08T18:31:34.091 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.091 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:34.091 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.091 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:34.091 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.191226+0000", 2024-05-08T18:31:34.091 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:34.091 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.092 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.092 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:34.092 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.191226+0000", 2024-05-08T18:31:34.092 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:34.092 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.092 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.092 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:34.092 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.191229+0000", 2024-05-08T18:31:34.092 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5299999999999999e-06 2024-05-08T18:31:34.092 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.092 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.092 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:34.092 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.191242+0000", 2024-05-08T18:31:34.092 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2816999999999999e-05 2024-05-08T18:31:34.093 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.093 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.093 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:34.093 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.191274+0000", 2024-05-08T18:31:34.093 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1846e-05 2024-05-08T18:31:34.093 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.093 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.093 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:34.093 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.191288+0000", 2024-05-08T18:31:34.093 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.468e-05 2024-05-08T18:31:34.093 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.093 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.093 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:34.094 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.191468+0000", 2024-05-08T18:31:34.094 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00017983499999999999 2024-05-08T18:31:34.094 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.094 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.094 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:34.094 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.191688+0000", 2024-05-08T18:31:34.094 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021985799999999999 2024-05-08T18:31:34.094 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.094 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.094 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:34.094 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.192001+0000", 2024-05-08T18:31:34.094 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00031337800000000001 2024-05-08T18:31:34.094 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.095 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.095 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:34.095 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.193245+0000", 2024-05-08T18:31:34.095 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012436400000000001 2024-05-08T18:31:34.095 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.095 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.095 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:34.095 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.194036+0000", 2024-05-08T18:31:34.095 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00079059699999999998 2024-05-08T18:31:34.095 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.095 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.095 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:34.096 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.194121+0000", 2024-05-08T18:31:34.096 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5270000000000002e-05 2024-05-08T18:31:34.096 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.096 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.096 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:34.096 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.194187+0000", 2024-05-08T18:31:34.096 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5902999999999996e-05 2024-05-08T18:31:34.096 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:34.096 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:34.096 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:34.096 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.096 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.096 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:780 6.1b 6:dc490aaa:::obj_delete_at_hint.0000000067:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:34.097 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.195206+0000", 2024-05-08T18:31:34.097 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 101.82564665300001, 2024-05-08T18:31:34.097 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00291544, 2024-05-08T18:31:34.097 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:34.097 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:34.097 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:34.097 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:34.097 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:34.097 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:34.097 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 780 2024-05-08T18:31:34.097 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.097 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:34.097 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.098 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:34.098 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.195206+0000", 2024-05-08T18:31:34.098 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:34.098 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.098 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.098 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:34.098 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.195206+0000", 2024-05-08T18:31:34.098 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:34.098 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.098 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.098 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:34.098 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.195208+0000", 2024-05-08T18:31:34.098 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0669999999999999e-06 2024-05-08T18:31:34.099 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.099 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.099 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:34.099 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.195220+0000", 2024-05-08T18:31:34.099 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.131e-05 2024-05-08T18:31:34.099 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.099 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.099 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:34.099 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.195250+0000", 2024-05-08T18:31:34.099 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0562999999999999e-05 2024-05-08T18:31:34.099 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.099 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.099 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:34.100 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.195270+0000", 2024-05-08T18:31:34.100 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9989000000000001e-05 2024-05-08T18:31:34.100 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.100 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.100 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:34.100 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.195395+0000", 2024-05-08T18:31:34.100 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012439600000000001 2024-05-08T18:31:34.100 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.100 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.100 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:34.100 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.195523+0000", 2024-05-08T18:31:34.100 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012824900000000001 2024-05-08T18:31:34.100 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.100 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.101 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:34.101 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.195808+0000", 2024-05-08T18:31:34.101 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00028518100000000002 2024-05-08T18:31:34.101 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.101 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.101 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:34.101 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.196897+0000", 2024-05-08T18:31:34.101 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0010887850000000001 2024-05-08T18:31:34.101 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.101 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.101 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:34.101 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.197964+0000", 2024-05-08T18:31:34.101 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0010671789999999999 2024-05-08T18:31:34.102 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.102 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.102 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:34.102 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.198044+0000", 2024-05-08T18:31:34.102 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.9616000000000005e-05 2024-05-08T18:31:34.102 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.102 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.102 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:34.102 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.198122+0000", 2024-05-08T18:31:34.102 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.8104999999999998e-05 2024-05-08T18:31:34.103 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:34.103 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:34.103 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:34.103 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.103 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.103 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:826 6.6 6:64735f45:::obj_delete_at_hint.0000000083:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:34.103 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.299128+0000", 2024-05-08T18:31:34.103 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 101.72172557499999, 2024-05-08T18:31:34.103 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0029196479999999999, 2024-05-08T18:31:34.103 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:34.103 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:34.103 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:34.103 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:34.103 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:34.104 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:34.104 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 826 2024-05-08T18:31:34.104 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.104 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:34.104 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.104 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:34.104 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.299128+0000", 2024-05-08T18:31:34.104 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:34.104 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.104 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.104 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:34.104 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.299128+0000", 2024-05-08T18:31:34.104 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:34.104 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.105 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.105 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:34.105 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.299129+0000", 2024-05-08T18:31:34.105 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.711e-06 2024-05-08T18:31:34.105 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.105 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.105 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:34.105 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.299137+0000", 2024-05-08T18:31:34.105 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6650000000000003e-06 2024-05-08T18:31:34.105 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.105 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.105 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:34.105 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.299157+0000", 2024-05-08T18:31:34.105 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.02e-05 2024-05-08T18:31:34.106 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.106 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.106 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:34.106 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.299166+0000", 2024-05-08T18:31:34.106 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7530000000000007e-06 2024-05-08T18:31:34.106 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.106 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.106 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:34.106 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.299240+0000", 2024-05-08T18:31:34.106 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.4297999999999999e-05 2024-05-08T18:31:34.106 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.106 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.106 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:34.107 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.299444+0000", 2024-05-08T18:31:34.107 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00020382399999999999 2024-05-08T18:31:34.107 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.107 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.107 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:31:34.107 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.299777+0000", 2024-05-08T18:31:34.107 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00033331700000000002 2024-05-08T18:31:34.107 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.107 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.107 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:34.107 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.301060+0000", 2024-05-08T18:31:34.107 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012829569999999999 2024-05-08T18:31:34.107 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.107 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.107 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:34.108 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.301865+0000", 2024-05-08T18:31:34.108 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00080503400000000004 2024-05-08T18:31:34.108 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.108 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.108 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:34.108 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.301979+0000", 2024-05-08T18:31:34.108 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011324600000000001 2024-05-08T18:31:34.108 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.108 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.108 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:34.109 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.302047+0000", 2024-05-08T18:31:34.109 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8643e-05 2024-05-08T18:31:34.109 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:34.109 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:34.109 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:34.109 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.109 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.109 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:838 6.c 6:330b1641:::obj_delete_at_hint.0000000087:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:34.109 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.328043+0000", 2024-05-08T18:31:34.109 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 101.692810431, 2024-05-08T18:31:34.109 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031589180000000001, 2024-05-08T18:31:34.109 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:34.109 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:34.110 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:34.110 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:34.110 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:34.110 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:34.110 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 838 2024-05-08T18:31:34.110 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.110 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:34.110 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.110 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:34.110 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.328043+0000", 2024-05-08T18:31:34.110 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:34.110 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.110 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.110 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:34.111 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.328043+0000", 2024-05-08T18:31:34.111 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:34.111 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.111 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.111 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:34.111 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.328045+0000", 2024-05-08T18:31:34.111 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3760000000000002e-06 2024-05-08T18:31:34.111 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.111 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.111 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:34.111 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.328057+0000", 2024-05-08T18:31:34.111 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1534e-05 2024-05-08T18:31:34.111 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.111 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.112 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:34.112 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.328087+0000", 2024-05-08T18:31:34.112 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0870000000000001e-05 2024-05-08T18:31:34.112 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.112 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.112 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:34.112 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.328102+0000", 2024-05-08T18:31:34.112 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4679e-05 2024-05-08T18:31:34.112 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.112 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.112 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:34.112 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.328217+0000", 2024-05-08T18:31:34.112 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011519300000000001 2024-05-08T18:31:34.112 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.113 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.113 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:34.113 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.328446+0000", 2024-05-08T18:31:34.113 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00022893499999999999 2024-05-08T18:31:34.113 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.113 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.113 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:31:34.113 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.328770+0000", 2024-05-08T18:31:34.113 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00032349700000000001 2024-05-08T18:31:34.113 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.113 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.113 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:34.113 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.330008+0000", 2024-05-08T18:31:34.113 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001238404 2024-05-08T18:31:34.114 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.114 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.114 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:34.114 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.331026+0000", 2024-05-08T18:31:34.114 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001017612 2024-05-08T18:31:34.114 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.114 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.114 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:34.114 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.331117+0000", 2024-05-08T18:31:34.114 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0932000000000003e-05 2024-05-08T18:31:34.114 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.114 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.114 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:34.115 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.331202+0000", 2024-05-08T18:31:34.115 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.4886e-05 2024-05-08T18:31:34.115 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:34.115 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:34.115 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:34.115 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.115 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.115 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:850 6.6 6:624175ac:::obj_delete_at_hint.0000000091:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:34.115 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.356951+0000", 2024-05-08T18:31:34.115 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 101.66390234399999, 2024-05-08T18:31:34.115 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028779000000000001, 2024-05-08T18:31:34.115 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:34.116 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:34.116 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:34.116 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:34.116 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:34.116 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:34.116 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 850 2024-05-08T18:31:34.116 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.116 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:34.116 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.116 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:34.116 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.356951+0000", 2024-05-08T18:31:34.116 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:34.116 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.116 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.117 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:34.117 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.356951+0000", 2024-05-08T18:31:34.117 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:34.117 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.117 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.117 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:34.117 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.356953+0000", 2024-05-08T18:31:34.117 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.446e-06 2024-05-08T18:31:34.117 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.117 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.117 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:34.117 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.356965+0000", 2024-05-08T18:31:34.117 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1404e-05 2024-05-08T18:31:34.118 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.118 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.118 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:34.118 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.356994+0000", 2024-05-08T18:31:34.118 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9526000000000002e-05 2024-05-08T18:31:34.118 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.118 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.118 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:34.118 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.357009+0000", 2024-05-08T18:31:34.118 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5126000000000001e-05 2024-05-08T18:31:34.118 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.118 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.118 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:34.119 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.357126+0000", 2024-05-08T18:31:34.119 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000116989 2024-05-08T18:31:34.119 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.119 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.119 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:34.119 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.357349+0000", 2024-05-08T18:31:34.119 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00022298899999999999 2024-05-08T18:31:34.119 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.119 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.119 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:31:34.119 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.357665+0000", 2024-05-08T18:31:34.119 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00031592700000000003 2024-05-08T18:31:34.119 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.120 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.120 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:34.120 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.358771+0000", 2024-05-08T18:31:34.120 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001105595 2024-05-08T18:31:34.120 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.120 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.120 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:34.120 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.359672+0000", 2024-05-08T18:31:34.120 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00090080300000000004 2024-05-08T18:31:34.120 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.120 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.120 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:34.120 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.359762+0000", 2024-05-08T18:31:34.120 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0099000000000006e-05 2024-05-08T18:31:34.120 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.121 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.121 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:34.121 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.359829+0000", 2024-05-08T18:31:34.121 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6995999999999993e-05 2024-05-08T18:31:34.121 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:34.121 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:34.121 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:34.121 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.121 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.121 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:852 6.6 6:624175ac:::obj_delete_at_hint.0000000091:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:34.121 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.360655+0000", 2024-05-08T18:31:34.121 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 101.66019847699999, 2024-05-08T18:31:34.121 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028684650000000002, 2024-05-08T18:31:34.121 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:34.122 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:34.122 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:34.122 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:34.122 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:34.122 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:34.122 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 852 2024-05-08T18:31:34.122 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.122 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:34.122 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.122 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:34.122 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.360655+0000", 2024-05-08T18:31:34.122 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:34.122 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.122 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.123 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:34.123 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.360655+0000", 2024-05-08T18:31:34.123 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:34.123 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.123 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.123 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:34.123 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.360656+0000", 2024-05-08T18:31:34.123 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.457e-06 2024-05-08T18:31:34.123 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.123 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.123 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:34.123 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.360663+0000", 2024-05-08T18:31:34.123 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5429999999999999e-06 2024-05-08T18:31:34.123 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.124 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.124 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:34.124 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.360682+0000", 2024-05-08T18:31:34.124 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9020000000000001e-05 2024-05-08T18:31:34.124 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.124 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.124 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:34.124 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.360693+0000", 2024-05-08T18:31:34.124 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.114e-05 2024-05-08T18:31:34.124 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.124 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.124 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:34.124 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.360775+0000", 2024-05-08T18:31:34.125 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.2206000000000005e-05 2024-05-08T18:31:34.125 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.125 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.125 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:34.125 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.360899+0000", 2024-05-08T18:31:34.125 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000124206 2024-05-08T18:31:34.125 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.125 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.125 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:31:34.125 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.361162+0000", 2024-05-08T18:31:34.125 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00026328400000000002 2024-05-08T18:31:34.125 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.125 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.125 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:34.125 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.362180+0000", 2024-05-08T18:31:34.126 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0010175119999999999 2024-05-08T18:31:34.126 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.126 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.126 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:34.126 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.363368+0000", 2024-05-08T18:31:34.126 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001187991 2024-05-08T18:31:34.126 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.126 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.126 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:34.126 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.363456+0000", 2024-05-08T18:31:34.126 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8016999999999994e-05 2024-05-08T18:31:34.126 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.126 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.126 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:34.127 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.363523+0000", 2024-05-08T18:31:34.127 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7088999999999994e-05 2024-05-08T18:31:34.127 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:34.127 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:34.127 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:34.127 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.127 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.127 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:865 6.c 6:31288c1b:::obj_delete_at_hint.0000000096:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:34.127 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.392164+0000", 2024-05-08T18:31:34.127 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 101.628689376, 2024-05-08T18:31:34.127 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0029815470000000002, 2024-05-08T18:31:34.127 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:34.127 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:34.127 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:34.128 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:34.128 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:34.128 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:34.128 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 865 2024-05-08T18:31:34.128 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.128 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:34.128 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.128 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:34.128 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.392164+0000", 2024-05-08T18:31:34.128 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:34.128 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.128 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.128 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:34.129 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.392164+0000", 2024-05-08T18:31:34.129 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:34.129 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.129 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.129 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:34.129 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.392166+0000", 2024-05-08T18:31:34.129 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4059999999999999e-06 2024-05-08T18:31:34.129 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.129 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.129 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:34.129 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.392177+0000", 2024-05-08T18:31:34.129 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1260000000000001e-05 2024-05-08T18:31:34.129 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.129 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.130 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:34.130 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.392208+0000", 2024-05-08T18:31:34.130 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0484000000000002e-05 2024-05-08T18:31:34.130 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.130 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.130 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:34.130 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.392222+0000", 2024-05-08T18:31:34.130 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4343e-05 2024-05-08T18:31:34.130 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.130 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.130 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:34.130 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.392355+0000", 2024-05-08T18:31:34.130 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000132602 2024-05-08T18:31:34.130 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.131 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.131 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:34.131 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.392565+0000", 2024-05-08T18:31:34.131 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000210442 2024-05-08T18:31:34.131 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.131 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.131 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:31:34.131 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.392874+0000", 2024-05-08T18:31:34.131 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00030868099999999999 2024-05-08T18:31:34.131 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.131 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.131 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:34.131 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.394087+0000", 2024-05-08T18:31:34.131 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012133300000000001 2024-05-08T18:31:34.132 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.132 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.132 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:34.132 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.394976+0000", 2024-05-08T18:31:34.132 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000888977 2024-05-08T18:31:34.132 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.132 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.132 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:34.132 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.395068+0000", 2024-05-08T18:31:34.132 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.2188999999999994e-05 2024-05-08T18:31:34.132 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.132 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.132 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:34.132 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.395145+0000", 2024-05-08T18:31:34.133 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6833000000000001e-05 2024-05-08T18:31:34.133 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:34.133 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:34.133 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:34.133 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.133 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.133 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:871 6.11 6:8d7f253a:::obj_delete_at_hint.0000000098:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:34.133 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.405724+0000", 2024-05-08T18:31:34.133 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 101.61512882, 2024-05-08T18:31:34.133 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0030012530000000002, 2024-05-08T18:31:34.133 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:34.133 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:34.133 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:34.133 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:34.134 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:34.134 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:34.134 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 871 2024-05-08T18:31:34.134 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.134 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:34.134 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.134 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:34.134 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.405724+0000", 2024-05-08T18:31:34.134 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:34.134 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.134 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.134 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:34.134 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.405724+0000", 2024-05-08T18:31:34.135 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:34.135 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.135 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.135 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:34.135 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.405726+0000", 2024-05-08T18:31:34.135 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1299999999999999e-06 2024-05-08T18:31:34.135 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.135 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.135 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:34.135 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.405737+0000", 2024-05-08T18:31:34.135 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0763e-05 2024-05-08T18:31:34.135 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.135 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.135 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:34.135 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.405762+0000", 2024-05-08T18:31:34.136 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5323000000000001e-05 2024-05-08T18:31:34.136 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.136 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.136 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:34.136 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.405776+0000", 2024-05-08T18:31:34.136 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3862999999999999e-05 2024-05-08T18:31:34.136 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.136 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.136 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:34.137 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.405928+0000", 2024-05-08T18:31:34.137 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015190000000000001 2024-05-08T18:31:34.137 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.137 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.137 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:34.137 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.406159+0000", 2024-05-08T18:31:34.137 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023114399999999999 2024-05-08T18:31:34.137 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.137 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.137 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:34.138 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.406453+0000", 2024-05-08T18:31:34.138 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00029329699999999998 2024-05-08T18:31:34.138 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.138 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.138 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:34.138 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.408103+0000", 2024-05-08T18:31:34.138 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0016499869999999999 2024-05-08T18:31:34.138 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.138 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.138 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:34.138 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.408520+0000", 2024-05-08T18:31:34.138 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00041694099999999999 2024-05-08T18:31:34.138 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.139 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.139 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:34.139 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.408606+0000", 2024-05-08T18:31:34.139 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6809000000000002e-05 2024-05-08T18:31:34.139 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.139 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.139 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:34.139 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.408726+0000", 2024-05-08T18:31:34.139 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000119096 2024-05-08T18:31:34.139 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:34.139 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:34.139 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:34.139 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.139 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.140 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:934 6.11 6:8cd774bc:::obj_delete_at_hint.0000000119:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:34.140 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.550387+0000", 2024-05-08T18:31:34.140 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 101.470465867, 2024-05-08T18:31:34.140 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0033028739999999999, 2024-05-08T18:31:34.140 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:34.140 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:34.140 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:34.140 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:34.140 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:34.140 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:34.140 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 934 2024-05-08T18:31:34.140 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.140 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:34.141 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.141 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:34.141 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.550387+0000", 2024-05-08T18:31:34.141 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:34.141 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.141 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.141 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:34.141 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.550387+0000", 2024-05-08T18:31:34.141 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:34.141 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.141 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.141 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:34.141 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.550390+0000", 2024-05-08T18:31:34.141 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.706e-06 2024-05-08T18:31:34.142 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.142 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.142 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:34.142 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.550401+0000", 2024-05-08T18:31:34.142 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1437000000000001e-05 2024-05-08T18:31:34.142 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.142 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.142 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:34.142 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.550433+0000", 2024-05-08T18:31:34.142 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2005999999999998e-05 2024-05-08T18:31:34.142 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.143 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.143 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:34.143 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.550448+0000", 2024-05-08T18:31:34.143 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5007e-05 2024-05-08T18:31:34.143 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.143 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.143 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:34.143 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.550607+0000", 2024-05-08T18:31:34.143 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000158288 2024-05-08T18:31:34.143 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.143 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.143 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:34.143 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.550974+0000", 2024-05-08T18:31:34.144 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00036768400000000001 2024-05-08T18:31:34.144 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.144 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.144 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:34.144 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.551516+0000", 2024-05-08T18:31:34.144 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00054126900000000004 2024-05-08T18:31:34.144 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.144 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.144 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:34.144 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.552847+0000", 2024-05-08T18:31:34.144 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0013308899999999999 2024-05-08T18:31:34.144 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.144 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.145 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:34.145 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.553531+0000", 2024-05-08T18:31:34.145 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00068438799999999997 2024-05-08T18:31:34.145 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.145 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.145 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:34.145 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.553621+0000", 2024-05-08T18:31:34.145 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9779999999999998e-05 2024-05-08T18:31:34.145 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:34.145 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:34.145 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:34.145 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.553690+0000", 2024-05-08T18:31:34.145 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9418999999999994e-05 2024-05-08T18:31:34.145 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:34.146 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:34.146 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:34.146 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:34.146 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:34.146 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:34.148 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-08T18:31:34.148 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2024-05-08T18:31:34.148 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:31:34.149 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2024-05-08T18:31:34.149 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:31:34.149 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2024-05-08T18:31:34.150 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:31:34.150 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2024-05-08T18:31:34.150 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:31:34.150 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:31:34.141+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:31:34.155 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2024-05-08T18:31:34.156 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:31:34.174 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2024-05-08T18:31:34.174 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:31:34.193 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2024-05-08T18:31:34.193 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:31:34.213 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2024-05-08T18:31:34.213 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:31:34.248 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:31:34.246+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:31:34.283 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:34.284 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:34.298 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-08T18:31:34.385 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:31:34.382+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:31:34.450 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:31:34.445+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:31:34.465 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:34.465 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:34.479 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-08T18:31:34.565 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:31:34.562+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:31:34.649 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:34.649 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:34.652 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:31:34.646+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:31:34.662 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-08T18:31:34.752 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:31:34.750+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:31:34.829 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:34.829 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:34.843 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-08T18:31:34.853 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:31:34.849+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:31:34.954 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:31:34.949+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:31:35.008 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:35.008 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:35.022 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-08T18:31:35.068 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:31:35.066+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:31:35.147 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:35.148 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:35.156 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:31:35.153+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:31:35.162 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-08T18:31:35.257 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:31:35.253+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:31:35.322 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:35.322 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:35.336 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-08T18:31:35.380 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:31:35.378+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:31:35.387 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-08T18:31:35.395 INFO:tasks.workunit.client.0.smithi097.stderr:Note: switching to '27d371685027569bcfa4efc661d3d3186f3a1776'. 2024-05-08T18:31:35.395 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-05-08T18:31:35.395 INFO:tasks.workunit.client.0.smithi097.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-05-08T18:31:35.395 INFO:tasks.workunit.client.0.smithi097.stderr:changes and commit them, and you can discard any commits you make in this 2024-05-08T18:31:35.395 INFO:tasks.workunit.client.0.smithi097.stderr:state without impacting any branches by switching back to a branch. 2024-05-08T18:31:35.396 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-05-08T18:31:35.396 INFO:tasks.workunit.client.0.smithi097.stderr:If you want to create a new branch to retain commits you create, you may 2024-05-08T18:31:35.396 INFO:tasks.workunit.client.0.smithi097.stderr:do so (now or later) by using -c with the switch command. Example: 2024-05-08T18:31:35.396 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-05-08T18:31:35.396 INFO:tasks.workunit.client.0.smithi097.stderr: git switch -c 2024-05-08T18:31:35.396 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-05-08T18:31:35.396 INFO:tasks.workunit.client.0.smithi097.stderr:Or undo this operation with: 2024-05-08T18:31:35.396 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-05-08T18:31:35.396 INFO:tasks.workunit.client.0.smithi097.stderr: git switch - 2024-05-08T18:31:35.396 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-05-08T18:31:35.396 INFO:tasks.workunit.client.0.smithi097.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-05-08T18:31:35.397 INFO:tasks.workunit.client.0.smithi097.stderr: 2024-05-08T18:31:35.397 INFO:tasks.workunit.client.0.smithi097.stderr:HEAD is now at 27d37168502 TEMPORARY for retry 2024-05-08T18:31:35.403 DEBUG:teuthology.orchestra.run.smithi097:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-05-08T18:31:35.452 INFO:tasks.workunit.client.0.smithi097.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-05-08T18:31:35.453 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:35.453 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:35.455 INFO:tasks.workunit.client.0.smithi097.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-08T18:31:35.456 INFO:tasks.workunit.client.0.smithi097.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-05-08T18:31:35.459 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:31:35.454+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:31:35.468 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-08T18:31:35.560 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:31:35.554+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:31:35.638 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:35.638 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:35.652 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-08T18:31:35.661 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:31:35.657+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:31:35.762 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:31:35.761+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:31:35.822 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:35.822 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:35.836 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-08T18:31:35.880 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:31:35.878+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:31:35.958 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:35.958 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:35.964 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:31:35.958+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:31:35.972 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-08T18:31:36.065 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:31:36.065+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:31:36.135 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:36.135 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:36.149 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-08T18:31:36.165 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:31:36.162+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:31:36.230 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-08T18:31:36.276 INFO:tasks.workunit.client.0.smithi097.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-05-08T18:31:36.276 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:31:36.277+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:31:36.282 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:36.282 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:36.297 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-08T18:31:36.355 INFO:tasks.workunit.client.0.smithi097.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-05-08T18:31:36.366 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:31:36.365+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:31:36.370 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2024-05-08T18:31:36.370 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:31:36.386 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2024-05-08T18:31:36.387 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:31:36.403 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2024-05-08T18:31:36.403 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:31:36.406 INFO:tasks.workunit.client.0.smithi097.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-08T18:31:36.407 INFO:tasks.workunit.client.0.smithi097.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-08T18:31:36.407 INFO:tasks.workunit.client.0.smithi097.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-05-08T18:31:36.419 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2024-05-08T18:31:36.419 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:31:36.440 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2024-05-08T18:31:36.440 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:31:36.447 INFO:tasks.workunit.client.0.smithi097.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-08T18:31:36.450 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-05-08T18:31:36.450 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-05-08T18:31:36.453 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:36.453 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:31:36.453 INFO:teuthology.orchestra.run.smithi097.stdout: "complaint_time": 30, 2024-05-08T18:31:36.453 INFO:teuthology.orchestra.run.smithi097.stdout: "num_blocked_ops": 0 2024-05-08T18:31:36.453 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:36.457 INFO:tasks.workunit:Running workunits matching rgw/s3_user_quota.pl on client.0... 2024-05-08T18:31:36.459 INFO:tasks.workunit:Running workunit rgw/s3_user_quota.pl... 2024-05-08T18:31:36.459 DEBUG:teuthology.orchestra.run.smithi097:workunit test rgw/s3_user_quota.pl> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=27d371685027569bcfa4efc661d3d3186f3a1776 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/s3_user_quota.pl 2024-05-08T18:31:36.462 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2024-05-08T18:31:36.463 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:31:36.466 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-08T18:31:36.468 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:31:36.462+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:31:36.483 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2024-05-08T18:31:36.484 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:31:36.502 INFO:teuthology.orchestra.run.smithi097.stderr:noscrub is set 2024-05-08T18:31:36.512 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2024-05-08T18:31:36.512 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:31:36.588 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:31:36.589+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:31:36.614 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:36.614 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2024-05-08T18:31:36.614 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2024-05-08T18:31:36.614 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-05-08T18:31:36.614 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.614 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4206.0:24 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'14, mlcod=16'9)", 2024-05-08T18:31:36.614 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:27.162224+0000", 2024-05-08T18:31:36.614 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 129.45039969499999, 2024-05-08T18:31:36.615 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032712890000000001, 2024-05-08T18:31:36.615 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:36.615 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:36.615 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:36.615 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:36.615 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.615 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:36.615 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162224+0000", 2024-05-08T18:31:36.615 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:36.615 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.615 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.615 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:36.615 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162224+0000", 2024-05-08T18:31:36.616 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:36.616 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.616 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.616 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:36.616 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162225+0000", 2024-05-08T18:31:36.616 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4899999999999999e-06 2024-05-08T18:31:36.616 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.616 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.616 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:36.616 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162306+0000", 2024-05-08T18:31:36.616 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.0589999999999999e-05 2024-05-08T18:31:36.616 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.616 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.617 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:36.617 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162332+0000", 2024-05-08T18:31:36.617 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5658999999999999e-05 2024-05-08T18:31:36.617 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.617 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.617 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:36.617 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162345+0000", 2024-05-08T18:31:36.617 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3512999999999999e-05 2024-05-08T18:31:36.617 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.617 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.617 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:36.617 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162465+0000", 2024-05-08T18:31:36.617 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000119577 2024-05-08T18:31:36.618 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.618 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.618 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:36.618 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.162513+0000", 2024-05-08T18:31:36.618 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8773999999999998e-05 2024-05-08T18:31:36.618 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.618 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.618 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:36.618 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.165405+0000", 2024-05-08T18:31:36.618 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028919200000000001 2024-05-08T18:31:36.618 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.618 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.618 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:36.619 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.165495+0000", 2024-05-08T18:31:36.619 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9765999999999994e-05 2024-05-08T18:31:36.619 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:36.619 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:36.619 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:36.619 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.619 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.619 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4206.0:25 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'15, mlcod=16'10)", 2024-05-08T18:31:36.619 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:27.164793+0000", 2024-05-08T18:31:36.619 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 129.44783056700001, 2024-05-08T18:31:36.619 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032285249999999999, 2024-05-08T18:31:36.619 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:36.620 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:36.620 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:36.620 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:36.620 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.620 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:36.620 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164793+0000", 2024-05-08T18:31:36.620 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:36.620 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.620 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.620 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:36.620 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164793+0000", 2024-05-08T18:31:36.620 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:36.620 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.621 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.621 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:36.621 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164795+0000", 2024-05-08T18:31:36.621 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0999999999999998e-06 2024-05-08T18:31:36.621 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.621 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.621 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:36.621 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164811+0000", 2024-05-08T18:31:36.621 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5722999999999998e-05 2024-05-08T18:31:36.621 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.621 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.621 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:36.621 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164841+0000", 2024-05-08T18:31:36.621 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0355999999999999e-05 2024-05-08T18:31:36.622 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.622 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.622 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:36.622 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164861+0000", 2024-05-08T18:31:36.622 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9533000000000001e-05 2024-05-08T18:31:36.622 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.622 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.622 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:36.622 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.164984+0000", 2024-05-08T18:31:36.622 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000123146 2024-05-08T18:31:36.622 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.622 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.622 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:36.623 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.165024+0000", 2024-05-08T18:31:36.623 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9690000000000001e-05 2024-05-08T18:31:36.623 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.623 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.623 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:36.623 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.167935+0000", 2024-05-08T18:31:36.623 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0029113300000000002 2024-05-08T18:31:36.623 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.623 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.623 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:36.623 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:27.168021+0000", 2024-05-08T18:31:36.623 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6646999999999999e-05 2024-05-08T18:31:36.624 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:36.624 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:36.624 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:36.624 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.624 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.624 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:60 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:31:36.624 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:48.674737+0000", 2024-05-08T18:31:36.624 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 107.93788664900001, 2024-05-08T18:31:36.624 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0035019780000000002, 2024-05-08T18:31:36.624 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:36.624 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:36.624 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:36.624 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:36.624 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:36.625 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:36.625 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 60 2024-05-08T18:31:36.625 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.625 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:36.625 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.625 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:36.625 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674737+0000", 2024-05-08T18:31:36.625 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:36.625 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.625 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.625 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:36.625 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674737+0000", 2024-05-08T18:31:36.625 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:36.625 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.626 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.626 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:36.626 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674740+0000", 2024-05-08T18:31:36.626 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.36e-06 2024-05-08T18:31:36.626 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.626 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.626 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:36.626 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674753+0000", 2024-05-08T18:31:36.626 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3151e-05 2024-05-08T18:31:36.626 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.626 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.626 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:36.626 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674789+0000", 2024-05-08T18:31:36.627 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5929000000000001e-05 2024-05-08T18:31:36.627 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.627 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.627 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:36.627 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674813+0000", 2024-05-08T18:31:36.627 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3325000000000001e-05 2024-05-08T18:31:36.627 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.627 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.627 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:36.627 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674981+0000", 2024-05-08T18:31:36.627 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016879899999999999 2024-05-08T18:31:36.627 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.627 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.628 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:36.628 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.675304+0000", 2024-05-08T18:31:36.628 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00032214400000000001 2024-05-08T18:31:36.628 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.628 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.628 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-05-08T18:31:36.628 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.675639+0000", 2024-05-08T18:31:36.628 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00033494699999999999 2024-05-08T18:31:36.628 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.628 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.628 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:36.628 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.676901+0000", 2024-05-08T18:31:36.628 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001262167 2024-05-08T18:31:36.629 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.629 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.629 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:36.629 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678078+0000", 2024-05-08T18:31:36.629 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001177588 2024-05-08T18:31:36.629 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.629 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.629 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:36.629 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678171+0000", 2024-05-08T18:31:36.629 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.2331999999999996e-05 2024-05-08T18:31:36.629 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.629 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.629 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:36.629 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678239+0000", 2024-05-08T18:31:36.630 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8236000000000002e-05 2024-05-08T18:31:36.630 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:36.630 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:36.630 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:36.630 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.630 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.630 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:61 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94069412632064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:31:36.630 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:48.678410+0000", 2024-05-08T18:31:36.630 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 107.934213257, 2024-05-08T18:31:36.630 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0026001800000000001, 2024-05-08T18:31:36.630 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:36.630 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:36.631 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:36.631 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:36.631 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:36.631 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:36.631 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 61 2024-05-08T18:31:36.631 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.631 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:36.631 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.631 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:36.631 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678410+0000", 2024-05-08T18:31:36.631 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:36.631 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.631 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.632 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:36.632 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678410+0000", 2024-05-08T18:31:36.632 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:36.632 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.632 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.632 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:36.632 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678413+0000", 2024-05-08T18:31:36.632 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.34e-06 2024-05-08T18:31:36.632 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.632 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.632 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:36.632 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678421+0000", 2024-05-08T18:31:36.632 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6910000000000003e-06 2024-05-08T18:31:36.633 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.633 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.633 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:36.633 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678447+0000", 2024-05-08T18:31:36.633 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6010999999999999e-05 2024-05-08T18:31:36.633 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.633 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.633 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:36.633 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678461+0000", 2024-05-08T18:31:36.633 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3900000000000001e-05 2024-05-08T18:31:36.633 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.633 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.633 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:36.634 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678560+0000", 2024-05-08T18:31:36.634 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.8834999999999998e-05 2024-05-08T18:31:36.634 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.634 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.634 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:36.634 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678704+0000", 2024-05-08T18:31:36.634 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000143769 2024-05-08T18:31:36.634 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.634 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.634 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-05-08T18:31:36.634 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.678942+0000", 2024-05-08T18:31:36.634 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023861800000000001 2024-05-08T18:31:36.634 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.634 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.635 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:36.635 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.680269+0000", 2024-05-08T18:31:36.635 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001326484 2024-05-08T18:31:36.635 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.635 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.635 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:36.635 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.680823+0000", 2024-05-08T18:31:36.635 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00055455900000000004 2024-05-08T18:31:36.635 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.635 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.635 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:36.635 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.680908+0000", 2024-05-08T18:31:36.635 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.4073999999999995e-05 2024-05-08T18:31:36.635 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.636 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.636 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:36.636 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.681010+0000", 2024-05-08T18:31:36.636 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010289900000000001 2024-05-08T18:31:36.636 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:36.636 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:36.636 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:36.636 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.636 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.636 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:31:36.636 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.671896+0000", 2024-05-08T18:31:36.636 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 104.940727372, 2024-05-08T18:31:36.636 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032352349999999999, 2024-05-08T18:31:36.636 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:36.637 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:36.637 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:36.637 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:36.637 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:36.637 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:36.637 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 206 2024-05-08T18:31:36.637 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.637 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:36.637 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.637 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:36.637 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671896+0000", 2024-05-08T18:31:36.637 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:36.637 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.637 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.638 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:36.638 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671896+0000", 2024-05-08T18:31:36.638 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:36.638 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.638 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.638 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:36.638 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671901+0000", 2024-05-08T18:31:36.638 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.763e-06 2024-05-08T18:31:36.638 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.638 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.638 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:36.638 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671920+0000", 2024-05-08T18:31:36.639 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9403e-05 2024-05-08T18:31:36.639 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.639 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.639 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:36.639 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671969+0000", 2024-05-08T18:31:36.639 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8343000000000001e-05 2024-05-08T18:31:36.639 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.639 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.639 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:36.639 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.671996+0000", 2024-05-08T18:31:36.639 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7307000000000001e-05 2024-05-08T18:31:36.639 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.639 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.639 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:36.639 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.672149+0000", 2024-05-08T18:31:36.640 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015336500000000001 2024-05-08T18:31:36.640 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.640 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.640 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:36.640 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.672393+0000", 2024-05-08T18:31:36.640 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024380800000000001 2024-05-08T18:31:36.640 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.640 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.640 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-05-08T18:31:36.640 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.672838+0000", 2024-05-08T18:31:36.640 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00044472700000000001 2024-05-08T18:31:36.640 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.640 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.640 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:36.641 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.674218+0000", 2024-05-08T18:31:36.641 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001380243 2024-05-08T18:31:36.641 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.641 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.641 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:36.641 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.674963+0000", 2024-05-08T18:31:36.641 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00074534999999999998 2024-05-08T18:31:36.641 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.641 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.641 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:36.641 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675057+0000", 2024-05-08T18:31:36.641 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.3633000000000003e-05 2024-05-08T18:31:36.641 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.641 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.642 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:36.642 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675131+0000", 2024-05-08T18:31:36.642 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.4293000000000002e-05 2024-05-08T18:31:36.642 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:36.642 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:36.642 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:36.642 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.642 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.642 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:36.642 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.694194+0000", 2024-05-08T18:31:36.642 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 104.91842997400001, 2024-05-08T18:31:36.642 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0087385129999999998, 2024-05-08T18:31:36.642 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:36.642 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:36.643 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:36.643 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:36.643 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:36.643 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:36.643 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 210 2024-05-08T18:31:36.643 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.643 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:36.643 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.643 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:36.643 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694194+0000", 2024-05-08T18:31:36.643 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:36.643 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.643 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.644 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:36.644 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694194+0000", 2024-05-08T18:31:36.644 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:36.644 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.644 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.644 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:36.644 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694196+0000", 2024-05-08T18:31:36.644 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6299999999999998e-06 2024-05-08T18:31:36.644 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.644 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.644 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:36.644 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694208+0000", 2024-05-08T18:31:36.644 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.187e-05 2024-05-08T18:31:36.644 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.645 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.645 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:36.645 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694240+0000", 2024-05-08T18:31:36.645 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1673e-05 2024-05-08T18:31:36.645 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.645 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.645 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:36.645 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694255+0000", 2024-05-08T18:31:36.645 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5573000000000002e-05 2024-05-08T18:31:36.645 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.645 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.645 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:36.645 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694394+0000", 2024-05-08T18:31:36.645 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000138536 2024-05-08T18:31:36.646 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.646 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.646 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-05-08T18:31:36.646 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.694405+0000", 2024-05-08T18:31:36.646 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0883000000000001e-05 2024-05-08T18:31:36.646 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.646 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.646 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:36.646 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.699491+0000", 2024-05-08T18:31:36.646 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0050861939999999996 2024-05-08T18:31:36.646 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.646 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.646 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:36.647 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.699829+0000", 2024-05-08T18:31:36.647 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000338191 2024-05-08T18:31:36.647 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.647 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.647 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:36.647 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.700504+0000", 2024-05-08T18:31:36.647 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000674481 2024-05-08T18:31:36.647 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.647 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.647 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:36.647 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.702152+0000", 2024-05-08T18:31:36.647 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0016487450000000001 2024-05-08T18:31:36.647 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.647 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.648 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:36.648 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.702792+0000", 2024-05-08T18:31:36.648 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00063962800000000005 2024-05-08T18:31:36.648 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.648 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.648 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:36.648 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.702874+0000", 2024-05-08T18:31:36.648 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.2091999999999999e-05 2024-05-08T18:31:36.648 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.648 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.648 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:36.648 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.702932+0000", 2024-05-08T18:31:36.648 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8016999999999997e-05 2024-05-08T18:31:36.648 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:36.649 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:36.649 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:36.649 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.649 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.649 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:36.649 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.728239+0000", 2024-05-08T18:31:36.649 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 104.884384113, 2024-05-08T18:31:36.649 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0035376119999999999, 2024-05-08T18:31:36.649 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:36.649 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:36.649 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:36.649 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:36.649 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:36.649 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:36.650 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 218 2024-05-08T18:31:36.650 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.650 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:36.650 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.650 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:36.650 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728239+0000", 2024-05-08T18:31:36.650 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:36.650 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.650 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.650 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:36.650 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728239+0000", 2024-05-08T18:31:36.650 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:36.650 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.651 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.651 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:36.651 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728242+0000", 2024-05-08T18:31:36.651 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0130000000000002e-06 2024-05-08T18:31:36.651 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.651 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.651 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:36.651 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728254+0000", 2024-05-08T18:31:36.651 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.172e-05 2024-05-08T18:31:36.651 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.651 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.651 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:36.651 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728285+0000", 2024-05-08T18:31:36.652 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0703000000000001e-05 2024-05-08T18:31:36.652 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.652 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.652 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:36.652 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728301+0000", 2024-05-08T18:31:36.652 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5656999999999999e-05 2024-05-08T18:31:36.652 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.652 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.652 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:36.652 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728460+0000", 2024-05-08T18:31:36.652 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015934200000000001 2024-05-08T18:31:36.652 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.652 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.652 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:36.652 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.728803+0000", 2024-05-08T18:31:36.653 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00034267400000000001 2024-05-08T18:31:36.653 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.653 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.653 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:36.653 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.729485+0000", 2024-05-08T18:31:36.653 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00068206799999999998 2024-05-08T18:31:36.653 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.653 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.653 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:36.653 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731218+0000", 2024-05-08T18:31:36.653 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0017332630000000001 2024-05-08T18:31:36.653 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.653 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.653 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:36.654 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731615+0000", 2024-05-08T18:31:36.654 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00039671699999999999 2024-05-08T18:31:36.654 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.654 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.654 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:36.654 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731709+0000", 2024-05-08T18:31:36.654 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.4740000000000004e-05 2024-05-08T18:31:36.654 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.654 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.654 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:36.655 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731777+0000", 2024-05-08T18:31:36.655 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7714999999999998e-05 2024-05-08T18:31:36.655 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:36.655 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:36.655 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:36.655 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.655 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.655 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:36.655 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.743331+0000", 2024-05-08T18:31:36.655 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 104.86929213000001, 2024-05-08T18:31:36.655 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031193229999999998, 2024-05-08T18:31:36.655 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:36.655 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:36.655 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:36.656 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:36.656 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:36.656 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:36.656 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 222 2024-05-08T18:31:36.656 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.656 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:36.656 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.656 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:36.656 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743331+0000", 2024-05-08T18:31:36.656 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:36.656 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.656 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.656 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:36.657 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743331+0000", 2024-05-08T18:31:36.657 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:36.657 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.657 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.657 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:36.657 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743334+0000", 2024-05-08T18:31:36.657 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2900000000000001e-06 2024-05-08T18:31:36.657 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.657 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.657 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:36.657 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743345+0000", 2024-05-08T18:31:36.657 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0947e-05 2024-05-08T18:31:36.657 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.658 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.658 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:36.658 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743375+0000", 2024-05-08T18:31:36.658 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0298999999999999e-05 2024-05-08T18:31:36.658 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.658 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.658 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:36.658 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743390+0000", 2024-05-08T18:31:36.658 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4606999999999999e-05 2024-05-08T18:31:36.658 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.658 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.658 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:36.658 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743524+0000", 2024-05-08T18:31:36.659 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000134105 2024-05-08T18:31:36.659 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.659 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.659 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:36.659 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.743738+0000", 2024-05-08T18:31:36.659 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000214222 2024-05-08T18:31:36.659 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.659 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.659 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:36.659 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.744159+0000", 2024-05-08T18:31:36.659 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00042102300000000002 2024-05-08T18:31:36.659 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.659 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.659 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:36.660 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.745399+0000", 2024-05-08T18:31:36.660 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012400309999999999 2024-05-08T18:31:36.660 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.660 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.660 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:36.660 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.746296+0000", 2024-05-08T18:31:36.660 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00089682 2024-05-08T18:31:36.660 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.660 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.660 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:36.660 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.746385+0000", 2024-05-08T18:31:36.660 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9289000000000005e-05 2024-05-08T18:31:36.661 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.661 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.661 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:36.661 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.746451+0000", 2024-05-08T18:31:36.661 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5690000000000003e-05 2024-05-08T18:31:36.661 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:36.661 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:36.661 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:36.661 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.661 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.661 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:36.661 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.772338+0000", 2024-05-08T18:31:36.661 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 104.84028592999999, 2024-05-08T18:31:36.662 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0035084059999999999, 2024-05-08T18:31:36.662 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:36.662 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:36.662 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:36.662 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:36.662 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:36.662 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:36.662 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 230 2024-05-08T18:31:36.662 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.662 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:36.662 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.662 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:36.662 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772338+0000", 2024-05-08T18:31:36.662 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:36.663 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.663 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.663 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:36.663 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772338+0000", 2024-05-08T18:31:36.663 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:36.663 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.663 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.663 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:36.663 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772340+0000", 2024-05-08T18:31:36.663 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3460000000000001e-06 2024-05-08T18:31:36.663 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.663 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.663 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:36.664 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772352+0000", 2024-05-08T18:31:36.664 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2284e-05 2024-05-08T18:31:36.664 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.664 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.664 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:36.664 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772382+0000", 2024-05-08T18:31:36.664 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0083e-05 2024-05-08T18:31:36.664 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.664 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.664 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:36.664 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772397+0000", 2024-05-08T18:31:36.664 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4963000000000001e-05 2024-05-08T18:31:36.665 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.665 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.665 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:36.665 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772508+0000", 2024-05-08T18:31:36.665 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000110402 2024-05-08T18:31:36.665 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.665 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.665 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:36.665 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.772742+0000", 2024-05-08T18:31:36.665 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023428899999999999 2024-05-08T18:31:36.665 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.665 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.665 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:36.665 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.773183+0000", 2024-05-08T18:31:36.666 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00044107899999999998 2024-05-08T18:31:36.666 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.666 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.666 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:36.666 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.774488+0000", 2024-05-08T18:31:36.666 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0013053940000000001 2024-05-08T18:31:36.666 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.666 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.666 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:36.666 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.775689+0000", 2024-05-08T18:31:36.666 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012004699999999999 2024-05-08T18:31:36.666 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.666 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.667 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:36.667 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.775777+0000", 2024-05-08T18:31:36.667 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8483e-05 2024-05-08T18:31:36.667 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.667 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.667 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:36.667 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.775846+0000", 2024-05-08T18:31:36.667 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8613000000000002e-05 2024-05-08T18:31:36.667 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:36.667 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:36.667 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:36.667 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.667 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.668 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:36.668 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.790921+0000", 2024-05-08T18:31:36.668 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 104.82170258399999, 2024-05-08T18:31:36.668 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003116869, 2024-05-08T18:31:36.668 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:36.668 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:36.668 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:36.668 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:36.668 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:36.668 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:36.668 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 235 2024-05-08T18:31:36.668 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.668 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:36.668 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.669 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:36.669 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790921+0000", 2024-05-08T18:31:36.669 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:36.669 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.669 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.669 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:36.669 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790921+0000", 2024-05-08T18:31:36.669 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:36.669 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.669 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.669 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:36.669 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790923+0000", 2024-05-08T18:31:36.669 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3199999999999998e-06 2024-05-08T18:31:36.669 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.670 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.670 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:36.670 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790934+0000", 2024-05-08T18:31:36.670 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.117e-05 2024-05-08T18:31:36.670 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.670 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.670 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:36.670 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790965+0000", 2024-05-08T18:31:36.670 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0392999999999999e-05 2024-05-08T18:31:36.670 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.670 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.670 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:36.670 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.790981+0000", 2024-05-08T18:31:36.671 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5699999999999999e-05 2024-05-08T18:31:36.671 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.671 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.671 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:36.671 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.791093+0000", 2024-05-08T18:31:36.671 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000112062 2024-05-08T18:31:36.671 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.671 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.671 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:36.671 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.791324+0000", 2024-05-08T18:31:36.671 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023142200000000001 2024-05-08T18:31:36.671 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.671 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.672 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:36.672 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.791761+0000", 2024-05-08T18:31:36.672 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00043669999999999999 2024-05-08T18:31:36.672 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.672 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.672 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:36.672 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.792996+0000", 2024-05-08T18:31:36.672 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001235713 2024-05-08T18:31:36.672 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.672 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.672 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:36.672 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.793850+0000", 2024-05-08T18:31:36.672 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00085392400000000005 2024-05-08T18:31:36.673 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.673 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.673 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:36.673 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.793971+0000", 2024-05-08T18:31:36.673 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000120516 2024-05-08T18:31:36.673 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.673 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.673 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:36.673 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794038+0000", 2024-05-08T18:31:36.673 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6948999999999999e-05 2024-05-08T18:31:36.673 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:36.673 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:36.673 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:36.673 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.674 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.674 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:349 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:36.674 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.817315+0000", 2024-05-08T18:31:36.674 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 104.795308713, 2024-05-08T18:31:36.674 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0036888580000000002, 2024-05-08T18:31:36.674 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:36.674 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:36.674 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:36.674 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:36.674 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:36.674 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:36.674 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 349 2024-05-08T18:31:36.675 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.675 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:36.675 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.675 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:36.675 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817315+0000", 2024-05-08T18:31:36.675 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:36.675 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.675 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.675 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:36.675 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817315+0000", 2024-05-08T18:31:36.675 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:36.675 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.675 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.676 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:36.676 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817316+0000", 2024-05-08T18:31:36.676 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3370000000000001e-06 2024-05-08T18:31:36.676 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.676 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.676 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:36.676 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817323+0000", 2024-05-08T18:31:36.676 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.4300000000000003e-06 2024-05-08T18:31:36.676 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.676 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.676 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:36.676 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817337+0000", 2024-05-08T18:31:36.676 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4025999999999999e-05 2024-05-08T18:31:36.676 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.677 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.677 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:36.677 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817345+0000", 2024-05-08T18:31:36.677 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5669999999999995e-06 2024-05-08T18:31:36.677 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.677 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.677 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:36.677 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817407+0000", 2024-05-08T18:31:36.677 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1882000000000001e-05 2024-05-08T18:31:36.677 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.677 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.677 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:36.677 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817508+0000", 2024-05-08T18:31:36.678 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000100585 2024-05-08T18:31:36.678 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.678 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.678 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:36.678 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.817673+0000", 2024-05-08T18:31:36.678 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000165802 2024-05-08T18:31:36.678 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.678 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.678 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:36.678 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.818715+0000", 2024-05-08T18:31:36.678 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0010417720000000001 2024-05-08T18:31:36.678 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.678 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.678 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:36.679 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.820892+0000", 2024-05-08T18:31:36.679 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0021771859999999998 2024-05-08T18:31:36.679 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.679 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.679 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:36.679 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.820950+0000", 2024-05-08T18:31:36.679 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7636000000000002e-05 2024-05-08T18:31:36.679 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.679 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.679 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:36.679 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.821004+0000", 2024-05-08T18:31:36.679 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3634999999999997e-05 2024-05-08T18:31:36.679 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:36.680 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:36.680 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:36.680 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.680 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.680 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:406 6.16 6:6dc3b799:reshard::reshard.0000000006:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:36.680 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.840465+0000", 2024-05-08T18:31:36.680 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 104.772158547, 2024-05-08T18:31:36.680 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003613032, 2024-05-08T18:31:36.680 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:36.681 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:36.681 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:36.681 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:36.681 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:36.681 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:36.681 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 406 2024-05-08T18:31:36.681 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.681 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:36.681 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.681 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:36.681 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840465+0000", 2024-05-08T18:31:36.681 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:36.681 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.681 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.682 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:36.682 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840465+0000", 2024-05-08T18:31:36.682 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:36.682 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.682 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.682 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:36.682 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840466+0000", 2024-05-08T18:31:36.682 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7499999999999999e-07 2024-05-08T18:31:36.682 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.682 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.682 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:36.682 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840471+0000", 2024-05-08T18:31:36.682 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9699999999999998e-06 2024-05-08T18:31:36.683 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.683 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.683 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:36.683 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840484+0000", 2024-05-08T18:31:36.683 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2717999999999999e-05 2024-05-08T18:31:36.683 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.683 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.683 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:36.683 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840490+0000", 2024-05-08T18:31:36.683 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.472e-06 2024-05-08T18:31:36.683 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.683 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.683 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:36.683 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840536+0000", 2024-05-08T18:31:36.684 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6409000000000002e-05 2024-05-08T18:31:36.684 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.684 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.684 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:36.684 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840591+0000", 2024-05-08T18:31:36.684 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4911000000000003e-05 2024-05-08T18:31:36.684 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.684 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.684 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:36.684 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.840745+0000", 2024-05-08T18:31:36.684 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015394900000000001 2024-05-08T18:31:36.684 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.684 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.685 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:36.685 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.841269+0000", 2024-05-08T18:31:36.685 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00052347299999999999 2024-05-08T18:31:36.685 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.685 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.685 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:36.685 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.843997+0000", 2024-05-08T18:31:36.685 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0027285080000000001 2024-05-08T18:31:36.685 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.685 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.685 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:36.685 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844033+0000", 2024-05-08T18:31:36.685 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6038000000000003e-05 2024-05-08T18:31:36.686 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.686 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.686 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:36.686 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844078+0000", 2024-05-08T18:31:36.686 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4709000000000002e-05 2024-05-08T18:31:36.686 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:36.686 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:36.686 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:36.686 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.686 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.686 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:413 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:36.686 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.844187+0000", 2024-05-08T18:31:36.686 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 104.76843697, 2024-05-08T18:31:36.687 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0024835069999999998, 2024-05-08T18:31:36.687 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:36.687 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:36.687 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:36.687 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:36.687 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:36.687 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:36.687 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 413 2024-05-08T18:31:36.687 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.687 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:36.687 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.687 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:36.687 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844187+0000", 2024-05-08T18:31:36.687 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:36.688 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.688 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.688 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:36.688 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844187+0000", 2024-05-08T18:31:36.688 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:36.688 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.688 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.688 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:36.688 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844187+0000", 2024-05-08T18:31:36.688 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9999999999999996e-07 2024-05-08T18:31:36.688 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.688 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.688 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:36.688 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844192+0000", 2024-05-08T18:31:36.688 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7899999999999999e-06 2024-05-08T18:31:36.689 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.689 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.689 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:36.689 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844203+0000", 2024-05-08T18:31:36.689 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1002000000000001e-05 2024-05-08T18:31:36.689 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.689 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.689 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:36.689 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844209+0000", 2024-05-08T18:31:36.689 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6570000000000002e-06 2024-05-08T18:31:36.689 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.689 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.689 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:36.690 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844270+0000", 2024-05-08T18:31:36.690 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0810999999999998e-05 2024-05-08T18:31:36.690 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.690 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.690 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:36.690 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844419+0000", 2024-05-08T18:31:36.690 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000149097 2024-05-08T18:31:36.690 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.690 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.690 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:36.690 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.844611+0000", 2024-05-08T18:31:36.690 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00019247900000000001 2024-05-08T18:31:36.690 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.691 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.691 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:36.691 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.845287+0000", 2024-05-08T18:31:36.691 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00067526000000000001 2024-05-08T18:31:36.691 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.691 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.691 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:36.691 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.846609+0000", 2024-05-08T18:31:36.691 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001322124 2024-05-08T18:31:36.691 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.691 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.691 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:36.691 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.846642+0000", 2024-05-08T18:31:36.692 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3654e-05 2024-05-08T18:31:36.692 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.692 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.692 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:36.692 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.846670+0000", 2024-05-08T18:31:36.692 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7733e-05 2024-05-08T18:31:36.692 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:36.692 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:36.692 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:36.692 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.692 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.692 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:420 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:36.692 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.847096+0000", 2024-05-08T18:31:36.692 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 104.765527676, 2024-05-08T18:31:36.693 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0026261589999999999, 2024-05-08T18:31:36.693 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:36.693 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:36.693 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:36.693 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:36.693 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:36.693 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:36.693 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 420 2024-05-08T18:31:36.693 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.693 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:36.693 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.693 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:36.693 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847096+0000", 2024-05-08T18:31:36.693 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:36.694 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.694 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.694 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:36.694 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847096+0000", 2024-05-08T18:31:36.694 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:36.694 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.694 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.694 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:36.694 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847097+0000", 2024-05-08T18:31:36.694 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.5499999999999996e-07 2024-05-08T18:31:36.694 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.694 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.694 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:36.694 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847103+0000", 2024-05-08T18:31:36.695 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8969999999999996e-06 2024-05-08T18:31:36.695 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.695 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.695 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:36.695 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847114+0000", 2024-05-08T18:31:36.695 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1549000000000001e-05 2024-05-08T18:31:36.695 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.695 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.695 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:36.695 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847120+0000", 2024-05-08T18:31:36.695 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5509999999999999e-06 2024-05-08T18:31:36.695 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.695 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.696 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:36.696 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847166+0000", 2024-05-08T18:31:36.696 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6683e-05 2024-05-08T18:31:36.696 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.696 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.696 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:36.696 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847213+0000", 2024-05-08T18:31:36.696 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6659000000000002e-05 2024-05-08T18:31:36.696 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.696 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.696 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:36.696 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847315+0000", 2024-05-08T18:31:36.696 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000102336 2024-05-08T18:31:36.696 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.697 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.697 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:36.697 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.847840+0000", 2024-05-08T18:31:36.697 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00052475000000000004 2024-05-08T18:31:36.697 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.697 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.697 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:36.697 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.849660+0000", 2024-05-08T18:31:36.697 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001819563 2024-05-08T18:31:36.697 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.697 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.697 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:36.697 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.849695+0000", 2024-05-08T18:31:36.697 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4761000000000001e-05 2024-05-08T18:31:36.698 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.698 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.698 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:36.698 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.849722+0000", 2024-05-08T18:31:36.698 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7455000000000001e-05 2024-05-08T18:31:36.698 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:36.698 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:36.698 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:36.698 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.698 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.698 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:532 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:36.698 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.908603+0000", 2024-05-08T18:31:36.698 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 104.704020126, 2024-05-08T18:31:36.698 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0038838950000000001, 2024-05-08T18:31:36.699 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:36.699 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:36.699 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:36.699 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:36.699 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:36.699 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:36.699 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 532 2024-05-08T18:31:36.699 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.699 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:36.699 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.699 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:36.699 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908603+0000", 2024-05-08T18:31:36.699 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:36.700 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.700 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.700 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:36.700 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908603+0000", 2024-05-08T18:31:36.700 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:36.700 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.700 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.700 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:36.700 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908605+0000", 2024-05-08T18:31:36.700 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1179999999999999e-06 2024-05-08T18:31:36.700 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.700 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.700 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:36.701 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908608+0000", 2024-05-08T18:31:36.701 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7419999999999999e-06 2024-05-08T18:31:36.701 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.701 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.701 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:36.701 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908618+0000", 2024-05-08T18:31:36.701 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.6889999999999999e-06 2024-05-08T18:31:36.701 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.701 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.701 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:36.701 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908625+0000", 2024-05-08T18:31:36.701 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1300000000000003e-06 2024-05-08T18:31:36.701 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.701 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.702 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:36.702 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908669+0000", 2024-05-08T18:31:36.702 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3832000000000003e-05 2024-05-08T18:31:36.702 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.702 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.702 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:36.702 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908724+0000", 2024-05-08T18:31:36.702 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5222000000000001e-05 2024-05-08T18:31:36.702 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.702 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.703 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:36.703 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.908854+0000", 2024-05-08T18:31:36.703 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012953500000000001 2024-05-08T18:31:36.703 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.703 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.703 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:36.703 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.909511+0000", 2024-05-08T18:31:36.703 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00065768399999999996 2024-05-08T18:31:36.703 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.703 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.703 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:36.703 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912426+0000", 2024-05-08T18:31:36.703 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0029146599999999999 2024-05-08T18:31:36.703 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.704 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.704 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:36.704 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912461+0000", 2024-05-08T18:31:36.704 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4934999999999997e-05 2024-05-08T18:31:36.704 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.704 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.704 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:36.704 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.912487+0000", 2024-05-08T18:31:36.704 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6347999999999999e-05 2024-05-08T18:31:36.704 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:36.704 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:36.704 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:36.704 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.704 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.705 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:534 6.9 6:9268b73e:::obj_delete_at_hint.0000000019:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:36.705 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.910153+0000", 2024-05-08T18:31:36.705 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 104.70247066899999, 2024-05-08T18:31:36.705 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0051089680000000002, 2024-05-08T18:31:36.705 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:36.705 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:36.705 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:36.705 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:36.705 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:36.705 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:36.705 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 534 2024-05-08T18:31:36.705 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.705 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:36.705 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.706 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:36.706 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910153+0000", 2024-05-08T18:31:36.706 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:36.706 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.706 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.706 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:36.706 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910153+0000", 2024-05-08T18:31:36.706 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:36.706 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.706 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.706 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:36.706 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910154+0000", 2024-05-08T18:31:36.706 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1039999999999999e-06 2024-05-08T18:31:36.706 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.707 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.707 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:36.707 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910158+0000", 2024-05-08T18:31:36.707 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7400000000000002e-06 2024-05-08T18:31:36.707 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.707 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.707 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:36.707 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910167+0000", 2024-05-08T18:31:36.707 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8880000000000003e-06 2024-05-08T18:31:36.707 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.707 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.707 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:36.707 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910173+0000", 2024-05-08T18:31:36.707 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.844e-06 2024-05-08T18:31:36.708 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.708 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.708 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:36.708 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910220+0000", 2024-05-08T18:31:36.708 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6582000000000002e-05 2024-05-08T18:31:36.708 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.708 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.708 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:36.708 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910287+0000", 2024-05-08T18:31:36.708 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7271e-05 2024-05-08T18:31:36.708 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.708 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.708 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:36.708 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910402+0000", 2024-05-08T18:31:36.709 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115127 2024-05-08T18:31:36.709 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.709 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.709 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:36.709 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.910881+0000", 2024-05-08T18:31:36.709 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000479025 2024-05-08T18:31:36.709 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.709 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.709 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:36.709 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.915206+0000", 2024-05-08T18:31:36.709 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.004324357 2024-05-08T18:31:36.709 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.709 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.710 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:36.710 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.915237+0000", 2024-05-08T18:31:36.710 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1590000000000001e-05 2024-05-08T18:31:36.710 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.710 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.710 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:36.710 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.915262+0000", 2024-05-08T18:31:36.710 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.444e-05 2024-05-08T18:31:36.710 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:36.710 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:36.710 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:36.710 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.710 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.710 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:583 6.0 6:03bbb29a:::obj_delete_at_hint.0000000026:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:36.711 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.947199+0000", 2024-05-08T18:31:36.711 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 104.665424472, 2024-05-08T18:31:36.711 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0025081510000000001, 2024-05-08T18:31:36.711 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:36.711 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:36.711 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:36.711 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:36.711 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:36.711 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:36.711 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 583 2024-05-08T18:31:36.711 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.711 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:36.711 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.712 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:36.712 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947199+0000", 2024-05-08T18:31:36.712 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:36.712 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.712 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.712 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:36.712 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947199+0000", 2024-05-08T18:31:36.712 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:36.712 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.712 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.712 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:36.712 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947200+0000", 2024-05-08T18:31:36.712 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3799999999999997e-07 2024-05-08T18:31:36.712 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.712 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.713 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:36.713 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947207+0000", 2024-05-08T18:31:36.713 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2030000000000003e-06 2024-05-08T18:31:36.713 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.713 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.713 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:36.713 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947217+0000", 2024-05-08T18:31:36.713 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0138e-05 2024-05-08T18:31:36.713 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.713 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.713 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:36.713 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.947224+0000", 2024-05-08T18:31:36.713 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5289999999999997e-06 2024-05-08T18:31:36.714 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.714 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.714 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:36.714 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.948039+0000", 2024-05-08T18:31:36.714 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00081500599999999996 2024-05-08T18:31:36.714 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.714 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.714 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:36.714 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.948230+0000", 2024-05-08T18:31:36.714 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000191838 2024-05-08T18:31:36.715 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.715 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.715 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:36.715 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.948606+0000", 2024-05-08T18:31:36.715 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00037547900000000001 2024-05-08T18:31:36.715 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.715 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.715 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:36.715 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.949406+0000", 2024-05-08T18:31:36.715 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000799674 2024-05-08T18:31:36.715 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.715 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.715 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:36.716 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.949630+0000", 2024-05-08T18:31:36.716 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00022474699999999999 2024-05-08T18:31:36.716 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.716 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.716 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:36.716 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.949664+0000", 2024-05-08T18:31:36.716 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3535999999999999e-05 2024-05-08T18:31:36.716 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.716 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.716 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:36.716 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.949707+0000", 2024-05-08T18:31:36.716 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3362999999999998e-05 2024-05-08T18:31:36.716 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:36.716 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:36.717 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:36.717 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.717 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.717 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:811 6.0 6:00569cb6:::obj_delete_at_hint.0000000078:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:36.717 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.263796+0000", 2024-05-08T18:31:36.717 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 104.348827204, 2024-05-08T18:31:36.717 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0027788019999999999, 2024-05-08T18:31:36.717 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:36.717 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:36.717 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:36.717 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:36.717 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:36.718 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:36.718 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 811 2024-05-08T18:31:36.718 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.718 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:36.718 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.718 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:36.718 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263796+0000", 2024-05-08T18:31:36.718 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:36.718 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.718 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.718 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:36.718 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263796+0000", 2024-05-08T18:31:36.718 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:36.719 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.719 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.719 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:36.719 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263799+0000", 2024-05-08T18:31:36.719 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5569999999999998e-06 2024-05-08T18:31:36.719 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.719 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.719 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:36.719 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263812+0000", 2024-05-08T18:31:36.719 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3145999999999999e-05 2024-05-08T18:31:36.719 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.719 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.719 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:36.720 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263842+0000", 2024-05-08T18:31:36.720 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0193e-05 2024-05-08T18:31:36.720 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.720 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.720 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:36.720 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263860+0000", 2024-05-08T18:31:36.720 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7880000000000002e-05 2024-05-08T18:31:36.720 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.720 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.720 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:36.720 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.263979+0000", 2024-05-08T18:31:36.720 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011919899999999999 2024-05-08T18:31:36.720 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.720 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.720 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:36.721 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.264222+0000", 2024-05-08T18:31:36.721 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024290800000000001 2024-05-08T18:31:36.721 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.721 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.721 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:36.721 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.264545+0000", 2024-05-08T18:31:36.721 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00032300200000000002 2024-05-08T18:31:36.721 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.721 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.721 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:36.721 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.265682+0000", 2024-05-08T18:31:36.721 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001136464 2024-05-08T18:31:36.721 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.721 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.722 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:36.722 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.266397+0000", 2024-05-08T18:31:36.722 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00071512799999999999 2024-05-08T18:31:36.722 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.722 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.722 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:36.722 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.266504+0000", 2024-05-08T18:31:36.722 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000107019 2024-05-08T18:31:36.722 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.722 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.722 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:36.722 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.266575+0000", 2024-05-08T18:31:36.723 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1305999999999998e-05 2024-05-08T18:31:36.723 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:36.723 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:36.723 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:36.723 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.723 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.723 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:36.723 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.445706+0000", 2024-05-08T18:31:36.723 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 104.166917488, 2024-05-08T18:31:36.723 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0026820630000000002, 2024-05-08T18:31:36.723 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:36.723 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:36.723 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:36.724 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:36.724 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:36.724 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:36.724 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 889 2024-05-08T18:31:36.724 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.724 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:36.724 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.724 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:36.724 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445706+0000", 2024-05-08T18:31:36.724 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:36.724 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.724 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.724 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:36.724 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445706+0000", 2024-05-08T18:31:36.725 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:36.725 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.725 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.725 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:36.725 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445709+0000", 2024-05-08T18:31:36.725 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0299999999999998e-06 2024-05-08T18:31:36.725 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.725 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.725 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:36.725 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445721+0000", 2024-05-08T18:31:36.725 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2366e-05 2024-05-08T18:31:36.725 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.725 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.725 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:36.726 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445752+0000", 2024-05-08T18:31:36.726 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0287e-05 2024-05-08T18:31:36.726 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.726 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.726 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:36.726 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445773+0000", 2024-05-08T18:31:36.726 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1367000000000001e-05 2024-05-08T18:31:36.726 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.726 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.726 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:36.726 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.445892+0000", 2024-05-08T18:31:36.727 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000119311 2024-05-08T18:31:36.727 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.727 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.727 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:36.727 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.446158+0000", 2024-05-08T18:31:36.727 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000265441 2024-05-08T18:31:36.727 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.727 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.727 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:36.727 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.446465+0000", 2024-05-08T18:31:36.727 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00030754300000000002 2024-05-08T18:31:36.727 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.727 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.727 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:36.728 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.447511+0000", 2024-05-08T18:31:36.728 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001045975 2024-05-08T18:31:36.728 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.728 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.728 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:36.728 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.448171+0000", 2024-05-08T18:31:36.728 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00065971200000000002 2024-05-08T18:31:36.728 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.728 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.728 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:36.728 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.448273+0000", 2024-05-08T18:31:36.728 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000101592 2024-05-08T18:31:36.728 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.728 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.729 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:36.729 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.448388+0000", 2024-05-08T18:31:36.729 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115439 2024-05-08T18:31:36.729 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:36.729 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:36.729 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:36.729 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.729 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.729 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1020 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_add in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-05-08T18:31:36.729 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:30:21.842276+0000", 2024-05-08T18:31:36.729 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 74.770347947000005, 2024-05-08T18:31:36.729 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0025898760000000001, 2024-05-08T18:31:36.730 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:36.730 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:36.730 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:36.730 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:36.730 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:36.730 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:36.730 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1020 2024-05-08T18:31:36.730 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.730 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:36.730 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.730 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:36.730 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842276+0000", 2024-05-08T18:31:36.730 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:36.731 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.731 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.731 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:36.731 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842276+0000", 2024-05-08T18:31:36.731 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:36.731 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.731 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.731 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:36.731 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842278+0000", 2024-05-08T18:31:36.731 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6129999999999998e-06 2024-05-08T18:31:36.731 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.731 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.731 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:36.732 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842290+0000", 2024-05-08T18:31:36.732 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2187999999999999e-05 2024-05-08T18:31:36.732 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.732 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.732 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:36.732 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842319+0000", 2024-05-08T18:31:36.732 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8782e-05 2024-05-08T18:31:36.732 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.732 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.732 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:36.732 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842336+0000", 2024-05-08T18:31:36.732 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6826000000000001e-05 2024-05-08T18:31:36.732 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.732 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.733 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:36.733 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842450+0000", 2024-05-08T18:31:36.733 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000113829 2024-05-08T18:31:36.733 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.733 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.733 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:36.733 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842627+0000", 2024-05-08T18:31:36.733 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00017756599999999999 2024-05-08T18:31:36.733 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.733 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.733 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:36.733 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.842794+0000", 2024-05-08T18:31:36.733 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000166866 2024-05-08T18:31:36.733 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.734 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.734 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:36.734 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.843540+0000", 2024-05-08T18:31:36.734 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00074611700000000003 2024-05-08T18:31:36.734 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.734 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.734 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:36.734 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.844762+0000", 2024-05-08T18:31:36.734 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012220309999999999 2024-05-08T18:31:36.734 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.734 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.734 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:36.734 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.844806+0000", 2024-05-08T18:31:36.735 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3414000000000001e-05 2024-05-08T18:31:36.735 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:36.735 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:36.735 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:36.735 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:30:21.844865+0000", 2024-05-08T18:31:36.735 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9644e-05 2024-05-08T18:31:36.735 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:36.735 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:36.735 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:36.735 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:36.735 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:36.735 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:36.737 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-08T18:31:36.737 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:31:36.734+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:31:36.837 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:31:36.837+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:31:36.903 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:36.903 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:31:36.903 INFO:teuthology.orchestra.run.smithi097.stdout: "num_ops": 0 2024-05-08T18:31:36.903 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:36.917 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-08T18:31:36.939 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:31:36.934+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:31:37.030 INFO:tasks.workunit.client.0.smithi097.stdout:Bucket Created: buck_2024_04_8_18_31_36 2024-05-08T18:31:37.040 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:31:37.034+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:31:37.073 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:37.073 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:31:37.074 INFO:teuthology.orchestra.run.smithi097.stdout: "complaint_time": 30, 2024-05-08T18:31:37.074 INFO:teuthology.orchestra.run.smithi097.stdout: "num_blocked_ops": 0 2024-05-08T18:31:37.074 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:37.089 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-08T18:31:37.140 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:31:37.141+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:31:37.192 INFO:tasks.workunit.client.0.smithi097.stderr:1+0 records in 2024-05-08T18:31:37.192 INFO:tasks.workunit.client.0.smithi097.stderr:1+0 records out 2024-05-08T18:31:37.192 INFO:tasks.workunit.client.0.smithi097.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00876382 s, 1.2 GB/s 2024-05-08T18:31:37.208 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:37.208 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2024-05-08T18:31:37.208 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2024-05-08T18:31:37.208 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-05-08T18:31:37.209 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.209 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4479.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-05-08T18:31:37.209 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:44.576320+0000", 2024-05-08T18:31:37.209 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 112.631922457, 2024-05-08T18:31:37.209 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019751892, 2024-05-08T18:31:37.209 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:37.209 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:37.209 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "reached pg", 2024-05-08T18:31:37.209 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:37.209 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4479", 2024-05-08T18:31:37.209 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3577501689", 2024-05-08T18:31:37.209 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 2 2024-05-08T18:31:37.209 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.210 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:37.210 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.210 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:37.210 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576320+0000", 2024-05-08T18:31:37.210 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:37.210 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.210 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.210 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:37.210 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576320+0000", 2024-05-08T18:31:37.210 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:37.210 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.210 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.210 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:37.211 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576323+0000", 2024-05-08T18:31:37.211 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.813e-06 2024-05-08T18:31:37.211 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.211 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.211 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:37.211 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576335+0000", 2024-05-08T18:31:37.211 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2330000000000001e-05 2024-05-08T18:31:37.211 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.211 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.211 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:37.211 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576367+0000", 2024-05-08T18:31:37.211 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2036999999999998e-05 2024-05-08T18:31:37.211 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.212 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.212 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:37.212 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576394+0000", 2024-05-08T18:31:37.212 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6529e-05 2024-05-08T18:31:37.212 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.212 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.212 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:37.212 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576550+0000", 2024-05-08T18:31:37.212 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000156718 2024-05-08T18:31:37.212 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.212 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.212 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-05-08T18:31:37.212 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576560+0000", 2024-05-08T18:31:37.212 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0040999999999999e-05 2024-05-08T18:31:37.213 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.213 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.213 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:37.213 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.587240+0000", 2024-05-08T18:31:37.213 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010679266999999999 2024-05-08T18:31:37.213 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.213 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.213 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2024-05-08T18:31:37.213 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.587266+0000", 2024-05-08T18:31:37.213 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6642e-05 2024-05-08T18:31:37.213 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.213 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.213 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:37.214 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.595882+0000", 2024-05-08T18:31:37.214 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0086159600000000006 2024-05-08T18:31:37.214 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.214 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.214 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:37.214 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.596072+0000", 2024-05-08T18:31:37.214 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000189555 2024-05-08T18:31:37.214 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:37.214 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:37.214 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:37.214 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.214 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.214 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:31:37.214 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:48.766182+0000", 2024-05-08T18:31:37.215 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 108.44206043, 2024-05-08T18:31:37.215 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031881209999999999, 2024-05-08T18:31:37.215 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:37.215 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:37.215 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:37.215 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:37.215 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:37.215 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:37.215 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 193 2024-05-08T18:31:37.215 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.215 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:37.215 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.215 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:37.216 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766182+0000", 2024-05-08T18:31:37.216 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:37.216 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.216 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.216 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:37.216 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766182+0000", 2024-05-08T18:31:37.216 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:37.216 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.216 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.216 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:37.216 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766184+0000", 2024-05-08T18:31:37.216 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4159999999999998e-06 2024-05-08T18:31:37.216 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.216 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.217 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:37.217 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766196+0000", 2024-05-08T18:31:37.217 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1814000000000001e-05 2024-05-08T18:31:37.217 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.217 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.217 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:37.217 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766227+0000", 2024-05-08T18:31:37.217 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0676000000000002e-05 2024-05-08T18:31:37.217 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.217 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.217 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:37.217 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766242+0000", 2024-05-08T18:31:37.217 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5497000000000001e-05 2024-05-08T18:31:37.218 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.218 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.218 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:37.218 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766354+0000", 2024-05-08T18:31:37.218 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000111579 2024-05-08T18:31:37.218 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.218 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.218 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:37.218 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766569+0000", 2024-05-08T18:31:37.218 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000214978 2024-05-08T18:31:37.218 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.219 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.219 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:37.219 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766834+0000", 2024-05-08T18:31:37.219 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00026551500000000002 2024-05-08T18:31:37.219 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.219 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.219 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:37.220 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.768577+0000", 2024-05-08T18:31:37.220 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001742513 2024-05-08T18:31:37.220 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.220 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.220 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:37.220 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.769150+0000", 2024-05-08T18:31:37.220 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00057320500000000003 2024-05-08T18:31:37.220 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.220 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.220 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:37.220 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.769250+0000", 2024-05-08T18:31:37.220 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.9846000000000006e-05 2024-05-08T18:31:37.220 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.221 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.221 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:37.221 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.769370+0000", 2024-05-08T18:31:37.221 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012008200000000001 2024-05-08T18:31:37.221 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:37.221 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:37.221 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:37.221 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.221 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.221 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:37.221 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.679562+0000", 2024-05-08T18:31:37.221 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 105.528680726, 2024-05-08T18:31:37.221 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0086320800000000003, 2024-05-08T18:31:37.221 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:37.221 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:37.222 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:37.222 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:37.222 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:37.222 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:37.222 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 208 2024-05-08T18:31:37.222 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.222 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:37.222 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.222 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:37.222 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679562+0000", 2024-05-08T18:31:37.222 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:37.222 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.223 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.223 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:37.223 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679562+0000", 2024-05-08T18:31:37.223 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:37.223 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.223 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.223 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:37.223 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679565+0000", 2024-05-08T18:31:37.223 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0800000000000002e-06 2024-05-08T18:31:37.223 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.223 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.223 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:37.223 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679578+0000", 2024-05-08T18:31:37.223 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3217000000000001e-05 2024-05-08T18:31:37.224 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.224 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.224 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:37.224 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679610+0000", 2024-05-08T18:31:37.224 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1696000000000003e-05 2024-05-08T18:31:37.224 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.224 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.224 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:37.224 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679625+0000", 2024-05-08T18:31:37.224 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5824e-05 2024-05-08T18:31:37.224 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.224 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.225 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:37.225 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679758+0000", 2024-05-08T18:31:37.225 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013231199999999999 2024-05-08T18:31:37.225 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.225 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.225 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-05-08T18:31:37.225 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679770+0000", 2024-05-08T18:31:37.225 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1800000000000001e-05 2024-05-08T18:31:37.225 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.225 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.226 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:37.226 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.685241+0000", 2024-05-08T18:31:37.226 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0054710169999999999 2024-05-08T18:31:37.226 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.226 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.226 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:37.226 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.685444+0000", 2024-05-08T18:31:37.226 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000203835 2024-05-08T18:31:37.226 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.226 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.226 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:37.226 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.685842+0000", 2024-05-08T18:31:37.227 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00039773 2024-05-08T18:31:37.227 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.227 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.227 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:37.227 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.687232+0000", 2024-05-08T18:31:37.227 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00139011 2024-05-08T18:31:37.227 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.227 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.227 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:37.227 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.688049+0000", 2024-05-08T18:31:37.227 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00081667000000000003 2024-05-08T18:31:37.227 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.227 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.227 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:37.228 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.688135+0000", 2024-05-08T18:31:37.228 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6299999999999997e-05 2024-05-08T18:31:37.228 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.228 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.228 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:37.228 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.688194+0000", 2024-05-08T18:31:37.228 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8489000000000002e-05 2024-05-08T18:31:37.228 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:37.228 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:37.228 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:37.228 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.228 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.228 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:37.228 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.707114+0000", 2024-05-08T18:31:37.229 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 105.501128712, 2024-05-08T18:31:37.229 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031802990000000001, 2024-05-08T18:31:37.229 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:37.229 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:37.229 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:37.229 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:37.229 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:37.229 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:37.229 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 212 2024-05-08T18:31:37.229 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.230 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:37.230 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.230 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:37.230 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707114+0000", 2024-05-08T18:31:37.230 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:37.230 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.230 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.230 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:37.230 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707114+0000", 2024-05-08T18:31:37.230 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:37.230 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.230 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.230 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:37.231 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707117+0000", 2024-05-08T18:31:37.231 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8629999999999999e-06 2024-05-08T18:31:37.231 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.231 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.231 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:37.231 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707129+0000", 2024-05-08T18:31:37.231 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2150000000000001e-05 2024-05-08T18:31:37.231 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.231 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.231 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:37.231 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707158+0000", 2024-05-08T18:31:37.231 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9513999999999999e-05 2024-05-08T18:31:37.231 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.231 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.232 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:37.232 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707173+0000", 2024-05-08T18:31:37.232 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5136e-05 2024-05-08T18:31:37.232 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.232 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.232 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:37.232 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707309+0000", 2024-05-08T18:31:37.232 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000135609 2024-05-08T18:31:37.232 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.233 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.233 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:37.233 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707523+0000", 2024-05-08T18:31:37.233 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021362200000000001 2024-05-08T18:31:37.233 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.233 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.233 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:37.233 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707918+0000", 2024-05-08T18:31:37.233 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00039556299999999998 2024-05-08T18:31:37.233 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.233 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.233 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:37.233 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.709166+0000", 2024-05-08T18:31:37.233 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012476410000000001 2024-05-08T18:31:37.234 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.234 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.234 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:37.234 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.710145+0000", 2024-05-08T18:31:37.234 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00097909899999999998 2024-05-08T18:31:37.234 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.234 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.234 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:37.234 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.710231+0000", 2024-05-08T18:31:37.234 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5625999999999996e-05 2024-05-08T18:31:37.235 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.235 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.235 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:37.235 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.710294+0000", 2024-05-08T18:31:37.235 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3476e-05 2024-05-08T18:31:37.235 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:37.235 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:37.235 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:37.235 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.235 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.235 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:37.235 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.731985+0000", 2024-05-08T18:31:37.235 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 105.476257487, 2024-05-08T18:31:37.236 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0039250600000000002, 2024-05-08T18:31:37.236 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:37.236 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:37.236 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:37.236 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:37.236 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:37.236 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:37.236 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 219 2024-05-08T18:31:37.236 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.236 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:37.236 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.236 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:37.236 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731985+0000", 2024-05-08T18:31:37.236 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:37.237 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.237 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.237 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:37.237 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731985+0000", 2024-05-08T18:31:37.237 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:37.237 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.237 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.237 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:37.237 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731988+0000", 2024-05-08T18:31:37.237 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6599999999999999e-06 2024-05-08T18:31:37.237 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.237 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.237 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:37.238 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.732017+0000", 2024-05-08T18:31:37.238 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9692999999999998e-05 2024-05-08T18:31:37.238 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.238 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.238 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:37.238 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.732048+0000", 2024-05-08T18:31:37.238 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1066999999999999e-05 2024-05-08T18:31:37.238 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.238 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.238 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:37.238 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.732064+0000", 2024-05-08T18:31:37.238 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5786000000000001e-05 2024-05-08T18:31:37.238 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.238 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.239 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:37.239 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.732213+0000", 2024-05-08T18:31:37.239 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014895899999999999 2024-05-08T18:31:37.239 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.239 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.239 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:37.239 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.732572+0000", 2024-05-08T18:31:37.239 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000358904 2024-05-08T18:31:37.239 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.239 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.239 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:37.239 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.733349+0000", 2024-05-08T18:31:37.239 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00077657699999999997 2024-05-08T18:31:37.240 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.240 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.240 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:37.240 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.734899+0000", 2024-05-08T18:31:37.240 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001550652 2024-05-08T18:31:37.240 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.240 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.240 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:37.240 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.735641+0000", 2024-05-08T18:31:37.240 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00074222000000000003 2024-05-08T18:31:37.240 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.240 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.240 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:37.241 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.735801+0000", 2024-05-08T18:31:37.241 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015913599999999999 2024-05-08T18:31:37.241 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.241 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.241 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:37.241 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.735910+0000", 2024-05-08T18:31:37.241 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000109406 2024-05-08T18:31:37.241 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:37.241 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:37.241 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:37.241 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.241 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.241 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:37.241 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.750251+0000", 2024-05-08T18:31:37.242 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 105.45799155500001, 2024-05-08T18:31:37.242 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0038408600000000002, 2024-05-08T18:31:37.242 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:37.242 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:37.242 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:37.242 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:37.242 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:37.242 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:37.242 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 224 2024-05-08T18:31:37.242 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.242 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:37.242 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.242 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:37.243 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750251+0000", 2024-05-08T18:31:37.243 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:37.243 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.243 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.243 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:37.243 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750251+0000", 2024-05-08T18:31:37.243 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:37.243 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.243 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.243 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:37.244 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750253+0000", 2024-05-08T18:31:37.244 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2129999999999998e-06 2024-05-08T18:31:37.244 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.244 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.244 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:37.244 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750265+0000", 2024-05-08T18:31:37.244 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1484000000000001e-05 2024-05-08T18:31:37.244 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.244 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.244 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:37.244 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750293+0000", 2024-05-08T18:31:37.244 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8673000000000001e-05 2024-05-08T18:31:37.244 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.245 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.245 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:37.245 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750308+0000", 2024-05-08T18:31:37.245 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4620000000000001e-05 2024-05-08T18:31:37.245 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.245 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.245 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:37.245 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750459+0000", 2024-05-08T18:31:37.245 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000151619 2024-05-08T18:31:37.245 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.246 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.246 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:37.246 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750822+0000", 2024-05-08T18:31:37.246 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000362467 2024-05-08T18:31:37.246 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.246 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.246 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:37.246 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.751591+0000", 2024-05-08T18:31:37.246 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00076934699999999998 2024-05-08T18:31:37.246 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.246 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.246 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:37.246 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.753042+0000", 2024-05-08T18:31:37.247 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001450652 2024-05-08T18:31:37.247 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.247 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.247 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:37.247 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.753792+0000", 2024-05-08T18:31:37.247 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00075045500000000002 2024-05-08T18:31:37.247 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.247 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.247 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:37.247 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.753977+0000", 2024-05-08T18:31:37.247 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000184511 2024-05-08T18:31:37.247 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.247 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.247 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:37.248 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.754092+0000", 2024-05-08T18:31:37.248 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000114819 2024-05-08T18:31:37.248 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:37.248 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:37.248 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:37.248 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.248 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.248 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:37.248 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.783902+0000", 2024-05-08T18:31:37.248 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 105.424340824, 2024-05-08T18:31:37.248 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003120046, 2024-05-08T18:31:37.248 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:37.248 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:37.249 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:37.249 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:37.249 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:37.249 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:37.249 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 233 2024-05-08T18:31:37.249 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.249 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:37.249 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.249 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:37.249 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.783902+0000", 2024-05-08T18:31:37.249 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:37.249 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.249 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.249 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:37.249 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.783902+0000", 2024-05-08T18:31:37.250 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:37.250 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.250 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.250 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:37.250 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.783904+0000", 2024-05-08T18:31:37.250 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5229999999999998e-06 2024-05-08T18:31:37.250 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.250 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.250 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:37.250 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.783916+0000", 2024-05-08T18:31:37.250 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1513e-05 2024-05-08T18:31:37.250 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.250 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.251 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:37.251 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.783947+0000", 2024-05-08T18:31:37.251 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1353000000000003e-05 2024-05-08T18:31:37.251 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.251 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.251 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:37.251 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.783964+0000", 2024-05-08T18:31:37.251 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6643e-05 2024-05-08T18:31:37.251 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.251 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.251 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:37.251 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.784110+0000", 2024-05-08T18:31:37.251 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014627299999999999 2024-05-08T18:31:37.251 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.252 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.252 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:37.252 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.784329+0000", 2024-05-08T18:31:37.252 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021892099999999999 2024-05-08T18:31:37.252 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.252 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.252 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:37.252 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.784752+0000", 2024-05-08T18:31:37.252 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00042336700000000001 2024-05-08T18:31:37.252 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.252 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.252 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:37.252 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.786093+0000", 2024-05-08T18:31:37.252 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00134107 2024-05-08T18:31:37.253 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.253 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.253 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:37.253 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.786863+0000", 2024-05-08T18:31:37.253 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00076949099999999997 2024-05-08T18:31:37.253 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.253 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.253 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:37.253 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.786955+0000", 2024-05-08T18:31:37.253 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.2478999999999993e-05 2024-05-08T18:31:37.253 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.253 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.253 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:37.254 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.787022+0000", 2024-05-08T18:31:37.254 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6413000000000003e-05 2024-05-08T18:31:37.254 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:37.254 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:37.254 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:37.254 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.254 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.254 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:751 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:37.254 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.125611+0000", 2024-05-08T18:31:37.254 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 105.082630975, 2024-05-08T18:31:37.254 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032716749999999999, 2024-05-08T18:31:37.254 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:37.254 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:37.255 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:37.255 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:37.255 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:37.255 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:37.255 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 751 2024-05-08T18:31:37.255 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.255 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:37.255 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.255 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:37.255 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125611+0000", 2024-05-08T18:31:37.255 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:37.255 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.255 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.255 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:37.255 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125611+0000", 2024-05-08T18:31:37.256 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:37.256 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.256 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.256 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:37.256 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125614+0000", 2024-05-08T18:31:37.256 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.12e-06 2024-05-08T18:31:37.256 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.256 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.256 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:37.256 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125624+0000", 2024-05-08T18:31:37.256 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0492999999999999e-05 2024-05-08T18:31:37.256 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.256 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.256 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:37.257 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125650+0000", 2024-05-08T18:31:37.257 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5907000000000001e-05 2024-05-08T18:31:37.257 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.257 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.257 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:37.257 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125667+0000", 2024-05-08T18:31:37.257 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.694e-05 2024-05-08T18:31:37.257 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.257 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.257 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:37.257 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125801+0000", 2024-05-08T18:31:37.257 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000134482 2024-05-08T18:31:37.257 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.257 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.258 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:37.258 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.126174+0000", 2024-05-08T18:31:37.258 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00037294999999999999 2024-05-08T18:31:37.258 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.258 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.258 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:37.258 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.126750+0000", 2024-05-08T18:31:37.258 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00057538900000000004 2024-05-08T18:31:37.258 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.258 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.258 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:37.258 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.127997+0000", 2024-05-08T18:31:37.259 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001247761 2024-05-08T18:31:37.259 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.259 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.259 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:37.259 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.128731+0000", 2024-05-08T18:31:37.259 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00073338099999999996 2024-05-08T18:31:37.259 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.259 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.259 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:37.259 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.128817+0000", 2024-05-08T18:31:37.259 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5993000000000002e-05 2024-05-08T18:31:37.259 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.260 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.260 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:37.260 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.128883+0000", 2024-05-08T18:31:37.260 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6259000000000004e-05 2024-05-08T18:31:37.260 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:37.260 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:37.260 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:37.260 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.260 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.260 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:753 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:37.260 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.129809+0000", 2024-05-08T18:31:37.260 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 105.078433437, 2024-05-08T18:31:37.260 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0033775440000000001, 2024-05-08T18:31:37.260 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:37.261 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:37.261 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:37.261 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:37.261 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:37.261 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:37.261 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 753 2024-05-08T18:31:37.261 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.261 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:37.261 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.261 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:37.261 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129809+0000", 2024-05-08T18:31:37.261 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:37.261 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.261 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.262 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:37.262 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129809+0000", 2024-05-08T18:31:37.262 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:37.262 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.262 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.262 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:37.262 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129811+0000", 2024-05-08T18:31:37.262 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1730000000000002e-06 2024-05-08T18:31:37.262 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.262 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.262 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:37.262 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129822+0000", 2024-05-08T18:31:37.262 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0583e-05 2024-05-08T18:31:37.263 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.263 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.263 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:37.263 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129852+0000", 2024-05-08T18:31:37.263 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0744000000000002e-05 2024-05-08T18:31:37.263 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.263 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.263 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:37.263 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129870+0000", 2024-05-08T18:31:37.263 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7955999999999999e-05 2024-05-08T18:31:37.263 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.263 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.263 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:37.263 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.130018+0000", 2024-05-08T18:31:37.264 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014747600000000001 2024-05-08T18:31:37.264 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.264 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.264 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:37.264 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.130259+0000", 2024-05-08T18:31:37.264 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024079099999999999 2024-05-08T18:31:37.264 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.264 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.264 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:37.264 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.130734+0000", 2024-05-08T18:31:37.264 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00047562 2024-05-08T18:31:37.264 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.264 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.264 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:37.265 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.131997+0000", 2024-05-08T18:31:37.265 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012626429999999999 2024-05-08T18:31:37.265 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.265 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.265 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:37.265 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.132923+0000", 2024-05-08T18:31:37.265 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00092627599999999997 2024-05-08T18:31:37.265 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.265 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.265 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:37.265 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.133076+0000", 2024-05-08T18:31:37.265 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000152989 2024-05-08T18:31:37.265 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.265 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.266 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:37.266 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.133187+0000", 2024-05-08T18:31:37.266 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000110293 2024-05-08T18:31:37.266 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:37.266 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:37.266 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:37.266 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.266 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.266 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:37.266 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.228247+0000", 2024-05-08T18:31:37.266 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 104.979995827, 2024-05-08T18:31:37.266 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032753449999999998, 2024-05-08T18:31:37.266 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:37.267 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:37.267 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:37.267 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:37.267 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:37.267 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:37.267 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 796 2024-05-08T18:31:37.267 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.267 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:37.267 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.267 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:37.267 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228247+0000", 2024-05-08T18:31:37.267 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:37.267 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.269 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.269 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:37.269 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228247+0000", 2024-05-08T18:31:37.270 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:37.270 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.270 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.270 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:37.270 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228249+0000", 2024-05-08T18:31:37.270 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3800000000000001e-06 2024-05-08T18:31:37.270 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.270 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.270 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:37.270 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228260+0000", 2024-05-08T18:31:37.270 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1496e-05 2024-05-08T18:31:37.270 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.270 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.271 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:37.271 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228292+0000", 2024-05-08T18:31:37.271 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1294000000000002e-05 2024-05-08T18:31:37.271 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.271 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.271 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:37.271 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228306+0000", 2024-05-08T18:31:37.271 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4606e-05 2024-05-08T18:31:37.271 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.271 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.271 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:37.271 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228443+0000", 2024-05-08T18:31:37.271 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013672599999999999 2024-05-08T18:31:37.272 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.272 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.272 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:37.272 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228813+0000", 2024-05-08T18:31:37.272 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00036987000000000001 2024-05-08T18:31:37.272 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.272 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.272 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:31:37.272 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.229365+0000", 2024-05-08T18:31:37.272 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00055210600000000002 2024-05-08T18:31:37.272 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.272 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.272 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:37.273 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.230800+0000", 2024-05-08T18:31:37.273 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001435006 2024-05-08T18:31:37.273 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.273 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.273 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:37.273 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.231369+0000", 2024-05-08T18:31:37.273 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00056848499999999998 2024-05-08T18:31:37.273 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.273 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.273 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:37.273 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.231455+0000", 2024-05-08T18:31:37.273 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6905999999999998e-05 2024-05-08T18:31:37.273 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.273 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.276 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:37.276 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.231522+0000", 2024-05-08T18:31:37.276 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6470000000000006e-05 2024-05-08T18:31:37.276 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:37.276 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:37.276 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:37.276 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.276 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.277 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:798 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:37.277 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.232573+0000", 2024-05-08T18:31:37.277 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 104.97566972, 2024-05-08T18:31:37.277 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0030406690000000002, 2024-05-08T18:31:37.277 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:37.277 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:37.277 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:37.277 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:37.277 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:37.277 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:37.277 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 798 2024-05-08T18:31:37.277 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.277 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:37.278 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.278 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:37.278 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232573+0000", 2024-05-08T18:31:37.278 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:37.278 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.278 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.278 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:37.278 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232573+0000", 2024-05-08T18:31:37.278 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:37.278 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.278 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.278 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:37.278 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232574+0000", 2024-05-08T18:31:37.278 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.446e-06 2024-05-08T18:31:37.279 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.279 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.279 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:37.279 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232581+0000", 2024-05-08T18:31:37.279 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.0670000000000003e-06 2024-05-08T18:31:37.279 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.279 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.279 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:37.279 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232600+0000", 2024-05-08T18:31:37.279 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8822999999999999e-05 2024-05-08T18:31:37.279 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.279 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.279 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:37.280 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232611+0000", 2024-05-08T18:31:37.280 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1233000000000001e-05 2024-05-08T18:31:37.280 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.280 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.280 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:37.280 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232731+0000", 2024-05-08T18:31:37.280 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000120189 2024-05-08T18:31:37.280 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.280 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.280 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:37.280 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.232963+0000", 2024-05-08T18:31:37.280 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023111900000000001 2024-05-08T18:31:37.280 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.280 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.281 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:31:37.281 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.233441+0000", 2024-05-08T18:31:37.281 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00047866899999999998 2024-05-08T18:31:37.281 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.281 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.281 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:37.281 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.234542+0000", 2024-05-08T18:31:37.281 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001101245 2024-05-08T18:31:37.281 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.281 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.281 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:37.281 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.235349+0000", 2024-05-08T18:31:37.281 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000806567 2024-05-08T18:31:37.281 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.282 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.282 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:37.282 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.235498+0000", 2024-05-08T18:31:37.282 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014907200000000001 2024-05-08T18:31:37.282 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.282 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.282 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:37.282 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.235613+0000", 2024-05-08T18:31:37.282 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115239 2024-05-08T18:31:37.282 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:37.282 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:37.282 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:37.282 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.282 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.283 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:37.283 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.248596+0000", 2024-05-08T18:31:37.283 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 104.95964591400001, 2024-05-08T18:31:37.283 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002919984, 2024-05-08T18:31:37.283 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:37.283 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:37.283 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:37.283 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:37.283 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:37.283 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:37.283 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 805 2024-05-08T18:31:37.283 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.283 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:37.283 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.284 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:37.284 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248596+0000", 2024-05-08T18:31:37.284 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:37.284 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.284 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.284 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:37.284 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248596+0000", 2024-05-08T18:31:37.284 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:37.284 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.284 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.284 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:37.284 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248599+0000", 2024-05-08T18:31:37.284 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3630000000000001e-06 2024-05-08T18:31:37.284 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.285 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.285 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:37.285 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248610+0000", 2024-05-08T18:31:37.285 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1267000000000001e-05 2024-05-08T18:31:37.285 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.285 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.285 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:37.285 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248641+0000", 2024-05-08T18:31:37.285 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1309999999999997e-05 2024-05-08T18:31:37.285 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.285 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.285 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:37.285 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248656+0000", 2024-05-08T18:31:37.285 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4449e-05 2024-05-08T18:31:37.285 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.286 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.286 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:37.286 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.248781+0000", 2024-05-08T18:31:37.286 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012500900000000001 2024-05-08T18:31:37.286 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.286 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.286 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:37.286 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.249001+0000", 2024-05-08T18:31:37.286 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021963500000000001 2024-05-08T18:31:37.286 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.286 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.286 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:37.287 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.249341+0000", 2024-05-08T18:31:37.287 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00034004100000000002 2024-05-08T18:31:37.287 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.287 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.287 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:37.287 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.250473+0000", 2024-05-08T18:31:37.287 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0011324180000000001 2024-05-08T18:31:37.287 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.287 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.287 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:37.287 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.251230+0000", 2024-05-08T18:31:37.287 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00075751400000000004 2024-05-08T18:31:37.287 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.287 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.288 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:37.288 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.251394+0000", 2024-05-08T18:31:37.288 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016379200000000001 2024-05-08T18:31:37.288 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.288 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.288 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:37.288 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.251516+0000", 2024-05-08T18:31:37.288 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012218600000000001 2024-05-08T18:31:37.288 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:37.288 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:37.288 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:37.288 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.288 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.288 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:37.289 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.313184+0000", 2024-05-08T18:31:37.289 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 104.89505823899999, 2024-05-08T18:31:37.289 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003040016, 2024-05-08T18:31:37.289 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:37.289 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:37.289 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:37.289 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:37.289 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:37.289 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:37.289 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 832 2024-05-08T18:31:37.289 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.289 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:37.289 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.290 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:37.290 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313184+0000", 2024-05-08T18:31:37.290 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:37.290 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.290 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.290 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:37.290 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313184+0000", 2024-05-08T18:31:37.290 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:37.290 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.290 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.290 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:37.290 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313187+0000", 2024-05-08T18:31:37.290 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5100000000000001e-06 2024-05-08T18:31:37.290 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.291 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.291 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:37.291 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313199+0000", 2024-05-08T18:31:37.291 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.201e-05 2024-05-08T18:31:37.291 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.291 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.291 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:37.291 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313229+0000", 2024-05-08T18:31:37.291 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9839e-05 2024-05-08T18:31:37.291 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.291 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.291 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:37.291 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313243+0000", 2024-05-08T18:31:37.291 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4727e-05 2024-05-08T18:31:37.292 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.292 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.292 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:37.292 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313358+0000", 2024-05-08T18:31:37.292 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115016 2024-05-08T18:31:37.292 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.292 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.292 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:37.292 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313577+0000", 2024-05-08T18:31:37.292 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021897799999999999 2024-05-08T18:31:37.293 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.293 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.293 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:31:37.293 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.313889+0000", 2024-05-08T18:31:37.293 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00031210400000000001 2024-05-08T18:31:37.293 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.293 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.293 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:37.293 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.315229+0000", 2024-05-08T18:31:37.293 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001339963 2024-05-08T18:31:37.293 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.293 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.293 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:37.293 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.315938+0000", 2024-05-08T18:31:37.294 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00070853400000000003 2024-05-08T18:31:37.294 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.294 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.294 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:37.294 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.316111+0000", 2024-05-08T18:31:37.294 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000173396 2024-05-08T18:31:37.294 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.294 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.294 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:37.294 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.316224+0000", 2024-05-08T18:31:37.294 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000112939 2024-05-08T18:31:37.294 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:37.294 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:37.294 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:37.295 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.295 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.295 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:834 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:37.295 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.317499+0000", 2024-05-08T18:31:37.295 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 104.89074343999999, 2024-05-08T18:31:37.295 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0033281109999999999, 2024-05-08T18:31:37.295 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:37.295 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:37.295 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:37.295 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:37.295 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:37.295 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:37.295 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 834 2024-05-08T18:31:37.296 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.296 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:37.296 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.296 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:37.296 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317499+0000", 2024-05-08T18:31:37.296 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:37.296 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.296 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.296 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:37.296 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317499+0000", 2024-05-08T18:31:37.296 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:37.296 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.296 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.296 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:37.297 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317501+0000", 2024-05-08T18:31:37.297 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9400000000000001e-06 2024-05-08T18:31:37.297 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.297 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.297 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:37.297 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317511+0000", 2024-05-08T18:31:37.297 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0297e-05 2024-05-08T18:31:37.297 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.297 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.297 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:37.297 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317532+0000", 2024-05-08T18:31:37.297 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1013e-05 2024-05-08T18:31:37.297 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.297 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.298 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:37.298 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317543+0000", 2024-05-08T18:31:37.298 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0757000000000001e-05 2024-05-08T18:31:37.298 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.298 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.298 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:37.298 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317658+0000", 2024-05-08T18:31:37.298 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115129 2024-05-08T18:31:37.298 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.298 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.298 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:37.298 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317887+0000", 2024-05-08T18:31:37.298 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00022880099999999999 2024-05-08T18:31:37.299 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.299 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.299 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:31:37.299 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.318378+0000", 2024-05-08T18:31:37.299 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00049129000000000002 2024-05-08T18:31:37.299 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.299 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.299 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:37.299 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.319597+0000", 2024-05-08T18:31:37.299 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012188469999999999 2024-05-08T18:31:37.299 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.299 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.299 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:37.299 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.320566+0000", 2024-05-08T18:31:37.300 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00096881599999999995 2024-05-08T18:31:37.300 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.300 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.300 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:37.300 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.320713+0000", 2024-05-08T18:31:37.300 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014691500000000001 2024-05-08T18:31:37.300 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.300 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.300 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:37.300 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.320827+0000", 2024-05-08T18:31:37.300 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000114306 2024-05-08T18:31:37.300 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:37.300 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:37.301 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:37.301 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.301 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.301 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:918 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:37.301 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.509337+0000", 2024-05-08T18:31:37.301 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 104.69890492, 2024-05-08T18:31:37.301 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002971787, 2024-05-08T18:31:37.301 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:37.301 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:37.301 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:37.301 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:37.301 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:37.301 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:37.301 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 918 2024-05-08T18:31:37.302 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.302 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:37.302 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.302 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:37.302 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509337+0000", 2024-05-08T18:31:37.302 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:37.302 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.302 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.302 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:37.302 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509337+0000", 2024-05-08T18:31:37.302 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:37.303 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.303 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.303 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:37.303 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509340+0000", 2024-05-08T18:31:37.303 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2570000000000002e-06 2024-05-08T18:31:37.303 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.303 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.303 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:37.303 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509351+0000", 2024-05-08T18:31:37.303 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0933e-05 2024-05-08T18:31:37.303 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.303 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.303 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:37.303 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509382+0000", 2024-05-08T18:31:37.304 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1198999999999997e-05 2024-05-08T18:31:37.304 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.304 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.304 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:37.304 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509400+0000", 2024-05-08T18:31:37.304 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8236999999999998e-05 2024-05-08T18:31:37.304 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.304 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.304 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:37.304 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509529+0000", 2024-05-08T18:31:37.304 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012905600000000001 2024-05-08T18:31:37.304 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.304 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.304 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:37.305 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.509777+0000", 2024-05-08T18:31:37.305 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024786799999999999 2024-05-08T18:31:37.305 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.305 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.305 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:37.305 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.510284+0000", 2024-05-08T18:31:37.305 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000506796 2024-05-08T18:31:37.305 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.305 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.305 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:37.305 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.511453+0000", 2024-05-08T18:31:37.305 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001169575 2024-05-08T18:31:37.305 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.306 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.306 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:37.306 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.512051+0000", 2024-05-08T18:31:37.306 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00059743100000000005 2024-05-08T18:31:37.306 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.306 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.306 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:37.306 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.512199+0000", 2024-05-08T18:31:37.306 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000148486 2024-05-08T18:31:37.306 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.306 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.306 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:37.306 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.512309+0000", 2024-05-08T18:31:37.306 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000109949 2024-05-08T18:31:37.307 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:37.307 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:37.307 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:37.307 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.307 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.307 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:37.307 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.578568+0000", 2024-05-08T18:31:37.307 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 104.629674858, 2024-05-08T18:31:37.307 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0030345839999999999, 2024-05-08T18:31:37.307 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:37.307 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:37.307 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:37.307 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:37.307 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:37.308 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:37.308 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 946 2024-05-08T18:31:37.308 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.308 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:37.308 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.308 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:37.308 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578568+0000", 2024-05-08T18:31:37.308 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:37.308 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.308 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.308 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:37.308 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578568+0000", 2024-05-08T18:31:37.308 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:37.308 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.309 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.309 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:37.309 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578570+0000", 2024-05-08T18:31:37.309 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3700000000000002e-06 2024-05-08T18:31:37.309 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.309 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.309 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:37.309 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578582+0000", 2024-05-08T18:31:37.309 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1627000000000001e-05 2024-05-08T18:31:37.309 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.309 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.309 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:37.309 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578612+0000", 2024-05-08T18:31:37.309 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0103e-05 2024-05-08T18:31:37.310 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.310 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.310 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:37.310 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578627+0000", 2024-05-08T18:31:37.310 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4949999999999999e-05 2024-05-08T18:31:37.310 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.310 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.310 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:37.310 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.578750+0000", 2024-05-08T18:31:37.310 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012309899999999999 2024-05-08T18:31:37.310 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.310 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.310 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:37.311 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.579042+0000", 2024-05-08T18:31:37.311 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00029212500000000001 2024-05-08T18:31:37.311 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.311 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.311 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:37.311 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.579557+0000", 2024-05-08T18:31:37.311 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00051536900000000001 2024-05-08T18:31:37.311 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.311 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.311 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:37.311 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.580698+0000", 2024-05-08T18:31:37.311 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001140774 2024-05-08T18:31:37.311 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.311 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.312 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:37.312 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.581367+0000", 2024-05-08T18:31:37.312 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00066884799999999999 2024-05-08T18:31:37.312 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.312 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.312 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:37.312 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.581489+0000", 2024-05-08T18:31:37.312 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012265600000000001 2024-05-08T18:31:37.312 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.312 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.312 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:37.312 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.581602+0000", 2024-05-08T18:31:37.312 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000112663 2024-05-08T18:31:37.312 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:37.312 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:37.313 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:37.313 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.313 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.313 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1178 4.27 4:e545f9df:::.dir.3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.1.0:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-05-08T18:31:37.313 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:37.015710+0000", 2024-05-08T18:31:37.313 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.19253237600000001, 2024-05-08T18:31:37.313 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0029383489999999998, 2024-05-08T18:31:37.313 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:37.313 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:37.313 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:37.313 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:37.313 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:37.313 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:37.313 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1178 2024-05-08T18:31:37.314 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.314 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:37.314 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.314 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:37.314 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.015710+0000", 2024-05-08T18:31:37.314 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:37.314 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.314 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.314 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:37.314 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.015710+0000", 2024-05-08T18:31:37.314 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:37.314 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.314 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.315 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:37.315 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.015713+0000", 2024-05-08T18:31:37.315 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.711e-06 2024-05-08T18:31:37.315 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.315 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.315 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:37.315 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.015723+0000", 2024-05-08T18:31:37.315 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0498e-05 2024-05-08T18:31:37.315 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.315 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.315 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:37.315 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.015746+0000", 2024-05-08T18:31:37.315 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2827999999999999e-05 2024-05-08T18:31:37.315 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.315 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.316 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:37.316 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.015758+0000", 2024-05-08T18:31:37.316 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2004999999999999e-05 2024-05-08T18:31:37.316 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.316 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.316 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:37.316 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.015827+0000", 2024-05-08T18:31:37.316 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8821999999999999e-05 2024-05-08T18:31:37.316 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.316 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.316 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:37.316 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.015984+0000", 2024-05-08T18:31:37.316 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015720900000000001 2024-05-08T18:31:37.317 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.317 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.317 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:31:37.317 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.016148+0000", 2024-05-08T18:31:37.317 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016427799999999999 2024-05-08T18:31:37.317 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.317 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.317 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:37.317 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.017107+0000", 2024-05-08T18:31:37.317 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00095820300000000003 2024-05-08T18:31:37.317 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.317 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.317 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:37.317 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.018584+0000", 2024-05-08T18:31:37.318 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0014777989999999999 2024-05-08T18:31:37.318 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.318 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.318 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:37.318 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.018617+0000", 2024-05-08T18:31:37.318 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2611999999999999e-05 2024-05-08T18:31:37.318 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.318 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.318 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:37.318 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.018648+0000", 2024-05-08T18:31:37.318 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1384000000000003e-05 2024-05-08T18:31:37.318 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:37.318 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:37.319 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:37.319 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.319 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.319 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1186 4.12 4:488b0b39:::.dir.3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.1.8:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-05-08T18:31:37.319 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:37.015800+0000", 2024-05-08T18:31:37.319 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.19244282300000001, 2024-05-08T18:31:37.319 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0041451500000000002, 2024-05-08T18:31:37.319 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:37.319 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:37.319 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:37.319 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:37.319 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:37.319 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:37.319 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1186 2024-05-08T18:31:37.320 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.320 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:37.320 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.320 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:37.320 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.015800+0000", 2024-05-08T18:31:37.320 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:37.320 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.320 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.320 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:37.320 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.015800+0000", 2024-05-08T18:31:37.320 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:37.320 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.320 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.320 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:37.321 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.015800+0000", 2024-05-08T18:31:37.321 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8800000000000002e-07 2024-05-08T18:31:37.321 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.321 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.321 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:37.321 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.015804+0000", 2024-05-08T18:31:37.321 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9319999999999998e-06 2024-05-08T18:31:37.321 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.321 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.321 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:37.321 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.015812+0000", 2024-05-08T18:31:37.321 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7209999999999994e-06 2024-05-08T18:31:37.321 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.322 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.322 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:37.322 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.015818+0000", 2024-05-08T18:31:37.322 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7790000000000001e-06 2024-05-08T18:31:37.322 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.322 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.322 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:37.322 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.015880+0000", 2024-05-08T18:31:37.322 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1896000000000005e-05 2024-05-08T18:31:37.322 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.322 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.322 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:37.322 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.016004+0000", 2024-05-08T18:31:37.322 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012434100000000001 2024-05-08T18:31:37.323 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.323 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.323 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:31:37.323 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.016154+0000", 2024-05-08T18:31:37.323 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014992799999999999 2024-05-08T18:31:37.323 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.323 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.323 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:37.323 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.017131+0000", 2024-05-08T18:31:37.323 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00097709800000000003 2024-05-08T18:31:37.323 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.323 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.323 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:37.323 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.019857+0000", 2024-05-08T18:31:37.324 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0027260230000000002 2024-05-08T18:31:37.324 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.324 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.324 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:37.324 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.019907+0000", 2024-05-08T18:31:37.324 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9524999999999998e-05 2024-05-08T18:31:37.324 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.324 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.324 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:37.324 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.019945+0000", 2024-05-08T18:31:37.324 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8219000000000001e-05 2024-05-08T18:31:37.324 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:37.325 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:37.325 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:37.325 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.325 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.325 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1181 4.21 e80/23 4:85baa8d2:::.dir.3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.1.3:head v 80'1, mlcod=0'0)", 2024-05-08T18:31:37.325 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:37.016330+0000", 2024-05-08T18:31:37.325 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.19191222599999999, 2024-05-08T18:31:37.325 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003592451, 2024-05-08T18:31:37.325 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:37.325 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:37.325 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:37.325 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:37.325 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.325 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:37.326 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.016330+0000", 2024-05-08T18:31:37.326 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:37.326 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.326 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.326 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:37.326 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.016330+0000", 2024-05-08T18:31:37.326 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:37.326 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.326 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.326 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:37.326 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.016330+0000", 2024-05-08T18:31:37.326 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.96e-07 2024-05-08T18:31:37.326 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.327 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.327 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:37.327 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.016336+0000", 2024-05-08T18:31:37.327 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6420000000000004e-06 2024-05-08T18:31:37.327 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.327 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.327 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:37.327 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.016346+0000", 2024-05-08T18:31:37.327 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.4320000000000005e-06 2024-05-08T18:31:37.327 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.327 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.327 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:37.327 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.016354+0000", 2024-05-08T18:31:37.327 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9509999999999995e-06 2024-05-08T18:31:37.328 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.328 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.328 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:37.328 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.016434+0000", 2024-05-08T18:31:37.328 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.9892e-05 2024-05-08T18:31:37.328 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.328 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.328 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:37.328 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.016453+0000", 2024-05-08T18:31:37.328 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8151e-05 2024-05-08T18:31:37.328 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.329 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.329 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:37.329 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.019888+0000", 2024-05-08T18:31:37.329 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0034350000000000001 2024-05-08T18:31:37.329 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.329 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.329 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:37.329 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.019923+0000", 2024-05-08T18:31:37.329 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5086999999999998e-05 2024-05-08T18:31:37.329 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:37.330 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:37.330 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:37.330 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.330 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.330 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1180 4.9 e80/23 4:92155ad4:::.dir.3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.1.2:head v 80'1, mlcod=0'0)", 2024-05-08T18:31:37.330 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:37.017436+0000", 2024-05-08T18:31:37.330 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.19080639399999999, 2024-05-08T18:31:37.330 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002995691, 2024-05-08T18:31:37.330 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:37.330 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:37.330 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:37.330 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:37.330 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.331 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:37.331 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.017436+0000", 2024-05-08T18:31:37.331 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:37.331 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.331 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.331 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:37.331 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.017436+0000", 2024-05-08T18:31:37.331 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:37.331 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.331 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.331 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:37.331 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.017436+0000", 2024-05-08T18:31:37.331 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.41e-07 2024-05-08T18:31:37.331 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.332 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.332 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:37.332 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.017440+0000", 2024-05-08T18:31:37.332 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0659999999999997e-06 2024-05-08T18:31:37.332 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.332 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.332 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:37.332 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.017449+0000", 2024-05-08T18:31:37.332 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.166e-06 2024-05-08T18:31:37.332 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.332 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.332 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:37.332 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.017455+0000", 2024-05-08T18:31:37.333 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.1030000000000001e-06 2024-05-08T18:31:37.333 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.333 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.333 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:37.333 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.017492+0000", 2024-05-08T18:31:37.333 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7162000000000001e-05 2024-05-08T18:31:37.333 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.333 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.333 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:37.334 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.017503+0000", 2024-05-08T18:31:37.334 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1073999999999999e-05 2024-05-08T18:31:37.334 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.334 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.334 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:37.334 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.020390+0000", 2024-05-08T18:31:37.334 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002887209 2024-05-08T18:31:37.334 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.334 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.334 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:37.334 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.020432+0000", 2024-05-08T18:31:37.334 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.1669999999999999e-05 2024-05-08T18:31:37.334 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:37.335 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:37.335 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:37.335 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:37.335 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:37.335 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:37.337 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-08T18:31:37.337 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:31:37.337+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:31:37.382 INFO:tasks.workunit.client.0.smithi097.stdout:quota enabled for the user usr1 2024-05-08T18:31:37.383 INFO:tasks.workunit.client.0.smithi097.stdout:adding file to bucket buck_2024_04_8_18_31_36: 10Mb. 2024-05-08T18:31:37.383 INFO:tasks.workunit.client.0.smithi097.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-08T18:31:37.383 INFO:tasks.workunit.client.0.smithi097.stdout:Test case: PASSED - quota set for user: usr1 with max_objects=0 passed 2024-05-08T18:31:37.383 INFO:tasks.workunit.client.0.smithi097.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-08T18:31:37.437 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:31:37.437+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:31:37.508 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:37.508 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:31:37.508 INFO:teuthology.orchestra.run.smithi097.stdout: "num_ops": 0 2024-05-08T18:31:37.509 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:37.522 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-08T18:31:37.564 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:31:37.565+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:31:37.636 INFO:tasks.workunit.client.0.smithi097.stdout:user usr1 deleted 2024-05-08T18:31:37.639 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:31:37.637+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:31:37.681 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:37.681 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:31:37.681 INFO:teuthology.orchestra.run.smithi097.stdout: "complaint_time": 30, 2024-05-08T18:31:37.681 INFO:teuthology.orchestra.run.smithi097.stdout: "num_blocked_ops": 0 2024-05-08T18:31:37.681 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:37.696 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-08T18:31:37.739 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:31:37.734+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:31:37.817 INFO:tasks.workunit.client.0.smithi097.stdout:Bucket Created: buck_2024_04_8_18_31_37 2024-05-08T18:31:37.840 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:31:37.841+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:31:37.858 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:37.858 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2024-05-08T18:31:37.859 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2024-05-08T18:31:37.859 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-05-08T18:31:37.859 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.859 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4479.0:40 5.b 5:d797044f:::zonegroup_info.ea3b680f-900d-4805-81ec-055811625780:head [create,call version.set in=10b,writefull 0~436] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-05-08T18:31:37.859 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:44.637551+0000", 2024-05-08T18:31:37.859 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 113.220742559, 2024-05-08T18:31:37.859 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003054013, 2024-05-08T18:31:37.859 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:37.859 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:37.859 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:37.859 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:37.859 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4479", 2024-05-08T18:31:37.859 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3577501689", 2024-05-08T18:31:37.859 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 40 2024-05-08T18:31:37.860 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.860 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:37.860 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.860 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:37.860 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.637551+0000", 2024-05-08T18:31:37.860 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:37.860 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.860 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.860 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:37.861 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.637551+0000", 2024-05-08T18:31:37.861 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:37.861 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.861 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.861 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:37.861 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.637554+0000", 2024-05-08T18:31:37.862 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6599999999999999e-06 2024-05-08T18:31:37.862 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.862 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.862 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:37.862 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.637576+0000", 2024-05-08T18:31:37.862 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1965999999999999e-05 2024-05-08T18:31:37.862 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.862 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.862 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:37.862 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.637603+0000", 2024-05-08T18:31:37.862 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7257e-05 2024-05-08T18:31:37.863 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.863 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.863 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:37.863 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.637623+0000", 2024-05-08T18:31:37.863 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9570000000000001e-05 2024-05-08T18:31:37.863 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.863 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.863 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:37.863 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.637766+0000", 2024-05-08T18:31:37.863 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000143435 2024-05-08T18:31:37.863 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.863 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.863 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:37.864 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.638167+0000", 2024-05-08T18:31:37.864 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00040082399999999998 2024-05-08T18:31:37.864 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.864 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.864 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:37.864 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.638627+0000", 2024-05-08T18:31:37.864 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00046019300000000002 2024-05-08T18:31:37.864 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.864 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.864 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:37.864 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.640399+0000", 2024-05-08T18:31:37.864 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0017714199999999999 2024-05-08T18:31:37.865 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.865 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.865 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:37.865 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.640447+0000", 2024-05-08T18:31:37.865 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8383000000000001e-05 2024-05-08T18:31:37.865 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.865 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.865 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:37.865 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.640534+0000", 2024-05-08T18:31:37.865 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7078999999999998e-05 2024-05-08T18:31:37.865 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.865 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.865 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:37.865 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.640606+0000", 2024-05-08T18:31:37.866 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1225999999999999e-05 2024-05-08T18:31:37.866 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:37.866 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:37.866 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:37.866 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.866 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.866 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4479.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-05-08T18:31:37.866 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:44.643918+0000", 2024-05-08T18:31:37.866 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 113.214376284, 2024-05-08T18:31:37.866 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002986004, 2024-05-08T18:31:37.866 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:37.866 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:37.866 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:37.867 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:37.867 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4479", 2024-05-08T18:31:37.867 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3577501689", 2024-05-08T18:31:37.867 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 42 2024-05-08T18:31:37.867 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.867 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:37.867 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.867 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:37.867 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.643918+0000", 2024-05-08T18:31:37.867 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:37.867 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.867 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.867 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:37.867 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.643918+0000", 2024-05-08T18:31:37.868 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:37.868 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.868 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.868 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:37.868 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.643919+0000", 2024-05-08T18:31:37.868 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4729999999999999e-06 2024-05-08T18:31:37.868 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.868 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.868 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:37.868 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.643927+0000", 2024-05-08T18:31:37.868 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6389999999999992e-06 2024-05-08T18:31:37.868 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.868 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.868 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:37.869 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.643945+0000", 2024-05-08T18:31:37.869 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8195000000000001e-05 2024-05-08T18:31:37.869 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.869 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.869 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:37.869 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.643954+0000", 2024-05-08T18:31:37.869 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5210000000000002e-06 2024-05-08T18:31:37.869 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.869 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.869 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:37.869 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.644123+0000", 2024-05-08T18:31:37.869 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016904999999999999 2024-05-08T18:31:37.870 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.870 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.870 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:37.870 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.644315+0000", 2024-05-08T18:31:37.870 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00019202800000000001 2024-05-08T18:31:37.870 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.870 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.870 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:37.870 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.644505+0000", 2024-05-08T18:31:37.870 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000190552 2024-05-08T18:31:37.870 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.870 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.870 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:37.871 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.645877+0000", 2024-05-08T18:31:37.871 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001371702 2024-05-08T18:31:37.871 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.871 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.871 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:37.871 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.646778+0000", 2024-05-08T18:31:37.871 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00090065700000000002 2024-05-08T18:31:37.871 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.871 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.871 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:37.871 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.646843+0000", 2024-05-08T18:31:37.871 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5504000000000002e-05 2024-05-08T18:31:37.871 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.871 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.871 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:37.872 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.646904+0000", 2024-05-08T18:31:37.872 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0683000000000002e-05 2024-05-08T18:31:37.872 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:37.872 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:37.872 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:37.872 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.872 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.872 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:57 7.3 e30/29 7:c609908c:::notify.5:head v 30'2, mlcod=0'0)", 2024-05-08T18:31:37.873 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:48.669376+0000", 2024-05-08T18:31:37.873 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 109.188918176, 2024-05-08T18:31:37.873 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0041509479999999998, 2024-05-08T18:31:37.873 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:37.873 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:37.873 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:37.874 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:37.874 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.874 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:37.874 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669376+0000", 2024-05-08T18:31:37.874 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:37.875 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.875 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.875 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:37.875 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669376+0000", 2024-05-08T18:31:37.875 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:37.875 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.876 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.876 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:37.876 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669378+0000", 2024-05-08T18:31:37.876 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.79e-06 2024-05-08T18:31:37.876 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.877 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.877 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:37.877 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669393+0000", 2024-05-08T18:31:37.877 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5053e-05 2024-05-08T18:31:37.877 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.878 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.878 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:37.878 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669427+0000", 2024-05-08T18:31:37.878 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4326999999999998e-05 2024-05-08T18:31:37.879 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.879 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.879 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:37.879 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669451+0000", 2024-05-08T18:31:37.879 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3629e-05 2024-05-08T18:31:37.879 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.880 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.880 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:37.880 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669563+0000", 2024-05-08T18:31:37.880 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011251099999999999 2024-05-08T18:31:37.880 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.881 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.881 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:37.881 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669607+0000", 2024-05-08T18:31:37.881 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3877e-05 2024-05-08T18:31:37.881 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.882 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.882 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:37.882 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.673401+0000", 2024-05-08T18:31:37.882 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0037942819999999999 2024-05-08T18:31:37.882 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.882 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.883 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:37.883 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.673527+0000", 2024-05-08T18:31:37.883 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012547900000000001 2024-05-08T18:31:37.883 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:37.883 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:37.883 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:37.884 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.884 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.884 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:58 7.14 e30/29 7:2b04a3e9:::notify.6:head v 30'1, mlcod=0'0)", 2024-05-08T18:31:37.884 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:48.669496+0000", 2024-05-08T18:31:37.884 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 109.188797804, 2024-05-08T18:31:37.885 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0046805609999999997, 2024-05-08T18:31:37.885 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:37.885 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:37.885 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:37.885 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:37.885 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.886 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:37.886 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669496+0000", 2024-05-08T18:31:37.886 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:37.886 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.886 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.886 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:37.887 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669496+0000", 2024-05-08T18:31:37.887 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:37.887 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.887 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.887 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:37.887 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669497+0000", 2024-05-08T18:31:37.888 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0100000000000001e-06 2024-05-08T18:31:37.888 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.888 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.888 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:37.888 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669507+0000", 2024-05-08T18:31:37.888 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.7540000000000001e-06 2024-05-08T18:31:37.888 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.889 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.889 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:37.889 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669528+0000", 2024-05-08T18:31:37.889 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.05e-05 2024-05-08T18:31:37.889 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.889 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.890 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:37.890 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669544+0000", 2024-05-08T18:31:37.890 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6716000000000001e-05 2024-05-08T18:31:37.890 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.890 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.890 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:37.890 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669667+0000", 2024-05-08T18:31:37.891 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012275799999999999 2024-05-08T18:31:37.891 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.891 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.891 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:37.891 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669706+0000", 2024-05-08T18:31:37.891 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8764999999999999e-05 2024-05-08T18:31:37.891 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.891 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.892 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:37.892 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674100+0000", 2024-05-08T18:31:37.892 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.004394528 2024-05-08T18:31:37.892 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.892 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.892 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:37.893 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674177+0000", 2024-05-08T18:31:37.893 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6530000000000001e-05 2024-05-08T18:31:37.893 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:37.893 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:37.893 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:37.893 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.893 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.894 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:37.894 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.794231+0000", 2024-05-08T18:31:37.894 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 106.064063413, 2024-05-08T18:31:37.894 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031872810000000001, 2024-05-08T18:31:37.894 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:37.895 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:37.895 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:37.895 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:37.895 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:37.895 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:37.896 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 236 2024-05-08T18:31:37.896 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.896 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:37.896 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.896 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:37.896 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794231+0000", 2024-05-08T18:31:37.897 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:37.897 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.897 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.897 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:37.897 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794231+0000", 2024-05-08T18:31:37.897 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:37.897 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.898 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.898 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:37.898 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794234+0000", 2024-05-08T18:31:37.898 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.36e-06 2024-05-08T18:31:37.898 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.898 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.898 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:37.898 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794248+0000", 2024-05-08T18:31:37.899 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4372999999999999e-05 2024-05-08T18:31:37.899 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.899 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.899 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:37.899 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794279+0000", 2024-05-08T18:31:37.899 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1075999999999999e-05 2024-05-08T18:31:37.899 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.900 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.900 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:37.900 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794295+0000", 2024-05-08T18:31:37.900 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5386000000000001e-05 2024-05-08T18:31:37.900 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.900 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.900 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:37.900 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794416+0000", 2024-05-08T18:31:37.901 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012071899999999999 2024-05-08T18:31:37.901 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.901 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.901 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:37.901 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794638+0000", 2024-05-08T18:31:37.901 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00022262599999999999 2024-05-08T18:31:37.901 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.902 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.902 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:37.902 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.795061+0000", 2024-05-08T18:31:37.902 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00042248900000000001 2024-05-08T18:31:37.902 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.903 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.903 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:37.903 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.796477+0000", 2024-05-08T18:31:37.903 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0014162230000000001 2024-05-08T18:31:37.903 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.903 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.904 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:37.904 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.797258+0000", 2024-05-08T18:31:37.904 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00078159400000000004 2024-05-08T18:31:37.904 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.904 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.905 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:37.905 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.797349+0000", 2024-05-08T18:31:37.905 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0462000000000002e-05 2024-05-08T18:31:37.905 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.905 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.906 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:37.906 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.797418+0000", 2024-05-08T18:31:37.906 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8973000000000005e-05 2024-05-08T18:31:37.906 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:37.906 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:37.906 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:37.906 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.906 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.907 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:281 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:37.907 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.806063+0000", 2024-05-08T18:31:37.907 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 106.052231279, 2024-05-08T18:31:37.907 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002923761, 2024-05-08T18:31:37.907 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:37.907 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:37.907 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:37.907 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:37.907 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:37.907 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:37.907 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 281 2024-05-08T18:31:37.907 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.907 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:37.908 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.908 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:37.908 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.806063+0000", 2024-05-08T18:31:37.908 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:37.908 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.908 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.908 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:37.908 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.806063+0000", 2024-05-08T18:31:37.908 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:37.908 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.908 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.908 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:37.908 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.806064+0000", 2024-05-08T18:31:37.908 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.204e-06 2024-05-08T18:31:37.908 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.909 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.909 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:37.909 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.806073+0000", 2024-05-08T18:31:37.909 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5609999999999999e-06 2024-05-08T18:31:37.909 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.909 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.909 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:37.909 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.806089+0000", 2024-05-08T18:31:37.909 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6673000000000001e-05 2024-05-08T18:31:37.909 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.909 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.909 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:37.909 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.806098+0000", 2024-05-08T18:31:37.909 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8899999999999996e-06 2024-05-08T18:31:37.910 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.910 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.910 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:37.910 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.806165+0000", 2024-05-08T18:31:37.910 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6927999999999993e-05 2024-05-08T18:31:37.910 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.910 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.910 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:37.910 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.806298+0000", 2024-05-08T18:31:37.910 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000132886 2024-05-08T18:31:37.910 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.910 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.911 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:31:37.911 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.806453+0000", 2024-05-08T18:31:37.911 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000155339 2024-05-08T18:31:37.911 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.911 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.911 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:37.911 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.807157+0000", 2024-05-08T18:31:37.911 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00070363900000000004 2024-05-08T18:31:37.911 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.911 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.911 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:37.911 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.808880+0000", 2024-05-08T18:31:37.911 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0017227130000000001 2024-05-08T18:31:37.912 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.912 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.912 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:37.912 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.808938+0000", 2024-05-08T18:31:37.912 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8814999999999998e-05 2024-05-08T18:31:37.912 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.912 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.912 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:37.912 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.808987+0000", 2024-05-08T18:31:37.912 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8112999999999998e-05 2024-05-08T18:31:37.912 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:37.912 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:37.912 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:37.912 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.913 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.913 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:304 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:37.913 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.809645+0000", 2024-05-08T18:31:37.913 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 106.04864944099999, 2024-05-08T18:31:37.913 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031633579999999998, 2024-05-08T18:31:37.913 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:37.913 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:37.913 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:37.913 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:37.913 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:37.913 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:37.913 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 304 2024-05-08T18:31:37.913 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.914 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:37.914 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.914 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:37.914 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809645+0000", 2024-05-08T18:31:37.914 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:37.914 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.914 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.914 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:37.914 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809645+0000", 2024-05-08T18:31:37.914 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:37.914 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.914 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.914 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:37.915 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809646+0000", 2024-05-08T18:31:37.915 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.113e-06 2024-05-08T18:31:37.915 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.915 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.915 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:37.915 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809652+0000", 2024-05-08T18:31:37.915 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1650000000000003e-06 2024-05-08T18:31:37.915 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.915 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.915 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:37.915 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809668+0000", 2024-05-08T18:31:37.915 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6025e-05 2024-05-08T18:31:37.915 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.916 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.916 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:37.916 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809678+0000", 2024-05-08T18:31:37.916 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0456e-05 2024-05-08T18:31:37.916 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.916 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.916 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:37.916 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809745+0000", 2024-05-08T18:31:37.916 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7088000000000005e-05 2024-05-08T18:31:37.917 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.917 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.917 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:37.917 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809803+0000", 2024-05-08T18:31:37.917 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7405999999999999e-05 2024-05-08T18:31:37.917 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.917 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.917 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:31:37.917 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809951+0000", 2024-05-08T18:31:37.917 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014775500000000001 2024-05-08T18:31:37.917 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.917 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.918 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:37.918 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.810564+0000", 2024-05-08T18:31:37.918 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00061324899999999996 2024-05-08T18:31:37.918 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.918 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.918 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:37.918 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.812744+0000", 2024-05-08T18:31:37.918 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0021804509999999999 2024-05-08T18:31:37.918 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.918 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.918 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:37.918 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.812781+0000", 2024-05-08T18:31:37.918 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6554999999999998e-05 2024-05-08T18:31:37.919 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.919 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.919 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:37.919 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.812808+0000", 2024-05-08T18:31:37.919 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7095000000000001e-05 2024-05-08T18:31:37.919 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:37.919 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:37.919 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:37.919 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.919 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.919 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:37.919 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.105553+0000", 2024-05-08T18:31:37.919 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 105.75274143, 2024-05-08T18:31:37.919 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028754850000000001, 2024-05-08T18:31:37.920 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:37.920 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:37.920 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:37.920 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:37.920 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:37.920 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:37.920 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 742 2024-05-08T18:31:37.920 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.920 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:37.920 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.920 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:37.920 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.105553+0000", 2024-05-08T18:31:37.920 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:37.920 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.921 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.921 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:37.921 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.105553+0000", 2024-05-08T18:31:37.921 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:37.921 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.921 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.921 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:37.921 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.105556+0000", 2024-05-08T18:31:37.921 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3100000000000001e-06 2024-05-08T18:31:37.921 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.921 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.921 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:37.921 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.105569+0000", 2024-05-08T18:31:37.922 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2754e-05 2024-05-08T18:31:37.922 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.922 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.922 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:37.922 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.105601+0000", 2024-05-08T18:31:37.922 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2435999999999999e-05 2024-05-08T18:31:37.922 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.922 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.922 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:37.922 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.105616+0000", 2024-05-08T18:31:37.922 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4657e-05 2024-05-08T18:31:37.922 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.923 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.923 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:37.923 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.105804+0000", 2024-05-08T18:31:37.923 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00018861799999999999 2024-05-08T18:31:37.923 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.923 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.923 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:37.923 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.106054+0000", 2024-05-08T18:31:37.923 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024948499999999997 2024-05-08T18:31:37.923 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.923 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.923 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:37.923 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.106390+0000", 2024-05-08T18:31:37.924 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00033640100000000001 2024-05-08T18:31:37.924 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.924 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.924 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:37.924 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.107527+0000", 2024-05-08T18:31:37.924 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001136871 2024-05-08T18:31:37.924 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.924 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.924 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:37.924 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.108265+0000", 2024-05-08T18:31:37.924 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00073753100000000004 2024-05-08T18:31:37.924 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.924 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.924 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:37.925 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.108353+0000", 2024-05-08T18:31:37.925 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8232999999999994e-05 2024-05-08T18:31:37.925 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.925 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.925 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:37.925 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.108428+0000", 2024-05-08T18:31:37.925 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.5189000000000001e-05 2024-05-08T18:31:37.925 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:37.925 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:37.925 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:37.925 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.925 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.925 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:37.926 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.148015+0000", 2024-05-08T18:31:37.926 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 105.71027948699999, 2024-05-08T18:31:37.926 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032297409999999999, 2024-05-08T18:31:37.926 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:37.926 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:37.926 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:37.926 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:37.926 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:37.926 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:37.926 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 760 2024-05-08T18:31:37.926 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.926 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:37.927 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.927 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:37.927 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.148015+0000", 2024-05-08T18:31:37.927 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:37.927 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.927 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.927 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:37.927 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.148015+0000", 2024-05-08T18:31:37.928 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:37.928 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.928 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.928 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:37.928 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.148017+0000", 2024-05-08T18:31:37.928 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1830000000000001e-06 2024-05-08T18:31:37.928 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.928 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.928 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:37.928 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.148030+0000", 2024-05-08T18:31:37.928 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2893e-05 2024-05-08T18:31:37.928 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.928 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.929 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:37.929 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.148061+0000", 2024-05-08T18:31:37.929 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0953e-05 2024-05-08T18:31:37.929 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.929 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.929 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:37.929 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.148077+0000", 2024-05-08T18:31:37.929 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6554000000000001e-05 2024-05-08T18:31:37.929 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.929 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.929 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:37.929 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.148230+0000", 2024-05-08T18:31:37.929 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015263899999999999 2024-05-08T18:31:37.930 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.930 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.930 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:37.930 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.148592+0000", 2024-05-08T18:31:37.930 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00036219699999999997 2024-05-08T18:31:37.930 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.930 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.930 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:37.930 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.149139+0000", 2024-05-08T18:31:37.930 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00054734599999999999 2024-05-08T18:31:37.930 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.930 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.930 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:37.931 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.150505+0000", 2024-05-08T18:31:37.931 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001365479 2024-05-08T18:31:37.931 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.931 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.931 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:37.931 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.151087+0000", 2024-05-08T18:31:37.931 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00058201200000000002 2024-05-08T18:31:37.931 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.931 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.931 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:37.931 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.151175+0000", 2024-05-08T18:31:37.931 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8199e-05 2024-05-08T18:31:37.931 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.932 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.932 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:37.932 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.151244+0000", 2024-05-08T18:31:37.932 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9286e-05 2024-05-08T18:31:37.932 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:37.932 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:37.932 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:37.932 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.932 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.932 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:37.932 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.277376+0000", 2024-05-08T18:31:37.932 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 105.58091756899999, 2024-05-08T18:31:37.932 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032022190000000001, 2024-05-08T18:31:37.932 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:37.933 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:37.933 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:37.933 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:37.933 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:37.933 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:37.933 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 817 2024-05-08T18:31:37.933 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.933 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:37.933 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.933 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:37.933 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.277376+0000", 2024-05-08T18:31:37.933 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:37.933 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.933 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.933 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:37.934 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.277376+0000", 2024-05-08T18:31:37.934 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:37.934 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.934 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.934 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:37.934 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.277379+0000", 2024-05-08T18:31:37.934 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4430000000000002e-06 2024-05-08T18:31:37.934 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.934 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.934 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:37.934 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.277391+0000", 2024-05-08T18:31:37.934 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1634000000000001e-05 2024-05-08T18:31:37.935 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.935 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.935 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:37.935 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.277421+0000", 2024-05-08T18:31:37.935 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0691999999999997e-05 2024-05-08T18:31:37.935 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.935 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.935 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:37.935 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.277438+0000", 2024-05-08T18:31:37.935 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7102999999999999e-05 2024-05-08T18:31:37.935 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.935 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.935 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:37.935 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.277602+0000", 2024-05-08T18:31:37.936 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016345300000000001 2024-05-08T18:31:37.936 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.936 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.936 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:37.936 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.278019+0000", 2024-05-08T18:31:37.936 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00041724699999999998 2024-05-08T18:31:37.936 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.936 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.936 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:31:37.936 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.278573+0000", 2024-05-08T18:31:37.936 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00055391900000000005 2024-05-08T18:31:37.936 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.936 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.936 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:37.936 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.279973+0000", 2024-05-08T18:31:37.937 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0013995819999999999 2024-05-08T18:31:37.937 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.937 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.937 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:37.937 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.280422+0000", 2024-05-08T18:31:37.937 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00044940699999999997 2024-05-08T18:31:37.937 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.937 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.937 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:37.937 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.280509+0000", 2024-05-08T18:31:37.937 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7455999999999997e-05 2024-05-08T18:31:37.938 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.938 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.938 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:37.938 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.280579+0000", 2024-05-08T18:31:37.938 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9282999999999994e-05 2024-05-08T18:31:37.938 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:37.938 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:37.938 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:37.938 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.941 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.941 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:37.941 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.281716+0000", 2024-05-08T18:31:37.941 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 105.57657820199999, 2024-05-08T18:31:37.942 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003275881, 2024-05-08T18:31:37.942 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:37.942 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:37.942 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:37.942 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:37.942 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:37.942 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:37.942 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 819 2024-05-08T18:31:37.942 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.942 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:37.943 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.943 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:37.943 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.281716+0000", 2024-05-08T18:31:37.943 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:37.943 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.943 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.943 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:37.943 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.281716+0000", 2024-05-08T18:31:37.943 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:37.943 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.943 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.943 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:37.943 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.281718+0000", 2024-05-08T18:31:37.944 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.863e-06 2024-05-08T18:31:37.944 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.944 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.944 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:37.944 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.281728+0000", 2024-05-08T18:31:37.944 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0550000000000001e-05 2024-05-08T18:31:37.944 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.944 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.944 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:37.944 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.281760+0000", 2024-05-08T18:31:37.944 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2150000000000002e-05 2024-05-08T18:31:37.944 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.944 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.944 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:37.945 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.281776+0000", 2024-05-08T18:31:37.945 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6005999999999999e-05 2024-05-08T18:31:37.945 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.945 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.945 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:37.945 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.281917+0000", 2024-05-08T18:31:37.945 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014070200000000001 2024-05-08T18:31:37.945 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.945 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.945 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:37.945 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.282148+0000", 2024-05-08T18:31:37.945 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023095200000000001 2024-05-08T18:31:37.945 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.946 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.946 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:31:37.946 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.282641+0000", 2024-05-08T18:31:37.946 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00049337999999999997 2024-05-08T18:31:37.946 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.946 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.946 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:37.946 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.284070+0000", 2024-05-08T18:31:37.946 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0014287950000000001 2024-05-08T18:31:37.946 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.946 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.946 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:37.946 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.284837+0000", 2024-05-08T18:31:37.947 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00076679799999999996 2024-05-08T18:31:37.947 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.947 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.947 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:37.947 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.284925+0000", 2024-05-08T18:31:37.947 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8165999999999996e-05 2024-05-08T18:31:37.947 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.947 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.947 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:37.947 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.284992+0000", 2024-05-08T18:31:37.947 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6519000000000005e-05 2024-05-08T18:31:37.947 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:37.947 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:37.948 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:37.948 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.948 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.948 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:37.948 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.334745+0000", 2024-05-08T18:31:37.948 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 105.523549292, 2024-05-08T18:31:37.948 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032404719999999999, 2024-05-08T18:31:37.948 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:37.948 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:37.949 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:37.949 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:37.949 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:37.949 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:37.949 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 841 2024-05-08T18:31:37.949 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.949 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:37.949 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.949 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:37.949 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.334745+0000", 2024-05-08T18:31:37.949 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:37.949 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.949 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.949 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:37.950 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.334745+0000", 2024-05-08T18:31:37.950 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:37.950 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.950 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.950 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:37.950 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.334747+0000", 2024-05-08T18:31:37.950 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.407e-06 2024-05-08T18:31:37.950 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.950 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.950 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:37.950 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.334759+0000", 2024-05-08T18:31:37.951 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1883e-05 2024-05-08T18:31:37.951 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.951 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.951 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:37.951 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.334789+0000", 2024-05-08T18:31:37.951 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9957000000000001e-05 2024-05-08T18:31:37.951 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.951 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.951 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:37.951 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.334804+0000", 2024-05-08T18:31:37.951 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4713e-05 2024-05-08T18:31:37.951 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.951 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.952 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:37.952 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.334951+0000", 2024-05-08T18:31:37.952 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000147675 2024-05-08T18:31:37.952 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.952 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.952 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:37.952 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.335304+0000", 2024-05-08T18:31:37.952 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00035214099999999999 2024-05-08T18:31:37.952 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.952 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.952 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:31:37.952 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.335859+0000", 2024-05-08T18:31:37.952 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00055546899999999995 2024-05-08T18:31:37.952 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.953 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.953 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:37.953 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.337168+0000", 2024-05-08T18:31:37.953 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0013087299999999999 2024-05-08T18:31:37.953 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.953 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.953 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:37.953 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.337808+0000", 2024-05-08T18:31:37.953 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00064005500000000005 2024-05-08T18:31:37.953 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.953 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.953 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:37.954 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.337894+0000", 2024-05-08T18:31:37.954 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6593000000000003e-05 2024-05-08T18:31:37.954 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.954 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.954 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:37.954 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.337985+0000", 2024-05-08T18:31:37.954 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0848999999999997e-05 2024-05-08T18:31:37.954 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:37.954 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:37.954 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:37.954 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.954 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.954 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:37.954 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.338870+0000", 2024-05-08T18:31:37.955 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 105.519424543, 2024-05-08T18:31:37.955 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002862121, 2024-05-08T18:31:37.955 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:37.955 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:37.955 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:37.955 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:37.955 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:37.955 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:37.955 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 843 2024-05-08T18:31:37.955 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.955 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:37.955 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.955 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:37.956 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.338870+0000", 2024-05-08T18:31:37.956 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:37.956 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.956 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.956 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:37.956 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.338870+0000", 2024-05-08T18:31:37.956 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:37.956 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.956 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.956 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:37.956 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.338872+0000", 2024-05-08T18:31:37.956 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3429999999999998e-06 2024-05-08T18:31:37.956 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.957 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.957 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:37.957 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.338883+0000", 2024-05-08T18:31:37.957 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1447000000000001e-05 2024-05-08T18:31:37.957 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.957 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.957 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:37.957 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.338914+0000", 2024-05-08T18:31:37.957 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1052e-05 2024-05-08T18:31:37.957 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.957 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.957 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:37.957 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.338932+0000", 2024-05-08T18:31:37.957 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7604e-05 2024-05-08T18:31:37.958 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.958 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.958 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:37.958 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.339019+0000", 2024-05-08T18:31:37.958 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6982000000000002e-05 2024-05-08T18:31:37.958 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.958 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.958 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:37.958 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.339139+0000", 2024-05-08T18:31:37.958 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011978599999999999 2024-05-08T18:31:37.958 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.958 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.958 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:31:37.958 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.339415+0000", 2024-05-08T18:31:37.959 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00027644799999999999 2024-05-08T18:31:37.959 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.959 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.959 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:37.959 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.340619+0000", 2024-05-08T18:31:37.959 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012043010000000001 2024-05-08T18:31:37.959 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.959 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.959 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:37.959 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.341454+0000", 2024-05-08T18:31:37.959 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00083464300000000004 2024-05-08T18:31:37.959 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.960 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.960 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:37.960 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.341609+0000", 2024-05-08T18:31:37.960 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000154752 2024-05-08T18:31:37.960 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.960 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.960 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:37.960 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.341732+0000", 2024-05-08T18:31:37.960 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012276299999999999 2024-05-08T18:31:37.960 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:37.960 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:37.961 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:37.961 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.961 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.961 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:37.961 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.349287+0000", 2024-05-08T18:31:37.961 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 105.50900671399999, 2024-05-08T18:31:37.962 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032683220000000002, 2024-05-08T18:31:37.962 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:37.962 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:37.962 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:37.962 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:37.962 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:37.962 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:37.962 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 847 2024-05-08T18:31:37.962 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.962 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:37.963 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.963 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:37.963 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.349287+0000", 2024-05-08T18:31:37.963 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:37.963 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.963 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.963 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:37.963 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.349287+0000", 2024-05-08T18:31:37.963 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:37.963 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.963 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.963 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:37.964 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.349290+0000", 2024-05-08T18:31:37.964 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3369999999999998e-06 2024-05-08T18:31:37.964 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.964 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.964 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:37.964 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.349318+0000", 2024-05-08T18:31:37.964 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8419999999999999e-05 2024-05-08T18:31:37.964 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.964 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.964 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:37.964 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.349348+0000", 2024-05-08T18:31:37.964 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0260000000000002e-05 2024-05-08T18:31:37.964 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.965 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.965 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:37.965 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.349364+0000", 2024-05-08T18:31:37.965 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5359999999999999e-05 2024-05-08T18:31:37.965 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.965 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.965 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:37.965 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.349511+0000", 2024-05-08T18:31:37.965 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014760199999999999 2024-05-08T18:31:37.965 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.965 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.965 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:37.965 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.349872+0000", 2024-05-08T18:31:37.965 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00036035 2024-05-08T18:31:37.966 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.966 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.966 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:31:37.966 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.350432+0000", 2024-05-08T18:31:37.966 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00056059600000000001 2024-05-08T18:31:37.966 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.966 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.966 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:37.966 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.351817+0000", 2024-05-08T18:31:37.966 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001385063 2024-05-08T18:31:37.966 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.966 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.966 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:37.966 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.352402+0000", 2024-05-08T18:31:37.967 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00058490500000000004 2024-05-08T18:31:37.967 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.967 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.967 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:37.967 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.352488+0000", 2024-05-08T18:31:37.967 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6032999999999994e-05 2024-05-08T18:31:37.967 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.967 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.967 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:37.967 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.352556+0000", 2024-05-08T18:31:37.967 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7396000000000003e-05 2024-05-08T18:31:37.967 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:37.967 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:37.968 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:37.968 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.968 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.968 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:37.968 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.353786+0000", 2024-05-08T18:31:37.968 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 105.504507879, 2024-05-08T18:31:37.968 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0029130850000000002, 2024-05-08T18:31:37.968 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:37.968 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:37.968 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:37.968 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:37.968 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:37.968 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:37.969 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 849 2024-05-08T18:31:37.969 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.969 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:37.969 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.969 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:37.969 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.353786+0000", 2024-05-08T18:31:37.969 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:37.969 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.969 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.969 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:37.969 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.353786+0000", 2024-05-08T18:31:37.969 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:37.969 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.969 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.970 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:37.970 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.353788+0000", 2024-05-08T18:31:37.970 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0370000000000001e-06 2024-05-08T18:31:37.970 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.970 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.970 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:37.970 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.353799+0000", 2024-05-08T18:31:37.970 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0686000000000001e-05 2024-05-08T18:31:37.970 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.970 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.970 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:37.970 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.353832+0000", 2024-05-08T18:31:37.970 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.341e-05 2024-05-08T18:31:37.970 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.971 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.971 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:37.971 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.353851+0000", 2024-05-08T18:31:37.971 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8343999999999999e-05 2024-05-08T18:31:37.971 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.971 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.971 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:37.971 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.353980+0000", 2024-05-08T18:31:37.971 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012914900000000001 2024-05-08T18:31:37.971 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.971 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.971 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:37.971 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.354123+0000", 2024-05-08T18:31:37.972 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000142912 2024-05-08T18:31:37.972 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.972 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.972 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:31:37.972 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.354393+0000", 2024-05-08T18:31:37.972 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00027009799999999997 2024-05-08T18:31:37.972 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.972 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.973 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:37.973 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.355769+0000", 2024-05-08T18:31:37.973 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001375839 2024-05-08T18:31:37.973 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.973 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.973 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:37.974 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.356421+0000", 2024-05-08T18:31:37.974 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00065227799999999995 2024-05-08T18:31:37.974 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.974 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.974 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:37.975 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.356592+0000", 2024-05-08T18:31:37.975 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000170586 2024-05-08T18:31:37.975 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.975 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.975 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:37.975 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.356699+0000", 2024-05-08T18:31:37.976 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010774599999999999 2024-05-08T18:31:37.976 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:37.976 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:37.976 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:37.976 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.977 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.977 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:37.977 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.402673+0000", 2024-05-08T18:31:37.977 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 105.455621206, 2024-05-08T18:31:37.977 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002928295, 2024-05-08T18:31:37.977 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:37.978 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:37.978 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:37.978 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:37.978 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:37.979 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:37.979 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 870 2024-05-08T18:31:37.979 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.979 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:37.979 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.979 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:37.980 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.402673+0000", 2024-05-08T18:31:37.980 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:37.980 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.980 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.980 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:37.980 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.402673+0000", 2024-05-08T18:31:37.981 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:37.981 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.981 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.981 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:37.981 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.402675+0000", 2024-05-08T18:31:37.981 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0030000000000001e-06 2024-05-08T18:31:37.981 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.982 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.982 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:37.982 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.402685+0000", 2024-05-08T18:31:37.982 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0566e-05 2024-05-08T18:31:37.982 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.982 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.983 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:37.983 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.402714+0000", 2024-05-08T18:31:37.983 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8804999999999999e-05 2024-05-08T18:31:37.983 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.983 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.983 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:37.984 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.402731+0000", 2024-05-08T18:31:37.984 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6731e-05 2024-05-08T18:31:37.984 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.984 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.984 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:37.984 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.402863+0000", 2024-05-08T18:31:37.984 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013194199999999999 2024-05-08T18:31:37.985 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.985 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.985 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:37.985 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.403096+0000", 2024-05-08T18:31:37.985 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023309900000000001 2024-05-08T18:31:37.985 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.986 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.986 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:37.986 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.403553+0000", 2024-05-08T18:31:37.986 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00045738700000000002 2024-05-08T18:31:37.986 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.986 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.987 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:37.987 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.404843+0000", 2024-05-08T18:31:37.987 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012894650000000001 2024-05-08T18:31:37.987 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.987 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.987 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:37.987 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.405348+0000", 2024-05-08T18:31:37.988 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00050483600000000004 2024-05-08T18:31:37.988 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.988 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.988 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:37.988 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.405491+0000", 2024-05-08T18:31:37.988 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014349299999999999 2024-05-08T18:31:37.989 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.989 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.989 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:37.989 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.405601+0000", 2024-05-08T18:31:37.989 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000109968 2024-05-08T18:31:37.989 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:37.990 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:37.990 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:37.990 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.990 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.990 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:37.990 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.484247+0000", 2024-05-08T18:31:37.991 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 105.374047006, 2024-05-08T18:31:37.991 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028903679999999999, 2024-05-08T18:31:37.991 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:37.991 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:37.991 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:37.991 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:37.991 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:37.992 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:37.992 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 907 2024-05-08T18:31:37.992 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.992 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:37.992 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.993 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:37.993 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.484247+0000", 2024-05-08T18:31:37.993 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:37.993 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.993 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.993 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:37.993 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.484247+0000", 2024-05-08T18:31:37.994 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:37.994 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.994 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.994 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:37.994 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.484250+0000", 2024-05-08T18:31:37.995 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6900000000000001e-06 2024-05-08T18:31:37.995 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.995 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.995 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:37.995 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.484263+0000", 2024-05-08T18:31:37.995 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2967e-05 2024-05-08T18:31:37.996 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.996 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.996 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:37.996 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.484294+0000", 2024-05-08T18:31:37.996 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1016000000000003e-05 2024-05-08T18:31:37.996 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.997 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.997 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:37.997 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.484309+0000", 2024-05-08T18:31:37.997 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5187e-05 2024-05-08T18:31:37.997 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.997 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.997 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:37.998 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.484467+0000", 2024-05-08T18:31:37.998 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015810499999999999 2024-05-08T18:31:37.998 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.998 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.998 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:37.998 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.484698+0000", 2024-05-08T18:31:37.999 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000230852 2024-05-08T18:31:37.999 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:37.999 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:37.999 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:31:37.999 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.485026+0000", 2024-05-08T18:31:37.999 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00032833 2024-05-08T18:31:38.000 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.000 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.000 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:38.000 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.486177+0000", 2024-05-08T18:31:38.000 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0011504309999999999 2024-05-08T18:31:38.000 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.001 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.001 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:38.001 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.486978+0000", 2024-05-08T18:31:38.001 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000801161 2024-05-08T18:31:38.001 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.001 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.001 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:38.002 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.487068+0000", 2024-05-08T18:31:38.002 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0435999999999999e-05 2024-05-08T18:31:38.002 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.002 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.002 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:38.002 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.487137+0000", 2024-05-08T18:31:38.002 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9193e-05 2024-05-08T18:31:38.003 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:38.003 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:38.003 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:38.003 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.003 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.003 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.5274.0:56 7.14 e80/29 7:2b04a3e9:::notify.6:head v 80'3, mlcod=30'1)", 2024-05-08T18:31:38.003 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:36.922675+0000", 2024-05-08T18:31:38.004 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.93561910100000001, 2024-05-08T18:31:38.004 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0060932800000000004, 2024-05-08T18:31:38.004 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:38.004 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:38.004 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:38.004 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:38.004 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.005 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:38.005 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:36.922675+0000", 2024-05-08T18:31:38.005 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:38.005 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.005 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.005 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:38.005 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:36.922675+0000", 2024-05-08T18:31:38.006 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:38.006 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.006 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.006 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:38.006 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:36.922675+0000", 2024-05-08T18:31:38.006 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5900000000000003e-07 2024-05-08T18:31:38.007 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.007 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.007 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:38.007 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:36.922679+0000", 2024-05-08T18:31:38.007 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5590000000000001e-06 2024-05-08T18:31:38.008 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.008 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.008 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:38.008 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:36.922686+0000", 2024-05-08T18:31:38.008 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.5739999999999998e-06 2024-05-08T18:31:38.008 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.009 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.009 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:38.009 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:36.922691+0000", 2024-05-08T18:31:38.009 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.0509999999999996e-06 2024-05-08T18:31:38.009 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.009 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.009 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:38.010 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:36.922732+0000", 2024-05-08T18:31:38.010 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0620000000000001e-05 2024-05-08T18:31:38.010 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.010 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.010 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:38.010 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:36.922744+0000", 2024-05-08T18:31:38.010 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1474999999999999e-05 2024-05-08T18:31:38.010 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.011 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.011 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:38.011 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:36.928742+0000", 2024-05-08T18:31:38.011 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0059983900000000001 2024-05-08T18:31:38.011 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.011 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.011 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:38.011 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:36.928768+0000", 2024-05-08T18:31:38.012 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6251999999999999e-05 2024-05-08T18:31:38.012 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:38.012 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:38.012 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:38.012 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.012 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.012 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.5018.0:56 7.14 e80/29 7:2b04a3e9:::notify.6:head v 80'15, mlcod=80'13)", 2024-05-08T18:31:38.012 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:37.741774+0000", 2024-05-08T18:31:38.013 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.116520338, 2024-05-08T18:31:38.013 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0037565960000000001, 2024-05-08T18:31:38.013 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:38.013 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:38.013 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:38.013 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:38.013 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.014 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:38.014 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.741774+0000", 2024-05-08T18:31:38.014 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:38.014 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.014 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.015 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:38.015 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.741774+0000", 2024-05-08T18:31:38.015 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:38.015 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.015 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.015 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:38.015 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.741774+0000", 2024-05-08T18:31:38.016 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7800000000000002e-07 2024-05-08T18:31:38.016 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.016 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.016 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:38.016 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.741790+0000", 2024-05-08T18:31:38.016 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6322000000000001e-05 2024-05-08T18:31:38.017 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.017 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.017 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:38.017 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.741798+0000", 2024-05-08T18:31:38.017 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.9610000000000005e-06 2024-05-08T18:31:38.017 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.017 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.018 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:38.018 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.741804+0000", 2024-05-08T18:31:38.018 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4450000000000004e-06 2024-05-08T18:31:38.018 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.018 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.018 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:38.018 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.741851+0000", 2024-05-08T18:31:38.019 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7638e-05 2024-05-08T18:31:38.019 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.019 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.019 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:38.019 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.741871+0000", 2024-05-08T18:31:38.019 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9191999999999999e-05 2024-05-08T18:31:38.019 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.019 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.019 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:38.019 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.745503+0000", 2024-05-08T18:31:38.019 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0036323420000000002 2024-05-08T18:31:38.020 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.020 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.020 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:38.020 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.745530+0000", 2024-05-08T18:31:38.020 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7317999999999998e-05 2024-05-08T18:31:38.020 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:38.020 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:38.020 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:38.020 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.020 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.020 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1212 4.0 4:0316270c:::.dir.3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.2.1:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-05-08T18:31:38.020 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:37.799894+0000", 2024-05-08T18:31:38.020 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.058400395000000001, 2024-05-08T18:31:38.021 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0062061470000000004, 2024-05-08T18:31:38.021 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:38.021 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:38.021 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:38.021 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:38.021 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:38.021 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:38.021 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1212 2024-05-08T18:31:38.021 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.021 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:38.021 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.022 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:38.022 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.799894+0000", 2024-05-08T18:31:38.022 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:38.022 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.022 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.022 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:38.022 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.799894+0000", 2024-05-08T18:31:38.022 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:38.022 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.022 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.022 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:38.023 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.799895+0000", 2024-05-08T18:31:38.023 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.787e-06 2024-05-08T18:31:38.023 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.023 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.023 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:38.023 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.799909+0000", 2024-05-08T18:31:38.023 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3233e-05 2024-05-08T18:31:38.023 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.023 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.023 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:38.023 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.799934+0000", 2024-05-08T18:31:38.024 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4898000000000001e-05 2024-05-08T18:31:38.024 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.024 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.024 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:38.024 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.799944+0000", 2024-05-08T18:31:38.024 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.9769999999999995e-06 2024-05-08T18:31:38.024 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.024 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.024 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:38.024 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.800014+0000", 2024-05-08T18:31:38.024 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.0912000000000001e-05 2024-05-08T18:31:38.025 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.025 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.025 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:38.025 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.800148+0000", 2024-05-08T18:31:38.025 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013343299999999999 2024-05-08T18:31:38.025 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.025 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.025 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:38.025 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.800279+0000", 2024-05-08T18:31:38.025 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013131500000000001 2024-05-08T18:31:38.025 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.026 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.026 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:38.026 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.803585+0000", 2024-05-08T18:31:38.026 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0033059320000000001 2024-05-08T18:31:38.026 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.026 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.026 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:38.026 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.806032+0000", 2024-05-08T18:31:38.026 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0024466470000000001 2024-05-08T18:31:38.026 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.026 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.027 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:38.027 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.806068+0000", 2024-05-08T18:31:38.027 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6075000000000003e-05 2024-05-08T18:31:38.027 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.027 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.027 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:38.027 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.806100+0000", 2024-05-08T18:31:38.027 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1937999999999998e-05 2024-05-08T18:31:38.027 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:38.027 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:38.027 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:38.027 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:38.028 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:38.028 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:38.029 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-08T18:31:38.030 INFO:tasks.workunit.client.0.smithi097.stderr:1+0 records in 2024-05-08T18:31:38.030 INFO:tasks.workunit.client.0.smithi097.stderr:1+0 records out 2024-05-08T18:31:38.030 INFO:tasks.workunit.client.0.smithi097.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0289611 s, 362 MB/s 2024-05-08T18:31:38.030 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:31:38.029+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:31:38.130 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:31:38.126+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:31:38.186 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:38.186 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:31:38.186 INFO:teuthology.orchestra.run.smithi097.stdout: "num_ops": 0 2024-05-08T18:31:38.186 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:38.200 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-08T18:31:38.231 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:31:38.226+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:31:38.276 INFO:tasks.workunit.client.0.smithi097.stdout:quota enabled for the user usr2 2024-05-08T18:31:38.276 INFO:tasks.workunit.client.0.smithi097.stdout:adding file to bucket buck_2024_04_8_18_31_37: 10Mb. 2024-05-08T18:31:38.276 INFO:tasks.workunit.client.0.smithi097.stdout:upload file successful 2024-05-08T18:31:38.276 INFO:tasks.workunit.client.0.smithi097.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-08T18:31:38.276 INFO:tasks.workunit.client.0.smithi097.stdout:Test case: PASSED - quota set for user: usr2 with max_objects=1 passed 2024-05-08T18:31:38.276 INFO:tasks.workunit.client.0.smithi097.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-08T18:31:38.312 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:38.312 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:31:38.313 INFO:teuthology.orchestra.run.smithi097.stdout: "complaint_time": 30, 2024-05-08T18:31:38.313 INFO:teuthology.orchestra.run.smithi097.stdout: "num_blocked_ops": 0 2024-05-08T18:31:38.313 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:38.328 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-08T18:31:38.372 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:31:38.373+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:31:38.432 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:31:38.430+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:31:38.448 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:38.448 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2024-05-08T18:31:38.448 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2024-05-08T18:31:38.448 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-05-08T18:31:38.448 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.449 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:57 7.3 7:c609908c:::notify.5:head [watch watch cookie 94069412621696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:31:38.449 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:48.668590+0000", 2024-05-08T18:31:38.449 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 109.779693769, 2024-05-08T18:31:38.449 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0054375830000000002, 2024-05-08T18:31:38.449 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:38.449 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:38.449 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:38.449 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:38.449 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:38.449 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:38.449 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 57 2024-05-08T18:31:38.449 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.449 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:38.450 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.450 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:38.450 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668590+0000", 2024-05-08T18:31:38.450 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:38.450 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.450 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.450 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:38.450 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668590+0000", 2024-05-08T18:31:38.450 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:38.450 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.450 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.450 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:38.450 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668592+0000", 2024-05-08T18:31:38.450 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0930000000000001e-06 2024-05-08T18:31:38.451 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.451 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.451 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:38.451 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668619+0000", 2024-05-08T18:31:38.451 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7396999999999999e-05 2024-05-08T18:31:38.451 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.451 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.451 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:38.451 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668650+0000", 2024-05-08T18:31:38.451 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0620000000000002e-05 2024-05-08T18:31:38.451 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.451 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.451 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:38.451 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668672+0000", 2024-05-08T18:31:38.452 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2093e-05 2024-05-08T18:31:38.452 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.452 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.452 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:38.452 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668782+0000", 2024-05-08T18:31:38.452 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011010600000000001 2024-05-08T18:31:38.452 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.452 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.452 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:38.452 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668934+0000", 2024-05-08T18:31:38.452 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000152268 2024-05-08T18:31:38.452 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.452 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.452 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-05-08T18:31:38.453 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669177+0000", 2024-05-08T18:31:38.453 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024286500000000001 2024-05-08T18:31:38.453 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.453 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.453 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:38.453 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.670404+0000", 2024-05-08T18:31:38.453 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001226932 2024-05-08T18:31:38.453 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.453 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.453 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:38.453 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.673822+0000", 2024-05-08T18:31:38.453 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003417776 2024-05-08T18:31:38.453 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.453 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.454 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:38.454 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.673924+0000", 2024-05-08T18:31:38.454 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000102379 2024-05-08T18:31:38.454 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.454 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.454 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:38.454 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674027+0000", 2024-05-08T18:31:38.454 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010305400000000001 2024-05-08T18:31:38.454 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:38.454 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:38.454 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:38.454 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.454 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.454 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:58 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:31:38.455 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:48.668750+0000", 2024-05-08T18:31:38.455 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 109.779533343, 2024-05-08T18:31:38.455 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0057687559999999999, 2024-05-08T18:31:38.455 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:38.455 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:38.455 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:38.455 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:38.455 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:38.455 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:38.455 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 58 2024-05-08T18:31:38.455 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.455 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:38.455 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.455 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:38.456 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668750+0000", 2024-05-08T18:31:38.456 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:38.456 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.456 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.456 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:38.456 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668750+0000", 2024-05-08T18:31:38.456 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:38.456 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.456 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.456 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:38.456 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668752+0000", 2024-05-08T18:31:38.456 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.64e-06 2024-05-08T18:31:38.456 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.456 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.456 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:38.457 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668760+0000", 2024-05-08T18:31:38.457 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5529999999999993e-06 2024-05-08T18:31:38.457 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.457 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.457 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:38.457 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668787+0000", 2024-05-08T18:31:38.457 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6475999999999999e-05 2024-05-08T18:31:38.457 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.457 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.457 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:38.457 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668804+0000", 2024-05-08T18:31:38.457 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7163000000000002e-05 2024-05-08T18:31:38.457 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.457 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.458 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:38.458 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668906+0000", 2024-05-08T18:31:38.458 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010241 2024-05-08T18:31:38.458 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.458 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.458 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:38.458 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669068+0000", 2024-05-08T18:31:38.458 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016144400000000001 2024-05-08T18:31:38.458 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.458 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.458 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-05-08T18:31:38.458 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669226+0000", 2024-05-08T18:31:38.458 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000158639 2024-05-08T18:31:38.458 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.459 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.459 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:38.459 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.670439+0000", 2024-05-08T18:31:38.459 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012124480000000001 2024-05-08T18:31:38.459 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.459 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.459 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:38.459 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674406+0000", 2024-05-08T18:31:38.459 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0039675259999999999 2024-05-08T18:31:38.459 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.459 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.459 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:38.459 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674469+0000", 2024-05-08T18:31:38.459 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.2903000000000004e-05 2024-05-08T18:31:38.459 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.460 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.460 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:38.460 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674519+0000", 2024-05-08T18:31:38.460 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9554e-05 2024-05-08T18:31:38.460 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:38.460 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:38.460 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:38.460 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.460 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.460 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-08T18:31:38.460 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.675404+0000", 2024-05-08T18:31:38.460 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 106.77287957199999, 2024-05-08T18:31:38.460 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003903147, 2024-05-08T18:31:38.460 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:38.461 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:38.461 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:38.461 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:38.461 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:38.461 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:38.461 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 207 2024-05-08T18:31:38.461 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.461 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:38.461 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.461 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:38.461 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675404+0000", 2024-05-08T18:31:38.461 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:38.461 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.461 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.462 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:38.462 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675404+0000", 2024-05-08T18:31:38.462 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:38.462 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.462 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.462 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:38.462 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675407+0000", 2024-05-08T18:31:38.462 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1729999999999999e-06 2024-05-08T18:31:38.462 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.462 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.462 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:38.462 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675422+0000", 2024-05-08T18:31:38.462 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.485e-05 2024-05-08T18:31:38.463 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.463 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.463 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:38.463 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675454+0000", 2024-05-08T18:31:38.463 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1656000000000003e-05 2024-05-08T18:31:38.463 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.463 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.463 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:38.463 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675470+0000", 2024-05-08T18:31:38.463 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.626e-05 2024-05-08T18:31:38.463 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.463 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.463 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:38.463 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675683+0000", 2024-05-08T18:31:38.464 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021312600000000001 2024-05-08T18:31:38.464 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.464 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.464 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:38.464 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.675972+0000", 2024-05-08T18:31:38.464 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00028885100000000002 2024-05-08T18:31:38.464 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.464 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.464 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:38.464 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.676369+0000", 2024-05-08T18:31:38.464 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000397227 2024-05-08T18:31:38.464 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.464 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.464 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:38.464 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.677780+0000", 2024-05-08T18:31:38.465 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001411186 2024-05-08T18:31:38.465 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.465 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.465 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:38.465 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679153+0000", 2024-05-08T18:31:38.465 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0013725720000000001 2024-05-08T18:31:38.465 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.465 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.465 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:38.465 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679240+0000", 2024-05-08T18:31:38.465 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7412999999999998e-05 2024-05-08T18:31:38.465 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.465 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.465 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:38.466 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679307+0000", 2024-05-08T18:31:38.466 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6833000000000002e-05 2024-05-08T18:31:38.466 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:38.466 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:38.466 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:38.466 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.466 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.466 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:38.466 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.776086+0000", 2024-05-08T18:31:38.466 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 106.672197406, 2024-05-08T18:31:38.466 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0037528710000000001, 2024-05-08T18:31:38.466 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:38.466 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:38.466 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:38.467 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:38.467 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:38.467 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:38.467 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 231 2024-05-08T18:31:38.467 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.467 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:38.467 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.467 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:38.467 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.776086+0000", 2024-05-08T18:31:38.467 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:38.467 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.467 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.467 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:38.467 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.776086+0000", 2024-05-08T18:31:38.468 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:38.468 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.468 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.468 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:38.468 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.776089+0000", 2024-05-08T18:31:38.468 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8870000000000001e-06 2024-05-08T18:31:38.468 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.468 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.468 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:38.468 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.776102+0000", 2024-05-08T18:31:38.468 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.294e-05 2024-05-08T18:31:38.468 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.468 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.468 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:38.468 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.776132+0000", 2024-05-08T18:31:38.469 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0113000000000001e-05 2024-05-08T18:31:38.469 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.469 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.469 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:38.469 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.776150+0000", 2024-05-08T18:31:38.469 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8216999999999999e-05 2024-05-08T18:31:38.469 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.469 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.469 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:38.469 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.776268+0000", 2024-05-08T18:31:38.469 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000117395 2024-05-08T18:31:38.469 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.469 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.469 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:38.470 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.776514+0000", 2024-05-08T18:31:38.470 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024602899999999999 2024-05-08T18:31:38.470 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.470 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.470 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:31:38.470 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.776920+0000", 2024-05-08T18:31:38.470 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000406723 2024-05-08T18:31:38.470 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.470 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.470 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:38.471 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.778360+0000", 2024-05-08T18:31:38.471 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0014393279999999999 2024-05-08T18:31:38.471 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.471 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.471 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:38.471 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.779687+0000", 2024-05-08T18:31:38.471 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001327674 2024-05-08T18:31:38.471 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.471 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.471 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:38.471 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.779777+0000", 2024-05-08T18:31:38.472 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9152000000000003e-05 2024-05-08T18:31:38.472 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.472 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.472 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:38.472 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.779839+0000", 2024-05-08T18:31:38.472 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.2413e-05 2024-05-08T18:31:38.472 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:38.472 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:38.472 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:38.472 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.472 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.472 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:541 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:38.473 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.916718+0000", 2024-05-08T18:31:38.473 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 106.531565308, 2024-05-08T18:31:38.473 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0041779829999999997, 2024-05-08T18:31:38.473 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:38.473 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:38.473 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:38.473 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:38.473 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:38.473 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:38.473 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 541 2024-05-08T18:31:38.473 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.473 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:38.473 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.473 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:38.473 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.916718+0000", 2024-05-08T18:31:38.474 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:38.474 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.474 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.474 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:38.474 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.916718+0000", 2024-05-08T18:31:38.474 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:38.474 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.474 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.474 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:38.474 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.916719+0000", 2024-05-08T18:31:38.474 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0100000000000005e-07 2024-05-08T18:31:38.475 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.475 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.475 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:38.475 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.916722+0000", 2024-05-08T18:31:38.475 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7760000000000002e-06 2024-05-08T18:31:38.475 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.475 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.475 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:38.475 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.916729+0000", 2024-05-08T18:31:38.475 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.8290000000000008e-06 2024-05-08T18:31:38.475 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.475 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.475 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:38.476 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.916734+0000", 2024-05-08T18:31:38.476 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3109999999999999e-06 2024-05-08T18:31:38.476 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.476 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.476 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:38.476 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.916776+0000", 2024-05-08T18:31:38.476 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.2086999999999999e-05 2024-05-08T18:31:38.476 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.476 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.476 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:38.476 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.916824+0000", 2024-05-08T18:31:38.477 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8412999999999999e-05 2024-05-08T18:31:38.477 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.477 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.477 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:31:38.477 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.916929+0000", 2024-05-08T18:31:38.477 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010480900000000001 2024-05-08T18:31:38.477 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.477 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.477 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:38.477 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.917428+0000", 2024-05-08T18:31:38.477 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00049889599999999997 2024-05-08T18:31:38.477 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.478 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.478 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:38.478 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.920833+0000", 2024-05-08T18:31:38.478 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0034047140000000001 2024-05-08T18:31:38.478 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.478 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.478 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:38.478 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.920868+0000", 2024-05-08T18:31:38.478 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5750999999999997e-05 2024-05-08T18:31:38.478 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.478 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.478 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:38.478 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.920896+0000", 2024-05-08T18:31:38.479 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7796e-05 2024-05-08T18:31:38.479 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:38.479 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:38.479 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:38.479 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.479 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.479 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.5274.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-05-08T18:31:38.479 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:36.922415+0000", 2024-05-08T18:31:38.479 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 1.5258684900000001, 2024-05-08T18:31:38.480 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0065500439999999997, 2024-05-08T18:31:38.480 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:38.480 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:38.480 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:38.480 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:38.480 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.5274", 2024-05-08T18:31:38.480 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/1159946380", 2024-05-08T18:31:38.480 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 56 2024-05-08T18:31:38.480 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.480 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:38.480 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.480 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:38.480 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:36.922415+0000", 2024-05-08T18:31:38.481 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:38.481 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.481 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.481 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:38.481 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:36.922415+0000", 2024-05-08T18:31:38.481 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:38.481 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.481 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.481 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:38.481 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:36.922415+0000", 2024-05-08T18:31:38.481 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5900000000000003e-07 2024-05-08T18:31:38.481 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.482 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.482 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:38.482 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:36.922417+0000", 2024-05-08T18:31:38.482 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.968e-06 2024-05-08T18:31:38.482 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.482 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.482 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:38.482 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:36.922422+0000", 2024-05-08T18:31:38.482 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7110000000000003e-06 2024-05-08T18:31:38.482 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.482 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.482 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:38.483 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:36.922427+0000", 2024-05-08T18:31:38.483 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9130000000000002e-06 2024-05-08T18:31:38.483 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.483 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.483 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:38.483 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:36.922463+0000", 2024-05-08T18:31:38.483 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5695999999999998e-05 2024-05-08T18:31:38.483 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.483 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.483 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:38.483 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:36.922503+0000", 2024-05-08T18:31:38.483 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0692999999999998e-05 2024-05-08T18:31:38.483 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.483 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.483 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-05-08T18:31:38.484 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:36.922570+0000", 2024-05-08T18:31:38.484 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6567000000000001e-05 2024-05-08T18:31:38.484 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.484 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.484 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:38.484 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:36.923531+0000", 2024-05-08T18:31:38.484 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00096120799999999996 2024-05-08T18:31:38.484 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.484 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.484 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:38.484 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:36.928873+0000", 2024-05-08T18:31:38.484 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0053416640000000003 2024-05-08T18:31:38.484 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.485 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.485 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:38.485 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:36.928924+0000", 2024-05-08T18:31:38.485 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.1371e-05 2024-05-08T18:31:38.485 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.485 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.485 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:38.485 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:36.928965+0000", 2024-05-08T18:31:38.485 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0893999999999998e-05 2024-05-08T18:31:38.485 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:38.485 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:38.485 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:38.485 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.485 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.485 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1181 4.21 4:85baa8d2:::.dir.3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.1.3:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-05-08T18:31:38.486 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:37.015762+0000", 2024-05-08T18:31:38.486 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 1.432521747, 2024-05-08T18:31:38.486 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0044060790000000002, 2024-05-08T18:31:38.486 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:38.486 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:38.486 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:38.486 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:38.486 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:38.486 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:38.487 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1181 2024-05-08T18:31:38.487 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.487 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:38.487 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.487 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:38.487 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.015762+0000", 2024-05-08T18:31:38.487 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:38.487 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.487 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.487 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:38.487 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.015762+0000", 2024-05-08T18:31:38.487 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:38.487 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.488 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.488 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:38.488 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.015763+0000", 2024-05-08T18:31:38.488 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.167e-06 2024-05-08T18:31:38.488 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.488 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.488 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:38.488 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.015781+0000", 2024-05-08T18:31:38.488 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8219999999999998e-05 2024-05-08T18:31:38.489 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.489 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.489 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:38.489 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.015796+0000", 2024-05-08T18:31:38.489 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5048999999999999e-05 2024-05-08T18:31:38.489 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.489 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.489 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:38.489 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.015805+0000", 2024-05-08T18:31:38.489 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7479999999999999e-06 2024-05-08T18:31:38.490 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.490 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.490 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:38.490 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.015901+0000", 2024-05-08T18:31:38.490 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.6215e-05 2024-05-08T18:31:38.490 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.490 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.490 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:38.490 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.016023+0000", 2024-05-08T18:31:38.491 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000121576 2024-05-08T18:31:38.491 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.491 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.491 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-05-08T18:31:38.491 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.016164+0000", 2024-05-08T18:31:38.491 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014124799999999999 2024-05-08T18:31:38.491 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.491 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.491 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:38.491 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.020053+0000", 2024-05-08T18:31:38.492 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0038886709999999998 2024-05-08T18:31:38.492 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.492 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.492 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:38.492 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.020082+0000", 2024-05-08T18:31:38.492 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9343999999999999e-05 2024-05-08T18:31:38.492 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.492 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.492 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:38.492 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.020128+0000", 2024-05-08T18:31:38.492 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6384999999999997e-05 2024-05-08T18:31:38.492 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.493 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.493 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:38.493 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.020168+0000", 2024-05-08T18:31:38.493 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9456000000000003e-05 2024-05-08T18:31:38.493 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:38.493 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:38.493 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:38.493 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.493 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.493 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1183 4.17 4:e9b5c940:::.dir.3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.1.5:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-05-08T18:31:38.493 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:37.015826+0000", 2024-05-08T18:31:38.493 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 1.432457343, 2024-05-08T18:31:38.494 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0043677179999999996, 2024-05-08T18:31:38.494 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:38.494 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:38.494 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:38.494 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:38.494 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:38.494 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:38.494 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1183 2024-05-08T18:31:38.494 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.494 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:38.494 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.494 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:38.495 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.015826+0000", 2024-05-08T18:31:38.495 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:38.495 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.495 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.495 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:38.495 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.015826+0000", 2024-05-08T18:31:38.495 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:38.495 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.495 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.495 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:38.495 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.015827+0000", 2024-05-08T18:31:38.495 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.99e-07 2024-05-08T18:31:38.495 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.495 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.496 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:38.496 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.015830+0000", 2024-05-08T18:31:38.496 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5499999999999999e-06 2024-05-08T18:31:38.496 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.496 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.496 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:38.496 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.015841+0000", 2024-05-08T18:31:38.496 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0281e-05 2024-05-08T18:31:38.496 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.497 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.497 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:38.497 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.015846+0000", 2024-05-08T18:31:38.497 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5319999999999997e-06 2024-05-08T18:31:38.497 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.497 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.497 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:38.497 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.015921+0000", 2024-05-08T18:31:38.497 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.4418999999999993e-05 2024-05-08T18:31:38.497 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.497 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.497 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:38.497 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.016023+0000", 2024-05-08T18:31:38.497 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000102828 2024-05-08T18:31:38.498 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.498 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.498 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:38.498 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.016164+0000", 2024-05-08T18:31:38.498 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014105699999999999 2024-05-08T18:31:38.498 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.498 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.498 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:38.498 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.019811+0000", 2024-05-08T18:31:38.498 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003646318 2024-05-08T18:31:38.498 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.498 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.499 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:38.499 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.020124+0000", 2024-05-08T18:31:38.499 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00031356 2024-05-08T18:31:38.499 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.499 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.499 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:38.499 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.020161+0000", 2024-05-08T18:31:38.499 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6502999999999999e-05 2024-05-08T18:31:38.499 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.499 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.499 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:38.499 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.020194+0000", 2024-05-08T18:31:38.499 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3071000000000002e-05 2024-05-08T18:31:38.499 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:38.500 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:38.500 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:38.500 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.500 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.500 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1187 4.10 4:0a0959ae:::.dir.3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.1.9:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-05-08T18:31:38.500 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:37.015880+0000", 2024-05-08T18:31:38.500 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 1.432403482, 2024-05-08T18:31:38.500 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0042183139999999999, 2024-05-08T18:31:38.500 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:38.500 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:38.500 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:38.500 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:38.501 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:38.501 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:38.501 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1187 2024-05-08T18:31:38.501 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.501 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:38.501 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.501 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:38.501 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.015880+0000", 2024-05-08T18:31:38.501 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:38.501 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.501 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.501 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:38.502 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.015880+0000", 2024-05-08T18:31:38.502 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:38.502 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.502 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.502 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:38.502 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.015881+0000", 2024-05-08T18:31:38.502 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8400000000000004e-07 2024-05-08T18:31:38.502 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.502 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.502 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:38.502 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.015884+0000", 2024-05-08T18:31:38.502 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5109999999999999e-06 2024-05-08T18:31:38.502 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.503 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.503 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:38.503 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.015893+0000", 2024-05-08T18:31:38.503 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.4100000000000008e-06 2024-05-08T18:31:38.503 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.503 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.503 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:38.503 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.015898+0000", 2024-05-08T18:31:38.503 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7350000000000001e-06 2024-05-08T18:31:38.503 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.503 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.503 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:38.503 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.015965+0000", 2024-05-08T18:31:38.503 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6445999999999994e-05 2024-05-08T18:31:38.504 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.504 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.504 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:38.504 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.016084+0000", 2024-05-08T18:31:38.504 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000119531 2024-05-08T18:31:38.504 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.504 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.504 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:38.504 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.016216+0000", 2024-05-08T18:31:38.504 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013150999999999999 2024-05-08T18:31:38.504 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.504 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.504 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:38.504 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.017275+0000", 2024-05-08T18:31:38.505 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001058862 2024-05-08T18:31:38.505 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.505 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.505 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:38.505 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.020007+0000", 2024-05-08T18:31:38.505 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0027323130000000001 2024-05-08T18:31:38.505 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.505 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.505 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:38.505 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.020058+0000", 2024-05-08T18:31:38.505 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.1434000000000003e-05 2024-05-08T18:31:38.506 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.506 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.506 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:38.506 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.020098+0000", 2024-05-08T18:31:38.506 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9978000000000002e-05 2024-05-08T18:31:38.506 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:38.506 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:38.506 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:38.506 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.506 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.506 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.5328.0:143 4.17 4:e9b5c940:::.dir.3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.1.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-05-08T18:31:38.506 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:37.589237+0000", 2024-05-08T18:31:38.507 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.85904673499999995, 2024-05-08T18:31:38.507 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0034969340000000002, 2024-05-08T18:31:38.507 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:38.507 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:38.507 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:38.507 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:38.507 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.5328", 2024-05-08T18:31:38.507 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/400329163", 2024-05-08T18:31:38.507 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 143 2024-05-08T18:31:38.507 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.507 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:38.507 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.507 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:38.507 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.589237+0000", 2024-05-08T18:31:38.507 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:38.508 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.508 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.508 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:38.508 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.589237+0000", 2024-05-08T18:31:38.508 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:38.508 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.508 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.508 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:38.508 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.589237+0000", 2024-05-08T18:31:38.508 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7599999999999997e-07 2024-05-08T18:31:38.508 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.508 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.509 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:38.509 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.589240+0000", 2024-05-08T18:31:38.509 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.537e-06 2024-05-08T18:31:38.509 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.509 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.509 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:38.509 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.589252+0000", 2024-05-08T18:31:38.509 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2274e-05 2024-05-08T18:31:38.509 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.509 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.509 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:38.509 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.589258+0000", 2024-05-08T18:31:38.509 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1079999999999998e-06 2024-05-08T18:31:38.509 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.510 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.510 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:38.510 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.589308+0000", 2024-05-08T18:31:38.510 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9638000000000001e-05 2024-05-08T18:31:38.510 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.510 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.510 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:38.510 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.589380+0000", 2024-05-08T18:31:38.510 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1775999999999999e-05 2024-05-08T18:31:38.510 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.511 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.511 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:38.511 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.589468+0000", 2024-05-08T18:31:38.511 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8749e-05 2024-05-08T18:31:38.511 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.511 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.511 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:38.511 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.590818+0000", 2024-05-08T18:31:38.511 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0013501279999999999 2024-05-08T18:31:38.511 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.511 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.511 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:38.512 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.592664+0000", 2024-05-08T18:31:38.512 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001845752 2024-05-08T18:31:38.512 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.512 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.512 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:38.512 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.592695+0000", 2024-05-08T18:31:38.512 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0771000000000001e-05 2024-05-08T18:31:38.512 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.512 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.512 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:38.512 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.592734+0000", 2024-05-08T18:31:38.512 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8724999999999999e-05 2024-05-08T18:31:38.512 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:38.512 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:38.513 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:38.513 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.513 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.513 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.5018.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-05-08T18:31:38.513 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:37.741544+0000", 2024-05-08T18:31:38.513 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.70673911499999997, 2024-05-08T18:31:38.513 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0041310289999999996, 2024-05-08T18:31:38.513 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:38.513 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:38.513 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:38.513 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:38.513 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.5018", 2024-05-08T18:31:38.513 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/1927960023", 2024-05-08T18:31:38.513 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 56 2024-05-08T18:31:38.514 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.514 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:38.514 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.514 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:38.514 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.741544+0000", 2024-05-08T18:31:38.514 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:38.514 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.514 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.514 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:38.514 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.741544+0000", 2024-05-08T18:31:38.514 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:38.514 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.515 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.515 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:38.515 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.741545+0000", 2024-05-08T18:31:38.515 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5000000000000002e-07 2024-05-08T18:31:38.515 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.515 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.515 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:38.515 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.741548+0000", 2024-05-08T18:31:38.515 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.903e-06 2024-05-08T18:31:38.515 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.515 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.515 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:38.515 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.741556+0000", 2024-05-08T18:31:38.516 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7759999999999997e-06 2024-05-08T18:31:38.516 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.516 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.516 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:38.516 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.741559+0000", 2024-05-08T18:31:38.516 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6729999999999998e-06 2024-05-08T18:31:38.516 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.516 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.516 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:38.516 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.741600+0000", 2024-05-08T18:31:38.516 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0643999999999999e-05 2024-05-08T18:31:38.516 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.517 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.517 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:38.517 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.741644+0000", 2024-05-08T18:31:38.517 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3742999999999998e-05 2024-05-08T18:31:38.517 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.517 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.517 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-05-08T18:31:38.517 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.741708+0000", 2024-05-08T18:31:38.517 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.4537999999999998e-05 2024-05-08T18:31:38.517 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.518 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.518 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:38.518 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.745556+0000", 2024-05-08T18:31:38.518 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0038472580000000001 2024-05-08T18:31:38.518 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.518 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.518 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:38.518 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.745624+0000", 2024-05-08T18:31:38.518 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8042999999999999e-05 2024-05-08T18:31:38.518 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.518 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.518 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:38.518 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.745652+0000", 2024-05-08T18:31:38.519 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8453999999999999e-05 2024-05-08T18:31:38.519 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.519 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.519 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:38.519 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.745675+0000", 2024-05-08T18:31:38.519 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3346999999999999e-05 2024-05-08T18:31:38.519 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:38.519 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:38.519 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:38.519 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.519 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.519 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1213 4.14 4:28b5ed3e:::.dir.3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.2.2:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-05-08T18:31:38.519 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:37.799874+0000", 2024-05-08T18:31:38.520 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.64840958100000001, 2024-05-08T18:31:38.520 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0041672180000000003, 2024-05-08T18:31:38.520 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:38.520 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:38.520 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:38.520 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:38.520 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:38.520 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:38.520 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1213 2024-05-08T18:31:38.520 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.520 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:38.520 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.520 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:38.520 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.799874+0000", 2024-05-08T18:31:38.521 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:38.521 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.521 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.521 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:38.521 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.799874+0000", 2024-05-08T18:31:38.521 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:38.521 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.521 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.521 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:38.521 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.799875+0000", 2024-05-08T18:31:38.522 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.71e-07 2024-05-08T18:31:38.522 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.522 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.522 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:38.522 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.799882+0000", 2024-05-08T18:31:38.522 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1180000000000003e-06 2024-05-08T18:31:38.522 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.522 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.522 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:38.522 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.799895+0000", 2024-05-08T18:31:38.523 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3481e-05 2024-05-08T18:31:38.523 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.523 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.523 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:38.523 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.799903+0000", 2024-05-08T18:31:38.523 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.8490000000000006e-06 2024-05-08T18:31:38.523 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.523 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.523 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:38.523 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.799963+0000", 2024-05-08T18:31:38.524 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9345999999999997e-05 2024-05-08T18:31:38.524 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.524 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.524 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:38.524 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.800099+0000", 2024-05-08T18:31:38.524 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013665699999999999 2024-05-08T18:31:38.524 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.524 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.524 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-05-08T18:31:38.524 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.800251+0000", 2024-05-08T18:31:38.524 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015142199999999999 2024-05-08T18:31:38.524 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.524 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.525 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:38.525 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.803769+0000", 2024-05-08T18:31:38.525 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0035187740000000001 2024-05-08T18:31:38.525 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.525 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.525 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:38.525 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.803948+0000", 2024-05-08T18:31:38.525 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000178438 2024-05-08T18:31:38.525 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.525 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.525 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:38.525 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.804003+0000", 2024-05-08T18:31:38.525 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5312999999999997e-05 2024-05-08T18:31:38.525 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.526 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.526 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:38.526 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.804041+0000", 2024-05-08T18:31:38.526 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7948999999999999e-05 2024-05-08T18:31:38.526 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:38.526 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:38.526 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:38.526 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.526 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.526 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1219 4.2b e80/23 4:d5d6c392:::.dir.3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.2.8:head v 80'1, mlcod=0'0)", 2024-05-08T18:31:38.527 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:37.801516+0000", 2024-05-08T18:31:38.527 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.64676786100000005, 2024-05-08T18:31:38.527 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0047670200000000003, 2024-05-08T18:31:38.527 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:38.527 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:38.527 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:38.527 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:38.527 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.527 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:38.527 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.801516+0000", 2024-05-08T18:31:38.527 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:38.527 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.528 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.528 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:38.528 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.801516+0000", 2024-05-08T18:31:38.528 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:38.528 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.528 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.528 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:38.528 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.801516+0000", 2024-05-08T18:31:38.528 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.16e-07 2024-05-08T18:31:38.528 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.528 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.528 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:38.528 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.801521+0000", 2024-05-08T18:31:38.528 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3159999999999998e-06 2024-05-08T18:31:38.529 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.529 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.529 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:38.529 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.801530+0000", 2024-05-08T18:31:38.529 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.7030000000000001e-06 2024-05-08T18:31:38.529 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.529 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.529 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:38.529 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.801535+0000", 2024-05-08T18:31:38.529 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9819999999999999e-06 2024-05-08T18:31:38.529 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.529 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.529 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:38.530 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.801585+0000", 2024-05-08T18:31:38.530 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.0046999999999997e-05 2024-05-08T18:31:38.530 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.530 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.530 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:38.530 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.801605+0000", 2024-05-08T18:31:38.530 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9667999999999999e-05 2024-05-08T18:31:38.530 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.530 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.530 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:38.531 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.806246+0000", 2024-05-08T18:31:38.531 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0046411000000000004 2024-05-08T18:31:38.531 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.531 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.531 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:38.532 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.806283+0000", 2024-05-08T18:31:38.532 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6387999999999998e-05 2024-05-08T18:31:38.532 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:38.532 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:38.532 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:38.532 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.532 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.532 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1217 4.c e80/23 4:3273f745:::.dir.3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.2.6:head v 80'1, mlcod=0'0)", 2024-05-08T18:31:38.532 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:37.802489+0000", 2024-05-08T18:31:38.532 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.64579489800000001, 2024-05-08T18:31:38.532 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0038135539999999998, 2024-05-08T18:31:38.533 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:38.533 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:38.533 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:38.533 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:38.533 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.533 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:38.533 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.802489+0000", 2024-05-08T18:31:38.533 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:38.533 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.533 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.533 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:38.533 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.802489+0000", 2024-05-08T18:31:38.534 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:38.534 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.534 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.534 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:38.534 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.802489+0000", 2024-05-08T18:31:38.534 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6000000000000003e-07 2024-05-08T18:31:38.534 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.534 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.534 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:38.534 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.802497+0000", 2024-05-08T18:31:38.534 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.3579999999999997e-06 2024-05-08T18:31:38.535 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.535 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.535 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:38.535 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.802505+0000", 2024-05-08T18:31:38.535 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7059999999999993e-06 2024-05-08T18:31:38.535 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.535 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.535 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:38.535 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.802510+0000", 2024-05-08T18:31:38.535 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.437e-06 2024-05-08T18:31:38.535 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.535 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.535 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:38.535 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.802558+0000", 2024-05-08T18:31:38.536 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8309000000000001e-05 2024-05-08T18:31:38.536 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.536 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.536 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:38.536 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.802569+0000", 2024-05-08T18:31:38.536 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1141999999999999e-05 2024-05-08T18:31:38.536 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.536 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.536 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:38.536 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.806276+0000", 2024-05-08T18:31:38.536 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0037065520000000001 2024-05-08T18:31:38.536 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.536 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.536 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:38.536 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.806302+0000", 2024-05-08T18:31:38.537 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.639e-05 2024-05-08T18:31:38.537 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:38.537 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:38.537 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:38.537 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.537 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.537 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.5367.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-05-08T18:31:38.537 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:37.921797+0000", 2024-05-08T18:31:38.537 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.52648622099999998, 2024-05-08T18:31:38.537 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0055479570000000001, 2024-05-08T18:31:38.537 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:38.538 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:38.538 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:38.538 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:38.538 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.5367", 2024-05-08T18:31:38.538 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3112754809", 2024-05-08T18:31:38.538 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 56 2024-05-08T18:31:38.538 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.538 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:38.538 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.538 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:38.538 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.921797+0000", 2024-05-08T18:31:38.538 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:38.539 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.539 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.539 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:38.539 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.921797+0000", 2024-05-08T18:31:38.539 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:38.539 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.539 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.539 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:38.539 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.921798+0000", 2024-05-08T18:31:38.539 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9500000000000002e-07 2024-05-08T18:31:38.539 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.539 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.539 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:38.539 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.921801+0000", 2024-05-08T18:31:38.540 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6819999999999999e-06 2024-05-08T18:31:38.540 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.540 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.540 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:38.540 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.921810+0000", 2024-05-08T18:31:38.540 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9660000000000002e-06 2024-05-08T18:31:38.540 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.540 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.540 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:38.540 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.921813+0000", 2024-05-08T18:31:38.540 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3589999999999999e-06 2024-05-08T18:31:38.540 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.540 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.541 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:38.541 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.921848+0000", 2024-05-08T18:31:38.541 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5193e-05 2024-05-08T18:31:38.541 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.541 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.541 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:38.541 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.921893+0000", 2024-05-08T18:31:38.541 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5291999999999999e-05 2024-05-08T18:31:38.541 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.541 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.541 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-05-08T18:31:38.541 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.921972+0000", 2024-05-08T18:31:38.541 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.8578999999999994e-05 2024-05-08T18:31:38.541 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.542 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.542 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:38.542 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.924078+0000", 2024-05-08T18:31:38.542 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0021059939999999999 2024-05-08T18:31:38.542 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.542 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.542 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:38.542 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.927293+0000", 2024-05-08T18:31:38.542 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032145099999999999 2024-05-08T18:31:38.542 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.542 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.543 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:38.543 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.927321+0000", 2024-05-08T18:31:38.543 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8853e-05 2024-05-08T18:31:38.543 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.543 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.543 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:38.543 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.927345+0000", 2024-05-08T18:31:38.543 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3833999999999999e-05 2024-05-08T18:31:38.543 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:38.543 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:38.544 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:38.544 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.544 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.544 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.5048.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94364071099616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-05-08T18:31:38.545 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:38.103301+0000", 2024-05-08T18:31:38.545 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.34498280100000001, 2024-05-08T18:31:38.545 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0053008530000000003, 2024-05-08T18:31:38.545 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:38.545 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:38.545 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:38.545 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:38.545 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.5048", 2024-05-08T18:31:38.545 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/1891951056", 2024-05-08T18:31:38.545 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 55 2024-05-08T18:31:38.545 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.545 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:38.545 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.546 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:38.546 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.103301+0000", 2024-05-08T18:31:38.546 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:38.546 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.546 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.546 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:38.546 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.103301+0000", 2024-05-08T18:31:38.546 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:38.546 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.546 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.546 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:38.547 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.103302+0000", 2024-05-08T18:31:38.547 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.5300000000000002e-07 2024-05-08T18:31:38.547 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.547 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.547 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:38.547 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.103305+0000", 2024-05-08T18:31:38.547 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8130000000000002e-06 2024-05-08T18:31:38.547 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.548 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.548 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:38.548 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.103316+0000", 2024-05-08T18:31:38.548 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0618999999999999e-05 2024-05-08T18:31:38.548 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.549 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.549 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:38.549 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.103322+0000", 2024-05-08T18:31:38.549 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3829999999999997e-06 2024-05-08T18:31:38.549 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.549 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.549 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:38.549 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.103364+0000", 2024-05-08T18:31:38.549 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.1943999999999997e-05 2024-05-08T18:31:38.549 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.549 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.549 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:38.549 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.103436+0000", 2024-05-08T18:31:38.550 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1386999999999999e-05 2024-05-08T18:31:38.550 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.550 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.550 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-05-08T18:31:38.550 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.103571+0000", 2024-05-08T18:31:38.550 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000135432 2024-05-08T18:31:38.550 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.550 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.550 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:38.550 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.108265+0000", 2024-05-08T18:31:38.550 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0046942429999999999 2024-05-08T18:31:38.550 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.550 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.551 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:38.551 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.108535+0000", 2024-05-08T18:31:38.551 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00026922399999999998 2024-05-08T18:31:38.551 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.551 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.551 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:38.551 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.108565+0000", 2024-05-08T18:31:38.551 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0117999999999999e-05 2024-05-08T18:31:38.551 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.551 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.551 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:38.551 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.108602+0000", 2024-05-08T18:31:38.551 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6736999999999997e-05 2024-05-08T18:31:38.551 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:38.552 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:38.552 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:38.552 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.552 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.552 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.5048.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94364071109248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-05-08T18:31:38.552 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:38.105896+0000", 2024-05-08T18:31:38.552 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.34238766300000001, 2024-05-08T18:31:38.552 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0053492180000000002, 2024-05-08T18:31:38.552 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:38.552 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:38.552 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:38.552 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:38.552 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.5048", 2024-05-08T18:31:38.553 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/1891951056", 2024-05-08T18:31:38.553 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 57 2024-05-08T18:31:38.553 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.553 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:38.553 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.553 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:38.553 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.105896+0000", 2024-05-08T18:31:38.553 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:38.553 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.553 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.553 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:38.553 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.105896+0000", 2024-05-08T18:31:38.553 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:38.554 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.554 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.554 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:38.554 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.105897+0000", 2024-05-08T18:31:38.554 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.124e-06 2024-05-08T18:31:38.554 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.554 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.554 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:38.554 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.105908+0000", 2024-05-08T18:31:38.554 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1080999999999999e-05 2024-05-08T18:31:38.554 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.554 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.554 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:38.555 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.105922+0000", 2024-05-08T18:31:38.555 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3814e-05 2024-05-08T18:31:38.555 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.555 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.555 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:38.555 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.105929+0000", 2024-05-08T18:31:38.555 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.0140000000000001e-06 2024-05-08T18:31:38.555 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.555 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.555 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:38.555 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.105979+0000", 2024-05-08T18:31:38.555 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.0522999999999997e-05 2024-05-08T18:31:38.555 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.556 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.556 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:38.556 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.106041+0000", 2024-05-08T18:31:38.556 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1888000000000001e-05 2024-05-08T18:31:38.556 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.556 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.556 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-05-08T18:31:38.556 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.106118+0000", 2024-05-08T18:31:38.556 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6787999999999997e-05 2024-05-08T18:31:38.556 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.556 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.556 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:38.556 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.110820+0000", 2024-05-08T18:31:38.556 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0047015549999999996 2024-05-08T18:31:38.557 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.557 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.557 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:38.557 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.111165+0000", 2024-05-08T18:31:38.557 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00034539500000000002 2024-05-08T18:31:38.557 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.557 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.557 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:38.557 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.111196+0000", 2024-05-08T18:31:38.557 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1068999999999997e-05 2024-05-08T18:31:38.557 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.558 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.558 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:38.558 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.111245+0000", 2024-05-08T18:31:38.558 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8967000000000001e-05 2024-05-08T18:31:38.558 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:38.558 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:38.558 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:38.558 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.558 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.558 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1234 3.38 3:1cb36fa1:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.2__shadow_.fYaqa8o34qSAauLRSqi3iwpmT5NwV5c_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-05-08T18:31:38.559 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:38.213439+0000", 2024-05-08T18:31:38.559 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.23484461300000001, 2024-05-08T18:31:38.559 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.028973664, 2024-05-08T18:31:38.559 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:38.559 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:38.559 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:38.559 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:38.559 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:38.559 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:38.559 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1234 2024-05-08T18:31:38.559 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.559 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:38.559 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.560 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:38.560 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.213439+0000", 2024-05-08T18:31:38.560 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:38.560 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.560 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.560 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:38.560 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.213439+0000", 2024-05-08T18:31:38.560 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:38.560 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.560 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.560 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:38.560 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.213442+0000", 2024-05-08T18:31:38.560 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7580000000000001e-06 2024-05-08T18:31:38.561 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.561 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.561 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:38.561 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.216804+0000", 2024-05-08T18:31:38.561 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0033619520000000001 2024-05-08T18:31:38.561 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.561 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.561 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:38.561 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.216838+0000", 2024-05-08T18:31:38.561 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4437999999999998e-05 2024-05-08T18:31:38.561 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.561 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.561 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:38.562 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.216854+0000", 2024-05-08T18:31:38.562 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5823000000000001e-05 2024-05-08T18:31:38.562 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.562 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.562 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:38.562 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.216938+0000", 2024-05-08T18:31:38.562 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.3842000000000001e-05 2024-05-08T18:31:38.562 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.562 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.562 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:38.562 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.217046+0000", 2024-05-08T18:31:38.562 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000108717 2024-05-08T18:31:38.562 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.563 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.563 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:38.563 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.217137+0000", 2024-05-08T18:31:38.563 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0278000000000005e-05 2024-05-08T18:31:38.563 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.563 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.563 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:38.563 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.225461+0000", 2024-05-08T18:31:38.563 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0083239330000000004 2024-05-08T18:31:38.563 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.563 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.563 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:38.563 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.242319+0000", 2024-05-08T18:31:38.564 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.016858445999999999 2024-05-08T18:31:38.564 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.564 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.564 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:38.564 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.242359+0000", 2024-05-08T18:31:38.564 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9657000000000003e-05 2024-05-08T18:31:38.564 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.564 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.564 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:38.564 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.242413+0000", 2024-05-08T18:31:38.564 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3820000000000003e-05 2024-05-08T18:31:38.564 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:38.565 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:38.565 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:38.565 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.565 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.565 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1237 3.c e80/21 3:3156de39:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.2_10Mb.:head v 80'1, mlcod=0'0)", 2024-05-08T18:31:38.565 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:38.251958+0000", 2024-05-08T18:31:38.565 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.19632587900000001, 2024-05-08T18:31:38.565 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010770866, 2024-05-08T18:31:38.565 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:38.565 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:38.566 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:38.566 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:38.566 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.566 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:38.566 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.251958+0000", 2024-05-08T18:31:38.566 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:38.566 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.566 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.566 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:38.566 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.251958+0000", 2024-05-08T18:31:38.566 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:38.566 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.566 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.567 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:38.567 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.251959+0000", 2024-05-08T18:31:38.567 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.384e-06 2024-05-08T18:31:38.567 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.567 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.567 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:38.567 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.256735+0000", 2024-05-08T18:31:38.567 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0047764790000000001 2024-05-08T18:31:38.567 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.567 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.567 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:38.567 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.256755+0000", 2024-05-08T18:31:38.567 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9483e-05 2024-05-08T18:31:38.568 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.568 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.568 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:38.568 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.256764+0000", 2024-05-08T18:31:38.568 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8519999999999993e-06 2024-05-08T18:31:38.568 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.568 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.568 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:38.568 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.256821+0000", 2024-05-08T18:31:38.568 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7345000000000001e-05 2024-05-08T18:31:38.568 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.568 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.568 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:38.569 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.256838+0000", 2024-05-08T18:31:38.569 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6827999999999999e-05 2024-05-08T18:31:38.569 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.569 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.569 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:38.569 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.262665+0000", 2024-05-08T18:31:38.569 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0058270650000000002 2024-05-08T18:31:38.569 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.569 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.569 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:38.569 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.262728+0000", 2024-05-08T18:31:38.569 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3429999999999994e-05 2024-05-08T18:31:38.569 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:38.569 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:38.570 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:38.570 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.570 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.570 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.5066.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-05-08T18:31:38.570 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:38.384881+0000", 2024-05-08T18:31:38.570 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.063402826999999995, 2024-05-08T18:31:38.570 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0035810799999999999, 2024-05-08T18:31:38.570 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:38.570 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:38.570 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:38.570 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:38.570 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.5066", 2024-05-08T18:31:38.570 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/4156398147", 2024-05-08T18:31:38.571 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 56 2024-05-08T18:31:38.571 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.571 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:38.571 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.571 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:38.571 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.384881+0000", 2024-05-08T18:31:38.571 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:38.571 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.571 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.571 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:38.571 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.384881+0000", 2024-05-08T18:31:38.571 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:38.571 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.571 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.572 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:38.572 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.384881+0000", 2024-05-08T18:31:38.572 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5000000000000003e-07 2024-05-08T18:31:38.572 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.572 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.572 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:38.572 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.384884+0000", 2024-05-08T18:31:38.572 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8650000000000001e-06 2024-05-08T18:31:38.572 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.572 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.572 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:38.572 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.384891+0000", 2024-05-08T18:31:38.572 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6250000000000001e-06 2024-05-08T18:31:38.573 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.573 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.573 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:38.573 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.384899+0000", 2024-05-08T18:31:38.573 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.3440000000000001e-06 2024-05-08T18:31:38.573 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.573 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.573 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:38.573 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.384942+0000", 2024-05-08T18:31:38.573 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.2963999999999997e-05 2024-05-08T18:31:38.573 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.573 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.573 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:38.573 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.384987+0000", 2024-05-08T18:31:38.574 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5179999999999998e-05 2024-05-08T18:31:38.574 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.574 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.574 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-05-08T18:31:38.574 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.385053+0000", 2024-05-08T18:31:38.574 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6271000000000003e-05 2024-05-08T18:31:38.574 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.574 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.574 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:38.575 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.385650+0000", 2024-05-08T18:31:38.575 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00059638900000000001 2024-05-08T18:31:38.575 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.575 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.575 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:38.575 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.388415+0000", 2024-05-08T18:31:38.575 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0027651849999999999 2024-05-08T18:31:38.575 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.575 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.575 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:38.575 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.388441+0000", 2024-05-08T18:31:38.575 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6332000000000001e-05 2024-05-08T18:31:38.575 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:38.575 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:38.576 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:38.576 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.388462+0000", 2024-05-08T18:31:38.576 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0375000000000001e-05 2024-05-08T18:31:38.576 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:38.576 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:38.576 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:38.576 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:38.576 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:38.576 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:38.577 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-08T18:31:38.577 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-08T18:31:38.578 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:31:38.574+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:31:38.579 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-08T18:31:38.580 INFO:tasks.workunit.client.0.smithi097.stdout:user usr2 deleted 2024-05-08T18:31:38.679 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:31:38.674+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:31:38.692 INFO:tasks.workunit.client.0.smithi097.stdout:Bucket Created: buck_2024_04_8_18_31_38 2024-05-08T18:31:38.717 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:31:38.717 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:31:38.717 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 0 2024-05-08T18:31:38.717 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:31:38.731 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-08T18:31:38.757 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2024-05-08T18:31:38.757 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:31:38.775 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2024-05-08T18:31:38.776 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:31:38.780 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:31:38.781+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:31:38.795 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2024-05-08T18:31:38.796 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:31:38.813 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2024-05-08T18:31:38.814 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:31:38.832 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2024-05-08T18:31:38.833 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:31:38.855 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2024-05-08T18:31:38.855 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:31:38.875 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2024-05-08T18:31:38.875 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:31:38.880 INFO:tasks.workunit.client.0.smithi097.stderr:1+0 records in 2024-05-08T18:31:38.880 INFO:tasks.workunit.client.0.smithi097.stderr:1+0 records out 2024-05-08T18:31:38.880 INFO:tasks.workunit.client.0.smithi097.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0287374 s, 365 MB/s 2024-05-08T18:31:38.880 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:31:38.881+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:31:38.893 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2024-05-08T18:31:38.893 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:31:38.902 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:38.903 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:38.917 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-08T18:31:38.981 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:31:38.978+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:31:39.043 INFO:tasks.workunit.client.0.smithi097.stdout:quota enabled for the user usr1 2024-05-08T18:31:39.043 INFO:tasks.workunit.client.0.smithi097.stdout:adding file to bucket buck_2024_04_8_18_31_38: 10Mb. 2024-05-08T18:31:39.043 INFO:tasks.workunit.client.0.smithi097.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-08T18:31:39.043 INFO:tasks.workunit.client.0.smithi097.stdout:Test case: PASSED - quota set for user: usr1 with max_size=0 passed 2024-05-08T18:31:39.043 INFO:tasks.workunit.client.0.smithi097.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-08T18:31:39.044 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:39.044 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:39.059 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-08T18:31:39.081 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:31:39.081+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:31:39.183 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:31:39.181+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:31:39.239 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:39.239 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:39.254 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-08T18:31:39.257 INFO:tasks.workunit.client.0.smithi097.stdout:user usr1 deleted 2024-05-08T18:31:39.284 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:31:39.285+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:31:39.382 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:39.382 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:39.385 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:31:39.382+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:31:39.396 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-08T18:31:39.416 INFO:tasks.workunit.client.0.smithi097.stdout:Bucket Created: buck_2024_04_8_18_31_39 2024-05-08T18:31:39.488 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:31:39.486+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:31:39.510 INFO:teuthology.orchestra.run.smithi097.stderr:nodeep-scrub is set 2024-05-08T18:31:39.571 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:39.572 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:39.587 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-08T18:31:39.588 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:31:39.589+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:31:39.688 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:31:39.689+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:31:39.752 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:39.752 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:39.766 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-08T18:31:39.817 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:31:39.814+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:31:39.890 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:39.890 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:39.891 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:31:39.886+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:31:39.904 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-08T18:31:39.995 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:31:39.993+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:31:40.071 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:40.071 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:40.085 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-08T18:31:40.095 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:31:40.093+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:31:40.198 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:31:40.194+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:31:40.203 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:40.203 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:40.209 INFO:tasks.workunit.client.0.smithi097.stderr:100+0 records in 2024-05-08T18:31:40.209 INFO:tasks.workunit.client.0.smithi097.stderr:100+0 records out 2024-05-08T18:31:40.209 INFO:tasks.workunit.client.0.smithi097.stderr:1048576000 bytes (1.0 GB, 1000 MiB) copied, 0.641823 s, 1.6 GB/s 2024-05-08T18:31:40.217 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-08T18:31:40.299 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:31:40.297+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:31:40.381 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:40.381 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:40.395 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-08T18:31:40.402 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:31:40.401+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:31:40.503 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:31:40.501+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:31:40.518 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:40.518 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:40.533 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-08T18:31:40.606 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:31:40.605+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:31:40.653 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:40.653 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:40.666 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-08T18:31:40.708 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:31:40.709+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:31:40.808 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:31:40.809+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:31:40.822 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:40.822 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:40.836 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-08T18:31:40.909 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:31:40.910+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:31:40.911 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-08T18:31:41.006 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:41.006 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:41.010 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:31:41.006+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:31:41.020 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-08T18:31:41.056 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2024-05-08T18:31:41.056 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:31:41.074 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2024-05-08T18:31:41.074 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:31:41.091 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2024-05-08T18:31:41.091 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:31:41.107 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2024-05-08T18:31:41.107 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:31:41.110 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:31:41.109+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:31:41.127 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2024-05-08T18:31:41.128 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:31:41.134 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:41.135 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:31:41.135 INFO:teuthology.orchestra.run.smithi097.stdout: "num_ops": 0 2024-05-08T18:31:41.135 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:41.148 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-08T18:31:41.148 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2024-05-08T18:31:41.149 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:31:41.168 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2024-05-08T18:31:41.168 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:31:41.188 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2024-05-08T18:31:41.189 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:31:41.211 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:31:41.206+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:31:41.288 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:41.288 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:31:41.288 INFO:teuthology.orchestra.run.smithi097.stdout: "complaint_time": 30, 2024-05-08T18:31:41.289 INFO:teuthology.orchestra.run.smithi097.stdout: "num_blocked_ops": 0 2024-05-08T18:31:41.289 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:41.301 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-08T18:31:41.311 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:31:41.306+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:31:41.412 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:41.412 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2024-05-08T18:31:41.412 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2024-05-08T18:31:41.412 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-05-08T18:31:41.412 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.412 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4479.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-05-08T18:31:41.413 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:44.576320+0000", 2024-05-08T18:31:41.413 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 116.834459573, 2024-05-08T18:31:41.413 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019751892, 2024-05-08T18:31:41.413 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:41.413 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:41.413 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "reached pg", 2024-05-08T18:31:41.413 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:41.413 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4479", 2024-05-08T18:31:41.413 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3577501689", 2024-05-08T18:31:41.413 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 2 2024-05-08T18:31:41.413 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.413 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:41.413 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.413 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:41.414 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576320+0000", 2024-05-08T18:31:41.414 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:41.414 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.414 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.414 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:41.414 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576320+0000", 2024-05-08T18:31:41.414 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:41.414 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.414 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.414 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:41.414 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576323+0000", 2024-05-08T18:31:41.414 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.813e-06 2024-05-08T18:31:41.415 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.415 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.415 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:41.415 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576335+0000", 2024-05-08T18:31:41.415 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2330000000000001e-05 2024-05-08T18:31:41.415 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.415 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.415 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:41.415 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576367+0000", 2024-05-08T18:31:41.415 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2036999999999998e-05 2024-05-08T18:31:41.415 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.415 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.415 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:41.415 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576394+0000", 2024-05-08T18:31:41.416 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6529e-05 2024-05-08T18:31:41.416 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.416 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.416 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:41.416 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576550+0000", 2024-05-08T18:31:41.416 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000156718 2024-05-08T18:31:41.416 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.416 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.416 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-05-08T18:31:41.416 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576560+0000", 2024-05-08T18:31:41.416 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0040999999999999e-05 2024-05-08T18:31:41.417 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.417 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.417 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:41.417 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.587240+0000", 2024-05-08T18:31:41.417 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010679266999999999 2024-05-08T18:31:41.417 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.417 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.417 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2024-05-08T18:31:41.417 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.587266+0000", 2024-05-08T18:31:41.417 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6642e-05 2024-05-08T18:31:41.417 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.418 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.418 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:41.418 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.595882+0000", 2024-05-08T18:31:41.418 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0086159600000000006 2024-05-08T18:31:41.418 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.418 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.418 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:41.418 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.596072+0000", 2024-05-08T18:31:41.418 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000189555 2024-05-08T18:31:41.418 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:41.418 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:41.418 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:41.419 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.419 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.419 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:31:41.419 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:48.766182+0000", 2024-05-08T18:31:41.419 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 112.644597546, 2024-05-08T18:31:41.419 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031881209999999999, 2024-05-08T18:31:41.419 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:41.419 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:41.419 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:41.420 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:41.420 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:41.420 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:41.420 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 193 2024-05-08T18:31:41.421 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.421 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:41.421 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.421 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:41.421 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766182+0000", 2024-05-08T18:31:41.421 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:41.422 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.422 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.422 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:41.422 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766182+0000", 2024-05-08T18:31:41.422 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:41.422 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.422 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.422 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:41.422 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766184+0000", 2024-05-08T18:31:41.422 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4159999999999998e-06 2024-05-08T18:31:41.422 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.423 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.423 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:41.423 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766196+0000", 2024-05-08T18:31:41.423 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1814000000000001e-05 2024-05-08T18:31:41.423 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.423 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.423 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:41.423 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766227+0000", 2024-05-08T18:31:41.423 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0676000000000002e-05 2024-05-08T18:31:41.423 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.426 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.426 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:41.426 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766242+0000", 2024-05-08T18:31:41.426 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5497000000000001e-05 2024-05-08T18:31:41.426 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.426 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.427 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:41.427 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766354+0000", 2024-05-08T18:31:41.427 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000111579 2024-05-08T18:31:41.427 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.427 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.427 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:41.427 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766569+0000", 2024-05-08T18:31:41.427 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000214978 2024-05-08T18:31:41.427 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.427 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.427 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:41.427 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.766834+0000", 2024-05-08T18:31:41.427 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00026551500000000002 2024-05-08T18:31:41.427 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.427 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.428 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:41.428 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.768577+0000", 2024-05-08T18:31:41.428 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001742513 2024-05-08T18:31:41.428 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.428 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.428 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:41.428 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.769150+0000", 2024-05-08T18:31:41.428 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00057320500000000003 2024-05-08T18:31:41.428 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.428 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.428 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:41.428 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.769250+0000", 2024-05-08T18:31:41.428 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.9846000000000006e-05 2024-05-08T18:31:41.428 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.429 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.429 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:41.429 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.769370+0000", 2024-05-08T18:31:41.429 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012008200000000001 2024-05-08T18:31:41.429 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:41.429 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:41.429 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:41.429 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.429 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.429 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:41.429 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.679562+0000", 2024-05-08T18:31:41.429 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 109.73121784200001, 2024-05-08T18:31:41.429 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0086320800000000003, 2024-05-08T18:31:41.429 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:41.429 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:41.430 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:41.430 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:41.430 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:41.431 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:41.431 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 208 2024-05-08T18:31:41.431 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.431 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:41.431 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.431 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:41.431 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679562+0000", 2024-05-08T18:31:41.431 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:41.431 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.431 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.432 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:41.432 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679562+0000", 2024-05-08T18:31:41.432 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:41.432 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.432 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.432 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:41.432 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679565+0000", 2024-05-08T18:31:41.432 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0800000000000002e-06 2024-05-08T18:31:41.432 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.432 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.433 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:41.433 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679578+0000", 2024-05-08T18:31:41.433 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3217000000000001e-05 2024-05-08T18:31:41.433 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.433 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.433 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:41.433 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679610+0000", 2024-05-08T18:31:41.433 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1696000000000003e-05 2024-05-08T18:31:41.433 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.433 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.433 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:41.433 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679625+0000", 2024-05-08T18:31:41.433 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5824e-05 2024-05-08T18:31:41.433 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.434 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.434 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:41.434 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679758+0000", 2024-05-08T18:31:41.434 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013231199999999999 2024-05-08T18:31:41.434 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.434 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.434 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-05-08T18:31:41.434 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.679770+0000", 2024-05-08T18:31:41.434 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1800000000000001e-05 2024-05-08T18:31:41.434 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.434 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.434 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:41.434 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.685241+0000", 2024-05-08T18:31:41.435 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0054710169999999999 2024-05-08T18:31:41.435 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.435 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.435 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:41.435 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.685444+0000", 2024-05-08T18:31:41.435 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000203835 2024-05-08T18:31:41.435 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.435 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.435 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:41.435 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.685842+0000", 2024-05-08T18:31:41.435 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00039773 2024-05-08T18:31:41.435 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.435 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.435 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:41.436 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.687232+0000", 2024-05-08T18:31:41.436 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00139011 2024-05-08T18:31:41.436 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.436 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.436 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:41.436 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.688049+0000", 2024-05-08T18:31:41.436 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00081667000000000003 2024-05-08T18:31:41.436 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.436 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.436 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:41.436 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.688135+0000", 2024-05-08T18:31:41.436 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6299999999999997e-05 2024-05-08T18:31:41.437 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.437 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.437 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:41.437 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.688194+0000", 2024-05-08T18:31:41.437 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8489000000000002e-05 2024-05-08T18:31:41.437 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:41.437 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:41.437 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:41.437 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.437 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.438 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:41.438 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.707114+0000", 2024-05-08T18:31:41.438 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 109.703665828, 2024-05-08T18:31:41.438 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031802990000000001, 2024-05-08T18:31:41.438 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:41.438 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:41.438 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:41.438 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:41.438 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:41.438 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:41.438 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 212 2024-05-08T18:31:41.438 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.438 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:41.439 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.439 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:41.439 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707114+0000", 2024-05-08T18:31:41.439 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:41.439 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.439 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.439 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:41.439 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707114+0000", 2024-05-08T18:31:41.439 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:41.439 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.439 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.439 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:41.439 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707117+0000", 2024-05-08T18:31:41.439 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8629999999999999e-06 2024-05-08T18:31:41.440 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.440 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.440 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:41.440 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707129+0000", 2024-05-08T18:31:41.440 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2150000000000001e-05 2024-05-08T18:31:41.440 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.440 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.440 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:41.440 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707158+0000", 2024-05-08T18:31:41.440 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9513999999999999e-05 2024-05-08T18:31:41.440 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.440 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.440 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:41.441 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707173+0000", 2024-05-08T18:31:41.441 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5136e-05 2024-05-08T18:31:41.441 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.441 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.441 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:41.441 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707309+0000", 2024-05-08T18:31:41.441 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000135609 2024-05-08T18:31:41.442 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.442 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.442 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:41.442 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707523+0000", 2024-05-08T18:31:41.442 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021362200000000001 2024-05-08T18:31:41.442 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.442 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.442 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:41.442 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.707918+0000", 2024-05-08T18:31:41.443 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00039556299999999998 2024-05-08T18:31:41.443 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.443 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.443 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:41.443 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.709166+0000", 2024-05-08T18:31:41.443 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012476410000000001 2024-05-08T18:31:41.443 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.443 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.443 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:41.443 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.710145+0000", 2024-05-08T18:31:41.443 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00097909899999999998 2024-05-08T18:31:41.444 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.444 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.444 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:41.444 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.710231+0000", 2024-05-08T18:31:41.444 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5625999999999996e-05 2024-05-08T18:31:41.444 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.444 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.444 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:41.444 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.710294+0000", 2024-05-08T18:31:41.444 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3476e-05 2024-05-08T18:31:41.444 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:41.444 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:41.444 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:41.444 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.444 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.445 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:41.445 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.731985+0000", 2024-05-08T18:31:41.445 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 109.678794603, 2024-05-08T18:31:41.445 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0039250600000000002, 2024-05-08T18:31:41.445 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:41.445 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:41.445 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:41.445 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:41.445 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:41.445 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:41.445 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 219 2024-05-08T18:31:41.445 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.445 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:41.445 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.446 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:41.446 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731985+0000", 2024-05-08T18:31:41.446 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:41.446 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.446 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.446 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:41.446 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731985+0000", 2024-05-08T18:31:41.446 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:41.446 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.446 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.446 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:41.446 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.731988+0000", 2024-05-08T18:31:41.446 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6599999999999999e-06 2024-05-08T18:31:41.446 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.447 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.447 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:41.447 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.732017+0000", 2024-05-08T18:31:41.447 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9692999999999998e-05 2024-05-08T18:31:41.447 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.447 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.447 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:41.447 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.732048+0000", 2024-05-08T18:31:41.447 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1066999999999999e-05 2024-05-08T18:31:41.447 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.447 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.447 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:41.447 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.732064+0000", 2024-05-08T18:31:41.447 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5786000000000001e-05 2024-05-08T18:31:41.447 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.448 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.448 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:41.448 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.732213+0000", 2024-05-08T18:31:41.448 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014895899999999999 2024-05-08T18:31:41.448 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.448 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.448 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:41.448 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.732572+0000", 2024-05-08T18:31:41.448 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000358904 2024-05-08T18:31:41.449 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.449 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.449 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:41.449 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.733349+0000", 2024-05-08T18:31:41.449 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00077657699999999997 2024-05-08T18:31:41.449 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.449 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.449 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:41.449 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.734899+0000", 2024-05-08T18:31:41.450 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001550652 2024-05-08T18:31:41.450 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.450 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.450 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:41.450 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.735641+0000", 2024-05-08T18:31:41.450 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00074222000000000003 2024-05-08T18:31:41.450 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.450 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.450 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:41.451 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.735801+0000", 2024-05-08T18:31:41.451 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015913599999999999 2024-05-08T18:31:41.451 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.451 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.452 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:41.452 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.735910+0000", 2024-05-08T18:31:41.452 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000109406 2024-05-08T18:31:41.452 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:41.452 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:41.452 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:41.452 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.452 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.452 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:41.452 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.750251+0000", 2024-05-08T18:31:41.453 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 109.66052867099999, 2024-05-08T18:31:41.453 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0038408600000000002, 2024-05-08T18:31:41.453 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:41.453 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:41.453 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:41.453 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:41.453 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:41.453 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:41.453 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 224 2024-05-08T18:31:41.453 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.454 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:41.454 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.454 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:41.454 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750251+0000", 2024-05-08T18:31:41.454 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:41.454 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.454 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.454 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:41.454 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750251+0000", 2024-05-08T18:31:41.454 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:41.454 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.454 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.454 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:41.455 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750253+0000", 2024-05-08T18:31:41.455 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2129999999999998e-06 2024-05-08T18:31:41.455 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.455 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.455 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:41.455 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750265+0000", 2024-05-08T18:31:41.455 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1484000000000001e-05 2024-05-08T18:31:41.455 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.455 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.455 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:41.455 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750293+0000", 2024-05-08T18:31:41.455 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8673000000000001e-05 2024-05-08T18:31:41.455 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.455 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.456 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:41.456 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750308+0000", 2024-05-08T18:31:41.456 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4620000000000001e-05 2024-05-08T18:31:41.456 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.456 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.456 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:41.456 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750459+0000", 2024-05-08T18:31:41.456 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000151619 2024-05-08T18:31:41.456 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.456 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.456 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:41.456 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.750822+0000", 2024-05-08T18:31:41.456 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000362467 2024-05-08T18:31:41.456 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.457 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.457 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:41.457 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.751591+0000", 2024-05-08T18:31:41.457 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00076934699999999998 2024-05-08T18:31:41.457 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.457 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.457 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:41.457 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.753042+0000", 2024-05-08T18:31:41.457 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001450652 2024-05-08T18:31:41.457 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.457 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.457 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:41.457 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.753792+0000", 2024-05-08T18:31:41.457 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00075045500000000002 2024-05-08T18:31:41.458 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.458 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.458 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:41.458 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.753977+0000", 2024-05-08T18:31:41.458 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000184511 2024-05-08T18:31:41.458 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.458 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.458 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:41.458 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.754092+0000", 2024-05-08T18:31:41.458 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000114819 2024-05-08T18:31:41.459 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:41.459 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:41.459 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:41.459 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.459 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.459 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:751 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:41.459 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.125611+0000", 2024-05-08T18:31:41.459 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 109.285168091, 2024-05-08T18:31:41.459 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032716749999999999, 2024-05-08T18:31:41.459 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:41.459 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:41.459 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:41.459 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:41.459 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:41.459 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:41.460 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 751 2024-05-08T18:31:41.460 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.460 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:41.460 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.460 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:41.460 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125611+0000", 2024-05-08T18:31:41.460 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:41.460 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.460 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.460 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:41.460 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125611+0000", 2024-05-08T18:31:41.460 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:41.460 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.460 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.461 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:41.461 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125614+0000", 2024-05-08T18:31:41.461 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.12e-06 2024-05-08T18:31:41.461 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.461 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.461 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:41.461 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125624+0000", 2024-05-08T18:31:41.461 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0492999999999999e-05 2024-05-08T18:31:41.461 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.461 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.461 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:41.461 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125650+0000", 2024-05-08T18:31:41.461 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5907000000000001e-05 2024-05-08T18:31:41.461 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.462 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.462 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:41.462 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125667+0000", 2024-05-08T18:31:41.462 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.694e-05 2024-05-08T18:31:41.462 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.462 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.462 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:41.463 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.125801+0000", 2024-05-08T18:31:41.463 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000134482 2024-05-08T18:31:41.463 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.463 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.463 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:41.463 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.126174+0000", 2024-05-08T18:31:41.463 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00037294999999999999 2024-05-08T18:31:41.463 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.463 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.463 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:41.463 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.126750+0000", 2024-05-08T18:31:41.463 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00057538900000000004 2024-05-08T18:31:41.464 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.464 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.464 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:41.464 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.127997+0000", 2024-05-08T18:31:41.464 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001247761 2024-05-08T18:31:41.464 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.464 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.464 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:41.464 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.128731+0000", 2024-05-08T18:31:41.464 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00073338099999999996 2024-05-08T18:31:41.464 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.464 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.464 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:41.465 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.128817+0000", 2024-05-08T18:31:41.465 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5993000000000002e-05 2024-05-08T18:31:41.465 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.465 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.465 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:41.465 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.128883+0000", 2024-05-08T18:31:41.465 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6259000000000004e-05 2024-05-08T18:31:41.465 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:41.465 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:41.465 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:41.465 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.465 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.465 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:753 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:41.466 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.129809+0000", 2024-05-08T18:31:41.466 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 109.280970553, 2024-05-08T18:31:41.466 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0033775440000000001, 2024-05-08T18:31:41.466 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:41.466 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:41.466 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:41.466 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:41.466 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:41.466 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:41.466 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 753 2024-05-08T18:31:41.467 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.467 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:41.467 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.467 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:41.467 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129809+0000", 2024-05-08T18:31:41.467 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:41.467 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.467 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.467 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:41.467 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129809+0000", 2024-05-08T18:31:41.468 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:41.468 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.468 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.468 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:41.468 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129811+0000", 2024-05-08T18:31:41.468 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1730000000000002e-06 2024-05-08T18:31:41.468 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.468 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.469 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:41.469 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129822+0000", 2024-05-08T18:31:41.469 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0583e-05 2024-05-08T18:31:41.469 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.469 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.469 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:41.470 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129852+0000", 2024-05-08T18:31:41.470 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0744000000000002e-05 2024-05-08T18:31:41.470 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.470 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.470 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:41.470 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.129870+0000", 2024-05-08T18:31:41.470 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7955999999999999e-05 2024-05-08T18:31:41.470 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.471 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.471 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:41.471 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.130018+0000", 2024-05-08T18:31:41.471 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014747600000000001 2024-05-08T18:31:41.471 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.471 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.471 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:41.471 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.130259+0000", 2024-05-08T18:31:41.471 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024079099999999999 2024-05-08T18:31:41.471 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.471 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.471 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:41.471 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.130734+0000", 2024-05-08T18:31:41.472 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00047562 2024-05-08T18:31:41.472 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.472 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.472 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:41.472 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.131997+0000", 2024-05-08T18:31:41.472 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012626429999999999 2024-05-08T18:31:41.472 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.472 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.472 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:41.472 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.132923+0000", 2024-05-08T18:31:41.472 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00092627599999999997 2024-05-08T18:31:41.472 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.472 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.472 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:41.473 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.133076+0000", 2024-05-08T18:31:41.473 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000152989 2024-05-08T18:31:41.473 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.473 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.473 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:41.473 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.133187+0000", 2024-05-08T18:31:41.473 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000110293 2024-05-08T18:31:41.473 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:41.473 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:41.473 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:41.474 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.474 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.474 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:41.474 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.228247+0000", 2024-05-08T18:31:41.474 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 109.182532943, 2024-05-08T18:31:41.474 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032753449999999998, 2024-05-08T18:31:41.474 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:41.474 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:41.474 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:41.474 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:41.474 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:41.474 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:41.474 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 796 2024-05-08T18:31:41.475 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.475 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:41.475 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.475 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:41.475 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228247+0000", 2024-05-08T18:31:41.475 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:41.475 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.475 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.475 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:41.475 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228247+0000", 2024-05-08T18:31:41.475 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:41.475 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.475 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.475 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:41.476 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228249+0000", 2024-05-08T18:31:41.476 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3800000000000001e-06 2024-05-08T18:31:41.476 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.476 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.476 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:41.476 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228260+0000", 2024-05-08T18:31:41.476 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1496e-05 2024-05-08T18:31:41.476 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.476 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.476 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:41.476 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228292+0000", 2024-05-08T18:31:41.476 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1294000000000002e-05 2024-05-08T18:31:41.476 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.476 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.476 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:41.477 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228306+0000", 2024-05-08T18:31:41.477 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4606e-05 2024-05-08T18:31:41.477 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.477 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.477 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:41.477 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228443+0000", 2024-05-08T18:31:41.477 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013672599999999999 2024-05-08T18:31:41.477 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.477 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.477 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:41.477 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.228813+0000", 2024-05-08T18:31:41.477 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00036987000000000001 2024-05-08T18:31:41.477 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.477 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.478 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:31:41.478 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.229365+0000", 2024-05-08T18:31:41.478 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00055210600000000002 2024-05-08T18:31:41.478 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.478 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.478 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:41.478 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.230800+0000", 2024-05-08T18:31:41.478 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001435006 2024-05-08T18:31:41.478 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.478 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.478 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:41.478 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.231369+0000", 2024-05-08T18:31:41.478 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00056848499999999998 2024-05-08T18:31:41.478 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.479 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.479 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:41.479 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.231455+0000", 2024-05-08T18:31:41.479 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6905999999999998e-05 2024-05-08T18:31:41.479 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.479 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.479 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:41.479 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.231522+0000", 2024-05-08T18:31:41.479 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6470000000000006e-05 2024-05-08T18:31:41.480 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:41.480 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:41.480 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:41.480 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.480 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.480 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:834 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:41.480 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.317499+0000", 2024-05-08T18:31:41.480 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 109.093280556, 2024-05-08T18:31:41.480 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0033281109999999999, 2024-05-08T18:31:41.480 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:41.480 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:41.480 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:41.480 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:41.480 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:41.481 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:41.481 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 834 2024-05-08T18:31:41.481 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.481 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:41.481 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.481 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:41.481 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317499+0000", 2024-05-08T18:31:41.481 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:41.481 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.481 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.481 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:41.481 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317499+0000", 2024-05-08T18:31:41.481 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:41.482 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.482 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.482 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:41.482 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317501+0000", 2024-05-08T18:31:41.482 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9400000000000001e-06 2024-05-08T18:31:41.482 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.482 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.482 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:41.482 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317511+0000", 2024-05-08T18:31:41.482 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0297e-05 2024-05-08T18:31:41.482 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.482 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.482 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:41.483 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317532+0000", 2024-05-08T18:31:41.483 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1013e-05 2024-05-08T18:31:41.483 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.483 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.483 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:41.483 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317543+0000", 2024-05-08T18:31:41.483 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0757000000000001e-05 2024-05-08T18:31:41.483 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.483 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.483 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:41.483 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317658+0000", 2024-05-08T18:31:41.483 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115129 2024-05-08T18:31:41.484 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.484 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.484 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:41.484 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.317887+0000", 2024-05-08T18:31:41.484 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00022880099999999999 2024-05-08T18:31:41.484 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.484 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.484 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:31:41.484 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.318378+0000", 2024-05-08T18:31:41.484 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00049129000000000002 2024-05-08T18:31:41.484 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.484 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.484 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:41.485 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.319597+0000", 2024-05-08T18:31:41.485 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012188469999999999 2024-05-08T18:31:41.485 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.485 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.485 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:41.485 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.320566+0000", 2024-05-08T18:31:41.485 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00096881599999999995 2024-05-08T18:31:41.485 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.485 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.485 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:41.485 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.320713+0000", 2024-05-08T18:31:41.485 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014691500000000001 2024-05-08T18:31:41.485 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.485 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.486 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:41.486 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.320827+0000", 2024-05-08T18:31:41.486 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000114306 2024-05-08T18:31:41.486 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:41.486 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:41.486 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:41.486 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.486 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.486 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1186 4.12 4:488b0b39:::.dir.3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.1.8:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-05-08T18:31:41.486 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:37.015800+0000", 2024-05-08T18:31:41.486 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4.3949799389999997, 2024-05-08T18:31:41.486 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0041451500000000002, 2024-05-08T18:31:41.486 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:41.487 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:41.487 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:41.487 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:41.487 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:41.487 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:41.487 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1186 2024-05-08T18:31:41.487 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.487 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:41.487 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.487 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:41.487 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.015800+0000", 2024-05-08T18:31:41.487 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:41.487 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.487 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.488 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:41.488 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.015800+0000", 2024-05-08T18:31:41.488 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:41.488 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.488 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.488 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:41.488 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.015800+0000", 2024-05-08T18:31:41.488 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8800000000000002e-07 2024-05-08T18:31:41.488 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.488 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.488 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:41.488 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.015804+0000", 2024-05-08T18:31:41.488 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9319999999999998e-06 2024-05-08T18:31:41.488 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.489 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.489 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:41.489 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.015812+0000", 2024-05-08T18:31:41.489 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7209999999999994e-06 2024-05-08T18:31:41.489 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.489 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.489 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:41.489 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.015818+0000", 2024-05-08T18:31:41.489 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7790000000000001e-06 2024-05-08T18:31:41.489 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.489 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.489 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:41.489 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.015880+0000", 2024-05-08T18:31:41.490 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1896000000000005e-05 2024-05-08T18:31:41.490 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.490 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.490 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:41.490 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.016004+0000", 2024-05-08T18:31:41.490 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012434100000000001 2024-05-08T18:31:41.490 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.490 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.490 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:31:41.491 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.016154+0000", 2024-05-08T18:31:41.491 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014992799999999999 2024-05-08T18:31:41.491 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.491 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.491 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:41.491 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.017131+0000", 2024-05-08T18:31:41.491 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00097709800000000003 2024-05-08T18:31:41.491 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.491 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.491 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:41.491 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.019857+0000", 2024-05-08T18:31:41.491 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0027260230000000002 2024-05-08T18:31:41.491 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.491 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.492 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:41.492 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.019907+0000", 2024-05-08T18:31:41.492 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9524999999999998e-05 2024-05-08T18:31:41.492 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.492 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.492 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:41.492 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.019945+0000", 2024-05-08T18:31:41.492 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8219000000000001e-05 2024-05-08T18:31:41.492 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:41.492 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:41.492 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:41.492 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.492 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.492 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1181 4.21 e80/23 4:85baa8d2:::.dir.3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.1.3:head v 80'1, mlcod=0'0)", 2024-05-08T18:31:41.493 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:37.016330+0000", 2024-05-08T18:31:41.493 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4.3944493419999997, 2024-05-08T18:31:41.493 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003592451, 2024-05-08T18:31:41.493 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:41.493 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:41.493 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:41.493 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:41.493 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.493 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:41.493 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.016330+0000", 2024-05-08T18:31:41.493 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:41.493 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.493 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.493 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:41.493 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.016330+0000", 2024-05-08T18:31:41.494 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:41.494 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.494 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.494 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:41.494 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.016330+0000", 2024-05-08T18:31:41.494 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.96e-07 2024-05-08T18:31:41.494 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.495 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.495 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:41.495 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.016336+0000", 2024-05-08T18:31:41.495 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6420000000000004e-06 2024-05-08T18:31:41.495 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.495 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.495 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:41.495 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.016346+0000", 2024-05-08T18:31:41.495 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.4320000000000005e-06 2024-05-08T18:31:41.495 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.496 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.496 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:41.496 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.016354+0000", 2024-05-08T18:31:41.496 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9509999999999995e-06 2024-05-08T18:31:41.496 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.496 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.496 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:41.496 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.016434+0000", 2024-05-08T18:31:41.496 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.9892e-05 2024-05-08T18:31:41.496 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.496 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.496 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:41.497 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.016453+0000", 2024-05-08T18:31:41.497 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8151e-05 2024-05-08T18:31:41.497 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.497 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.497 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:41.497 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.019888+0000", 2024-05-08T18:31:41.497 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0034350000000000001 2024-05-08T18:31:41.497 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.497 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.497 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:41.497 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.019923+0000", 2024-05-08T18:31:41.497 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5086999999999998e-05 2024-05-08T18:31:41.497 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:41.497 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:41.498 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:41.498 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.498 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.498 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.5328.0:146 4.12 4:488b0b39:::.dir.3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.1.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-05-08T18:31:41.498 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:37.589218+0000", 2024-05-08T18:31:41.498 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 3.8215612430000001, 2024-05-08T18:31:41.498 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0041244039999999999, 2024-05-08T18:31:41.498 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:41.498 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:41.498 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:41.498 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:41.499 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.5328", 2024-05-08T18:31:41.499 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/400329163", 2024-05-08T18:31:41.499 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 146 2024-05-08T18:31:41.499 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.499 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:41.499 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.499 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:41.499 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.589218+0000", 2024-05-08T18:31:41.499 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:41.499 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.499 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.499 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:41.499 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.589218+0000", 2024-05-08T18:31:41.499 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:41.500 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.500 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.500 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:41.500 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.589219+0000", 2024-05-08T18:31:41.500 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5000000000000003e-07 2024-05-08T18:31:41.501 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.501 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.501 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:41.501 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.589222+0000", 2024-05-08T18:31:41.501 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.675e-06 2024-05-08T18:31:41.501 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.501 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.501 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:41.501 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.589230+0000", 2024-05-08T18:31:41.501 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.8180000000000004e-06 2024-05-08T18:31:41.501 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.501 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.501 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:41.502 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.589236+0000", 2024-05-08T18:31:41.502 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7300000000000002e-06 2024-05-08T18:31:41.502 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.502 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.502 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:41.502 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.589292+0000", 2024-05-08T18:31:41.502 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5689000000000002e-05 2024-05-08T18:31:41.502 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.502 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.502 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:41.502 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.589376+0000", 2024-05-08T18:31:41.502 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.4467000000000003e-05 2024-05-08T18:31:41.503 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.503 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.503 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:31:41.503 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.589482+0000", 2024-05-08T18:31:41.503 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000106037 2024-05-08T18:31:41.503 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.503 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.503 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:41.503 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.590212+0000", 2024-05-08T18:31:41.503 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00073004400000000001 2024-05-08T18:31:41.503 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.503 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.503 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:41.503 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.593291+0000", 2024-05-08T18:31:41.504 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0030783450000000001 2024-05-08T18:31:41.504 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.504 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.504 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:41.504 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.593320+0000", 2024-05-08T18:31:41.504 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9805e-05 2024-05-08T18:31:41.504 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.504 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.504 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:41.504 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.593343+0000", 2024-05-08T18:31:41.504 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2243999999999999e-05 2024-05-08T18:31:41.505 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:41.505 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:41.505 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:41.505 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.505 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.505 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1211 4.f 4:f16cc448:::.dir.3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.2.0:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-05-08T18:31:41.505 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:37.799870+0000", 2024-05-08T18:31:41.505 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 3.610909242, 2024-05-08T18:31:41.505 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0042447199999999996, 2024-05-08T18:31:41.506 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:41.506 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:41.506 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:41.506 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:41.506 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:41.506 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:41.506 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1211 2024-05-08T18:31:41.506 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.506 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:41.506 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.506 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:41.506 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.799870+0000", 2024-05-08T18:31:41.506 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:41.506 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.507 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.507 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:41.507 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.799870+0000", 2024-05-08T18:31:41.507 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:41.507 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.507 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.507 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:41.507 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.799873+0000", 2024-05-08T18:31:41.507 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4590000000000001e-06 2024-05-08T18:31:41.507 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.507 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.507 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:41.507 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.799881+0000", 2024-05-08T18:31:41.508 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6689999999999995e-06 2024-05-08T18:31:41.508 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.508 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.508 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:41.508 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.799900+0000", 2024-05-08T18:31:41.508 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8598999999999999e-05 2024-05-08T18:31:41.508 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.508 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.508 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:41.508 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.799910+0000", 2024-05-08T18:31:41.508 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.7669999999999998e-06 2024-05-08T18:31:41.508 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.508 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.508 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:41.509 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.799977+0000", 2024-05-08T18:31:41.509 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7525000000000001e-05 2024-05-08T18:31:41.509 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.509 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.509 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:41.509 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.800100+0000", 2024-05-08T18:31:41.509 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012299300000000001 2024-05-08T18:31:41.509 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.509 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.509 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:41.509 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.800251+0000", 2024-05-08T18:31:41.509 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015037399999999999 2024-05-08T18:31:41.509 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.509 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.510 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:41.510 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.801077+0000", 2024-05-08T18:31:41.510 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00082585999999999998 2024-05-08T18:31:41.510 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.510 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.510 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:41.510 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.804023+0000", 2024-05-08T18:31:41.510 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0029464959999999998 2024-05-08T18:31:41.510 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.510 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.510 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:41.511 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.804074+0000", 2024-05-08T18:31:41.511 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.0704000000000001e-05 2024-05-08T18:31:41.511 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.511 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.511 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:41.511 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.804115+0000", 2024-05-08T18:31:41.512 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.1273999999999998e-05 2024-05-08T18:31:41.512 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:41.512 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:41.512 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:41.512 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.512 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.513 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1221 4.12 4:4b7fd427:::.dir.3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.2.10:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-05-08T18:31:41.513 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:37.800039+0000", 2024-05-08T18:31:41.513 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 3.610740083, 2024-05-08T18:31:41.513 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0052063650000000001, 2024-05-08T18:31:41.513 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:41.513 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:41.514 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:41.514 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:41.514 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:41.514 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:41.514 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1221 2024-05-08T18:31:41.514 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.514 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:41.514 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.514 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:41.514 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.800039+0000", 2024-05-08T18:31:41.514 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:41.515 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.515 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.515 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:41.515 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.800039+0000", 2024-05-08T18:31:41.515 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:41.515 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.515 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.515 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:41.515 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.800040+0000", 2024-05-08T18:31:41.515 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.9899999999999999e-07 2024-05-08T18:31:41.516 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.516 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.516 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:41.516 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.800045+0000", 2024-05-08T18:31:41.516 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.724e-06 2024-05-08T18:31:41.516 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.516 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.516 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:41.516 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.800054+0000", 2024-05-08T18:31:41.516 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.2979999999999997e-06 2024-05-08T18:31:41.516 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.516 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.516 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:41.516 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.800060+0000", 2024-05-08T18:31:41.517 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0959999999999997e-06 2024-05-08T18:31:41.517 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.517 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.517 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:41.517 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.800118+0000", 2024-05-08T18:31:41.517 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7351e-05 2024-05-08T18:31:41.517 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.517 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.517 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:41.517 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.800237+0000", 2024-05-08T18:31:41.517 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011909900000000001 2024-05-08T18:31:41.517 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.517 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.517 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:31:41.518 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.800415+0000", 2024-05-08T18:31:41.518 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00017809499999999999 2024-05-08T18:31:41.518 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.518 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.518 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:41.518 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.803761+0000", 2024-05-08T18:31:41.518 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0033460579999999998 2024-05-08T18:31:41.518 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.518 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.518 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:41.518 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.805191+0000", 2024-05-08T18:31:41.518 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001429802 2024-05-08T18:31:41.518 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.519 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.519 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:41.519 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.805221+0000", 2024-05-08T18:31:41.519 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0357000000000001e-05 2024-05-08T18:31:41.519 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.519 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.519 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:41.519 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.805246+0000", 2024-05-08T18:31:41.519 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4686e-05 2024-05-08T18:31:41.519 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:41.519 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:41.519 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:41.519 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.519 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.520 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1213 4.14 e80/23 4:28b5ed3e:::.dir.3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.2.2:head v 80'1, mlcod=0'0)", 2024-05-08T18:31:41.520 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:37.800632+0000", 2024-05-08T18:31:41.520 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 3.6101472389999998, 2024-05-08T18:31:41.520 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031740520000000001, 2024-05-08T18:31:41.520 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:41.520 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:41.520 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:41.520 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:41.520 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.520 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:41.521 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.800632+0000", 2024-05-08T18:31:41.521 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:41.521 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.521 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.521 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:41.521 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.800632+0000", 2024-05-08T18:31:41.521 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:41.521 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.521 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.521 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:41.522 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.800633+0000", 2024-05-08T18:31:41.522 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1599999999999999e-06 2024-05-08T18:31:41.522 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.522 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.522 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:41.522 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.800640+0000", 2024-05-08T18:31:41.522 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.4869999999999999e-06 2024-05-08T18:31:41.522 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.522 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.522 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:41.522 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.800652+0000", 2024-05-08T18:31:41.522 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1853e-05 2024-05-08T18:31:41.523 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.523 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.523 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:41.523 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.800659+0000", 2024-05-08T18:31:41.523 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.4839999999999998e-06 2024-05-08T18:31:41.523 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.523 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.523 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:41.523 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.800710+0000", 2024-05-08T18:31:41.523 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.0840000000000001e-05 2024-05-08T18:31:41.523 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.523 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.523 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:41.523 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.800728+0000", 2024-05-08T18:31:41.524 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7601e-05 2024-05-08T18:31:41.524 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.524 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.524 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:41.524 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.803769+0000", 2024-05-08T18:31:41.524 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0030411290000000001 2024-05-08T18:31:41.524 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.524 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.524 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:41.524 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.803806+0000", 2024-05-08T18:31:41.524 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7497999999999999e-05 2024-05-08T18:31:41.524 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:41.524 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:41.524 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:41.524 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.525 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.525 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1215 4.3e e80/23 4:7eea06a8:::.dir.3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.2.4:head v 80'1, mlcod=0'0)", 2024-05-08T18:31:41.525 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:37.801753+0000", 2024-05-08T18:31:41.525 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 3.6090270049999997, 2024-05-08T18:31:41.525 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0045987190000000002, 2024-05-08T18:31:41.525 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:41.525 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:41.525 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:41.525 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:41.525 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.525 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:41.526 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.801753+0000", 2024-05-08T18:31:41.526 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:41.526 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.526 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.526 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:41.526 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.801753+0000", 2024-05-08T18:31:41.526 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:41.526 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.526 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.526 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:41.526 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.801753+0000", 2024-05-08T18:31:41.526 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1999999999999999e-07 2024-05-08T18:31:41.527 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.527 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.527 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:41.527 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.801762+0000", 2024-05-08T18:31:41.527 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.4300000000000006e-06 2024-05-08T18:31:41.527 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.527 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.527 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:41.527 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.801775+0000", 2024-05-08T18:31:41.527 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3253e-05 2024-05-08T18:31:41.527 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.527 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.527 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:41.527 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.801782+0000", 2024-05-08T18:31:41.528 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.5599999999999996e-06 2024-05-08T18:31:41.528 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.528 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.528 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:41.528 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.801827+0000", 2024-05-08T18:31:41.528 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4558000000000003e-05 2024-05-08T18:31:41.528 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.528 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.528 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:41.528 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.801838+0000", 2024-05-08T18:31:41.528 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1046999999999999e-05 2024-05-08T18:31:41.528 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.529 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.529 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:41.529 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.806322+0000", 2024-05-08T18:31:41.529 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0044834610000000002 2024-05-08T18:31:41.529 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.529 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.529 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:41.529 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.806351+0000", 2024-05-08T18:31:41.529 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9689999999999999e-05 2024-05-08T18:31:41.529 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:41.529 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:41.529 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:41.529 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.529 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.530 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.5066.0:148 4.12 4:4b7fd427:::.dir.3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.2.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-05-08T18:31:41.530 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:38.486136+0000", 2024-05-08T18:31:41.530 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 2.9246435549999998, 2024-05-08T18:31:41.530 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0043021149999999996, 2024-05-08T18:31:41.530 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:41.530 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:41.530 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:41.530 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:41.530 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.5066", 2024-05-08T18:31:41.530 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/4156398147", 2024-05-08T18:31:41.530 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 148 2024-05-08T18:31:41.530 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.531 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:41.531 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.531 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:41.531 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.486136+0000", 2024-05-08T18:31:41.531 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:41.531 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.531 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.531 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:41.531 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.486136+0000", 2024-05-08T18:31:41.531 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:41.531 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.531 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.531 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:41.531 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.486137+0000", 2024-05-08T18:31:41.531 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.2799999999999996e-07 2024-05-08T18:31:41.532 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.532 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.532 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:41.532 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.486140+0000", 2024-05-08T18:31:41.532 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7249999999999999e-06 2024-05-08T18:31:41.532 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.532 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.532 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:41.532 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.486149+0000", 2024-05-08T18:31:41.532 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.1789999999999997e-06 2024-05-08T18:31:41.532 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.532 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.532 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:41.533 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.486156+0000", 2024-05-08T18:31:41.534 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9999999999999999e-06 2024-05-08T18:31:41.534 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.534 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.534 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:41.534 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.486209+0000", 2024-05-08T18:31:41.534 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.2667999999999998e-05 2024-05-08T18:31:41.534 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.534 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.534 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:41.534 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.486281+0000", 2024-05-08T18:31:41.534 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2144000000000006e-05 2024-05-08T18:31:41.534 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.534 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.534 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:31:41.535 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.486383+0000", 2024-05-08T18:31:41.535 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010153399999999999 2024-05-08T18:31:41.535 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.535 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.535 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:41.535 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.487769+0000", 2024-05-08T18:31:41.535 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0013858550000000001 2024-05-08T18:31:41.535 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.535 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.535 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:41.535 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.490362+0000", 2024-05-08T18:31:41.535 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002593368 2024-05-08T18:31:41.535 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.535 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.536 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:41.536 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.490412+0000", 2024-05-08T18:31:41.536 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.0170000000000002e-05 2024-05-08T18:31:41.536 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.536 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.536 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:41.536 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.490438+0000", 2024-05-08T18:31:41.536 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5843999999999999e-05 2024-05-08T18:31:41.536 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:41.537 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:41.537 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:41.537 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.537 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.537 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1255 4.2 4:42f50dea:::.dir.3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.3.2:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-05-08T18:31:41.537 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:38.677540+0000", 2024-05-08T18:31:41.537 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 2.7332396409999999, 2024-05-08T18:31:41.537 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0084523959999999992, 2024-05-08T18:31:41.537 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:41.537 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:41.537 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:41.537 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:41.537 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:41.538 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:41.538 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1255 2024-05-08T18:31:41.538 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.538 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:41.538 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.538 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:41.538 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.677540+0000", 2024-05-08T18:31:41.538 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:41.538 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.538 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.538 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:41.538 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.677540+0000", 2024-05-08T18:31:41.538 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:41.539 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.539 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.539 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:41.539 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.677543+0000", 2024-05-08T18:31:41.539 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7070000000000001e-06 2024-05-08T18:31:41.539 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.539 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.539 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:41.539 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.677550+0000", 2024-05-08T18:31:41.539 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7549999999999994e-06 2024-05-08T18:31:41.539 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.539 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.539 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:41.539 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.677567+0000", 2024-05-08T18:31:41.540 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7156e-05 2024-05-08T18:31:41.540 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.540 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.540 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:41.540 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.677575+0000", 2024-05-08T18:31:41.540 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.8630000000000008e-06 2024-05-08T18:31:41.540 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.540 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.540 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:41.540 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.677631+0000", 2024-05-08T18:31:41.540 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5244999999999997e-05 2024-05-08T18:31:41.540 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.540 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.540 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:41.541 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.677762+0000", 2024-05-08T18:31:41.541 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000131707 2024-05-08T18:31:41.541 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.541 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.541 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:41.541 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.677935+0000", 2024-05-08T18:31:41.541 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00017296799999999999 2024-05-08T18:31:41.541 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.541 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.541 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:41.541 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.678925+0000", 2024-05-08T18:31:41.541 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00098947700000000011 2024-05-08T18:31:41.541 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.541 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.542 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:41.542 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.685879+0000", 2024-05-08T18:31:41.542 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0069542440000000001 2024-05-08T18:31:41.542 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.542 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.542 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:41.542 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.685949+0000", 2024-05-08T18:31:41.542 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9900999999999994e-05 2024-05-08T18:31:41.542 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.542 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.542 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:41.542 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.685992+0000", 2024-05-08T18:31:41.542 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3373e-05 2024-05-08T18:31:41.543 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:41.543 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:41.543 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:41.543 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.543 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.543 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1257 4.4 4:2199e877:::.dir.3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.3.4:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-05-08T18:31:41.543 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:38.677597+0000", 2024-05-08T18:31:41.543 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 2.7331826939999999, 2024-05-08T18:31:41.543 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0055904850000000001, 2024-05-08T18:31:41.543 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:41.543 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:41.544 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:41.544 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:41.544 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:41.544 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:41.544 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1257 2024-05-08T18:31:41.544 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.544 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:41.544 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.544 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:41.544 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.677597+0000", 2024-05-08T18:31:41.544 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:41.545 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.545 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.545 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:41.545 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.677597+0000", 2024-05-08T18:31:41.545 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:41.545 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.545 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.545 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:41.545 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.677597+0000", 2024-05-08T18:31:41.545 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5499999999999998e-07 2024-05-08T18:31:41.545 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.546 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.546 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:41.546 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.677601+0000", 2024-05-08T18:31:41.546 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8480000000000003e-06 2024-05-08T18:31:41.546 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.546 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.546 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:41.546 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.677608+0000", 2024-05-08T18:31:41.547 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1559999999999998e-06 2024-05-08T18:31:41.547 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.547 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.547 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:41.547 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.677615+0000", 2024-05-08T18:31:41.547 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5869999999999998e-06 2024-05-08T18:31:41.547 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.547 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.547 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:41.547 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.677702+0000", 2024-05-08T18:31:41.547 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6810000000000004e-05 2024-05-08T18:31:41.548 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.548 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.548 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:41.548 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.677795+0000", 2024-05-08T18:31:41.548 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.3636999999999998e-05 2024-05-08T18:31:41.548 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.548 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.548 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:31:41.548 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.677930+0000", 2024-05-08T18:31:41.548 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013449999999999999 2024-05-08T18:31:41.548 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.548 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.548 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:41.549 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.679367+0000", 2024-05-08T18:31:41.549 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001437125 2024-05-08T18:31:41.549 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.549 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.549 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:41.549 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.683125+0000", 2024-05-08T18:31:41.549 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0037583120000000002 2024-05-08T18:31:41.549 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.549 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.549 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:41.549 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.683161+0000", 2024-05-08T18:31:41.549 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5639999999999998e-05 2024-05-08T18:31:41.549 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:41.549 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:41.550 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:41.550 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.683187+0000", 2024-05-08T18:31:41.550 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6415e-05 2024-05-08T18:31:41.550 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:41.550 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:41.550 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:41.550 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:41.550 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:41.550 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:41.551 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-08T18:31:41.552 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:31:41.410+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:31:41.552 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:31:41.546+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:31:41.553 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-08T18:31:41.653 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:31:41.653+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:31:41.708 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:41.708 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:31:41.708 INFO:teuthology.orchestra.run.smithi097.stdout: "num_ops": 0 2024-05-08T18:31:41.708 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:41.722 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-08T18:31:41.754 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:31:41.750+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:31:41.856 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:31:41.850+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:31:41.876 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:41.876 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:31:41.877 INFO:teuthology.orchestra.run.smithi097.stdout: "complaint_time": 30, 2024-05-08T18:31:41.877 INFO:teuthology.orchestra.run.smithi097.stdout: "num_blocked_ops": 0 2024-05-08T18:31:41.877 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:41.890 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-08T18:31:41.957 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:31:41.957+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:31:42.003 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:42.003 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2024-05-08T18:31:42.003 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2024-05-08T18:31:42.003 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-05-08T18:31:42.003 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.003 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4479.0:40 5.b 5:d797044f:::zonegroup_info.ea3b680f-900d-4805-81ec-055811625780:head [create,call version.set in=10b,writefull 0~436] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-05-08T18:31:42.003 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:44.637551+0000", 2024-05-08T18:31:42.003 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 117.36496220799999, 2024-05-08T18:31:42.003 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003054013, 2024-05-08T18:31:42.003 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:42.004 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:42.004 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:42.004 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:42.004 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4479", 2024-05-08T18:31:42.004 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3577501689", 2024-05-08T18:31:42.004 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 40 2024-05-08T18:31:42.004 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.004 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:42.004 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.004 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:42.004 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.637551+0000", 2024-05-08T18:31:42.004 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:42.004 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.005 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.005 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:42.005 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.637551+0000", 2024-05-08T18:31:42.005 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:42.005 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.005 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.005 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:42.005 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.637554+0000", 2024-05-08T18:31:42.005 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6599999999999999e-06 2024-05-08T18:31:42.005 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.005 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.005 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:42.005 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.637576+0000", 2024-05-08T18:31:42.005 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1965999999999999e-05 2024-05-08T18:31:42.006 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.006 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.006 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:42.006 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.637603+0000", 2024-05-08T18:31:42.006 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7257e-05 2024-05-08T18:31:42.006 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.006 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.006 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:42.006 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.637623+0000", 2024-05-08T18:31:42.006 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9570000000000001e-05 2024-05-08T18:31:42.006 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.006 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.006 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:42.007 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.637766+0000", 2024-05-08T18:31:42.007 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000143435 2024-05-08T18:31:42.007 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.007 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.007 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:42.007 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.638167+0000", 2024-05-08T18:31:42.007 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00040082399999999998 2024-05-08T18:31:42.007 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.007 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.007 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:42.007 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.638627+0000", 2024-05-08T18:31:42.007 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00046019300000000002 2024-05-08T18:31:42.007 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.008 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.008 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:42.008 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.640399+0000", 2024-05-08T18:31:42.008 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0017714199999999999 2024-05-08T18:31:42.008 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.008 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.008 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:42.008 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.640447+0000", 2024-05-08T18:31:42.008 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8383000000000001e-05 2024-05-08T18:31:42.008 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.008 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.008 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:42.008 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.640534+0000", 2024-05-08T18:31:42.008 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7078999999999998e-05 2024-05-08T18:31:42.008 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.009 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.009 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:42.009 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.640606+0000", 2024-05-08T18:31:42.009 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1225999999999999e-05 2024-05-08T18:31:42.009 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:42.009 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:42.009 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:42.009 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.009 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.009 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:57 7.3 e30/29 7:c609908c:::notify.5:head v 30'2, mlcod=0'0)", 2024-05-08T18:31:42.009 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:48.669376+0000", 2024-05-08T18:31:42.010 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 113.33313782499999, 2024-05-08T18:31:42.010 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0041509479999999998, 2024-05-08T18:31:42.010 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:42.010 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:42.010 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:42.010 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:42.010 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.010 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:42.010 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669376+0000", 2024-05-08T18:31:42.010 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:42.010 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.010 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.010 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:42.010 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669376+0000", 2024-05-08T18:31:42.011 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:42.011 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.011 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.011 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:42.011 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669378+0000", 2024-05-08T18:31:42.011 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.79e-06 2024-05-08T18:31:42.011 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.011 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.011 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:42.011 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669393+0000", 2024-05-08T18:31:42.011 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5053e-05 2024-05-08T18:31:42.011 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.011 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.012 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:42.012 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669427+0000", 2024-05-08T18:31:42.012 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4326999999999998e-05 2024-05-08T18:31:42.012 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.012 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.012 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:42.012 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669451+0000", 2024-05-08T18:31:42.012 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3629e-05 2024-05-08T18:31:42.012 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.012 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.012 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:42.012 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669563+0000", 2024-05-08T18:31:42.012 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011251099999999999 2024-05-08T18:31:42.012 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.012 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.013 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:42.013 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669607+0000", 2024-05-08T18:31:42.013 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3877e-05 2024-05-08T18:31:42.013 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.013 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.013 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:42.013 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.673401+0000", 2024-05-08T18:31:42.013 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0037942819999999999 2024-05-08T18:31:42.013 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.013 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.013 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:42.013 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.673527+0000", 2024-05-08T18:31:42.013 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012547900000000001 2024-05-08T18:31:42.014 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:42.014 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:42.014 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:42.014 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.014 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.014 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:58 7.14 e30/29 7:2b04a3e9:::notify.6:head v 30'1, mlcod=0'0)", 2024-05-08T18:31:42.014 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:48.669496+0000", 2024-05-08T18:31:42.014 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 113.333017453, 2024-05-08T18:31:42.014 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0046805609999999997, 2024-05-08T18:31:42.014 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:42.014 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:42.014 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:42.014 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:42.014 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.015 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:42.015 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669496+0000", 2024-05-08T18:31:42.015 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:42.015 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.015 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.015 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:42.015 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669496+0000", 2024-05-08T18:31:42.015 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:42.015 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.015 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.015 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:42.015 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669497+0000", 2024-05-08T18:31:42.015 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0100000000000001e-06 2024-05-08T18:31:42.016 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.016 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.016 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:42.016 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669507+0000", 2024-05-08T18:31:42.016 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.7540000000000001e-06 2024-05-08T18:31:42.016 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.016 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.016 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:42.016 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669528+0000", 2024-05-08T18:31:42.016 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.05e-05 2024-05-08T18:31:42.016 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.016 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.016 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:42.016 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669544+0000", 2024-05-08T18:31:42.016 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6716000000000001e-05 2024-05-08T18:31:42.017 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.017 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.017 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:42.017 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669667+0000", 2024-05-08T18:31:42.017 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012275799999999999 2024-05-08T18:31:42.017 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.017 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.017 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:42.017 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669706+0000", 2024-05-08T18:31:42.017 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8764999999999999e-05 2024-05-08T18:31:42.017 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.017 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.018 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:42.018 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674100+0000", 2024-05-08T18:31:42.018 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.004394528 2024-05-08T18:31:42.018 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.018 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.018 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:42.018 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674177+0000", 2024-05-08T18:31:42.018 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6530000000000001e-05 2024-05-08T18:31:42.018 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:42.018 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:42.019 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:42.019 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.019 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.019 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:42.019 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.794231+0000", 2024-05-08T18:31:42.019 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 110.20828306200001, 2024-05-08T18:31:42.019 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031872810000000001, 2024-05-08T18:31:42.019 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:42.019 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:42.019 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:42.019 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:42.019 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:42.019 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:42.020 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 236 2024-05-08T18:31:42.020 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.020 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:42.020 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.020 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:42.020 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794231+0000", 2024-05-08T18:31:42.020 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:42.020 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.020 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.020 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:42.020 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794231+0000", 2024-05-08T18:31:42.020 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:42.020 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.020 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.021 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:42.021 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794234+0000", 2024-05-08T18:31:42.021 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.36e-06 2024-05-08T18:31:42.021 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.021 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.021 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:42.021 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794248+0000", 2024-05-08T18:31:42.021 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4372999999999999e-05 2024-05-08T18:31:42.021 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.021 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.021 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:42.021 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794279+0000", 2024-05-08T18:31:42.021 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1075999999999999e-05 2024-05-08T18:31:42.021 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.022 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.022 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:42.022 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794295+0000", 2024-05-08T18:31:42.022 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5386000000000001e-05 2024-05-08T18:31:42.022 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.022 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.022 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:42.022 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794416+0000", 2024-05-08T18:31:42.022 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012071899999999999 2024-05-08T18:31:42.022 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.022 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.022 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:42.022 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.794638+0000", 2024-05-08T18:31:42.023 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00022262599999999999 2024-05-08T18:31:42.023 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.023 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.023 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:42.023 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.795061+0000", 2024-05-08T18:31:42.023 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00042248900000000001 2024-05-08T18:31:42.023 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.023 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.023 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:42.023 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.796477+0000", 2024-05-08T18:31:42.023 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0014162230000000001 2024-05-08T18:31:42.023 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.023 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.024 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:42.024 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.797258+0000", 2024-05-08T18:31:42.024 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00078159400000000004 2024-05-08T18:31:42.024 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.024 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.024 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:42.024 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.797349+0000", 2024-05-08T18:31:42.024 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0462000000000002e-05 2024-05-08T18:31:42.024 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.024 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.024 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:42.024 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.797418+0000", 2024-05-08T18:31:42.024 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8973000000000005e-05 2024-05-08T18:31:42.025 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:42.025 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:42.025 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:42.025 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.025 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.025 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:304 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:42.025 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:51.809645+0000", 2024-05-08T18:31:42.025 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 110.19286909, 2024-05-08T18:31:42.025 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031633579999999998, 2024-05-08T18:31:42.025 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:42.025 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:42.025 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:42.025 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:42.025 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:42.026 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:42.026 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 304 2024-05-08T18:31:42.026 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.026 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:42.026 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.026 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:42.026 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809645+0000", 2024-05-08T18:31:42.026 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:42.026 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.026 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.026 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:42.026 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809645+0000", 2024-05-08T18:31:42.026 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:42.027 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.027 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.027 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:42.027 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809646+0000", 2024-05-08T18:31:42.027 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.113e-06 2024-05-08T18:31:42.027 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.027 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.027 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:42.027 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809652+0000", 2024-05-08T18:31:42.027 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1650000000000003e-06 2024-05-08T18:31:42.027 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.027 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.027 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:42.027 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809668+0000", 2024-05-08T18:31:42.027 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6025e-05 2024-05-08T18:31:42.028 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.028 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.028 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:42.028 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809678+0000", 2024-05-08T18:31:42.028 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0456e-05 2024-05-08T18:31:42.028 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.028 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.028 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:42.028 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809745+0000", 2024-05-08T18:31:42.028 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7088000000000005e-05 2024-05-08T18:31:42.028 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.028 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.028 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:42.028 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809803+0000", 2024-05-08T18:31:42.028 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7405999999999999e-05 2024-05-08T18:31:42.029 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.029 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.029 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:31:42.029 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.809951+0000", 2024-05-08T18:31:42.029 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014775500000000001 2024-05-08T18:31:42.029 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.029 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.029 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:42.029 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.810564+0000", 2024-05-08T18:31:42.029 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00061324899999999996 2024-05-08T18:31:42.029 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.029 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.029 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:42.029 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.812744+0000", 2024-05-08T18:31:42.030 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0021804509999999999 2024-05-08T18:31:42.030 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.030 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.030 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:42.030 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.812781+0000", 2024-05-08T18:31:42.030 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6554999999999998e-05 2024-05-08T18:31:42.030 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.030 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.030 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:42.030 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:51.812808+0000", 2024-05-08T18:31:42.030 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7095000000000001e-05 2024-05-08T18:31:42.030 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:42.030 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:42.031 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:42.031 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.031 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.031 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:42.031 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.148015+0000", 2024-05-08T18:31:42.031 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 109.854499136, 2024-05-08T18:31:42.031 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032297409999999999, 2024-05-08T18:31:42.031 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:42.031 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:42.031 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:42.031 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:42.031 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:42.032 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:42.032 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 760 2024-05-08T18:31:42.032 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.032 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:42.032 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.032 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:42.032 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.148015+0000", 2024-05-08T18:31:42.032 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:42.032 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.032 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.032 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:42.032 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.148015+0000", 2024-05-08T18:31:42.032 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:42.032 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.032 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.033 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:42.033 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.148017+0000", 2024-05-08T18:31:42.033 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1830000000000001e-06 2024-05-08T18:31:42.033 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.033 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.033 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:42.033 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.148030+0000", 2024-05-08T18:31:42.033 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2893e-05 2024-05-08T18:31:42.033 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.033 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.033 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:42.033 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.148061+0000", 2024-05-08T18:31:42.033 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0953e-05 2024-05-08T18:31:42.033 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.034 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.034 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:42.034 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.148077+0000", 2024-05-08T18:31:42.034 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6554000000000001e-05 2024-05-08T18:31:42.034 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.034 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.034 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:42.034 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.148230+0000", 2024-05-08T18:31:42.034 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015263899999999999 2024-05-08T18:31:42.034 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.034 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.034 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:42.034 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.148592+0000", 2024-05-08T18:31:42.035 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00036219699999999997 2024-05-08T18:31:42.035 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.035 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.035 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:42.035 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.149139+0000", 2024-05-08T18:31:42.035 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00054734599999999999 2024-05-08T18:31:42.035 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.035 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.035 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:42.035 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.150505+0000", 2024-05-08T18:31:42.035 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001365479 2024-05-08T18:31:42.035 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.035 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.035 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:42.037 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.151087+0000", 2024-05-08T18:31:42.037 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00058201200000000002 2024-05-08T18:31:42.037 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.037 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.037 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:42.038 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.151175+0000", 2024-05-08T18:31:42.038 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8199e-05 2024-05-08T18:31:42.038 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.038 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.038 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:42.038 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.151244+0000", 2024-05-08T18:31:42.038 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9286e-05 2024-05-08T18:31:42.038 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:42.038 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:42.038 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:42.038 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.038 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.038 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:42.039 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.277376+0000", 2024-05-08T18:31:42.039 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 109.725137218, 2024-05-08T18:31:42.039 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032022190000000001, 2024-05-08T18:31:42.039 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:42.039 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:42.039 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:42.039 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:42.039 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:42.039 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:42.039 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 817 2024-05-08T18:31:42.039 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.039 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:42.039 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.039 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:42.040 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.277376+0000", 2024-05-08T18:31:42.040 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:42.040 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.040 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.040 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:42.040 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.277376+0000", 2024-05-08T18:31:42.040 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:42.040 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.040 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.040 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:42.040 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.277379+0000", 2024-05-08T18:31:42.040 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4430000000000002e-06 2024-05-08T18:31:42.040 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.040 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.040 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:42.041 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.277391+0000", 2024-05-08T18:31:42.041 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1634000000000001e-05 2024-05-08T18:31:42.041 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.041 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.041 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:42.041 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.277421+0000", 2024-05-08T18:31:42.041 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0691999999999997e-05 2024-05-08T18:31:42.041 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.041 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.041 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:42.041 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.277438+0000", 2024-05-08T18:31:42.041 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7102999999999999e-05 2024-05-08T18:31:42.041 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.042 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.042 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:42.042 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.277602+0000", 2024-05-08T18:31:42.042 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016345300000000001 2024-05-08T18:31:42.042 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.042 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.042 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:42.042 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.278019+0000", 2024-05-08T18:31:42.042 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00041724699999999998 2024-05-08T18:31:42.042 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.042 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.042 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:31:42.042 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.278573+0000", 2024-05-08T18:31:42.042 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00055391900000000005 2024-05-08T18:31:42.043 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.043 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.043 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:42.043 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.279973+0000", 2024-05-08T18:31:42.043 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0013995819999999999 2024-05-08T18:31:42.043 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.043 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.043 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:42.043 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.280422+0000", 2024-05-08T18:31:42.043 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00044940699999999997 2024-05-08T18:31:42.043 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.043 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.043 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:42.043 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.280509+0000", 2024-05-08T18:31:42.044 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7455999999999997e-05 2024-05-08T18:31:42.044 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.044 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.044 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:42.044 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.280579+0000", 2024-05-08T18:31:42.044 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9282999999999994e-05 2024-05-08T18:31:42.044 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:42.044 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:42.044 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:42.044 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.044 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.044 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:42.044 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.281716+0000", 2024-05-08T18:31:42.044 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 109.720797851, 2024-05-08T18:31:42.045 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003275881, 2024-05-08T18:31:42.045 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:42.045 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:42.045 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:42.045 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:42.045 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:42.045 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:42.045 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 819 2024-05-08T18:31:42.045 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.045 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:42.045 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.045 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:42.045 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.281716+0000", 2024-05-08T18:31:42.045 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:42.046 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.046 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.046 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:42.046 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.281716+0000", 2024-05-08T18:31:42.046 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:42.046 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.046 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.046 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:42.046 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.281718+0000", 2024-05-08T18:31:42.046 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.863e-06 2024-05-08T18:31:42.046 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.046 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.046 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:42.047 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.281728+0000", 2024-05-08T18:31:42.047 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0550000000000001e-05 2024-05-08T18:31:42.047 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.047 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.047 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:42.047 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.281760+0000", 2024-05-08T18:31:42.047 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2150000000000002e-05 2024-05-08T18:31:42.047 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.047 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.047 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:42.047 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.281776+0000", 2024-05-08T18:31:42.047 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6005999999999999e-05 2024-05-08T18:31:42.047 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.048 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.048 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:42.048 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.281917+0000", 2024-05-08T18:31:42.048 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014070200000000001 2024-05-08T18:31:42.048 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.048 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.048 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:42.048 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.282148+0000", 2024-05-08T18:31:42.048 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023095200000000001 2024-05-08T18:31:42.048 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.048 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.048 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:31:42.048 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.282641+0000", 2024-05-08T18:31:42.049 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00049337999999999997 2024-05-08T18:31:42.049 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.049 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.049 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:42.049 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.284070+0000", 2024-05-08T18:31:42.049 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0014287950000000001 2024-05-08T18:31:42.049 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.049 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.049 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:42.049 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.284837+0000", 2024-05-08T18:31:42.049 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00076679799999999996 2024-05-08T18:31:42.049 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.049 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.049 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:42.050 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.284925+0000", 2024-05-08T18:31:42.050 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8165999999999996e-05 2024-05-08T18:31:42.050 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.050 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.050 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:42.050 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.284992+0000", 2024-05-08T18:31:42.050 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6519000000000005e-05 2024-05-08T18:31:42.050 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:42.050 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:42.050 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:42.050 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.050 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.051 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:42.051 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.334745+0000", 2024-05-08T18:31:42.051 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 109.66776894100001, 2024-05-08T18:31:42.051 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032404719999999999, 2024-05-08T18:31:42.051 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:42.051 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:42.051 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:42.051 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:42.051 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:42.051 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:42.051 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 841 2024-05-08T18:31:42.051 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.051 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:42.051 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.052 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:42.052 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.334745+0000", 2024-05-08T18:31:42.052 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:42.052 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.052 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.052 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:42.052 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.334745+0000", 2024-05-08T18:31:42.052 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:42.052 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.052 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.052 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:42.053 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.334747+0000", 2024-05-08T18:31:42.053 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.407e-06 2024-05-08T18:31:42.053 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.053 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.053 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:42.053 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.334759+0000", 2024-05-08T18:31:42.053 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1883e-05 2024-05-08T18:31:42.053 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.053 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.053 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:42.053 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.334789+0000", 2024-05-08T18:31:42.053 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9957000000000001e-05 2024-05-08T18:31:42.053 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.053 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.054 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:42.054 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.334804+0000", 2024-05-08T18:31:42.054 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4713e-05 2024-05-08T18:31:42.054 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.054 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.054 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:42.054 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.334951+0000", 2024-05-08T18:31:42.054 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000147675 2024-05-08T18:31:42.054 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.054 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.054 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:42.054 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.335304+0000", 2024-05-08T18:31:42.054 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00035214099999999999 2024-05-08T18:31:42.055 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.055 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.055 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:31:42.055 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.335859+0000", 2024-05-08T18:31:42.055 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00055546899999999995 2024-05-08T18:31:42.055 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.055 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.055 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:42.055 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.337168+0000", 2024-05-08T18:31:42.056 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0013087299999999999 2024-05-08T18:31:42.056 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.056 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.056 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:42.056 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.337808+0000", 2024-05-08T18:31:42.056 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00064005500000000005 2024-05-08T18:31:42.056 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.056 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.056 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:42.056 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.337894+0000", 2024-05-08T18:31:42.056 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6593000000000003e-05 2024-05-08T18:31:42.056 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.056 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.056 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:42.057 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.337985+0000", 2024-05-08T18:31:42.057 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0848999999999997e-05 2024-05-08T18:31:42.057 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:42.057 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:42.057 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:42.057 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.057 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.057 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-08T18:31:42.058 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:52.349287+0000", 2024-05-08T18:31:42.058 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 109.653226363, 2024-05-08T18:31:42.058 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032683220000000002, 2024-05-08T18:31:42.058 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:42.058 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:42.058 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:42.058 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:42.059 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:42.059 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:42.059 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 847 2024-05-08T18:31:42.059 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.059 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:42.059 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.059 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:42.060 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.349287+0000", 2024-05-08T18:31:42.060 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:42.060 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.060 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.060 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:42.060 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.349287+0000", 2024-05-08T18:31:42.060 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:42.060 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.060 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.061 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:42.061 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.349290+0000", 2024-05-08T18:31:42.061 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3369999999999998e-06 2024-05-08T18:31:42.061 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.061 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.061 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:42.061 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.349318+0000", 2024-05-08T18:31:42.062 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8419999999999999e-05 2024-05-08T18:31:42.062 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.062 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.062 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:42.062 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.349348+0000", 2024-05-08T18:31:42.062 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0260000000000002e-05 2024-05-08T18:31:42.062 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.062 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.062 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:42.062 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.349364+0000", 2024-05-08T18:31:42.063 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5359999999999999e-05 2024-05-08T18:31:42.063 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.063 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.063 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:42.063 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.349511+0000", 2024-05-08T18:31:42.063 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014760199999999999 2024-05-08T18:31:42.064 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.064 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.064 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:42.064 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.349872+0000", 2024-05-08T18:31:42.064 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00036035 2024-05-08T18:31:42.065 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.065 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.065 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:31:42.065 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.350432+0000", 2024-05-08T18:31:42.065 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00056059600000000001 2024-05-08T18:31:42.065 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.065 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.065 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:42.065 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.351817+0000", 2024-05-08T18:31:42.065 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001385063 2024-05-08T18:31:42.065 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.065 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.066 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:42.066 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.352402+0000", 2024-05-08T18:31:42.066 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00058490500000000004 2024-05-08T18:31:42.066 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.066 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.066 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:42.066 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.352488+0000", 2024-05-08T18:31:42.067 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6032999999999994e-05 2024-05-08T18:31:42.067 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.067 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.067 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:42.067 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:52.352556+0000", 2024-05-08T18:31:42.067 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7396000000000003e-05 2024-05-08T18:31:42.067 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:42.067 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:42.067 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:42.068 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.068 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.068 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.5274.0:56 7.14 e80/29 7:2b04a3e9:::notify.6:head v 80'3, mlcod=30'1)", 2024-05-08T18:31:42.068 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:36.922675+0000", 2024-05-08T18:31:42.068 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 5.0798387500000004, 2024-05-08T18:31:42.068 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0060932800000000004, 2024-05-08T18:31:42.068 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:42.068 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:42.069 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:42.069 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:42.069 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.069 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:42.069 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:36.922675+0000", 2024-05-08T18:31:42.069 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:42.069 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.069 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.069 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:42.070 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:36.922675+0000", 2024-05-08T18:31:42.070 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:42.070 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.070 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.070 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:42.071 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:36.922675+0000", 2024-05-08T18:31:42.071 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5900000000000003e-07 2024-05-08T18:31:42.071 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.071 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.071 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:42.071 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:36.922679+0000", 2024-05-08T18:31:42.071 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5590000000000001e-06 2024-05-08T18:31:42.071 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.072 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.072 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:42.072 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:36.922686+0000", 2024-05-08T18:31:42.072 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.5739999999999998e-06 2024-05-08T18:31:42.072 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.072 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.072 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:42.072 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:36.922691+0000", 2024-05-08T18:31:42.072 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.0509999999999996e-06 2024-05-08T18:31:42.072 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.073 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.073 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:42.073 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:36.922732+0000", 2024-05-08T18:31:42.073 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0620000000000001e-05 2024-05-08T18:31:42.073 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.073 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.073 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:42.074 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:36.922744+0000", 2024-05-08T18:31:42.074 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1474999999999999e-05 2024-05-08T18:31:42.074 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.074 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.074 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:42.074 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:36.928742+0000", 2024-05-08T18:31:42.074 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0059983900000000001 2024-05-08T18:31:42.074 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.075 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.075 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:42.075 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:36.928768+0000", 2024-05-08T18:31:42.075 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6251999999999999e-05 2024-05-08T18:31:42.075 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:42.075 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:42.075 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:42.075 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.076 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.076 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.5018.0:56 7.14 e80/29 7:2b04a3e9:::notify.6:head v 80'15, mlcod=80'13)", 2024-05-08T18:31:42.076 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:37.741774+0000", 2024-05-08T18:31:42.076 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4.260739987, 2024-05-08T18:31:42.076 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0037565960000000001, 2024-05-08T18:31:42.076 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:42.076 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:42.077 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:42.077 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:42.077 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.077 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:42.077 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.741774+0000", 2024-05-08T18:31:42.078 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:42.078 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.078 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.078 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:42.078 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.741774+0000", 2024-05-08T18:31:42.078 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:42.078 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.078 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.078 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:42.079 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.741774+0000", 2024-05-08T18:31:42.079 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7800000000000002e-07 2024-05-08T18:31:42.079 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.079 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.079 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:42.079 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.741790+0000", 2024-05-08T18:31:42.079 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6322000000000001e-05 2024-05-08T18:31:42.079 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.079 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.079 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:42.080 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.741798+0000", 2024-05-08T18:31:42.080 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.9610000000000005e-06 2024-05-08T18:31:42.080 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.080 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.080 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:42.080 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.741804+0000", 2024-05-08T18:31:42.080 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4450000000000004e-06 2024-05-08T18:31:42.080 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.080 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.081 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:42.081 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.741851+0000", 2024-05-08T18:31:42.081 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7638e-05 2024-05-08T18:31:42.081 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.081 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.081 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:42.081 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.741871+0000", 2024-05-08T18:31:42.081 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9191999999999999e-05 2024-05-08T18:31:42.081 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.082 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.082 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:42.082 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.745503+0000", 2024-05-08T18:31:42.082 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0036323420000000002 2024-05-08T18:31:42.082 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.082 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.082 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:42.082 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.745530+0000", 2024-05-08T18:31:42.083 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7317999999999998e-05 2024-05-08T18:31:42.083 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:42.083 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:42.083 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:42.083 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.083 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.084 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1212 4.0 4:0316270c:::.dir.3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.2.1:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-05-08T18:31:42.084 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:37.799894+0000", 2024-05-08T18:31:42.084 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4.2026200439999997, 2024-05-08T18:31:42.084 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0062061470000000004, 2024-05-08T18:31:42.084 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:42.085 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:42.085 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:42.085 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:42.085 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:42.085 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:42.085 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1212 2024-05-08T18:31:42.085 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.085 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:42.085 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.085 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:42.086 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.799894+0000", 2024-05-08T18:31:42.086 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:42.086 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.086 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.086 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:42.086 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.799894+0000", 2024-05-08T18:31:42.086 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:42.086 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.087 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.087 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:42.087 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.799895+0000", 2024-05-08T18:31:42.087 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.787e-06 2024-05-08T18:31:42.087 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.087 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.087 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:42.087 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.799909+0000", 2024-05-08T18:31:42.087 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3233e-05 2024-05-08T18:31:42.088 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.088 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.088 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:42.088 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.799934+0000", 2024-05-08T18:31:42.088 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4898000000000001e-05 2024-05-08T18:31:42.088 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.088 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.088 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:42.089 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.799944+0000", 2024-05-08T18:31:42.089 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.9769999999999995e-06 2024-05-08T18:31:42.089 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.089 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.089 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:42.089 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.800014+0000", 2024-05-08T18:31:42.089 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.0912000000000001e-05 2024-05-08T18:31:42.089 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.089 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.090 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:42.090 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.800148+0000", 2024-05-08T18:31:42.090 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013343299999999999 2024-05-08T18:31:42.090 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.090 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.090 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:42.091 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.800279+0000", 2024-05-08T18:31:42.091 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013131500000000001 2024-05-08T18:31:42.091 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.091 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.091 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:42.092 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.803585+0000", 2024-05-08T18:31:42.092 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0033059320000000001 2024-05-08T18:31:42.092 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.092 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.092 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:42.092 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.806032+0000", 2024-05-08T18:31:42.092 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0024466470000000001 2024-05-08T18:31:42.093 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.093 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.093 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:42.093 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.806068+0000", 2024-05-08T18:31:42.093 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6075000000000003e-05 2024-05-08T18:31:42.093 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.093 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.093 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:42.094 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.806100+0000", 2024-05-08T18:31:42.094 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1937999999999998e-05 2024-05-08T18:31:42.094 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:42.094 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:42.094 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:42.094 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.094 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.094 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.5367.0:56 7.14 e80/29 7:2b04a3e9:::notify.6:head v 80'18, mlcod=80'16)", 2024-05-08T18:31:42.095 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:37.922029+0000", 2024-05-08T18:31:42.095 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4.0804850669999997, 2024-05-08T18:31:42.095 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0051732790000000002, 2024-05-08T18:31:42.095 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:42.095 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:42.095 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:42.095 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:42.095 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.095 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:42.095 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.922029+0000", 2024-05-08T18:31:42.096 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:42.096 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.096 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.096 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:42.096 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.922029+0000", 2024-05-08T18:31:42.096 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:42.096 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.096 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.097 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:42.097 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.922029+0000", 2024-05-08T18:31:42.097 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0899999999999997e-07 2024-05-08T18:31:42.097 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.097 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.097 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:42.097 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.922032+0000", 2024-05-08T18:31:42.097 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3519999999999998e-06 2024-05-08T18:31:42.097 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.098 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.098 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:42.098 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.922037+0000", 2024-05-08T18:31:42.098 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3789999999999999e-06 2024-05-08T18:31:42.098 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.098 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.099 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:42.099 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.922044+0000", 2024-05-08T18:31:42.099 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.357e-06 2024-05-08T18:31:42.099 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.099 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.099 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:42.100 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.922092+0000", 2024-05-08T18:31:42.100 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7692999999999999e-05 2024-05-08T18:31:42.100 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.100 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.100 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:42.100 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.922110+0000", 2024-05-08T18:31:42.100 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7949999999999999e-05 2024-05-08T18:31:42.100 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.100 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.100 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:42.100 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.927173+0000", 2024-05-08T18:31:42.101 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0050635740000000004 2024-05-08T18:31:42.101 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.101 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.101 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:42.101 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.927202+0000", 2024-05-08T18:31:42.101 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8665000000000001e-05 2024-05-08T18:31:42.101 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:42.101 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:42.101 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:42.102 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.102 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.102 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.5048.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94364071105744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-05-08T18:31:42.102 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:38.098487+0000", 2024-05-08T18:31:42.102 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 3.9040263629999998, 2024-05-08T18:31:42.102 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0043287619999999999, 2024-05-08T18:31:42.102 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:42.102 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:42.103 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:42.103 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:42.103 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.5048", 2024-05-08T18:31:42.103 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/1891951056", 2024-05-08T18:31:42.103 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 51 2024-05-08T18:31:42.103 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.103 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:42.103 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.103 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:42.104 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.098487+0000", 2024-05-08T18:31:42.104 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:42.104 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.104 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.104 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:42.104 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.098487+0000", 2024-05-08T18:31:42.104 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:42.104 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.104 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.104 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:42.105 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.098488+0000", 2024-05-08T18:31:42.105 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.8299999999999996e-07 2024-05-08T18:31:42.105 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.105 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.105 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:42.105 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.098492+0000", 2024-05-08T18:31:42.105 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0149999999999997e-06 2024-05-08T18:31:42.106 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.106 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.106 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:42.106 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.098505+0000", 2024-05-08T18:31:42.106 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3261000000000001e-05 2024-05-08T18:31:42.106 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.107 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.107 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:42.107 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.098513+0000", 2024-05-08T18:31:42.107 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.5299999999999999e-06 2024-05-08T18:31:42.107 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.107 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.107 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:42.107 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.098554+0000", 2024-05-08T18:31:42.108 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.1273000000000003e-05 2024-05-08T18:31:42.108 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.108 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.108 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:42.108 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.098618+0000", 2024-05-08T18:31:42.108 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.4160999999999998e-05 2024-05-08T18:31:42.108 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.108 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.108 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:42.108 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.098708+0000", 2024-05-08T18:31:42.109 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9184000000000005e-05 2024-05-08T18:31:42.109 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.109 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.109 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:42.109 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.100888+0000", 2024-05-08T18:31:42.109 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0021803249999999999 2024-05-08T18:31:42.109 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.109 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.109 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:42.110 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.102720+0000", 2024-05-08T18:31:42.110 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0018321240000000001 2024-05-08T18:31:42.110 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.110 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.110 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:42.110 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.102754+0000", 2024-05-08T18:31:42.110 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3824e-05 2024-05-08T18:31:42.110 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.110 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.111 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:42.111 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.102816+0000", 2024-05-08T18:31:42.111 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.2281999999999998e-05 2024-05-08T18:31:42.111 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:42.111 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:42.111 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:42.111 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.111 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.111 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.5048.0:55 7.3 e80/29 7:c609908c:::notify.5:head v 80'22, mlcod=80'20)", 2024-05-08T18:31:42.112 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:38.103625+0000", 2024-05-08T18:31:42.112 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 3.8988887170000002, 2024-05-08T18:31:42.112 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0046621220000000003, 2024-05-08T18:31:42.112 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:42.112 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:42.112 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:42.112 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:42.113 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.113 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:42.113 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.103625+0000", 2024-05-08T18:31:42.113 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:42.113 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.113 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.113 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:42.113 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.103625+0000", 2024-05-08T18:31:42.113 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:42.113 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.113 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.114 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:42.114 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.103625+0000", 2024-05-08T18:31:42.114 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6899999999999998e-07 2024-05-08T18:31:42.114 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.114 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.115 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:42.115 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.103630+0000", 2024-05-08T18:31:42.115 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.1760000000000003e-06 2024-05-08T18:31:42.115 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.115 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.115 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:42.116 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.103637+0000", 2024-05-08T18:31:42.116 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.875e-06 2024-05-08T18:31:42.116 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.116 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.116 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:42.116 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.103643+0000", 2024-05-08T18:31:42.116 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3340000000000001e-06 2024-05-08T18:31:42.116 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.116 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.116 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:42.116 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.103690+0000", 2024-05-08T18:31:42.116 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7670999999999998e-05 2024-05-08T18:31:42.117 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.117 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.117 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:42.117 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.103710+0000", 2024-05-08T18:31:42.117 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9230000000000001e-05 2024-05-08T18:31:42.117 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.117 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.118 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:42.118 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.108246+0000", 2024-05-08T18:31:42.118 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0045359629999999996 2024-05-08T18:31:42.118 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.118 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.118 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:42.118 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.108287+0000", 2024-05-08T18:31:42.119 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.1504000000000001e-05 2024-05-08T18:31:42.119 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:42.119 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:42.119 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:42.119 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.119 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.120 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.5048.0:57 7.14 e80/29 7:2b04a3e9:::notify.6:head v 80'22, mlcod=80'20)", 2024-05-08T18:31:42.120 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:38.106196+0000", 2024-05-08T18:31:42.120 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 3.8963177030000002, 2024-05-08T18:31:42.120 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00487003, 2024-05-08T18:31:42.120 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:42.120 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:42.121 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:42.121 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:42.121 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.121 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:42.121 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.106196+0000", 2024-05-08T18:31:42.121 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:42.121 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.121 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.121 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:42.121 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.106196+0000", 2024-05-08T18:31:42.121 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:42.121 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.121 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.122 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:42.122 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.106197+0000", 2024-05-08T18:31:42.122 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6799999999999999e-07 2024-05-08T18:31:42.122 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.122 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.122 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:42.122 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.106203+0000", 2024-05-08T18:31:42.123 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.4359999999999999e-06 2024-05-08T18:31:42.123 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.123 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.123 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:42.123 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.106218+0000", 2024-05-08T18:31:42.123 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5084e-05 2024-05-08T18:31:42.123 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.123 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.124 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:42.124 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.106226+0000", 2024-05-08T18:31:42.124 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.3640000000000001e-06 2024-05-08T18:31:42.124 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.124 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.124 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:42.125 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.106302+0000", 2024-05-08T18:31:42.125 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.5910999999999999e-05 2024-05-08T18:31:42.125 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.125 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.125 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:42.125 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.106323+0000", 2024-05-08T18:31:42.125 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1582000000000001e-05 2024-05-08T18:31:42.126 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.126 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.126 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:42.126 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.111001+0000", 2024-05-08T18:31:42.126 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0046776530000000004 2024-05-08T18:31:42.126 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.126 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.126 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:42.126 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.111066+0000", 2024-05-08T18:31:42.127 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5131999999999999e-05 2024-05-08T18:31:42.127 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:42.127 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:42.127 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:42.127 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.127 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.127 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.5066.0:56 7.14 e80/29 7:2b04a3e9:::notify.6:head v 80'24, mlcod=80'22)", 2024-05-08T18:31:42.127 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:38.385143+0000", 2024-05-08T18:31:42.127 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 3.6173711389999998, 2024-05-08T18:31:42.127 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031781829999999998, 2024-05-08T18:31:42.127 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:42.128 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:42.128 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:42.128 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:42.128 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.128 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:42.128 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.385143+0000", 2024-05-08T18:31:42.128 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:42.129 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.129 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.129 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:42.129 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.385143+0000", 2024-05-08T18:31:42.129 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:42.129 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.130 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.130 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:42.130 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.385143+0000", 2024-05-08T18:31:42.130 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4499999999999997e-07 2024-05-08T18:31:42.130 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.130 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.130 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:42.130 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.385149+0000", 2024-05-08T18:31:42.130 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0680000000000002e-06 2024-05-08T18:31:42.130 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.131 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.131 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:42.131 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.385156+0000", 2024-05-08T18:31:42.131 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1539999999999996e-06 2024-05-08T18:31:42.131 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.131 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.131 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:42.131 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.385161+0000", 2024-05-08T18:31:42.131 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.0590000000000002e-06 2024-05-08T18:31:42.132 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.132 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.132 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:42.132 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.385212+0000", 2024-05-08T18:31:42.132 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.0522000000000002e-05 2024-05-08T18:31:42.132 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.132 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.132 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:42.133 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.385233+0000", 2024-05-08T18:31:42.133 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1492999999999999e-05 2024-05-08T18:31:42.133 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.133 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.133 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:42.133 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.388294+0000", 2024-05-08T18:31:42.134 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0030604809999999999 2024-05-08T18:31:42.134 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.134 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.134 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:42.134 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.388321+0000", 2024-05-08T18:31:42.134 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6860999999999999e-05 2024-05-08T18:31:42.134 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:42.134 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:42.134 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:42.135 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.135 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.135 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.5066.0:139 4.0 4:0316270c:::.dir.3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.2.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-05-08T18:31:42.135 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:38.486082+0000", 2024-05-08T18:31:42.135 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 3.51643208, 2024-05-08T18:31:42.135 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0053184820000000002, 2024-05-08T18:31:42.135 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:42.136 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:42.136 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:42.136 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:42.136 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.5066", 2024-05-08T18:31:42.136 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/4156398147", 2024-05-08T18:31:42.136 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 139 2024-05-08T18:31:42.136 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.136 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:42.136 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.136 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:42.136 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.486082+0000", 2024-05-08T18:31:42.137 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:42.137 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.137 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.137 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:42.137 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.486082+0000", 2024-05-08T18:31:42.137 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:42.138 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.138 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.138 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:42.138 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.486083+0000", 2024-05-08T18:31:42.138 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.001e-06 2024-05-08T18:31:42.138 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.139 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.139 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:42.139 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.486088+0000", 2024-05-08T18:31:42.139 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9200000000000003e-06 2024-05-08T18:31:42.139 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.139 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.139 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:42.139 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.486106+0000", 2024-05-08T18:31:42.139 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8151e-05 2024-05-08T18:31:42.139 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.140 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.140 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:42.140 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.486120+0000", 2024-05-08T18:31:42.140 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4361e-05 2024-05-08T18:31:42.140 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.140 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.140 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:42.140 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.486169+0000", 2024-05-08T18:31:42.140 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8489999999999998e-05 2024-05-08T18:31:42.141 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.141 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.141 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:42.141 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.486239+0000", 2024-05-08T18:31:42.141 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.0376000000000005e-05 2024-05-08T18:31:42.141 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.142 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.142 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:42.142 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.486334+0000", 2024-05-08T18:31:42.142 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.4794000000000001e-05 2024-05-08T18:31:42.142 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.143 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.143 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:42.143 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.487057+0000", 2024-05-08T18:31:42.143 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00072319699999999997 2024-05-08T18:31:42.143 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.143 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.143 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:42.143 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.491342+0000", 2024-05-08T18:31:42.143 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0042854310000000001 2024-05-08T18:31:42.143 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.143 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.144 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:42.144 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.491374+0000", 2024-05-08T18:31:42.144 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1931000000000003e-05 2024-05-08T18:31:42.144 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.144 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.144 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:42.144 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.491400+0000", 2024-05-08T18:31:42.144 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5829999999999998e-05 2024-05-08T18:31:42.145 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:42.145 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:42.145 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:42.145 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.145 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.145 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1258 4.2d 4:b50bdddd:::.dir.3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.3.5:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-05-08T18:31:42.145 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:38.677559+0000", 2024-05-08T18:31:42.145 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 3.3249544559999999, 2024-05-08T18:31:42.145 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031255469999999998, 2024-05-08T18:31:42.146 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:42.146 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:42.146 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:42.146 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:42.146 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:42.147 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:42.147 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1258 2024-05-08T18:31:42.147 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.147 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:42.147 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.147 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:42.148 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.677559+0000", 2024-05-08T18:31:42.148 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:42.148 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.148 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.148 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:42.148 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.677559+0000", 2024-05-08T18:31:42.148 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:42.148 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.148 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.148 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:42.149 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.677562+0000", 2024-05-08T18:31:42.149 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3259999999999998e-06 2024-05-08T18:31:42.149 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.149 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.149 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:42.149 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.677584+0000", 2024-05-08T18:31:42.149 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2827999999999999e-05 2024-05-08T18:31:42.149 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.149 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.149 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:42.150 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.677609+0000", 2024-05-08T18:31:42.150 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4562e-05 2024-05-08T18:31:42.150 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.150 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.150 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:42.151 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.677619+0000", 2024-05-08T18:31:42.151 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0385e-05 2024-05-08T18:31:42.151 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.151 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.151 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:42.151 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.677688+0000", 2024-05-08T18:31:42.152 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8625000000000001e-05 2024-05-08T18:31:42.152 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.152 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.152 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:42.152 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.677837+0000", 2024-05-08T18:31:42.152 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014855900000000001 2024-05-08T18:31:42.152 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.152 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.152 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:31:42.152 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.677991+0000", 2024-05-08T18:31:42.152 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015415700000000001 2024-05-08T18:31:42.153 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.153 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.153 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:42.153 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.678884+0000", 2024-05-08T18:31:42.153 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00089316799999999996 2024-05-08T18:31:42.153 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.153 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.154 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:42.154 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.680624+0000", 2024-05-08T18:31:42.154 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001740447 2024-05-08T18:31:42.154 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.154 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.154 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:42.154 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.680658+0000", 2024-05-08T18:31:42.154 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3769999999999997e-05 2024-05-08T18:31:42.154 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.154 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.154 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:42.154 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.680685+0000", 2024-05-08T18:31:42.155 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6720000000000002e-05 2024-05-08T18:31:42.155 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:42.155 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:42.155 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:42.155 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:42.155 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:42.155 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:42.157 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-08T18:31:42.157 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:31:42.157+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:31:42.257 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:31:42.254+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:31:42.338 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:42.338 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:31:42.338 INFO:teuthology.orchestra.run.smithi097.stdout: "num_ops": 0 2024-05-08T18:31:42.338 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:42.359 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-08T18:31:42.359 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:31:42.357+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:31:42.460 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:31:42.461+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:31:42.549 INFO:teuthology.orchestra.run.smithi097.stderr:noscrub is unset 2024-05-08T18:31:42.550 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:42.550 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:31:42.550 INFO:teuthology.orchestra.run.smithi097.stdout: "complaint_time": 30, 2024-05-08T18:31:42.550 INFO:teuthology.orchestra.run.smithi097.stdout: "num_blocked_ops": 0 2024-05-08T18:31:42.550 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:42.565 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:31:42.558+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:31:42.577 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-08T18:31:42.672 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:31:42.673+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:31:42.764 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:31:42.758+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:31:42.774 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:42.775 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2024-05-08T18:31:42.775 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2024-05-08T18:31:42.775 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-05-08T18:31:42.775 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.775 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:57 7.3 7:c609908c:::notify.5:head [watch watch cookie 94069412621696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:31:42.775 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:48.668590+0000", 2024-05-08T18:31:42.775 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 114.105175489, 2024-05-08T18:31:42.775 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0054375830000000002, 2024-05-08T18:31:42.775 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:42.775 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:42.776 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:42.776 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:42.776 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:42.776 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:42.776 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 57 2024-05-08T18:31:42.776 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.776 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:42.776 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.776 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:42.776 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668590+0000", 2024-05-08T18:31:42.776 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:42.776 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.776 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.776 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:42.777 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668590+0000", 2024-05-08T18:31:42.777 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:42.777 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.777 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.777 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:42.778 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668592+0000", 2024-05-08T18:31:42.778 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0930000000000001e-06 2024-05-08T18:31:42.778 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.778 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.778 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:42.778 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668619+0000", 2024-05-08T18:31:42.779 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7396999999999999e-05 2024-05-08T18:31:42.779 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.779 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.779 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:42.779 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668650+0000", 2024-05-08T18:31:42.779 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0620000000000002e-05 2024-05-08T18:31:42.780 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.780 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.780 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:42.780 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668672+0000", 2024-05-08T18:31:42.780 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2093e-05 2024-05-08T18:31:42.781 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.781 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.781 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:42.781 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668782+0000", 2024-05-08T18:31:42.781 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011010600000000001 2024-05-08T18:31:42.781 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.782 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.782 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:42.782 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668934+0000", 2024-05-08T18:31:42.782 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000152268 2024-05-08T18:31:42.782 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.783 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.783 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-05-08T18:31:42.783 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669177+0000", 2024-05-08T18:31:42.783 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024286500000000001 2024-05-08T18:31:42.783 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.784 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.784 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:42.784 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.670404+0000", 2024-05-08T18:31:42.784 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001226932 2024-05-08T18:31:42.784 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.784 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.785 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:42.785 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.673822+0000", 2024-05-08T18:31:42.785 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003417776 2024-05-08T18:31:42.785 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.785 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.785 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:42.785 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.673924+0000", 2024-05-08T18:31:42.786 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000102379 2024-05-08T18:31:42.786 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.786 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.786 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:42.786 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674027+0000", 2024-05-08T18:31:42.786 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010305400000000001 2024-05-08T18:31:42.787 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:42.787 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:42.787 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:42.787 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.787 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.787 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:58 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-08T18:31:42.787 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:48.668750+0000", 2024-05-08T18:31:42.788 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 114.105015063, 2024-05-08T18:31:42.788 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0057687559999999999, 2024-05-08T18:31:42.788 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:42.788 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:42.788 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:42.788 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:42.789 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:42.789 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:42.789 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 58 2024-05-08T18:31:42.789 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.789 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:42.789 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.789 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:42.790 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668750+0000", 2024-05-08T18:31:42.790 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:42.790 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.790 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.790 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:42.790 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668750+0000", 2024-05-08T18:31:42.791 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:42.791 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.791 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.791 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:42.791 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668752+0000", 2024-05-08T18:31:42.791 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.64e-06 2024-05-08T18:31:42.791 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.791 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.792 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:42.792 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668760+0000", 2024-05-08T18:31:42.792 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5529999999999993e-06 2024-05-08T18:31:42.792 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.792 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.792 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:42.792 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668787+0000", 2024-05-08T18:31:42.792 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6475999999999999e-05 2024-05-08T18:31:42.793 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.793 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.793 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:42.793 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668804+0000", 2024-05-08T18:31:42.793 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7163000000000002e-05 2024-05-08T18:31:42.793 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.793 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.794 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:42.794 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.668906+0000", 2024-05-08T18:31:42.794 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010241 2024-05-08T18:31:42.794 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.794 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.794 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:42.794 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669068+0000", 2024-05-08T18:31:42.795 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016144400000000001 2024-05-08T18:31:42.795 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.795 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.795 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-05-08T18:31:42.795 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.669226+0000", 2024-05-08T18:31:42.795 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000158639 2024-05-08T18:31:42.796 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.796 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.796 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:42.796 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.670439+0000", 2024-05-08T18:31:42.796 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012124480000000001 2024-05-08T18:31:42.796 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.797 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.797 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:42.797 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674406+0000", 2024-05-08T18:31:42.797 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0039675259999999999 2024-05-08T18:31:42.797 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.798 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.798 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:42.798 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674469+0000", 2024-05-08T18:31:42.798 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.2903000000000004e-05 2024-05-08T18:31:42.798 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.798 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.798 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:42.799 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:48.674519+0000", 2024-05-08T18:31:42.799 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9554e-05 2024-05-08T18:31:42.799 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:42.799 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:42.799 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:42.799 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.799 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.799 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.5274.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-05-08T18:31:42.800 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:36.922415+0000", 2024-05-08T18:31:42.800 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 5.8513502099999997, 2024-05-08T18:31:42.800 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0065500439999999997, 2024-05-08T18:31:42.800 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:42.800 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:42.800 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:42.800 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:42.801 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.5274", 2024-05-08T18:31:42.801 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/1159946380", 2024-05-08T18:31:42.801 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 56 2024-05-08T18:31:42.801 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.801 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:42.801 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.801 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:42.802 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:36.922415+0000", 2024-05-08T18:31:42.802 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:42.802 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.802 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.802 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:42.802 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:36.922415+0000", 2024-05-08T18:31:42.803 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:42.803 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.803 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.803 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:42.803 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:36.922415+0000", 2024-05-08T18:31:42.803 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5900000000000003e-07 2024-05-08T18:31:42.804 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.804 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.804 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:42.804 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:36.922417+0000", 2024-05-08T18:31:42.804 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.968e-06 2024-05-08T18:31:42.804 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.805 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.806 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:42.806 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:36.922422+0000", 2024-05-08T18:31:42.806 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7110000000000003e-06 2024-05-08T18:31:42.806 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.806 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.806 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:42.806 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:36.922427+0000", 2024-05-08T18:31:42.806 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9130000000000002e-06 2024-05-08T18:31:42.806 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.806 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.807 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:42.807 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:36.922463+0000", 2024-05-08T18:31:42.807 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5695999999999998e-05 2024-05-08T18:31:42.807 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.807 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.807 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:42.807 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:36.922503+0000", 2024-05-08T18:31:42.807 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0692999999999998e-05 2024-05-08T18:31:42.807 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.807 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.808 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-05-08T18:31:42.808 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:36.922570+0000", 2024-05-08T18:31:42.808 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6567000000000001e-05 2024-05-08T18:31:42.808 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.808 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.808 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:42.808 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:36.923531+0000", 2024-05-08T18:31:42.808 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00096120799999999996 2024-05-08T18:31:42.808 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.808 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.808 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:42.808 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:36.928873+0000", 2024-05-08T18:31:42.808 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0053416640000000003 2024-05-08T18:31:42.808 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.809 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.809 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:42.809 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:36.928924+0000", 2024-05-08T18:31:42.809 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.1371e-05 2024-05-08T18:31:42.809 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.809 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.809 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:42.809 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:36.928965+0000", 2024-05-08T18:31:42.809 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0893999999999998e-05 2024-05-08T18:31:42.809 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:42.809 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:42.809 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:42.809 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.809 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.810 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.5367.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-05-08T18:31:42.810 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:37.921797+0000", 2024-05-08T18:31:42.810 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4.8519679409999998, 2024-05-08T18:31:42.810 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0055479570000000001, 2024-05-08T18:31:42.810 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:42.810 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:42.810 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:42.810 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:42.810 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.5367", 2024-05-08T18:31:42.810 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3112754809", 2024-05-08T18:31:42.810 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 56 2024-05-08T18:31:42.810 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.810 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:42.811 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.811 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:42.811 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.921797+0000", 2024-05-08T18:31:42.811 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:42.811 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.811 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.811 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:42.811 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.921797+0000", 2024-05-08T18:31:42.811 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:42.811 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.811 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.811 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:42.811 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.921798+0000", 2024-05-08T18:31:42.812 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9500000000000002e-07 2024-05-08T18:31:42.812 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.812 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.812 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:42.812 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.921801+0000", 2024-05-08T18:31:42.812 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6819999999999999e-06 2024-05-08T18:31:42.812 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.812 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.812 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:42.812 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.921810+0000", 2024-05-08T18:31:42.812 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9660000000000002e-06 2024-05-08T18:31:42.812 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.812 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.812 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:42.813 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.921813+0000", 2024-05-08T18:31:42.813 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3589999999999999e-06 2024-05-08T18:31:42.813 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.813 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.813 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:42.813 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.921848+0000", 2024-05-08T18:31:42.813 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5193e-05 2024-05-08T18:31:42.813 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.813 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.813 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:42.813 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.921893+0000", 2024-05-08T18:31:42.813 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5291999999999999e-05 2024-05-08T18:31:42.813 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.813 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.813 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-05-08T18:31:42.814 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.921972+0000", 2024-05-08T18:31:42.814 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.8578999999999994e-05 2024-05-08T18:31:42.814 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.814 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.814 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:42.814 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.924078+0000", 2024-05-08T18:31:42.814 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0021059939999999999 2024-05-08T18:31:42.814 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.814 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.814 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:42.814 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.927293+0000", 2024-05-08T18:31:42.814 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032145099999999999 2024-05-08T18:31:42.814 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.815 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.815 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:42.815 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.927321+0000", 2024-05-08T18:31:42.815 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8853e-05 2024-05-08T18:31:42.815 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.815 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.815 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:42.815 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:37.927345+0000", 2024-05-08T18:31:42.815 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3833999999999999e-05 2024-05-08T18:31:42.815 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:42.815 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:42.815 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:42.815 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.816 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.816 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.5048.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94364071109248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-05-08T18:31:42.816 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:38.105896+0000", 2024-05-08T18:31:42.816 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4.6678693830000002, 2024-05-08T18:31:42.816 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0053492180000000002, 2024-05-08T18:31:42.816 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:42.816 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:42.816 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:42.816 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:42.816 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.5048", 2024-05-08T18:31:42.816 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/1891951056", 2024-05-08T18:31:42.816 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 57 2024-05-08T18:31:42.816 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.816 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:42.816 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.817 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:42.817 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.105896+0000", 2024-05-08T18:31:42.817 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:42.817 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.817 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.817 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:42.817 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.105896+0000", 2024-05-08T18:31:42.817 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:42.817 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.817 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.817 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:42.817 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.105897+0000", 2024-05-08T18:31:42.817 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.124e-06 2024-05-08T18:31:42.817 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.818 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.818 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:42.818 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.105908+0000", 2024-05-08T18:31:42.818 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1080999999999999e-05 2024-05-08T18:31:42.818 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.818 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.818 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:42.818 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.105922+0000", 2024-05-08T18:31:42.818 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3814e-05 2024-05-08T18:31:42.818 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.818 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.818 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:42.819 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.105929+0000", 2024-05-08T18:31:42.819 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.0140000000000001e-06 2024-05-08T18:31:42.819 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.819 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.819 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:42.819 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.105979+0000", 2024-05-08T18:31:42.819 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.0522999999999997e-05 2024-05-08T18:31:42.819 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.819 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.819 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:42.819 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.106041+0000", 2024-05-08T18:31:42.819 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1888000000000001e-05 2024-05-08T18:31:42.819 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.820 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.820 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-05-08T18:31:42.820 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.106118+0000", 2024-05-08T18:31:42.820 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6787999999999997e-05 2024-05-08T18:31:42.820 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.820 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.820 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:42.820 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.110820+0000", 2024-05-08T18:31:42.821 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0047015549999999996 2024-05-08T18:31:42.821 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.821 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.821 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:42.821 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.111165+0000", 2024-05-08T18:31:42.821 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00034539500000000002 2024-05-08T18:31:42.821 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.821 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.822 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:42.822 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.111196+0000", 2024-05-08T18:31:42.822 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1068999999999997e-05 2024-05-08T18:31:42.822 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.822 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.822 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:42.822 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.111245+0000", 2024-05-08T18:31:42.823 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8967000000000001e-05 2024-05-08T18:31:42.823 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:42.823 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:42.823 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:42.823 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.823 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.824 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1234 3.38 3:1cb36fa1:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.2__shadow_.fYaqa8o34qSAauLRSqi3iwpmT5NwV5c_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-05-08T18:31:42.824 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:38.213439+0000", 2024-05-08T18:31:42.824 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4.5603263329999999, 2024-05-08T18:31:42.824 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.028973664, 2024-05-08T18:31:42.824 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:42.824 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:42.825 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:42.825 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:42.825 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:42.825 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:42.825 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1234 2024-05-08T18:31:42.825 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.825 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:42.826 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.826 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:42.826 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.213439+0000", 2024-05-08T18:31:42.826 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:42.826 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.826 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.827 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:42.827 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.213439+0000", 2024-05-08T18:31:42.827 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:42.827 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.827 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.827 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:42.828 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.213442+0000", 2024-05-08T18:31:42.828 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7580000000000001e-06 2024-05-08T18:31:42.828 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.828 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.828 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:42.828 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.216804+0000", 2024-05-08T18:31:42.829 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0033619520000000001 2024-05-08T18:31:42.829 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.829 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.829 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:42.829 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.216838+0000", 2024-05-08T18:31:42.829 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4437999999999998e-05 2024-05-08T18:31:42.829 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.830 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.830 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:42.830 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.216854+0000", 2024-05-08T18:31:42.830 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5823000000000001e-05 2024-05-08T18:31:42.830 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.830 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.831 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:42.831 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.216938+0000", 2024-05-08T18:31:42.831 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.3842000000000001e-05 2024-05-08T18:31:42.831 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.831 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.831 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:42.831 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.217046+0000", 2024-05-08T18:31:42.831 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000108717 2024-05-08T18:31:42.831 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.832 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.832 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:42.832 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.217137+0000", 2024-05-08T18:31:42.832 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0278000000000005e-05 2024-05-08T18:31:42.832 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.832 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.833 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:42.833 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.225461+0000", 2024-05-08T18:31:42.833 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0083239330000000004 2024-05-08T18:31:42.833 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.833 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.833 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:42.833 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.242319+0000", 2024-05-08T18:31:42.834 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.016858445999999999 2024-05-08T18:31:42.834 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.834 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.834 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:42.834 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.242359+0000", 2024-05-08T18:31:42.835 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9657000000000003e-05 2024-05-08T18:31:42.835 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.835 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.835 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:42.835 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.242413+0000", 2024-05-08T18:31:42.835 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3820000000000003e-05 2024-05-08T18:31:42.836 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:42.836 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:42.836 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:42.836 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.836 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.837 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1237 3.c e80/21 3:3156de39:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.2_10Mb.:head v 80'1, mlcod=0'0)", 2024-05-08T18:31:42.837 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:38.251958+0000", 2024-05-08T18:31:42.837 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4.5218075989999997, 2024-05-08T18:31:42.837 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010770866, 2024-05-08T18:31:42.837 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:42.837 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:42.838 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:42.838 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:42.838 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.838 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:42.838 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.251958+0000", 2024-05-08T18:31:42.838 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:42.839 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.839 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.839 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:42.839 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.251958+0000", 2024-05-08T18:31:42.839 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:42.839 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.840 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.840 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:42.840 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.251959+0000", 2024-05-08T18:31:42.840 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.384e-06 2024-05-08T18:31:42.840 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.840 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.841 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:42.841 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.256735+0000", 2024-05-08T18:31:42.841 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0047764790000000001 2024-05-08T18:31:42.841 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.841 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.841 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:42.842 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.256755+0000", 2024-05-08T18:31:42.842 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9483e-05 2024-05-08T18:31:42.842 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.842 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.842 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:42.843 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.256764+0000", 2024-05-08T18:31:42.843 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8519999999999993e-06 2024-05-08T18:31:42.843 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.843 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.843 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:42.843 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.256821+0000", 2024-05-08T18:31:42.844 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7345000000000001e-05 2024-05-08T18:31:42.844 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.844 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.844 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:42.844 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.256838+0000", 2024-05-08T18:31:42.845 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6827999999999999e-05 2024-05-08T18:31:42.845 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.845 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.845 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:42.845 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.262665+0000", 2024-05-08T18:31:42.845 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0058270650000000002 2024-05-08T18:31:42.845 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.846 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.846 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:42.846 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.262728+0000", 2024-05-08T18:31:42.846 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3429999999999994e-05 2024-05-08T18:31:42.846 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:42.846 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:42.846 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:42.846 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.846 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.846 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.5111.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94256125266496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-05-08T18:31:42.846 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:38.801037+0000", 2024-05-08T18:31:42.846 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 3.972727779, 2024-05-08T18:31:42.847 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0083052009999999999, 2024-05-08T18:31:42.847 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:42.847 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:42.847 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:42.847 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:42.847 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.5111", 2024-05-08T18:31:42.847 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/438639429", 2024-05-08T18:31:42.847 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 55 2024-05-08T18:31:42.847 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.847 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:42.847 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.847 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:42.847 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.801037+0000", 2024-05-08T18:31:42.847 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:42.847 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.848 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.848 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:42.848 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.801037+0000", 2024-05-08T18:31:42.848 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:42.848 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.848 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.848 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:42.848 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.801038+0000", 2024-05-08T18:31:42.848 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5000000000000001e-07 2024-05-08T18:31:42.848 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.848 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.848 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:42.848 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.801042+0000", 2024-05-08T18:31:42.849 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6909999999999999e-06 2024-05-08T18:31:42.849 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.849 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.849 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:42.849 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.801054+0000", 2024-05-08T18:31:42.849 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2333e-05 2024-05-08T18:31:42.849 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.849 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.849 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:42.849 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.801061+0000", 2024-05-08T18:31:42.849 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1289999999999998e-06 2024-05-08T18:31:42.849 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.849 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.849 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:42.850 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.801099+0000", 2024-05-08T18:31:42.850 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7780000000000001e-05 2024-05-08T18:31:42.850 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.850 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.850 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:42.850 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.801151+0000", 2024-05-08T18:31:42.850 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.1678999999999998e-05 2024-05-08T18:31:42.850 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.850 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.850 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-05-08T18:31:42.850 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.801232+0000", 2024-05-08T18:31:42.850 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.1334000000000004e-05 2024-05-08T18:31:42.850 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.851 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.851 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:42.851 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.801653+0000", 2024-05-08T18:31:42.851 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000421025 2024-05-08T18:31:42.851 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.851 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.851 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:42.851 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.809222+0000", 2024-05-08T18:31:42.851 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0075691059999999999 2024-05-08T18:31:42.851 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.851 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.851 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:42.851 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.809274+0000", 2024-05-08T18:31:42.851 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.1901999999999999e-05 2024-05-08T18:31:42.852 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.852 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.852 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:42.852 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.809343+0000", 2024-05-08T18:31:42.852 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8372000000000002e-05 2024-05-08T18:31:42.852 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:42.852 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:42.852 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:42.852 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.852 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.852 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.5111.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94256125263520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-05-08T18:31:42.852 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:38.803653+0000", 2024-05-08T18:31:42.853 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 3.9701121439999998, 2024-05-08T18:31:42.853 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0058540429999999997, 2024-05-08T18:31:42.853 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:42.853 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:42.853 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:42.853 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:42.853 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.5111", 2024-05-08T18:31:42.853 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/438639429", 2024-05-08T18:31:42.853 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 57 2024-05-08T18:31:42.853 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.853 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:42.853 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.853 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:42.853 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.803653+0000", 2024-05-08T18:31:42.854 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:42.854 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.854 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.854 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:42.854 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.803653+0000", 2024-05-08T18:31:42.854 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:42.854 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.854 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.854 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:42.854 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.803654+0000", 2024-05-08T18:31:42.854 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6799999999999999e-07 2024-05-08T18:31:42.854 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.854 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.855 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:42.855 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.803658+0000", 2024-05-08T18:31:42.855 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9099999999999998e-06 2024-05-08T18:31:42.855 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.855 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.855 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:42.855 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.803667+0000", 2024-05-08T18:31:42.855 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8480000000000007e-06 2024-05-08T18:31:42.855 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.855 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.855 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:42.855 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.803672+0000", 2024-05-08T18:31:42.855 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9520000000000002e-06 2024-05-08T18:31:42.856 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.856 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.856 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:42.856 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.803710+0000", 2024-05-08T18:31:42.856 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8121000000000003e-05 2024-05-08T18:31:42.856 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.856 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.856 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:42.856 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.803755+0000", 2024-05-08T18:31:42.856 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5296999999999997e-05 2024-05-08T18:31:42.856 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.856 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.856 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-05-08T18:31:42.857 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.803843+0000", 2024-05-08T18:31:42.857 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8256000000000003e-05 2024-05-08T18:31:42.857 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.857 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.857 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:42.857 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.806176+0000", 2024-05-08T18:31:42.857 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0023329050000000001 2024-05-08T18:31:42.857 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.857 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.857 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:42.857 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.809445+0000", 2024-05-08T18:31:42.857 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032689300000000002 2024-05-08T18:31:42.857 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.857 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.858 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:42.858 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.809473+0000", 2024-05-08T18:31:42.858 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8164e-05 2024-05-08T18:31:42.858 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.858 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.858 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:42.858 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.809507+0000", 2024-05-08T18:31:42.858 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3791999999999998e-05 2024-05-08T18:31:42.858 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:42.858 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:42.858 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:42.858 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.858 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.859 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1318 3.c e81/21 3:329e59e6:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_4:head v 81'3, mlcod=80'1)", 2024-05-08T18:31:42.859 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.344399+0000", 2024-05-08T18:31:42.859 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.429366372, 2024-05-08T18:31:42.859 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.016160681999999999, 2024-05-08T18:31:42.859 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:42.859 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:42.859 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:42.859 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:42.859 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.859 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:42.859 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.344399+0000", 2024-05-08T18:31:42.859 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:42.859 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.860 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.860 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:42.860 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.344399+0000", 2024-05-08T18:31:42.860 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:42.860 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.860 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.860 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:42.860 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.344401+0000", 2024-05-08T18:31:42.860 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.767e-06 2024-05-08T18:31:42.860 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.860 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.860 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:42.860 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.351623+0000", 2024-05-08T18:31:42.861 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.007222554 2024-05-08T18:31:42.861 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.861 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.861 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:42.861 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.351667+0000", 2024-05-08T18:31:42.861 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4192e-05 2024-05-08T18:31:42.861 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.861 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.861 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:42.861 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.351690+0000", 2024-05-08T18:31:42.861 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2708999999999999e-05 2024-05-08T18:31:42.861 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.861 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.861 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:42.861 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.351781+0000", 2024-05-08T18:31:42.862 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0556999999999994e-05 2024-05-08T18:31:42.862 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.862 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.862 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:42.862 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.351799+0000", 2024-05-08T18:31:42.862 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8581e-05 2024-05-08T18:31:42.862 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.862 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.862 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:42.862 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.360513+0000", 2024-05-08T18:31:42.862 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.008713864 2024-05-08T18:31:42.862 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.862 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.863 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:42.863 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.360560+0000", 2024-05-08T18:31:42.863 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6458000000000001e-05 2024-05-08T18:31:42.863 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:42.863 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:42.863 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:42.863 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.863 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.863 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1323 3.8 3:1035fbfb:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-08T18:31:42.863 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.415356+0000", 2024-05-08T18:31:42.863 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.35840880200000003, 2024-05-08T18:31:42.863 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.015238969999999999, 2024-05-08T18:31:42.863 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:42.863 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:42.864 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:42.864 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:42.864 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:42.864 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:42.864 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1323 2024-05-08T18:31:42.864 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.864 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:42.864 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.864 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:42.864 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.415356+0000", 2024-05-08T18:31:42.864 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:42.864 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.864 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.864 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:42.865 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.415356+0000", 2024-05-08T18:31:42.865 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:42.865 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.865 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.865 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:42.865 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.415359+0000", 2024-05-08T18:31:42.865 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.835e-06 2024-05-08T18:31:42.865 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.865 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.865 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:42.865 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.417337+0000", 2024-05-08T18:31:42.865 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001978198 2024-05-08T18:31:42.865 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.865 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.866 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:42.866 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.417388+0000", 2024-05-08T18:31:42.866 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.0983999999999998e-05 2024-05-08T18:31:42.866 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.866 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.866 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:42.866 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.417410+0000", 2024-05-08T18:31:42.866 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2062e-05 2024-05-08T18:31:42.866 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.866 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.866 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:42.866 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.417500+0000", 2024-05-08T18:31:42.866 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9703000000000005e-05 2024-05-08T18:31:42.867 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.867 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.867 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:42.867 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.417640+0000", 2024-05-08T18:31:42.867 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000140082 2024-05-08T18:31:42.867 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.867 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.867 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-05-08T18:31:42.867 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.417759+0000", 2024-05-08T18:31:42.867 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000118559 2024-05-08T18:31:42.867 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.867 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.867 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:42.867 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.429647+0000", 2024-05-08T18:31:42.868 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011888266999999999 2024-05-08T18:31:42.868 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.868 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.868 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:42.868 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.430487+0000", 2024-05-08T18:31:42.868 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00083960999999999997 2024-05-08T18:31:42.868 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.868 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.868 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:42.868 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.430548+0000", 2024-05-08T18:31:42.868 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0881999999999997e-05 2024-05-08T18:31:42.868 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.868 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.868 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:42.869 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.430595+0000", 2024-05-08T18:31:42.869 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7787999999999997e-05 2024-05-08T18:31:42.869 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:42.869 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:42.869 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:42.869 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.869 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.869 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1330 3.8 3:124da8ab:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-08T18:31:42.869 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.493255+0000", 2024-05-08T18:31:42.869 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.28051052399999998, 2024-05-08T18:31:42.869 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.016189959, 2024-05-08T18:31:42.869 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:42.869 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:42.869 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:42.870 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:42.870 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:42.870 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:42.870 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1330 2024-05-08T18:31:42.870 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.870 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:42.870 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.870 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:42.870 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.493255+0000", 2024-05-08T18:31:42.870 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:42.870 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.870 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.870 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:42.870 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.493255+0000", 2024-05-08T18:31:42.871 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:42.871 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.871 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.871 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:42.871 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.493258+0000", 2024-05-08T18:31:42.871 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0180000000000002e-06 2024-05-08T18:31:42.871 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.871 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.871 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:42.871 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.494859+0000", 2024-05-08T18:31:42.871 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001600853 2024-05-08T18:31:42.871 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.871 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.871 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:42.872 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.494883+0000", 2024-05-08T18:31:42.872 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4680000000000001e-05 2024-05-08T18:31:42.872 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.872 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.872 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:42.872 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.494894+0000", 2024-05-08T18:31:42.872 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0601999999999999e-05 2024-05-08T18:31:42.872 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.872 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.872 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:42.872 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.494972+0000", 2024-05-08T18:31:42.872 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.8534000000000004e-05 2024-05-08T18:31:42.872 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.872 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.872 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:42.873 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.495134+0000", 2024-05-08T18:31:42.873 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016150999999999999 2024-05-08T18:31:42.873 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.873 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.873 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-05-08T18:31:42.873 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.495261+0000", 2024-05-08T18:31:42.873 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012695600000000001 2024-05-08T18:31:42.873 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.873 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.873 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:42.873 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.508455+0000", 2024-05-08T18:31:42.873 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.013194449 2024-05-08T18:31:42.873 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.873 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.874 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:42.874 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.509294+0000", 2024-05-08T18:31:42.874 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000839061 2024-05-08T18:31:42.874 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.874 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.874 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:42.874 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.509388+0000", 2024-05-08T18:31:42.874 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.3682000000000002e-05 2024-05-08T18:31:42.874 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.874 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.874 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:42.874 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.509445+0000", 2024-05-08T18:31:42.874 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6613999999999997e-05 2024-05-08T18:31:42.874 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:42.874 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:42.875 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:42.875 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.875 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.875 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1336 3.2 3:42c6ce4f:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:42.875 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.558532+0000", 2024-05-08T18:31:42.875 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.215233076, 2024-05-08T18:31:42.875 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.033214269999999997, 2024-05-08T18:31:42.875 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:42.875 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:42.875 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:42.875 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:42.875 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:42.875 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:42.876 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1336 2024-05-08T18:31:42.876 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.876 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:42.876 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.876 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:42.876 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.558532+0000", 2024-05-08T18:31:42.876 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:42.876 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.876 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.876 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:42.876 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.558532+0000", 2024-05-08T18:31:42.876 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:42.876 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.876 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.876 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:42.877 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.558535+0000", 2024-05-08T18:31:42.877 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9689999999999999e-06 2024-05-08T18:31:42.877 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.877 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.877 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:42.877 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.560549+0000", 2024-05-08T18:31:42.877 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0020142469999999998 2024-05-08T18:31:42.877 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.877 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.877 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:42.877 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.560576+0000", 2024-05-08T18:31:42.877 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6908000000000001e-05 2024-05-08T18:31:42.877 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.877 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.878 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:42.878 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.560595+0000", 2024-05-08T18:31:42.878 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8383999999999999e-05 2024-05-08T18:31:42.878 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.878 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.878 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:42.878 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.560680+0000", 2024-05-08T18:31:42.878 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5424000000000001e-05 2024-05-08T18:31:42.878 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.878 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.878 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-05-08T18:31:42.878 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.560685+0000", 2024-05-08T18:31:42.878 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.327e-06 2024-05-08T18:31:42.878 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.879 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.879 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:42.879 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.570079+0000", 2024-05-08T18:31:42.879 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0093940680000000002 2024-05-08T18:31:42.879 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.879 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.879 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:42.879 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.570249+0000", 2024-05-08T18:31:42.879 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000169953 2024-05-08T18:31:42.879 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.879 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.879 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-05-08T18:31:42.879 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.570423+0000", 2024-05-08T18:31:42.879 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00017355499999999999 2024-05-08T18:31:42.880 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.880 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.880 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:42.880 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.590293+0000", 2024-05-08T18:31:42.880 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019869761999999999 2024-05-08T18:31:42.880 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.880 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.880 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:42.880 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.591628+0000", 2024-05-08T18:31:42.880 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0013351599999999999 2024-05-08T18:31:42.880 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.880 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.880 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:42.880 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.591692+0000", 2024-05-08T18:31:42.880 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3822e-05 2024-05-08T18:31:42.881 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.881 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.881 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:42.881 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.591746+0000", 2024-05-08T18:31:42.881 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4691000000000002e-05 2024-05-08T18:31:42.881 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:42.881 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:42.881 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:42.881 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.881 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.881 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1340 3.23 e82/21 3:c7ef75f6:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_26:head v 82'1, mlcod=0'0)", 2024-05-08T18:31:42.881 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.604118+0000", 2024-05-08T18:31:42.881 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.16964727800000001, 2024-05-08T18:31:42.881 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011974046, 2024-05-08T18:31:42.882 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:42.882 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:42.882 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:42.882 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:42.882 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.882 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:42.882 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.604118+0000", 2024-05-08T18:31:42.882 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:42.882 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.882 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.882 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:42.882 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.604118+0000", 2024-05-08T18:31:42.882 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:42.882 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.882 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.883 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:42.883 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.604118+0000", 2024-05-08T18:31:42.883 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.53e-07 2024-05-08T18:31:42.883 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.883 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.883 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:42.883 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.605931+0000", 2024-05-08T18:31:42.883 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0018125249999999999 2024-05-08T18:31:42.883 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.883 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.883 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:42.883 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.605952+0000", 2024-05-08T18:31:42.883 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0896000000000001e-05 2024-05-08T18:31:42.883 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.884 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.884 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:42.884 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.605961+0000", 2024-05-08T18:31:42.884 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.3270000000000007e-06 2024-05-08T18:31:42.884 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.884 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.884 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:42.884 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.606028+0000", 2024-05-08T18:31:42.884 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7237999999999996e-05 2024-05-08T18:31:42.884 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.884 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.884 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:42.884 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.606050+0000", 2024-05-08T18:31:42.885 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1934e-05 2024-05-08T18:31:42.885 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.885 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.885 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:42.885 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.616030+0000", 2024-05-08T18:31:42.885 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0099800740000000002 2024-05-08T18:31:42.885 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.885 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.885 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:42.885 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.616092+0000", 2024-05-08T18:31:42.885 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1798999999999996e-05 2024-05-08T18:31:42.885 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:42.885 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:42.885 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:42.886 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.886 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.886 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1341 3.5 e82/46 3:a0d72baa:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_27:head v 82'1, mlcod=0'0)", 2024-05-08T18:31:42.886 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.616372+0000", 2024-05-08T18:31:42.886 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.15739328299999999, 2024-05-08T18:31:42.886 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.01113834, 2024-05-08T18:31:42.886 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:42.886 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:42.886 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:42.886 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:42.886 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.886 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:42.886 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.616372+0000", 2024-05-08T18:31:42.887 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:42.887 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.887 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.887 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:42.887 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.616372+0000", 2024-05-08T18:31:42.887 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:42.887 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.887 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.887 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:42.887 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.616372+0000", 2024-05-08T18:31:42.887 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5800000000000001e-07 2024-05-08T18:31:42.887 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.887 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.887 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:42.888 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.617692+0000", 2024-05-08T18:31:42.888 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001319408 2024-05-08T18:31:42.888 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.888 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.888 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:42.888 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.617718+0000", 2024-05-08T18:31:42.888 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6506e-05 2024-05-08T18:31:42.888 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.888 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.888 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:42.888 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.617733+0000", 2024-05-08T18:31:42.888 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4588e-05 2024-05-08T18:31:42.888 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.888 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.889 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:42.889 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.617804+0000", 2024-05-08T18:31:42.889 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.0919000000000003e-05 2024-05-08T18:31:42.889 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.889 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.889 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:42.889 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.617827+0000", 2024-05-08T18:31:42.889 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3600000000000001e-05 2024-05-08T18:31:42.889 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.889 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.889 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:42.889 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.627441+0000", 2024-05-08T18:31:42.889 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0096142689999999999 2024-05-08T18:31:42.890 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.890 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.890 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:42.890 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.627510+0000", 2024-05-08T18:31:42.890 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8792000000000001e-05 2024-05-08T18:31:42.890 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:42.890 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:42.890 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:42.890 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.890 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.890 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1346 3.29 3:9766a0f4:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_32:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:42.890 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.663599+0000", 2024-05-08T18:31:42.890 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.110166288, 2024-05-08T18:31:42.891 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.018562168, 2024-05-08T18:31:42.891 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:42.891 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:42.891 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:42.891 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:42.891 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:42.891 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:42.891 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1346 2024-05-08T18:31:42.891 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.891 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:42.891 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.891 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:42.891 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.663599+0000", 2024-05-08T18:31:42.891 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:42.891 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.892 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.892 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:42.892 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.663599+0000", 2024-05-08T18:31:42.892 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:42.892 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.892 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.892 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:42.892 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.663601+0000", 2024-05-08T18:31:42.892 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.328e-06 2024-05-08T18:31:42.892 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.892 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.892 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:42.892 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.665307+0000", 2024-05-08T18:31:42.893 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0017060879999999999 2024-05-08T18:31:42.893 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.893 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.893 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:42.893 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.665332+0000", 2024-05-08T18:31:42.893 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5142000000000001e-05 2024-05-08T18:31:42.893 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.893 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.893 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:42.893 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.665344+0000", 2024-05-08T18:31:42.893 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1464000000000001e-05 2024-05-08T18:31:42.893 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.893 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.893 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:42.894 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.665419+0000", 2024-05-08T18:31:42.894 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.5129000000000005e-05 2024-05-08T18:31:42.894 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.894 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.894 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:42.894 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.665529+0000", 2024-05-08T18:31:42.894 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000109787 2024-05-08T18:31:42.894 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.894 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.894 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:31:42.894 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.665627+0000", 2024-05-08T18:31:42.894 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.8190999999999996e-05 2024-05-08T18:31:42.894 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.894 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.895 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:42.895 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.673488+0000", 2024-05-08T18:31:42.895 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0078611819999999995 2024-05-08T18:31:42.895 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.895 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.895 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:42.895 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.682043+0000", 2024-05-08T18:31:42.895 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0085545829999999993 2024-05-08T18:31:42.895 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.895 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.895 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:42.895 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.682106+0000", 2024-05-08T18:31:42.895 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.2706000000000006e-05 2024-05-08T18:31:42.895 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.896 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.896 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:42.896 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.682161+0000", 2024-05-08T18:31:42.896 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5568000000000001e-05 2024-05-08T18:31:42.896 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:42.896 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:42.896 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:42.896 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.896 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.896 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1348 3.38 3:1ca8d3e1:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_34:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:42.896 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.684650+0000", 2024-05-08T18:31:42.896 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.089115178000000003, 2024-05-08T18:31:42.896 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.018994840999999998, 2024-05-08T18:31:42.896 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:42.897 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:42.897 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:42.897 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:42.897 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:42.897 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:42.897 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1348 2024-05-08T18:31:42.897 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.897 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:42.897 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.897 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:42.897 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.684650+0000", 2024-05-08T18:31:42.897 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:42.897 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.898 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.898 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:42.898 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.684650+0000", 2024-05-08T18:31:42.898 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:42.898 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.898 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.898 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:42.898 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.684652+0000", 2024-05-08T18:31:42.898 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3860000000000001e-06 2024-05-08T18:31:42.898 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.898 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.898 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:42.898 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.686933+0000", 2024-05-08T18:31:42.898 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0022806369999999999 2024-05-08T18:31:42.899 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.899 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.899 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:42.899 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.686950+0000", 2024-05-08T18:31:42.899 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7377e-05 2024-05-08T18:31:42.899 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.899 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.899 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:42.899 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.686962+0000", 2024-05-08T18:31:42.899 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1756000000000001e-05 2024-05-08T18:31:42.899 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.899 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.899 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:42.899 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.687038+0000", 2024-05-08T18:31:42.900 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.5623000000000004e-05 2024-05-08T18:31:42.900 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.900 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.900 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:42.900 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.687226+0000", 2024-05-08T18:31:42.900 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000188457 2024-05-08T18:31:42.900 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.900 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.900 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:42.900 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.687394+0000", 2024-05-08T18:31:42.900 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016753300000000001 2024-05-08T18:31:42.900 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.900 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.900 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:42.901 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.694346+0000", 2024-05-08T18:31:42.901 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0069519639999999997 2024-05-08T18:31:42.901 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.901 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.901 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:42.901 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.703479+0000", 2024-05-08T18:31:42.901 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0091331829999999996 2024-05-08T18:31:42.901 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.901 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.901 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:42.901 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.703567+0000", 2024-05-08T18:31:42.901 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8294000000000005e-05 2024-05-08T18:31:42.902 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.902 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.902 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:42.902 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.703645+0000", 2024-05-08T18:31:42.902 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7631000000000003e-05 2024-05-08T18:31:42.902 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:42.902 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:42.902 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:42.902 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.902 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.902 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1349 3.27 3:e5090c80:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_35:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:42.902 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.696361+0000", 2024-05-08T18:31:42.902 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.077404107999999999, 2024-05-08T18:31:42.903 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019944929, 2024-05-08T18:31:42.903 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:42.903 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:42.903 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:42.903 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:42.903 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:42.903 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:42.903 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1349 2024-05-08T18:31:42.903 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.903 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:42.903 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.903 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:42.903 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.696361+0000", 2024-05-08T18:31:42.904 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:42.904 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.904 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.904 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:42.904 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.696361+0000", 2024-05-08T18:31:42.904 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:42.904 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.904 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.904 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:42.904 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.696363+0000", 2024-05-08T18:31:42.904 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1160000000000002e-06 2024-05-08T18:31:42.904 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.904 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.905 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:42.905 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.698294+0000", 2024-05-08T18:31:42.905 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001931026 2024-05-08T18:31:42.905 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.905 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.905 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:42.905 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.698324+0000", 2024-05-08T18:31:42.905 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9658e-05 2024-05-08T18:31:42.905 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.905 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.905 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:42.905 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.698339+0000", 2024-05-08T18:31:42.905 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5381000000000001e-05 2024-05-08T18:31:42.905 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.906 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.906 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:42.906 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.698430+0000", 2024-05-08T18:31:42.906 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0353999999999996e-05 2024-05-08T18:31:42.906 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.906 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.906 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:42.906 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.698591+0000", 2024-05-08T18:31:42.906 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016140999999999999 2024-05-08T18:31:42.906 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.906 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.906 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:31:42.906 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.698741+0000", 2024-05-08T18:31:42.906 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014955099999999999 2024-05-08T18:31:42.907 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.907 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.907 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:42.907 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.706987+0000", 2024-05-08T18:31:42.907 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0082466599999999994 2024-05-08T18:31:42.907 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.907 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.907 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:42.907 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.716183+0000", 2024-05-08T18:31:42.907 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0091959529999999998 2024-05-08T18:31:42.907 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.907 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.907 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:42.907 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.716252+0000", 2024-05-08T18:31:42.907 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8804000000000001e-05 2024-05-08T18:31:42.908 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.908 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.908 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:42.908 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.716306+0000", 2024-05-08T18:31:42.908 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4015999999999999e-05 2024-05-08T18:31:42.908 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:42.908 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:42.908 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:42.908 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.908 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.908 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1351 3.27 3:e75c4558:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_37:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:42.908 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.719093+0000", 2024-05-08T18:31:42.908 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.054671758000000001, 2024-05-08T18:31:42.908 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.016526314, 2024-05-08T18:31:42.909 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:42.909 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:42.909 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:42.909 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:42.909 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:42.909 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:42.909 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1351 2024-05-08T18:31:42.909 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.909 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:42.909 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.909 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:42.909 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.719093+0000", 2024-05-08T18:31:42.909 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:42.910 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.910 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.910 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:42.910 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.719093+0000", 2024-05-08T18:31:42.910 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:42.910 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.910 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.910 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:42.910 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.719096+0000", 2024-05-08T18:31:42.910 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0249999999999998e-06 2024-05-08T18:31:42.910 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.910 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.910 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:42.910 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.721010+0000", 2024-05-08T18:31:42.911 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001913821 2024-05-08T18:31:42.911 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.911 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.911 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:42.911 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.721041+0000", 2024-05-08T18:31:42.911 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0679000000000002e-05 2024-05-08T18:31:42.911 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.911 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.911 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:42.911 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.721056+0000", 2024-05-08T18:31:42.911 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4630999999999999e-05 2024-05-08T18:31:42.911 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.911 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.911 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:42.912 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.721139+0000", 2024-05-08T18:31:42.912 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.3174e-05 2024-05-08T18:31:42.912 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.912 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.912 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:42.912 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.721264+0000", 2024-05-08T18:31:42.912 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012507600000000001 2024-05-08T18:31:42.912 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.912 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.912 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:31:42.912 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.721361+0000", 2024-05-08T18:31:42.912 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.7406999999999998e-05 2024-05-08T18:31:42.912 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.912 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.912 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:42.913 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.731468+0000", 2024-05-08T18:31:42.913 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010107065 2024-05-08T18:31:42.913 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.913 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.913 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:42.913 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.735495+0000", 2024-05-08T18:31:42.913 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0040267080000000004 2024-05-08T18:31:42.913 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.913 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.913 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:42.913 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.735563+0000", 2024-05-08T18:31:42.913 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8195999999999996e-05 2024-05-08T18:31:42.913 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.913 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.914 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:42.914 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.735620+0000", 2024-05-08T18:31:42.914 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6532e-05 2024-05-08T18:31:42.914 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:42.914 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:42.914 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:42.914 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.914 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.914 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1353 3.19 e82/21 3:9832a795:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_39:head v 82'1, mlcod=0'0)", 2024-05-08T18:31:42.914 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.742694+0000", 2024-05-08T18:31:42.914 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.031071003, 2024-05-08T18:31:42.914 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012213956999999999, 2024-05-08T18:31:42.914 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:42.914 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:42.915 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:42.915 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:42.915 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.915 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:42.915 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.742694+0000", 2024-05-08T18:31:42.915 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:42.915 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.915 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.915 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:42.915 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.742694+0000", 2024-05-08T18:31:42.915 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:42.915 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.915 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.915 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:42.916 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.742696+0000", 2024-05-08T18:31:42.916 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.691e-06 2024-05-08T18:31:42.916 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.916 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.916 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:42.916 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.744900+0000", 2024-05-08T18:31:42.916 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0022044819999999998 2024-05-08T18:31:42.916 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.916 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.916 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:42.916 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.744922+0000", 2024-05-08T18:31:42.916 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1829000000000001e-05 2024-05-08T18:31:42.916 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.916 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.917 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:42.917 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.744931+0000", 2024-05-08T18:31:42.917 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8240000000000006e-06 2024-05-08T18:31:42.917 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.917 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.917 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:42.917 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.745004+0000", 2024-05-08T18:31:42.917 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.3003000000000006e-05 2024-05-08T18:31:42.917 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.917 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.917 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:42.917 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.745022+0000", 2024-05-08T18:31:42.917 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7773000000000001e-05 2024-05-08T18:31:42.917 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.918 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.918 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:42.918 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.754852+0000", 2024-05-08T18:31:42.918 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0098301369999999992 2024-05-08T18:31:42.918 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:42.918 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:42.918 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:42.918 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.754908+0000", 2024-05-08T18:31:42.918 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6218000000000003e-05 2024-05-08T18:31:42.918 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:42.918 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:42.918 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:42.918 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:42.918 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:42.919 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:42.920 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-08T18:31:42.920 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:31:42.921+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:31:43.020 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:31:43.018+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:31:43.062 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:31:43.062 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:31:43.062 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 0 2024-05-08T18:31:43.062 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:31:43.082 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-08T18:31:43.129 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:31:43.126+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:31:43.206 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-08T18:31:43.252 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:31:43.253+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:31:43.266 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:31:43.266 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:31:43.266 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2024-05-08T18:31:43.266 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2024-05-08T18:31:43.266 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:31:43.284 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-08T18:31:43.328 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:31:43.326+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:31:43.370 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2024-05-08T18:31:43.371 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:31:43.393 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2024-05-08T18:31:43.393 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:31:43.412 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2024-05-08T18:31:43.412 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:31:43.424 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:31:43.422+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:31:43.429 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:31:43.429 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2024-05-08T18:31:43.429 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2024-05-08T18:31:43.429 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-05-08T18:31:43.429 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.429 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1217 4.c 4:3273f745:::.dir.3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.2.6:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-05-08T18:31:43.429 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:37.800101+0000", 2024-05-08T18:31:43.429 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 5.6266141469999997, 2024-05-08T18:31:43.429 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0067770039999999997, 2024-05-08T18:31:43.430 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:43.430 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:43.430 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:43.430 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:43.430 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:31:43.430 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:43.430 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1217 2024-05-08T18:31:43.430 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.430 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:43.430 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.430 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:43.430 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:37.800101+0000", 2024-05-08T18:31:43.431 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:43.431 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.431 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.431 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:43.431 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:37.800101+0000", 2024-05-08T18:31:43.431 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:43.431 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.431 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.431 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:43.431 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:37.800103+0000", 2024-05-08T18:31:43.431 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3939999999999999e-06 2024-05-08T18:31:43.431 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.432 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.432 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:43.432 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:37.800116+0000", 2024-05-08T18:31:43.432 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2856e-05 2024-05-08T18:31:43.432 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.432 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.432 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:43.432 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:37.800166+0000", 2024-05-08T18:31:43.432 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0476999999999998e-05 2024-05-08T18:31:43.432 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.432 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.432 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:43.432 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:37.800185+0000", 2024-05-08T18:31:43.433 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8816000000000001e-05 2024-05-08T18:31:43.433 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.433 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.433 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:43.433 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:37.800358+0000", 2024-05-08T18:31:43.433 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017335500000000001 2024-05-08T18:31:43.433 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.433 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.433 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:43.433 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:37.800669+0000", 2024-05-08T18:31:43.434 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00031062800000000002 2024-05-08T18:31:43.434 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.434 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.434 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:43.434 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:37.801047+0000", 2024-05-08T18:31:43.434 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00037856100000000002 2024-05-08T18:31:43.434 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.434 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.434 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:43.434 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:37.805306+0000", 2024-05-08T18:31:43.434 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0042582009999999997 2024-05-08T18:31:43.434 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.435 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.435 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:43.435 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:37.806615+0000", 2024-05-08T18:31:43.435 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001309298 2024-05-08T18:31:43.435 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.435 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.435 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:43.435 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:37.806760+0000", 2024-05-08T18:31:43.435 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000144952 2024-05-08T18:31:43.435 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.435 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.435 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:43.435 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:37.806878+0000", 2024-05-08T18:31:43.435 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000118466 2024-05-08T18:31:43.436 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:43.436 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:43.436 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:43.436 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.436 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.436 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1218 4.1 4:82eedc4a:::.dir.3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.2.7:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-05-08T18:31:43.436 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:37.800232+0000", 2024-05-08T18:31:43.436 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 5.6264835839999998, 2024-05-08T18:31:43.436 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0059135990000000003, 2024-05-08T18:31:43.436 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:43.436 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:43.436 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:43.436 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:43.436 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:31:43.437 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:43.437 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1218 2024-05-08T18:31:43.437 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.437 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:43.437 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.437 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:43.437 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:37.800232+0000", 2024-05-08T18:31:43.437 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:43.437 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.437 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.437 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:43.437 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:37.800232+0000", 2024-05-08T18:31:43.437 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:43.437 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.438 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.438 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:43.438 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:37.800233+0000", 2024-05-08T18:31:43.438 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3799999999999999e-06 2024-05-08T18:31:43.438 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.438 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.438 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:43.438 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:37.800242+0000", 2024-05-08T18:31:43.438 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4060000000000005e-06 2024-05-08T18:31:43.438 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.438 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.438 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:43.438 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:37.800261+0000", 2024-05-08T18:31:43.438 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9677000000000002e-05 2024-05-08T18:31:43.439 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.439 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.439 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:43.439 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:37.800276+0000", 2024-05-08T18:31:43.439 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5043e-05 2024-05-08T18:31:43.439 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.439 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.439 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:43.439 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:37.800420+0000", 2024-05-08T18:31:43.439 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014317299999999999 2024-05-08T18:31:43.440 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.440 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.440 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:43.440 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:37.800730+0000", 2024-05-08T18:31:43.440 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00031058000000000002 2024-05-08T18:31:43.440 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.440 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.440 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:43.440 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:37.801105+0000", 2024-05-08T18:31:43.440 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00037511100000000002 2024-05-08T18:31:43.440 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.440 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.440 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:43.440 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:37.805388+0000", 2024-05-08T18:31:43.441 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0042823649999999998 2024-05-08T18:31:43.441 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.441 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.441 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:43.441 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:37.805886+0000", 2024-05-08T18:31:43.441 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00049823900000000004 2024-05-08T18:31:43.441 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.441 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.441 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:43.441 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:37.806044+0000", 2024-05-08T18:31:43.441 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015834900000000001 2024-05-08T18:31:43.441 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.441 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.441 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:43.441 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:37.806145+0000", 2024-05-08T18:31:43.442 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000101276 2024-05-08T18:31:43.442 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:43.442 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:43.442 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:43.442 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.442 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.442 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1220 4.2c 4:3508d0e5:::.dir.3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.2.9:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-05-08T18:31:43.442 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:37.800308+0000", 2024-05-08T18:31:43.442 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 5.6264076709999999, 2024-05-08T18:31:43.442 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0079252739999999995, 2024-05-08T18:31:43.442 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:43.442 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:43.442 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:43.442 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:43.443 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:31:43.443 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:43.443 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1220 2024-05-08T18:31:43.443 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.443 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:43.443 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.443 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:43.443 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:37.800308+0000", 2024-05-08T18:31:43.443 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:43.444 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.444 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.444 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:43.444 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:37.800308+0000", 2024-05-08T18:31:43.444 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:43.444 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.444 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.444 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:43.444 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:37.800309+0000", 2024-05-08T18:31:43.444 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3430000000000001e-06 2024-05-08T18:31:43.444 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.444 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.444 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:43.445 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:37.800317+0000", 2024-05-08T18:31:43.445 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5900000000000002e-06 2024-05-08T18:31:43.445 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.445 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.445 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:43.445 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:37.800339+0000", 2024-05-08T18:31:43.445 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2175999999999999e-05 2024-05-08T18:31:43.445 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.445 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.445 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:43.445 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:37.800352+0000", 2024-05-08T18:31:43.445 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3033e-05 2024-05-08T18:31:43.445 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.446 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.446 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:43.446 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:37.801761+0000", 2024-05-08T18:31:43.446 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00140906 2024-05-08T18:31:43.446 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.446 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.446 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:43.446 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:37.802079+0000", 2024-05-08T18:31:43.446 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00031769099999999999 2024-05-08T18:31:43.446 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.446 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.446 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:31:43.446 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:37.802488+0000", 2024-05-08T18:31:43.446 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00040917299999999998 2024-05-08T18:31:43.447 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.447 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.447 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:43.447 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:37.807965+0000", 2024-05-08T18:31:43.447 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.005477333 2024-05-08T18:31:43.447 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.447 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.447 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:43.447 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:37.808067+0000", 2024-05-08T18:31:43.447 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010203 2024-05-08T18:31:43.447 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.447 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.447 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:43.448 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:37.808149+0000", 2024-05-08T18:31:43.448 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2281999999999996e-05 2024-05-08T18:31:43.448 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.448 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.448 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:43.448 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:37.808233+0000", 2024-05-08T18:31:43.448 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3562999999999999e-05 2024-05-08T18:31:43.448 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:43.448 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:43.448 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:43.448 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.448 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.448 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1315 3.2c e81/21 3:368ed9cc:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_1:head v 81'1, mlcod=0'0)", 2024-05-08T18:31:43.448 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.310943+0000", 2024-05-08T18:31:43.449 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 1.115772813, 2024-05-08T18:31:43.449 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019031756, 2024-05-08T18:31:43.449 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:43.449 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:43.449 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:43.449 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:43.449 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.449 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:43.449 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.310943+0000", 2024-05-08T18:31:43.449 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:43.449 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.449 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.449 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:43.449 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.310943+0000", 2024-05-08T18:31:43.450 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:43.450 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.450 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.450 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:43.450 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.310945+0000", 2024-05-08T18:31:43.450 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7800000000000001e-06 2024-05-08T18:31:43.450 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.450 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.450 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:43.450 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.315838+0000", 2024-05-08T18:31:43.450 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0048930800000000002 2024-05-08T18:31:43.450 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.450 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.451 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:43.451 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.315886+0000", 2024-05-08T18:31:43.451 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7336000000000002e-05 2024-05-08T18:31:43.451 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.451 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.451 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:43.451 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.315912+0000", 2024-05-08T18:31:43.451 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6584000000000002e-05 2024-05-08T18:31:43.451 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.451 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.451 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:43.451 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.316123+0000", 2024-05-08T18:31:43.451 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00021075400000000001 2024-05-08T18:31:43.451 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.452 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.452 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:43.452 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.316165+0000", 2024-05-08T18:31:43.452 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1709999999999999e-05 2024-05-08T18:31:43.452 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.452 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.452 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:43.452 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.329876+0000", 2024-05-08T18:31:43.452 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013710803000000001 2024-05-08T18:31:43.452 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.452 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.452 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:43.452 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.329974+0000", 2024-05-08T18:31:43.452 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8709000000000006e-05 2024-05-08T18:31:43.453 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:43.453 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:43.453 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:43.453 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.453 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.453 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1321 3.1b e81/21 3:d9207229:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_7:head v 81'1, mlcod=0'0)", 2024-05-08T18:31:43.453 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.391574+0000", 2024-05-08T18:31:43.453 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 1.035141031, 2024-05-08T18:31:43.453 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016614245, 2024-05-08T18:31:43.453 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:43.453 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:43.453 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:43.453 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:43.453 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.454 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:43.454 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.391574+0000", 2024-05-08T18:31:43.454 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:43.454 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.454 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.454 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:43.454 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.391574+0000", 2024-05-08T18:31:43.454 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:43.454 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.454 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.454 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:43.454 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.391578+0000", 2024-05-08T18:31:43.454 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3440000000000001e-06 2024-05-08T18:31:43.454 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.455 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.455 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:43.455 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.396175+0000", 2024-05-08T18:31:43.455 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0045968850000000002 2024-05-08T18:31:43.455 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.455 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.455 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:43.455 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.396209+0000", 2024-05-08T18:31:43.455 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4146000000000001e-05 2024-05-08T18:31:43.455 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.455 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.455 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:43.455 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.396228+0000", 2024-05-08T18:31:43.456 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9687e-05 2024-05-08T18:31:43.456 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.456 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.456 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:43.456 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.396353+0000", 2024-05-08T18:31:43.456 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012448200000000001 2024-05-08T18:31:43.456 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.456 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.456 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:43.456 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.396392+0000", 2024-05-08T18:31:43.456 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9419999999999999e-05 2024-05-08T18:31:43.456 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.456 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.456 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:43.457 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.408054+0000", 2024-05-08T18:31:43.457 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011661695999999999 2024-05-08T18:31:43.457 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.457 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.457 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:43.457 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.408189+0000", 2024-05-08T18:31:43.457 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000134585 2024-05-08T18:31:43.457 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:43.457 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:43.457 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:43.457 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.457 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.457 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1322 3.f e81/21 3:f3016725:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_8:head v 81'1, mlcod=0'0)", 2024-05-08T18:31:43.457 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.404407+0000", 2024-05-08T18:31:43.458 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 1.0223080099999999, 2024-05-08T18:31:43.458 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016824525999999999, 2024-05-08T18:31:43.458 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:43.458 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:43.458 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:43.458 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:43.458 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.458 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:43.458 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.404407+0000", 2024-05-08T18:31:43.458 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:43.458 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.458 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.459 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:43.459 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.404407+0000", 2024-05-08T18:31:43.459 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:43.459 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.459 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.459 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:43.459 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.404409+0000", 2024-05-08T18:31:43.459 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9460000000000001e-06 2024-05-08T18:31:43.459 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.459 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.459 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:43.459 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.409446+0000", 2024-05-08T18:31:43.459 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.005036942 2024-05-08T18:31:43.459 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.460 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.460 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:43.460 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.409476+0000", 2024-05-08T18:31:43.460 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.9346999999999999e-05 2024-05-08T18:31:43.460 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.460 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.460 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:43.460 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.409498+0000", 2024-05-08T18:31:43.460 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2690000000000001e-05 2024-05-08T18:31:43.460 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.460 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.460 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:43.460 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.409607+0000", 2024-05-08T18:31:43.461 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000108546 2024-05-08T18:31:43.461 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.461 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.461 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:43.461 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.409643+0000", 2024-05-08T18:31:43.461 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5719000000000001e-05 2024-05-08T18:31:43.461 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.461 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.461 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:43.461 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.421097+0000", 2024-05-08T18:31:43.461 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011454166999999999 2024-05-08T18:31:43.461 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.461 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.462 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:43.462 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.421232+0000", 2024-05-08T18:31:43.462 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013516900000000001 2024-05-08T18:31:43.462 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:43.462 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:43.462 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:43.462 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.462 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.462 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1326 3.1b e81/21 3:da64adf7:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_12:head v 81'2, mlcod=0'0)", 2024-05-08T18:31:43.462 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.453834+0000", 2024-05-08T18:31:43.462 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.97288183900000003, 2024-05-08T18:31:43.462 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015468416, 2024-05-08T18:31:43.462 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:43.463 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:43.463 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:43.463 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:43.463 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.463 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:43.463 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.453834+0000", 2024-05-08T18:31:43.463 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:43.463 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.463 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.463 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:43.463 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.453834+0000", 2024-05-08T18:31:43.463 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:43.463 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.463 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.464 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:43.464 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.453836+0000", 2024-05-08T18:31:43.464 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1830000000000001e-06 2024-05-08T18:31:43.464 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.464 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.464 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:43.464 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.459099+0000", 2024-05-08T18:31:43.464 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0052629499999999997 2024-05-08T18:31:43.464 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.464 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.464 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:43.464 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.459134+0000", 2024-05-08T18:31:43.464 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5437e-05 2024-05-08T18:31:43.464 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.465 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.465 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:43.465 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.459151+0000", 2024-05-08T18:31:43.465 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6506000000000001e-05 2024-05-08T18:31:43.465 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.465 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.465 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:43.465 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.459335+0000", 2024-05-08T18:31:43.465 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00018429500000000001 2024-05-08T18:31:43.465 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.465 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.465 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:43.465 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.459376+0000", 2024-05-08T18:31:43.466 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.07e-05 2024-05-08T18:31:43.466 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.466 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.466 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:43.466 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.469198+0000", 2024-05-08T18:31:43.466 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0098225489999999999 2024-05-08T18:31:43.466 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.466 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.466 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:43.466 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.469302+0000", 2024-05-08T18:31:43.466 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010379599999999999 2024-05-08T18:31:43.466 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:43.466 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:43.467 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:43.467 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.467 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.467 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1327 3.1a 3:58da5138:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-08T18:31:43.467 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.463447+0000", 2024-05-08T18:31:43.467 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.96326853199999996, 2024-05-08T18:31:43.467 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018677618999999999, 2024-05-08T18:31:43.467 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:43.467 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:43.467 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:43.467 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:43.467 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:31:43.467 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:43.467 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1327 2024-05-08T18:31:43.468 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.468 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:43.468 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.468 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:43.468 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.463447+0000", 2024-05-08T18:31:43.468 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:43.468 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.468 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.468 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:43.468 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.463447+0000", 2024-05-08T18:31:43.468 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:43.468 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.468 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.468 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:43.469 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.463455+0000", 2024-05-08T18:31:43.469 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2430000000000005e-06 2024-05-08T18:31:43.469 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.469 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.469 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:43.469 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.469224+0000", 2024-05-08T18:31:43.469 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0057690830000000004 2024-05-08T18:31:43.469 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.469 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.469 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:43.469 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.469255+0000", 2024-05-08T18:31:43.469 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1000000000000001e-05 2024-05-08T18:31:43.469 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.469 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.470 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:43.470 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.469273+0000", 2024-05-08T18:31:43.470 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7920000000000001e-05 2024-05-08T18:31:43.470 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.474 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.474 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:43.474 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.469451+0000", 2024-05-08T18:31:43.474 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017836499999999999 2024-05-08T18:31:43.474 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.474 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.474 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:43.474 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.469687+0000", 2024-05-08T18:31:43.474 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000235255 2024-05-08T18:31:43.474 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.474 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.474 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:31:43.475 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.469899+0000", 2024-05-08T18:31:43.475 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00021257200000000001 2024-05-08T18:31:43.475 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.475 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.475 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:43.475 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.480590+0000", 2024-05-08T18:31:43.475 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010690963 2024-05-08T18:31:43.475 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.475 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.475 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:43.475 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.481813+0000", 2024-05-08T18:31:43.475 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001223001 2024-05-08T18:31:43.475 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.476 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.476 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:43.476 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.481982+0000", 2024-05-08T18:31:43.476 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016828500000000001 2024-05-08T18:31:43.476 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.476 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.476 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:43.476 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.482124+0000", 2024-05-08T18:31:43.476 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014293199999999999 2024-05-08T18:31:43.476 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:43.476 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:43.476 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:43.476 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.477 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.477 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1328 3.14 3:2b0d89be:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-08T18:31:43.477 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.473844+0000", 2024-05-08T18:31:43.477 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.95287164300000005, 2024-05-08T18:31:43.477 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.031713811000000001, 2024-05-08T18:31:43.477 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:43.477 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:43.477 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:43.477 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:43.477 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:31:43.477 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:43.477 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1328 2024-05-08T18:31:43.477 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.477 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:43.478 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.478 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:43.478 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.473844+0000", 2024-05-08T18:31:43.478 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:43.478 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.478 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.478 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:43.478 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.473844+0000", 2024-05-08T18:31:43.478 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:43.478 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.478 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.478 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:43.478 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.473847+0000", 2024-05-08T18:31:43.479 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3100000000000001e-06 2024-05-08T18:31:43.479 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.479 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.479 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:43.479 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.479452+0000", 2024-05-08T18:31:43.479 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0056046910000000002 2024-05-08T18:31:43.479 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.479 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.479 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:43.479 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.479485+0000", 2024-05-08T18:31:43.479 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2808999999999997e-05 2024-05-08T18:31:43.479 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.479 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.480 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:43.480 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.479508+0000", 2024-05-08T18:31:43.480 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3119999999999999e-05 2024-05-08T18:31:43.480 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.480 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.480 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:43.480 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.479638+0000", 2024-05-08T18:31:43.480 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000130586 2024-05-08T18:31:43.480 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.480 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.480 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:43.480 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.479896+0000", 2024-05-08T18:31:43.480 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00025793799999999998 2024-05-08T18:31:43.481 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.481 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.481 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:43.481 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.480111+0000", 2024-05-08T18:31:43.481 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00021487200000000001 2024-05-08T18:31:43.481 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.481 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.481 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:43.481 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.502946+0000", 2024-05-08T18:31:43.481 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.022835101 2024-05-08T18:31:43.481 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.481 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.481 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:43.481 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.505389+0000", 2024-05-08T18:31:43.481 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0024426510000000001 2024-05-08T18:31:43.482 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.482 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.482 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:43.482 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.505479+0000", 2024-05-08T18:31:43.482 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.9863000000000003e-05 2024-05-08T18:31:43.482 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.482 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.482 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:43.482 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.505558+0000", 2024-05-08T18:31:43.482 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8869999999999995e-05 2024-05-08T18:31:43.482 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:43.482 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:43.482 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:43.483 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.483 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.483 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1332 3.14 3:2bdfae75:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-08T18:31:43.483 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.514410+0000", 2024-05-08T18:31:43.483 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.91230551900000001, 2024-05-08T18:31:43.483 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.026281202, 2024-05-08T18:31:43.483 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:43.483 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:43.483 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:43.483 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:43.483 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:31:43.483 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:43.483 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1332 2024-05-08T18:31:43.484 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.484 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:43.484 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.484 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:43.484 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.514410+0000", 2024-05-08T18:31:43.484 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:43.484 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.484 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.484 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:43.484 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.514410+0000", 2024-05-08T18:31:43.484 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:43.484 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.484 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.484 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:43.485 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.514413+0000", 2024-05-08T18:31:43.485 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3160000000000001e-06 2024-05-08T18:31:43.485 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.485 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.485 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:43.485 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.519067+0000", 2024-05-08T18:31:43.485 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0046540319999999998 2024-05-08T18:31:43.485 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.485 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.485 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:43.485 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.519104+0000", 2024-05-08T18:31:43.485 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6890000000000001e-05 2024-05-08T18:31:43.485 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.486 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.486 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:43.486 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.519121+0000", 2024-05-08T18:31:43.486 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6583e-05 2024-05-08T18:31:43.486 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.486 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.486 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:43.486 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.519235+0000", 2024-05-08T18:31:43.486 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000114233 2024-05-08T18:31:43.486 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.486 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.486 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:43.486 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.519509+0000", 2024-05-08T18:31:43.487 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000274534 2024-05-08T18:31:43.487 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.487 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.487 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:43.487 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.519763+0000", 2024-05-08T18:31:43.487 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000253088 2024-05-08T18:31:43.487 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.487 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.487 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:43.487 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.532461+0000", 2024-05-08T18:31:43.487 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012698134 2024-05-08T18:31:43.487 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.487 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.488 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:43.488 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.540405+0000", 2024-05-08T18:31:43.488 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0079440699999999993 2024-05-08T18:31:43.488 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.488 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.488 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:43.488 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.540577+0000", 2024-05-08T18:31:43.488 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017180299999999999 2024-05-08T18:31:43.488 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.488 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.488 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:43.488 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.540691+0000", 2024-05-08T18:31:43.488 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011451900000000001 2024-05-08T18:31:43.488 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:43.488 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:43.489 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:43.489 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.489 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.489 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1334 3.f e81/21 3:f1b2aee4:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_20:head v 81'2, mlcod=0'0)", 2024-05-08T18:31:43.489 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.540860+0000", 2024-05-08T18:31:43.489 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.88585551200000001, 2024-05-08T18:31:43.489 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015497903, 2024-05-08T18:31:43.489 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:43.489 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:43.489 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:43.489 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:43.489 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.490 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:43.490 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.540860+0000", 2024-05-08T18:31:43.490 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:43.490 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.490 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.490 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:43.490 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.540860+0000", 2024-05-08T18:31:43.490 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:43.490 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.490 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.490 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:43.490 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.540861+0000", 2024-05-08T18:31:43.490 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5099999999999999e-06 2024-05-08T18:31:43.491 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.491 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.491 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:43.491 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.543997+0000", 2024-05-08T18:31:43.491 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0031360770000000001 2024-05-08T18:31:43.491 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.491 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.491 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:43.491 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.544040+0000", 2024-05-08T18:31:43.491 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.2743000000000001e-05 2024-05-08T18:31:43.491 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.491 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.491 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:43.491 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.544066+0000", 2024-05-08T18:31:43.492 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5999999999999998e-05 2024-05-08T18:31:43.492 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.492 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.492 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:43.492 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.544235+0000", 2024-05-08T18:31:43.492 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000168985 2024-05-08T18:31:43.492 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.492 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.492 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:43.492 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.544303+0000", 2024-05-08T18:31:43.492 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7392999999999997e-05 2024-05-08T18:31:43.492 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.492 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.493 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:43.493 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.556090+0000", 2024-05-08T18:31:43.493 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011786904000000001 2024-05-08T18:31:43.493 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.493 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.493 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:43.493 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.556358+0000", 2024-05-08T18:31:43.493 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00026829099999999998 2024-05-08T18:31:43.493 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:43.493 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:43.493 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:43.493 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.493 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.494 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1344 3.11 e82/21 3:887b1945:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_30:head v 82'1, mlcod=0'0)", 2024-05-08T18:31:43.494 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.649641+0000", 2024-05-08T18:31:43.494 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.77707483200000005, 2024-05-08T18:31:43.494 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015168635999999999, 2024-05-08T18:31:43.494 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:43.494 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:43.494 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:43.494 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:43.494 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.494 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:43.494 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.649641+0000", 2024-05-08T18:31:43.494 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:43.495 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.495 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.495 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:43.495 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.649641+0000", 2024-05-08T18:31:43.495 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:43.495 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.495 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.495 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:43.495 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.649643+0000", 2024-05-08T18:31:43.495 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.897e-06 2024-05-08T18:31:43.495 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.495 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.495 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:43.495 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.652254+0000", 2024-05-08T18:31:43.495 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0026104029999999999 2024-05-08T18:31:43.496 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.496 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.496 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:43.496 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.652304+0000", 2024-05-08T18:31:43.496 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9954000000000003e-05 2024-05-08T18:31:43.496 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.496 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.496 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:43.496 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.652330+0000", 2024-05-08T18:31:43.496 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.633e-05 2024-05-08T18:31:43.496 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.496 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.496 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:43.496 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.652479+0000", 2024-05-08T18:31:43.497 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014837199999999999 2024-05-08T18:31:43.497 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.497 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.497 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:43.497 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.652529+0000", 2024-05-08T18:31:43.497 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0371999999999998e-05 2024-05-08T18:31:43.497 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.497 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.497 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:43.497 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.664683+0000", 2024-05-08T18:31:43.497 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012153796 2024-05-08T18:31:43.497 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.497 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.497 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:43.498 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.664809+0000", 2024-05-08T18:31:43.498 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012651200000000001 2024-05-08T18:31:43.498 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:43.498 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:43.498 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:43.498 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.498 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.498 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1346 3.29 e82/21 3:9766a0f4:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_32:head v 82'1, mlcod=0'0)", 2024-05-08T18:31:43.498 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.665936+0000", 2024-05-08T18:31:43.498 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.760778917, 2024-05-08T18:31:43.498 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015958892999999998, 2024-05-08T18:31:43.498 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:43.498 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:43.498 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:43.499 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:43.499 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.499 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:43.499 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.665936+0000", 2024-05-08T18:31:43.499 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:43.499 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.499 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.499 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:43.499 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.665936+0000", 2024-05-08T18:31:43.499 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:43.499 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.499 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.500 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:43.500 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.665937+0000", 2024-05-08T18:31:43.500 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3300000000000002e-07 2024-05-08T18:31:43.500 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.500 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.500 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:43.500 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.672096+0000", 2024-05-08T18:31:43.500 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0061585399999999997 2024-05-08T18:31:43.500 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.500 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.500 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:43.500 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.672123+0000", 2024-05-08T18:31:43.500 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7613000000000001e-05 2024-05-08T18:31:43.501 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.501 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.501 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:43.501 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.672139+0000", 2024-05-08T18:31:43.501 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5869999999999999e-05 2024-05-08T18:31:43.501 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.501 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.501 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:43.501 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.672222+0000", 2024-05-08T18:31:43.501 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2368999999999997e-05 2024-05-08T18:31:43.501 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.501 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.501 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:43.501 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.672255+0000", 2024-05-08T18:31:43.502 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3540000000000001e-05 2024-05-08T18:31:43.502 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.502 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.502 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:43.502 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.681740+0000", 2024-05-08T18:31:43.502 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0094849860000000008 2024-05-08T18:31:43.502 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.502 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.502 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:43.502 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.681895+0000", 2024-05-08T18:31:43.502 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015534199999999999 2024-05-08T18:31:43.502 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:43.502 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:43.503 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:43.503 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.503 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.503 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1349 3.27 e82/21 3:e5090c80:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_35:head v 82'1, mlcod=0'0)", 2024-05-08T18:31:43.503 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.699543+0000", 2024-05-08T18:31:43.503 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.727172861, 2024-05-08T18:31:43.503 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016329854000000001, 2024-05-08T18:31:43.503 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:43.503 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:43.503 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:43.503 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:43.503 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.503 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:43.504 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.699543+0000", 2024-05-08T18:31:43.504 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:43.504 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.504 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.504 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:43.504 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.699543+0000", 2024-05-08T18:31:43.504 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:43.504 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.504 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.504 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:43.504 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.699545+0000", 2024-05-08T18:31:43.504 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6529999999999998e-06 2024-05-08T18:31:43.504 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.505 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.505 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:43.505 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.704546+0000", 2024-05-08T18:31:43.505 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0050003599999999997 2024-05-08T18:31:43.505 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.505 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.505 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:43.505 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.704582+0000", 2024-05-08T18:31:43.505 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6165999999999999e-05 2024-05-08T18:31:43.505 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.505 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.505 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:43.505 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.704599+0000", 2024-05-08T18:31:43.505 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.713e-05 2024-05-08T18:31:43.506 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.506 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.506 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:43.506 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.704734+0000", 2024-05-08T18:31:43.506 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000135012 2024-05-08T18:31:43.506 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.506 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.506 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:43.506 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.704776+0000", 2024-05-08T18:31:43.506 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.2626999999999997e-05 2024-05-08T18:31:43.506 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.506 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.506 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:43.507 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.715744+0000", 2024-05-08T18:31:43.507 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010967153 2024-05-08T18:31:43.507 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.507 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.507 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:43.507 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.715872+0000", 2024-05-08T18:31:43.507 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012875300000000001 2024-05-08T18:31:43.507 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:43.507 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:43.507 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:43.507 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.507 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.507 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1351 3.27 e82/21 3:e75c4558:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_37:head v 82'2, mlcod=0'0)", 2024-05-08T18:31:43.507 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.721625+0000", 2024-05-08T18:31:43.508 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.705090094, 2024-05-08T18:31:43.508 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013669064, 2024-05-08T18:31:43.508 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:43.508 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:43.508 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:43.508 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:43.508 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.508 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:43.508 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.721625+0000", 2024-05-08T18:31:43.508 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:43.508 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.508 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.509 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:43.509 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.721625+0000", 2024-05-08T18:31:43.509 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:43.509 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.509 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.509 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:43.509 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.721628+0000", 2024-05-08T18:31:43.509 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5600000000000001e-06 2024-05-08T18:31:43.509 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.509 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.509 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:43.509 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.725874+0000", 2024-05-08T18:31:43.509 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0042464349999999998 2024-05-08T18:31:43.510 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.510 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.510 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:43.510 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.725908+0000", 2024-05-08T18:31:43.510 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3735999999999997e-05 2024-05-08T18:31:43.510 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.510 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.510 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:43.510 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.725926+0000", 2024-05-08T18:31:43.510 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.766e-05 2024-05-08T18:31:43.510 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.510 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.510 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:43.511 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.726038+0000", 2024-05-08T18:31:43.511 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000112025 2024-05-08T18:31:43.511 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.511 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.511 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:43.511 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.726081+0000", 2024-05-08T18:31:43.511 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3609999999999998e-05 2024-05-08T18:31:43.511 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.511 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.511 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:43.511 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.735197+0000", 2024-05-08T18:31:43.511 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0091160860000000007 2024-05-08T18:31:43.511 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.511 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.512 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:43.512 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.735294+0000", 2024-05-08T18:31:43.512 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6952000000000003e-05 2024-05-08T18:31:43.512 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:43.512 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:43.512 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:43.512 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.512 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.512 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1357 3.f e82/21 3:f2d0b7b2:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_43:head v 82'3, mlcod=81'1)", 2024-05-08T18:31:43.512 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.786870+0000", 2024-05-08T18:31:43.512 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.63984553600000005, 2024-05-08T18:31:43.512 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016941210000000002, 2024-05-08T18:31:43.512 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:43.512 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:43.512 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:43.513 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:43.513 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.513 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:43.513 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.786870+0000", 2024-05-08T18:31:43.513 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:43.513 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.513 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.513 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:43.513 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.786870+0000", 2024-05-08T18:31:43.513 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:43.513 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.513 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.513 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:43.513 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.786872+0000", 2024-05-08T18:31:43.514 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5770000000000001e-06 2024-05-08T18:31:43.514 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.514 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.514 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:43.514 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.789682+0000", 2024-05-08T18:31:43.514 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0028092859999999998 2024-05-08T18:31:43.514 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.514 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.514 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:43.514 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.789720+0000", 2024-05-08T18:31:43.514 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7932999999999997e-05 2024-05-08T18:31:43.514 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.514 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.515 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:43.515 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.789740+0000", 2024-05-08T18:31:43.515 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9862999999999999e-05 2024-05-08T18:31:43.515 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.515 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.515 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:43.515 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.789893+0000", 2024-05-08T18:31:43.515 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015356500000000001 2024-05-08T18:31:43.515 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.515 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.515 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:43.515 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.789961+0000", 2024-05-08T18:31:43.515 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8122999999999998e-05 2024-05-08T18:31:43.515 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.516 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.516 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:43.516 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.803714+0000", 2024-05-08T18:31:43.516 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013752664 2024-05-08T18:31:43.516 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.516 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.516 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:43.516 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.803811+0000", 2024-05-08T18:31:43.516 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7199000000000002e-05 2024-05-08T18:31:43.516 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:43.516 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:43.516 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:43.516 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.516 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.517 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1369 3.1 e82/21 3:83b9a38d:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_55:head v 82'1, mlcod=0'0)", 2024-05-08T18:31:43.517 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.908721+0000", 2024-05-08T18:31:43.517 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.51799448000000003, 2024-05-08T18:31:43.517 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016507898999999999, 2024-05-08T18:31:43.517 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:43.517 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:43.517 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:43.517 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:43.517 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.517 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:43.517 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.908721+0000", 2024-05-08T18:31:43.517 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:43.517 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.517 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.518 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:43.518 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.908721+0000", 2024-05-08T18:31:43.518 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:43.518 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.518 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.518 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:43.518 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.908722+0000", 2024-05-08T18:31:43.518 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1600000000000001e-07 2024-05-08T18:31:43.518 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.518 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.518 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:43.518 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.912935+0000", 2024-05-08T18:31:43.518 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0042138219999999999 2024-05-08T18:31:43.519 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.519 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.519 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:43.519 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.912970+0000", 2024-05-08T18:31:43.519 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4722999999999999e-05 2024-05-08T18:31:43.519 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.519 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.519 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:43.519 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.912988+0000", 2024-05-08T18:31:43.519 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7972999999999999e-05 2024-05-08T18:31:43.519 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.519 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.519 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:43.519 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.913127+0000", 2024-05-08T18:31:43.519 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013925600000000001 2024-05-08T18:31:43.520 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.520 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.520 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:43.520 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.913167+0000", 2024-05-08T18:31:43.520 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9928999999999997e-05 2024-05-08T18:31:43.520 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.520 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.520 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:43.520 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.925089+0000", 2024-05-08T18:31:43.520 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011921510999999999 2024-05-08T18:31:43.520 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.520 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.520 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:43.521 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.925229+0000", 2024-05-08T18:31:43.521 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014006899999999999 2024-05-08T18:31:43.521 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:43.521 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:43.521 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:43.521 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.521 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.521 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1370 3.9 3:91bbaad9:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_56:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:43.521 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.915888+0000", 2024-05-08T18:31:43.521 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.51082727100000003, 2024-05-08T18:31:43.521 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.028543105999999999, 2024-05-08T18:31:43.521 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:43.521 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:43.521 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:43.522 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:43.522 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:31:43.522 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:43.522 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1370 2024-05-08T18:31:43.522 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.522 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:43.522 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.522 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:43.522 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.915888+0000", 2024-05-08T18:31:43.522 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:43.522 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.522 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.522 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:43.523 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.915888+0000", 2024-05-08T18:31:43.523 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:43.523 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.523 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.523 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:43.523 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.915892+0000", 2024-05-08T18:31:43.523 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1269999999999996e-06 2024-05-08T18:31:43.523 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.523 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.523 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:43.523 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.919887+0000", 2024-05-08T18:31:43.523 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039945529999999996 2024-05-08T18:31:43.523 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.523 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.524 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:43.524 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.919929+0000", 2024-05-08T18:31:43.524 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1832999999999997e-05 2024-05-08T18:31:43.524 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.524 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.524 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:43.524 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.919950+0000", 2024-05-08T18:31:43.524 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1197000000000001e-05 2024-05-08T18:31:43.524 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.524 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.524 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:43.524 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.920108+0000", 2024-05-08T18:31:43.524 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015827899999999999 2024-05-08T18:31:43.524 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.525 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.525 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:43.525 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.920401+0000", 2024-05-08T18:31:43.525 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029259799999999998 2024-05-08T18:31:43.525 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.525 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.525 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-05-08T18:31:43.525 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.920625+0000", 2024-05-08T18:31:43.525 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022383099999999999 2024-05-08T18:31:43.525 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.525 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.525 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:43.525 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.933935+0000", 2024-05-08T18:31:43.525 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013310298999999999 2024-05-08T18:31:43.526 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.526 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.526 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:43.526 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.944330+0000", 2024-05-08T18:31:43.526 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010395107000000001 2024-05-08T18:31:43.526 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.526 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.526 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:43.526 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.944383+0000", 2024-05-08T18:31:43.526 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2772000000000002e-05 2024-05-08T18:31:43.526 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.526 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.526 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:43.527 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.944431+0000", 2024-05-08T18:31:43.527 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8510000000000001e-05 2024-05-08T18:31:43.527 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:43.527 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:43.527 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:43.527 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.527 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.527 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1378 3.31 e82/21 3:8cc8fed9:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_64:head v 82'1, mlcod=0'0)", 2024-05-08T18:31:43.527 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:43.014456+0000", 2024-05-08T18:31:43.527 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.41225942199999999, 2024-05-08T18:31:43.527 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013085566999999999, 2024-05-08T18:31:43.527 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:43.527 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:43.527 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:43.528 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:43.528 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.528 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:43.528 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.014456+0000", 2024-05-08T18:31:43.528 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:43.528 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.528 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.528 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:43.528 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.014456+0000", 2024-05-08T18:31:43.528 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:43.528 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.528 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.528 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:43.528 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.014456+0000", 2024-05-08T18:31:43.529 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7500000000000001e-07 2024-05-08T18:31:43.529 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.529 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.529 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:43.529 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.018510+0000", 2024-05-08T18:31:43.529 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.004053564 2024-05-08T18:31:43.529 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.529 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.529 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:43.529 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.018530+0000", 2024-05-08T18:31:43.529 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9953e-05 2024-05-08T18:31:43.529 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.529 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.529 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:43.530 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.018541+0000", 2024-05-08T18:31:43.530 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1114999999999999e-05 2024-05-08T18:31:43.530 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.530 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.530 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:43.530 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.018648+0000", 2024-05-08T18:31:43.530 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000106783 2024-05-08T18:31:43.530 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.530 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.530 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:43.530 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.018692+0000", 2024-05-08T18:31:43.530 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4793999999999998e-05 2024-05-08T18:31:43.530 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.531 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.531 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:43.531 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.027481+0000", 2024-05-08T18:31:43.531 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0087887460000000001 2024-05-08T18:31:43.531 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.531 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.531 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:43.531 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.027542+0000", 2024-05-08T18:31:43.531 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.0337000000000002e-05 2024-05-08T18:31:43.531 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:43.531 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:43.531 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:43.531 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.531 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.532 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1385 3.1a 3:5abdd61d:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_71:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:43.532 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:43.106312+0000", 2024-05-08T18:31:43.532 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.32040369200000002, 2024-05-08T18:31:43.532 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018362961000000001, 2024-05-08T18:31:43.532 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:43.532 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:43.532 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:43.532 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:43.532 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:31:43.532 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:43.532 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1385 2024-05-08T18:31:43.532 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.532 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:43.533 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.533 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:43.533 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.106312+0000", 2024-05-08T18:31:43.533 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:43.533 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.533 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.533 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:43.533 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.106312+0000", 2024-05-08T18:31:43.533 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:43.533 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.533 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.533 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:43.533 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.106316+0000", 2024-05-08T18:31:43.533 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8739999999999997e-06 2024-05-08T18:31:43.534 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.534 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.534 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:43.534 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.110250+0000", 2024-05-08T18:31:43.534 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039342600000000002 2024-05-08T18:31:43.534 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.534 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.534 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:43.534 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.110289+0000", 2024-05-08T18:31:43.534 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8782999999999998e-05 2024-05-08T18:31:43.534 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.534 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.534 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:43.535 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.110306+0000", 2024-05-08T18:31:43.535 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7793000000000001e-05 2024-05-08T18:31:43.535 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.535 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.535 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:43.535 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.110454+0000", 2024-05-08T18:31:43.535 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014750899999999999 2024-05-08T18:31:43.535 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.535 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.535 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:43.535 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.110700+0000", 2024-05-08T18:31:43.535 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00024594500000000002 2024-05-08T18:31:43.535 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.536 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.536 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:31:43.536 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.110951+0000", 2024-05-08T18:31:43.536 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00025154499999999999 2024-05-08T18:31:43.536 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.536 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.536 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:43.536 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.120973+0000", 2024-05-08T18:31:43.536 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010021835999999999 2024-05-08T18:31:43.536 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.536 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.536 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:43.536 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.124583+0000", 2024-05-08T18:31:43.536 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0036096840000000002 2024-05-08T18:31:43.537 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.537 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.537 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:43.537 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.124630+0000", 2024-05-08T18:31:43.537 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7419000000000001e-05 2024-05-08T18:31:43.537 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:43.537 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:43.537 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:43.537 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.124675+0000", 2024-05-08T18:31:43.537 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4313000000000001e-05 2024-05-08T18:31:43.537 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:43.537 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:43.537 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:43.537 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:43.538 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:43.538 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:31:43.538 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2024-05-08T18:31:43.539 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:31:43.540 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2024-05-08T18:31:43.540 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:31:43.540 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-08T18:31:43.541 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2024-05-08T18:31:43.541 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:31:43.541 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2024-05-08T18:31:43.542 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:31:43.542 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:31:43.537+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:31:43.563 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2024-05-08T18:31:43.563 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:31:43.640 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:31:43.634+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:31:43.719 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:43.719 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:43.738 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-08T18:31:43.781 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:31:43.778+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:31:43.842 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:31:43.838+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:31:43.924 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:43.924 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:43.940 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-08T18:31:43.984 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:31:43.982+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:31:44.043 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:31:44.041+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:31:44.113 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:44.114 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:44.129 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-08T18:31:44.144 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:31:44.145+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:31:44.245 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:31:44.242+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:31:44.263 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:44.263 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:44.278 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-08T18:31:44.372 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:31:44.370+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:31:44.447 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:31:44.445+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:31:44.455 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:44.455 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:44.473 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-08T18:31:44.560 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:31:44.558+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:31:44.584 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-08T18:31:44.650 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:31:44.646+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:31:44.653 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:44.653 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:44.675 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-08T18:31:44.764 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:31:44.762+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:31:44.852 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:31:44.846+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:31:44.860 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:44.860 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:44.877 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-08T18:31:44.964 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:31:44.962+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:31:45.054 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:31:45.050+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:31:45.054 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:45.054 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:45.076 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-08T18:31:45.155 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:31:45.153+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:31:45.256 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:31:45.257+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:31:45.258 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:45.258 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:45.276 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-08T18:31:45.356 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:31:45.354+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:31:45.427 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:45.427 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:45.451 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-08T18:31:45.476 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:31:45.474+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:31:45.559 INFO:teuthology.orchestra.run.smithi097.stderr:nodeep-scrub is unset 2024-05-08T18:31:45.577 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:31:45.577+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:31:45.591 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-08T18:31:45.607 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:45.607 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:45.624 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-08T18:31:45.632 INFO:tasks.workunit.client.0.smithi097.stdout:quota enabled for the user usr2 2024-05-08T18:31:45.632 INFO:tasks.workunit.client.0.smithi097.stdout:adding file to bucket buck_2024_04_8_18_31_39: 1Gb. 2024-05-08T18:31:45.632 INFO:tasks.workunit.client.0.smithi097.stdout:upload file successful 2024-05-08T18:31:45.632 INFO:tasks.workunit.client.0.smithi097.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-08T18:31:45.632 INFO:tasks.workunit.client.0.smithi097.stdout:Test case: PASSED - quota set for user: usr2 with max_size=1048576000 passed 2024-05-08T18:31:45.632 INFO:tasks.workunit.client.0.smithi097.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-08T18:31:45.678 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:31:45.674+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:31:45.753 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2024-05-08T18:31:45.754 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:31:45.765 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:45.765 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2024-05-08T18:31:45.765 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2024-05-08T18:31:45.765 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-05-08T18:31:45.765 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.765 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1321 3.1b 3:d9207229:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-08T18:31:45.765 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.388504+0000", 2024-05-08T18:31:45.765 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 3.3757763430000001, 2024-05-08T18:31:45.765 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021407464000000001, 2024-05-08T18:31:45.765 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:45.765 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:45.766 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:45.766 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:45.766 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:45.766 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:45.766 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1321 2024-05-08T18:31:45.766 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.766 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:45.766 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.766 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:45.766 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.388504+0000", 2024-05-08T18:31:45.766 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:45.766 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.766 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.767 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:45.767 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.388504+0000", 2024-05-08T18:31:45.767 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:45.767 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.767 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.767 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:45.767 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.388507+0000", 2024-05-08T18:31:45.767 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6060000000000001e-06 2024-05-08T18:31:45.767 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.767 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.767 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:45.767 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.390938+0000", 2024-05-08T18:31:45.768 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0024313590000000001 2024-05-08T18:31:45.768 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.768 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.768 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:45.768 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.390965+0000", 2024-05-08T18:31:45.768 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6568999999999999e-05 2024-05-08T18:31:45.768 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.768 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.768 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:45.768 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.390978+0000", 2024-05-08T18:31:45.768 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2989999999999999e-05 2024-05-08T18:31:45.768 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.768 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.769 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:45.769 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.391050+0000", 2024-05-08T18:31:45.769 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2315000000000001e-05 2024-05-08T18:31:45.769 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.769 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.769 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:45.769 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.391166+0000", 2024-05-08T18:31:45.769 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000116224 2024-05-08T18:31:45.769 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.769 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.769 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:31:45.769 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.391281+0000", 2024-05-08T18:31:45.769 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115214 2024-05-08T18:31:45.770 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.770 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.770 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:45.770 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.401759+0000", 2024-05-08T18:31:45.770 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010477030999999999 2024-05-08T18:31:45.770 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.770 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.770 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:45.770 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.409773+0000", 2024-05-08T18:31:45.770 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0080146379999999993 2024-05-08T18:31:45.770 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.770 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.771 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:45.771 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.409853+0000", 2024-05-08T18:31:45.771 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.9542000000000005e-05 2024-05-08T18:31:45.771 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.771 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.771 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:45.771 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.409912+0000", 2024-05-08T18:31:45.771 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8975999999999999e-05 2024-05-08T18:31:45.771 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:45.771 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:45.771 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:45.771 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.772 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.772 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1324 3.3a e81/21 3:5fe59963:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_10:head v 81'1, mlcod=0'0)", 2024-05-08T18:31:45.772 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.435298+0000", 2024-05-08T18:31:45.772 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 3.3289825959999999, 2024-05-08T18:31:45.772 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.013271099, 2024-05-08T18:31:45.772 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:45.772 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:45.772 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:45.772 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:45.772 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.772 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:45.772 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.435298+0000", 2024-05-08T18:31:45.772 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:45.773 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.773 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.773 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:45.773 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.435298+0000", 2024-05-08T18:31:45.773 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:45.773 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.773 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.773 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:45.773 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.435299+0000", 2024-05-08T18:31:45.773 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4720000000000001e-06 2024-05-08T18:31:45.773 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.773 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.774 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:45.774 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.441573+0000", 2024-05-08T18:31:45.774 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0062736830000000004 2024-05-08T18:31:45.774 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.774 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.774 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:45.774 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.441604+0000", 2024-05-08T18:31:45.774 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1253e-05 2024-05-08T18:31:45.774 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.774 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.774 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:45.774 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.441627+0000", 2024-05-08T18:31:45.774 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2413999999999999e-05 2024-05-08T18:31:45.775 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.775 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.775 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:45.775 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.441718+0000", 2024-05-08T18:31:45.775 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.1014999999999995e-05 2024-05-08T18:31:45.775 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.775 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.775 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:45.775 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.441743+0000", 2024-05-08T18:31:45.775 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5174999999999999e-05 2024-05-08T18:31:45.775 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.775 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.775 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:45.776 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.448500+0000", 2024-05-08T18:31:45.776 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0067570979999999996 2024-05-08T18:31:45.776 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.776 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.776 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:45.776 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.448569+0000", 2024-05-08T18:31:45.776 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8989e-05 2024-05-08T18:31:45.776 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:45.776 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:45.776 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:45.776 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.776 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.776 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1326 3.1b 3:da64adf7:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-08T18:31:45.777 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.451531+0000", 2024-05-08T18:31:45.777 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 3.3127498769999999, 2024-05-08T18:31:45.777 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.018015155000000001, 2024-05-08T18:31:45.777 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:45.777 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:45.777 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:45.777 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:45.777 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:45.777 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:45.777 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1326 2024-05-08T18:31:45.777 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.777 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:45.777 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.778 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:45.778 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.451531+0000", 2024-05-08T18:31:45.778 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:45.778 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.778 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.778 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:45.778 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.451531+0000", 2024-05-08T18:31:45.778 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:45.778 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.778 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.778 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:45.778 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.451533+0000", 2024-05-08T18:31:45.778 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5040000000000001e-06 2024-05-08T18:31:45.779 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.779 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.779 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:45.779 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.453105+0000", 2024-05-08T18:31:45.779 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001571949 2024-05-08T18:31:45.779 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.779 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.779 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:45.779 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.453138+0000", 2024-05-08T18:31:45.779 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2916999999999997e-05 2024-05-08T18:31:45.779 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.779 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.779 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:45.780 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.453154+0000", 2024-05-08T18:31:45.780 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5837000000000001e-05 2024-05-08T18:31:45.780 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.780 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.780 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:45.780 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.453240+0000", 2024-05-08T18:31:45.780 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5705999999999996e-05 2024-05-08T18:31:45.780 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.780 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.780 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:45.780 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.453408+0000", 2024-05-08T18:31:45.780 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000168209 2024-05-08T18:31:45.780 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.781 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.781 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:31:45.781 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.453522+0000", 2024-05-08T18:31:45.781 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000114664 2024-05-08T18:31:45.781 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.781 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.781 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:45.781 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.461332+0000", 2024-05-08T18:31:45.781 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0078093030000000001 2024-05-08T18:31:45.781 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.781 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.781 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:45.781 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.469470+0000", 2024-05-08T18:31:45.782 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0081381349999999995 2024-05-08T18:31:45.782 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.782 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.782 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:45.782 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.469512+0000", 2024-05-08T18:31:45.782 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.2466999999999998e-05 2024-05-08T18:31:45.782 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.782 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.782 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:45.782 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.469546+0000", 2024-05-08T18:31:45.782 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3463999999999997e-05 2024-05-08T18:31:45.782 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:45.782 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:45.783 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:45.783 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.783 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.783 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1333 3.3d 3:bdc3cb6c:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-08T18:31:45.783 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.524089+0000", 2024-05-08T18:31:45.783 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 3.2401912519999998, 2024-05-08T18:31:45.783 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.01302146, 2024-05-08T18:31:45.783 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:45.783 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:45.783 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:45.783 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:45.783 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:45.783 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:45.784 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1333 2024-05-08T18:31:45.784 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.784 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:45.784 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.784 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:45.784 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.524089+0000", 2024-05-08T18:31:45.784 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:45.784 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.784 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.784 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:45.784 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.524089+0000", 2024-05-08T18:31:45.785 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:45.785 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.785 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.785 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:45.785 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.524092+0000", 2024-05-08T18:31:45.785 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9969999999999999e-06 2024-05-08T18:31:45.786 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.786 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.786 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:45.786 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.525635+0000", 2024-05-08T18:31:45.786 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001542292 2024-05-08T18:31:45.786 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.786 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.786 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:45.786 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.525661+0000", 2024-05-08T18:31:45.786 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6437000000000001e-05 2024-05-08T18:31:45.786 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.786 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.786 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:45.787 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.525672+0000", 2024-05-08T18:31:45.787 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1059e-05 2024-05-08T18:31:45.787 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.787 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.787 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:45.787 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.525745+0000", 2024-05-08T18:31:45.787 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2576000000000004e-05 2024-05-08T18:31:45.787 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.787 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.787 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:45.787 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.525874+0000", 2024-05-08T18:31:45.787 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012944899999999999 2024-05-08T18:31:45.788 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.788 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.788 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-05-08T18:31:45.788 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.525989+0000", 2024-05-08T18:31:45.788 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000114511 2024-05-08T18:31:45.788 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.788 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.788 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:45.788 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.536664+0000", 2024-05-08T18:31:45.788 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010675314999999999 2024-05-08T18:31:45.788 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.788 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.788 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:45.789 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.536985+0000", 2024-05-08T18:31:45.789 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00032079599999999998 2024-05-08T18:31:45.789 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.789 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.789 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:45.789 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.537052+0000", 2024-05-08T18:31:45.789 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7774999999999994e-05 2024-05-08T18:31:45.789 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.789 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.789 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:45.789 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.537111+0000", 2024-05-08T18:31:45.789 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8252999999999999e-05 2024-05-08T18:31:45.789 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:45.789 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:45.790 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:45.790 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.790 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.790 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1335 3.12 3:4b3afb01:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-08T18:31:45.790 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.544122+0000", 2024-05-08T18:31:45.790 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 3.2201582640000002, 2024-05-08T18:31:45.790 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.024776217, 2024-05-08T18:31:45.790 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:45.790 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:45.790 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:45.790 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:45.790 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:45.790 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:45.790 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1335 2024-05-08T18:31:45.791 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.791 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:45.791 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.791 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:45.791 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.544122+0000", 2024-05-08T18:31:45.791 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:45.791 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.791 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.791 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:45.791 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.544122+0000", 2024-05-08T18:31:45.791 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:45.791 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.791 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.791 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:45.791 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.544126+0000", 2024-05-08T18:31:45.792 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2349999999999999e-06 2024-05-08T18:31:45.792 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.792 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.792 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:45.792 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.551632+0000", 2024-05-08T18:31:45.792 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0075062829999999999 2024-05-08T18:31:45.792 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.792 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.792 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:45.792 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.551661+0000", 2024-05-08T18:31:45.792 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9675e-05 2024-05-08T18:31:45.792 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.792 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.793 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:45.793 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.551676+0000", 2024-05-08T18:31:45.793 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4440999999999999e-05 2024-05-08T18:31:45.793 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.793 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.793 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:45.793 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.551759+0000", 2024-05-08T18:31:45.793 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.2964000000000001e-05 2024-05-08T18:31:45.793 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.793 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.793 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:45.793 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.551884+0000", 2024-05-08T18:31:45.793 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000125599 2024-05-08T18:31:45.794 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.794 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.794 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:45.794 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.551983+0000", 2024-05-08T18:31:45.794 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.9024000000000006e-05 2024-05-08T18:31:45.794 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.794 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.794 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:45.794 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.560099+0000", 2024-05-08T18:31:45.794 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0081154090000000005 2024-05-08T18:31:45.794 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.794 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.794 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:45.795 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.568804+0000", 2024-05-08T18:31:45.795 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.008705506 2024-05-08T18:31:45.795 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.795 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.795 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:45.795 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.568853+0000", 2024-05-08T18:31:45.795 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9023999999999997e-05 2024-05-08T18:31:45.795 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.795 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.795 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:45.795 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.568898+0000", 2024-05-08T18:31:45.795 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5056999999999999e-05 2024-05-08T18:31:45.795 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:45.795 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:45.795 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:45.796 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.796 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.796 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1338 3.32 3:4dfd6cdb:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:45.796 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.584551+0000", 2024-05-08T18:31:45.796 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 3.1797296089999998, 2024-05-08T18:31:45.796 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.013213514000000001, 2024-05-08T18:31:45.796 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:45.796 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:45.796 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:45.796 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:45.796 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:45.796 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:45.796 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1338 2024-05-08T18:31:45.797 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.797 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:45.797 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.797 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:45.797 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.584551+0000", 2024-05-08T18:31:45.797 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:45.797 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.797 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.797 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:45.797 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.584551+0000", 2024-05-08T18:31:45.797 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:45.797 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.798 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.798 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:45.798 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.584555+0000", 2024-05-08T18:31:45.798 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8130000000000002e-06 2024-05-08T18:31:45.798 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.798 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.798 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:45.798 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.586266+0000", 2024-05-08T18:31:45.798 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0017111330000000001 2024-05-08T18:31:45.798 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.798 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.798 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:45.799 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.586290+0000", 2024-05-08T18:31:45.799 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3714999999999999e-05 2024-05-08T18:31:45.799 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.799 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.799 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:45.799 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.586303+0000", 2024-05-08T18:31:45.799 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3349999999999999e-05 2024-05-08T18:31:45.799 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.799 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.799 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:45.799 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.586384+0000", 2024-05-08T18:31:45.799 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.0999000000000002e-05 2024-05-08T18:31:45.799 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.799 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.800 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:45.800 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.586532+0000", 2024-05-08T18:31:45.800 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000147684 2024-05-08T18:31:45.800 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.800 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.800 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-05-08T18:31:45.800 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.586664+0000", 2024-05-08T18:31:45.800 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013227700000000001 2024-05-08T18:31:45.800 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.800 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.800 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:45.800 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.597281+0000", 2024-05-08T18:31:45.800 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010617527 2024-05-08T18:31:45.800 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.801 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.801 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:45.801 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.597686+0000", 2024-05-08T18:31:45.801 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00040497900000000003 2024-05-08T18:31:45.801 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.801 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.801 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:45.801 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.597726+0000", 2024-05-08T18:31:45.801 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9518999999999999e-05 2024-05-08T18:31:45.801 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.801 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.801 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:45.801 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.597764+0000", 2024-05-08T18:31:45.801 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8518e-05 2024-05-08T18:31:45.802 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:45.802 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:45.802 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:45.802 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.802 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.802 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1340 3.23 3:c7ef75f6:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_26:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:45.802 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.602401+0000", 2024-05-08T18:31:45.802 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 3.1618792450000002, 2024-05-08T18:31:45.802 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.013972725, 2024-05-08T18:31:45.802 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:45.803 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:45.803 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:45.803 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:45.803 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:45.803 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:45.803 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1340 2024-05-08T18:31:45.803 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.803 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:45.803 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.803 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:45.803 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.602401+0000", 2024-05-08T18:31:45.803 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:45.804 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.804 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.804 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:45.804 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.602401+0000", 2024-05-08T18:31:45.804 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:45.804 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.804 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.804 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:45.804 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.602404+0000", 2024-05-08T18:31:45.804 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6070000000000002e-06 2024-05-08T18:31:45.804 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.804 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.804 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:45.805 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.603625+0000", 2024-05-08T18:31:45.805 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012212900000000001 2024-05-08T18:31:45.805 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.805 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.805 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:45.805 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.603650+0000", 2024-05-08T18:31:45.805 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4899e-05 2024-05-08T18:31:45.805 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.805 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.805 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:45.805 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.603661+0000", 2024-05-08T18:31:45.805 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0942e-05 2024-05-08T18:31:45.805 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.806 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.806 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:45.806 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.603730+0000", 2024-05-08T18:31:45.806 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9028000000000004e-05 2024-05-08T18:31:45.806 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.806 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.806 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:45.806 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.603867+0000", 2024-05-08T18:31:45.806 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000136561 2024-05-08T18:31:45.806 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.806 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.806 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:45.806 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.603993+0000", 2024-05-08T18:31:45.807 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012675800000000001 2024-05-08T18:31:45.807 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.807 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.807 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:45.807 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.615726+0000", 2024-05-08T18:31:45.807 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011732543999999999 2024-05-08T18:31:45.807 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.807 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.807 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:45.807 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.616270+0000", 2024-05-08T18:31:45.807 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00054401799999999995 2024-05-08T18:31:45.807 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.807 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.808 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:45.808 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.616314+0000", 2024-05-08T18:31:45.808 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4209999999999999e-05 2024-05-08T18:31:45.808 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.808 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.808 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:45.808 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.616374+0000", 2024-05-08T18:31:45.808 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9867999999999997e-05 2024-05-08T18:31:45.808 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:45.808 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:45.808 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:45.808 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.808 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.808 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1342 3.32 3:4c847226:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_28:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:45.809 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.624304+0000", 2024-05-08T18:31:45.809 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 3.139976221, 2024-05-08T18:31:45.809 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.01719648, 2024-05-08T18:31:45.809 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:45.809 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:45.809 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:45.809 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:45.809 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:45.809 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:45.809 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1342 2024-05-08T18:31:45.809 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.809 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:45.809 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.810 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:45.810 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.624304+0000", 2024-05-08T18:31:45.810 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:45.810 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.810 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.810 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:45.810 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.624304+0000", 2024-05-08T18:31:45.810 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:45.810 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.810 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.810 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:45.810 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.624308+0000", 2024-05-08T18:31:45.810 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2100000000000002e-06 2024-05-08T18:31:45.811 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.811 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.811 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:45.811 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.625980+0000", 2024-05-08T18:31:45.811 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001672574 2024-05-08T18:31:45.811 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.811 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.811 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:45.811 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.626017+0000", 2024-05-08T18:31:45.811 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6769e-05 2024-05-08T18:31:45.811 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.811 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.811 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:45.811 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.626028+0000", 2024-05-08T18:31:45.812 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0652000000000001e-05 2024-05-08T18:31:45.812 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.812 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.812 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:45.812 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.626094+0000", 2024-05-08T18:31:45.812 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6514999999999996e-05 2024-05-08T18:31:45.812 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.812 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.812 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:45.812 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.626212+0000", 2024-05-08T18:31:45.812 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000117681 2024-05-08T18:31:45.812 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.812 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.812 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-05-08T18:31:45.813 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.626333+0000", 2024-05-08T18:31:45.813 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000120899 2024-05-08T18:31:45.813 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.813 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.813 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:45.813 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.636331+0000", 2024-05-08T18:31:45.813 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0099978989999999993 2024-05-08T18:31:45.813 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.813 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.813 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:45.813 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.641371+0000", 2024-05-08T18:31:45.813 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0050405010000000002 2024-05-08T18:31:45.813 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.814 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.814 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:45.814 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.641445+0000", 2024-05-08T18:31:45.814 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.4253999999999998e-05 2024-05-08T18:31:45.814 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.814 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.814 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:45.814 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.641501+0000", 2024-05-08T18:31:45.814 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5526000000000003e-05 2024-05-08T18:31:45.814 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:45.814 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:45.814 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:45.815 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.815 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.815 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1347 3.2b 3:d515696f:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_33:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:45.815 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.674338+0000", 2024-05-08T18:31:45.815 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 3.0899428640000002, 2024-05-08T18:31:45.815 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.016855103999999999, 2024-05-08T18:31:45.815 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:45.815 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:45.815 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:45.815 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:45.815 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:45.815 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:45.816 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1347 2024-05-08T18:31:45.816 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.816 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:45.816 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.816 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:45.816 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.674338+0000", 2024-05-08T18:31:45.816 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:45.816 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.816 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.816 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:45.816 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.674338+0000", 2024-05-08T18:31:45.816 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:45.816 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.816 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.817 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:45.817 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.674340+0000", 2024-05-08T18:31:45.817 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3429999999999998e-06 2024-05-08T18:31:45.817 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.817 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.817 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:45.817 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.676277+0000", 2024-05-08T18:31:45.817 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0019373529999999999 2024-05-08T18:31:45.817 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.817 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.817 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:45.817 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.676303+0000", 2024-05-08T18:31:45.817 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5561000000000001e-05 2024-05-08T18:31:45.818 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.818 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.818 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:45.818 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.676316+0000", 2024-05-08T18:31:45.818 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2748000000000001e-05 2024-05-08T18:31:45.818 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.818 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.818 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:45.818 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.676391+0000", 2024-05-08T18:31:45.818 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.5196000000000003e-05 2024-05-08T18:31:45.818 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.818 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.818 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:45.819 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.676578+0000", 2024-05-08T18:31:45.819 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00018751799999999999 2024-05-08T18:31:45.819 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.819 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.819 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:45.819 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.676754+0000", 2024-05-08T18:31:45.819 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00017542400000000001 2024-05-08T18:31:45.819 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.819 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.819 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:45.819 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.685847+0000", 2024-05-08T18:31:45.819 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0090928550000000004 2024-05-08T18:31:45.819 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.819 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.820 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:45.820 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.691097+0000", 2024-05-08T18:31:45.820 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0052502570000000004 2024-05-08T18:31:45.820 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.820 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.820 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:45.820 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.691137+0000", 2024-05-08T18:31:45.820 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0525999999999998e-05 2024-05-08T18:31:45.820 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.820 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.820 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:45.820 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.691193+0000", 2024-05-08T18:31:45.820 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5322999999999999e-05 2024-05-08T18:31:45.821 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:45.821 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:45.821 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:45.821 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.821 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.821 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1350 3.3a e82/21 3:5caef9cc:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_36:head v 82'2, mlcod=0'0)", 2024-05-08T18:31:45.821 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.714432+0000", 2024-05-08T18:31:45.821 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 3.0498484299999999, 2024-05-08T18:31:45.821 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.016857391999999999, 2024-05-08T18:31:45.821 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:45.821 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:45.821 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:45.821 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:45.821 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.822 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:45.822 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.714432+0000", 2024-05-08T18:31:45.822 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:45.822 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.822 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.822 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:45.822 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.714432+0000", 2024-05-08T18:31:45.822 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:45.822 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.822 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.822 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:45.822 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.714432+0000", 2024-05-08T18:31:45.822 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.97e-07 2024-05-08T18:31:45.822 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.823 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.823 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:45.823 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.718412+0000", 2024-05-08T18:31:45.823 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0039799609999999997 2024-05-08T18:31:45.823 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.823 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.823 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:45.823 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.718428+0000", 2024-05-08T18:31:45.823 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5979000000000001e-05 2024-05-08T18:31:45.823 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.823 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.823 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:45.823 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.718436+0000", 2024-05-08T18:31:45.824 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6190000000000002e-06 2024-05-08T18:31:45.824 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.824 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.824 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:45.824 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.718497+0000", 2024-05-08T18:31:45.824 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0732000000000001e-05 2024-05-08T18:31:45.824 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.824 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.824 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:45.824 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.718515+0000", 2024-05-08T18:31:45.824 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7944e-05 2024-05-08T18:31:45.824 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.824 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.824 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:45.825 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.731209+0000", 2024-05-08T18:31:45.825 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012694766 2024-05-08T18:31:45.825 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.825 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.825 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:45.825 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.731290+0000", 2024-05-08T18:31:45.825 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.0193999999999998e-05 2024-05-08T18:31:45.825 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:45.825 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:45.825 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:45.825 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.825 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.825 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1359 3.23 3:c4bb5cd6:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_45:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:45.826 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.802240+0000", 2024-05-08T18:31:45.826 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 2.9620400440000001, 2024-05-08T18:31:45.826 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.015300419000000001, 2024-05-08T18:31:45.826 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:45.826 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:45.826 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:45.826 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:45.826 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:45.826 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:45.826 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1359 2024-05-08T18:31:45.826 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.826 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:45.827 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.827 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:45.827 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.802240+0000", 2024-05-08T18:31:45.827 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:45.827 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.827 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.827 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:45.827 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.802240+0000", 2024-05-08T18:31:45.827 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:45.827 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.827 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.827 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:45.827 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.802244+0000", 2024-05-08T18:31:45.827 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3019999999999999e-06 2024-05-08T18:31:45.828 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.828 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.828 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:45.828 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.803735+0000", 2024-05-08T18:31:45.828 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001491388 2024-05-08T18:31:45.828 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.828 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.828 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:45.828 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.803763+0000", 2024-05-08T18:31:45.828 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7356e-05 2024-05-08T18:31:45.828 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.828 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.828 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:45.829 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.803776+0000", 2024-05-08T18:31:45.829 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3491e-05 2024-05-08T18:31:45.829 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.829 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.829 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:45.829 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.803849+0000", 2024-05-08T18:31:45.829 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2787999999999995e-05 2024-05-08T18:31:45.829 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.829 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.829 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:45.829 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.803966+0000", 2024-05-08T18:31:45.829 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011736899999999999 2024-05-08T18:31:45.829 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.829 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.830 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:45.830 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.804066+0000", 2024-05-08T18:31:45.830 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000100233 2024-05-08T18:31:45.830 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.830 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.830 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:45.830 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.816989+0000", 2024-05-08T18:31:45.830 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012922975 2024-05-08T18:31:45.830 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.830 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.830 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:45.831 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.817414+0000", 2024-05-08T18:31:45.831 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00042497900000000003 2024-05-08T18:31:45.831 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.831 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.831 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:45.831 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.817485+0000", 2024-05-08T18:31:45.831 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.0409999999999998e-05 2024-05-08T18:31:45.831 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.831 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.831 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:45.831 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.817541+0000", 2024-05-08T18:31:45.831 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6128000000000002e-05 2024-05-08T18:31:45.831 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:45.832 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:45.832 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:45.832 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.832 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.832 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1360 3.20 e82/21 3:0629b24f:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_46:head v 82'1, mlcod=0'0)", 2024-05-08T18:31:45.832 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.817317+0000", 2024-05-08T18:31:45.832 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 2.9469637209999999, 2024-05-08T18:31:45.832 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.013497733, 2024-05-08T18:31:45.832 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:45.832 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:45.832 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:45.832 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:45.832 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.832 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:45.833 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.817317+0000", 2024-05-08T18:31:45.833 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:45.833 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.833 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.833 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:45.833 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.817317+0000", 2024-05-08T18:31:45.833 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:45.833 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.833 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.833 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:45.833 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.817317+0000", 2024-05-08T18:31:45.834 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7300000000000001e-07 2024-05-08T18:31:45.834 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.834 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.834 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:45.834 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.822985+0000", 2024-05-08T18:31:45.834 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0056676970000000002 2024-05-08T18:31:45.834 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.834 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.834 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:45.834 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.823009+0000", 2024-05-08T18:31:45.834 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4213e-05 2024-05-08T18:31:45.834 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.834 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.835 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:45.835 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.823020+0000", 2024-05-08T18:31:45.835 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0304e-05 2024-05-08T18:31:45.835 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.835 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.835 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:45.835 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.823094+0000", 2024-05-08T18:31:45.835 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.4108000000000003e-05 2024-05-08T18:31:45.835 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.835 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.835 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:45.835 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.823118+0000", 2024-05-08T18:31:45.835 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4491e-05 2024-05-08T18:31:45.836 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.836 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.836 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:45.836 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.830760+0000", 2024-05-08T18:31:45.836 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0076422629999999998 2024-05-08T18:31:45.836 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.836 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.836 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:45.836 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.830815+0000", 2024-05-08T18:31:45.836 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4184000000000002e-05 2024-05-08T18:31:45.836 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:45.836 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:45.836 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:45.837 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.837 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.837 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1368 3.2b 3:d58e0c07:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_54:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:45.837 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.896083+0000", 2024-05-08T18:31:45.837 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 2.8681979279999998, 2024-05-08T18:31:45.837 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.016328565999999999, 2024-05-08T18:31:45.837 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:45.837 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:45.837 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:45.837 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:45.837 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:45.837 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:45.837 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1368 2024-05-08T18:31:45.838 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.838 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:45.838 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.838 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:45.838 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.896083+0000", 2024-05-08T18:31:45.838 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:45.838 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.838 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.838 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:45.838 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.896083+0000", 2024-05-08T18:31:45.838 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:45.838 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.839 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.839 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:45.839 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.896086+0000", 2024-05-08T18:31:45.839 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.994e-06 2024-05-08T18:31:45.839 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.839 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.839 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:45.839 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.897619+0000", 2024-05-08T18:31:45.839 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001533455 2024-05-08T18:31:45.839 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.840 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.840 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:45.840 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.897637+0000", 2024-05-08T18:31:45.840 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7529000000000001e-05 2024-05-08T18:31:45.840 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.840 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.840 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:45.840 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.897645+0000", 2024-05-08T18:31:45.840 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.2770000000000005e-06 2024-05-08T18:31:45.840 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.840 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.840 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:45.841 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.897710+0000", 2024-05-08T18:31:45.841 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5605000000000006e-05 2024-05-08T18:31:45.841 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.841 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.841 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:45.841 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.897848+0000", 2024-05-08T18:31:45.841 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013730400000000001 2024-05-08T18:31:45.841 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.841 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.841 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:45.841 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.898013+0000", 2024-05-08T18:31:45.841 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016484099999999999 2024-05-08T18:31:45.841 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.841 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.842 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:45.842 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.904122+0000", 2024-05-08T18:31:45.842 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0061091849999999996 2024-05-08T18:31:45.842 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.842 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.842 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:45.842 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.912291+0000", 2024-05-08T18:31:45.842 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0081693849999999995 2024-05-08T18:31:45.842 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.842 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.842 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:45.842 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.912358+0000", 2024-05-08T18:31:45.842 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7237999999999996e-05 2024-05-08T18:31:45.843 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.843 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.843 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:45.843 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.912411+0000", 2024-05-08T18:31:45.843 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.2753000000000001e-05 2024-05-08T18:31:45.843 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:45.843 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:45.843 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:45.843 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.843 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.843 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1369 3.1 3:83b9a38d:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_55:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:45.843 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.906106+0000", 2024-05-08T18:31:45.843 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 2.8581748449999997, 2024-05-08T18:31:45.843 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019548026, 2024-05-08T18:31:45.844 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:45.844 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:45.844 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:45.844 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:45.844 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:45.844 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:45.844 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1369 2024-05-08T18:31:45.844 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.844 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:45.844 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.844 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:45.844 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.906106+0000", 2024-05-08T18:31:45.845 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:45.845 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.845 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.845 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:45.845 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.906106+0000", 2024-05-08T18:31:45.845 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:45.845 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.845 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.845 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:45.845 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.906108+0000", 2024-05-08T18:31:45.845 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6539999999999999e-06 2024-05-08T18:31:45.845 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.845 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.845 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:45.845 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.907835+0000", 2024-05-08T18:31:45.846 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001726602 2024-05-08T18:31:45.846 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.846 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.846 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:45.846 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.907870+0000", 2024-05-08T18:31:45.846 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4588999999999997e-05 2024-05-08T18:31:45.846 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.846 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.846 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:45.846 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.907888+0000", 2024-05-08T18:31:45.846 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8423e-05 2024-05-08T18:31:45.846 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.846 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.846 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:45.847 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.907966+0000", 2024-05-08T18:31:45.847 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.8472000000000004e-05 2024-05-08T18:31:45.847 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.847 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.847 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:45.847 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.908119+0000", 2024-05-08T18:31:45.847 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015291099999999999 2024-05-08T18:31:45.847 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.847 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.847 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:31:45.847 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.908251+0000", 2024-05-08T18:31:45.847 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013147899999999999 2024-05-08T18:31:45.847 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.848 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.848 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:45.848 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.917998+0000", 2024-05-08T18:31:45.848 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0097476720000000006 2024-05-08T18:31:45.848 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.848 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.848 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:45.848 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.925533+0000", 2024-05-08T18:31:45.848 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.007534794 2024-05-08T18:31:45.848 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.848 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.848 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:45.849 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.925599+0000", 2024-05-08T18:31:45.849 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5945999999999995e-05 2024-05-08T18:31:45.849 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.849 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.849 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:45.849 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.925654+0000", 2024-05-08T18:31:45.849 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4484000000000002e-05 2024-05-08T18:31:45.849 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:45.849 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:45.849 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:45.849 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.849 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.849 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1372 3.39 e82/46 3:9eccad39:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_58:head v 82'3, mlcod=82'1)", 2024-05-08T18:31:45.850 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.939472+0000", 2024-05-08T18:31:45.850 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 2.824808746, 2024-05-08T18:31:45.850 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.013663310999999999, 2024-05-08T18:31:45.850 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:45.850 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:45.850 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:45.850 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:45.850 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.850 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:45.850 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.939472+0000", 2024-05-08T18:31:45.850 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:45.850 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.851 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.851 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:45.851 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.939472+0000", 2024-05-08T18:31:45.851 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:45.851 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.851 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.851 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:45.851 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.939474+0000", 2024-05-08T18:31:45.851 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1179999999999999e-06 2024-05-08T18:31:45.851 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.851 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.851 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:45.851 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.941023+0000", 2024-05-08T18:31:45.852 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0015487529999999999 2024-05-08T18:31:45.852 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.852 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.852 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:45.852 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.941056+0000", 2024-05-08T18:31:45.852 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3764999999999999e-05 2024-05-08T18:31:45.852 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.852 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.852 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:45.852 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.941072+0000", 2024-05-08T18:31:45.852 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5753e-05 2024-05-08T18:31:45.852 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.852 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.853 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:45.853 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.941148+0000", 2024-05-08T18:31:45.853 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.5545999999999998e-05 2024-05-08T18:31:45.853 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.853 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.853 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:45.853 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.941169+0000", 2024-05-08T18:31:45.853 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1749000000000001e-05 2024-05-08T18:31:45.853 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.853 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.853 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:45.853 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.953075+0000", 2024-05-08T18:31:45.853 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.01190595 2024-05-08T18:31:45.853 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.854 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.854 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:45.854 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.953135+0000", 2024-05-08T18:31:45.854 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9676999999999998e-05 2024-05-08T18:31:45.854 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:45.854 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:45.854 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:45.854 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.854 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.854 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1379 3.17 3:ea263986:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_65:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:45.854 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:43.027587+0000", 2024-05-08T18:31:45.854 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 2.736693265, 2024-05-08T18:31:45.855 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.016538460000000001, 2024-05-08T18:31:45.855 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:45.855 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:45.855 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:45.855 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:45.855 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:45.855 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:45.855 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1379 2024-05-08T18:31:45.855 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.855 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:45.855 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.855 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:45.856 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.027587+0000", 2024-05-08T18:31:45.856 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:45.856 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.856 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.856 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:45.856 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.027587+0000", 2024-05-08T18:31:45.856 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:45.856 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.856 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.856 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:45.856 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.027590+0000", 2024-05-08T18:31:45.856 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2620000000000001e-06 2024-05-08T18:31:45.856 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.856 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.857 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:45.857 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.029179+0000", 2024-05-08T18:31:45.857 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0015893770000000001 2024-05-08T18:31:45.857 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.857 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.857 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:45.857 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.029208+0000", 2024-05-08T18:31:45.857 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9241e-05 2024-05-08T18:31:45.857 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.857 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.857 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:45.857 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.029221+0000", 2024-05-08T18:31:45.857 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3186e-05 2024-05-08T18:31:45.857 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.858 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.858 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:45.858 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.029301+0000", 2024-05-08T18:31:45.858 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.9765000000000006e-05 2024-05-08T18:31:45.858 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.858 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.858 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:45.858 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.029445+0000", 2024-05-08T18:31:45.858 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014380299999999999 2024-05-08T18:31:45.858 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.858 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.858 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:45.859 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.029541+0000", 2024-05-08T18:31:45.859 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.6294999999999999e-05 2024-05-08T18:31:45.859 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.859 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.859 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:45.859 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.035786+0000", 2024-05-08T18:31:45.859 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0062446050000000003 2024-05-08T18:31:45.859 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.859 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.859 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:45.859 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.043937+0000", 2024-05-08T18:31:45.859 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0081511080000000007 2024-05-08T18:31:45.859 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.859 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.859 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:45.860 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.044041+0000", 2024-05-08T18:31:45.860 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010367200000000001 2024-05-08T18:31:45.860 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.860 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.860 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:45.860 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.044126+0000", 2024-05-08T18:31:45.860 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5146000000000001e-05 2024-05-08T18:31:45.860 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:45.860 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:45.860 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:45.860 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.860 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.860 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1381 3.20 e82/21 3:07260bee:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_67:head v 82'2, mlcod=0'0)", 2024-05-08T18:31:45.860 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:43.064393+0000", 2024-05-08T18:31:45.861 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 2.6998873100000003, 2024-05-08T18:31:45.861 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.013137583, 2024-05-08T18:31:45.861 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:45.861 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:45.861 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:45.861 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:45.861 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.861 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:45.861 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.064393+0000", 2024-05-08T18:31:45.861 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:45.861 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.861 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.861 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:45.861 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.064393+0000", 2024-05-08T18:31:45.862 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:45.862 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.862 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.862 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:45.862 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.064395+0000", 2024-05-08T18:31:45.862 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1280000000000002e-06 2024-05-08T18:31:45.862 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.862 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.862 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:45.862 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.069644+0000", 2024-05-08T18:31:45.862 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0052486449999999997 2024-05-08T18:31:45.862 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.862 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.863 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:45.863 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.069678+0000", 2024-05-08T18:31:45.863 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4434000000000003e-05 2024-05-08T18:31:45.863 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.863 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.863 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:45.863 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.069695+0000", 2024-05-08T18:31:45.863 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6881e-05 2024-05-08T18:31:45.863 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.863 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.863 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:45.863 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.069776+0000", 2024-05-08T18:31:45.863 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.0222999999999994e-05 2024-05-08T18:31:45.863 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.864 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.864 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:45.864 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.069794+0000", 2024-05-08T18:31:45.864 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8904999999999999e-05 2024-05-08T18:31:45.864 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.864 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.864 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:45.864 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.077434+0000", 2024-05-08T18:31:45.864 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0076391239999999997 2024-05-08T18:31:45.864 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.864 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.864 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:45.864 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.077531+0000", 2024-05-08T18:31:45.864 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.7243000000000004e-05 2024-05-08T18:31:45.864 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:45.865 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:45.865 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:45.865 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.865 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.865 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1394 3.1 3:827d5ec4:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_80:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:45.865 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:43.213768+0000", 2024-05-08T18:31:45.865 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 2.5505125250000003, 2024-05-08T18:31:45.865 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.016525767, 2024-05-08T18:31:45.865 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:45.865 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:45.865 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:45.865 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:45.865 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:45.866 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:45.866 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1394 2024-05-08T18:31:45.866 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.866 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:45.866 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.866 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:45.866 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.213768+0000", 2024-05-08T18:31:45.866 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:45.866 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.866 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.866 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:45.866 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.213768+0000", 2024-05-08T18:31:45.866 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:45.867 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.867 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.867 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:45.867 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.213770+0000", 2024-05-08T18:31:45.867 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.464e-06 2024-05-08T18:31:45.867 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.867 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.867 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:45.867 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.216067+0000", 2024-05-08T18:31:45.867 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0022960569999999998 2024-05-08T18:31:45.867 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.867 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.868 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:45.868 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.216090+0000", 2024-05-08T18:31:45.868 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3082e-05 2024-05-08T18:31:45.868 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.868 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.868 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:45.868 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.216104+0000", 2024-05-08T18:31:45.868 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.428e-05 2024-05-08T18:31:45.868 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.868 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.868 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:45.868 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.216189+0000", 2024-05-08T18:31:45.868 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5536000000000002e-05 2024-05-08T18:31:45.868 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.869 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.869 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:45.869 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.216350+0000", 2024-05-08T18:31:45.869 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000160154 2024-05-08T18:31:45.869 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.869 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.869 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:31:45.869 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.216510+0000", 2024-05-08T18:31:45.869 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016037899999999999 2024-05-08T18:31:45.869 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.869 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.869 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:45.870 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.227673+0000", 2024-05-08T18:31:45.870 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011163185000000001 2024-05-08T18:31:45.870 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.870 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.870 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:45.870 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.230162+0000", 2024-05-08T18:31:45.870 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0024892809999999999 2024-05-08T18:31:45.870 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.870 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.870 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:45.870 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.230235+0000", 2024-05-08T18:31:45.871 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2778e-05 2024-05-08T18:31:45.871 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.871 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.871 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:45.871 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.230294+0000", 2024-05-08T18:31:45.871 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8570999999999999e-05 2024-05-08T18:31:45.871 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:45.871 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:45.871 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:45.871 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.871 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.871 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1399 3.2b 3:d7e5e605:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_85:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:45.871 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:43.263518+0000", 2024-05-08T18:31:45.872 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 2.5007622349999998, 2024-05-08T18:31:45.872 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.013165347000000001, 2024-05-08T18:31:45.872 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:45.872 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:45.872 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:45.872 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:45.872 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:45.872 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:45.872 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1399 2024-05-08T18:31:45.872 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.872 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:45.872 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.873 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:45.873 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.263518+0000", 2024-05-08T18:31:45.873 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:45.873 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.873 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.873 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:45.873 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.263518+0000", 2024-05-08T18:31:45.873 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:45.873 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.873 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.873 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:45.873 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.263521+0000", 2024-05-08T18:31:45.874 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.435e-06 2024-05-08T18:31:45.874 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.874 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.874 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:45.874 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.264866+0000", 2024-05-08T18:31:45.874 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001345417 2024-05-08T18:31:45.874 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.874 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.874 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:45.874 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.264894+0000", 2024-05-08T18:31:45.874 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7509999999999999e-05 2024-05-08T18:31:45.874 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.875 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.875 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:45.875 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.264904+0000", 2024-05-08T18:31:45.875 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0443e-05 2024-05-08T18:31:45.875 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.875 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.875 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:45.875 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.264975+0000", 2024-05-08T18:31:45.875 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1229999999999994e-05 2024-05-08T18:31:45.875 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.875 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.875 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:45.875 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.265123+0000", 2024-05-08T18:31:45.875 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000147816 2024-05-08T18:31:45.876 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.876 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.876 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:45.876 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.265241+0000", 2024-05-08T18:31:45.876 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000117465 2024-05-08T18:31:45.876 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.876 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.876 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:45.876 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.271680+0000", 2024-05-08T18:31:45.876 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0064390979999999999 2024-05-08T18:31:45.876 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.876 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.876 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:45.877 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.276563+0000", 2024-05-08T18:31:45.877 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0048829060000000002 2024-05-08T18:31:45.877 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.877 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.877 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:45.877 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.276630+0000", 2024-05-08T18:31:45.877 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7607999999999994e-05 2024-05-08T18:31:45.877 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.877 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.877 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:45.877 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.276684+0000", 2024-05-08T18:31:45.877 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3418999999999998e-05 2024-05-08T18:31:45.877 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:45.877 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:45.877 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:45.878 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.878 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.878 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1408 3.17 3:e9c201e6:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_94:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:45.878 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:43.352944+0000", 2024-05-08T18:31:45.878 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 2.4113368949999998, 2024-05-08T18:31:45.878 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.014540925999999999, 2024-05-08T18:31:45.878 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:45.878 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:45.878 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:45.878 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:45.878 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:45.878 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:45.878 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1408 2024-05-08T18:31:45.879 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.879 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:45.879 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.879 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:45.879 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.352944+0000", 2024-05-08T18:31:45.879 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:45.879 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.879 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.879 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:45.879 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.352944+0000", 2024-05-08T18:31:45.879 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:45.879 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.879 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.880 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:45.880 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.352946+0000", 2024-05-08T18:31:45.880 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6570000000000001e-06 2024-05-08T18:31:45.880 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.880 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.880 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:45.880 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.355237+0000", 2024-05-08T18:31:45.880 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0022910059999999999 2024-05-08T18:31:45.880 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.880 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.880 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:45.880 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.355261+0000", 2024-05-08T18:31:45.880 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4158000000000001e-05 2024-05-08T18:31:45.881 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.881 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.881 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:45.881 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.355272+0000", 2024-05-08T18:31:45.881 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.013e-05 2024-05-08T18:31:45.881 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.881 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.881 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:45.881 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.355368+0000", 2024-05-08T18:31:45.881 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.6491999999999997e-05 2024-05-08T18:31:45.881 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.881 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.881 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:45.882 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.355540+0000", 2024-05-08T18:31:45.882 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000172201 2024-05-08T18:31:45.882 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.882 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.882 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:45.882 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.355691+0000", 2024-05-08T18:31:45.882 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015104699999999999 2024-05-08T18:31:45.882 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.882 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.882 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:45.882 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.365371+0000", 2024-05-08T18:31:45.882 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0096800380000000002 2024-05-08T18:31:45.883 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.883 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.883 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:45.883 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.367401+0000", 2024-05-08T18:31:45.883 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002029225 2024-05-08T18:31:45.883 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.883 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.883 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:45.883 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.367442+0000", 2024-05-08T18:31:45.883 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0994000000000001e-05 2024-05-08T18:31:45.883 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:45.883 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:45.883 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:45.883 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.367485+0000", 2024-05-08T18:31:45.884 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.2978000000000001e-05 2024-05-08T18:31:45.884 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:45.884 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:45.884 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:45.884 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:45.884 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:45.884 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:45.885 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2024-05-08T18:31:45.885 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:31:45.886 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-08T18:31:45.887 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2024-05-08T18:31:45.887 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:31:45.887 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2024-05-08T18:31:45.888 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:31:45.888 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2024-05-08T18:31:45.888 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:31:45.889 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2024-05-08T18:31:45.889 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:31:45.889 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2024-05-08T18:31:45.889 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:31:45.890 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:31:45.885+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:31:45.904 INFO:tasks.workunit.client.0.smithi097.stdout:user usr2 deleted 2024-05-08T18:31:45.906 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2024-05-08T18:31:45.907 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:31:45.986 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:31:45.982+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:31:46.029 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:46.030 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:31:46.030 INFO:teuthology.orchestra.run.smithi097.stdout: "num_ops": 0 2024-05-08T18:31:46.030 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:46.045 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-08T18:31:46.088 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:31:46.089+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:31:46.095 INFO:tasks.workunit.client.0.smithi097.stdout:Bucket Created: buck_2024_04_8_18_31_46 2024-05-08T18:31:46.168 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:46.169 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:31:46.169 INFO:teuthology.orchestra.run.smithi097.stdout: "complaint_time": 30, 2024-05-08T18:31:46.169 INFO:teuthology.orchestra.run.smithi097.stdout: "num_blocked_ops": 0 2024-05-08T18:31:46.169 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:46.184 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-08T18:31:46.228 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:31:46.229+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:31:46.290 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:31:46.286+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:31:46.324 INFO:tasks.workunit.client.0.smithi097.stderr:10+0 records in 2024-05-08T18:31:46.324 INFO:tasks.workunit.client.0.smithi097.stderr:10+0 records out 2024-05-08T18:31:46.324 INFO:tasks.workunit.client.0.smithi097.stderr:104857600 bytes (105 MB, 100 MiB) copied, 0.0744429 s, 1.4 GB/s 2024-05-08T18:31:46.350 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:46.350 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2024-05-08T18:31:46.350 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2024-05-08T18:31:46.350 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-05-08T18:31:46.350 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.350 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4479.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-05-08T18:31:46.350 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:44.576320+0000", 2024-05-08T18:31:46.350 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 121.772083815, 2024-05-08T18:31:46.351 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019751892, 2024-05-08T18:31:46.351 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:46.351 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:46.351 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "reached pg", 2024-05-08T18:31:46.351 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:46.351 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4479", 2024-05-08T18:31:46.351 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3577501689", 2024-05-08T18:31:46.351 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 2 2024-05-08T18:31:46.351 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.351 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:46.351 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.351 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:46.352 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576320+0000", 2024-05-08T18:31:46.352 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:46.352 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.352 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.352 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:46.352 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576320+0000", 2024-05-08T18:31:46.352 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:46.352 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.352 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.352 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:46.352 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576323+0000", 2024-05-08T18:31:46.352 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.813e-06 2024-05-08T18:31:46.353 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.353 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.353 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:46.353 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576335+0000", 2024-05-08T18:31:46.353 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2330000000000001e-05 2024-05-08T18:31:46.353 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.353 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.353 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:46.353 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576367+0000", 2024-05-08T18:31:46.353 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2036999999999998e-05 2024-05-08T18:31:46.353 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.353 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.354 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:46.354 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576394+0000", 2024-05-08T18:31:46.354 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6529e-05 2024-05-08T18:31:46.354 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.354 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.354 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:46.354 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576550+0000", 2024-05-08T18:31:46.354 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000156718 2024-05-08T18:31:46.354 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.355 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.355 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-05-08T18:31:46.355 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576560+0000", 2024-05-08T18:31:46.355 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0040999999999999e-05 2024-05-08T18:31:46.355 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.355 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.355 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:46.355 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.587240+0000", 2024-05-08T18:31:46.355 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010679266999999999 2024-05-08T18:31:46.355 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.355 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.355 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2024-05-08T18:31:46.356 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.587266+0000", 2024-05-08T18:31:46.356 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6642e-05 2024-05-08T18:31:46.356 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.356 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.356 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:46.356 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.595882+0000", 2024-05-08T18:31:46.356 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0086159600000000006 2024-05-08T18:31:46.356 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.356 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.356 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:46.356 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.596072+0000", 2024-05-08T18:31:46.357 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000189555 2024-05-08T18:31:46.357 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:46.357 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:46.357 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:46.357 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.357 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.357 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1316 3.0 3:03a68e79:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-08T18:31:46.357 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.312804+0000", 2024-05-08T18:31:46.357 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4.0356002350000004, 2024-05-08T18:31:46.357 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021400750999999999, 2024-05-08T18:31:46.357 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:46.357 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:46.358 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:46.358 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:46.358 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:46.358 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:46.358 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1316 2024-05-08T18:31:46.358 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.358 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:46.358 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.358 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:46.358 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.312804+0000", 2024-05-08T18:31:46.358 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:46.358 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.358 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.359 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:46.359 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.312804+0000", 2024-05-08T18:31:46.359 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:46.359 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.359 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.359 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:46.359 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.312807+0000", 2024-05-08T18:31:46.359 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.134e-06 2024-05-08T18:31:46.359 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.359 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.359 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:46.359 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.317697+0000", 2024-05-08T18:31:46.359 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0048908129999999999 2024-05-08T18:31:46.360 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.360 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.360 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:46.360 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.317741+0000", 2024-05-08T18:31:46.360 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3381999999999999e-05 2024-05-08T18:31:46.360 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.360 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.360 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:46.360 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.317766+0000", 2024-05-08T18:31:46.360 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4905999999999998e-05 2024-05-08T18:31:46.360 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.360 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.361 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:46.361 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.317880+0000", 2024-05-08T18:31:46.361 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000114325 2024-05-08T18:31:46.361 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.361 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.361 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:46.361 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.318049+0000", 2024-05-08T18:31:46.361 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000168424 2024-05-08T18:31:46.361 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.361 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.361 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-05-08T18:31:46.361 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.318200+0000", 2024-05-08T18:31:46.361 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000151368 2024-05-08T18:31:46.361 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.362 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.362 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:46.362 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.326262+0000", 2024-05-08T18:31:46.362 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0080624249999999998 2024-05-08T18:31:46.362 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.362 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.362 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:46.362 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.334084+0000", 2024-05-08T18:31:46.362 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0078220189999999995 2024-05-08T18:31:46.362 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.362 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.362 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:46.362 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.334151+0000", 2024-05-08T18:31:46.363 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6469000000000003e-05 2024-05-08T18:31:46.363 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.363 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.363 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:46.363 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.334204+0000", 2024-05-08T18:31:46.363 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3486000000000003e-05 2024-05-08T18:31:46.363 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:46.363 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:46.363 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:46.363 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.363 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.363 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1323 3.8 e81/21 3:1035fbfb:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_9:head v 81'1, mlcod=0'0)", 2024-05-08T18:31:46.364 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.417887+0000", 2024-05-08T18:31:46.364 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 3.930516678, 2024-05-08T18:31:46.364 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012382977999999999, 2024-05-08T18:31:46.364 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:46.364 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:46.364 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:46.364 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:46.364 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.364 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:46.364 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.417887+0000", 2024-05-08T18:31:46.364 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:46.364 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.365 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.365 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:46.365 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.417887+0000", 2024-05-08T18:31:46.365 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:46.365 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.365 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.365 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:46.365 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.417889+0000", 2024-05-08T18:31:46.365 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.827e-06 2024-05-08T18:31:46.365 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.365 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.365 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:46.365 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.421237+0000", 2024-05-08T18:31:46.366 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0033480440000000001 2024-05-08T18:31:46.366 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.366 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.366 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:46.366 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.421262+0000", 2024-05-08T18:31:46.366 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5267000000000001e-05 2024-05-08T18:31:46.366 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.366 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.366 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:46.366 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.421275+0000", 2024-05-08T18:31:46.366 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2714999999999999e-05 2024-05-08T18:31:46.366 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.367 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.367 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:46.367 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.421348+0000", 2024-05-08T18:31:46.367 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2933000000000001e-05 2024-05-08T18:31:46.367 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.367 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.367 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:46.367 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.421365+0000", 2024-05-08T18:31:46.367 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6804e-05 2024-05-08T18:31:46.367 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.367 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.367 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:46.367 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.430139+0000", 2024-05-08T18:31:46.368 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0087743519999999992 2024-05-08T18:31:46.368 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.368 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.368 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:46.368 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.430270+0000", 2024-05-08T18:31:46.368 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013103600000000001 2024-05-08T18:31:46.368 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:46.368 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:46.368 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:46.368 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.368 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.368 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1327 3.1a e81/21 3:58da5138:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_13:head v 81'1, mlcod=0'0)", 2024-05-08T18:31:46.368 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.470013+0000", 2024-05-08T18:31:46.368 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 3.8783906039999998, 2024-05-08T18:31:46.369 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011330646, 2024-05-08T18:31:46.369 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:46.369 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:46.369 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:46.369 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:46.369 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.369 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:46.369 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.470013+0000", 2024-05-08T18:31:46.369 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:46.369 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.369 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.369 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:46.370 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.470013+0000", 2024-05-08T18:31:46.370 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:46.370 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.370 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.370 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:46.370 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.470015+0000", 2024-05-08T18:31:46.370 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.378e-06 2024-05-08T18:31:46.370 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.370 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.370 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:46.370 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.475032+0000", 2024-05-08T18:31:46.370 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0050172080000000004 2024-05-08T18:31:46.371 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.371 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.371 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:46.371 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.475056+0000", 2024-05-08T18:31:46.371 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4119999999999999e-05 2024-05-08T18:31:46.371 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.371 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.371 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:46.371 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.475070+0000", 2024-05-08T18:31:46.371 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4504999999999999e-05 2024-05-08T18:31:46.371 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.371 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.372 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:46.372 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.475152+0000", 2024-05-08T18:31:46.372 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.1981e-05 2024-05-08T18:31:46.372 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.372 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.372 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:46.372 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.475171+0000", 2024-05-08T18:31:46.372 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8668000000000002e-05 2024-05-08T18:31:46.372 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.372 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.372 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:46.372 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.481291+0000", 2024-05-08T18:31:46.373 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0061197430000000004 2024-05-08T18:31:46.373 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.373 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.373 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:46.373 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.481344+0000", 2024-05-08T18:31:46.373 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3043e-05 2024-05-08T18:31:46.373 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:46.373 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:46.373 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:46.373 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.373 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.373 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1330 3.8 e81/21 3:124da8ab:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_16:head v 81'2, mlcod=0'0)", 2024-05-08T18:31:46.373 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.495388+0000", 2024-05-08T18:31:46.374 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 3.8530154520000002, 2024-05-08T18:31:46.374 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011386743, 2024-05-08T18:31:46.374 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:46.374 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:46.374 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:46.374 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:46.374 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.374 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:46.374 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.495388+0000", 2024-05-08T18:31:46.374 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:46.374 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.374 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.375 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:46.375 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.495388+0000", 2024-05-08T18:31:46.375 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:46.375 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.375 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.375 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:46.375 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.495390+0000", 2024-05-08T18:31:46.375 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2139999999999999e-06 2024-05-08T18:31:46.375 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.375 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.375 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:46.375 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.496871+0000", 2024-05-08T18:31:46.375 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001481581 2024-05-08T18:31:46.375 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.376 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.376 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:46.376 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.496899+0000", 2024-05-08T18:31:46.376 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7616000000000001e-05 2024-05-08T18:31:46.376 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.376 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.376 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:46.376 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.496916+0000", 2024-05-08T18:31:46.376 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7655e-05 2024-05-08T18:31:46.376 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.376 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.376 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:46.377 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.497003+0000", 2024-05-08T18:31:46.377 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6952000000000004e-05 2024-05-08T18:31:46.377 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.377 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.377 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:46.377 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.497035+0000", 2024-05-08T18:31:46.377 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1529000000000003e-05 2024-05-08T18:31:46.377 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.377 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.377 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:46.377 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.506706+0000", 2024-05-08T18:31:46.377 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0096707540000000002 2024-05-08T18:31:46.377 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.378 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.378 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:46.378 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.506775+0000", 2024-05-08T18:31:46.378 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9442000000000004e-05 2024-05-08T18:31:46.378 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:46.378 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:46.378 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:46.378 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.378 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.379 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1336 3.2 e82/46 3:42c6ce4f:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_22:head v 82'1, mlcod=0'0)", 2024-05-08T18:31:46.379 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.573034+0000", 2024-05-08T18:31:46.379 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 3.7753696469999998, 2024-05-08T18:31:46.379 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.018430308999999999, 2024-05-08T18:31:46.379 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:46.379 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:46.379 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:46.379 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:46.379 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.379 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:46.379 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.573034+0000", 2024-05-08T18:31:46.379 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:46.379 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.379 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.379 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:46.380 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.573034+0000", 2024-05-08T18:31:46.380 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:46.380 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.380 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.380 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:46.380 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.573034+0000", 2024-05-08T18:31:46.380 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.48e-07 2024-05-08T18:31:46.380 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.380 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.380 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:46.380 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.578475+0000", 2024-05-08T18:31:46.380 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0054408690000000001 2024-05-08T18:31:46.380 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.380 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.381 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:46.381 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.578488+0000", 2024-05-08T18:31:46.381 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2777e-05 2024-05-08T18:31:46.381 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.381 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.381 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:46.381 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.578499+0000", 2024-05-08T18:31:46.381 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0995999999999999e-05 2024-05-08T18:31:46.381 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.381 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.381 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:46.381 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.578875+0000", 2024-05-08T18:31:46.381 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000376139 2024-05-08T18:31:46.382 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.382 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.382 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:46.382 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.578900+0000", 2024-05-08T18:31:46.382 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5205e-05 2024-05-08T18:31:46.382 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.382 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.382 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:46.382 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.591395+0000", 2024-05-08T18:31:46.382 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012494244 2024-05-08T18:31:46.382 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.382 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.382 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:46.383 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.591464+0000", 2024-05-08T18:31:46.383 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9831000000000003e-05 2024-05-08T18:31:46.383 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:46.383 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:46.383 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:46.383 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.383 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.383 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1342 3.32 e82/21 3:4c847226:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_28:head v 82'2, mlcod=0'0)", 2024-05-08T18:31:46.383 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.626427+0000", 2024-05-08T18:31:46.383 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 3.7219771320000001, 2024-05-08T18:31:46.383 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.013168078, 2024-05-08T18:31:46.383 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:46.383 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:46.384 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:46.384 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:46.384 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.384 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:46.384 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.626427+0000", 2024-05-08T18:31:46.384 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:46.384 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.384 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.384 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:46.384 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.626427+0000", 2024-05-08T18:31:46.384 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:46.384 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.384 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.384 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:46.385 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.626428+0000", 2024-05-08T18:31:46.385 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.672e-06 2024-05-08T18:31:46.385 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.385 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.385 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:46.385 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.628013+0000", 2024-05-08T18:31:46.385 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0015845569999999999 2024-05-08T18:31:46.385 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.385 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.385 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:46.385 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.628035+0000", 2024-05-08T18:31:46.385 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2419999999999999e-05 2024-05-08T18:31:46.385 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.385 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.386 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:46.386 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.628046+0000", 2024-05-08T18:31:46.386 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0353999999999999e-05 2024-05-08T18:31:46.386 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.386 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.386 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:46.386 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.628116+0000", 2024-05-08T18:31:46.386 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.0722999999999994e-05 2024-05-08T18:31:46.386 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.386 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.386 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:46.386 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.628138+0000", 2024-05-08T18:31:46.387 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1583999999999999e-05 2024-05-08T18:31:46.387 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.387 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.387 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:46.387 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.639523+0000", 2024-05-08T18:31:46.387 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011385052 2024-05-08T18:31:46.387 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.387 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.387 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:46.387 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.639595+0000", 2024-05-08T18:31:46.387 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1716000000000003e-05 2024-05-08T18:31:46.387 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:46.387 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:46.387 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:46.387 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.388 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.388 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1352 3.0 3:0085bede:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_38:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:46.388 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.730228+0000", 2024-05-08T18:31:46.388 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 3.6181761959999998, 2024-05-08T18:31:46.388 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.013827124999999999, 2024-05-08T18:31:46.388 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:46.388 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:46.388 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:46.388 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:46.388 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:46.388 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:46.388 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1352 2024-05-08T18:31:46.388 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.389 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:46.389 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.389 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:46.389 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.730228+0000", 2024-05-08T18:31:46.389 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:46.389 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.389 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.389 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:46.389 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.730228+0000", 2024-05-08T18:31:46.389 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:46.389 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.389 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.389 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:46.390 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.730230+0000", 2024-05-08T18:31:46.390 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.34e-06 2024-05-08T18:31:46.390 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.390 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.390 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:46.390 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.731986+0000", 2024-05-08T18:31:46.390 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0017560379999999999 2024-05-08T18:31:46.390 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.390 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.390 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:46.390 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.732011+0000", 2024-05-08T18:31:46.390 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5548e-05 2024-05-08T18:31:46.390 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.390 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.391 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:46.391 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.732025+0000", 2024-05-08T18:31:46.391 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3103e-05 2024-05-08T18:31:46.391 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.391 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.391 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:46.391 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.732121+0000", 2024-05-08T18:31:46.391 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.6000000000000002e-05 2024-05-08T18:31:46.391 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.391 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.391 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:46.391 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.732314+0000", 2024-05-08T18:31:46.392 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00019294900000000001 2024-05-08T18:31:46.392 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.392 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.392 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-05-08T18:31:46.392 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.732488+0000", 2024-05-08T18:31:46.392 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000174747 2024-05-08T18:31:46.392 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.392 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.392 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:46.392 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.743193+0000", 2024-05-08T18:31:46.392 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010704910999999999 2024-05-08T18:31:46.392 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.392 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.392 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:46.393 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.743921+0000", 2024-05-08T18:31:46.393 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000728205 2024-05-08T18:31:46.393 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.393 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.393 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:46.393 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.743997+0000", 2024-05-08T18:31:46.393 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.5198999999999996e-05 2024-05-08T18:31:46.393 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.393 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.393 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:46.393 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.744055+0000", 2024-05-08T18:31:46.393 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8084999999999997e-05 2024-05-08T18:31:46.393 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:46.393 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:46.394 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:46.394 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.394 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.394 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1353 3.19 3:9832a795:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_39:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:46.394 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.740875+0000", 2024-05-08T18:31:46.394 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 3.6075290820000001, 2024-05-08T18:31:46.394 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.014311799, 2024-05-08T18:31:46.394 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:46.394 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:46.394 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:46.394 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:46.394 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:46.394 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:46.395 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1353 2024-05-08T18:31:46.395 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.395 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:46.395 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.395 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:46.395 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.740875+0000", 2024-05-08T18:31:46.395 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:46.395 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.395 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.395 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:46.395 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.740875+0000", 2024-05-08T18:31:46.395 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:46.396 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.396 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.396 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:46.396 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.740877+0000", 2024-05-08T18:31:46.396 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9539999999999998e-06 2024-05-08T18:31:46.396 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.396 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.396 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:46.396 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.742244+0000", 2024-05-08T18:31:46.396 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001367041 2024-05-08T18:31:46.396 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.396 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.396 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:46.396 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.742277+0000", 2024-05-08T18:31:46.397 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2855000000000003e-05 2024-05-08T18:31:46.397 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.397 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.397 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:46.397 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.742290+0000", 2024-05-08T18:31:46.397 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3919e-05 2024-05-08T18:31:46.397 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.397 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.397 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:46.397 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.742377+0000", 2024-05-08T18:31:46.397 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6148000000000003e-05 2024-05-08T18:31:46.397 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.397 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.398 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:46.398 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.742489+0000", 2024-05-08T18:31:46.398 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000112207 2024-05-08T18:31:46.398 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.398 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.398 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:46.398 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.742589+0000", 2024-05-08T18:31:46.398 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000100253 2024-05-08T18:31:46.398 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.398 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.398 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:46.398 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.754466+0000", 2024-05-08T18:31:46.399 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011876711999999999 2024-05-08T18:31:46.399 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.399 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.399 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:46.399 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.755080+0000", 2024-05-08T18:31:46.399 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00061390200000000005 2024-05-08T18:31:46.399 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.399 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.399 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:46.399 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.755119+0000", 2024-05-08T18:31:46.399 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9563000000000001e-05 2024-05-08T18:31:46.399 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.399 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.399 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:46.400 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.755186+0000", 2024-05-08T18:31:46.400 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7244999999999997e-05 2024-05-08T18:31:46.400 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:46.400 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:46.400 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:46.400 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.400 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.400 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1356 3.2 e82/46 3:41e29af7:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_42:head v 82'2, mlcod=0'0)", 2024-05-08T18:31:46.400 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.773148+0000", 2024-05-08T18:31:46.400 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 3.5752558150000002, 2024-05-08T18:31:46.400 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.013374621, 2024-05-08T18:31:46.400 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:46.401 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:46.401 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:46.401 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:46.401 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.401 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:46.401 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.773148+0000", 2024-05-08T18:31:46.401 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:46.401 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.401 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.401 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:46.401 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.773148+0000", 2024-05-08T18:31:46.401 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:46.401 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.402 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.402 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:46.402 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.773150+0000", 2024-05-08T18:31:46.402 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7940000000000001e-06 2024-05-08T18:31:46.402 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.402 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.402 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:46.402 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.774924+0000", 2024-05-08T18:31:46.402 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0017746319999999999 2024-05-08T18:31:46.402 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.402 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.402 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:46.402 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.774942+0000", 2024-05-08T18:31:46.403 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7819999999999999e-05 2024-05-08T18:31:46.403 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.403 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.403 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:46.403 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.774952+0000", 2024-05-08T18:31:46.403 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.8039999999999996e-06 2024-05-08T18:31:46.403 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.403 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.403 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:46.403 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.775018+0000", 2024-05-08T18:31:46.403 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5951000000000006e-05 2024-05-08T18:31:46.403 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.403 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.404 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:46.404 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.775039+0000", 2024-05-08T18:31:46.404 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0962999999999999e-05 2024-05-08T18:31:46.404 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.404 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.404 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:46.404 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.786465+0000", 2024-05-08T18:31:46.404 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011425820999999999 2024-05-08T18:31:46.404 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.404 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.404 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:46.404 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.786523+0000", 2024-05-08T18:31:46.404 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7836e-05 2024-05-08T18:31:46.405 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:46.405 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:46.405 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:46.405 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.405 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.405 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1364 3.19 3:9b6bd3b9:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_50:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:46.405 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.853643+0000", 2024-05-08T18:31:46.405 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 3.4947607280000001, 2024-05-08T18:31:46.405 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.013216927, 2024-05-08T18:31:46.405 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:46.405 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:46.405 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:46.405 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:46.406 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:46.406 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:46.406 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1364 2024-05-08T18:31:46.406 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.406 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:46.406 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.406 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:46.406 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.853643+0000", 2024-05-08T18:31:46.406 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:46.406 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.406 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.406 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:46.406 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.853643+0000", 2024-05-08T18:31:46.406 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:46.407 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.407 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.407 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:46.407 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.853645+0000", 2024-05-08T18:31:46.407 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4219999999999999e-06 2024-05-08T18:31:46.407 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.407 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.407 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:46.407 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.855207+0000", 2024-05-08T18:31:46.407 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001562031 2024-05-08T18:31:46.407 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.407 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.407 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:46.408 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.855222+0000", 2024-05-08T18:31:46.408 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4823e-05 2024-05-08T18:31:46.408 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.408 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.408 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:46.408 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.855232+0000", 2024-05-08T18:31:46.408 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0033e-05 2024-05-08T18:31:46.408 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.408 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.408 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:46.408 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.855307+0000", 2024-05-08T18:31:46.408 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.4358999999999997e-05 2024-05-08T18:31:46.408 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.408 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.409 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:46.409 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.855525+0000", 2024-05-08T18:31:46.409 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021857300000000001 2024-05-08T18:31:46.409 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.409 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.409 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:46.409 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.855699+0000", 2024-05-08T18:31:46.409 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00017360100000000001 2024-05-08T18:31:46.409 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.409 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.409 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:46.409 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.866057+0000", 2024-05-08T18:31:46.409 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010357847 2024-05-08T18:31:46.410 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.410 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.410 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:46.410 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.866741+0000", 2024-05-08T18:31:46.410 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00068395800000000003 2024-05-08T18:31:46.410 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.410 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.410 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:46.410 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.866806+0000", 2024-05-08T18:31:46.410 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5660999999999994e-05 2024-05-08T18:31:46.410 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.410 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.410 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:46.410 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.866860+0000", 2024-05-08T18:31:46.411 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3619000000000003e-05 2024-05-08T18:31:46.411 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:46.411 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:46.411 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:46.411 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.411 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.411 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1367 3.3e 3:7d67f190:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_53:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:46.411 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.883854+0000", 2024-05-08T18:31:46.411 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 3.4645500399999998, 2024-05-08T18:31:46.411 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.013212130000000001, 2024-05-08T18:31:46.411 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:46.411 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:46.411 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:46.411 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:46.412 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:46.412 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:46.412 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1367 2024-05-08T18:31:46.412 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.412 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:46.412 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.412 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:46.412 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.883854+0000", 2024-05-08T18:31:46.412 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:46.412 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.412 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.412 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:46.412 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.883854+0000", 2024-05-08T18:31:46.412 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:46.413 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.413 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.413 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:46.413 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.883856+0000", 2024-05-08T18:31:46.413 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3929999999999998e-06 2024-05-08T18:31:46.413 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.413 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.413 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:46.413 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.885471+0000", 2024-05-08T18:31:46.413 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001615079 2024-05-08T18:31:46.413 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.413 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.413 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:46.414 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.885496+0000", 2024-05-08T18:31:46.414 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5142000000000001e-05 2024-05-08T18:31:46.414 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.414 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.414 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:46.414 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.885507+0000", 2024-05-08T18:31:46.414 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0538e-05 2024-05-08T18:31:46.414 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.414 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.414 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:46.414 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.885587+0000", 2024-05-08T18:31:46.414 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.0266999999999996e-05 2024-05-08T18:31:46.414 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.414 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.415 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:46.415 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.885737+0000", 2024-05-08T18:31:46.415 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015008999999999999 2024-05-08T18:31:46.415 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.415 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.415 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:46.415 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.885870+0000", 2024-05-08T18:31:46.415 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000132507 2024-05-08T18:31:46.415 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.415 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.415 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:46.415 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.896651+0000", 2024-05-08T18:31:46.415 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010781570000000001 2024-05-08T18:31:46.415 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.416 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.416 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:46.416 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.896965+0000", 2024-05-08T18:31:46.416 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00031394399999999997 2024-05-08T18:31:46.416 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.416 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.416 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:46.416 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.897021+0000", 2024-05-08T18:31:46.416 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6198e-05 2024-05-08T18:31:46.416 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.416 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.416 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:46.416 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.897066+0000", 2024-05-08T18:31:46.417 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4401999999999999e-05 2024-05-08T18:31:46.417 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:46.417 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:46.417 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:46.417 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.417 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.417 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1371 3.19 3:9bd55f7b:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_57:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:46.417 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.925956+0000", 2024-05-08T18:31:46.417 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 3.4224482300000001, 2024-05-08T18:31:46.417 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.020098687, 2024-05-08T18:31:46.417 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:46.417 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:46.417 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:46.418 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:46.418 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:46.418 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:46.418 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1371 2024-05-08T18:31:46.418 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.418 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:46.418 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.418 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:46.418 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.925956+0000", 2024-05-08T18:31:46.418 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:46.418 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.418 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.418 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:46.419 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.925956+0000", 2024-05-08T18:31:46.419 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:46.419 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.419 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.419 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:46.419 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.925958+0000", 2024-05-08T18:31:46.419 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3939999999999999e-06 2024-05-08T18:31:46.419 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.419 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.419 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:46.419 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.927928+0000", 2024-05-08T18:31:46.419 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0019701779999999999 2024-05-08T18:31:46.419 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.419 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.420 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:46.420 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.927964+0000", 2024-05-08T18:31:46.420 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6226999999999997e-05 2024-05-08T18:31:46.420 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.420 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.420 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:46.420 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.927984+0000", 2024-05-08T18:31:46.420 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9647999999999999e-05 2024-05-08T18:31:46.420 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.420 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.420 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:46.420 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.928065+0000", 2024-05-08T18:31:46.420 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.1379999999999997e-05 2024-05-08T18:31:46.421 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.421 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.421 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:46.421 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.928171+0000", 2024-05-08T18:31:46.421 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000105618 2024-05-08T18:31:46.421 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.421 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.421 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:46.421 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.928283+0000", 2024-05-08T18:31:46.421 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000111733 2024-05-08T18:31:46.421 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.421 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.421 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:46.421 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.942089+0000", 2024-05-08T18:31:46.422 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.013805817999999999 2024-05-08T18:31:46.422 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.422 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.422 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:46.422 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.945982+0000", 2024-05-08T18:31:46.422 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0038930129999999999 2024-05-08T18:31:46.422 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.422 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.422 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:46.422 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.946022+0000", 2024-05-08T18:31:46.422 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0224e-05 2024-05-08T18:31:46.422 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.422 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.423 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:46.423 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.946054+0000", 2024-05-08T18:31:46.423 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2453999999999998e-05 2024-05-08T18:31:46.423 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:46.423 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:46.423 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:46.423 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.423 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.423 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1374 3.19 3:9a2ca5a0:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_60:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:46.423 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.956999+0000", 2024-05-08T18:31:46.423 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 3.3914049930000001, 2024-05-08T18:31:46.423 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011439477, 2024-05-08T18:31:46.423 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:46.424 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:46.424 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:46.424 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:46.424 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:46.424 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:46.424 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1374 2024-05-08T18:31:46.424 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.424 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:46.424 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.424 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:46.424 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.956999+0000", 2024-05-08T18:31:46.424 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:46.424 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.424 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.425 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:46.425 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.956999+0000", 2024-05-08T18:31:46.425 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:46.425 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.425 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.425 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:46.425 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.957002+0000", 2024-05-08T18:31:46.425 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8219999999999998e-06 2024-05-08T18:31:46.425 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.425 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.425 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:46.425 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.958268+0000", 2024-05-08T18:31:46.425 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012660799999999999 2024-05-08T18:31:46.425 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.426 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.426 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:46.426 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.958295+0000", 2024-05-08T18:31:46.426 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7438999999999999e-05 2024-05-08T18:31:46.426 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.426 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.426 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:46.426 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.958310+0000", 2024-05-08T18:31:46.426 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4635e-05 2024-05-08T18:31:46.426 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.426 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.426 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:46.426 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.958371+0000", 2024-05-08T18:31:46.426 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1583999999999999e-05 2024-05-08T18:31:46.427 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.427 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.427 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:46.427 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.958515+0000", 2024-05-08T18:31:46.427 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014339600000000001 2024-05-08T18:31:46.427 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.427 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.427 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:46.427 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.958643+0000", 2024-05-08T18:31:46.427 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012828699999999999 2024-05-08T18:31:46.427 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.427 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.428 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:46.428 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.966167+0000", 2024-05-08T18:31:46.428 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0075240250000000002 2024-05-08T18:31:46.428 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.428 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.428 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:46.428 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.968328+0000", 2024-05-08T18:31:46.428 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002160777 2024-05-08T18:31:46.428 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.428 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.428 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:46.428 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.968381+0000", 2024-05-08T18:31:46.428 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3538999999999997e-05 2024-05-08T18:31:46.428 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.429 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.429 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:46.429 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.968438+0000", 2024-05-08T18:31:46.429 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6892999999999999e-05 2024-05-08T18:31:46.429 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:46.429 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:46.429 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:46.429 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.429 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.429 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1378 3.31 3:8cc8fed9:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_64:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:46.429 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:43.012136+0000", 2024-05-08T18:31:46.429 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 3.3362679960000001, 2024-05-08T18:31:46.429 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.015872313999999998, 2024-05-08T18:31:46.429 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:46.430 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:46.430 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:46.430 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:46.430 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:46.430 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:46.430 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1378 2024-05-08T18:31:46.430 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.430 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:46.430 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.430 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:46.430 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.012136+0000", 2024-05-08T18:31:46.430 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:46.430 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.431 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.431 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:46.431 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.012136+0000", 2024-05-08T18:31:46.431 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:46.431 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.431 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.431 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:46.431 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.012139+0000", 2024-05-08T18:31:46.431 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4340000000000001e-06 2024-05-08T18:31:46.431 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.431 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.431 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:46.431 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.013630+0000", 2024-05-08T18:31:46.431 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001491081 2024-05-08T18:31:46.432 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.432 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.432 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:46.432 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.013668+0000", 2024-05-08T18:31:46.432 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8155000000000003e-05 2024-05-08T18:31:46.432 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.432 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.432 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:46.432 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.013687+0000", 2024-05-08T18:31:46.432 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8581e-05 2024-05-08T18:31:46.432 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.432 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.432 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:46.432 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.013786+0000", 2024-05-08T18:31:46.433 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.9242999999999998e-05 2024-05-08T18:31:46.433 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.433 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.433 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:46.433 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.013977+0000", 2024-05-08T18:31:46.433 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00019064400000000001 2024-05-08T18:31:46.433 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.433 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.433 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:31:46.433 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.014136+0000", 2024-05-08T18:31:46.433 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000159223 2024-05-08T18:31:46.433 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.433 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.433 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:46.434 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.021030+0000", 2024-05-08T18:31:46.434 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0068940319999999996 2024-05-08T18:31:46.434 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.434 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.434 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:46.434 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.027799+0000", 2024-05-08T18:31:46.434 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00676868 2024-05-08T18:31:46.434 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.434 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.434 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:46.434 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.027917+0000", 2024-05-08T18:31:46.434 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011818400000000001 2024-05-08T18:31:46.434 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.434 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.435 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:46.435 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.028008+0000", 2024-05-08T18:31:46.435 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.1057000000000006e-05 2024-05-08T18:31:46.435 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:46.435 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:46.435 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:46.435 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.435 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.435 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1380 3.3e 3:7d684d22:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_66:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:46.435 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:43.041619+0000", 2024-05-08T18:31:46.435 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 3.306784612, 2024-05-08T18:31:46.435 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012536192, 2024-05-08T18:31:46.435 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:46.435 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:46.436 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:46.436 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:46.436 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:46.436 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:46.436 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1380 2024-05-08T18:31:46.436 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.436 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:46.436 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.436 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:46.436 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.041619+0000", 2024-05-08T18:31:46.436 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:46.436 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.436 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.436 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:46.437 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.041619+0000", 2024-05-08T18:31:46.437 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:46.437 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.437 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.437 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:46.437 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.041621+0000", 2024-05-08T18:31:46.437 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3159999999999999e-06 2024-05-08T18:31:46.437 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.437 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.437 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:46.437 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.043213+0000", 2024-05-08T18:31:46.437 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0015913870000000001 2024-05-08T18:31:46.437 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.437 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.438 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:46.438 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.043238+0000", 2024-05-08T18:31:46.438 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5575000000000002e-05 2024-05-08T18:31:46.438 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.438 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.438 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:46.438 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.043249+0000", 2024-05-08T18:31:46.438 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0936e-05 2024-05-08T18:31:46.438 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.438 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.438 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:46.438 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.043335+0000", 2024-05-08T18:31:46.438 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5796000000000003e-05 2024-05-08T18:31:46.439 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.439 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.439 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:46.439 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.043524+0000", 2024-05-08T18:31:46.439 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00018895300000000001 2024-05-08T18:31:46.439 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.439 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.439 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:46.439 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.043704+0000", 2024-05-08T18:31:46.439 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00017979399999999999 2024-05-08T18:31:46.439 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.439 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.439 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:46.439 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.053711+0000", 2024-05-08T18:31:46.439 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010006694999999999 2024-05-08T18:31:46.440 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.440 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.440 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:46.440 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.054084+0000", 2024-05-08T18:31:46.440 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00037332899999999999 2024-05-08T18:31:46.440 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.440 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.440 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:46.440 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.054122+0000", 2024-05-08T18:31:46.440 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8430000000000003e-05 2024-05-08T18:31:46.440 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.440 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.440 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:46.441 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.054155+0000", 2024-05-08T18:31:46.441 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2981000000000002e-05 2024-05-08T18:31:46.441 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:46.441 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:46.441 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:46.441 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.441 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.441 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1385 3.1a e82/21 3:5abdd61d:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_71:head v 82'2, mlcod=0'0)", 2024-05-08T18:31:46.441 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:43.111067+0000", 2024-05-08T18:31:46.441 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 3.2373369190000001, 2024-05-08T18:31:46.441 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.013230812999999999, 2024-05-08T18:31:46.441 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:46.441 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:46.441 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:46.441 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:46.442 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.442 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:46.442 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.111067+0000", 2024-05-08T18:31:46.442 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:46.442 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.442 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.442 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:46.442 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.111067+0000", 2024-05-08T18:31:46.442 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:46.442 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.442 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.442 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:46.442 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.111068+0000", 2024-05-08T18:31:46.443 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.485e-06 2024-05-08T18:31:46.443 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.443 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.443 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:46.443 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.116689+0000", 2024-05-08T18:31:46.443 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0056206010000000002 2024-05-08T18:31:46.443 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.443 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.443 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:46.443 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.116711+0000", 2024-05-08T18:31:46.443 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1725999999999998e-05 2024-05-08T18:31:46.443 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.443 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.443 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:46.444 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.116723+0000", 2024-05-08T18:31:46.444 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2343e-05 2024-05-08T18:31:46.444 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.444 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.444 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:46.444 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.116827+0000", 2024-05-08T18:31:46.444 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000103744 2024-05-08T18:31:46.444 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.444 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.444 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:46.444 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.116867+0000", 2024-05-08T18:31:46.444 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0518000000000001e-05 2024-05-08T18:31:46.444 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.444 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.445 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:46.445 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.124236+0000", 2024-05-08T18:31:46.445 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0073690980000000001 2024-05-08T18:31:46.445 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.445 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.445 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:46.445 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.124298+0000", 2024-05-08T18:31:46.445 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1297999999999995e-05 2024-05-08T18:31:46.445 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:46.445 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:46.445 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:46.445 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.445 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.445 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1390 3.0 3:00a67f20:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_76:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:46.446 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:43.173995+0000", 2024-05-08T18:31:46.446 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 3.174408755, 2024-05-08T18:31:46.446 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.014872183000000001, 2024-05-08T18:31:46.446 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:46.446 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:46.446 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:46.446 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:46.446 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:46.446 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:46.446 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1390 2024-05-08T18:31:46.446 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.446 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:46.446 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.446 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:46.447 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.173995+0000", 2024-05-08T18:31:46.447 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:46.447 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.447 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.447 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:46.447 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.173995+0000", 2024-05-08T18:31:46.447 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:46.447 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.447 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.447 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:46.447 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.173998+0000", 2024-05-08T18:31:46.447 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9390000000000002e-06 2024-05-08T18:31:46.447 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.447 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.448 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:46.448 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.175751+0000", 2024-05-08T18:31:46.448 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0017533360000000001 2024-05-08T18:31:46.448 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.448 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.448 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:46.448 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.175789+0000", 2024-05-08T18:31:46.448 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7991000000000003e-05 2024-05-08T18:31:46.448 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.448 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.448 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:46.448 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.175810+0000", 2024-05-08T18:31:46.448 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1228000000000001e-05 2024-05-08T18:31:46.448 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.449 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.449 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:46.449 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.175888+0000", 2024-05-08T18:31:46.449 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7288999999999998e-05 2024-05-08T18:31:46.449 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.449 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.449 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:46.449 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.176042+0000", 2024-05-08T18:31:46.449 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000154437 2024-05-08T18:31:46.449 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.449 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.449 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-05-08T18:31:46.449 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.176163+0000", 2024-05-08T18:31:46.449 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000120306 2024-05-08T18:31:46.450 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.450 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.450 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:46.450 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.187621+0000", 2024-05-08T18:31:46.450 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011458034000000001 2024-05-08T18:31:46.450 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.450 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.450 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:46.450 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.188751+0000", 2024-05-08T18:31:46.450 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0011302020000000001 2024-05-08T18:31:46.450 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.450 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.450 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:46.450 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.188815+0000", 2024-05-08T18:31:46.451 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3918999999999996e-05 2024-05-08T18:31:46.451 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.451 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.451 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:46.451 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.188867+0000", 2024-05-08T18:31:46.451 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.2502e-05 2024-05-08T18:31:46.451 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:46.451 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:46.451 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:46.451 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.451 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.451 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1397 3.31 3:8def190d:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_83:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:46.451 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:43.244469+0000", 2024-05-08T18:31:46.452 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 3.1039350909999999, 2024-05-08T18:31:46.452 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012102296, 2024-05-08T18:31:46.452 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:46.452 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:46.452 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:46.452 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:46.452 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:46.452 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:46.452 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1397 2024-05-08T18:31:46.452 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.452 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:46.452 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.452 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:46.452 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.244469+0000", 2024-05-08T18:31:46.453 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:46.453 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.453 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.453 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:46.453 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.244469+0000", 2024-05-08T18:31:46.453 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:46.453 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.453 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.453 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:46.453 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.244472+0000", 2024-05-08T18:31:46.453 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8210000000000003e-06 2024-05-08T18:31:46.453 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.453 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.453 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:46.454 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.246032+0000", 2024-05-08T18:31:46.454 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0015596029999999999 2024-05-08T18:31:46.454 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.454 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.454 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:46.454 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.246057+0000", 2024-05-08T18:31:46.454 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4519e-05 2024-05-08T18:31:46.454 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.454 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.455 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:46.455 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.246066+0000", 2024-05-08T18:31:46.455 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.8689999999999999e-06 2024-05-08T18:31:46.455 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.455 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.455 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:46.455 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.246152+0000", 2024-05-08T18:31:46.455 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5659000000000001e-05 2024-05-08T18:31:46.455 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.455 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.455 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:46.455 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.246317+0000", 2024-05-08T18:31:46.455 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000164971 2024-05-08T18:31:46.456 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.456 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.456 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:31:46.456 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.246470+0000", 2024-05-08T18:31:46.456 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000152738 2024-05-08T18:31:46.456 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.456 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.456 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:46.456 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.251017+0000", 2024-05-08T18:31:46.456 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0045468440000000004 2024-05-08T18:31:46.456 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.456 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.457 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:46.457 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.256479+0000", 2024-05-08T18:31:46.457 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0054620989999999998 2024-05-08T18:31:46.457 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.457 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.457 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:46.457 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.256520+0000", 2024-05-08T18:31:46.457 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.1561999999999999e-05 2024-05-08T18:31:46.457 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.457 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.457 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:46.457 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.256571+0000", 2024-05-08T18:31:46.457 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.0611e-05 2024-05-08T18:31:46.458 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:46.458 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:46.458 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:46.458 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.458 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.458 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1404 3.25 3:a4d3268f:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_90:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:46.458 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:43.312775+0000", 2024-05-08T18:31:46.458 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 3.0356288760000001, 2024-05-08T18:31:46.458 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012465034, 2024-05-08T18:31:46.458 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:46.458 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:46.458 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:46.458 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:46.458 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:46.459 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:46.459 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1404 2024-05-08T18:31:46.459 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.459 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:46.459 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.459 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:46.459 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.312775+0000", 2024-05-08T18:31:46.459 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:46.459 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.459 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.459 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:46.459 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.312775+0000", 2024-05-08T18:31:46.460 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:46.460 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.460 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.460 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:46.460 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.312777+0000", 2024-05-08T18:31:46.460 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4219999999999999e-06 2024-05-08T18:31:46.460 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.460 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.460 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:46.460 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.314626+0000", 2024-05-08T18:31:46.460 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0018485039999999999 2024-05-08T18:31:46.461 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.461 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.461 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:46.461 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.314651+0000", 2024-05-08T18:31:46.461 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5085000000000001e-05 2024-05-08T18:31:46.461 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.461 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.461 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:46.461 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.314663+0000", 2024-05-08T18:31:46.461 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2514000000000001e-05 2024-05-08T18:31:46.461 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.461 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.461 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:46.462 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.314741+0000", 2024-05-08T18:31:46.462 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7825999999999997e-05 2024-05-08T18:31:46.462 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.462 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.462 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:46.462 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.314877+0000", 2024-05-08T18:31:46.462 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013528100000000001 2024-05-08T18:31:46.462 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.462 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.462 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-05-08T18:31:46.462 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.314979+0000", 2024-05-08T18:31:46.462 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000102897 2024-05-08T18:31:46.463 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.463 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.463 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:46.463 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.324390+0000", 2024-05-08T18:31:46.463 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0094105579999999994 2024-05-08T18:31:46.463 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.463 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.463 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:46.463 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.325118+0000", 2024-05-08T18:31:46.463 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00072824399999999996 2024-05-08T18:31:46.463 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.463 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.463 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:46.464 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.325187+0000", 2024-05-08T18:31:46.464 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8325999999999996e-05 2024-05-08T18:31:46.464 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:46.464 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:46.464 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:46.464 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.325240+0000", 2024-05-08T18:31:46.464 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3377000000000001e-05 2024-05-08T18:31:46.464 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:46.464 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:46.464 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:46.464 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:46.464 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:46.464 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:46.466 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-08T18:31:46.466 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:31:46.465+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:31:46.566 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:31:46.565+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:31:46.624 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:46.625 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:31:46.625 INFO:teuthology.orchestra.run.smithi097.stdout: "num_ops": 0 2024-05-08T18:31:46.625 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:46.638 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-08T18:31:46.680 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:31:46.681+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:31:46.769 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:31:46.769+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:31:46.817 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:46.817 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:31:46.817 INFO:teuthology.orchestra.run.smithi097.stdout: "complaint_time": 30, 2024-05-08T18:31:46.817 INFO:teuthology.orchestra.run.smithi097.stdout: "num_blocked_ops": 0 2024-05-08T18:31:46.817 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:46.837 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-08T18:31:46.880 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:31:46.881+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:31:46.971 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:31:46.966+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:31:46.986 INFO:tasks.workunit.client.0.smithi097.stdout:quota enabled for the user 0.626361150601046 2024-05-08T18:31:46.986 INFO:tasks.workunit.client.0.smithi097.stdout:adding file to bucket buck_2024_04_8_18_31_46: 100Mb. 2024-05-08T18:31:46.986 INFO:tasks.workunit.client.0.smithi097.stdout:upload file successful 2024-05-08T18:31:47.011 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:47.011 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2024-05-08T18:31:47.011 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2024-05-08T18:31:47.011 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-05-08T18:31:47.011 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.011 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1316 3.0 e81/21 3:03a68e79:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_2:head v 81'1, mlcod=0'0)", 2024-05-08T18:31:47.011 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.318330+0000", 2024-05-08T18:31:47.011 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4.6911094860000002, 2024-05-08T18:31:47.011 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.015176533000000001, 2024-05-08T18:31:47.011 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:47.011 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:47.011 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:47.012 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:47.012 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.012 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:47.012 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.318330+0000", 2024-05-08T18:31:47.012 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:47.012 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.012 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.012 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:47.012 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.318330+0000", 2024-05-08T18:31:47.013 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:47.013 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.013 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.013 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:47.013 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.318333+0000", 2024-05-08T18:31:47.013 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9629999999999998e-06 2024-05-08T18:31:47.013 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.013 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.014 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:47.014 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.323328+0000", 2024-05-08T18:31:47.014 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.004995172 2024-05-08T18:31:47.014 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.014 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.014 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:47.014 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.323366+0000", 2024-05-08T18:31:47.015 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7837999999999999e-05 2024-05-08T18:31:47.015 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.015 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.015 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:47.015 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.323391+0000", 2024-05-08T18:31:47.015 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4913e-05 2024-05-08T18:31:47.016 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.016 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.016 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:47.016 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.323520+0000", 2024-05-08T18:31:47.016 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000129238 2024-05-08T18:31:47.016 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.017 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.017 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:47.017 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.323546+0000", 2024-05-08T18:31:47.017 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5508999999999999e-05 2024-05-08T18:31:47.017 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.017 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.017 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:47.018 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.333439+0000", 2024-05-08T18:31:47.018 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0098928169999999999 2024-05-08T18:31:47.018 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.018 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.018 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:47.018 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.333507+0000", 2024-05-08T18:31:47.018 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8083000000000005e-05 2024-05-08T18:31:47.019 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:47.019 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:47.019 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:47.019 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.019 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.019 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1317 3.2d e81/21 3:b70e9396:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_3:head v 81'1, mlcod=0'0)", 2024-05-08T18:31:47.019 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.331170+0000", 2024-05-08T18:31:47.019 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4.6782692170000004, 2024-05-08T18:31:47.020 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019680382, 2024-05-08T18:31:47.020 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:47.020 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:47.020 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:47.020 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:47.020 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.021 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:47.021 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.331170+0000", 2024-05-08T18:31:47.021 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:47.021 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.021 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.021 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:47.021 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.331170+0000", 2024-05-08T18:31:47.022 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:47.022 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.022 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.022 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:47.022 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.331172+0000", 2024-05-08T18:31:47.022 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.933e-06 2024-05-08T18:31:47.023 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.023 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.023 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:47.023 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.341697+0000", 2024-05-08T18:31:47.023 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010524759999999999 2024-05-08T18:31:47.023 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.023 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.023 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:47.023 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.341753+0000", 2024-05-08T18:31:47.024 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5828000000000001e-05 2024-05-08T18:31:47.024 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.024 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.024 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:47.024 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.341776+0000", 2024-05-08T18:31:47.024 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3379000000000001e-05 2024-05-08T18:31:47.024 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.024 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.024 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:47.024 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.341871+0000", 2024-05-08T18:31:47.024 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.4307000000000004e-05 2024-05-08T18:31:47.024 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.025 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.025 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:47.025 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.341895+0000", 2024-05-08T18:31:47.025 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4629000000000001e-05 2024-05-08T18:31:47.025 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.025 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.025 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:47.025 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.350793+0000", 2024-05-08T18:31:47.025 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0088981219999999996 2024-05-08T18:31:47.025 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.025 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.025 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:47.026 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.350851+0000", 2024-05-08T18:31:47.026 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7423999999999998e-05 2024-05-08T18:31:47.026 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:47.026 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:47.026 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:47.026 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.026 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.026 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1325 3.2d e81/21 3:b7fa4974:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_11:head v 81'2, mlcod=0'0)", 2024-05-08T18:31:47.026 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.444803+0000", 2024-05-08T18:31:47.026 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4.5646363350000003, 2024-05-08T18:31:47.026 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012603454, 2024-05-08T18:31:47.026 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:47.026 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:47.027 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:47.027 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:47.027 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.027 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:47.027 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.444803+0000", 2024-05-08T18:31:47.027 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:47.027 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.027 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.027 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:47.027 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.444803+0000", 2024-05-08T18:31:47.027 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:47.027 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.027 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.028 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:47.028 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.444805+0000", 2024-05-08T18:31:47.028 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.782e-06 2024-05-08T18:31:47.028 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.028 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.028 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:47.028 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.448805+0000", 2024-05-08T18:31:47.028 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0040002859999999996 2024-05-08T18:31:47.028 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.028 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.028 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:47.028 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.448828+0000", 2024-05-08T18:31:47.028 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2748e-05 2024-05-08T18:31:47.029 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.029 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.029 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:47.029 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.448841+0000", 2024-05-08T18:31:47.029 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2456000000000001e-05 2024-05-08T18:31:47.029 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.029 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.029 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:47.029 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.448917+0000", 2024-05-08T18:31:47.029 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6643000000000005e-05 2024-05-08T18:31:47.029 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.029 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.029 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:47.030 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.448945+0000", 2024-05-08T18:31:47.030 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7656000000000001e-05 2024-05-08T18:31:47.030 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.030 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.030 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:47.030 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.457322+0000", 2024-05-08T18:31:47.030 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0083770990000000007 2024-05-08T18:31:47.030 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.030 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.030 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:47.030 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.457407+0000", 2024-05-08T18:31:47.030 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.4783999999999993e-05 2024-05-08T18:31:47.031 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:47.031 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:47.031 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:47.031 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.031 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.031 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1329 3.21 3:87d2ef9d:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-08T18:31:47.031 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.483324+0000", 2024-05-08T18:31:47.031 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4.5261154120000002, 2024-05-08T18:31:47.031 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.020245062000000001, 2024-05-08T18:31:47.031 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:47.031 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:47.032 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:47.032 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:47.032 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:47.032 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:47.032 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1329 2024-05-08T18:31:47.032 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.032 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:47.032 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.032 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:47.032 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.483324+0000", 2024-05-08T18:31:47.032 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:47.032 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.033 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.033 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:47.033 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.483324+0000", 2024-05-08T18:31:47.033 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:47.033 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.033 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.033 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:47.033 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.483328+0000", 2024-05-08T18:31:47.034 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3160000000000001e-06 2024-05-08T18:31:47.034 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.034 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.034 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:47.034 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.484909+0000", 2024-05-08T18:31:47.034 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001581325 2024-05-08T18:31:47.034 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.034 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.034 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:47.034 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.484935+0000", 2024-05-08T18:31:47.034 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5746999999999999e-05 2024-05-08T18:31:47.034 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.034 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.035 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:47.035 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.484945+0000", 2024-05-08T18:31:47.035 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0827e-05 2024-05-08T18:31:47.035 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.035 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.035 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:47.035 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.485031+0000", 2024-05-08T18:31:47.035 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5811999999999998e-05 2024-05-08T18:31:47.035 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.035 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.035 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:47.035 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.485229+0000", 2024-05-08T18:31:47.036 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00019749000000000001 2024-05-08T18:31:47.036 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.036 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.036 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:47.036 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.485390+0000", 2024-05-08T18:31:47.036 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000161058 2024-05-08T18:31:47.036 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.036 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.036 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:47.036 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.492144+0000", 2024-05-08T18:31:47.036 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0067546109999999998 2024-05-08T18:31:47.036 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.036 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.037 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:47.037 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.503464+0000", 2024-05-08T18:31:47.037 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011319997 2024-05-08T18:31:47.037 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.037 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.037 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:47.037 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.503515+0000", 2024-05-08T18:31:47.037 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.0132e-05 2024-05-08T18:31:47.037 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.037 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.037 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:47.037 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.503569+0000", 2024-05-08T18:31:47.038 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4747000000000003e-05 2024-05-08T18:31:47.038 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:47.038 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:47.038 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:47.038 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.038 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.038 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1341 3.5 3:a0d72baa:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_27:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:47.038 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.613380+0000", 2024-05-08T18:31:47.038 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4.3960599909999996, 2024-05-08T18:31:47.038 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.016698074, 2024-05-08T18:31:47.038 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:47.038 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:47.039 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:47.039 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:47.039 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:47.039 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:47.039 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1341 2024-05-08T18:31:47.039 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.039 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:47.039 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.039 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:47.039 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.613380+0000", 2024-05-08T18:31:47.039 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:47.039 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.039 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.040 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:47.040 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.613380+0000", 2024-05-08T18:31:47.040 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:47.040 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.040 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.040 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:47.040 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.613382+0000", 2024-05-08T18:31:47.040 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5979999999999999e-06 2024-05-08T18:31:47.040 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.040 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.040 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:47.040 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.615142+0000", 2024-05-08T18:31:47.041 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0017599040000000001 2024-05-08T18:31:47.041 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.041 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.041 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:47.041 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.615174+0000", 2024-05-08T18:31:47.041 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1458000000000003e-05 2024-05-08T18:31:47.041 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.041 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.041 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:47.041 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.615189+0000", 2024-05-08T18:31:47.041 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5809000000000001e-05 2024-05-08T18:31:47.041 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.042 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.042 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:47.042 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.615267+0000", 2024-05-08T18:31:47.042 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7898999999999994e-05 2024-05-08T18:31:47.042 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.042 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.042 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:47.042 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.615393+0000", 2024-05-08T18:31:47.042 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012611999999999999 2024-05-08T18:31:47.043 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.043 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.043 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:47.043 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.615500+0000", 2024-05-08T18:31:47.043 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010621899999999999 2024-05-08T18:31:47.043 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.043 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.043 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:47.043 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.627687+0000", 2024-05-08T18:31:47.043 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012186936000000001 2024-05-08T18:31:47.043 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.043 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.043 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:47.043 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.629963+0000", 2024-05-08T18:31:47.044 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0022760160000000001 2024-05-08T18:31:47.044 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.044 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.044 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:47.044 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.630025+0000", 2024-05-08T18:31:47.044 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.2409999999999994e-05 2024-05-08T18:31:47.044 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.044 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.044 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:47.044 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.630078+0000", 2024-05-08T18:31:47.044 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.2704999999999998e-05 2024-05-08T18:31:47.044 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:47.044 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:47.045 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:47.045 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.045 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.045 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1343 3.39 3:9f4e1e83:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_29:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:47.045 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.634194+0000", 2024-05-08T18:31:47.045 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4.3752456520000003, 2024-05-08T18:31:47.045 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.014278074999999999, 2024-05-08T18:31:47.045 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:47.045 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:47.045 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:47.045 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:47.045 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:47.046 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:47.046 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1343 2024-05-08T18:31:47.046 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.046 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:47.046 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.046 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:47.046 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.634194+0000", 2024-05-08T18:31:47.046 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:47.047 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.047 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.047 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:47.047 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.634194+0000", 2024-05-08T18:31:47.047 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:47.047 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.047 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.048 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:47.048 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.634197+0000", 2024-05-08T18:31:47.048 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0620000000000001e-06 2024-05-08T18:31:47.048 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.048 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.048 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:47.049 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.635963+0000", 2024-05-08T18:31:47.049 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001766098 2024-05-08T18:31:47.049 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.049 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.049 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:47.049 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.635987+0000", 2024-05-08T18:31:47.050 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3360999999999999e-05 2024-05-08T18:31:47.050 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.050 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.050 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:47.050 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.635998+0000", 2024-05-08T18:31:47.050 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1284000000000001e-05 2024-05-08T18:31:47.050 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.051 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.051 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:47.051 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.636079+0000", 2024-05-08T18:31:47.051 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.1493000000000001e-05 2024-05-08T18:31:47.051 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.051 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.052 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:47.052 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.636262+0000", 2024-05-08T18:31:47.052 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00018223999999999999 2024-05-08T18:31:47.052 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.052 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.052 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:47.052 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.636417+0000", 2024-05-08T18:31:47.052 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015549699999999999 2024-05-08T18:31:47.053 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.053 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.053 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:47.053 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.648058+0000", 2024-05-08T18:31:47.053 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011640908 2024-05-08T18:31:47.053 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.053 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.054 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:47.054 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.648354+0000", 2024-05-08T18:31:47.054 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00029571799999999999 2024-05-08T18:31:47.054 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.054 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.054 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:47.055 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.648420+0000", 2024-05-08T18:31:47.055 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6818999999999998e-05 2024-05-08T18:31:47.055 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.055 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.055 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:47.055 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.648472+0000", 2024-05-08T18:31:47.056 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.1595000000000003e-05 2024-05-08T18:31:47.056 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:47.056 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:47.056 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:47.056 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.056 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.056 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1352 3.0 e82/21 3:0085bede:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_38:head v 82'2, mlcod=0'0)", 2024-05-08T18:31:47.056 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.732652+0000", 2024-05-08T18:31:47.057 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4.276787186, 2024-05-08T18:31:47.057 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010931293, 2024-05-08T18:31:47.057 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:47.057 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:47.057 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:47.057 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:47.057 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.057 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:47.057 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.732652+0000", 2024-05-08T18:31:47.057 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:47.057 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.057 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.057 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:47.058 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.732652+0000", 2024-05-08T18:31:47.058 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:47.058 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.058 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.058 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:47.058 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.732653+0000", 2024-05-08T18:31:47.058 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.13e-07 2024-05-08T18:31:47.058 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.058 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.058 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:47.058 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.734222+0000", 2024-05-08T18:31:47.058 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00156931 2024-05-08T18:31:47.059 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.059 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.059 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:47.059 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.734248+0000", 2024-05-08T18:31:47.059 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.527e-05 2024-05-08T18:31:47.059 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.059 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.059 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:47.059 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.734261+0000", 2024-05-08T18:31:47.059 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3509999999999999e-05 2024-05-08T18:31:47.059 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.059 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.059 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:47.059 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.734331+0000", 2024-05-08T18:31:47.060 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9790999999999996e-05 2024-05-08T18:31:47.060 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.060 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.060 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:47.060 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.734351+0000", 2024-05-08T18:31:47.060 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9775e-05 2024-05-08T18:31:47.060 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.060 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.060 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:47.060 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.743520+0000", 2024-05-08T18:31:47.060 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0091690599999999997 2024-05-08T18:31:47.060 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.060 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.061 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:47.061 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.743584+0000", 2024-05-08T18:31:47.061 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.4064000000000002e-05 2024-05-08T18:31:47.061 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:47.061 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:47.061 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:47.061 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.061 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.061 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1358 3.5 3:a0d2e4cd:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_44:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:47.061 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.792476+0000", 2024-05-08T18:31:47.061 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4.2169636090000004, 2024-05-08T18:31:47.061 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.017319887999999999, 2024-05-08T18:31:47.061 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:47.062 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:47.062 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:47.062 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:47.062 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:47.062 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:47.062 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1358 2024-05-08T18:31:47.062 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.062 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:47.062 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.062 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:47.062 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.792476+0000", 2024-05-08T18:31:47.062 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:47.063 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.063 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.063 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:47.063 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.792476+0000", 2024-05-08T18:31:47.063 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:47.063 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.063 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.063 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:47.063 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.792480+0000", 2024-05-08T18:31:47.063 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6780000000000002e-06 2024-05-08T18:31:47.063 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.063 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.064 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:47.064 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.794611+0000", 2024-05-08T18:31:47.064 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0021309689999999999 2024-05-08T18:31:47.064 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.064 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.064 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:47.064 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.794635+0000", 2024-05-08T18:31:47.064 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4210999999999999e-05 2024-05-08T18:31:47.064 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.065 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.065 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:47.065 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.794646+0000", 2024-05-08T18:31:47.065 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0939e-05 2024-05-08T18:31:47.065 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.065 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.065 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:47.065 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.794720+0000", 2024-05-08T18:31:47.065 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.4257000000000004e-05 2024-05-08T18:31:47.065 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.065 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.065 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:47.065 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.794848+0000", 2024-05-08T18:31:47.066 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000128279 2024-05-08T18:31:47.066 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.066 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.066 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:47.066 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.794981+0000", 2024-05-08T18:31:47.066 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013264099999999999 2024-05-08T18:31:47.066 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.066 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.066 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:47.066 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.806096+0000", 2024-05-08T18:31:47.066 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011114702000000001 2024-05-08T18:31:47.066 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.066 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.067 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:47.067 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.809702+0000", 2024-05-08T18:31:47.067 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0036063660000000002 2024-05-08T18:31:47.067 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.067 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.067 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:47.067 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.809749+0000", 2024-05-08T18:31:47.067 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6564999999999999e-05 2024-05-08T18:31:47.067 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.067 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.067 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:47.068 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.809796+0000", 2024-05-08T18:31:47.068 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7280999999999997e-05 2024-05-08T18:31:47.068 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:47.068 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:47.068 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:47.068 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.068 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.068 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1366 3.39 3:9c29fb9f:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_52:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:47.068 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.873737+0000", 2024-05-08T18:31:47.068 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4.1357025409999997, 2024-05-08T18:31:47.068 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.013710574, 2024-05-08T18:31:47.068 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:47.069 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:47.069 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:47.069 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:47.069 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:47.069 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:47.069 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1366 2024-05-08T18:31:47.069 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.069 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:47.070 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.070 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:47.070 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.873737+0000", 2024-05-08T18:31:47.070 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:47.070 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.070 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.070 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:47.071 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.873737+0000", 2024-05-08T18:31:47.071 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:47.071 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.071 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.071 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:47.071 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.873740+0000", 2024-05-08T18:31:47.072 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2449999999999998e-06 2024-05-08T18:31:47.072 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.072 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.072 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:47.072 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.875455+0000", 2024-05-08T18:31:47.072 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0017145839999999999 2024-05-08T18:31:47.073 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.073 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.073 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:47.073 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.875484+0000", 2024-05-08T18:31:47.073 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9325000000000001e-05 2024-05-08T18:31:47.073 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.073 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.074 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:47.074 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.875499+0000", 2024-05-08T18:31:47.074 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4874e-05 2024-05-08T18:31:47.074 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.074 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.074 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:47.074 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.875571+0000", 2024-05-08T18:31:47.075 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2035999999999999e-05 2024-05-08T18:31:47.075 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.075 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.075 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:47.075 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.875691+0000", 2024-05-08T18:31:47.075 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012016 2024-05-08T18:31:47.075 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.075 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.076 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:47.076 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.875805+0000", 2024-05-08T18:31:47.076 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011333 2024-05-08T18:31:47.076 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.076 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.076 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:47.077 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.886875+0000", 2024-05-08T18:31:47.077 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011069997999999999 2024-05-08T18:31:47.077 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.077 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.077 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:47.077 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.887363+0000", 2024-05-08T18:31:47.077 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00048848499999999998 2024-05-08T18:31:47.078 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.078 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.078 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:47.078 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.887410+0000", 2024-05-08T18:31:47.078 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7264e-05 2024-05-08T18:31:47.078 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.079 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.079 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:47.079 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.887448+0000", 2024-05-08T18:31:47.079 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7273e-05 2024-05-08T18:31:47.079 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:47.079 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:47.080 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:47.080 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.080 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.080 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1370 3.9 e82/21 3:91bbaad9:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_56:head v 82'1, mlcod=0'0)", 2024-05-08T18:31:47.080 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.920855+0000", 2024-05-08T18:31:47.080 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4.0885848620000003, 2024-05-08T18:31:47.080 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.023027817999999999, 2024-05-08T18:31:47.080 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:47.080 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:47.080 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:47.081 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:47.081 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.081 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:47.081 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.920855+0000", 2024-05-08T18:31:47.081 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:47.081 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.081 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.081 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:47.081 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.920855+0000", 2024-05-08T18:31:47.081 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:47.081 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.081 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.081 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:47.082 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.920855+0000", 2024-05-08T18:31:47.082 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7399999999999999e-07 2024-05-08T18:31:47.082 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.082 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.082 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:47.082 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.926227+0000", 2024-05-08T18:31:47.082 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0053715129999999996 2024-05-08T18:31:47.082 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.082 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.083 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:47.083 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.926252+0000", 2024-05-08T18:31:47.083 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5709000000000001e-05 2024-05-08T18:31:47.083 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.083 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.083 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:47.083 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.926265+0000", 2024-05-08T18:31:47.083 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2159e-05 2024-05-08T18:31:47.083 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.083 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.083 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:47.084 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.926339+0000", 2024-05-08T18:31:47.084 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.4058000000000001e-05 2024-05-08T18:31:47.084 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.084 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.084 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:47.084 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.926355+0000", 2024-05-08T18:31:47.084 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6274e-05 2024-05-08T18:31:47.084 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.084 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.084 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:47.085 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.943850+0000", 2024-05-08T18:31:47.085 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.017495502999999999 2024-05-08T18:31:47.085 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.085 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.085 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:47.085 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.943883+0000", 2024-05-08T18:31:47.085 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2227999999999997e-05 2024-05-08T18:31:47.085 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:47.085 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:47.085 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:47.086 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.086 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.086 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1372 3.39 3:9eccad39:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_58:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:47.086 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.936995+0000", 2024-05-08T18:31:47.086 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4.072444709, 2024-05-08T18:31:47.086 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.016484776, 2024-05-08T18:31:47.086 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:47.086 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:47.086 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:47.087 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:47.087 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:47.087 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:47.087 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1372 2024-05-08T18:31:47.087 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.087 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:47.087 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.087 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:47.087 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.936995+0000", 2024-05-08T18:31:47.087 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:47.087 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.087 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.087 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:47.088 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.936995+0000", 2024-05-08T18:31:47.088 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:47.088 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.088 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.088 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:47.088 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.936997+0000", 2024-05-08T18:31:47.088 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3980000000000002e-06 2024-05-08T18:31:47.088 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.088 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.088 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:47.088 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.938982+0000", 2024-05-08T18:31:47.088 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001984591 2024-05-08T18:31:47.089 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.089 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.089 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:47.089 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.939011+0000", 2024-05-08T18:31:47.089 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8598999999999998e-05 2024-05-08T18:31:47.089 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.089 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.089 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:47.089 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.939026+0000", 2024-05-08T18:31:47.089 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5197999999999999e-05 2024-05-08T18:31:47.089 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.089 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.090 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:47.090 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.939106+0000", 2024-05-08T18:31:47.090 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.0656999999999997e-05 2024-05-08T18:31:47.090 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.090 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.090 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:47.090 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.939250+0000", 2024-05-08T18:31:47.090 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000143516 2024-05-08T18:31:47.090 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.091 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.091 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:47.091 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.939357+0000", 2024-05-08T18:31:47.091 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000107261 2024-05-08T18:31:47.091 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.091 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.091 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:47.092 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.953303+0000", 2024-05-08T18:31:47.092 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.013946188999999999 2024-05-08T18:31:47.092 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.092 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.092 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:47.092 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.953356+0000", 2024-05-08T18:31:47.092 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.2222000000000002e-05 2024-05-08T18:31:47.092 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.092 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.093 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:47.093 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.953425+0000", 2024-05-08T18:31:47.093 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9265999999999997e-05 2024-05-08T18:31:47.093 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.093 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.093 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:47.093 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.953480+0000", 2024-05-08T18:31:47.093 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4879000000000001e-05 2024-05-08T18:31:47.094 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:47.094 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:47.094 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:47.094 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.094 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.094 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1375 3.39 3:9c8c420a:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_61:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:47.094 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.971052+0000", 2024-05-08T18:31:47.095 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4.0383877229999996, 2024-05-08T18:31:47.095 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.013332797, 2024-05-08T18:31:47.095 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:47.095 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:47.095 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:47.095 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:47.095 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:47.095 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:47.096 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1375 2024-05-08T18:31:47.096 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.096 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:47.096 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.096 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:47.096 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.971052+0000", 2024-05-08T18:31:47.096 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:47.096 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.096 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.096 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:47.096 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.971052+0000", 2024-05-08T18:31:47.096 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:47.096 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.096 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.097 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:47.097 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.971055+0000", 2024-05-08T18:31:47.097 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.977e-06 2024-05-08T18:31:47.097 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.097 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.097 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:47.097 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.972822+0000", 2024-05-08T18:31:47.097 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0017668619999999999 2024-05-08T18:31:47.097 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.097 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.097 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:47.097 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.972846+0000", 2024-05-08T18:31:47.097 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4519999999999999e-05 2024-05-08T18:31:47.097 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.098 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.098 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:47.098 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.972857+0000", 2024-05-08T18:31:47.098 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0457e-05 2024-05-08T18:31:47.098 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.098 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.098 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:47.098 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.972935+0000", 2024-05-08T18:31:47.098 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.8650000000000001e-05 2024-05-08T18:31:47.098 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.098 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.098 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:47.098 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.973121+0000", 2024-05-08T18:31:47.099 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000185816 2024-05-08T18:31:47.099 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.099 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.099 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:47.099 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.973289+0000", 2024-05-08T18:31:47.099 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016798299999999999 2024-05-08T18:31:47.099 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.099 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.099 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:47.099 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.983934+0000", 2024-05-08T18:31:47.099 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010644733999999999 2024-05-08T18:31:47.099 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.099 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.099 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:47.100 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.984287+0000", 2024-05-08T18:31:47.100 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00035295200000000002 2024-05-08T18:31:47.100 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.100 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.100 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:47.100 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.984342+0000", 2024-05-08T18:31:47.100 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5282999999999999e-05 2024-05-08T18:31:47.100 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.100 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.100 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:47.100 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.984385+0000", 2024-05-08T18:31:47.100 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.2562999999999999e-05 2024-05-08T18:31:47.100 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:47.100 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:47.101 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:47.101 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.101 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.101 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1384 3.5 3:a0f4371d:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_70:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:47.101 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:43.093875+0000", 2024-05-08T18:31:47.101 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 3.9155646079999999, 2024-05-08T18:31:47.101 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.013806097999999999, 2024-05-08T18:31:47.101 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:47.101 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:47.101 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:47.101 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:47.101 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:47.101 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:47.101 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1384 2024-05-08T18:31:47.102 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.102 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:47.102 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.102 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:47.102 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.093875+0000", 2024-05-08T18:31:47.102 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:47.102 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.102 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.102 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:47.102 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.093875+0000", 2024-05-08T18:31:47.102 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:47.102 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.102 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.102 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:47.103 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.093878+0000", 2024-05-08T18:31:47.103 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8990000000000001e-06 2024-05-08T18:31:47.103 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.103 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.103 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:47.103 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.095579+0000", 2024-05-08T18:31:47.103 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001700628 2024-05-08T18:31:47.103 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.103 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.103 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:47.103 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.095608+0000", 2024-05-08T18:31:47.103 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9371000000000001e-05 2024-05-08T18:31:47.103 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.103 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.104 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:47.104 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.095626+0000", 2024-05-08T18:31:47.104 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8221999999999999e-05 2024-05-08T18:31:47.104 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.104 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.104 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:47.104 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.095722+0000", 2024-05-08T18:31:47.104 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.5963000000000003e-05 2024-05-08T18:31:47.104 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.104 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.104 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:47.104 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.095908+0000", 2024-05-08T18:31:47.104 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00018594999999999999 2024-05-08T18:31:47.105 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.105 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.105 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:47.105 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.096081+0000", 2024-05-08T18:31:47.105 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00017264799999999999 2024-05-08T18:31:47.105 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.105 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.105 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:47.105 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.107122+0000", 2024-05-08T18:31:47.105 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011041249 2024-05-08T18:31:47.105 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.105 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.105 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:47.105 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.107565+0000", 2024-05-08T18:31:47.105 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00044287999999999999 2024-05-08T18:31:47.106 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.106 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.106 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:47.106 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.107630+0000", 2024-05-08T18:31:47.106 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.4745000000000004e-05 2024-05-08T18:31:47.106 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.106 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.106 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:47.106 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.107681+0000", 2024-05-08T18:31:47.106 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.1542999999999998e-05 2024-05-08T18:31:47.106 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:47.106 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:47.106 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:47.107 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.107 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.107 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1390 3.0 e82/21 3:00a67f20:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_76:head v 82'3, mlcod=81'1)", 2024-05-08T18:31:47.107 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:43.176277+0000", 2024-05-08T18:31:47.107 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 3.8331621999999999, 2024-05-08T18:31:47.107 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012246539000000001, 2024-05-08T18:31:47.107 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:47.107 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:47.107 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:47.107 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:47.107 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.107 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:47.107 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.176277+0000", 2024-05-08T18:31:47.107 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:47.108 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.108 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.108 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:47.108 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.176277+0000", 2024-05-08T18:31:47.108 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:47.108 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.108 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.108 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:47.108 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.176279+0000", 2024-05-08T18:31:47.108 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.001e-06 2024-05-08T18:31:47.108 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.108 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.108 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:47.108 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.178169+0000", 2024-05-08T18:31:47.109 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0018891100000000001 2024-05-08T18:31:47.109 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.109 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.109 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:47.109 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.178202+0000", 2024-05-08T18:31:47.109 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3315999999999997e-05 2024-05-08T18:31:47.109 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.109 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.109 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:47.109 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.178218+0000", 2024-05-08T18:31:47.109 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5889999999999999e-05 2024-05-08T18:31:47.109 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.109 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.109 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:47.110 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.178308+0000", 2024-05-08T18:31:47.110 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0080000000000005e-05 2024-05-08T18:31:47.110 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.110 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.110 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:47.110 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.178346+0000", 2024-05-08T18:31:47.110 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7931e-05 2024-05-08T18:31:47.110 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.110 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.110 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:47.110 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.188460+0000", 2024-05-08T18:31:47.110 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010113715000000001 2024-05-08T18:31:47.110 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.110 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.111 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:47.111 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.188524+0000", 2024-05-08T18:31:47.111 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.4496e-05 2024-05-08T18:31:47.111 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:47.111 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:47.111 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:47.111 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.111 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.111 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1402 3.2d e82/21 3:b43c4320:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_88:head v 82'3, mlcod=81'1)", 2024-05-08T18:31:47.111 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:43.297364+0000", 2024-05-08T18:31:47.111 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 3.7120759290000001, 2024-05-08T18:31:47.111 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.013017687999999999, 2024-05-08T18:31:47.111 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:47.111 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:47.112 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:47.112 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:47.112 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.112 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:47.112 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.297364+0000", 2024-05-08T18:31:47.112 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:47.112 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.112 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.112 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:47.112 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.297364+0000", 2024-05-08T18:31:47.112 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:47.112 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.112 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.112 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:47.113 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.297364+0000", 2024-05-08T18:31:47.113 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.16e-07 2024-05-08T18:31:47.113 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.113 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.113 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:47.113 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.302711+0000", 2024-05-08T18:31:47.113 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0053466039999999996 2024-05-08T18:31:47.113 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.113 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.113 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:47.113 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.302747+0000", 2024-05-08T18:31:47.113 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6823000000000003e-05 2024-05-08T18:31:47.113 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.113 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.113 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:47.114 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.302761+0000", 2024-05-08T18:31:47.114 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4028e-05 2024-05-08T18:31:47.114 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.114 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.114 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:47.114 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.302846+0000", 2024-05-08T18:31:47.114 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.4775000000000001e-05 2024-05-08T18:31:47.114 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.114 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.114 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:47.114 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.302876+0000", 2024-05-08T18:31:47.114 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9882e-05 2024-05-08T18:31:47.114 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.114 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.115 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:47.115 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.310331+0000", 2024-05-08T18:31:47.115 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0074546320000000001 2024-05-08T18:31:47.115 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.115 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.115 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:47.115 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.310381+0000", 2024-05-08T18:31:47.115 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.0727999999999999e-05 2024-05-08T18:31:47.115 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:47.115 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:47.115 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:47.115 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.115 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.115 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1613 3.3d e83/21 3:bcbc5fe8:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_1:head v 83'3, mlcod=81'1)", 2024-05-08T18:31:47.116 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:46.699842+0000", 2024-05-08T18:31:47.116 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.30959719299999999, 2024-05-08T18:31:47.116 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012876298, 2024-05-08T18:31:47.116 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:47.116 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:47.116 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:47.116 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:47.116 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.116 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:47.116 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.699842+0000", 2024-05-08T18:31:47.116 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:47.116 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.116 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.116 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:47.116 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.699842+0000", 2024-05-08T18:31:47.117 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:47.117 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.117 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.117 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:47.117 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.699845+0000", 2024-05-08T18:31:47.117 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.04e-06 2024-05-08T18:31:47.117 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.117 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.117 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:47.117 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.702634+0000", 2024-05-08T18:31:47.117 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0027896010000000001 2024-05-08T18:31:47.117 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.117 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.117 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:47.118 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.702660+0000", 2024-05-08T18:31:47.118 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6265999999999999e-05 2024-05-08T18:31:47.118 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.118 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.118 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:47.118 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.702674+0000", 2024-05-08T18:31:47.118 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3297e-05 2024-05-08T18:31:47.118 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.118 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.118 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:47.118 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.702759+0000", 2024-05-08T18:31:47.118 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5110000000000003e-05 2024-05-08T18:31:47.118 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.118 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.119 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:47.119 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.702789+0000", 2024-05-08T18:31:47.119 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0434999999999999e-05 2024-05-08T18:31:47.119 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.119 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.119 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:47.119 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.712639+0000", 2024-05-08T18:31:47.119 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0098496850000000004 2024-05-08T18:31:47.119 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.119 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.119 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:47.119 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.712719+0000", 2024-05-08T18:31:47.119 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.9864000000000006e-05 2024-05-08T18:31:47.120 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:47.120 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:47.120 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:47.120 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.120 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.120 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1621 3.5 3:a3bb7dd2:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-05-08T18:31:47.120 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:46.781044+0000", 2024-05-08T18:31:47.120 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.228396077, 2024-05-08T18:31:47.120 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.016696294, 2024-05-08T18:31:47.120 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:47.120 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:47.120 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:47.120 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:47.121 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:47.121 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:47.121 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1621 2024-05-08T18:31:47.121 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.121 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:47.121 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.121 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:47.121 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.781044+0000", 2024-05-08T18:31:47.121 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:47.121 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.121 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.121 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:47.121 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.781044+0000", 2024-05-08T18:31:47.121 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:47.122 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.122 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.122 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:47.122 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.781047+0000", 2024-05-08T18:31:47.122 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9009999999999996e-06 2024-05-08T18:31:47.122 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.122 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.122 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:47.122 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.782953+0000", 2024-05-08T18:31:47.122 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001905985 2024-05-08T18:31:47.122 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.122 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.122 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:47.123 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.782984+0000", 2024-05-08T18:31:47.123 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0568000000000003e-05 2024-05-08T18:31:47.123 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.123 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.123 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:47.123 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.782998+0000", 2024-05-08T18:31:47.123 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3499000000000001e-05 2024-05-08T18:31:47.123 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.123 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.123 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:47.123 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.783072+0000", 2024-05-08T18:31:47.123 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.4104999999999996e-05 2024-05-08T18:31:47.123 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.123 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.124 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:47.124 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.783226+0000", 2024-05-08T18:31:47.124 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015405900000000001 2024-05-08T18:31:47.124 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.124 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.124 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:47.124 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.783377+0000", 2024-05-08T18:31:47.124 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015162500000000001 2024-05-08T18:31:47.124 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.124 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.124 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:47.124 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.796988+0000", 2024-05-08T18:31:47.124 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.013610652000000001 2024-05-08T18:31:47.124 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.125 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.125 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:47.125 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.797630+0000", 2024-05-08T18:31:47.125 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00064184599999999995 2024-05-08T18:31:47.125 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.125 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.125 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:47.125 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.797692+0000", 2024-05-08T18:31:47.125 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.2396000000000004e-05 2024-05-08T18:31:47.125 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.125 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.125 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:47.125 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.797740+0000", 2024-05-08T18:31:47.126 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7657999999999997e-05 2024-05-08T18:31:47.126 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:47.126 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:47.126 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:47.126 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.126 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.126 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1624 3.3d e83/21 3:bc2f41f0:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_12:head v 83'4, mlcod=82'2)", 2024-05-08T18:31:47.126 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:46.814956+0000", 2024-05-08T18:31:47.126 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.19448325499999999, 2024-05-08T18:31:47.126 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.022594933000000001, 2024-05-08T18:31:47.126 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:47.126 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:47.126 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:47.126 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:47.127 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.127 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:47.127 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.814956+0000", 2024-05-08T18:31:47.127 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:47.127 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.127 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.127 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:47.127 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.814956+0000", 2024-05-08T18:31:47.127 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:47.127 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.127 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.127 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:47.127 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.814959+0000", 2024-05-08T18:31:47.127 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.339e-06 2024-05-08T18:31:47.128 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.128 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.128 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:47.128 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.818131+0000", 2024-05-08T18:31:47.128 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031725149999999999 2024-05-08T18:31:47.128 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.128 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.128 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:47.128 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.818171+0000", 2024-05-08T18:31:47.128 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9295000000000002e-05 2024-05-08T18:31:47.128 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.128 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.128 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:47.128 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.818191+0000", 2024-05-08T18:31:47.128 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0329000000000001e-05 2024-05-08T18:31:47.129 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.129 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.129 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:47.129 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.818363+0000", 2024-05-08T18:31:47.129 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000172337 2024-05-08T18:31:47.129 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.129 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.129 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:47.129 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.818415+0000", 2024-05-08T18:31:47.129 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.2203999999999997e-05 2024-05-08T18:31:47.129 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.129 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.129 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:47.130 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.837470+0000", 2024-05-08T18:31:47.130 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019054950000000001 2024-05-08T18:31:47.130 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.130 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.130 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:47.130 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.837551+0000", 2024-05-08T18:31:47.130 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.0964000000000006e-05 2024-05-08T18:31:47.130 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:47.130 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:47.130 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:47.130 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.130 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.130 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1632 3.21 3:86ca081f:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_20:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-05-08T18:31:47.130 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:46.903772+0000", 2024-05-08T18:31:47.131 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.105668145, 2024-05-08T18:31:47.131 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.015516323, 2024-05-08T18:31:47.131 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:47.131 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:47.131 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:47.131 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:47.131 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:47.131 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:47.131 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1632 2024-05-08T18:31:47.131 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.131 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:47.131 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.131 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:47.131 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.903772+0000", 2024-05-08T18:31:47.131 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:47.132 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.132 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.132 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:47.132 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.903772+0000", 2024-05-08T18:31:47.132 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:47.132 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.132 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.132 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:47.132 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.903774+0000", 2024-05-08T18:31:47.132 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8040000000000002e-06 2024-05-08T18:31:47.132 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.132 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.132 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:47.132 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.905653+0000", 2024-05-08T18:31:47.133 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001878872 2024-05-08T18:31:47.133 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.133 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.133 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:47.133 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.905675+0000", 2024-05-08T18:31:47.133 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2238999999999998e-05 2024-05-08T18:31:47.133 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.133 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.133 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:47.133 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.905686+0000", 2024-05-08T18:31:47.133 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0145e-05 2024-05-08T18:31:47.133 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.133 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.133 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:47.134 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.905748+0000", 2024-05-08T18:31:47.134 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.2595000000000006e-05 2024-05-08T18:31:47.134 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.134 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.134 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:47.134 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.905871+0000", 2024-05-08T18:31:47.134 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012235999999999999 2024-05-08T18:31:47.134 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.134 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.134 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:47.134 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.905986+0000", 2024-05-08T18:31:47.134 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115025 2024-05-08T18:31:47.134 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.134 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.135 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:47.135 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.910243+0000", 2024-05-08T18:31:47.135 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0042571099999999997 2024-05-08T18:31:47.135 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.135 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.135 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:47.135 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.919213+0000", 2024-05-08T18:31:47.135 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.008970347 2024-05-08T18:31:47.135 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.135 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.135 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:47.135 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.919255+0000", 2024-05-08T18:31:47.135 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.1909000000000001e-05 2024-05-08T18:31:47.135 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.136 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.136 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:47.136 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.919288+0000", 2024-05-08T18:31:47.136 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2916999999999997e-05 2024-05-08T18:31:47.136 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:47.136 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:47.136 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:47.136 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.136 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.136 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1638 3.9 e83/21 3:9152f27e:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5_100Mb.:head v 83'6, mlcod=82'4)", 2024-05-08T18:31:47.136 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:46.971157+0000", 2024-05-08T18:31:47.136 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.038282428, 2024-05-08T18:31:47.136 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012153826, 2024-05-08T18:31:47.136 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:47.137 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:47.137 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:47.137 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:47.137 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.137 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:47.137 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.971157+0000", 2024-05-08T18:31:47.137 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:47.137 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.137 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.137 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:47.137 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.971157+0000", 2024-05-08T18:31:47.137 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:47.137 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.137 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.138 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:47.138 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.971159+0000", 2024-05-08T18:31:47.138 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.499e-06 2024-05-08T18:31:47.138 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.138 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.138 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:47.138 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.976606+0000", 2024-05-08T18:31:47.138 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0054470500000000002 2024-05-08T18:31:47.138 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.138 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.138 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:47.138 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.976627+0000", 2024-05-08T18:31:47.138 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1109000000000001e-05 2024-05-08T18:31:47.139 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.139 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.139 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:47.139 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.976639+0000", 2024-05-08T18:31:47.139 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2544000000000001e-05 2024-05-08T18:31:47.139 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.139 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.139 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:47.139 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.976762+0000", 2024-05-08T18:31:47.139 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012254 2024-05-08T18:31:47.139 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.139 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.139 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:47.140 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.976787+0000", 2024-05-08T18:31:47.140 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4683999999999999e-05 2024-05-08T18:31:47.140 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.140 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.140 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:47.140 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.983270+0000", 2024-05-08T18:31:47.140 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0064833010000000003 2024-05-08T18:31:47.140 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.140 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.140 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:47.140 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.983311+0000", 2024-05-08T18:31:47.140 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.1099000000000001e-05 2024-05-08T18:31:47.140 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:47.140 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:47.141 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:47.141 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:47.141 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:47.141 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:47.142 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-08T18:31:47.143 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:31:47.141+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:31:47.152 INFO:tasks.workunit.client.0.smithi097.stdout:Bucket Created: buck_2024_04_8_18_31_47 2024-05-08T18:31:47.242 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:31:47.241+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:31:47.268 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:47.268 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:31:47.268 INFO:teuthology.orchestra.run.smithi097.stdout: "num_ops": 0 2024-05-08T18:31:47.269 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:47.283 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-08T18:31:47.343 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:31:47.338+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:31:47.435 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:47.435 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:31:47.436 INFO:teuthology.orchestra.run.smithi097.stdout: "complaint_time": 30, 2024-05-08T18:31:47.436 INFO:teuthology.orchestra.run.smithi097.stdout: "num_blocked_ops": 0 2024-05-08T18:31:47.436 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:47.444 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:31:47.442+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:31:47.447 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-08T18:31:47.546 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:31:47.545+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:31:47.571 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:47.572 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2024-05-08T18:31:47.572 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2024-05-08T18:31:47.572 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-05-08T18:31:47.572 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.572 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1234 3.38 3:1cb36fa1:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.2__shadow_.fYaqa8o34qSAauLRSqi3iwpmT5NwV5c_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-05-08T18:31:47.572 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:38.213439+0000", 2024-05-08T18:31:47.572 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 9.3556428989999993, 2024-05-08T18:31:47.572 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.028973664, 2024-05-08T18:31:47.572 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:47.572 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:47.572 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:47.572 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:47.572 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:47.573 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:47.573 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1234 2024-05-08T18:31:47.573 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.573 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:47.573 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.573 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:47.573 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.213439+0000", 2024-05-08T18:31:47.573 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:47.573 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.573 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.573 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:47.573 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.213439+0000", 2024-05-08T18:31:47.573 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:47.574 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.574 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.574 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:47.574 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.213442+0000", 2024-05-08T18:31:47.574 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7580000000000001e-06 2024-05-08T18:31:47.574 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.574 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.574 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:47.574 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.216804+0000", 2024-05-08T18:31:47.574 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0033619520000000001 2024-05-08T18:31:47.574 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.574 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.574 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:47.575 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.216838+0000", 2024-05-08T18:31:47.575 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4437999999999998e-05 2024-05-08T18:31:47.575 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.575 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.575 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:47.575 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.216854+0000", 2024-05-08T18:31:47.575 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5823000000000001e-05 2024-05-08T18:31:47.575 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.575 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.575 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:47.575 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.216938+0000", 2024-05-08T18:31:47.575 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.3842000000000001e-05 2024-05-08T18:31:47.576 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.576 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.576 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:47.577 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.217046+0000", 2024-05-08T18:31:47.577 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000108717 2024-05-08T18:31:47.577 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.578 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.578 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:47.578 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.217137+0000", 2024-05-08T18:31:47.578 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0278000000000005e-05 2024-05-08T18:31:47.578 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.578 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.578 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:47.578 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.225461+0000", 2024-05-08T18:31:47.578 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0083239330000000004 2024-05-08T18:31:47.579 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.579 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.579 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:47.579 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.242319+0000", 2024-05-08T18:31:47.579 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.016858445999999999 2024-05-08T18:31:47.579 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.579 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.579 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:47.579 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.242359+0000", 2024-05-08T18:31:47.579 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9657000000000003e-05 2024-05-08T18:31:47.579 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.579 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.579 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:47.579 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.242413+0000", 2024-05-08T18:31:47.580 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3820000000000003e-05 2024-05-08T18:31:47.580 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:47.580 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:47.580 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:47.580 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.580 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.580 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1318 3.c e81/21 3:329e59e6:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_4:head v 81'3, mlcod=80'1)", 2024-05-08T18:31:47.580 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.344399+0000", 2024-05-08T18:31:47.580 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 5.2246829379999999, 2024-05-08T18:31:47.580 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.016160681999999999, 2024-05-08T18:31:47.580 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:47.580 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:47.580 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:47.580 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:47.581 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.581 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:47.581 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.344399+0000", 2024-05-08T18:31:47.581 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:47.581 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.581 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.581 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:47.581 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.344399+0000", 2024-05-08T18:31:47.581 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:47.581 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.581 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.581 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:47.581 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.344401+0000", 2024-05-08T18:31:47.581 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.767e-06 2024-05-08T18:31:47.581 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.582 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.582 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:47.582 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.351623+0000", 2024-05-08T18:31:47.582 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.007222554 2024-05-08T18:31:47.582 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.582 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.582 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:47.582 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.351667+0000", 2024-05-08T18:31:47.582 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4192e-05 2024-05-08T18:31:47.583 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.583 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.583 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:47.583 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.351690+0000", 2024-05-08T18:31:47.583 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2708999999999999e-05 2024-05-08T18:31:47.583 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.583 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.583 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:47.583 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.351781+0000", 2024-05-08T18:31:47.583 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0556999999999994e-05 2024-05-08T18:31:47.583 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.584 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.584 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:47.584 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.351799+0000", 2024-05-08T18:31:47.584 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8581e-05 2024-05-08T18:31:47.584 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.584 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.584 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:47.584 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.360513+0000", 2024-05-08T18:31:47.584 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.008713864 2024-05-08T18:31:47.585 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.585 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.585 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:47.585 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.360560+0000", 2024-05-08T18:31:47.585 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6458000000000001e-05 2024-05-08T18:31:47.585 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:47.585 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:47.585 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:47.585 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.585 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.585 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1330 3.8 3:124da8ab:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-08T18:31:47.586 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.493255+0000", 2024-05-08T18:31:47.586 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 5.0758270899999998, 2024-05-08T18:31:47.586 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.016189959, 2024-05-08T18:31:47.586 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:47.586 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:47.586 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:47.586 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:47.586 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:47.586 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:47.586 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1330 2024-05-08T18:31:47.586 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.586 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:47.586 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.587 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:47.587 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.493255+0000", 2024-05-08T18:31:47.587 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:47.587 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.587 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.587 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:47.587 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.493255+0000", 2024-05-08T18:31:47.587 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:47.587 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.587 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.587 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:47.587 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.493258+0000", 2024-05-08T18:31:47.587 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0180000000000002e-06 2024-05-08T18:31:47.587 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.588 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.588 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:47.588 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.494859+0000", 2024-05-08T18:31:47.588 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001600853 2024-05-08T18:31:47.588 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.588 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.588 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:47.589 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.494883+0000", 2024-05-08T18:31:47.589 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4680000000000001e-05 2024-05-08T18:31:47.589 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.589 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.589 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:47.589 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.494894+0000", 2024-05-08T18:31:47.589 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0601999999999999e-05 2024-05-08T18:31:47.589 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.589 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.589 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:47.589 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.494972+0000", 2024-05-08T18:31:47.589 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.8534000000000004e-05 2024-05-08T18:31:47.590 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.590 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.590 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:47.590 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.495134+0000", 2024-05-08T18:31:47.590 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016150999999999999 2024-05-08T18:31:47.590 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.590 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.590 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-05-08T18:31:47.590 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.495261+0000", 2024-05-08T18:31:47.590 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012695600000000001 2024-05-08T18:31:47.590 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.590 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.590 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:47.591 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.508455+0000", 2024-05-08T18:31:47.591 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.013194449 2024-05-08T18:31:47.591 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.591 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.591 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:47.591 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.509294+0000", 2024-05-08T18:31:47.591 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000839061 2024-05-08T18:31:47.591 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.591 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.591 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:47.591 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.509388+0000", 2024-05-08T18:31:47.591 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.3682000000000002e-05 2024-05-08T18:31:47.591 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.591 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.592 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:47.592 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.509445+0000", 2024-05-08T18:31:47.592 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6613999999999997e-05 2024-05-08T18:31:47.592 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:47.592 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:47.592 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:47.592 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.592 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.592 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1336 3.2 3:42c6ce4f:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:47.592 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.558532+0000", 2024-05-08T18:31:47.592 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 5.010549642, 2024-05-08T18:31:47.592 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.033214269999999997, 2024-05-08T18:31:47.592 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:47.592 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:47.593 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:47.593 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:47.593 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:47.593 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:47.593 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1336 2024-05-08T18:31:47.593 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.593 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:47.593 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.593 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:47.593 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.558532+0000", 2024-05-08T18:31:47.593 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:47.593 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.593 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.593 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:47.594 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.558532+0000", 2024-05-08T18:31:47.594 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:47.594 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.594 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.594 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:47.594 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.558535+0000", 2024-05-08T18:31:47.594 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9689999999999999e-06 2024-05-08T18:31:47.594 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.594 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.594 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:47.594 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.560549+0000", 2024-05-08T18:31:47.594 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0020142469999999998 2024-05-08T18:31:47.594 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.595 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.595 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:47.595 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.560576+0000", 2024-05-08T18:31:47.595 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6908000000000001e-05 2024-05-08T18:31:47.595 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.595 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.595 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:47.595 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.560595+0000", 2024-05-08T18:31:47.595 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8383999999999999e-05 2024-05-08T18:31:47.595 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.595 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.595 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:47.595 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.560680+0000", 2024-05-08T18:31:47.595 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5424000000000001e-05 2024-05-08T18:31:47.596 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.596 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.596 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-05-08T18:31:47.596 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.560685+0000", 2024-05-08T18:31:47.596 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.327e-06 2024-05-08T18:31:47.596 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.596 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.596 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:47.596 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.570079+0000", 2024-05-08T18:31:47.596 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0093940680000000002 2024-05-08T18:31:47.596 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.596 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.596 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:47.596 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.570249+0000", 2024-05-08T18:31:47.597 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000169953 2024-05-08T18:31:47.597 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.597 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.597 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-05-08T18:31:47.597 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.570423+0000", 2024-05-08T18:31:47.597 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00017355499999999999 2024-05-08T18:31:47.597 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.597 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.597 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:47.597 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.590293+0000", 2024-05-08T18:31:47.597 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019869761999999999 2024-05-08T18:31:47.597 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.597 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.597 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:47.598 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.591628+0000", 2024-05-08T18:31:47.598 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0013351599999999999 2024-05-08T18:31:47.598 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.598 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.598 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:47.598 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.591692+0000", 2024-05-08T18:31:47.598 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3822e-05 2024-05-08T18:31:47.598 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.598 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.598 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:47.598 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.591746+0000", 2024-05-08T18:31:47.598 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4691000000000002e-05 2024-05-08T18:31:47.598 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:47.598 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:47.599 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:47.599 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.599 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.599 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1346 3.29 3:9766a0f4:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_32:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:47.599 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.663599+0000", 2024-05-08T18:31:47.599 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4.9054828539999997, 2024-05-08T18:31:47.599 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.018562168, 2024-05-08T18:31:47.599 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:47.599 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:47.600 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:47.600 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:47.600 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:47.600 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:47.600 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1346 2024-05-08T18:31:47.600 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.600 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:47.600 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.600 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:47.600 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.663599+0000", 2024-05-08T18:31:47.600 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:47.600 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.600 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.600 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:47.601 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.663599+0000", 2024-05-08T18:31:47.601 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:47.601 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.601 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.601 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:47.601 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.663601+0000", 2024-05-08T18:31:47.601 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.328e-06 2024-05-08T18:31:47.601 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.601 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.601 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:47.601 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.665307+0000", 2024-05-08T18:31:47.601 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0017060879999999999 2024-05-08T18:31:47.601 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.601 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.601 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:47.602 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.665332+0000", 2024-05-08T18:31:47.602 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5142000000000001e-05 2024-05-08T18:31:47.602 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.602 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.602 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:47.602 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.665344+0000", 2024-05-08T18:31:47.602 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1464000000000001e-05 2024-05-08T18:31:47.602 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.602 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.602 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:47.602 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.665419+0000", 2024-05-08T18:31:47.602 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.5129000000000005e-05 2024-05-08T18:31:47.602 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.603 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.603 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:47.603 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.665529+0000", 2024-05-08T18:31:47.603 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000109787 2024-05-08T18:31:47.603 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.603 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.603 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:31:47.603 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.665627+0000", 2024-05-08T18:31:47.603 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.8190999999999996e-05 2024-05-08T18:31:47.603 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.603 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.603 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:47.603 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.673488+0000", 2024-05-08T18:31:47.604 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0078611819999999995 2024-05-08T18:31:47.604 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.604 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.604 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:47.604 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.682043+0000", 2024-05-08T18:31:47.604 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0085545829999999993 2024-05-08T18:31:47.604 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.604 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.604 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:47.604 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.682106+0000", 2024-05-08T18:31:47.604 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.2706000000000006e-05 2024-05-08T18:31:47.604 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.604 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.604 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:47.605 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.682161+0000", 2024-05-08T18:31:47.605 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5568000000000001e-05 2024-05-08T18:31:47.605 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:47.605 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:47.605 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:47.605 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.605 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.605 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1348 3.38 3:1ca8d3e1:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_34:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:47.605 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.684650+0000", 2024-05-08T18:31:47.605 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4.8844317440000005, 2024-05-08T18:31:47.605 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.018994840999999998, 2024-05-08T18:31:47.605 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:47.605 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:47.606 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:47.606 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:47.606 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:47.606 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:47.606 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1348 2024-05-08T18:31:47.606 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.606 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:47.606 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.606 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:47.606 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.684650+0000", 2024-05-08T18:31:47.606 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:47.606 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.606 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.607 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:47.607 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.684650+0000", 2024-05-08T18:31:47.607 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:47.607 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.607 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.607 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:47.607 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.684652+0000", 2024-05-08T18:31:47.607 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3860000000000001e-06 2024-05-08T18:31:47.607 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.607 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.607 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:47.607 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.686933+0000", 2024-05-08T18:31:47.607 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0022806369999999999 2024-05-08T18:31:47.607 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.608 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.608 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:47.608 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.686950+0000", 2024-05-08T18:31:47.608 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7377e-05 2024-05-08T18:31:47.608 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.608 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.608 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:47.608 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.686962+0000", 2024-05-08T18:31:47.608 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1756000000000001e-05 2024-05-08T18:31:47.608 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.608 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.608 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:47.608 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.687038+0000", 2024-05-08T18:31:47.609 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.5623000000000004e-05 2024-05-08T18:31:47.609 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.609 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.609 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:47.609 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.687226+0000", 2024-05-08T18:31:47.609 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000188457 2024-05-08T18:31:47.609 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.609 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.609 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:47.609 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.687394+0000", 2024-05-08T18:31:47.609 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016753300000000001 2024-05-08T18:31:47.610 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.610 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.610 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:47.610 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.694346+0000", 2024-05-08T18:31:47.610 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0069519639999999997 2024-05-08T18:31:47.610 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.610 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.610 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:47.610 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.703479+0000", 2024-05-08T18:31:47.610 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0091331829999999996 2024-05-08T18:31:47.610 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.610 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.611 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:47.611 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.703567+0000", 2024-05-08T18:31:47.611 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8294000000000005e-05 2024-05-08T18:31:47.611 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.611 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.611 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:47.611 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.703645+0000", 2024-05-08T18:31:47.611 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7631000000000003e-05 2024-05-08T18:31:47.611 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:47.611 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:47.611 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:47.611 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.611 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.611 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1349 3.27 3:e5090c80:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_35:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:47.611 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.696361+0000", 2024-05-08T18:31:47.612 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4.872720674, 2024-05-08T18:31:47.612 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019944929, 2024-05-08T18:31:47.612 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:47.612 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:47.612 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:47.612 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:47.612 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:47.612 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:47.612 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1349 2024-05-08T18:31:47.612 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.612 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:47.613 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.613 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:47.613 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.696361+0000", 2024-05-08T18:31:47.613 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:47.613 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.613 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.613 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:47.613 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.696361+0000", 2024-05-08T18:31:47.613 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:47.613 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.613 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.613 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:47.613 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.696363+0000", 2024-05-08T18:31:47.614 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1160000000000002e-06 2024-05-08T18:31:47.614 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.614 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.614 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:47.614 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.698294+0000", 2024-05-08T18:31:47.614 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001931026 2024-05-08T18:31:47.614 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.614 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.614 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:47.614 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.698324+0000", 2024-05-08T18:31:47.614 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9658e-05 2024-05-08T18:31:47.614 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.614 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.614 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:47.615 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.698339+0000", 2024-05-08T18:31:47.615 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5381000000000001e-05 2024-05-08T18:31:47.615 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.615 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.615 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:47.615 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.698430+0000", 2024-05-08T18:31:47.615 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0353999999999996e-05 2024-05-08T18:31:47.615 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.615 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.615 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:47.615 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.698591+0000", 2024-05-08T18:31:47.615 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016140999999999999 2024-05-08T18:31:47.615 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.616 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.616 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:31:47.616 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.698741+0000", 2024-05-08T18:31:47.616 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014955099999999999 2024-05-08T18:31:47.616 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.616 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.616 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:47.616 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.706987+0000", 2024-05-08T18:31:47.616 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0082466599999999994 2024-05-08T18:31:47.616 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.616 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.616 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:47.616 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.716183+0000", 2024-05-08T18:31:47.616 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0091959529999999998 2024-05-08T18:31:47.617 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.617 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.617 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:47.617 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.716252+0000", 2024-05-08T18:31:47.617 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8804000000000001e-05 2024-05-08T18:31:47.617 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.617 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.617 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:47.617 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.716306+0000", 2024-05-08T18:31:47.617 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4015999999999999e-05 2024-05-08T18:31:47.617 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:47.617 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:47.617 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:47.617 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.618 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.618 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1351 3.27 3:e75c4558:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_37:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:47.618 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.719093+0000", 2024-05-08T18:31:47.618 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4.8499883239999999, 2024-05-08T18:31:47.618 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.016526314, 2024-05-08T18:31:47.618 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:47.618 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:47.618 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:47.618 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:47.618 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:47.618 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:47.618 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1351 2024-05-08T18:31:47.619 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.619 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:47.619 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.619 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:47.619 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.719093+0000", 2024-05-08T18:31:47.619 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:47.619 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.619 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.619 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:47.619 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.719093+0000", 2024-05-08T18:31:47.619 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:47.619 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.619 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.619 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:47.620 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.719096+0000", 2024-05-08T18:31:47.620 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0249999999999998e-06 2024-05-08T18:31:47.620 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.620 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.620 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:47.620 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.721010+0000", 2024-05-08T18:31:47.620 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001913821 2024-05-08T18:31:47.620 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.620 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.621 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:47.621 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.721041+0000", 2024-05-08T18:31:47.621 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0679000000000002e-05 2024-05-08T18:31:47.621 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.621 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.621 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:47.621 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.721056+0000", 2024-05-08T18:31:47.621 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4630999999999999e-05 2024-05-08T18:31:47.621 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.621 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.621 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:47.621 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.721139+0000", 2024-05-08T18:31:47.621 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.3174e-05 2024-05-08T18:31:47.621 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.621 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.622 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:47.622 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.721264+0000", 2024-05-08T18:31:47.622 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012507600000000001 2024-05-08T18:31:47.622 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.622 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.622 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:31:47.622 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.721361+0000", 2024-05-08T18:31:47.622 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.7406999999999998e-05 2024-05-08T18:31:47.622 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.622 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.622 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:47.622 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.731468+0000", 2024-05-08T18:31:47.623 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010107065 2024-05-08T18:31:47.623 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.623 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.623 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:47.623 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.735495+0000", 2024-05-08T18:31:47.623 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0040267080000000004 2024-05-08T18:31:47.623 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.623 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.623 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:47.623 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.735563+0000", 2024-05-08T18:31:47.623 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8195999999999996e-05 2024-05-08T18:31:47.624 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.624 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.624 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:47.624 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.735620+0000", 2024-05-08T18:31:47.624 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6532e-05 2024-05-08T18:31:47.624 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:47.624 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:47.624 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:47.624 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.624 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.624 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1355 3.28 e82/21 3:14052413:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_41:head v 82'1, mlcod=0'0)", 2024-05-08T18:31:47.624 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.768053+0000", 2024-05-08T18:31:47.625 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4.801028842, 2024-05-08T18:31:47.625 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019664687, 2024-05-08T18:31:47.625 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:47.625 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:47.625 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:47.625 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:47.625 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.625 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:47.625 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.768053+0000", 2024-05-08T18:31:47.625 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:47.625 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.625 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.625 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:47.625 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.768053+0000", 2024-05-08T18:31:47.626 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:47.626 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.626 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.626 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:47.626 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.768055+0000", 2024-05-08T18:31:47.626 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6959999999999999e-06 2024-05-08T18:31:47.626 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.626 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.626 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:47.626 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.772115+0000", 2024-05-08T18:31:47.626 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0040600139999999998 2024-05-08T18:31:47.626 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.626 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.627 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:47.627 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.772149+0000", 2024-05-08T18:31:47.627 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4638999999999998e-05 2024-05-08T18:31:47.627 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.627 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.627 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:47.627 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.772165+0000", 2024-05-08T18:31:47.627 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5435999999999999e-05 2024-05-08T18:31:47.628 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.628 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.628 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:47.628 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.772261+0000", 2024-05-08T18:31:47.628 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.6724000000000004e-05 2024-05-08T18:31:47.628 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.628 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.628 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:47.628 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.772289+0000", 2024-05-08T18:31:47.629 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7243e-05 2024-05-08T18:31:47.629 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.629 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.629 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:47.629 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.787670+0000", 2024-05-08T18:31:47.629 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.015380906 2024-05-08T18:31:47.629 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.629 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.629 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:47.629 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.787718+0000", 2024-05-08T18:31:47.629 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8028999999999997e-05 2024-05-08T18:31:47.629 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:47.630 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:47.630 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:47.630 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.630 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.630 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1356 3.2 3:41e29af7:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_42:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:47.630 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.771157+0000", 2024-05-08T18:31:47.630 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4.7979248610000003, 2024-05-08T18:31:47.630 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.018991331, 2024-05-08T18:31:47.630 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:47.630 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:47.630 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:47.631 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:47.631 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:47.631 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:47.631 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1356 2024-05-08T18:31:47.631 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.631 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:47.631 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.631 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:47.631 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.771157+0000", 2024-05-08T18:31:47.631 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:47.631 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.631 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.631 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:47.632 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.771157+0000", 2024-05-08T18:31:47.632 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:47.632 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.632 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.632 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:47.632 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.771160+0000", 2024-05-08T18:31:47.632 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1820000000000002e-06 2024-05-08T18:31:47.632 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.632 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.632 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:47.632 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.772778+0000", 2024-05-08T18:31:47.632 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001617926 2024-05-08T18:31:47.632 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.632 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.633 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:47.633 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.772790+0000", 2024-05-08T18:31:47.633 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1609e-05 2024-05-08T18:31:47.633 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.633 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.633 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:47.633 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.772797+0000", 2024-05-08T18:31:47.633 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.3270000000000003e-06 2024-05-08T18:31:47.633 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.633 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.633 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:47.633 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.772851+0000", 2024-05-08T18:31:47.633 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3987999999999999e-05 2024-05-08T18:31:47.634 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.634 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.634 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:47.634 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.772947+0000", 2024-05-08T18:31:47.634 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.5809000000000004e-05 2024-05-08T18:31:47.634 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.634 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.634 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-05-08T18:31:47.634 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.773040+0000", 2024-05-08T18:31:47.634 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.3422000000000001e-05 2024-05-08T18:31:47.634 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.634 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.634 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:47.635 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.786246+0000", 2024-05-08T18:31:47.635 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.013205744 2024-05-08T18:31:47.635 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.635 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.635 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:47.635 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.790017+0000", 2024-05-08T18:31:47.635 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0037707539999999999 2024-05-08T18:31:47.635 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.635 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.635 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:47.635 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.790091+0000", 2024-05-08T18:31:47.635 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.4664000000000002e-05 2024-05-08T18:31:47.635 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.635 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.636 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:47.636 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.790148+0000", 2024-05-08T18:31:47.636 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6906e-05 2024-05-08T18:31:47.636 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:47.636 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:47.636 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:47.636 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.636 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.636 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1407 3.22 e82/21 3:46b64ebe:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_93:head v 82'2, mlcod=0'0)", 2024-05-08T18:31:47.636 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:43.347361+0000", 2024-05-08T18:31:47.636 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4.2217212599999998, 2024-05-08T18:31:47.636 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.017804430999999999, 2024-05-08T18:31:47.636 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:47.636 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:47.637 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:47.637 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:47.637 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.637 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:47.637 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.347361+0000", 2024-05-08T18:31:47.637 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:47.637 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.637 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.637 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:47.637 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.347361+0000", 2024-05-08T18:31:47.637 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:47.637 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.637 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.637 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:47.638 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.347362+0000", 2024-05-08T18:31:47.638 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9489999999999999e-06 2024-05-08T18:31:47.638 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.638 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.638 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:47.638 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.352295+0000", 2024-05-08T18:31:47.638 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0049320659999999997 2024-05-08T18:31:47.638 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.638 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.638 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:47.638 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.352314+0000", 2024-05-08T18:31:47.638 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9057999999999999e-05 2024-05-08T18:31:47.638 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.639 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.639 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:47.639 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.352326+0000", 2024-05-08T18:31:47.639 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2244e-05 2024-05-08T18:31:47.639 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.639 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.639 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:47.639 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.352386+0000", 2024-05-08T18:31:47.639 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0066999999999999e-05 2024-05-08T18:31:47.639 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.639 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.639 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:47.639 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.352405+0000", 2024-05-08T18:31:47.639 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.872e-05 2024-05-08T18:31:47.640 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.640 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.640 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:47.640 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.365075+0000", 2024-05-08T18:31:47.640 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012670241 2024-05-08T18:31:47.640 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.640 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.640 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:47.640 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.365165+0000", 2024-05-08T18:31:47.640 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0086000000000005e-05 2024-05-08T18:31:47.640 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:47.640 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:47.640 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:47.640 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.641 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.641 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1414 3.29 3:946e7bc1:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_100:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:47.641 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:43.412960+0000", 2024-05-08T18:31:47.641 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4.1561214819999996, 2024-05-08T18:31:47.641 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.017447297, 2024-05-08T18:31:47.641 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:47.641 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:47.641 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:47.642 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:47.642 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:47.642 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:47.642 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1414 2024-05-08T18:31:47.642 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.642 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:47.642 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.642 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:47.642 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.412960+0000", 2024-05-08T18:31:47.642 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:47.642 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.642 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.642 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:47.643 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.412960+0000", 2024-05-08T18:31:47.643 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:47.643 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.643 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.643 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:47.643 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.412963+0000", 2024-05-08T18:31:47.643 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4219999999999999e-06 2024-05-08T18:31:47.643 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.643 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.643 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:47.643 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.414327+0000", 2024-05-08T18:31:47.643 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001364608 2024-05-08T18:31:47.643 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.643 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.644 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:47.644 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.414348+0000", 2024-05-08T18:31:47.644 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0981000000000001e-05 2024-05-08T18:31:47.644 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.644 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.644 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:47.644 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.414359+0000", 2024-05-08T18:31:47.644 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0900000000000001e-05 2024-05-08T18:31:47.645 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.645 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.645 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:47.645 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.414418+0000", 2024-05-08T18:31:47.645 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8430000000000001e-05 2024-05-08T18:31:47.645 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.645 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.646 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:47.646 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.414542+0000", 2024-05-08T18:31:47.646 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012464600000000001 2024-05-08T18:31:47.646 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.646 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.646 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:31:47.646 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.414646+0000", 2024-05-08T18:31:47.646 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000103492 2024-05-08T18:31:47.646 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.646 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.646 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:47.646 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.421327+0000", 2024-05-08T18:31:47.646 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0066811700000000002 2024-05-08T18:31:47.647 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.647 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.647 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:47.647 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.430304+0000", 2024-05-08T18:31:47.647 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0089774220000000005 2024-05-08T18:31:47.647 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.647 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.647 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:47.647 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.430364+0000", 2024-05-08T18:31:47.647 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9431000000000001e-05 2024-05-08T18:31:47.647 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.647 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.648 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:47.648 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.430408+0000", 2024-05-08T18:31:47.648 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3795000000000003e-05 2024-05-08T18:31:47.648 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:47.648 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:47.648 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:47.648 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.648 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.648 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1616 3.7 3:e2c69de8:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-05-08T18:31:47.648 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:46.728206+0000", 2024-05-08T18:31:47.648 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.84087563099999996, 2024-05-08T18:31:47.648 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.024382826, 2024-05-08T18:31:47.648 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:47.649 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:47.649 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:47.649 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:47.649 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:47.649 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:47.649 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1616 2024-05-08T18:31:47.649 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.649 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:47.649 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.649 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:47.649 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.728206+0000", 2024-05-08T18:31:47.649 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:47.649 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.649 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.650 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:47.650 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.728206+0000", 2024-05-08T18:31:47.650 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:47.650 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.650 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.650 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:47.650 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.728209+0000", 2024-05-08T18:31:47.650 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3060000000000002e-06 2024-05-08T18:31:47.650 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.650 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.650 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:47.650 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.730475+0000", 2024-05-08T18:31:47.650 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0022651899999999998 2024-05-08T18:31:47.651 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.651 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.651 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:47.651 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.730508+0000", 2024-05-08T18:31:47.651 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3226999999999999e-05 2024-05-08T18:31:47.651 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.651 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.651 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:47.651 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.730523+0000", 2024-05-08T18:31:47.651 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4715999999999999e-05 2024-05-08T18:31:47.651 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.651 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.652 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:47.652 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.730618+0000", 2024-05-08T18:31:47.652 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.5619999999999996e-05 2024-05-08T18:31:47.652 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.652 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.652 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:47.652 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.730831+0000", 2024-05-08T18:31:47.652 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021288599999999999 2024-05-08T18:31:47.653 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.653 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.653 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:47.653 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.730970+0000", 2024-05-08T18:31:47.653 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013861400000000001 2024-05-08T18:31:47.653 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.653 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.653 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:47.653 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.742595+0000", 2024-05-08T18:31:47.653 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011624951 2024-05-08T18:31:47.653 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.654 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.654 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:47.654 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.752495+0000", 2024-05-08T18:31:47.654 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0098999910000000003 2024-05-08T18:31:47.654 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.654 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.654 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:47.654 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.752546+0000", 2024-05-08T18:31:47.654 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.1422999999999999e-05 2024-05-08T18:31:47.655 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.655 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.655 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:47.655 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.752589+0000", 2024-05-08T18:31:47.655 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.2901999999999997e-05 2024-05-08T18:31:47.655 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:47.655 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:47.655 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:47.656 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.656 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.656 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1625 3.1e 3:798e9c4d:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-05-08T18:31:47.656 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:46.821701+0000", 2024-05-08T18:31:47.656 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.74738098600000002, 2024-05-08T18:31:47.656 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019517788000000001, 2024-05-08T18:31:47.656 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:47.656 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:47.656 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:47.657 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:47.657 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:47.657 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:47.657 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1625 2024-05-08T18:31:47.657 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.657 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:47.657 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.657 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:47.657 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.821701+0000", 2024-05-08T18:31:47.658 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:47.658 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.658 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.658 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:47.658 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.821701+0000", 2024-05-08T18:31:47.658 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:47.658 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.658 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.659 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:47.659 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.821704+0000", 2024-05-08T18:31:47.659 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9450000000000002e-06 2024-05-08T18:31:47.659 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.659 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.659 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:47.659 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.824221+0000", 2024-05-08T18:31:47.659 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0025171600000000001 2024-05-08T18:31:47.659 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.660 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.660 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:47.660 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.824251+0000", 2024-05-08T18:31:47.660 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0243000000000002e-05 2024-05-08T18:31:47.660 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.660 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.660 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:47.660 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.824265+0000", 2024-05-08T18:31:47.660 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3482999999999999e-05 2024-05-08T18:31:47.661 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.661 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.661 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:47.661 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.824353+0000", 2024-05-08T18:31:47.661 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8146999999999995e-05 2024-05-08T18:31:47.661 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.661 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.661 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:47.662 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.824560+0000", 2024-05-08T18:31:47.662 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00020771400000000001 2024-05-08T18:31:47.662 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.662 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.662 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:31:47.662 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.824720+0000", 2024-05-08T18:31:47.662 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015998799999999999 2024-05-08T18:31:47.662 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.662 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.663 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:47.663 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.837381+0000", 2024-05-08T18:31:47.663 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012660803 2024-05-08T18:31:47.663 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.663 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.663 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:47.663 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.841087+0000", 2024-05-08T18:31:47.663 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0037056519999999998 2024-05-08T18:31:47.663 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.664 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.664 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:47.664 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.841160+0000", 2024-05-08T18:31:47.664 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.3208999999999997e-05 2024-05-08T18:31:47.664 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.664 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.664 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:47.664 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.841219+0000", 2024-05-08T18:31:47.664 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8443999999999998e-05 2024-05-08T18:31:47.665 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:47.665 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:47.665 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:47.665 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.665 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.665 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1627 3.b 3:d1c181db:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-05-08T18:31:47.665 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:46.850618+0000", 2024-05-08T18:31:47.665 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.718463611, 2024-05-08T18:31:47.666 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.027553586000000001, 2024-05-08T18:31:47.666 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:47.666 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:47.666 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:47.666 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:47.666 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:47.666 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:47.666 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1627 2024-05-08T18:31:47.666 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.666 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:47.666 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.666 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:47.667 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.850618+0000", 2024-05-08T18:31:47.667 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:47.667 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.667 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.667 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:47.667 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.850618+0000", 2024-05-08T18:31:47.667 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:47.667 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.667 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.667 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:47.667 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.850621+0000", 2024-05-08T18:31:47.667 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0299999999999998e-06 2024-05-08T18:31:47.667 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.667 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.668 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:47.668 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.852369+0000", 2024-05-08T18:31:47.668 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001748229 2024-05-08T18:31:47.668 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.668 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.668 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:47.668 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.852397+0000", 2024-05-08T18:31:47.668 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7542000000000002e-05 2024-05-08T18:31:47.668 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.668 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.669 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:47.669 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.852410+0000", 2024-05-08T18:31:47.669 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2798e-05 2024-05-08T18:31:47.669 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.669 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.669 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:47.669 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.852537+0000", 2024-05-08T18:31:47.670 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000126756 2024-05-08T18:31:47.670 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.670 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.670 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:47.670 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.852785+0000", 2024-05-08T18:31:47.670 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024892099999999998 2024-05-08T18:31:47.670 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.670 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.670 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:47.671 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.853042+0000", 2024-05-08T18:31:47.671 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00025698799999999999 2024-05-08T18:31:47.671 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.671 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.671 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:47.671 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.876145+0000", 2024-05-08T18:31:47.671 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.023102746 2024-05-08T18:31:47.671 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.671 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.671 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:47.671 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.878045+0000", 2024-05-08T18:31:47.671 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0018999850000000001 2024-05-08T18:31:47.671 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.671 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.672 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:47.672 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.878117+0000", 2024-05-08T18:31:47.672 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1464000000000006e-05 2024-05-08T18:31:47.672 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.672 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.672 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:47.672 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.878172+0000", 2024-05-08T18:31:47.672 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5127000000000003e-05 2024-05-08T18:31:47.672 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:47.672 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:47.672 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:47.672 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.672 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.672 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1629 3.24 3:27d2a12f:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-05-08T18:31:47.673 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:46.873022+0000", 2024-05-08T18:31:47.673 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.69605960700000002, 2024-05-08T18:31:47.673 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019610209, 2024-05-08T18:31:47.673 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:47.673 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:47.673 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:47.673 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:47.673 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:47.673 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:47.673 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1629 2024-05-08T18:31:47.673 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.673 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:47.673 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.673 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:47.674 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.873022+0000", 2024-05-08T18:31:47.674 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:47.674 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.674 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.674 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:47.674 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.873022+0000", 2024-05-08T18:31:47.674 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:47.674 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.674 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.674 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:47.674 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.873024+0000", 2024-05-08T18:31:47.674 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.826e-06 2024-05-08T18:31:47.674 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.675 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.675 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:47.675 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.874556+0000", 2024-05-08T18:31:47.675 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0015321009999999999 2024-05-08T18:31:47.675 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.675 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.675 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:47.675 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.874593+0000", 2024-05-08T18:31:47.675 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6696000000000002e-05 2024-05-08T18:31:47.675 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.675 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.675 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:47.675 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.874610+0000", 2024-05-08T18:31:47.675 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7374e-05 2024-05-08T18:31:47.676 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.676 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.676 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:47.676 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.874687+0000", 2024-05-08T18:31:47.676 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7219999999999996e-05 2024-05-08T18:31:47.676 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.676 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.676 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:47.676 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.874823+0000", 2024-05-08T18:31:47.676 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013538600000000001 2024-05-08T18:31:47.676 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.676 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.676 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:31:47.676 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.874921+0000", 2024-05-08T18:31:47.677 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.8679999999999997e-05 2024-05-08T18:31:47.677 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.677 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.677 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:47.677 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.883485+0000", 2024-05-08T18:31:47.677 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0085638299999999997 2024-05-08T18:31:47.677 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.677 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.677 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:47.677 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.892549+0000", 2024-05-08T18:31:47.677 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0090635850000000007 2024-05-08T18:31:47.677 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.677 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.677 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:47.678 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.892593+0000", 2024-05-08T18:31:47.678 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4566e-05 2024-05-08T18:31:47.678 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.678 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.678 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:47.678 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.892632+0000", 2024-05-08T18:31:47.678 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8945000000000001e-05 2024-05-08T18:31:47.678 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:47.678 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:47.678 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:47.678 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.678 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.678 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1630 3.1e 3:7a85a01c:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-05-08T18:31:47.678 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:46.882333+0000", 2024-05-08T18:31:47.679 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.68674864899999999, 2024-05-08T18:31:47.679 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.018692686999999999, 2024-05-08T18:31:47.679 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:47.679 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:47.679 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:47.679 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:47.679 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:47.679 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:47.679 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1630 2024-05-08T18:31:47.679 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.679 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:47.679 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.679 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:47.679 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.882333+0000", 2024-05-08T18:31:47.680 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:47.680 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.680 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.680 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:47.680 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.882333+0000", 2024-05-08T18:31:47.680 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:47.680 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.680 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.680 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:47.680 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.882336+0000", 2024-05-08T18:31:47.680 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7089999999999998e-06 2024-05-08T18:31:47.680 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.680 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.680 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:47.681 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.883864+0000", 2024-05-08T18:31:47.681 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0015277859999999999 2024-05-08T18:31:47.681 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.681 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.681 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:47.681 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.883885+0000", 2024-05-08T18:31:47.681 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1534000000000001e-05 2024-05-08T18:31:47.681 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.681 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.681 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:47.681 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.883900+0000", 2024-05-08T18:31:47.681 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4773999999999999e-05 2024-05-08T18:31:47.681 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.681 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.682 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:47.682 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.883982+0000", 2024-05-08T18:31:47.682 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.2109999999999998e-05 2024-05-08T18:31:47.682 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.682 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.682 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:47.682 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.884128+0000", 2024-05-08T18:31:47.682 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014600299999999999 2024-05-08T18:31:47.682 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.682 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.682 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:31:47.682 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.884249+0000", 2024-05-08T18:31:47.682 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012081799999999999 2024-05-08T18:31:47.683 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.683 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.683 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:47.683 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.890584+0000", 2024-05-08T18:31:47.683 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0063351079999999999 2024-05-08T18:31:47.683 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.683 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.683 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:47.683 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.900934+0000", 2024-05-08T18:31:47.683 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010349591 2024-05-08T18:31:47.683 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.683 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.684 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:47.684 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.900975+0000", 2024-05-08T18:31:47.684 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0979000000000002e-05 2024-05-08T18:31:47.684 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.684 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.684 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:47.684 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.901026+0000", 2024-05-08T18:31:47.684 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.1275e-05 2024-05-08T18:31:47.684 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:47.684 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:47.684 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:47.684 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.685 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.685 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1633 3.15 e83/21 3:ab226f54:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_21:head v 83'2, mlcod=0'0)", 2024-05-08T18:31:47.685 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:46.920100+0000", 2024-05-08T18:31:47.685 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.64898221700000003, 2024-05-08T18:31:47.685 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.022841956, 2024-05-08T18:31:47.685 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:47.685 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:47.685 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:47.685 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:47.685 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.685 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:47.685 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.920100+0000", 2024-05-08T18:31:47.685 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:47.685 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.686 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.686 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:47.686 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.920100+0000", 2024-05-08T18:31:47.686 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:47.686 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.686 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.686 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:47.686 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.920101+0000", 2024-05-08T18:31:47.686 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4309999999999999e-06 2024-05-08T18:31:47.686 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.686 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.686 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:47.686 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.926002+0000", 2024-05-08T18:31:47.687 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0059014820000000004 2024-05-08T18:31:47.687 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.687 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.687 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:47.687 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.926041+0000", 2024-05-08T18:31:47.687 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8217999999999999e-05 2024-05-08T18:31:47.687 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.687 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.687 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:47.687 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.926057+0000", 2024-05-08T18:31:47.687 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5877000000000001e-05 2024-05-08T18:31:47.687 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.687 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.687 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:47.688 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.926149+0000", 2024-05-08T18:31:47.688 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.2361000000000006e-05 2024-05-08T18:31:47.688 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.688 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.688 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:47.688 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.926178+0000", 2024-05-08T18:31:47.688 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9544999999999999e-05 2024-05-08T18:31:47.688 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.688 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.688 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:47.688 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.942887+0000", 2024-05-08T18:31:47.689 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.016708163000000002 2024-05-08T18:31:47.689 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.689 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.689 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:47.689 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.942942+0000", 2024-05-08T18:31:47.689 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4879000000000001e-05 2024-05-08T18:31:47.689 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:47.689 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:47.689 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:47.689 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.689 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.689 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1634 3.b 3:d3d25f94:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-05-08T18:31:47.689 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:46.925230+0000", 2024-05-08T18:31:47.689 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.64385148199999997, 2024-05-08T18:31:47.689 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.022437625999999999, 2024-05-08T18:31:47.690 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:47.690 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:47.690 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:47.690 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:47.690 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:47.690 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:47.690 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1634 2024-05-08T18:31:47.690 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.690 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:47.690 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.690 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:47.690 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.925230+0000", 2024-05-08T18:31:47.691 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:47.691 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.691 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.691 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:47.691 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.925230+0000", 2024-05-08T18:31:47.691 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:47.691 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.691 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.691 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:47.691 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.925234+0000", 2024-05-08T18:31:47.691 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6789999999999998e-06 2024-05-08T18:31:47.691 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.691 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.691 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:47.692 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.927184+0000", 2024-05-08T18:31:47.692 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0019497799999999999 2024-05-08T18:31:47.692 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.692 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.692 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:47.692 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.927205+0000", 2024-05-08T18:31:47.692 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1231000000000001e-05 2024-05-08T18:31:47.692 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.692 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.692 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:47.692 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.927214+0000", 2024-05-08T18:31:47.692 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0159999999999997e-06 2024-05-08T18:31:47.692 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.692 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.693 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:47.693 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.927287+0000", 2024-05-08T18:31:47.693 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.3192e-05 2024-05-08T18:31:47.693 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.693 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.693 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:47.693 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.927495+0000", 2024-05-08T18:31:47.693 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00020766099999999999 2024-05-08T18:31:47.693 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.693 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.693 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:47.693 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.927653+0000", 2024-05-08T18:31:47.693 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015861799999999999 2024-05-08T18:31:47.693 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.694 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.694 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:47.694 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.947344+0000", 2024-05-08T18:31:47.694 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019690112999999999 2024-05-08T18:31:47.694 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.694 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.694 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:47.694 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.947572+0000", 2024-05-08T18:31:47.694 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000228292 2024-05-08T18:31:47.694 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.694 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.694 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:47.694 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.947618+0000", 2024-05-08T18:31:47.694 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5880000000000001e-05 2024-05-08T18:31:47.695 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.695 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.695 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:47.695 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.947668+0000", 2024-05-08T18:31:47.695 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.0164000000000003e-05 2024-05-08T18:31:47.695 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:47.695 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:47.695 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:47.695 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.695 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.695 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1635 3.27 3:e4667ce2:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-05-08T18:31:47.695 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:46.936207+0000", 2024-05-08T18:31:47.695 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.63287486400000004, 2024-05-08T18:31:47.696 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.018244245999999999, 2024-05-08T18:31:47.696 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:47.696 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:47.696 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:47.696 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:47.696 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:47.696 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:47.696 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1635 2024-05-08T18:31:47.696 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.696 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:47.696 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.696 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:47.696 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.936207+0000", 2024-05-08T18:31:47.696 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:47.697 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.697 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.697 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:47.697 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.936207+0000", 2024-05-08T18:31:47.697 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:47.697 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.697 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.697 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:47.697 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.936210+0000", 2024-05-08T18:31:47.697 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.106e-06 2024-05-08T18:31:47.697 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.697 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.697 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:47.697 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.937940+0000", 2024-05-08T18:31:47.698 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001729972 2024-05-08T18:31:47.698 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.698 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.698 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:47.698 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.937963+0000", 2024-05-08T18:31:47.698 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3084000000000001e-05 2024-05-08T18:31:47.698 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.698 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.698 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:47.698 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.937975+0000", 2024-05-08T18:31:47.698 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2072000000000001e-05 2024-05-08T18:31:47.698 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.698 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.698 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:47.699 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.938060+0000", 2024-05-08T18:31:47.699 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5006000000000006e-05 2024-05-08T18:31:47.699 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.699 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.699 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:47.699 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.938220+0000", 2024-05-08T18:31:47.699 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000160018 2024-05-08T18:31:47.699 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.699 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.699 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:31:47.699 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.938359+0000", 2024-05-08T18:31:47.699 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013879300000000001 2024-05-08T18:31:47.699 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.700 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.700 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:47.700 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.947820+0000", 2024-05-08T18:31:47.700 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0094607370000000003 2024-05-08T18:31:47.700 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.700 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.700 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:47.700 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.954291+0000", 2024-05-08T18:31:47.700 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0064716030000000003 2024-05-08T18:31:47.700 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.700 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.700 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:47.700 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.954353+0000", 2024-05-08T18:31:47.700 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1965999999999996e-05 2024-05-08T18:31:47.700 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:47.701 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:47.701 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:47.701 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.954451+0000", 2024-05-08T18:31:47.701 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.7888999999999997e-05 2024-05-08T18:31:47.701 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:47.701 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:47.701 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:47.701 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:47.701 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:47.701 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:47.701 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-08T18:31:47.703 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-08T18:31:47.704 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:31:47.701+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:31:47.804 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:31:47.798+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:31:47.835 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:31:47.835 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:31:47.835 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 0 2024-05-08T18:31:47.835 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:31:47.850 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-08T18:31:47.905 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:31:47.905+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:31:47.928 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-08T18:31:48.006 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:31:48.005+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:31:48.014 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:31:48.014 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:31:48.014 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2024-05-08T18:31:48.014 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2024-05-08T18:31:48.014 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:31:48.028 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-08T18:31:48.061 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2024-05-08T18:31:48.061 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:31:48.077 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2024-05-08T18:31:48.077 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:31:48.090 INFO:tasks.workunit.client.0.smithi097.stderr:10+0 records in 2024-05-08T18:31:48.090 INFO:tasks.workunit.client.0.smithi097.stderr:10+0 records out 2024-05-08T18:31:48.090 INFO:tasks.workunit.client.0.smithi097.stderr:104857600 bytes (105 MB, 100 MiB) copied, 0.767897 s, 137 MB/s 2024-05-08T18:31:48.093 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2024-05-08T18:31:48.093 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:31:48.107 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:31:48.105+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:31:48.110 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2024-05-08T18:31:48.110 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:31:48.129 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2024-05-08T18:31:48.130 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:31:48.147 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:48.147 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:48.150 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2024-05-08T18:31:48.151 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:31:48.162 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-08T18:31:48.169 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2024-05-08T18:31:48.169 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:31:48.188 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2024-05-08T18:31:48.189 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:31:48.248 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:31:48.249+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:31:48.287 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:48.287 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:48.301 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-08T18:31:48.348 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:31:48.346+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:31:48.409 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:31:48.409+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:31:48.423 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:48.423 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:48.437 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-08T18:31:48.510 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:31:48.509+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:31:48.559 INFO:teuthology.orchestra.run.smithi097.stderr:noscrub is set 2024-05-08T18:31:48.627 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:48.627 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:48.636 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:31:48.637+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:31:48.648 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-08T18:31:48.713 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:31:48.713+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:31:48.776 INFO:tasks.workunit.client.0.smithi097.stdout:quota enabled for the user 0.626361150601046 2024-05-08T18:31:48.776 INFO:tasks.workunit.client.0.smithi097.stdout:adding file to bucket buck_2024_04_8_18_31_47: 100Mb. 2024-05-08T18:31:48.777 INFO:tasks.workunit.client.0.smithi097.stdout:upload file successful 2024-05-08T18:31:48.787 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:48.787 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:48.802 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-08T18:31:48.814 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:31:48.813+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:31:48.915 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:31:48.913+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:31:48.916 INFO:tasks.workunit.client.0.smithi097.stdout:Bucket Created: buck_2024_04_8_18_31_48 2024-05-08T18:31:48.930 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:48.930 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:48.944 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-08T18:31:49.016 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:31:49.017+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:31:49.071 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:49.071 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:49.085 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-08T18:31:49.118 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:31:49.117+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:31:49.202 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:49.203 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:49.217 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-08T18:31:49.219 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:31:49.217+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:31:49.320 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:31:49.317+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:31:49.341 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:49.341 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:49.355 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-08T18:31:49.420 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:31:49.421+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:31:49.476 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:49.476 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:49.490 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-08T18:31:49.521 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:31:49.518+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:31:49.622 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:31:49.618+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:31:49.623 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:49.623 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:49.640 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-08T18:31:49.678 INFO:tasks.workunit.client.0.smithi097.stderr:10+0 records in 2024-05-08T18:31:49.678 INFO:tasks.workunit.client.0.smithi097.stderr:10+0 records out 2024-05-08T18:31:49.678 INFO:tasks.workunit.client.0.smithi097.stderr:104857600 bytes (105 MB, 100 MiB) copied, 0.628066 s, 167 MB/s 2024-05-08T18:31:49.724 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:31:49.721+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:31:49.776 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:49.776 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:49.790 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-08T18:31:49.825 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:31:49.822+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:31:49.926 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:31:49.925+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:31:49.944 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:49.944 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:49.957 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-08T18:31:50.048 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:31:50.049+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:31:50.127 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:31:50.122+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:31:50.176 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:50.176 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:50.200 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-08T18:31:50.206 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-08T18:31:50.228 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:31:50.222+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:31:50.328 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:31:50.329+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:31:50.397 INFO:tasks.workunit.client.0.smithi097.stdout:quota enabled for the user 0.626361150601046 2024-05-08T18:31:50.397 INFO:tasks.workunit.client.0.smithi097.stdout:adding file to bucket buck_2024_04_8_18_31_48: 100Mb. 2024-05-08T18:31:50.397 INFO:tasks.workunit.client.0.smithi097.stdout:upload file successful 2024-05-08T18:31:50.397 INFO:tasks.workunit.client.0.smithi097.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-08T18:31:50.398 INFO:tasks.workunit.client.0.smithi097.stdout:Test case: PASSED - user quota max size for 0.626361150601046 passed on 3 buckets 2024-05-08T18:31:50.398 INFO:tasks.workunit.client.0.smithi097.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-08T18:31:50.402 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2024-05-08T18:31:50.402 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:31:50.417 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:50.417 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:50.419 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2024-05-08T18:31:50.419 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:31:50.428 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:31:50.429+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:31:50.432 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-08T18:31:50.436 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2024-05-08T18:31:50.437 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:31:50.456 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2024-05-08T18:31:50.456 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:31:50.477 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2024-05-08T18:31:50.477 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:31:50.499 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2024-05-08T18:31:50.499 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:31:50.523 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2024-05-08T18:31:50.523 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:31:50.530 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:31:50.529+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:31:50.544 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2024-05-08T18:31:50.544 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:31:50.563 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:50.564 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2024-05-08T18:31:50.564 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2024-05-08T18:31:50.564 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-05-08T18:31:50.564 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.564 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4479.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-05-08T18:31:50.565 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:29:44.576320+0000", 2024-05-08T18:31:50.565 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 125.98643398500001, 2024-05-08T18:31:50.565 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019751892, 2024-05-08T18:31:50.565 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:50.566 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:50.566 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "reached pg", 2024-05-08T18:31:50.566 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:50.566 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4479", 2024-05-08T18:31:50.566 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3577501689", 2024-05-08T18:31:50.567 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 2 2024-05-08T18:31:50.567 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.567 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:50.567 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.567 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:50.567 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576320+0000", 2024-05-08T18:31:50.567 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:50.568 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.568 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.569 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:50.570 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576320+0000", 2024-05-08T18:31:50.570 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:50.570 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.570 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.570 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:50.570 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576323+0000", 2024-05-08T18:31:50.571 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.813e-06 2024-05-08T18:31:50.571 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.571 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.571 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:50.571 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576335+0000", 2024-05-08T18:31:50.571 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2330000000000001e-05 2024-05-08T18:31:50.572 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.572 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.572 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:50.572 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576367+0000", 2024-05-08T18:31:50.572 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2036999999999998e-05 2024-05-08T18:31:50.572 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.573 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.573 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:50.573 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576394+0000", 2024-05-08T18:31:50.573 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6529e-05 2024-05-08T18:31:50.573 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.573 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.574 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:50.574 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576550+0000", 2024-05-08T18:31:50.574 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000156718 2024-05-08T18:31:50.574 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.574 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.574 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-05-08T18:31:50.575 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.576560+0000", 2024-05-08T18:31:50.575 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0040999999999999e-05 2024-05-08T18:31:50.575 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.575 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.575 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:50.575 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.587240+0000", 2024-05-08T18:31:50.576 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010679266999999999 2024-05-08T18:31:50.576 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.576 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.576 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2024-05-08T18:31:50.576 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.587266+0000", 2024-05-08T18:31:50.576 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6642e-05 2024-05-08T18:31:50.577 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.577 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.577 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:50.577 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.595882+0000", 2024-05-08T18:31:50.577 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0086159600000000006 2024-05-08T18:31:50.577 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.578 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.578 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:50.578 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:29:44.596072+0000", 2024-05-08T18:31:50.578 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000189555 2024-05-08T18:31:50.578 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:50.578 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:50.579 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:50.579 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.579 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.579 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1316 3.0 3:03a68e79:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-08T18:31:50.579 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.312804+0000", 2024-05-08T18:31:50.579 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 8.2499504049999999, 2024-05-08T18:31:50.580 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021400750999999999, 2024-05-08T18:31:50.580 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:50.580 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:50.580 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:50.580 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:50.581 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:50.581 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:50.581 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1316 2024-05-08T18:31:50.581 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.581 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:50.581 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.581 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:50.581 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.312804+0000", 2024-05-08T18:31:50.581 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:50.581 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.582 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.582 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:50.582 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.312804+0000", 2024-05-08T18:31:50.582 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:50.582 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.582 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.582 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:50.582 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.312807+0000", 2024-05-08T18:31:50.582 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.134e-06 2024-05-08T18:31:50.583 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.583 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.583 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:50.583 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.317697+0000", 2024-05-08T18:31:50.583 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0048908129999999999 2024-05-08T18:31:50.583 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.583 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.583 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:50.583 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.317741+0000", 2024-05-08T18:31:50.583 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3381999999999999e-05 2024-05-08T18:31:50.584 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.584 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.584 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:50.584 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.317766+0000", 2024-05-08T18:31:50.584 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4905999999999998e-05 2024-05-08T18:31:50.584 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.584 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.584 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:50.584 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.317880+0000", 2024-05-08T18:31:50.585 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000114325 2024-05-08T18:31:50.585 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.585 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.585 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:50.585 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.318049+0000", 2024-05-08T18:31:50.585 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000168424 2024-05-08T18:31:50.585 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.586 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.586 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-05-08T18:31:50.586 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.318200+0000", 2024-05-08T18:31:50.586 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000151368 2024-05-08T18:31:50.586 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.586 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.586 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:50.586 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.326262+0000", 2024-05-08T18:31:50.586 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0080624249999999998 2024-05-08T18:31:50.587 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.587 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.587 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:50.587 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.334084+0000", 2024-05-08T18:31:50.587 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0078220189999999995 2024-05-08T18:31:50.587 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.587 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.587 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:50.587 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.334151+0000", 2024-05-08T18:31:50.588 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6469000000000003e-05 2024-05-08T18:31:50.588 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.588 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.588 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:50.588 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.334204+0000", 2024-05-08T18:31:50.588 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3486000000000003e-05 2024-05-08T18:31:50.588 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:50.588 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:50.588 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:50.589 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.589 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.589 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1323 3.8 e81/21 3:1035fbfb:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_9:head v 81'1, mlcod=0'0)", 2024-05-08T18:31:50.589 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.417887+0000", 2024-05-08T18:31:50.589 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 8.1448668479999995, 2024-05-08T18:31:50.589 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012382977999999999, 2024-05-08T18:31:50.589 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:50.589 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:50.589 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:50.589 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:50.590 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.590 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:50.590 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.417887+0000", 2024-05-08T18:31:50.590 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:50.590 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.590 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.590 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:50.590 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.417887+0000", 2024-05-08T18:31:50.590 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:50.591 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.591 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.591 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:50.591 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.417889+0000", 2024-05-08T18:31:50.591 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.827e-06 2024-05-08T18:31:50.591 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.591 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.591 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:50.591 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.421237+0000", 2024-05-08T18:31:50.592 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0033480440000000001 2024-05-08T18:31:50.592 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.592 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.592 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:50.592 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.421262+0000", 2024-05-08T18:31:50.592 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5267000000000001e-05 2024-05-08T18:31:50.592 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.593 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.593 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:50.593 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.421275+0000", 2024-05-08T18:31:50.593 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2714999999999999e-05 2024-05-08T18:31:50.593 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.593 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.593 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:50.593 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.421348+0000", 2024-05-08T18:31:50.593 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2933000000000001e-05 2024-05-08T18:31:50.593 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.593 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.593 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:50.594 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.421365+0000", 2024-05-08T18:31:50.594 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6804e-05 2024-05-08T18:31:50.594 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.594 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.594 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:50.594 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.430139+0000", 2024-05-08T18:31:50.594 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0087743519999999992 2024-05-08T18:31:50.594 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.594 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.594 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:50.594 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.430270+0000", 2024-05-08T18:31:50.594 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013103600000000001 2024-05-08T18:31:50.594 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:50.595 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:50.595 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:50.595 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.595 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.595 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1330 3.8 e81/21 3:124da8ab:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_16:head v 81'2, mlcod=0'0)", 2024-05-08T18:31:50.595 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.495388+0000", 2024-05-08T18:31:50.595 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 8.0673656220000005, 2024-05-08T18:31:50.595 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011386743, 2024-05-08T18:31:50.595 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:50.595 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:50.595 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:50.595 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:50.595 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.595 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:50.596 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.495388+0000", 2024-05-08T18:31:50.596 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:50.596 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.596 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.596 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:50.597 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.495388+0000", 2024-05-08T18:31:50.597 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:50.597 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.597 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.597 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:50.597 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.495390+0000", 2024-05-08T18:31:50.597 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2139999999999999e-06 2024-05-08T18:31:50.597 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.597 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.597 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:50.597 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.496871+0000", 2024-05-08T18:31:50.597 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001481581 2024-05-08T18:31:50.597 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.597 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.598 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:50.598 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.496899+0000", 2024-05-08T18:31:50.598 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7616000000000001e-05 2024-05-08T18:31:50.598 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.598 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.598 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:50.598 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.496916+0000", 2024-05-08T18:31:50.598 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7655e-05 2024-05-08T18:31:50.598 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.598 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.598 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:50.598 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.497003+0000", 2024-05-08T18:31:50.598 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6952000000000004e-05 2024-05-08T18:31:50.599 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.599 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.599 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:50.599 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.497035+0000", 2024-05-08T18:31:50.599 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1529000000000003e-05 2024-05-08T18:31:50.599 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.599 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.599 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:50.599 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.506706+0000", 2024-05-08T18:31:50.599 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0096707540000000002 2024-05-08T18:31:50.599 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.599 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.599 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:50.599 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.506775+0000", 2024-05-08T18:31:50.600 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9442000000000004e-05 2024-05-08T18:31:50.600 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:50.600 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:50.600 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:50.600 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.600 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.600 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1336 3.2 e82/46 3:42c6ce4f:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_22:head v 82'1, mlcod=0'0)", 2024-05-08T18:31:50.600 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.573034+0000", 2024-05-08T18:31:50.600 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 7.9897198170000001, 2024-05-08T18:31:50.600 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.018430308999999999, 2024-05-08T18:31:50.600 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:50.600 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:50.600 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:50.600 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:50.600 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.601 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:50.601 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.573034+0000", 2024-05-08T18:31:50.601 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:50.601 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.601 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.601 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:50.601 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.573034+0000", 2024-05-08T18:31:50.601 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:50.601 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.601 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.601 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:50.601 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.573034+0000", 2024-05-08T18:31:50.601 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.48e-07 2024-05-08T18:31:50.601 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.601 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.602 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:50.602 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.578475+0000", 2024-05-08T18:31:50.602 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0054408690000000001 2024-05-08T18:31:50.602 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.602 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.602 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:50.602 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.578488+0000", 2024-05-08T18:31:50.602 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2777e-05 2024-05-08T18:31:50.602 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.602 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.602 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:50.602 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.578499+0000", 2024-05-08T18:31:50.602 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0995999999999999e-05 2024-05-08T18:31:50.602 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.603 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.603 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:50.603 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.578875+0000", 2024-05-08T18:31:50.603 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000376139 2024-05-08T18:31:50.603 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.603 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.603 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:50.603 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.578900+0000", 2024-05-08T18:31:50.603 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5205e-05 2024-05-08T18:31:50.603 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.603 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.603 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:50.603 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.591395+0000", 2024-05-08T18:31:50.603 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012494244 2024-05-08T18:31:50.604 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.604 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.604 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:50.604 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.591464+0000", 2024-05-08T18:31:50.604 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9831000000000003e-05 2024-05-08T18:31:50.604 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:50.604 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:50.604 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:50.604 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.604 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.604 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1342 3.32 e82/21 3:4c847226:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_28:head v 82'2, mlcod=0'0)", 2024-05-08T18:31:50.604 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.626427+0000", 2024-05-08T18:31:50.604 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 7.9363273020000005, 2024-05-08T18:31:50.604 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.013168078, 2024-05-08T18:31:50.604 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:50.605 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:50.605 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:50.605 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:50.605 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.605 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:50.605 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.626427+0000", 2024-05-08T18:31:50.605 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:50.605 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.605 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.605 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:50.605 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.626427+0000", 2024-05-08T18:31:50.605 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:50.605 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.605 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.606 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:50.606 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.626428+0000", 2024-05-08T18:31:50.606 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.672e-06 2024-05-08T18:31:50.606 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.606 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.606 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:50.606 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.628013+0000", 2024-05-08T18:31:50.606 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0015845569999999999 2024-05-08T18:31:50.606 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.606 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.606 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:50.606 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.628035+0000", 2024-05-08T18:31:50.606 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2419999999999999e-05 2024-05-08T18:31:50.606 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.607 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.607 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:50.607 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.628046+0000", 2024-05-08T18:31:50.607 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0353999999999999e-05 2024-05-08T18:31:50.607 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.607 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.607 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:50.607 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.628116+0000", 2024-05-08T18:31:50.607 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.0722999999999994e-05 2024-05-08T18:31:50.607 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.607 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.607 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:50.607 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.628138+0000", 2024-05-08T18:31:50.607 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1583999999999999e-05 2024-05-08T18:31:50.608 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.608 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.608 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:50.608 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.639523+0000", 2024-05-08T18:31:50.608 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011385052 2024-05-08T18:31:50.608 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.608 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.608 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:50.608 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.639595+0000", 2024-05-08T18:31:50.608 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1716000000000003e-05 2024-05-08T18:31:50.608 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:50.608 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:50.608 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:50.608 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.609 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.609 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1352 3.0 3:0085bede:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_38:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:50.609 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.730228+0000", 2024-05-08T18:31:50.609 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 7.8325263659999997, 2024-05-08T18:31:50.609 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.013827124999999999, 2024-05-08T18:31:50.609 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:50.609 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:50.609 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:50.609 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:50.609 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:50.609 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:50.609 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1352 2024-05-08T18:31:50.609 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.610 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:50.610 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.610 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:50.610 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.730228+0000", 2024-05-08T18:31:50.610 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:50.610 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.610 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.610 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:50.610 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.730228+0000", 2024-05-08T18:31:50.610 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:50.610 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.610 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.610 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:50.610 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.730230+0000", 2024-05-08T18:31:50.611 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.34e-06 2024-05-08T18:31:50.611 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.611 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.611 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:50.611 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.731986+0000", 2024-05-08T18:31:50.611 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0017560379999999999 2024-05-08T18:31:50.611 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.611 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.611 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:50.611 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.732011+0000", 2024-05-08T18:31:50.611 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5548e-05 2024-05-08T18:31:50.611 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.611 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.611 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:50.612 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.732025+0000", 2024-05-08T18:31:50.612 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3103e-05 2024-05-08T18:31:50.612 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.612 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.612 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:50.612 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.732121+0000", 2024-05-08T18:31:50.612 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.6000000000000002e-05 2024-05-08T18:31:50.612 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.612 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.612 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:50.612 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.732314+0000", 2024-05-08T18:31:50.612 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00019294900000000001 2024-05-08T18:31:50.612 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.612 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.612 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-05-08T18:31:50.613 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.732488+0000", 2024-05-08T18:31:50.613 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000174747 2024-05-08T18:31:50.613 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.613 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.613 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:50.613 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.743193+0000", 2024-05-08T18:31:50.613 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010704910999999999 2024-05-08T18:31:50.613 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.613 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.613 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:50.613 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.743921+0000", 2024-05-08T18:31:50.613 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000728205 2024-05-08T18:31:50.613 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.613 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.614 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:50.614 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.743997+0000", 2024-05-08T18:31:50.614 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.5198999999999996e-05 2024-05-08T18:31:50.614 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.614 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.614 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:50.614 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.744055+0000", 2024-05-08T18:31:50.614 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8084999999999997e-05 2024-05-08T18:31:50.614 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:50.614 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:50.614 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:50.614 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.614 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.614 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1353 3.19 3:9832a795:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_39:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:50.615 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.740875+0000", 2024-05-08T18:31:50.615 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 7.8218792520000004, 2024-05-08T18:31:50.615 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.014311799, 2024-05-08T18:31:50.615 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:50.615 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:50.615 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:50.615 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:50.615 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:50.615 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:50.615 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1353 2024-05-08T18:31:50.615 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.615 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:50.615 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.615 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:50.616 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.740875+0000", 2024-05-08T18:31:50.616 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:50.616 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.616 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.616 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:50.616 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.740875+0000", 2024-05-08T18:31:50.616 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:50.616 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.616 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.616 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:50.616 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.740877+0000", 2024-05-08T18:31:50.616 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9539999999999998e-06 2024-05-08T18:31:50.616 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.616 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.616 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:50.617 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.742244+0000", 2024-05-08T18:31:50.617 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001367041 2024-05-08T18:31:50.617 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.617 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.617 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:50.617 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.742277+0000", 2024-05-08T18:31:50.617 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2855000000000003e-05 2024-05-08T18:31:50.617 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.617 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.617 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:50.617 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.742290+0000", 2024-05-08T18:31:50.617 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3919e-05 2024-05-08T18:31:50.617 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.617 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.618 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:50.618 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.742377+0000", 2024-05-08T18:31:50.618 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6148000000000003e-05 2024-05-08T18:31:50.618 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.618 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.618 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:50.618 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.742489+0000", 2024-05-08T18:31:50.618 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000112207 2024-05-08T18:31:50.618 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.618 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.618 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:50.618 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.742589+0000", 2024-05-08T18:31:50.618 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000100253 2024-05-08T18:31:50.618 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.619 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.619 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:50.619 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.754466+0000", 2024-05-08T18:31:50.619 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011876711999999999 2024-05-08T18:31:50.619 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.619 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.619 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:50.619 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.755080+0000", 2024-05-08T18:31:50.619 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00061390200000000005 2024-05-08T18:31:50.619 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.619 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.619 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:50.619 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.755119+0000", 2024-05-08T18:31:50.619 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9563000000000001e-05 2024-05-08T18:31:50.620 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.620 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.620 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:50.620 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.755186+0000", 2024-05-08T18:31:50.620 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7244999999999997e-05 2024-05-08T18:31:50.620 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:50.620 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:50.620 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:50.620 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.620 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.620 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1356 3.2 e82/46 3:41e29af7:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_42:head v 82'2, mlcod=0'0)", 2024-05-08T18:31:50.620 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.773148+0000", 2024-05-08T18:31:50.620 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 7.7896059849999997, 2024-05-08T18:31:50.620 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.013374621, 2024-05-08T18:31:50.621 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:50.621 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:50.621 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:50.621 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:50.621 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.621 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:50.621 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.773148+0000", 2024-05-08T18:31:50.621 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:50.621 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.621 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.621 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:50.621 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.773148+0000", 2024-05-08T18:31:50.621 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:50.621 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.622 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.622 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:50.622 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.773150+0000", 2024-05-08T18:31:50.622 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7940000000000001e-06 2024-05-08T18:31:50.622 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.622 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.622 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:50.622 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.774924+0000", 2024-05-08T18:31:50.622 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0017746319999999999 2024-05-08T18:31:50.622 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.622 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.622 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:50.622 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.774942+0000", 2024-05-08T18:31:50.622 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7819999999999999e-05 2024-05-08T18:31:50.623 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.623 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.623 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:50.623 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.774952+0000", 2024-05-08T18:31:50.623 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.8039999999999996e-06 2024-05-08T18:31:50.623 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.623 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.623 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:50.623 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.775018+0000", 2024-05-08T18:31:50.623 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5951000000000006e-05 2024-05-08T18:31:50.623 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.623 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.623 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:50.623 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.775039+0000", 2024-05-08T18:31:50.623 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0962999999999999e-05 2024-05-08T18:31:50.624 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.624 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.624 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:50.624 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.786465+0000", 2024-05-08T18:31:50.624 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011425820999999999 2024-05-08T18:31:50.624 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.624 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.624 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:50.624 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.786523+0000", 2024-05-08T18:31:50.624 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7836e-05 2024-05-08T18:31:50.624 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:50.624 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:50.624 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:50.624 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.625 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.625 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1364 3.19 3:9b6bd3b9:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_50:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:50.625 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.853643+0000", 2024-05-08T18:31:50.625 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 7.7091108980000005, 2024-05-08T18:31:50.625 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.013216927, 2024-05-08T18:31:50.625 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:50.625 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:50.625 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:50.625 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:50.625 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:50.625 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:50.625 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1364 2024-05-08T18:31:50.625 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.626 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:50.626 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.626 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:50.626 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.853643+0000", 2024-05-08T18:31:50.626 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:50.626 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.626 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.626 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:50.626 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.853643+0000", 2024-05-08T18:31:50.626 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:50.626 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.626 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.627 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:50.627 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.853645+0000", 2024-05-08T18:31:50.627 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4219999999999999e-06 2024-05-08T18:31:50.627 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.627 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.627 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:50.627 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.855207+0000", 2024-05-08T18:31:50.627 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001562031 2024-05-08T18:31:50.627 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.627 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.627 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:50.627 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.855222+0000", 2024-05-08T18:31:50.627 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4823e-05 2024-05-08T18:31:50.627 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.627 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.628 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:50.628 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.855232+0000", 2024-05-08T18:31:50.628 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0033e-05 2024-05-08T18:31:50.628 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.628 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.628 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:50.628 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.855307+0000", 2024-05-08T18:31:50.628 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.4358999999999997e-05 2024-05-08T18:31:50.628 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.628 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.628 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:50.628 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.855525+0000", 2024-05-08T18:31:50.628 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021857300000000001 2024-05-08T18:31:50.628 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.629 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.629 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:50.629 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.855699+0000", 2024-05-08T18:31:50.629 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00017360100000000001 2024-05-08T18:31:50.629 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.629 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.629 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:50.629 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.866057+0000", 2024-05-08T18:31:50.629 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010357847 2024-05-08T18:31:50.629 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.629 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.629 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:50.629 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.866741+0000", 2024-05-08T18:31:50.629 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00068395800000000003 2024-05-08T18:31:50.630 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.630 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.630 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:50.630 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.866806+0000", 2024-05-08T18:31:50.630 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5660999999999994e-05 2024-05-08T18:31:50.630 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.630 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.630 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:50.630 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.866860+0000", 2024-05-08T18:31:50.630 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3619000000000003e-05 2024-05-08T18:31:50.630 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:50.630 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:50.630 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:50.630 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.630 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.631 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1367 3.3e 3:7d67f190:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_53:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:50.631 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.883854+0000", 2024-05-08T18:31:50.631 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 7.6789002100000001, 2024-05-08T18:31:50.631 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.013212130000000001, 2024-05-08T18:31:50.631 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:50.631 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:50.631 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:50.631 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:50.631 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:50.631 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:50.631 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1367 2024-05-08T18:31:50.631 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.631 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:50.631 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.632 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:50.632 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.883854+0000", 2024-05-08T18:31:50.632 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:50.632 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.632 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.632 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:50.632 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.883854+0000", 2024-05-08T18:31:50.632 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:50.632 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.632 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.632 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:50.632 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.883856+0000", 2024-05-08T18:31:50.632 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3929999999999998e-06 2024-05-08T18:31:50.632 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.632 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.633 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:50.633 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.885471+0000", 2024-05-08T18:31:50.633 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001615079 2024-05-08T18:31:50.633 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.633 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.633 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:50.633 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.885496+0000", 2024-05-08T18:31:50.633 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5142000000000001e-05 2024-05-08T18:31:50.633 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.633 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.633 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:50.633 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.885507+0000", 2024-05-08T18:31:50.633 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0538e-05 2024-05-08T18:31:50.633 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.634 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.634 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:50.634 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.885587+0000", 2024-05-08T18:31:50.634 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.0266999999999996e-05 2024-05-08T18:31:50.634 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.634 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.634 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:50.634 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.885737+0000", 2024-05-08T18:31:50.634 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015008999999999999 2024-05-08T18:31:50.634 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.634 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.634 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:50.634 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.885870+0000", 2024-05-08T18:31:50.634 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000132507 2024-05-08T18:31:50.635 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.635 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.635 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:50.635 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.896651+0000", 2024-05-08T18:31:50.635 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010781570000000001 2024-05-08T18:31:50.635 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.635 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.635 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:50.635 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.896965+0000", 2024-05-08T18:31:50.635 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00031394399999999997 2024-05-08T18:31:50.635 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.635 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.635 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:50.635 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.897021+0000", 2024-05-08T18:31:50.636 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6198e-05 2024-05-08T18:31:50.636 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.636 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.636 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:50.636 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.897066+0000", 2024-05-08T18:31:50.636 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4401999999999999e-05 2024-05-08T18:31:50.636 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:50.636 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:50.636 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:50.636 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.636 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.636 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1371 3.19 3:9bd55f7b:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_57:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:50.636 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.925956+0000", 2024-05-08T18:31:50.636 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 7.6367984, 2024-05-08T18:31:50.637 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.020098687, 2024-05-08T18:31:50.637 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:50.637 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:50.637 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:50.637 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:50.637 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:50.637 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:50.637 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1371 2024-05-08T18:31:50.637 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.637 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:50.637 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.637 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:50.637 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.925956+0000", 2024-05-08T18:31:50.637 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:50.638 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.638 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.638 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:50.638 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.925956+0000", 2024-05-08T18:31:50.638 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:50.638 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.638 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.638 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:50.638 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.925958+0000", 2024-05-08T18:31:50.638 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3939999999999999e-06 2024-05-08T18:31:50.638 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.638 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.638 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:50.638 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.927928+0000", 2024-05-08T18:31:50.639 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0019701779999999999 2024-05-08T18:31:50.639 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.639 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.639 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:50.639 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.927964+0000", 2024-05-08T18:31:50.639 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6226999999999997e-05 2024-05-08T18:31:50.639 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.639 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.639 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:50.639 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.927984+0000", 2024-05-08T18:31:50.639 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9647999999999999e-05 2024-05-08T18:31:50.639 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.639 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.639 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:50.640 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.928065+0000", 2024-05-08T18:31:50.640 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.1379999999999997e-05 2024-05-08T18:31:50.640 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.640 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.640 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:50.640 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.928171+0000", 2024-05-08T18:31:50.640 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000105618 2024-05-08T18:31:50.640 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.640 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.640 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:50.640 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.928283+0000", 2024-05-08T18:31:50.640 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000111733 2024-05-08T18:31:50.640 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.640 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.640 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:50.641 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.942089+0000", 2024-05-08T18:31:50.641 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.013805817999999999 2024-05-08T18:31:50.641 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.641 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.641 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:50.641 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.945982+0000", 2024-05-08T18:31:50.641 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0038930129999999999 2024-05-08T18:31:50.641 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.641 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.641 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:50.641 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.946022+0000", 2024-05-08T18:31:50.641 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0224e-05 2024-05-08T18:31:50.641 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.641 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.641 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:50.642 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.946054+0000", 2024-05-08T18:31:50.642 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2453999999999998e-05 2024-05-08T18:31:50.642 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:50.642 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:50.642 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:50.642 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.642 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.642 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1374 3.19 3:9a2ca5a0:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_60:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:50.642 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.956999+0000", 2024-05-08T18:31:50.642 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 7.6057551629999995, 2024-05-08T18:31:50.642 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011439477, 2024-05-08T18:31:50.642 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:50.642 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:50.642 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:50.643 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:50.643 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:50.643 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:50.643 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1374 2024-05-08T18:31:50.643 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.643 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:50.643 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.643 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:50.643 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.956999+0000", 2024-05-08T18:31:50.643 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:50.643 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.643 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.643 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:50.643 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.956999+0000", 2024-05-08T18:31:50.644 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:50.644 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.644 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.644 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:50.644 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.957002+0000", 2024-05-08T18:31:50.644 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8219999999999998e-06 2024-05-08T18:31:50.644 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.644 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.644 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:50.644 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.958268+0000", 2024-05-08T18:31:50.644 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012660799999999999 2024-05-08T18:31:50.644 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.644 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.644 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:50.644 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.958295+0000", 2024-05-08T18:31:50.645 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7438999999999999e-05 2024-05-08T18:31:50.645 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.645 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.645 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:50.645 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.958310+0000", 2024-05-08T18:31:50.645 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4635e-05 2024-05-08T18:31:50.645 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.645 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.645 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:50.645 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.958371+0000", 2024-05-08T18:31:50.645 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1583999999999999e-05 2024-05-08T18:31:50.645 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.645 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.645 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:50.645 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.958515+0000", 2024-05-08T18:31:50.646 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014339600000000001 2024-05-08T18:31:50.646 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.646 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.646 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:50.646 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.958643+0000", 2024-05-08T18:31:50.646 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012828699999999999 2024-05-08T18:31:50.646 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.646 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.646 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:50.646 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.966167+0000", 2024-05-08T18:31:50.646 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0075240250000000002 2024-05-08T18:31:50.646 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.646 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.647 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:50.647 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.968328+0000", 2024-05-08T18:31:50.647 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002160777 2024-05-08T18:31:50.647 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.647 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.647 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:50.647 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.968381+0000", 2024-05-08T18:31:50.647 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3538999999999997e-05 2024-05-08T18:31:50.647 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.647 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.647 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:50.647 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.968438+0000", 2024-05-08T18:31:50.647 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6892999999999999e-05 2024-05-08T18:31:50.647 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:50.647 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:50.648 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:50.648 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.648 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.648 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1378 3.31 3:8cc8fed9:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_64:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:50.648 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:43.012136+0000", 2024-05-08T18:31:50.648 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 7.5506181659999996, 2024-05-08T18:31:50.648 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.015872313999999998, 2024-05-08T18:31:50.648 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:50.648 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:50.648 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:50.648 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:50.648 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:50.648 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:50.648 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1378 2024-05-08T18:31:50.649 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.649 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:50.649 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.649 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:50.649 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.012136+0000", 2024-05-08T18:31:50.649 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:50.649 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.649 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.649 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:50.649 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.012136+0000", 2024-05-08T18:31:50.649 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:50.649 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.649 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.649 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:50.650 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.012139+0000", 2024-05-08T18:31:50.650 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4340000000000001e-06 2024-05-08T18:31:50.650 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.650 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.650 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:50.650 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.013630+0000", 2024-05-08T18:31:50.650 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001491081 2024-05-08T18:31:50.650 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.650 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.650 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:50.650 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.013668+0000", 2024-05-08T18:31:50.650 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8155000000000003e-05 2024-05-08T18:31:50.650 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.650 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.651 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:50.651 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.013687+0000", 2024-05-08T18:31:50.651 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8581e-05 2024-05-08T18:31:50.651 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.651 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.651 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:50.651 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.013786+0000", 2024-05-08T18:31:50.651 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.9242999999999998e-05 2024-05-08T18:31:50.651 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.651 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.651 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:50.651 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.013977+0000", 2024-05-08T18:31:50.651 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00019064400000000001 2024-05-08T18:31:50.651 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.651 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.652 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:31:50.652 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.014136+0000", 2024-05-08T18:31:50.652 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000159223 2024-05-08T18:31:50.652 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.652 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.652 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:50.652 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.021030+0000", 2024-05-08T18:31:50.652 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0068940319999999996 2024-05-08T18:31:50.652 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.652 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.652 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:50.652 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.027799+0000", 2024-05-08T18:31:50.652 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00676868 2024-05-08T18:31:50.652 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.652 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.653 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:50.653 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.027917+0000", 2024-05-08T18:31:50.653 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011818400000000001 2024-05-08T18:31:50.653 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.653 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.653 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:50.653 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.028008+0000", 2024-05-08T18:31:50.653 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.1057000000000006e-05 2024-05-08T18:31:50.653 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:50.653 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:50.653 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:50.653 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.653 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.653 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1380 3.3e 3:7d684d22:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_66:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:50.654 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:43.041619+0000", 2024-05-08T18:31:50.654 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 7.5211347819999999, 2024-05-08T18:31:50.654 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012536192, 2024-05-08T18:31:50.654 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:50.654 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:50.654 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:50.654 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:50.654 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:50.654 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:50.654 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1380 2024-05-08T18:31:50.654 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.654 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:50.654 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.654 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:50.654 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.041619+0000", 2024-05-08T18:31:50.655 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:50.655 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.655 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.655 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:50.655 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.041619+0000", 2024-05-08T18:31:50.655 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:50.655 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.655 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.655 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:50.655 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.041621+0000", 2024-05-08T18:31:50.655 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3159999999999999e-06 2024-05-08T18:31:50.655 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.655 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.655 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:50.656 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.043213+0000", 2024-05-08T18:31:50.656 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0015913870000000001 2024-05-08T18:31:50.657 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.657 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.657 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:50.657 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.043238+0000", 2024-05-08T18:31:50.657 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5575000000000002e-05 2024-05-08T18:31:50.657 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.657 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.657 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:50.658 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.043249+0000", 2024-05-08T18:31:50.658 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0936e-05 2024-05-08T18:31:50.658 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.658 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.658 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:50.658 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.043335+0000", 2024-05-08T18:31:50.658 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5796000000000003e-05 2024-05-08T18:31:50.658 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.658 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.658 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:50.658 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.043524+0000", 2024-05-08T18:31:50.658 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00018895300000000001 2024-05-08T18:31:50.658 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.658 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.659 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:50.659 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.043704+0000", 2024-05-08T18:31:50.659 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00017979399999999999 2024-05-08T18:31:50.659 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.659 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.659 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:50.659 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.053711+0000", 2024-05-08T18:31:50.659 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010006694999999999 2024-05-08T18:31:50.659 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.659 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.659 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:50.659 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.054084+0000", 2024-05-08T18:31:50.659 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00037332899999999999 2024-05-08T18:31:50.659 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.660 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.660 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:50.660 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.054122+0000", 2024-05-08T18:31:50.660 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8430000000000003e-05 2024-05-08T18:31:50.660 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.660 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.660 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:50.660 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.054155+0000", 2024-05-08T18:31:50.660 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2981000000000002e-05 2024-05-08T18:31:50.660 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:50.660 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:50.660 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:50.660 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.660 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.660 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1385 3.1a e82/21 3:5abdd61d:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_71:head v 82'2, mlcod=0'0)", 2024-05-08T18:31:50.661 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:43.111067+0000", 2024-05-08T18:31:50.661 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 7.451687089, 2024-05-08T18:31:50.661 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.013230812999999999, 2024-05-08T18:31:50.661 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:50.661 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:50.661 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:50.661 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:50.661 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.661 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:50.661 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.111067+0000", 2024-05-08T18:31:50.661 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:50.661 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.661 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.661 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:50.662 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.111067+0000", 2024-05-08T18:31:50.662 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:50.662 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.662 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.662 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:50.662 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.111068+0000", 2024-05-08T18:31:50.662 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.485e-06 2024-05-08T18:31:50.662 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.662 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.662 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:50.662 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.116689+0000", 2024-05-08T18:31:50.662 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0056206010000000002 2024-05-08T18:31:50.662 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.662 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.663 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:50.663 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.116711+0000", 2024-05-08T18:31:50.663 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1725999999999998e-05 2024-05-08T18:31:50.663 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.663 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.663 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:50.663 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.116723+0000", 2024-05-08T18:31:50.663 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2343e-05 2024-05-08T18:31:50.663 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.663 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.663 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:50.663 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.116827+0000", 2024-05-08T18:31:50.663 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000103744 2024-05-08T18:31:50.663 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.664 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.664 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:50.664 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.116867+0000", 2024-05-08T18:31:50.664 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0518000000000001e-05 2024-05-08T18:31:50.664 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.664 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.664 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:50.664 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.124236+0000", 2024-05-08T18:31:50.664 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0073690980000000001 2024-05-08T18:31:50.664 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.664 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.664 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:50.664 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.124298+0000", 2024-05-08T18:31:50.664 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1297999999999995e-05 2024-05-08T18:31:50.664 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:50.665 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:50.665 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:50.665 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.665 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.665 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1390 3.0 3:00a67f20:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_76:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:50.665 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:43.173995+0000", 2024-05-08T18:31:50.665 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 7.3887589250000003, 2024-05-08T18:31:50.665 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.014872183000000001, 2024-05-08T18:31:50.665 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:50.665 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:50.665 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:50.665 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:50.665 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:50.665 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:50.666 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1390 2024-05-08T18:31:50.666 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.666 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:50.666 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.666 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:50.666 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.173995+0000", 2024-05-08T18:31:50.666 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:50.666 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.666 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.666 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:50.666 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.173995+0000", 2024-05-08T18:31:50.666 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:50.666 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.666 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.667 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:50.667 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.173998+0000", 2024-05-08T18:31:50.667 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9390000000000002e-06 2024-05-08T18:31:50.667 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.667 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.667 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:50.667 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.175751+0000", 2024-05-08T18:31:50.667 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0017533360000000001 2024-05-08T18:31:50.667 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.667 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.667 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:50.667 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.175789+0000", 2024-05-08T18:31:50.667 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7991000000000003e-05 2024-05-08T18:31:50.667 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.668 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.668 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:50.668 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.175810+0000", 2024-05-08T18:31:50.668 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1228000000000001e-05 2024-05-08T18:31:50.668 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.668 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.668 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:50.668 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.175888+0000", 2024-05-08T18:31:50.668 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7288999999999998e-05 2024-05-08T18:31:50.668 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.668 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.668 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:50.668 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.176042+0000", 2024-05-08T18:31:50.668 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000154437 2024-05-08T18:31:50.668 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.669 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.669 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-05-08T18:31:50.669 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.176163+0000", 2024-05-08T18:31:50.669 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000120306 2024-05-08T18:31:50.669 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.669 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.669 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:50.669 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.187621+0000", 2024-05-08T18:31:50.669 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011458034000000001 2024-05-08T18:31:50.669 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.669 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.669 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:50.669 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.188751+0000", 2024-05-08T18:31:50.669 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0011302020000000001 2024-05-08T18:31:50.670 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.670 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.670 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:50.670 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.188815+0000", 2024-05-08T18:31:50.670 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3918999999999996e-05 2024-05-08T18:31:50.670 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.670 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.670 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:50.670 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.188867+0000", 2024-05-08T18:31:50.670 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.2502e-05 2024-05-08T18:31:50.670 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:50.670 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:50.670 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:50.670 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.670 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.671 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1397 3.31 3:8def190d:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_83:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:50.671 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:43.244469+0000", 2024-05-08T18:31:50.671 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 7.3182852609999998, 2024-05-08T18:31:50.671 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012102296, 2024-05-08T18:31:50.671 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:50.671 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:50.671 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:50.671 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:50.671 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:50.671 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:50.671 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1397 2024-05-08T18:31:50.671 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.671 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:50.671 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.671 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:50.672 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.244469+0000", 2024-05-08T18:31:50.672 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:50.672 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.672 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.672 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:50.672 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.244469+0000", 2024-05-08T18:31:50.672 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:50.672 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.672 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.672 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:50.672 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.244472+0000", 2024-05-08T18:31:50.672 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8210000000000003e-06 2024-05-08T18:31:50.672 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.673 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.673 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:50.673 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.246032+0000", 2024-05-08T18:31:50.673 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0015596029999999999 2024-05-08T18:31:50.673 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.673 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.673 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:50.673 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.246057+0000", 2024-05-08T18:31:50.673 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4519e-05 2024-05-08T18:31:50.673 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.673 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.673 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:50.673 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.246066+0000", 2024-05-08T18:31:50.673 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.8689999999999999e-06 2024-05-08T18:31:50.673 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.674 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.674 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:50.674 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.246152+0000", 2024-05-08T18:31:50.674 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5659000000000001e-05 2024-05-08T18:31:50.674 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.674 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.674 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:50.674 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.246317+0000", 2024-05-08T18:31:50.674 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000164971 2024-05-08T18:31:50.674 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.674 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.674 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:31:50.675 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.246470+0000", 2024-05-08T18:31:50.675 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000152738 2024-05-08T18:31:50.675 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.675 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.675 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:50.675 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.251017+0000", 2024-05-08T18:31:50.675 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0045468440000000004 2024-05-08T18:31:50.675 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.675 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.675 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:50.675 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.256479+0000", 2024-05-08T18:31:50.675 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0054620989999999998 2024-05-08T18:31:50.675 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.675 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.676 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:50.676 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.256520+0000", 2024-05-08T18:31:50.676 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.1561999999999999e-05 2024-05-08T18:31:50.676 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.676 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.676 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:50.676 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.256571+0000", 2024-05-08T18:31:50.676 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.0611e-05 2024-05-08T18:31:50.676 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:50.676 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:50.676 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:50.676 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.676 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.676 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1404 3.25 3:a4d3268f:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_90:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:50.676 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:43.312775+0000", 2024-05-08T18:31:50.677 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 7.249979046, 2024-05-08T18:31:50.677 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012465034, 2024-05-08T18:31:50.677 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:50.677 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:50.677 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:50.677 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:50.677 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:50.677 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:50.677 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1404 2024-05-08T18:31:50.677 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.677 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:50.677 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.677 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:50.677 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.312775+0000", 2024-05-08T18:31:50.678 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:50.678 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.678 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.678 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:50.678 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.312775+0000", 2024-05-08T18:31:50.678 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:50.678 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.678 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.678 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:50.678 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.312777+0000", 2024-05-08T18:31:50.678 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4219999999999999e-06 2024-05-08T18:31:50.678 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.678 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.678 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:50.679 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.314626+0000", 2024-05-08T18:31:50.679 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0018485039999999999 2024-05-08T18:31:50.679 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.679 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.679 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:50.679 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.314651+0000", 2024-05-08T18:31:50.679 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5085000000000001e-05 2024-05-08T18:31:50.679 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.679 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.679 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:50.679 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.314663+0000", 2024-05-08T18:31:50.679 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2514000000000001e-05 2024-05-08T18:31:50.679 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.679 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.680 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:50.680 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.314741+0000", 2024-05-08T18:31:50.680 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7825999999999997e-05 2024-05-08T18:31:50.680 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.680 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.680 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:50.680 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.314877+0000", 2024-05-08T18:31:50.680 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013528100000000001 2024-05-08T18:31:50.680 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.680 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.680 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-05-08T18:31:50.680 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.314979+0000", 2024-05-08T18:31:50.680 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000102897 2024-05-08T18:31:50.680 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.681 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.681 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:50.681 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.324390+0000", 2024-05-08T18:31:50.681 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0094105579999999994 2024-05-08T18:31:50.681 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.681 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.681 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:50.681 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.325118+0000", 2024-05-08T18:31:50.681 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00072824399999999996 2024-05-08T18:31:50.681 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.681 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.681 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:50.681 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.325187+0000", 2024-05-08T18:31:50.681 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8325999999999996e-05 2024-05-08T18:31:50.681 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.682 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.682 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:50.682 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.325240+0000", 2024-05-08T18:31:50.682 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3377000000000001e-05 2024-05-08T18:31:50.682 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:50.682 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:50.682 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:50.682 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.682 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.682 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1628 3.19 3:9bf7ecec:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-05-08T18:31:50.682 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:46.861184+0000", 2024-05-08T18:31:50.682 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 3.701570255, 2024-05-08T18:31:50.682 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.017287249000000001, 2024-05-08T18:31:50.682 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:50.683 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:50.683 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:50.683 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:50.683 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:50.683 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:50.683 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1628 2024-05-08T18:31:50.683 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.683 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:50.683 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.683 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:50.683 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.861184+0000", 2024-05-08T18:31:50.683 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:50.683 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.683 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.683 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:50.684 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.861184+0000", 2024-05-08T18:31:50.684 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:50.684 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.684 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.684 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:50.684 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.861186+0000", 2024-05-08T18:31:50.684 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5550000000000001e-06 2024-05-08T18:31:50.684 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.684 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.684 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:50.684 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.863295+0000", 2024-05-08T18:31:50.684 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002108604 2024-05-08T18:31:50.684 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.684 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.685 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:50.685 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.863321+0000", 2024-05-08T18:31:50.685 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6143e-05 2024-05-08T18:31:50.685 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.685 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.685 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:50.685 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.863332+0000", 2024-05-08T18:31:50.685 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.147e-05 2024-05-08T18:31:50.685 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.685 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.685 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:50.685 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.863466+0000", 2024-05-08T18:31:50.685 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013374799999999999 2024-05-08T18:31:50.685 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.685 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.686 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:50.686 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.863785+0000", 2024-05-08T18:31:50.686 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00031887099999999998 2024-05-08T18:31:50.686 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.686 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.686 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:50.686 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.864102+0000", 2024-05-08T18:31:50.686 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00031737099999999999 2024-05-08T18:31:50.686 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.686 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.686 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:50.686 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.876722+0000", 2024-05-08T18:31:50.686 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0126193 2024-05-08T18:31:50.686 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.687 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.687 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:50.687 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.878213+0000", 2024-05-08T18:31:50.687 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001491755 2024-05-08T18:31:50.687 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.687 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.687 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:50.687 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.878361+0000", 2024-05-08T18:31:50.687 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000147033 2024-05-08T18:31:50.687 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.687 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.687 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:50.687 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.878471+0000", 2024-05-08T18:31:50.687 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000110399 2024-05-08T18:31:50.688 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:50.688 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:50.688 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:50.688 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:50.688 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:50.688 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:50.688 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-08T18:31:50.690 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-08T18:31:50.690 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:31:50.689+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:31:50.736 INFO:tasks.workunit.client.0.smithi097.stdout:user 0.626361150601046 deleted 2024-05-08T18:31:50.791 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:31:50.789+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:31:50.844 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-05-08T18:31:50.845 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-05-08T18:31:50.848 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:50.848 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-05-08T18:31:50.848 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.848 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.5429.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94084838826720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-08T18:31:50.849 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:50.848528+0000", 2024-05-08T18:31:50.849 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.0016114600000000001, 2024-05-08T18:31:50.849 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001628993, 2024-05-08T18:31:50.849 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:50.849 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:50.849 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "waiting for sub ops", 2024-05-08T18:31:50.849 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:50.849 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.5429", 2024-05-08T18:31:50.849 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/1057442005", 2024-05-08T18:31:50.849 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 51 2024-05-08T18:31:50.849 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.849 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:50.849 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.849 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:50.850 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:50.848528+0000", 2024-05-08T18:31:50.850 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:50.850 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.850 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.850 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:50.850 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:50.848528+0000", 2024-05-08T18:31:50.850 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:50.850 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.850 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.850 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:50.850 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:50.848529+0000", 2024-05-08T18:31:50.850 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0109999999999999e-06 2024-05-08T18:31:50.850 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.851 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.851 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:50.851 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:50.848534+0000", 2024-05-08T18:31:50.851 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7400000000000004e-06 2024-05-08T18:31:50.851 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.851 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.851 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:50.851 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:50.848548+0000", 2024-05-08T18:31:50.851 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3763e-05 2024-05-08T18:31:50.851 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.851 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.851 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:50.851 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:50.848555+0000", 2024-05-08T18:31:50.851 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.622e-06 2024-05-08T18:31:50.852 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.852 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.852 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:50.852 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:50.848599+0000", 2024-05-08T18:31:50.852 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3282999999999999e-05 2024-05-08T18:31:50.852 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.852 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.853 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:50.853 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:50.848641+0000", 2024-05-08T18:31:50.853 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.2137e-05 2024-05-08T18:31:50.853 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.853 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.853 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:50.853 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:50.848726+0000", 2024-05-08T18:31:50.853 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5065e-05 2024-05-08T18:31:50.853 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.853 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.853 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:50.853 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:50.849113+0000", 2024-05-08T18:31:50.854 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00038770500000000002 2024-05-08T18:31:50.854 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.854 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.854 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:50.854 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:50.850128+0000", 2024-05-08T18:31:50.854 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0010144100000000001 2024-05-08T18:31:50.854 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:50.854 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:50.854 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:50.854 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.854 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.854 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop_reply(client.5429.0:51 7.e e84/29 ondisk, result = 0)", 2024-05-08T18:31:50.854 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:50.850009+0000", 2024-05-08T18:31:50.854 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.00013088800000000001, 2024-05-08T18:31:50.855 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00020132099999999999, 2024-05-08T18:31:50.855 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:50.855 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:50.855 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-05-08T18:31:50.855 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:50.855 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.855 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:50.855 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:50.850009+0000", 2024-05-08T18:31:50.855 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:50.855 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.855 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.855 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:50.855 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:50.850009+0000", 2024-05-08T18:31:50.855 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:50.856 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.856 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.856 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:50.856 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:50.850010+0000", 2024-05-08T18:31:50.856 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7599999999999996e-07 2024-05-08T18:31:50.856 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.856 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.856 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:50.856 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:50.850014+0000", 2024-05-08T18:31:50.856 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5469999999999998e-06 2024-05-08T18:31:50.856 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.856 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.856 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:50.856 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:50.850027+0000", 2024-05-08T18:31:50.857 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3266e-05 2024-05-08T18:31:50.857 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.857 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.857 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:50.857 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:50.850034+0000", 2024-05-08T18:31:50.857 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.0759999999999997e-06 2024-05-08T18:31:50.857 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.857 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.857 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:50.857 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:50.850112+0000", 2024-05-08T18:31:50.857 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7372000000000004e-05 2024-05-08T18:31:50.857 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:50.857 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:50.858 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:50.858 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:50.850121+0000", 2024-05-08T18:31:50.858 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0690000000000008e-06 2024-05-08T18:31:50.858 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:50.858 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:50.858 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:50.858 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:50.858 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2024-05-08T18:31:50.858 INFO:teuthology.orchestra.run.smithi097.stdout: "num_ops": 2 2024-05-08T18:31:50.858 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:50.869 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-08T18:31:50.892 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:31:50.890+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:31:50.917 INFO:tasks.workunit.client.0.smithi097.stdout:Bucket Created: buck_2024_04_8_18_31_50 2024-05-08T18:31:50.993 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:31:50.993+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:31:51.034 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:51.035 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:31:51.035 INFO:teuthology.orchestra.run.smithi097.stdout: "complaint_time": 30, 2024-05-08T18:31:51.035 INFO:teuthology.orchestra.run.smithi097.stdout: "num_blocked_ops": 0 2024-05-08T18:31:51.035 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:51.048 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-08T18:31:51.094 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:31:51.090+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:31:51.194 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:31:51.194+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:31:51.204 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:51.204 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2024-05-08T18:31:51.204 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2024-05-08T18:31:51.204 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-05-08T18:31:51.204 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.204 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1316 3.0 e81/21 3:03a68e79:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_2:head v 81'1, mlcod=0'0)", 2024-05-08T18:31:51.204 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.318330+0000", 2024-05-08T18:31:51.204 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 8.8847685799999994, 2024-05-08T18:31:51.204 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.015176533000000001, 2024-05-08T18:31:51.204 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:51.205 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:51.205 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:51.205 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:51.205 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.205 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:51.205 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.318330+0000", 2024-05-08T18:31:51.205 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:51.205 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.205 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.205 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:51.205 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.318330+0000", 2024-05-08T18:31:51.205 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:51.205 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.206 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.206 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:51.206 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.318333+0000", 2024-05-08T18:31:51.206 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9629999999999998e-06 2024-05-08T18:31:51.206 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.206 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.206 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:51.206 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.323328+0000", 2024-05-08T18:31:51.206 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.004995172 2024-05-08T18:31:51.206 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.206 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.206 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:51.206 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.323366+0000", 2024-05-08T18:31:51.207 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7837999999999999e-05 2024-05-08T18:31:51.207 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.207 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.207 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:51.207 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.323391+0000", 2024-05-08T18:31:51.207 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4913e-05 2024-05-08T18:31:51.207 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.207 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.207 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:51.207 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.323520+0000", 2024-05-08T18:31:51.207 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000129238 2024-05-08T18:31:51.207 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.207 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.207 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:51.208 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.323546+0000", 2024-05-08T18:31:51.208 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5508999999999999e-05 2024-05-08T18:31:51.208 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.208 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.208 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:51.208 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.333439+0000", 2024-05-08T18:31:51.208 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0098928169999999999 2024-05-08T18:31:51.208 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.208 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.208 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:51.208 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.333507+0000", 2024-05-08T18:31:51.208 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8083000000000005e-05 2024-05-08T18:31:51.208 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:51.209 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:51.209 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:51.209 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.209 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.209 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1317 3.2d e81/21 3:b70e9396:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_3:head v 81'1, mlcod=0'0)", 2024-05-08T18:31:51.209 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.331170+0000", 2024-05-08T18:31:51.209 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 8.8719283109999996, 2024-05-08T18:31:51.209 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019680382, 2024-05-08T18:31:51.209 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:51.209 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:51.209 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:51.209 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:51.209 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.210 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:51.210 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.331170+0000", 2024-05-08T18:31:51.210 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:51.210 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.210 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.210 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:51.210 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.331170+0000", 2024-05-08T18:31:51.210 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:51.210 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.210 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.210 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:51.211 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.331172+0000", 2024-05-08T18:31:51.211 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.933e-06 2024-05-08T18:31:51.211 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.211 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.211 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:51.211 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.341697+0000", 2024-05-08T18:31:51.211 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010524759999999999 2024-05-08T18:31:51.211 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.211 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.211 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:51.211 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.341753+0000", 2024-05-08T18:31:51.211 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5828000000000001e-05 2024-05-08T18:31:51.211 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.212 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.212 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:51.212 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.341776+0000", 2024-05-08T18:31:51.212 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3379000000000001e-05 2024-05-08T18:31:51.212 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.212 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.212 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:51.212 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.341871+0000", 2024-05-08T18:31:51.212 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.4307000000000004e-05 2024-05-08T18:31:51.212 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.212 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.212 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:51.212 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.341895+0000", 2024-05-08T18:31:51.213 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4629000000000001e-05 2024-05-08T18:31:51.213 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.213 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.213 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:51.213 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.350793+0000", 2024-05-08T18:31:51.213 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0088981219999999996 2024-05-08T18:31:51.213 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.213 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.213 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:51.213 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.350851+0000", 2024-05-08T18:31:51.213 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7423999999999998e-05 2024-05-08T18:31:51.213 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:51.213 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:51.214 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:51.214 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.214 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.214 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1325 3.2d e81/21 3:b7fa4974:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_11:head v 81'2, mlcod=0'0)", 2024-05-08T18:31:51.214 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.444803+0000", 2024-05-08T18:31:51.214 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 8.7582954290000004, 2024-05-08T18:31:51.214 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012603454, 2024-05-08T18:31:51.214 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:51.214 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:51.214 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:51.214 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:51.214 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.215 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:51.215 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.444803+0000", 2024-05-08T18:31:51.215 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:51.215 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.215 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.215 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:51.215 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.444803+0000", 2024-05-08T18:31:51.215 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:51.215 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.215 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.215 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:51.215 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.444805+0000", 2024-05-08T18:31:51.215 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.782e-06 2024-05-08T18:31:51.216 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.216 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.216 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:51.216 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.448805+0000", 2024-05-08T18:31:51.216 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0040002859999999996 2024-05-08T18:31:51.216 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.216 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.216 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:51.216 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.448828+0000", 2024-05-08T18:31:51.216 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2748e-05 2024-05-08T18:31:51.216 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.216 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.216 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:51.217 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.448841+0000", 2024-05-08T18:31:51.217 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2456000000000001e-05 2024-05-08T18:31:51.217 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.217 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.217 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:51.217 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.448917+0000", 2024-05-08T18:31:51.217 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6643000000000005e-05 2024-05-08T18:31:51.217 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.217 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.217 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:51.217 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.448945+0000", 2024-05-08T18:31:51.217 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7656000000000001e-05 2024-05-08T18:31:51.218 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.218 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.218 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:51.218 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.457322+0000", 2024-05-08T18:31:51.218 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0083770990000000007 2024-05-08T18:31:51.218 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.218 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.218 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:51.218 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.457407+0000", 2024-05-08T18:31:51.218 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.4783999999999993e-05 2024-05-08T18:31:51.218 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:51.218 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:51.218 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:51.219 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.219 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.219 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1329 3.21 3:87d2ef9d:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-08T18:31:51.219 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.483324+0000", 2024-05-08T18:31:51.219 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 8.7197745060000003, 2024-05-08T18:31:51.219 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.020245062000000001, 2024-05-08T18:31:51.219 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:51.219 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:51.219 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:51.219 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:51.219 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:51.219 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:51.220 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1329 2024-05-08T18:31:51.220 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.220 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:51.220 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.220 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:51.220 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.483324+0000", 2024-05-08T18:31:51.220 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:51.220 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.220 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.220 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:51.220 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.483324+0000", 2024-05-08T18:31:51.220 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:51.220 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.221 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.221 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:51.221 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.483328+0000", 2024-05-08T18:31:51.221 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3160000000000001e-06 2024-05-08T18:31:51.221 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.221 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.221 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:51.221 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.484909+0000", 2024-05-08T18:31:51.221 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001581325 2024-05-08T18:31:51.221 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.221 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.221 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:51.221 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.484935+0000", 2024-05-08T18:31:51.222 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5746999999999999e-05 2024-05-08T18:31:51.222 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.222 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.222 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:51.222 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.484945+0000", 2024-05-08T18:31:51.222 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0827e-05 2024-05-08T18:31:51.222 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.222 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.222 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:51.222 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.485031+0000", 2024-05-08T18:31:51.222 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5811999999999998e-05 2024-05-08T18:31:51.222 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.222 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.223 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:51.223 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.485229+0000", 2024-05-08T18:31:51.223 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00019749000000000001 2024-05-08T18:31:51.223 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.223 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.223 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:51.223 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.485390+0000", 2024-05-08T18:31:51.223 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000161058 2024-05-08T18:31:51.223 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.223 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.223 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:51.223 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.492144+0000", 2024-05-08T18:31:51.223 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0067546109999999998 2024-05-08T18:31:51.224 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.224 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.224 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:51.224 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.503464+0000", 2024-05-08T18:31:51.224 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011319997 2024-05-08T18:31:51.224 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.224 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.224 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:51.224 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.503515+0000", 2024-05-08T18:31:51.224 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.0132e-05 2024-05-08T18:31:51.224 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.224 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.224 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:51.225 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.503569+0000", 2024-05-08T18:31:51.225 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4747000000000003e-05 2024-05-08T18:31:51.225 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:51.225 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:51.225 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:51.225 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.225 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.225 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1341 3.5 3:a0d72baa:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_27:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:51.225 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.613380+0000", 2024-05-08T18:31:51.225 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 8.5897190850000005, 2024-05-08T18:31:51.225 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.016698074, 2024-05-08T18:31:51.225 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:51.225 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:51.225 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:51.226 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:51.226 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:51.226 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:51.226 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1341 2024-05-08T18:31:51.226 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.226 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:51.226 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.226 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:51.226 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.613380+0000", 2024-05-08T18:31:51.226 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:51.226 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.226 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.226 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:51.227 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.613380+0000", 2024-05-08T18:31:51.227 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:51.227 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.227 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.227 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:51.227 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.613382+0000", 2024-05-08T18:31:51.227 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5979999999999999e-06 2024-05-08T18:31:51.227 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.227 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.227 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:51.227 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.615142+0000", 2024-05-08T18:31:51.227 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0017599040000000001 2024-05-08T18:31:51.227 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.228 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.228 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:51.228 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.615174+0000", 2024-05-08T18:31:51.228 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1458000000000003e-05 2024-05-08T18:31:51.228 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.228 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.228 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:51.228 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.615189+0000", 2024-05-08T18:31:51.228 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5809000000000001e-05 2024-05-08T18:31:51.228 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.228 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.228 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:51.228 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.615267+0000", 2024-05-08T18:31:51.228 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7898999999999994e-05 2024-05-08T18:31:51.229 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.229 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.229 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:51.229 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.615393+0000", 2024-05-08T18:31:51.229 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012611999999999999 2024-05-08T18:31:51.229 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.229 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.229 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:51.229 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.615500+0000", 2024-05-08T18:31:51.229 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010621899999999999 2024-05-08T18:31:51.229 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.229 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.229 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:51.230 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.627687+0000", 2024-05-08T18:31:51.230 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012186936000000001 2024-05-08T18:31:51.230 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.230 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.230 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:51.230 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.629963+0000", 2024-05-08T18:31:51.230 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0022760160000000001 2024-05-08T18:31:51.230 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.230 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.230 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:51.230 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.630025+0000", 2024-05-08T18:31:51.230 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.2409999999999994e-05 2024-05-08T18:31:51.230 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.231 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.231 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:51.231 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.630078+0000", 2024-05-08T18:31:51.231 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.2704999999999998e-05 2024-05-08T18:31:51.231 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:51.231 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:51.231 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:51.231 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.231 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.231 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1343 3.39 3:9f4e1e83:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_29:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:51.231 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.634194+0000", 2024-05-08T18:31:51.231 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 8.5689047459999994, 2024-05-08T18:31:51.231 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.014278074999999999, 2024-05-08T18:31:51.231 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:51.232 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:51.232 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:51.232 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:51.232 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:51.232 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:51.232 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1343 2024-05-08T18:31:51.232 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.232 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:51.232 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.232 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:51.232 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.634194+0000", 2024-05-08T18:31:51.232 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:51.232 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.232 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.233 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:51.233 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.634194+0000", 2024-05-08T18:31:51.233 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:51.233 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.233 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.233 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:51.233 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.634197+0000", 2024-05-08T18:31:51.233 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0620000000000001e-06 2024-05-08T18:31:51.233 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.233 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.233 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:51.233 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.635963+0000", 2024-05-08T18:31:51.233 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001766098 2024-05-08T18:31:51.234 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.234 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.234 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:51.234 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.635987+0000", 2024-05-08T18:31:51.234 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3360999999999999e-05 2024-05-08T18:31:51.234 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.234 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.235 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:51.235 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.635998+0000", 2024-05-08T18:31:51.235 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1284000000000001e-05 2024-05-08T18:31:51.235 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.235 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.235 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:51.235 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.636079+0000", 2024-05-08T18:31:51.235 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.1493000000000001e-05 2024-05-08T18:31:51.235 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.235 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.236 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:51.236 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.636262+0000", 2024-05-08T18:31:51.236 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00018223999999999999 2024-05-08T18:31:51.236 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.236 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.236 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:51.236 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.636417+0000", 2024-05-08T18:31:51.236 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015549699999999999 2024-05-08T18:31:51.236 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.236 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.236 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:51.237 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.648058+0000", 2024-05-08T18:31:51.237 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011640908 2024-05-08T18:31:51.237 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.237 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.237 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:51.237 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.648354+0000", 2024-05-08T18:31:51.237 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00029571799999999999 2024-05-08T18:31:51.237 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.237 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.237 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:51.237 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.648420+0000", 2024-05-08T18:31:51.238 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6818999999999998e-05 2024-05-08T18:31:51.238 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.238 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.238 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:51.238 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.648472+0000", 2024-05-08T18:31:51.238 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.1595000000000003e-05 2024-05-08T18:31:51.238 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:51.238 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:51.238 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:51.238 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.238 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.239 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1352 3.0 e82/21 3:0085bede:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_38:head v 82'2, mlcod=0'0)", 2024-05-08T18:31:51.239 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.732652+0000", 2024-05-08T18:31:51.239 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 8.4704462800000009, 2024-05-08T18:31:51.239 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010931293, 2024-05-08T18:31:51.239 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:51.239 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:51.239 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:51.239 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:51.239 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.239 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:51.239 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.732652+0000", 2024-05-08T18:31:51.240 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:51.240 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.240 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.240 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:51.240 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.732652+0000", 2024-05-08T18:31:51.240 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:51.240 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.240 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.240 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:51.240 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.732653+0000", 2024-05-08T18:31:51.240 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.13e-07 2024-05-08T18:31:51.241 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.241 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.241 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:51.241 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.734222+0000", 2024-05-08T18:31:51.241 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00156931 2024-05-08T18:31:51.241 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.241 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.241 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:51.241 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.734248+0000", 2024-05-08T18:31:51.241 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.527e-05 2024-05-08T18:31:51.242 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.242 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.242 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:51.242 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.734261+0000", 2024-05-08T18:31:51.242 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3509999999999999e-05 2024-05-08T18:31:51.242 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.242 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.242 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:51.242 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.734331+0000", 2024-05-08T18:31:51.242 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9790999999999996e-05 2024-05-08T18:31:51.242 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.243 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.243 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:51.243 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.734351+0000", 2024-05-08T18:31:51.243 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9775e-05 2024-05-08T18:31:51.243 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.243 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.243 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:51.243 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.743520+0000", 2024-05-08T18:31:51.243 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0091690599999999997 2024-05-08T18:31:51.243 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.243 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.244 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:51.244 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.743584+0000", 2024-05-08T18:31:51.244 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.4064000000000002e-05 2024-05-08T18:31:51.244 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:51.244 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:51.244 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:51.244 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.244 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.244 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1358 3.5 3:a0d2e4cd:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_44:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:51.244 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.792476+0000", 2024-05-08T18:31:51.245 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 8.4106227029999996, 2024-05-08T18:31:51.245 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.017319887999999999, 2024-05-08T18:31:51.245 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:51.245 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:51.245 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:51.245 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:51.245 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:51.245 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:51.245 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1358 2024-05-08T18:31:51.245 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.245 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:51.245 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.246 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:51.246 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.792476+0000", 2024-05-08T18:31:51.246 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:51.246 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.246 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.246 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:51.246 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.792476+0000", 2024-05-08T18:31:51.246 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:51.246 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.246 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.246 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:51.247 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.792480+0000", 2024-05-08T18:31:51.247 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6780000000000002e-06 2024-05-08T18:31:51.247 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.247 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.247 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:51.247 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.794611+0000", 2024-05-08T18:31:51.247 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0021309689999999999 2024-05-08T18:31:51.247 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.247 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.247 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:51.248 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.794635+0000", 2024-05-08T18:31:51.248 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4210999999999999e-05 2024-05-08T18:31:51.248 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.248 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.248 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:51.248 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.794646+0000", 2024-05-08T18:31:51.248 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0939e-05 2024-05-08T18:31:51.248 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.248 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.248 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:51.248 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.794720+0000", 2024-05-08T18:31:51.249 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.4257000000000004e-05 2024-05-08T18:31:51.249 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.249 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.249 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:51.249 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.794848+0000", 2024-05-08T18:31:51.249 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000128279 2024-05-08T18:31:51.249 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.249 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.249 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:51.249 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.794981+0000", 2024-05-08T18:31:51.249 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013264099999999999 2024-05-08T18:31:51.250 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.250 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.250 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:51.250 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.806096+0000", 2024-05-08T18:31:51.250 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011114702000000001 2024-05-08T18:31:51.250 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.250 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.250 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:51.250 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.809702+0000", 2024-05-08T18:31:51.250 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0036063660000000002 2024-05-08T18:31:51.251 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.251 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.251 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:51.251 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.809749+0000", 2024-05-08T18:31:51.251 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6564999999999999e-05 2024-05-08T18:31:51.251 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.251 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.251 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:51.251 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.809796+0000", 2024-05-08T18:31:51.251 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7280999999999997e-05 2024-05-08T18:31:51.251 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:51.252 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:51.252 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:51.252 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.252 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.252 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1366 3.39 3:9c29fb9f:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_52:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:51.252 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.873737+0000", 2024-05-08T18:31:51.252 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 8.3293616349999997, 2024-05-08T18:31:51.252 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.013710574, 2024-05-08T18:31:51.252 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:51.252 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:51.252 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:51.253 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:51.253 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:51.253 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:51.253 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1366 2024-05-08T18:31:51.253 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.253 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:51.253 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.253 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:51.253 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.873737+0000", 2024-05-08T18:31:51.253 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:51.253 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.254 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.254 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:51.254 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.873737+0000", 2024-05-08T18:31:51.254 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:51.254 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.254 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.254 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:51.254 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.873740+0000", 2024-05-08T18:31:51.254 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2449999999999998e-06 2024-05-08T18:31:51.254 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.254 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.255 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:51.255 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.875455+0000", 2024-05-08T18:31:51.255 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0017145839999999999 2024-05-08T18:31:51.255 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.255 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.255 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:51.255 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.875484+0000", 2024-05-08T18:31:51.255 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9325000000000001e-05 2024-05-08T18:31:51.255 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.255 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.256 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:51.256 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.875499+0000", 2024-05-08T18:31:51.256 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4874e-05 2024-05-08T18:31:51.256 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.256 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.256 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:51.256 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.875571+0000", 2024-05-08T18:31:51.256 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2035999999999999e-05 2024-05-08T18:31:51.256 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.256 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.256 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:51.256 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.875691+0000", 2024-05-08T18:31:51.257 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012016 2024-05-08T18:31:51.257 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.257 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.257 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:51.257 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.875805+0000", 2024-05-08T18:31:51.257 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011333 2024-05-08T18:31:51.257 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.257 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.257 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:51.257 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.886875+0000", 2024-05-08T18:31:51.257 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011069997999999999 2024-05-08T18:31:51.258 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.258 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.258 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:51.258 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.887363+0000", 2024-05-08T18:31:51.258 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00048848499999999998 2024-05-08T18:31:51.258 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.258 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.258 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:51.258 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.887410+0000", 2024-05-08T18:31:51.258 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7264e-05 2024-05-08T18:31:51.258 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.259 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.259 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:51.259 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.887448+0000", 2024-05-08T18:31:51.259 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7273e-05 2024-05-08T18:31:51.259 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:51.259 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:51.259 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:51.259 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.259 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.259 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1370 3.9 e82/21 3:91bbaad9:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_56:head v 82'1, mlcod=0'0)", 2024-05-08T18:31:51.259 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.920855+0000", 2024-05-08T18:31:51.260 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 8.2822439560000003, 2024-05-08T18:31:51.260 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.023027817999999999, 2024-05-08T18:31:51.260 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:51.260 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:51.260 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:51.260 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:51.260 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.260 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:51.260 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.920855+0000", 2024-05-08T18:31:51.260 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:51.260 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.261 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.261 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:51.261 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.920855+0000", 2024-05-08T18:31:51.261 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:51.261 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.261 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.261 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:51.261 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.920855+0000", 2024-05-08T18:31:51.261 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7399999999999999e-07 2024-05-08T18:31:51.261 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.261 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.261 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:51.262 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.926227+0000", 2024-05-08T18:31:51.262 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0053715129999999996 2024-05-08T18:31:51.262 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.262 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.262 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:51.262 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.926252+0000", 2024-05-08T18:31:51.262 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5709000000000001e-05 2024-05-08T18:31:51.262 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.262 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.262 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:51.262 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.926265+0000", 2024-05-08T18:31:51.263 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2159e-05 2024-05-08T18:31:51.263 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.263 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.263 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:51.263 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.926339+0000", 2024-05-08T18:31:51.263 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.4058000000000001e-05 2024-05-08T18:31:51.263 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.263 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.263 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:51.263 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.926355+0000", 2024-05-08T18:31:51.263 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6274e-05 2024-05-08T18:31:51.263 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.264 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.264 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:51.264 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.943850+0000", 2024-05-08T18:31:51.264 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.017495502999999999 2024-05-08T18:31:51.264 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.264 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.264 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:51.264 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.943883+0000", 2024-05-08T18:31:51.264 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2227999999999997e-05 2024-05-08T18:31:51.264 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:51.264 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:51.265 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:51.265 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.265 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.265 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1372 3.39 3:9eccad39:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_58:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:51.265 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.936995+0000", 2024-05-08T18:31:51.265 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 8.266103803, 2024-05-08T18:31:51.265 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.016484776, 2024-05-08T18:31:51.265 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:51.265 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:51.265 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:51.265 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:51.266 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:51.266 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:51.266 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1372 2024-05-08T18:31:51.266 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.266 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:51.266 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.266 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:51.266 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.936995+0000", 2024-05-08T18:31:51.266 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:51.266 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.266 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.267 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:51.267 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.936995+0000", 2024-05-08T18:31:51.267 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:51.267 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.267 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.267 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:51.267 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.936997+0000", 2024-05-08T18:31:51.267 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3980000000000002e-06 2024-05-08T18:31:51.267 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.267 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.267 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:51.268 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.938982+0000", 2024-05-08T18:31:51.268 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001984591 2024-05-08T18:31:51.268 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.268 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.268 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:51.268 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.939011+0000", 2024-05-08T18:31:51.268 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8598999999999998e-05 2024-05-08T18:31:51.268 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.268 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.268 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:51.268 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.939026+0000", 2024-05-08T18:31:51.268 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5197999999999999e-05 2024-05-08T18:31:51.269 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.269 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.269 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:51.269 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.939106+0000", 2024-05-08T18:31:51.269 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.0656999999999997e-05 2024-05-08T18:31:51.269 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.269 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.269 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:51.269 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.939250+0000", 2024-05-08T18:31:51.269 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000143516 2024-05-08T18:31:51.269 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.270 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.270 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:51.270 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.939357+0000", 2024-05-08T18:31:51.270 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000107261 2024-05-08T18:31:51.270 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.270 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.270 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:51.270 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.953303+0000", 2024-05-08T18:31:51.270 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.013946188999999999 2024-05-08T18:31:51.270 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.270 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.270 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:51.271 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.953356+0000", 2024-05-08T18:31:51.271 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.2222000000000002e-05 2024-05-08T18:31:51.271 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.271 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.271 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:51.271 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.953425+0000", 2024-05-08T18:31:51.271 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9265999999999997e-05 2024-05-08T18:31:51.271 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.271 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.271 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:51.271 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.953480+0000", 2024-05-08T18:31:51.272 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4879000000000001e-05 2024-05-08T18:31:51.272 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:51.272 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:51.272 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:51.272 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.272 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.272 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1375 3.39 3:9c8c420a:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_61:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:51.272 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.971052+0000", 2024-05-08T18:31:51.272 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 8.2320468170000005, 2024-05-08T18:31:51.272 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.013332797, 2024-05-08T18:31:51.272 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:51.273 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:51.273 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:51.273 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:51.273 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:51.273 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:51.273 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1375 2024-05-08T18:31:51.273 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.273 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:51.273 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.273 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:51.273 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.971052+0000", 2024-05-08T18:31:51.274 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:51.274 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.274 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.274 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:51.274 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.971052+0000", 2024-05-08T18:31:51.274 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:51.274 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.274 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.274 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:51.274 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.971055+0000", 2024-05-08T18:31:51.274 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.977e-06 2024-05-08T18:31:51.275 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.275 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.275 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:51.275 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.972822+0000", 2024-05-08T18:31:51.275 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0017668619999999999 2024-05-08T18:31:51.275 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.275 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.275 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:51.275 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.972846+0000", 2024-05-08T18:31:51.275 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4519999999999999e-05 2024-05-08T18:31:51.275 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.275 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.276 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:51.276 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.972857+0000", 2024-05-08T18:31:51.276 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0457e-05 2024-05-08T18:31:51.276 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.276 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.276 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:51.276 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.972935+0000", 2024-05-08T18:31:51.276 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.8650000000000001e-05 2024-05-08T18:31:51.276 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.276 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.277 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:51.277 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.973121+0000", 2024-05-08T18:31:51.277 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000185816 2024-05-08T18:31:51.277 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.277 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.277 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:51.277 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.973289+0000", 2024-05-08T18:31:51.277 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016798299999999999 2024-05-08T18:31:51.277 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.277 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.277 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:51.278 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.983934+0000", 2024-05-08T18:31:51.278 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010644733999999999 2024-05-08T18:31:51.278 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.278 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.278 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:51.278 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.984287+0000", 2024-05-08T18:31:51.278 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00035295200000000002 2024-05-08T18:31:51.278 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.278 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.278 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:51.278 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.984342+0000", 2024-05-08T18:31:51.279 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5282999999999999e-05 2024-05-08T18:31:51.279 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.279 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.279 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:51.279 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.984385+0000", 2024-05-08T18:31:51.279 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.2562999999999999e-05 2024-05-08T18:31:51.279 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:51.279 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:51.279 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:51.279 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.279 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.279 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1384 3.5 3:a0f4371d:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_70:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:51.280 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:43.093875+0000", 2024-05-08T18:31:51.280 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 8.1092237019999995, 2024-05-08T18:31:51.280 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.013806097999999999, 2024-05-08T18:31:51.280 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:51.280 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:51.280 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:51.280 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:51.280 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:51.280 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:51.280 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1384 2024-05-08T18:31:51.280 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.281 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:51.281 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.281 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:51.281 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.093875+0000", 2024-05-08T18:31:51.281 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:51.281 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.281 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.281 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:51.281 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.093875+0000", 2024-05-08T18:31:51.281 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:51.281 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.281 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.282 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:51.282 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.093878+0000", 2024-05-08T18:31:51.282 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8990000000000001e-06 2024-05-08T18:31:51.282 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.282 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.282 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:51.282 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.095579+0000", 2024-05-08T18:31:51.282 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001700628 2024-05-08T18:31:51.282 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.282 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.283 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:51.283 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.095608+0000", 2024-05-08T18:31:51.283 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9371000000000001e-05 2024-05-08T18:31:51.283 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.283 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.283 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:51.283 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.095626+0000", 2024-05-08T18:31:51.283 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8221999999999999e-05 2024-05-08T18:31:51.283 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.283 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.283 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:51.283 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.095722+0000", 2024-05-08T18:31:51.284 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.5963000000000003e-05 2024-05-08T18:31:51.284 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.284 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.284 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:51.284 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.095908+0000", 2024-05-08T18:31:51.284 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00018594999999999999 2024-05-08T18:31:51.284 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.284 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.284 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:51.284 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.096081+0000", 2024-05-08T18:31:51.284 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00017264799999999999 2024-05-08T18:31:51.285 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.285 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.285 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:51.285 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.107122+0000", 2024-05-08T18:31:51.285 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011041249 2024-05-08T18:31:51.285 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.285 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.285 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:51.285 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.107565+0000", 2024-05-08T18:31:51.285 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00044287999999999999 2024-05-08T18:31:51.285 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.286 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.286 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:51.286 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.107630+0000", 2024-05-08T18:31:51.286 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.4745000000000004e-05 2024-05-08T18:31:51.286 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.286 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.286 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:51.286 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.107681+0000", 2024-05-08T18:31:51.286 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.1542999999999998e-05 2024-05-08T18:31:51.286 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:51.286 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:51.286 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:51.287 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.287 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.287 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1390 3.0 e82/21 3:00a67f20:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_76:head v 82'3, mlcod=81'1)", 2024-05-08T18:31:51.287 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:43.176277+0000", 2024-05-08T18:31:51.287 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 8.0268212939999994, 2024-05-08T18:31:51.287 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012246539000000001, 2024-05-08T18:31:51.287 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:51.287 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:51.287 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:51.287 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:51.287 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.288 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:51.288 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.176277+0000", 2024-05-08T18:31:51.288 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:51.288 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.288 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.288 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:51.288 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.176277+0000", 2024-05-08T18:31:51.288 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:51.288 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.288 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.289 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:51.289 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.176279+0000", 2024-05-08T18:31:51.289 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.001e-06 2024-05-08T18:31:51.289 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.289 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.289 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:51.289 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.178169+0000", 2024-05-08T18:31:51.289 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0018891100000000001 2024-05-08T18:31:51.289 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.289 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.289 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:51.289 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.178202+0000", 2024-05-08T18:31:51.290 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3315999999999997e-05 2024-05-08T18:31:51.290 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.290 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.290 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:51.290 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.178218+0000", 2024-05-08T18:31:51.290 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5889999999999999e-05 2024-05-08T18:31:51.290 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.290 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.290 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:51.290 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.178308+0000", 2024-05-08T18:31:51.290 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0080000000000005e-05 2024-05-08T18:31:51.291 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.291 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.291 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:51.291 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.178346+0000", 2024-05-08T18:31:51.291 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7931e-05 2024-05-08T18:31:51.291 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.291 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.291 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:51.291 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.188460+0000", 2024-05-08T18:31:51.291 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010113715000000001 2024-05-08T18:31:51.291 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.292 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.292 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:51.292 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.188524+0000", 2024-05-08T18:31:51.292 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.4496e-05 2024-05-08T18:31:51.292 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:51.292 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:51.292 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:51.292 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.292 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.292 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1402 3.2d e82/21 3:b43c4320:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_88:head v 82'3, mlcod=81'1)", 2024-05-08T18:31:51.293 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:43.297364+0000", 2024-05-08T18:31:51.293 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 7.9057350230000001, 2024-05-08T18:31:51.293 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.013017687999999999, 2024-05-08T18:31:51.293 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:51.293 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:51.293 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:51.293 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:51.293 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.293 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:51.293 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.297364+0000", 2024-05-08T18:31:51.293 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:51.293 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.294 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.294 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:51.294 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.297364+0000", 2024-05-08T18:31:51.294 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:51.294 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.294 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.294 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:51.294 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.297364+0000", 2024-05-08T18:31:51.294 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.16e-07 2024-05-08T18:31:51.294 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.295 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.295 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:51.295 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.302711+0000", 2024-05-08T18:31:51.295 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0053466039999999996 2024-05-08T18:31:51.295 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.295 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.295 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:51.295 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.302747+0000", 2024-05-08T18:31:51.295 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6823000000000003e-05 2024-05-08T18:31:51.295 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.295 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.295 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:51.296 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.302761+0000", 2024-05-08T18:31:51.296 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4028e-05 2024-05-08T18:31:51.296 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.296 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.296 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:51.296 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.302846+0000", 2024-05-08T18:31:51.296 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.4775000000000001e-05 2024-05-08T18:31:51.296 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.296 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.296 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:51.296 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.302876+0000", 2024-05-08T18:31:51.296 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9882e-05 2024-05-08T18:31:51.296 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.297 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.297 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:51.297 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.310331+0000", 2024-05-08T18:31:51.297 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0074546320000000001 2024-05-08T18:31:51.297 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.297 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.297 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:51.297 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.310381+0000", 2024-05-08T18:31:51.297 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.0727999999999999e-05 2024-05-08T18:31:51.297 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:51.297 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:51.298 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:51.298 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.298 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.298 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1613 3.3d e83/21 3:bcbc5fe8:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_1:head v 83'3, mlcod=81'1)", 2024-05-08T18:31:51.298 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:46.699842+0000", 2024-05-08T18:31:51.298 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4.5032562870000001, 2024-05-08T18:31:51.298 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012876298, 2024-05-08T18:31:51.298 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:51.298 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:51.298 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:51.298 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:51.299 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.299 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:51.299 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.699842+0000", 2024-05-08T18:31:51.299 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:51.299 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.299 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.299 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:51.299 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.699842+0000", 2024-05-08T18:31:51.299 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:51.299 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.299 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.300 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:51.300 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.699845+0000", 2024-05-08T18:31:51.300 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.04e-06 2024-05-08T18:31:51.300 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.300 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.300 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:51.300 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.702634+0000", 2024-05-08T18:31:51.300 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0027896010000000001 2024-05-08T18:31:51.300 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.300 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.301 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:51.301 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.702660+0000", 2024-05-08T18:31:51.301 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6265999999999999e-05 2024-05-08T18:31:51.301 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.301 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.301 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:51.301 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.702674+0000", 2024-05-08T18:31:51.301 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3297e-05 2024-05-08T18:31:51.301 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.301 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.302 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:51.302 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.702759+0000", 2024-05-08T18:31:51.302 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5110000000000003e-05 2024-05-08T18:31:51.302 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.302 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.302 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:51.302 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.702789+0000", 2024-05-08T18:31:51.302 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0434999999999999e-05 2024-05-08T18:31:51.302 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.302 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.302 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:51.303 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.712639+0000", 2024-05-08T18:31:51.303 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0098496850000000004 2024-05-08T18:31:51.303 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.303 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.303 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:51.303 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.712719+0000", 2024-05-08T18:31:51.303 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.9864000000000006e-05 2024-05-08T18:31:51.303 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:51.303 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:51.303 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:51.303 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.304 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.304 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1621 3.5 3:a3bb7dd2:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-05-08T18:31:51.304 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:46.781044+0000", 2024-05-08T18:31:51.304 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4.4220551710000002, 2024-05-08T18:31:51.304 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.016696294, 2024-05-08T18:31:51.304 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:51.304 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:51.304 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:51.304 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:51.304 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:51.304 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:51.305 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1621 2024-05-08T18:31:51.305 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.305 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:51.305 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.305 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:51.305 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.781044+0000", 2024-05-08T18:31:51.305 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:51.305 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.305 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.305 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:51.305 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.781044+0000", 2024-05-08T18:31:51.306 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:51.306 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.306 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.306 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:51.306 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.781047+0000", 2024-05-08T18:31:51.306 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9009999999999996e-06 2024-05-08T18:31:51.306 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.306 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.306 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:51.306 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.782953+0000", 2024-05-08T18:31:51.306 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001905985 2024-05-08T18:31:51.307 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.307 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.307 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:51.307 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.782984+0000", 2024-05-08T18:31:51.307 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0568000000000003e-05 2024-05-08T18:31:51.307 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.307 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.307 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:51.307 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.782998+0000", 2024-05-08T18:31:51.307 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3499000000000001e-05 2024-05-08T18:31:51.307 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.308 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.308 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:51.308 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.783072+0000", 2024-05-08T18:31:51.308 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.4104999999999996e-05 2024-05-08T18:31:51.308 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.308 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.308 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:51.308 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.783226+0000", 2024-05-08T18:31:51.308 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015405900000000001 2024-05-08T18:31:51.308 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.308 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.309 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:51.309 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.783377+0000", 2024-05-08T18:31:51.309 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015162500000000001 2024-05-08T18:31:51.309 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.309 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.309 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:51.309 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.796988+0000", 2024-05-08T18:31:51.309 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.013610652000000001 2024-05-08T18:31:51.309 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.309 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.309 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:51.309 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.797630+0000", 2024-05-08T18:31:51.310 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00064184599999999995 2024-05-08T18:31:51.310 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.310 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.310 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:51.310 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.797692+0000", 2024-05-08T18:31:51.310 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.2396000000000004e-05 2024-05-08T18:31:51.310 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.310 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.310 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:51.310 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.797740+0000", 2024-05-08T18:31:51.310 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7657999999999997e-05 2024-05-08T18:31:51.311 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:51.311 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:51.311 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:51.311 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.311 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.311 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1624 3.3d e83/21 3:bc2f41f0:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_12:head v 83'4, mlcod=82'2)", 2024-05-08T18:31:51.311 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:46.814956+0000", 2024-05-08T18:31:51.311 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4.3881423489999998, 2024-05-08T18:31:51.311 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.022594933000000001, 2024-05-08T18:31:51.311 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:51.311 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:51.312 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:51.312 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:51.312 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.312 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:51.312 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.814956+0000", 2024-05-08T18:31:51.312 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:51.312 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.312 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.312 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:51.312 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.814956+0000", 2024-05-08T18:31:51.312 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:51.313 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.313 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.313 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:51.313 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.814959+0000", 2024-05-08T18:31:51.313 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.339e-06 2024-05-08T18:31:51.313 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.313 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.313 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:51.313 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.818131+0000", 2024-05-08T18:31:51.313 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031725149999999999 2024-05-08T18:31:51.313 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.313 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.314 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:51.314 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.818171+0000", 2024-05-08T18:31:51.314 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9295000000000002e-05 2024-05-08T18:31:51.314 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.314 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.314 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:51.314 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.818191+0000", 2024-05-08T18:31:51.314 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0329000000000001e-05 2024-05-08T18:31:51.314 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.314 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.315 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:51.315 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.818363+0000", 2024-05-08T18:31:51.315 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000172337 2024-05-08T18:31:51.315 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.315 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.315 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:51.315 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.818415+0000", 2024-05-08T18:31:51.315 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.2203999999999997e-05 2024-05-08T18:31:51.315 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.315 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.316 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:51.316 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.837470+0000", 2024-05-08T18:31:51.316 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019054950000000001 2024-05-08T18:31:51.316 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.316 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.316 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:51.316 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.837551+0000", 2024-05-08T18:31:51.316 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.0964000000000006e-05 2024-05-08T18:31:51.316 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:51.316 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:51.316 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:51.317 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.317 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.317 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1632 3.21 3:86ca081f:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_20:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-05-08T18:31:51.317 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:46.903772+0000", 2024-05-08T18:31:51.317 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4.2993272390000001, 2024-05-08T18:31:51.317 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.015516323, 2024-05-08T18:31:51.317 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:51.317 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:51.317 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:51.317 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:51.317 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:51.317 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:51.318 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1632 2024-05-08T18:31:51.318 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.318 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:51.318 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.318 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:51.318 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.903772+0000", 2024-05-08T18:31:51.318 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:51.318 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.318 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.318 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:51.319 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.903772+0000", 2024-05-08T18:31:51.319 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:51.319 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.319 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.319 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:51.319 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.903774+0000", 2024-05-08T18:31:51.319 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8040000000000002e-06 2024-05-08T18:31:51.319 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.319 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.319 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:51.319 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.905653+0000", 2024-05-08T18:31:51.319 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001878872 2024-05-08T18:31:51.320 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.320 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.320 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:51.320 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.905675+0000", 2024-05-08T18:31:51.320 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2238999999999998e-05 2024-05-08T18:31:51.320 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.320 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.320 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:51.320 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.905686+0000", 2024-05-08T18:31:51.320 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0145e-05 2024-05-08T18:31:51.320 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.320 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.321 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:51.321 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.905748+0000", 2024-05-08T18:31:51.321 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.2595000000000006e-05 2024-05-08T18:31:51.321 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.321 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.321 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:51.321 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.905871+0000", 2024-05-08T18:31:51.321 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012235999999999999 2024-05-08T18:31:51.321 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.321 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.321 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:51.321 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.905986+0000", 2024-05-08T18:31:51.322 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115025 2024-05-08T18:31:51.322 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.322 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.322 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:51.322 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.910243+0000", 2024-05-08T18:31:51.322 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0042571099999999997 2024-05-08T18:31:51.322 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.322 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.322 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:51.322 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.919213+0000", 2024-05-08T18:31:51.322 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.008970347 2024-05-08T18:31:51.322 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.323 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.323 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:51.323 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.919255+0000", 2024-05-08T18:31:51.323 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.1909000000000001e-05 2024-05-08T18:31:51.323 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.323 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.323 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:51.323 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.919288+0000", 2024-05-08T18:31:51.323 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2916999999999997e-05 2024-05-08T18:31:51.323 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:51.324 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:51.324 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:51.324 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.324 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.324 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1638 3.9 e83/21 3:9152f27e:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5_100Mb.:head v 83'6, mlcod=82'4)", 2024-05-08T18:31:51.324 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:46.971157+0000", 2024-05-08T18:31:51.324 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4.2319415219999996, 2024-05-08T18:31:51.324 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012153826, 2024-05-08T18:31:51.324 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:51.324 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:51.324 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:51.324 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:51.325 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.325 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:51.325 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.971157+0000", 2024-05-08T18:31:51.325 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:51.325 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.325 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.325 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:51.325 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.971157+0000", 2024-05-08T18:31:51.325 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:51.325 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.325 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.325 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:51.325 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.971159+0000", 2024-05-08T18:31:51.326 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.499e-06 2024-05-08T18:31:51.326 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.326 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.326 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:51.326 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.976606+0000", 2024-05-08T18:31:51.326 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0054470500000000002 2024-05-08T18:31:51.326 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.326 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.326 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:51.327 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.976627+0000", 2024-05-08T18:31:51.327 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1109000000000001e-05 2024-05-08T18:31:51.327 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.327 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.327 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:51.327 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.976639+0000", 2024-05-08T18:31:51.327 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2544000000000001e-05 2024-05-08T18:31:51.327 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.327 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.327 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:51.328 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.976762+0000", 2024-05-08T18:31:51.328 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012254 2024-05-08T18:31:51.328 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.328 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.328 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:51.328 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.976787+0000", 2024-05-08T18:31:51.328 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4683999999999999e-05 2024-05-08T18:31:51.328 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.328 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.328 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:51.329 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.983270+0000", 2024-05-08T18:31:51.329 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0064833010000000003 2024-05-08T18:31:51.329 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.329 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.329 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:51.329 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.983311+0000", 2024-05-08T18:31:51.329 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.1099000000000001e-05 2024-05-08T18:31:51.329 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:51.329 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:51.329 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:51.329 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:51.330 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:51.330 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:51.331 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-08T18:31:51.332 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:31:51.329+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:31:51.432 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:31:51.429+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:31:51.494 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:51.494 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:31:51.495 INFO:teuthology.orchestra.run.smithi097.stdout: "num_ops": 0 2024-05-08T18:31:51.495 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:51.511 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-08T18:31:51.533 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:31:51.530+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:31:51.598 INFO:teuthology.orchestra.run.smithi097.stderr:nodeep-scrub is set 2024-05-08T18:31:51.598 INFO:teuthology.orchestra.run.smithi097.stderr:reweighted osd.0 to 1 (10000) 2024-05-08T18:31:51.632 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-05-08T18:31:51.680 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:31:51.681+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:31:51.684 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:51.684 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:31:51.684 INFO:teuthology.orchestra.run.smithi097.stdout: "complaint_time": 30, 2024-05-08T18:31:51.685 INFO:teuthology.orchestra.run.smithi097.stdout: "num_blocked_ops": 0 2024-05-08T18:31:51.685 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:51.703 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-08T18:31:51.744 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:31:51.745+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:31:51.836 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:31:51.830+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:31:51.863 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:51.863 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2024-05-08T18:31:51.863 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2024-05-08T18:31:51.863 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-05-08T18:31:51.863 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.863 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1234 3.38 3:1cb36fa1:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.2__shadow_.fYaqa8o34qSAauLRSqi3iwpmT5NwV5c_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-05-08T18:31:51.863 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:38.213439+0000", 2024-05-08T18:31:51.863 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 13.649270252999999, 2024-05-08T18:31:51.864 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.028973664, 2024-05-08T18:31:51.864 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:51.864 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:51.864 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:51.864 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:51.864 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:51.864 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:51.864 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1234 2024-05-08T18:31:51.864 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.864 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:51.864 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.864 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:51.864 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.213439+0000", 2024-05-08T18:31:51.865 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:51.865 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.865 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.865 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:51.865 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.213439+0000", 2024-05-08T18:31:51.865 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:51.865 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.865 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.865 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:51.865 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.213442+0000", 2024-05-08T18:31:51.865 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7580000000000001e-06 2024-05-08T18:31:51.865 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.865 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.866 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:51.866 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.216804+0000", 2024-05-08T18:31:51.866 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0033619520000000001 2024-05-08T18:31:51.866 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.866 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.866 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:51.866 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.216838+0000", 2024-05-08T18:31:51.866 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4437999999999998e-05 2024-05-08T18:31:51.866 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.866 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.866 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:51.866 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.216854+0000", 2024-05-08T18:31:51.866 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5823000000000001e-05 2024-05-08T18:31:51.867 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.867 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.867 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:51.867 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.216938+0000", 2024-05-08T18:31:51.867 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.3842000000000001e-05 2024-05-08T18:31:51.867 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.867 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.867 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:51.867 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.217046+0000", 2024-05-08T18:31:51.867 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000108717 2024-05-08T18:31:51.867 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.868 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.868 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:51.868 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.217137+0000", 2024-05-08T18:31:51.868 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0278000000000005e-05 2024-05-08T18:31:51.868 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.868 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.868 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:51.868 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.225461+0000", 2024-05-08T18:31:51.868 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0083239330000000004 2024-05-08T18:31:51.868 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.868 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.868 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:51.868 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.242319+0000", 2024-05-08T18:31:51.868 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.016858445999999999 2024-05-08T18:31:51.869 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.869 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.869 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:51.869 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.242359+0000", 2024-05-08T18:31:51.869 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9657000000000003e-05 2024-05-08T18:31:51.869 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.869 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.869 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:51.869 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.242413+0000", 2024-05-08T18:31:51.869 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3820000000000003e-05 2024-05-08T18:31:51.869 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:51.869 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:51.870 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:51.870 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.870 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.870 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1318 3.c e81/21 3:329e59e6:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_4:head v 81'3, mlcod=80'1)", 2024-05-08T18:31:51.870 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.344399+0000", 2024-05-08T18:31:51.870 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 9.5183102920000007, 2024-05-08T18:31:51.870 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.016160681999999999, 2024-05-08T18:31:51.870 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:51.870 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:51.870 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:51.870 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:51.870 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.871 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:51.871 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.344399+0000", 2024-05-08T18:31:51.871 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:51.871 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.871 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.871 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:51.871 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.344399+0000", 2024-05-08T18:31:51.871 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:51.871 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.871 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.871 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:51.871 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.344401+0000", 2024-05-08T18:31:51.871 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.767e-06 2024-05-08T18:31:51.872 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.872 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.872 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:51.872 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.351623+0000", 2024-05-08T18:31:51.872 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.007222554 2024-05-08T18:31:51.872 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.872 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.872 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:51.872 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.351667+0000", 2024-05-08T18:31:51.872 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4192e-05 2024-05-08T18:31:51.872 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.872 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.872 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:51.873 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.351690+0000", 2024-05-08T18:31:51.873 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2708999999999999e-05 2024-05-08T18:31:51.873 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.873 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.873 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:51.873 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.351781+0000", 2024-05-08T18:31:51.873 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0556999999999994e-05 2024-05-08T18:31:51.873 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.873 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.873 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:51.873 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.351799+0000", 2024-05-08T18:31:51.873 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8581e-05 2024-05-08T18:31:51.873 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.874 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.874 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:51.874 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.360513+0000", 2024-05-08T18:31:51.874 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.008713864 2024-05-08T18:31:51.874 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.874 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.874 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:51.874 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.360560+0000", 2024-05-08T18:31:51.874 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6458000000000001e-05 2024-05-08T18:31:51.874 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:51.874 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:51.874 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:51.874 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.874 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.875 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1330 3.8 3:124da8ab:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-08T18:31:51.875 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.493255+0000", 2024-05-08T18:31:51.875 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 9.3694544440000005, 2024-05-08T18:31:51.875 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.016189959, 2024-05-08T18:31:51.875 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:51.875 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:51.875 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:51.875 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:51.875 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:51.875 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:51.875 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1330 2024-05-08T18:31:51.875 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.875 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:51.876 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.876 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:51.876 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.493255+0000", 2024-05-08T18:31:51.876 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:51.876 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.876 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.876 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:51.876 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.493255+0000", 2024-05-08T18:31:51.876 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:51.876 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.876 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.876 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:51.876 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.493258+0000", 2024-05-08T18:31:51.876 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0180000000000002e-06 2024-05-08T18:31:51.877 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.877 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.877 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:51.877 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.494859+0000", 2024-05-08T18:31:51.877 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001600853 2024-05-08T18:31:51.877 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.877 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.877 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:51.877 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.494883+0000", 2024-05-08T18:31:51.877 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4680000000000001e-05 2024-05-08T18:31:51.877 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.877 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.878 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:51.878 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.494894+0000", 2024-05-08T18:31:51.878 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0601999999999999e-05 2024-05-08T18:31:51.878 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.878 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.878 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:51.878 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.494972+0000", 2024-05-08T18:31:51.878 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.8534000000000004e-05 2024-05-08T18:31:51.878 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.878 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.878 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:51.878 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.495134+0000", 2024-05-08T18:31:51.878 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016150999999999999 2024-05-08T18:31:51.879 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.879 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.879 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-05-08T18:31:51.879 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.495261+0000", 2024-05-08T18:31:51.879 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012695600000000001 2024-05-08T18:31:51.879 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.879 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.879 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:51.879 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.508455+0000", 2024-05-08T18:31:51.879 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.013194449 2024-05-08T18:31:51.879 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.879 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.885 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:51.885 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.509294+0000", 2024-05-08T18:31:51.886 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000839061 2024-05-08T18:31:51.886 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.886 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.886 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:51.886 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.509388+0000", 2024-05-08T18:31:51.886 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.3682000000000002e-05 2024-05-08T18:31:51.886 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.886 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.886 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:51.886 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.509445+0000", 2024-05-08T18:31:51.886 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6613999999999997e-05 2024-05-08T18:31:51.886 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:51.887 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:51.887 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:51.887 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.887 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.887 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1336 3.2 3:42c6ce4f:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:51.887 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.558532+0000", 2024-05-08T18:31:51.887 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 9.3041769960000007, 2024-05-08T18:31:51.887 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.033214269999999997, 2024-05-08T18:31:51.887 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:51.887 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:51.887 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:51.887 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:51.887 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:51.887 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:51.888 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1336 2024-05-08T18:31:51.888 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.888 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:51.888 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.888 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:51.888 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.558532+0000", 2024-05-08T18:31:51.888 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:51.888 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.888 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.889 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:51.889 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.558532+0000", 2024-05-08T18:31:51.889 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:51.889 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.889 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.889 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:51.889 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.558535+0000", 2024-05-08T18:31:51.889 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9689999999999999e-06 2024-05-08T18:31:51.889 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.889 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.889 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:51.890 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.560549+0000", 2024-05-08T18:31:51.890 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0020142469999999998 2024-05-08T18:31:51.890 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.890 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.890 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:51.890 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.560576+0000", 2024-05-08T18:31:51.890 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6908000000000001e-05 2024-05-08T18:31:51.890 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.890 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.890 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:51.890 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.560595+0000", 2024-05-08T18:31:51.890 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8383999999999999e-05 2024-05-08T18:31:51.890 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.891 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.891 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:51.891 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.560680+0000", 2024-05-08T18:31:51.891 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5424000000000001e-05 2024-05-08T18:31:51.891 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.891 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.891 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-05-08T18:31:51.891 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.560685+0000", 2024-05-08T18:31:51.891 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.327e-06 2024-05-08T18:31:51.891 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.891 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.891 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:51.891 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.570079+0000", 2024-05-08T18:31:51.891 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0093940680000000002 2024-05-08T18:31:51.892 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.892 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.892 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:51.892 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.570249+0000", 2024-05-08T18:31:51.892 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000169953 2024-05-08T18:31:51.892 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.892 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.892 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-05-08T18:31:51.892 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.570423+0000", 2024-05-08T18:31:51.892 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00017355499999999999 2024-05-08T18:31:51.892 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.892 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.892 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:51.892 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.590293+0000", 2024-05-08T18:31:51.892 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019869761999999999 2024-05-08T18:31:51.893 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.893 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.893 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:51.893 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.591628+0000", 2024-05-08T18:31:51.893 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0013351599999999999 2024-05-08T18:31:51.893 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.893 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.893 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:51.893 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.591692+0000", 2024-05-08T18:31:51.893 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3822e-05 2024-05-08T18:31:51.893 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.893 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.893 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:51.893 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.591746+0000", 2024-05-08T18:31:51.894 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4691000000000002e-05 2024-05-08T18:31:51.894 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:51.894 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:51.894 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:51.894 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.894 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.894 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1346 3.29 3:9766a0f4:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_32:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:51.894 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.663599+0000", 2024-05-08T18:31:51.894 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 9.1991102080000005, 2024-05-08T18:31:51.894 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.018562168, 2024-05-08T18:31:51.894 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:51.894 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:51.894 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:51.895 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:51.895 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:51.895 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:51.895 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1346 2024-05-08T18:31:51.895 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.895 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:51.895 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.895 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:51.895 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.663599+0000", 2024-05-08T18:31:51.895 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:51.895 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.895 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.895 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:51.895 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.663599+0000", 2024-05-08T18:31:51.896 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:51.896 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.896 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.896 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:51.896 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.663601+0000", 2024-05-08T18:31:51.896 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.328e-06 2024-05-08T18:31:51.896 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.896 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.896 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:51.896 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.665307+0000", 2024-05-08T18:31:51.897 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0017060879999999999 2024-05-08T18:31:51.897 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.897 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.897 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:51.897 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.665332+0000", 2024-05-08T18:31:51.897 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5142000000000001e-05 2024-05-08T18:31:51.897 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.897 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.897 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:51.897 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.665344+0000", 2024-05-08T18:31:51.897 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1464000000000001e-05 2024-05-08T18:31:51.897 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.897 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.897 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:51.898 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.665419+0000", 2024-05-08T18:31:51.898 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.5129000000000005e-05 2024-05-08T18:31:51.898 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.898 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.898 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:51.898 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.665529+0000", 2024-05-08T18:31:51.898 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000109787 2024-05-08T18:31:51.898 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.898 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.898 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:31:51.898 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.665627+0000", 2024-05-08T18:31:51.898 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.8190999999999996e-05 2024-05-08T18:31:51.898 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.899 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.899 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:51.899 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.673488+0000", 2024-05-08T18:31:51.899 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0078611819999999995 2024-05-08T18:31:51.899 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.899 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.899 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:51.899 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.682043+0000", 2024-05-08T18:31:51.899 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0085545829999999993 2024-05-08T18:31:51.900 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.900 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.900 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:51.900 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.682106+0000", 2024-05-08T18:31:51.900 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.2706000000000006e-05 2024-05-08T18:31:51.900 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.900 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.900 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:51.901 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.682161+0000", 2024-05-08T18:31:51.901 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5568000000000001e-05 2024-05-08T18:31:51.901 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:51.901 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:51.901 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:51.901 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.902 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.902 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1348 3.38 3:1ca8d3e1:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_34:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:51.902 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.684650+0000", 2024-05-08T18:31:51.902 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 9.1780590980000003, 2024-05-08T18:31:51.902 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.018994840999999998, 2024-05-08T18:31:51.902 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:51.902 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:51.902 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:51.902 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:51.902 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:51.902 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:51.903 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1348 2024-05-08T18:31:51.903 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.903 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:51.903 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.903 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:51.903 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.684650+0000", 2024-05-08T18:31:51.903 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:51.904 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.904 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.904 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:51.904 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.684650+0000", 2024-05-08T18:31:51.904 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:51.904 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.904 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.905 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:51.905 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.684652+0000", 2024-05-08T18:31:51.905 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3860000000000001e-06 2024-05-08T18:31:51.905 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.905 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.905 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:51.905 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.686933+0000", 2024-05-08T18:31:51.905 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0022806369999999999 2024-05-08T18:31:51.906 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.906 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.906 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:51.906 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.686950+0000", 2024-05-08T18:31:51.906 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7377e-05 2024-05-08T18:31:51.906 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.906 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.907 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:51.907 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.686962+0000", 2024-05-08T18:31:51.907 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1756000000000001e-05 2024-05-08T18:31:51.907 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.907 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.907 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:51.907 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.687038+0000", 2024-05-08T18:31:51.907 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.5623000000000004e-05 2024-05-08T18:31:51.907 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.907 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.908 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:51.908 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.687226+0000", 2024-05-08T18:31:51.908 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000188457 2024-05-08T18:31:51.908 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.908 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.908 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:51.908 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.687394+0000", 2024-05-08T18:31:51.908 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016753300000000001 2024-05-08T18:31:51.908 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.908 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.908 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:51.908 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.694346+0000", 2024-05-08T18:31:51.908 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0069519639999999997 2024-05-08T18:31:51.908 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.909 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.909 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:51.909 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.703479+0000", 2024-05-08T18:31:51.909 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0091331829999999996 2024-05-08T18:31:51.909 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.909 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.909 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:51.909 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.703567+0000", 2024-05-08T18:31:51.909 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8294000000000005e-05 2024-05-08T18:31:51.909 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.909 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.909 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:51.909 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.703645+0000", 2024-05-08T18:31:51.910 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7631000000000003e-05 2024-05-08T18:31:51.910 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:51.910 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:51.910 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:51.910 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.910 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.910 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1349 3.27 3:e5090c80:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_35:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:51.910 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.696361+0000", 2024-05-08T18:31:51.911 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 9.1663480279999998, 2024-05-08T18:31:51.911 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019944929, 2024-05-08T18:31:51.911 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:51.911 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:51.911 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:51.911 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:51.911 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:51.911 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:51.911 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1349 2024-05-08T18:31:51.911 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.911 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:51.911 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.911 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:51.912 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.696361+0000", 2024-05-08T18:31:51.912 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:51.912 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.912 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.912 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:51.912 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.696361+0000", 2024-05-08T18:31:51.912 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:51.912 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.912 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.913 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:51.913 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.696363+0000", 2024-05-08T18:31:51.913 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1160000000000002e-06 2024-05-08T18:31:51.913 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.913 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.913 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:51.913 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.698294+0000", 2024-05-08T18:31:51.914 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001931026 2024-05-08T18:31:51.914 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.914 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.914 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:51.914 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.698324+0000", 2024-05-08T18:31:51.914 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9658e-05 2024-05-08T18:31:51.915 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.915 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.915 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:51.915 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.698339+0000", 2024-05-08T18:31:51.915 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5381000000000001e-05 2024-05-08T18:31:51.915 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.915 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.915 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:51.915 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.698430+0000", 2024-05-08T18:31:51.915 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0353999999999996e-05 2024-05-08T18:31:51.915 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.915 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.915 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:51.916 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.698591+0000", 2024-05-08T18:31:51.916 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016140999999999999 2024-05-08T18:31:51.916 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.916 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.916 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:31:51.916 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.698741+0000", 2024-05-08T18:31:51.916 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014955099999999999 2024-05-08T18:31:51.916 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.916 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.916 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:51.916 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.706987+0000", 2024-05-08T18:31:51.916 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0082466599999999994 2024-05-08T18:31:51.916 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.916 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.917 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:51.917 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.716183+0000", 2024-05-08T18:31:51.917 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0091959529999999998 2024-05-08T18:31:51.917 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.917 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.917 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:51.917 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.716252+0000", 2024-05-08T18:31:51.917 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8804000000000001e-05 2024-05-08T18:31:51.917 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.917 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.918 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:51.918 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.716306+0000", 2024-05-08T18:31:51.918 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4015999999999999e-05 2024-05-08T18:31:51.918 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:51.918 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:51.918 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:51.918 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.918 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.918 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1351 3.27 3:e75c4558:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_37:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:51.918 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.719093+0000", 2024-05-08T18:31:51.918 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 9.1436156779999997, 2024-05-08T18:31:51.918 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.016526314, 2024-05-08T18:31:51.919 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:51.919 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:51.919 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:51.919 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:51.919 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:51.919 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:51.919 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1351 2024-05-08T18:31:51.919 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.919 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:51.919 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.919 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:51.919 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.719093+0000", 2024-05-08T18:31:51.919 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:51.919 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.920 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.920 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:51.920 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.719093+0000", 2024-05-08T18:31:51.920 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:51.920 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.920 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.920 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:51.920 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.719096+0000", 2024-05-08T18:31:51.920 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0249999999999998e-06 2024-05-08T18:31:51.920 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.920 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.920 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:51.920 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.721010+0000", 2024-05-08T18:31:51.920 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001913821 2024-05-08T18:31:51.921 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.921 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.921 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:51.921 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.721041+0000", 2024-05-08T18:31:51.921 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0679000000000002e-05 2024-05-08T18:31:51.921 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.921 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.921 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:51.921 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.721056+0000", 2024-05-08T18:31:51.921 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4630999999999999e-05 2024-05-08T18:31:51.921 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.921 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.921 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:51.921 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.721139+0000", 2024-05-08T18:31:51.921 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.3174e-05 2024-05-08T18:31:51.922 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.922 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.922 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:51.922 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.721264+0000", 2024-05-08T18:31:51.922 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012507600000000001 2024-05-08T18:31:51.922 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.922 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.922 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:31:51.922 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.721361+0000", 2024-05-08T18:31:51.922 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.7406999999999998e-05 2024-05-08T18:31:51.922 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.922 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.922 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:51.923 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.731468+0000", 2024-05-08T18:31:51.923 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010107065 2024-05-08T18:31:51.923 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.923 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.923 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:51.923 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.735495+0000", 2024-05-08T18:31:51.923 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0040267080000000004 2024-05-08T18:31:51.923 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.923 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.923 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:51.923 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.735563+0000", 2024-05-08T18:31:51.923 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8195999999999996e-05 2024-05-08T18:31:51.923 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.923 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.923 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:51.924 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.735620+0000", 2024-05-08T18:31:51.924 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6532e-05 2024-05-08T18:31:51.924 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:51.924 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:51.924 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:51.924 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.924 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.924 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1355 3.28 e82/21 3:14052413:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_41:head v 82'1, mlcod=0'0)", 2024-05-08T18:31:51.924 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.768053+0000", 2024-05-08T18:31:51.924 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 9.0946561960000007, 2024-05-08T18:31:51.924 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019664687, 2024-05-08T18:31:51.924 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:51.924 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:51.924 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:51.925 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:51.925 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.925 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:51.925 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.768053+0000", 2024-05-08T18:31:51.925 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:51.925 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.925 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.925 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:51.925 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.768053+0000", 2024-05-08T18:31:51.925 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:51.925 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.925 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.925 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:51.925 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.768055+0000", 2024-05-08T18:31:51.925 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6959999999999999e-06 2024-05-08T18:31:51.926 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.926 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.926 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:51.926 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.772115+0000", 2024-05-08T18:31:51.926 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0040600139999999998 2024-05-08T18:31:51.926 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.926 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.926 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:51.926 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.772149+0000", 2024-05-08T18:31:51.926 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4638999999999998e-05 2024-05-08T18:31:51.926 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.926 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.926 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:51.926 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.772165+0000", 2024-05-08T18:31:51.927 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5435999999999999e-05 2024-05-08T18:31:51.927 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.927 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.927 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:51.927 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.772261+0000", 2024-05-08T18:31:51.927 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.6724000000000004e-05 2024-05-08T18:31:51.927 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.927 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.927 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:51.927 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.772289+0000", 2024-05-08T18:31:51.927 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7243e-05 2024-05-08T18:31:51.927 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.928 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.928 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:51.928 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.787670+0000", 2024-05-08T18:31:51.928 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.015380906 2024-05-08T18:31:51.928 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.928 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.928 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:51.929 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.787718+0000", 2024-05-08T18:31:51.929 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8028999999999997e-05 2024-05-08T18:31:51.929 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:51.929 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:51.929 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:51.929 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.929 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.929 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1356 3.2 3:41e29af7:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_42:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:51.929 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.771157+0000", 2024-05-08T18:31:51.929 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 9.0915522150000001, 2024-05-08T18:31:51.929 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.018991331, 2024-05-08T18:31:51.929 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:51.929 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:51.929 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:51.930 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:51.930 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:51.930 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:51.930 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1356 2024-05-08T18:31:51.930 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.930 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:51.930 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.930 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:51.930 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.771157+0000", 2024-05-08T18:31:51.930 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:51.930 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.930 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.930 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:51.930 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.771157+0000", 2024-05-08T18:31:51.931 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:51.931 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.931 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.931 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:51.931 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.771160+0000", 2024-05-08T18:31:51.931 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1820000000000002e-06 2024-05-08T18:31:51.931 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.931 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.931 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:51.931 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.772778+0000", 2024-05-08T18:31:51.931 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001617926 2024-05-08T18:31:51.932 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.932 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.932 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:51.932 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.772790+0000", 2024-05-08T18:31:51.932 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1609e-05 2024-05-08T18:31:51.932 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.932 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.932 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:51.933 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.772797+0000", 2024-05-08T18:31:51.933 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.3270000000000003e-06 2024-05-08T18:31:51.933 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.933 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.933 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:51.933 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.772851+0000", 2024-05-08T18:31:51.933 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3987999999999999e-05 2024-05-08T18:31:51.933 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.934 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.934 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:51.934 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.772947+0000", 2024-05-08T18:31:51.934 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.5809000000000004e-05 2024-05-08T18:31:51.934 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.934 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.934 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-05-08T18:31:51.934 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.773040+0000", 2024-05-08T18:31:51.935 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.3422000000000001e-05 2024-05-08T18:31:51.935 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.935 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.935 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:51.935 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.786246+0000", 2024-05-08T18:31:51.935 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.013205744 2024-05-08T18:31:51.935 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.936 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.936 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:51.936 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.790017+0000", 2024-05-08T18:31:51.936 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0037707539999999999 2024-05-08T18:31:51.936 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.936 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.937 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:51.937 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.790091+0000", 2024-05-08T18:31:51.937 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.4664000000000002e-05 2024-05-08T18:31:51.937 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.937 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.937 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:51.938 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.790148+0000", 2024-05-08T18:31:51.938 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6906e-05 2024-05-08T18:31:51.938 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:51.938 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:51.938 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:51.938 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.938 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.939 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1407 3.22 e82/21 3:46b64ebe:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_93:head v 82'2, mlcod=0'0)", 2024-05-08T18:31:51.939 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:43.347361+0000", 2024-05-08T18:31:51.939 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 8.5153486140000005, 2024-05-08T18:31:51.939 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.017804430999999999, 2024-05-08T18:31:51.939 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:51.939 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:51.939 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:51.939 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:51.939 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.939 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:51.939 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.347361+0000", 2024-05-08T18:31:51.940 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:51.940 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.940 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.940 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:51.940 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.347361+0000", 2024-05-08T18:31:51.940 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:51.940 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.940 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.940 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:51.940 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.347362+0000", 2024-05-08T18:31:51.940 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9489999999999999e-06 2024-05-08T18:31:51.940 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.940 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.940 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:51.940 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.352295+0000", 2024-05-08T18:31:51.941 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0049320659999999997 2024-05-08T18:31:51.941 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.941 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.941 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:51.941 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.352314+0000", 2024-05-08T18:31:51.941 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9057999999999999e-05 2024-05-08T18:31:51.941 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.941 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.941 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:51.941 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.352326+0000", 2024-05-08T18:31:51.941 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2244e-05 2024-05-08T18:31:51.941 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.941 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.941 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:51.942 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.352386+0000", 2024-05-08T18:31:51.942 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0066999999999999e-05 2024-05-08T18:31:51.942 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.942 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.942 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:51.942 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.352405+0000", 2024-05-08T18:31:51.942 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.872e-05 2024-05-08T18:31:51.942 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.942 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.942 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:51.942 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.365075+0000", 2024-05-08T18:31:51.942 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012670241 2024-05-08T18:31:51.942 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.943 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.943 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:51.943 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.365165+0000", 2024-05-08T18:31:51.943 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0086000000000005e-05 2024-05-08T18:31:51.943 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:51.943 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:51.943 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:51.943 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.943 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.943 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1414 3.29 3:946e7bc1:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_100:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:51.943 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:43.412960+0000", 2024-05-08T18:31:51.943 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 8.4497488359999995, 2024-05-08T18:31:51.943 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.017447297, 2024-05-08T18:31:51.943 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:51.944 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:51.944 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:51.944 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:51.944 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:51.944 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:51.944 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1414 2024-05-08T18:31:51.944 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.944 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:51.944 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.944 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:51.944 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.412960+0000", 2024-05-08T18:31:51.944 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:51.944 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.944 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.945 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:51.945 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.412960+0000", 2024-05-08T18:31:51.945 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:51.945 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.945 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.945 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:51.945 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.412963+0000", 2024-05-08T18:31:51.945 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4219999999999999e-06 2024-05-08T18:31:51.945 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.945 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.945 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:51.945 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.414327+0000", 2024-05-08T18:31:51.945 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001364608 2024-05-08T18:31:51.945 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.946 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.946 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:51.946 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.414348+0000", 2024-05-08T18:31:51.946 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0981000000000001e-05 2024-05-08T18:31:51.946 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.946 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.946 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:51.946 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.414359+0000", 2024-05-08T18:31:51.946 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0900000000000001e-05 2024-05-08T18:31:51.946 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.946 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.946 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:51.946 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.414418+0000", 2024-05-08T18:31:51.947 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8430000000000001e-05 2024-05-08T18:31:51.947 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.947 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.947 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:51.947 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.414542+0000", 2024-05-08T18:31:51.947 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012464600000000001 2024-05-08T18:31:51.947 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.947 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.947 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:31:51.947 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.414646+0000", 2024-05-08T18:31:51.947 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000103492 2024-05-08T18:31:51.947 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.947 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.947 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:51.948 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.421327+0000", 2024-05-08T18:31:51.948 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0066811700000000002 2024-05-08T18:31:51.948 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.948 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.948 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:51.948 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.430304+0000", 2024-05-08T18:31:51.948 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0089774220000000005 2024-05-08T18:31:51.948 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.948 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.948 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:51.948 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.430364+0000", 2024-05-08T18:31:51.948 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9431000000000001e-05 2024-05-08T18:31:51.948 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.948 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.948 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:51.949 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.430408+0000", 2024-05-08T18:31:51.949 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3795000000000003e-05 2024-05-08T18:31:51.949 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:51.949 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:51.949 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:51.949 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.949 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.949 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1616 3.7 3:e2c69de8:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-05-08T18:31:51.949 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:46.728206+0000", 2024-05-08T18:31:51.950 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 5.1345029850000001, 2024-05-08T18:31:51.950 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.024382826, 2024-05-08T18:31:51.950 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:51.950 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:51.950 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:51.950 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:51.950 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:51.950 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:51.950 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1616 2024-05-08T18:31:51.950 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.950 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:51.950 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.950 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:51.951 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.728206+0000", 2024-05-08T18:31:51.951 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:51.951 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.951 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.951 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:51.951 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.728206+0000", 2024-05-08T18:31:51.951 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:51.951 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.951 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.951 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:51.951 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.728209+0000", 2024-05-08T18:31:51.951 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3060000000000002e-06 2024-05-08T18:31:51.951 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.951 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.952 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:51.952 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.730475+0000", 2024-05-08T18:31:51.952 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0022651899999999998 2024-05-08T18:31:51.952 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.952 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.952 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:51.952 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.730508+0000", 2024-05-08T18:31:51.952 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3226999999999999e-05 2024-05-08T18:31:51.952 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.952 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.952 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:51.952 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.730523+0000", 2024-05-08T18:31:51.952 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4715999999999999e-05 2024-05-08T18:31:51.952 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.953 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.953 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:51.953 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.730618+0000", 2024-05-08T18:31:51.953 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.5619999999999996e-05 2024-05-08T18:31:51.953 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.953 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.953 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:51.953 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.730831+0000", 2024-05-08T18:31:51.953 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021288599999999999 2024-05-08T18:31:51.953 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.953 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.953 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:51.953 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.730970+0000", 2024-05-08T18:31:51.953 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013861400000000001 2024-05-08T18:31:51.954 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.954 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.954 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:51.954 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.742595+0000", 2024-05-08T18:31:51.954 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011624951 2024-05-08T18:31:51.954 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.954 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.954 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:51.954 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.752495+0000", 2024-05-08T18:31:51.954 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0098999910000000003 2024-05-08T18:31:51.954 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.954 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.954 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:51.954 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.752546+0000", 2024-05-08T18:31:51.955 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.1422999999999999e-05 2024-05-08T18:31:51.955 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.955 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.955 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:51.955 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.752589+0000", 2024-05-08T18:31:51.955 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.2901999999999997e-05 2024-05-08T18:31:51.955 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:51.955 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:51.955 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:51.955 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.955 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.955 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1625 3.1e 3:798e9c4d:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-05-08T18:31:51.955 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:46.821701+0000", 2024-05-08T18:31:51.955 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 5.0410083400000003, 2024-05-08T18:31:51.956 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019517788000000001, 2024-05-08T18:31:51.956 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:51.956 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:51.956 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:51.956 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:51.956 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:51.956 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:51.956 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1625 2024-05-08T18:31:51.956 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.956 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:51.956 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.956 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:51.956 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.821701+0000", 2024-05-08T18:31:51.957 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:51.957 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.957 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.957 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:51.957 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.821701+0000", 2024-05-08T18:31:51.957 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:51.957 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.957 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.957 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:51.957 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.821704+0000", 2024-05-08T18:31:51.957 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9450000000000002e-06 2024-05-08T18:31:51.958 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.958 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.958 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:51.958 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.824221+0000", 2024-05-08T18:31:51.958 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0025171600000000001 2024-05-08T18:31:51.958 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.958 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.958 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:51.958 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.824251+0000", 2024-05-08T18:31:51.958 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0243000000000002e-05 2024-05-08T18:31:51.958 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.958 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.958 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:51.958 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.824265+0000", 2024-05-08T18:31:51.959 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3482999999999999e-05 2024-05-08T18:31:51.959 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.959 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.959 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:51.959 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.824353+0000", 2024-05-08T18:31:51.959 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8146999999999995e-05 2024-05-08T18:31:51.959 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.959 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.959 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:51.959 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.824560+0000", 2024-05-08T18:31:51.959 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00020771400000000001 2024-05-08T18:31:51.959 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.959 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.960 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:31:51.960 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.824720+0000", 2024-05-08T18:31:51.960 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015998799999999999 2024-05-08T18:31:51.960 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.960 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.960 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:51.960 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.837381+0000", 2024-05-08T18:31:51.960 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012660803 2024-05-08T18:31:51.960 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.960 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.960 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:51.961 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.841087+0000", 2024-05-08T18:31:51.961 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0037056519999999998 2024-05-08T18:31:51.961 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.961 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.961 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:51.961 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.841160+0000", 2024-05-08T18:31:51.961 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.3208999999999997e-05 2024-05-08T18:31:51.961 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.961 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.961 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:51.961 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.841219+0000", 2024-05-08T18:31:51.961 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8443999999999998e-05 2024-05-08T18:31:51.962 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:51.962 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:51.962 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:51.962 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.962 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.962 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1627 3.b 3:d1c181db:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-05-08T18:31:51.962 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:46.850618+0000", 2024-05-08T18:31:51.962 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 5.0120909649999996, 2024-05-08T18:31:51.962 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.027553586000000001, 2024-05-08T18:31:51.962 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:51.962 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:51.962 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:51.962 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:51.963 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:51.963 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:51.963 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1627 2024-05-08T18:31:51.963 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.963 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:51.963 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.963 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:51.963 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.850618+0000", 2024-05-08T18:31:51.963 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:51.964 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.964 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.964 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:51.964 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.850618+0000", 2024-05-08T18:31:51.964 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:51.964 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.965 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.965 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:51.965 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.850621+0000", 2024-05-08T18:31:51.965 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0299999999999998e-06 2024-05-08T18:31:51.965 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.965 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.966 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:51.966 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.852369+0000", 2024-05-08T18:31:51.966 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001748229 2024-05-08T18:31:51.966 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.966 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.966 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:51.967 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.852397+0000", 2024-05-08T18:31:51.967 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7542000000000002e-05 2024-05-08T18:31:51.967 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.967 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.967 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:51.967 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.852410+0000", 2024-05-08T18:31:51.968 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2798e-05 2024-05-08T18:31:51.968 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.968 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.968 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:51.968 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.852537+0000", 2024-05-08T18:31:51.968 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000126756 2024-05-08T18:31:51.969 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.969 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.969 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:51.969 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.852785+0000", 2024-05-08T18:31:51.969 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024892099999999998 2024-05-08T18:31:51.969 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.970 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.970 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:51.970 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.853042+0000", 2024-05-08T18:31:51.970 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00025698799999999999 2024-05-08T18:31:51.970 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.970 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.971 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:51.971 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.876145+0000", 2024-05-08T18:31:51.971 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.023102746 2024-05-08T18:31:51.971 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.971 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.971 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:51.971 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.878045+0000", 2024-05-08T18:31:51.972 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0018999850000000001 2024-05-08T18:31:51.972 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.972 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.972 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:51.972 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.878117+0000", 2024-05-08T18:31:51.972 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1464000000000006e-05 2024-05-08T18:31:51.973 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.973 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.973 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:51.973 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.878172+0000", 2024-05-08T18:31:51.973 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5127000000000003e-05 2024-05-08T18:31:51.974 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:51.974 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:51.974 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:51.974 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.974 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.975 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1629 3.24 3:27d2a12f:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-05-08T18:31:51.975 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:46.873022+0000", 2024-05-08T18:31:51.975 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4.9896869610000003, 2024-05-08T18:31:51.975 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019610209, 2024-05-08T18:31:51.975 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:51.975 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:51.975 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:51.976 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:51.976 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:51.976 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:51.976 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1629 2024-05-08T18:31:51.976 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.976 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:51.977 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.977 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:51.977 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.873022+0000", 2024-05-08T18:31:51.977 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:51.977 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.977 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.977 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:51.978 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.873022+0000", 2024-05-08T18:31:51.978 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:51.978 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.978 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.978 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:51.978 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.873024+0000", 2024-05-08T18:31:51.979 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.826e-06 2024-05-08T18:31:51.979 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.979 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.979 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:51.979 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.874556+0000", 2024-05-08T18:31:51.979 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0015321009999999999 2024-05-08T18:31:51.980 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.980 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.980 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:51.980 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.874593+0000", 2024-05-08T18:31:51.980 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6696000000000002e-05 2024-05-08T18:31:51.980 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.981 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.981 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:51.981 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.874610+0000", 2024-05-08T18:31:51.981 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7374e-05 2024-05-08T18:31:51.981 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.981 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.981 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:51.982 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.874687+0000", 2024-05-08T18:31:51.982 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7219999999999996e-05 2024-05-08T18:31:51.982 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.982 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.982 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:51.982 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.874823+0000", 2024-05-08T18:31:51.983 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013538600000000001 2024-05-08T18:31:51.983 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.983 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.983 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:31:51.983 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.874921+0000", 2024-05-08T18:31:51.983 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.8679999999999997e-05 2024-05-08T18:31:51.983 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.984 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.984 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:51.984 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.883485+0000", 2024-05-08T18:31:51.984 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0085638299999999997 2024-05-08T18:31:51.984 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.984 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.984 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:51.984 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.892549+0000", 2024-05-08T18:31:51.985 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0090635850000000007 2024-05-08T18:31:51.985 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.985 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.985 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:51.985 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.892593+0000", 2024-05-08T18:31:51.985 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4566e-05 2024-05-08T18:31:51.985 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.985 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.986 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:51.986 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.892632+0000", 2024-05-08T18:31:51.986 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8945000000000001e-05 2024-05-08T18:31:51.986 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:51.986 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:51.986 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:51.986 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.986 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.987 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1630 3.1e 3:7a85a01c:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-05-08T18:31:51.987 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:46.882333+0000", 2024-05-08T18:31:51.987 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4.9803760029999999, 2024-05-08T18:31:51.987 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.018692686999999999, 2024-05-08T18:31:51.987 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:51.987 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:51.987 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:51.987 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:51.988 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:51.988 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:51.988 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1630 2024-05-08T18:31:51.988 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.988 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:51.988 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.988 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:51.988 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.882333+0000", 2024-05-08T18:31:51.988 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:51.988 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.988 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.988 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:51.988 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.882333+0000", 2024-05-08T18:31:51.988 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:51.989 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.989 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.989 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:51.989 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.882336+0000", 2024-05-08T18:31:51.989 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7089999999999998e-06 2024-05-08T18:31:51.989 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.989 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.989 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:51.989 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.883864+0000", 2024-05-08T18:31:51.989 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0015277859999999999 2024-05-08T18:31:51.989 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.989 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.989 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:51.989 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.883885+0000", 2024-05-08T18:31:51.989 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1534000000000001e-05 2024-05-08T18:31:51.990 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.990 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.990 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:51.990 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.883900+0000", 2024-05-08T18:31:51.990 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4773999999999999e-05 2024-05-08T18:31:51.990 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.990 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.990 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:51.990 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.883982+0000", 2024-05-08T18:31:51.990 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.2109999999999998e-05 2024-05-08T18:31:51.990 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.990 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.990 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:51.991 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.884128+0000", 2024-05-08T18:31:51.991 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014600299999999999 2024-05-08T18:31:51.991 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.991 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.991 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:31:51.991 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.884249+0000", 2024-05-08T18:31:51.991 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012081799999999999 2024-05-08T18:31:51.991 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.991 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.991 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:51.991 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.890584+0000", 2024-05-08T18:31:51.991 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0063351079999999999 2024-05-08T18:31:51.992 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.992 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.992 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:51.992 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.900934+0000", 2024-05-08T18:31:51.992 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010349591 2024-05-08T18:31:51.992 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.992 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.992 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:51.992 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.900975+0000", 2024-05-08T18:31:51.992 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0979000000000002e-05 2024-05-08T18:31:51.993 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.993 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.993 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:51.993 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.901026+0000", 2024-05-08T18:31:51.993 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.1275e-05 2024-05-08T18:31:51.993 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:51.993 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:51.993 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:51.993 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.993 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.993 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1633 3.15 e83/21 3:ab226f54:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_21:head v 83'2, mlcod=0'0)", 2024-05-08T18:31:51.993 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:46.920100+0000", 2024-05-08T18:31:51.993 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4.9426095710000002, 2024-05-08T18:31:51.993 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.022841956, 2024-05-08T18:31:51.994 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:51.994 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:51.994 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:51.994 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:51.994 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.994 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:51.994 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.920100+0000", 2024-05-08T18:31:51.994 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:51.994 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.994 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.994 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:51.994 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.920100+0000", 2024-05-08T18:31:51.994 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:51.995 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.995 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.995 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:51.995 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.920101+0000", 2024-05-08T18:31:51.995 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4309999999999999e-06 2024-05-08T18:31:51.995 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.995 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.995 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:51.995 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.926002+0000", 2024-05-08T18:31:51.995 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0059014820000000004 2024-05-08T18:31:51.995 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.995 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.995 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:51.995 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.926041+0000", 2024-05-08T18:31:51.996 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8217999999999999e-05 2024-05-08T18:31:51.996 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.996 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.996 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:51.996 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.926057+0000", 2024-05-08T18:31:51.996 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5877000000000001e-05 2024-05-08T18:31:51.996 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.996 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.996 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:51.996 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.926149+0000", 2024-05-08T18:31:51.996 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.2361000000000006e-05 2024-05-08T18:31:51.996 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.996 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.996 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:51.996 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.926178+0000", 2024-05-08T18:31:51.997 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9544999999999999e-05 2024-05-08T18:31:51.997 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.997 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.997 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:51.997 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.942887+0000", 2024-05-08T18:31:51.997 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.016708163000000002 2024-05-08T18:31:51.997 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.997 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.997 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:51.997 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.942942+0000", 2024-05-08T18:31:51.997 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4879000000000001e-05 2024-05-08T18:31:51.997 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:51.997 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:51.997 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:51.998 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.998 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.998 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1634 3.b 3:d3d25f94:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-05-08T18:31:51.998 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:46.925230+0000", 2024-05-08T18:31:51.998 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4.9374788360000004, 2024-05-08T18:31:51.998 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.022437625999999999, 2024-05-08T18:31:51.998 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:51.998 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:51.998 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:51.998 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:51.998 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:51.998 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:51.998 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1634 2024-05-08T18:31:51.999 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.999 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:51.999 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.999 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:51.999 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.925230+0000", 2024-05-08T18:31:51.999 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:51.999 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:51.999 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:51.999 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:51.999 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.925230+0000", 2024-05-08T18:31:51.999 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:52.000 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:52.000 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:52.000 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:52.000 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.925234+0000", 2024-05-08T18:31:52.000 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6789999999999998e-06 2024-05-08T18:31:52.000 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:52.000 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:52.000 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:52.000 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.927184+0000", 2024-05-08T18:31:52.000 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0019497799999999999 2024-05-08T18:31:52.000 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:52.000 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:52.000 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:52.000 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.927205+0000", 2024-05-08T18:31:52.001 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1231000000000001e-05 2024-05-08T18:31:52.001 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:52.001 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:52.001 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:52.001 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.927214+0000", 2024-05-08T18:31:52.001 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0159999999999997e-06 2024-05-08T18:31:52.001 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:52.001 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:52.001 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:52.001 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.927287+0000", 2024-05-08T18:31:52.001 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.3192e-05 2024-05-08T18:31:52.001 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:52.001 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:52.001 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:52.002 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.927495+0000", 2024-05-08T18:31:52.002 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00020766099999999999 2024-05-08T18:31:52.002 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:52.002 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:52.002 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:52.002 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.927653+0000", 2024-05-08T18:31:52.002 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015861799999999999 2024-05-08T18:31:52.002 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:52.002 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:52.003 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:52.003 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.947344+0000", 2024-05-08T18:31:52.003 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019690112999999999 2024-05-08T18:31:52.003 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:52.003 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:52.003 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:52.003 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.947572+0000", 2024-05-08T18:31:52.003 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000228292 2024-05-08T18:31:52.003 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:52.003 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:52.003 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:52.003 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.947618+0000", 2024-05-08T18:31:52.003 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5880000000000001e-05 2024-05-08T18:31:52.003 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:52.004 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:52.004 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:52.004 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.947668+0000", 2024-05-08T18:31:52.004 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.0164000000000003e-05 2024-05-08T18:31:52.004 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:52.004 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:52.004 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:52.004 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:52.004 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:52.004 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1635 3.27 3:e4667ce2:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-05-08T18:31:52.004 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:46.936207+0000", 2024-05-08T18:31:52.004 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4.9265022179999995, 2024-05-08T18:31:52.004 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.018244245999999999, 2024-05-08T18:31:52.004 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:52.005 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:52.005 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:52.005 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:52.005 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:52.005 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:52.005 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1635 2024-05-08T18:31:52.005 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:52.005 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:52.005 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:52.005 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:52.005 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.936207+0000", 2024-05-08T18:31:52.005 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:52.005 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:52.005 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:52.006 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:52.006 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.936207+0000", 2024-05-08T18:31:52.006 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:52.006 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:52.006 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:52.006 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:52.007 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.936210+0000", 2024-05-08T18:31:52.007 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.106e-06 2024-05-08T18:31:52.007 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:52.007 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:52.007 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:52.007 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.937940+0000", 2024-05-08T18:31:52.007 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001729972 2024-05-08T18:31:52.008 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:52.008 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:52.008 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:52.008 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.937963+0000", 2024-05-08T18:31:52.008 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3084000000000001e-05 2024-05-08T18:31:52.008 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:52.009 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:52.009 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:52.009 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.937975+0000", 2024-05-08T18:31:52.009 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2072000000000001e-05 2024-05-08T18:31:52.009 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:52.009 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:52.009 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:52.009 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.938060+0000", 2024-05-08T18:31:52.009 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5006000000000006e-05 2024-05-08T18:31:52.009 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:52.009 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:52.009 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:52.009 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.938220+0000", 2024-05-08T18:31:52.010 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000160018 2024-05-08T18:31:52.010 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:52.010 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:52.010 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:31:52.010 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.938359+0000", 2024-05-08T18:31:52.010 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013879300000000001 2024-05-08T18:31:52.010 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:52.010 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:52.010 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:52.010 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.947820+0000", 2024-05-08T18:31:52.010 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0094607370000000003 2024-05-08T18:31:52.010 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:52.010 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:52.011 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:52.011 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.954291+0000", 2024-05-08T18:31:52.011 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0064716030000000003 2024-05-08T18:31:52.011 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:52.011 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:52.011 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:52.011 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.954353+0000", 2024-05-08T18:31:52.011 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1965999999999996e-05 2024-05-08T18:31:52.011 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:52.011 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:52.011 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:52.011 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.954451+0000", 2024-05-08T18:31:52.011 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.7888999999999997e-05 2024-05-08T18:31:52.011 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:52.011 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:52.012 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:52.012 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:52.012 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:52.012 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:52.014 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-08T18:31:52.014 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:31:52.013+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:31:52.114 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:31:52.110+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:31:52.145 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:31:52.145 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:31:52.145 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 0 2024-05-08T18:31:52.145 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:31:52.161 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-08T18:31:52.248 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:31:52.246+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:31:52.316 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:31:52.317+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:31:52.328 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:31:52.329 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:31:52.329 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2024-05-08T18:31:52.329 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2024-05-08T18:31:52.329 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:31:52.344 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-08T18:31:52.418 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:31:52.417+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:31:52.516 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:31:52.516 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2024-05-08T18:31:52.516 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2024-05-08T18:31:52.516 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-05-08T18:31:52.516 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.516 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1315 3.2c e81/21 3:368ed9cc:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_1:head v 81'1, mlcod=0'0)", 2024-05-08T18:31:52.516 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.310943+0000", 2024-05-08T18:31:52.516 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 10.202902216, 2024-05-08T18:31:52.517 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019031756, 2024-05-08T18:31:52.517 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:52.517 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:52.517 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:52.517 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:52.517 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.517 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:52.517 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.310943+0000", 2024-05-08T18:31:52.517 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:52.517 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.517 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.517 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:52.518 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.310943+0000", 2024-05-08T18:31:52.518 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:52.518 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.518 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.518 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:52.518 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.310945+0000", 2024-05-08T18:31:52.518 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7800000000000001e-06 2024-05-08T18:31:52.518 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.518 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.518 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:52.518 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.315838+0000", 2024-05-08T18:31:52.518 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0048930800000000002 2024-05-08T18:31:52.519 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.519 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.519 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:52.519 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.315886+0000", 2024-05-08T18:31:52.519 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7336000000000002e-05 2024-05-08T18:31:52.519 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.519 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.519 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:52.519 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.315912+0000", 2024-05-08T18:31:52.519 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6584000000000002e-05 2024-05-08T18:31:52.519 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.519 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.519 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:52.520 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.316123+0000", 2024-05-08T18:31:52.520 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00021075400000000001 2024-05-08T18:31:52.520 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.520 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.520 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:52.520 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.316165+0000", 2024-05-08T18:31:52.520 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1709999999999999e-05 2024-05-08T18:31:52.520 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.520 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.520 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:52.520 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.329876+0000", 2024-05-08T18:31:52.520 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013710803000000001 2024-05-08T18:31:52.520 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.521 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.521 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:52.521 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.329974+0000", 2024-05-08T18:31:52.521 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8709000000000006e-05 2024-05-08T18:31:52.521 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:52.521 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:52.521 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:52.521 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.521 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.521 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1321 3.1b e81/21 3:d9207229:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_7:head v 81'1, mlcod=0'0)", 2024-05-08T18:31:52.522 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.391574+0000", 2024-05-08T18:31:52.522 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 10.122270434000001, 2024-05-08T18:31:52.522 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016614245, 2024-05-08T18:31:52.522 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:52.522 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:52.522 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:52.522 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:52.522 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.522 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:52.522 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.391574+0000", 2024-05-08T18:31:52.522 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:52.522 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.522 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.523 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:52.523 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.391574+0000", 2024-05-08T18:31:52.523 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:52.523 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.523 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.523 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:52.523 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.391578+0000", 2024-05-08T18:31:52.523 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3440000000000001e-06 2024-05-08T18:31:52.523 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.523 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.523 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:52.523 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.396175+0000", 2024-05-08T18:31:52.524 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0045968850000000002 2024-05-08T18:31:52.524 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.524 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.524 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:52.524 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.396209+0000", 2024-05-08T18:31:52.524 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4146000000000001e-05 2024-05-08T18:31:52.524 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.524 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.524 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:52.524 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.396228+0000", 2024-05-08T18:31:52.524 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9687e-05 2024-05-08T18:31:52.524 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.524 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.525 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:52.525 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.396353+0000", 2024-05-08T18:31:52.525 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012448200000000001 2024-05-08T18:31:52.525 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.525 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.525 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:52.525 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.396392+0000", 2024-05-08T18:31:52.525 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9419999999999999e-05 2024-05-08T18:31:52.525 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.525 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.525 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:52.525 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.408054+0000", 2024-05-08T18:31:52.525 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011661695999999999 2024-05-08T18:31:52.525 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.526 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.526 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:52.526 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.408189+0000", 2024-05-08T18:31:52.526 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000134585 2024-05-08T18:31:52.526 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:52.526 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:52.526 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:52.526 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.526 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.526 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1322 3.f e81/21 3:f3016725:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_8:head v 81'1, mlcod=0'0)", 2024-05-08T18:31:52.526 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.404407+0000", 2024-05-08T18:31:52.526 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 10.109437413, 2024-05-08T18:31:52.527 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016824525999999999, 2024-05-08T18:31:52.527 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:52.527 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:52.527 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:52.527 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:52.527 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.527 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:52.527 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.404407+0000", 2024-05-08T18:31:52.527 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:52.527 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.527 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.527 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:52.527 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.404407+0000", 2024-05-08T18:31:52.528 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:52.528 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.528 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.528 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:52.528 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.404409+0000", 2024-05-08T18:31:52.528 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9460000000000001e-06 2024-05-08T18:31:52.528 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.528 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.528 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:52.528 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.409446+0000", 2024-05-08T18:31:52.528 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.005036942 2024-05-08T18:31:52.528 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.528 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.529 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:52.529 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.409476+0000", 2024-05-08T18:31:52.529 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.9346999999999999e-05 2024-05-08T18:31:52.529 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.529 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.529 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:52.529 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.409498+0000", 2024-05-08T18:31:52.529 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2690000000000001e-05 2024-05-08T18:31:52.529 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.529 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.529 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:52.529 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.409607+0000", 2024-05-08T18:31:52.530 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000108546 2024-05-08T18:31:52.530 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.530 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.530 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:52.530 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.409643+0000", 2024-05-08T18:31:52.530 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5719000000000001e-05 2024-05-08T18:31:52.530 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.530 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.530 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:52.531 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.421097+0000", 2024-05-08T18:31:52.531 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011454166999999999 2024-05-08T18:31:52.531 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.531 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.531 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:52.531 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.421232+0000", 2024-05-08T18:31:52.531 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013516900000000001 2024-05-08T18:31:52.531 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:52.531 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:52.531 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:52.531 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.531 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.532 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1326 3.1b e81/21 3:da64adf7:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_12:head v 81'2, mlcod=0'0)", 2024-05-08T18:31:52.532 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.453834+0000", 2024-05-08T18:31:52.532 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 10.060011242, 2024-05-08T18:31:52.532 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015468416, 2024-05-08T18:31:52.532 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:52.532 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:52.532 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:52.532 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:52.532 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.532 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:52.532 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.453834+0000", 2024-05-08T18:31:52.533 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:52.533 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.533 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.533 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:52.533 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.453834+0000", 2024-05-08T18:31:52.533 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:52.533 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.533 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.533 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:52.533 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.453836+0000", 2024-05-08T18:31:52.533 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1830000000000001e-06 2024-05-08T18:31:52.533 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.534 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.534 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:52.534 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.459099+0000", 2024-05-08T18:31:52.534 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0052629499999999997 2024-05-08T18:31:52.534 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.534 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.534 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:52.534 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.459134+0000", 2024-05-08T18:31:52.534 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5437e-05 2024-05-08T18:31:52.534 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.534 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.534 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:52.535 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.459151+0000", 2024-05-08T18:31:52.535 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6506000000000001e-05 2024-05-08T18:31:52.535 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.535 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.535 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:52.535 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.459335+0000", 2024-05-08T18:31:52.535 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00018429500000000001 2024-05-08T18:31:52.535 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.535 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.535 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:52.535 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.459376+0000", 2024-05-08T18:31:52.535 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.07e-05 2024-05-08T18:31:52.535 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.536 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.536 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:52.536 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.469198+0000", 2024-05-08T18:31:52.536 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0098225489999999999 2024-05-08T18:31:52.536 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.536 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.536 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:52.536 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.469302+0000", 2024-05-08T18:31:52.536 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010379599999999999 2024-05-08T18:31:52.536 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:52.536 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:52.536 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:52.536 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.537 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.537 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1327 3.1a 3:58da5138:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-08T18:31:52.537 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.463447+0000", 2024-05-08T18:31:52.537 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 10.050397934999999, 2024-05-08T18:31:52.537 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018677618999999999, 2024-05-08T18:31:52.537 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:52.537 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:52.537 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:52.537 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:52.537 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:31:52.537 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:52.537 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1327 2024-05-08T18:31:52.538 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.538 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:52.538 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.538 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:52.538 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.463447+0000", 2024-05-08T18:31:52.538 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:52.538 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.538 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.538 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:52.538 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.463447+0000", 2024-05-08T18:31:52.538 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:52.538 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.539 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.539 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:52.539 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.463455+0000", 2024-05-08T18:31:52.539 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2430000000000005e-06 2024-05-08T18:31:52.539 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.539 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.539 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:52.539 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.469224+0000", 2024-05-08T18:31:52.539 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0057690830000000004 2024-05-08T18:31:52.539 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.539 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.539 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:52.540 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.469255+0000", 2024-05-08T18:31:52.540 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1000000000000001e-05 2024-05-08T18:31:52.540 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.540 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.540 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:52.540 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.469273+0000", 2024-05-08T18:31:52.540 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7920000000000001e-05 2024-05-08T18:31:52.540 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.540 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.540 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:52.540 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.469451+0000", 2024-05-08T18:31:52.540 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017836499999999999 2024-05-08T18:31:52.541 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.541 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.541 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:52.541 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.469687+0000", 2024-05-08T18:31:52.541 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000235255 2024-05-08T18:31:52.541 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.541 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.541 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:31:52.541 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.469899+0000", 2024-05-08T18:31:52.541 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00021257200000000001 2024-05-08T18:31:52.541 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.541 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.541 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:52.542 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.480590+0000", 2024-05-08T18:31:52.542 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010690963 2024-05-08T18:31:52.542 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.542 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.542 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:52.542 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.481813+0000", 2024-05-08T18:31:52.542 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001223001 2024-05-08T18:31:52.542 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.542 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.542 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:52.542 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.481982+0000", 2024-05-08T18:31:52.542 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016828500000000001 2024-05-08T18:31:52.543 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.543 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.543 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:52.543 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.482124+0000", 2024-05-08T18:31:52.543 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014293199999999999 2024-05-08T18:31:52.543 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:52.543 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:52.543 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:52.543 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.543 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.543 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1328 3.14 3:2b0d89be:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-08T18:31:52.543 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.473844+0000", 2024-05-08T18:31:52.543 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 10.040001046, 2024-05-08T18:31:52.544 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.031713811000000001, 2024-05-08T18:31:52.544 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:52.544 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:52.544 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:52.544 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:52.544 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:31:52.544 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:52.544 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1328 2024-05-08T18:31:52.544 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.544 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:52.544 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.544 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:52.545 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.473844+0000", 2024-05-08T18:31:52.545 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:52.545 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.545 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.545 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:52.545 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.473844+0000", 2024-05-08T18:31:52.545 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:52.545 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.545 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.545 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:52.545 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.473847+0000", 2024-05-08T18:31:52.545 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3100000000000001e-06 2024-05-08T18:31:52.545 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.545 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.546 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:52.546 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.479452+0000", 2024-05-08T18:31:52.546 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0056046910000000002 2024-05-08T18:31:52.546 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.546 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.546 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:52.546 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.479485+0000", 2024-05-08T18:31:52.546 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2808999999999997e-05 2024-05-08T18:31:52.546 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.546 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.546 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:52.547 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.479508+0000", 2024-05-08T18:31:52.547 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3119999999999999e-05 2024-05-08T18:31:52.547 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.547 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.547 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:52.547 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.479638+0000", 2024-05-08T18:31:52.547 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000130586 2024-05-08T18:31:52.547 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.547 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.547 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:52.547 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.479896+0000", 2024-05-08T18:31:52.547 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00025793799999999998 2024-05-08T18:31:52.547 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.547 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.548 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:52.548 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.480111+0000", 2024-05-08T18:31:52.548 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00021487200000000001 2024-05-08T18:31:52.548 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.548 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.548 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:52.548 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.502946+0000", 2024-05-08T18:31:52.548 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.022835101 2024-05-08T18:31:52.548 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.548 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.548 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:52.548 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.505389+0000", 2024-05-08T18:31:52.549 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0024426510000000001 2024-05-08T18:31:52.549 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.549 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.549 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:52.549 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.505479+0000", 2024-05-08T18:31:52.549 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.9863000000000003e-05 2024-05-08T18:31:52.549 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.549 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.549 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:52.549 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.505558+0000", 2024-05-08T18:31:52.549 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8869999999999995e-05 2024-05-08T18:31:52.550 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:52.550 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:52.550 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:52.550 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.550 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.550 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1332 3.14 3:2bdfae75:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-08T18:31:52.550 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.514410+0000", 2024-05-08T18:31:52.550 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 9.9994349220000007, 2024-05-08T18:31:52.550 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.026281202, 2024-05-08T18:31:52.550 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:52.550 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:52.550 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:52.550 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:52.551 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:31:52.551 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:52.551 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1332 2024-05-08T18:31:52.551 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.551 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:52.551 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.551 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:52.551 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.514410+0000", 2024-05-08T18:31:52.551 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:52.551 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.551 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.551 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:52.552 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.514410+0000", 2024-05-08T18:31:52.552 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:52.552 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.552 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.552 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:52.552 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.514413+0000", 2024-05-08T18:31:52.552 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3160000000000001e-06 2024-05-08T18:31:52.552 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.552 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.552 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:52.552 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.519067+0000", 2024-05-08T18:31:52.552 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0046540319999999998 2024-05-08T18:31:52.552 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.553 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.553 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:52.553 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.519104+0000", 2024-05-08T18:31:52.553 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6890000000000001e-05 2024-05-08T18:31:52.553 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.553 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.553 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:52.553 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.519121+0000", 2024-05-08T18:31:52.553 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6583e-05 2024-05-08T18:31:52.553 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.553 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.553 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:52.553 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.519235+0000", 2024-05-08T18:31:52.553 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000114233 2024-05-08T18:31:52.554 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.554 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.554 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:52.554 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.519509+0000", 2024-05-08T18:31:52.554 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000274534 2024-05-08T18:31:52.554 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.554 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.554 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:52.554 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.519763+0000", 2024-05-08T18:31:52.554 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000253088 2024-05-08T18:31:52.554 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.554 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.554 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:52.554 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.532461+0000", 2024-05-08T18:31:52.555 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012698134 2024-05-08T18:31:52.555 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.555 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.555 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:52.555 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.540405+0000", 2024-05-08T18:31:52.555 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0079440699999999993 2024-05-08T18:31:52.555 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.555 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.555 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:52.555 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.540577+0000", 2024-05-08T18:31:52.556 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017180299999999999 2024-05-08T18:31:52.556 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.556 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.556 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:52.556 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.540691+0000", 2024-05-08T18:31:52.556 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011451900000000001 2024-05-08T18:31:52.556 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:52.556 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:52.556 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:52.556 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.556 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.556 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1334 3.f e81/21 3:f1b2aee4:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_20:head v 81'2, mlcod=0'0)", 2024-05-08T18:31:52.557 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.540860+0000", 2024-05-08T18:31:52.557 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 9.9729849149999996, 2024-05-08T18:31:52.557 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015497903, 2024-05-08T18:31:52.557 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:52.557 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:52.557 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:52.557 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:52.557 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.557 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:52.557 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.540860+0000", 2024-05-08T18:31:52.557 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:52.557 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.557 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.557 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:52.558 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.540860+0000", 2024-05-08T18:31:52.558 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:52.558 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.558 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.558 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:52.559 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.540861+0000", 2024-05-08T18:31:52.559 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5099999999999999e-06 2024-05-08T18:31:52.559 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.559 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.559 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:52.559 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.543997+0000", 2024-05-08T18:31:52.559 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0031360770000000001 2024-05-08T18:31:52.559 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.559 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.560 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:52.560 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.544040+0000", 2024-05-08T18:31:52.560 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.2743000000000001e-05 2024-05-08T18:31:52.560 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.560 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.560 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:52.560 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.544066+0000", 2024-05-08T18:31:52.560 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5999999999999998e-05 2024-05-08T18:31:52.560 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.560 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.560 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:52.560 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.544235+0000", 2024-05-08T18:31:52.560 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000168985 2024-05-08T18:31:52.560 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.561 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.561 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:52.561 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.544303+0000", 2024-05-08T18:31:52.561 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7392999999999997e-05 2024-05-08T18:31:52.561 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.561 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.561 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:52.561 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.556090+0000", 2024-05-08T18:31:52.561 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011786904000000001 2024-05-08T18:31:52.561 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.561 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.561 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:52.561 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.556358+0000", 2024-05-08T18:31:52.561 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00026829099999999998 2024-05-08T18:31:52.562 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:52.562 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:52.562 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:52.562 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.562 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.562 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1346 3.29 e82/21 3:9766a0f4:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_32:head v 82'1, mlcod=0'0)", 2024-05-08T18:31:52.562 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.665936+0000", 2024-05-08T18:31:52.562 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 9.8479083200000002, 2024-05-08T18:31:52.562 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015958892999999998, 2024-05-08T18:31:52.562 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:52.562 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:52.562 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:52.562 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:52.563 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.563 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:52.563 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.665936+0000", 2024-05-08T18:31:52.563 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:52.563 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.563 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.563 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:52.563 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.665936+0000", 2024-05-08T18:31:52.563 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:52.563 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.563 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.563 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:52.563 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.665937+0000", 2024-05-08T18:31:52.563 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3300000000000002e-07 2024-05-08T18:31:52.564 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.564 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.564 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:52.564 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.672096+0000", 2024-05-08T18:31:52.564 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0061585399999999997 2024-05-08T18:31:52.564 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.564 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.564 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:52.564 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.672123+0000", 2024-05-08T18:31:52.564 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7613000000000001e-05 2024-05-08T18:31:52.564 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.564 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.564 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:52.565 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.672139+0000", 2024-05-08T18:31:52.565 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5869999999999999e-05 2024-05-08T18:31:52.565 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.565 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.565 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:52.565 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.672222+0000", 2024-05-08T18:31:52.565 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2368999999999997e-05 2024-05-08T18:31:52.565 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.565 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.565 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:52.565 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.672255+0000", 2024-05-08T18:31:52.565 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3540000000000001e-05 2024-05-08T18:31:52.565 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.565 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.566 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:52.566 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.681740+0000", 2024-05-08T18:31:52.566 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0094849860000000008 2024-05-08T18:31:52.566 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.566 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.566 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:52.566 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.681895+0000", 2024-05-08T18:31:52.566 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015534199999999999 2024-05-08T18:31:52.566 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:52.566 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:52.566 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:52.566 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.566 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.567 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1349 3.27 e82/21 3:e5090c80:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_35:head v 82'1, mlcod=0'0)", 2024-05-08T18:31:52.567 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.699543+0000", 2024-05-08T18:31:52.567 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 9.8143022640000002, 2024-05-08T18:31:52.567 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016329854000000001, 2024-05-08T18:31:52.567 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:52.567 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:52.567 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:52.567 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:52.567 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.567 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:52.567 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.699543+0000", 2024-05-08T18:31:52.567 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:52.567 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.567 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.568 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:52.568 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.699543+0000", 2024-05-08T18:31:52.568 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:52.568 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.568 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.568 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:52.568 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.699545+0000", 2024-05-08T18:31:52.568 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6529999999999998e-06 2024-05-08T18:31:52.568 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.568 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.568 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:52.568 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.704546+0000", 2024-05-08T18:31:52.568 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0050003599999999997 2024-05-08T18:31:52.568 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.569 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.569 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:52.569 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.704582+0000", 2024-05-08T18:31:52.569 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6165999999999999e-05 2024-05-08T18:31:52.569 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.569 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.569 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:52.569 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.704599+0000", 2024-05-08T18:31:52.569 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.713e-05 2024-05-08T18:31:52.569 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.569 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.569 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:52.569 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.704734+0000", 2024-05-08T18:31:52.569 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000135012 2024-05-08T18:31:52.570 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.570 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.570 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:52.570 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.704776+0000", 2024-05-08T18:31:52.570 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.2626999999999997e-05 2024-05-08T18:31:52.570 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.570 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.570 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:52.570 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.715744+0000", 2024-05-08T18:31:52.570 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010967153 2024-05-08T18:31:52.570 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.570 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.570 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:52.571 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.715872+0000", 2024-05-08T18:31:52.571 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012875300000000001 2024-05-08T18:31:52.571 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:52.571 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:52.571 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:52.571 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.571 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.571 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1357 3.f e82/21 3:f2d0b7b2:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_43:head v 82'3, mlcod=81'1)", 2024-05-08T18:31:52.571 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.786870+0000", 2024-05-08T18:31:52.571 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 9.7269749389999998, 2024-05-08T18:31:52.571 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016941210000000002, 2024-05-08T18:31:52.571 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:52.571 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:52.571 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:52.571 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:52.572 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.572 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:52.572 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.786870+0000", 2024-05-08T18:31:52.572 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:52.572 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.572 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.572 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:52.572 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.786870+0000", 2024-05-08T18:31:52.572 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:52.572 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.572 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.573 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:52.573 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.786872+0000", 2024-05-08T18:31:52.573 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5770000000000001e-06 2024-05-08T18:31:52.573 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.573 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.573 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:52.573 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.789682+0000", 2024-05-08T18:31:52.573 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0028092859999999998 2024-05-08T18:31:52.573 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.573 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.573 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:52.573 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.789720+0000", 2024-05-08T18:31:52.574 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7932999999999997e-05 2024-05-08T18:31:52.574 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.574 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.574 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:52.574 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.789740+0000", 2024-05-08T18:31:52.574 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9862999999999999e-05 2024-05-08T18:31:52.574 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.574 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.574 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:52.574 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.789893+0000", 2024-05-08T18:31:52.575 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015356500000000001 2024-05-08T18:31:52.575 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.575 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.575 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:52.575 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.789961+0000", 2024-05-08T18:31:52.575 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8122999999999998e-05 2024-05-08T18:31:52.575 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.575 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.575 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:52.575 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.803714+0000", 2024-05-08T18:31:52.575 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013752664 2024-05-08T18:31:52.575 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.575 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.576 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:52.576 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.803811+0000", 2024-05-08T18:31:52.576 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7199000000000002e-05 2024-05-08T18:31:52.576 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:52.576 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:52.576 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:52.576 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.576 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.576 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1369 3.1 e82/21 3:83b9a38d:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_55:head v 82'1, mlcod=0'0)", 2024-05-08T18:31:52.576 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.908721+0000", 2024-05-08T18:31:52.576 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 9.6051238829999992, 2024-05-08T18:31:52.576 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016507898999999999, 2024-05-08T18:31:52.576 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:52.576 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:52.577 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:52.577 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:52.577 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.577 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:52.577 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.908721+0000", 2024-05-08T18:31:52.577 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:52.577 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.577 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.577 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:52.577 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.908721+0000", 2024-05-08T18:31:52.577 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:52.577 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.577 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.577 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:52.578 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.908722+0000", 2024-05-08T18:31:52.578 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1600000000000001e-07 2024-05-08T18:31:52.578 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.578 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.578 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:52.578 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.912935+0000", 2024-05-08T18:31:52.578 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0042138219999999999 2024-05-08T18:31:52.578 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.578 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.578 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:52.578 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.912970+0000", 2024-05-08T18:31:52.578 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4722999999999999e-05 2024-05-08T18:31:52.579 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.579 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.579 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:52.579 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.912988+0000", 2024-05-08T18:31:52.579 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7972999999999999e-05 2024-05-08T18:31:52.579 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.579 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.579 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:52.579 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.913127+0000", 2024-05-08T18:31:52.579 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013925600000000001 2024-05-08T18:31:52.579 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.579 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.579 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:52.580 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.913167+0000", 2024-05-08T18:31:52.580 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9928999999999997e-05 2024-05-08T18:31:52.580 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.580 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.580 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:52.580 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.925089+0000", 2024-05-08T18:31:52.580 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011921510999999999 2024-05-08T18:31:52.580 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.580 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.580 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:52.580 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.925229+0000", 2024-05-08T18:31:52.580 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014006899999999999 2024-05-08T18:31:52.581 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:52.581 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:52.581 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:52.581 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.581 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.581 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1370 3.9 3:91bbaad9:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_56:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:52.581 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.915888+0000", 2024-05-08T18:31:52.581 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 9.5979566740000006, 2024-05-08T18:31:52.581 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.028543105999999999, 2024-05-08T18:31:52.581 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:52.581 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:52.581 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:52.581 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:52.582 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:31:52.582 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:52.582 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1370 2024-05-08T18:31:52.582 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.582 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:52.582 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.582 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:52.582 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.915888+0000", 2024-05-08T18:31:52.582 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:52.583 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.583 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.583 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:52.583 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.915888+0000", 2024-05-08T18:31:52.583 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:52.583 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.583 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.583 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:52.583 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.915892+0000", 2024-05-08T18:31:52.583 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1269999999999996e-06 2024-05-08T18:31:52.583 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.583 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.583 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:52.584 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.919887+0000", 2024-05-08T18:31:52.584 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039945529999999996 2024-05-08T18:31:52.584 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.584 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.584 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:52.584 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.919929+0000", 2024-05-08T18:31:52.584 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1832999999999997e-05 2024-05-08T18:31:52.584 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.584 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.584 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:52.584 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.919950+0000", 2024-05-08T18:31:52.584 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1197000000000001e-05 2024-05-08T18:31:52.584 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.584 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.585 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:52.585 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.920108+0000", 2024-05-08T18:31:52.585 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015827899999999999 2024-05-08T18:31:52.585 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.585 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.585 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:52.585 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.920401+0000", 2024-05-08T18:31:52.585 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029259799999999998 2024-05-08T18:31:52.585 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.585 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.585 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-05-08T18:31:52.585 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.920625+0000", 2024-05-08T18:31:52.585 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022383099999999999 2024-05-08T18:31:52.586 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.586 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.586 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:52.586 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.933935+0000", 2024-05-08T18:31:52.586 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013310298999999999 2024-05-08T18:31:52.586 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.586 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.586 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:52.586 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.944330+0000", 2024-05-08T18:31:52.586 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010395107000000001 2024-05-08T18:31:52.586 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.586 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.587 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:52.587 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.944383+0000", 2024-05-08T18:31:52.587 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2772000000000002e-05 2024-05-08T18:31:52.587 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.587 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.587 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:52.587 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.944431+0000", 2024-05-08T18:31:52.587 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8510000000000001e-05 2024-05-08T18:31:52.587 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:52.587 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:52.587 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:52.587 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.587 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.587 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1385 3.1a 3:5abdd61d:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_71:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:52.588 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:43.106312+0000", 2024-05-08T18:31:52.588 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 9.4075330949999998, 2024-05-08T18:31:52.588 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018362961000000001, 2024-05-08T18:31:52.588 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:52.588 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:52.588 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:52.588 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:52.588 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:31:52.588 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:52.588 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1385 2024-05-08T18:31:52.588 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.588 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:52.588 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.589 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:52.589 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.106312+0000", 2024-05-08T18:31:52.589 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:52.589 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.589 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.589 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:52.589 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.106312+0000", 2024-05-08T18:31:52.589 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:52.589 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.589 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.590 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:52.590 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.106316+0000", 2024-05-08T18:31:52.590 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8739999999999997e-06 2024-05-08T18:31:52.590 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.590 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.590 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:52.590 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.110250+0000", 2024-05-08T18:31:52.590 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039342600000000002 2024-05-08T18:31:52.590 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.590 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.590 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:52.591 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.110289+0000", 2024-05-08T18:31:52.591 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8782999999999998e-05 2024-05-08T18:31:52.591 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.591 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.591 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:52.591 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.110306+0000", 2024-05-08T18:31:52.591 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7793000000000001e-05 2024-05-08T18:31:52.591 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.591 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.591 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:52.591 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.110454+0000", 2024-05-08T18:31:52.591 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014750899999999999 2024-05-08T18:31:52.591 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.591 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.592 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:52.592 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.110700+0000", 2024-05-08T18:31:52.592 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00024594500000000002 2024-05-08T18:31:52.592 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.592 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.592 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:31:52.592 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.110951+0000", 2024-05-08T18:31:52.592 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00025154499999999999 2024-05-08T18:31:52.592 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.592 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.592 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:52.592 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.120973+0000", 2024-05-08T18:31:52.593 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010021835999999999 2024-05-08T18:31:52.593 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.593 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.593 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:52.593 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.124583+0000", 2024-05-08T18:31:52.593 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0036096840000000002 2024-05-08T18:31:52.593 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.593 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.593 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:52.593 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.124630+0000", 2024-05-08T18:31:52.593 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7419000000000001e-05 2024-05-08T18:31:52.594 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.594 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.594 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:52.594 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.124675+0000", 2024-05-08T18:31:52.594 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4313000000000001e-05 2024-05-08T18:31:52.594 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:52.594 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:52.594 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:52.594 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.594 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.594 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1409 3.3 3:c39a24d8:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_95:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:52.594 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:43.363571+0000", 2024-05-08T18:31:52.595 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 9.1502736040000006, 2024-05-08T18:31:52.595 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.021085779999999998, 2024-05-08T18:31:52.595 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:52.595 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:52.595 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:52.595 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:52.595 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:31:52.595 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:52.595 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1409 2024-05-08T18:31:52.595 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.595 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:52.595 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.595 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:52.596 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.363571+0000", 2024-05-08T18:31:52.596 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:52.596 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.596 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.596 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:52.596 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.363571+0000", 2024-05-08T18:31:52.596 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:52.596 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.596 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.596 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:52.596 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.363575+0000", 2024-05-08T18:31:52.596 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7579999999999998e-06 2024-05-08T18:31:52.596 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.596 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.597 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:52.597 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.368212+0000", 2024-05-08T18:31:52.597 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0046369269999999999 2024-05-08T18:31:52.597 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.597 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.597 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:52.597 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.368236+0000", 2024-05-08T18:31:52.597 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.442e-05 2024-05-08T18:31:52.597 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.597 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.597 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:52.597 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.368249+0000", 2024-05-08T18:31:52.597 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2451e-05 2024-05-08T18:31:52.597 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.598 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.598 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:52.598 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.368370+0000", 2024-05-08T18:31:52.598 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000121166 2024-05-08T18:31:52.598 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.598 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.598 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:52.598 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.368577+0000", 2024-05-08T18:31:52.598 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000207429 2024-05-08T18:31:52.598 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.598 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.598 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:52.599 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.368761+0000", 2024-05-08T18:31:52.599 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00018409599999999999 2024-05-08T18:31:52.599 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.599 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.599 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:52.599 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.379675+0000", 2024-05-08T18:31:52.599 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010913058999999999 2024-05-08T18:31:52.599 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.599 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.599 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:52.599 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.384574+0000", 2024-05-08T18:31:52.599 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.004899937 2024-05-08T18:31:52.599 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.600 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.600 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:52.600 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.384616+0000", 2024-05-08T18:31:52.600 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.2035e-05 2024-05-08T18:31:52.600 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.600 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.600 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:52.600 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.384657+0000", 2024-05-08T18:31:52.600 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0501999999999999e-05 2024-05-08T18:31:52.600 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:52.600 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:52.600 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:52.600 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.600 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.601 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1414 3.29 e82/21 3:946e7bc1:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_100:head v 82'2, mlcod=0'0)", 2024-05-08T18:31:52.601 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:43.414971+0000", 2024-05-08T18:31:52.601 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 9.0988742459999994, 2024-05-08T18:31:52.601 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015207076999999999, 2024-05-08T18:31:52.601 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:52.601 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:52.601 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:52.601 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:52.601 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.601 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:52.601 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.414971+0000", 2024-05-08T18:31:52.601 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:52.601 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.601 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.602 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:52.602 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.414971+0000", 2024-05-08T18:31:52.602 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:52.602 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.602 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.602 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:52.602 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.414972+0000", 2024-05-08T18:31:52.602 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6729999999999999e-06 2024-05-08T18:31:52.602 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.602 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.602 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:52.602 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.420875+0000", 2024-05-08T18:31:52.603 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0059031379999999996 2024-05-08T18:31:52.603 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.603 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.603 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:52.603 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.420911+0000", 2024-05-08T18:31:52.603 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5963000000000001e-05 2024-05-08T18:31:52.603 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.603 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.603 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:52.603 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.420928+0000", 2024-05-08T18:31:52.603 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7045999999999999e-05 2024-05-08T18:31:52.603 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.603 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.604 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:52.604 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.421019+0000", 2024-05-08T18:31:52.604 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.0941999999999998e-05 2024-05-08T18:31:52.604 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.604 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.604 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:52.604 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.421047+0000", 2024-05-08T18:31:52.604 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7246e-05 2024-05-08T18:31:52.604 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.604 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.604 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:52.604 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.430078+0000", 2024-05-08T18:31:52.604 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0090311369999999998 2024-05-08T18:31:52.605 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.605 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.605 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:52.605 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.430178+0000", 2024-05-08T18:31:52.605 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.9932000000000005e-05 2024-05-08T18:31:52.605 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:52.605 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:52.605 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:52.605 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.605 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.605 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1614 3.14 3:284b5d90:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-05-08T18:31:52.605 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:46.708825+0000", 2024-05-08T18:31:52.605 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 5.8050193910000001, 2024-05-08T18:31:52.606 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.032864125000000001, 2024-05-08T18:31:52.606 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:52.606 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:52.606 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:52.606 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:52.606 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:31:52.606 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:52.606 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1614 2024-05-08T18:31:52.606 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.606 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:52.606 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.606 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:52.607 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.708825+0000", 2024-05-08T18:31:52.607 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:52.607 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.607 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.607 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:52.607 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.708825+0000", 2024-05-08T18:31:52.607 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:52.607 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.607 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.607 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:52.607 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.708828+0000", 2024-05-08T18:31:52.607 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6630000000000002e-06 2024-05-08T18:31:52.607 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.608 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.608 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:52.608 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.715671+0000", 2024-05-08T18:31:52.608 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.006842669 2024-05-08T18:31:52.608 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.608 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.608 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:52.608 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.715706+0000", 2024-05-08T18:31:52.608 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4872000000000001e-05 2024-05-08T18:31:52.608 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.608 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.608 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:52.608 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.715722+0000", 2024-05-08T18:31:52.609 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6670000000000001e-05 2024-05-08T18:31:52.609 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.609 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.609 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:52.609 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.715850+0000", 2024-05-08T18:31:52.609 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000127322 2024-05-08T18:31:52.609 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.609 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.609 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:52.609 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.716102+0000", 2024-05-08T18:31:52.609 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00025211899999999998 2024-05-08T18:31:52.609 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.609 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.610 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:52.610 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.716339+0000", 2024-05-08T18:31:52.610 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00023702099999999999 2024-05-08T18:31:52.610 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.610 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.610 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:52.610 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.737899+0000", 2024-05-08T18:31:52.610 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.021560414 2024-05-08T18:31:52.610 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.610 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.610 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:52.610 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.741414+0000", 2024-05-08T18:31:52.610 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0035152669999999999 2024-05-08T18:31:52.611 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.611 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.611 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:52.611 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.741571+0000", 2024-05-08T18:31:52.611 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015644500000000001 2024-05-08T18:31:52.611 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.611 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.611 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:52.611 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.741690+0000", 2024-05-08T18:31:52.611 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000118663 2024-05-08T18:31:52.611 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:52.611 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:52.612 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:52.612 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.612 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.612 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1622 3.11 e83/21 3:8a36e97a:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_10:head v 83'7, mlcod=82'5)", 2024-05-08T18:31:52.612 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:46.797808+0000", 2024-05-08T18:31:52.612 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 5.7160372720000003, 2024-05-08T18:31:52.612 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019395200000000001, 2024-05-08T18:31:52.612 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:52.612 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:52.612 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:52.612 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:52.612 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.612 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:52.613 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.797808+0000", 2024-05-08T18:31:52.613 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:52.613 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.613 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.613 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:52.613 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.797808+0000", 2024-05-08T18:31:52.613 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:52.613 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.613 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.613 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:52.613 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.797810+0000", 2024-05-08T18:31:52.613 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9800000000000001e-06 2024-05-08T18:31:52.613 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.613 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.614 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:52.614 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.801567+0000", 2024-05-08T18:31:52.614 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0037578709999999999 2024-05-08T18:31:52.614 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.614 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.614 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:52.614 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.801610+0000", 2024-05-08T18:31:52.614 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3013000000000003e-05 2024-05-08T18:31:52.614 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.614 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.614 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:52.614 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.801628+0000", 2024-05-08T18:31:52.615 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7677e-05 2024-05-08T18:31:52.615 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.615 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.615 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:52.615 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.801798+0000", 2024-05-08T18:31:52.615 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000169548 2024-05-08T18:31:52.615 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.615 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.615 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:52.615 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.801836+0000", 2024-05-08T18:31:52.615 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.799e-05 2024-05-08T18:31:52.615 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.615 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.616 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:52.616 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.817068+0000", 2024-05-08T18:31:52.616 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015232671999999999 2024-05-08T18:31:52.616 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.616 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.616 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:52.616 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.817203+0000", 2024-05-08T18:31:52.616 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000134449 2024-05-08T18:31:52.616 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:52.616 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:52.616 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:52.616 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.616 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.617 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1629 3.24 e83/21 3:27d2a12f:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_17:head v 83'2, mlcod=0'0)", 2024-05-08T18:31:52.617 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:46.875375+0000", 2024-05-08T18:31:52.617 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 5.6384695730000001, 2024-05-08T18:31:52.617 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017035814, 2024-05-08T18:31:52.617 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:52.617 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:52.617 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:52.617 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:52.617 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.617 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:52.617 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.875375+0000", 2024-05-08T18:31:52.617 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:52.617 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.618 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.618 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:52.618 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.875375+0000", 2024-05-08T18:31:52.618 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:52.618 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.618 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.618 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:52.618 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.875378+0000", 2024-05-08T18:31:52.618 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6029999999999999e-06 2024-05-08T18:31:52.618 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.618 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.618 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:52.618 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.880781+0000", 2024-05-08T18:31:52.619 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0054034319999999997 2024-05-08T18:31:52.619 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.619 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.619 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:52.619 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.880818+0000", 2024-05-08T18:31:52.619 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6303000000000001e-05 2024-05-08T18:31:52.619 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.619 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.619 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:52.619 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.880833+0000", 2024-05-08T18:31:52.619 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5852999999999999e-05 2024-05-08T18:31:52.619 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.619 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.620 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:52.620 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.880987+0000", 2024-05-08T18:31:52.620 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015368599999999999 2024-05-08T18:31:52.620 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.620 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.620 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:52.620 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.881053+0000", 2024-05-08T18:31:52.620 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6260000000000006e-05 2024-05-08T18:31:52.620 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.620 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.620 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:52.620 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.892244+0000", 2024-05-08T18:31:52.620 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011191002 2024-05-08T18:31:52.621 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.621 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.621 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:52.621 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.892411+0000", 2024-05-08T18:31:52.621 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000166675 2024-05-08T18:31:52.621 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:52.621 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:52.621 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:52.621 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.621 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.621 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1638 3.9 3:9152f27e:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5_100Mb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-05-08T18:31:52.621 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:46.965638+0000", 2024-05-08T18:31:52.621 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 5.5482069010000004, 2024-05-08T18:31:52.622 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.021363499000000001, 2024-05-08T18:31:52.622 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:52.622 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:52.622 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:52.622 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:52.622 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:31:52.622 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:52.622 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1638 2024-05-08T18:31:52.622 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.622 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:52.622 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.622 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:52.622 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.965638+0000", 2024-05-08T18:31:52.623 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:52.623 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.623 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.623 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:52.623 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.965638+0000", 2024-05-08T18:31:52.623 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:52.623 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.623 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.623 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:52.623 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.965640+0000", 2024-05-08T18:31:52.623 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.68e-06 2024-05-08T18:31:52.623 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.623 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.624 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:52.624 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.969701+0000", 2024-05-08T18:31:52.624 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0040609870000000003 2024-05-08T18:31:52.624 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.624 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.624 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:52.624 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.969734+0000", 2024-05-08T18:31:52.624 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3460000000000002e-05 2024-05-08T18:31:52.624 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.624 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.624 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:52.624 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.969750+0000", 2024-05-08T18:31:52.624 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5919000000000001e-05 2024-05-08T18:31:52.624 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.624 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.625 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:52.625 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.969886+0000", 2024-05-08T18:31:52.625 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000135759 2024-05-08T18:31:52.625 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.625 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.625 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:52.625 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.970159+0000", 2024-05-08T18:31:52.625 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00027367199999999998 2024-05-08T18:31:52.625 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.625 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.625 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-05-08T18:31:52.625 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.971062+0000", 2024-05-08T18:31:52.626 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00090291000000000004 2024-05-08T18:31:52.626 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.626 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.626 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:52.626 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.983851+0000", 2024-05-08T18:31:52.626 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012788882999999999 2024-05-08T18:31:52.626 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.626 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.626 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:52.626 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.986511+0000", 2024-05-08T18:31:52.626 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0026593530000000002 2024-05-08T18:31:52.626 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.626 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.626 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:52.627 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.986843+0000", 2024-05-08T18:31:52.627 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00033259400000000002 2024-05-08T18:31:52.627 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:52.627 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:52.627 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:52.627 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.987001+0000", 2024-05-08T18:31:52.627 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015828199999999999 2024-05-08T18:31:52.627 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:52.627 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:52.627 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:52.627 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:52.627 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:52.627 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:31:52.628 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-08T18:31:52.630 INFO:teuthology.orchestra.run.smithi097.stderr:reweighted osd.1 to 1 (10000) 2024-05-08T18:31:52.630 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-08T18:31:52.631 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-05-08T18:31:52.631 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:31:52.629+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:31:52.730 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:31:52.729+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:31:52.760 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:31:52.760 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:31:52.760 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 0 2024-05-08T18:31:52.760 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:31:52.774 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-08T18:31:52.812 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2024-05-08T18:31:52.813 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:31:52.829 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2024-05-08T18:31:52.829 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:31:52.830 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:31:52.826+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:31:52.845 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2024-05-08T18:31:52.845 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:31:52.860 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2024-05-08T18:31:52.861 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:31:52.880 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2024-05-08T18:31:52.880 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:31:52.900 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:52.900 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:52.901 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2024-05-08T18:31:52.901 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:31:52.915 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-08T18:31:52.918 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2024-05-08T18:31:52.918 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:31:52.932 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:31:52.933+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:31:52.935 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2024-05-08T18:31:52.936 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:31:53.033 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:31:53.033+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:31:53.083 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:53.083 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:53.097 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-08T18:31:53.134 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:31:53.133+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:31:53.215 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:53.216 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:53.229 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-08T18:31:53.272 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:31:53.270+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:31:53.336 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:31:53.337+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:31:53.352 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:53.352 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:53.366 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-08T18:31:53.452 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:31:53.450+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:31:53.532 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:53.533 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:53.538 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:31:53.537+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:31:53.546 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-08T18:31:53.620 INFO:teuthology.orchestra.run.smithi097.stderr:reweighted osd.2 to 1 (10000) 2024-05-08T18:31:53.622 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-08T18:31:53.645 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-05-08T18:31:53.646 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:31:53.645+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:31:53.711 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:53.712 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:53.726 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-08T18:31:53.739 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:31:53.737+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:31:53.839 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:31:53.837+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:31:53.846 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:53.846 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:53.860 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-08T18:31:53.940 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:31:53.941+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:31:53.978 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:53.978 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:53.992 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-08T18:31:54.041 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:31:54.041+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:31:54.104 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:54.104 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:54.116 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-08T18:31:54.143 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:31:54.142+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:31:54.243 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:31:54.241+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:31:54.284 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:54.284 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:54.298 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-08T18:31:54.384 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:31:54.385+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:31:54.445 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:31:54.445+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:31:54.466 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:54.466 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:54.480 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-08T18:31:54.572 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:31:54.573+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:31:54.636 INFO:teuthology.orchestra.run.smithi097.stderr:noscrub is unset 2024-05-08T18:31:54.646 INFO:teuthology.orchestra.run.smithi097.stderr:reweighted osd.3 to 1 (10000) 2024-05-08T18:31:54.646 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:31:54.645+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:31:54.665 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:54.665 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:54.667 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-05-08T18:31:54.679 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-08T18:31:54.768 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:31:54.769+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:31:54.838 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:54.838 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:54.849 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:31:54.846+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:31:54.854 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-08T18:31:54.949 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:31:54.950+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:31:54.952 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-08T18:31:55.010 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:55.010 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:55.024 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-08T18:31:55.049 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:31:55.046+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:31:55.087 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2024-05-08T18:31:55.087 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:31:55.103 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2024-05-08T18:31:55.103 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:31:55.118 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2024-05-08T18:31:55.119 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:31:55.134 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2024-05-08T18:31:55.134 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:31:55.137 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:55.137 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:31:55.137 INFO:teuthology.orchestra.run.smithi097.stdout: "num_ops": 0 2024-05-08T18:31:55.137 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:55.150 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:31:55.149+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:31:55.151 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-08T18:31:55.155 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2024-05-08T18:31:55.155 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:31:55.176 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2024-05-08T18:31:55.176 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:31:55.195 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2024-05-08T18:31:55.196 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:31:55.215 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2024-05-08T18:31:55.216 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:31:55.264 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:55.264 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:31:55.264 INFO:teuthology.orchestra.run.smithi097.stdout: "complaint_time": 30, 2024-05-08T18:31:55.264 INFO:teuthology.orchestra.run.smithi097.stdout: "num_blocked_ops": 0 2024-05-08T18:31:55.264 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:55.264 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:31:55.265+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:31:55.277 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-08T18:31:55.352 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:31:55.350+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:31:55.442 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:55.442 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2024-05-08T18:31:55.442 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2024-05-08T18:31:55.442 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-05-08T18:31:55.443 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.443 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1316 3.0 e81/21 3:03a68e79:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_2:head v 81'1, mlcod=0'0)", 2024-05-08T18:31:55.443 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.318330+0000", 2024-05-08T18:31:55.443 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 13.121584361, 2024-05-08T18:31:55.443 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.015176533000000001, 2024-05-08T18:31:55.443 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:55.443 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:55.443 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:55.443 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:55.443 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.443 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:55.443 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.318330+0000", 2024-05-08T18:31:55.444 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:55.444 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.444 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.444 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:55.444 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.318330+0000", 2024-05-08T18:31:55.444 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:55.444 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.444 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.444 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:55.444 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.318333+0000", 2024-05-08T18:31:55.444 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9629999999999998e-06 2024-05-08T18:31:55.444 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.444 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.445 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:55.445 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.323328+0000", 2024-05-08T18:31:55.445 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.004995172 2024-05-08T18:31:55.445 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.445 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.445 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:55.445 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.323366+0000", 2024-05-08T18:31:55.445 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7837999999999999e-05 2024-05-08T18:31:55.445 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.445 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.445 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:55.445 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.323391+0000", 2024-05-08T18:31:55.445 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4913e-05 2024-05-08T18:31:55.446 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.446 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.446 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:55.446 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.323520+0000", 2024-05-08T18:31:55.446 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000129238 2024-05-08T18:31:55.446 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.446 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.446 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:55.446 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.323546+0000", 2024-05-08T18:31:55.446 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5508999999999999e-05 2024-05-08T18:31:55.446 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.447 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.447 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:55.447 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.333439+0000", 2024-05-08T18:31:55.447 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0098928169999999999 2024-05-08T18:31:55.447 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.447 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.447 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:55.447 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.333507+0000", 2024-05-08T18:31:55.448 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8083000000000005e-05 2024-05-08T18:31:55.448 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:55.448 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:55.448 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:55.448 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.448 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.448 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1317 3.2d e81/21 3:b70e9396:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_3:head v 81'1, mlcod=0'0)", 2024-05-08T18:31:55.448 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.331170+0000", 2024-05-08T18:31:55.448 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 13.108744092, 2024-05-08T18:31:55.449 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019680382, 2024-05-08T18:31:55.449 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:55.449 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:55.449 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:55.449 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:55.449 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.449 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:55.449 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.331170+0000", 2024-05-08T18:31:55.449 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:55.449 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.449 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.450 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:55.450 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.331170+0000", 2024-05-08T18:31:55.450 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:55.450 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.450 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.450 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:55.450 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.331172+0000", 2024-05-08T18:31:55.450 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.933e-06 2024-05-08T18:31:55.450 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.450 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.450 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:55.450 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.341697+0000", 2024-05-08T18:31:55.450 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010524759999999999 2024-05-08T18:31:55.451 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.451 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.451 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:55.451 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.341753+0000", 2024-05-08T18:31:55.451 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5828000000000001e-05 2024-05-08T18:31:55.451 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.451 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.451 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:55.451 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.341776+0000", 2024-05-08T18:31:55.451 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3379000000000001e-05 2024-05-08T18:31:55.451 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.451 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.451 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:55.452 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.341871+0000", 2024-05-08T18:31:55.452 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.4307000000000004e-05 2024-05-08T18:31:55.452 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.452 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.452 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:55.452 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.341895+0000", 2024-05-08T18:31:55.452 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4629000000000001e-05 2024-05-08T18:31:55.452 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.452 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.452 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:55.452 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.350793+0000", 2024-05-08T18:31:55.452 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0088981219999999996 2024-05-08T18:31:55.452 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.452 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.453 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:55.453 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.350851+0000", 2024-05-08T18:31:55.453 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7423999999999998e-05 2024-05-08T18:31:55.453 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:55.453 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:55.453 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:55.453 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.453 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.453 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1325 3.2d e81/21 3:b7fa4974:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_11:head v 81'2, mlcod=0'0)", 2024-05-08T18:31:55.453 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.444803+0000", 2024-05-08T18:31:55.453 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 12.995111209999999, 2024-05-08T18:31:55.454 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012603454, 2024-05-08T18:31:55.454 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:55.454 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:55.454 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:55.454 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:55.454 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.454 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:55.454 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.444803+0000", 2024-05-08T18:31:55.454 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:55.454 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.454 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.454 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:55.454 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.444803+0000", 2024-05-08T18:31:55.455 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:55.455 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.455 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.455 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:55.455 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.444805+0000", 2024-05-08T18:31:55.455 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.782e-06 2024-05-08T18:31:55.455 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.455 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.455 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:55.455 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.448805+0000", 2024-05-08T18:31:55.455 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0040002859999999996 2024-05-08T18:31:55.455 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.455 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.455 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:55.456 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.448828+0000", 2024-05-08T18:31:55.456 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2748e-05 2024-05-08T18:31:55.456 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.456 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.456 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:55.456 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.448841+0000", 2024-05-08T18:31:55.456 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2456000000000001e-05 2024-05-08T18:31:55.456 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.456 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.456 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:55.456 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.448917+0000", 2024-05-08T18:31:55.456 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6643000000000005e-05 2024-05-08T18:31:55.456 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.456 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.457 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:55.457 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.448945+0000", 2024-05-08T18:31:55.457 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7656000000000001e-05 2024-05-08T18:31:55.457 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.457 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.457 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:55.457 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.457322+0000", 2024-05-08T18:31:55.457 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0083770990000000007 2024-05-08T18:31:55.457 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.457 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.457 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:55.457 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.457407+0000", 2024-05-08T18:31:55.457 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.4783999999999993e-05 2024-05-08T18:31:55.458 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:55.458 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:55.458 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:55.458 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.458 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.458 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1329 3.21 3:87d2ef9d:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-08T18:31:55.458 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.483324+0000", 2024-05-08T18:31:55.458 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 12.956590287000001, 2024-05-08T18:31:55.458 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.020245062000000001, 2024-05-08T18:31:55.459 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:55.459 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:55.459 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:55.459 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:55.459 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:55.459 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:55.459 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1329 2024-05-08T18:31:55.459 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.459 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:55.459 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.459 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:55.459 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.483324+0000", 2024-05-08T18:31:55.459 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:55.460 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.460 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.460 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:55.460 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.483324+0000", 2024-05-08T18:31:55.460 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:55.460 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.460 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.460 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:55.460 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.483328+0000", 2024-05-08T18:31:55.460 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3160000000000001e-06 2024-05-08T18:31:55.460 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.460 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.460 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:55.460 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.484909+0000", 2024-05-08T18:31:55.461 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001581325 2024-05-08T18:31:55.461 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.461 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.461 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:55.461 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.484935+0000", 2024-05-08T18:31:55.461 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5746999999999999e-05 2024-05-08T18:31:55.461 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.461 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.461 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:55.461 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.484945+0000", 2024-05-08T18:31:55.461 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0827e-05 2024-05-08T18:31:55.461 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.461 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.462 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:55.462 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.485031+0000", 2024-05-08T18:31:55.462 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5811999999999998e-05 2024-05-08T18:31:55.462 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.462 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.462 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:55.462 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.485229+0000", 2024-05-08T18:31:55.462 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00019749000000000001 2024-05-08T18:31:55.462 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.462 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.462 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:55.462 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.485390+0000", 2024-05-08T18:31:55.462 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000161058 2024-05-08T18:31:55.462 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.463 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.463 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:55.463 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.492144+0000", 2024-05-08T18:31:55.463 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0067546109999999998 2024-05-08T18:31:55.463 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.463 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.463 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:55.463 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.503464+0000", 2024-05-08T18:31:55.463 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011319997 2024-05-08T18:31:55.463 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.463 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.463 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:55.463 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.503515+0000", 2024-05-08T18:31:55.464 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.0132e-05 2024-05-08T18:31:55.464 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.464 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.464 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:55.464 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.503569+0000", 2024-05-08T18:31:55.464 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4747000000000003e-05 2024-05-08T18:31:55.464 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:55.464 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:55.464 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:55.464 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.464 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.464 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1341 3.5 3:a0d72baa:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_27:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:55.464 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.613380+0000", 2024-05-08T18:31:55.464 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 12.826534865999999, 2024-05-08T18:31:55.465 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.016698074, 2024-05-08T18:31:55.465 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:55.465 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:55.465 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:55.465 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:55.465 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:55.465 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:55.465 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1341 2024-05-08T18:31:55.465 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.465 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:55.465 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.465 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:55.465 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.613380+0000", 2024-05-08T18:31:55.465 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:55.466 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.466 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.466 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:55.466 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.613380+0000", 2024-05-08T18:31:55.466 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:55.467 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.467 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.467 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:55.467 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.613382+0000", 2024-05-08T18:31:55.467 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5979999999999999e-06 2024-05-08T18:31:55.467 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.467 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.467 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:55.467 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.615142+0000", 2024-05-08T18:31:55.467 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0017599040000000001 2024-05-08T18:31:55.467 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.467 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.467 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:55.467 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.615174+0000", 2024-05-08T18:31:55.468 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1458000000000003e-05 2024-05-08T18:31:55.468 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.468 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.468 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:55.468 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.615189+0000", 2024-05-08T18:31:55.468 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5809000000000001e-05 2024-05-08T18:31:55.468 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.468 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.468 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:55.469 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.615267+0000", 2024-05-08T18:31:55.469 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7898999999999994e-05 2024-05-08T18:31:55.469 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.469 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.469 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:55.469 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.615393+0000", 2024-05-08T18:31:55.469 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012611999999999999 2024-05-08T18:31:55.469 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.469 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.469 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:55.469 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.615500+0000", 2024-05-08T18:31:55.469 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010621899999999999 2024-05-08T18:31:55.469 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.470 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.470 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:55.470 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.627687+0000", 2024-05-08T18:31:55.470 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012186936000000001 2024-05-08T18:31:55.470 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.470 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.470 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:55.470 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.629963+0000", 2024-05-08T18:31:55.470 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0022760160000000001 2024-05-08T18:31:55.470 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.470 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.470 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:55.470 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.630025+0000", 2024-05-08T18:31:55.470 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.2409999999999994e-05 2024-05-08T18:31:55.471 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.471 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.471 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:55.471 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.630078+0000", 2024-05-08T18:31:55.471 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.2704999999999998e-05 2024-05-08T18:31:55.471 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:55.471 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:55.471 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:55.471 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.471 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.471 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1343 3.39 3:9f4e1e83:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_29:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:55.471 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.634194+0000", 2024-05-08T18:31:55.471 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 12.805720527, 2024-05-08T18:31:55.472 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.014278074999999999, 2024-05-08T18:31:55.472 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:55.472 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:55.472 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:55.472 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:55.472 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:55.472 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:55.472 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1343 2024-05-08T18:31:55.472 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.472 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:55.472 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.472 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:55.472 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.634194+0000", 2024-05-08T18:31:55.472 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:55.473 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.473 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.473 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:55.473 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.634194+0000", 2024-05-08T18:31:55.473 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:55.473 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.473 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.473 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:55.473 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.634197+0000", 2024-05-08T18:31:55.473 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0620000000000001e-06 2024-05-08T18:31:55.473 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.473 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.473 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:55.473 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.635963+0000", 2024-05-08T18:31:55.474 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001766098 2024-05-08T18:31:55.474 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.474 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.474 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:55.474 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.635987+0000", 2024-05-08T18:31:55.474 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3360999999999999e-05 2024-05-08T18:31:55.474 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.474 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.474 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:55.474 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.635998+0000", 2024-05-08T18:31:55.474 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1284000000000001e-05 2024-05-08T18:31:55.474 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.474 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.475 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:55.475 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.636079+0000", 2024-05-08T18:31:55.475 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.1493000000000001e-05 2024-05-08T18:31:55.475 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.475 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.475 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:55.475 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.636262+0000", 2024-05-08T18:31:55.475 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00018223999999999999 2024-05-08T18:31:55.475 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.475 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.475 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:55.475 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.636417+0000", 2024-05-08T18:31:55.475 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015549699999999999 2024-05-08T18:31:55.476 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.476 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.476 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:55.476 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.648058+0000", 2024-05-08T18:31:55.476 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011640908 2024-05-08T18:31:55.476 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.476 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.476 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:55.476 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.648354+0000", 2024-05-08T18:31:55.476 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00029571799999999999 2024-05-08T18:31:55.476 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.476 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.477 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:55.477 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.648420+0000", 2024-05-08T18:31:55.477 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6818999999999998e-05 2024-05-08T18:31:55.477 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.477 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.477 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:55.477 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.648472+0000", 2024-05-08T18:31:55.477 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.1595000000000003e-05 2024-05-08T18:31:55.477 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:55.477 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:55.477 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:55.477 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.477 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.478 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1352 3.0 e82/21 3:0085bede:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_38:head v 82'2, mlcod=0'0)", 2024-05-08T18:31:55.478 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.732652+0000", 2024-05-08T18:31:55.478 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 12.707262061, 2024-05-08T18:31:55.478 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010931293, 2024-05-08T18:31:55.478 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:55.478 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:55.478 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:55.478 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:55.478 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.478 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:55.478 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.732652+0000", 2024-05-08T18:31:55.479 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:55.479 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.479 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.479 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:55.479 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.732652+0000", 2024-05-08T18:31:55.479 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:55.479 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.479 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.479 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:55.479 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.732653+0000", 2024-05-08T18:31:55.480 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.13e-07 2024-05-08T18:31:55.480 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.480 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.480 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:55.480 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.734222+0000", 2024-05-08T18:31:55.480 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00156931 2024-05-08T18:31:55.480 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.480 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.480 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:55.481 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.734248+0000", 2024-05-08T18:31:55.481 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.527e-05 2024-05-08T18:31:55.481 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.481 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.481 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:55.481 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.734261+0000", 2024-05-08T18:31:55.481 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3509999999999999e-05 2024-05-08T18:31:55.481 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.481 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.481 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:55.481 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.734331+0000", 2024-05-08T18:31:55.481 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9790999999999996e-05 2024-05-08T18:31:55.481 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.481 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.482 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:55.482 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.734351+0000", 2024-05-08T18:31:55.482 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9775e-05 2024-05-08T18:31:55.482 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.482 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.482 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:55.482 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.743520+0000", 2024-05-08T18:31:55.482 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0091690599999999997 2024-05-08T18:31:55.482 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.482 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.482 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:55.482 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.743584+0000", 2024-05-08T18:31:55.482 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.4064000000000002e-05 2024-05-08T18:31:55.483 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:55.483 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:55.483 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:55.483 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.483 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.483 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1358 3.5 3:a0d2e4cd:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_44:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:55.483 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.792476+0000", 2024-05-08T18:31:55.483 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 12.647438484, 2024-05-08T18:31:55.484 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.017319887999999999, 2024-05-08T18:31:55.484 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:55.484 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:55.484 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:55.484 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:55.484 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:55.484 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:55.485 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1358 2024-05-08T18:31:55.485 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.485 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:55.485 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.485 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:55.485 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.792476+0000", 2024-05-08T18:31:55.486 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:55.486 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.486 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.486 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:55.486 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.792476+0000", 2024-05-08T18:31:55.486 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:55.486 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.487 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.487 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:55.487 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.792480+0000", 2024-05-08T18:31:55.487 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6780000000000002e-06 2024-05-08T18:31:55.487 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.487 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.487 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:55.487 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.794611+0000", 2024-05-08T18:31:55.487 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0021309689999999999 2024-05-08T18:31:55.487 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.488 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.488 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:55.488 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.794635+0000", 2024-05-08T18:31:55.488 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4210999999999999e-05 2024-05-08T18:31:55.488 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.488 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.488 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:55.488 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.794646+0000", 2024-05-08T18:31:55.488 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0939e-05 2024-05-08T18:31:55.489 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.489 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.489 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:55.489 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.794720+0000", 2024-05-08T18:31:55.489 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.4257000000000004e-05 2024-05-08T18:31:55.489 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.489 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.489 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:55.489 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.794848+0000", 2024-05-08T18:31:55.489 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000128279 2024-05-08T18:31:55.489 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.489 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.490 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:55.490 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.794981+0000", 2024-05-08T18:31:55.490 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013264099999999999 2024-05-08T18:31:55.490 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.490 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.490 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:55.490 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.806096+0000", 2024-05-08T18:31:55.490 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011114702000000001 2024-05-08T18:31:55.490 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.490 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.490 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:55.491 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.809702+0000", 2024-05-08T18:31:55.491 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0036063660000000002 2024-05-08T18:31:55.491 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.491 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.491 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:55.491 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.809749+0000", 2024-05-08T18:31:55.492 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6564999999999999e-05 2024-05-08T18:31:55.492 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.492 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.492 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:55.492 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.809796+0000", 2024-05-08T18:31:55.492 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7280999999999997e-05 2024-05-08T18:31:55.493 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:55.493 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:55.493 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:55.493 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.493 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.493 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1366 3.39 3:9c29fb9f:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_52:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:55.493 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.873737+0000", 2024-05-08T18:31:55.494 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 12.566177416, 2024-05-08T18:31:55.494 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.013710574, 2024-05-08T18:31:55.494 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:55.494 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:55.494 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:55.494 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:55.494 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:55.494 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:55.494 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1366 2024-05-08T18:31:55.494 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.494 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:55.495 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.495 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:55.495 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.873737+0000", 2024-05-08T18:31:55.495 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:55.495 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.495 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.495 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:55.495 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.873737+0000", 2024-05-08T18:31:55.495 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:55.495 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.495 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.495 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:55.495 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.873740+0000", 2024-05-08T18:31:55.495 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2449999999999998e-06 2024-05-08T18:31:55.496 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.496 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.496 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:55.496 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.875455+0000", 2024-05-08T18:31:55.496 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0017145839999999999 2024-05-08T18:31:55.496 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.496 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.496 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:55.496 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.875484+0000", 2024-05-08T18:31:55.496 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9325000000000001e-05 2024-05-08T18:31:55.496 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.496 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.496 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:55.497 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.875499+0000", 2024-05-08T18:31:55.497 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4874e-05 2024-05-08T18:31:55.497 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.497 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.497 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:55.497 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.875571+0000", 2024-05-08T18:31:55.498 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2035999999999999e-05 2024-05-08T18:31:55.498 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.498 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.498 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:55.498 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.875691+0000", 2024-05-08T18:31:55.498 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012016 2024-05-08T18:31:55.499 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.499 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.499 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:55.499 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.875805+0000", 2024-05-08T18:31:55.499 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011333 2024-05-08T18:31:55.499 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.499 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.500 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:55.500 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.886875+0000", 2024-05-08T18:31:55.500 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011069997999999999 2024-05-08T18:31:55.500 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.500 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.500 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:55.500 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.887363+0000", 2024-05-08T18:31:55.500 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00048848499999999998 2024-05-08T18:31:55.500 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.500 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.500 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:55.500 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.887410+0000", 2024-05-08T18:31:55.501 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7264e-05 2024-05-08T18:31:55.501 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.501 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.501 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:55.501 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.887448+0000", 2024-05-08T18:31:55.501 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7273e-05 2024-05-08T18:31:55.501 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:55.501 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:55.501 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:55.501 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.501 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.501 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1370 3.9 e82/21 3:91bbaad9:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_56:head v 82'1, mlcod=0'0)", 2024-05-08T18:31:55.501 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.920855+0000", 2024-05-08T18:31:55.501 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 12.519059736999999, 2024-05-08T18:31:55.502 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.023027817999999999, 2024-05-08T18:31:55.502 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:55.502 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:55.502 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:55.502 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:55.502 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.502 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:55.502 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.920855+0000", 2024-05-08T18:31:55.502 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:55.502 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.502 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.502 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:55.502 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.920855+0000", 2024-05-08T18:31:55.503 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:55.503 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.503 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.503 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:55.503 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.920855+0000", 2024-05-08T18:31:55.503 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7399999999999999e-07 2024-05-08T18:31:55.503 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.503 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.503 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:55.503 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.926227+0000", 2024-05-08T18:31:55.503 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0053715129999999996 2024-05-08T18:31:55.503 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.504 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.504 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:55.504 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.926252+0000", 2024-05-08T18:31:55.504 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5709000000000001e-05 2024-05-08T18:31:55.504 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.504 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.504 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:55.504 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.926265+0000", 2024-05-08T18:31:55.504 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2159e-05 2024-05-08T18:31:55.504 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.504 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.505 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:55.505 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.926339+0000", 2024-05-08T18:31:55.505 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.4058000000000001e-05 2024-05-08T18:31:55.505 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.505 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.505 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:55.505 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.926355+0000", 2024-05-08T18:31:55.505 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6274e-05 2024-05-08T18:31:55.505 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.505 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.505 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:55.505 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.943850+0000", 2024-05-08T18:31:55.505 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.017495502999999999 2024-05-08T18:31:55.506 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.506 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.506 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:55.506 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.943883+0000", 2024-05-08T18:31:55.506 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2227999999999997e-05 2024-05-08T18:31:55.506 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:55.506 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:55.506 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:55.506 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.506 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.506 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1372 3.39 3:9eccad39:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_58:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:55.506 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.936995+0000", 2024-05-08T18:31:55.506 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 12.502919584000001, 2024-05-08T18:31:55.507 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.016484776, 2024-05-08T18:31:55.507 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:55.507 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:55.507 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:55.507 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:55.507 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:55.507 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:55.507 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1372 2024-05-08T18:31:55.507 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.507 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:55.507 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.507 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:55.507 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.936995+0000", 2024-05-08T18:31:55.508 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:55.508 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.508 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.508 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:55.508 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.936995+0000", 2024-05-08T18:31:55.508 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:55.508 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.508 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.508 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:55.508 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.936997+0000", 2024-05-08T18:31:55.508 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3980000000000002e-06 2024-05-08T18:31:55.508 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.508 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.509 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:55.509 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.938982+0000", 2024-05-08T18:31:55.509 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001984591 2024-05-08T18:31:55.509 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.509 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.509 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:55.509 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.939011+0000", 2024-05-08T18:31:55.509 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8598999999999998e-05 2024-05-08T18:31:55.509 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.509 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.510 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:55.510 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.939026+0000", 2024-05-08T18:31:55.510 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5197999999999999e-05 2024-05-08T18:31:55.510 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.510 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.510 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:55.510 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.939106+0000", 2024-05-08T18:31:55.510 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.0656999999999997e-05 2024-05-08T18:31:55.510 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.510 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.510 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:55.510 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.939250+0000", 2024-05-08T18:31:55.511 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000143516 2024-05-08T18:31:55.511 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.511 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.511 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:55.511 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.939357+0000", 2024-05-08T18:31:55.511 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000107261 2024-05-08T18:31:55.511 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.511 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.511 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:55.511 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.953303+0000", 2024-05-08T18:31:55.511 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.013946188999999999 2024-05-08T18:31:55.512 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.512 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.512 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:55.512 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.953356+0000", 2024-05-08T18:31:55.512 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.2222000000000002e-05 2024-05-08T18:31:55.512 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.512 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.512 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:55.512 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.953425+0000", 2024-05-08T18:31:55.512 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9265999999999997e-05 2024-05-08T18:31:55.513 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.513 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.513 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:55.513 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.953480+0000", 2024-05-08T18:31:55.513 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4879000000000001e-05 2024-05-08T18:31:55.513 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:55.513 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:55.513 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:55.513 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.513 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.513 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1375 3.39 3:9c8c420a:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_61:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:55.513 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.971052+0000", 2024-05-08T18:31:55.513 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 12.468862597999999, 2024-05-08T18:31:55.514 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.013332797, 2024-05-08T18:31:55.514 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:55.514 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:55.514 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:55.514 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:55.514 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:55.514 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:55.514 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1375 2024-05-08T18:31:55.515 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.515 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:55.515 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.515 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:55.515 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.971052+0000", 2024-05-08T18:31:55.515 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:55.515 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.515 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.515 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:55.515 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.971052+0000", 2024-05-08T18:31:55.515 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:55.515 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.515 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.516 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:55.516 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.971055+0000", 2024-05-08T18:31:55.516 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.977e-06 2024-05-08T18:31:55.516 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.516 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.516 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:55.516 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.972822+0000", 2024-05-08T18:31:55.516 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0017668619999999999 2024-05-08T18:31:55.516 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.516 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.516 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:55.516 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.972846+0000", 2024-05-08T18:31:55.516 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4519999999999999e-05 2024-05-08T18:31:55.516 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.517 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.517 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:55.517 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.972857+0000", 2024-05-08T18:31:55.517 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0457e-05 2024-05-08T18:31:55.517 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.517 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.517 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:55.517 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.972935+0000", 2024-05-08T18:31:55.517 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.8650000000000001e-05 2024-05-08T18:31:55.517 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.517 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.517 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:55.517 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.973121+0000", 2024-05-08T18:31:55.518 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000185816 2024-05-08T18:31:55.518 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.518 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.518 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:55.518 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.973289+0000", 2024-05-08T18:31:55.518 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016798299999999999 2024-05-08T18:31:55.518 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.518 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.518 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:55.518 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.983934+0000", 2024-05-08T18:31:55.518 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010644733999999999 2024-05-08T18:31:55.518 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.518 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.519 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:55.519 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.984287+0000", 2024-05-08T18:31:55.519 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00035295200000000002 2024-05-08T18:31:55.519 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.519 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.519 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:55.519 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.984342+0000", 2024-05-08T18:31:55.519 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5282999999999999e-05 2024-05-08T18:31:55.519 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.519 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.519 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:55.519 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.984385+0000", 2024-05-08T18:31:55.519 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.2562999999999999e-05 2024-05-08T18:31:55.520 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:55.520 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:55.520 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:55.520 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.520 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.520 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1384 3.5 3:a0f4371d:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_70:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:55.520 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:43.093875+0000", 2024-05-08T18:31:55.520 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 12.346039483, 2024-05-08T18:31:55.520 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.013806097999999999, 2024-05-08T18:31:55.520 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:55.520 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:55.520 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:55.521 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:55.521 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:55.521 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:55.521 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1384 2024-05-08T18:31:55.521 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.521 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:55.521 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.521 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:55.521 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.093875+0000", 2024-05-08T18:31:55.521 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:55.521 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.521 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.521 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:55.522 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.093875+0000", 2024-05-08T18:31:55.522 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:55.522 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.522 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.522 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:55.522 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.093878+0000", 2024-05-08T18:31:55.522 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8990000000000001e-06 2024-05-08T18:31:55.522 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.522 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.522 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:55.522 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.095579+0000", 2024-05-08T18:31:55.522 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001700628 2024-05-08T18:31:55.523 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.523 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.523 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:55.523 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.095608+0000", 2024-05-08T18:31:55.523 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9371000000000001e-05 2024-05-08T18:31:55.523 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.523 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.523 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:55.523 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.095626+0000", 2024-05-08T18:31:55.523 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8221999999999999e-05 2024-05-08T18:31:55.523 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.523 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.523 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:55.524 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.095722+0000", 2024-05-08T18:31:55.524 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.5963000000000003e-05 2024-05-08T18:31:55.524 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.524 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.524 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:55.524 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.095908+0000", 2024-05-08T18:31:55.524 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00018594999999999999 2024-05-08T18:31:55.524 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.524 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.524 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:55.524 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.096081+0000", 2024-05-08T18:31:55.524 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00017264799999999999 2024-05-08T18:31:55.524 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.525 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.525 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:55.525 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.107122+0000", 2024-05-08T18:31:55.525 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011041249 2024-05-08T18:31:55.525 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.525 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.525 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:55.525 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.107565+0000", 2024-05-08T18:31:55.526 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00044287999999999999 2024-05-08T18:31:55.526 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.526 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.526 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:55.526 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.107630+0000", 2024-05-08T18:31:55.526 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.4745000000000004e-05 2024-05-08T18:31:55.526 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.526 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.526 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:55.527 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.107681+0000", 2024-05-08T18:31:55.527 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.1542999999999998e-05 2024-05-08T18:31:55.527 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:55.527 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:55.527 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:55.527 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.527 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.527 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1390 3.0 e82/21 3:00a67f20:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_76:head v 82'3, mlcod=81'1)", 2024-05-08T18:31:55.527 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:43.176277+0000", 2024-05-08T18:31:55.527 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 12.263637075, 2024-05-08T18:31:55.527 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012246539000000001, 2024-05-08T18:31:55.527 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:55.527 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:55.528 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:55.528 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:55.528 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.528 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:55.528 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.176277+0000", 2024-05-08T18:31:55.528 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:55.528 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.528 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.528 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:55.528 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.176277+0000", 2024-05-08T18:31:55.528 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:55.528 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.528 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.529 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:55.529 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.176279+0000", 2024-05-08T18:31:55.529 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.001e-06 2024-05-08T18:31:55.529 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.529 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.529 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:55.529 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.178169+0000", 2024-05-08T18:31:55.529 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0018891100000000001 2024-05-08T18:31:55.529 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.529 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.529 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:55.529 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.178202+0000", 2024-05-08T18:31:55.529 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3315999999999997e-05 2024-05-08T18:31:55.530 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.530 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.530 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:55.530 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.178218+0000", 2024-05-08T18:31:55.530 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5889999999999999e-05 2024-05-08T18:31:55.530 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.530 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.530 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:55.530 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.178308+0000", 2024-05-08T18:31:55.530 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0080000000000005e-05 2024-05-08T18:31:55.530 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.530 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.530 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:55.531 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.178346+0000", 2024-05-08T18:31:55.531 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7931e-05 2024-05-08T18:31:55.531 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.531 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.531 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:55.531 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.188460+0000", 2024-05-08T18:31:55.531 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010113715000000001 2024-05-08T18:31:55.531 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.531 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.531 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:55.531 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.188524+0000", 2024-05-08T18:31:55.531 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.4496e-05 2024-05-08T18:31:55.531 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:55.532 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:55.532 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:55.532 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.532 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.532 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1402 3.2d e82/21 3:b43c4320:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_88:head v 82'3, mlcod=81'1)", 2024-05-08T18:31:55.532 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:43.297364+0000", 2024-05-08T18:31:55.532 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 12.142550804000001, 2024-05-08T18:31:55.532 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.013017687999999999, 2024-05-08T18:31:55.532 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:55.532 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:55.532 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:55.532 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:55.533 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.533 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:55.533 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.297364+0000", 2024-05-08T18:31:55.533 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:55.533 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.533 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.533 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:55.533 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.297364+0000", 2024-05-08T18:31:55.533 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:55.533 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.533 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.533 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:55.533 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.297364+0000", 2024-05-08T18:31:55.533 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.16e-07 2024-05-08T18:31:55.534 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.534 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.534 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:55.534 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.302711+0000", 2024-05-08T18:31:55.534 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0053466039999999996 2024-05-08T18:31:55.534 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.534 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.534 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:55.534 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.302747+0000", 2024-05-08T18:31:55.534 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6823000000000003e-05 2024-05-08T18:31:55.534 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.534 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.534 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:55.535 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.302761+0000", 2024-05-08T18:31:55.535 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4028e-05 2024-05-08T18:31:55.535 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.535 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.535 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:55.535 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.302846+0000", 2024-05-08T18:31:55.535 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.4775000000000001e-05 2024-05-08T18:31:55.535 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.535 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.535 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:55.536 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.302876+0000", 2024-05-08T18:31:55.536 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9882e-05 2024-05-08T18:31:55.536 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.536 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.536 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:55.536 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.310331+0000", 2024-05-08T18:31:55.536 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0074546320000000001 2024-05-08T18:31:55.536 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.536 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.536 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:55.536 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.310381+0000", 2024-05-08T18:31:55.536 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.0727999999999999e-05 2024-05-08T18:31:55.536 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:55.536 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:55.537 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:55.537 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.537 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.537 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1613 3.3d e83/21 3:bcbc5fe8:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_1:head v 83'3, mlcod=81'1)", 2024-05-08T18:31:55.537 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:46.699842+0000", 2024-05-08T18:31:55.537 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 8.7400720679999999, 2024-05-08T18:31:55.537 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012876298, 2024-05-08T18:31:55.537 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:55.537 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:55.537 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:55.537 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:55.537 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.537 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:55.538 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.699842+0000", 2024-05-08T18:31:55.538 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:55.538 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.538 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.538 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:55.538 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.699842+0000", 2024-05-08T18:31:55.538 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:55.538 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.538 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.538 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:55.538 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.699845+0000", 2024-05-08T18:31:55.538 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.04e-06 2024-05-08T18:31:55.538 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.539 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.539 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:55.539 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.702634+0000", 2024-05-08T18:31:55.539 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0027896010000000001 2024-05-08T18:31:55.539 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.539 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.539 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:55.539 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.702660+0000", 2024-05-08T18:31:55.539 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6265999999999999e-05 2024-05-08T18:31:55.539 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.539 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.539 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:55.539 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.702674+0000", 2024-05-08T18:31:55.539 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3297e-05 2024-05-08T18:31:55.540 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.540 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.540 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:55.540 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.702759+0000", 2024-05-08T18:31:55.540 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5110000000000003e-05 2024-05-08T18:31:55.540 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.540 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.540 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:55.540 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.702789+0000", 2024-05-08T18:31:55.540 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0434999999999999e-05 2024-05-08T18:31:55.540 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.540 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.540 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:55.540 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.712639+0000", 2024-05-08T18:31:55.541 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0098496850000000004 2024-05-08T18:31:55.541 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.541 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.541 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:55.541 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.712719+0000", 2024-05-08T18:31:55.541 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.9864000000000006e-05 2024-05-08T18:31:55.541 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:55.541 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:55.541 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:55.541 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.541 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.541 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1621 3.5 3:a3bb7dd2:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-05-08T18:31:55.541 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:46.781044+0000", 2024-05-08T18:31:55.542 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 8.6588709520000009, 2024-05-08T18:31:55.542 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.016696294, 2024-05-08T18:31:55.542 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:55.542 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:55.542 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:55.542 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:55.542 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:55.542 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:55.542 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1621 2024-05-08T18:31:55.542 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.542 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:55.542 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.542 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:55.543 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.781044+0000", 2024-05-08T18:31:55.543 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:55.543 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.543 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.543 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:55.543 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.781044+0000", 2024-05-08T18:31:55.543 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:55.543 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.543 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.543 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:55.543 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.781047+0000", 2024-05-08T18:31:55.543 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9009999999999996e-06 2024-05-08T18:31:55.543 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.543 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.544 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:55.544 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.782953+0000", 2024-05-08T18:31:55.544 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001905985 2024-05-08T18:31:55.544 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.544 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.544 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:55.544 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.782984+0000", 2024-05-08T18:31:55.544 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0568000000000003e-05 2024-05-08T18:31:55.544 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.544 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.544 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:55.544 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.782998+0000", 2024-05-08T18:31:55.544 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3499000000000001e-05 2024-05-08T18:31:55.544 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.544 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.545 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:55.545 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.783072+0000", 2024-05-08T18:31:55.545 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.4104999999999996e-05 2024-05-08T18:31:55.545 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.545 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.545 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:55.545 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.783226+0000", 2024-05-08T18:31:55.545 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015405900000000001 2024-05-08T18:31:55.545 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.545 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.545 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:55.545 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.783377+0000", 2024-05-08T18:31:55.545 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015162500000000001 2024-05-08T18:31:55.546 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.546 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.546 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:55.546 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.796988+0000", 2024-05-08T18:31:55.546 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.013610652000000001 2024-05-08T18:31:55.546 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.546 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.546 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:55.546 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.797630+0000", 2024-05-08T18:31:55.547 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00064184599999999995 2024-05-08T18:31:55.547 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.547 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.547 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:55.547 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.797692+0000", 2024-05-08T18:31:55.547 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.2396000000000004e-05 2024-05-08T18:31:55.547 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.547 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.547 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:55.547 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.797740+0000", 2024-05-08T18:31:55.547 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7657999999999997e-05 2024-05-08T18:31:55.547 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:55.548 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:55.548 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:55.548 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.548 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.548 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1624 3.3d e83/21 3:bc2f41f0:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_12:head v 83'4, mlcod=82'2)", 2024-05-08T18:31:55.548 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:46.814956+0000", 2024-05-08T18:31:55.548 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 8.6249581299999996, 2024-05-08T18:31:55.548 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.022594933000000001, 2024-05-08T18:31:55.548 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:55.548 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:55.548 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:55.548 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:55.549 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.549 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:55.549 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.814956+0000", 2024-05-08T18:31:55.549 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:55.549 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.549 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.549 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:55.549 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.814956+0000", 2024-05-08T18:31:55.549 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:55.549 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.549 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.549 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:55.549 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.814959+0000", 2024-05-08T18:31:55.550 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.339e-06 2024-05-08T18:31:55.550 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.550 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.550 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:55.550 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.818131+0000", 2024-05-08T18:31:55.550 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031725149999999999 2024-05-08T18:31:55.550 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.550 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.550 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:55.550 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.818171+0000", 2024-05-08T18:31:55.550 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9295000000000002e-05 2024-05-08T18:31:55.551 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.551 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.551 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:55.551 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.818191+0000", 2024-05-08T18:31:55.551 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0329000000000001e-05 2024-05-08T18:31:55.551 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.551 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.551 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:55.551 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.818363+0000", 2024-05-08T18:31:55.551 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000172337 2024-05-08T18:31:55.551 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.551 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.551 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:55.551 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.818415+0000", 2024-05-08T18:31:55.552 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.2203999999999997e-05 2024-05-08T18:31:55.552 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.552 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.552 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:55.552 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.837470+0000", 2024-05-08T18:31:55.552 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019054950000000001 2024-05-08T18:31:55.552 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.552 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.552 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:55.552 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.837551+0000", 2024-05-08T18:31:55.552 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.0964000000000006e-05 2024-05-08T18:31:55.552 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:55.552 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:55.553 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:55.553 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.553 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.553 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1632 3.21 3:86ca081f:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_20:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-05-08T18:31:55.553 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:46.903772+0000", 2024-05-08T18:31:55.553 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 8.5361430200000008, 2024-05-08T18:31:55.553 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.015516323, 2024-05-08T18:31:55.553 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:55.553 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:55.553 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:55.553 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:55.553 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:55.553 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:55.553 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1632 2024-05-08T18:31:55.554 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.554 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:55.554 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.554 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:55.554 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.903772+0000", 2024-05-08T18:31:55.554 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:55.554 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.554 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.554 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:55.554 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.903772+0000", 2024-05-08T18:31:55.555 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:55.555 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.555 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.555 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:55.555 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.903774+0000", 2024-05-08T18:31:55.555 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8040000000000002e-06 2024-05-08T18:31:55.555 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.555 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.555 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:55.555 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.905653+0000", 2024-05-08T18:31:55.555 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001878872 2024-05-08T18:31:55.555 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.555 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.556 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:55.556 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.905675+0000", 2024-05-08T18:31:55.556 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2238999999999998e-05 2024-05-08T18:31:55.556 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.556 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.556 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:55.556 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.905686+0000", 2024-05-08T18:31:55.556 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0145e-05 2024-05-08T18:31:55.556 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.557 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.557 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:55.557 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.905748+0000", 2024-05-08T18:31:55.557 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.2595000000000006e-05 2024-05-08T18:31:55.557 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.557 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.557 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:55.557 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.905871+0000", 2024-05-08T18:31:55.557 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012235999999999999 2024-05-08T18:31:55.557 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.557 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.557 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:55.557 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.905986+0000", 2024-05-08T18:31:55.558 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115025 2024-05-08T18:31:55.558 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.558 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.558 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:55.558 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.910243+0000", 2024-05-08T18:31:55.558 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0042571099999999997 2024-05-08T18:31:55.558 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.558 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.558 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:55.558 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.919213+0000", 2024-05-08T18:31:55.558 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.008970347 2024-05-08T18:31:55.558 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.558 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.559 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:55.559 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.919255+0000", 2024-05-08T18:31:55.559 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.1909000000000001e-05 2024-05-08T18:31:55.559 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.559 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.559 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:55.559 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.919288+0000", 2024-05-08T18:31:55.559 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2916999999999997e-05 2024-05-08T18:31:55.559 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:55.559 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:55.559 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:55.559 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.559 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.560 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1638 3.9 e83/21 3:9152f27e:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5_100Mb.:head v 83'6, mlcod=82'4)", 2024-05-08T18:31:55.560 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:46.971157+0000", 2024-05-08T18:31:55.560 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 8.4687573030000003, 2024-05-08T18:31:55.560 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012153826, 2024-05-08T18:31:55.560 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:55.560 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:55.560 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:55.560 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:55.560 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.560 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:55.560 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.971157+0000", 2024-05-08T18:31:55.560 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:55.560 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.560 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.561 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:55.561 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.971157+0000", 2024-05-08T18:31:55.561 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:55.561 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.561 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.561 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:55.561 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.971159+0000", 2024-05-08T18:31:55.561 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.499e-06 2024-05-08T18:31:55.561 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.561 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.561 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:55.561 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.976606+0000", 2024-05-08T18:31:55.561 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0054470500000000002 2024-05-08T18:31:55.562 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.562 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.562 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:55.562 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.976627+0000", 2024-05-08T18:31:55.562 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1109000000000001e-05 2024-05-08T18:31:55.562 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.562 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.562 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:55.562 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.976639+0000", 2024-05-08T18:31:55.562 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2544000000000001e-05 2024-05-08T18:31:55.562 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.562 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.562 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:55.562 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.976762+0000", 2024-05-08T18:31:55.563 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012254 2024-05-08T18:31:55.563 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.563 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.563 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:55.563 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.976787+0000", 2024-05-08T18:31:55.563 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4683999999999999e-05 2024-05-08T18:31:55.563 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.563 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.563 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:55.563 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.983270+0000", 2024-05-08T18:31:55.563 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0064833010000000003 2024-05-08T18:31:55.563 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:55.564 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:55.564 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:55.564 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.983311+0000", 2024-05-08T18:31:55.564 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.1099000000000001e-05 2024-05-08T18:31:55.564 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:55.564 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:55.564 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:55.564 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:55.564 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:55.564 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:55.566 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-08T18:31:55.566 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:31:55.562+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:31:55.638 INFO:teuthology.orchestra.run.smithi097.stderr:reweighted osd.4 to 1 (10000) 2024-05-08T18:31:55.665 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-05-08T18:31:55.666 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:31:55.662+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:31:55.699 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:55.699 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:31:55.699 INFO:teuthology.orchestra.run.smithi097.stdout: "num_ops": 0 2024-05-08T18:31:55.699 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:55.713 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-08T18:31:55.800 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:31:55.801+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:31:55.869 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:31:55.866+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:31:55.871 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:55.871 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:31:55.871 INFO:teuthology.orchestra.run.smithi097.stdout: "complaint_time": 30, 2024-05-08T18:31:55.872 INFO:teuthology.orchestra.run.smithi097.stdout: "num_blocked_ops": 0 2024-05-08T18:31:55.872 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:55.885 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-08T18:31:55.970 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:31:55.966+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:31:56.038 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:56.038 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2024-05-08T18:31:56.038 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2024-05-08T18:31:56.038 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-05-08T18:31:56.039 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.039 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1234 3.38 3:1cb36fa1:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.2__shadow_.fYaqa8o34qSAauLRSqi3iwpmT5NwV5c_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-05-08T18:31:56.039 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:38.213439+0000", 2024-05-08T18:31:56.039 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 17.824330295999999, 2024-05-08T18:31:56.039 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.028973664, 2024-05-08T18:31:56.039 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:56.039 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:56.039 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:56.039 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:56.039 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:56.039 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:56.039 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1234 2024-05-08T18:31:56.039 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.040 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:56.040 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.040 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:56.040 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.213439+0000", 2024-05-08T18:31:56.040 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:56.040 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.040 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.040 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:56.040 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.213439+0000", 2024-05-08T18:31:56.040 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:56.040 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.040 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.040 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:56.040 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.213442+0000", 2024-05-08T18:31:56.041 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7580000000000001e-06 2024-05-08T18:31:56.041 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.041 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.041 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:56.041 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.216804+0000", 2024-05-08T18:31:56.041 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0033619520000000001 2024-05-08T18:31:56.041 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.041 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.041 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:56.041 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.216838+0000", 2024-05-08T18:31:56.041 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4437999999999998e-05 2024-05-08T18:31:56.041 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.041 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.042 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:56.042 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.216854+0000", 2024-05-08T18:31:56.042 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5823000000000001e-05 2024-05-08T18:31:56.042 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.042 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.042 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:56.042 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.216938+0000", 2024-05-08T18:31:56.042 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.3842000000000001e-05 2024-05-08T18:31:56.042 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.042 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.042 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:56.042 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.217046+0000", 2024-05-08T18:31:56.042 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000108717 2024-05-08T18:31:56.043 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.043 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.043 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:56.043 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.217137+0000", 2024-05-08T18:31:56.043 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0278000000000005e-05 2024-05-08T18:31:56.043 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.043 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.043 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:56.043 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.225461+0000", 2024-05-08T18:31:56.043 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0083239330000000004 2024-05-08T18:31:56.043 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.043 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.043 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:56.044 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.242319+0000", 2024-05-08T18:31:56.044 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.016858445999999999 2024-05-08T18:31:56.044 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.044 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.044 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:56.044 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.242359+0000", 2024-05-08T18:31:56.044 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9657000000000003e-05 2024-05-08T18:31:56.044 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.044 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.044 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:56.044 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.242413+0000", 2024-05-08T18:31:56.044 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3820000000000003e-05 2024-05-08T18:31:56.044 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:56.044 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:56.044 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:56.045 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.045 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.045 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1318 3.c e81/21 3:329e59e6:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_4:head v 81'3, mlcod=80'1)", 2024-05-08T18:31:56.045 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.344399+0000", 2024-05-08T18:31:56.045 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 13.693370335000001, 2024-05-08T18:31:56.045 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.016160681999999999, 2024-05-08T18:31:56.045 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:56.045 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:56.045 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:56.045 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:56.045 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.045 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:56.045 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.344399+0000", 2024-05-08T18:31:56.045 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:56.046 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.046 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.046 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:56.046 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.344399+0000", 2024-05-08T18:31:56.046 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:56.046 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.046 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.046 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:56.046 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.344401+0000", 2024-05-08T18:31:56.046 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.767e-06 2024-05-08T18:31:56.046 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.046 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.046 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:56.047 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.351623+0000", 2024-05-08T18:31:56.047 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.007222554 2024-05-08T18:31:56.047 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.047 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.047 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:56.047 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.351667+0000", 2024-05-08T18:31:56.047 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4192e-05 2024-05-08T18:31:56.047 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.047 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.047 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:56.047 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.351690+0000", 2024-05-08T18:31:56.047 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2708999999999999e-05 2024-05-08T18:31:56.047 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.047 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.047 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:56.048 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.351781+0000", 2024-05-08T18:31:56.048 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0556999999999994e-05 2024-05-08T18:31:56.048 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.048 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.048 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:56.048 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.351799+0000", 2024-05-08T18:31:56.048 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8581e-05 2024-05-08T18:31:56.048 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.048 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.048 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:56.048 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.360513+0000", 2024-05-08T18:31:56.048 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.008713864 2024-05-08T18:31:56.048 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.048 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.048 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:56.049 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.360560+0000", 2024-05-08T18:31:56.049 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6458000000000001e-05 2024-05-08T18:31:56.049 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:56.049 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:56.049 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:56.049 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.049 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.049 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1330 3.8 3:124da8ab:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-08T18:31:56.049 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.493255+0000", 2024-05-08T18:31:56.049 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 13.544514487000001, 2024-05-08T18:31:56.049 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.016189959, 2024-05-08T18:31:56.049 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:56.049 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:56.050 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:56.050 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:56.050 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:56.050 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:56.050 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1330 2024-05-08T18:31:56.050 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.050 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:56.050 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.050 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:56.050 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.493255+0000", 2024-05-08T18:31:56.050 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:56.050 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.050 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.050 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:56.051 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.493255+0000", 2024-05-08T18:31:56.051 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:56.051 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.051 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.051 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:56.051 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.493258+0000", 2024-05-08T18:31:56.051 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0180000000000002e-06 2024-05-08T18:31:56.051 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.051 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.051 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:56.051 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.494859+0000", 2024-05-08T18:31:56.051 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001600853 2024-05-08T18:31:56.051 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.051 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.052 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:56.052 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.494883+0000", 2024-05-08T18:31:56.052 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4680000000000001e-05 2024-05-08T18:31:56.052 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.052 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.052 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:56.052 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.494894+0000", 2024-05-08T18:31:56.052 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0601999999999999e-05 2024-05-08T18:31:56.052 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.052 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.052 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:56.052 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.494972+0000", 2024-05-08T18:31:56.052 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.8534000000000004e-05 2024-05-08T18:31:56.052 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.053 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.053 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:56.053 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.495134+0000", 2024-05-08T18:31:56.053 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016150999999999999 2024-05-08T18:31:56.053 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.053 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.053 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-05-08T18:31:56.053 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.495261+0000", 2024-05-08T18:31:56.053 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012695600000000001 2024-05-08T18:31:56.053 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.053 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.053 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:56.053 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.508455+0000", 2024-05-08T18:31:56.054 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.013194449 2024-05-08T18:31:56.054 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.054 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.054 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:56.054 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.509294+0000", 2024-05-08T18:31:56.054 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000839061 2024-05-08T18:31:56.054 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.054 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.054 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:56.054 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.509388+0000", 2024-05-08T18:31:56.054 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.3682000000000002e-05 2024-05-08T18:31:56.054 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.054 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.054 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:56.055 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.509445+0000", 2024-05-08T18:31:56.055 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6613999999999997e-05 2024-05-08T18:31:56.055 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:56.055 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:56.055 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:56.055 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.055 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.055 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1336 3.2 3:42c6ce4f:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:56.055 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.558532+0000", 2024-05-08T18:31:56.055 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 13.479237038999999, 2024-05-08T18:31:56.055 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.033214269999999997, 2024-05-08T18:31:56.055 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:56.056 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:56.056 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:56.056 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:56.056 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:56.056 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:56.056 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1336 2024-05-08T18:31:56.056 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.056 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:56.056 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.056 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:56.056 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.558532+0000", 2024-05-08T18:31:56.056 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:56.056 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.057 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.057 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:56.057 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.558532+0000", 2024-05-08T18:31:56.057 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:56.057 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.057 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.057 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:56.057 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.558535+0000", 2024-05-08T18:31:56.057 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9689999999999999e-06 2024-05-08T18:31:56.057 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.057 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.057 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:56.057 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.560549+0000", 2024-05-08T18:31:56.058 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0020142469999999998 2024-05-08T18:31:56.058 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.058 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.058 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:56.058 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.560576+0000", 2024-05-08T18:31:56.058 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6908000000000001e-05 2024-05-08T18:31:56.058 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.058 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.058 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:56.058 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.560595+0000", 2024-05-08T18:31:56.058 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8383999999999999e-05 2024-05-08T18:31:56.058 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.058 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.058 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:56.059 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.560680+0000", 2024-05-08T18:31:56.059 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5424000000000001e-05 2024-05-08T18:31:56.059 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.059 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.059 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-05-08T18:31:56.059 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.560685+0000", 2024-05-08T18:31:56.059 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.327e-06 2024-05-08T18:31:56.059 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.059 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.059 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:56.059 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.570079+0000", 2024-05-08T18:31:56.059 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0093940680000000002 2024-05-08T18:31:56.059 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.059 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.060 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:56.060 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.570249+0000", 2024-05-08T18:31:56.060 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000169953 2024-05-08T18:31:56.060 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.060 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.060 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-05-08T18:31:56.060 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.570423+0000", 2024-05-08T18:31:56.060 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00017355499999999999 2024-05-08T18:31:56.060 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.060 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.060 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:56.060 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.590293+0000", 2024-05-08T18:31:56.060 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019869761999999999 2024-05-08T18:31:56.061 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.061 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.061 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:56.061 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.591628+0000", 2024-05-08T18:31:56.061 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0013351599999999999 2024-05-08T18:31:56.061 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.061 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.061 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:56.061 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.591692+0000", 2024-05-08T18:31:56.061 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3822e-05 2024-05-08T18:31:56.061 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.061 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.061 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:56.061 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.591746+0000", 2024-05-08T18:31:56.062 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4691000000000002e-05 2024-05-08T18:31:56.062 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:56.062 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:56.062 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:56.062 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.062 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.062 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1346 3.29 3:9766a0f4:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_32:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:56.062 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.663599+0000", 2024-05-08T18:31:56.062 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 13.374170251000001, 2024-05-08T18:31:56.062 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.018562168, 2024-05-08T18:31:56.062 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:56.062 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:56.062 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:56.063 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:56.063 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:56.063 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:56.063 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1346 2024-05-08T18:31:56.063 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.063 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:56.063 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.063 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:56.063 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.663599+0000", 2024-05-08T18:31:56.063 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:56.063 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.063 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.063 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:56.063 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.663599+0000", 2024-05-08T18:31:56.064 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:56.064 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.064 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.064 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:56.064 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.663601+0000", 2024-05-08T18:31:56.064 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.328e-06 2024-05-08T18:31:56.064 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.064 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.064 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:56.064 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.665307+0000", 2024-05-08T18:31:56.064 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0017060879999999999 2024-05-08T18:31:56.064 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.064 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.065 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:56.065 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.665332+0000", 2024-05-08T18:31:56.065 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5142000000000001e-05 2024-05-08T18:31:56.065 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.065 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.065 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:56.065 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.665344+0000", 2024-05-08T18:31:56.065 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1464000000000001e-05 2024-05-08T18:31:56.065 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.065 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.065 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:56.065 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.665419+0000", 2024-05-08T18:31:56.065 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.5129000000000005e-05 2024-05-08T18:31:56.065 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.066 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.066 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:56.066 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.665529+0000", 2024-05-08T18:31:56.066 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000109787 2024-05-08T18:31:56.066 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.066 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.066 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:31:56.066 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.665627+0000", 2024-05-08T18:31:56.066 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.8190999999999996e-05 2024-05-08T18:31:56.066 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.066 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.066 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:56.066 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.673488+0000", 2024-05-08T18:31:56.066 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0078611819999999995 2024-05-08T18:31:56.067 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.067 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.067 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:56.067 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.682043+0000", 2024-05-08T18:31:56.067 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0085545829999999993 2024-05-08T18:31:56.067 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.067 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.067 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:56.067 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.682106+0000", 2024-05-08T18:31:56.067 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.2706000000000006e-05 2024-05-08T18:31:56.067 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.067 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.067 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:56.068 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.682161+0000", 2024-05-08T18:31:56.068 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5568000000000001e-05 2024-05-08T18:31:56.068 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:56.068 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:56.068 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:56.068 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.068 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.068 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1348 3.38 3:1ca8d3e1:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_34:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:56.068 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.684650+0000", 2024-05-08T18:31:56.068 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 13.353119141000001, 2024-05-08T18:31:56.068 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.018994840999999998, 2024-05-08T18:31:56.068 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:56.068 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:56.068 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:56.068 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:56.069 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:56.069 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:56.069 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1348 2024-05-08T18:31:56.069 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.069 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:56.069 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.069 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:56.069 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.684650+0000", 2024-05-08T18:31:56.069 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:56.069 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.069 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.069 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:56.069 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.684650+0000", 2024-05-08T18:31:56.070 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:56.070 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.070 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.070 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:56.070 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.684652+0000", 2024-05-08T18:31:56.070 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3860000000000001e-06 2024-05-08T18:31:56.070 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.070 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.070 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:56.070 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.686933+0000", 2024-05-08T18:31:56.070 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0022806369999999999 2024-05-08T18:31:56.070 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.070 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.071 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:56.071 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.686950+0000", 2024-05-08T18:31:56.071 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7377e-05 2024-05-08T18:31:56.071 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.071 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.071 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:56.071 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.686962+0000", 2024-05-08T18:31:56.071 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1756000000000001e-05 2024-05-08T18:31:56.071 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.071 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.071 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:56.071 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.687038+0000", 2024-05-08T18:31:56.071 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.5623000000000004e-05 2024-05-08T18:31:56.071 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.072 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.072 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:56.072 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.687226+0000", 2024-05-08T18:31:56.072 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000188457 2024-05-08T18:31:56.072 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.072 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.072 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:56.072 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.687394+0000", 2024-05-08T18:31:56.072 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016753300000000001 2024-05-08T18:31:56.072 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.072 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.072 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:56.072 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.694346+0000", 2024-05-08T18:31:56.072 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0069519639999999997 2024-05-08T18:31:56.073 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.073 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.073 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:56.073 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.703479+0000", 2024-05-08T18:31:56.073 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0091331829999999996 2024-05-08T18:31:56.073 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.073 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.073 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:56.073 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.703567+0000", 2024-05-08T18:31:56.073 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8294000000000005e-05 2024-05-08T18:31:56.073 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.073 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.073 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:56.074 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.703645+0000", 2024-05-08T18:31:56.074 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7631000000000003e-05 2024-05-08T18:31:56.074 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:56.074 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:56.074 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:56.074 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.074 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.074 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1349 3.27 3:e5090c80:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_35:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:56.074 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.696361+0000", 2024-05-08T18:31:56.074 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 13.341408071, 2024-05-08T18:31:56.074 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019944929, 2024-05-08T18:31:56.074 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:56.074 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:56.074 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:56.075 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:56.075 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:56.075 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:56.075 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1349 2024-05-08T18:31:56.075 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.075 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:56.075 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.075 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:56.075 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.696361+0000", 2024-05-08T18:31:56.075 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:56.075 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.075 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.075 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:56.075 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.696361+0000", 2024-05-08T18:31:56.076 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:56.076 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.076 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.076 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:56.076 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.696363+0000", 2024-05-08T18:31:56.076 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1160000000000002e-06 2024-05-08T18:31:56.076 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.076 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.076 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:56.076 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.698294+0000", 2024-05-08T18:31:56.076 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001931026 2024-05-08T18:31:56.076 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.076 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.076 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:56.077 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.698324+0000", 2024-05-08T18:31:56.077 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9658e-05 2024-05-08T18:31:56.077 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.077 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.077 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:56.077 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.698339+0000", 2024-05-08T18:31:56.077 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5381000000000001e-05 2024-05-08T18:31:56.077 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.077 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.077 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:56.077 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.698430+0000", 2024-05-08T18:31:56.077 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0353999999999996e-05 2024-05-08T18:31:56.077 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.077 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.078 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:56.078 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.698591+0000", 2024-05-08T18:31:56.078 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016140999999999999 2024-05-08T18:31:56.078 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.078 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.078 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:31:56.078 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.698741+0000", 2024-05-08T18:31:56.078 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014955099999999999 2024-05-08T18:31:56.078 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.078 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.078 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:56.078 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.706987+0000", 2024-05-08T18:31:56.078 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0082466599999999994 2024-05-08T18:31:56.078 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.078 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.079 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:56.079 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.716183+0000", 2024-05-08T18:31:56.079 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0091959529999999998 2024-05-08T18:31:56.079 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.079 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.079 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:56.079 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.716252+0000", 2024-05-08T18:31:56.079 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8804000000000001e-05 2024-05-08T18:31:56.079 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.079 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.079 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:56.079 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.716306+0000", 2024-05-08T18:31:56.079 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4015999999999999e-05 2024-05-08T18:31:56.079 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:56.080 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:56.080 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:56.080 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.080 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.080 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1351 3.27 3:e75c4558:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_37:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:56.080 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.719093+0000", 2024-05-08T18:31:56.080 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 13.318675721, 2024-05-08T18:31:56.080 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.016526314, 2024-05-08T18:31:56.080 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:56.080 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:56.080 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:56.080 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:56.080 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:56.081 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:56.081 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1351 2024-05-08T18:31:56.081 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.081 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:56.081 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.081 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:56.081 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.719093+0000", 2024-05-08T18:31:56.081 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:56.081 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.081 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.081 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:56.081 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.719093+0000", 2024-05-08T18:31:56.081 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:56.081 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.082 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.082 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:56.082 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.719096+0000", 2024-05-08T18:31:56.082 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0249999999999998e-06 2024-05-08T18:31:56.082 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.082 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.082 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:56.082 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.721010+0000", 2024-05-08T18:31:56.082 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001913821 2024-05-08T18:31:56.082 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.082 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.082 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:56.082 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.721041+0000", 2024-05-08T18:31:56.083 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0679000000000002e-05 2024-05-08T18:31:56.083 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.083 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.083 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:56.083 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.721056+0000", 2024-05-08T18:31:56.083 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4630999999999999e-05 2024-05-08T18:31:56.083 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.083 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.083 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:56.083 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.721139+0000", 2024-05-08T18:31:56.083 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.3174e-05 2024-05-08T18:31:56.083 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.083 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.083 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:56.084 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.721264+0000", 2024-05-08T18:31:56.084 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012507600000000001 2024-05-08T18:31:56.084 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.084 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.084 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:31:56.084 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.721361+0000", 2024-05-08T18:31:56.084 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.7406999999999998e-05 2024-05-08T18:31:56.084 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.084 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.084 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:56.084 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.731468+0000", 2024-05-08T18:31:56.084 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010107065 2024-05-08T18:31:56.084 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.084 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.085 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:56.085 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.735495+0000", 2024-05-08T18:31:56.085 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0040267080000000004 2024-05-08T18:31:56.085 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.085 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.085 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:56.085 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.735563+0000", 2024-05-08T18:31:56.085 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8195999999999996e-05 2024-05-08T18:31:56.085 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.085 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.085 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:56.085 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.735620+0000", 2024-05-08T18:31:56.085 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6532e-05 2024-05-08T18:31:56.085 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:56.086 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:56.086 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:56.086 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.086 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.086 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1355 3.28 e82/21 3:14052413:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_41:head v 82'1, mlcod=0'0)", 2024-05-08T18:31:56.086 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.768053+0000", 2024-05-08T18:31:56.086 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 13.269716238999999, 2024-05-08T18:31:56.086 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019664687, 2024-05-08T18:31:56.086 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:56.086 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:56.086 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:56.086 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:56.086 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.087 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:56.087 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.768053+0000", 2024-05-08T18:31:56.087 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:56.087 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.087 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.087 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:56.087 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.768053+0000", 2024-05-08T18:31:56.087 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:56.087 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.087 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.087 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:56.087 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.768055+0000", 2024-05-08T18:31:56.087 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6959999999999999e-06 2024-05-08T18:31:56.087 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.088 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.088 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:56.088 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.772115+0000", 2024-05-08T18:31:56.088 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0040600139999999998 2024-05-08T18:31:56.088 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.088 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.088 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:56.088 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.772149+0000", 2024-05-08T18:31:56.088 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4638999999999998e-05 2024-05-08T18:31:56.088 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.088 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.088 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:56.088 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.772165+0000", 2024-05-08T18:31:56.088 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5435999999999999e-05 2024-05-08T18:31:56.089 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.089 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.089 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:56.089 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.772261+0000", 2024-05-08T18:31:56.089 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.6724000000000004e-05 2024-05-08T18:31:56.089 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.089 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.089 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:56.089 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.772289+0000", 2024-05-08T18:31:56.089 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7243e-05 2024-05-08T18:31:56.089 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.089 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.089 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:56.089 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.787670+0000", 2024-05-08T18:31:56.089 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.015380906 2024-05-08T18:31:56.090 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.090 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.090 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:56.090 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.787718+0000", 2024-05-08T18:31:56.090 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8028999999999997e-05 2024-05-08T18:31:56.090 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:56.090 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:56.090 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:56.090 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.090 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.090 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1356 3.2 3:41e29af7:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_42:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:56.090 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.771157+0000", 2024-05-08T18:31:56.090 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 13.266612258, 2024-05-08T18:31:56.091 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.018991331, 2024-05-08T18:31:56.091 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:56.091 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:56.091 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:56.091 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:56.091 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:56.091 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:56.091 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1356 2024-05-08T18:31:56.091 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.091 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:56.091 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.091 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:56.091 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.771157+0000", 2024-05-08T18:31:56.091 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:56.091 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.092 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.092 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:56.092 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.771157+0000", 2024-05-08T18:31:56.092 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:56.092 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.092 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.092 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:56.092 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.771160+0000", 2024-05-08T18:31:56.092 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1820000000000002e-06 2024-05-08T18:31:56.092 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.092 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.092 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:56.092 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.772778+0000", 2024-05-08T18:31:56.092 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001617926 2024-05-08T18:31:56.093 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.093 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.093 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:56.093 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.772790+0000", 2024-05-08T18:31:56.093 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1609e-05 2024-05-08T18:31:56.093 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.093 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.093 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:56.093 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.772797+0000", 2024-05-08T18:31:56.093 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.3270000000000003e-06 2024-05-08T18:31:56.093 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.093 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.093 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:56.093 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.772851+0000", 2024-05-08T18:31:56.094 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3987999999999999e-05 2024-05-08T18:31:56.094 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.094 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.094 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:56.094 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.772947+0000", 2024-05-08T18:31:56.094 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.5809000000000004e-05 2024-05-08T18:31:56.094 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.094 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.094 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-05-08T18:31:56.094 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.773040+0000", 2024-05-08T18:31:56.094 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.3422000000000001e-05 2024-05-08T18:31:56.094 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.094 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.095 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:56.095 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.786246+0000", 2024-05-08T18:31:56.095 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.013205744 2024-05-08T18:31:56.095 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.095 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.095 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:56.095 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.790017+0000", 2024-05-08T18:31:56.095 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0037707539999999999 2024-05-08T18:31:56.095 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.095 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.095 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:56.095 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.790091+0000", 2024-05-08T18:31:56.095 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.4664000000000002e-05 2024-05-08T18:31:56.095 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.096 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.096 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:56.096 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.790148+0000", 2024-05-08T18:31:56.096 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6906e-05 2024-05-08T18:31:56.096 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:56.096 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:56.096 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:56.096 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.096 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.096 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1407 3.22 e82/21 3:46b64ebe:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_93:head v 82'2, mlcod=0'0)", 2024-05-08T18:31:56.096 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:43.347361+0000", 2024-05-08T18:31:56.096 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 12.690408657000001, 2024-05-08T18:31:56.096 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.017804430999999999, 2024-05-08T18:31:56.096 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:56.097 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:56.097 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:56.097 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:56.097 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.097 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:56.097 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.347361+0000", 2024-05-08T18:31:56.097 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:56.097 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.097 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.097 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:56.097 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.347361+0000", 2024-05-08T18:31:56.097 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:56.097 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.098 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.098 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:56.098 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.347362+0000", 2024-05-08T18:31:56.098 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9489999999999999e-06 2024-05-08T18:31:56.098 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.098 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.098 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:56.098 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.352295+0000", 2024-05-08T18:31:56.098 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0049320659999999997 2024-05-08T18:31:56.098 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.098 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.098 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:56.098 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.352314+0000", 2024-05-08T18:31:56.099 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9057999999999999e-05 2024-05-08T18:31:56.099 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.099 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.099 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:56.099 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.352326+0000", 2024-05-08T18:31:56.099 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2244e-05 2024-05-08T18:31:56.099 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.099 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.099 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:56.099 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.352386+0000", 2024-05-08T18:31:56.099 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0066999999999999e-05 2024-05-08T18:31:56.099 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.099 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.099 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:56.099 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.352405+0000", 2024-05-08T18:31:56.100 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.872e-05 2024-05-08T18:31:56.100 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.100 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.100 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:56.100 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.365075+0000", 2024-05-08T18:31:56.100 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012670241 2024-05-08T18:31:56.100 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.100 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.100 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:56.100 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.365165+0000", 2024-05-08T18:31:56.100 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0086000000000005e-05 2024-05-08T18:31:56.100 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:56.100 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:56.100 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:56.101 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.101 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.101 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1414 3.29 3:946e7bc1:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_100:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:56.101 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:43.412960+0000", 2024-05-08T18:31:56.101 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 12.624808879, 2024-05-08T18:31:56.101 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.017447297, 2024-05-08T18:31:56.101 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:56.101 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:56.101 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:56.101 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:56.101 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:56.101 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:56.101 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1414 2024-05-08T18:31:56.101 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.102 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:56.102 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.102 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:56.102 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.412960+0000", 2024-05-08T18:31:56.102 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:56.102 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.102 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.102 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:56.102 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.412960+0000", 2024-05-08T18:31:56.102 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:56.102 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.102 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.102 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:56.102 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.412963+0000", 2024-05-08T18:31:56.103 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4219999999999999e-06 2024-05-08T18:31:56.103 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.103 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.103 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:56.103 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.414327+0000", 2024-05-08T18:31:56.103 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001364608 2024-05-08T18:31:56.103 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.103 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.103 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:56.103 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.414348+0000", 2024-05-08T18:31:56.103 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0981000000000001e-05 2024-05-08T18:31:56.103 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.103 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.103 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:56.103 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.414359+0000", 2024-05-08T18:31:56.104 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0900000000000001e-05 2024-05-08T18:31:56.104 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.104 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.104 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:56.104 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.414418+0000", 2024-05-08T18:31:56.104 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8430000000000001e-05 2024-05-08T18:31:56.104 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.104 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.104 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:56.104 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.414542+0000", 2024-05-08T18:31:56.104 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012464600000000001 2024-05-08T18:31:56.104 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.104 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.104 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:31:56.104 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.414646+0000", 2024-05-08T18:31:56.105 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000103492 2024-05-08T18:31:56.105 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.105 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.105 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:56.105 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.421327+0000", 2024-05-08T18:31:56.105 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0066811700000000002 2024-05-08T18:31:56.105 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.105 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.105 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:56.105 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.430304+0000", 2024-05-08T18:31:56.105 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0089774220000000005 2024-05-08T18:31:56.105 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.105 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.105 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:56.105 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.430364+0000", 2024-05-08T18:31:56.106 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9431000000000001e-05 2024-05-08T18:31:56.106 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.106 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.106 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:56.106 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.430408+0000", 2024-05-08T18:31:56.106 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3795000000000003e-05 2024-05-08T18:31:56.106 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:56.106 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:56.106 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:56.106 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.106 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.106 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1616 3.7 3:e2c69de8:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-05-08T18:31:56.106 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:46.728206+0000", 2024-05-08T18:31:56.106 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 9.3095630279999995, 2024-05-08T18:31:56.107 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.024382826, 2024-05-08T18:31:56.107 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:56.107 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:56.107 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:56.107 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:56.107 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:56.107 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:56.107 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1616 2024-05-08T18:31:56.107 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.107 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:56.107 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.107 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:56.107 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.728206+0000", 2024-05-08T18:31:56.107 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:56.108 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.108 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.108 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:56.108 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.728206+0000", 2024-05-08T18:31:56.108 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:56.108 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.108 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.108 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:56.108 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.728209+0000", 2024-05-08T18:31:56.108 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3060000000000002e-06 2024-05-08T18:31:56.108 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.108 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.108 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:56.108 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.730475+0000", 2024-05-08T18:31:56.108 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0022651899999999998 2024-05-08T18:31:56.109 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.109 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.109 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:56.109 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.730508+0000", 2024-05-08T18:31:56.109 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3226999999999999e-05 2024-05-08T18:31:56.109 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.109 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.109 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:56.109 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.730523+0000", 2024-05-08T18:31:56.109 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4715999999999999e-05 2024-05-08T18:31:56.109 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.109 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.109 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:56.109 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.730618+0000", 2024-05-08T18:31:56.110 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.5619999999999996e-05 2024-05-08T18:31:56.110 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.110 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.110 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:56.110 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.730831+0000", 2024-05-08T18:31:56.110 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021288599999999999 2024-05-08T18:31:56.110 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.110 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.110 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:56.110 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.730970+0000", 2024-05-08T18:31:56.110 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013861400000000001 2024-05-08T18:31:56.110 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.110 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.110 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:56.111 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.742595+0000", 2024-05-08T18:31:56.111 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011624951 2024-05-08T18:31:56.111 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.111 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.111 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:56.111 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.752495+0000", 2024-05-08T18:31:56.111 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0098999910000000003 2024-05-08T18:31:56.111 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.111 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.111 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:56.111 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.752546+0000", 2024-05-08T18:31:56.111 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.1422999999999999e-05 2024-05-08T18:31:56.111 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.111 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.112 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:56.112 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.752589+0000", 2024-05-08T18:31:56.112 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.2901999999999997e-05 2024-05-08T18:31:56.112 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:56.112 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:56.112 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:56.112 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.112 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.112 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1625 3.1e 3:798e9c4d:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-05-08T18:31:56.112 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:46.821701+0000", 2024-05-08T18:31:56.112 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 9.2160683829999996, 2024-05-08T18:31:56.112 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019517788000000001, 2024-05-08T18:31:56.112 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:56.112 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:56.113 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:56.113 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:56.113 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:56.113 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:56.113 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1625 2024-05-08T18:31:56.113 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.113 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:56.113 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.113 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:56.113 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.821701+0000", 2024-05-08T18:31:56.113 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:56.113 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.113 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.113 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:56.114 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.821701+0000", 2024-05-08T18:31:56.114 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:56.114 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.114 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.114 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:56.114 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.821704+0000", 2024-05-08T18:31:56.114 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9450000000000002e-06 2024-05-08T18:31:56.114 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.114 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.114 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:56.114 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.824221+0000", 2024-05-08T18:31:56.114 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0025171600000000001 2024-05-08T18:31:56.114 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.114 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.115 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:56.115 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.824251+0000", 2024-05-08T18:31:56.115 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0243000000000002e-05 2024-05-08T18:31:56.115 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.115 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.115 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:56.115 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.824265+0000", 2024-05-08T18:31:56.115 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3482999999999999e-05 2024-05-08T18:31:56.115 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.115 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.115 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:56.115 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.824353+0000", 2024-05-08T18:31:56.115 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8146999999999995e-05 2024-05-08T18:31:56.115 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.115 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.116 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:56.116 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.824560+0000", 2024-05-08T18:31:56.116 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00020771400000000001 2024-05-08T18:31:56.116 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.116 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.116 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:31:56.116 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.824720+0000", 2024-05-08T18:31:56.116 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015998799999999999 2024-05-08T18:31:56.116 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.116 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.116 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:56.116 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.837381+0000", 2024-05-08T18:31:56.116 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012660803 2024-05-08T18:31:56.116 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.117 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.117 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:56.117 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.841087+0000", 2024-05-08T18:31:56.117 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0037056519999999998 2024-05-08T18:31:56.117 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.117 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.117 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:56.117 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.841160+0000", 2024-05-08T18:31:56.117 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.3208999999999997e-05 2024-05-08T18:31:56.117 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.117 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.117 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:56.117 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.841219+0000", 2024-05-08T18:31:56.117 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8443999999999998e-05 2024-05-08T18:31:56.118 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:56.118 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:56.118 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:56.118 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.118 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.118 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1627 3.b 3:d1c181db:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-05-08T18:31:56.118 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:46.850618+0000", 2024-05-08T18:31:56.118 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 9.1871510080000007, 2024-05-08T18:31:56.118 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.027553586000000001, 2024-05-08T18:31:56.118 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:56.118 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:56.118 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:56.118 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:56.118 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:56.119 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:56.119 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1627 2024-05-08T18:31:56.119 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.119 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:56.119 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.119 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:56.119 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.850618+0000", 2024-05-08T18:31:56.119 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:56.119 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.119 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.119 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:56.119 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.850618+0000", 2024-05-08T18:31:56.119 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:56.119 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.120 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.120 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:56.120 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.850621+0000", 2024-05-08T18:31:56.120 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0299999999999998e-06 2024-05-08T18:31:56.120 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.120 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.120 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:56.120 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.852369+0000", 2024-05-08T18:31:56.120 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001748229 2024-05-08T18:31:56.120 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.120 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.120 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:56.120 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.852397+0000", 2024-05-08T18:31:56.121 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7542000000000002e-05 2024-05-08T18:31:56.121 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.121 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.121 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:56.121 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.852410+0000", 2024-05-08T18:31:56.121 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2798e-05 2024-05-08T18:31:56.121 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.121 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.121 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:56.121 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.852537+0000", 2024-05-08T18:31:56.121 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000126756 2024-05-08T18:31:56.121 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.121 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.121 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:56.122 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.852785+0000", 2024-05-08T18:31:56.122 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024892099999999998 2024-05-08T18:31:56.122 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.122 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.122 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:56.122 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.853042+0000", 2024-05-08T18:31:56.122 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00025698799999999999 2024-05-08T18:31:56.122 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.122 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.122 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:56.122 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.876145+0000", 2024-05-08T18:31:56.122 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.023102746 2024-05-08T18:31:56.122 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.122 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.122 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:56.123 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.878045+0000", 2024-05-08T18:31:56.123 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0018999850000000001 2024-05-08T18:31:56.123 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.123 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.123 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:56.123 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.878117+0000", 2024-05-08T18:31:56.123 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1464000000000006e-05 2024-05-08T18:31:56.123 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.123 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.123 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:56.123 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.878172+0000", 2024-05-08T18:31:56.123 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5127000000000003e-05 2024-05-08T18:31:56.123 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:56.123 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:56.124 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:56.124 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.124 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.124 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1629 3.24 3:27d2a12f:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-05-08T18:31:56.124 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:46.873022+0000", 2024-05-08T18:31:56.124 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 9.1647470040000005, 2024-05-08T18:31:56.124 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019610209, 2024-05-08T18:31:56.124 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:56.124 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:56.124 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:56.124 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:56.124 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:56.124 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:56.124 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1629 2024-05-08T18:31:56.125 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.125 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:56.125 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.125 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:56.125 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.873022+0000", 2024-05-08T18:31:56.125 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:56.125 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.125 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.125 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:56.125 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.873022+0000", 2024-05-08T18:31:56.125 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:56.125 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.125 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.126 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:56.126 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.873024+0000", 2024-05-08T18:31:56.126 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.826e-06 2024-05-08T18:31:56.126 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.126 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.126 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:56.126 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.874556+0000", 2024-05-08T18:31:56.126 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0015321009999999999 2024-05-08T18:31:56.126 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.126 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.126 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:56.126 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.874593+0000", 2024-05-08T18:31:56.126 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6696000000000002e-05 2024-05-08T18:31:56.126 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.127 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.127 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:56.127 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.874610+0000", 2024-05-08T18:31:56.127 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7374e-05 2024-05-08T18:31:56.127 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.127 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.127 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:56.127 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.874687+0000", 2024-05-08T18:31:56.127 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7219999999999996e-05 2024-05-08T18:31:56.127 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.127 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.127 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:56.127 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.874823+0000", 2024-05-08T18:31:56.127 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013538600000000001 2024-05-08T18:31:56.127 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.128 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.128 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:31:56.128 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.874921+0000", 2024-05-08T18:31:56.128 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.8679999999999997e-05 2024-05-08T18:31:56.128 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.128 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.128 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:56.128 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.883485+0000", 2024-05-08T18:31:56.128 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0085638299999999997 2024-05-08T18:31:56.128 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.128 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.128 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:56.128 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.892549+0000", 2024-05-08T18:31:56.128 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0090635850000000007 2024-05-08T18:31:56.128 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.129 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.129 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:56.129 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.892593+0000", 2024-05-08T18:31:56.129 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4566e-05 2024-05-08T18:31:56.129 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.129 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.129 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:56.129 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.892632+0000", 2024-05-08T18:31:56.129 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8945000000000001e-05 2024-05-08T18:31:56.129 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:56.129 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:56.129 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:56.129 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.129 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.130 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1630 3.1e 3:7a85a01c:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-05-08T18:31:56.130 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:46.882333+0000", 2024-05-08T18:31:56.130 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 9.1554360460000002, 2024-05-08T18:31:56.130 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.018692686999999999, 2024-05-08T18:31:56.130 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:56.130 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:56.130 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:56.130 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:56.130 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:56.130 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:56.130 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1630 2024-05-08T18:31:56.130 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.130 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:56.130 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.131 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:56.131 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.882333+0000", 2024-05-08T18:31:56.131 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:56.131 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.131 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.131 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:56.131 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.882333+0000", 2024-05-08T18:31:56.131 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:56.131 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.131 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.131 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:56.131 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.882336+0000", 2024-05-08T18:31:56.131 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7089999999999998e-06 2024-05-08T18:31:56.131 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.131 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.132 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:56.132 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.883864+0000", 2024-05-08T18:31:56.132 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0015277859999999999 2024-05-08T18:31:56.132 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.132 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.132 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:56.132 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.883885+0000", 2024-05-08T18:31:56.132 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1534000000000001e-05 2024-05-08T18:31:56.132 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.132 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.132 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:56.132 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.883900+0000", 2024-05-08T18:31:56.132 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4773999999999999e-05 2024-05-08T18:31:56.133 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.133 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.133 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:56.133 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.883982+0000", 2024-05-08T18:31:56.133 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.2109999999999998e-05 2024-05-08T18:31:56.133 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.133 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.133 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:56.133 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.884128+0000", 2024-05-08T18:31:56.133 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014600299999999999 2024-05-08T18:31:56.133 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.133 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.133 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:31:56.133 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.884249+0000", 2024-05-08T18:31:56.134 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012081799999999999 2024-05-08T18:31:56.134 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.134 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.134 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:56.134 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.890584+0000", 2024-05-08T18:31:56.134 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0063351079999999999 2024-05-08T18:31:56.134 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.134 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.134 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:56.134 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.900934+0000", 2024-05-08T18:31:56.134 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010349591 2024-05-08T18:31:56.134 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.134 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.134 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:56.134 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.900975+0000", 2024-05-08T18:31:56.135 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0979000000000002e-05 2024-05-08T18:31:56.135 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.135 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.135 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:56.135 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.901026+0000", 2024-05-08T18:31:56.135 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.1275e-05 2024-05-08T18:31:56.135 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:56.135 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:56.135 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:56.135 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.135 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.135 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1633 3.15 e83/21 3:ab226f54:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_21:head v 83'2, mlcod=0'0)", 2024-05-08T18:31:56.135 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:46.920100+0000", 2024-05-08T18:31:56.135 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 9.1176696140000004, 2024-05-08T18:31:56.136 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.022841956, 2024-05-08T18:31:56.136 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:56.136 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:56.136 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:56.136 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:56.136 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.136 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:56.136 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.920100+0000", 2024-05-08T18:31:56.136 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:56.136 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.136 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.136 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:56.136 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.920100+0000", 2024-05-08T18:31:56.136 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:56.137 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.137 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.137 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:56.137 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.920101+0000", 2024-05-08T18:31:56.137 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4309999999999999e-06 2024-05-08T18:31:56.137 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.137 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.137 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:56.137 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.926002+0000", 2024-05-08T18:31:56.137 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0059014820000000004 2024-05-08T18:31:56.137 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.137 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.137 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:56.137 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.926041+0000", 2024-05-08T18:31:56.138 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8217999999999999e-05 2024-05-08T18:31:56.138 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.138 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.138 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:56.138 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.926057+0000", 2024-05-08T18:31:56.138 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5877000000000001e-05 2024-05-08T18:31:56.138 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.138 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.138 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:56.138 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.926149+0000", 2024-05-08T18:31:56.138 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.2361000000000006e-05 2024-05-08T18:31:56.138 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.138 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.138 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:56.139 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.926178+0000", 2024-05-08T18:31:56.139 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9544999999999999e-05 2024-05-08T18:31:56.139 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.139 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.139 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:56.139 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.942887+0000", 2024-05-08T18:31:56.139 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.016708163000000002 2024-05-08T18:31:56.139 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.139 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.139 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:56.139 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.942942+0000", 2024-05-08T18:31:56.139 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4879000000000001e-05 2024-05-08T18:31:56.139 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:56.139 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:56.140 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:56.140 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.140 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.140 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1634 3.b 3:d3d25f94:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-05-08T18:31:56.140 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:46.925230+0000", 2024-05-08T18:31:56.140 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 9.1125388790000006, 2024-05-08T18:31:56.140 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.022437625999999999, 2024-05-08T18:31:56.140 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:56.140 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:56.140 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:56.140 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:56.140 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:56.140 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:56.140 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1634 2024-05-08T18:31:56.140 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.141 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:56.141 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.141 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:56.141 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.925230+0000", 2024-05-08T18:31:56.141 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:56.141 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.141 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.141 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:56.141 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.925230+0000", 2024-05-08T18:31:56.141 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:56.141 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.141 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.141 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:56.141 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.925234+0000", 2024-05-08T18:31:56.142 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6789999999999998e-06 2024-05-08T18:31:56.142 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.142 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.142 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:56.142 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.927184+0000", 2024-05-08T18:31:56.142 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0019497799999999999 2024-05-08T18:31:56.142 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.142 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.142 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:56.142 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.927205+0000", 2024-05-08T18:31:56.142 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1231000000000001e-05 2024-05-08T18:31:56.142 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.142 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.142 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:56.143 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.927214+0000", 2024-05-08T18:31:56.143 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0159999999999997e-06 2024-05-08T18:31:56.143 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.143 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.143 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:56.143 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.927287+0000", 2024-05-08T18:31:56.143 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.3192e-05 2024-05-08T18:31:56.143 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.143 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.143 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:56.143 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.927495+0000", 2024-05-08T18:31:56.143 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00020766099999999999 2024-05-08T18:31:56.143 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.143 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.143 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:56.144 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.927653+0000", 2024-05-08T18:31:56.144 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015861799999999999 2024-05-08T18:31:56.144 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.144 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.144 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:56.144 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.947344+0000", 2024-05-08T18:31:56.144 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019690112999999999 2024-05-08T18:31:56.144 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.144 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.144 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:56.144 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.947572+0000", 2024-05-08T18:31:56.144 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000228292 2024-05-08T18:31:56.144 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.144 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.144 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:56.145 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.947618+0000", 2024-05-08T18:31:56.145 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5880000000000001e-05 2024-05-08T18:31:56.145 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.145 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.145 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:56.145 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.947668+0000", 2024-05-08T18:31:56.145 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.0164000000000003e-05 2024-05-08T18:31:56.145 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:56.145 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:56.145 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:56.145 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.145 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.145 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1635 3.27 3:e4667ce2:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-05-08T18:31:56.146 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:46.936207+0000", 2024-05-08T18:31:56.146 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 9.1015622609999998, 2024-05-08T18:31:56.146 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.018244245999999999, 2024-05-08T18:31:56.146 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:56.146 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:56.146 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:56.146 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:56.146 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:56.146 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:56.146 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1635 2024-05-08T18:31:56.146 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.146 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:56.146 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.146 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:56.146 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.936207+0000", 2024-05-08T18:31:56.147 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:56.147 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.147 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.147 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:56.147 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.936207+0000", 2024-05-08T18:31:56.147 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:56.147 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.147 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.147 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:56.147 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.936210+0000", 2024-05-08T18:31:56.147 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.106e-06 2024-05-08T18:31:56.147 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.147 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.147 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:56.148 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.937940+0000", 2024-05-08T18:31:56.148 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001729972 2024-05-08T18:31:56.148 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.148 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.148 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:56.148 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.937963+0000", 2024-05-08T18:31:56.148 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3084000000000001e-05 2024-05-08T18:31:56.148 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.148 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.148 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:56.148 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.937975+0000", 2024-05-08T18:31:56.148 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2072000000000001e-05 2024-05-08T18:31:56.148 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.148 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.148 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:56.149 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.938060+0000", 2024-05-08T18:31:56.149 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5006000000000006e-05 2024-05-08T18:31:56.149 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.149 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.149 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:56.149 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.938220+0000", 2024-05-08T18:31:56.149 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000160018 2024-05-08T18:31:56.149 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.149 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.149 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:31:56.149 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.938359+0000", 2024-05-08T18:31:56.149 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013879300000000001 2024-05-08T18:31:56.149 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.149 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.150 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:56.150 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.947820+0000", 2024-05-08T18:31:56.150 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0094607370000000003 2024-05-08T18:31:56.150 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.150 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.150 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:56.150 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.954291+0000", 2024-05-08T18:31:56.150 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0064716030000000003 2024-05-08T18:31:56.150 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.150 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.150 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:56.150 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.954353+0000", 2024-05-08T18:31:56.150 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1965999999999996e-05 2024-05-08T18:31:56.150 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:56.150 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:56.151 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:56.151 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.954451+0000", 2024-05-08T18:31:56.151 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.7888999999999997e-05 2024-05-08T18:31:56.151 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:56.151 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:56.151 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:56.151 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:56.151 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:56.151 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:56.152 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-08T18:31:56.153 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:31:56.150+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:31:56.254 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:31:56.250+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:31:56.285 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:31:56.286 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:31:56.286 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 0 2024-05-08T18:31:56.286 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:31:56.300 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-08T18:31:56.391 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:31:56.386+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:31:56.455 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:31:56.450+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:31:56.466 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:31:56.466 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:31:56.466 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2024-05-08T18:31:56.466 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2024-05-08T18:31:56.466 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:31:56.480 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-08T18:31:56.557 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:31:56.557+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:31:56.651 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:31:56.651 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2024-05-08T18:31:56.652 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2024-05-08T18:31:56.652 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-05-08T18:31:56.652 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.652 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1315 3.2c e81/21 3:368ed9cc:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_1:head v 81'1, mlcod=0'0)", 2024-05-08T18:31:56.652 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.310943+0000", 2024-05-08T18:31:56.652 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 14.339075214999999, 2024-05-08T18:31:56.652 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019031756, 2024-05-08T18:31:56.652 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:56.652 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:56.652 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:56.652 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:56.652 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.653 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:56.653 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.310943+0000", 2024-05-08T18:31:56.653 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:56.653 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.653 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.653 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:56.653 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.310943+0000", 2024-05-08T18:31:56.653 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:56.653 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.653 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.653 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:56.653 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.310945+0000", 2024-05-08T18:31:56.653 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7800000000000001e-06 2024-05-08T18:31:56.654 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.654 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.654 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:56.654 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.315838+0000", 2024-05-08T18:31:56.654 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0048930800000000002 2024-05-08T18:31:56.654 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.654 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.654 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:56.654 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.315886+0000", 2024-05-08T18:31:56.654 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7336000000000002e-05 2024-05-08T18:31:56.654 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.655 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.655 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:56.655 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.315912+0000", 2024-05-08T18:31:56.655 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6584000000000002e-05 2024-05-08T18:31:56.655 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.655 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.655 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:56.655 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.316123+0000", 2024-05-08T18:31:56.655 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00021075400000000001 2024-05-08T18:31:56.655 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.655 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.655 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:56.655 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.316165+0000", 2024-05-08T18:31:56.655 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1709999999999999e-05 2024-05-08T18:31:56.656 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.656 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.656 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:56.656 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.329876+0000", 2024-05-08T18:31:56.656 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013710803000000001 2024-05-08T18:31:56.656 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.656 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.656 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:56.656 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.329974+0000", 2024-05-08T18:31:56.656 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8709000000000006e-05 2024-05-08T18:31:56.656 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:56.656 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:56.656 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:56.656 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.657 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.657 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1321 3.1b e81/21 3:d9207229:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_7:head v 81'1, mlcod=0'0)", 2024-05-08T18:31:56.657 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.391574+0000", 2024-05-08T18:31:56.657 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 14.258443433, 2024-05-08T18:31:56.657 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016614245, 2024-05-08T18:31:56.657 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:56.657 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:56.657 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:56.657 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:56.657 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.657 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:56.657 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.391574+0000", 2024-05-08T18:31:56.657 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:56.658 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.658 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.658 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:56.658 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.391574+0000", 2024-05-08T18:31:56.658 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:56.658 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.658 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.658 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:56.658 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.391578+0000", 2024-05-08T18:31:56.658 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3440000000000001e-06 2024-05-08T18:31:56.658 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.658 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.658 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:56.659 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.396175+0000", 2024-05-08T18:31:56.659 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0045968850000000002 2024-05-08T18:31:56.659 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.659 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.659 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:56.659 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.396209+0000", 2024-05-08T18:31:56.659 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4146000000000001e-05 2024-05-08T18:31:56.659 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.659 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.659 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:56.659 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.396228+0000", 2024-05-08T18:31:56.659 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9687e-05 2024-05-08T18:31:56.659 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.660 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.660 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:56.660 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.396353+0000", 2024-05-08T18:31:56.660 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012448200000000001 2024-05-08T18:31:56.660 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.660 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.660 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:56.660 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.396392+0000", 2024-05-08T18:31:56.660 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9419999999999999e-05 2024-05-08T18:31:56.660 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.660 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.660 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:56.660 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.408054+0000", 2024-05-08T18:31:56.660 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011661695999999999 2024-05-08T18:31:56.661 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.661 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.661 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:56.661 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.408189+0000", 2024-05-08T18:31:56.661 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000134585 2024-05-08T18:31:56.661 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:56.661 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:56.661 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:56.661 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.661 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.661 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1322 3.f e81/21 3:f3016725:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_8:head v 81'1, mlcod=0'0)", 2024-05-08T18:31:56.661 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.404407+0000", 2024-05-08T18:31:56.662 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 14.245610412, 2024-05-08T18:31:56.662 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016824525999999999, 2024-05-08T18:31:56.662 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:56.662 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:56.662 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:56.662 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:56.662 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.662 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:56.662 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.404407+0000", 2024-05-08T18:31:56.662 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:56.662 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.662 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.662 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:56.662 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.404407+0000", 2024-05-08T18:31:56.663 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:56.663 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.663 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.663 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:56.663 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.404409+0000", 2024-05-08T18:31:56.663 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9460000000000001e-06 2024-05-08T18:31:56.663 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.663 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.663 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:56.663 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.409446+0000", 2024-05-08T18:31:56.663 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.005036942 2024-05-08T18:31:56.663 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.663 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.664 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:56.664 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.409476+0000", 2024-05-08T18:31:56.664 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.9346999999999999e-05 2024-05-08T18:31:56.664 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.664 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.664 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:56.664 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.409498+0000", 2024-05-08T18:31:56.664 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2690000000000001e-05 2024-05-08T18:31:56.664 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.664 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.664 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:56.664 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.409607+0000", 2024-05-08T18:31:56.664 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000108546 2024-05-08T18:31:56.664 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.665 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.665 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:56.665 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.409643+0000", 2024-05-08T18:31:56.665 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5719000000000001e-05 2024-05-08T18:31:56.665 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.665 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.665 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:56.665 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.421097+0000", 2024-05-08T18:31:56.665 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011454166999999999 2024-05-08T18:31:56.665 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.665 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.665 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:56.665 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.421232+0000", 2024-05-08T18:31:56.666 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013516900000000001 2024-05-08T18:31:56.666 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:56.666 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:56.666 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:56.666 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.666 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.666 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1326 3.1b e81/21 3:da64adf7:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_12:head v 81'2, mlcod=0'0)", 2024-05-08T18:31:56.666 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.453834+0000", 2024-05-08T18:31:56.666 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 14.196184240999999, 2024-05-08T18:31:56.666 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015468416, 2024-05-08T18:31:56.666 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:56.666 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:56.666 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:56.667 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:56.667 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.667 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:56.667 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.453834+0000", 2024-05-08T18:31:56.667 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:56.667 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.667 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.667 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:56.667 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.453834+0000", 2024-05-08T18:31:56.667 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:56.667 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.667 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.668 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:56.668 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.453836+0000", 2024-05-08T18:31:56.668 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1830000000000001e-06 2024-05-08T18:31:56.668 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.668 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.668 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:56.668 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.459099+0000", 2024-05-08T18:31:56.668 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0052629499999999997 2024-05-08T18:31:56.668 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.668 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.668 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:56.668 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.459134+0000", 2024-05-08T18:31:56.669 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5437e-05 2024-05-08T18:31:56.669 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.669 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.669 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:56.669 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.459151+0000", 2024-05-08T18:31:56.669 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6506000000000001e-05 2024-05-08T18:31:56.669 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.669 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.669 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:56.669 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.459335+0000", 2024-05-08T18:31:56.669 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00018429500000000001 2024-05-08T18:31:56.669 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.669 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.669 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:56.670 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.459376+0000", 2024-05-08T18:31:56.670 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.07e-05 2024-05-08T18:31:56.670 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.670 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.670 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:56.670 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.469198+0000", 2024-05-08T18:31:56.670 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0098225489999999999 2024-05-08T18:31:56.670 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.670 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.670 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:56.670 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.469302+0000", 2024-05-08T18:31:56.670 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010379599999999999 2024-05-08T18:31:56.671 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:56.671 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:56.671 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:56.671 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.671 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.671 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1327 3.1a 3:58da5138:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-08T18:31:56.671 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.463447+0000", 2024-05-08T18:31:56.671 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 14.186570934000001, 2024-05-08T18:31:56.671 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018677618999999999, 2024-05-08T18:31:56.671 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:56.671 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:56.671 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:56.671 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:56.672 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:31:56.672 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:56.672 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1327 2024-05-08T18:31:56.672 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.672 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:56.672 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.672 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:56.672 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.463447+0000", 2024-05-08T18:31:56.672 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:56.672 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.672 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.672 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:56.672 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.463447+0000", 2024-05-08T18:31:56.673 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:56.673 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.673 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.673 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:56.673 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.463455+0000", 2024-05-08T18:31:56.673 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2430000000000005e-06 2024-05-08T18:31:56.673 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.673 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.673 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:56.673 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.469224+0000", 2024-05-08T18:31:56.673 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0057690830000000004 2024-05-08T18:31:56.673 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.673 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.673 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:56.674 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.469255+0000", 2024-05-08T18:31:56.674 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1000000000000001e-05 2024-05-08T18:31:56.674 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.674 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.674 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:56.674 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.469273+0000", 2024-05-08T18:31:56.674 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7920000000000001e-05 2024-05-08T18:31:56.674 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.674 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.674 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:56.674 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.469451+0000", 2024-05-08T18:31:56.674 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017836499999999999 2024-05-08T18:31:56.675 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.675 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.675 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:56.675 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.469687+0000", 2024-05-08T18:31:56.675 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000235255 2024-05-08T18:31:56.675 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.675 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.675 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:31:56.675 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.469899+0000", 2024-05-08T18:31:56.675 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00021257200000000001 2024-05-08T18:31:56.675 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.675 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.675 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:56.676 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.480590+0000", 2024-05-08T18:31:56.676 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010690963 2024-05-08T18:31:56.676 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.676 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.676 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:56.676 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.481813+0000", 2024-05-08T18:31:56.676 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001223001 2024-05-08T18:31:56.676 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.676 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.676 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:56.676 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.481982+0000", 2024-05-08T18:31:56.677 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016828500000000001 2024-05-08T18:31:56.677 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.677 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.677 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:56.677 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.482124+0000", 2024-05-08T18:31:56.677 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014293199999999999 2024-05-08T18:31:56.677 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:56.677 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:56.677 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:56.677 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.677 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.677 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1328 3.14 3:2b0d89be:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-08T18:31:56.678 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.473844+0000", 2024-05-08T18:31:56.678 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 14.176174045, 2024-05-08T18:31:56.678 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.031713811000000001, 2024-05-08T18:31:56.678 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:56.678 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:56.678 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:56.678 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:56.678 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:31:56.678 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:56.678 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1328 2024-05-08T18:31:56.678 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.678 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:56.678 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.679 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:56.679 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.473844+0000", 2024-05-08T18:31:56.679 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:56.679 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.679 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.679 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:56.679 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.473844+0000", 2024-05-08T18:31:56.679 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:56.679 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.679 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.679 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:56.679 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.473847+0000", 2024-05-08T18:31:56.679 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3100000000000001e-06 2024-05-08T18:31:56.680 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.680 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.680 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:56.680 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.479452+0000", 2024-05-08T18:31:56.680 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0056046910000000002 2024-05-08T18:31:56.680 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.680 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.680 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:56.680 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.479485+0000", 2024-05-08T18:31:56.680 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2808999999999997e-05 2024-05-08T18:31:56.680 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.680 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.680 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:56.680 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.479508+0000", 2024-05-08T18:31:56.681 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3119999999999999e-05 2024-05-08T18:31:56.681 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.681 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.681 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:56.681 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.479638+0000", 2024-05-08T18:31:56.681 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000130586 2024-05-08T18:31:56.681 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.681 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.681 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:56.681 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.479896+0000", 2024-05-08T18:31:56.681 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00025793799999999998 2024-05-08T18:31:56.681 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.681 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.682 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:56.682 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.480111+0000", 2024-05-08T18:31:56.682 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00021487200000000001 2024-05-08T18:31:56.682 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.682 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.682 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:56.682 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.502946+0000", 2024-05-08T18:31:56.682 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.022835101 2024-05-08T18:31:56.682 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.682 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.682 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:56.682 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.505389+0000", 2024-05-08T18:31:56.682 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0024426510000000001 2024-05-08T18:31:56.683 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.683 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.683 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:56.683 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.505479+0000", 2024-05-08T18:31:56.683 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.9863000000000003e-05 2024-05-08T18:31:56.683 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.683 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.683 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:56.683 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.505558+0000", 2024-05-08T18:31:56.683 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8869999999999995e-05 2024-05-08T18:31:56.683 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:56.683 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:56.683 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:56.684 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.684 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.684 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1332 3.14 3:2bdfae75:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-08T18:31:56.684 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.514410+0000", 2024-05-08T18:31:56.684 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 14.135607921, 2024-05-08T18:31:56.684 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.026281202, 2024-05-08T18:31:56.684 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:56.684 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:56.684 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:56.684 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:56.684 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:31:56.684 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:56.684 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1332 2024-05-08T18:31:56.685 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.685 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:56.685 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.685 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:56.685 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.514410+0000", 2024-05-08T18:31:56.685 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:56.685 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.685 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.685 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:56.685 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.514410+0000", 2024-05-08T18:31:56.685 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:56.685 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.685 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.686 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:56.686 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.514413+0000", 2024-05-08T18:31:56.686 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3160000000000001e-06 2024-05-08T18:31:56.686 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.686 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.686 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:56.686 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.519067+0000", 2024-05-08T18:31:56.686 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0046540319999999998 2024-05-08T18:31:56.686 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.686 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.686 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:56.686 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.519104+0000", 2024-05-08T18:31:56.686 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6890000000000001e-05 2024-05-08T18:31:56.687 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.687 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.687 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:56.687 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.519121+0000", 2024-05-08T18:31:56.687 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6583e-05 2024-05-08T18:31:56.687 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.687 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.687 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:56.687 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.519235+0000", 2024-05-08T18:31:56.687 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000114233 2024-05-08T18:31:56.687 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.687 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.687 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:56.687 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.519509+0000", 2024-05-08T18:31:56.688 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000274534 2024-05-08T18:31:56.688 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.688 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.688 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:56.688 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.519763+0000", 2024-05-08T18:31:56.688 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000253088 2024-05-08T18:31:56.688 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.688 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.688 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:56.688 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.532461+0000", 2024-05-08T18:31:56.688 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012698134 2024-05-08T18:31:56.688 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.688 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.689 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:56.689 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.540405+0000", 2024-05-08T18:31:56.689 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0079440699999999993 2024-05-08T18:31:56.689 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.689 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.689 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:56.689 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.540577+0000", 2024-05-08T18:31:56.689 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017180299999999999 2024-05-08T18:31:56.689 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.689 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.689 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:56.689 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.540691+0000", 2024-05-08T18:31:56.689 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011451900000000001 2024-05-08T18:31:56.689 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:56.690 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:56.690 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:56.690 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.690 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.690 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1334 3.f e81/21 3:f1b2aee4:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_20:head v 81'2, mlcod=0'0)", 2024-05-08T18:31:56.690 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.540860+0000", 2024-05-08T18:31:56.690 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 14.109157914000001, 2024-05-08T18:31:56.690 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015497903, 2024-05-08T18:31:56.690 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:56.690 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:56.690 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:56.690 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:56.690 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.691 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:56.691 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.540860+0000", 2024-05-08T18:31:56.691 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:56.691 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.691 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.691 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:56.691 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.540860+0000", 2024-05-08T18:31:56.691 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:56.691 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.691 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.691 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:56.691 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.540861+0000", 2024-05-08T18:31:56.692 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5099999999999999e-06 2024-05-08T18:31:56.692 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.692 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.692 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:56.692 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.543997+0000", 2024-05-08T18:31:56.692 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0031360770000000001 2024-05-08T18:31:56.692 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.692 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.692 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:56.692 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.544040+0000", 2024-05-08T18:31:56.692 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.2743000000000001e-05 2024-05-08T18:31:56.692 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.692 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.692 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:56.693 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.544066+0000", 2024-05-08T18:31:56.693 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5999999999999998e-05 2024-05-08T18:31:56.693 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.693 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.693 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:56.693 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.544235+0000", 2024-05-08T18:31:56.693 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000168985 2024-05-08T18:31:56.693 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.693 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.693 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:56.693 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.544303+0000", 2024-05-08T18:31:56.693 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7392999999999997e-05 2024-05-08T18:31:56.693 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.693 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.694 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:56.694 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.556090+0000", 2024-05-08T18:31:56.694 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011786904000000001 2024-05-08T18:31:56.694 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.694 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.694 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:56.694 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.556358+0000", 2024-05-08T18:31:56.694 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00026829099999999998 2024-05-08T18:31:56.694 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:56.694 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:56.694 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:56.694 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.694 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.695 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1346 3.29 e82/21 3:9766a0f4:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_32:head v 82'1, mlcod=0'0)", 2024-05-08T18:31:56.695 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.665936+0000", 2024-05-08T18:31:56.695 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 13.984081319, 2024-05-08T18:31:56.695 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015958892999999998, 2024-05-08T18:31:56.695 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:56.695 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:56.695 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:56.695 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:56.695 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.695 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:56.695 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.665936+0000", 2024-05-08T18:31:56.695 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:56.695 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.696 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.696 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:56.696 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.665936+0000", 2024-05-08T18:31:56.696 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:56.696 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.696 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.696 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:56.696 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.665937+0000", 2024-05-08T18:31:56.696 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3300000000000002e-07 2024-05-08T18:31:56.696 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.696 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.696 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:56.696 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.672096+0000", 2024-05-08T18:31:56.697 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0061585399999999997 2024-05-08T18:31:56.697 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.697 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.697 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:56.697 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.672123+0000", 2024-05-08T18:31:56.697 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7613000000000001e-05 2024-05-08T18:31:56.697 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.697 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.697 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:56.697 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.672139+0000", 2024-05-08T18:31:56.697 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5869999999999999e-05 2024-05-08T18:31:56.697 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.697 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.697 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:56.698 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.672222+0000", 2024-05-08T18:31:56.698 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2368999999999997e-05 2024-05-08T18:31:56.698 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.698 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.698 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:56.698 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.672255+0000", 2024-05-08T18:31:56.698 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3540000000000001e-05 2024-05-08T18:31:56.698 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.698 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.698 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:56.699 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.681740+0000", 2024-05-08T18:31:56.699 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0094849860000000008 2024-05-08T18:31:56.699 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.699 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.699 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:56.699 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.681895+0000", 2024-05-08T18:31:56.699 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015534199999999999 2024-05-08T18:31:56.699 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:56.699 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:56.699 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:56.699 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.699 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.699 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1349 3.27 e82/21 3:e5090c80:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_35:head v 82'1, mlcod=0'0)", 2024-05-08T18:31:56.699 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.699543+0000", 2024-05-08T18:31:56.700 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 13.950475263, 2024-05-08T18:31:56.700 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016329854000000001, 2024-05-08T18:31:56.700 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:56.700 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:56.700 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:56.700 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:56.700 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.700 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:56.700 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.699543+0000", 2024-05-08T18:31:56.700 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:56.700 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.700 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.700 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:56.700 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.699543+0000", 2024-05-08T18:31:56.701 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:56.701 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.701 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.701 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:56.701 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.699545+0000", 2024-05-08T18:31:56.701 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6529999999999998e-06 2024-05-08T18:31:56.701 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.701 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.701 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:56.701 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.704546+0000", 2024-05-08T18:31:56.701 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0050003599999999997 2024-05-08T18:31:56.701 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.701 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.701 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:56.702 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.704582+0000", 2024-05-08T18:31:56.702 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6165999999999999e-05 2024-05-08T18:31:56.702 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.702 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.702 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:56.702 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.704599+0000", 2024-05-08T18:31:56.702 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.713e-05 2024-05-08T18:31:56.702 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.702 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.702 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:56.702 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.704734+0000", 2024-05-08T18:31:56.702 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000135012 2024-05-08T18:31:56.703 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.703 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.703 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:56.703 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.704776+0000", 2024-05-08T18:31:56.703 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.2626999999999997e-05 2024-05-08T18:31:56.703 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.703 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.703 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:56.703 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.715744+0000", 2024-05-08T18:31:56.703 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010967153 2024-05-08T18:31:56.703 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.703 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.703 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:56.703 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.715872+0000", 2024-05-08T18:31:56.703 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012875300000000001 2024-05-08T18:31:56.704 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:56.704 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:56.704 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:56.704 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.704 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.704 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1357 3.f e82/21 3:f2d0b7b2:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_43:head v 82'3, mlcod=81'1)", 2024-05-08T18:31:56.704 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.786870+0000", 2024-05-08T18:31:56.704 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 13.863147938000001, 2024-05-08T18:31:56.704 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016941210000000002, 2024-05-08T18:31:56.704 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:56.704 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:56.704 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:56.704 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:56.704 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.705 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:56.705 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.786870+0000", 2024-05-08T18:31:56.705 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:56.705 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.705 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.705 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:56.705 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.786870+0000", 2024-05-08T18:31:56.705 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:56.705 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.705 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.705 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:56.705 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.786872+0000", 2024-05-08T18:31:56.705 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5770000000000001e-06 2024-05-08T18:31:56.706 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.706 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.706 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:56.706 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.789682+0000", 2024-05-08T18:31:56.706 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0028092859999999998 2024-05-08T18:31:56.706 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.706 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.706 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:56.706 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.789720+0000", 2024-05-08T18:31:56.706 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7932999999999997e-05 2024-05-08T18:31:56.706 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.706 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.707 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:56.707 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.789740+0000", 2024-05-08T18:31:56.707 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9862999999999999e-05 2024-05-08T18:31:56.707 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.707 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.707 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:56.707 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.789893+0000", 2024-05-08T18:31:56.707 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015356500000000001 2024-05-08T18:31:56.707 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.707 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.707 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:56.707 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.789961+0000", 2024-05-08T18:31:56.707 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8122999999999998e-05 2024-05-08T18:31:56.707 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.708 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.708 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:56.708 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.803714+0000", 2024-05-08T18:31:56.708 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013752664 2024-05-08T18:31:56.708 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.708 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.708 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:56.708 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.803811+0000", 2024-05-08T18:31:56.708 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7199000000000002e-05 2024-05-08T18:31:56.708 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:56.708 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:56.708 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:56.709 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.709 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.709 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1369 3.1 e82/21 3:83b9a38d:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_55:head v 82'1, mlcod=0'0)", 2024-05-08T18:31:56.709 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.908721+0000", 2024-05-08T18:31:56.709 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 13.741296882, 2024-05-08T18:31:56.709 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016507898999999999, 2024-05-08T18:31:56.709 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:56.709 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:56.709 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:56.709 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:56.709 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.709 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:56.709 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.908721+0000", 2024-05-08T18:31:56.709 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:56.709 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.710 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.710 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:56.710 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.908721+0000", 2024-05-08T18:31:56.710 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:56.710 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.710 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.710 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:56.710 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.908722+0000", 2024-05-08T18:31:56.710 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1600000000000001e-07 2024-05-08T18:31:56.710 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.710 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.711 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:56.711 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.912935+0000", 2024-05-08T18:31:56.711 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0042138219999999999 2024-05-08T18:31:56.711 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.711 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.711 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:56.711 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.912970+0000", 2024-05-08T18:31:56.711 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4722999999999999e-05 2024-05-08T18:31:56.711 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.711 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.711 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:56.711 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.912988+0000", 2024-05-08T18:31:56.711 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7972999999999999e-05 2024-05-08T18:31:56.711 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.712 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.712 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:56.712 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.913127+0000", 2024-05-08T18:31:56.712 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013925600000000001 2024-05-08T18:31:56.712 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.712 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.712 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:56.712 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.913167+0000", 2024-05-08T18:31:56.712 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9928999999999997e-05 2024-05-08T18:31:56.712 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.712 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.712 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:56.712 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.925089+0000", 2024-05-08T18:31:56.713 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011921510999999999 2024-05-08T18:31:56.713 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.713 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.713 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:56.713 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.925229+0000", 2024-05-08T18:31:56.713 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014006899999999999 2024-05-08T18:31:56.713 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:56.713 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:56.713 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:56.713 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.713 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.713 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1370 3.9 3:91bbaad9:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_56:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:56.713 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.915888+0000", 2024-05-08T18:31:56.714 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 13.734129673, 2024-05-08T18:31:56.714 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.028543105999999999, 2024-05-08T18:31:56.714 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:56.714 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:56.714 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:56.714 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:56.714 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:31:56.714 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:56.714 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1370 2024-05-08T18:31:56.714 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.714 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:56.714 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.714 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:56.715 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.915888+0000", 2024-05-08T18:31:56.715 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:56.715 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.715 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.715 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:56.715 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.915888+0000", 2024-05-08T18:31:56.715 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:56.715 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.715 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.715 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:56.715 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.915892+0000", 2024-05-08T18:31:56.715 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1269999999999996e-06 2024-05-08T18:31:56.715 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.715 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.716 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:56.716 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.919887+0000", 2024-05-08T18:31:56.716 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039945529999999996 2024-05-08T18:31:56.716 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.716 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.716 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:56.716 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.919929+0000", 2024-05-08T18:31:56.716 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1832999999999997e-05 2024-05-08T18:31:56.716 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.716 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.716 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:56.716 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.919950+0000", 2024-05-08T18:31:56.716 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1197000000000001e-05 2024-05-08T18:31:56.716 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.717 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.717 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:56.717 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.920108+0000", 2024-05-08T18:31:56.717 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015827899999999999 2024-05-08T18:31:56.717 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.717 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.717 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:56.717 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.920401+0000", 2024-05-08T18:31:56.717 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029259799999999998 2024-05-08T18:31:56.717 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.717 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.717 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-05-08T18:31:56.717 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.920625+0000", 2024-05-08T18:31:56.718 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022383099999999999 2024-05-08T18:31:56.718 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.718 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.718 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:56.718 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.933935+0000", 2024-05-08T18:31:56.718 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013310298999999999 2024-05-08T18:31:56.718 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.718 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.718 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:56.718 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.944330+0000", 2024-05-08T18:31:56.718 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010395107000000001 2024-05-08T18:31:56.718 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.718 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.718 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:56.719 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.944383+0000", 2024-05-08T18:31:56.719 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2772000000000002e-05 2024-05-08T18:31:56.719 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.719 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.719 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:56.719 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.944431+0000", 2024-05-08T18:31:56.719 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8510000000000001e-05 2024-05-08T18:31:56.719 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:56.719 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:56.719 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:56.719 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.719 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.719 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1385 3.1a 3:5abdd61d:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_71:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:56.719 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:43.106312+0000", 2024-05-08T18:31:56.720 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 13.543706094000001, 2024-05-08T18:31:56.720 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018362961000000001, 2024-05-08T18:31:56.720 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:56.720 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:56.720 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:56.720 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:56.720 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:31:56.720 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:56.720 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1385 2024-05-08T18:31:56.720 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.720 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:56.720 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.720 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:56.721 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.106312+0000", 2024-05-08T18:31:56.721 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:56.721 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.721 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.721 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:56.721 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.106312+0000", 2024-05-08T18:31:56.721 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:56.721 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.721 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.721 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:56.721 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.106316+0000", 2024-05-08T18:31:56.721 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8739999999999997e-06 2024-05-08T18:31:56.721 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.721 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.721 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:56.722 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.110250+0000", 2024-05-08T18:31:56.722 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039342600000000002 2024-05-08T18:31:56.722 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.722 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.722 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:56.722 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.110289+0000", 2024-05-08T18:31:56.722 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8782999999999998e-05 2024-05-08T18:31:56.722 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.722 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.722 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:56.722 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.110306+0000", 2024-05-08T18:31:56.722 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7793000000000001e-05 2024-05-08T18:31:56.722 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.723 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.723 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:56.723 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.110454+0000", 2024-05-08T18:31:56.723 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014750899999999999 2024-05-08T18:31:56.723 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.723 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.723 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:56.723 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.110700+0000", 2024-05-08T18:31:56.723 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00024594500000000002 2024-05-08T18:31:56.723 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.723 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.723 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:31:56.723 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.110951+0000", 2024-05-08T18:31:56.723 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00025154499999999999 2024-05-08T18:31:56.724 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.724 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.724 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:56.724 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.120973+0000", 2024-05-08T18:31:56.724 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010021835999999999 2024-05-08T18:31:56.724 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.724 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.724 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:56.724 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.124583+0000", 2024-05-08T18:31:56.724 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0036096840000000002 2024-05-08T18:31:56.724 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.724 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.724 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:56.724 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.124630+0000", 2024-05-08T18:31:56.725 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7419000000000001e-05 2024-05-08T18:31:56.725 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.725 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.725 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:56.725 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.124675+0000", 2024-05-08T18:31:56.725 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4313000000000001e-05 2024-05-08T18:31:56.725 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:56.725 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:56.725 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:56.725 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.725 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.725 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1409 3.3 3:c39a24d8:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_95:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:56.725 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:43.363571+0000", 2024-05-08T18:31:56.726 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 13.286446603, 2024-05-08T18:31:56.726 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.021085779999999998, 2024-05-08T18:31:56.726 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:56.726 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:56.726 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:56.726 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:56.726 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:31:56.726 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:56.726 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1409 2024-05-08T18:31:56.726 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.726 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:56.726 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.726 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:56.727 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.363571+0000", 2024-05-08T18:31:56.727 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:56.727 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.727 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.727 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:56.727 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.363571+0000", 2024-05-08T18:31:56.727 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:56.727 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.727 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.727 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:56.727 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.363575+0000", 2024-05-08T18:31:56.727 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7579999999999998e-06 2024-05-08T18:31:56.727 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.727 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.728 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:56.728 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.368212+0000", 2024-05-08T18:31:56.728 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0046369269999999999 2024-05-08T18:31:56.728 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.728 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.728 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:56.728 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.368236+0000", 2024-05-08T18:31:56.728 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.442e-05 2024-05-08T18:31:56.728 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.728 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.728 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:56.728 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.368249+0000", 2024-05-08T18:31:56.728 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2451e-05 2024-05-08T18:31:56.728 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.729 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.729 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:56.729 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.368370+0000", 2024-05-08T18:31:56.729 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000121166 2024-05-08T18:31:56.729 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.729 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.729 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:56.729 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.368577+0000", 2024-05-08T18:31:56.729 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000207429 2024-05-08T18:31:56.729 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.729 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.729 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:56.729 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.368761+0000", 2024-05-08T18:31:56.729 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00018409599999999999 2024-05-08T18:31:56.730 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.730 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.730 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:56.730 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.379675+0000", 2024-05-08T18:31:56.730 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010913058999999999 2024-05-08T18:31:56.730 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.730 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.730 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:56.730 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.384574+0000", 2024-05-08T18:31:56.730 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.004899937 2024-05-08T18:31:56.730 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.730 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.730 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:56.731 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.384616+0000", 2024-05-08T18:31:56.731 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.2035e-05 2024-05-08T18:31:56.731 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.731 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.731 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:56.731 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.384657+0000", 2024-05-08T18:31:56.731 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0501999999999999e-05 2024-05-08T18:31:56.731 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:56.731 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:56.731 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:56.731 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.731 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.731 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1414 3.29 e82/21 3:946e7bc1:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_100:head v 82'2, mlcod=0'0)", 2024-05-08T18:31:56.731 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:43.414971+0000", 2024-05-08T18:31:56.732 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 13.235047245000001, 2024-05-08T18:31:56.732 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015207076999999999, 2024-05-08T18:31:56.732 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:56.732 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:56.732 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:56.732 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:56.732 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.732 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:56.732 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.414971+0000", 2024-05-08T18:31:56.732 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:56.732 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.732 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.732 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:56.732 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.414971+0000", 2024-05-08T18:31:56.733 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:56.733 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.733 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.733 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:56.733 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.414972+0000", 2024-05-08T18:31:56.733 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6729999999999999e-06 2024-05-08T18:31:56.733 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.733 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.733 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:56.733 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.420875+0000", 2024-05-08T18:31:56.733 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0059031379999999996 2024-05-08T18:31:56.733 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.733 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.733 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:56.734 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.420911+0000", 2024-05-08T18:31:56.734 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5963000000000001e-05 2024-05-08T18:31:56.734 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.734 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.734 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:56.734 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.420928+0000", 2024-05-08T18:31:56.734 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7045999999999999e-05 2024-05-08T18:31:56.734 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.734 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.734 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:56.735 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.421019+0000", 2024-05-08T18:31:56.735 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.0941999999999998e-05 2024-05-08T18:31:56.735 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.735 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.735 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:56.735 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.421047+0000", 2024-05-08T18:31:56.735 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7246e-05 2024-05-08T18:31:56.735 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.735 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.735 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:56.735 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.430078+0000", 2024-05-08T18:31:56.735 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0090311369999999998 2024-05-08T18:31:56.735 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.735 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.736 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:56.736 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.430178+0000", 2024-05-08T18:31:56.736 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.9932000000000005e-05 2024-05-08T18:31:56.736 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:56.736 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:56.736 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:56.736 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.736 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.736 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1614 3.14 3:284b5d90:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-05-08T18:31:56.736 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:46.708825+0000", 2024-05-08T18:31:56.736 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 9.9411923899999994, 2024-05-08T18:31:56.736 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.032864125000000001, 2024-05-08T18:31:56.736 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:56.737 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:56.737 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:56.737 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:56.737 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:31:56.737 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:56.737 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1614 2024-05-08T18:31:56.737 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.737 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:56.737 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.737 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:56.737 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.708825+0000", 2024-05-08T18:31:56.737 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:56.737 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.737 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.738 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:56.738 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.708825+0000", 2024-05-08T18:31:56.738 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:56.738 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.738 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.738 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:56.738 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.708828+0000", 2024-05-08T18:31:56.738 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6630000000000002e-06 2024-05-08T18:31:56.738 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.738 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.738 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:56.738 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.715671+0000", 2024-05-08T18:31:56.739 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.006842669 2024-05-08T18:31:56.739 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.739 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.739 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:56.739 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.715706+0000", 2024-05-08T18:31:56.739 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4872000000000001e-05 2024-05-08T18:31:56.739 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.739 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.739 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:56.739 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.715722+0000", 2024-05-08T18:31:56.739 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6670000000000001e-05 2024-05-08T18:31:56.739 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.739 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.739 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:56.740 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.715850+0000", 2024-05-08T18:31:56.740 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000127322 2024-05-08T18:31:56.740 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.740 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.740 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:56.740 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.716102+0000", 2024-05-08T18:31:56.740 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00025211899999999998 2024-05-08T18:31:56.740 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.740 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.740 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:56.740 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.716339+0000", 2024-05-08T18:31:56.740 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00023702099999999999 2024-05-08T18:31:56.740 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.740 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.741 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:56.741 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.737899+0000", 2024-05-08T18:31:56.741 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.021560414 2024-05-08T18:31:56.741 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.741 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.741 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:56.741 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.741414+0000", 2024-05-08T18:31:56.741 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0035152669999999999 2024-05-08T18:31:56.741 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.741 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.741 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:56.741 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.741571+0000", 2024-05-08T18:31:56.741 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015644500000000001 2024-05-08T18:31:56.741 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.742 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.742 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:56.742 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.741690+0000", 2024-05-08T18:31:56.742 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000118663 2024-05-08T18:31:56.742 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:56.742 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:56.742 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:56.742 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.742 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.742 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1622 3.11 e83/21 3:8a36e97a:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_10:head v 83'7, mlcod=82'5)", 2024-05-08T18:31:56.742 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:46.797808+0000", 2024-05-08T18:31:56.742 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 9.8522102710000006, 2024-05-08T18:31:56.742 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019395200000000001, 2024-05-08T18:31:56.743 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:56.743 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:56.743 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:56.743 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:56.743 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.743 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:56.743 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.797808+0000", 2024-05-08T18:31:56.743 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:56.743 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.743 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.743 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:56.743 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.797808+0000", 2024-05-08T18:31:56.743 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:56.744 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.744 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.744 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:56.744 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.797810+0000", 2024-05-08T18:31:56.744 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9800000000000001e-06 2024-05-08T18:31:56.744 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.744 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.744 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:56.744 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.801567+0000", 2024-05-08T18:31:56.744 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0037578709999999999 2024-05-08T18:31:56.744 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.744 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.744 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:56.744 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.801610+0000", 2024-05-08T18:31:56.745 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3013000000000003e-05 2024-05-08T18:31:56.745 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.745 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.745 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:56.745 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.801628+0000", 2024-05-08T18:31:56.745 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7677e-05 2024-05-08T18:31:56.745 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.745 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.745 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:56.745 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.801798+0000", 2024-05-08T18:31:56.745 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000169548 2024-05-08T18:31:56.745 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.745 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.745 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:56.746 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.801836+0000", 2024-05-08T18:31:56.746 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.799e-05 2024-05-08T18:31:56.746 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.746 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.746 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:56.746 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.817068+0000", 2024-05-08T18:31:56.746 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015232671999999999 2024-05-08T18:31:56.746 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.746 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.746 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:56.746 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.817203+0000", 2024-05-08T18:31:56.746 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000134449 2024-05-08T18:31:56.746 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:56.746 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:56.747 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:56.747 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.747 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.747 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1629 3.24 e83/21 3:27d2a12f:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_17:head v 83'2, mlcod=0'0)", 2024-05-08T18:31:56.747 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:46.875375+0000", 2024-05-08T18:31:56.747 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 9.7746425719999994, 2024-05-08T18:31:56.747 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017035814, 2024-05-08T18:31:56.747 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:56.747 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:56.747 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:56.747 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:56.747 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.747 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:56.748 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.875375+0000", 2024-05-08T18:31:56.748 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:56.748 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.748 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.748 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:56.748 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.875375+0000", 2024-05-08T18:31:56.748 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:56.748 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.748 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.748 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:56.748 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.875378+0000", 2024-05-08T18:31:56.748 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6029999999999999e-06 2024-05-08T18:31:56.748 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.748 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.749 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:56.749 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.880781+0000", 2024-05-08T18:31:56.749 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0054034319999999997 2024-05-08T18:31:56.749 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.749 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.749 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:56.749 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.880818+0000", 2024-05-08T18:31:56.749 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6303000000000001e-05 2024-05-08T18:31:56.749 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.749 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.750 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:56.750 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.880833+0000", 2024-05-08T18:31:56.750 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5852999999999999e-05 2024-05-08T18:31:56.750 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.750 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.750 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:56.750 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.880987+0000", 2024-05-08T18:31:56.750 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015368599999999999 2024-05-08T18:31:56.750 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.750 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.750 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:56.750 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.881053+0000", 2024-05-08T18:31:56.750 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6260000000000006e-05 2024-05-08T18:31:56.750 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.751 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.751 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:56.751 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.892244+0000", 2024-05-08T18:31:56.751 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011191002 2024-05-08T18:31:56.751 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.751 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.751 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:56.751 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.892411+0000", 2024-05-08T18:31:56.751 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000166675 2024-05-08T18:31:56.751 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:56.751 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:56.751 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:56.751 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.751 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.752 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1638 3.9 3:9152f27e:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5_100Mb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-05-08T18:31:56.752 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:46.965638+0000", 2024-05-08T18:31:56.752 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 9.6843798999999997, 2024-05-08T18:31:56.752 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.021363499000000001, 2024-05-08T18:31:56.752 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:56.752 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:56.752 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:56.752 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:56.752 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:31:56.752 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:56.752 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1638 2024-05-08T18:31:56.752 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.752 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:56.753 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.753 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:56.753 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.965638+0000", 2024-05-08T18:31:56.753 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:56.753 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.753 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.753 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:56.753 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.965638+0000", 2024-05-08T18:31:56.753 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:56.753 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.753 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.753 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:56.753 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.965640+0000", 2024-05-08T18:31:56.753 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.68e-06 2024-05-08T18:31:56.754 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.754 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.754 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:56.754 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.969701+0000", 2024-05-08T18:31:56.754 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0040609870000000003 2024-05-08T18:31:56.754 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.754 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.754 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:56.754 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.969734+0000", 2024-05-08T18:31:56.754 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3460000000000002e-05 2024-05-08T18:31:56.754 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.754 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.754 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:56.755 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.969750+0000", 2024-05-08T18:31:56.755 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5919000000000001e-05 2024-05-08T18:31:56.755 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.755 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.755 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:56.755 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.969886+0000", 2024-05-08T18:31:56.755 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000135759 2024-05-08T18:31:56.755 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.755 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.755 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:56.755 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.970159+0000", 2024-05-08T18:31:56.755 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00027367199999999998 2024-05-08T18:31:56.755 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.755 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.755 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-05-08T18:31:56.756 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.971062+0000", 2024-05-08T18:31:56.756 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00090291000000000004 2024-05-08T18:31:56.756 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.756 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.756 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:56.756 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.983851+0000", 2024-05-08T18:31:56.756 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012788882999999999 2024-05-08T18:31:56.756 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.756 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.756 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:56.756 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.986511+0000", 2024-05-08T18:31:56.756 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0026593530000000002 2024-05-08T18:31:56.756 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.757 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.757 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:56.757 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.986843+0000", 2024-05-08T18:31:56.757 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00033259400000000002 2024-05-08T18:31:56.757 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:56.757 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:56.757 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:56.757 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.987001+0000", 2024-05-08T18:31:56.757 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015828199999999999 2024-05-08T18:31:56.757 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:56.757 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:56.757 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:56.757 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:56.757 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:56.758 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:31:56.758 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-08T18:31:56.760 INFO:teuthology.orchestra.run.smithi097.stderr:reweighted osd.5 to 1 (10000) 2024-05-08T18:31:56.760 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-08T18:31:56.761 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:31:56.754+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:31:56.761 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-05-08T18:31:56.860 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:31:56.861+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:31:56.934 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:31:56.934 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:31:56.934 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 0 2024-05-08T18:31:56.934 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:31:56.948 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-08T18:31:56.992 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:31:56.990+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:31:57.062 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:31:57.058+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:31:57.067 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:31:57.067 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:31:57.067 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2024-05-08T18:31:57.067 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2024-05-08T18:31:57.067 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:31:57.081 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-08T18:31:57.164 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:31:57.161+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:31:57.231 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-08T18:31:57.252 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:31:57.252 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2024-05-08T18:31:57.252 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2024-05-08T18:31:57.252 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-05-08T18:31:57.252 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.252 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1234 3.38 e80/21 3:1cb36fa1:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.2__shadow_.fYaqa8o34qSAauLRSqi3iwpmT5NwV5c_1:head v 80'1, mlcod=0'0)", 2024-05-08T18:31:57.252 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:38.217418+0000", 2024-05-08T18:31:57.252 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 19.034239564, 2024-05-08T18:31:57.252 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.02469151, 2024-05-08T18:31:57.252 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:57.253 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:57.253 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:57.253 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:57.253 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.253 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:57.253 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.217418+0000", 2024-05-08T18:31:57.253 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:57.253 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.253 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.253 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:57.253 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.217418+0000", 2024-05-08T18:31:57.253 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:57.253 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.254 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.254 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:57.254 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.217420+0000", 2024-05-08T18:31:57.254 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9970000000000001e-06 2024-05-08T18:31:57.254 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.254 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.254 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:57.254 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.225957+0000", 2024-05-08T18:31:57.254 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0085373180000000003 2024-05-08T18:31:57.254 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.254 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.254 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:57.254 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.226002+0000", 2024-05-08T18:31:57.255 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4462999999999998e-05 2024-05-08T18:31:57.255 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.255 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.255 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:57.255 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.226036+0000", 2024-05-08T18:31:57.255 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4286999999999999e-05 2024-05-08T18:31:57.255 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.255 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.255 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:57.255 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.226204+0000", 2024-05-08T18:31:57.255 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000168219 2024-05-08T18:31:57.255 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.255 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.255 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:57.256 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.226269+0000", 2024-05-08T18:31:57.256 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4858999999999997e-05 2024-05-08T18:31:57.256 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.256 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.256 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:57.256 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.242001+0000", 2024-05-08T18:31:57.256 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015731898000000001 2024-05-08T18:31:57.256 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.256 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.256 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:57.256 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.242109+0000", 2024-05-08T18:31:57.256 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010846899999999999 2024-05-08T18:31:57.256 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:57.256 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:57.257 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:57.257 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.257 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.257 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1237 3.c 3:3156de39:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.2_10Mb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (355) in=17b,setxattr user.rgw.acl (129) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-05-08T18:31:57.257 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:38.244592+0000", 2024-05-08T18:31:57.257 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 19.007065260000001, 2024-05-08T18:31:57.257 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.021467379000000002, 2024-05-08T18:31:57.257 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:57.257 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:57.257 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:57.257 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:57.257 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:31:57.257 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:57.257 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1237 2024-05-08T18:31:57.258 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.258 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:57.258 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.258 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:57.258 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.244592+0000", 2024-05-08T18:31:57.258 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:57.258 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.258 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.258 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:57.258 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.244592+0000", 2024-05-08T18:31:57.258 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:57.258 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.258 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.258 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:57.259 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.244599+0000", 2024-05-08T18:31:57.259 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3170000000000004e-06 2024-05-08T18:31:57.259 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.259 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.259 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:57.259 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.250239+0000", 2024-05-08T18:31:57.259 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0056396270000000004 2024-05-08T18:31:57.259 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.259 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.259 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:57.259 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.250279+0000", 2024-05-08T18:31:57.259 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0370000000000001e-05 2024-05-08T18:31:57.259 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.260 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.260 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:57.260 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.250305+0000", 2024-05-08T18:31:57.260 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5259999999999999e-05 2024-05-08T18:31:57.260 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.260 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.260 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:57.260 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.250509+0000", 2024-05-08T18:31:57.260 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020390800000000001 2024-05-08T18:31:57.260 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.260 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.260 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:57.260 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.250777+0000", 2024-05-08T18:31:57.260 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00026804200000000002 2024-05-08T18:31:57.261 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.261 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.261 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:57.261 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.251654+0000", 2024-05-08T18:31:57.261 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00087763999999999995 2024-05-08T18:31:57.261 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.261 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.261 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:57.261 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.263070+0000", 2024-05-08T18:31:57.261 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011415544 2024-05-08T18:31:57.261 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.261 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.261 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:57.261 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.265866+0000", 2024-05-08T18:31:57.262 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002795699 2024-05-08T18:31:57.262 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.262 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.262 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:57.262 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.265975+0000", 2024-05-08T18:31:57.262 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000109819 2024-05-08T18:31:57.262 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.263 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.263 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:57.263 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.266060+0000", 2024-05-08T18:31:57.263 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4153000000000006e-05 2024-05-08T18:31:57.263 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:57.263 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:57.263 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:57.263 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.263 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.263 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1318 3.c 3:329e59e6:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-08T18:31:57.263 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.337285+0000", 2024-05-08T18:31:57.263 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 14.914372837, 2024-05-08T18:31:57.263 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.024126754, 2024-05-08T18:31:57.264 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:57.264 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:57.264 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:57.264 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:57.264 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:31:57.264 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:57.264 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1318 2024-05-08T18:31:57.264 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.264 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:57.264 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.264 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:57.264 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.337285+0000", 2024-05-08T18:31:57.264 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:57.264 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.265 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.265 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:57.265 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.337285+0000", 2024-05-08T18:31:57.265 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:57.265 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.265 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.265 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:57.265 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.337288+0000", 2024-05-08T18:31:57.265 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6799999999999999e-06 2024-05-08T18:31:57.265 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.265 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.265 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:57.265 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.343559+0000", 2024-05-08T18:31:57.266 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0062709920000000004 2024-05-08T18:31:57.266 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.266 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.266 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:57.266 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.343600+0000", 2024-05-08T18:31:57.266 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0686000000000003e-05 2024-05-08T18:31:57.266 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.266 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.266 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:57.266 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.343621+0000", 2024-05-08T18:31:57.266 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1364000000000001e-05 2024-05-08T18:31:57.266 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.266 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.266 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:57.267 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.343774+0000", 2024-05-08T18:31:57.267 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000152495 2024-05-08T18:31:57.267 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.267 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.267 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:57.267 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.344025+0000", 2024-05-08T18:31:57.267 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00025118800000000001 2024-05-08T18:31:57.267 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.267 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.267 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:57.267 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.344259+0000", 2024-05-08T18:31:57.267 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000234455 2024-05-08T18:31:57.267 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.267 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.268 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:57.268 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.357786+0000", 2024-05-08T18:31:57.268 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013526338000000001 2024-05-08T18:31:57.268 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.268 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.268 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:57.268 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.361116+0000", 2024-05-08T18:31:57.268 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0033298619999999998 2024-05-08T18:31:57.268 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.268 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.268 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:57.268 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.361290+0000", 2024-05-08T18:31:57.268 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017451200000000001 2024-05-08T18:31:57.269 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.269 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.269 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:57.269 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.361411+0000", 2024-05-08T18:31:57.269 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012118200000000001 2024-05-08T18:31:57.269 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:57.269 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:57.269 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:57.269 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.269 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.269 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1319 3.35 e81/21 3:add64cdc:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_5:head v 81'1, mlcod=0'0)", 2024-05-08T18:31:57.269 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.363830+0000", 2024-05-08T18:31:57.269 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 14.887827894000001, 2024-05-08T18:31:57.269 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017296962999999999, 2024-05-08T18:31:57.270 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:57.270 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:57.270 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:57.270 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:57.270 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.270 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:57.270 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.363830+0000", 2024-05-08T18:31:57.270 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:57.270 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.270 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.270 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:57.270 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.363830+0000", 2024-05-08T18:31:57.270 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:57.271 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.271 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.271 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:57.271 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.363832+0000", 2024-05-08T18:31:57.271 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5059999999999998e-06 2024-05-08T18:31:57.271 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.271 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.271 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:57.271 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.366782+0000", 2024-05-08T18:31:57.271 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002950088 2024-05-08T18:31:57.271 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.271 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.271 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:57.271 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.366834+0000", 2024-05-08T18:31:57.272 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1860000000000002e-05 2024-05-08T18:31:57.272 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.272 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.272 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:57.272 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.366861+0000", 2024-05-08T18:31:57.272 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7172999999999999e-05 2024-05-08T18:31:57.272 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.272 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.272 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:57.272 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.367044+0000", 2024-05-08T18:31:57.272 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000183081 2024-05-08T18:31:57.272 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.272 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.272 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:57.272 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.367109+0000", 2024-05-08T18:31:57.273 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4346999999999999e-05 2024-05-08T18:31:57.273 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.273 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.273 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:57.273 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.381025+0000", 2024-05-08T18:31:57.273 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013916767999999999 2024-05-08T18:31:57.273 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.273 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.273 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:57.273 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.381127+0000", 2024-05-08T18:31:57.273 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010114 2024-05-08T18:31:57.273 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:57.273 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:57.273 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:57.274 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.274 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.274 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1324 3.3a 3:5fe59963:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-08T18:31:57.274 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.429632+0000", 2024-05-08T18:31:57.274 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 14.822025133, 2024-05-08T18:31:57.274 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019556068999999999, 2024-05-08T18:31:57.274 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:57.274 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:57.274 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:57.274 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:57.274 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:31:57.274 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:57.274 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1324 2024-05-08T18:31:57.274 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.275 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:57.275 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.275 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:57.275 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.429632+0000", 2024-05-08T18:31:57.275 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:57.275 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.275 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.275 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:57.275 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.429632+0000", 2024-05-08T18:31:57.275 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:57.275 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.275 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.275 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:57.275 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.429636+0000", 2024-05-08T18:31:57.275 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9060000000000004e-06 2024-05-08T18:31:57.276 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.276 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.276 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:57.276 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.434488+0000", 2024-05-08T18:31:57.276 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0048521270000000003 2024-05-08T18:31:57.276 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.276 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.276 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:57.276 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.434529+0000", 2024-05-08T18:31:57.276 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0365999999999999e-05 2024-05-08T18:31:57.276 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.276 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.276 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:57.276 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.434548+0000", 2024-05-08T18:31:57.276 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8893999999999999e-05 2024-05-08T18:31:57.277 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.277 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.277 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:57.277 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.434680+0000", 2024-05-08T18:31:57.277 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000132285 2024-05-08T18:31:57.277 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.277 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.277 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:57.277 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.434925+0000", 2024-05-08T18:31:57.277 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00024557799999999999 2024-05-08T18:31:57.277 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.277 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.277 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:57.277 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.435148+0000", 2024-05-08T18:31:57.278 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022281800000000001 2024-05-08T18:31:57.278 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.278 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.278 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:57.278 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.447529+0000", 2024-05-08T18:31:57.278 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012380584 2024-05-08T18:31:57.278 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.278 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.278 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:57.278 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.448987+0000", 2024-05-08T18:31:57.278 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0014577189999999999 2024-05-08T18:31:57.278 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.278 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.278 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:57.279 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.449113+0000", 2024-05-08T18:31:57.279 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000126482 2024-05-08T18:31:57.279 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.279 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.279 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:57.279 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.449188+0000", 2024-05-08T18:31:57.279 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5309999999999996e-05 2024-05-08T18:31:57.279 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:57.279 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:57.279 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:57.279 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.279 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.279 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1329 3.21 e81/21 3:87d2ef9d:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_15:head v 81'1, mlcod=0'0)", 2024-05-08T18:31:57.280 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.485669+0000", 2024-05-08T18:31:57.280 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 14.765988386, 2024-05-08T18:31:57.280 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017689297, 2024-05-08T18:31:57.280 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:57.280 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:57.280 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:57.280 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:57.280 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.280 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:57.280 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.485669+0000", 2024-05-08T18:31:57.280 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:57.280 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.280 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.280 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:57.280 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.485669+0000", 2024-05-08T18:31:57.281 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:57.281 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.281 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.281 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:57.281 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.485673+0000", 2024-05-08T18:31:57.281 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5329999999999999e-06 2024-05-08T18:31:57.281 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.281 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.281 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:57.281 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.490524+0000", 2024-05-08T18:31:57.281 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0048517040000000001 2024-05-08T18:31:57.281 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.281 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.281 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:57.282 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.490575+0000", 2024-05-08T18:31:57.282 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1162000000000002e-05 2024-05-08T18:31:57.282 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.282 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.282 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:57.282 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.490601+0000", 2024-05-08T18:31:57.282 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6007e-05 2024-05-08T18:31:57.282 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.282 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.282 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:57.282 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.490762+0000", 2024-05-08T18:31:57.282 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000160586 2024-05-08T18:31:57.282 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.283 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.283 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:57.283 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.490817+0000", 2024-05-08T18:31:57.283 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5299e-05 2024-05-08T18:31:57.283 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.283 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.283 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:57.283 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.503282+0000", 2024-05-08T18:31:57.283 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.01246419 2024-05-08T18:31:57.283 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.283 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.283 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:57.283 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.503358+0000", 2024-05-08T18:31:57.284 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6816000000000005e-05 2024-05-08T18:31:57.284 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:57.284 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:57.284 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:57.284 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.284 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.284 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1345 3.16 3:6b11af87:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_31:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:57.284 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.654496+0000", 2024-05-08T18:31:57.284 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 14.597161785000001, 2024-05-08T18:31:57.284 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018804122, 2024-05-08T18:31:57.284 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:57.284 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:57.284 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:57.284 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:57.285 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:31:57.285 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:57.285 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1345 2024-05-08T18:31:57.285 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.285 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:57.285 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.285 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:57.285 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.654496+0000", 2024-05-08T18:31:57.285 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:57.285 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.285 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.285 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:57.285 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.654496+0000", 2024-05-08T18:31:57.286 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:57.286 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.286 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.286 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:57.286 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.654501+0000", 2024-05-08T18:31:57.286 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.383e-06 2024-05-08T18:31:57.286 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.286 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.286 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:57.286 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.658837+0000", 2024-05-08T18:31:57.286 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0043363580000000002 2024-05-08T18:31:57.286 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.286 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.286 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:57.287 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.658886+0000", 2024-05-08T18:31:57.287 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8364e-05 2024-05-08T18:31:57.287 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.287 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.287 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:57.287 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.658908+0000", 2024-05-08T18:31:57.287 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2019999999999999e-05 2024-05-08T18:31:57.287 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.287 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.287 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:57.287 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.659056+0000", 2024-05-08T18:31:57.287 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014852499999999999 2024-05-08T18:31:57.287 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.287 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.288 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:57.288 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.659359+0000", 2024-05-08T18:31:57.288 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00030253799999999998 2024-05-08T18:31:57.288 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.288 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.288 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:57.288 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.659565+0000", 2024-05-08T18:31:57.288 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000206372 2024-05-08T18:31:57.288 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.288 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.288 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:57.288 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.668806+0000", 2024-05-08T18:31:57.288 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0092405300000000003 2024-05-08T18:31:57.288 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.289 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.289 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:57.289 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.673130+0000", 2024-05-08T18:31:57.289 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0043237869999999999 2024-05-08T18:31:57.289 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.289 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.289 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:57.289 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.673221+0000", 2024-05-08T18:31:57.289 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1891999999999994e-05 2024-05-08T18:31:57.289 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.289 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.289 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:57.289 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.673300+0000", 2024-05-08T18:31:57.289 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8353e-05 2024-05-08T18:31:57.289 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:57.290 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:57.290 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:57.290 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.290 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.290 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1350 3.3a 3:5caef9cc:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_36:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:57.290 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.707170+0000", 2024-05-08T18:31:57.290 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 14.544487531, 2024-05-08T18:31:57.290 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.02479787, 2024-05-08T18:31:57.290 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:57.290 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:57.290 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:57.290 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:57.290 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:31:57.291 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:57.291 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1350 2024-05-08T18:31:57.291 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.291 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:57.291 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.291 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:57.291 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.707170+0000", 2024-05-08T18:31:57.291 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:57.291 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.291 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.291 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:57.291 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.707170+0000", 2024-05-08T18:31:57.291 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:57.291 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.292 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.292 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:57.292 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.707174+0000", 2024-05-08T18:31:57.292 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6629999999999999e-06 2024-05-08T18:31:57.292 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.292 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.292 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:57.292 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.713406+0000", 2024-05-08T18:31:57.292 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0062328030000000003 2024-05-08T18:31:57.292 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.292 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.292 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:57.292 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.713446+0000", 2024-05-08T18:31:57.292 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9990000000000002e-05 2024-05-08T18:31:57.293 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.293 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.293 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:57.293 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.713466+0000", 2024-05-08T18:31:57.293 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0136000000000002e-05 2024-05-08T18:31:57.293 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.293 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.293 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:57.293 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.713609+0000", 2024-05-08T18:31:57.293 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014227599999999999 2024-05-08T18:31:57.293 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.293 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.293 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:57.293 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.713871+0000", 2024-05-08T18:31:57.294 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000261885 2024-05-08T18:31:57.294 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.294 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.294 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:57.294 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.714152+0000", 2024-05-08T18:31:57.294 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00028181099999999998 2024-05-08T18:31:57.294 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.294 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.294 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:57.294 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.723750+0000", 2024-05-08T18:31:57.295 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0095972739999999994 2024-05-08T18:31:57.295 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.295 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.295 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:57.295 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.731740+0000", 2024-05-08T18:31:57.295 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0079900969999999998 2024-05-08T18:31:57.295 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.295 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.295 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:57.295 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.731843+0000", 2024-05-08T18:31:57.295 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000103052 2024-05-08T18:31:57.295 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.295 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.295 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:57.296 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.731968+0000", 2024-05-08T18:31:57.296 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000124883 2024-05-08T18:31:57.296 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:57.296 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:57.296 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:57.296 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.296 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.296 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1354 3.3c 3:3dadbb2b:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_40:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:57.296 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.752128+0000", 2024-05-08T18:31:57.296 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 14.499529282999999, 2024-05-08T18:31:57.296 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018345100999999999, 2024-05-08T18:31:57.296 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:57.296 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:57.296 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:57.297 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:57.297 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:31:57.297 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:57.297 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1354 2024-05-08T18:31:57.297 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.297 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:57.297 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.297 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:57.297 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.752128+0000", 2024-05-08T18:31:57.297 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:57.297 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.297 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.298 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:57.298 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.752128+0000", 2024-05-08T18:31:57.298 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:57.298 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.298 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.298 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:57.298 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.752131+0000", 2024-05-08T18:31:57.298 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1099999999999999e-06 2024-05-08T18:31:57.298 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.298 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.298 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:57.299 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.756064+0000", 2024-05-08T18:31:57.299 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039330470000000003 2024-05-08T18:31:57.299 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.299 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.299 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:57.299 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.756099+0000", 2024-05-08T18:31:57.299 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4672999999999998e-05 2024-05-08T18:31:57.299 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.299 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.299 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:57.299 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.756117+0000", 2024-05-08T18:31:57.299 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7915999999999999e-05 2024-05-08T18:31:57.299 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.299 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.300 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:57.300 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.756305+0000", 2024-05-08T18:31:57.300 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00018806300000000001 2024-05-08T18:31:57.300 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.300 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.300 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:57.300 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.756554+0000", 2024-05-08T18:31:57.300 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00024884400000000002 2024-05-08T18:31:57.300 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.300 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.300 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:57.300 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.756778+0000", 2024-05-08T18:31:57.300 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000223988 2024-05-08T18:31:57.300 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.301 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.301 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:57.301 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.765533+0000", 2024-05-08T18:31:57.301 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0087551209999999994 2024-05-08T18:31:57.301 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.301 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.301 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:57.301 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.770135+0000", 2024-05-08T18:31:57.301 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0046018279999999996 2024-05-08T18:31:57.301 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.301 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.301 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:57.301 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.770312+0000", 2024-05-08T18:31:57.301 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017694299999999999 2024-05-08T18:31:57.302 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.302 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.302 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:57.302 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.770473+0000", 2024-05-08T18:31:57.302 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016156800000000001 2024-05-08T18:31:57.302 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:57.302 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:57.302 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:57.302 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.302 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.302 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1355 3.28 3:14052413:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_41:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:57.302 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.762527+0000", 2024-05-08T18:31:57.302 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 14.489129968, 2024-05-08T18:31:57.302 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.026016406999999998, 2024-05-08T18:31:57.303 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:57.303 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:57.303 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:57.303 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:57.303 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:31:57.303 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:57.303 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1355 2024-05-08T18:31:57.303 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.303 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:57.303 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.303 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:57.303 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.762527+0000", 2024-05-08T18:31:57.303 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:57.303 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.304 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.304 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:57.304 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.762527+0000", 2024-05-08T18:31:57.304 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:57.304 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.304 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.304 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:57.304 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.762545+0000", 2024-05-08T18:31:57.304 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7045999999999999e-05 2024-05-08T18:31:57.304 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.304 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.304 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:57.304 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.767178+0000", 2024-05-08T18:31:57.304 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0046339420000000003 2024-05-08T18:31:57.305 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.305 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.305 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:57.305 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.767214+0000", 2024-05-08T18:31:57.305 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5855999999999997e-05 2024-05-08T18:31:57.305 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.305 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.305 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:57.305 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.767242+0000", 2024-05-08T18:31:57.305 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8113e-05 2024-05-08T18:31:57.305 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.305 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.305 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:57.305 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.767401+0000", 2024-05-08T18:31:57.305 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000158429 2024-05-08T18:31:57.306 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.306 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.306 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:57.306 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.767648+0000", 2024-05-08T18:31:57.306 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000247328 2024-05-08T18:31:57.306 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.306 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.306 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:57.306 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.767899+0000", 2024-05-08T18:31:57.306 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00025059799999999999 2024-05-08T18:31:57.306 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.306 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.306 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:57.306 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.780702+0000", 2024-05-08T18:31:57.307 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012803238 2024-05-08T18:31:57.307 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.307 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.307 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:57.307 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.788231+0000", 2024-05-08T18:31:57.307 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0075285090000000001 2024-05-08T18:31:57.307 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.307 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.307 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:57.307 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.788402+0000", 2024-05-08T18:31:57.307 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017113299999999999 2024-05-08T18:31:57.307 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.307 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.307 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:57.308 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.788544+0000", 2024-05-08T18:31:57.308 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014221500000000001 2024-05-08T18:31:57.308 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:57.308 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:57.308 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:57.308 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.308 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.308 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1377 3.28 3:1730bdaf:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_63:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:57.308 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.996763+0000", 2024-05-08T18:31:57.308 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 14.254894820000001, 2024-05-08T18:31:57.308 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.02215497, 2024-05-08T18:31:57.308 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:57.308 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:57.308 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:57.308 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:57.309 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:31:57.309 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:57.309 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1377 2024-05-08T18:31:57.309 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.309 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:57.309 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.309 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:57.309 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.996763+0000", 2024-05-08T18:31:57.309 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:57.309 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.309 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.309 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:57.309 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.996763+0000", 2024-05-08T18:31:57.309 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:57.310 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.310 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.310 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:57.310 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.996766+0000", 2024-05-08T18:31:57.310 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.9299999999999999e-06 2024-05-08T18:31:57.310 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.310 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.310 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:57.310 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.002222+0000", 2024-05-08T18:31:57.310 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0054559819999999998 2024-05-08T18:31:57.310 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.310 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.310 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:57.311 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.002259+0000", 2024-05-08T18:31:57.311 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7222999999999999e-05 2024-05-08T18:31:57.311 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.311 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.311 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:57.311 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.002277+0000", 2024-05-08T18:31:57.311 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8607e-05 2024-05-08T18:31:57.311 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.311 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.311 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:57.311 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.002484+0000", 2024-05-08T18:31:57.311 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020670500000000001 2024-05-08T18:31:57.311 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.311 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.312 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:57.312 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.002843+0000", 2024-05-08T18:31:57.312 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00035888100000000002 2024-05-08T18:31:57.312 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.312 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.312 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:57.312 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.003165+0000", 2024-05-08T18:31:57.312 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00032193 2024-05-08T18:31:57.312 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.312 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.312 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:57.312 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.011993+0000", 2024-05-08T18:31:57.312 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.008827718 2024-05-08T18:31:57.312 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.313 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.313 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:57.313 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.018733+0000", 2024-05-08T18:31:57.313 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.006739989 2024-05-08T18:31:57.313 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.313 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.313 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:57.313 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.018840+0000", 2024-05-08T18:31:57.313 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000107799 2024-05-08T18:31:57.313 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.313 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.313 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:57.313 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.018918+0000", 2024-05-08T18:31:57.313 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.7206000000000006e-05 2024-05-08T18:31:57.314 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:57.314 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:57.314 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:57.314 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.314 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.314 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1382 3.3c 3:3ed9d8c1:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_68:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:57.314 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:43.066505+0000", 2024-05-08T18:31:57.314 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 14.185151938000001, 2024-05-08T18:31:57.314 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017959088000000002, 2024-05-08T18:31:57.314 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:57.314 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:57.314 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:57.314 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:57.315 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:31:57.315 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:57.315 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1382 2024-05-08T18:31:57.315 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.315 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:57.315 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.315 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:57.315 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.066505+0000", 2024-05-08T18:31:57.315 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:57.315 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.315 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.315 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:57.315 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.066505+0000", 2024-05-08T18:31:57.315 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:57.316 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.316 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.316 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:57.316 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.066509+0000", 2024-05-08T18:31:57.316 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9330000000000003e-06 2024-05-08T18:31:57.316 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.316 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.316 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:57.316 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.070605+0000", 2024-05-08T18:31:57.316 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0040954190000000003 2024-05-08T18:31:57.316 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.316 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.316 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:57.316 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.070644+0000", 2024-05-08T18:31:57.316 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9143000000000001e-05 2024-05-08T18:31:57.317 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.317 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.317 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:57.317 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.070663+0000", 2024-05-08T18:31:57.317 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.946e-05 2024-05-08T18:31:57.317 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.317 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.317 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:57.317 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.070797+0000", 2024-05-08T18:31:57.317 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000133895 2024-05-08T18:31:57.317 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.317 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.317 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:57.317 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.071141+0000", 2024-05-08T18:31:57.318 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00034375399999999999 2024-05-08T18:31:57.318 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.318 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.318 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:57.318 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.071553+0000", 2024-05-08T18:31:57.318 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000412304 2024-05-08T18:31:57.318 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.318 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.318 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:57.318 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.082253+0000", 2024-05-08T18:31:57.318 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010699301 2024-05-08T18:31:57.318 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.318 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.318 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:57.318 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.084278+0000", 2024-05-08T18:31:57.319 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002025504 2024-05-08T18:31:57.319 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.319 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.319 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:57.319 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.084377+0000", 2024-05-08T18:31:57.319 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8832000000000005e-05 2024-05-08T18:31:57.319 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.319 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.319 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:57.319 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.084465+0000", 2024-05-08T18:31:57.319 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.7542999999999999e-05 2024-05-08T18:31:57.319 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:57.319 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:57.319 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:57.320 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.320 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.320 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1389 3.2a 3:54f0af80:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_75:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:57.320 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:43.164992+0000", 2024-05-08T18:31:57.320 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 14.086665112, 2024-05-08T18:31:57.320 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017620855000000001, 2024-05-08T18:31:57.320 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:57.320 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:57.320 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:57.320 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:57.320 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:31:57.320 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:57.320 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1389 2024-05-08T18:31:57.321 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.321 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:57.321 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.321 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:57.321 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.164992+0000", 2024-05-08T18:31:57.321 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:57.321 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.321 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.321 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:57.321 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.164992+0000", 2024-05-08T18:31:57.321 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:57.321 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.321 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.321 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:57.322 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.164994+0000", 2024-05-08T18:31:57.322 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.883e-06 2024-05-08T18:31:57.322 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.322 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.322 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:57.322 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.168981+0000", 2024-05-08T18:31:57.322 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039864210000000004 2024-05-08T18:31:57.322 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.322 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.322 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:57.323 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.169001+0000", 2024-05-08T18:31:57.323 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0299999999999999e-05 2024-05-08T18:31:57.323 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.323 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.323 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:57.323 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.169011+0000", 2024-05-08T18:31:57.323 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.9969999999999993e-06 2024-05-08T18:31:57.323 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.323 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.323 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:57.323 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.169091+0000", 2024-05-08T18:31:57.323 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9887000000000003e-05 2024-05-08T18:31:57.323 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.323 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.324 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:57.324 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.169236+0000", 2024-05-08T18:31:57.324 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000145551 2024-05-08T18:31:57.324 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.324 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.324 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:57.324 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.169358+0000", 2024-05-08T18:31:57.324 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012136700000000001 2024-05-08T18:31:57.324 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.324 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.324 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:57.324 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.181853+0000", 2024-05-08T18:31:57.324 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012495681999999999 2024-05-08T18:31:57.325 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.325 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.325 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:57.325 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.182522+0000", 2024-05-08T18:31:57.325 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00066872199999999996 2024-05-08T18:31:57.325 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.325 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.325 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:57.325 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.182571+0000", 2024-05-08T18:31:57.325 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8701e-05 2024-05-08T18:31:57.325 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.325 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.325 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:57.325 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.182613+0000", 2024-05-08T18:31:57.325 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.2344e-05 2024-05-08T18:31:57.326 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:57.326 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:57.326 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:57.326 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.326 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.326 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1392 3.1c 3:3980ad1f:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_78:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:57.326 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:43.194783+0000", 2024-05-08T18:31:57.326 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 14.056874656, 2024-05-08T18:31:57.326 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016994925000000001, 2024-05-08T18:31:57.326 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:57.326 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:57.326 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:57.326 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:57.326 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:31:57.327 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:57.327 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1392 2024-05-08T18:31:57.327 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.327 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:57.327 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.327 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:57.327 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.194783+0000", 2024-05-08T18:31:57.327 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:57.327 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.327 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.327 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:57.327 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.194783+0000", 2024-05-08T18:31:57.327 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:57.328 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.328 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.328 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:57.328 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.194785+0000", 2024-05-08T18:31:57.328 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.181e-06 2024-05-08T18:31:57.328 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.328 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.328 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:57.328 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.198668+0000", 2024-05-08T18:31:57.328 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0038826490000000002 2024-05-08T18:31:57.328 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.328 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.329 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:57.329 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.198693+0000", 2024-05-08T18:31:57.329 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5771000000000001e-05 2024-05-08T18:31:57.329 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.329 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.329 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:57.329 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.198707+0000", 2024-05-08T18:31:57.329 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.345e-05 2024-05-08T18:31:57.329 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.329 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.329 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:57.329 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.198785+0000", 2024-05-08T18:31:57.329 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8415000000000001e-05 2024-05-08T18:31:57.329 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.330 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.330 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:57.330 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.198923+0000", 2024-05-08T18:31:57.330 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013767599999999999 2024-05-08T18:31:57.330 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.330 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.330 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 4", 2024-05-08T18:31:57.330 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.199032+0000", 2024-05-08T18:31:57.330 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000108853 2024-05-08T18:31:57.330 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.330 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.330 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:57.330 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.204221+0000", 2024-05-08T18:31:57.331 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0051894080000000004 2024-05-08T18:31:57.331 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.331 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.331 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:57.331 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.211655+0000", 2024-05-08T18:31:57.331 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0074334709999999997 2024-05-08T18:31:57.331 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.331 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.331 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:57.331 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.211715+0000", 2024-05-08T18:31:57.331 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.0007000000000003e-05 2024-05-08T18:31:57.331 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.331 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.331 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:57.331 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.211778+0000", 2024-05-08T18:31:57.332 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3044000000000002e-05 2024-05-08T18:31:57.332 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:57.332 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:57.332 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:57.332 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.332 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.332 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1407 3.22 3:46b64ebe:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_93:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:57.332 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:43.343033+0000", 2024-05-08T18:31:57.332 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 13.908624473, 2024-05-08T18:31:57.332 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.022710952, 2024-05-08T18:31:57.332 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:57.332 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:57.332 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:57.332 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:57.332 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:31:57.332 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:57.333 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1407 2024-05-08T18:31:57.333 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.333 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:57.333 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.333 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:57.333 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.343033+0000", 2024-05-08T18:31:57.333 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:57.333 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.333 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.333 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:57.333 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.343033+0000", 2024-05-08T18:31:57.333 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:57.333 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.333 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.334 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:57.334 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.343035+0000", 2024-05-08T18:31:57.334 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5100000000000001e-06 2024-05-08T18:31:57.334 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.334 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.334 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:57.334 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.346921+0000", 2024-05-08T18:31:57.334 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0038850489999999998 2024-05-08T18:31:57.334 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.334 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.334 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:57.334 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.346943+0000", 2024-05-08T18:31:57.334 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2897000000000001e-05 2024-05-08T18:31:57.335 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.335 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.335 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:57.335 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.346956+0000", 2024-05-08T18:31:57.335 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2159e-05 2024-05-08T18:31:57.335 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.335 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.335 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:57.335 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.347033+0000", 2024-05-08T18:31:57.335 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.7898000000000005e-05 2024-05-08T18:31:57.335 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.335 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.335 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:57.336 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.347179+0000", 2024-05-08T18:31:57.336 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014600400000000001 2024-05-08T18:31:57.336 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.336 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.336 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:57.336 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.347304+0000", 2024-05-08T18:31:57.336 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012491100000000001 2024-05-08T18:31:57.336 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.336 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.336 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:57.336 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.355666+0000", 2024-05-08T18:31:57.336 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0083618319999999996 2024-05-08T18:31:57.336 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.336 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.337 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:57.337 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.365667+0000", 2024-05-08T18:31:57.337 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010000289000000001 2024-05-08T18:31:57.337 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.337 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.337 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:57.337 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.365709+0000", 2024-05-08T18:31:57.337 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.2549000000000002e-05 2024-05-08T18:31:57.337 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.337 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.337 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:57.337 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.365744+0000", 2024-05-08T18:31:57.337 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4854000000000002e-05 2024-05-08T18:31:57.337 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:57.338 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:57.338 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:57.338 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.338 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.338 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1413 3.2f 3:f6ed8c1f:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_99:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:57.338 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:43.405307+0000", 2024-05-08T18:31:57.338 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 13.846350685000001, 2024-05-08T18:31:57.338 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.025254335999999999, 2024-05-08T18:31:57.338 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:57.338 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:57.338 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:57.338 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:57.339 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:31:57.339 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:57.339 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1413 2024-05-08T18:31:57.339 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.339 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:57.339 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.339 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:57.339 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.405307+0000", 2024-05-08T18:31:57.339 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:57.339 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.339 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.339 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:57.339 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.405307+0000", 2024-05-08T18:31:57.339 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:57.340 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.340 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.340 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:57.340 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.405310+0000", 2024-05-08T18:31:57.340 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0800000000000002e-06 2024-05-08T18:31:57.340 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.340 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.340 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:57.340 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.411517+0000", 2024-05-08T18:31:57.340 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0062069270000000001 2024-05-08T18:31:57.340 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.340 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.340 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:57.340 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.411551+0000", 2024-05-08T18:31:57.341 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4579000000000002e-05 2024-05-08T18:31:57.341 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.341 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.341 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:57.341 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.411570+0000", 2024-05-08T18:31:57.341 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8179999999999999e-05 2024-05-08T18:31:57.341 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.341 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.341 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:57.341 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.411654+0000", 2024-05-08T18:31:57.341 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4708000000000003e-05 2024-05-08T18:31:57.341 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.341 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.341 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:57.341 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.411768+0000", 2024-05-08T18:31:57.342 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000114176 2024-05-08T18:31:57.342 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.342 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.342 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 7", 2024-05-08T18:31:57.342 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.411864+0000", 2024-05-08T18:31:57.342 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.5637000000000006e-05 2024-05-08T18:31:57.342 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.342 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.342 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:57.342 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.420357+0000", 2024-05-08T18:31:57.342 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0084934529999999998 2024-05-08T18:31:57.342 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.343 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.343 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:57.343 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.430427+0000", 2024-05-08T18:31:57.343 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010069855000000001 2024-05-08T18:31:57.343 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.343 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.343 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:57.343 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.430501+0000", 2024-05-08T18:31:57.343 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3613000000000001e-05 2024-05-08T18:31:57.343 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.343 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.343 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:57.343 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.430561+0000", 2024-05-08T18:31:57.343 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.0127999999999998e-05 2024-05-08T18:31:57.343 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:57.344 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:57.344 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:57.344 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.344 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.344 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1416 3.30 3:0e28688d:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_102:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:57.344 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:43.434441+0000", 2024-05-08T18:31:57.344 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 13.817216801000001, 2024-05-08T18:31:57.344 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019457368999999999, 2024-05-08T18:31:57.344 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:57.344 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:57.344 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:57.344 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:57.344 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:31:57.344 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:57.345 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1416 2024-05-08T18:31:57.345 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.345 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:57.345 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.345 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:57.345 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.434441+0000", 2024-05-08T18:31:57.345 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:57.345 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.345 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.345 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:57.345 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.434441+0000", 2024-05-08T18:31:57.345 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:57.345 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.346 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.346 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:57.346 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.434443+0000", 2024-05-08T18:31:57.346 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6029999999999999e-06 2024-05-08T18:31:57.346 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.346 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.346 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:57.346 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.438597+0000", 2024-05-08T18:31:57.346 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0041532890000000001 2024-05-08T18:31:57.346 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.346 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.346 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:57.346 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.438645+0000", 2024-05-08T18:31:57.346 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8563999999999998e-05 2024-05-08T18:31:57.347 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.347 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.347 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:57.347 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.438673+0000", 2024-05-08T18:31:57.347 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7526e-05 2024-05-08T18:31:57.347 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.347 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.347 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:57.347 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.438775+0000", 2024-05-08T18:31:57.347 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0001024 2024-05-08T18:31:57.347 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.347 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.347 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:57.347 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.438896+0000", 2024-05-08T18:31:57.347 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000121471 2024-05-08T18:31:57.348 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.348 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.348 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:57.348 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.438993+0000", 2024-05-08T18:31:57.348 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6689999999999998e-05 2024-05-08T18:31:57.348 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.348 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.348 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:57.348 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.444986+0000", 2024-05-08T18:31:57.348 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0059928250000000002 2024-05-08T18:31:57.348 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.348 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.349 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:57.349 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.453733+0000", 2024-05-08T18:31:57.349 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0087465570000000003 2024-05-08T18:31:57.349 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.349 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.349 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:57.349 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.453823+0000", 2024-05-08T18:31:57.349 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.0044999999999996e-05 2024-05-08T18:31:57.349 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.349 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.349 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:57.349 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.453898+0000", 2024-05-08T18:31:57.349 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5399000000000001e-05 2024-05-08T18:31:57.349 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:57.349 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:57.350 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:57.350 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.350 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.350 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1418 3.22 3:451dcafc:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_104:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:57.350 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:43.455183+0000", 2024-05-08T18:31:57.350 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 13.796474412, 2024-05-08T18:31:57.350 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016290814000000001, 2024-05-08T18:31:57.350 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:57.350 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:57.350 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:57.350 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:57.350 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:31:57.350 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:57.351 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1418 2024-05-08T18:31:57.351 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.351 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:57.351 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.351 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:57.351 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.455183+0000", 2024-05-08T18:31:57.351 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:57.351 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.351 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.351 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:57.351 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.455183+0000", 2024-05-08T18:31:57.351 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:57.351 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.352 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.352 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:57.352 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.455185+0000", 2024-05-08T18:31:57.352 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.984e-06 2024-05-08T18:31:57.352 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.352 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.352 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:57.352 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.459033+0000", 2024-05-08T18:31:57.352 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0038479270000000001 2024-05-08T18:31:57.352 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.352 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.352 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:57.352 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.459058+0000", 2024-05-08T18:31:57.352 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5412e-05 2024-05-08T18:31:57.353 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.353 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.353 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:57.353 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.459070+0000", 2024-05-08T18:31:57.353 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1848000000000001e-05 2024-05-08T18:31:57.353 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.353 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.353 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:57.353 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.459155+0000", 2024-05-08T18:31:57.353 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4404e-05 2024-05-08T18:31:57.353 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.353 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.353 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:57.353 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.459368+0000", 2024-05-08T18:31:57.354 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00021298700000000001 2024-05-08T18:31:57.354 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.354 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.354 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:57.354 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.459574+0000", 2024-05-08T18:31:57.354 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000206324 2024-05-08T18:31:57.354 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.354 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.354 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:57.354 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.467663+0000", 2024-05-08T18:31:57.354 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0080891639999999994 2024-05-08T18:31:57.354 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.354 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.355 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:57.355 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.471400+0000", 2024-05-08T18:31:57.355 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0037373889999999998 2024-05-08T18:31:57.355 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.355 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.355 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:57.355 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.471440+0000", 2024-05-08T18:31:57.355 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9549999999999999e-05 2024-05-08T18:31:57.355 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.355 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.355 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:57.355 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.471474+0000", 2024-05-08T18:31:57.355 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3825000000000002e-05 2024-05-08T18:31:57.355 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:57.356 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:57.356 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:57.356 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.356 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.356 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1615 3.35 e83/21 3:ae758c88:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_3:head v 83'7, mlcod=82'5)", 2024-05-08T18:31:57.356 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:46.729645+0000", 2024-05-08T18:31:57.356 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 10.522012042, 2024-05-08T18:31:57.356 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.022764072, 2024-05-08T18:31:57.356 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:57.356 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:57.356 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:57.356 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:57.356 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.356 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:57.357 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.729645+0000", 2024-05-08T18:31:57.357 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:57.357 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.357 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.357 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:57.357 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.729645+0000", 2024-05-08T18:31:57.357 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:57.357 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.357 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.357 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:57.357 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.729649+0000", 2024-05-08T18:31:57.357 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3830000000000001e-06 2024-05-08T18:31:57.357 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.357 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.358 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:57.358 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.734571+0000", 2024-05-08T18:31:57.358 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0049222600000000004 2024-05-08T18:31:57.358 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.358 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.358 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:57.358 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.734611+0000", 2024-05-08T18:31:57.358 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9969000000000003e-05 2024-05-08T18:31:57.358 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.358 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.358 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:57.358 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.734629+0000", 2024-05-08T18:31:57.358 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7827000000000001e-05 2024-05-08T18:31:57.358 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.359 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.359 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:57.359 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.734800+0000", 2024-05-08T18:31:57.359 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000170929 2024-05-08T18:31:57.359 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.359 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.359 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:57.359 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.734867+0000", 2024-05-08T18:31:57.359 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6952000000000005e-05 2024-05-08T18:31:57.359 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.359 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.359 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:57.359 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.752282+0000", 2024-05-08T18:31:57.359 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017415669000000002 2024-05-08T18:31:57.360 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.360 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.360 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:57.360 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.752409+0000", 2024-05-08T18:31:57.360 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000127083 2024-05-08T18:31:57.360 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:57.360 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:57.360 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:57.360 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.360 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.360 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1618 3.1c 3:3b36ad14:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-05-08T18:31:57.360 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:46.750394+0000", 2024-05-08T18:31:57.360 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 10.501263848000001, 2024-05-08T18:31:57.360 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.023322207000000001, 2024-05-08T18:31:57.361 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:31:57.361 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:31:57.361 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:57.361 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:31:57.361 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:31:57.361 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:57.361 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1618 2024-05-08T18:31:57.361 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.361 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:31:57.361 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.361 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:31:57.361 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.750394+0000", 2024-05-08T18:31:57.361 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:57.361 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.362 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.362 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:31:57.362 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.750394+0000", 2024-05-08T18:31:57.362 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:31:57.362 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.362 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.362 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:31:57.362 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.750399+0000", 2024-05-08T18:31:57.362 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9760000000000003e-06 2024-05-08T18:31:57.362 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.362 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.362 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:31:57.362 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.756899+0000", 2024-05-08T18:31:57.363 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0065001809999999998 2024-05-08T18:31:57.363 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.363 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.363 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:31:57.363 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.756936+0000", 2024-05-08T18:31:57.363 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7716000000000003e-05 2024-05-08T18:31:57.363 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.363 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.363 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:31:57.363 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.756955+0000", 2024-05-08T18:31:57.363 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8196999999999999e-05 2024-05-08T18:31:57.363 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.363 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.363 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:31:57.363 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.757132+0000", 2024-05-08T18:31:57.364 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017692200000000001 2024-05-08T18:31:57.364 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.364 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.364 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:31:57.364 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.757531+0000", 2024-05-08T18:31:57.364 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00039989700000000002 2024-05-08T18:31:57.364 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.364 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.364 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 4", 2024-05-08T18:31:57.364 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.757770+0000", 2024-05-08T18:31:57.364 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000238908 2024-05-08T18:31:57.364 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.364 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.364 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:31:57.364 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.768339+0000", 2024-05-08T18:31:57.365 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010568394 2024-05-08T18:31:57.365 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.365 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.365 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:57.365 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.773409+0000", 2024-05-08T18:31:57.365 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0050704019999999999 2024-05-08T18:31:57.365 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.365 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.365 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:31:57.365 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.773584+0000", 2024-05-08T18:31:57.365 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017481500000000001 2024-05-08T18:31:57.365 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:31:57.365 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:31:57.365 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:31:57.365 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.773716+0000", 2024-05-08T18:31:57.366 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013179899999999999 2024-05-08T18:31:57.366 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:57.366 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:57.366 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:57.366 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:31:57.366 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:31:57.366 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:31:57.368 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-08T18:31:57.368 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:31:57.365+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:31:57.384 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2024-05-08T18:31:57.385 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:31:57.401 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2024-05-08T18:31:57.401 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:31:57.417 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2024-05-08T18:31:57.417 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:31:57.433 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2024-05-08T18:31:57.434 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:31:57.453 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2024-05-08T18:31:57.453 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:31:57.469 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:31:57.466+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:31:57.472 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2024-05-08T18:31:57.473 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:31:57.491 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2024-05-08T18:31:57.492 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:31:57.496 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:57.496 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:57.510 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-08T18:31:57.512 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2024-05-08T18:31:57.512 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:31:57.596 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:31:57.594+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:31:57.671 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:31:57.669+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:31:57.672 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:57.672 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:57.677 INFO:teuthology.orchestra.run.smithi097.stderr:reweighted osd.6 to 1 (10000) 2024-05-08T18:31:57.677 INFO:teuthology.orchestra.run.smithi097.stderr:nodeep-scrub is unset 2024-05-08T18:31:57.688 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-08T18:31:57.714 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-05-08T18:31:57.804 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:31:57.805+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:31:57.857 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:57.857 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:57.871 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-08T18:31:57.872 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:31:57.866+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:31:57.972 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:31:57.973+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:31:58.032 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:58.032 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:58.047 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-08T18:31:58.093 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:31:58.090+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:31:58.169 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:58.170 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:58.175 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:31:58.173+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:31:58.183 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-08T18:31:58.235 INFO:tasks.workunit.client.0.smithi097.stderr:100+0 records in 2024-05-08T18:31:58.235 INFO:tasks.workunit.client.0.smithi097.stderr:100+0 records out 2024-05-08T18:31:58.235 INFO:tasks.workunit.client.0.smithi097.stderr:1048576000 bytes (1.0 GB, 1000 MiB) copied, 7.04717 s, 149 MB/s 2024-05-08T18:31:58.276 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:31:58.273+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:31:58.356 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:58.356 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:58.372 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-08T18:31:58.377 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:31:58.374+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:31:58.478 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:31:58.474+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:31:58.492 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:58.492 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:58.506 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-08T18:31:58.578 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:31:58.574+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:31:58.633 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:58.633 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:58.647 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-08T18:31:58.687 INFO:teuthology.orchestra.run.smithi097.stderr:reweighted osd.7 to 1 (10000) 2024-05-08T18:31:58.687 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:31:58.685+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:31:58.704 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-05-08T18:31:58.705 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T18:31:58.766 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:58.766 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:58.780 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-08T18:31:58.781 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:31:58.781+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:31:58.881 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:31:58.878+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:31:58.937 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:58.938 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:58.952 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-08T18:31:58.981 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:31:58.978+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:31:59.054 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-05-08T18:31:59.060 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2024-05-08T18:31:59.065 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:59.065 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:59.068 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":161,"stamp":"2024-05-08T18:31:58.680624+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1353354748,"num_objects":538,"num_object_clones":0,"num_object_copies":1076,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":538,"num_whiteouts":0,"num_read":1814,"num_read_kb":1536,"num_write":1335,"num_write_kb":1343286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1998,"ondisk_log_size":1998,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2901128,"kb_used_data":2651660,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":752073592,"statfs":{"total":773094113280,"available":770123358208,"internally_reserved":0,"allocated":2715299840,"data_stored":2711362087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-615,"num_objects":-7,"num_object_clones":0,"num_object_copies":-14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-7,"num_whiteouts":0,"num_read":161,"num_read_kb":158,"num_write":76,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.039058"},"pg_stats":[{"pgid":"3.3f","version":"82'3","reported_seq":143,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.645123+0000","last_change":"2024-05-08T18:29:40.574221+0000","last_active":"2024-05-08T18:31:54.645123+0000","last_peered":"2024-05-08T18:31:54.645123+0000","last_clean":"2024-05-08T18:31:54.645123+0000","last_became_active":"2024-05-08T18:29:40.573543+0000","last_became_peered":"2024-05-08T18:29:40.573543+0000","last_unstale":"2024-05-08T18:31:54.645123+0000","last_undegraded":"2024-05-08T18:31:54.645123+0000","last_fullsized":"2024-05-08T18:31:54.645123+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:57.223609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":136,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.466713+0000","last_change":"2024-05-08T18:29:42.563773+0000","last_active":"2024-05-08T18:31:55.466713+0000","last_peered":"2024-05-08T18:31:55.466713+0000","last_clean":"2024-05-08T18:31:55.466713+0000","last_became_active":"2024-05-08T18:29:42.561201+0000","last_became_peered":"2024-05-08T18:29:42.561201+0000","last_unstale":"2024-05-08T18:31:55.466713+0000","last_undegraded":"2024-05-08T18:31:55.466713+0000","last_fullsized":"2024-05-08T18:31:55.466713+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:55.055481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"82'4","reported_seq":147,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.958396+0000","last_change":"2024-05-08T18:29:40.549299+0000","last_active":"2024-05-08T18:31:54.958396+0000","last_peered":"2024-05-08T18:31:54.958396+0000","last_clean":"2024-05-08T18:31:54.958396+0000","last_became_active":"2024-05-08T18:29:40.548930+0000","last_became_peered":"2024-05-08T18:29:40.548930+0000","last_unstale":"2024-05-08T18:31:54.958396+0000","last_undegraded":"2024-05-08T18:31:54.958396+0000","last_fullsized":"2024-05-08T18:31:54.958396+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:06:36.198647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"84'2","reported_seq":140,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.643214+0000","last_change":"2024-05-08T18:29:42.572074+0000","last_active":"2024-05-08T18:31:54.643214+0000","last_peered":"2024-05-08T18:31:54.643214+0000","last_clean":"2024-05-08T18:31:54.643214+0000","last_became_active":"2024-05-08T18:29:42.571344+0000","last_became_peered":"2024-05-08T18:29:42.571344+0000","last_unstale":"2024-05-08T18:31:54.643214+0000","last_undegraded":"2024-05-08T18:31:54.643214+0000","last_fullsized":"2024-05-08T18:31:54.643214+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:36.890277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"84'5","reported_seq":148,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.649285+0000","last_change":"2024-05-08T18:29:40.539048+0000","last_active":"2024-05-08T18:31:54.649285+0000","last_peered":"2024-05-08T18:31:54.649285+0000","last_clean":"2024-05-08T18:31:54.649285+0000","last_became_active":"2024-05-08T18:29:40.538458+0000","last_became_peered":"2024-05-08T18:29:40.538458+0000","last_unstale":"2024-05-08T18:31:54.649285+0000","last_undegraded":"2024-05-08T18:31:54.649285+0000","last_fullsized":"2024-05-08T18:31:54.649285+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:36:37.796095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":140,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.646101+0000","last_change":"2024-05-08T18:29:42.569718+0000","last_active":"2024-05-08T18:31:55.646101+0000","last_peered":"2024-05-08T18:31:55.646101+0000","last_clean":"2024-05-08T18:31:55.646101+0000","last_became_active":"2024-05-08T18:29:42.569026+0000","last_became_peered":"2024-05-08T18:29:42.569026+0000","last_unstale":"2024-05-08T18:31:55.646101+0000","last_undegraded":"2024-05-08T18:31:55.646101+0000","last_fullsized":"2024-05-08T18:31:55.646101+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:42.045615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"84'8","reported_seq":149,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.469278+0000","last_change":"2024-05-08T18:29:40.557700+0000","last_active":"2024-05-08T18:31:55.469278+0000","last_peered":"2024-05-08T18:31:55.469278+0000","last_clean":"2024-05-08T18:31:55.469278+0000","last_became_active":"2024-05-08T18:29:40.556884+0000","last_became_peered":"2024-05-08T18:29:40.556884+0000","last_unstale":"2024-05-08T18:31:55.469278+0000","last_undegraded":"2024-05-08T18:31:55.469278+0000","last_fullsized":"2024-05-08T18:31:55.469278+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:21:38.354933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":138,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.649041+0000","last_change":"2024-05-08T18:29:42.566448+0000","last_active":"2024-05-08T18:31:54.649041+0000","last_peered":"2024-05-08T18:31:54.649041+0000","last_clean":"2024-05-08T18:31:54.649041+0000","last_became_active":"2024-05-08T18:29:42.566058+0000","last_became_peered":"2024-05-08T18:29:42.566058+0000","last_unstale":"2024-05-08T18:31:54.649041+0000","last_undegraded":"2024-05-08T18:31:54.649041+0000","last_fullsized":"2024-05-08T18:31:54.649041+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:53:03.097704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"82'1","reported_seq":140,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.644161+0000","last_change":"2024-05-08T18:29:40.571195+0000","last_active":"2024-05-08T18:31:54.644161+0000","last_peered":"2024-05-08T18:31:54.644161+0000","last_clean":"2024-05-08T18:31:54.644161+0000","last_became_active":"2024-05-08T18:29:40.570467+0000","last_became_peered":"2024-05-08T18:29:40.570467+0000","last_unstale":"2024-05-08T18:31:54.644161+0000","last_undegraded":"2024-05-08T18:31:54.644161+0000","last_fullsized":"2024-05-08T18:31:54.644161+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:39.986094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":136,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.469348+0000","last_change":"2024-05-08T18:29:42.566506+0000","last_active":"2024-05-08T18:31:55.469348+0000","last_peered":"2024-05-08T18:31:55.469348+0000","last_clean":"2024-05-08T18:31:55.469348+0000","last_became_active":"2024-05-08T18:29:42.565740+0000","last_became_peered":"2024-05-08T18:29:42.565740+0000","last_unstale":"2024-05-08T18:31:55.469348+0000","last_undegraded":"2024-05-08T18:31:55.469348+0000","last_fullsized":"2024-05-08T18:31:55.469348+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:58.320701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"82'4","reported_seq":144,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.468399+0000","last_change":"2024-05-08T18:29:40.538314+0000","last_active":"2024-05-08T18:31:55.468399+0000","last_peered":"2024-05-08T18:31:55.468399+0000","last_clean":"2024-05-08T18:31:55.468399+0000","last_became_active":"2024-05-08T18:29:40.537458+0000","last_became_peered":"2024-05-08T18:29:40.537458+0000","last_unstale":"2024-05-08T18:31:55.468399+0000","last_undegraded":"2024-05-08T18:31:55.468399+0000","last_fullsized":"2024-05-08T18:31:55.468399+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:56.300986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":141,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.646430+0000","last_change":"2024-05-08T18:29:42.570054+0000","last_active":"2024-05-08T18:31:55.646430+0000","last_peered":"2024-05-08T18:31:55.646430+0000","last_clean":"2024-05-08T18:31:55.646430+0000","last_became_active":"2024-05-08T18:29:42.569255+0000","last_became_peered":"2024-05-08T18:29:42.569255+0000","last_unstale":"2024-05-08T18:31:55.646430+0000","last_undegraded":"2024-05-08T18:31:55.646430+0000","last_fullsized":"2024-05-08T18:31:55.646430+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:11:01.702482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"84'9","reported_seq":97,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-08T18:31:53.614639+0000","last_change":"2024-05-08T18:30:21.210397+0000","last_active":"2024-05-08T18:31:53.614639+0000","last_peered":"2024-05-08T18:31:53.614639+0000","last_clean":"2024-05-08T18:31:53.614639+0000","last_became_active":"2024-05-08T18:30:21.210052+0000","last_became_peered":"2024-05-08T18:30:21.210052+0000","last_unstale":"2024-05-08T18:31:53.614639+0000","last_undegraded":"2024-05-08T18:31:53.614639+0000","last_fullsized":"2024-05-08T18:31:53.614639+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:51:05.355593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"80'2","reported_seq":142,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.469348+0000","last_change":"2024-05-08T18:29:42.562084+0000","last_active":"2024-05-08T18:31:55.469348+0000","last_peered":"2024-05-08T18:31:55.469348+0000","last_clean":"2024-05-08T18:31:55.469348+0000","last_became_active":"2024-05-08T18:29:42.560699+0000","last_became_peered":"2024-05-08T18:29:42.560699+0000","last_unstale":"2024-05-08T18:31:55.469348+0000","last_undegraded":"2024-05-08T18:31:55.469348+0000","last_fullsized":"2024-05-08T18:31:55.469348+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:09.787597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"84'7","reported_seq":148,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.645974+0000","last_change":"2024-05-08T18:29:40.564339+0000","last_active":"2024-05-08T18:31:54.645974+0000","last_peered":"2024-05-08T18:31:54.645974+0000","last_clean":"2024-05-08T18:31:54.645974+0000","last_became_active":"2024-05-08T18:29:40.564038+0000","last_became_peered":"2024-05-08T18:29:40.564038+0000","last_unstale":"2024-05-08T18:31:54.645974+0000","last_undegraded":"2024-05-08T18:31:54.645974+0000","last_fullsized":"2024-05-08T18:31:54.645974+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:40:23.287885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"84'8","reported_seq":149,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-08T18:31:53.617204+0000","last_change":"2024-05-08T18:29:42.570253+0000","last_active":"2024-05-08T18:31:53.617204+0000","last_peered":"2024-05-08T18:31:53.617204+0000","last_clean":"2024-05-08T18:31:53.617204+0000","last_became_active":"2024-05-08T18:29:42.569917+0000","last_became_peered":"2024-05-08T18:29:42.569917+0000","last_unstale":"2024-05-08T18:31:53.617204+0000","last_undegraded":"2024-05-08T18:31:53.617204+0000","last_fullsized":"2024-05-08T18:31:53.617204+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:14:45.575219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"84'4","reported_seq":150,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.645210+0000","last_change":"2024-05-08T18:29:42.568116+0000","last_active":"2024-05-08T18:31:55.645210+0000","last_peered":"2024-05-08T18:31:55.645210+0000","last_clean":"2024-05-08T18:31:55.645210+0000","last_became_active":"2024-05-08T18:29:42.567399+0000","last_became_peered":"2024-05-08T18:29:42.567399+0000","last_unstale":"2024-05-08T18:31:55.645210+0000","last_undegraded":"2024-05-08T18:31:55.645210+0000","last_fullsized":"2024-05-08T18:31:55.645210+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:35.037465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"82'7","reported_seq":146,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.645153+0000","last_change":"2024-05-08T18:29:40.571982+0000","last_active":"2024-05-08T18:31:54.645153+0000","last_peered":"2024-05-08T18:31:54.645153+0000","last_clean":"2024-05-08T18:31:54.645153+0000","last_became_active":"2024-05-08T18:29:40.570600+0000","last_became_peered":"2024-05-08T18:29:40.570600+0000","last_unstale":"2024-05-08T18:31:54.645153+0000","last_undegraded":"2024-05-08T18:31:54.645153+0000","last_fullsized":"2024-05-08T18:31:54.645153+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:54:14.520118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"80'2","reported_seq":140,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.643661+0000","last_change":"2024-05-08T18:29:42.578449+0000","last_active":"2024-05-08T18:31:54.643661+0000","last_peered":"2024-05-08T18:31:54.643661+0000","last_clean":"2024-05-08T18:31:54.643661+0000","last_became_active":"2024-05-08T18:29:42.577789+0000","last_became_peered":"2024-05-08T18:29:42.577789+0000","last_unstale":"2024-05-08T18:31:54.643661+0000","last_undegraded":"2024-05-08T18:31:54.643661+0000","last_fullsized":"2024-05-08T18:31:54.643661+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:09.787597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"84'7","reported_seq":146,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.470168+0000","last_change":"2024-05-08T18:29:40.570618+0000","last_active":"2024-05-08T18:31:55.470168+0000","last_peered":"2024-05-08T18:31:55.470168+0000","last_clean":"2024-05-08T18:31:55.470168+0000","last_became_active":"2024-05-08T18:29:40.569519+0000","last_became_peered":"2024-05-08T18:29:40.569519+0000","last_unstale":"2024-05-08T18:31:55.470168+0000","last_undegraded":"2024-05-08T18:31:55.470168+0000","last_fullsized":"2024-05-08T18:31:55.470168+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:09:42.581976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":136,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.471270+0000","last_change":"2024-05-08T18:29:42.563056+0000","last_active":"2024-05-08T18:31:55.471270+0000","last_peered":"2024-05-08T18:31:55.471270+0000","last_clean":"2024-05-08T18:31:55.471270+0000","last_became_active":"2024-05-08T18:29:42.562296+0000","last_became_peered":"2024-05-08T18:29:42.562296+0000","last_unstale":"2024-05-08T18:31:55.471270+0000","last_undegraded":"2024-05-08T18:31:55.471270+0000","last_fullsized":"2024-05-08T18:31:55.471270+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:36.890277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"83'7","reported_seq":146,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.471014+0000","last_change":"2024-05-08T18:29:40.564353+0000","last_active":"2024-05-08T18:31:55.471014+0000","last_peered":"2024-05-08T18:31:55.471014+0000","last_clean":"2024-05-08T18:31:55.471014+0000","last_became_active":"2024-05-08T18:29:40.563516+0000","last_became_peered":"2024-05-08T18:29:40.563516+0000","last_unstale":"2024-05-08T18:31:55.471014+0000","last_undegraded":"2024-05-08T18:31:55.471014+0000","last_fullsized":"2024-05-08T18:31:55.471014+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:06:36.198647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"84'3","reported_seq":140,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-08T18:31:53.617484+0000","last_change":"2024-05-08T18:29:42.567006+0000","last_active":"2024-05-08T18:31:53.617484+0000","last_peered":"2024-05-08T18:31:53.617484+0000","last_clean":"2024-05-08T18:31:53.617484+0000","last_became_active":"2024-05-08T18:29:42.566256+0000","last_became_peered":"2024-05-08T18:29:42.566256+0000","last_unstale":"2024-05-08T18:31:53.617484+0000","last_undegraded":"2024-05-08T18:31:53.617484+0000","last_fullsized":"2024-05-08T18:31:53.617484+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:09:44.601690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"84'3","reported_seq":147,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.645496+0000","last_change":"2024-05-08T18:29:40.573212+0000","last_active":"2024-05-08T18:31:55.645496+0000","last_peered":"2024-05-08T18:31:55.645496+0000","last_clean":"2024-05-08T18:31:55.645496+0000","last_became_active":"2024-05-08T18:29:40.572250+0000","last_became_peered":"2024-05-08T18:29:40.572250+0000","last_unstale":"2024-05-08T18:31:55.645496+0000","last_undegraded":"2024-05-08T18:31:55.645496+0000","last_fullsized":"2024-05-08T18:31:55.645496+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:25:01.595224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"84'5","reported_seq":145,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-08T18:31:53.616407+0000","last_change":"2024-05-08T18:29:42.570847+0000","last_active":"2024-05-08T18:31:53.616407+0000","last_peered":"2024-05-08T18:31:53.616407+0000","last_clean":"2024-05-08T18:31:53.616407+0000","last_became_active":"2024-05-08T18:29:42.570435+0000","last_became_peered":"2024-05-08T18:29:42.570435+0000","last_unstale":"2024-05-08T18:31:53.616407+0000","last_undegraded":"2024-05-08T18:31:53.616407+0000","last_fullsized":"2024-05-08T18:31:53.616407+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:21:40.374647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"84'3","reported_seq":144,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.645597+0000","last_change":"2024-05-08T18:29:40.566815+0000","last_active":"2024-05-08T18:31:54.645597+0000","last_peered":"2024-05-08T18:31:54.645597+0000","last_clean":"2024-05-08T18:31:54.645597+0000","last_became_active":"2024-05-08T18:29:40.566531+0000","last_became_peered":"2024-05-08T18:29:40.566531+0000","last_unstale":"2024-05-08T18:31:54.645597+0000","last_undegraded":"2024-05-08T18:31:54.645597+0000","last_fullsized":"2024-05-08T18:31:54.645597+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:52.462279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"84'8","reported_seq":154,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.646538+0000","last_change":"2024-05-08T18:29:42.554846+0000","last_active":"2024-05-08T18:31:55.646538+0000","last_peered":"2024-05-08T18:31:55.646538+0000","last_clean":"2024-05-08T18:31:55.646538+0000","last_became_active":"2024-05-08T18:29:42.554115+0000","last_became_peered":"2024-05-08T18:29:42.554115+0000","last_unstale":"2024-05-08T18:31:55.646538+0000","last_undegraded":"2024-05-08T18:31:55.646538+0000","last_fullsized":"2024-05-08T18:31:55.646538+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:22:14.793035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"83'4","reported_seq":146,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.648919+0000","last_change":"2024-05-08T18:29:40.547776+0000","last_active":"2024-05-08T18:31:54.648919+0000","last_peered":"2024-05-08T18:31:54.648919+0000","last_clean":"2024-05-08T18:31:54.648919+0000","last_became_active":"2024-05-08T18:29:40.547384+0000","last_became_peered":"2024-05-08T18:29:40.547384+0000","last_unstale":"2024-05-08T18:31:54.648919+0000","last_undegraded":"2024-05-08T18:31:54.648919+0000","last_fullsized":"2024-05-08T18:31:54.648919+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:14:26.628603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"84'6","reported_seq":132,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.644707+0000","last_change":"2024-05-08T18:29:50.685390+0000","last_active":"2024-05-08T18:31:55.644707+0000","last_peered":"2024-05-08T18:31:55.644707+0000","last_clean":"2024-05-08T18:31:55.644707+0000","last_became_active":"2024-05-08T18:29:50.684644+0000","last_became_peered":"2024-05-08T18:29:50.684644+0000","last_unstale":"2024-05-08T18:31:55.644707+0000","last_undegraded":"2024-05-08T18:31:55.644707+0000","last_fullsized":"2024-05-08T18:31:55.644707+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:10:38.951662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":636,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"84'10","reported_seq":156,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.646912+0000","last_change":"2024-05-08T18:29:42.573805+0000","last_active":"2024-05-08T18:31:54.646912+0000","last_peered":"2024-05-08T18:31:54.646912+0000","last_clean":"2024-05-08T18:31:54.646912+0000","last_became_active":"2024-05-08T18:29:42.573296+0000","last_became_peered":"2024-05-08T18:29:42.573296+0000","last_unstale":"2024-05-08T18:31:54.646912+0000","last_undegraded":"2024-05-08T18:31:54.646912+0000","last_fullsized":"2024-05-08T18:31:54.646912+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:21.935293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"84'4","reported_seq":143,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.644509+0000","last_change":"2024-05-08T18:29:40.570733+0000","last_active":"2024-05-08T18:31:54.644509+0000","last_peered":"2024-05-08T18:31:54.644509+0000","last_clean":"2024-05-08T18:31:54.644509+0000","last_became_active":"2024-05-08T18:29:40.569711+0000","last_became_peered":"2024-05-08T18:29:40.569711+0000","last_unstale":"2024-05-08T18:31:54.644509+0000","last_undegraded":"2024-05-08T18:31:54.644509+0000","last_fullsized":"2024-05-08T18:31:54.644509+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:18:08.784274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":132,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.468986+0000","last_change":"2024-05-08T18:29:44.594185+0000","last_active":"2024-05-08T18:31:55.468986+0000","last_peered":"2024-05-08T18:31:55.468986+0000","last_clean":"2024-05-08T18:31:55.468986+0000","last_became_active":"2024-05-08T18:29:44.593442+0000","last_became_peered":"2024-05-08T18:29:44.593442+0000","last_unstale":"2024-05-08T18:31:55.468986+0000","last_undegraded":"2024-05-08T18:31:55.468986+0000","last_fullsized":"2024-05-08T18:31:55.468986+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:52:25.736491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"84'14","reported_seq":151,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.649596+0000","last_change":"2024-05-08T18:29:46.594652+0000","last_active":"2024-05-08T18:31:54.649596+0000","last_peered":"2024-05-08T18:31:54.649596+0000","last_clean":"2024-05-08T18:31:54.649596+0000","last_became_active":"2024-05-08T18:29:46.593656+0000","last_became_peered":"2024-05-08T18:29:46.593656+0000","last_unstale":"2024-05-08T18:31:54.649596+0000","last_undegraded":"2024-05-08T18:31:54.649596+0000","last_fullsized":"2024-05-08T18:31:54.649596+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:50:27.608888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":123,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.644737+0000","last_change":"2024-05-08T18:29:48.639834+0000","last_active":"2024-05-08T18:31:54.644737+0000","last_peered":"2024-05-08T18:31:54.644737+0000","last_clean":"2024-05-08T18:31:54.644737+0000","last_became_active":"2024-05-08T18:29:48.639122+0000","last_became_peered":"2024-05-08T18:29:48.639122+0000","last_unstale":"2024-05-08T18:31:54.644737+0000","last_undegraded":"2024-05-08T18:31:54.644737+0000","last_fullsized":"2024-05-08T18:31:54.644737+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:14:22.304773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"83'4","reported_seq":125,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.471063+0000","last_change":"2024-05-08T18:29:50.672303+0000","last_active":"2024-05-08T18:31:55.471063+0000","last_peered":"2024-05-08T18:31:55.471063+0000","last_clean":"2024-05-08T18:31:55.471063+0000","last_became_active":"2024-05-08T18:29:50.671513+0000","last_became_peered":"2024-05-08T18:29:50.671513+0000","last_unstale":"2024-05-08T18:31:55.471063+0000","last_undegraded":"2024-05-08T18:31:55.471063+0000","last_fullsized":"2024-05-08T18:31:55.471063+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:12:05.780786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"84'4","reported_seq":146,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.469910+0000","last_change":"2024-05-08T18:29:42.565462+0000","last_active":"2024-05-08T18:31:55.469910+0000","last_peered":"2024-05-08T18:31:55.469910+0000","last_clean":"2024-05-08T18:31:55.469910+0000","last_became_active":"2024-05-08T18:29:42.564741+0000","last_became_peered":"2024-05-08T18:29:42.564741+0000","last_unstale":"2024-05-08T18:31:55.469910+0000","last_undegraded":"2024-05-08T18:31:55.469910+0000","last_fullsized":"2024-05-08T18:31:55.469910+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:25:56.129785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"82'3","reported_seq":145,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.649950+0000","last_change":"2024-05-08T18:29:40.564796+0000","last_active":"2024-05-08T18:31:54.649950+0000","last_peered":"2024-05-08T18:31:54.649950+0000","last_clean":"2024-05-08T18:31:54.649950+0000","last_became_active":"2024-05-08T18:29:40.564401+0000","last_became_peered":"2024-05-08T18:29:40.564401+0000","last_unstale":"2024-05-08T18:31:54.649950+0000","last_undegraded":"2024-05-08T18:31:54.649950+0000","last_fullsized":"2024-05-08T18:31:54.649950+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:19:11.492397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":133,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.646806+0000","last_change":"2024-05-08T18:29:44.587689+0000","last_active":"2024-05-08T18:31:54.646806+0000","last_peered":"2024-05-08T18:31:54.646806+0000","last_clean":"2024-05-08T18:31:54.646806+0000","last_became_active":"2024-05-08T18:29:44.586975+0000","last_became_peered":"2024-05-08T18:29:44.586975+0000","last_unstale":"2024-05-08T18:31:54.646806+0000","last_undegraded":"2024-05-08T18:31:54.646806+0000","last_fullsized":"2024-05-08T18:31:54.646806+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:04:49.020450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"83'7","reported_seq":142,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.647688+0000","last_change":"2024-05-08T18:29:46.600906+0000","last_active":"2024-05-08T18:31:55.647688+0000","last_peered":"2024-05-08T18:31:55.647688+0000","last_clean":"2024-05-08T18:31:55.647688+0000","last_became_active":"2024-05-08T18:29:46.599894+0000","last_became_peered":"2024-05-08T18:29:46.599894+0000","last_unstale":"2024-05-08T18:31:55.647688+0000","last_undegraded":"2024-05-08T18:31:55.647688+0000","last_fullsized":"2024-05-08T18:31:55.647688+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:24:13.568294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":128,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.646107+0000","last_change":"2024-05-08T18:29:48.614324+0000","last_active":"2024-05-08T18:31:55.646107+0000","last_peered":"2024-05-08T18:31:55.646107+0000","last_clean":"2024-05-08T18:31:55.646107+0000","last_became_active":"2024-05-08T18:29:48.613591+0000","last_became_peered":"2024-05-08T18:29:48.613591+0000","last_unstale":"2024-05-08T18:31:55.646107+0000","last_undegraded":"2024-05-08T18:31:55.646107+0000","last_fullsized":"2024-05-08T18:31:55.646107+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:47:54.034851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":122,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.646596+0000","last_change":"2024-05-08T18:29:50.684773+0000","last_active":"2024-05-08T18:31:54.646596+0000","last_peered":"2024-05-08T18:31:54.646596+0000","last_clean":"2024-05-08T18:31:54.646596+0000","last_became_active":"2024-05-08T18:29:50.683931+0000","last_became_peered":"2024-05-08T18:29:50.683931+0000","last_unstale":"2024-05-08T18:31:54.646596+0000","last_undegraded":"2024-05-08T18:31:54.646596+0000","last_fullsized":"2024-05-08T18:31:54.646596+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:17:10.582636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"80'2","reported_seq":143,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.649868+0000","last_change":"2024-05-08T18:29:42.574437+0000","last_active":"2024-05-08T18:31:54.649868+0000","last_peered":"2024-05-08T18:31:54.649868+0000","last_clean":"2024-05-08T18:31:54.649868+0000","last_became_active":"2024-05-08T18:29:42.574146+0000","last_became_peered":"2024-05-08T18:29:42.574146+0000","last_unstale":"2024-05-08T18:31:54.649868+0000","last_undegraded":"2024-05-08T18:31:54.649868+0000","last_fullsized":"2024-05-08T18:31:54.649868+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:55:30.468069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"83'7","reported_seq":146,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.643906+0000","last_change":"2024-05-08T18:29:40.559677+0000","last_active":"2024-05-08T18:31:54.643906+0000","last_peered":"2024-05-08T18:31:54.643906+0000","last_clean":"2024-05-08T18:31:54.643906+0000","last_became_active":"2024-05-08T18:29:40.558819+0000","last_became_peered":"2024-05-08T18:29:40.558819+0000","last_unstale":"2024-05-08T18:31:54.643906+0000","last_undegraded":"2024-05-08T18:31:54.643906+0000","last_fullsized":"2024-05-08T18:31:54.643906+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:28.426657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":133,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.649690+0000","last_change":"2024-05-08T18:29:44.596801+0000","last_active":"2024-05-08T18:31:54.649690+0000","last_peered":"2024-05-08T18:31:54.649690+0000","last_clean":"2024-05-08T18:31:54.649690+0000","last_became_active":"2024-05-08T18:29:44.596111+0000","last_became_peered":"2024-05-08T18:29:44.596111+0000","last_unstale":"2024-05-08T18:31:54.649690+0000","last_undegraded":"2024-05-08T18:31:54.649690+0000","last_fullsized":"2024-05-08T18:31:54.649690+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:04.423266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"33'10","reported_seq":141,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-08T18:31:53.616117+0000","last_change":"2024-05-08T18:29:46.608330+0000","last_active":"2024-05-08T18:31:53.616117+0000","last_peered":"2024-05-08T18:31:53.616117+0000","last_clean":"2024-05-08T18:31:53.616117+0000","last_became_active":"2024-05-08T18:29:46.607580+0000","last_became_peered":"2024-05-08T18:29:46.607580+0000","last_unstale":"2024-05-08T18:31:53.616117+0000","last_undegraded":"2024-05-08T18:31:53.616117+0000","last_fullsized":"2024-05-08T18:31:53.616117+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:22:18.837103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"84'86","reported_seq":313,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.643816+0000","last_change":"2024-05-08T18:29:48.642718+0000","last_active":"2024-05-08T18:31:54.643816+0000","last_peered":"2024-05-08T18:31:54.643816+0000","last_clean":"2024-05-08T18:31:54.643816+0000","last_became_active":"2024-05-08T18:29:48.641950+0000","last_became_peered":"2024-05-08T18:29:48.641950+0000","last_unstale":"2024-05-08T18:31:54.643816+0000","last_undegraded":"2024-05-08T18:31:54.643816+0000","last_fullsized":"2024-05-08T18:31:54.643816+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:00:11.720096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"84'2","reported_seq":126,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.645092+0000","last_change":"2024-05-08T18:29:50.660378+0000","last_active":"2024-05-08T18:31:55.645092+0000","last_peered":"2024-05-08T18:31:55.645092+0000","last_clean":"2024-05-08T18:31:55.645092+0000","last_became_active":"2024-05-08T18:29:50.659649+0000","last_became_peered":"2024-05-08T18:29:50.659649+0000","last_unstale":"2024-05-08T18:31:55.645092+0000","last_undegraded":"2024-05-08T18:31:55.645092+0000","last_fullsized":"2024-05-08T18:31:55.645092+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:34:14.488295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"80'2","reported_seq":142,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.649161+0000","last_change":"2024-05-08T18:29:42.577267+0000","last_active":"2024-05-08T18:31:54.649161+0000","last_peered":"2024-05-08T18:31:54.649161+0000","last_clean":"2024-05-08T18:31:54.649161+0000","last_became_active":"2024-05-08T18:29:42.576740+0000","last_became_peered":"2024-05-08T18:29:42.576740+0000","last_unstale":"2024-05-08T18:31:54.649161+0000","last_undegraded":"2024-05-08T18:31:54.649161+0000","last_fullsized":"2024-05-08T18:31:54.649161+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:57:14.869860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"82'3","reported_seq":142,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.467473+0000","last_change":"2024-05-08T18:29:40.547524+0000","last_active":"2024-05-08T18:31:55.467473+0000","last_peered":"2024-05-08T18:31:55.467473+0000","last_clean":"2024-05-08T18:31:55.467473+0000","last_became_active":"2024-05-08T18:29:40.545749+0000","last_became_peered":"2024-05-08T18:29:40.545749+0000","last_unstale":"2024-05-08T18:31:55.467473+0000","last_undegraded":"2024-05-08T18:31:55.467473+0000","last_fullsized":"2024-05-08T18:31:55.467473+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:12:59.146887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":132,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.469109+0000","last_change":"2024-05-08T18:29:44.579839+0000","last_active":"2024-05-08T18:31:55.469109+0000","last_peered":"2024-05-08T18:31:55.469109+0000","last_clean":"2024-05-08T18:31:55.469109+0000","last_became_active":"2024-05-08T18:29:44.578142+0000","last_became_peered":"2024-05-08T18:29:44.578142+0000","last_unstale":"2024-05-08T18:31:55.469109+0000","last_undegraded":"2024-05-08T18:31:55.469109+0000","last_fullsized":"2024-05-08T18:31:55.469109+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:51:09.413191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"84'14","reported_seq":148,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.643910+0000","last_change":"2024-05-08T18:29:46.607288+0000","last_active":"2024-05-08T18:31:54.643910+0000","last_peered":"2024-05-08T18:31:54.643910+0000","last_clean":"2024-05-08T18:31:54.643910+0000","last_became_active":"2024-05-08T18:29:46.605154+0000","last_became_peered":"2024-05-08T18:29:46.605154+0000","last_unstale":"2024-05-08T18:31:54.643910+0000","last_undegraded":"2024-05-08T18:31:54.643910+0000","last_fullsized":"2024-05-08T18:31:54.643910+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:23.940519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"84'86","reported_seq":243,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.645866+0000","last_change":"2024-05-08T18:29:48.634956+0000","last_active":"2024-05-08T18:31:54.645866+0000","last_peered":"2024-05-08T18:31:54.645866+0000","last_clean":"2024-05-08T18:31:54.645866+0000","last_became_active":"2024-05-08T18:29:48.633858+0000","last_became_peered":"2024-05-08T18:29:48.633858+0000","last_unstale":"2024-05-08T18:31:54.645866+0000","last_undegraded":"2024-05-08T18:31:54.645866+0000","last_fullsized":"2024-05-08T18:31:54.645866+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:50:48.169666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"84'8","reported_seq":157,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.467545+0000","last_change":"2024-05-08T18:29:42.567744+0000","last_active":"2024-05-08T18:31:55.467545+0000","last_peered":"2024-05-08T18:31:55.467545+0000","last_clean":"2024-05-08T18:31:55.467545+0000","last_became_active":"2024-05-08T18:29:42.566974+0000","last_became_peered":"2024-05-08T18:29:42.566974+0000","last_unstale":"2024-05-08T18:31:55.467545+0000","last_undegraded":"2024-05-08T18:31:55.467545+0000","last_fullsized":"2024-05-08T18:31:55.467545+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:42.045615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"82'7","reported_seq":147,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.645378+0000","last_change":"2024-05-08T18:29:40.572499+0000","last_active":"2024-05-08T18:31:54.645378+0000","last_peered":"2024-05-08T18:31:54.645378+0000","last_clean":"2024-05-08T18:31:54.645378+0000","last_became_active":"2024-05-08T18:29:40.571322+0000","last_became_peered":"2024-05-08T18:29:40.571322+0000","last_unstale":"2024-05-08T18:31:54.645378+0000","last_undegraded":"2024-05-08T18:31:54.645378+0000","last_fullsized":"2024-05-08T18:31:54.645378+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:31.119374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":132,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.643045+0000","last_change":"2024-05-08T18:29:44.597045+0000","last_active":"2024-05-08T18:31:54.643045+0000","last_peered":"2024-05-08T18:31:54.643045+0000","last_clean":"2024-05-08T18:31:54.643045+0000","last_became_active":"2024-05-08T18:29:44.596282+0000","last_became_peered":"2024-05-08T18:29:44.596282+0000","last_unstale":"2024-05-08T18:31:54.643045+0000","last_undegraded":"2024-05-08T18:31:54.643045+0000","last_fullsized":"2024-05-08T18:31:54.643045+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:35:51.288126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"84'25","reported_seq":166,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.467937+0000","last_change":"2024-05-08T18:29:46.590633+0000","last_active":"2024-05-08T18:31:55.467937+0000","last_peered":"2024-05-08T18:31:55.467937+0000","last_clean":"2024-05-08T18:31:55.467937+0000","last_became_active":"2024-05-08T18:29:46.589600+0000","last_became_peered":"2024-05-08T18:29:46.589600+0000","last_unstale":"2024-05-08T18:31:55.467937+0000","last_undegraded":"2024-05-08T18:31:55.467937+0000","last_fullsized":"2024-05-08T18:31:55.467937+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:23.940519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":126,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.956913+0000","last_change":"2024-05-08T18:29:48.630758+0000","last_active":"2024-05-08T18:31:54.956913+0000","last_peered":"2024-05-08T18:31:54.956913+0000","last_clean":"2024-05-08T18:31:54.956913+0000","last_became_active":"2024-05-08T18:29:48.630017+0000","last_became_peered":"2024-05-08T18:29:48.630017+0000","last_unstale":"2024-05-08T18:31:54.956913+0000","last_undegraded":"2024-05-08T18:31:54.956913+0000","last_fullsized":"2024-05-08T18:31:54.956913+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:39.879384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"80'12","reported_seq":141,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.468401+0000","last_change":"2024-05-08T18:29:50.672682+0000","last_active":"2024-05-08T18:31:55.468401+0000","last_peered":"2024-05-08T18:31:55.468401+0000","last_clean":"2024-05-08T18:31:55.468401+0000","last_became_active":"2024-05-08T18:29:50.671923+0000","last_became_peered":"2024-05-08T18:29:50.671923+0000","last_unstale":"2024-05-08T18:31:55.468401+0000","last_undegraded":"2024-05-08T18:31:55.468401+0000","last_fullsized":"2024-05-08T18:31:55.468401+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:38.318890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":34,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"80'2","reported_seq":146,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.645583+0000","last_change":"2024-05-08T18:29:42.554289+0000","last_active":"2024-05-08T18:31:55.645583+0000","last_peered":"2024-05-08T18:31:55.645583+0000","last_clean":"2024-05-08T18:31:55.645583+0000","last_became_active":"2024-05-08T18:29:42.553574+0000","last_became_peered":"2024-05-08T18:29:42.553574+0000","last_unstale":"2024-05-08T18:31:55.645583+0000","last_undegraded":"2024-05-08T18:31:55.645583+0000","last_fullsized":"2024-05-08T18:31:55.645583+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:42.005809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"84'3","reported_seq":143,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.645433+0000","last_change":"2024-05-08T18:29:40.570169+0000","last_active":"2024-05-08T18:31:54.645433+0000","last_peered":"2024-05-08T18:31:54.645433+0000","last_clean":"2024-05-08T18:31:54.645433+0000","last_became_active":"2024-05-08T18:29:40.569542+0000","last_became_peered":"2024-05-08T18:29:40.569542+0000","last_unstale":"2024-05-08T18:31:54.645433+0000","last_undegraded":"2024-05-08T18:31:54.645433+0000","last_fullsized":"2024-05-08T18:31:54.645433+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:08:13.006752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"26'1","reported_seq":189,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-08T18:31:53.615108+0000","last_change":"2024-05-08T18:29:44.579659+0000","last_active":"2024-05-08T18:31:53.615108+0000","last_peered":"2024-05-08T18:31:53.615108+0000","last_clean":"2024-05-08T18:31:53.615108+0000","last_became_active":"2024-05-08T18:29:44.579152+0000","last_became_peered":"2024-05-08T18:29:44.579152+0000","last_unstale":"2024-05-08T18:31:53.615108+0000","last_undegraded":"2024-05-08T18:31:53.615108+0000","last_fullsized":"2024-05-08T18:31:53.615108+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:15:00.358583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":85,"num_read_kb":85,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"84'14","reported_seq":150,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.646160+0000","last_change":"2024-05-08T18:29:46.600224+0000","last_active":"2024-05-08T18:31:54.646160+0000","last_peered":"2024-05-08T18:31:54.646160+0000","last_clean":"2024-05-08T18:31:54.646160+0000","last_became_active":"2024-05-08T18:29:46.599464+0000","last_became_peered":"2024-05-08T18:29:46.599464+0000","last_unstale":"2024-05-08T18:31:54.646160+0000","last_undegraded":"2024-05-08T18:31:54.646160+0000","last_fullsized":"2024-05-08T18:31:54.646160+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:26:40.238188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":125,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.644838+0000","last_change":"2024-05-08T18:29:48.637939+0000","last_active":"2024-05-08T18:31:54.644838+0000","last_peered":"2024-05-08T18:31:54.644838+0000","last_clean":"2024-05-08T18:31:54.644838+0000","last_became_active":"2024-05-08T18:29:48.637231+0000","last_became_peered":"2024-05-08T18:29:48.637231+0000","last_unstale":"2024-05-08T18:31:54.644838+0000","last_undegraded":"2024-05-08T18:31:54.644838+0000","last_fullsized":"2024-05-08T18:31:54.644838+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:04.571608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":120,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.470219+0000","last_change":"2024-05-08T18:29:50.681831+0000","last_active":"2024-05-08T18:31:55.470219+0000","last_peered":"2024-05-08T18:31:55.470219+0000","last_clean":"2024-05-08T18:31:55.470219+0000","last_became_active":"2024-05-08T18:29:50.681287+0000","last_became_peered":"2024-05-08T18:29:50.681287+0000","last_unstale":"2024-05-08T18:31:55.470219+0000","last_undegraded":"2024-05-08T18:31:55.470219+0000","last_fullsized":"2024-05-08T18:31:55.470219+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:30:24.111488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":136,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.468167+0000","last_change":"2024-05-08T18:29:42.562975+0000","last_active":"2024-05-08T18:31:55.468167+0000","last_peered":"2024-05-08T18:31:55.468167+0000","last_clean":"2024-05-08T18:31:55.468167+0000","last_became_active":"2024-05-08T18:29:42.562267+0000","last_became_peered":"2024-05-08T18:29:42.562267+0000","last_unstale":"2024-05-08T18:31:55.468167+0000","last_undegraded":"2024-05-08T18:31:55.468167+0000","last_fullsized":"2024-05-08T18:31:55.468167+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:30.446371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"84'5","reported_seq":145,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.644865+0000","last_change":"2024-05-08T18:29:40.570736+0000","last_active":"2024-05-08T18:31:54.644865+0000","last_peered":"2024-05-08T18:31:54.644865+0000","last_clean":"2024-05-08T18:31:54.644865+0000","last_became_active":"2024-05-08T18:29:40.569626+0000","last_became_peered":"2024-05-08T18:29:40.569626+0000","last_unstale":"2024-05-08T18:31:54.644865+0000","last_undegraded":"2024-05-08T18:31:54.644865+0000","last_fullsized":"2024-05-08T18:31:54.644865+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:56.300986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"26'1","reported_seq":188,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-08T18:31:53.617044+0000","last_change":"2024-05-08T18:29:44.581748+0000","last_active":"2024-05-08T18:31:53.617044+0000","last_peered":"2024-05-08T18:31:53.617044+0000","last_clean":"2024-05-08T18:31:53.617044+0000","last_became_active":"2024-05-08T18:29:44.581067+0000","last_became_peered":"2024-05-08T18:29:44.581067+0000","last_unstale":"2024-05-08T18:31:53.617044+0000","last_undegraded":"2024-05-08T18:31:53.617044+0000","last_fullsized":"2024-05-08T18:31:53.617044+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:44.043691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":85,"num_read_kb":85,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"84'20","reported_seq":158,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.643446+0000","last_change":"2024-05-08T18:29:46.605887+0000","last_active":"2024-05-08T18:31:54.643446+0000","last_peered":"2024-05-08T18:31:54.643446+0000","last_clean":"2024-05-08T18:31:54.643446+0000","last_became_active":"2024-05-08T18:29:46.604966+0000","last_became_peered":"2024-05-08T18:29:46.604966+0000","last_unstale":"2024-05-08T18:31:54.643446+0000","last_undegraded":"2024-05-08T18:31:54.643446+0000","last_fullsized":"2024-05-08T18:31:54.643446+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:07:54.654205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"84'86","reported_seq":244,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.643525+0000","last_change":"2024-05-08T18:29:48.638657+0000","last_active":"2024-05-08T18:31:54.643525+0000","last_peered":"2024-05-08T18:31:54.643525+0000","last_clean":"2024-05-08T18:31:54.643525+0000","last_became_active":"2024-05-08T18:29:48.637758+0000","last_became_peered":"2024-05-08T18:29:48.637758+0000","last_unstale":"2024-05-08T18:31:54.643525+0000","last_undegraded":"2024-05-08T18:31:54.643525+0000","last_fullsized":"2024-05-08T18:31:54.643525+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:45:24.153991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"84'1","reported_seq":123,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.649254+0000","last_change":"2024-05-08T18:29:50.684501+0000","last_active":"2024-05-08T18:31:54.649254+0000","last_peered":"2024-05-08T18:31:54.649254+0000","last_clean":"2024-05-08T18:31:54.649254+0000","last_became_active":"2024-05-08T18:29:50.683738+0000","last_became_peered":"2024-05-08T18:29:50.683738+0000","last_unstale":"2024-05-08T18:31:54.649254+0000","last_undegraded":"2024-05-08T18:31:54.649254+0000","last_fullsized":"2024-05-08T18:31:54.649254+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:22.834262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"84'4","reported_seq":148,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.649655+0000","last_change":"2024-05-08T18:29:42.569401+0000","last_active":"2024-05-08T18:31:54.649655+0000","last_peered":"2024-05-08T18:31:54.649655+0000","last_clean":"2024-05-08T18:31:54.649655+0000","last_became_active":"2024-05-08T18:29:42.568659+0000","last_became_peered":"2024-05-08T18:29:42.568659+0000","last_unstale":"2024-05-08T18:31:54.649655+0000","last_undegraded":"2024-05-08T18:31:54.649655+0000","last_fullsized":"2024-05-08T18:31:54.649655+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:35:23.016110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"82'5","reported_seq":147,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.469917+0000","last_change":"2024-05-08T18:29:40.557076+0000","last_active":"2024-05-08T18:31:55.469917+0000","last_peered":"2024-05-08T18:31:55.469917+0000","last_clean":"2024-05-08T18:31:55.469917+0000","last_became_active":"2024-05-08T18:29:40.555805+0000","last_became_peered":"2024-05-08T18:29:40.555805+0000","last_unstale":"2024-05-08T18:31:55.469917+0000","last_undegraded":"2024-05-08T18:31:55.469917+0000","last_fullsized":"2024-05-08T18:31:55.469917+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:13.946346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":15,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":131,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-08T18:31:53.616546+0000","last_change":"2024-05-08T18:29:44.573892+0000","last_active":"2024-05-08T18:31:53.616546+0000","last_peered":"2024-05-08T18:31:53.616546+0000","last_clean":"2024-05-08T18:31:53.616546+0000","last_became_active":"2024-05-08T18:29:44.573308+0000","last_became_peered":"2024-05-08T18:29:44.573308+0000","last_unstale":"2024-05-08T18:31:53.616546+0000","last_undegraded":"2024-05-08T18:31:53.616546+0000","last_fullsized":"2024-05-08T18:31:53.616546+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:37.075348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"84'22","reported_seq":163,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.643796+0000","last_change":"2024-05-08T18:29:46.595585+0000","last_active":"2024-05-08T18:31:54.643796+0000","last_peered":"2024-05-08T18:31:54.643796+0000","last_clean":"2024-05-08T18:31:54.643796+0000","last_became_active":"2024-05-08T18:29:46.594930+0000","last_became_peered":"2024-05-08T18:29:46.594930+0000","last_unstale":"2024-05-08T18:31:54.643796+0000","last_undegraded":"2024-05-08T18:31:54.643796+0000","last_fullsized":"2024-05-08T18:31:54.643796+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:11.768269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":122,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-08T18:31:53.614428+0000","last_change":"2024-05-08T18:29:48.638137+0000","last_active":"2024-05-08T18:31:53.614428+0000","last_peered":"2024-05-08T18:31:53.614428+0000","last_clean":"2024-05-08T18:31:53.614428+0000","last_became_active":"2024-05-08T18:29:48.637370+0000","last_became_peered":"2024-05-08T18:29:48.637370+0000","last_unstale":"2024-05-08T18:31:53.614428+0000","last_undegraded":"2024-05-08T18:31:53.614428+0000","last_fullsized":"2024-05-08T18:31:53.614428+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:15.859849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"83'2","reported_seq":125,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.956941+0000","last_change":"2024-05-08T18:29:50.688760+0000","last_active":"2024-05-08T18:31:54.956941+0000","last_peered":"2024-05-08T18:31:54.956941+0000","last_clean":"2024-05-08T18:31:54.956941+0000","last_became_active":"2024-05-08T18:29:50.687960+0000","last_became_peered":"2024-05-08T18:29:50.687960+0000","last_unstale":"2024-05-08T18:31:54.956941+0000","last_undegraded":"2024-05-08T18:31:54.956941+0000","last_fullsized":"2024-05-08T18:31:54.956941+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:21:19.624895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"80'2","reported_seq":145,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.646554+0000","last_change":"2024-05-08T18:29:42.557850+0000","last_active":"2024-05-08T18:31:55.646554+0000","last_peered":"2024-05-08T18:31:55.646554+0000","last_clean":"2024-05-08T18:31:55.646554+0000","last_became_active":"2024-05-08T18:29:42.557119+0000","last_became_peered":"2024-05-08T18:29:42.557119+0000","last_unstale":"2024-05-08T18:31:55.646554+0000","last_undegraded":"2024-05-08T18:31:55.646554+0000","last_fullsized":"2024-05-08T18:31:55.646554+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:25:56.129785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"84'4","reported_seq":146,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.645139+0000","last_change":"2024-05-08T18:29:40.544530+0000","last_active":"2024-05-08T18:31:54.645139+0000","last_peered":"2024-05-08T18:31:54.645139+0000","last_clean":"2024-05-08T18:31:54.645139+0000","last_became_active":"2024-05-08T18:29:40.544215+0000","last_became_peered":"2024-05-08T18:29:40.544215+0000","last_unstale":"2024-05-08T18:31:54.645139+0000","last_undegraded":"2024-05-08T18:31:54.645139+0000","last_fullsized":"2024-05-08T18:31:54.645139+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:14:26.628603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":130,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-08T18:31:53.616942+0000","last_change":"2024-05-08T18:29:44.588227+0000","last_active":"2024-05-08T18:31:53.616942+0000","last_peered":"2024-05-08T18:31:53.616942+0000","last_clean":"2024-05-08T18:31:53.616942+0000","last_became_active":"2024-05-08T18:29:44.587822+0000","last_became_peered":"2024-05-08T18:29:44.587822+0000","last_unstale":"2024-05-08T18:31:53.616942+0000","last_undegraded":"2024-05-08T18:31:53.616942+0000","last_fullsized":"2024-05-08T18:31:53.616942+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:18:12.841872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"85'17","reported_seq":157,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.646630+0000","last_change":"2024-05-08T18:29:46.603563+0000","last_active":"2024-05-08T18:31:55.646630+0000","last_peered":"2024-05-08T18:31:55.646630+0000","last_clean":"2024-05-08T18:31:55.646630+0000","last_became_active":"2024-05-08T18:29:46.602801+0000","last_became_peered":"2024-05-08T18:29:46.602801+0000","last_unstale":"2024-05-08T18:31:55.646630+0000","last_undegraded":"2024-05-08T18:31:55.646630+0000","last_fullsized":"2024-05-08T18:31:55.646630+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:22:36.338527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":126,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.649567+0000","last_change":"2024-05-08T18:29:48.642806+0000","last_active":"2024-05-08T18:31:54.649567+0000","last_peered":"2024-05-08T18:31:54.649567+0000","last_clean":"2024-05-08T18:31:54.649567+0000","last_became_active":"2024-05-08T18:29:48.641813+0000","last_became_peered":"2024-05-08T18:29:48.641813+0000","last_unstale":"2024-05-08T18:31:54.649567+0000","last_undegraded":"2024-05-08T18:31:54.649567+0000","last_fullsized":"2024-05-08T18:31:54.649567+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:50:48.169666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"80'2","reported_seq":124,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.644840+0000","last_change":"2024-05-08T18:29:50.689819+0000","last_active":"2024-05-08T18:31:54.644840+0000","last_peered":"2024-05-08T18:31:54.644840+0000","last_clean":"2024-05-08T18:31:54.644840+0000","last_became_active":"2024-05-08T18:29:50.686739+0000","last_became_peered":"2024-05-08T18:29:50.686739+0000","last_unstale":"2024-05-08T18:31:54.644840+0000","last_undegraded":"2024-05-08T18:31:54.644840+0000","last_fullsized":"2024-05-08T18:31:54.644840+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:45:34.171402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":140,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.646692+0000","last_change":"2024-05-08T18:29:42.552388+0000","last_active":"2024-05-08T18:31:55.646692+0000","last_peered":"2024-05-08T18:31:55.646692+0000","last_clean":"2024-05-08T18:31:55.646692+0000","last_became_active":"2024-05-08T18:29:42.551647+0000","last_became_peered":"2024-05-08T18:29:42.551647+0000","last_unstale":"2024-05-08T18:31:55.646692+0000","last_undegraded":"2024-05-08T18:31:55.646692+0000","last_fullsized":"2024-05-08T18:31:55.646692+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:55.055481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"84'5","reported_seq":145,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.468471+0000","last_change":"2024-05-08T18:29:40.562946+0000","last_active":"2024-05-08T18:31:55.468471+0000","last_peered":"2024-05-08T18:31:55.468471+0000","last_clean":"2024-05-08T18:31:55.468471+0000","last_became_active":"2024-05-08T18:29:40.550942+0000","last_became_peered":"2024-05-08T18:29:40.550942+0000","last_unstale":"2024-05-08T18:31:55.468471+0000","last_undegraded":"2024-05-08T18:31:55.468471+0000","last_fullsized":"2024-05-08T18:31:55.468471+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:22.579629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":134,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.957872+0000","last_change":"2024-05-08T18:29:44.593681+0000","last_active":"2024-05-08T18:31:54.957872+0000","last_peered":"2024-05-08T18:31:54.957872+0000","last_clean":"2024-05-08T18:31:54.957872+0000","last_became_active":"2024-05-08T18:29:44.593242+0000","last_became_peered":"2024-05-08T18:29:44.593242+0000","last_unstale":"2024-05-08T18:31:54.957872+0000","last_undegraded":"2024-05-08T18:31:54.957872+0000","last_fullsized":"2024-05-08T18:31:54.957872+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:57.093364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"85'21","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-08T18:31:53.616901+0000","last_change":"2024-05-08T18:29:46.589514+0000","last_active":"2024-05-08T18:31:53.616901+0000","last_peered":"2024-05-08T18:31:53.616901+0000","last_clean":"2024-05-08T18:31:53.616901+0000","last_became_active":"2024-05-08T18:29:46.588784+0000","last_became_peered":"2024-05-08T18:29:46.588784+0000","last_unstale":"2024-05-08T18:31:53.616901+0000","last_undegraded":"2024-05-08T18:31:53.616901+0000","last_fullsized":"2024-05-08T18:31:53.616901+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:02:30.355168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":20,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"84'86","reported_seq":249,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-08T18:31:53.616813+0000","last_change":"2024-05-08T18:29:48.631007+0000","last_active":"2024-05-08T18:31:53.616813+0000","last_peered":"2024-05-08T18:31:53.616813+0000","last_clean":"2024-05-08T18:31:53.616813+0000","last_became_active":"2024-05-08T18:29:48.630229+0000","last_became_peered":"2024-05-08T18:29:48.630229+0000","last_unstale":"2024-05-08T18:31:53.616813+0000","last_undegraded":"2024-05-08T18:31:53.616813+0000","last_fullsized":"2024-05-08T18:31:53.616813+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:44:03.778419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":123,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.957127+0000","last_change":"2024-05-08T18:29:50.675105+0000","last_active":"2024-05-08T18:31:54.957127+0000","last_peered":"2024-05-08T18:31:54.957127+0000","last_clean":"2024-05-08T18:31:54.957127+0000","last_became_active":"2024-05-08T18:29:50.674292+0000","last_became_peered":"2024-05-08T18:29:50.674292+0000","last_unstale":"2024-05-08T18:31:54.957127+0000","last_undegraded":"2024-05-08T18:31:54.957127+0000","last_fullsized":"2024-05-08T18:31:54.957127+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:47:15.423647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"84'4","reported_seq":150,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.647400+0000","last_change":"2024-05-08T18:29:42.579707+0000","last_active":"2024-05-08T18:31:55.647400+0000","last_peered":"2024-05-08T18:31:55.647400+0000","last_clean":"2024-05-08T18:31:55.647400+0000","last_became_active":"2024-05-08T18:29:42.579059+0000","last_became_peered":"2024-05-08T18:29:42.579059+0000","last_unstale":"2024-05-08T18:31:55.647400+0000","last_undegraded":"2024-05-08T18:31:55.647400+0000","last_fullsized":"2024-05-08T18:31:55.647400+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:09.787597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"84'7","reported_seq":153,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.647323+0000","last_change":"2024-05-08T18:29:40.555327+0000","last_active":"2024-05-08T18:31:55.647323+0000","last_peered":"2024-05-08T18:31:55.647323+0000","last_clean":"2024-05-08T18:31:55.647323+0000","last_became_active":"2024-05-08T18:29:40.554594+0000","last_became_peered":"2024-05-08T18:29:40.554594+0000","last_unstale":"2024-05-08T18:31:55.647323+0000","last_undegraded":"2024-05-08T18:31:55.647323+0000","last_fullsized":"2024-05-08T18:31:55.647323+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:19.841114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3,"num_read_kb":4,"num_write":17,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"26'2","reported_seq":248,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.472433+0000","last_change":"2024-05-08T18:29:44.582434+0000","last_active":"2024-05-08T18:31:55.472433+0000","last_peered":"2024-05-08T18:31:55.472433+0000","last_clean":"2024-05-08T18:31:55.472433+0000","last_became_active":"2024-05-08T18:29:44.581699+0000","last_became_peered":"2024-05-08T18:29:44.581699+0000","last_unstale":"2024-05-08T18:31:55.472433+0000","last_undegraded":"2024-05-08T18:31:55.472433+0000","last_fullsized":"2024-05-08T18:31:55.472433+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:19:29.113643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":114,"num_read_kb":114,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"33'10","reported_seq":144,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.645983+0000","last_change":"2024-05-08T18:29:46.590860+0000","last_active":"2024-05-08T18:31:54.645983+0000","last_peered":"2024-05-08T18:31:54.645983+0000","last_clean":"2024-05-08T18:31:54.645983+0000","last_became_active":"2024-05-08T18:29:46.590087+0000","last_became_peered":"2024-05-08T18:29:46.590087+0000","last_unstale":"2024-05-08T18:31:54.645983+0000","last_undegraded":"2024-05-08T18:31:54.645983+0000","last_fullsized":"2024-05-08T18:31:54.645983+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:19:58.358449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"84'86","reported_seq":272,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.470466+0000","last_change":"2024-05-08T18:29:48.635548+0000","last_active":"2024-05-08T18:31:55.470466+0000","last_peered":"2024-05-08T18:31:55.470466+0000","last_clean":"2024-05-08T18:31:55.470466+0000","last_became_active":"2024-05-08T18:29:48.634801+0000","last_became_peered":"2024-05-08T18:29:48.634801+0000","last_unstale":"2024-05-08T18:31:55.470466+0000","last_undegraded":"2024-05-08T18:31:55.470466+0000","last_fullsized":"2024-05-08T18:31:55.470466+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:04:20.128031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":125,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.646045+0000","last_change":"2024-05-08T18:29:50.668279+0000","last_active":"2024-05-08T18:31:55.646045+0000","last_peered":"2024-05-08T18:31:55.646045+0000","last_clean":"2024-05-08T18:31:55.646045+0000","last_became_active":"2024-05-08T18:29:50.667536+0000","last_became_peered":"2024-05-08T18:29:50.667536+0000","last_unstale":"2024-05-08T18:31:55.646045+0000","last_undegraded":"2024-05-08T18:31:55.646045+0000","last_fullsized":"2024-05-08T18:31:55.646045+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:12:05.780786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"84'12","reported_seq":162,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.958681+0000","last_change":"2024-05-08T18:29:42.563807+0000","last_active":"2024-05-08T18:31:54.958681+0000","last_peered":"2024-05-08T18:31:54.958681+0000","last_clean":"2024-05-08T18:31:54.958681+0000","last_became_active":"2024-05-08T18:29:42.563416+0000","last_became_peered":"2024-05-08T18:29:42.563416+0000","last_unstale":"2024-05-08T18:31:54.958681+0000","last_undegraded":"2024-05-08T18:31:54.958681+0000","last_fullsized":"2024-05-08T18:31:54.958681+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:18:10.803989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"84'10","reported_seq":152,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.646259+0000","last_change":"2024-05-08T18:29:40.548898+0000","last_active":"2024-05-08T18:31:54.646259+0000","last_peered":"2024-05-08T18:31:54.646259+0000","last_clean":"2024-05-08T18:31:54.646259+0000","last_became_active":"2024-05-08T18:29:40.548591+0000","last_became_peered":"2024-05-08T18:29:40.548591+0000","last_unstale":"2024-05-08T18:31:54.646259+0000","last_undegraded":"2024-05-08T18:31:54.646259+0000","last_fullsized":"2024-05-08T18:31:54.646259+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:27:41.414153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":136,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.647155+0000","last_change":"2024-05-08T18:29:44.582578+0000","last_active":"2024-05-08T18:31:55.647155+0000","last_peered":"2024-05-08T18:31:55.647155+0000","last_clean":"2024-05-08T18:31:55.647155+0000","last_became_active":"2024-05-08T18:29:44.581832+0000","last_became_peered":"2024-05-08T18:29:44.581832+0000","last_unstale":"2024-05-08T18:31:55.647155+0000","last_undegraded":"2024-05-08T18:31:55.647155+0000","last_fullsized":"2024-05-08T18:31:55.647155+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:52:25.736491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"84'22","reported_seq":161,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.468737+0000","last_change":"2024-05-08T18:29:46.602459+0000","last_active":"2024-05-08T18:31:55.468737+0000","last_peered":"2024-05-08T18:31:55.468737+0000","last_clean":"2024-05-08T18:31:55.468737+0000","last_became_active":"2024-05-08T18:29:46.601740+0000","last_became_peered":"2024-05-08T18:29:46.601740+0000","last_unstale":"2024-05-08T18:31:55.468737+0000","last_undegraded":"2024-05-08T18:31:55.468737+0000","last_fullsized":"2024-05-08T18:31:55.468737+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:58:31.293922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":123,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.468807+0000","last_change":"2024-05-08T18:29:48.640046+0000","last_active":"2024-05-08T18:31:55.468807+0000","last_peered":"2024-05-08T18:31:55.468807+0000","last_clean":"2024-05-08T18:31:55.468807+0000","last_became_active":"2024-05-08T18:29:48.639309+0000","last_became_peered":"2024-05-08T18:29:48.639309+0000","last_unstale":"2024-05-08T18:31:55.468807+0000","last_undegraded":"2024-05-08T18:31:55.468807+0000","last_fullsized":"2024-05-08T18:31:55.468807+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:10.533065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":123,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.956857+0000","last_change":"2024-05-08T18:29:50.668361+0000","last_active":"2024-05-08T18:31:54.956857+0000","last_peered":"2024-05-08T18:31:54.956857+0000","last_clean":"2024-05-08T18:31:54.956857+0000","last_became_active":"2024-05-08T18:29:50.667636+0000","last_became_peered":"2024-05-08T18:29:50.667636+0000","last_unstale":"2024-05-08T18:31:54.956857+0000","last_undegraded":"2024-05-08T18:31:54.956857+0000","last_fullsized":"2024-05-08T18:31:54.956857+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:58:35.356885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"84'2","reported_seq":141,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.470752+0000","last_change":"2024-05-08T18:29:42.584098+0000","last_active":"2024-05-08T18:31:55.470752+0000","last_peered":"2024-05-08T18:31:55.470752+0000","last_clean":"2024-05-08T18:31:55.470752+0000","last_became_active":"2024-05-08T18:29:42.583639+0000","last_became_peered":"2024-05-08T18:29:42.583639+0000","last_unstale":"2024-05-08T18:31:55.470752+0000","last_undegraded":"2024-05-08T18:31:55.470752+0000","last_fullsized":"2024-05-08T18:31:55.470752+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:08:15.026467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":242,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.643538+0000","last_change":"2024-05-08T18:29:27.115522+0000","last_active":"2024-05-08T18:31:54.643538+0000","last_peered":"2024-05-08T18:31:54.643538+0000","last_clean":"2024-05-08T18:31:54.643538+0000","last_became_active":"2024-05-08T18:29:27.112960+0000","last_became_peered":"2024-05-08T18:29:27.112960+0000","last_unstale":"2024-05-08T18:31:54.643538+0000","last_undegraded":"2024-05-08T18:31:54.643538+0000","last_fullsized":"2024-05-08T18:31:54.643538+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:26.091102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:26.091102+0000","last_clean_scrub_stamp":"2024-05-08T18:29:26.091102+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:09:50.296961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":147,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.468532+0000","last_change":"2024-05-08T18:29:34.496467+0000","last_active":"2024-05-08T18:31:55.468532+0000","last_peered":"2024-05-08T18:31:55.468532+0000","last_clean":"2024-05-08T18:31:55.468532+0000","last_became_active":"2024-05-08T18:29:34.495632+0000","last_became_peered":"2024-05-08T18:29:34.495632+0000","last_unstale":"2024-05-08T18:31:55.468532+0000","last_undegraded":"2024-05-08T18:31:55.468532+0000","last_fullsized":"2024-05-08T18:31:55.468532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:35.917391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"82'4","reported_seq":151,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.645356+0000","last_change":"2024-05-08T18:30:20.849562+0000","last_active":"2024-05-08T18:31:54.645356+0000","last_peered":"2024-05-08T18:31:54.645356+0000","last_clean":"2024-05-08T18:31:54.645356+0000","last_became_active":"2024-05-08T18:30:20.849160+0000","last_became_peered":"2024-05-08T18:30:20.849160+0000","last_unstale":"2024-05-08T18:31:54.645356+0000","last_undegraded":"2024-05-08T18:31:54.645356+0000","last_fullsized":"2024-05-08T18:31:54.645356+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:29:13.478886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":132,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.644019+0000","last_change":"2024-05-08T18:29:44.592445+0000","last_active":"2024-05-08T18:31:54.644019+0000","last_peered":"2024-05-08T18:31:54.644019+0000","last_clean":"2024-05-08T18:31:54.644019+0000","last_became_active":"2024-05-08T18:29:44.587855+0000","last_became_peered":"2024-05-08T18:29:44.587855+0000","last_unstale":"2024-05-08T18:31:54.644019+0000","last_undegraded":"2024-05-08T18:31:54.644019+0000","last_fullsized":"2024-05-08T18:31:54.644019+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:06:05.355648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"84'30","reported_seq":173,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.472724+0000","last_change":"2024-05-08T18:29:46.595394+0000","last_active":"2024-05-08T18:31:55.472724+0000","last_peered":"2024-05-08T18:31:55.472724+0000","last_clean":"2024-05-08T18:31:55.472724+0000","last_became_active":"2024-05-08T18:29:46.594573+0000","last_became_peered":"2024-05-08T18:29:46.594573+0000","last_unstale":"2024-05-08T18:31:55.472724+0000","last_undegraded":"2024-05-08T18:31:55.472724+0000","last_fullsized":"2024-05-08T18:31:55.472724+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:47:11.360684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71557,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":23,"num_write":20,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":126,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.649360+0000","last_change":"2024-05-08T18:29:48.632178+0000","last_active":"2024-05-08T18:31:54.649360+0000","last_peered":"2024-05-08T18:31:54.649360+0000","last_clean":"2024-05-08T18:31:54.649360+0000","last_became_active":"2024-05-08T18:29:48.631481+0000","last_became_peered":"2024-05-08T18:29:48.631481+0000","last_unstale":"2024-05-08T18:31:54.649360+0000","last_undegraded":"2024-05-08T18:31:54.649360+0000","last_fullsized":"2024-05-08T18:31:54.649360+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:34.806539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"80'2","reported_seq":121,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.466878+0000","last_change":"2024-05-08T18:29:50.675319+0000","last_active":"2024-05-08T18:31:55.466878+0000","last_peered":"2024-05-08T18:31:55.466878+0000","last_clean":"2024-05-08T18:31:55.466878+0000","last_became_active":"2024-05-08T18:29:50.674526+0000","last_became_peered":"2024-05-08T18:29:50.674526+0000","last_unstale":"2024-05-08T18:31:55.466878+0000","last_undegraded":"2024-05-08T18:31:55.466878+0000","last_fullsized":"2024-05-08T18:31:55.466878+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:59:06.404586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"84'4","reported_seq":149,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.649743+0000","last_change":"2024-05-08T18:29:42.568584+0000","last_active":"2024-05-08T18:31:54.649743+0000","last_peered":"2024-05-08T18:31:54.649743+0000","last_clean":"2024-05-08T18:31:54.649743+0000","last_became_active":"2024-05-08T18:29:42.568244+0000","last_became_peered":"2024-05-08T18:29:42.568244+0000","last_unstale":"2024-05-08T18:31:54.649743+0000","last_undegraded":"2024-05-08T18:31:54.649743+0000","last_fullsized":"2024-05-08T18:31:54.649743+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:20.397730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":146,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.643218+0000","last_change":"2024-05-08T18:29:34.497654+0000","last_active":"2024-05-08T18:31:54.643218+0000","last_peered":"2024-05-08T18:31:54.643218+0000","last_clean":"2024-05-08T18:31:54.643218+0000","last_became_active":"2024-05-08T18:29:34.495812+0000","last_became_peered":"2024-05-08T18:29:34.495812+0000","last_unstale":"2024-05-08T18:31:54.643218+0000","last_undegraded":"2024-05-08T18:31:54.643218+0000","last_fullsized":"2024-05-08T18:31:54.643218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:37:02.202613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"83'5","reported_seq":148,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.643930+0000","last_change":"2024-05-08T18:29:40.560653+0000","last_active":"2024-05-08T18:31:54.643930+0000","last_peered":"2024-05-08T18:31:54.643930+0000","last_clean":"2024-05-08T18:31:54.643930+0000","last_became_active":"2024-05-08T18:29:40.560296+0000","last_became_peered":"2024-05-08T18:29:40.560296+0000","last_unstale":"2024-05-08T18:31:54.643930+0000","last_undegraded":"2024-05-08T18:31:54.643930+0000","last_fullsized":"2024-05-08T18:31:54.643930+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:52.462279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":133,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.472980+0000","last_change":"2024-05-08T18:29:44.594681+0000","last_active":"2024-05-08T18:31:55.472980+0000","last_peered":"2024-05-08T18:31:55.472980+0000","last_clean":"2024-05-08T18:31:55.472980+0000","last_became_active":"2024-05-08T18:29:44.593917+0000","last_became_peered":"2024-05-08T18:29:44.593917+0000","last_unstale":"2024-05-08T18:31:55.472980+0000","last_undegraded":"2024-05-08T18:31:55.472980+0000","last_fullsized":"2024-05-08T18:31:55.472980+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:59:00.335437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"84'95","reported_seq":298,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.957823+0000","last_change":"2024-05-08T18:29:46.599932+0000","last_active":"2024-05-08T18:31:54.957823+0000","last_peered":"2024-05-08T18:31:54.957823+0000","last_clean":"2024-05-08T18:31:54.957823+0000","last_became_active":"2024-05-08T18:29:46.594789+0000","last_became_peered":"2024-05-08T18:29:46.594789+0000","last_unstale":"2024-05-08T18:31:54.957823+0000","last_undegraded":"2024-05-08T18:31:54.957823+0000","last_fullsized":"2024-05-08T18:31:54.957823+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:04:18.099848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9947,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":128,"num_read_kb":113,"num_write":28,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":124,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.643832+0000","last_change":"2024-05-08T18:29:48.634661+0000","last_active":"2024-05-08T18:31:54.643832+0000","last_peered":"2024-05-08T18:31:54.643832+0000","last_clean":"2024-05-08T18:31:54.643832+0000","last_became_active":"2024-05-08T18:29:48.634044+0000","last_became_peered":"2024-05-08T18:29:48.634044+0000","last_unstale":"2024-05-08T18:31:54.643832+0000","last_undegraded":"2024-05-08T18:31:54.643832+0000","last_fullsized":"2024-05-08T18:31:54.643832+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:01:46.238076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":122,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.956946+0000","last_change":"2024-05-08T18:29:50.676536+0000","last_active":"2024-05-08T18:31:54.956946+0000","last_peered":"2024-05-08T18:31:54.956946+0000","last_clean":"2024-05-08T18:31:54.956946+0000","last_became_active":"2024-05-08T18:29:50.675770+0000","last_became_peered":"2024-05-08T18:29:50.675770+0000","last_unstale":"2024-05-08T18:31:54.956946+0000","last_undegraded":"2024-05-08T18:31:54.956946+0000","last_fullsized":"2024-05-08T18:31:54.956946+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:28.003482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":139,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.958777+0000","last_change":"2024-05-08T18:29:42.575253+0000","last_active":"2024-05-08T18:31:54.958777+0000","last_peered":"2024-05-08T18:31:54.958777+0000","last_clean":"2024-05-08T18:31:54.958777+0000","last_became_active":"2024-05-08T18:29:42.573621+0000","last_became_peered":"2024-05-08T18:29:42.573621+0000","last_unstale":"2024-05-08T18:31:54.958777+0000","last_undegraded":"2024-05-08T18:31:54.958777+0000","last_fullsized":"2024-05-08T18:31:54.958777+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:59.243324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":145,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-08T18:31:53.615550+0000","last_change":"2024-05-08T18:29:34.491071+0000","last_active":"2024-05-08T18:31:53.615550+0000","last_peered":"2024-05-08T18:31:53.615550+0000","last_clean":"2024-05-08T18:31:53.615550+0000","last_became_active":"2024-05-08T18:29:34.490717+0000","last_became_peered":"2024-05-08T18:29:34.490717+0000","last_unstale":"2024-05-08T18:31:53.615550+0000","last_undegraded":"2024-05-08T18:31:53.615550+0000","last_fullsized":"2024-05-08T18:31:53.615550+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:55.793312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"83'7","reported_seq":150,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.956722+0000","last_change":"2024-05-08T18:29:40.530634+0000","last_active":"2024-05-08T18:31:54.956722+0000","last_peered":"2024-05-08T18:31:54.956722+0000","last_clean":"2024-05-08T18:31:54.956722+0000","last_became_active":"2024-05-08T18:29:40.529804+0000","last_became_peered":"2024-05-08T18:29:40.529804+0000","last_unstale":"2024-05-08T18:31:54.956722+0000","last_undegraded":"2024-05-08T18:31:54.956722+0000","last_fullsized":"2024-05-08T18:31:54.956722+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:59:25.840149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"26'1","reported_seq":132,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-08T18:31:53.617391+0000","last_change":"2024-05-08T18:29:44.584678+0000","last_active":"2024-05-08T18:31:53.617391+0000","last_peered":"2024-05-08T18:31:53.617391+0000","last_clean":"2024-05-08T18:31:53.617391+0000","last_became_active":"2024-05-08T18:29:44.584227+0000","last_became_peered":"2024-05-08T18:29:44.584227+0000","last_unstale":"2024-05-08T18:31:53.617391+0000","last_undegraded":"2024-05-08T18:31:53.617391+0000","last_fullsized":"2024-05-08T18:31:53.617391+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:04:01.281207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'15","reported_seq":175,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.644330+0000","last_change":"2024-05-08T18:29:46.608720+0000","last_active":"2024-05-08T18:31:54.644330+0000","last_peered":"2024-05-08T18:31:54.644330+0000","last_clean":"2024-05-08T18:31:54.644330+0000","last_became_active":"2024-05-08T18:29:46.607989+0000","last_became_peered":"2024-05-08T18:29:46.607989+0000","last_unstale":"2024-05-08T18:31:54.644330+0000","last_undegraded":"2024-05-08T18:31:54.644330+0000","last_fullsized":"2024-05-08T18:31:54.644330+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:58:31.293922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":127,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.649005+0000","last_change":"2024-05-08T18:29:48.625269+0000","last_active":"2024-05-08T18:31:54.649005+0000","last_peered":"2024-05-08T18:31:54.649005+0000","last_clean":"2024-05-08T18:31:54.649005+0000","last_became_active":"2024-05-08T18:29:48.624545+0000","last_became_peered":"2024-05-08T18:29:48.624545+0000","last_unstale":"2024-05-08T18:31:54.649005+0000","last_undegraded":"2024-05-08T18:31:54.649005+0000","last_fullsized":"2024-05-08T18:31:54.649005+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:16:42.799734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"84'12","reported_seq":144,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.645855+0000","last_change":"2024-05-08T18:29:50.688851+0000","last_active":"2024-05-08T18:31:54.645855+0000","last_peered":"2024-05-08T18:31:54.645855+0000","last_clean":"2024-05-08T18:31:54.645855+0000","last_became_active":"2024-05-08T18:29:50.687978+0000","last_became_peered":"2024-05-08T18:29:50.687978+0000","last_unstale":"2024-05-08T18:31:54.645855+0000","last_undegraded":"2024-05-08T18:31:54.645855+0000","last_fullsized":"2024-05-08T18:31:54.645855+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:28:29.836446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":42,"num_write":31,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"84'4","reported_seq":154,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.958079+0000","last_change":"2024-05-08T18:31:22.008678+0000","last_active":"2024-05-08T18:31:54.958079+0000","last_peered":"2024-05-08T18:31:54.958079+0000","last_clean":"2024-05-08T18:31:54.958079+0000","last_became_active":"2024-05-08T18:31:22.008342+0000","last_became_peered":"2024-05-08T18:31:22.008342+0000","last_unstale":"2024-05-08T18:31:54.958079+0000","last_undegraded":"2024-05-08T18:31:54.958079+0000","last_fullsized":"2024-05-08T18:31:54.958079+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:40:30.531379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":147,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.469342+0000","last_change":"2024-05-08T18:29:34.496942+0000","last_active":"2024-05-08T18:31:55.469342+0000","last_peered":"2024-05-08T18:31:55.469342+0000","last_clean":"2024-05-08T18:31:55.469342+0000","last_became_active":"2024-05-08T18:29:34.495882+0000","last_became_peered":"2024-05-08T18:29:34.495882+0000","last_unstale":"2024-05-08T18:31:55.469342+0000","last_undegraded":"2024-05-08T18:31:55.469342+0000","last_fullsized":"2024-05-08T18:31:55.469342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:55.793312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"82'4","reported_seq":149,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.646219+0000","last_change":"2024-05-08T18:29:40.554353+0000","last_active":"2024-05-08T18:31:55.646219+0000","last_peered":"2024-05-08T18:31:55.646219+0000","last_clean":"2024-05-08T18:31:55.646219+0000","last_became_active":"2024-05-08T18:29:40.553527+0000","last_became_peered":"2024-05-08T18:29:40.553527+0000","last_unstale":"2024-05-08T18:31:55.646219+0000","last_undegraded":"2024-05-08T18:31:55.646219+0000","last_fullsized":"2024-05-08T18:31:55.646219+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:03:42.148647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":135,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.649147+0000","last_change":"2024-05-08T18:29:44.597411+0000","last_active":"2024-05-08T18:31:54.649147+0000","last_peered":"2024-05-08T18:31:54.649147+0000","last_clean":"2024-05-08T18:31:54.649147+0000","last_became_active":"2024-05-08T18:29:44.596678+0000","last_became_peered":"2024-05-08T18:29:44.596678+0000","last_unstale":"2024-05-08T18:31:54.649147+0000","last_undegraded":"2024-05-08T18:31:54.649147+0000","last_fullsized":"2024-05-08T18:31:54.649147+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:37:23.674968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'12","reported_seq":147,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.646456+0000","last_change":"2024-05-08T18:29:46.607040+0000","last_active":"2024-05-08T18:31:54.646456+0000","last_peered":"2024-05-08T18:31:54.646456+0000","last_clean":"2024-05-08T18:31:54.646456+0000","last_became_active":"2024-05-08T18:29:46.606367+0000","last_became_peered":"2024-05-08T18:29:46.606367+0000","last_unstale":"2024-05-08T18:31:54.646456+0000","last_undegraded":"2024-05-08T18:31:54.646456+0000","last_fullsized":"2024-05-08T18:31:54.646456+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:59:26.650126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":123,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.470718+0000","last_change":"2024-05-08T18:29:48.632665+0000","last_active":"2024-05-08T18:31:55.470718+0000","last_peered":"2024-05-08T18:31:55.470718+0000","last_clean":"2024-05-08T18:31:55.470718+0000","last_became_active":"2024-05-08T18:29:48.631874+0000","last_became_peered":"2024-05-08T18:29:48.631874+0000","last_unstale":"2024-05-08T18:31:55.470718+0000","last_undegraded":"2024-05-08T18:31:55.470718+0000","last_fullsized":"2024-05-08T18:31:55.470718+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:06:09.390017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":120,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.466180+0000","last_change":"2024-05-08T18:29:50.683443+0000","last_active":"2024-05-08T18:31:55.466180+0000","last_peered":"2024-05-08T18:31:55.466180+0000","last_clean":"2024-05-08T18:31:55.466180+0000","last_became_active":"2024-05-08T18:29:50.682634+0000","last_became_peered":"2024-05-08T18:29:50.682634+0000","last_unstale":"2024-05-08T18:31:55.466180+0000","last_undegraded":"2024-05-08T18:31:55.466180+0000","last_fullsized":"2024-05-08T18:31:55.466180+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:10:38.951662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"80'2","reported_seq":144,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.957396+0000","last_change":"2024-05-08T18:29:42.574593+0000","last_active":"2024-05-08T18:31:54.957396+0000","last_peered":"2024-05-08T18:31:54.957396+0000","last_clean":"2024-05-08T18:31:54.957396+0000","last_became_active":"2024-05-08T18:29:42.574288+0000","last_became_peered":"2024-05-08T18:29:42.574288+0000","last_unstale":"2024-05-08T18:31:54.957396+0000","last_undegraded":"2024-05-08T18:31:54.957396+0000","last_fullsized":"2024-05-08T18:31:54.957396+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:58.320701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"83'7","reported_seq":95,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-08T18:31:53.616270+0000","last_change":"2024-05-08T18:30:20.850805+0000","last_active":"2024-05-08T18:31:53.616270+0000","last_peered":"2024-05-08T18:31:53.616270+0000","last_clean":"2024-05-08T18:31:53.616270+0000","last_became_active":"2024-05-08T18:30:20.850365+0000","last_became_peered":"2024-05-08T18:30:20.850365+0000","last_unstale":"2024-05-08T18:31:53.616270+0000","last_undegraded":"2024-05-08T18:31:53.616270+0000","last_fullsized":"2024-05-08T18:31:53.616270+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:52:21.678894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":149,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.958189+0000","last_change":"2024-05-08T18:29:34.606393+0000","last_active":"2024-05-08T18:31:54.958189+0000","last_peered":"2024-05-08T18:31:54.958189+0000","last_clean":"2024-05-08T18:31:54.958189+0000","last_became_active":"2024-05-08T18:29:34.605574+0000","last_became_peered":"2024-05-08T18:29:34.605574+0000","last_unstale":"2024-05-08T18:31:54.958189+0000","last_undegraded":"2024-05-08T18:31:54.958189+0000","last_fullsized":"2024-05-08T18:31:54.958189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:55.793312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":135,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.649311+0000","last_change":"2024-05-08T18:29:44.595127+0000","last_active":"2024-05-08T18:31:54.649311+0000","last_peered":"2024-05-08T18:31:54.649311+0000","last_clean":"2024-05-08T18:31:54.649311+0000","last_became_active":"2024-05-08T18:29:44.594642+0000","last_became_peered":"2024-05-08T18:29:44.594642+0000","last_unstale":"2024-05-08T18:31:54.649311+0000","last_undegraded":"2024-05-08T18:31:54.649311+0000","last_fullsized":"2024-05-08T18:31:54.649311+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:04:49.020450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"84'29","reported_seq":174,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.643796+0000","last_change":"2024-05-08T18:29:46.602279+0000","last_active":"2024-05-08T18:31:54.643796+0000","last_peered":"2024-05-08T18:31:54.643796+0000","last_clean":"2024-05-08T18:31:54.643796+0000","last_became_active":"2024-05-08T18:29:46.599707+0000","last_became_peered":"2024-05-08T18:29:46.599707+0000","last_unstale":"2024-05-08T18:31:54.643796+0000","last_undegraded":"2024-05-08T18:31:54.643796+0000","last_fullsized":"2024-05-08T18:31:54.643796+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:54:48.654215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4762,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":36,"num_read_kb":24,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":129,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.644871+0000","last_change":"2024-05-08T18:29:48.639458+0000","last_active":"2024-05-08T18:31:55.644871+0000","last_peered":"2024-05-08T18:31:55.644871+0000","last_clean":"2024-05-08T18:31:55.644871+0000","last_became_active":"2024-05-08T18:29:48.638709+0000","last_became_peered":"2024-05-08T18:29:48.638709+0000","last_unstale":"2024-05-08T18:31:55.644871+0000","last_undegraded":"2024-05-08T18:31:55.644871+0000","last_fullsized":"2024-05-08T18:31:55.644871+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:19:58.182291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"84'2","reported_seq":125,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.649129+0000","last_change":"2024-05-08T18:29:50.681077+0000","last_active":"2024-05-08T18:31:54.649129+0000","last_peered":"2024-05-08T18:31:54.649129+0000","last_clean":"2024-05-08T18:31:54.649129+0000","last_became_active":"2024-05-08T18:29:50.675766+0000","last_became_peered":"2024-05-08T18:29:50.675766+0000","last_unstale":"2024-05-08T18:31:54.649129+0000","last_undegraded":"2024-05-08T18:31:54.649129+0000","last_fullsized":"2024-05-08T18:31:54.649129+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:09:29.641515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":422,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"80'2","reported_seq":144,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.649938+0000","last_change":"2024-05-08T18:29:42.571265+0000","last_active":"2024-05-08T18:31:54.649938+0000","last_peered":"2024-05-08T18:31:54.649938+0000","last_clean":"2024-05-08T18:31:54.649938+0000","last_became_active":"2024-05-08T18:29:42.570645+0000","last_became_peered":"2024-05-08T18:29:42.570645+0000","last_unstale":"2024-05-08T18:31:54.649938+0000","last_undegraded":"2024-05-08T18:31:54.649938+0000","last_fullsized":"2024-05-08T18:31:54.649938+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:30:29.452640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"82'1","reported_seq":144,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.958081+0000","last_change":"2024-05-08T18:29:40.531079+0000","last_active":"2024-05-08T18:31:54.958081+0000","last_peered":"2024-05-08T18:31:54.958081+0000","last_clean":"2024-05-08T18:31:54.958081+0000","last_became_active":"2024-05-08T18:29:40.530256+0000","last_became_peered":"2024-05-08T18:29:40.530256+0000","last_unstale":"2024-05-08T18:31:54.958081+0000","last_undegraded":"2024-05-08T18:31:54.958081+0000","last_fullsized":"2024-05-08T18:31:54.958081+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:09:42.581976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":146,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.645053+0000","last_change":"2024-05-08T18:29:34.603292+0000","last_active":"2024-05-08T18:31:54.645053+0000","last_peered":"2024-05-08T18:31:54.645053+0000","last_clean":"2024-05-08T18:31:54.645053+0000","last_became_active":"2024-05-08T18:29:34.602547+0000","last_became_peered":"2024-05-08T18:29:34.602547+0000","last_unstale":"2024-05-08T18:31:54.645053+0000","last_undegraded":"2024-05-08T18:31:54.645053+0000","last_fullsized":"2024-05-08T18:31:54.645053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:24:55.555475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":132,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.467541+0000","last_change":"2024-05-08T18:29:44.593275+0000","last_active":"2024-05-08T18:31:55.467541+0000","last_peered":"2024-05-08T18:31:55.467541+0000","last_clean":"2024-05-08T18:31:55.467541+0000","last_became_active":"2024-05-08T18:29:44.591870+0000","last_became_peered":"2024-05-08T18:29:44.591870+0000","last_unstale":"2024-05-08T18:31:55.467541+0000","last_undegraded":"2024-05-08T18:31:55.467541+0000","last_fullsized":"2024-05-08T18:31:55.467541+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:35.176971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"33'14","reported_seq":152,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.956695+0000","last_change":"2024-05-08T18:29:46.603499+0000","last_active":"2024-05-08T18:31:54.956695+0000","last_peered":"2024-05-08T18:31:54.956695+0000","last_clean":"2024-05-08T18:31:54.956695+0000","last_became_active":"2024-05-08T18:29:46.602920+0000","last_became_peered":"2024-05-08T18:29:46.602920+0000","last_unstale":"2024-05-08T18:31:54.956695+0000","last_undegraded":"2024-05-08T18:31:54.956695+0000","last_fullsized":"2024-05-08T18:31:54.956695+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:08.504882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"84'86","reported_seq":249,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.466988+0000","last_change":"2024-05-08T18:29:48.634915+0000","last_active":"2024-05-08T18:31:55.466988+0000","last_peered":"2024-05-08T18:31:55.466988+0000","last_clean":"2024-05-08T18:31:55.466988+0000","last_became_active":"2024-05-08T18:29:48.634280+0000","last_became_peered":"2024-05-08T18:29:48.634280+0000","last_unstale":"2024-05-08T18:31:55.466988+0000","last_undegraded":"2024-05-08T18:31:55.466988+0000","last_fullsized":"2024-05-08T18:31:55.466988+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:19:58.182291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"80'2","reported_seq":123,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.649457+0000","last_change":"2024-05-08T18:29:50.688742+0000","last_active":"2024-05-08T18:31:54.649457+0000","last_peered":"2024-05-08T18:31:54.649457+0000","last_clean":"2024-05-08T18:31:54.649457+0000","last_became_active":"2024-05-08T18:29:50.687135+0000","last_became_peered":"2024-05-08T18:29:50.687135+0000","last_unstale":"2024-05-08T18:31:54.649457+0000","last_undegraded":"2024-05-08T18:31:54.649457+0000","last_fullsized":"2024-05-08T18:31:54.649457+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:12:49.040807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"80'2","reported_seq":93,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-08T18:31:53.615208+0000","last_change":"2024-05-08T18:30:21.220561+0000","last_active":"2024-05-08T18:31:53.615208+0000","last_peered":"2024-05-08T18:31:53.615208+0000","last_clean":"2024-05-08T18:31:53.615208+0000","last_became_active":"2024-05-08T18:30:21.220196+0000","last_became_peered":"2024-05-08T18:30:21.220196+0000","last_unstale":"2024-05-08T18:31:53.615208+0000","last_undegraded":"2024-05-08T18:31:53.615208+0000","last_fullsized":"2024-05-08T18:31:53.615208+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:19:27.075761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"83'5","reported_seq":147,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.645963+0000","last_change":"2024-05-08T18:29:40.565872+0000","last_active":"2024-05-08T18:31:54.645963+0000","last_peered":"2024-05-08T18:31:54.645963+0000","last_clean":"2024-05-08T18:31:54.645963+0000","last_became_active":"2024-05-08T18:29:40.565655+0000","last_became_peered":"2024-05-08T18:29:40.565655+0000","last_unstale":"2024-05-08T18:31:54.645963+0000","last_undegraded":"2024-05-08T18:31:54.645963+0000","last_fullsized":"2024-05-08T18:31:54.645963+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:16:16.521258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":149,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.958487+0000","last_change":"2024-05-08T18:29:34.501273+0000","last_active":"2024-05-08T18:31:54.958487+0000","last_peered":"2024-05-08T18:31:54.958487+0000","last_clean":"2024-05-08T18:31:54.958487+0000","last_became_active":"2024-05-08T18:29:34.500933+0000","last_became_peered":"2024-05-08T18:29:34.500933+0000","last_unstale":"2024-05-08T18:31:54.958487+0000","last_undegraded":"2024-05-08T18:31:54.958487+0000","last_fullsized":"2024-05-08T18:31:54.958487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:35.917391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":137,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.645175+0000","last_change":"2024-05-08T18:29:44.576227+0000","last_active":"2024-05-08T18:31:55.645175+0000","last_peered":"2024-05-08T18:31:55.645175+0000","last_clean":"2024-05-08T18:31:55.645175+0000","last_became_active":"2024-05-08T18:29:44.575454+0000","last_became_peered":"2024-05-08T18:29:44.575454+0000","last_unstale":"2024-05-08T18:31:55.645175+0000","last_undegraded":"2024-05-08T18:31:55.645175+0000","last_fullsized":"2024-05-08T18:31:55.645175+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:06:05.355648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"80'11","reported_seq":149,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.646220+0000","last_change":"2024-05-08T18:29:46.609633+0000","last_active":"2024-05-08T18:31:55.646220+0000","last_peered":"2024-05-08T18:31:55.646220+0000","last_clean":"2024-05-08T18:31:55.646220+0000","last_became_active":"2024-05-08T18:29:46.603455+0000","last_became_peered":"2024-05-08T18:29:46.603455+0000","last_unstale":"2024-05-08T18:31:55.646220+0000","last_undegraded":"2024-05-08T18:31:55.646220+0000","last_fullsized":"2024-05-08T18:31:55.646220+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:07:54.654205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"84'86","reported_seq":275,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.786663+0000","last_change":"2024-05-08T18:29:48.637898+0000","last_active":"2024-05-08T18:31:54.786663+0000","last_peered":"2024-05-08T18:31:54.786663+0000","last_clean":"2024-05-08T18:31:54.786663+0000","last_became_active":"2024-05-08T18:29:48.637070+0000","last_became_peered":"2024-05-08T18:29:48.637070+0000","last_unstale":"2024-05-08T18:31:54.786663+0000","last_undegraded":"2024-05-08T18:31:54.786663+0000","last_fullsized":"2024-05-08T18:31:54.786663+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:03:46.392864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"84'10","reported_seq":136,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.649065+0000","last_change":"2024-05-08T18:29:50.691526+0000","last_active":"2024-05-08T18:31:54.649065+0000","last_peered":"2024-05-08T18:31:54.649065+0000","last_clean":"2024-05-08T18:31:54.649065+0000","last_became_active":"2024-05-08T18:29:50.690767+0000","last_became_peered":"2024-05-08T18:29:50.690767+0000","last_unstale":"2024-05-08T18:31:54.649065+0000","last_undegraded":"2024-05-08T18:31:54.649065+0000","last_fullsized":"2024-05-08T18:31:54.649065+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:32:29.972139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"84'8","reported_seq":158,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.645938+0000","last_change":"2024-05-08T18:29:42.562006+0000","last_active":"2024-05-08T18:31:55.645938+0000","last_peered":"2024-05-08T18:31:55.645938+0000","last_clean":"2024-05-08T18:31:55.645938+0000","last_became_active":"2024-05-08T18:29:42.560861+0000","last_became_peered":"2024-05-08T18:29:42.560861+0000","last_unstale":"2024-05-08T18:31:55.645938+0000","last_undegraded":"2024-05-08T18:31:55.645938+0000","last_fullsized":"2024-05-08T18:31:55.645938+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:36.890277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"83'5","reported_seq":148,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.649817+0000","last_change":"2024-05-08T18:29:40.550529+0000","last_active":"2024-05-08T18:31:54.649817+0000","last_peered":"2024-05-08T18:31:54.649817+0000","last_clean":"2024-05-08T18:31:54.649817+0000","last_became_active":"2024-05-08T18:29:40.550241+0000","last_became_peered":"2024-05-08T18:29:40.550241+0000","last_unstale":"2024-05-08T18:31:54.649817+0000","last_undegraded":"2024-05-08T18:31:54.649817+0000","last_fullsized":"2024-05-08T18:31:54.649817+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:48.294532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":146,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.471529+0000","last_change":"2024-05-08T18:29:34.493537+0000","last_active":"2024-05-08T18:31:55.471529+0000","last_peered":"2024-05-08T18:31:55.471529+0000","last_clean":"2024-05-08T18:31:55.471529+0000","last_became_active":"2024-05-08T18:29:34.492891+0000","last_became_peered":"2024-05-08T18:29:34.492891+0000","last_unstale":"2024-05-08T18:31:55.471529+0000","last_undegraded":"2024-05-08T18:31:55.471529+0000","last_fullsized":"2024-05-08T18:31:55.471529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:09:07.992256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":134,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.645114+0000","last_change":"2024-05-08T18:29:44.590102+0000","last_active":"2024-05-08T18:31:54.645114+0000","last_peered":"2024-05-08T18:31:54.645114+0000","last_clean":"2024-05-08T18:31:54.645114+0000","last_became_active":"2024-05-08T18:29:44.589471+0000","last_became_peered":"2024-05-08T18:29:44.589471+0000","last_unstale":"2024-05-08T18:31:54.645114+0000","last_undegraded":"2024-05-08T18:31:54.645114+0000","last_fullsized":"2024-05-08T18:31:54.645114+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:14:04.085401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"84'34","reported_seq":179,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.643351+0000","last_change":"2024-05-08T18:29:46.606967+0000","last_active":"2024-05-08T18:31:54.643351+0000","last_peered":"2024-05-08T18:31:54.643351+0000","last_clean":"2024-05-08T18:31:54.643351+0000","last_became_active":"2024-05-08T18:29:46.605693+0000","last_became_peered":"2024-05-08T18:29:46.605693+0000","last_unstale":"2024-05-08T18:31:54.643351+0000","last_undegraded":"2024-05-08T18:31:54.643351+0000","last_fullsized":"2024-05-08T18:31:54.643351+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:24:13.568294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":126,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.645241+0000","last_change":"2024-05-08T18:29:48.634271+0000","last_active":"2024-05-08T18:31:54.645241+0000","last_peered":"2024-05-08T18:31:54.645241+0000","last_clean":"2024-05-08T18:31:54.645241+0000","last_became_active":"2024-05-08T18:29:48.633607+0000","last_became_peered":"2024-05-08T18:29:48.633607+0000","last_unstale":"2024-05-08T18:31:54.645241+0000","last_undegraded":"2024-05-08T18:31:54.645241+0000","last_fullsized":"2024-05-08T18:31:54.645241+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:34.806539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":120,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.468505+0000","last_change":"2024-05-08T18:29:50.685494+0000","last_active":"2024-05-08T18:31:55.468505+0000","last_peered":"2024-05-08T18:31:55.468505+0000","last_clean":"2024-05-08T18:31:55.468505+0000","last_became_active":"2024-05-08T18:29:50.684818+0000","last_became_peered":"2024-05-08T18:29:50.684818+0000","last_unstale":"2024-05-08T18:31:55.468505+0000","last_undegraded":"2024-05-08T18:31:55.468505+0000","last_fullsized":"2024-05-08T18:31:55.468505+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:22.220842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":123,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.649461+0000","last_change":"2024-05-08T18:29:50.682937+0000","last_active":"2024-05-08T18:31:54.649461+0000","last_peered":"2024-05-08T18:31:54.649461+0000","last_clean":"2024-05-08T18:31:54.649461+0000","last_became_active":"2024-05-08T18:29:50.681771+0000","last_became_peered":"2024-05-08T18:29:50.681771+0000","last_unstale":"2024-05-08T18:31:54.649461+0000","last_undegraded":"2024-05-08T18:31:54.649461+0000","last_fullsized":"2024-05-08T18:31:54.649461+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:28:29.836446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"84'4","reported_seq":150,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.645648+0000","last_change":"2024-05-08T18:29:42.575909+0000","last_active":"2024-05-08T18:31:55.645648+0000","last_peered":"2024-05-08T18:31:55.645648+0000","last_clean":"2024-05-08T18:31:55.645648+0000","last_became_active":"2024-05-08T18:29:42.574877+0000","last_became_peered":"2024-05-08T18:29:42.574877+0000","last_unstale":"2024-05-08T18:31:55.645648+0000","last_undegraded":"2024-05-08T18:31:55.645648+0000","last_fullsized":"2024-05-08T18:31:55.645648+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:33.139089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"84'8","reported_seq":152,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.645293+0000","last_change":"2024-05-08T18:29:40.566496+0000","last_active":"2024-05-08T18:31:55.645293+0000","last_peered":"2024-05-08T18:31:55.645293+0000","last_clean":"2024-05-08T18:31:55.645293+0000","last_became_active":"2024-05-08T18:29:40.565874+0000","last_became_peered":"2024-05-08T18:29:40.565874+0000","last_unstale":"2024-05-08T18:31:55.645293+0000","last_undegraded":"2024-05-08T18:31:55.645293+0000","last_fullsized":"2024-05-08T18:31:55.645293+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:07.239963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":134,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.957552+0000","last_change":"2024-05-08T18:29:44.595410+0000","last_active":"2024-05-08T18:31:54.957552+0000","last_peered":"2024-05-08T18:31:54.957552+0000","last_clean":"2024-05-08T18:31:54.957552+0000","last_became_active":"2024-05-08T18:29:44.594286+0000","last_became_peered":"2024-05-08T18:29:44.594286+0000","last_unstale":"2024-05-08T18:31:54.957552+0000","last_undegraded":"2024-05-08T18:31:54.957552+0000","last_fullsized":"2024-05-08T18:31:54.957552+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:38.928160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"84'16","reported_seq":153,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.644675+0000","last_change":"2024-05-08T18:29:46.591009+0000","last_active":"2024-05-08T18:31:54.644675+0000","last_peered":"2024-05-08T18:31:54.644675+0000","last_clean":"2024-05-08T18:31:54.644675+0000","last_became_active":"2024-05-08T18:29:46.588810+0000","last_became_peered":"2024-05-08T18:29:46.588810+0000","last_unstale":"2024-05-08T18:31:54.644675+0000","last_undegraded":"2024-05-08T18:31:54.644675+0000","last_fullsized":"2024-05-08T18:31:54.644675+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:34:45.745300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":125,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.644898+0000","last_change":"2024-05-08T18:29:48.634986+0000","last_active":"2024-05-08T18:31:54.644898+0000","last_peered":"2024-05-08T18:31:54.644898+0000","last_clean":"2024-05-08T18:31:54.644898+0000","last_became_active":"2024-05-08T18:29:48.633866+0000","last_became_peered":"2024-05-08T18:29:48.633866+0000","last_unstale":"2024-05-08T18:31:54.644898+0000","last_undegraded":"2024-05-08T18:31:54.644898+0000","last_fullsized":"2024-05-08T18:31:54.644898+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:46.539830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"83'16","reported_seq":144,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.646200+0000","last_change":"2024-05-08T18:29:50.693408+0000","last_active":"2024-05-08T18:31:54.646200+0000","last_peered":"2024-05-08T18:31:54.646200+0000","last_clean":"2024-05-08T18:31:54.646200+0000","last_became_active":"2024-05-08T18:29:50.692687+0000","last_became_peered":"2024-05-08T18:29:50.692687+0000","last_unstale":"2024-05-08T18:31:54.646200+0000","last_undegraded":"2024-05-08T18:31:54.646200+0000","last_fullsized":"2024-05-08T18:31:54.646200+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:22.834262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":28,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"83'6","reported_seq":153,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.957291+0000","last_change":"2024-05-08T18:29:42.581368+0000","last_active":"2024-05-08T18:31:54.957291+0000","last_peered":"2024-05-08T18:31:54.957291+0000","last_clean":"2024-05-08T18:31:54.957291+0000","last_became_active":"2024-05-08T18:29:42.580887+0000","last_became_peered":"2024-05-08T18:29:42.580887+0000","last_unstale":"2024-05-08T18:31:54.957291+0000","last_undegraded":"2024-05-08T18:31:54.957291+0000","last_fullsized":"2024-05-08T18:31:54.957291+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:08:15.026467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"84'4","reported_seq":143,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.644484+0000","last_change":"2024-05-08T18:29:40.572770+0000","last_active":"2024-05-08T18:31:54.644484+0000","last_peered":"2024-05-08T18:31:54.644484+0000","last_clean":"2024-05-08T18:31:54.644484+0000","last_became_active":"2024-05-08T18:29:40.572079+0000","last_became_peered":"2024-05-08T18:29:40.572079+0000","last_unstale":"2024-05-08T18:31:54.644484+0000","last_undegraded":"2024-05-08T18:31:54.644484+0000","last_fullsized":"2024-05-08T18:31:54.644484+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:05.929806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":133,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.645727+0000","last_change":"2024-05-08T18:29:44.581323+0000","last_active":"2024-05-08T18:31:54.645727+0000","last_peered":"2024-05-08T18:31:54.645727+0000","last_clean":"2024-05-08T18:31:54.645727+0000","last_became_active":"2024-05-08T18:29:44.580805+0000","last_became_peered":"2024-05-08T18:29:44.580805+0000","last_unstale":"2024-05-08T18:31:54.645727+0000","last_undegraded":"2024-05-08T18:31:54.645727+0000","last_fullsized":"2024-05-08T18:31:54.645727+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:35:25.591140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"47'5","reported_seq":137,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.643508+0000","last_change":"2024-05-08T18:29:46.602495+0000","last_active":"2024-05-08T18:31:54.643508+0000","last_peered":"2024-05-08T18:31:54.643508+0000","last_clean":"2024-05-08T18:31:54.643508+0000","last_became_active":"2024-05-08T18:29:46.599789+0000","last_became_peered":"2024-05-08T18:29:46.599789+0000","last_unstale":"2024-05-08T18:31:54.643508+0000","last_undegraded":"2024-05-08T18:31:54.643508+0000","last_fullsized":"2024-05-08T18:31:54.643508+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:18:16.375808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":123,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.643110+0000","last_change":"2024-05-08T18:29:48.642994+0000","last_active":"2024-05-08T18:31:54.643110+0000","last_peered":"2024-05-08T18:31:54.643110+0000","last_clean":"2024-05-08T18:31:54.643110+0000","last_became_active":"2024-05-08T18:29:48.642056+0000","last_became_peered":"2024-05-08T18:29:48.642056+0000","last_unstale":"2024-05-08T18:31:54.643110+0000","last_undegraded":"2024-05-08T18:31:54.643110+0000","last_fullsized":"2024-05-08T18:31:54.643110+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:47:54.034851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":122,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.649042+0000","last_change":"2024-05-08T18:29:50.672513+0000","last_active":"2024-05-08T18:31:54.649042+0000","last_peered":"2024-05-08T18:31:54.649042+0000","last_clean":"2024-05-08T18:31:54.649042+0000","last_became_active":"2024-05-08T18:29:50.671781+0000","last_became_peered":"2024-05-08T18:29:50.671781+0000","last_unstale":"2024-05-08T18:31:54.649042+0000","last_undegraded":"2024-05-08T18:31:54.649042+0000","last_fullsized":"2024-05-08T18:31:54.649042+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:45:34.171402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":137,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.644951+0000","last_change":"2024-05-08T18:29:42.576843+0000","last_active":"2024-05-08T18:31:54.644951+0000","last_peered":"2024-05-08T18:31:54.644951+0000","last_clean":"2024-05-08T18:31:54.644951+0000","last_became_active":"2024-05-08T18:29:42.576379+0000","last_became_peered":"2024-05-08T18:29:42.576379+0000","last_unstale":"2024-05-08T18:31:54.644951+0000","last_undegraded":"2024-05-08T18:31:54.644951+0000","last_fullsized":"2024-05-08T18:31:54.644951+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:20.471010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"84'6","reported_seq":146,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.470006+0000","last_change":"2024-05-08T18:29:40.542997+0000","last_active":"2024-05-08T18:31:55.470006+0000","last_peered":"2024-05-08T18:31:55.470006+0000","last_clean":"2024-05-08T18:31:55.470006+0000","last_became_active":"2024-05-08T18:29:40.542239+0000","last_became_peered":"2024-05-08T18:29:40.542239+0000","last_unstale":"2024-05-08T18:31:55.470006+0000","last_undegraded":"2024-05-08T18:31:55.470006+0000","last_fullsized":"2024-05-08T18:31:55.470006+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:14:43.555504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":131,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.642535+0000","last_change":"2024-05-08T18:29:44.594178+0000","last_active":"2024-05-08T18:31:54.642535+0000","last_peered":"2024-05-08T18:31:54.642535+0000","last_clean":"2024-05-08T18:31:54.642535+0000","last_became_active":"2024-05-08T18:29:44.592476+0000","last_became_peered":"2024-05-08T18:29:44.592476+0000","last_unstale":"2024-05-08T18:31:54.642535+0000","last_undegraded":"2024-05-08T18:31:54.642535+0000","last_fullsized":"2024-05-08T18:31:54.642535+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:04:16.093662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"84'16","reported_seq":153,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.645675+0000","last_change":"2024-05-08T18:29:46.597288+0000","last_active":"2024-05-08T18:31:54.645675+0000","last_peered":"2024-05-08T18:31:54.645675+0000","last_clean":"2024-05-08T18:31:54.645675+0000","last_became_active":"2024-05-08T18:29:46.596452+0000","last_became_peered":"2024-05-08T18:29:46.596452+0000","last_unstale":"2024-05-08T18:31:54.645675+0000","last_undegraded":"2024-05-08T18:31:54.645675+0000","last_fullsized":"2024-05-08T18:31:54.645675+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:32:43.245753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":123,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.467288+0000","last_change":"2024-05-08T18:29:48.635436+0000","last_active":"2024-05-08T18:31:55.467288+0000","last_peered":"2024-05-08T18:31:55.467288+0000","last_clean":"2024-05-08T18:31:55.467288+0000","last_became_active":"2024-05-08T18:29:48.634704+0000","last_became_peered":"2024-05-08T18:29:48.634704+0000","last_unstale":"2024-05-08T18:31:55.467288+0000","last_undegraded":"2024-05-08T18:31:55.467288+0000","last_fullsized":"2024-05-08T18:31:55.467288+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:55:52.238481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"83'2","reported_seq":123,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.467988+0000","last_change":"2024-05-08T18:29:50.687974+0000","last_active":"2024-05-08T18:31:55.467988+0000","last_peered":"2024-05-08T18:31:55.467988+0000","last_clean":"2024-05-08T18:31:55.467988+0000","last_became_active":"2024-05-08T18:29:50.687045+0000","last_became_peered":"2024-05-08T18:29:50.687045+0000","last_unstale":"2024-05-08T18:31:55.467988+0000","last_undegraded":"2024-05-08T18:31:55.467988+0000","last_fullsized":"2024-05-08T18:31:55.467988+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:55:01.894779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"84'3","reported_seq":148,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.645413+0000","last_change":"2024-05-08T18:30:20.850226+0000","last_active":"2024-05-08T18:31:54.645413+0000","last_peered":"2024-05-08T18:31:54.645413+0000","last_clean":"2024-05-08T18:31:54.645413+0000","last_became_active":"2024-05-08T18:30:20.849751+0000","last_became_peered":"2024-05-08T18:30:20.849751+0000","last_unstale":"2024-05-08T18:31:54.645413+0000","last_undegraded":"2024-05-08T18:31:54.645413+0000","last_fullsized":"2024-05-08T18:31:54.645413+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:33:31.550958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"84'7","reported_seq":149,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.649892+0000","last_change":"2024-05-08T18:29:40.541112+0000","last_active":"2024-05-08T18:31:54.649892+0000","last_peered":"2024-05-08T18:31:54.649892+0000","last_clean":"2024-05-08T18:31:54.649892+0000","last_became_active":"2024-05-08T18:29:40.540835+0000","last_became_peered":"2024-05-08T18:29:40.540835+0000","last_unstale":"2024-05-08T18:31:54.649892+0000","last_undegraded":"2024-05-08T18:31:54.649892+0000","last_fullsized":"2024-05-08T18:31:54.649892+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:43:14.995191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":131,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.467896+0000","last_change":"2024-05-08T18:29:44.592033+0000","last_active":"2024-05-08T18:31:55.467896+0000","last_peered":"2024-05-08T18:31:55.467896+0000","last_clean":"2024-05-08T18:31:55.467896+0000","last_became_active":"2024-05-08T18:29:44.590454+0000","last_became_peered":"2024-05-08T18:29:44.590454+0000","last_unstale":"2024-05-08T18:31:55.467896+0000","last_undegraded":"2024-05-08T18:31:55.467896+0000","last_fullsized":"2024-05-08T18:31:55.467896+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:11:03.740365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"84'14","reported_seq":148,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.642960+0000","last_change":"2024-05-08T18:29:46.607002+0000","last_active":"2024-05-08T18:31:54.642960+0000","last_peered":"2024-05-08T18:31:54.642960+0000","last_clean":"2024-05-08T18:31:54.642960+0000","last_became_active":"2024-05-08T18:29:46.606172+0000","last_became_peered":"2024-05-08T18:29:46.606172+0000","last_unstale":"2024-05-08T18:31:54.642960+0000","last_undegraded":"2024-05-08T18:31:54.642960+0000","last_fullsized":"2024-05-08T18:31:54.642960+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:37:35.850414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":126,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.648903+0000","last_change":"2024-05-08T18:29:48.632948+0000","last_active":"2024-05-08T18:31:54.648903+0000","last_peered":"2024-05-08T18:31:54.648903+0000","last_clean":"2024-05-08T18:31:54.648903+0000","last_became_active":"2024-05-08T18:29:48.631219+0000","last_became_peered":"2024-05-08T18:29:48.631219+0000","last_unstale":"2024-05-08T18:31:54.648903+0000","last_undegraded":"2024-05-08T18:31:54.648903+0000","last_fullsized":"2024-05-08T18:31:54.648903+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:19:01.454355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":136,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.471142+0000","last_change":"2024-05-08T18:29:42.570180+0000","last_active":"2024-05-08T18:31:55.471142+0000","last_peered":"2024-05-08T18:31:55.471142+0000","last_clean":"2024-05-08T18:31:55.471142+0000","last_became_active":"2024-05-08T18:29:42.569425+0000","last_became_peered":"2024-05-08T18:29:42.569425+0000","last_unstale":"2024-05-08T18:31:55.471142+0000","last_undegraded":"2024-05-08T18:31:55.471142+0000","last_fullsized":"2024-05-08T18:31:55.471142+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:35.037465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"84'2","reported_seq":143,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.646131+0000","last_change":"2024-05-08T18:29:40.547711+0000","last_active":"2024-05-08T18:31:54.646131+0000","last_peered":"2024-05-08T18:31:54.646131+0000","last_clean":"2024-05-08T18:31:54.646131+0000","last_became_active":"2024-05-08T18:29:40.547479+0000","last_became_peered":"2024-05-08T18:29:40.547479+0000","last_unstale":"2024-05-08T18:31:54.646131+0000","last_undegraded":"2024-05-08T18:31:54.646131+0000","last_fullsized":"2024-05-08T18:31:54.646131+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:12:40.901620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":135,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.649455+0000","last_change":"2024-05-08T18:29:44.591547+0000","last_active":"2024-05-08T18:31:54.649455+0000","last_peered":"2024-05-08T18:31:54.649455+0000","last_clean":"2024-05-08T18:31:54.649455+0000","last_became_active":"2024-05-08T18:29:44.590498+0000","last_became_peered":"2024-05-08T18:29:44.590498+0000","last_unstale":"2024-05-08T18:31:54.649455+0000","last_undegraded":"2024-05-08T18:31:54.649455+0000","last_fullsized":"2024-05-08T18:31:54.649455+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:14:04.085401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"84'23","reported_seq":164,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.957230+0000","last_change":"2024-05-08T18:29:46.600437+0000","last_active":"2024-05-08T18:31:54.957230+0000","last_peered":"2024-05-08T18:31:54.957230+0000","last_clean":"2024-05-08T18:31:54.957230+0000","last_became_active":"2024-05-08T18:29:46.594672+0000","last_became_peered":"2024-05-08T18:29:46.594672+0000","last_unstale":"2024-05-08T18:31:54.957230+0000","last_undegraded":"2024-05-08T18:31:54.957230+0000","last_fullsized":"2024-05-08T18:31:54.957230+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:35:53.294312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":124,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.468861+0000","last_change":"2024-05-08T18:29:48.639840+0000","last_active":"2024-05-08T18:31:55.468861+0000","last_peered":"2024-05-08T18:31:55.468861+0000","last_clean":"2024-05-08T18:31:55.468861+0000","last_became_active":"2024-05-08T18:29:48.639120+0000","last_became_peered":"2024-05-08T18:29:48.639120+0000","last_unstale":"2024-05-08T18:31:55.468861+0000","last_undegraded":"2024-05-08T18:31:55.468861+0000","last_fullsized":"2024-05-08T18:31:55.468861+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:13:50.865474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"84'2","reported_seq":124,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.644856+0000","last_change":"2024-05-08T18:29:50.684843+0000","last_active":"2024-05-08T18:31:54.644856+0000","last_peered":"2024-05-08T18:31:54.644856+0000","last_clean":"2024-05-08T18:31:54.644856+0000","last_became_active":"2024-05-08T18:29:50.684119+0000","last_became_peered":"2024-05-08T18:29:50.684119+0000","last_unstale":"2024-05-08T18:31:54.644856+0000","last_undegraded":"2024-05-08T18:31:54.644856+0000","last_fullsized":"2024-05-08T18:31:54.644856+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:09:29.641515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"80'2","reported_seq":144,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.649659+0000","last_change":"2024-05-08T18:29:42.575763+0000","last_active":"2024-05-08T18:31:54.649659+0000","last_peered":"2024-05-08T18:31:54.649659+0000","last_clean":"2024-05-08T18:31:54.649659+0000","last_became_active":"2024-05-08T18:29:42.575450+0000","last_became_peered":"2024-05-08T18:29:42.575450+0000","last_unstale":"2024-05-08T18:31:54.649659+0000","last_undegraded":"2024-05-08T18:31:54.649659+0000","last_fullsized":"2024-05-08T18:31:54.649659+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:20.471010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"83'8","reported_seq":150,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.957428+0000","last_change":"2024-05-08T18:29:40.546101+0000","last_active":"2024-05-08T18:31:54.957428+0000","last_peered":"2024-05-08T18:31:54.957428+0000","last_clean":"2024-05-08T18:31:54.957428+0000","last_became_active":"2024-05-08T18:29:40.545814+0000","last_became_peered":"2024-05-08T18:29:40.545814+0000","last_unstale":"2024-05-08T18:31:54.957428+0000","last_undegraded":"2024-05-08T18:31:54.957428+0000","last_fullsized":"2024-05-08T18:31:54.957428+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:22.579629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":132,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.470866+0000","last_change":"2024-05-08T18:29:44.591310+0000","last_active":"2024-05-08T18:31:55.470866+0000","last_peered":"2024-05-08T18:31:55.470866+0000","last_clean":"2024-05-08T18:31:55.470866+0000","last_became_active":"2024-05-08T18:29:44.590394+0000","last_became_peered":"2024-05-08T18:29:44.590394+0000","last_unstale":"2024-05-08T18:31:55.470866+0000","last_undegraded":"2024-05-08T18:31:55.470866+0000","last_fullsized":"2024-05-08T18:31:55.470866+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:02:28.348982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"84'20","reported_seq":157,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.643728+0000","last_change":"2024-05-08T18:29:46.605887+0000","last_active":"2024-05-08T18:31:54.643728+0000","last_peered":"2024-05-08T18:31:54.643728+0000","last_clean":"2024-05-08T18:31:54.643728+0000","last_became_active":"2024-05-08T18:29:46.604917+0000","last_became_peered":"2024-05-08T18:29:46.604917+0000","last_unstale":"2024-05-08T18:31:54.643728+0000","last_undegraded":"2024-05-08T18:31:54.643728+0000","last_fullsized":"2024-05-08T18:31:54.643728+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:22:36.338527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":126,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.957461+0000","last_change":"2024-05-08T18:29:48.644420+0000","last_active":"2024-05-08T18:31:54.957461+0000","last_peered":"2024-05-08T18:31:54.957461+0000","last_clean":"2024-05-08T18:31:54.957461+0000","last_became_active":"2024-05-08T18:29:48.643493+0000","last_became_peered":"2024-05-08T18:29:48.643493+0000","last_unstale":"2024-05-08T18:31:54.957461+0000","last_undegraded":"2024-05-08T18:31:54.957461+0000","last_fullsized":"2024-05-08T18:31:54.957461+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:19:33.148012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":119,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.467051+0000","last_change":"2024-05-08T18:29:50.687485+0000","last_active":"2024-05-08T18:31:55.467051+0000","last_peered":"2024-05-08T18:31:55.467051+0000","last_clean":"2024-05-08T18:31:55.467051+0000","last_became_active":"2024-05-08T18:29:50.686750+0000","last_became_peered":"2024-05-08T18:29:50.686750+0000","last_unstale":"2024-05-08T18:31:55.467051+0000","last_undegraded":"2024-05-08T18:31:55.467051+0000","last_fullsized":"2024-05-08T18:31:55.467051+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:41.914164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"84'3","reported_seq":143,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.646077+0000","last_change":"2024-05-08T18:29:42.566571+0000","last_active":"2024-05-08T18:31:54.646077+0000","last_peered":"2024-05-08T18:31:54.646077+0000","last_clean":"2024-05-08T18:31:54.646077+0000","last_became_active":"2024-05-08T18:29:42.563695+0000","last_became_peered":"2024-05-08T18:29:42.563695+0000","last_unstale":"2024-05-08T18:31:54.646077+0000","last_undegraded":"2024-05-08T18:31:54.646077+0000","last_fullsized":"2024-05-08T18:31:54.646077+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:46.887628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"84'6","reported_seq":150,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.646813+0000","last_change":"2024-05-08T18:29:40.545512+0000","last_active":"2024-05-08T18:31:55.646813+0000","last_peered":"2024-05-08T18:31:55.646813+0000","last_clean":"2024-05-08T18:31:55.646813+0000","last_became_active":"2024-05-08T18:29:40.544216+0000","last_became_peered":"2024-05-08T18:29:40.544216+0000","last_unstale":"2024-05-08T18:31:55.646813+0000","last_undegraded":"2024-05-08T18:31:55.646813+0000","last_fullsized":"2024-05-08T18:31:55.646813+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:37:08.242362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":136,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.647329+0000","last_change":"2024-05-08T18:29:44.576107+0000","last_active":"2024-05-08T18:31:55.647329+0000","last_peered":"2024-05-08T18:31:55.647329+0000","last_clean":"2024-05-08T18:31:55.647329+0000","last_became_active":"2024-05-08T18:29:44.575344+0000","last_became_peered":"2024-05-08T18:29:44.575344+0000","last_unstale":"2024-05-08T18:31:55.647329+0000","last_undegraded":"2024-05-08T18:31:55.647329+0000","last_fullsized":"2024-05-08T18:31:55.647329+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:19.731003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"84'16","reported_seq":154,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.649645+0000","last_change":"2024-05-08T18:29:46.584785+0000","last_active":"2024-05-08T18:31:54.649645+0000","last_peered":"2024-05-08T18:31:54.649645+0000","last_clean":"2024-05-08T18:31:54.649645+0000","last_became_active":"2024-05-08T18:29:46.583390+0000","last_became_peered":"2024-05-08T18:29:46.583390+0000","last_unstale":"2024-05-08T18:31:54.649645+0000","last_undegraded":"2024-05-08T18:31:54.649645+0000","last_fullsized":"2024-05-08T18:31:54.649645+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:27:01.747339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":127,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.957978+0000","last_change":"2024-05-08T18:29:48.643558+0000","last_active":"2024-05-08T18:31:54.957978+0000","last_peered":"2024-05-08T18:31:54.957978+0000","last_clean":"2024-05-08T18:31:54.957978+0000","last_became_active":"2024-05-08T18:29:48.642773+0000","last_became_peered":"2024-05-08T18:29:48.642773+0000","last_unstale":"2024-05-08T18:31:54.957978+0000","last_undegraded":"2024-05-08T18:31:54.957978+0000","last_fullsized":"2024-05-08T18:31:54.957978+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:59:04.369806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":120,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.471339+0000","last_change":"2024-05-08T18:29:50.674796+0000","last_active":"2024-05-08T18:31:55.471339+0000","last_peered":"2024-05-08T18:31:55.471339+0000","last_clean":"2024-05-08T18:31:55.471339+0000","last_became_active":"2024-05-08T18:29:50.674057+0000","last_became_peered":"2024-05-08T18:29:50.674057+0000","last_unstale":"2024-05-08T18:31:55.471339+0000","last_undegraded":"2024-05-08T18:31:55.471339+0000","last_fullsized":"2024-05-08T18:31:55.471339+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:34:14.488295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"84'4","reported_seq":144,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-08T18:31:53.616488+0000","last_change":"2024-05-08T18:29:42.577642+0000","last_active":"2024-05-08T18:31:53.616488+0000","last_peered":"2024-05-08T18:31:53.616488+0000","last_clean":"2024-05-08T18:31:53.616488+0000","last_became_active":"2024-05-08T18:29:42.577275+0000","last_became_peered":"2024-05-08T18:29:42.577275+0000","last_unstale":"2024-05-08T18:31:53.616488+0000","last_undegraded":"2024-05-08T18:31:53.616488+0000","last_fullsized":"2024-05-08T18:31:53.616488+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:51:45.155037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"82'4","reported_seq":146,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.648921+0000","last_change":"2024-05-08T18:29:40.562873+0000","last_active":"2024-05-08T18:31:54.648921+0000","last_peered":"2024-05-08T18:31:54.648921+0000","last_clean":"2024-05-08T18:31:54.648921+0000","last_became_active":"2024-05-08T18:29:40.562594+0000","last_became_peered":"2024-05-08T18:29:40.562594+0000","last_unstale":"2024-05-08T18:31:54.648921+0000","last_undegraded":"2024-05-08T18:31:54.648921+0000","last_fullsized":"2024-05-08T18:31:54.648921+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:16:16.521258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":134,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.957660+0000","last_change":"2024-05-08T18:29:44.594152+0000","last_active":"2024-05-08T18:31:54.957660+0000","last_peered":"2024-05-08T18:31:54.957660+0000","last_clean":"2024-05-08T18:31:54.957660+0000","last_became_active":"2024-05-08T18:29:44.593398+0000","last_became_peered":"2024-05-08T18:29:44.593398+0000","last_unstale":"2024-05-08T18:31:54.957660+0000","last_undegraded":"2024-05-08T18:31:54.957660+0000","last_fullsized":"2024-05-08T18:31:54.957660+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:11.825480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"85'12","reported_seq":150,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.647072+0000","last_change":"2024-05-08T18:29:46.602137+0000","last_active":"2024-05-08T18:31:55.647072+0000","last_peered":"2024-05-08T18:31:55.647072+0000","last_clean":"2024-05-08T18:31:55.647072+0000","last_became_active":"2024-05-08T18:29:46.601402+0000","last_became_peered":"2024-05-08T18:29:46.601402+0000","last_unstale":"2024-05-08T18:31:55.647072+0000","last_undegraded":"2024-05-08T18:31:55.647072+0000","last_fullsized":"2024-05-08T18:31:55.647072+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:23.940519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":22,"num_read_kb":17,"num_write":24,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"84'86","reported_seq":245,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.470149+0000","last_change":"2024-05-08T18:29:48.635696+0000","last_active":"2024-05-08T18:31:55.470149+0000","last_peered":"2024-05-08T18:31:55.470149+0000","last_clean":"2024-05-08T18:31:55.470149+0000","last_became_active":"2024-05-08T18:29:48.634859+0000","last_became_peered":"2024-05-08T18:29:48.634859+0000","last_unstale":"2024-05-08T18:31:55.470149+0000","last_undegraded":"2024-05-08T18:31:55.470149+0000","last_fullsized":"2024-05-08T18:31:55.470149+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:35:55.322495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":119,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.642505+0000","last_change":"2024-05-08T18:29:50.679757+0000","last_active":"2024-05-08T18:31:54.642505+0000","last_peered":"2024-05-08T18:31:54.642505+0000","last_clean":"2024-05-08T18:31:54.642505+0000","last_became_active":"2024-05-08T18:29:50.679011+0000","last_became_peered":"2024-05-08T18:29:50.679011+0000","last_unstale":"2024-05-08T18:31:54.642505+0000","last_undegraded":"2024-05-08T18:31:54.642505+0000","last_fullsized":"2024-05-08T18:31:54.642505+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:34:14.488295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"84'8","reported_seq":160,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.645384+0000","last_change":"2024-05-08T18:29:42.560354+0000","last_active":"2024-05-08T18:31:55.645384+0000","last_peered":"2024-05-08T18:31:55.645384+0000","last_clean":"2024-05-08T18:31:55.645384+0000","last_became_active":"2024-05-08T18:29:42.559647+0000","last_became_peered":"2024-05-08T18:29:42.559647+0000","last_unstale":"2024-05-08T18:31:55.645384+0000","last_undegraded":"2024-05-08T18:31:55.645384+0000","last_fullsized":"2024-05-08T18:31:55.645384+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:18:10.803989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"84'7","reported_seq":147,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.469537+0000","last_change":"2024-05-08T18:29:40.557683+0000","last_active":"2024-05-08T18:31:55.469537+0000","last_peered":"2024-05-08T18:31:55.469537+0000","last_clean":"2024-05-08T18:31:55.469537+0000","last_became_active":"2024-05-08T18:29:40.556254+0000","last_became_peered":"2024-05-08T18:29:40.556254+0000","last_unstale":"2024-05-08T18:31:55.469537+0000","last_undegraded":"2024-05-08T18:31:55.469537+0000","last_fullsized":"2024-05-08T18:31:55.469537+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:51:43.135322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":131,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.643116+0000","last_change":"2024-05-08T18:29:44.594068+0000","last_active":"2024-05-08T18:31:54.643116+0000","last_peered":"2024-05-08T18:31:54.643116+0000","last_clean":"2024-05-08T18:31:54.643116+0000","last_became_active":"2024-05-08T18:29:44.593322+0000","last_became_peered":"2024-05-08T18:29:44.593322+0000","last_unstale":"2024-05-08T18:31:54.643116+0000","last_undegraded":"2024-05-08T18:31:54.643116+0000","last_fullsized":"2024-05-08T18:31:54.643116+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:19.731003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"84'21","reported_seq":159,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.471605+0000","last_change":"2024-05-08T18:29:46.604700+0000","last_active":"2024-05-08T18:31:55.471605+0000","last_peered":"2024-05-08T18:31:55.471605+0000","last_clean":"2024-05-08T18:31:55.471605+0000","last_became_active":"2024-05-08T18:29:46.603885+0000","last_became_peered":"2024-05-08T18:29:46.603885+0000","last_unstale":"2024-05-08T18:31:55.471605+0000","last_undegraded":"2024-05-08T18:31:55.471605+0000","last_fullsized":"2024-05-08T18:31:55.471605+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:22:36.338527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9698,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":18,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":126,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.643185+0000","last_change":"2024-05-08T18:29:48.640814+0000","last_active":"2024-05-08T18:31:54.643185+0000","last_peered":"2024-05-08T18:31:54.643185+0000","last_clean":"2024-05-08T18:31:54.643185+0000","last_became_active":"2024-05-08T18:29:48.640046+0000","last_became_peered":"2024-05-08T18:29:48.640046+0000","last_unstale":"2024-05-08T18:31:54.643185+0000","last_undegraded":"2024-05-08T18:31:54.643185+0000","last_fullsized":"2024-05-08T18:31:54.643185+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:53:21.219706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"83'8","reported_seq":133,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.645409+0000","last_change":"2024-05-08T18:29:50.692688+0000","last_active":"2024-05-08T18:31:54.645409+0000","last_peered":"2024-05-08T18:31:54.645409+0000","last_clean":"2024-05-08T18:31:54.645409+0000","last_became_active":"2024-05-08T18:29:50.692123+0000","last_became_peered":"2024-05-08T18:29:50.692123+0000","last_unstale":"2024-05-08T18:31:54.645409+0000","last_undegraded":"2024-05-08T18:31:54.645409+0000","last_fullsized":"2024-05-08T18:31:54.645409+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:38.318890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":140,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.646350+0000","last_change":"2024-05-08T18:29:42.558336+0000","last_active":"2024-05-08T18:31:55.646350+0000","last_peered":"2024-05-08T18:31:55.646350+0000","last_clean":"2024-05-08T18:31:55.646350+0000","last_became_active":"2024-05-08T18:29:42.557570+0000","last_became_peered":"2024-05-08T18:29:42.557570+0000","last_unstale":"2024-05-08T18:31:55.646350+0000","last_undegraded":"2024-05-08T18:31:55.646350+0000","last_fullsized":"2024-05-08T18:31:55.646350+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:54:16.539832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"84'2","reported_seq":142,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.470174+0000","last_change":"2024-05-08T18:29:40.537090+0000","last_active":"2024-05-08T18:31:55.470174+0000","last_peered":"2024-05-08T18:31:55.470174+0000","last_clean":"2024-05-08T18:31:55.470174+0000","last_became_active":"2024-05-08T18:29:40.536188+0000","last_became_peered":"2024-05-08T18:29:40.536188+0000","last_unstale":"2024-05-08T18:31:55.470174+0000","last_undegraded":"2024-05-08T18:31:55.470174+0000","last_fullsized":"2024-05-08T18:31:55.470174+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:22:48.880581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":132,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.468279+0000","last_change":"2024-05-08T18:29:44.578901+0000","last_active":"2024-05-08T18:31:55.468279+0000","last_peered":"2024-05-08T18:31:55.468279+0000","last_clean":"2024-05-08T18:31:55.468279+0000","last_became_active":"2024-05-08T18:29:44.578171+0000","last_became_peered":"2024-05-08T18:29:44.578171+0000","last_unstale":"2024-05-08T18:31:55.468279+0000","last_undegraded":"2024-05-08T18:31:55.468279+0000","last_fullsized":"2024-05-08T18:31:55.468279+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:19.731003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"84'16","reported_seq":153,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.643185+0000","last_change":"2024-05-08T18:29:46.604539+0000","last_active":"2024-05-08T18:31:54.643185+0000","last_peered":"2024-05-08T18:31:54.643185+0000","last_clean":"2024-05-08T18:31:54.643185+0000","last_became_active":"2024-05-08T18:29:46.603728+0000","last_became_peered":"2024-05-08T18:29:46.603728+0000","last_unstale":"2024-05-08T18:31:54.643185+0000","last_undegraded":"2024-05-08T18:31:54.643185+0000","last_fullsized":"2024-05-08T18:31:54.643185+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:12:41.226788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":123,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.467334+0000","last_change":"2024-05-08T18:29:48.635813+0000","last_active":"2024-05-08T18:31:55.467334+0000","last_peered":"2024-05-08T18:31:55.467334+0000","last_clean":"2024-05-08T18:31:55.467334+0000","last_became_active":"2024-05-08T18:29:48.634664+0000","last_became_peered":"2024-05-08T18:29:48.634664+0000","last_unstale":"2024-05-08T18:31:55.467334+0000","last_undegraded":"2024-05-08T18:31:55.467334+0000","last_fullsized":"2024-05-08T18:31:55.467334+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:27:23.427365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"84'1","reported_seq":122,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.646303+0000","last_change":"2024-05-08T18:29:50.687517+0000","last_active":"2024-05-08T18:31:54.646303+0000","last_peered":"2024-05-08T18:31:54.646303+0000","last_clean":"2024-05-08T18:31:54.646303+0000","last_became_active":"2024-05-08T18:29:50.686662+0000","last_became_peered":"2024-05-08T18:29:50.686662+0000","last_unstale":"2024-05-08T18:31:54.646303+0000","last_undegraded":"2024-05-08T18:31:54.646303+0000","last_fullsized":"2024-05-08T18:31:54.646303+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:58:00.455559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"84'1","reported_seq":138,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.645068+0000","last_change":"2024-05-08T18:29:42.558848+0000","last_active":"2024-05-08T18:31:54.645068+0000","last_peered":"2024-05-08T18:31:54.645068+0000","last_clean":"2024-05-08T18:31:54.645068+0000","last_became_active":"2024-05-08T18:29:42.558390+0000","last_became_peered":"2024-05-08T18:29:42.558390+0000","last_unstale":"2024-05-08T18:31:54.645068+0000","last_undegraded":"2024-05-08T18:31:54.645068+0000","last_fullsized":"2024-05-08T18:31:54.645068+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:55:30.468069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"84'7","reported_seq":150,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.646658+0000","last_change":"2024-05-08T18:29:40.567772+0000","last_active":"2024-05-08T18:31:54.646658+0000","last_peered":"2024-05-08T18:31:54.646658+0000","last_clean":"2024-05-08T18:31:54.646658+0000","last_became_active":"2024-05-08T18:29:40.567482+0000","last_became_peered":"2024-05-08T18:29:40.567482+0000","last_unstale":"2024-05-08T18:31:54.646658+0000","last_undegraded":"2024-05-08T18:31:54.646658+0000","last_fullsized":"2024-05-08T18:31:54.646658+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:36:37.796095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":5,"num_write":17,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":136,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.644711+0000","last_change":"2024-05-08T18:29:44.596876+0000","last_active":"2024-05-08T18:31:55.644711+0000","last_peered":"2024-05-08T18:31:55.644711+0000","last_clean":"2024-05-08T18:31:55.644711+0000","last_became_active":"2024-05-08T18:29:44.595712+0000","last_became_peered":"2024-05-08T18:29:44.595712+0000","last_unstale":"2024-05-08T18:31:55.644711+0000","last_undegraded":"2024-05-08T18:31:55.644711+0000","last_fullsized":"2024-05-08T18:31:55.644711+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:35:51.288126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"84'10","reported_seq":144,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.646389+0000","last_change":"2024-05-08T18:29:46.598637+0000","last_active":"2024-05-08T18:31:54.646389+0000","last_peered":"2024-05-08T18:31:54.646389+0000","last_clean":"2024-05-08T18:31:54.646389+0000","last_became_active":"2024-05-08T18:29:46.597394+0000","last_became_peered":"2024-05-08T18:29:46.597394+0000","last_unstale":"2024-05-08T18:31:54.646389+0000","last_undegraded":"2024-05-08T18:31:54.646389+0000","last_fullsized":"2024-05-08T18:31:54.646389+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:52:22.540814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":128,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.644913+0000","last_change":"2024-05-08T18:29:48.642251+0000","last_active":"2024-05-08T18:31:55.644913+0000","last_peered":"2024-05-08T18:31:55.644913+0000","last_clean":"2024-05-08T18:31:55.644913+0000","last_became_active":"2024-05-08T18:29:48.641666+0000","last_became_peered":"2024-05-08T18:29:48.641666+0000","last_unstale":"2024-05-08T18:31:55.644913+0000","last_undegraded":"2024-05-08T18:31:55.644913+0000","last_fullsized":"2024-05-08T18:31:55.644913+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:13:50.865474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"80'2","reported_seq":122,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.643992+0000","last_change":"2024-05-08T18:29:50.685668+0000","last_active":"2024-05-08T18:31:54.643992+0000","last_peered":"2024-05-08T18:31:54.643992+0000","last_clean":"2024-05-08T18:31:54.643992+0000","last_became_active":"2024-05-08T18:29:50.684958+0000","last_became_peered":"2024-05-08T18:29:50.684958+0000","last_unstale":"2024-05-08T18:31:54.643992+0000","last_undegraded":"2024-05-08T18:31:54.643992+0000","last_fullsized":"2024-05-08T18:31:54.643992+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:55:01.894779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":140,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.645476+0000","last_change":"2024-05-08T18:29:42.562063+0000","last_active":"2024-05-08T18:31:55.645476+0000","last_peered":"2024-05-08T18:31:55.645476+0000","last_clean":"2024-05-08T18:31:55.645476+0000","last_became_active":"2024-05-08T18:29:42.558871+0000","last_became_peered":"2024-05-08T18:29:42.558871+0000","last_unstale":"2024-05-08T18:31:55.645476+0000","last_undegraded":"2024-05-08T18:31:55.645476+0000","last_fullsized":"2024-05-08T18:31:55.645476+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:59.243324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"84'4","reported_seq":147,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.649800+0000","last_change":"2024-05-08T18:29:40.541070+0000","last_active":"2024-05-08T18:31:54.649800+0000","last_peered":"2024-05-08T18:31:54.649800+0000","last_clean":"2024-05-08T18:31:54.649800+0000","last_became_active":"2024-05-08T18:29:40.540767+0000","last_became_peered":"2024-05-08T18:29:40.540767+0000","last_unstale":"2024-05-08T18:31:54.649800+0000","last_undegraded":"2024-05-08T18:31:54.649800+0000","last_fullsized":"2024-05-08T18:31:54.649800+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:09:39.835826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"26'1","reported_seq":135,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.956771+0000","last_change":"2024-05-08T18:29:44.592737+0000","last_active":"2024-05-08T18:31:54.956771+0000","last_peered":"2024-05-08T18:31:54.956771+0000","last_clean":"2024-05-08T18:31:54.956771+0000","last_became_active":"2024-05-08T18:29:44.592243+0000","last_became_peered":"2024-05-08T18:29:44.592243+0000","last_unstale":"2024-05-08T18:31:54.956771+0000","last_undegraded":"2024-05-08T18:31:54.956771+0000","last_fullsized":"2024-05-08T18:31:54.956771+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:59.744050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"84'15","reported_seq":154,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.645440+0000","last_change":"2024-05-08T18:29:46.610835+0000","last_active":"2024-05-08T18:31:55.645440+0000","last_peered":"2024-05-08T18:31:55.645440+0000","last_clean":"2024-05-08T18:31:55.645440+0000","last_became_active":"2024-05-08T18:29:46.609903+0000","last_became_peered":"2024-05-08T18:29:46.609903+0000","last_unstale":"2024-05-08T18:31:55.645440+0000","last_undegraded":"2024-05-08T18:31:55.645440+0000","last_fullsized":"2024-05-08T18:31:55.645440+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:37:35.850414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":126,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.648819+0000","last_change":"2024-05-08T18:29:48.629822+0000","last_active":"2024-05-08T18:31:54.648819+0000","last_peered":"2024-05-08T18:31:54.648819+0000","last_clean":"2024-05-08T18:31:54.648819+0000","last_became_active":"2024-05-08T18:29:48.629204+0000","last_became_peered":"2024-05-08T18:29:48.629204+0000","last_unstale":"2024-05-08T18:31:54.648819+0000","last_undegraded":"2024-05-08T18:31:54.648819+0000","last_fullsized":"2024-05-08T18:31:54.648819+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:04.571608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"84'6","reported_seq":133,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.647539+0000","last_change":"2024-05-08T18:29:50.668101+0000","last_active":"2024-05-08T18:31:55.647539+0000","last_peered":"2024-05-08T18:31:55.647539+0000","last_clean":"2024-05-08T18:31:55.647539+0000","last_became_active":"2024-05-08T18:29:50.667357+0000","last_became_peered":"2024-05-08T18:29:50.667357+0000","last_unstale":"2024-05-08T18:31:55.647539+0000","last_undegraded":"2024-05-08T18:31:55.647539+0000","last_fullsized":"2024-05-08T18:31:55.647539+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:55:01.894779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"84'3","reported_seq":145,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.958697+0000","last_change":"2024-05-08T18:29:42.581366+0000","last_active":"2024-05-08T18:31:54.958697+0000","last_peered":"2024-05-08T18:31:54.958697+0000","last_clean":"2024-05-08T18:31:54.958697+0000","last_became_active":"2024-05-08T18:29:42.580988+0000","last_became_peered":"2024-05-08T18:29:42.580988+0000","last_unstale":"2024-05-08T18:31:54.958697+0000","last_undegraded":"2024-05-08T18:31:54.958697+0000","last_fullsized":"2024-05-08T18:31:54.958697+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:42.005809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"84'9","reported_seq":150,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.467403+0000","last_change":"2024-05-08T18:29:40.562025+0000","last_active":"2024-05-08T18:31:55.467403+0000","last_peered":"2024-05-08T18:31:55.467403+0000","last_clean":"2024-05-08T18:31:55.467403+0000","last_became_active":"2024-05-08T18:29:40.561277+0000","last_became_peered":"2024-05-08T18:29:40.561277+0000","last_unstale":"2024-05-08T18:31:55.467403+0000","last_undegraded":"2024-05-08T18:31:55.467403+0000","last_fullsized":"2024-05-08T18:31:55.467403+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:59:25.840149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":19,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":139,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.958289+0000","last_change":"2024-05-08T18:29:42.573832+0000","last_active":"2024-05-08T18:31:54.958289+0000","last_peered":"2024-05-08T18:31:54.958289+0000","last_clean":"2024-05-08T18:31:54.958289+0000","last_became_active":"2024-05-08T18:29:42.573502+0000","last_became_peered":"2024-05-08T18:29:42.573502+0000","last_unstale":"2024-05-08T18:31:54.958289+0000","last_undegraded":"2024-05-08T18:31:54.958289+0000","last_fullsized":"2024-05-08T18:31:54.958289+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:35.037465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"84'5","reported_seq":144,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-08T18:31:53.615193+0000","last_change":"2024-05-08T18:29:40.533094+0000","last_active":"2024-05-08T18:31:53.615193+0000","last_peered":"2024-05-08T18:31:53.615193+0000","last_clean":"2024-05-08T18:31:53.615193+0000","last_became_active":"2024-05-08T18:29:40.532246+0000","last_became_peered":"2024-05-08T18:29:40.532246+0000","last_unstale":"2024-05-08T18:31:53.615193+0000","last_undegraded":"2024-05-08T18:31:53.615193+0000","last_fullsized":"2024-05-08T18:31:53.615193+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:37:08.242362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":137,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.469313+0000","last_change":"2024-05-08T18:29:42.565298+0000","last_active":"2024-05-08T18:31:55.469313+0000","last_peered":"2024-05-08T18:31:55.469313+0000","last_clean":"2024-05-08T18:31:55.469313+0000","last_became_active":"2024-05-08T18:29:42.564542+0000","last_became_peered":"2024-05-08T18:29:42.564542+0000","last_unstale":"2024-05-08T18:31:55.469313+0000","last_undegraded":"2024-05-08T18:31:55.469313+0000","last_fullsized":"2024-05-08T18:31:55.469313+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:57.706167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"84'8","reported_seq":149,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.469100+0000","last_change":"2024-05-08T18:29:40.556958+0000","last_active":"2024-05-08T18:31:55.469100+0000","last_peered":"2024-05-08T18:31:55.469100+0000","last_clean":"2024-05-08T18:31:55.469100+0000","last_became_active":"2024-05-08T18:29:40.556091+0000","last_became_peered":"2024-05-08T18:29:40.556091+0000","last_unstale":"2024-05-08T18:31:55.469100+0000","last_undegraded":"2024-05-08T18:31:55.469100+0000","last_fullsized":"2024-05-08T18:31:55.469100+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:39.986094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"84'5","reported_seq":150,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.958240+0000","last_change":"2024-05-08T18:29:42.574619+0000","last_active":"2024-05-08T18:31:54.958240+0000","last_peered":"2024-05-08T18:31:54.958240+0000","last_clean":"2024-05-08T18:31:54.958240+0000","last_became_active":"2024-05-08T18:29:42.573178+0000","last_became_peered":"2024-05-08T18:29:42.573178+0000","last_unstale":"2024-05-08T18:31:54.958240+0000","last_undegraded":"2024-05-08T18:31:54.958240+0000","last_fullsized":"2024-05-08T18:31:54.958240+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:33.139089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"84'4","reported_seq":147,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.649220+0000","last_change":"2024-05-08T18:29:40.544338+0000","last_active":"2024-05-08T18:31:54.649220+0000","last_peered":"2024-05-08T18:31:54.649220+0000","last_clean":"2024-05-08T18:31:54.649220+0000","last_became_active":"2024-05-08T18:29:40.544107+0000","last_became_peered":"2024-05-08T18:29:40.544107+0000","last_unstale":"2024-05-08T18:31:54.649220+0000","last_undegraded":"2024-05-08T18:31:54.649220+0000","last_fullsized":"2024-05-08T18:31:54.649220+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:54.200883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"84'2","reported_seq":143,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.646154+0000","last_change":"2024-05-08T18:29:42.576979+0000","last_active":"2024-05-08T18:31:54.646154+0000","last_peered":"2024-05-08T18:31:54.646154+0000","last_clean":"2024-05-08T18:31:54.646154+0000","last_became_active":"2024-05-08T18:29:42.576395+0000","last_became_peered":"2024-05-08T18:29:42.576395+0000","last_unstale":"2024-05-08T18:31:54.646154+0000","last_undegraded":"2024-05-08T18:31:54.646154+0000","last_fullsized":"2024-05-08T18:31:54.646154+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:53:03.097704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"83'2","reported_seq":144,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.647010+0000","last_change":"2024-05-08T18:29:40.558142+0000","last_active":"2024-05-08T18:31:54.647010+0000","last_peered":"2024-05-08T18:31:54.647010+0000","last_clean":"2024-05-08T18:31:54.647010+0000","last_became_active":"2024-05-08T18:29:40.557874+0000","last_became_peered":"2024-05-08T18:29:40.557874+0000","last_unstale":"2024-05-08T18:31:54.647010+0000","last_undegraded":"2024-05-08T18:31:54.647010+0000","last_fullsized":"2024-05-08T18:31:54.647010+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:54.200883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":141,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.646717+0000","last_change":"2024-05-08T18:29:42.558324+0000","last_active":"2024-05-08T18:31:55.646717+0000","last_peered":"2024-05-08T18:31:55.646717+0000","last_clean":"2024-05-08T18:31:55.646717+0000","last_became_active":"2024-05-08T18:29:42.556774+0000","last_became_peered":"2024-05-08T18:29:42.556774+0000","last_unstale":"2024-05-08T18:31:55.646717+0000","last_undegraded":"2024-05-08T18:31:55.646717+0000","last_fullsized":"2024-05-08T18:31:55.646717+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:02:26.311100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"82'2","reported_seq":150,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.957960+0000","last_change":"2024-05-08T18:30:20.858467+0000","last_active":"2024-05-08T18:31:54.957960+0000","last_peered":"2024-05-08T18:31:54.957960+0000","last_clean":"2024-05-08T18:31:54.957960+0000","last_became_active":"2024-05-08T18:30:20.858016+0000","last_became_peered":"2024-05-08T18:30:20.858016+0000","last_unstale":"2024-05-08T18:31:54.957960+0000","last_undegraded":"2024-05-08T18:31:54.957960+0000","last_fullsized":"2024-05-08T18:31:54.957960+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:10:28.824915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"84'4","reported_seq":148,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.644823+0000","last_change":"2024-05-08T18:29:42.562772+0000","last_active":"2024-05-08T18:31:54.644823+0000","last_peered":"2024-05-08T18:31:54.644823+0000","last_clean":"2024-05-08T18:31:54.644823+0000","last_became_active":"2024-05-08T18:29:42.562420+0000","last_became_peered":"2024-05-08T18:29:42.562420+0000","last_unstale":"2024-05-08T18:31:54.644823+0000","last_undegraded":"2024-05-08T18:31:54.644823+0000","last_fullsized":"2024-05-08T18:31:54.644823+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:30:29.452640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"82'2","reported_seq":142,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.470352+0000","last_change":"2024-05-08T18:29:40.562024+0000","last_active":"2024-05-08T18:31:55.470352+0000","last_peered":"2024-05-08T18:31:55.470352+0000","last_clean":"2024-05-08T18:31:55.470352+0000","last_became_active":"2024-05-08T18:29:40.561326+0000","last_became_peered":"2024-05-08T18:29:40.561326+0000","last_unstale":"2024-05-08T18:31:55.470352+0000","last_undegraded":"2024-05-08T18:31:55.470352+0000","last_fullsized":"2024-05-08T18:31:55.470352+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:21:38.354933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"84'3","reported_seq":142,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.467124+0000","last_change":"2024-05-08T18:29:42.561419+0000","last_active":"2024-05-08T18:31:55.467124+0000","last_peered":"2024-05-08T18:31:55.467124+0000","last_clean":"2024-05-08T18:31:55.467124+0000","last_became_active":"2024-05-08T18:29:42.560520+0000","last_became_peered":"2024-05-08T18:29:42.560520+0000","last_unstale":"2024-05-08T18:31:55.467124+0000","last_undegraded":"2024-05-08T18:31:55.467124+0000","last_fullsized":"2024-05-08T18:31:55.467124+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:07.949520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"83'7","reported_seq":149,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.649364+0000","last_change":"2024-05-08T18:29:40.554884+0000","last_active":"2024-05-08T18:31:54.649364+0000","last_peered":"2024-05-08T18:31:54.649364+0000","last_clean":"2024-05-08T18:31:54.649364+0000","last_became_active":"2024-05-08T18:29:40.554603+0000","last_became_peered":"2024-05-08T18:29:40.554603+0000","last_unstale":"2024-05-08T18:31:54.649364+0000","last_undegraded":"2024-05-08T18:31:54.649364+0000","last_fullsized":"2024-05-08T18:31:54.649364+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:09:39.835826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"84'4","reported_seq":148,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.649711+0000","last_change":"2024-05-08T18:29:42.574689+0000","last_active":"2024-05-08T18:31:54.649711+0000","last_peered":"2024-05-08T18:31:54.649711+0000","last_clean":"2024-05-08T18:31:54.649711+0000","last_became_active":"2024-05-08T18:29:42.573947+0000","last_became_peered":"2024-05-08T18:29:42.573947+0000","last_unstale":"2024-05-08T18:31:54.649711+0000","last_undegraded":"2024-05-08T18:31:54.649711+0000","last_fullsized":"2024-05-08T18:31:54.649711+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:57:14.869860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"84'7","reported_seq":148,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.467958+0000","last_change":"2024-05-08T18:29:40.554005+0000","last_active":"2024-05-08T18:31:55.467958+0000","last_peered":"2024-05-08T18:31:55.467958+0000","last_clean":"2024-05-08T18:31:55.467958+0000","last_became_active":"2024-05-08T18:29:40.553356+0000","last_became_peered":"2024-05-08T18:29:40.553356+0000","last_unstale":"2024-05-08T18:31:55.467958+0000","last_undegraded":"2024-05-08T18:31:55.467958+0000","last_fullsized":"2024-05-08T18:31:55.467958+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:08:13.006752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"84'2","reported_seq":145,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.647354+0000","last_change":"2024-05-08T18:29:42.566487+0000","last_active":"2024-05-08T18:31:55.647354+0000","last_peered":"2024-05-08T18:31:55.647354+0000","last_clean":"2024-05-08T18:31:55.647354+0000","last_became_active":"2024-05-08T18:29:42.565760+0000","last_became_peered":"2024-05-08T18:29:42.565760+0000","last_unstale":"2024-05-08T18:31:55.647354+0000","last_undegraded":"2024-05-08T18:31:55.647354+0000","last_fullsized":"2024-05-08T18:31:55.647354+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:57.706167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"83'7","reported_seq":149,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.645146+0000","last_change":"2024-05-08T18:29:40.552543+0000","last_active":"2024-05-08T18:31:54.645146+0000","last_peered":"2024-05-08T18:31:54.645146+0000","last_clean":"2024-05-08T18:31:54.645146+0000","last_became_active":"2024-05-08T18:29:40.552307+0000","last_became_peered":"2024-05-08T18:29:40.552307+0000","last_unstale":"2024-05-08T18:31:54.645146+0000","last_undegraded":"2024-05-08T18:31:54.645146+0000","last_fullsized":"2024-05-08T18:31:54.645146+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:48.294532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"84'4","reported_seq":144,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-08T18:31:53.617654+0000","last_change":"2024-05-08T18:29:42.561658+0000","last_active":"2024-05-08T18:31:53.617654+0000","last_peered":"2024-05-08T18:31:53.617654+0000","last_clean":"2024-05-08T18:31:53.617654+0000","last_became_active":"2024-05-08T18:29:42.561171+0000","last_became_peered":"2024-05-08T18:29:42.561171+0000","last_unstale":"2024-05-08T18:31:53.617654+0000","last_undegraded":"2024-05-08T18:31:53.617654+0000","last_fullsized":"2024-05-08T18:31:53.617654+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:15.966061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"82'5","reported_seq":146,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.468966+0000","last_change":"2024-05-08T18:29:40.543041+0000","last_active":"2024-05-08T18:31:55.468966+0000","last_peered":"2024-05-08T18:31:55.468966+0000","last_clean":"2024-05-08T18:31:55.468966+0000","last_became_active":"2024-05-08T18:29:40.542398+0000","last_became_peered":"2024-05-08T18:29:40.542398+0000","last_unstale":"2024-05-08T18:31:55.468966+0000","last_undegraded":"2024-05-08T18:31:55.468966+0000","last_fullsized":"2024-05-08T18:31:55.468966+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:33.017750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"84'5","reported_seq":151,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.646635+0000","last_change":"2024-05-08T18:29:42.579690+0000","last_active":"2024-05-08T18:31:55.646635+0000","last_peered":"2024-05-08T18:31:55.646635+0000","last_clean":"2024-05-08T18:31:55.646635+0000","last_became_active":"2024-05-08T18:29:42.578981+0000","last_became_peered":"2024-05-08T18:29:42.578981+0000","last_unstale":"2024-05-08T18:31:55.646635+0000","last_undegraded":"2024-05-08T18:31:55.646635+0000","last_fullsized":"2024-05-08T18:31:55.646635+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:36:03.084561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"82'6","reported_seq":149,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.649454+0000","last_change":"2024-05-08T18:29:40.548499+0000","last_active":"2024-05-08T18:31:54.649454+0000","last_peered":"2024-05-08T18:31:54.649454+0000","last_clean":"2024-05-08T18:31:54.649454+0000","last_became_active":"2024-05-08T18:29:40.548177+0000","last_became_peered":"2024-05-08T18:29:40.548177+0000","last_unstale":"2024-05-08T18:31:54.649454+0000","last_undegraded":"2024-05-08T18:31:54.649454+0000","last_fullsized":"2024-05-08T18:31:54.649454+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:27:41.414153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"80'2","reported_seq":140,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.643685+0000","last_change":"2024-05-08T18:29:42.575892+0000","last_active":"2024-05-08T18:31:54.643685+0000","last_peered":"2024-05-08T18:31:54.643685+0000","last_clean":"2024-05-08T18:31:54.643685+0000","last_became_active":"2024-05-08T18:29:42.573384+0000","last_became_peered":"2024-05-08T18:29:42.573384+0000","last_unstale":"2024-05-08T18:31:54.643685+0000","last_undegraded":"2024-05-08T18:31:54.643685+0000","last_fullsized":"2024-05-08T18:31:54.643685+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:55.055481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"82'2","reported_seq":142,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.469842+0000","last_change":"2024-05-08T18:29:40.565068+0000","last_active":"2024-05-08T18:31:55.469842+0000","last_peered":"2024-05-08T18:31:55.469842+0000","last_clean":"2024-05-08T18:31:55.469842+0000","last_became_active":"2024-05-08T18:29:40.563231+0000","last_became_peered":"2024-05-08T18:29:40.563231+0000","last_unstale":"2024-05-08T18:31:55.469842+0000","last_undegraded":"2024-05-08T18:31:55.469842+0000","last_fullsized":"2024-05-08T18:31:55.469842+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:17:47.828990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":138,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.646463+0000","last_change":"2024-05-08T18:29:42.564338+0000","last_active":"2024-05-08T18:31:54.646463+0000","last_peered":"2024-05-08T18:31:54.646463+0000","last_clean":"2024-05-08T18:31:54.646463+0000","last_became_active":"2024-05-08T18:29:42.563822+0000","last_became_peered":"2024-05-08T18:29:42.563822+0000","last_unstale":"2024-05-08T18:31:54.646463+0000","last_undegraded":"2024-05-08T18:31:54.646463+0000","last_fullsized":"2024-05-08T18:31:54.646463+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:23.397435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"83'9","reported_seq":149,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.645111+0000","last_change":"2024-05-08T18:29:40.573333+0000","last_active":"2024-05-08T18:31:54.645111+0000","last_peered":"2024-05-08T18:31:54.645111+0000","last_clean":"2024-05-08T18:31:54.645111+0000","last_became_active":"2024-05-08T18:29:40.571195+0000","last_became_peered":"2024-05-08T18:29:40.571195+0000","last_unstale":"2024-05-08T18:31:54.645111+0000","last_undegraded":"2024-05-08T18:31:54.645111+0000","last_fullsized":"2024-05-08T18:31:54.645111+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:33.017750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":137,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.644818+0000","last_change":"2024-05-08T18:29:42.563085+0000","last_active":"2024-05-08T18:31:54.644818+0000","last_peered":"2024-05-08T18:31:54.644818+0000","last_clean":"2024-05-08T18:31:54.644818+0000","last_became_active":"2024-05-08T18:29:42.560419+0000","last_became_peered":"2024-05-08T18:29:42.560419+0000","last_unstale":"2024-05-08T18:31:54.644818+0000","last_undegraded":"2024-05-08T18:31:54.644818+0000","last_fullsized":"2024-05-08T18:31:54.644818+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:20.397730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"84'4","reported_seq":142,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-08T18:31:53.618234+0000","last_change":"2024-05-08T18:29:40.568890+0000","last_active":"2024-05-08T18:31:53.618234+0000","last_peered":"2024-05-08T18:31:53.618234+0000","last_clean":"2024-05-08T18:31:53.618234+0000","last_became_active":"2024-05-08T18:29:40.568584+0000","last_became_peered":"2024-05-08T18:29:40.568584+0000","last_unstale":"2024-05-08T18:31:53.618234+0000","last_undegraded":"2024-05-08T18:31:53.618234+0000","last_fullsized":"2024-05-08T18:31:53.618234+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:25:01.595224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"83'6","reported_seq":145,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.643148+0000","last_change":"2024-05-08T18:29:42.574277+0000","last_active":"2024-05-08T18:31:54.643148+0000","last_peered":"2024-05-08T18:31:54.643148+0000","last_clean":"2024-05-08T18:31:54.643148+0000","last_became_active":"2024-05-08T18:29:42.573563+0000","last_became_peered":"2024-05-08T18:29:42.573563+0000","last_unstale":"2024-05-08T18:31:54.643148+0000","last_undegraded":"2024-05-08T18:31:54.643148+0000","last_fullsized":"2024-05-08T18:31:54.643148+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:57.706167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"84'3","reported_seq":143,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.473054+0000","last_change":"2024-05-08T18:29:40.562058+0000","last_active":"2024-05-08T18:31:55.473054+0000","last_peered":"2024-05-08T18:31:55.473054+0000","last_clean":"2024-05-08T18:31:55.473054+0000","last_became_active":"2024-05-08T18:29:40.561360+0000","last_became_peered":"2024-05-08T18:29:40.561360+0000","last_unstale":"2024-05-08T18:31:55.473054+0000","last_undegraded":"2024-05-08T18:31:55.473054+0000","last_fullsized":"2024-05-08T18:31:55.473054+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:05.929806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"84'8","reported_seq":149,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.467694+0000","last_change":"2024-05-08T18:29:40.538728+0000","last_active":"2024-05-08T18:31:55.467694+0000","last_peered":"2024-05-08T18:31:55.467694+0000","last_clean":"2024-05-08T18:31:55.467694+0000","last_became_active":"2024-05-08T18:29:40.537925+0000","last_became_peered":"2024-05-08T18:29:40.537925+0000","last_unstale":"2024-05-08T18:31:55.467694+0000","last_undegraded":"2024-05-08T18:31:55.467694+0000","last_fullsized":"2024-05-08T18:31:55.467694+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:28.426657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3,"num_read_kb":4,"num_write":18,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"84'6","reported_seq":153,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.649609+0000","last_change":"2024-05-08T18:29:42.574941+0000","last_active":"2024-05-08T18:31:54.649609+0000","last_peered":"2024-05-08T18:31:54.649609+0000","last_clean":"2024-05-08T18:31:54.649609+0000","last_became_active":"2024-05-08T18:29:42.574351+0000","last_became_peered":"2024-05-08T18:29:42.574351+0000","last_unstale":"2024-05-08T18:31:54.649609+0000","last_undegraded":"2024-05-08T18:31:54.649609+0000","last_fullsized":"2024-05-08T18:31:54.649609+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:21.935293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"82'5","reported_seq":147,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.957311+0000","last_change":"2024-05-08T18:29:40.543714+0000","last_active":"2024-05-08T18:31:54.957311+0000","last_peered":"2024-05-08T18:31:54.957311+0000","last_clean":"2024-05-08T18:31:54.957311+0000","last_became_active":"2024-05-08T18:29:40.542965+0000","last_became_peered":"2024-05-08T18:29:40.542965+0000","last_unstale":"2024-05-08T18:31:54.957311+0000","last_undegraded":"2024-05-08T18:31:54.957311+0000","last_fullsized":"2024-05-08T18:31:54.957311+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:12:59.146887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":136,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.469630+0000","last_change":"2024-05-08T18:29:42.560007+0000","last_active":"2024-05-08T18:31:55.469630+0000","last_peered":"2024-05-08T18:31:55.469630+0000","last_clean":"2024-05-08T18:31:55.469630+0000","last_became_active":"2024-05-08T18:29:42.559028+0000","last_became_peered":"2024-05-08T18:29:42.559028+0000","last_unstale":"2024-05-08T18:31:55.469630+0000","last_undegraded":"2024-05-08T18:31:55.469630+0000","last_fullsized":"2024-05-08T18:31:55.469630+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:36:03.084561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1079,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":197,"num_read_kb":190,"num_write":195,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":688,"ondisk_log_size":688,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":98648,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":794,"num_read_kb":553,"num_write":451,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":458752,"data_stored":157436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":620,"ondisk_log_size":620,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":284,"num_read_kb":284,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":455,"num_read_kb":435,"num_write":195,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":185,"ondisk_log_size":185,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":1352663040,"num_objects":323,"num_object_clones":0,"num_object_copies":646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":323,"num_whiteouts":0,"num_read":18,"num_read_kb":19,"num_write":383,"num_write_kb":1341440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2705326080,"data_stored":2705326080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":333,"ondisk_log_size":333,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509475,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":391228,"kb_used_data":360040,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93980612,"statfs":{"total":96636764160,"available":96236146688,"internally_reserved":0,"allocated":368680960,"data_stored":368180979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509475,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":239068,"kb_used_data":207888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94132772,"statfs":{"total":96636764160,"available":96391958528,"internally_reserved":0,"allocated":212877312,"data_stored":212400724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509473,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":474712,"kb_used_data":443532,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93897128,"statfs":{"total":96636764160,"available":96150659072,"internally_reserved":0,"allocated":454176768,"data_stored":453648471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509473,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":413156,"kb_used_data":381972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93958684,"statfs":{"total":96636764160,"available":96213692416,"internally_reserved":0,"allocated":391139328,"data_stored":390666602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542178,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":462396,"kb_used_data":431212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93909444,"statfs":{"total":96636764160,"available":96163270656,"internally_reserved":0,"allocated":441561088,"data_stored":441055114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542178,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":257488,"kb_used_data":226304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94114352,"statfs":{"total":96636764160,"available":96373096448,"internally_reserved":0,"allocated":231735296,"data_stored":231268639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542176,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":261616,"kb_used_data":230432,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94110224,"statfs":{"total":96636764160,"available":96368869376,"internally_reserved":0,"allocated":235962368,"data_stored":235472985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542178,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":401464,"kb_used_data":370280,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93970376,"statfs":{"total":96636764160,"available":96225665024,"internally_reserved":0,"allocated":379166720,"data_stored":378668573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":377487360,"data_stored":377487360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":234881024,"data_stored":234881024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":230686720,"data_stored":230686720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":440401920,"data_stored":440401920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":390070272,"data_stored":390070272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":452984832,"data_stored":452984832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":211812352,"data_stored":211812352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":367001600,"data_stored":367001600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":12223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":65021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":75918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":21,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T18:31:59.079 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T18:31:59.081 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-08T18:31:59.125 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:31:59.125+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:31:59.183 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:31:59.181+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:31:59.236 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:59.236 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:59.251 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-08T18:31:59.284 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:31:59.282+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:31:59.385 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:31:59.385+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:31:59.402 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:59.402 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:59.416 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-05-08T18:31:59.420 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-08T18:31:59.425 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2024-05-08T18:31:59.434 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":161,"stamp":"2024-05-08T18:31:58.680624+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1353354748,"num_objects":538,"num_object_clones":0,"num_object_copies":1076,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":538,"num_whiteouts":0,"num_read":1814,"num_read_kb":1536,"num_write":1335,"num_write_kb":1343286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1998,"ondisk_log_size":1998,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2901128,"kb_used_data":2651660,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":752073592,"statfs":{"total":773094113280,"available":770123358208,"internally_reserved":0,"allocated":2715299840,"data_stored":2711362087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-615,"num_objects":-7,"num_object_clones":0,"num_object_copies":-14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-7,"num_whiteouts":0,"num_read":161,"num_read_kb":158,"num_write":76,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.039058"},"pg_stats":[{"pgid":"3.3f","version":"82'3","reported_seq":143,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.645123+0000","last_change":"2024-05-08T18:29:40.574221+0000","last_active":"2024-05-08T18:31:54.645123+0000","last_peered":"2024-05-08T18:31:54.645123+0000","last_clean":"2024-05-08T18:31:54.645123+0000","last_became_active":"2024-05-08T18:29:40.573543+0000","last_became_peered":"2024-05-08T18:29:40.573543+0000","last_unstale":"2024-05-08T18:31:54.645123+0000","last_undegraded":"2024-05-08T18:31:54.645123+0000","last_fullsized":"2024-05-08T18:31:54.645123+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:57.223609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":136,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.466713+0000","last_change":"2024-05-08T18:29:42.563773+0000","last_active":"2024-05-08T18:31:55.466713+0000","last_peered":"2024-05-08T18:31:55.466713+0000","last_clean":"2024-05-08T18:31:55.466713+0000","last_became_active":"2024-05-08T18:29:42.561201+0000","last_became_peered":"2024-05-08T18:29:42.561201+0000","last_unstale":"2024-05-08T18:31:55.466713+0000","last_undegraded":"2024-05-08T18:31:55.466713+0000","last_fullsized":"2024-05-08T18:31:55.466713+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:55.055481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"82'4","reported_seq":147,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.958396+0000","last_change":"2024-05-08T18:29:40.549299+0000","last_active":"2024-05-08T18:31:54.958396+0000","last_peered":"2024-05-08T18:31:54.958396+0000","last_clean":"2024-05-08T18:31:54.958396+0000","last_became_active":"2024-05-08T18:29:40.548930+0000","last_became_peered":"2024-05-08T18:29:40.548930+0000","last_unstale":"2024-05-08T18:31:54.958396+0000","last_undegraded":"2024-05-08T18:31:54.958396+0000","last_fullsized":"2024-05-08T18:31:54.958396+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:06:36.198647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"84'2","reported_seq":140,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.643214+0000","last_change":"2024-05-08T18:29:42.572074+0000","last_active":"2024-05-08T18:31:54.643214+0000","last_peered":"2024-05-08T18:31:54.643214+0000","last_clean":"2024-05-08T18:31:54.643214+0000","last_became_active":"2024-05-08T18:29:42.571344+0000","last_became_peered":"2024-05-08T18:29:42.571344+0000","last_unstale":"2024-05-08T18:31:54.643214+0000","last_undegraded":"2024-05-08T18:31:54.643214+0000","last_fullsized":"2024-05-08T18:31:54.643214+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:36.890277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"84'5","reported_seq":148,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.649285+0000","last_change":"2024-05-08T18:29:40.539048+0000","last_active":"2024-05-08T18:31:54.649285+0000","last_peered":"2024-05-08T18:31:54.649285+0000","last_clean":"2024-05-08T18:31:54.649285+0000","last_became_active":"2024-05-08T18:29:40.538458+0000","last_became_peered":"2024-05-08T18:29:40.538458+0000","last_unstale":"2024-05-08T18:31:54.649285+0000","last_undegraded":"2024-05-08T18:31:54.649285+0000","last_fullsized":"2024-05-08T18:31:54.649285+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:36:37.796095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":140,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.646101+0000","last_change":"2024-05-08T18:29:42.569718+0000","last_active":"2024-05-08T18:31:55.646101+0000","last_peered":"2024-05-08T18:31:55.646101+0000","last_clean":"2024-05-08T18:31:55.646101+0000","last_became_active":"2024-05-08T18:29:42.569026+0000","last_became_peered":"2024-05-08T18:29:42.569026+0000","last_unstale":"2024-05-08T18:31:55.646101+0000","last_undegraded":"2024-05-08T18:31:55.646101+0000","last_fullsized":"2024-05-08T18:31:55.646101+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:42.045615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"84'8","reported_seq":149,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.469278+0000","last_change":"2024-05-08T18:29:40.557700+0000","last_active":"2024-05-08T18:31:55.469278+0000","last_peered":"2024-05-08T18:31:55.469278+0000","last_clean":"2024-05-08T18:31:55.469278+0000","last_became_active":"2024-05-08T18:29:40.556884+0000","last_became_peered":"2024-05-08T18:29:40.556884+0000","last_unstale":"2024-05-08T18:31:55.469278+0000","last_undegraded":"2024-05-08T18:31:55.469278+0000","last_fullsized":"2024-05-08T18:31:55.469278+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:21:38.354933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":138,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.649041+0000","last_change":"2024-05-08T18:29:42.566448+0000","last_active":"2024-05-08T18:31:54.649041+0000","last_peered":"2024-05-08T18:31:54.649041+0000","last_clean":"2024-05-08T18:31:54.649041+0000","last_became_active":"2024-05-08T18:29:42.566058+0000","last_became_peered":"2024-05-08T18:29:42.566058+0000","last_unstale":"2024-05-08T18:31:54.649041+0000","last_undegraded":"2024-05-08T18:31:54.649041+0000","last_fullsized":"2024-05-08T18:31:54.649041+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:53:03.097704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"82'1","reported_seq":140,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.644161+0000","last_change":"2024-05-08T18:29:40.571195+0000","last_active":"2024-05-08T18:31:54.644161+0000","last_peered":"2024-05-08T18:31:54.644161+0000","last_clean":"2024-05-08T18:31:54.644161+0000","last_became_active":"2024-05-08T18:29:40.570467+0000","last_became_peered":"2024-05-08T18:29:40.570467+0000","last_unstale":"2024-05-08T18:31:54.644161+0000","last_undegraded":"2024-05-08T18:31:54.644161+0000","last_fullsized":"2024-05-08T18:31:54.644161+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:39.986094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":136,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.469348+0000","last_change":"2024-05-08T18:29:42.566506+0000","last_active":"2024-05-08T18:31:55.469348+0000","last_peered":"2024-05-08T18:31:55.469348+0000","last_clean":"2024-05-08T18:31:55.469348+0000","last_became_active":"2024-05-08T18:29:42.565740+0000","last_became_peered":"2024-05-08T18:29:42.565740+0000","last_unstale":"2024-05-08T18:31:55.469348+0000","last_undegraded":"2024-05-08T18:31:55.469348+0000","last_fullsized":"2024-05-08T18:31:55.469348+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:58.320701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"82'4","reported_seq":144,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.468399+0000","last_change":"2024-05-08T18:29:40.538314+0000","last_active":"2024-05-08T18:31:55.468399+0000","last_peered":"2024-05-08T18:31:55.468399+0000","last_clean":"2024-05-08T18:31:55.468399+0000","last_became_active":"2024-05-08T18:29:40.537458+0000","last_became_peered":"2024-05-08T18:29:40.537458+0000","last_unstale":"2024-05-08T18:31:55.468399+0000","last_undegraded":"2024-05-08T18:31:55.468399+0000","last_fullsized":"2024-05-08T18:31:55.468399+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:56.300986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":141,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.646430+0000","last_change":"2024-05-08T18:29:42.570054+0000","last_active":"2024-05-08T18:31:55.646430+0000","last_peered":"2024-05-08T18:31:55.646430+0000","last_clean":"2024-05-08T18:31:55.646430+0000","last_became_active":"2024-05-08T18:29:42.569255+0000","last_became_peered":"2024-05-08T18:29:42.569255+0000","last_unstale":"2024-05-08T18:31:55.646430+0000","last_undegraded":"2024-05-08T18:31:55.646430+0000","last_fullsized":"2024-05-08T18:31:55.646430+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:11:01.702482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"84'9","reported_seq":97,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-08T18:31:53.614639+0000","last_change":"2024-05-08T18:30:21.210397+0000","last_active":"2024-05-08T18:31:53.614639+0000","last_peered":"2024-05-08T18:31:53.614639+0000","last_clean":"2024-05-08T18:31:53.614639+0000","last_became_active":"2024-05-08T18:30:21.210052+0000","last_became_peered":"2024-05-08T18:30:21.210052+0000","last_unstale":"2024-05-08T18:31:53.614639+0000","last_undegraded":"2024-05-08T18:31:53.614639+0000","last_fullsized":"2024-05-08T18:31:53.614639+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:51:05.355593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"80'2","reported_seq":142,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.469348+0000","last_change":"2024-05-08T18:29:42.562084+0000","last_active":"2024-05-08T18:31:55.469348+0000","last_peered":"2024-05-08T18:31:55.469348+0000","last_clean":"2024-05-08T18:31:55.469348+0000","last_became_active":"2024-05-08T18:29:42.560699+0000","last_became_peered":"2024-05-08T18:29:42.560699+0000","last_unstale":"2024-05-08T18:31:55.469348+0000","last_undegraded":"2024-05-08T18:31:55.469348+0000","last_fullsized":"2024-05-08T18:31:55.469348+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:09.787597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"84'7","reported_seq":148,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.645974+0000","last_change":"2024-05-08T18:29:40.564339+0000","last_active":"2024-05-08T18:31:54.645974+0000","last_peered":"2024-05-08T18:31:54.645974+0000","last_clean":"2024-05-08T18:31:54.645974+0000","last_became_active":"2024-05-08T18:29:40.564038+0000","last_became_peered":"2024-05-08T18:29:40.564038+0000","last_unstale":"2024-05-08T18:31:54.645974+0000","last_undegraded":"2024-05-08T18:31:54.645974+0000","last_fullsized":"2024-05-08T18:31:54.645974+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:40:23.287885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"84'8","reported_seq":149,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-08T18:31:53.617204+0000","last_change":"2024-05-08T18:29:42.570253+0000","last_active":"2024-05-08T18:31:53.617204+0000","last_peered":"2024-05-08T18:31:53.617204+0000","last_clean":"2024-05-08T18:31:53.617204+0000","last_became_active":"2024-05-08T18:29:42.569917+0000","last_became_peered":"2024-05-08T18:29:42.569917+0000","last_unstale":"2024-05-08T18:31:53.617204+0000","last_undegraded":"2024-05-08T18:31:53.617204+0000","last_fullsized":"2024-05-08T18:31:53.617204+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:14:45.575219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"84'4","reported_seq":150,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.645210+0000","last_change":"2024-05-08T18:29:42.568116+0000","last_active":"2024-05-08T18:31:55.645210+0000","last_peered":"2024-05-08T18:31:55.645210+0000","last_clean":"2024-05-08T18:31:55.645210+0000","last_became_active":"2024-05-08T18:29:42.567399+0000","last_became_peered":"2024-05-08T18:29:42.567399+0000","last_unstale":"2024-05-08T18:31:55.645210+0000","last_undegraded":"2024-05-08T18:31:55.645210+0000","last_fullsized":"2024-05-08T18:31:55.645210+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:35.037465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"82'7","reported_seq":146,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.645153+0000","last_change":"2024-05-08T18:29:40.571982+0000","last_active":"2024-05-08T18:31:54.645153+0000","last_peered":"2024-05-08T18:31:54.645153+0000","last_clean":"2024-05-08T18:31:54.645153+0000","last_became_active":"2024-05-08T18:29:40.570600+0000","last_became_peered":"2024-05-08T18:29:40.570600+0000","last_unstale":"2024-05-08T18:31:54.645153+0000","last_undegraded":"2024-05-08T18:31:54.645153+0000","last_fullsized":"2024-05-08T18:31:54.645153+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:54:14.520118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"80'2","reported_seq":140,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.643661+0000","last_change":"2024-05-08T18:29:42.578449+0000","last_active":"2024-05-08T18:31:54.643661+0000","last_peered":"2024-05-08T18:31:54.643661+0000","last_clean":"2024-05-08T18:31:54.643661+0000","last_became_active":"2024-05-08T18:29:42.577789+0000","last_became_peered":"2024-05-08T18:29:42.577789+0000","last_unstale":"2024-05-08T18:31:54.643661+0000","last_undegraded":"2024-05-08T18:31:54.643661+0000","last_fullsized":"2024-05-08T18:31:54.643661+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:09.787597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"84'7","reported_seq":146,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.470168+0000","last_change":"2024-05-08T18:29:40.570618+0000","last_active":"2024-05-08T18:31:55.470168+0000","last_peered":"2024-05-08T18:31:55.470168+0000","last_clean":"2024-05-08T18:31:55.470168+0000","last_became_active":"2024-05-08T18:29:40.569519+0000","last_became_peered":"2024-05-08T18:29:40.569519+0000","last_unstale":"2024-05-08T18:31:55.470168+0000","last_undegraded":"2024-05-08T18:31:55.470168+0000","last_fullsized":"2024-05-08T18:31:55.470168+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:09:42.581976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":136,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.471270+0000","last_change":"2024-05-08T18:29:42.563056+0000","last_active":"2024-05-08T18:31:55.471270+0000","last_peered":"2024-05-08T18:31:55.471270+0000","last_clean":"2024-05-08T18:31:55.471270+0000","last_became_active":"2024-05-08T18:29:42.562296+0000","last_became_peered":"2024-05-08T18:29:42.562296+0000","last_unstale":"2024-05-08T18:31:55.471270+0000","last_undegraded":"2024-05-08T18:31:55.471270+0000","last_fullsized":"2024-05-08T18:31:55.471270+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:36.890277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"83'7","reported_seq":146,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.471014+0000","last_change":"2024-05-08T18:29:40.564353+0000","last_active":"2024-05-08T18:31:55.471014+0000","last_peered":"2024-05-08T18:31:55.471014+0000","last_clean":"2024-05-08T18:31:55.471014+0000","last_became_active":"2024-05-08T18:29:40.563516+0000","last_became_peered":"2024-05-08T18:29:40.563516+0000","last_unstale":"2024-05-08T18:31:55.471014+0000","last_undegraded":"2024-05-08T18:31:55.471014+0000","last_fullsized":"2024-05-08T18:31:55.471014+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:06:36.198647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"84'3","reported_seq":140,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-08T18:31:53.617484+0000","last_change":"2024-05-08T18:29:42.567006+0000","last_active":"2024-05-08T18:31:53.617484+0000","last_peered":"2024-05-08T18:31:53.617484+0000","last_clean":"2024-05-08T18:31:53.617484+0000","last_became_active":"2024-05-08T18:29:42.566256+0000","last_became_peered":"2024-05-08T18:29:42.566256+0000","last_unstale":"2024-05-08T18:31:53.617484+0000","last_undegraded":"2024-05-08T18:31:53.617484+0000","last_fullsized":"2024-05-08T18:31:53.617484+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:09:44.601690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"84'3","reported_seq":147,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.645496+0000","last_change":"2024-05-08T18:29:40.573212+0000","last_active":"2024-05-08T18:31:55.645496+0000","last_peered":"2024-05-08T18:31:55.645496+0000","last_clean":"2024-05-08T18:31:55.645496+0000","last_became_active":"2024-05-08T18:29:40.572250+0000","last_became_peered":"2024-05-08T18:29:40.572250+0000","last_unstale":"2024-05-08T18:31:55.645496+0000","last_undegraded":"2024-05-08T18:31:55.645496+0000","last_fullsized":"2024-05-08T18:31:55.645496+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:25:01.595224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"84'5","reported_seq":145,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-08T18:31:53.616407+0000","last_change":"2024-05-08T18:29:42.570847+0000","last_active":"2024-05-08T18:31:53.616407+0000","last_peered":"2024-05-08T18:31:53.616407+0000","last_clean":"2024-05-08T18:31:53.616407+0000","last_became_active":"2024-05-08T18:29:42.570435+0000","last_became_peered":"2024-05-08T18:29:42.570435+0000","last_unstale":"2024-05-08T18:31:53.616407+0000","last_undegraded":"2024-05-08T18:31:53.616407+0000","last_fullsized":"2024-05-08T18:31:53.616407+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:21:40.374647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"84'3","reported_seq":144,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.645597+0000","last_change":"2024-05-08T18:29:40.566815+0000","last_active":"2024-05-08T18:31:54.645597+0000","last_peered":"2024-05-08T18:31:54.645597+0000","last_clean":"2024-05-08T18:31:54.645597+0000","last_became_active":"2024-05-08T18:29:40.566531+0000","last_became_peered":"2024-05-08T18:29:40.566531+0000","last_unstale":"2024-05-08T18:31:54.645597+0000","last_undegraded":"2024-05-08T18:31:54.645597+0000","last_fullsized":"2024-05-08T18:31:54.645597+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:52.462279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"84'8","reported_seq":154,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.646538+0000","last_change":"2024-05-08T18:29:42.554846+0000","last_active":"2024-05-08T18:31:55.646538+0000","last_peered":"2024-05-08T18:31:55.646538+0000","last_clean":"2024-05-08T18:31:55.646538+0000","last_became_active":"2024-05-08T18:29:42.554115+0000","last_became_peered":"2024-05-08T18:29:42.554115+0000","last_unstale":"2024-05-08T18:31:55.646538+0000","last_undegraded":"2024-05-08T18:31:55.646538+0000","last_fullsized":"2024-05-08T18:31:55.646538+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:22:14.793035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"83'4","reported_seq":146,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.648919+0000","last_change":"2024-05-08T18:29:40.547776+0000","last_active":"2024-05-08T18:31:54.648919+0000","last_peered":"2024-05-08T18:31:54.648919+0000","last_clean":"2024-05-08T18:31:54.648919+0000","last_became_active":"2024-05-08T18:29:40.547384+0000","last_became_peered":"2024-05-08T18:29:40.547384+0000","last_unstale":"2024-05-08T18:31:54.648919+0000","last_undegraded":"2024-05-08T18:31:54.648919+0000","last_fullsized":"2024-05-08T18:31:54.648919+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:14:26.628603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"84'6","reported_seq":132,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.644707+0000","last_change":"2024-05-08T18:29:50.685390+0000","last_active":"2024-05-08T18:31:55.644707+0000","last_peered":"2024-05-08T18:31:55.644707+0000","last_clean":"2024-05-08T18:31:55.644707+0000","last_became_active":"2024-05-08T18:29:50.684644+0000","last_became_peered":"2024-05-08T18:29:50.684644+0000","last_unstale":"2024-05-08T18:31:55.644707+0000","last_undegraded":"2024-05-08T18:31:55.644707+0000","last_fullsized":"2024-05-08T18:31:55.644707+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:10:38.951662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":636,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"84'10","reported_seq":156,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.646912+0000","last_change":"2024-05-08T18:29:42.573805+0000","last_active":"2024-05-08T18:31:54.646912+0000","last_peered":"2024-05-08T18:31:54.646912+0000","last_clean":"2024-05-08T18:31:54.646912+0000","last_became_active":"2024-05-08T18:29:42.573296+0000","last_became_peered":"2024-05-08T18:29:42.573296+0000","last_unstale":"2024-05-08T18:31:54.646912+0000","last_undegraded":"2024-05-08T18:31:54.646912+0000","last_fullsized":"2024-05-08T18:31:54.646912+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:21.935293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"84'4","reported_seq":143,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.644509+0000","last_change":"2024-05-08T18:29:40.570733+0000","last_active":"2024-05-08T18:31:54.644509+0000","last_peered":"2024-05-08T18:31:54.644509+0000","last_clean":"2024-05-08T18:31:54.644509+0000","last_became_active":"2024-05-08T18:29:40.569711+0000","last_became_peered":"2024-05-08T18:29:40.569711+0000","last_unstale":"2024-05-08T18:31:54.644509+0000","last_undegraded":"2024-05-08T18:31:54.644509+0000","last_fullsized":"2024-05-08T18:31:54.644509+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:18:08.784274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":132,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.468986+0000","last_change":"2024-05-08T18:29:44.594185+0000","last_active":"2024-05-08T18:31:55.468986+0000","last_peered":"2024-05-08T18:31:55.468986+0000","last_clean":"2024-05-08T18:31:55.468986+0000","last_became_active":"2024-05-08T18:29:44.593442+0000","last_became_peered":"2024-05-08T18:29:44.593442+0000","last_unstale":"2024-05-08T18:31:55.468986+0000","last_undegraded":"2024-05-08T18:31:55.468986+0000","last_fullsized":"2024-05-08T18:31:55.468986+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:52:25.736491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"84'14","reported_seq":151,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.649596+0000","last_change":"2024-05-08T18:29:46.594652+0000","last_active":"2024-05-08T18:31:54.649596+0000","last_peered":"2024-05-08T18:31:54.649596+0000","last_clean":"2024-05-08T18:31:54.649596+0000","last_became_active":"2024-05-08T18:29:46.593656+0000","last_became_peered":"2024-05-08T18:29:46.593656+0000","last_unstale":"2024-05-08T18:31:54.649596+0000","last_undegraded":"2024-05-08T18:31:54.649596+0000","last_fullsized":"2024-05-08T18:31:54.649596+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:50:27.608888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":123,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.644737+0000","last_change":"2024-05-08T18:29:48.639834+0000","last_active":"2024-05-08T18:31:54.644737+0000","last_peered":"2024-05-08T18:31:54.644737+0000","last_clean":"2024-05-08T18:31:54.644737+0000","last_became_active":"2024-05-08T18:29:48.639122+0000","last_became_peered":"2024-05-08T18:29:48.639122+0000","last_unstale":"2024-05-08T18:31:54.644737+0000","last_undegraded":"2024-05-08T18:31:54.644737+0000","last_fullsized":"2024-05-08T18:31:54.644737+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:14:22.304773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"83'4","reported_seq":125,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.471063+0000","last_change":"2024-05-08T18:29:50.672303+0000","last_active":"2024-05-08T18:31:55.471063+0000","last_peered":"2024-05-08T18:31:55.471063+0000","last_clean":"2024-05-08T18:31:55.471063+0000","last_became_active":"2024-05-08T18:29:50.671513+0000","last_became_peered":"2024-05-08T18:29:50.671513+0000","last_unstale":"2024-05-08T18:31:55.471063+0000","last_undegraded":"2024-05-08T18:31:55.471063+0000","last_fullsized":"2024-05-08T18:31:55.471063+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:12:05.780786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"84'4","reported_seq":146,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.469910+0000","last_change":"2024-05-08T18:29:42.565462+0000","last_active":"2024-05-08T18:31:55.469910+0000","last_peered":"2024-05-08T18:31:55.469910+0000","last_clean":"2024-05-08T18:31:55.469910+0000","last_became_active":"2024-05-08T18:29:42.564741+0000","last_became_peered":"2024-05-08T18:29:42.564741+0000","last_unstale":"2024-05-08T18:31:55.469910+0000","last_undegraded":"2024-05-08T18:31:55.469910+0000","last_fullsized":"2024-05-08T18:31:55.469910+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:25:56.129785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"82'3","reported_seq":145,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.649950+0000","last_change":"2024-05-08T18:29:40.564796+0000","last_active":"2024-05-08T18:31:54.649950+0000","last_peered":"2024-05-08T18:31:54.649950+0000","last_clean":"2024-05-08T18:31:54.649950+0000","last_became_active":"2024-05-08T18:29:40.564401+0000","last_became_peered":"2024-05-08T18:29:40.564401+0000","last_unstale":"2024-05-08T18:31:54.649950+0000","last_undegraded":"2024-05-08T18:31:54.649950+0000","last_fullsized":"2024-05-08T18:31:54.649950+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:19:11.492397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":133,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.646806+0000","last_change":"2024-05-08T18:29:44.587689+0000","last_active":"2024-05-08T18:31:54.646806+0000","last_peered":"2024-05-08T18:31:54.646806+0000","last_clean":"2024-05-08T18:31:54.646806+0000","last_became_active":"2024-05-08T18:29:44.586975+0000","last_became_peered":"2024-05-08T18:29:44.586975+0000","last_unstale":"2024-05-08T18:31:54.646806+0000","last_undegraded":"2024-05-08T18:31:54.646806+0000","last_fullsized":"2024-05-08T18:31:54.646806+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:04:49.020450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"83'7","reported_seq":142,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.647688+0000","last_change":"2024-05-08T18:29:46.600906+0000","last_active":"2024-05-08T18:31:55.647688+0000","last_peered":"2024-05-08T18:31:55.647688+0000","last_clean":"2024-05-08T18:31:55.647688+0000","last_became_active":"2024-05-08T18:29:46.599894+0000","last_became_peered":"2024-05-08T18:29:46.599894+0000","last_unstale":"2024-05-08T18:31:55.647688+0000","last_undegraded":"2024-05-08T18:31:55.647688+0000","last_fullsized":"2024-05-08T18:31:55.647688+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:24:13.568294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":128,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.646107+0000","last_change":"2024-05-08T18:29:48.614324+0000","last_active":"2024-05-08T18:31:55.646107+0000","last_peered":"2024-05-08T18:31:55.646107+0000","last_clean":"2024-05-08T18:31:55.646107+0000","last_became_active":"2024-05-08T18:29:48.613591+0000","last_became_peered":"2024-05-08T18:29:48.613591+0000","last_unstale":"2024-05-08T18:31:55.646107+0000","last_undegraded":"2024-05-08T18:31:55.646107+0000","last_fullsized":"2024-05-08T18:31:55.646107+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:47:54.034851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":122,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.646596+0000","last_change":"2024-05-08T18:29:50.684773+0000","last_active":"2024-05-08T18:31:54.646596+0000","last_peered":"2024-05-08T18:31:54.646596+0000","last_clean":"2024-05-08T18:31:54.646596+0000","last_became_active":"2024-05-08T18:29:50.683931+0000","last_became_peered":"2024-05-08T18:29:50.683931+0000","last_unstale":"2024-05-08T18:31:54.646596+0000","last_undegraded":"2024-05-08T18:31:54.646596+0000","last_fullsized":"2024-05-08T18:31:54.646596+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:17:10.582636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"80'2","reported_seq":143,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.649868+0000","last_change":"2024-05-08T18:29:42.574437+0000","last_active":"2024-05-08T18:31:54.649868+0000","last_peered":"2024-05-08T18:31:54.649868+0000","last_clean":"2024-05-08T18:31:54.649868+0000","last_became_active":"2024-05-08T18:29:42.574146+0000","last_became_peered":"2024-05-08T18:29:42.574146+0000","last_unstale":"2024-05-08T18:31:54.649868+0000","last_undegraded":"2024-05-08T18:31:54.649868+0000","last_fullsized":"2024-05-08T18:31:54.649868+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:55:30.468069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"83'7","reported_seq":146,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.643906+0000","last_change":"2024-05-08T18:29:40.559677+0000","last_active":"2024-05-08T18:31:54.643906+0000","last_peered":"2024-05-08T18:31:54.643906+0000","last_clean":"2024-05-08T18:31:54.643906+0000","last_became_active":"2024-05-08T18:29:40.558819+0000","last_became_peered":"2024-05-08T18:29:40.558819+0000","last_unstale":"2024-05-08T18:31:54.643906+0000","last_undegraded":"2024-05-08T18:31:54.643906+0000","last_fullsized":"2024-05-08T18:31:54.643906+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:28.426657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":133,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.649690+0000","last_change":"2024-05-08T18:29:44.596801+0000","last_active":"2024-05-08T18:31:54.649690+0000","last_peered":"2024-05-08T18:31:54.649690+0000","last_clean":"2024-05-08T18:31:54.649690+0000","last_became_active":"2024-05-08T18:29:44.596111+0000","last_became_peered":"2024-05-08T18:29:44.596111+0000","last_unstale":"2024-05-08T18:31:54.649690+0000","last_undegraded":"2024-05-08T18:31:54.649690+0000","last_fullsized":"2024-05-08T18:31:54.649690+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:04.423266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"33'10","reported_seq":141,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-08T18:31:53.616117+0000","last_change":"2024-05-08T18:29:46.608330+0000","last_active":"2024-05-08T18:31:53.616117+0000","last_peered":"2024-05-08T18:31:53.616117+0000","last_clean":"2024-05-08T18:31:53.616117+0000","last_became_active":"2024-05-08T18:29:46.607580+0000","last_became_peered":"2024-05-08T18:29:46.607580+0000","last_unstale":"2024-05-08T18:31:53.616117+0000","last_undegraded":"2024-05-08T18:31:53.616117+0000","last_fullsized":"2024-05-08T18:31:53.616117+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:22:18.837103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"84'86","reported_seq":313,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.643816+0000","last_change":"2024-05-08T18:29:48.642718+0000","last_active":"2024-05-08T18:31:54.643816+0000","last_peered":"2024-05-08T18:31:54.643816+0000","last_clean":"2024-05-08T18:31:54.643816+0000","last_became_active":"2024-05-08T18:29:48.641950+0000","last_became_peered":"2024-05-08T18:29:48.641950+0000","last_unstale":"2024-05-08T18:31:54.643816+0000","last_undegraded":"2024-05-08T18:31:54.643816+0000","last_fullsized":"2024-05-08T18:31:54.643816+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:00:11.720096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"84'2","reported_seq":126,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.645092+0000","last_change":"2024-05-08T18:29:50.660378+0000","last_active":"2024-05-08T18:31:55.645092+0000","last_peered":"2024-05-08T18:31:55.645092+0000","last_clean":"2024-05-08T18:31:55.645092+0000","last_became_active":"2024-05-08T18:29:50.659649+0000","last_became_peered":"2024-05-08T18:29:50.659649+0000","last_unstale":"2024-05-08T18:31:55.645092+0000","last_undegraded":"2024-05-08T18:31:55.645092+0000","last_fullsized":"2024-05-08T18:31:55.645092+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:34:14.488295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"80'2","reported_seq":142,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.649161+0000","last_change":"2024-05-08T18:29:42.577267+0000","last_active":"2024-05-08T18:31:54.649161+0000","last_peered":"2024-05-08T18:31:54.649161+0000","last_clean":"2024-05-08T18:31:54.649161+0000","last_became_active":"2024-05-08T18:29:42.576740+0000","last_became_peered":"2024-05-08T18:29:42.576740+0000","last_unstale":"2024-05-08T18:31:54.649161+0000","last_undegraded":"2024-05-08T18:31:54.649161+0000","last_fullsized":"2024-05-08T18:31:54.649161+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:57:14.869860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"82'3","reported_seq":142,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.467473+0000","last_change":"2024-05-08T18:29:40.547524+0000","last_active":"2024-05-08T18:31:55.467473+0000","last_peered":"2024-05-08T18:31:55.467473+0000","last_clean":"2024-05-08T18:31:55.467473+0000","last_became_active":"2024-05-08T18:29:40.545749+0000","last_became_peered":"2024-05-08T18:29:40.545749+0000","last_unstale":"2024-05-08T18:31:55.467473+0000","last_undegraded":"2024-05-08T18:31:55.467473+0000","last_fullsized":"2024-05-08T18:31:55.467473+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:12:59.146887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":132,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.469109+0000","last_change":"2024-05-08T18:29:44.579839+0000","last_active":"2024-05-08T18:31:55.469109+0000","last_peered":"2024-05-08T18:31:55.469109+0000","last_clean":"2024-05-08T18:31:55.469109+0000","last_became_active":"2024-05-08T18:29:44.578142+0000","last_became_peered":"2024-05-08T18:29:44.578142+0000","last_unstale":"2024-05-08T18:31:55.469109+0000","last_undegraded":"2024-05-08T18:31:55.469109+0000","last_fullsized":"2024-05-08T18:31:55.469109+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:51:09.413191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"84'14","reported_seq":148,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.643910+0000","last_change":"2024-05-08T18:29:46.607288+0000","last_active":"2024-05-08T18:31:54.643910+0000","last_peered":"2024-05-08T18:31:54.643910+0000","last_clean":"2024-05-08T18:31:54.643910+0000","last_became_active":"2024-05-08T18:29:46.605154+0000","last_became_peered":"2024-05-08T18:29:46.605154+0000","last_unstale":"2024-05-08T18:31:54.643910+0000","last_undegraded":"2024-05-08T18:31:54.643910+0000","last_fullsized":"2024-05-08T18:31:54.643910+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:23.940519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"84'86","reported_seq":243,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.645866+0000","last_change":"2024-05-08T18:29:48.634956+0000","last_active":"2024-05-08T18:31:54.645866+0000","last_peered":"2024-05-08T18:31:54.645866+0000","last_clean":"2024-05-08T18:31:54.645866+0000","last_became_active":"2024-05-08T18:29:48.633858+0000","last_became_peered":"2024-05-08T18:29:48.633858+0000","last_unstale":"2024-05-08T18:31:54.645866+0000","last_undegraded":"2024-05-08T18:31:54.645866+0000","last_fullsized":"2024-05-08T18:31:54.645866+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:50:48.169666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"84'8","reported_seq":157,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.467545+0000","last_change":"2024-05-08T18:29:42.567744+0000","last_active":"2024-05-08T18:31:55.467545+0000","last_peered":"2024-05-08T18:31:55.467545+0000","last_clean":"2024-05-08T18:31:55.467545+0000","last_became_active":"2024-05-08T18:29:42.566974+0000","last_became_peered":"2024-05-08T18:29:42.566974+0000","last_unstale":"2024-05-08T18:31:55.467545+0000","last_undegraded":"2024-05-08T18:31:55.467545+0000","last_fullsized":"2024-05-08T18:31:55.467545+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:42.045615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"82'7","reported_seq":147,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.645378+0000","last_change":"2024-05-08T18:29:40.572499+0000","last_active":"2024-05-08T18:31:54.645378+0000","last_peered":"2024-05-08T18:31:54.645378+0000","last_clean":"2024-05-08T18:31:54.645378+0000","last_became_active":"2024-05-08T18:29:40.571322+0000","last_became_peered":"2024-05-08T18:29:40.571322+0000","last_unstale":"2024-05-08T18:31:54.645378+0000","last_undegraded":"2024-05-08T18:31:54.645378+0000","last_fullsized":"2024-05-08T18:31:54.645378+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:31.119374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":132,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.643045+0000","last_change":"2024-05-08T18:29:44.597045+0000","last_active":"2024-05-08T18:31:54.643045+0000","last_peered":"2024-05-08T18:31:54.643045+0000","last_clean":"2024-05-08T18:31:54.643045+0000","last_became_active":"2024-05-08T18:29:44.596282+0000","last_became_peered":"2024-05-08T18:29:44.596282+0000","last_unstale":"2024-05-08T18:31:54.643045+0000","last_undegraded":"2024-05-08T18:31:54.643045+0000","last_fullsized":"2024-05-08T18:31:54.643045+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:35:51.288126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"84'25","reported_seq":166,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.467937+0000","last_change":"2024-05-08T18:29:46.590633+0000","last_active":"2024-05-08T18:31:55.467937+0000","last_peered":"2024-05-08T18:31:55.467937+0000","last_clean":"2024-05-08T18:31:55.467937+0000","last_became_active":"2024-05-08T18:29:46.589600+0000","last_became_peered":"2024-05-08T18:29:46.589600+0000","last_unstale":"2024-05-08T18:31:55.467937+0000","last_undegraded":"2024-05-08T18:31:55.467937+0000","last_fullsized":"2024-05-08T18:31:55.467937+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:23.940519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":126,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.956913+0000","last_change":"2024-05-08T18:29:48.630758+0000","last_active":"2024-05-08T18:31:54.956913+0000","last_peered":"2024-05-08T18:31:54.956913+0000","last_clean":"2024-05-08T18:31:54.956913+0000","last_became_active":"2024-05-08T18:29:48.630017+0000","last_became_peered":"2024-05-08T18:29:48.630017+0000","last_unstale":"2024-05-08T18:31:54.956913+0000","last_undegraded":"2024-05-08T18:31:54.956913+0000","last_fullsized":"2024-05-08T18:31:54.956913+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:39.879384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"80'12","reported_seq":141,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.468401+0000","last_change":"2024-05-08T18:29:50.672682+0000","last_active":"2024-05-08T18:31:55.468401+0000","last_peered":"2024-05-08T18:31:55.468401+0000","last_clean":"2024-05-08T18:31:55.468401+0000","last_became_active":"2024-05-08T18:29:50.671923+0000","last_became_peered":"2024-05-08T18:29:50.671923+0000","last_unstale":"2024-05-08T18:31:55.468401+0000","last_undegraded":"2024-05-08T18:31:55.468401+0000","last_fullsized":"2024-05-08T18:31:55.468401+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:38.318890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":34,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"80'2","reported_seq":146,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.645583+0000","last_change":"2024-05-08T18:29:42.554289+0000","last_active":"2024-05-08T18:31:55.645583+0000","last_peered":"2024-05-08T18:31:55.645583+0000","last_clean":"2024-05-08T18:31:55.645583+0000","last_became_active":"2024-05-08T18:29:42.553574+0000","last_became_peered":"2024-05-08T18:29:42.553574+0000","last_unstale":"2024-05-08T18:31:55.645583+0000","last_undegraded":"2024-05-08T18:31:55.645583+0000","last_fullsized":"2024-05-08T18:31:55.645583+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:42.005809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"84'3","reported_seq":143,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.645433+0000","last_change":"2024-05-08T18:29:40.570169+0000","last_active":"2024-05-08T18:31:54.645433+0000","last_peered":"2024-05-08T18:31:54.645433+0000","last_clean":"2024-05-08T18:31:54.645433+0000","last_became_active":"2024-05-08T18:29:40.569542+0000","last_became_peered":"2024-05-08T18:29:40.569542+0000","last_unstale":"2024-05-08T18:31:54.645433+0000","last_undegraded":"2024-05-08T18:31:54.645433+0000","last_fullsized":"2024-05-08T18:31:54.645433+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:08:13.006752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"26'1","reported_seq":189,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-08T18:31:53.615108+0000","last_change":"2024-05-08T18:29:44.579659+0000","last_active":"2024-05-08T18:31:53.615108+0000","last_peered":"2024-05-08T18:31:53.615108+0000","last_clean":"2024-05-08T18:31:53.615108+0000","last_became_active":"2024-05-08T18:29:44.579152+0000","last_became_peered":"2024-05-08T18:29:44.579152+0000","last_unstale":"2024-05-08T18:31:53.615108+0000","last_undegraded":"2024-05-08T18:31:53.615108+0000","last_fullsized":"2024-05-08T18:31:53.615108+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:15:00.358583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":85,"num_read_kb":85,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"84'14","reported_seq":150,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.646160+0000","last_change":"2024-05-08T18:29:46.600224+0000","last_active":"2024-05-08T18:31:54.646160+0000","last_peered":"2024-05-08T18:31:54.646160+0000","last_clean":"2024-05-08T18:31:54.646160+0000","last_became_active":"2024-05-08T18:29:46.599464+0000","last_became_peered":"2024-05-08T18:29:46.599464+0000","last_unstale":"2024-05-08T18:31:54.646160+0000","last_undegraded":"2024-05-08T18:31:54.646160+0000","last_fullsized":"2024-05-08T18:31:54.646160+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:26:40.238188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":125,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.644838+0000","last_change":"2024-05-08T18:29:48.637939+0000","last_active":"2024-05-08T18:31:54.644838+0000","last_peered":"2024-05-08T18:31:54.644838+0000","last_clean":"2024-05-08T18:31:54.644838+0000","last_became_active":"2024-05-08T18:29:48.637231+0000","last_became_peered":"2024-05-08T18:29:48.637231+0000","last_unstale":"2024-05-08T18:31:54.644838+0000","last_undegraded":"2024-05-08T18:31:54.644838+0000","last_fullsized":"2024-05-08T18:31:54.644838+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:04.571608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":120,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.470219+0000","last_change":"2024-05-08T18:29:50.681831+0000","last_active":"2024-05-08T18:31:55.470219+0000","last_peered":"2024-05-08T18:31:55.470219+0000","last_clean":"2024-05-08T18:31:55.470219+0000","last_became_active":"2024-05-08T18:29:50.681287+0000","last_became_peered":"2024-05-08T18:29:50.681287+0000","last_unstale":"2024-05-08T18:31:55.470219+0000","last_undegraded":"2024-05-08T18:31:55.470219+0000","last_fullsized":"2024-05-08T18:31:55.470219+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:30:24.111488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":136,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.468167+0000","last_change":"2024-05-08T18:29:42.562975+0000","last_active":"2024-05-08T18:31:55.468167+0000","last_peered":"2024-05-08T18:31:55.468167+0000","last_clean":"2024-05-08T18:31:55.468167+0000","last_became_active":"2024-05-08T18:29:42.562267+0000","last_became_peered":"2024-05-08T18:29:42.562267+0000","last_unstale":"2024-05-08T18:31:55.468167+0000","last_undegraded":"2024-05-08T18:31:55.468167+0000","last_fullsized":"2024-05-08T18:31:55.468167+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:30.446371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"84'5","reported_seq":145,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.644865+0000","last_change":"2024-05-08T18:29:40.570736+0000","last_active":"2024-05-08T18:31:54.644865+0000","last_peered":"2024-05-08T18:31:54.644865+0000","last_clean":"2024-05-08T18:31:54.644865+0000","last_became_active":"2024-05-08T18:29:40.569626+0000","last_became_peered":"2024-05-08T18:29:40.569626+0000","last_unstale":"2024-05-08T18:31:54.644865+0000","last_undegraded":"2024-05-08T18:31:54.644865+0000","last_fullsized":"2024-05-08T18:31:54.644865+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:56.300986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"26'1","reported_seq":188,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-08T18:31:53.617044+0000","last_change":"2024-05-08T18:29:44.581748+0000","last_active":"2024-05-08T18:31:53.617044+0000","last_peered":"2024-05-08T18:31:53.617044+0000","last_clean":"2024-05-08T18:31:53.617044+0000","last_became_active":"2024-05-08T18:29:44.581067+0000","last_became_peered":"2024-05-08T18:29:44.581067+0000","last_unstale":"2024-05-08T18:31:53.617044+0000","last_undegraded":"2024-05-08T18:31:53.617044+0000","last_fullsized":"2024-05-08T18:31:53.617044+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:44.043691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":85,"num_read_kb":85,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"84'20","reported_seq":158,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.643446+0000","last_change":"2024-05-08T18:29:46.605887+0000","last_active":"2024-05-08T18:31:54.643446+0000","last_peered":"2024-05-08T18:31:54.643446+0000","last_clean":"2024-05-08T18:31:54.643446+0000","last_became_active":"2024-05-08T18:29:46.604966+0000","last_became_peered":"2024-05-08T18:29:46.604966+0000","last_unstale":"2024-05-08T18:31:54.643446+0000","last_undegraded":"2024-05-08T18:31:54.643446+0000","last_fullsized":"2024-05-08T18:31:54.643446+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:07:54.654205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"84'86","reported_seq":244,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.643525+0000","last_change":"2024-05-08T18:29:48.638657+0000","last_active":"2024-05-08T18:31:54.643525+0000","last_peered":"2024-05-08T18:31:54.643525+0000","last_clean":"2024-05-08T18:31:54.643525+0000","last_became_active":"2024-05-08T18:29:48.637758+0000","last_became_peered":"2024-05-08T18:29:48.637758+0000","last_unstale":"2024-05-08T18:31:54.643525+0000","last_undegraded":"2024-05-08T18:31:54.643525+0000","last_fullsized":"2024-05-08T18:31:54.643525+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:45:24.153991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"84'1","reported_seq":123,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.649254+0000","last_change":"2024-05-08T18:29:50.684501+0000","last_active":"2024-05-08T18:31:54.649254+0000","last_peered":"2024-05-08T18:31:54.649254+0000","last_clean":"2024-05-08T18:31:54.649254+0000","last_became_active":"2024-05-08T18:29:50.683738+0000","last_became_peered":"2024-05-08T18:29:50.683738+0000","last_unstale":"2024-05-08T18:31:54.649254+0000","last_undegraded":"2024-05-08T18:31:54.649254+0000","last_fullsized":"2024-05-08T18:31:54.649254+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:22.834262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"84'4","reported_seq":148,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.649655+0000","last_change":"2024-05-08T18:29:42.569401+0000","last_active":"2024-05-08T18:31:54.649655+0000","last_peered":"2024-05-08T18:31:54.649655+0000","last_clean":"2024-05-08T18:31:54.649655+0000","last_became_active":"2024-05-08T18:29:42.568659+0000","last_became_peered":"2024-05-08T18:29:42.568659+0000","last_unstale":"2024-05-08T18:31:54.649655+0000","last_undegraded":"2024-05-08T18:31:54.649655+0000","last_fullsized":"2024-05-08T18:31:54.649655+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:35:23.016110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"82'5","reported_seq":147,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.469917+0000","last_change":"2024-05-08T18:29:40.557076+0000","last_active":"2024-05-08T18:31:55.469917+0000","last_peered":"2024-05-08T18:31:55.469917+0000","last_clean":"2024-05-08T18:31:55.469917+0000","last_became_active":"2024-05-08T18:29:40.555805+0000","last_became_peered":"2024-05-08T18:29:40.555805+0000","last_unstale":"2024-05-08T18:31:55.469917+0000","last_undegraded":"2024-05-08T18:31:55.469917+0000","last_fullsized":"2024-05-08T18:31:55.469917+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:13.946346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":15,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":131,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-08T18:31:53.616546+0000","last_change":"2024-05-08T18:29:44.573892+0000","last_active":"2024-05-08T18:31:53.616546+0000","last_peered":"2024-05-08T18:31:53.616546+0000","last_clean":"2024-05-08T18:31:53.616546+0000","last_became_active":"2024-05-08T18:29:44.573308+0000","last_became_peered":"2024-05-08T18:29:44.573308+0000","last_unstale":"2024-05-08T18:31:53.616546+0000","last_undegraded":"2024-05-08T18:31:53.616546+0000","last_fullsized":"2024-05-08T18:31:53.616546+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:37.075348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"84'22","reported_seq":163,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.643796+0000","last_change":"2024-05-08T18:29:46.595585+0000","last_active":"2024-05-08T18:31:54.643796+0000","last_peered":"2024-05-08T18:31:54.643796+0000","last_clean":"2024-05-08T18:31:54.643796+0000","last_became_active":"2024-05-08T18:29:46.594930+0000","last_became_peered":"2024-05-08T18:29:46.594930+0000","last_unstale":"2024-05-08T18:31:54.643796+0000","last_undegraded":"2024-05-08T18:31:54.643796+0000","last_fullsized":"2024-05-08T18:31:54.643796+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:11.768269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":122,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-08T18:31:53.614428+0000","last_change":"2024-05-08T18:29:48.638137+0000","last_active":"2024-05-08T18:31:53.614428+0000","last_peered":"2024-05-08T18:31:53.614428+0000","last_clean":"2024-05-08T18:31:53.614428+0000","last_became_active":"2024-05-08T18:29:48.637370+0000","last_became_peered":"2024-05-08T18:29:48.637370+0000","last_unstale":"2024-05-08T18:31:53.614428+0000","last_undegraded":"2024-05-08T18:31:53.614428+0000","last_fullsized":"2024-05-08T18:31:53.614428+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:15.859849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"83'2","reported_seq":125,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.956941+0000","last_change":"2024-05-08T18:29:50.688760+0000","last_active":"2024-05-08T18:31:54.956941+0000","last_peered":"2024-05-08T18:31:54.956941+0000","last_clean":"2024-05-08T18:31:54.956941+0000","last_became_active":"2024-05-08T18:29:50.687960+0000","last_became_peered":"2024-05-08T18:29:50.687960+0000","last_unstale":"2024-05-08T18:31:54.956941+0000","last_undegraded":"2024-05-08T18:31:54.956941+0000","last_fullsized":"2024-05-08T18:31:54.956941+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:21:19.624895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"80'2","reported_seq":145,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.646554+0000","last_change":"2024-05-08T18:29:42.557850+0000","last_active":"2024-05-08T18:31:55.646554+0000","last_peered":"2024-05-08T18:31:55.646554+0000","last_clean":"2024-05-08T18:31:55.646554+0000","last_became_active":"2024-05-08T18:29:42.557119+0000","last_became_peered":"2024-05-08T18:29:42.557119+0000","last_unstale":"2024-05-08T18:31:55.646554+0000","last_undegraded":"2024-05-08T18:31:55.646554+0000","last_fullsized":"2024-05-08T18:31:55.646554+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:25:56.129785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"84'4","reported_seq":146,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.645139+0000","last_change":"2024-05-08T18:29:40.544530+0000","last_active":"2024-05-08T18:31:54.645139+0000","last_peered":"2024-05-08T18:31:54.645139+0000","last_clean":"2024-05-08T18:31:54.645139+0000","last_became_active":"2024-05-08T18:29:40.544215+0000","last_became_peered":"2024-05-08T18:29:40.544215+0000","last_unstale":"2024-05-08T18:31:54.645139+0000","last_undegraded":"2024-05-08T18:31:54.645139+0000","last_fullsized":"2024-05-08T18:31:54.645139+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:14:26.628603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":130,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-08T18:31:53.616942+0000","last_change":"2024-05-08T18:29:44.588227+0000","last_active":"2024-05-08T18:31:53.616942+0000","last_peered":"2024-05-08T18:31:53.616942+0000","last_clean":"2024-05-08T18:31:53.616942+0000","last_became_active":"2024-05-08T18:29:44.587822+0000","last_became_peered":"2024-05-08T18:29:44.587822+0000","last_unstale":"2024-05-08T18:31:53.616942+0000","last_undegraded":"2024-05-08T18:31:53.616942+0000","last_fullsized":"2024-05-08T18:31:53.616942+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:18:12.841872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"85'17","reported_seq":157,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.646630+0000","last_change":"2024-05-08T18:29:46.603563+0000","last_active":"2024-05-08T18:31:55.646630+0000","last_peered":"2024-05-08T18:31:55.646630+0000","last_clean":"2024-05-08T18:31:55.646630+0000","last_became_active":"2024-05-08T18:29:46.602801+0000","last_became_peered":"2024-05-08T18:29:46.602801+0000","last_unstale":"2024-05-08T18:31:55.646630+0000","last_undegraded":"2024-05-08T18:31:55.646630+0000","last_fullsized":"2024-05-08T18:31:55.646630+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:22:36.338527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":126,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.649567+0000","last_change":"2024-05-08T18:29:48.642806+0000","last_active":"2024-05-08T18:31:54.649567+0000","last_peered":"2024-05-08T18:31:54.649567+0000","last_clean":"2024-05-08T18:31:54.649567+0000","last_became_active":"2024-05-08T18:29:48.641813+0000","last_became_peered":"2024-05-08T18:29:48.641813+0000","last_unstale":"2024-05-08T18:31:54.649567+0000","last_undegraded":"2024-05-08T18:31:54.649567+0000","last_fullsized":"2024-05-08T18:31:54.649567+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:50:48.169666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"80'2","reported_seq":124,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.644840+0000","last_change":"2024-05-08T18:29:50.689819+0000","last_active":"2024-05-08T18:31:54.644840+0000","last_peered":"2024-05-08T18:31:54.644840+0000","last_clean":"2024-05-08T18:31:54.644840+0000","last_became_active":"2024-05-08T18:29:50.686739+0000","last_became_peered":"2024-05-08T18:29:50.686739+0000","last_unstale":"2024-05-08T18:31:54.644840+0000","last_undegraded":"2024-05-08T18:31:54.644840+0000","last_fullsized":"2024-05-08T18:31:54.644840+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:45:34.171402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":140,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.646692+0000","last_change":"2024-05-08T18:29:42.552388+0000","last_active":"2024-05-08T18:31:55.646692+0000","last_peered":"2024-05-08T18:31:55.646692+0000","last_clean":"2024-05-08T18:31:55.646692+0000","last_became_active":"2024-05-08T18:29:42.551647+0000","last_became_peered":"2024-05-08T18:29:42.551647+0000","last_unstale":"2024-05-08T18:31:55.646692+0000","last_undegraded":"2024-05-08T18:31:55.646692+0000","last_fullsized":"2024-05-08T18:31:55.646692+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:55.055481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"84'5","reported_seq":145,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.468471+0000","last_change":"2024-05-08T18:29:40.562946+0000","last_active":"2024-05-08T18:31:55.468471+0000","last_peered":"2024-05-08T18:31:55.468471+0000","last_clean":"2024-05-08T18:31:55.468471+0000","last_became_active":"2024-05-08T18:29:40.550942+0000","last_became_peered":"2024-05-08T18:29:40.550942+0000","last_unstale":"2024-05-08T18:31:55.468471+0000","last_undegraded":"2024-05-08T18:31:55.468471+0000","last_fullsized":"2024-05-08T18:31:55.468471+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:22.579629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":134,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.957872+0000","last_change":"2024-05-08T18:29:44.593681+0000","last_active":"2024-05-08T18:31:54.957872+0000","last_peered":"2024-05-08T18:31:54.957872+0000","last_clean":"2024-05-08T18:31:54.957872+0000","last_became_active":"2024-05-08T18:29:44.593242+0000","last_became_peered":"2024-05-08T18:29:44.593242+0000","last_unstale":"2024-05-08T18:31:54.957872+0000","last_undegraded":"2024-05-08T18:31:54.957872+0000","last_fullsized":"2024-05-08T18:31:54.957872+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:57.093364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"85'21","reported_seq":157,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-08T18:31:53.616901+0000","last_change":"2024-05-08T18:29:46.589514+0000","last_active":"2024-05-08T18:31:53.616901+0000","last_peered":"2024-05-08T18:31:53.616901+0000","last_clean":"2024-05-08T18:31:53.616901+0000","last_became_active":"2024-05-08T18:29:46.588784+0000","last_became_peered":"2024-05-08T18:29:46.588784+0000","last_unstale":"2024-05-08T18:31:53.616901+0000","last_undegraded":"2024-05-08T18:31:53.616901+0000","last_fullsized":"2024-05-08T18:31:53.616901+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:02:30.355168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":20,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"84'86","reported_seq":249,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-08T18:31:53.616813+0000","last_change":"2024-05-08T18:29:48.631007+0000","last_active":"2024-05-08T18:31:53.616813+0000","last_peered":"2024-05-08T18:31:53.616813+0000","last_clean":"2024-05-08T18:31:53.616813+0000","last_became_active":"2024-05-08T18:29:48.630229+0000","last_became_peered":"2024-05-08T18:29:48.630229+0000","last_unstale":"2024-05-08T18:31:53.616813+0000","last_undegraded":"2024-05-08T18:31:53.616813+0000","last_fullsized":"2024-05-08T18:31:53.616813+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:44:03.778419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":123,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.957127+0000","last_change":"2024-05-08T18:29:50.675105+0000","last_active":"2024-05-08T18:31:54.957127+0000","last_peered":"2024-05-08T18:31:54.957127+0000","last_clean":"2024-05-08T18:31:54.957127+0000","last_became_active":"2024-05-08T18:29:50.674292+0000","last_became_peered":"2024-05-08T18:29:50.674292+0000","last_unstale":"2024-05-08T18:31:54.957127+0000","last_undegraded":"2024-05-08T18:31:54.957127+0000","last_fullsized":"2024-05-08T18:31:54.957127+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:47:15.423647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"84'4","reported_seq":150,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.647400+0000","last_change":"2024-05-08T18:29:42.579707+0000","last_active":"2024-05-08T18:31:55.647400+0000","last_peered":"2024-05-08T18:31:55.647400+0000","last_clean":"2024-05-08T18:31:55.647400+0000","last_became_active":"2024-05-08T18:29:42.579059+0000","last_became_peered":"2024-05-08T18:29:42.579059+0000","last_unstale":"2024-05-08T18:31:55.647400+0000","last_undegraded":"2024-05-08T18:31:55.647400+0000","last_fullsized":"2024-05-08T18:31:55.647400+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:09.787597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"84'7","reported_seq":153,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.647323+0000","last_change":"2024-05-08T18:29:40.555327+0000","last_active":"2024-05-08T18:31:55.647323+0000","last_peered":"2024-05-08T18:31:55.647323+0000","last_clean":"2024-05-08T18:31:55.647323+0000","last_became_active":"2024-05-08T18:29:40.554594+0000","last_became_peered":"2024-05-08T18:29:40.554594+0000","last_unstale":"2024-05-08T18:31:55.647323+0000","last_undegraded":"2024-05-08T18:31:55.647323+0000","last_fullsized":"2024-05-08T18:31:55.647323+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:19.841114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3,"num_read_kb":4,"num_write":17,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"26'2","reported_seq":248,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.472433+0000","last_change":"2024-05-08T18:29:44.582434+0000","last_active":"2024-05-08T18:31:55.472433+0000","last_peered":"2024-05-08T18:31:55.472433+0000","last_clean":"2024-05-08T18:31:55.472433+0000","last_became_active":"2024-05-08T18:29:44.581699+0000","last_became_peered":"2024-05-08T18:29:44.581699+0000","last_unstale":"2024-05-08T18:31:55.472433+0000","last_undegraded":"2024-05-08T18:31:55.472433+0000","last_fullsized":"2024-05-08T18:31:55.472433+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:19:29.113643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":114,"num_read_kb":114,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"33'10","reported_seq":144,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.645983+0000","last_change":"2024-05-08T18:29:46.590860+0000","last_active":"2024-05-08T18:31:54.645983+0000","last_peered":"2024-05-08T18:31:54.645983+0000","last_clean":"2024-05-08T18:31:54.645983+0000","last_became_active":"2024-05-08T18:29:46.590087+0000","last_became_peered":"2024-05-08T18:29:46.590087+0000","last_unstale":"2024-05-08T18:31:54.645983+0000","last_undegraded":"2024-05-08T18:31:54.645983+0000","last_fullsized":"2024-05-08T18:31:54.645983+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:19:58.358449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"84'86","reported_seq":272,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.470466+0000","last_change":"2024-05-08T18:29:48.635548+0000","last_active":"2024-05-08T18:31:55.470466+0000","last_peered":"2024-05-08T18:31:55.470466+0000","last_clean":"2024-05-08T18:31:55.470466+0000","last_became_active":"2024-05-08T18:29:48.634801+0000","last_became_peered":"2024-05-08T18:29:48.634801+0000","last_unstale":"2024-05-08T18:31:55.470466+0000","last_undegraded":"2024-05-08T18:31:55.470466+0000","last_fullsized":"2024-05-08T18:31:55.470466+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:04:20.128031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":125,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.646045+0000","last_change":"2024-05-08T18:29:50.668279+0000","last_active":"2024-05-08T18:31:55.646045+0000","last_peered":"2024-05-08T18:31:55.646045+0000","last_clean":"2024-05-08T18:31:55.646045+0000","last_became_active":"2024-05-08T18:29:50.667536+0000","last_became_peered":"2024-05-08T18:29:50.667536+0000","last_unstale":"2024-05-08T18:31:55.646045+0000","last_undegraded":"2024-05-08T18:31:55.646045+0000","last_fullsized":"2024-05-08T18:31:55.646045+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:12:05.780786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"84'12","reported_seq":162,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.958681+0000","last_change":"2024-05-08T18:29:42.563807+0000","last_active":"2024-05-08T18:31:54.958681+0000","last_peered":"2024-05-08T18:31:54.958681+0000","last_clean":"2024-05-08T18:31:54.958681+0000","last_became_active":"2024-05-08T18:29:42.563416+0000","last_became_peered":"2024-05-08T18:29:42.563416+0000","last_unstale":"2024-05-08T18:31:54.958681+0000","last_undegraded":"2024-05-08T18:31:54.958681+0000","last_fullsized":"2024-05-08T18:31:54.958681+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:18:10.803989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"84'10","reported_seq":152,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.646259+0000","last_change":"2024-05-08T18:29:40.548898+0000","last_active":"2024-05-08T18:31:54.646259+0000","last_peered":"2024-05-08T18:31:54.646259+0000","last_clean":"2024-05-08T18:31:54.646259+0000","last_became_active":"2024-05-08T18:29:40.548591+0000","last_became_peered":"2024-05-08T18:29:40.548591+0000","last_unstale":"2024-05-08T18:31:54.646259+0000","last_undegraded":"2024-05-08T18:31:54.646259+0000","last_fullsized":"2024-05-08T18:31:54.646259+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:27:41.414153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":136,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.647155+0000","last_change":"2024-05-08T18:29:44.582578+0000","last_active":"2024-05-08T18:31:55.647155+0000","last_peered":"2024-05-08T18:31:55.647155+0000","last_clean":"2024-05-08T18:31:55.647155+0000","last_became_active":"2024-05-08T18:29:44.581832+0000","last_became_peered":"2024-05-08T18:29:44.581832+0000","last_unstale":"2024-05-08T18:31:55.647155+0000","last_undegraded":"2024-05-08T18:31:55.647155+0000","last_fullsized":"2024-05-08T18:31:55.647155+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:52:25.736491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"84'22","reported_seq":161,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.468737+0000","last_change":"2024-05-08T18:29:46.602459+0000","last_active":"2024-05-08T18:31:55.468737+0000","last_peered":"2024-05-08T18:31:55.468737+0000","last_clean":"2024-05-08T18:31:55.468737+0000","last_became_active":"2024-05-08T18:29:46.601740+0000","last_became_peered":"2024-05-08T18:29:46.601740+0000","last_unstale":"2024-05-08T18:31:55.468737+0000","last_undegraded":"2024-05-08T18:31:55.468737+0000","last_fullsized":"2024-05-08T18:31:55.468737+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:58:31.293922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":123,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.468807+0000","last_change":"2024-05-08T18:29:48.640046+0000","last_active":"2024-05-08T18:31:55.468807+0000","last_peered":"2024-05-08T18:31:55.468807+0000","last_clean":"2024-05-08T18:31:55.468807+0000","last_became_active":"2024-05-08T18:29:48.639309+0000","last_became_peered":"2024-05-08T18:29:48.639309+0000","last_unstale":"2024-05-08T18:31:55.468807+0000","last_undegraded":"2024-05-08T18:31:55.468807+0000","last_fullsized":"2024-05-08T18:31:55.468807+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:10.533065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":123,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.956857+0000","last_change":"2024-05-08T18:29:50.668361+0000","last_active":"2024-05-08T18:31:54.956857+0000","last_peered":"2024-05-08T18:31:54.956857+0000","last_clean":"2024-05-08T18:31:54.956857+0000","last_became_active":"2024-05-08T18:29:50.667636+0000","last_became_peered":"2024-05-08T18:29:50.667636+0000","last_unstale":"2024-05-08T18:31:54.956857+0000","last_undegraded":"2024-05-08T18:31:54.956857+0000","last_fullsized":"2024-05-08T18:31:54.956857+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:58:35.356885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"84'2","reported_seq":141,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.470752+0000","last_change":"2024-05-08T18:29:42.584098+0000","last_active":"2024-05-08T18:31:55.470752+0000","last_peered":"2024-05-08T18:31:55.470752+0000","last_clean":"2024-05-08T18:31:55.470752+0000","last_became_active":"2024-05-08T18:29:42.583639+0000","last_became_peered":"2024-05-08T18:29:42.583639+0000","last_unstale":"2024-05-08T18:31:55.470752+0000","last_undegraded":"2024-05-08T18:31:55.470752+0000","last_fullsized":"2024-05-08T18:31:55.470752+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:08:15.026467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":242,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.643538+0000","last_change":"2024-05-08T18:29:27.115522+0000","last_active":"2024-05-08T18:31:54.643538+0000","last_peered":"2024-05-08T18:31:54.643538+0000","last_clean":"2024-05-08T18:31:54.643538+0000","last_became_active":"2024-05-08T18:29:27.112960+0000","last_became_peered":"2024-05-08T18:29:27.112960+0000","last_unstale":"2024-05-08T18:31:54.643538+0000","last_undegraded":"2024-05-08T18:31:54.643538+0000","last_fullsized":"2024-05-08T18:31:54.643538+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:26.091102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:26.091102+0000","last_clean_scrub_stamp":"2024-05-08T18:29:26.091102+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:09:50.296961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":147,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.468532+0000","last_change":"2024-05-08T18:29:34.496467+0000","last_active":"2024-05-08T18:31:55.468532+0000","last_peered":"2024-05-08T18:31:55.468532+0000","last_clean":"2024-05-08T18:31:55.468532+0000","last_became_active":"2024-05-08T18:29:34.495632+0000","last_became_peered":"2024-05-08T18:29:34.495632+0000","last_unstale":"2024-05-08T18:31:55.468532+0000","last_undegraded":"2024-05-08T18:31:55.468532+0000","last_fullsized":"2024-05-08T18:31:55.468532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:35.917391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"82'4","reported_seq":151,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.645356+0000","last_change":"2024-05-08T18:30:20.849562+0000","last_active":"2024-05-08T18:31:54.645356+0000","last_peered":"2024-05-08T18:31:54.645356+0000","last_clean":"2024-05-08T18:31:54.645356+0000","last_became_active":"2024-05-08T18:30:20.849160+0000","last_became_peered":"2024-05-08T18:30:20.849160+0000","last_unstale":"2024-05-08T18:31:54.645356+0000","last_undegraded":"2024-05-08T18:31:54.645356+0000","last_fullsized":"2024-05-08T18:31:54.645356+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:29:13.478886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":132,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.644019+0000","last_change":"2024-05-08T18:29:44.592445+0000","last_active":"2024-05-08T18:31:54.644019+0000","last_peered":"2024-05-08T18:31:54.644019+0000","last_clean":"2024-05-08T18:31:54.644019+0000","last_became_active":"2024-05-08T18:29:44.587855+0000","last_became_peered":"2024-05-08T18:29:44.587855+0000","last_unstale":"2024-05-08T18:31:54.644019+0000","last_undegraded":"2024-05-08T18:31:54.644019+0000","last_fullsized":"2024-05-08T18:31:54.644019+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:06:05.355648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"84'30","reported_seq":173,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.472724+0000","last_change":"2024-05-08T18:29:46.595394+0000","last_active":"2024-05-08T18:31:55.472724+0000","last_peered":"2024-05-08T18:31:55.472724+0000","last_clean":"2024-05-08T18:31:55.472724+0000","last_became_active":"2024-05-08T18:29:46.594573+0000","last_became_peered":"2024-05-08T18:29:46.594573+0000","last_unstale":"2024-05-08T18:31:55.472724+0000","last_undegraded":"2024-05-08T18:31:55.472724+0000","last_fullsized":"2024-05-08T18:31:55.472724+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:47:11.360684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71557,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":23,"num_write":20,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":126,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.649360+0000","last_change":"2024-05-08T18:29:48.632178+0000","last_active":"2024-05-08T18:31:54.649360+0000","last_peered":"2024-05-08T18:31:54.649360+0000","last_clean":"2024-05-08T18:31:54.649360+0000","last_became_active":"2024-05-08T18:29:48.631481+0000","last_became_peered":"2024-05-08T18:29:48.631481+0000","last_unstale":"2024-05-08T18:31:54.649360+0000","last_undegraded":"2024-05-08T18:31:54.649360+0000","last_fullsized":"2024-05-08T18:31:54.649360+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:34.806539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"80'2","reported_seq":121,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.466878+0000","last_change":"2024-05-08T18:29:50.675319+0000","last_active":"2024-05-08T18:31:55.466878+0000","last_peered":"2024-05-08T18:31:55.466878+0000","last_clean":"2024-05-08T18:31:55.466878+0000","last_became_active":"2024-05-08T18:29:50.674526+0000","last_became_peered":"2024-05-08T18:29:50.674526+0000","last_unstale":"2024-05-08T18:31:55.466878+0000","last_undegraded":"2024-05-08T18:31:55.466878+0000","last_fullsized":"2024-05-08T18:31:55.466878+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:59:06.404586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"84'4","reported_seq":149,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.649743+0000","last_change":"2024-05-08T18:29:42.568584+0000","last_active":"2024-05-08T18:31:54.649743+0000","last_peered":"2024-05-08T18:31:54.649743+0000","last_clean":"2024-05-08T18:31:54.649743+0000","last_became_active":"2024-05-08T18:29:42.568244+0000","last_became_peered":"2024-05-08T18:29:42.568244+0000","last_unstale":"2024-05-08T18:31:54.649743+0000","last_undegraded":"2024-05-08T18:31:54.649743+0000","last_fullsized":"2024-05-08T18:31:54.649743+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:20.397730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":146,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.643218+0000","last_change":"2024-05-08T18:29:34.497654+0000","last_active":"2024-05-08T18:31:54.643218+0000","last_peered":"2024-05-08T18:31:54.643218+0000","last_clean":"2024-05-08T18:31:54.643218+0000","last_became_active":"2024-05-08T18:29:34.495812+0000","last_became_peered":"2024-05-08T18:29:34.495812+0000","last_unstale":"2024-05-08T18:31:54.643218+0000","last_undegraded":"2024-05-08T18:31:54.643218+0000","last_fullsized":"2024-05-08T18:31:54.643218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:37:02.202613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"83'5","reported_seq":148,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.643930+0000","last_change":"2024-05-08T18:29:40.560653+0000","last_active":"2024-05-08T18:31:54.643930+0000","last_peered":"2024-05-08T18:31:54.643930+0000","last_clean":"2024-05-08T18:31:54.643930+0000","last_became_active":"2024-05-08T18:29:40.560296+0000","last_became_peered":"2024-05-08T18:29:40.560296+0000","last_unstale":"2024-05-08T18:31:54.643930+0000","last_undegraded":"2024-05-08T18:31:54.643930+0000","last_fullsized":"2024-05-08T18:31:54.643930+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:52.462279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":133,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.472980+0000","last_change":"2024-05-08T18:29:44.594681+0000","last_active":"2024-05-08T18:31:55.472980+0000","last_peered":"2024-05-08T18:31:55.472980+0000","last_clean":"2024-05-08T18:31:55.472980+0000","last_became_active":"2024-05-08T18:29:44.593917+0000","last_became_peered":"2024-05-08T18:29:44.593917+0000","last_unstale":"2024-05-08T18:31:55.472980+0000","last_undegraded":"2024-05-08T18:31:55.472980+0000","last_fullsized":"2024-05-08T18:31:55.472980+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:59:00.335437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"84'95","reported_seq":298,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.957823+0000","last_change":"2024-05-08T18:29:46.599932+0000","last_active":"2024-05-08T18:31:54.957823+0000","last_peered":"2024-05-08T18:31:54.957823+0000","last_clean":"2024-05-08T18:31:54.957823+0000","last_became_active":"2024-05-08T18:29:46.594789+0000","last_became_peered":"2024-05-08T18:29:46.594789+0000","last_unstale":"2024-05-08T18:31:54.957823+0000","last_undegraded":"2024-05-08T18:31:54.957823+0000","last_fullsized":"2024-05-08T18:31:54.957823+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:04:18.099848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9947,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":128,"num_read_kb":113,"num_write":28,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":124,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.643832+0000","last_change":"2024-05-08T18:29:48.634661+0000","last_active":"2024-05-08T18:31:54.643832+0000","last_peered":"2024-05-08T18:31:54.643832+0000","last_clean":"2024-05-08T18:31:54.643832+0000","last_became_active":"2024-05-08T18:29:48.634044+0000","last_became_peered":"2024-05-08T18:29:48.634044+0000","last_unstale":"2024-05-08T18:31:54.643832+0000","last_undegraded":"2024-05-08T18:31:54.643832+0000","last_fullsized":"2024-05-08T18:31:54.643832+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:01:46.238076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":122,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.956946+0000","last_change":"2024-05-08T18:29:50.676536+0000","last_active":"2024-05-08T18:31:54.956946+0000","last_peered":"2024-05-08T18:31:54.956946+0000","last_clean":"2024-05-08T18:31:54.956946+0000","last_became_active":"2024-05-08T18:29:50.675770+0000","last_became_peered":"2024-05-08T18:29:50.675770+0000","last_unstale":"2024-05-08T18:31:54.956946+0000","last_undegraded":"2024-05-08T18:31:54.956946+0000","last_fullsized":"2024-05-08T18:31:54.956946+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:28.003482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":139,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.958777+0000","last_change":"2024-05-08T18:29:42.575253+0000","last_active":"2024-05-08T18:31:54.958777+0000","last_peered":"2024-05-08T18:31:54.958777+0000","last_clean":"2024-05-08T18:31:54.958777+0000","last_became_active":"2024-05-08T18:29:42.573621+0000","last_became_peered":"2024-05-08T18:29:42.573621+0000","last_unstale":"2024-05-08T18:31:54.958777+0000","last_undegraded":"2024-05-08T18:31:54.958777+0000","last_fullsized":"2024-05-08T18:31:54.958777+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:59.243324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":145,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-08T18:31:53.615550+0000","last_change":"2024-05-08T18:29:34.491071+0000","last_active":"2024-05-08T18:31:53.615550+0000","last_peered":"2024-05-08T18:31:53.615550+0000","last_clean":"2024-05-08T18:31:53.615550+0000","last_became_active":"2024-05-08T18:29:34.490717+0000","last_became_peered":"2024-05-08T18:29:34.490717+0000","last_unstale":"2024-05-08T18:31:53.615550+0000","last_undegraded":"2024-05-08T18:31:53.615550+0000","last_fullsized":"2024-05-08T18:31:53.615550+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:55.793312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"83'7","reported_seq":150,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.956722+0000","last_change":"2024-05-08T18:29:40.530634+0000","last_active":"2024-05-08T18:31:54.956722+0000","last_peered":"2024-05-08T18:31:54.956722+0000","last_clean":"2024-05-08T18:31:54.956722+0000","last_became_active":"2024-05-08T18:29:40.529804+0000","last_became_peered":"2024-05-08T18:29:40.529804+0000","last_unstale":"2024-05-08T18:31:54.956722+0000","last_undegraded":"2024-05-08T18:31:54.956722+0000","last_fullsized":"2024-05-08T18:31:54.956722+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:59:25.840149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"26'1","reported_seq":132,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-08T18:31:53.617391+0000","last_change":"2024-05-08T18:29:44.584678+0000","last_active":"2024-05-08T18:31:53.617391+0000","last_peered":"2024-05-08T18:31:53.617391+0000","last_clean":"2024-05-08T18:31:53.617391+0000","last_became_active":"2024-05-08T18:29:44.584227+0000","last_became_peered":"2024-05-08T18:29:44.584227+0000","last_unstale":"2024-05-08T18:31:53.617391+0000","last_undegraded":"2024-05-08T18:31:53.617391+0000","last_fullsized":"2024-05-08T18:31:53.617391+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:04:01.281207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'15","reported_seq":175,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.644330+0000","last_change":"2024-05-08T18:29:46.608720+0000","last_active":"2024-05-08T18:31:54.644330+0000","last_peered":"2024-05-08T18:31:54.644330+0000","last_clean":"2024-05-08T18:31:54.644330+0000","last_became_active":"2024-05-08T18:29:46.607989+0000","last_became_peered":"2024-05-08T18:29:46.607989+0000","last_unstale":"2024-05-08T18:31:54.644330+0000","last_undegraded":"2024-05-08T18:31:54.644330+0000","last_fullsized":"2024-05-08T18:31:54.644330+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:58:31.293922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":127,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.649005+0000","last_change":"2024-05-08T18:29:48.625269+0000","last_active":"2024-05-08T18:31:54.649005+0000","last_peered":"2024-05-08T18:31:54.649005+0000","last_clean":"2024-05-08T18:31:54.649005+0000","last_became_active":"2024-05-08T18:29:48.624545+0000","last_became_peered":"2024-05-08T18:29:48.624545+0000","last_unstale":"2024-05-08T18:31:54.649005+0000","last_undegraded":"2024-05-08T18:31:54.649005+0000","last_fullsized":"2024-05-08T18:31:54.649005+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:16:42.799734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"84'12","reported_seq":144,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.645855+0000","last_change":"2024-05-08T18:29:50.688851+0000","last_active":"2024-05-08T18:31:54.645855+0000","last_peered":"2024-05-08T18:31:54.645855+0000","last_clean":"2024-05-08T18:31:54.645855+0000","last_became_active":"2024-05-08T18:29:50.687978+0000","last_became_peered":"2024-05-08T18:29:50.687978+0000","last_unstale":"2024-05-08T18:31:54.645855+0000","last_undegraded":"2024-05-08T18:31:54.645855+0000","last_fullsized":"2024-05-08T18:31:54.645855+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:28:29.836446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":42,"num_write":31,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"84'4","reported_seq":154,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.958079+0000","last_change":"2024-05-08T18:31:22.008678+0000","last_active":"2024-05-08T18:31:54.958079+0000","last_peered":"2024-05-08T18:31:54.958079+0000","last_clean":"2024-05-08T18:31:54.958079+0000","last_became_active":"2024-05-08T18:31:22.008342+0000","last_became_peered":"2024-05-08T18:31:22.008342+0000","last_unstale":"2024-05-08T18:31:54.958079+0000","last_undegraded":"2024-05-08T18:31:54.958079+0000","last_fullsized":"2024-05-08T18:31:54.958079+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:40:30.531379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":147,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.469342+0000","last_change":"2024-05-08T18:29:34.496942+0000","last_active":"2024-05-08T18:31:55.469342+0000","last_peered":"2024-05-08T18:31:55.469342+0000","last_clean":"2024-05-08T18:31:55.469342+0000","last_became_active":"2024-05-08T18:29:34.495882+0000","last_became_peered":"2024-05-08T18:29:34.495882+0000","last_unstale":"2024-05-08T18:31:55.469342+0000","last_undegraded":"2024-05-08T18:31:55.469342+0000","last_fullsized":"2024-05-08T18:31:55.469342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:55.793312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"82'4","reported_seq":149,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.646219+0000","last_change":"2024-05-08T18:29:40.554353+0000","last_active":"2024-05-08T18:31:55.646219+0000","last_peered":"2024-05-08T18:31:55.646219+0000","last_clean":"2024-05-08T18:31:55.646219+0000","last_became_active":"2024-05-08T18:29:40.553527+0000","last_became_peered":"2024-05-08T18:29:40.553527+0000","last_unstale":"2024-05-08T18:31:55.646219+0000","last_undegraded":"2024-05-08T18:31:55.646219+0000","last_fullsized":"2024-05-08T18:31:55.646219+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:03:42.148647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":135,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.649147+0000","last_change":"2024-05-08T18:29:44.597411+0000","last_active":"2024-05-08T18:31:54.649147+0000","last_peered":"2024-05-08T18:31:54.649147+0000","last_clean":"2024-05-08T18:31:54.649147+0000","last_became_active":"2024-05-08T18:29:44.596678+0000","last_became_peered":"2024-05-08T18:29:44.596678+0000","last_unstale":"2024-05-08T18:31:54.649147+0000","last_undegraded":"2024-05-08T18:31:54.649147+0000","last_fullsized":"2024-05-08T18:31:54.649147+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:37:23.674968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'12","reported_seq":147,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.646456+0000","last_change":"2024-05-08T18:29:46.607040+0000","last_active":"2024-05-08T18:31:54.646456+0000","last_peered":"2024-05-08T18:31:54.646456+0000","last_clean":"2024-05-08T18:31:54.646456+0000","last_became_active":"2024-05-08T18:29:46.606367+0000","last_became_peered":"2024-05-08T18:29:46.606367+0000","last_unstale":"2024-05-08T18:31:54.646456+0000","last_undegraded":"2024-05-08T18:31:54.646456+0000","last_fullsized":"2024-05-08T18:31:54.646456+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:59:26.650126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":123,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.470718+0000","last_change":"2024-05-08T18:29:48.632665+0000","last_active":"2024-05-08T18:31:55.470718+0000","last_peered":"2024-05-08T18:31:55.470718+0000","last_clean":"2024-05-08T18:31:55.470718+0000","last_became_active":"2024-05-08T18:29:48.631874+0000","last_became_peered":"2024-05-08T18:29:48.631874+0000","last_unstale":"2024-05-08T18:31:55.470718+0000","last_undegraded":"2024-05-08T18:31:55.470718+0000","last_fullsized":"2024-05-08T18:31:55.470718+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:06:09.390017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":120,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.466180+0000","last_change":"2024-05-08T18:29:50.683443+0000","last_active":"2024-05-08T18:31:55.466180+0000","last_peered":"2024-05-08T18:31:55.466180+0000","last_clean":"2024-05-08T18:31:55.466180+0000","last_became_active":"2024-05-08T18:29:50.682634+0000","last_became_peered":"2024-05-08T18:29:50.682634+0000","last_unstale":"2024-05-08T18:31:55.466180+0000","last_undegraded":"2024-05-08T18:31:55.466180+0000","last_fullsized":"2024-05-08T18:31:55.466180+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:10:38.951662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"80'2","reported_seq":144,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.957396+0000","last_change":"2024-05-08T18:29:42.574593+0000","last_active":"2024-05-08T18:31:54.957396+0000","last_peered":"2024-05-08T18:31:54.957396+0000","last_clean":"2024-05-08T18:31:54.957396+0000","last_became_active":"2024-05-08T18:29:42.574288+0000","last_became_peered":"2024-05-08T18:29:42.574288+0000","last_unstale":"2024-05-08T18:31:54.957396+0000","last_undegraded":"2024-05-08T18:31:54.957396+0000","last_fullsized":"2024-05-08T18:31:54.957396+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:58.320701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"83'7","reported_seq":95,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-08T18:31:53.616270+0000","last_change":"2024-05-08T18:30:20.850805+0000","last_active":"2024-05-08T18:31:53.616270+0000","last_peered":"2024-05-08T18:31:53.616270+0000","last_clean":"2024-05-08T18:31:53.616270+0000","last_became_active":"2024-05-08T18:30:20.850365+0000","last_became_peered":"2024-05-08T18:30:20.850365+0000","last_unstale":"2024-05-08T18:31:53.616270+0000","last_undegraded":"2024-05-08T18:31:53.616270+0000","last_fullsized":"2024-05-08T18:31:53.616270+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:52:21.678894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":149,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.958189+0000","last_change":"2024-05-08T18:29:34.606393+0000","last_active":"2024-05-08T18:31:54.958189+0000","last_peered":"2024-05-08T18:31:54.958189+0000","last_clean":"2024-05-08T18:31:54.958189+0000","last_became_active":"2024-05-08T18:29:34.605574+0000","last_became_peered":"2024-05-08T18:29:34.605574+0000","last_unstale":"2024-05-08T18:31:54.958189+0000","last_undegraded":"2024-05-08T18:31:54.958189+0000","last_fullsized":"2024-05-08T18:31:54.958189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:55.793312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":135,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.649311+0000","last_change":"2024-05-08T18:29:44.595127+0000","last_active":"2024-05-08T18:31:54.649311+0000","last_peered":"2024-05-08T18:31:54.649311+0000","last_clean":"2024-05-08T18:31:54.649311+0000","last_became_active":"2024-05-08T18:29:44.594642+0000","last_became_peered":"2024-05-08T18:29:44.594642+0000","last_unstale":"2024-05-08T18:31:54.649311+0000","last_undegraded":"2024-05-08T18:31:54.649311+0000","last_fullsized":"2024-05-08T18:31:54.649311+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:04:49.020450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"84'29","reported_seq":174,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.643796+0000","last_change":"2024-05-08T18:29:46.602279+0000","last_active":"2024-05-08T18:31:54.643796+0000","last_peered":"2024-05-08T18:31:54.643796+0000","last_clean":"2024-05-08T18:31:54.643796+0000","last_became_active":"2024-05-08T18:29:46.599707+0000","last_became_peered":"2024-05-08T18:29:46.599707+0000","last_unstale":"2024-05-08T18:31:54.643796+0000","last_undegraded":"2024-05-08T18:31:54.643796+0000","last_fullsized":"2024-05-08T18:31:54.643796+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:54:48.654215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4762,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":36,"num_read_kb":24,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":129,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.644871+0000","last_change":"2024-05-08T18:29:48.639458+0000","last_active":"2024-05-08T18:31:55.644871+0000","last_peered":"2024-05-08T18:31:55.644871+0000","last_clean":"2024-05-08T18:31:55.644871+0000","last_became_active":"2024-05-08T18:29:48.638709+0000","last_became_peered":"2024-05-08T18:29:48.638709+0000","last_unstale":"2024-05-08T18:31:55.644871+0000","last_undegraded":"2024-05-08T18:31:55.644871+0000","last_fullsized":"2024-05-08T18:31:55.644871+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:19:58.182291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"84'2","reported_seq":125,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.649129+0000","last_change":"2024-05-08T18:29:50.681077+0000","last_active":"2024-05-08T18:31:54.649129+0000","last_peered":"2024-05-08T18:31:54.649129+0000","last_clean":"2024-05-08T18:31:54.649129+0000","last_became_active":"2024-05-08T18:29:50.675766+0000","last_became_peered":"2024-05-08T18:29:50.675766+0000","last_unstale":"2024-05-08T18:31:54.649129+0000","last_undegraded":"2024-05-08T18:31:54.649129+0000","last_fullsized":"2024-05-08T18:31:54.649129+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:09:29.641515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":422,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"80'2","reported_seq":144,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.649938+0000","last_change":"2024-05-08T18:29:42.571265+0000","last_active":"2024-05-08T18:31:54.649938+0000","last_peered":"2024-05-08T18:31:54.649938+0000","last_clean":"2024-05-08T18:31:54.649938+0000","last_became_active":"2024-05-08T18:29:42.570645+0000","last_became_peered":"2024-05-08T18:29:42.570645+0000","last_unstale":"2024-05-08T18:31:54.649938+0000","last_undegraded":"2024-05-08T18:31:54.649938+0000","last_fullsized":"2024-05-08T18:31:54.649938+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:30:29.452640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"82'1","reported_seq":144,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.958081+0000","last_change":"2024-05-08T18:29:40.531079+0000","last_active":"2024-05-08T18:31:54.958081+0000","last_peered":"2024-05-08T18:31:54.958081+0000","last_clean":"2024-05-08T18:31:54.958081+0000","last_became_active":"2024-05-08T18:29:40.530256+0000","last_became_peered":"2024-05-08T18:29:40.530256+0000","last_unstale":"2024-05-08T18:31:54.958081+0000","last_undegraded":"2024-05-08T18:31:54.958081+0000","last_fullsized":"2024-05-08T18:31:54.958081+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:09:42.581976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":146,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.645053+0000","last_change":"2024-05-08T18:29:34.603292+0000","last_active":"2024-05-08T18:31:54.645053+0000","last_peered":"2024-05-08T18:31:54.645053+0000","last_clean":"2024-05-08T18:31:54.645053+0000","last_became_active":"2024-05-08T18:29:34.602547+0000","last_became_peered":"2024-05-08T18:29:34.602547+0000","last_unstale":"2024-05-08T18:31:54.645053+0000","last_undegraded":"2024-05-08T18:31:54.645053+0000","last_fullsized":"2024-05-08T18:31:54.645053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:24:55.555475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":132,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.467541+0000","last_change":"2024-05-08T18:29:44.593275+0000","last_active":"2024-05-08T18:31:55.467541+0000","last_peered":"2024-05-08T18:31:55.467541+0000","last_clean":"2024-05-08T18:31:55.467541+0000","last_became_active":"2024-05-08T18:29:44.591870+0000","last_became_peered":"2024-05-08T18:29:44.591870+0000","last_unstale":"2024-05-08T18:31:55.467541+0000","last_undegraded":"2024-05-08T18:31:55.467541+0000","last_fullsized":"2024-05-08T18:31:55.467541+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:35.176971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"33'14","reported_seq":152,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.956695+0000","last_change":"2024-05-08T18:29:46.603499+0000","last_active":"2024-05-08T18:31:54.956695+0000","last_peered":"2024-05-08T18:31:54.956695+0000","last_clean":"2024-05-08T18:31:54.956695+0000","last_became_active":"2024-05-08T18:29:46.602920+0000","last_became_peered":"2024-05-08T18:29:46.602920+0000","last_unstale":"2024-05-08T18:31:54.956695+0000","last_undegraded":"2024-05-08T18:31:54.956695+0000","last_fullsized":"2024-05-08T18:31:54.956695+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:08.504882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"84'86","reported_seq":249,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.466988+0000","last_change":"2024-05-08T18:29:48.634915+0000","last_active":"2024-05-08T18:31:55.466988+0000","last_peered":"2024-05-08T18:31:55.466988+0000","last_clean":"2024-05-08T18:31:55.466988+0000","last_became_active":"2024-05-08T18:29:48.634280+0000","last_became_peered":"2024-05-08T18:29:48.634280+0000","last_unstale":"2024-05-08T18:31:55.466988+0000","last_undegraded":"2024-05-08T18:31:55.466988+0000","last_fullsized":"2024-05-08T18:31:55.466988+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:19:58.182291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"80'2","reported_seq":123,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.649457+0000","last_change":"2024-05-08T18:29:50.688742+0000","last_active":"2024-05-08T18:31:54.649457+0000","last_peered":"2024-05-08T18:31:54.649457+0000","last_clean":"2024-05-08T18:31:54.649457+0000","last_became_active":"2024-05-08T18:29:50.687135+0000","last_became_peered":"2024-05-08T18:29:50.687135+0000","last_unstale":"2024-05-08T18:31:54.649457+0000","last_undegraded":"2024-05-08T18:31:54.649457+0000","last_fullsized":"2024-05-08T18:31:54.649457+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:12:49.040807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"80'2","reported_seq":93,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-08T18:31:53.615208+0000","last_change":"2024-05-08T18:30:21.220561+0000","last_active":"2024-05-08T18:31:53.615208+0000","last_peered":"2024-05-08T18:31:53.615208+0000","last_clean":"2024-05-08T18:31:53.615208+0000","last_became_active":"2024-05-08T18:30:21.220196+0000","last_became_peered":"2024-05-08T18:30:21.220196+0000","last_unstale":"2024-05-08T18:31:53.615208+0000","last_undegraded":"2024-05-08T18:31:53.615208+0000","last_fullsized":"2024-05-08T18:31:53.615208+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:19:27.075761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"83'5","reported_seq":147,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.645963+0000","last_change":"2024-05-08T18:29:40.565872+0000","last_active":"2024-05-08T18:31:54.645963+0000","last_peered":"2024-05-08T18:31:54.645963+0000","last_clean":"2024-05-08T18:31:54.645963+0000","last_became_active":"2024-05-08T18:29:40.565655+0000","last_became_peered":"2024-05-08T18:29:40.565655+0000","last_unstale":"2024-05-08T18:31:54.645963+0000","last_undegraded":"2024-05-08T18:31:54.645963+0000","last_fullsized":"2024-05-08T18:31:54.645963+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:16:16.521258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":149,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.958487+0000","last_change":"2024-05-08T18:29:34.501273+0000","last_active":"2024-05-08T18:31:54.958487+0000","last_peered":"2024-05-08T18:31:54.958487+0000","last_clean":"2024-05-08T18:31:54.958487+0000","last_became_active":"2024-05-08T18:29:34.500933+0000","last_became_peered":"2024-05-08T18:29:34.500933+0000","last_unstale":"2024-05-08T18:31:54.958487+0000","last_undegraded":"2024-05-08T18:31:54.958487+0000","last_fullsized":"2024-05-08T18:31:54.958487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:35.917391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":137,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.645175+0000","last_change":"2024-05-08T18:29:44.576227+0000","last_active":"2024-05-08T18:31:55.645175+0000","last_peered":"2024-05-08T18:31:55.645175+0000","last_clean":"2024-05-08T18:31:55.645175+0000","last_became_active":"2024-05-08T18:29:44.575454+0000","last_became_peered":"2024-05-08T18:29:44.575454+0000","last_unstale":"2024-05-08T18:31:55.645175+0000","last_undegraded":"2024-05-08T18:31:55.645175+0000","last_fullsized":"2024-05-08T18:31:55.645175+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:06:05.355648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"80'11","reported_seq":149,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.646220+0000","last_change":"2024-05-08T18:29:46.609633+0000","last_active":"2024-05-08T18:31:55.646220+0000","last_peered":"2024-05-08T18:31:55.646220+0000","last_clean":"2024-05-08T18:31:55.646220+0000","last_became_active":"2024-05-08T18:29:46.603455+0000","last_became_peered":"2024-05-08T18:29:46.603455+0000","last_unstale":"2024-05-08T18:31:55.646220+0000","last_undegraded":"2024-05-08T18:31:55.646220+0000","last_fullsized":"2024-05-08T18:31:55.646220+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:07:54.654205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"84'86","reported_seq":275,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.786663+0000","last_change":"2024-05-08T18:29:48.637898+0000","last_active":"2024-05-08T18:31:54.786663+0000","last_peered":"2024-05-08T18:31:54.786663+0000","last_clean":"2024-05-08T18:31:54.786663+0000","last_became_active":"2024-05-08T18:29:48.637070+0000","last_became_peered":"2024-05-08T18:29:48.637070+0000","last_unstale":"2024-05-08T18:31:54.786663+0000","last_undegraded":"2024-05-08T18:31:54.786663+0000","last_fullsized":"2024-05-08T18:31:54.786663+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:03:46.392864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"84'10","reported_seq":136,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.649065+0000","last_change":"2024-05-08T18:29:50.691526+0000","last_active":"2024-05-08T18:31:54.649065+0000","last_peered":"2024-05-08T18:31:54.649065+0000","last_clean":"2024-05-08T18:31:54.649065+0000","last_became_active":"2024-05-08T18:29:50.690767+0000","last_became_peered":"2024-05-08T18:29:50.690767+0000","last_unstale":"2024-05-08T18:31:54.649065+0000","last_undegraded":"2024-05-08T18:31:54.649065+0000","last_fullsized":"2024-05-08T18:31:54.649065+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:32:29.972139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"84'8","reported_seq":158,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.645938+0000","last_change":"2024-05-08T18:29:42.562006+0000","last_active":"2024-05-08T18:31:55.645938+0000","last_peered":"2024-05-08T18:31:55.645938+0000","last_clean":"2024-05-08T18:31:55.645938+0000","last_became_active":"2024-05-08T18:29:42.560861+0000","last_became_peered":"2024-05-08T18:29:42.560861+0000","last_unstale":"2024-05-08T18:31:55.645938+0000","last_undegraded":"2024-05-08T18:31:55.645938+0000","last_fullsized":"2024-05-08T18:31:55.645938+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:36.890277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"83'5","reported_seq":148,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.649817+0000","last_change":"2024-05-08T18:29:40.550529+0000","last_active":"2024-05-08T18:31:54.649817+0000","last_peered":"2024-05-08T18:31:54.649817+0000","last_clean":"2024-05-08T18:31:54.649817+0000","last_became_active":"2024-05-08T18:29:40.550241+0000","last_became_peered":"2024-05-08T18:29:40.550241+0000","last_unstale":"2024-05-08T18:31:54.649817+0000","last_undegraded":"2024-05-08T18:31:54.649817+0000","last_fullsized":"2024-05-08T18:31:54.649817+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:48.294532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":146,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.471529+0000","last_change":"2024-05-08T18:29:34.493537+0000","last_active":"2024-05-08T18:31:55.471529+0000","last_peered":"2024-05-08T18:31:55.471529+0000","last_clean":"2024-05-08T18:31:55.471529+0000","last_became_active":"2024-05-08T18:29:34.492891+0000","last_became_peered":"2024-05-08T18:29:34.492891+0000","last_unstale":"2024-05-08T18:31:55.471529+0000","last_undegraded":"2024-05-08T18:31:55.471529+0000","last_fullsized":"2024-05-08T18:31:55.471529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:09:07.992256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":134,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.645114+0000","last_change":"2024-05-08T18:29:44.590102+0000","last_active":"2024-05-08T18:31:54.645114+0000","last_peered":"2024-05-08T18:31:54.645114+0000","last_clean":"2024-05-08T18:31:54.645114+0000","last_became_active":"2024-05-08T18:29:44.589471+0000","last_became_peered":"2024-05-08T18:29:44.589471+0000","last_unstale":"2024-05-08T18:31:54.645114+0000","last_undegraded":"2024-05-08T18:31:54.645114+0000","last_fullsized":"2024-05-08T18:31:54.645114+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:14:04.085401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"84'34","reported_seq":179,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.643351+0000","last_change":"2024-05-08T18:29:46.606967+0000","last_active":"2024-05-08T18:31:54.643351+0000","last_peered":"2024-05-08T18:31:54.643351+0000","last_clean":"2024-05-08T18:31:54.643351+0000","last_became_active":"2024-05-08T18:29:46.605693+0000","last_became_peered":"2024-05-08T18:29:46.605693+0000","last_unstale":"2024-05-08T18:31:54.643351+0000","last_undegraded":"2024-05-08T18:31:54.643351+0000","last_fullsized":"2024-05-08T18:31:54.643351+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:24:13.568294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":126,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.645241+0000","last_change":"2024-05-08T18:29:48.634271+0000","last_active":"2024-05-08T18:31:54.645241+0000","last_peered":"2024-05-08T18:31:54.645241+0000","last_clean":"2024-05-08T18:31:54.645241+0000","last_became_active":"2024-05-08T18:29:48.633607+0000","last_became_peered":"2024-05-08T18:29:48.633607+0000","last_unstale":"2024-05-08T18:31:54.645241+0000","last_undegraded":"2024-05-08T18:31:54.645241+0000","last_fullsized":"2024-05-08T18:31:54.645241+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:34.806539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":120,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.468505+0000","last_change":"2024-05-08T18:29:50.685494+0000","last_active":"2024-05-08T18:31:55.468505+0000","last_peered":"2024-05-08T18:31:55.468505+0000","last_clean":"2024-05-08T18:31:55.468505+0000","last_became_active":"2024-05-08T18:29:50.684818+0000","last_became_peered":"2024-05-08T18:29:50.684818+0000","last_unstale":"2024-05-08T18:31:55.468505+0000","last_undegraded":"2024-05-08T18:31:55.468505+0000","last_fullsized":"2024-05-08T18:31:55.468505+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:22.220842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":123,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.649461+0000","last_change":"2024-05-08T18:29:50.682937+0000","last_active":"2024-05-08T18:31:54.649461+0000","last_peered":"2024-05-08T18:31:54.649461+0000","last_clean":"2024-05-08T18:31:54.649461+0000","last_became_active":"2024-05-08T18:29:50.681771+0000","last_became_peered":"2024-05-08T18:29:50.681771+0000","last_unstale":"2024-05-08T18:31:54.649461+0000","last_undegraded":"2024-05-08T18:31:54.649461+0000","last_fullsized":"2024-05-08T18:31:54.649461+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:28:29.836446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"84'4","reported_seq":150,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.645648+0000","last_change":"2024-05-08T18:29:42.575909+0000","last_active":"2024-05-08T18:31:55.645648+0000","last_peered":"2024-05-08T18:31:55.645648+0000","last_clean":"2024-05-08T18:31:55.645648+0000","last_became_active":"2024-05-08T18:29:42.574877+0000","last_became_peered":"2024-05-08T18:29:42.574877+0000","last_unstale":"2024-05-08T18:31:55.645648+0000","last_undegraded":"2024-05-08T18:31:55.645648+0000","last_fullsized":"2024-05-08T18:31:55.645648+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:33.139089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"84'8","reported_seq":152,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.645293+0000","last_change":"2024-05-08T18:29:40.566496+0000","last_active":"2024-05-08T18:31:55.645293+0000","last_peered":"2024-05-08T18:31:55.645293+0000","last_clean":"2024-05-08T18:31:55.645293+0000","last_became_active":"2024-05-08T18:29:40.565874+0000","last_became_peered":"2024-05-08T18:29:40.565874+0000","last_unstale":"2024-05-08T18:31:55.645293+0000","last_undegraded":"2024-05-08T18:31:55.645293+0000","last_fullsized":"2024-05-08T18:31:55.645293+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:07.239963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":134,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.957552+0000","last_change":"2024-05-08T18:29:44.595410+0000","last_active":"2024-05-08T18:31:54.957552+0000","last_peered":"2024-05-08T18:31:54.957552+0000","last_clean":"2024-05-08T18:31:54.957552+0000","last_became_active":"2024-05-08T18:29:44.594286+0000","last_became_peered":"2024-05-08T18:29:44.594286+0000","last_unstale":"2024-05-08T18:31:54.957552+0000","last_undegraded":"2024-05-08T18:31:54.957552+0000","last_fullsized":"2024-05-08T18:31:54.957552+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:38.928160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"84'16","reported_seq":153,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.644675+0000","last_change":"2024-05-08T18:29:46.591009+0000","last_active":"2024-05-08T18:31:54.644675+0000","last_peered":"2024-05-08T18:31:54.644675+0000","last_clean":"2024-05-08T18:31:54.644675+0000","last_became_active":"2024-05-08T18:29:46.588810+0000","last_became_peered":"2024-05-08T18:29:46.588810+0000","last_unstale":"2024-05-08T18:31:54.644675+0000","last_undegraded":"2024-05-08T18:31:54.644675+0000","last_fullsized":"2024-05-08T18:31:54.644675+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:34:45.745300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":125,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.644898+0000","last_change":"2024-05-08T18:29:48.634986+0000","last_active":"2024-05-08T18:31:54.644898+0000","last_peered":"2024-05-08T18:31:54.644898+0000","last_clean":"2024-05-08T18:31:54.644898+0000","last_became_active":"2024-05-08T18:29:48.633866+0000","last_became_peered":"2024-05-08T18:29:48.633866+0000","last_unstale":"2024-05-08T18:31:54.644898+0000","last_undegraded":"2024-05-08T18:31:54.644898+0000","last_fullsized":"2024-05-08T18:31:54.644898+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:46.539830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"83'16","reported_seq":144,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.646200+0000","last_change":"2024-05-08T18:29:50.693408+0000","last_active":"2024-05-08T18:31:54.646200+0000","last_peered":"2024-05-08T18:31:54.646200+0000","last_clean":"2024-05-08T18:31:54.646200+0000","last_became_active":"2024-05-08T18:29:50.692687+0000","last_became_peered":"2024-05-08T18:29:50.692687+0000","last_unstale":"2024-05-08T18:31:54.646200+0000","last_undegraded":"2024-05-08T18:31:54.646200+0000","last_fullsized":"2024-05-08T18:31:54.646200+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:22.834262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":28,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"83'6","reported_seq":153,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.957291+0000","last_change":"2024-05-08T18:29:42.581368+0000","last_active":"2024-05-08T18:31:54.957291+0000","last_peered":"2024-05-08T18:31:54.957291+0000","last_clean":"2024-05-08T18:31:54.957291+0000","last_became_active":"2024-05-08T18:29:42.580887+0000","last_became_peered":"2024-05-08T18:29:42.580887+0000","last_unstale":"2024-05-08T18:31:54.957291+0000","last_undegraded":"2024-05-08T18:31:54.957291+0000","last_fullsized":"2024-05-08T18:31:54.957291+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:08:15.026467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"84'4","reported_seq":143,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.644484+0000","last_change":"2024-05-08T18:29:40.572770+0000","last_active":"2024-05-08T18:31:54.644484+0000","last_peered":"2024-05-08T18:31:54.644484+0000","last_clean":"2024-05-08T18:31:54.644484+0000","last_became_active":"2024-05-08T18:29:40.572079+0000","last_became_peered":"2024-05-08T18:29:40.572079+0000","last_unstale":"2024-05-08T18:31:54.644484+0000","last_undegraded":"2024-05-08T18:31:54.644484+0000","last_fullsized":"2024-05-08T18:31:54.644484+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:05.929806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":133,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.645727+0000","last_change":"2024-05-08T18:29:44.581323+0000","last_active":"2024-05-08T18:31:54.645727+0000","last_peered":"2024-05-08T18:31:54.645727+0000","last_clean":"2024-05-08T18:31:54.645727+0000","last_became_active":"2024-05-08T18:29:44.580805+0000","last_became_peered":"2024-05-08T18:29:44.580805+0000","last_unstale":"2024-05-08T18:31:54.645727+0000","last_undegraded":"2024-05-08T18:31:54.645727+0000","last_fullsized":"2024-05-08T18:31:54.645727+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:35:25.591140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"47'5","reported_seq":137,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.643508+0000","last_change":"2024-05-08T18:29:46.602495+0000","last_active":"2024-05-08T18:31:54.643508+0000","last_peered":"2024-05-08T18:31:54.643508+0000","last_clean":"2024-05-08T18:31:54.643508+0000","last_became_active":"2024-05-08T18:29:46.599789+0000","last_became_peered":"2024-05-08T18:29:46.599789+0000","last_unstale":"2024-05-08T18:31:54.643508+0000","last_undegraded":"2024-05-08T18:31:54.643508+0000","last_fullsized":"2024-05-08T18:31:54.643508+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:18:16.375808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":123,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.643110+0000","last_change":"2024-05-08T18:29:48.642994+0000","last_active":"2024-05-08T18:31:54.643110+0000","last_peered":"2024-05-08T18:31:54.643110+0000","last_clean":"2024-05-08T18:31:54.643110+0000","last_became_active":"2024-05-08T18:29:48.642056+0000","last_became_peered":"2024-05-08T18:29:48.642056+0000","last_unstale":"2024-05-08T18:31:54.643110+0000","last_undegraded":"2024-05-08T18:31:54.643110+0000","last_fullsized":"2024-05-08T18:31:54.643110+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:47:54.034851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":122,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.649042+0000","last_change":"2024-05-08T18:29:50.672513+0000","last_active":"2024-05-08T18:31:54.649042+0000","last_peered":"2024-05-08T18:31:54.649042+0000","last_clean":"2024-05-08T18:31:54.649042+0000","last_became_active":"2024-05-08T18:29:50.671781+0000","last_became_peered":"2024-05-08T18:29:50.671781+0000","last_unstale":"2024-05-08T18:31:54.649042+0000","last_undegraded":"2024-05-08T18:31:54.649042+0000","last_fullsized":"2024-05-08T18:31:54.649042+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:45:34.171402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":137,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.644951+0000","last_change":"2024-05-08T18:29:42.576843+0000","last_active":"2024-05-08T18:31:54.644951+0000","last_peered":"2024-05-08T18:31:54.644951+0000","last_clean":"2024-05-08T18:31:54.644951+0000","last_became_active":"2024-05-08T18:29:42.576379+0000","last_became_peered":"2024-05-08T18:29:42.576379+0000","last_unstale":"2024-05-08T18:31:54.644951+0000","last_undegraded":"2024-05-08T18:31:54.644951+0000","last_fullsized":"2024-05-08T18:31:54.644951+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:20.471010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"84'6","reported_seq":146,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.470006+0000","last_change":"2024-05-08T18:29:40.542997+0000","last_active":"2024-05-08T18:31:55.470006+0000","last_peered":"2024-05-08T18:31:55.470006+0000","last_clean":"2024-05-08T18:31:55.470006+0000","last_became_active":"2024-05-08T18:29:40.542239+0000","last_became_peered":"2024-05-08T18:29:40.542239+0000","last_unstale":"2024-05-08T18:31:55.470006+0000","last_undegraded":"2024-05-08T18:31:55.470006+0000","last_fullsized":"2024-05-08T18:31:55.470006+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:14:43.555504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":131,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.642535+0000","last_change":"2024-05-08T18:29:44.594178+0000","last_active":"2024-05-08T18:31:54.642535+0000","last_peered":"2024-05-08T18:31:54.642535+0000","last_clean":"2024-05-08T18:31:54.642535+0000","last_became_active":"2024-05-08T18:29:44.592476+0000","last_became_peered":"2024-05-08T18:29:44.592476+0000","last_unstale":"2024-05-08T18:31:54.642535+0000","last_undegraded":"2024-05-08T18:31:54.642535+0000","last_fullsized":"2024-05-08T18:31:54.642535+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:04:16.093662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"84'16","reported_seq":153,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.645675+0000","last_change":"2024-05-08T18:29:46.597288+0000","last_active":"2024-05-08T18:31:54.645675+0000","last_peered":"2024-05-08T18:31:54.645675+0000","last_clean":"2024-05-08T18:31:54.645675+0000","last_became_active":"2024-05-08T18:29:46.596452+0000","last_became_peered":"2024-05-08T18:29:46.596452+0000","last_unstale":"2024-05-08T18:31:54.645675+0000","last_undegraded":"2024-05-08T18:31:54.645675+0000","last_fullsized":"2024-05-08T18:31:54.645675+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:32:43.245753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":123,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.467288+0000","last_change":"2024-05-08T18:29:48.635436+0000","last_active":"2024-05-08T18:31:55.467288+0000","last_peered":"2024-05-08T18:31:55.467288+0000","last_clean":"2024-05-08T18:31:55.467288+0000","last_became_active":"2024-05-08T18:29:48.634704+0000","last_became_peered":"2024-05-08T18:29:48.634704+0000","last_unstale":"2024-05-08T18:31:55.467288+0000","last_undegraded":"2024-05-08T18:31:55.467288+0000","last_fullsized":"2024-05-08T18:31:55.467288+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:55:52.238481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"83'2","reported_seq":123,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.467988+0000","last_change":"2024-05-08T18:29:50.687974+0000","last_active":"2024-05-08T18:31:55.467988+0000","last_peered":"2024-05-08T18:31:55.467988+0000","last_clean":"2024-05-08T18:31:55.467988+0000","last_became_active":"2024-05-08T18:29:50.687045+0000","last_became_peered":"2024-05-08T18:29:50.687045+0000","last_unstale":"2024-05-08T18:31:55.467988+0000","last_undegraded":"2024-05-08T18:31:55.467988+0000","last_fullsized":"2024-05-08T18:31:55.467988+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:55:01.894779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"84'3","reported_seq":148,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.645413+0000","last_change":"2024-05-08T18:30:20.850226+0000","last_active":"2024-05-08T18:31:54.645413+0000","last_peered":"2024-05-08T18:31:54.645413+0000","last_clean":"2024-05-08T18:31:54.645413+0000","last_became_active":"2024-05-08T18:30:20.849751+0000","last_became_peered":"2024-05-08T18:30:20.849751+0000","last_unstale":"2024-05-08T18:31:54.645413+0000","last_undegraded":"2024-05-08T18:31:54.645413+0000","last_fullsized":"2024-05-08T18:31:54.645413+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:33:31.550958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"84'7","reported_seq":149,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.649892+0000","last_change":"2024-05-08T18:29:40.541112+0000","last_active":"2024-05-08T18:31:54.649892+0000","last_peered":"2024-05-08T18:31:54.649892+0000","last_clean":"2024-05-08T18:31:54.649892+0000","last_became_active":"2024-05-08T18:29:40.540835+0000","last_became_peered":"2024-05-08T18:29:40.540835+0000","last_unstale":"2024-05-08T18:31:54.649892+0000","last_undegraded":"2024-05-08T18:31:54.649892+0000","last_fullsized":"2024-05-08T18:31:54.649892+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:43:14.995191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":131,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.467896+0000","last_change":"2024-05-08T18:29:44.592033+0000","last_active":"2024-05-08T18:31:55.467896+0000","last_peered":"2024-05-08T18:31:55.467896+0000","last_clean":"2024-05-08T18:31:55.467896+0000","last_became_active":"2024-05-08T18:29:44.590454+0000","last_became_peered":"2024-05-08T18:29:44.590454+0000","last_unstale":"2024-05-08T18:31:55.467896+0000","last_undegraded":"2024-05-08T18:31:55.467896+0000","last_fullsized":"2024-05-08T18:31:55.467896+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:11:03.740365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"84'14","reported_seq":148,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.642960+0000","last_change":"2024-05-08T18:29:46.607002+0000","last_active":"2024-05-08T18:31:54.642960+0000","last_peered":"2024-05-08T18:31:54.642960+0000","last_clean":"2024-05-08T18:31:54.642960+0000","last_became_active":"2024-05-08T18:29:46.606172+0000","last_became_peered":"2024-05-08T18:29:46.606172+0000","last_unstale":"2024-05-08T18:31:54.642960+0000","last_undegraded":"2024-05-08T18:31:54.642960+0000","last_fullsized":"2024-05-08T18:31:54.642960+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:37:35.850414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":126,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.648903+0000","last_change":"2024-05-08T18:29:48.632948+0000","last_active":"2024-05-08T18:31:54.648903+0000","last_peered":"2024-05-08T18:31:54.648903+0000","last_clean":"2024-05-08T18:31:54.648903+0000","last_became_active":"2024-05-08T18:29:48.631219+0000","last_became_peered":"2024-05-08T18:29:48.631219+0000","last_unstale":"2024-05-08T18:31:54.648903+0000","last_undegraded":"2024-05-08T18:31:54.648903+0000","last_fullsized":"2024-05-08T18:31:54.648903+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:19:01.454355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":136,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.471142+0000","last_change":"2024-05-08T18:29:42.570180+0000","last_active":"2024-05-08T18:31:55.471142+0000","last_peered":"2024-05-08T18:31:55.471142+0000","last_clean":"2024-05-08T18:31:55.471142+0000","last_became_active":"2024-05-08T18:29:42.569425+0000","last_became_peered":"2024-05-08T18:29:42.569425+0000","last_unstale":"2024-05-08T18:31:55.471142+0000","last_undegraded":"2024-05-08T18:31:55.471142+0000","last_fullsized":"2024-05-08T18:31:55.471142+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:35.037465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"84'2","reported_seq":143,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.646131+0000","last_change":"2024-05-08T18:29:40.547711+0000","last_active":"2024-05-08T18:31:54.646131+0000","last_peered":"2024-05-08T18:31:54.646131+0000","last_clean":"2024-05-08T18:31:54.646131+0000","last_became_active":"2024-05-08T18:29:40.547479+0000","last_became_peered":"2024-05-08T18:29:40.547479+0000","last_unstale":"2024-05-08T18:31:54.646131+0000","last_undegraded":"2024-05-08T18:31:54.646131+0000","last_fullsized":"2024-05-08T18:31:54.646131+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:12:40.901620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":135,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.649455+0000","last_change":"2024-05-08T18:29:44.591547+0000","last_active":"2024-05-08T18:31:54.649455+0000","last_peered":"2024-05-08T18:31:54.649455+0000","last_clean":"2024-05-08T18:31:54.649455+0000","last_became_active":"2024-05-08T18:29:44.590498+0000","last_became_peered":"2024-05-08T18:29:44.590498+0000","last_unstale":"2024-05-08T18:31:54.649455+0000","last_undegraded":"2024-05-08T18:31:54.649455+0000","last_fullsized":"2024-05-08T18:31:54.649455+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:14:04.085401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"84'23","reported_seq":164,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.957230+0000","last_change":"2024-05-08T18:29:46.600437+0000","last_active":"2024-05-08T18:31:54.957230+0000","last_peered":"2024-05-08T18:31:54.957230+0000","last_clean":"2024-05-08T18:31:54.957230+0000","last_became_active":"2024-05-08T18:29:46.594672+0000","last_became_peered":"2024-05-08T18:29:46.594672+0000","last_unstale":"2024-05-08T18:31:54.957230+0000","last_undegraded":"2024-05-08T18:31:54.957230+0000","last_fullsized":"2024-05-08T18:31:54.957230+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:35:53.294312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":124,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.468861+0000","last_change":"2024-05-08T18:29:48.639840+0000","last_active":"2024-05-08T18:31:55.468861+0000","last_peered":"2024-05-08T18:31:55.468861+0000","last_clean":"2024-05-08T18:31:55.468861+0000","last_became_active":"2024-05-08T18:29:48.639120+0000","last_became_peered":"2024-05-08T18:29:48.639120+0000","last_unstale":"2024-05-08T18:31:55.468861+0000","last_undegraded":"2024-05-08T18:31:55.468861+0000","last_fullsized":"2024-05-08T18:31:55.468861+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:13:50.865474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"84'2","reported_seq":124,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.644856+0000","last_change":"2024-05-08T18:29:50.684843+0000","last_active":"2024-05-08T18:31:54.644856+0000","last_peered":"2024-05-08T18:31:54.644856+0000","last_clean":"2024-05-08T18:31:54.644856+0000","last_became_active":"2024-05-08T18:29:50.684119+0000","last_became_peered":"2024-05-08T18:29:50.684119+0000","last_unstale":"2024-05-08T18:31:54.644856+0000","last_undegraded":"2024-05-08T18:31:54.644856+0000","last_fullsized":"2024-05-08T18:31:54.644856+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:09:29.641515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"80'2","reported_seq":144,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.649659+0000","last_change":"2024-05-08T18:29:42.575763+0000","last_active":"2024-05-08T18:31:54.649659+0000","last_peered":"2024-05-08T18:31:54.649659+0000","last_clean":"2024-05-08T18:31:54.649659+0000","last_became_active":"2024-05-08T18:29:42.575450+0000","last_became_peered":"2024-05-08T18:29:42.575450+0000","last_unstale":"2024-05-08T18:31:54.649659+0000","last_undegraded":"2024-05-08T18:31:54.649659+0000","last_fullsized":"2024-05-08T18:31:54.649659+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:20.471010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"83'8","reported_seq":150,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.957428+0000","last_change":"2024-05-08T18:29:40.546101+0000","last_active":"2024-05-08T18:31:54.957428+0000","last_peered":"2024-05-08T18:31:54.957428+0000","last_clean":"2024-05-08T18:31:54.957428+0000","last_became_active":"2024-05-08T18:29:40.545814+0000","last_became_peered":"2024-05-08T18:29:40.545814+0000","last_unstale":"2024-05-08T18:31:54.957428+0000","last_undegraded":"2024-05-08T18:31:54.957428+0000","last_fullsized":"2024-05-08T18:31:54.957428+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:22.579629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":132,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.470866+0000","last_change":"2024-05-08T18:29:44.591310+0000","last_active":"2024-05-08T18:31:55.470866+0000","last_peered":"2024-05-08T18:31:55.470866+0000","last_clean":"2024-05-08T18:31:55.470866+0000","last_became_active":"2024-05-08T18:29:44.590394+0000","last_became_peered":"2024-05-08T18:29:44.590394+0000","last_unstale":"2024-05-08T18:31:55.470866+0000","last_undegraded":"2024-05-08T18:31:55.470866+0000","last_fullsized":"2024-05-08T18:31:55.470866+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:02:28.348982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"84'20","reported_seq":157,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.643728+0000","last_change":"2024-05-08T18:29:46.605887+0000","last_active":"2024-05-08T18:31:54.643728+0000","last_peered":"2024-05-08T18:31:54.643728+0000","last_clean":"2024-05-08T18:31:54.643728+0000","last_became_active":"2024-05-08T18:29:46.604917+0000","last_became_peered":"2024-05-08T18:29:46.604917+0000","last_unstale":"2024-05-08T18:31:54.643728+0000","last_undegraded":"2024-05-08T18:31:54.643728+0000","last_fullsized":"2024-05-08T18:31:54.643728+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:22:36.338527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":126,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.957461+0000","last_change":"2024-05-08T18:29:48.644420+0000","last_active":"2024-05-08T18:31:54.957461+0000","last_peered":"2024-05-08T18:31:54.957461+0000","last_clean":"2024-05-08T18:31:54.957461+0000","last_became_active":"2024-05-08T18:29:48.643493+0000","last_became_peered":"2024-05-08T18:29:48.643493+0000","last_unstale":"2024-05-08T18:31:54.957461+0000","last_undegraded":"2024-05-08T18:31:54.957461+0000","last_fullsized":"2024-05-08T18:31:54.957461+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:19:33.148012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":119,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.467051+0000","last_change":"2024-05-08T18:29:50.687485+0000","last_active":"2024-05-08T18:31:55.467051+0000","last_peered":"2024-05-08T18:31:55.467051+0000","last_clean":"2024-05-08T18:31:55.467051+0000","last_became_active":"2024-05-08T18:29:50.686750+0000","last_became_peered":"2024-05-08T18:29:50.686750+0000","last_unstale":"2024-05-08T18:31:55.467051+0000","last_undegraded":"2024-05-08T18:31:55.467051+0000","last_fullsized":"2024-05-08T18:31:55.467051+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:41.914164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"84'3","reported_seq":143,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.646077+0000","last_change":"2024-05-08T18:29:42.566571+0000","last_active":"2024-05-08T18:31:54.646077+0000","last_peered":"2024-05-08T18:31:54.646077+0000","last_clean":"2024-05-08T18:31:54.646077+0000","last_became_active":"2024-05-08T18:29:42.563695+0000","last_became_peered":"2024-05-08T18:29:42.563695+0000","last_unstale":"2024-05-08T18:31:54.646077+0000","last_undegraded":"2024-05-08T18:31:54.646077+0000","last_fullsized":"2024-05-08T18:31:54.646077+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:46.887628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"84'6","reported_seq":150,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.646813+0000","last_change":"2024-05-08T18:29:40.545512+0000","last_active":"2024-05-08T18:31:55.646813+0000","last_peered":"2024-05-08T18:31:55.646813+0000","last_clean":"2024-05-08T18:31:55.646813+0000","last_became_active":"2024-05-08T18:29:40.544216+0000","last_became_peered":"2024-05-08T18:29:40.544216+0000","last_unstale":"2024-05-08T18:31:55.646813+0000","last_undegraded":"2024-05-08T18:31:55.646813+0000","last_fullsized":"2024-05-08T18:31:55.646813+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:37:08.242362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":136,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.647329+0000","last_change":"2024-05-08T18:29:44.576107+0000","last_active":"2024-05-08T18:31:55.647329+0000","last_peered":"2024-05-08T18:31:55.647329+0000","last_clean":"2024-05-08T18:31:55.647329+0000","last_became_active":"2024-05-08T18:29:44.575344+0000","last_became_peered":"2024-05-08T18:29:44.575344+0000","last_unstale":"2024-05-08T18:31:55.647329+0000","last_undegraded":"2024-05-08T18:31:55.647329+0000","last_fullsized":"2024-05-08T18:31:55.647329+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:19.731003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"84'16","reported_seq":154,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.649645+0000","last_change":"2024-05-08T18:29:46.584785+0000","last_active":"2024-05-08T18:31:54.649645+0000","last_peered":"2024-05-08T18:31:54.649645+0000","last_clean":"2024-05-08T18:31:54.649645+0000","last_became_active":"2024-05-08T18:29:46.583390+0000","last_became_peered":"2024-05-08T18:29:46.583390+0000","last_unstale":"2024-05-08T18:31:54.649645+0000","last_undegraded":"2024-05-08T18:31:54.649645+0000","last_fullsized":"2024-05-08T18:31:54.649645+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:27:01.747339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":127,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.957978+0000","last_change":"2024-05-08T18:29:48.643558+0000","last_active":"2024-05-08T18:31:54.957978+0000","last_peered":"2024-05-08T18:31:54.957978+0000","last_clean":"2024-05-08T18:31:54.957978+0000","last_became_active":"2024-05-08T18:29:48.642773+0000","last_became_peered":"2024-05-08T18:29:48.642773+0000","last_unstale":"2024-05-08T18:31:54.957978+0000","last_undegraded":"2024-05-08T18:31:54.957978+0000","last_fullsized":"2024-05-08T18:31:54.957978+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:59:04.369806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":120,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.471339+0000","last_change":"2024-05-08T18:29:50.674796+0000","last_active":"2024-05-08T18:31:55.471339+0000","last_peered":"2024-05-08T18:31:55.471339+0000","last_clean":"2024-05-08T18:31:55.471339+0000","last_became_active":"2024-05-08T18:29:50.674057+0000","last_became_peered":"2024-05-08T18:29:50.674057+0000","last_unstale":"2024-05-08T18:31:55.471339+0000","last_undegraded":"2024-05-08T18:31:55.471339+0000","last_fullsized":"2024-05-08T18:31:55.471339+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:34:14.488295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"84'4","reported_seq":144,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-08T18:31:53.616488+0000","last_change":"2024-05-08T18:29:42.577642+0000","last_active":"2024-05-08T18:31:53.616488+0000","last_peered":"2024-05-08T18:31:53.616488+0000","last_clean":"2024-05-08T18:31:53.616488+0000","last_became_active":"2024-05-08T18:29:42.577275+0000","last_became_peered":"2024-05-08T18:29:42.577275+0000","last_unstale":"2024-05-08T18:31:53.616488+0000","last_undegraded":"2024-05-08T18:31:53.616488+0000","last_fullsized":"2024-05-08T18:31:53.616488+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:51:45.155037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"82'4","reported_seq":146,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.648921+0000","last_change":"2024-05-08T18:29:40.562873+0000","last_active":"2024-05-08T18:31:54.648921+0000","last_peered":"2024-05-08T18:31:54.648921+0000","last_clean":"2024-05-08T18:31:54.648921+0000","last_became_active":"2024-05-08T18:29:40.562594+0000","last_became_peered":"2024-05-08T18:29:40.562594+0000","last_unstale":"2024-05-08T18:31:54.648921+0000","last_undegraded":"2024-05-08T18:31:54.648921+0000","last_fullsized":"2024-05-08T18:31:54.648921+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:16:16.521258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":134,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.957660+0000","last_change":"2024-05-08T18:29:44.594152+0000","last_active":"2024-05-08T18:31:54.957660+0000","last_peered":"2024-05-08T18:31:54.957660+0000","last_clean":"2024-05-08T18:31:54.957660+0000","last_became_active":"2024-05-08T18:29:44.593398+0000","last_became_peered":"2024-05-08T18:29:44.593398+0000","last_unstale":"2024-05-08T18:31:54.957660+0000","last_undegraded":"2024-05-08T18:31:54.957660+0000","last_fullsized":"2024-05-08T18:31:54.957660+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:11.825480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"85'12","reported_seq":150,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.647072+0000","last_change":"2024-05-08T18:29:46.602137+0000","last_active":"2024-05-08T18:31:55.647072+0000","last_peered":"2024-05-08T18:31:55.647072+0000","last_clean":"2024-05-08T18:31:55.647072+0000","last_became_active":"2024-05-08T18:29:46.601402+0000","last_became_peered":"2024-05-08T18:29:46.601402+0000","last_unstale":"2024-05-08T18:31:55.647072+0000","last_undegraded":"2024-05-08T18:31:55.647072+0000","last_fullsized":"2024-05-08T18:31:55.647072+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:23.940519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":22,"num_read_kb":17,"num_write":24,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"84'86","reported_seq":245,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.470149+0000","last_change":"2024-05-08T18:29:48.635696+0000","last_active":"2024-05-08T18:31:55.470149+0000","last_peered":"2024-05-08T18:31:55.470149+0000","last_clean":"2024-05-08T18:31:55.470149+0000","last_became_active":"2024-05-08T18:29:48.634859+0000","last_became_peered":"2024-05-08T18:29:48.634859+0000","last_unstale":"2024-05-08T18:31:55.470149+0000","last_undegraded":"2024-05-08T18:31:55.470149+0000","last_fullsized":"2024-05-08T18:31:55.470149+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:35:55.322495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":119,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.642505+0000","last_change":"2024-05-08T18:29:50.679757+0000","last_active":"2024-05-08T18:31:54.642505+0000","last_peered":"2024-05-08T18:31:54.642505+0000","last_clean":"2024-05-08T18:31:54.642505+0000","last_became_active":"2024-05-08T18:29:50.679011+0000","last_became_peered":"2024-05-08T18:29:50.679011+0000","last_unstale":"2024-05-08T18:31:54.642505+0000","last_undegraded":"2024-05-08T18:31:54.642505+0000","last_fullsized":"2024-05-08T18:31:54.642505+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:34:14.488295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"84'8","reported_seq":160,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.645384+0000","last_change":"2024-05-08T18:29:42.560354+0000","last_active":"2024-05-08T18:31:55.645384+0000","last_peered":"2024-05-08T18:31:55.645384+0000","last_clean":"2024-05-08T18:31:55.645384+0000","last_became_active":"2024-05-08T18:29:42.559647+0000","last_became_peered":"2024-05-08T18:29:42.559647+0000","last_unstale":"2024-05-08T18:31:55.645384+0000","last_undegraded":"2024-05-08T18:31:55.645384+0000","last_fullsized":"2024-05-08T18:31:55.645384+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:18:10.803989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"84'7","reported_seq":147,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.469537+0000","last_change":"2024-05-08T18:29:40.557683+0000","last_active":"2024-05-08T18:31:55.469537+0000","last_peered":"2024-05-08T18:31:55.469537+0000","last_clean":"2024-05-08T18:31:55.469537+0000","last_became_active":"2024-05-08T18:29:40.556254+0000","last_became_peered":"2024-05-08T18:29:40.556254+0000","last_unstale":"2024-05-08T18:31:55.469537+0000","last_undegraded":"2024-05-08T18:31:55.469537+0000","last_fullsized":"2024-05-08T18:31:55.469537+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:51:43.135322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":131,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.643116+0000","last_change":"2024-05-08T18:29:44.594068+0000","last_active":"2024-05-08T18:31:54.643116+0000","last_peered":"2024-05-08T18:31:54.643116+0000","last_clean":"2024-05-08T18:31:54.643116+0000","last_became_active":"2024-05-08T18:29:44.593322+0000","last_became_peered":"2024-05-08T18:29:44.593322+0000","last_unstale":"2024-05-08T18:31:54.643116+0000","last_undegraded":"2024-05-08T18:31:54.643116+0000","last_fullsized":"2024-05-08T18:31:54.643116+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:19.731003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"84'21","reported_seq":159,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.471605+0000","last_change":"2024-05-08T18:29:46.604700+0000","last_active":"2024-05-08T18:31:55.471605+0000","last_peered":"2024-05-08T18:31:55.471605+0000","last_clean":"2024-05-08T18:31:55.471605+0000","last_became_active":"2024-05-08T18:29:46.603885+0000","last_became_peered":"2024-05-08T18:29:46.603885+0000","last_unstale":"2024-05-08T18:31:55.471605+0000","last_undegraded":"2024-05-08T18:31:55.471605+0000","last_fullsized":"2024-05-08T18:31:55.471605+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:22:36.338527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9698,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":18,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":126,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.643185+0000","last_change":"2024-05-08T18:29:48.640814+0000","last_active":"2024-05-08T18:31:54.643185+0000","last_peered":"2024-05-08T18:31:54.643185+0000","last_clean":"2024-05-08T18:31:54.643185+0000","last_became_active":"2024-05-08T18:29:48.640046+0000","last_became_peered":"2024-05-08T18:29:48.640046+0000","last_unstale":"2024-05-08T18:31:54.643185+0000","last_undegraded":"2024-05-08T18:31:54.643185+0000","last_fullsized":"2024-05-08T18:31:54.643185+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:53:21.219706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"83'8","reported_seq":133,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.645409+0000","last_change":"2024-05-08T18:29:50.692688+0000","last_active":"2024-05-08T18:31:54.645409+0000","last_peered":"2024-05-08T18:31:54.645409+0000","last_clean":"2024-05-08T18:31:54.645409+0000","last_became_active":"2024-05-08T18:29:50.692123+0000","last_became_peered":"2024-05-08T18:29:50.692123+0000","last_unstale":"2024-05-08T18:31:54.645409+0000","last_undegraded":"2024-05-08T18:31:54.645409+0000","last_fullsized":"2024-05-08T18:31:54.645409+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:38.318890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":140,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.646350+0000","last_change":"2024-05-08T18:29:42.558336+0000","last_active":"2024-05-08T18:31:55.646350+0000","last_peered":"2024-05-08T18:31:55.646350+0000","last_clean":"2024-05-08T18:31:55.646350+0000","last_became_active":"2024-05-08T18:29:42.557570+0000","last_became_peered":"2024-05-08T18:29:42.557570+0000","last_unstale":"2024-05-08T18:31:55.646350+0000","last_undegraded":"2024-05-08T18:31:55.646350+0000","last_fullsized":"2024-05-08T18:31:55.646350+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:54:16.539832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"84'2","reported_seq":142,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.470174+0000","last_change":"2024-05-08T18:29:40.537090+0000","last_active":"2024-05-08T18:31:55.470174+0000","last_peered":"2024-05-08T18:31:55.470174+0000","last_clean":"2024-05-08T18:31:55.470174+0000","last_became_active":"2024-05-08T18:29:40.536188+0000","last_became_peered":"2024-05-08T18:29:40.536188+0000","last_unstale":"2024-05-08T18:31:55.470174+0000","last_undegraded":"2024-05-08T18:31:55.470174+0000","last_fullsized":"2024-05-08T18:31:55.470174+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:22:48.880581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":132,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.468279+0000","last_change":"2024-05-08T18:29:44.578901+0000","last_active":"2024-05-08T18:31:55.468279+0000","last_peered":"2024-05-08T18:31:55.468279+0000","last_clean":"2024-05-08T18:31:55.468279+0000","last_became_active":"2024-05-08T18:29:44.578171+0000","last_became_peered":"2024-05-08T18:29:44.578171+0000","last_unstale":"2024-05-08T18:31:55.468279+0000","last_undegraded":"2024-05-08T18:31:55.468279+0000","last_fullsized":"2024-05-08T18:31:55.468279+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:19.731003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"84'16","reported_seq":153,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.643185+0000","last_change":"2024-05-08T18:29:46.604539+0000","last_active":"2024-05-08T18:31:54.643185+0000","last_peered":"2024-05-08T18:31:54.643185+0000","last_clean":"2024-05-08T18:31:54.643185+0000","last_became_active":"2024-05-08T18:29:46.603728+0000","last_became_peered":"2024-05-08T18:29:46.603728+0000","last_unstale":"2024-05-08T18:31:54.643185+0000","last_undegraded":"2024-05-08T18:31:54.643185+0000","last_fullsized":"2024-05-08T18:31:54.643185+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:12:41.226788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":123,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.467334+0000","last_change":"2024-05-08T18:29:48.635813+0000","last_active":"2024-05-08T18:31:55.467334+0000","last_peered":"2024-05-08T18:31:55.467334+0000","last_clean":"2024-05-08T18:31:55.467334+0000","last_became_active":"2024-05-08T18:29:48.634664+0000","last_became_peered":"2024-05-08T18:29:48.634664+0000","last_unstale":"2024-05-08T18:31:55.467334+0000","last_undegraded":"2024-05-08T18:31:55.467334+0000","last_fullsized":"2024-05-08T18:31:55.467334+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:27:23.427365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"84'1","reported_seq":122,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.646303+0000","last_change":"2024-05-08T18:29:50.687517+0000","last_active":"2024-05-08T18:31:54.646303+0000","last_peered":"2024-05-08T18:31:54.646303+0000","last_clean":"2024-05-08T18:31:54.646303+0000","last_became_active":"2024-05-08T18:29:50.686662+0000","last_became_peered":"2024-05-08T18:29:50.686662+0000","last_unstale":"2024-05-08T18:31:54.646303+0000","last_undegraded":"2024-05-08T18:31:54.646303+0000","last_fullsized":"2024-05-08T18:31:54.646303+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:58:00.455559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"84'1","reported_seq":138,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.645068+0000","last_change":"2024-05-08T18:29:42.558848+0000","last_active":"2024-05-08T18:31:54.645068+0000","last_peered":"2024-05-08T18:31:54.645068+0000","last_clean":"2024-05-08T18:31:54.645068+0000","last_became_active":"2024-05-08T18:29:42.558390+0000","last_became_peered":"2024-05-08T18:29:42.558390+0000","last_unstale":"2024-05-08T18:31:54.645068+0000","last_undegraded":"2024-05-08T18:31:54.645068+0000","last_fullsized":"2024-05-08T18:31:54.645068+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:55:30.468069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"84'7","reported_seq":150,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.646658+0000","last_change":"2024-05-08T18:29:40.567772+0000","last_active":"2024-05-08T18:31:54.646658+0000","last_peered":"2024-05-08T18:31:54.646658+0000","last_clean":"2024-05-08T18:31:54.646658+0000","last_became_active":"2024-05-08T18:29:40.567482+0000","last_became_peered":"2024-05-08T18:29:40.567482+0000","last_unstale":"2024-05-08T18:31:54.646658+0000","last_undegraded":"2024-05-08T18:31:54.646658+0000","last_fullsized":"2024-05-08T18:31:54.646658+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:36:37.796095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":5,"num_write":17,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":136,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.644711+0000","last_change":"2024-05-08T18:29:44.596876+0000","last_active":"2024-05-08T18:31:55.644711+0000","last_peered":"2024-05-08T18:31:55.644711+0000","last_clean":"2024-05-08T18:31:55.644711+0000","last_became_active":"2024-05-08T18:29:44.595712+0000","last_became_peered":"2024-05-08T18:29:44.595712+0000","last_unstale":"2024-05-08T18:31:55.644711+0000","last_undegraded":"2024-05-08T18:31:55.644711+0000","last_fullsized":"2024-05-08T18:31:55.644711+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:35:51.288126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"84'10","reported_seq":144,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.646389+0000","last_change":"2024-05-08T18:29:46.598637+0000","last_active":"2024-05-08T18:31:54.646389+0000","last_peered":"2024-05-08T18:31:54.646389+0000","last_clean":"2024-05-08T18:31:54.646389+0000","last_became_active":"2024-05-08T18:29:46.597394+0000","last_became_peered":"2024-05-08T18:29:46.597394+0000","last_unstale":"2024-05-08T18:31:54.646389+0000","last_undegraded":"2024-05-08T18:31:54.646389+0000","last_fullsized":"2024-05-08T18:31:54.646389+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:52:22.540814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":128,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.644913+0000","last_change":"2024-05-08T18:29:48.642251+0000","last_active":"2024-05-08T18:31:55.644913+0000","last_peered":"2024-05-08T18:31:55.644913+0000","last_clean":"2024-05-08T18:31:55.644913+0000","last_became_active":"2024-05-08T18:29:48.641666+0000","last_became_peered":"2024-05-08T18:29:48.641666+0000","last_unstale":"2024-05-08T18:31:55.644913+0000","last_undegraded":"2024-05-08T18:31:55.644913+0000","last_fullsized":"2024-05-08T18:31:55.644913+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:13:50.865474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"80'2","reported_seq":122,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.643992+0000","last_change":"2024-05-08T18:29:50.685668+0000","last_active":"2024-05-08T18:31:54.643992+0000","last_peered":"2024-05-08T18:31:54.643992+0000","last_clean":"2024-05-08T18:31:54.643992+0000","last_became_active":"2024-05-08T18:29:50.684958+0000","last_became_peered":"2024-05-08T18:29:50.684958+0000","last_unstale":"2024-05-08T18:31:54.643992+0000","last_undegraded":"2024-05-08T18:31:54.643992+0000","last_fullsized":"2024-05-08T18:31:54.643992+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:55:01.894779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":140,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.645476+0000","last_change":"2024-05-08T18:29:42.562063+0000","last_active":"2024-05-08T18:31:55.645476+0000","last_peered":"2024-05-08T18:31:55.645476+0000","last_clean":"2024-05-08T18:31:55.645476+0000","last_became_active":"2024-05-08T18:29:42.558871+0000","last_became_peered":"2024-05-08T18:29:42.558871+0000","last_unstale":"2024-05-08T18:31:55.645476+0000","last_undegraded":"2024-05-08T18:31:55.645476+0000","last_fullsized":"2024-05-08T18:31:55.645476+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:59.243324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"84'4","reported_seq":147,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.649800+0000","last_change":"2024-05-08T18:29:40.541070+0000","last_active":"2024-05-08T18:31:54.649800+0000","last_peered":"2024-05-08T18:31:54.649800+0000","last_clean":"2024-05-08T18:31:54.649800+0000","last_became_active":"2024-05-08T18:29:40.540767+0000","last_became_peered":"2024-05-08T18:29:40.540767+0000","last_unstale":"2024-05-08T18:31:54.649800+0000","last_undegraded":"2024-05-08T18:31:54.649800+0000","last_fullsized":"2024-05-08T18:31:54.649800+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:09:39.835826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"26'1","reported_seq":135,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.956771+0000","last_change":"2024-05-08T18:29:44.592737+0000","last_active":"2024-05-08T18:31:54.956771+0000","last_peered":"2024-05-08T18:31:54.956771+0000","last_clean":"2024-05-08T18:31:54.956771+0000","last_became_active":"2024-05-08T18:29:44.592243+0000","last_became_peered":"2024-05-08T18:29:44.592243+0000","last_unstale":"2024-05-08T18:31:54.956771+0000","last_undegraded":"2024-05-08T18:31:54.956771+0000","last_fullsized":"2024-05-08T18:31:54.956771+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:59.744050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"84'15","reported_seq":154,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.645440+0000","last_change":"2024-05-08T18:29:46.610835+0000","last_active":"2024-05-08T18:31:55.645440+0000","last_peered":"2024-05-08T18:31:55.645440+0000","last_clean":"2024-05-08T18:31:55.645440+0000","last_became_active":"2024-05-08T18:29:46.609903+0000","last_became_peered":"2024-05-08T18:29:46.609903+0000","last_unstale":"2024-05-08T18:31:55.645440+0000","last_undegraded":"2024-05-08T18:31:55.645440+0000","last_fullsized":"2024-05-08T18:31:55.645440+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:37:35.850414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":126,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.648819+0000","last_change":"2024-05-08T18:29:48.629822+0000","last_active":"2024-05-08T18:31:54.648819+0000","last_peered":"2024-05-08T18:31:54.648819+0000","last_clean":"2024-05-08T18:31:54.648819+0000","last_became_active":"2024-05-08T18:29:48.629204+0000","last_became_peered":"2024-05-08T18:29:48.629204+0000","last_unstale":"2024-05-08T18:31:54.648819+0000","last_undegraded":"2024-05-08T18:31:54.648819+0000","last_fullsized":"2024-05-08T18:31:54.648819+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:04.571608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"84'6","reported_seq":133,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.647539+0000","last_change":"2024-05-08T18:29:50.668101+0000","last_active":"2024-05-08T18:31:55.647539+0000","last_peered":"2024-05-08T18:31:55.647539+0000","last_clean":"2024-05-08T18:31:55.647539+0000","last_became_active":"2024-05-08T18:29:50.667357+0000","last_became_peered":"2024-05-08T18:29:50.667357+0000","last_unstale":"2024-05-08T18:31:55.647539+0000","last_undegraded":"2024-05-08T18:31:55.647539+0000","last_fullsized":"2024-05-08T18:31:55.647539+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:55:01.894779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"84'3","reported_seq":145,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.958697+0000","last_change":"2024-05-08T18:29:42.581366+0000","last_active":"2024-05-08T18:31:54.958697+0000","last_peered":"2024-05-08T18:31:54.958697+0000","last_clean":"2024-05-08T18:31:54.958697+0000","last_became_active":"2024-05-08T18:29:42.580988+0000","last_became_peered":"2024-05-08T18:29:42.580988+0000","last_unstale":"2024-05-08T18:31:54.958697+0000","last_undegraded":"2024-05-08T18:31:54.958697+0000","last_fullsized":"2024-05-08T18:31:54.958697+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:42.005809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"84'9","reported_seq":150,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.467403+0000","last_change":"2024-05-08T18:29:40.562025+0000","last_active":"2024-05-08T18:31:55.467403+0000","last_peered":"2024-05-08T18:31:55.467403+0000","last_clean":"2024-05-08T18:31:55.467403+0000","last_became_active":"2024-05-08T18:29:40.561277+0000","last_became_peered":"2024-05-08T18:29:40.561277+0000","last_unstale":"2024-05-08T18:31:55.467403+0000","last_undegraded":"2024-05-08T18:31:55.467403+0000","last_fullsized":"2024-05-08T18:31:55.467403+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:59:25.840149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":19,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":139,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.958289+0000","last_change":"2024-05-08T18:29:42.573832+0000","last_active":"2024-05-08T18:31:54.958289+0000","last_peered":"2024-05-08T18:31:54.958289+0000","last_clean":"2024-05-08T18:31:54.958289+0000","last_became_active":"2024-05-08T18:29:42.573502+0000","last_became_peered":"2024-05-08T18:29:42.573502+0000","last_unstale":"2024-05-08T18:31:54.958289+0000","last_undegraded":"2024-05-08T18:31:54.958289+0000","last_fullsized":"2024-05-08T18:31:54.958289+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:35.037465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"84'5","reported_seq":144,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-08T18:31:53.615193+0000","last_change":"2024-05-08T18:29:40.533094+0000","last_active":"2024-05-08T18:31:53.615193+0000","last_peered":"2024-05-08T18:31:53.615193+0000","last_clean":"2024-05-08T18:31:53.615193+0000","last_became_active":"2024-05-08T18:29:40.532246+0000","last_became_peered":"2024-05-08T18:29:40.532246+0000","last_unstale":"2024-05-08T18:31:53.615193+0000","last_undegraded":"2024-05-08T18:31:53.615193+0000","last_fullsized":"2024-05-08T18:31:53.615193+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:37:08.242362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":137,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.469313+0000","last_change":"2024-05-08T18:29:42.565298+0000","last_active":"2024-05-08T18:31:55.469313+0000","last_peered":"2024-05-08T18:31:55.469313+0000","last_clean":"2024-05-08T18:31:55.469313+0000","last_became_active":"2024-05-08T18:29:42.564542+0000","last_became_peered":"2024-05-08T18:29:42.564542+0000","last_unstale":"2024-05-08T18:31:55.469313+0000","last_undegraded":"2024-05-08T18:31:55.469313+0000","last_fullsized":"2024-05-08T18:31:55.469313+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:57.706167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"84'8","reported_seq":149,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.469100+0000","last_change":"2024-05-08T18:29:40.556958+0000","last_active":"2024-05-08T18:31:55.469100+0000","last_peered":"2024-05-08T18:31:55.469100+0000","last_clean":"2024-05-08T18:31:55.469100+0000","last_became_active":"2024-05-08T18:29:40.556091+0000","last_became_peered":"2024-05-08T18:29:40.556091+0000","last_unstale":"2024-05-08T18:31:55.469100+0000","last_undegraded":"2024-05-08T18:31:55.469100+0000","last_fullsized":"2024-05-08T18:31:55.469100+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:39.986094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"84'5","reported_seq":150,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.958240+0000","last_change":"2024-05-08T18:29:42.574619+0000","last_active":"2024-05-08T18:31:54.958240+0000","last_peered":"2024-05-08T18:31:54.958240+0000","last_clean":"2024-05-08T18:31:54.958240+0000","last_became_active":"2024-05-08T18:29:42.573178+0000","last_became_peered":"2024-05-08T18:29:42.573178+0000","last_unstale":"2024-05-08T18:31:54.958240+0000","last_undegraded":"2024-05-08T18:31:54.958240+0000","last_fullsized":"2024-05-08T18:31:54.958240+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:33.139089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"84'4","reported_seq":147,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.649220+0000","last_change":"2024-05-08T18:29:40.544338+0000","last_active":"2024-05-08T18:31:54.649220+0000","last_peered":"2024-05-08T18:31:54.649220+0000","last_clean":"2024-05-08T18:31:54.649220+0000","last_became_active":"2024-05-08T18:29:40.544107+0000","last_became_peered":"2024-05-08T18:29:40.544107+0000","last_unstale":"2024-05-08T18:31:54.649220+0000","last_undegraded":"2024-05-08T18:31:54.649220+0000","last_fullsized":"2024-05-08T18:31:54.649220+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:54.200883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"84'2","reported_seq":143,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.646154+0000","last_change":"2024-05-08T18:29:42.576979+0000","last_active":"2024-05-08T18:31:54.646154+0000","last_peered":"2024-05-08T18:31:54.646154+0000","last_clean":"2024-05-08T18:31:54.646154+0000","last_became_active":"2024-05-08T18:29:42.576395+0000","last_became_peered":"2024-05-08T18:29:42.576395+0000","last_unstale":"2024-05-08T18:31:54.646154+0000","last_undegraded":"2024-05-08T18:31:54.646154+0000","last_fullsized":"2024-05-08T18:31:54.646154+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:53:03.097704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"83'2","reported_seq":144,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.647010+0000","last_change":"2024-05-08T18:29:40.558142+0000","last_active":"2024-05-08T18:31:54.647010+0000","last_peered":"2024-05-08T18:31:54.647010+0000","last_clean":"2024-05-08T18:31:54.647010+0000","last_became_active":"2024-05-08T18:29:40.557874+0000","last_became_peered":"2024-05-08T18:29:40.557874+0000","last_unstale":"2024-05-08T18:31:54.647010+0000","last_undegraded":"2024-05-08T18:31:54.647010+0000","last_fullsized":"2024-05-08T18:31:54.647010+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:54.200883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":141,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.646717+0000","last_change":"2024-05-08T18:29:42.558324+0000","last_active":"2024-05-08T18:31:55.646717+0000","last_peered":"2024-05-08T18:31:55.646717+0000","last_clean":"2024-05-08T18:31:55.646717+0000","last_became_active":"2024-05-08T18:29:42.556774+0000","last_became_peered":"2024-05-08T18:29:42.556774+0000","last_unstale":"2024-05-08T18:31:55.646717+0000","last_undegraded":"2024-05-08T18:31:55.646717+0000","last_fullsized":"2024-05-08T18:31:55.646717+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:02:26.311100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"82'2","reported_seq":150,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.957960+0000","last_change":"2024-05-08T18:30:20.858467+0000","last_active":"2024-05-08T18:31:54.957960+0000","last_peered":"2024-05-08T18:31:54.957960+0000","last_clean":"2024-05-08T18:31:54.957960+0000","last_became_active":"2024-05-08T18:30:20.858016+0000","last_became_peered":"2024-05-08T18:30:20.858016+0000","last_unstale":"2024-05-08T18:31:54.957960+0000","last_undegraded":"2024-05-08T18:31:54.957960+0000","last_fullsized":"2024-05-08T18:31:54.957960+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:10:28.824915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"84'4","reported_seq":148,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.644823+0000","last_change":"2024-05-08T18:29:42.562772+0000","last_active":"2024-05-08T18:31:54.644823+0000","last_peered":"2024-05-08T18:31:54.644823+0000","last_clean":"2024-05-08T18:31:54.644823+0000","last_became_active":"2024-05-08T18:29:42.562420+0000","last_became_peered":"2024-05-08T18:29:42.562420+0000","last_unstale":"2024-05-08T18:31:54.644823+0000","last_undegraded":"2024-05-08T18:31:54.644823+0000","last_fullsized":"2024-05-08T18:31:54.644823+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:30:29.452640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"82'2","reported_seq":142,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.470352+0000","last_change":"2024-05-08T18:29:40.562024+0000","last_active":"2024-05-08T18:31:55.470352+0000","last_peered":"2024-05-08T18:31:55.470352+0000","last_clean":"2024-05-08T18:31:55.470352+0000","last_became_active":"2024-05-08T18:29:40.561326+0000","last_became_peered":"2024-05-08T18:29:40.561326+0000","last_unstale":"2024-05-08T18:31:55.470352+0000","last_undegraded":"2024-05-08T18:31:55.470352+0000","last_fullsized":"2024-05-08T18:31:55.470352+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:21:38.354933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"84'3","reported_seq":142,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.467124+0000","last_change":"2024-05-08T18:29:42.561419+0000","last_active":"2024-05-08T18:31:55.467124+0000","last_peered":"2024-05-08T18:31:55.467124+0000","last_clean":"2024-05-08T18:31:55.467124+0000","last_became_active":"2024-05-08T18:29:42.560520+0000","last_became_peered":"2024-05-08T18:29:42.560520+0000","last_unstale":"2024-05-08T18:31:55.467124+0000","last_undegraded":"2024-05-08T18:31:55.467124+0000","last_fullsized":"2024-05-08T18:31:55.467124+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:07.949520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"83'7","reported_seq":149,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.649364+0000","last_change":"2024-05-08T18:29:40.554884+0000","last_active":"2024-05-08T18:31:54.649364+0000","last_peered":"2024-05-08T18:31:54.649364+0000","last_clean":"2024-05-08T18:31:54.649364+0000","last_became_active":"2024-05-08T18:29:40.554603+0000","last_became_peered":"2024-05-08T18:29:40.554603+0000","last_unstale":"2024-05-08T18:31:54.649364+0000","last_undegraded":"2024-05-08T18:31:54.649364+0000","last_fullsized":"2024-05-08T18:31:54.649364+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:09:39.835826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"84'4","reported_seq":148,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.649711+0000","last_change":"2024-05-08T18:29:42.574689+0000","last_active":"2024-05-08T18:31:54.649711+0000","last_peered":"2024-05-08T18:31:54.649711+0000","last_clean":"2024-05-08T18:31:54.649711+0000","last_became_active":"2024-05-08T18:29:42.573947+0000","last_became_peered":"2024-05-08T18:29:42.573947+0000","last_unstale":"2024-05-08T18:31:54.649711+0000","last_undegraded":"2024-05-08T18:31:54.649711+0000","last_fullsized":"2024-05-08T18:31:54.649711+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:57:14.869860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"84'7","reported_seq":148,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.467958+0000","last_change":"2024-05-08T18:29:40.554005+0000","last_active":"2024-05-08T18:31:55.467958+0000","last_peered":"2024-05-08T18:31:55.467958+0000","last_clean":"2024-05-08T18:31:55.467958+0000","last_became_active":"2024-05-08T18:29:40.553356+0000","last_became_peered":"2024-05-08T18:29:40.553356+0000","last_unstale":"2024-05-08T18:31:55.467958+0000","last_undegraded":"2024-05-08T18:31:55.467958+0000","last_fullsized":"2024-05-08T18:31:55.467958+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:08:13.006752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"84'2","reported_seq":145,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.647354+0000","last_change":"2024-05-08T18:29:42.566487+0000","last_active":"2024-05-08T18:31:55.647354+0000","last_peered":"2024-05-08T18:31:55.647354+0000","last_clean":"2024-05-08T18:31:55.647354+0000","last_became_active":"2024-05-08T18:29:42.565760+0000","last_became_peered":"2024-05-08T18:29:42.565760+0000","last_unstale":"2024-05-08T18:31:55.647354+0000","last_undegraded":"2024-05-08T18:31:55.647354+0000","last_fullsized":"2024-05-08T18:31:55.647354+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:57.706167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"83'7","reported_seq":149,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.645146+0000","last_change":"2024-05-08T18:29:40.552543+0000","last_active":"2024-05-08T18:31:54.645146+0000","last_peered":"2024-05-08T18:31:54.645146+0000","last_clean":"2024-05-08T18:31:54.645146+0000","last_became_active":"2024-05-08T18:29:40.552307+0000","last_became_peered":"2024-05-08T18:29:40.552307+0000","last_unstale":"2024-05-08T18:31:54.645146+0000","last_undegraded":"2024-05-08T18:31:54.645146+0000","last_fullsized":"2024-05-08T18:31:54.645146+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:48.294532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"84'4","reported_seq":144,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-08T18:31:53.617654+0000","last_change":"2024-05-08T18:29:42.561658+0000","last_active":"2024-05-08T18:31:53.617654+0000","last_peered":"2024-05-08T18:31:53.617654+0000","last_clean":"2024-05-08T18:31:53.617654+0000","last_became_active":"2024-05-08T18:29:42.561171+0000","last_became_peered":"2024-05-08T18:29:42.561171+0000","last_unstale":"2024-05-08T18:31:53.617654+0000","last_undegraded":"2024-05-08T18:31:53.617654+0000","last_fullsized":"2024-05-08T18:31:53.617654+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:15.966061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"82'5","reported_seq":146,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.468966+0000","last_change":"2024-05-08T18:29:40.543041+0000","last_active":"2024-05-08T18:31:55.468966+0000","last_peered":"2024-05-08T18:31:55.468966+0000","last_clean":"2024-05-08T18:31:55.468966+0000","last_became_active":"2024-05-08T18:29:40.542398+0000","last_became_peered":"2024-05-08T18:29:40.542398+0000","last_unstale":"2024-05-08T18:31:55.468966+0000","last_undegraded":"2024-05-08T18:31:55.468966+0000","last_fullsized":"2024-05-08T18:31:55.468966+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:33.017750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"84'5","reported_seq":151,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.646635+0000","last_change":"2024-05-08T18:29:42.579690+0000","last_active":"2024-05-08T18:31:55.646635+0000","last_peered":"2024-05-08T18:31:55.646635+0000","last_clean":"2024-05-08T18:31:55.646635+0000","last_became_active":"2024-05-08T18:29:42.578981+0000","last_became_peered":"2024-05-08T18:29:42.578981+0000","last_unstale":"2024-05-08T18:31:55.646635+0000","last_undegraded":"2024-05-08T18:31:55.646635+0000","last_fullsized":"2024-05-08T18:31:55.646635+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:36:03.084561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"82'6","reported_seq":149,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.649454+0000","last_change":"2024-05-08T18:29:40.548499+0000","last_active":"2024-05-08T18:31:54.649454+0000","last_peered":"2024-05-08T18:31:54.649454+0000","last_clean":"2024-05-08T18:31:54.649454+0000","last_became_active":"2024-05-08T18:29:40.548177+0000","last_became_peered":"2024-05-08T18:29:40.548177+0000","last_unstale":"2024-05-08T18:31:54.649454+0000","last_undegraded":"2024-05-08T18:31:54.649454+0000","last_fullsized":"2024-05-08T18:31:54.649454+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:27:41.414153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"80'2","reported_seq":140,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.643685+0000","last_change":"2024-05-08T18:29:42.575892+0000","last_active":"2024-05-08T18:31:54.643685+0000","last_peered":"2024-05-08T18:31:54.643685+0000","last_clean":"2024-05-08T18:31:54.643685+0000","last_became_active":"2024-05-08T18:29:42.573384+0000","last_became_peered":"2024-05-08T18:29:42.573384+0000","last_unstale":"2024-05-08T18:31:54.643685+0000","last_undegraded":"2024-05-08T18:31:54.643685+0000","last_fullsized":"2024-05-08T18:31:54.643685+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:55.055481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"82'2","reported_seq":142,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.469842+0000","last_change":"2024-05-08T18:29:40.565068+0000","last_active":"2024-05-08T18:31:55.469842+0000","last_peered":"2024-05-08T18:31:55.469842+0000","last_clean":"2024-05-08T18:31:55.469842+0000","last_became_active":"2024-05-08T18:29:40.563231+0000","last_became_peered":"2024-05-08T18:29:40.563231+0000","last_unstale":"2024-05-08T18:31:55.469842+0000","last_undegraded":"2024-05-08T18:31:55.469842+0000","last_fullsized":"2024-05-08T18:31:55.469842+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:17:47.828990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":138,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.646463+0000","last_change":"2024-05-08T18:29:42.564338+0000","last_active":"2024-05-08T18:31:54.646463+0000","last_peered":"2024-05-08T18:31:54.646463+0000","last_clean":"2024-05-08T18:31:54.646463+0000","last_became_active":"2024-05-08T18:29:42.563822+0000","last_became_peered":"2024-05-08T18:29:42.563822+0000","last_unstale":"2024-05-08T18:31:54.646463+0000","last_undegraded":"2024-05-08T18:31:54.646463+0000","last_fullsized":"2024-05-08T18:31:54.646463+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:23.397435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"83'9","reported_seq":149,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.645111+0000","last_change":"2024-05-08T18:29:40.573333+0000","last_active":"2024-05-08T18:31:54.645111+0000","last_peered":"2024-05-08T18:31:54.645111+0000","last_clean":"2024-05-08T18:31:54.645111+0000","last_became_active":"2024-05-08T18:29:40.571195+0000","last_became_peered":"2024-05-08T18:29:40.571195+0000","last_unstale":"2024-05-08T18:31:54.645111+0000","last_undegraded":"2024-05-08T18:31:54.645111+0000","last_fullsized":"2024-05-08T18:31:54.645111+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:33.017750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":137,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.644818+0000","last_change":"2024-05-08T18:29:42.563085+0000","last_active":"2024-05-08T18:31:54.644818+0000","last_peered":"2024-05-08T18:31:54.644818+0000","last_clean":"2024-05-08T18:31:54.644818+0000","last_became_active":"2024-05-08T18:29:42.560419+0000","last_became_peered":"2024-05-08T18:29:42.560419+0000","last_unstale":"2024-05-08T18:31:54.644818+0000","last_undegraded":"2024-05-08T18:31:54.644818+0000","last_fullsized":"2024-05-08T18:31:54.644818+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:20.397730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"84'4","reported_seq":142,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-05-08T18:31:53.618234+0000","last_change":"2024-05-08T18:29:40.568890+0000","last_active":"2024-05-08T18:31:53.618234+0000","last_peered":"2024-05-08T18:31:53.618234+0000","last_clean":"2024-05-08T18:31:53.618234+0000","last_became_active":"2024-05-08T18:29:40.568584+0000","last_became_peered":"2024-05-08T18:29:40.568584+0000","last_unstale":"2024-05-08T18:31:53.618234+0000","last_undegraded":"2024-05-08T18:31:53.618234+0000","last_fullsized":"2024-05-08T18:31:53.618234+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:25:01.595224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"83'6","reported_seq":145,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.643148+0000","last_change":"2024-05-08T18:29:42.574277+0000","last_active":"2024-05-08T18:31:54.643148+0000","last_peered":"2024-05-08T18:31:54.643148+0000","last_clean":"2024-05-08T18:31:54.643148+0000","last_became_active":"2024-05-08T18:29:42.573563+0000","last_became_peered":"2024-05-08T18:29:42.573563+0000","last_unstale":"2024-05-08T18:31:54.643148+0000","last_undegraded":"2024-05-08T18:31:54.643148+0000","last_fullsized":"2024-05-08T18:31:54.643148+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:57.706167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"84'3","reported_seq":143,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.473054+0000","last_change":"2024-05-08T18:29:40.562058+0000","last_active":"2024-05-08T18:31:55.473054+0000","last_peered":"2024-05-08T18:31:55.473054+0000","last_clean":"2024-05-08T18:31:55.473054+0000","last_became_active":"2024-05-08T18:29:40.561360+0000","last_became_peered":"2024-05-08T18:29:40.561360+0000","last_unstale":"2024-05-08T18:31:55.473054+0000","last_undegraded":"2024-05-08T18:31:55.473054+0000","last_fullsized":"2024-05-08T18:31:55.473054+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:05.929806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"84'8","reported_seq":149,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.467694+0000","last_change":"2024-05-08T18:29:40.538728+0000","last_active":"2024-05-08T18:31:55.467694+0000","last_peered":"2024-05-08T18:31:55.467694+0000","last_clean":"2024-05-08T18:31:55.467694+0000","last_became_active":"2024-05-08T18:29:40.537925+0000","last_became_peered":"2024-05-08T18:29:40.537925+0000","last_unstale":"2024-05-08T18:31:55.467694+0000","last_undegraded":"2024-05-08T18:31:55.467694+0000","last_fullsized":"2024-05-08T18:31:55.467694+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:28.426657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3,"num_read_kb":4,"num_write":18,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"84'6","reported_seq":153,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.649609+0000","last_change":"2024-05-08T18:29:42.574941+0000","last_active":"2024-05-08T18:31:54.649609+0000","last_peered":"2024-05-08T18:31:54.649609+0000","last_clean":"2024-05-08T18:31:54.649609+0000","last_became_active":"2024-05-08T18:29:42.574351+0000","last_became_peered":"2024-05-08T18:29:42.574351+0000","last_unstale":"2024-05-08T18:31:54.649609+0000","last_undegraded":"2024-05-08T18:31:54.649609+0000","last_fullsized":"2024-05-08T18:31:54.649609+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:21.935293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"82'5","reported_seq":147,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:54.957311+0000","last_change":"2024-05-08T18:29:40.543714+0000","last_active":"2024-05-08T18:31:54.957311+0000","last_peered":"2024-05-08T18:31:54.957311+0000","last_clean":"2024-05-08T18:31:54.957311+0000","last_became_active":"2024-05-08T18:29:40.542965+0000","last_became_peered":"2024-05-08T18:29:40.542965+0000","last_unstale":"2024-05-08T18:31:54.957311+0000","last_undegraded":"2024-05-08T18:31:54.957311+0000","last_fullsized":"2024-05-08T18:31:54.957311+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:12:59.146887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":136,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-08T18:31:55.469630+0000","last_change":"2024-05-08T18:29:42.560007+0000","last_active":"2024-05-08T18:31:55.469630+0000","last_peered":"2024-05-08T18:31:55.469630+0000","last_clean":"2024-05-08T18:31:55.469630+0000","last_became_active":"2024-05-08T18:29:42.559028+0000","last_became_peered":"2024-05-08T18:29:42.559028+0000","last_unstale":"2024-05-08T18:31:55.469630+0000","last_undegraded":"2024-05-08T18:31:55.469630+0000","last_fullsized":"2024-05-08T18:31:55.469630+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:36:03.084561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1079,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":197,"num_read_kb":190,"num_write":195,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":688,"ondisk_log_size":688,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":98648,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":794,"num_read_kb":553,"num_write":451,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":458752,"data_stored":157436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":620,"ondisk_log_size":620,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":284,"num_read_kb":284,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":455,"num_read_kb":435,"num_write":195,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":185,"ondisk_log_size":185,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":1352663040,"num_objects":323,"num_object_clones":0,"num_object_copies":646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":323,"num_whiteouts":0,"num_read":18,"num_read_kb":19,"num_write":383,"num_write_kb":1341440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2705326080,"data_stored":2705326080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":333,"ondisk_log_size":333,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509475,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":391228,"kb_used_data":360040,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93980612,"statfs":{"total":96636764160,"available":96236146688,"internally_reserved":0,"allocated":368680960,"data_stored":368180979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509475,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":239068,"kb_used_data":207888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94132772,"statfs":{"total":96636764160,"available":96391958528,"internally_reserved":0,"allocated":212877312,"data_stored":212400724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509473,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":474712,"kb_used_data":443532,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93897128,"statfs":{"total":96636764160,"available":96150659072,"internally_reserved":0,"allocated":454176768,"data_stored":453648471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509473,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":413156,"kb_used_data":381972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93958684,"statfs":{"total":96636764160,"available":96213692416,"internally_reserved":0,"allocated":391139328,"data_stored":390666602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542178,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":462396,"kb_used_data":431212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93909444,"statfs":{"total":96636764160,"available":96163270656,"internally_reserved":0,"allocated":441561088,"data_stored":441055114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542178,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":257488,"kb_used_data":226304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94114352,"statfs":{"total":96636764160,"available":96373096448,"internally_reserved":0,"allocated":231735296,"data_stored":231268639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542176,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":261616,"kb_used_data":230432,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94110224,"statfs":{"total":96636764160,"available":96368869376,"internally_reserved":0,"allocated":235962368,"data_stored":235472985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542178,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":401464,"kb_used_data":370280,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93970376,"statfs":{"total":96636764160,"available":96225665024,"internally_reserved":0,"allocated":379166720,"data_stored":378668573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":377487360,"data_stored":377487360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":234881024,"data_stored":234881024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":230686720,"data_stored":230686720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":440401920,"data_stored":440401920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":390070272,"data_stored":390070272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":452984832,"data_stored":452984832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":211812352,"data_stored":211812352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":367001600,"data_stored":367001600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":12223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":65021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":75918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":21,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T18:31:59.443 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-05-08T18:31:59.444 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-05-08T18:31:59.486 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:31:59.482+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:31:59.530 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-08T18:31:59.586 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:31:59.585+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:31:59.587 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:31:59.587 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:31:59.602 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-08T18:31:59.674 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2024-05-08T18:31:59.674 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:31:59.686 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:31:59.685+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:31:59.694 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2024-05-08T18:31:59.694 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:31:59.715 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-08T18:31:59.725 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2024-05-08T18:31:59.725 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:31:59.745 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2024-05-08T18:31:59.745 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:31:59.756 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:31:59.757 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2024-05-08T18:31:59.757 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2024-05-08T18:31:59.757 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-05-08T18:31:59.757 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.757 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1316 3.0 e81/21 3:03a68e79:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_2:head v 81'1, mlcod=0'0)", 2024-05-08T18:31:59.757 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.318330+0000", 2024-05-08T18:31:59.757 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 17.437139862999999, 2024-05-08T18:31:59.757 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.015176533000000001, 2024-05-08T18:31:59.758 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:59.758 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:59.758 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:59.758 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:59.758 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.758 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:59.758 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.318330+0000", 2024-05-08T18:31:59.758 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:59.758 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.758 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.758 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:59.758 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.318330+0000", 2024-05-08T18:31:59.758 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:59.758 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.759 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.759 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:59.759 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.318333+0000", 2024-05-08T18:31:59.759 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9629999999999998e-06 2024-05-08T18:31:59.759 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.759 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.759 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:59.759 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.323328+0000", 2024-05-08T18:31:59.759 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.004995172 2024-05-08T18:31:59.759 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.759 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.759 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:59.759 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.323366+0000", 2024-05-08T18:31:59.759 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7837999999999999e-05 2024-05-08T18:31:59.760 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.760 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.760 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:59.760 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.323391+0000", 2024-05-08T18:31:59.760 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4913e-05 2024-05-08T18:31:59.760 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.760 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.760 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:59.760 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.323520+0000", 2024-05-08T18:31:59.760 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000129238 2024-05-08T18:31:59.760 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.760 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.760 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:59.760 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.323546+0000", 2024-05-08T18:31:59.761 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5508999999999999e-05 2024-05-08T18:31:59.761 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.761 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.761 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:59.761 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.333439+0000", 2024-05-08T18:31:59.761 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0098928169999999999 2024-05-08T18:31:59.761 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.761 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.761 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:59.761 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.333507+0000", 2024-05-08T18:31:59.761 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8083000000000005e-05 2024-05-08T18:31:59.761 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:59.761 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:59.762 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:59.762 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.762 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.762 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1317 3.2d e81/21 3:b70e9396:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_3:head v 81'1, mlcod=0'0)", 2024-05-08T18:31:59.762 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.331170+0000", 2024-05-08T18:31:59.762 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 17.424299594000001, 2024-05-08T18:31:59.762 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019680382, 2024-05-08T18:31:59.762 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:59.762 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:59.762 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:59.762 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:59.762 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.762 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:59.762 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.331170+0000", 2024-05-08T18:31:59.763 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:59.763 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.763 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.763 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:59.763 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.331170+0000", 2024-05-08T18:31:59.763 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:59.763 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.763 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.763 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:59.763 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.331172+0000", 2024-05-08T18:31:59.763 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.933e-06 2024-05-08T18:31:59.763 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.763 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.763 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:59.764 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.341697+0000", 2024-05-08T18:31:59.764 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010524759999999999 2024-05-08T18:31:59.764 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.764 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.764 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:59.764 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.341753+0000", 2024-05-08T18:31:59.764 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5828000000000001e-05 2024-05-08T18:31:59.764 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.764 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.764 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:59.764 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.341776+0000", 2024-05-08T18:31:59.764 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3379000000000001e-05 2024-05-08T18:31:59.764 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.764 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.765 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:59.765 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.341871+0000", 2024-05-08T18:31:59.765 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.4307000000000004e-05 2024-05-08T18:31:59.765 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.765 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.765 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:59.765 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.341895+0000", 2024-05-08T18:31:59.765 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4629000000000001e-05 2024-05-08T18:31:59.765 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.765 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.765 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:59.765 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.350793+0000", 2024-05-08T18:31:59.765 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0088981219999999996 2024-05-08T18:31:59.765 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.766 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.766 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:59.766 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.350851+0000", 2024-05-08T18:31:59.766 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7423999999999998e-05 2024-05-08T18:31:59.766 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:59.766 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:59.766 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:59.766 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.766 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.766 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1325 3.2d e81/21 3:b7fa4974:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_11:head v 81'2, mlcod=0'0)", 2024-05-08T18:31:59.766 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.444803+0000", 2024-05-08T18:31:59.766 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 17.310666712, 2024-05-08T18:31:59.766 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012603454, 2024-05-08T18:31:59.766 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:59.767 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:59.767 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:59.767 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:59.767 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.767 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:59.767 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.444803+0000", 2024-05-08T18:31:59.767 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:59.767 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.767 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.767 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:59.767 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.444803+0000", 2024-05-08T18:31:59.767 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:59.767 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.767 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.768 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:59.768 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.444805+0000", 2024-05-08T18:31:59.768 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.782e-06 2024-05-08T18:31:59.768 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.768 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.768 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:59.768 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.448805+0000", 2024-05-08T18:31:59.768 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0040002859999999996 2024-05-08T18:31:59.768 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.768 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.768 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:59.768 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.448828+0000", 2024-05-08T18:31:59.768 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2748e-05 2024-05-08T18:31:59.768 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.769 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.769 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:59.769 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.448841+0000", 2024-05-08T18:31:59.769 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2456000000000001e-05 2024-05-08T18:31:59.769 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.769 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.769 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:59.769 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.448917+0000", 2024-05-08T18:31:59.769 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6643000000000005e-05 2024-05-08T18:31:59.769 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.769 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.769 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:59.769 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.448945+0000", 2024-05-08T18:31:59.769 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7656000000000001e-05 2024-05-08T18:31:59.770 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.770 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.770 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:59.770 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.457322+0000", 2024-05-08T18:31:59.770 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0083770990000000007 2024-05-08T18:31:59.770 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.770 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.770 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:59.770 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.457407+0000", 2024-05-08T18:31:59.770 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.4783999999999993e-05 2024-05-08T18:31:59.770 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:59.770 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:59.770 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:59.771 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.771 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.771 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1329 3.21 3:87d2ef9d:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-08T18:31:59.771 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.483324+0000", 2024-05-08T18:31:59.771 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 17.272145789, 2024-05-08T18:31:59.771 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.020245062000000001, 2024-05-08T18:31:59.771 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:59.771 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:59.771 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:59.771 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:59.771 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:59.771 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:59.771 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1329 2024-05-08T18:31:59.771 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.772 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:59.772 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.772 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:59.772 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.483324+0000", 2024-05-08T18:31:59.772 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:59.772 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.772 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.772 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:59.772 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.483324+0000", 2024-05-08T18:31:59.772 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:59.772 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.772 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.772 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:59.772 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.483328+0000", 2024-05-08T18:31:59.773 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3160000000000001e-06 2024-05-08T18:31:59.773 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.773 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.773 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:59.773 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.484909+0000", 2024-05-08T18:31:59.773 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001581325 2024-05-08T18:31:59.773 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.773 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.773 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:59.773 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.484935+0000", 2024-05-08T18:31:59.773 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5746999999999999e-05 2024-05-08T18:31:59.773 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.773 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.774 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:59.774 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.484945+0000", 2024-05-08T18:31:59.774 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0827e-05 2024-05-08T18:31:59.774 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.774 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.774 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:59.774 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.485031+0000", 2024-05-08T18:31:59.774 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5811999999999998e-05 2024-05-08T18:31:59.774 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.774 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.774 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:59.774 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.485229+0000", 2024-05-08T18:31:59.774 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00019749000000000001 2024-05-08T18:31:59.774 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.775 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.775 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:59.775 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.485390+0000", 2024-05-08T18:31:59.775 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000161058 2024-05-08T18:31:59.775 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.775 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.775 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:59.775 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.492144+0000", 2024-05-08T18:31:59.775 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0067546109999999998 2024-05-08T18:31:59.775 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.775 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.775 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:59.775 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.503464+0000", 2024-05-08T18:31:59.775 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011319997 2024-05-08T18:31:59.776 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.776 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.776 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:59.776 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.503515+0000", 2024-05-08T18:31:59.776 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.0132e-05 2024-05-08T18:31:59.776 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.776 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.776 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:59.776 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.503569+0000", 2024-05-08T18:31:59.776 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4747000000000003e-05 2024-05-08T18:31:59.776 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:59.776 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:59.776 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:59.776 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.777 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.777 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1341 3.5 3:a0d72baa:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_27:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:59.777 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.613380+0000", 2024-05-08T18:31:59.777 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 17.142090368000002, 2024-05-08T18:31:59.777 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.016698074, 2024-05-08T18:31:59.777 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:59.777 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:59.777 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:59.777 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:59.777 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:59.777 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:59.777 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1341 2024-05-08T18:31:59.777 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.777 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:59.778 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.778 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:59.778 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.613380+0000", 2024-05-08T18:31:59.778 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:59.778 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.778 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.778 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:59.778 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.613380+0000", 2024-05-08T18:31:59.778 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:59.778 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.778 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.778 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:59.778 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.613382+0000", 2024-05-08T18:31:59.778 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5979999999999999e-06 2024-05-08T18:31:59.779 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.779 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.779 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:59.779 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.615142+0000", 2024-05-08T18:31:59.779 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0017599040000000001 2024-05-08T18:31:59.779 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.779 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.779 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:59.779 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.615174+0000", 2024-05-08T18:31:59.779 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1458000000000003e-05 2024-05-08T18:31:59.779 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.779 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.779 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:59.779 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.615189+0000", 2024-05-08T18:31:59.780 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5809000000000001e-05 2024-05-08T18:31:59.780 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.780 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.780 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:59.780 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.615267+0000", 2024-05-08T18:31:59.780 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7898999999999994e-05 2024-05-08T18:31:59.780 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.780 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.780 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:59.780 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.615393+0000", 2024-05-08T18:31:59.780 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012611999999999999 2024-05-08T18:31:59.780 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.780 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.780 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:59.780 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.615500+0000", 2024-05-08T18:31:59.781 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010621899999999999 2024-05-08T18:31:59.781 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.781 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.781 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:59.781 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.627687+0000", 2024-05-08T18:31:59.781 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012186936000000001 2024-05-08T18:31:59.781 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.781 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.781 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:59.781 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.629963+0000", 2024-05-08T18:31:59.781 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0022760160000000001 2024-05-08T18:31:59.781 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.781 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.781 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:59.782 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.630025+0000", 2024-05-08T18:31:59.782 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.2409999999999994e-05 2024-05-08T18:31:59.782 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.782 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.782 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:59.782 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.630078+0000", 2024-05-08T18:31:59.782 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.2704999999999998e-05 2024-05-08T18:31:59.782 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:59.782 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:59.782 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:59.782 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.782 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.782 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1343 3.39 3:9f4e1e83:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_29:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:59.782 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.634194+0000", 2024-05-08T18:31:59.783 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 17.121276029000001, 2024-05-08T18:31:59.783 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.014278074999999999, 2024-05-08T18:31:59.783 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:59.783 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:59.783 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:59.783 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:59.783 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:59.783 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:59.783 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1343 2024-05-08T18:31:59.783 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.783 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:59.783 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.783 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:59.783 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.634194+0000", 2024-05-08T18:31:59.784 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:59.784 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.784 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.784 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:59.784 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.634194+0000", 2024-05-08T18:31:59.784 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:59.784 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.784 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.784 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:59.784 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.634197+0000", 2024-05-08T18:31:59.784 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0620000000000001e-06 2024-05-08T18:31:59.784 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.784 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.784 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:59.785 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.635963+0000", 2024-05-08T18:31:59.785 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001766098 2024-05-08T18:31:59.785 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.785 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.785 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:59.785 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.635987+0000", 2024-05-08T18:31:59.785 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3360999999999999e-05 2024-05-08T18:31:59.785 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.785 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.785 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:59.785 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.635998+0000", 2024-05-08T18:31:59.785 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1284000000000001e-05 2024-05-08T18:31:59.785 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.785 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.785 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:59.786 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.636079+0000", 2024-05-08T18:31:59.786 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.1493000000000001e-05 2024-05-08T18:31:59.786 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.786 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.786 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:59.786 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.636262+0000", 2024-05-08T18:31:59.786 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00018223999999999999 2024-05-08T18:31:59.786 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.786 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.786 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:59.786 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.636417+0000", 2024-05-08T18:31:59.786 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015549699999999999 2024-05-08T18:31:59.786 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.786 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.787 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:59.787 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.648058+0000", 2024-05-08T18:31:59.787 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011640908 2024-05-08T18:31:59.787 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.787 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.787 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:59.787 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.648354+0000", 2024-05-08T18:31:59.787 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00029571799999999999 2024-05-08T18:31:59.787 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.787 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.787 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:59.787 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.648420+0000", 2024-05-08T18:31:59.787 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6818999999999998e-05 2024-05-08T18:31:59.788 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.788 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.788 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:59.788 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.648472+0000", 2024-05-08T18:31:59.788 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.1595000000000003e-05 2024-05-08T18:31:59.788 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:59.788 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:59.788 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:59.788 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.788 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.788 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1352 3.0 e82/21 3:0085bede:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_38:head v 82'2, mlcod=0'0)", 2024-05-08T18:31:59.788 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.732652+0000", 2024-05-08T18:31:59.788 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 17.022817563, 2024-05-08T18:31:59.788 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010931293, 2024-05-08T18:31:59.789 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:59.789 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:59.789 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:59.789 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:59.789 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.789 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:59.789 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.732652+0000", 2024-05-08T18:31:59.789 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:59.789 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.789 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.789 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:59.789 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.732652+0000", 2024-05-08T18:31:59.789 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:59.789 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.789 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.790 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:59.790 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.732653+0000", 2024-05-08T18:31:59.790 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.13e-07 2024-05-08T18:31:59.790 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.790 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.790 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:59.790 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.734222+0000", 2024-05-08T18:31:59.790 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00156931 2024-05-08T18:31:59.790 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.790 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.790 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:59.790 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.734248+0000", 2024-05-08T18:31:59.790 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.527e-05 2024-05-08T18:31:59.790 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.791 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.791 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:59.791 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.734261+0000", 2024-05-08T18:31:59.791 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3509999999999999e-05 2024-05-08T18:31:59.791 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.791 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.791 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:59.791 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.734331+0000", 2024-05-08T18:31:59.791 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9790999999999996e-05 2024-05-08T18:31:59.791 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.791 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.791 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:59.791 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.734351+0000", 2024-05-08T18:31:59.791 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9775e-05 2024-05-08T18:31:59.792 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.792 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.792 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:59.792 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.743520+0000", 2024-05-08T18:31:59.792 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0091690599999999997 2024-05-08T18:31:59.792 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.792 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.792 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:59.792 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.743584+0000", 2024-05-08T18:31:59.792 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.4064000000000002e-05 2024-05-08T18:31:59.792 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:59.792 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:59.792 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:59.792 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.793 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.793 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1358 3.5 3:a0d2e4cd:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_44:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:59.793 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.792476+0000", 2024-05-08T18:31:59.793 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 16.962993986000001, 2024-05-08T18:31:59.793 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.017319887999999999, 2024-05-08T18:31:59.793 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:59.793 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:59.793 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:59.793 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:59.793 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:59.793 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:59.793 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1358 2024-05-08T18:31:59.793 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.793 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:59.794 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.794 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:59.794 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.792476+0000", 2024-05-08T18:31:59.794 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:59.794 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.794 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.794 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:59.794 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.792476+0000", 2024-05-08T18:31:59.794 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:59.794 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.794 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.794 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:59.794 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.792480+0000", 2024-05-08T18:31:59.794 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6780000000000002e-06 2024-05-08T18:31:59.795 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.795 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.795 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:59.795 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.794611+0000", 2024-05-08T18:31:59.795 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0021309689999999999 2024-05-08T18:31:59.795 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.795 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.795 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:59.795 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.794635+0000", 2024-05-08T18:31:59.795 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4210999999999999e-05 2024-05-08T18:31:59.795 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.795 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.795 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:59.795 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.794646+0000", 2024-05-08T18:31:59.795 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0939e-05 2024-05-08T18:31:59.796 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.796 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.796 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:59.796 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.794720+0000", 2024-05-08T18:31:59.796 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.4257000000000004e-05 2024-05-08T18:31:59.796 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.796 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.796 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:59.796 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.794848+0000", 2024-05-08T18:31:59.796 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000128279 2024-05-08T18:31:59.796 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.796 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.796 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:59.796 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.794981+0000", 2024-05-08T18:31:59.796 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013264099999999999 2024-05-08T18:31:59.797 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.797 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.797 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:59.797 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.806096+0000", 2024-05-08T18:31:59.797 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011114702000000001 2024-05-08T18:31:59.797 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.797 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.797 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:59.797 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.809702+0000", 2024-05-08T18:31:59.797 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0036063660000000002 2024-05-08T18:31:59.797 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.797 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.797 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:59.797 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.809749+0000", 2024-05-08T18:31:59.798 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6564999999999999e-05 2024-05-08T18:31:59.798 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.798 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.798 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:59.798 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.809796+0000", 2024-05-08T18:31:59.798 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7280999999999997e-05 2024-05-08T18:31:59.798 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:59.798 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:59.798 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:59.798 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.798 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.798 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1366 3.39 3:9c29fb9f:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_52:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:59.798 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.873737+0000", 2024-05-08T18:31:59.799 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 16.881732918000001, 2024-05-08T18:31:59.799 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.013710574, 2024-05-08T18:31:59.799 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:59.799 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:59.799 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:59.799 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:59.799 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:59.799 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:59.799 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1366 2024-05-08T18:31:59.799 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.799 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:59.799 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.799 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:59.799 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.873737+0000", 2024-05-08T18:31:59.800 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:59.800 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.800 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.800 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:59.800 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.873737+0000", 2024-05-08T18:31:59.800 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:59.800 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.800 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.800 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:59.800 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.873740+0000", 2024-05-08T18:31:59.800 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2449999999999998e-06 2024-05-08T18:31:59.800 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.800 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.800 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:59.801 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.875455+0000", 2024-05-08T18:31:59.801 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0017145839999999999 2024-05-08T18:31:59.801 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.801 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.801 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:59.801 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.875484+0000", 2024-05-08T18:31:59.801 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9325000000000001e-05 2024-05-08T18:31:59.801 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.801 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.801 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:59.801 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.875499+0000", 2024-05-08T18:31:59.801 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4874e-05 2024-05-08T18:31:59.801 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.801 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.801 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:59.802 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.875571+0000", 2024-05-08T18:31:59.802 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2035999999999999e-05 2024-05-08T18:31:59.802 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.802 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.802 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:59.802 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.875691+0000", 2024-05-08T18:31:59.802 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012016 2024-05-08T18:31:59.802 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.802 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.802 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:59.802 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.875805+0000", 2024-05-08T18:31:59.802 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011333 2024-05-08T18:31:59.802 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.803 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.803 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:59.803 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.886875+0000", 2024-05-08T18:31:59.803 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011069997999999999 2024-05-08T18:31:59.803 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.803 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.803 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:59.803 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.887363+0000", 2024-05-08T18:31:59.803 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00048848499999999998 2024-05-08T18:31:59.803 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.803 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.803 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:59.803 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.887410+0000", 2024-05-08T18:31:59.803 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7264e-05 2024-05-08T18:31:59.803 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.804 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.804 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:59.804 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.887448+0000", 2024-05-08T18:31:59.804 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7273e-05 2024-05-08T18:31:59.804 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:59.804 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:59.804 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:59.804 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.804 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.804 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1370 3.9 e82/21 3:91bbaad9:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_56:head v 82'1, mlcod=0'0)", 2024-05-08T18:31:59.804 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.920855+0000", 2024-05-08T18:31:59.804 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 16.834615239000001, 2024-05-08T18:31:59.804 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.023027817999999999, 2024-05-08T18:31:59.804 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:59.804 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:59.805 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:59.805 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:59.805 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.805 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:59.805 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.920855+0000", 2024-05-08T18:31:59.805 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:59.805 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.805 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.805 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:59.805 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.920855+0000", 2024-05-08T18:31:59.805 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:59.805 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.805 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.805 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:59.806 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.920855+0000", 2024-05-08T18:31:59.806 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7399999999999999e-07 2024-05-08T18:31:59.806 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.806 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.806 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:59.806 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.926227+0000", 2024-05-08T18:31:59.806 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0053715129999999996 2024-05-08T18:31:59.806 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.806 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.806 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:59.806 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.926252+0000", 2024-05-08T18:31:59.806 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5709000000000001e-05 2024-05-08T18:31:59.806 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.806 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.807 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:59.807 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.926265+0000", 2024-05-08T18:31:59.807 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2159e-05 2024-05-08T18:31:59.807 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.807 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.807 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:59.807 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.926339+0000", 2024-05-08T18:31:59.807 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.4058000000000001e-05 2024-05-08T18:31:59.807 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.807 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.807 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:59.807 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.926355+0000", 2024-05-08T18:31:59.807 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6274e-05 2024-05-08T18:31:59.807 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.807 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.808 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:59.808 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.943850+0000", 2024-05-08T18:31:59.808 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.017495502999999999 2024-05-08T18:31:59.808 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.808 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.808 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:59.808 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.943883+0000", 2024-05-08T18:31:59.808 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2227999999999997e-05 2024-05-08T18:31:59.808 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:59.808 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:59.808 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:59.808 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.808 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.808 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1372 3.39 3:9eccad39:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_58:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:59.808 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.936995+0000", 2024-05-08T18:31:59.809 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 16.818475085999999, 2024-05-08T18:31:59.809 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.016484776, 2024-05-08T18:31:59.809 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:59.809 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:59.809 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:59.809 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:59.809 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:59.809 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:59.809 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1372 2024-05-08T18:31:59.809 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.809 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:59.809 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.809 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:59.809 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.936995+0000", 2024-05-08T18:31:59.810 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:59.810 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.810 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.810 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:59.810 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.936995+0000", 2024-05-08T18:31:59.810 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:59.810 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.810 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.810 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:59.810 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.936997+0000", 2024-05-08T18:31:59.810 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3980000000000002e-06 2024-05-08T18:31:59.810 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.810 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.810 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:59.811 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.938982+0000", 2024-05-08T18:31:59.811 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001984591 2024-05-08T18:31:59.811 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.811 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.811 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:59.811 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.939011+0000", 2024-05-08T18:31:59.811 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8598999999999998e-05 2024-05-08T18:31:59.811 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.811 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.811 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:59.811 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.939026+0000", 2024-05-08T18:31:59.811 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5197999999999999e-05 2024-05-08T18:31:59.811 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.811 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.812 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:59.812 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.939106+0000", 2024-05-08T18:31:59.812 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.0656999999999997e-05 2024-05-08T18:31:59.812 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.812 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.812 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:59.812 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.939250+0000", 2024-05-08T18:31:59.812 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000143516 2024-05-08T18:31:59.812 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.812 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.812 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:59.812 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.939357+0000", 2024-05-08T18:31:59.812 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000107261 2024-05-08T18:31:59.812 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.813 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.813 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:59.813 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.953303+0000", 2024-05-08T18:31:59.813 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.013946188999999999 2024-05-08T18:31:59.813 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.813 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.813 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:59.813 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.953356+0000", 2024-05-08T18:31:59.813 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.2222000000000002e-05 2024-05-08T18:31:59.813 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.813 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.813 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:59.813 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.953425+0000", 2024-05-08T18:31:59.813 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9265999999999997e-05 2024-05-08T18:31:59.814 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.814 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.814 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:59.814 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.953480+0000", 2024-05-08T18:31:59.814 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4879000000000001e-05 2024-05-08T18:31:59.814 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:59.814 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:59.814 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:59.814 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.814 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.815 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1375 3.39 3:9c8c420a:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_61:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:59.815 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.971052+0000", 2024-05-08T18:31:59.815 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 16.7844181, 2024-05-08T18:31:59.815 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.013332797, 2024-05-08T18:31:59.815 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:59.815 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:59.815 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:59.815 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:59.815 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:59.815 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:59.815 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1375 2024-05-08T18:31:59.815 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.815 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:59.816 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.816 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:59.816 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.971052+0000", 2024-05-08T18:31:59.816 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:59.816 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.816 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.816 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:59.816 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.971052+0000", 2024-05-08T18:31:59.816 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:59.816 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.816 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.816 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:59.816 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.971055+0000", 2024-05-08T18:31:59.816 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.977e-06 2024-05-08T18:31:59.816 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.817 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.817 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:59.817 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.972822+0000", 2024-05-08T18:31:59.817 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0017668619999999999 2024-05-08T18:31:59.817 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.817 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.817 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:59.817 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.972846+0000", 2024-05-08T18:31:59.817 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4519999999999999e-05 2024-05-08T18:31:59.817 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.817 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.817 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:59.817 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.972857+0000", 2024-05-08T18:31:59.817 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0457e-05 2024-05-08T18:31:59.818 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.818 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.818 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:59.818 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.972935+0000", 2024-05-08T18:31:59.818 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.8650000000000001e-05 2024-05-08T18:31:59.818 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.818 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.818 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:59.818 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.973121+0000", 2024-05-08T18:31:59.818 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000185816 2024-05-08T18:31:59.818 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.818 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.818 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0", 2024-05-08T18:31:59.819 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.973289+0000", 2024-05-08T18:31:59.819 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016798299999999999 2024-05-08T18:31:59.819 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.819 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.819 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:59.819 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.983934+0000", 2024-05-08T18:31:59.819 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010644733999999999 2024-05-08T18:31:59.819 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.819 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.819 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:59.819 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.984287+0000", 2024-05-08T18:31:59.819 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00035295200000000002 2024-05-08T18:31:59.819 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.819 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.819 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:59.820 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.984342+0000", 2024-05-08T18:31:59.820 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5282999999999999e-05 2024-05-08T18:31:59.820 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.820 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.820 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:59.820 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.984385+0000", 2024-05-08T18:31:59.820 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.2562999999999999e-05 2024-05-08T18:31:59.820 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:59.820 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:59.820 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:59.820 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.820 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.820 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1384 3.5 3:a0f4371d:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_70:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:31:59.820 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:43.093875+0000", 2024-05-08T18:31:59.821 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 16.661594985000001, 2024-05-08T18:31:59.821 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.013806097999999999, 2024-05-08T18:31:59.821 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:59.821 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:59.821 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:59.821 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:59.821 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:59.821 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:59.821 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1384 2024-05-08T18:31:59.821 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.821 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:59.821 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.821 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:59.821 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.093875+0000", 2024-05-08T18:31:59.821 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:59.822 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.822 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.822 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:59.822 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.093875+0000", 2024-05-08T18:31:59.822 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:59.822 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.822 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.822 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:59.822 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.093878+0000", 2024-05-08T18:31:59.822 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8990000000000001e-06 2024-05-08T18:31:59.822 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.822 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.822 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:59.822 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.095579+0000", 2024-05-08T18:31:59.823 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001700628 2024-05-08T18:31:59.823 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.823 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.823 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:59.823 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.095608+0000", 2024-05-08T18:31:59.823 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9371000000000001e-05 2024-05-08T18:31:59.823 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.823 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.823 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:59.823 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.095626+0000", 2024-05-08T18:31:59.823 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8221999999999999e-05 2024-05-08T18:31:59.823 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.823 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.823 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:59.823 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.095722+0000", 2024-05-08T18:31:59.824 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.5963000000000003e-05 2024-05-08T18:31:59.824 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.824 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.824 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:59.824 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.095908+0000", 2024-05-08T18:31:59.824 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00018594999999999999 2024-05-08T18:31:59.824 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.824 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.824 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:59.824 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.096081+0000", 2024-05-08T18:31:59.824 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00017264799999999999 2024-05-08T18:31:59.824 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.824 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.824 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:59.825 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.107122+0000", 2024-05-08T18:31:59.825 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011041249 2024-05-08T18:31:59.825 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.825 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.825 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:59.825 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.107565+0000", 2024-05-08T18:31:59.825 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00044287999999999999 2024-05-08T18:31:59.825 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.825 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.825 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:59.825 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.107630+0000", 2024-05-08T18:31:59.825 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.4745000000000004e-05 2024-05-08T18:31:59.825 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.825 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.826 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:59.826 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.107681+0000", 2024-05-08T18:31:59.826 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.1542999999999998e-05 2024-05-08T18:31:59.826 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:59.826 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:59.826 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:59.826 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.826 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.826 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1390 3.0 e82/21 3:00a67f20:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_76:head v 82'3, mlcod=81'1)", 2024-05-08T18:31:59.826 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:43.176277+0000", 2024-05-08T18:31:59.826 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 16.579192577000001, 2024-05-08T18:31:59.826 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012246539000000001, 2024-05-08T18:31:59.826 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:59.826 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:59.827 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:59.827 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:59.827 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.827 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:59.827 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.176277+0000", 2024-05-08T18:31:59.827 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:59.827 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.827 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.827 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:59.827 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.176277+0000", 2024-05-08T18:31:59.827 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:59.827 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.827 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.827 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:59.828 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.176279+0000", 2024-05-08T18:31:59.828 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.001e-06 2024-05-08T18:31:59.828 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.828 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.828 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:59.828 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.178169+0000", 2024-05-08T18:31:59.828 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0018891100000000001 2024-05-08T18:31:59.828 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.828 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.828 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:59.828 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.178202+0000", 2024-05-08T18:31:59.828 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3315999999999997e-05 2024-05-08T18:31:59.828 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.828 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.829 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:59.829 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.178218+0000", 2024-05-08T18:31:59.829 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5889999999999999e-05 2024-05-08T18:31:59.829 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.829 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.829 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:59.829 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.178308+0000", 2024-05-08T18:31:59.829 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0080000000000005e-05 2024-05-08T18:31:59.829 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.829 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.829 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:59.829 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.178346+0000", 2024-05-08T18:31:59.829 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7931e-05 2024-05-08T18:31:59.829 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.829 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.830 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:59.830 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.188460+0000", 2024-05-08T18:31:59.830 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010113715000000001 2024-05-08T18:31:59.830 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.830 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.830 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:59.830 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.188524+0000", 2024-05-08T18:31:59.830 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.4496e-05 2024-05-08T18:31:59.830 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:59.830 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:59.830 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:59.830 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.830 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.830 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1402 3.2d e82/21 3:b43c4320:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_88:head v 82'3, mlcod=81'1)", 2024-05-08T18:31:59.831 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:43.297364+0000", 2024-05-08T18:31:59.831 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 16.458106306000001, 2024-05-08T18:31:59.831 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.013017687999999999, 2024-05-08T18:31:59.831 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:59.831 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:59.831 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:59.831 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:59.831 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.831 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:59.831 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.297364+0000", 2024-05-08T18:31:59.831 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:59.831 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.831 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.831 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:59.832 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.297364+0000", 2024-05-08T18:31:59.832 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:59.832 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.832 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.832 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:59.832 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.297364+0000", 2024-05-08T18:31:59.832 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.16e-07 2024-05-08T18:31:59.832 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.832 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.832 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:59.832 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.302711+0000", 2024-05-08T18:31:59.832 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0053466039999999996 2024-05-08T18:31:59.832 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.832 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.833 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:59.833 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.302747+0000", 2024-05-08T18:31:59.833 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6823000000000003e-05 2024-05-08T18:31:59.833 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.833 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.833 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:59.833 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.302761+0000", 2024-05-08T18:31:59.833 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4028e-05 2024-05-08T18:31:59.833 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.833 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.833 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:59.833 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.302846+0000", 2024-05-08T18:31:59.833 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.4775000000000001e-05 2024-05-08T18:31:59.833 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.833 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.834 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:59.834 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.302876+0000", 2024-05-08T18:31:59.834 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9882e-05 2024-05-08T18:31:59.834 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.834 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.834 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:59.834 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.310331+0000", 2024-05-08T18:31:59.834 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0074546320000000001 2024-05-08T18:31:59.834 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.834 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.834 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:59.834 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.310381+0000", 2024-05-08T18:31:59.835 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.0727999999999999e-05 2024-05-08T18:31:59.835 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:59.835 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:59.835 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:59.835 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.835 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.835 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1613 3.3d e83/21 3:bcbc5fe8:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_1:head v 83'3, mlcod=81'1)", 2024-05-08T18:31:59.835 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:46.699842+0000", 2024-05-08T18:31:59.835 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 13.05562757, 2024-05-08T18:31:59.835 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012876298, 2024-05-08T18:31:59.835 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:59.835 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:59.835 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:59.835 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:59.836 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.836 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:59.836 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.699842+0000", 2024-05-08T18:31:59.836 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:59.836 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.836 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.836 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:59.836 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.699842+0000", 2024-05-08T18:31:59.836 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:59.836 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.836 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.836 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:59.836 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.699845+0000", 2024-05-08T18:31:59.836 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.04e-06 2024-05-08T18:31:59.837 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.837 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.837 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:59.837 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.702634+0000", 2024-05-08T18:31:59.837 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0027896010000000001 2024-05-08T18:31:59.837 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.837 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.837 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:59.837 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.702660+0000", 2024-05-08T18:31:59.837 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6265999999999999e-05 2024-05-08T18:31:59.837 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.837 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.837 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:59.837 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.702674+0000", 2024-05-08T18:31:59.837 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3297e-05 2024-05-08T18:31:59.838 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.838 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.838 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:59.838 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.702759+0000", 2024-05-08T18:31:59.838 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5110000000000003e-05 2024-05-08T18:31:59.838 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.838 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.838 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:59.838 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.702789+0000", 2024-05-08T18:31:59.838 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0434999999999999e-05 2024-05-08T18:31:59.838 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.838 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.838 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:59.839 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.712639+0000", 2024-05-08T18:31:59.839 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0098496850000000004 2024-05-08T18:31:59.839 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.839 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.839 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:59.839 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.712719+0000", 2024-05-08T18:31:59.839 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.9864000000000006e-05 2024-05-08T18:31:59.839 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:59.839 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:59.839 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:59.839 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.839 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.839 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1621 3.5 3:a3bb7dd2:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-05-08T18:31:59.839 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:46.781044+0000", 2024-05-08T18:31:59.840 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 12.974426454, 2024-05-08T18:31:59.840 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.016696294, 2024-05-08T18:31:59.840 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:59.840 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:59.840 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:59.840 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:59.840 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:59.840 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:59.840 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1621 2024-05-08T18:31:59.840 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.840 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:59.840 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.840 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:59.840 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.781044+0000", 2024-05-08T18:31:59.841 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:59.841 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.841 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.841 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:59.841 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.781044+0000", 2024-05-08T18:31:59.841 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:59.841 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.841 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.841 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:59.841 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.781047+0000", 2024-05-08T18:31:59.841 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9009999999999996e-06 2024-05-08T18:31:59.841 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.841 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.842 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:59.842 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.782953+0000", 2024-05-08T18:31:59.842 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001905985 2024-05-08T18:31:59.842 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.842 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.842 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:59.842 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.782984+0000", 2024-05-08T18:31:59.842 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0568000000000003e-05 2024-05-08T18:31:59.842 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.842 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.842 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:59.842 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.782998+0000", 2024-05-08T18:31:59.842 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3499000000000001e-05 2024-05-08T18:31:59.843 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.843 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.843 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:59.843 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.783072+0000", 2024-05-08T18:31:59.843 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.4104999999999996e-05 2024-05-08T18:31:59.843 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.843 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.843 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:59.843 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.783226+0000", 2024-05-08T18:31:59.843 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015405900000000001 2024-05-08T18:31:59.843 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.843 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.843 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 3", 2024-05-08T18:31:59.843 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.783377+0000", 2024-05-08T18:31:59.844 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015162500000000001 2024-05-08T18:31:59.844 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.844 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.844 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:59.844 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.796988+0000", 2024-05-08T18:31:59.844 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.013610652000000001 2024-05-08T18:31:59.844 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.844 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.844 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:59.844 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.797630+0000", 2024-05-08T18:31:59.844 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00064184599999999995 2024-05-08T18:31:59.844 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.844 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.844 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:59.845 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.797692+0000", 2024-05-08T18:31:59.845 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.2396000000000004e-05 2024-05-08T18:31:59.845 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.845 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.845 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:59.845 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.797740+0000", 2024-05-08T18:31:59.845 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7657999999999997e-05 2024-05-08T18:31:59.845 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:59.845 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:59.845 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:59.845 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.845 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.845 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1624 3.3d e83/21 3:bc2f41f0:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_12:head v 83'4, mlcod=82'2)", 2024-05-08T18:31:59.845 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:46.814956+0000", 2024-05-08T18:31:59.846 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 12.940513632, 2024-05-08T18:31:59.846 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.022594933000000001, 2024-05-08T18:31:59.846 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:59.846 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:59.846 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:59.846 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:59.846 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.846 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:59.846 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.814956+0000", 2024-05-08T18:31:59.846 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:59.846 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.846 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.846 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:59.846 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.814956+0000", 2024-05-08T18:31:59.847 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:59.847 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.847 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.847 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:59.847 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.814959+0000", 2024-05-08T18:31:59.847 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.339e-06 2024-05-08T18:31:59.847 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.847 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.847 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:59.847 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.818131+0000", 2024-05-08T18:31:59.847 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031725149999999999 2024-05-08T18:31:59.847 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.847 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.847 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:59.847 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.818171+0000", 2024-05-08T18:31:59.848 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9295000000000002e-05 2024-05-08T18:31:59.848 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.848 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.848 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:59.848 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.818191+0000", 2024-05-08T18:31:59.848 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0329000000000001e-05 2024-05-08T18:31:59.848 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.848 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.848 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:59.848 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.818363+0000", 2024-05-08T18:31:59.848 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000172337 2024-05-08T18:31:59.848 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.848 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.848 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:59.849 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.818415+0000", 2024-05-08T18:31:59.849 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.2203999999999997e-05 2024-05-08T18:31:59.849 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.849 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.849 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:59.849 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.837470+0000", 2024-05-08T18:31:59.849 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019054950000000001 2024-05-08T18:31:59.849 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.849 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.849 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:59.849 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.837551+0000", 2024-05-08T18:31:59.849 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.0964000000000006e-05 2024-05-08T18:31:59.849 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:59.849 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:59.850 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:59.850 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.850 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.850 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1632 3.21 3:86ca081f:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_20:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-05-08T18:31:59.850 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:46.903772+0000", 2024-05-08T18:31:59.850 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 12.851698522, 2024-05-08T18:31:59.850 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.015516323, 2024-05-08T18:31:59.850 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:59.850 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:59.850 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:59.850 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:31:59.850 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:31:59.850 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:31:59.850 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1632 2024-05-08T18:31:59.851 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.851 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:59.851 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.851 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:59.851 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.903772+0000", 2024-05-08T18:31:59.851 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:59.851 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.851 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.851 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:59.851 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.903772+0000", 2024-05-08T18:31:59.851 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:59.851 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.851 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.851 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:59.852 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.903774+0000", 2024-05-08T18:31:59.852 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8040000000000002e-06 2024-05-08T18:31:59.852 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.852 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.852 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:59.852 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.905653+0000", 2024-05-08T18:31:59.852 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001878872 2024-05-08T18:31:59.852 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.852 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.852 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:59.852 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.905675+0000", 2024-05-08T18:31:59.852 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2238999999999998e-05 2024-05-08T18:31:59.852 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.852 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.853 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:59.853 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.905686+0000", 2024-05-08T18:31:59.853 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0145e-05 2024-05-08T18:31:59.853 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.853 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.853 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:59.853 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.905748+0000", 2024-05-08T18:31:59.853 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.2595000000000006e-05 2024-05-08T18:31:59.853 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.853 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.853 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:59.853 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.905871+0000", 2024-05-08T18:31:59.853 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012235999999999999 2024-05-08T18:31:59.853 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.854 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.854 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:31:59.854 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.905986+0000", 2024-05-08T18:31:59.854 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115025 2024-05-08T18:31:59.854 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.854 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.854 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:31:59.854 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.910243+0000", 2024-05-08T18:31:59.854 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0042571099999999997 2024-05-08T18:31:59.854 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.854 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.854 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:31:59.854 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.919213+0000", 2024-05-08T18:31:59.854 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.008970347 2024-05-08T18:31:59.855 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.855 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.855 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:59.855 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.919255+0000", 2024-05-08T18:31:59.855 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.1909000000000001e-05 2024-05-08T18:31:59.855 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.855 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.855 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:59.855 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.919288+0000", 2024-05-08T18:31:59.855 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2916999999999997e-05 2024-05-08T18:31:59.855 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:59.855 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:59.855 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:59.855 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.856 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.856 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1638 3.9 e83/21 3:9152f27e:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5_100Mb.:head v 83'6, mlcod=82'4)", 2024-05-08T18:31:59.856 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:46.971157+0000", 2024-05-08T18:31:59.856 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 12.784312805000001, 2024-05-08T18:31:59.856 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012153826, 2024-05-08T18:31:59.856 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:31:59.856 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:31:59.856 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:31:59.856 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:31:59.856 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.856 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:31:59.856 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.971157+0000", 2024-05-08T18:31:59.856 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:59.856 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.856 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.857 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:31:59.857 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.971157+0000", 2024-05-08T18:31:59.857 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:31:59.857 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.857 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.857 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:31:59.857 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.971159+0000", 2024-05-08T18:31:59.857 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.499e-06 2024-05-08T18:31:59.857 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.857 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.857 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:31:59.857 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.976606+0000", 2024-05-08T18:31:59.857 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0054470500000000002 2024-05-08T18:31:59.857 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.858 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.858 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:31:59.858 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.976627+0000", 2024-05-08T18:31:59.858 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1109000000000001e-05 2024-05-08T18:31:59.858 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.858 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.858 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:31:59.858 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.976639+0000", 2024-05-08T18:31:59.858 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2544000000000001e-05 2024-05-08T18:31:59.858 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.858 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.858 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:31:59.858 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.976762+0000", 2024-05-08T18:31:59.858 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012254 2024-05-08T18:31:59.859 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.859 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.859 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:31:59.859 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.976787+0000", 2024-05-08T18:31:59.859 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4683999999999999e-05 2024-05-08T18:31:59.859 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.859 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.859 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:31:59.859 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.983270+0000", 2024-05-08T18:31:59.859 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0064833010000000003 2024-05-08T18:31:59.859 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:31:59.859 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:31:59.859 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:31:59.859 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.983311+0000", 2024-05-08T18:31:59.860 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.1099000000000001e-05 2024-05-08T18:31:59.860 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:59.860 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:59.860 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:59.860 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:31:59.860 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:31:59.860 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:31:59.861 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2024-05-08T18:31:59.861 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:31:59.862 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-08T18:31:59.862 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2024-05-08T18:31:59.863 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:31:59.863 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2024-05-08T18:31:59.863 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:31:59.864 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2024-05-08T18:31:59.864 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:31:59.865 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:31:59.858+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:31:59.962 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:31:59.961+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:32:00.012 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:32:00.012 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:32:00.012 INFO:teuthology.orchestra.run.smithi097.stdout: "num_ops": 0 2024-05-08T18:32:00.012 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:32:00.025 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-08T18:32:00.063 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:32:00.058+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:32:00.164 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:32:00.162+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:32:00.175 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:32:00.175 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:32:00.175 INFO:teuthology.orchestra.run.smithi097.stdout: "complaint_time": 30, 2024-05-08T18:32:00.175 INFO:teuthology.orchestra.run.smithi097.stdout: "num_blocked_ops": 0 2024-05-08T18:32:00.175 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:32:00.188 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-08T18:32:00.265 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:32:00.265+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:32:00.313 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:32:00.313 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2024-05-08T18:32:00.313 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2024-05-08T18:32:00.313 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-05-08T18:32:00.313 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.313 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1234 3.38 3:1cb36fa1:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.2__shadow_.fYaqa8o34qSAauLRSqi3iwpmT5NwV5c_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-05-08T18:32:00.313 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:38.213439+0000", 2024-05-08T18:32:00.313 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 22.098709981999999, 2024-05-08T18:32:00.313 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.028973664, 2024-05-08T18:32:00.314 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:32:00.314 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:32:00.314 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:00.314 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:32:00.314 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:32:00.314 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:00.314 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1234 2024-05-08T18:32:00.314 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.314 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:32:00.314 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.314 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:32:00.315 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.213439+0000", 2024-05-08T18:32:00.315 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:00.315 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.315 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.315 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:32:00.315 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.213439+0000", 2024-05-08T18:32:00.315 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:00.315 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.315 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.315 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:32:00.316 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.213442+0000", 2024-05-08T18:32:00.316 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7580000000000001e-06 2024-05-08T18:32:00.316 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.316 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.316 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:32:00.316 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.216804+0000", 2024-05-08T18:32:00.316 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0033619520000000001 2024-05-08T18:32:00.316 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.316 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.316 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:32:00.316 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.216838+0000", 2024-05-08T18:32:00.316 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4437999999999998e-05 2024-05-08T18:32:00.317 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.317 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.317 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:32:00.317 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.216854+0000", 2024-05-08T18:32:00.317 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5823000000000001e-05 2024-05-08T18:32:00.317 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.317 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.317 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:32:00.317 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.216938+0000", 2024-05-08T18:32:00.317 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.3842000000000001e-05 2024-05-08T18:32:00.317 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.317 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.317 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:32:00.317 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.217046+0000", 2024-05-08T18:32:00.318 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000108717 2024-05-08T18:32:00.318 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.318 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.318 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:32:00.318 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.217137+0000", 2024-05-08T18:32:00.318 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0278000000000005e-05 2024-05-08T18:32:00.318 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.318 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.318 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:32:00.318 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.225461+0000", 2024-05-08T18:32:00.318 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0083239330000000004 2024-05-08T18:32:00.318 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.319 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.319 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:00.319 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.242319+0000", 2024-05-08T18:32:00.319 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.016858445999999999 2024-05-08T18:32:00.319 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.319 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.319 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:32:00.319 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.242359+0000", 2024-05-08T18:32:00.319 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9657000000000003e-05 2024-05-08T18:32:00.319 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.319 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.320 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:32:00.320 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.242413+0000", 2024-05-08T18:32:00.320 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3820000000000003e-05 2024-05-08T18:32:00.320 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:00.320 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:32:00.320 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:00.320 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.320 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.320 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1318 3.c e81/21 3:329e59e6:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_4:head v 81'3, mlcod=80'1)", 2024-05-08T18:32:00.320 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.344399+0000", 2024-05-08T18:32:00.320 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 17.967750021000001, 2024-05-08T18:32:00.320 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.016160681999999999, 2024-05-08T18:32:00.320 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:32:00.320 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:32:00.321 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:00.321 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:32:00.321 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.321 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:32:00.321 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.344399+0000", 2024-05-08T18:32:00.321 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:00.321 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.321 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.321 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:32:00.321 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.344399+0000", 2024-05-08T18:32:00.321 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:00.321 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.321 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.321 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:32:00.322 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.344401+0000", 2024-05-08T18:32:00.322 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.767e-06 2024-05-08T18:32:00.322 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.322 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.322 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:32:00.322 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.351623+0000", 2024-05-08T18:32:00.322 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.007222554 2024-05-08T18:32:00.322 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.322 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.322 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:32:00.322 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.351667+0000", 2024-05-08T18:32:00.322 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4192e-05 2024-05-08T18:32:00.322 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.323 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.323 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:32:00.323 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.351690+0000", 2024-05-08T18:32:00.323 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2708999999999999e-05 2024-05-08T18:32:00.323 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.323 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.323 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:32:00.323 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.351781+0000", 2024-05-08T18:32:00.323 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0556999999999994e-05 2024-05-08T18:32:00.323 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.323 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.323 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:32:00.323 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.351799+0000", 2024-05-08T18:32:00.324 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8581e-05 2024-05-08T18:32:00.324 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.324 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.324 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:32:00.324 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.360513+0000", 2024-05-08T18:32:00.324 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.008713864 2024-05-08T18:32:00.324 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.324 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.324 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:32:00.324 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.360560+0000", 2024-05-08T18:32:00.324 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6458000000000001e-05 2024-05-08T18:32:00.324 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:00.325 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:32:00.325 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:00.325 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.325 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.325 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1330 3.8 3:124da8ab:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-08T18:32:00.325 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.493255+0000", 2024-05-08T18:32:00.325 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 17.818894173, 2024-05-08T18:32:00.325 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.016189959, 2024-05-08T18:32:00.325 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:32:00.325 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:32:00.325 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:00.325 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:32:00.325 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:32:00.325 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:00.326 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1330 2024-05-08T18:32:00.326 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.326 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:32:00.326 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.326 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:32:00.326 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.493255+0000", 2024-05-08T18:32:00.326 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:00.326 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.326 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.326 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:32:00.326 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.493255+0000", 2024-05-08T18:32:00.326 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:00.326 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.326 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.327 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:32:00.327 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.493258+0000", 2024-05-08T18:32:00.327 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0180000000000002e-06 2024-05-08T18:32:00.327 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.327 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.327 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:32:00.327 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.494859+0000", 2024-05-08T18:32:00.327 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001600853 2024-05-08T18:32:00.327 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.327 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.327 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:32:00.327 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.494883+0000", 2024-05-08T18:32:00.327 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4680000000000001e-05 2024-05-08T18:32:00.328 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.328 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.328 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:32:00.328 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.494894+0000", 2024-05-08T18:32:00.328 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0601999999999999e-05 2024-05-08T18:32:00.328 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.328 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.328 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:32:00.328 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.494972+0000", 2024-05-08T18:32:00.328 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.8534000000000004e-05 2024-05-08T18:32:00.328 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.328 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.328 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:32:00.329 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.495134+0000", 2024-05-08T18:32:00.329 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016150999999999999 2024-05-08T18:32:00.329 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.329 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.329 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-05-08T18:32:00.329 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.495261+0000", 2024-05-08T18:32:00.329 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012695600000000001 2024-05-08T18:32:00.329 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.329 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.329 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:00.330 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.508455+0000", 2024-05-08T18:32:00.330 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.013194449 2024-05-08T18:32:00.330 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.330 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.330 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:32:00.330 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.509294+0000", 2024-05-08T18:32:00.330 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000839061 2024-05-08T18:32:00.330 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.330 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.330 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:32:00.330 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.509388+0000", 2024-05-08T18:32:00.330 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.3682000000000002e-05 2024-05-08T18:32:00.330 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.331 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.331 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:32:00.331 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.509445+0000", 2024-05-08T18:32:00.331 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6613999999999997e-05 2024-05-08T18:32:00.331 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:00.331 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:32:00.331 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:00.331 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.331 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.331 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1336 3.2 3:42c6ce4f:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:32:00.331 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.558532+0000", 2024-05-08T18:32:00.331 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 17.753616725000001, 2024-05-08T18:32:00.331 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.033214269999999997, 2024-05-08T18:32:00.332 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:32:00.332 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:32:00.332 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:00.332 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:32:00.332 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:32:00.332 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:00.332 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1336 2024-05-08T18:32:00.332 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.332 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:32:00.332 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.332 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:32:00.332 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.558532+0000", 2024-05-08T18:32:00.332 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:00.333 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.333 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.333 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:32:00.333 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.558532+0000", 2024-05-08T18:32:00.333 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:00.333 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.333 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.333 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:32:00.333 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.558535+0000", 2024-05-08T18:32:00.333 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9689999999999999e-06 2024-05-08T18:32:00.334 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.334 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.334 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:32:00.334 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.560549+0000", 2024-05-08T18:32:00.334 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0020142469999999998 2024-05-08T18:32:00.334 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.334 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.334 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:32:00.334 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.560576+0000", 2024-05-08T18:32:00.334 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6908000000000001e-05 2024-05-08T18:32:00.334 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.335 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.335 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:32:00.335 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.560595+0000", 2024-05-08T18:32:00.335 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8383999999999999e-05 2024-05-08T18:32:00.335 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.335 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.335 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:32:00.335 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.560680+0000", 2024-05-08T18:32:00.335 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5424000000000001e-05 2024-05-08T18:32:00.335 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.335 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.336 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-05-08T18:32:00.336 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.560685+0000", 2024-05-08T18:32:00.336 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.327e-06 2024-05-08T18:32:00.336 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.336 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.336 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:32:00.336 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.570079+0000", 2024-05-08T18:32:00.336 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0093940680000000002 2024-05-08T18:32:00.336 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.336 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.336 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:32:00.336 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.570249+0000", 2024-05-08T18:32:00.336 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000169953 2024-05-08T18:32:00.337 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.337 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.337 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-05-08T18:32:00.337 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.570423+0000", 2024-05-08T18:32:00.337 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00017355499999999999 2024-05-08T18:32:00.337 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.337 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.337 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:32:00.337 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.590293+0000", 2024-05-08T18:32:00.337 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019869761999999999 2024-05-08T18:32:00.337 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.338 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.338 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:00.338 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.591628+0000", 2024-05-08T18:32:00.338 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0013351599999999999 2024-05-08T18:32:00.338 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.338 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.338 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:32:00.338 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.591692+0000", 2024-05-08T18:32:00.338 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3822e-05 2024-05-08T18:32:00.338 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.338 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.338 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:32:00.338 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.591746+0000", 2024-05-08T18:32:00.339 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4691000000000002e-05 2024-05-08T18:32:00.339 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:00.339 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:32:00.339 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:00.339 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.339 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.339 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1346 3.29 3:9766a0f4:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_32:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:32:00.339 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.663599+0000", 2024-05-08T18:32:00.339 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 17.648549936999999, 2024-05-08T18:32:00.339 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.018562168, 2024-05-08T18:32:00.339 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:32:00.339 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:32:00.339 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:00.339 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:32:00.340 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:32:00.340 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:00.340 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1346 2024-05-08T18:32:00.340 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.340 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:32:00.340 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.340 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:32:00.340 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.663599+0000", 2024-05-08T18:32:00.340 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:00.340 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.340 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.340 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:32:00.341 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.663599+0000", 2024-05-08T18:32:00.341 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:00.341 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.341 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.341 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:32:00.341 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.663601+0000", 2024-05-08T18:32:00.341 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.328e-06 2024-05-08T18:32:00.341 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.341 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.341 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:32:00.341 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.665307+0000", 2024-05-08T18:32:00.341 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0017060879999999999 2024-05-08T18:32:00.342 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.342 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.342 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:32:00.342 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.665332+0000", 2024-05-08T18:32:00.342 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5142000000000001e-05 2024-05-08T18:32:00.342 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.342 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.342 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:32:00.342 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.665344+0000", 2024-05-08T18:32:00.342 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1464000000000001e-05 2024-05-08T18:32:00.342 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.342 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.342 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:32:00.342 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.665419+0000", 2024-05-08T18:32:00.343 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.5129000000000005e-05 2024-05-08T18:32:00.343 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.343 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.343 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:32:00.343 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.665529+0000", 2024-05-08T18:32:00.343 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000109787 2024-05-08T18:32:00.343 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.343 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.343 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:32:00.344 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.665627+0000", 2024-05-08T18:32:00.344 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.8190999999999996e-05 2024-05-08T18:32:00.344 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.344 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.344 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:32:00.344 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.673488+0000", 2024-05-08T18:32:00.344 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0078611819999999995 2024-05-08T18:32:00.344 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.344 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.344 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:00.344 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.682043+0000", 2024-05-08T18:32:00.344 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0085545829999999993 2024-05-08T18:32:00.345 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.345 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.345 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:32:00.345 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.682106+0000", 2024-05-08T18:32:00.345 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.2706000000000006e-05 2024-05-08T18:32:00.345 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.345 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.345 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:32:00.345 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.682161+0000", 2024-05-08T18:32:00.345 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5568000000000001e-05 2024-05-08T18:32:00.345 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:00.345 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:32:00.345 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:00.345 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.346 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.346 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1348 3.38 3:1ca8d3e1:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_34:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:32:00.346 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.684650+0000", 2024-05-08T18:32:00.346 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 17.627498827, 2024-05-08T18:32:00.346 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.018994840999999998, 2024-05-08T18:32:00.346 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:32:00.346 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:32:00.346 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:00.346 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:32:00.346 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:32:00.346 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:00.346 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1348 2024-05-08T18:32:00.347 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.347 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:32:00.347 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.347 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:32:00.347 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.684650+0000", 2024-05-08T18:32:00.347 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:00.347 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.347 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.347 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:32:00.347 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.684650+0000", 2024-05-08T18:32:00.347 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:00.348 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.348 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.348 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:32:00.348 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.684652+0000", 2024-05-08T18:32:00.348 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3860000000000001e-06 2024-05-08T18:32:00.348 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.348 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.348 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:32:00.348 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.686933+0000", 2024-05-08T18:32:00.348 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0022806369999999999 2024-05-08T18:32:00.348 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.348 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.349 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:32:00.349 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.686950+0000", 2024-05-08T18:32:00.349 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7377e-05 2024-05-08T18:32:00.349 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.349 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.349 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:32:00.349 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.686962+0000", 2024-05-08T18:32:00.349 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1756000000000001e-05 2024-05-08T18:32:00.349 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.349 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.349 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:32:00.349 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.687038+0000", 2024-05-08T18:32:00.349 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.5623000000000004e-05 2024-05-08T18:32:00.350 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.350 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.350 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:32:00.350 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.687226+0000", 2024-05-08T18:32:00.350 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000188457 2024-05-08T18:32:00.350 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.350 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.350 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:32:00.350 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.687394+0000", 2024-05-08T18:32:00.350 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016753300000000001 2024-05-08T18:32:00.350 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.350 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.351 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:32:00.351 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.694346+0000", 2024-05-08T18:32:00.351 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0069519639999999997 2024-05-08T18:32:00.351 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.351 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.351 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:00.351 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.703479+0000", 2024-05-08T18:32:00.351 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0091331829999999996 2024-05-08T18:32:00.351 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.351 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.352 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:32:00.352 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.703567+0000", 2024-05-08T18:32:00.352 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8294000000000005e-05 2024-05-08T18:32:00.352 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.352 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.352 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:32:00.352 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.703645+0000", 2024-05-08T18:32:00.352 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7631000000000003e-05 2024-05-08T18:32:00.352 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:00.352 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:32:00.352 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:00.353 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.353 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.353 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1349 3.27 3:e5090c80:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_35:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:32:00.353 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.696361+0000", 2024-05-08T18:32:00.353 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 17.615787757, 2024-05-08T18:32:00.353 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019944929, 2024-05-08T18:32:00.353 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:32:00.353 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:32:00.353 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:00.353 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:32:00.353 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:32:00.353 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:00.353 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1349 2024-05-08T18:32:00.353 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.354 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:32:00.354 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.354 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:32:00.354 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.696361+0000", 2024-05-08T18:32:00.354 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:00.354 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.354 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.354 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:32:00.354 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.696361+0000", 2024-05-08T18:32:00.354 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:00.355 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.355 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.355 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:32:00.355 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.696363+0000", 2024-05-08T18:32:00.355 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1160000000000002e-06 2024-05-08T18:32:00.355 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.355 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.355 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:32:00.355 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.698294+0000", 2024-05-08T18:32:00.355 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001931026 2024-05-08T18:32:00.355 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.355 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.355 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:32:00.356 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.698324+0000", 2024-05-08T18:32:00.356 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9658e-05 2024-05-08T18:32:00.356 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.356 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.356 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:32:00.356 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.698339+0000", 2024-05-08T18:32:00.356 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5381000000000001e-05 2024-05-08T18:32:00.356 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.356 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.356 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:32:00.356 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.698430+0000", 2024-05-08T18:32:00.356 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0353999999999996e-05 2024-05-08T18:32:00.356 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.356 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.357 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:32:00.357 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.698591+0000", 2024-05-08T18:32:00.357 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016140999999999999 2024-05-08T18:32:00.357 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.357 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.357 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:32:00.357 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.698741+0000", 2024-05-08T18:32:00.357 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014955099999999999 2024-05-08T18:32:00.357 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.357 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.357 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:32:00.358 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.706987+0000", 2024-05-08T18:32:00.358 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0082466599999999994 2024-05-08T18:32:00.358 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.358 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.358 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:00.358 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.716183+0000", 2024-05-08T18:32:00.358 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0091959529999999998 2024-05-08T18:32:00.358 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.358 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.358 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:32:00.358 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.716252+0000", 2024-05-08T18:32:00.359 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8804000000000001e-05 2024-05-08T18:32:00.359 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.359 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.359 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:32:00.359 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.716306+0000", 2024-05-08T18:32:00.359 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4015999999999999e-05 2024-05-08T18:32:00.359 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:00.359 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:32:00.359 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:00.359 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.359 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.359 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1351 3.27 3:e75c4558:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_37:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:32:00.359 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.719093+0000", 2024-05-08T18:32:00.359 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 17.593055407000001, 2024-05-08T18:32:00.360 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.016526314, 2024-05-08T18:32:00.360 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:32:00.360 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:32:00.360 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:00.360 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:32:00.360 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:32:00.360 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:00.360 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1351 2024-05-08T18:32:00.360 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.361 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:32:00.361 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.361 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:32:00.361 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.719093+0000", 2024-05-08T18:32:00.361 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:00.361 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.362 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.362 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:32:00.362 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.719093+0000", 2024-05-08T18:32:00.362 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:00.362 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.362 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.362 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:32:00.363 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.719096+0000", 2024-05-08T18:32:00.363 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0249999999999998e-06 2024-05-08T18:32:00.363 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.363 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.363 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:32:00.363 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.721010+0000", 2024-05-08T18:32:00.363 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001913821 2024-05-08T18:32:00.363 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.363 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.364 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:32:00.364 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.721041+0000", 2024-05-08T18:32:00.364 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0679000000000002e-05 2024-05-08T18:32:00.364 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.364 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.364 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:32:00.364 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.721056+0000", 2024-05-08T18:32:00.364 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4630999999999999e-05 2024-05-08T18:32:00.364 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.364 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.364 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:32:00.364 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.721139+0000", 2024-05-08T18:32:00.364 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.3174e-05 2024-05-08T18:32:00.364 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.365 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.365 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:32:00.365 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.721264+0000", 2024-05-08T18:32:00.365 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012507600000000001 2024-05-08T18:32:00.365 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.365 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.365 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:32:00.365 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.721361+0000", 2024-05-08T18:32:00.365 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.7406999999999998e-05 2024-05-08T18:32:00.366 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.366 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.366 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:32:00.366 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.731468+0000", 2024-05-08T18:32:00.366 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010107065 2024-05-08T18:32:00.366 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.366 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.366 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:00.366 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.735495+0000", 2024-05-08T18:32:00.366 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0040267080000000004 2024-05-08T18:32:00.366 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.366 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.366 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:32:00.367 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.735563+0000", 2024-05-08T18:32:00.367 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8195999999999996e-05 2024-05-08T18:32:00.367 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.367 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.367 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:32:00.367 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.735620+0000", 2024-05-08T18:32:00.367 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6532e-05 2024-05-08T18:32:00.367 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:00.367 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:32:00.367 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:00.367 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.367 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.367 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1355 3.28 e82/21 3:14052413:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_41:head v 82'1, mlcod=0'0)", 2024-05-08T18:32:00.367 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.768053+0000", 2024-05-08T18:32:00.368 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 17.544095925000001, 2024-05-08T18:32:00.368 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019664687, 2024-05-08T18:32:00.368 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:32:00.368 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:32:00.368 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:00.368 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:32:00.368 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.368 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:32:00.368 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.768053+0000", 2024-05-08T18:32:00.368 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:00.368 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.368 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.368 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:32:00.368 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.768053+0000", 2024-05-08T18:32:00.369 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:00.369 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.369 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.369 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:32:00.369 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.768055+0000", 2024-05-08T18:32:00.369 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6959999999999999e-06 2024-05-08T18:32:00.369 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.369 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.369 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:32:00.369 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.772115+0000", 2024-05-08T18:32:00.369 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0040600139999999998 2024-05-08T18:32:00.369 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.369 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.369 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:32:00.370 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.772149+0000", 2024-05-08T18:32:00.370 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4638999999999998e-05 2024-05-08T18:32:00.370 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.370 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.370 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:32:00.370 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.772165+0000", 2024-05-08T18:32:00.370 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5435999999999999e-05 2024-05-08T18:32:00.370 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.370 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.370 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:32:00.370 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.772261+0000", 2024-05-08T18:32:00.370 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.6724000000000004e-05 2024-05-08T18:32:00.370 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.370 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.371 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:32:00.371 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.772289+0000", 2024-05-08T18:32:00.371 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7243e-05 2024-05-08T18:32:00.371 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.371 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.371 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:32:00.371 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.787670+0000", 2024-05-08T18:32:00.371 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.015380906 2024-05-08T18:32:00.371 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.371 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.371 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:32:00.371 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.787718+0000", 2024-05-08T18:32:00.371 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8028999999999997e-05 2024-05-08T18:32:00.371 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:00.372 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:32:00.372 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:00.372 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.372 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.372 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1356 3.2 3:41e29af7:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_42:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:32:00.372 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.771157+0000", 2024-05-08T18:32:00.372 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 17.540991943999998, 2024-05-08T18:32:00.372 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.018991331, 2024-05-08T18:32:00.372 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:32:00.372 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:32:00.372 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:00.372 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:32:00.372 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:32:00.372 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:00.372 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1356 2024-05-08T18:32:00.373 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.373 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:32:00.373 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.373 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:32:00.373 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.771157+0000", 2024-05-08T18:32:00.373 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:00.373 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.373 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.373 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:32:00.373 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.771157+0000", 2024-05-08T18:32:00.373 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:00.373 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.373 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.373 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:32:00.374 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.771160+0000", 2024-05-08T18:32:00.374 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1820000000000002e-06 2024-05-08T18:32:00.374 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.374 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.374 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:32:00.374 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.772778+0000", 2024-05-08T18:32:00.374 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001617926 2024-05-08T18:32:00.374 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.374 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.374 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:32:00.374 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.772790+0000", 2024-05-08T18:32:00.374 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1609e-05 2024-05-08T18:32:00.374 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.375 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.375 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:32:00.375 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.772797+0000", 2024-05-08T18:32:00.375 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.3270000000000003e-06 2024-05-08T18:32:00.375 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.375 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.375 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:32:00.375 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.772851+0000", 2024-05-08T18:32:00.375 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3987999999999999e-05 2024-05-08T18:32:00.375 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.375 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.375 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:32:00.375 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.772947+0000", 2024-05-08T18:32:00.376 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.5809000000000004e-05 2024-05-08T18:32:00.376 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.376 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.376 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-05-08T18:32:00.376 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.773040+0000", 2024-05-08T18:32:00.376 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.3422000000000001e-05 2024-05-08T18:32:00.376 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.376 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.377 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:32:00.377 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.786246+0000", 2024-05-08T18:32:00.377 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.013205744 2024-05-08T18:32:00.377 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.377 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.377 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:00.377 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.790017+0000", 2024-05-08T18:32:00.377 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0037707539999999999 2024-05-08T18:32:00.377 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.377 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.377 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:32:00.377 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.790091+0000", 2024-05-08T18:32:00.377 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.4664000000000002e-05 2024-05-08T18:32:00.377 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.378 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.378 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:32:00.378 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.790148+0000", 2024-05-08T18:32:00.378 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6906e-05 2024-05-08T18:32:00.378 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:00.378 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:32:00.378 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:00.378 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.379 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.379 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1407 3.22 e82/21 3:46b64ebe:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_93:head v 82'2, mlcod=0'0)", 2024-05-08T18:32:00.379 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:43.347361+0000", 2024-05-08T18:32:00.379 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 16.964788342999999, 2024-05-08T18:32:00.379 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.017804430999999999, 2024-05-08T18:32:00.379 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:32:00.379 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:32:00.379 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:00.379 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:32:00.379 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.379 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:32:00.380 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.347361+0000", 2024-05-08T18:32:00.380 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:00.380 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.380 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.380 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:32:00.380 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.347361+0000", 2024-05-08T18:32:00.380 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:00.380 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.380 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.380 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:32:00.380 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.347362+0000", 2024-05-08T18:32:00.380 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9489999999999999e-06 2024-05-08T18:32:00.380 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.380 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.381 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:32:00.381 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.352295+0000", 2024-05-08T18:32:00.381 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0049320659999999997 2024-05-08T18:32:00.381 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.381 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.381 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:32:00.381 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.352314+0000", 2024-05-08T18:32:00.381 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9057999999999999e-05 2024-05-08T18:32:00.381 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.381 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.381 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:32:00.382 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.352326+0000", 2024-05-08T18:32:00.382 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2244e-05 2024-05-08T18:32:00.382 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.382 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.382 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:32:00.382 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.352386+0000", 2024-05-08T18:32:00.382 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0066999999999999e-05 2024-05-08T18:32:00.383 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.383 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.383 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:32:00.383 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.352405+0000", 2024-05-08T18:32:00.383 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.872e-05 2024-05-08T18:32:00.383 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.383 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.383 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:32:00.383 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.365075+0000", 2024-05-08T18:32:00.384 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012670241 2024-05-08T18:32:00.384 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.384 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.384 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:32:00.384 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.365165+0000", 2024-05-08T18:32:00.384 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0086000000000005e-05 2024-05-08T18:32:00.384 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:00.384 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:32:00.384 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:00.385 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.385 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.385 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1414 3.29 3:946e7bc1:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_100:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:32:00.385 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:43.412960+0000", 2024-05-08T18:32:00.385 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 16.899188564999999, 2024-05-08T18:32:00.385 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.017447297, 2024-05-08T18:32:00.385 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:32:00.385 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:32:00.385 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:00.385 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:32:00.385 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:32:00.385 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:00.385 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1414 2024-05-08T18:32:00.385 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.386 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:32:00.386 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.386 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:32:00.386 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.412960+0000", 2024-05-08T18:32:00.386 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:00.386 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.386 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.386 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:32:00.386 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.412960+0000", 2024-05-08T18:32:00.387 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:00.387 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.387 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.387 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:32:00.387 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.412963+0000", 2024-05-08T18:32:00.387 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4219999999999999e-06 2024-05-08T18:32:00.387 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.387 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.387 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:32:00.387 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.414327+0000", 2024-05-08T18:32:00.387 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001364608 2024-05-08T18:32:00.387 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.387 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.387 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:32:00.388 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.414348+0000", 2024-05-08T18:32:00.388 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0981000000000001e-05 2024-05-08T18:32:00.388 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.388 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.388 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:32:00.388 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.414359+0000", 2024-05-08T18:32:00.388 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0900000000000001e-05 2024-05-08T18:32:00.388 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.388 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.388 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:32:00.388 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.414418+0000", 2024-05-08T18:32:00.388 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8430000000000001e-05 2024-05-08T18:32:00.388 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.388 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.389 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:32:00.389 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.414542+0000", 2024-05-08T18:32:00.389 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012464600000000001 2024-05-08T18:32:00.389 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.389 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.389 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:32:00.389 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.414646+0000", 2024-05-08T18:32:00.389 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000103492 2024-05-08T18:32:00.389 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.389 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.389 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:32:00.389 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.421327+0000", 2024-05-08T18:32:00.389 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0066811700000000002 2024-05-08T18:32:00.389 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.390 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.390 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:00.390 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.430304+0000", 2024-05-08T18:32:00.390 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0089774220000000005 2024-05-08T18:32:00.390 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.390 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.390 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:32:00.390 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.430364+0000", 2024-05-08T18:32:00.390 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9431000000000001e-05 2024-05-08T18:32:00.390 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.390 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.390 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:32:00.391 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:43.430408+0000", 2024-05-08T18:32:00.391 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3795000000000003e-05 2024-05-08T18:32:00.391 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:00.391 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:32:00.391 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:00.391 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.391 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.391 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1616 3.7 3:e2c69de8:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-05-08T18:32:00.391 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:46.728206+0000", 2024-05-08T18:32:00.391 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 13.583942713999999, 2024-05-08T18:32:00.391 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.024382826, 2024-05-08T18:32:00.391 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:32:00.391 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:32:00.392 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:00.392 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:32:00.392 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:32:00.392 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:00.392 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1616 2024-05-08T18:32:00.392 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.392 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:32:00.392 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.392 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:32:00.392 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.728206+0000", 2024-05-08T18:32:00.392 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:00.392 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.392 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.393 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:32:00.393 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.728206+0000", 2024-05-08T18:32:00.393 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:00.393 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.393 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.393 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:32:00.393 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.728209+0000", 2024-05-08T18:32:00.393 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3060000000000002e-06 2024-05-08T18:32:00.393 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.393 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.393 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:32:00.393 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.730475+0000", 2024-05-08T18:32:00.393 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0022651899999999998 2024-05-08T18:32:00.394 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.394 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.394 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:32:00.394 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.730508+0000", 2024-05-08T18:32:00.394 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3226999999999999e-05 2024-05-08T18:32:00.394 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.394 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.394 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:32:00.394 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.730523+0000", 2024-05-08T18:32:00.394 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4715999999999999e-05 2024-05-08T18:32:00.394 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.394 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.395 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:32:00.395 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.730618+0000", 2024-05-08T18:32:00.395 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.5619999999999996e-05 2024-05-08T18:32:00.395 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.395 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.395 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:32:00.395 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.730831+0000", 2024-05-08T18:32:00.395 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021288599999999999 2024-05-08T18:32:00.395 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.395 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.395 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:32:00.395 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.730970+0000", 2024-05-08T18:32:00.395 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013861400000000001 2024-05-08T18:32:00.395 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.396 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.396 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:32:00.396 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.742595+0000", 2024-05-08T18:32:00.396 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011624951 2024-05-08T18:32:00.396 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.396 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.396 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:00.396 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.752495+0000", 2024-05-08T18:32:00.396 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0098999910000000003 2024-05-08T18:32:00.396 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.396 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.396 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:32:00.396 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.752546+0000", 2024-05-08T18:32:00.396 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.1422999999999999e-05 2024-05-08T18:32:00.397 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.397 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.397 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:32:00.397 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.752589+0000", 2024-05-08T18:32:00.397 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.2901999999999997e-05 2024-05-08T18:32:00.397 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:00.397 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:32:00.397 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:00.397 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.398 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.398 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1625 3.1e 3:798e9c4d:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-05-08T18:32:00.398 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:46.821701+0000", 2024-05-08T18:32:00.398 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 13.490448068999999, 2024-05-08T18:32:00.398 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019517788000000001, 2024-05-08T18:32:00.398 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:32:00.398 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:32:00.398 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:00.398 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:32:00.398 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:32:00.399 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:00.399 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1625 2024-05-08T18:32:00.399 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.399 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:32:00.399 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.399 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:32:00.399 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.821701+0000", 2024-05-08T18:32:00.399 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:00.399 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.399 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.400 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:32:00.400 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.821701+0000", 2024-05-08T18:32:00.400 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:00.400 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.400 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.400 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:32:00.400 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.821704+0000", 2024-05-08T18:32:00.400 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9450000000000002e-06 2024-05-08T18:32:00.400 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.400 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.400 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:32:00.400 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.824221+0000", 2024-05-08T18:32:00.400 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0025171600000000001 2024-05-08T18:32:00.401 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.401 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.401 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:32:00.401 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.824251+0000", 2024-05-08T18:32:00.401 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0243000000000002e-05 2024-05-08T18:32:00.401 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.401 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.401 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:32:00.401 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.824265+0000", 2024-05-08T18:32:00.401 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3482999999999999e-05 2024-05-08T18:32:00.401 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.402 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.402 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:32:00.402 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.824353+0000", 2024-05-08T18:32:00.402 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8146999999999995e-05 2024-05-08T18:32:00.402 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.402 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.402 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:32:00.403 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.824560+0000", 2024-05-08T18:32:00.403 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00020771400000000001 2024-05-08T18:32:00.403 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.403 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.403 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:32:00.403 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.824720+0000", 2024-05-08T18:32:00.403 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015998799999999999 2024-05-08T18:32:00.403 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.403 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.403 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:32:00.404 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.837381+0000", 2024-05-08T18:32:00.404 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012660803 2024-05-08T18:32:00.404 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.404 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.404 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:00.404 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.841087+0000", 2024-05-08T18:32:00.404 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0037056519999999998 2024-05-08T18:32:00.404 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.404 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.404 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:32:00.404 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.841160+0000", 2024-05-08T18:32:00.404 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.3208999999999997e-05 2024-05-08T18:32:00.404 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.405 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.405 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:32:00.405 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.841219+0000", 2024-05-08T18:32:00.405 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8443999999999998e-05 2024-05-08T18:32:00.405 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:00.405 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:32:00.405 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:00.405 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.405 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.405 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1627 3.b 3:d1c181db:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-05-08T18:32:00.405 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:46.850618+0000", 2024-05-08T18:32:00.405 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 13.461530694, 2024-05-08T18:32:00.405 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.027553586000000001, 2024-05-08T18:32:00.405 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:32:00.406 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:32:00.406 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:00.406 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:32:00.406 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:32:00.406 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:00.406 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1627 2024-05-08T18:32:00.406 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.406 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:32:00.406 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.406 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:32:00.406 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.850618+0000", 2024-05-08T18:32:00.406 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:00.406 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.407 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.407 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:32:00.407 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.850618+0000", 2024-05-08T18:32:00.407 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:00.407 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.407 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.407 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:32:00.407 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.850621+0000", 2024-05-08T18:32:00.407 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0299999999999998e-06 2024-05-08T18:32:00.407 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.408 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.408 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:32:00.408 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.852369+0000", 2024-05-08T18:32:00.408 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001748229 2024-05-08T18:32:00.408 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.408 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.408 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:32:00.408 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.852397+0000", 2024-05-08T18:32:00.408 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7542000000000002e-05 2024-05-08T18:32:00.408 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.408 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.408 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:32:00.408 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.852410+0000", 2024-05-08T18:32:00.408 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2798e-05 2024-05-08T18:32:00.409 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.409 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.409 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:32:00.409 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.852537+0000", 2024-05-08T18:32:00.409 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000126756 2024-05-08T18:32:00.409 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.409 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.409 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:32:00.409 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.852785+0000", 2024-05-08T18:32:00.409 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024892099999999998 2024-05-08T18:32:00.409 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.409 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.409 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0", 2024-05-08T18:32:00.409 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.853042+0000", 2024-05-08T18:32:00.410 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00025698799999999999 2024-05-08T18:32:00.410 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.410 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.410 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:32:00.410 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.876145+0000", 2024-05-08T18:32:00.410 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.023102746 2024-05-08T18:32:00.410 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.410 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.410 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:00.410 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.878045+0000", 2024-05-08T18:32:00.410 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0018999850000000001 2024-05-08T18:32:00.410 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.410 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.411 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:32:00.411 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.878117+0000", 2024-05-08T18:32:00.411 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1464000000000006e-05 2024-05-08T18:32:00.411 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.411 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.411 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:32:00.411 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.878172+0000", 2024-05-08T18:32:00.411 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5127000000000003e-05 2024-05-08T18:32:00.411 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:00.411 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:32:00.411 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:00.412 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.412 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.412 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1629 3.24 3:27d2a12f:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-05-08T18:32:00.412 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:46.873022+0000", 2024-05-08T18:32:00.412 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 13.43912669, 2024-05-08T18:32:00.412 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019610209, 2024-05-08T18:32:00.412 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:32:00.412 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:32:00.412 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:00.412 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:32:00.412 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:32:00.412 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:00.412 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1629 2024-05-08T18:32:00.412 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.413 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:32:00.413 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.413 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:32:00.413 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.873022+0000", 2024-05-08T18:32:00.413 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:00.413 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.413 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.413 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:32:00.413 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.873022+0000", 2024-05-08T18:32:00.413 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:00.413 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.413 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.413 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:32:00.413 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.873024+0000", 2024-05-08T18:32:00.414 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.826e-06 2024-05-08T18:32:00.414 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.414 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.414 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:32:00.414 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.874556+0000", 2024-05-08T18:32:00.414 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0015321009999999999 2024-05-08T18:32:00.414 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.414 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.414 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:32:00.414 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.874593+0000", 2024-05-08T18:32:00.414 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6696000000000002e-05 2024-05-08T18:32:00.414 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.415 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.415 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:32:00.415 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.874610+0000", 2024-05-08T18:32:00.415 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7374e-05 2024-05-08T18:32:00.415 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.415 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.415 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:32:00.415 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.874687+0000", 2024-05-08T18:32:00.415 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7219999999999996e-05 2024-05-08T18:32:00.415 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.415 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.416 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:32:00.416 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.874823+0000", 2024-05-08T18:32:00.416 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013538600000000001 2024-05-08T18:32:00.416 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.416 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.416 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:32:00.416 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.874921+0000", 2024-05-08T18:32:00.416 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.8679999999999997e-05 2024-05-08T18:32:00.416 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.416 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.416 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:32:00.416 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.883485+0000", 2024-05-08T18:32:00.416 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0085638299999999997 2024-05-08T18:32:00.416 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.417 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.417 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:00.417 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.892549+0000", 2024-05-08T18:32:00.417 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0090635850000000007 2024-05-08T18:32:00.417 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.417 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.417 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:32:00.417 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.892593+0000", 2024-05-08T18:32:00.417 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4566e-05 2024-05-08T18:32:00.417 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.417 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.417 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:32:00.418 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.892632+0000", 2024-05-08T18:32:00.418 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8945000000000001e-05 2024-05-08T18:32:00.418 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:00.418 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:32:00.418 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:00.418 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.418 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.418 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1630 3.1e 3:7a85a01c:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-05-08T18:32:00.418 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:46.882333+0000", 2024-05-08T18:32:00.418 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 13.429815732, 2024-05-08T18:32:00.418 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.018692686999999999, 2024-05-08T18:32:00.418 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:32:00.419 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:32:00.419 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:00.419 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:32:00.419 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:32:00.419 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:00.419 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1630 2024-05-08T18:32:00.419 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.419 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:32:00.419 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.419 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:32:00.419 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.882333+0000", 2024-05-08T18:32:00.419 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:00.419 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.420 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.420 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:32:00.420 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.882333+0000", 2024-05-08T18:32:00.420 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:00.420 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.420 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.420 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:32:00.420 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.882336+0000", 2024-05-08T18:32:00.420 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7089999999999998e-06 2024-05-08T18:32:00.420 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.420 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.420 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:32:00.420 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.883864+0000", 2024-05-08T18:32:00.420 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0015277859999999999 2024-05-08T18:32:00.421 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.421 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.421 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:32:00.421 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.883885+0000", 2024-05-08T18:32:00.421 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1534000000000001e-05 2024-05-08T18:32:00.421 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.421 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.421 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:32:00.421 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.883900+0000", 2024-05-08T18:32:00.421 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4773999999999999e-05 2024-05-08T18:32:00.421 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.421 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.421 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:32:00.421 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.883982+0000", 2024-05-08T18:32:00.422 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.2109999999999998e-05 2024-05-08T18:32:00.422 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.422 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.422 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:32:00.422 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.884128+0000", 2024-05-08T18:32:00.422 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014600299999999999 2024-05-08T18:32:00.422 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.422 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.422 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:32:00.422 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.884249+0000", 2024-05-08T18:32:00.422 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012081799999999999 2024-05-08T18:32:00.422 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.422 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.423 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:32:00.423 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.890584+0000", 2024-05-08T18:32:00.423 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0063351079999999999 2024-05-08T18:32:00.423 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.423 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.423 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:00.423 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.900934+0000", 2024-05-08T18:32:00.423 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010349591 2024-05-08T18:32:00.423 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.423 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.423 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:32:00.423 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.900975+0000", 2024-05-08T18:32:00.423 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0979000000000002e-05 2024-05-08T18:32:00.424 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.424 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.424 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:32:00.424 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.901026+0000", 2024-05-08T18:32:00.424 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.1275e-05 2024-05-08T18:32:00.424 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:00.424 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:32:00.424 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:00.424 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.424 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.424 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1633 3.15 e83/21 3:ab226f54:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_21:head v 83'2, mlcod=0'0)", 2024-05-08T18:32:00.424 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:46.920100+0000", 2024-05-08T18:32:00.424 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 13.3920493, 2024-05-08T18:32:00.424 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.022841956, 2024-05-08T18:32:00.425 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:32:00.425 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:32:00.425 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:00.425 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:32:00.425 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.425 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:32:00.425 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.920100+0000", 2024-05-08T18:32:00.425 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:00.425 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.425 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.425 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:32:00.425 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.920100+0000", 2024-05-08T18:32:00.425 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:00.425 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.426 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.426 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:32:00.426 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.920101+0000", 2024-05-08T18:32:00.426 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4309999999999999e-06 2024-05-08T18:32:00.426 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.426 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.426 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:32:00.426 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.926002+0000", 2024-05-08T18:32:00.426 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0059014820000000004 2024-05-08T18:32:00.426 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.426 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.426 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:32:00.427 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.926041+0000", 2024-05-08T18:32:00.427 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8217999999999999e-05 2024-05-08T18:32:00.427 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.427 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.427 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:32:00.427 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.926057+0000", 2024-05-08T18:32:00.427 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5877000000000001e-05 2024-05-08T18:32:00.427 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.427 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.427 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:32:00.427 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.926149+0000", 2024-05-08T18:32:00.427 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.2361000000000006e-05 2024-05-08T18:32:00.427 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.427 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.428 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:32:00.428 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.926178+0000", 2024-05-08T18:32:00.428 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9544999999999999e-05 2024-05-08T18:32:00.428 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.428 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.428 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:32:00.428 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.942887+0000", 2024-05-08T18:32:00.428 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.016708163000000002 2024-05-08T18:32:00.428 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.428 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.428 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:32:00.428 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.942942+0000", 2024-05-08T18:32:00.428 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4879000000000001e-05 2024-05-08T18:32:00.428 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:00.429 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:32:00.429 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:00.429 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.429 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.429 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1634 3.b 3:d3d25f94:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-05-08T18:32:00.429 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:46.925230+0000", 2024-05-08T18:32:00.429 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 13.386918565, 2024-05-08T18:32:00.429 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.022437625999999999, 2024-05-08T18:32:00.429 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:32:00.429 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:32:00.429 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:00.429 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:32:00.429 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:32:00.429 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:00.430 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1634 2024-05-08T18:32:00.430 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.430 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:32:00.430 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.430 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:32:00.430 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.925230+0000", 2024-05-08T18:32:00.430 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:00.430 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.430 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.430 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:32:00.430 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.925230+0000", 2024-05-08T18:32:00.430 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:00.430 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.430 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.431 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:32:00.431 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.925234+0000", 2024-05-08T18:32:00.431 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6789999999999998e-06 2024-05-08T18:32:00.431 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.431 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.431 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:32:00.431 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.927184+0000", 2024-05-08T18:32:00.431 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0019497799999999999 2024-05-08T18:32:00.431 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.431 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.431 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:32:00.431 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.927205+0000", 2024-05-08T18:32:00.431 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1231000000000001e-05 2024-05-08T18:32:00.431 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.432 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.432 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:32:00.432 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.927214+0000", 2024-05-08T18:32:00.432 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0159999999999997e-06 2024-05-08T18:32:00.432 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.432 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.432 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:32:00.432 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.927287+0000", 2024-05-08T18:32:00.432 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.3192e-05 2024-05-08T18:32:00.432 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.432 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.432 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:32:00.432 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.927495+0000", 2024-05-08T18:32:00.432 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00020766099999999999 2024-05-08T18:32:00.433 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.433 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.433 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0", 2024-05-08T18:32:00.433 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.927653+0000", 2024-05-08T18:32:00.433 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015861799999999999 2024-05-08T18:32:00.433 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.433 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.433 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:32:00.433 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.947344+0000", 2024-05-08T18:32:00.433 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019690112999999999 2024-05-08T18:32:00.433 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.433 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.433 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:00.434 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.947572+0000", 2024-05-08T18:32:00.434 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000228292 2024-05-08T18:32:00.434 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.434 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.434 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:32:00.434 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.947618+0000", 2024-05-08T18:32:00.434 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5880000000000001e-05 2024-05-08T18:32:00.434 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.434 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.434 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:32:00.434 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.947668+0000", 2024-05-08T18:32:00.434 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.0164000000000003e-05 2024-05-08T18:32:00.434 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:00.434 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:32:00.435 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:00.435 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.435 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.435 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1635 3.27 3:e4667ce2:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-05-08T18:32:00.435 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:46.936207+0000", 2024-05-08T18:32:00.435 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 13.375941946999999, 2024-05-08T18:32:00.435 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.018244245999999999, 2024-05-08T18:32:00.435 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:32:00.435 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:32:00.435 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:00.435 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:32:00.435 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:32:00.436 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:00.436 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1635 2024-05-08T18:32:00.436 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.436 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:32:00.436 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.436 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:32:00.436 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.936207+0000", 2024-05-08T18:32:00.436 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:00.436 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.436 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.436 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:32:00.436 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.936207+0000", 2024-05-08T18:32:00.436 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:00.436 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.437 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.437 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:32:00.437 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.936210+0000", 2024-05-08T18:32:00.437 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.106e-06 2024-05-08T18:32:00.437 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.437 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.437 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:32:00.437 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.937940+0000", 2024-05-08T18:32:00.437 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001729972 2024-05-08T18:32:00.437 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.437 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.437 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:32:00.437 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.937963+0000", 2024-05-08T18:32:00.437 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3084000000000001e-05 2024-05-08T18:32:00.438 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.438 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.438 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:32:00.438 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.937975+0000", 2024-05-08T18:32:00.438 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2072000000000001e-05 2024-05-08T18:32:00.438 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.438 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.438 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:32:00.438 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.938060+0000", 2024-05-08T18:32:00.438 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5006000000000006e-05 2024-05-08T18:32:00.438 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.438 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.438 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:32:00.439 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.938220+0000", 2024-05-08T18:32:00.439 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000160018 2024-05-08T18:32:00.439 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.439 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.439 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:32:00.439 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.938359+0000", 2024-05-08T18:32:00.439 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013879300000000001 2024-05-08T18:32:00.439 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.439 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.439 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:32:00.439 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.947820+0000", 2024-05-08T18:32:00.439 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0094607370000000003 2024-05-08T18:32:00.439 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.439 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.440 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:00.440 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.954291+0000", 2024-05-08T18:32:00.440 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0064716030000000003 2024-05-08T18:32:00.440 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.440 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.440 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:32:00.440 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.954353+0000", 2024-05-08T18:32:00.440 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1965999999999996e-05 2024-05-08T18:32:00.440 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:00.440 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:00.440 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:32:00.440 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.954451+0000", 2024-05-08T18:32:00.440 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.7888999999999997e-05 2024-05-08T18:32:00.440 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:00.441 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:32:00.441 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:00.441 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:00.441 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:32:00.441 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:32:00.442 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-08T18:32:00.443 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:32:00.441+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:32:00.543 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:32:00.538+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:32:00.574 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:32:00.574 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-05-08T18:32:00.574 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.574 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1825 3.3 3:c2847c2a:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-05-08T18:32:00.574 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:00.555863+0000", 2024-05-08T18:32:00.574 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.019738208, 2024-05-08T18:32:00.575 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019830509999999999, 2024-05-08T18:32:00.575 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:00.575 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:00.575 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "waiting for sub ops", 2024-05-08T18:32:00.575 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:00.575 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:00.575 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:00.575 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1825 2024-05-08T18:32:00.575 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.575 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:00.575 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.575 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:00.575 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.555863+0000", 2024-05-08T18:32:00.576 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:00.576 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.576 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.576 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:00.576 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.555863+0000", 2024-05-08T18:32:00.576 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:00.576 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.576 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.576 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:00.576 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.555868+0000", 2024-05-08T18:32:00.576 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6829999999999999e-06 2024-05-08T18:32:00.576 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.576 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.577 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:00.577 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.563352+0000", 2024-05-08T18:32:00.577 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0074842199999999998 2024-05-08T18:32:00.577 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.577 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.577 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:00.577 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.563383+0000", 2024-05-08T18:32:00.577 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1393000000000003e-05 2024-05-08T18:32:00.577 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.577 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.577 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:00.577 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.563399+0000", 2024-05-08T18:32:00.577 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6064000000000001e-05 2024-05-08T18:32:00.577 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.578 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.578 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:00.578 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.563492+0000", 2024-05-08T18:32:00.578 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2532000000000001e-05 2024-05-08T18:32:00.578 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.578 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.578 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:00.578 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.563672+0000", 2024-05-08T18:32:00.578 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000180039 2024-05-08T18:32:00.578 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.578 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.578 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:32:00.578 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.563839+0000", 2024-05-08T18:32:00.579 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000166885 2024-05-08T18:32:00.579 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.579 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.579 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:00.579 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.571019+0000", 2024-05-08T18:32:00.579 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0071807019999999997 2024-05-08T18:32:00.579 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:00.579 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:00.579 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:00.579 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:00.579 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2024-05-08T18:32:00.579 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 1 2024-05-08T18:32:00.579 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:32:00.596 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-08T18:32:00.644 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:32:00.645+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:32:00.698 INFO:teuthology.orchestra.run.smithi097.stderr:noscrub is set 2024-05-08T18:32:00.768 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:32:00.769+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:32:00.769 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:32:00.769 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:32:00.769 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2024-05-08T18:32:00.769 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2024-05-08T18:32:00.769 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:32:00.787 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-08T18:32:00.847 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:32:00.845+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:32:00.929 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:32:00.929 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2024-05-08T18:32:00.929 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2024-05-08T18:32:00.929 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-05-08T18:32:00.929 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.929 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1315 3.2c e81/21 3:368ed9cc:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_1:head v 81'1, mlcod=0'0)", 2024-05-08T18:32:00.930 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.310943+0000", 2024-05-08T18:32:00.930 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 18.616227566999999, 2024-05-08T18:32:00.930 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019031756, 2024-05-08T18:32:00.930 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:00.930 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:00.930 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:00.930 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:00.930 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.930 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:00.930 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.310943+0000", 2024-05-08T18:32:00.930 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:00.930 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.930 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.931 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:00.931 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.310943+0000", 2024-05-08T18:32:00.931 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:00.931 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.931 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.931 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:00.931 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.310945+0000", 2024-05-08T18:32:00.931 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7800000000000001e-06 2024-05-08T18:32:00.931 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.931 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.931 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:00.931 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.315838+0000", 2024-05-08T18:32:00.931 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0048930800000000002 2024-05-08T18:32:00.932 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.932 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.932 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:00.932 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.315886+0000", 2024-05-08T18:32:00.932 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7336000000000002e-05 2024-05-08T18:32:00.932 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.932 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.932 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:00.932 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.315912+0000", 2024-05-08T18:32:00.932 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6584000000000002e-05 2024-05-08T18:32:00.932 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.932 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.932 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:00.933 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.316123+0000", 2024-05-08T18:32:00.933 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00021075400000000001 2024-05-08T18:32:00.933 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.933 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.933 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:00.933 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.316165+0000", 2024-05-08T18:32:00.933 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1709999999999999e-05 2024-05-08T18:32:00.933 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.933 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.933 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:00.933 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.329876+0000", 2024-05-08T18:32:00.933 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013710803000000001 2024-05-08T18:32:00.933 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.934 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.934 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:00.934 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.329974+0000", 2024-05-08T18:32:00.934 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8709000000000006e-05 2024-05-08T18:32:00.934 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:00.934 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:00.934 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:00.934 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.934 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.934 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1321 3.1b e81/21 3:d9207229:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_7:head v 81'1, mlcod=0'0)", 2024-05-08T18:32:00.934 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.391574+0000", 2024-05-08T18:32:00.934 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 18.535595785000002, 2024-05-08T18:32:00.935 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016614245, 2024-05-08T18:32:00.935 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:00.935 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:00.935 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:00.935 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:00.935 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.935 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:00.935 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.391574+0000", 2024-05-08T18:32:00.935 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:00.935 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.935 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.935 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:00.935 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.391574+0000", 2024-05-08T18:32:00.935 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:00.936 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.936 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.936 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:00.936 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.391578+0000", 2024-05-08T18:32:00.936 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3440000000000001e-06 2024-05-08T18:32:00.936 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.936 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.936 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:00.936 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.396175+0000", 2024-05-08T18:32:00.936 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0045968850000000002 2024-05-08T18:32:00.936 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.936 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.936 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:00.936 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.396209+0000", 2024-05-08T18:32:00.936 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4146000000000001e-05 2024-05-08T18:32:00.937 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.937 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.937 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:00.937 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.396228+0000", 2024-05-08T18:32:00.937 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9687e-05 2024-05-08T18:32:00.937 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.937 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.937 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:00.937 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.396353+0000", 2024-05-08T18:32:00.937 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012448200000000001 2024-05-08T18:32:00.937 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.938 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.938 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:00.938 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.396392+0000", 2024-05-08T18:32:00.938 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9419999999999999e-05 2024-05-08T18:32:00.938 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.938 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.938 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:00.938 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.408054+0000", 2024-05-08T18:32:00.938 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011661695999999999 2024-05-08T18:32:00.938 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.938 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.938 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:00.938 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.408189+0000", 2024-05-08T18:32:00.938 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000134585 2024-05-08T18:32:00.939 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:00.939 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:00.939 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:00.939 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.939 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.939 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1322 3.f e81/21 3:f3016725:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_8:head v 81'1, mlcod=0'0)", 2024-05-08T18:32:00.939 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.404407+0000", 2024-05-08T18:32:00.939 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 18.522762763999999, 2024-05-08T18:32:00.939 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016824525999999999, 2024-05-08T18:32:00.939 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:00.939 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:00.939 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:00.939 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:00.939 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.939 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:00.940 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.404407+0000", 2024-05-08T18:32:00.940 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:00.940 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.940 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.940 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:00.940 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.404407+0000", 2024-05-08T18:32:00.940 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:00.940 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.940 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.940 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:00.940 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.404409+0000", 2024-05-08T18:32:00.940 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9460000000000001e-06 2024-05-08T18:32:00.940 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.940 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.941 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:00.941 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.409446+0000", 2024-05-08T18:32:00.941 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.005036942 2024-05-08T18:32:00.941 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.941 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.941 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:00.941 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.409476+0000", 2024-05-08T18:32:00.941 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.9346999999999999e-05 2024-05-08T18:32:00.941 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.941 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.941 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:00.941 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.409498+0000", 2024-05-08T18:32:00.941 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2690000000000001e-05 2024-05-08T18:32:00.941 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.942 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.942 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:00.942 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.409607+0000", 2024-05-08T18:32:00.942 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000108546 2024-05-08T18:32:00.942 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.942 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.942 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:00.942 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.409643+0000", 2024-05-08T18:32:00.942 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5719000000000001e-05 2024-05-08T18:32:00.942 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.942 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.942 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:00.942 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.421097+0000", 2024-05-08T18:32:00.942 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011454166999999999 2024-05-08T18:32:00.943 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.943 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.943 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:00.943 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.421232+0000", 2024-05-08T18:32:00.943 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013516900000000001 2024-05-08T18:32:00.943 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:00.943 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:00.943 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:00.943 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.943 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.943 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1327 3.1a 3:58da5138:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-08T18:32:00.943 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.463447+0000", 2024-05-08T18:32:00.943 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 18.463723286, 2024-05-08T18:32:00.944 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018677618999999999, 2024-05-08T18:32:00.944 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:00.944 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:00.944 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:00.944 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:00.944 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:00.944 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:00.944 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1327 2024-05-08T18:32:00.944 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.944 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:00.944 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.944 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:00.944 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.463447+0000", 2024-05-08T18:32:00.945 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:00.945 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.945 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.945 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:00.945 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.463447+0000", 2024-05-08T18:32:00.945 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:00.945 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.945 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.945 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:00.945 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.463455+0000", 2024-05-08T18:32:00.945 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2430000000000005e-06 2024-05-08T18:32:00.945 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.945 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.946 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:00.946 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.469224+0000", 2024-05-08T18:32:00.946 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0057690830000000004 2024-05-08T18:32:00.946 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.946 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.946 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:00.946 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.469255+0000", 2024-05-08T18:32:00.946 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1000000000000001e-05 2024-05-08T18:32:00.946 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.946 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.946 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:00.946 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.469273+0000", 2024-05-08T18:32:00.946 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7920000000000001e-05 2024-05-08T18:32:00.946 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.947 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.947 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:00.947 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.469451+0000", 2024-05-08T18:32:00.947 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017836499999999999 2024-05-08T18:32:00.947 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.947 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.947 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:00.947 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.469687+0000", 2024-05-08T18:32:00.947 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000235255 2024-05-08T18:32:00.947 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.947 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.947 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:32:00.947 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.469899+0000", 2024-05-08T18:32:00.948 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00021257200000000001 2024-05-08T18:32:00.948 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.948 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.948 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:00.948 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.480590+0000", 2024-05-08T18:32:00.948 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010690963 2024-05-08T18:32:00.948 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.948 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.948 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:00.948 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.481813+0000", 2024-05-08T18:32:00.948 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001223001 2024-05-08T18:32:00.948 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.948 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.948 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:00.949 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.481982+0000", 2024-05-08T18:32:00.949 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016828500000000001 2024-05-08T18:32:00.949 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.949 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.949 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:00.949 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.482124+0000", 2024-05-08T18:32:00.949 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014293199999999999 2024-05-08T18:32:00.949 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:00.949 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:00.949 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:00.949 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.949 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.949 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1328 3.14 3:2b0d89be:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-08T18:32:00.949 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.473844+0000", 2024-05-08T18:32:00.950 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 18.453326397000001, 2024-05-08T18:32:00.950 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.031713811000000001, 2024-05-08T18:32:00.950 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:00.950 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:00.950 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:00.950 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:00.950 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:00.950 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:00.950 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1328 2024-05-08T18:32:00.950 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.950 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:00.950 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.950 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:00.951 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.473844+0000", 2024-05-08T18:32:00.951 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:00.951 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.951 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.951 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:00.951 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.473844+0000", 2024-05-08T18:32:00.951 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:00.951 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.951 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.951 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:00.951 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.473847+0000", 2024-05-08T18:32:00.951 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3100000000000001e-06 2024-05-08T18:32:00.951 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.952 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.952 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:00.952 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.479452+0000", 2024-05-08T18:32:00.952 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0056046910000000002 2024-05-08T18:32:00.952 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.952 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.952 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:00.952 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.479485+0000", 2024-05-08T18:32:00.952 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2808999999999997e-05 2024-05-08T18:32:00.952 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.952 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.952 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:00.952 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.479508+0000", 2024-05-08T18:32:00.952 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3119999999999999e-05 2024-05-08T18:32:00.952 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.953 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.953 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:00.953 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.479638+0000", 2024-05-08T18:32:00.953 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000130586 2024-05-08T18:32:00.953 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.953 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.953 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:00.953 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.479896+0000", 2024-05-08T18:32:00.953 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00025793799999999998 2024-05-08T18:32:00.953 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.953 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.953 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 7", 2024-05-08T18:32:00.953 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.480111+0000", 2024-05-08T18:32:00.953 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00021487200000000001 2024-05-08T18:32:00.954 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.954 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.954 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:00.954 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.502946+0000", 2024-05-08T18:32:00.954 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.022835101 2024-05-08T18:32:00.954 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.954 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.954 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:00.954 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.505389+0000", 2024-05-08T18:32:00.954 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0024426510000000001 2024-05-08T18:32:00.954 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.954 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.954 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:00.954 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.505479+0000", 2024-05-08T18:32:00.955 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.9863000000000003e-05 2024-05-08T18:32:00.955 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.955 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.955 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:00.955 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.505558+0000", 2024-05-08T18:32:00.955 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8869999999999995e-05 2024-05-08T18:32:00.955 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:00.955 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:00.955 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:00.955 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.955 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.955 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1332 3.14 3:2bdfae75:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-08T18:32:00.955 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.514410+0000", 2024-05-08T18:32:00.955 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 18.412760273, 2024-05-08T18:32:00.956 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.026281202, 2024-05-08T18:32:00.956 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:00.956 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:00.956 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:00.956 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:00.956 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:00.956 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:00.956 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1332 2024-05-08T18:32:00.956 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.956 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:00.956 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.956 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:00.956 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.514410+0000", 2024-05-08T18:32:00.956 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:00.956 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.957 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.957 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:00.957 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.514410+0000", 2024-05-08T18:32:00.957 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:00.957 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.957 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.957 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:00.957 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.514413+0000", 2024-05-08T18:32:00.957 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3160000000000001e-06 2024-05-08T18:32:00.957 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.957 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.957 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:00.957 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.519067+0000", 2024-05-08T18:32:00.958 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0046540319999999998 2024-05-08T18:32:00.958 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.958 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.958 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:00.958 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.519104+0000", 2024-05-08T18:32:00.958 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6890000000000001e-05 2024-05-08T18:32:00.958 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.958 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.958 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:00.958 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.519121+0000", 2024-05-08T18:32:00.958 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6583e-05 2024-05-08T18:32:00.958 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.958 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.959 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:00.959 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.519235+0000", 2024-05-08T18:32:00.959 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000114233 2024-05-08T18:32:00.959 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.959 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.959 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:00.959 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.519509+0000", 2024-05-08T18:32:00.959 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000274534 2024-05-08T18:32:00.959 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.959 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.959 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 7", 2024-05-08T18:32:00.959 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.519763+0000", 2024-05-08T18:32:00.959 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000253088 2024-05-08T18:32:00.959 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.960 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.960 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:00.960 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.532461+0000", 2024-05-08T18:32:00.960 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012698134 2024-05-08T18:32:00.960 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.960 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.960 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:00.960 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.540405+0000", 2024-05-08T18:32:00.960 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0079440699999999993 2024-05-08T18:32:00.960 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.960 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.960 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:00.960 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.540577+0000", 2024-05-08T18:32:00.961 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017180299999999999 2024-05-08T18:32:00.961 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.961 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.961 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:00.961 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.540691+0000", 2024-05-08T18:32:00.961 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011451900000000001 2024-05-08T18:32:00.961 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:00.961 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:00.961 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:00.961 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.961 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.961 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1346 3.29 e82/21 3:9766a0f4:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_32:head v 82'1, mlcod=0'0)", 2024-05-08T18:32:00.961 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.665936+0000", 2024-05-08T18:32:00.962 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 18.261233670999999, 2024-05-08T18:32:00.962 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015958892999999998, 2024-05-08T18:32:00.962 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:00.962 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:00.962 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:00.962 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:00.962 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.962 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:00.962 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.665936+0000", 2024-05-08T18:32:00.962 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:00.962 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.962 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.962 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:00.962 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.665936+0000", 2024-05-08T18:32:00.963 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:00.963 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.963 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.963 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:00.963 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.665937+0000", 2024-05-08T18:32:00.963 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3300000000000002e-07 2024-05-08T18:32:00.963 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.963 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.963 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:00.963 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.672096+0000", 2024-05-08T18:32:00.963 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0061585399999999997 2024-05-08T18:32:00.963 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.963 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.963 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:00.963 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.672123+0000", 2024-05-08T18:32:00.964 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7613000000000001e-05 2024-05-08T18:32:00.964 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.964 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.964 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:00.964 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.672139+0000", 2024-05-08T18:32:00.964 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5869999999999999e-05 2024-05-08T18:32:00.964 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.964 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.964 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:00.964 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.672222+0000", 2024-05-08T18:32:00.964 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2368999999999997e-05 2024-05-08T18:32:00.964 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.964 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.965 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:00.965 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.672255+0000", 2024-05-08T18:32:00.965 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3540000000000001e-05 2024-05-08T18:32:00.965 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.965 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.965 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:00.965 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.681740+0000", 2024-05-08T18:32:00.965 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0094849860000000008 2024-05-08T18:32:00.965 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.965 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.965 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:00.965 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.681895+0000", 2024-05-08T18:32:00.965 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015534199999999999 2024-05-08T18:32:00.965 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:00.966 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:00.966 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:00.966 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.966 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.966 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1349 3.27 e82/21 3:e5090c80:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_35:head v 82'1, mlcod=0'0)", 2024-05-08T18:32:00.966 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.699543+0000", 2024-05-08T18:32:00.966 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 18.227627614999999, 2024-05-08T18:32:00.966 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016329854000000001, 2024-05-08T18:32:00.966 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:00.966 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:00.966 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:00.966 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:00.966 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.966 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:00.967 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.699543+0000", 2024-05-08T18:32:00.967 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:00.967 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.967 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.967 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:00.967 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.699543+0000", 2024-05-08T18:32:00.967 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:00.967 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.967 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.967 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:00.967 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.699545+0000", 2024-05-08T18:32:00.967 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6529999999999998e-06 2024-05-08T18:32:00.967 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.967 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.968 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:00.968 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.704546+0000", 2024-05-08T18:32:00.968 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0050003599999999997 2024-05-08T18:32:00.968 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.968 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.968 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:00.968 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.704582+0000", 2024-05-08T18:32:00.968 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6165999999999999e-05 2024-05-08T18:32:00.968 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.968 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.968 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:00.969 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.704599+0000", 2024-05-08T18:32:00.969 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.713e-05 2024-05-08T18:32:00.969 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.969 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.969 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:00.969 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.704734+0000", 2024-05-08T18:32:00.969 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000135012 2024-05-08T18:32:00.969 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.969 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.969 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:00.969 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.704776+0000", 2024-05-08T18:32:00.970 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.2626999999999997e-05 2024-05-08T18:32:00.970 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.970 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.970 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:00.970 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.715744+0000", 2024-05-08T18:32:00.970 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010967153 2024-05-08T18:32:00.970 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.970 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.970 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:00.970 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.715872+0000", 2024-05-08T18:32:00.970 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012875300000000001 2024-05-08T18:32:00.970 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:00.970 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:00.971 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:00.971 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.971 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.971 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1357 3.f e82/21 3:f2d0b7b2:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_43:head v 82'3, mlcod=81'1)", 2024-05-08T18:32:00.971 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.786870+0000", 2024-05-08T18:32:00.971 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 18.140300289999999, 2024-05-08T18:32:00.971 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016941210000000002, 2024-05-08T18:32:00.971 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:00.971 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:00.971 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:00.971 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:00.971 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.971 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:00.972 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.786870+0000", 2024-05-08T18:32:00.972 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:00.972 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.972 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.972 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:00.972 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.786870+0000", 2024-05-08T18:32:00.972 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:00.972 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.972 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.972 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:00.972 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.786872+0000", 2024-05-08T18:32:00.972 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5770000000000001e-06 2024-05-08T18:32:00.972 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.972 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.973 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:00.973 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.789682+0000", 2024-05-08T18:32:00.973 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0028092859999999998 2024-05-08T18:32:00.973 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.973 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.973 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:00.973 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.789720+0000", 2024-05-08T18:32:00.973 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7932999999999997e-05 2024-05-08T18:32:00.973 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.973 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.973 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:00.973 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.789740+0000", 2024-05-08T18:32:00.973 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9862999999999999e-05 2024-05-08T18:32:00.973 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.973 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.974 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:00.974 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.789893+0000", 2024-05-08T18:32:00.974 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015356500000000001 2024-05-08T18:32:00.974 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.974 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.974 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:00.974 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.789961+0000", 2024-05-08T18:32:00.974 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8122999999999998e-05 2024-05-08T18:32:00.974 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.974 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.974 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:00.974 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.803714+0000", 2024-05-08T18:32:00.974 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013752664 2024-05-08T18:32:00.975 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.975 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.975 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:00.975 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.803811+0000", 2024-05-08T18:32:00.975 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7199000000000002e-05 2024-05-08T18:32:00.975 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:00.975 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:00.975 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:00.975 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.975 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.975 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1369 3.1 e82/21 3:83b9a38d:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_55:head v 82'1, mlcod=0'0)", 2024-05-08T18:32:00.975 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.908721+0000", 2024-05-08T18:32:00.975 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 18.018449233999998, 2024-05-08T18:32:00.975 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016507898999999999, 2024-05-08T18:32:00.976 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:00.976 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:00.976 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:00.976 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:00.976 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.976 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:00.976 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.908721+0000", 2024-05-08T18:32:00.976 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:00.976 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.976 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.976 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:00.976 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.908721+0000", 2024-05-08T18:32:00.976 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:00.976 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.976 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.977 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:00.977 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.908722+0000", 2024-05-08T18:32:00.977 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1600000000000001e-07 2024-05-08T18:32:00.977 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.977 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.977 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:00.977 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.912935+0000", 2024-05-08T18:32:00.977 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0042138219999999999 2024-05-08T18:32:00.977 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.977 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.977 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:00.977 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.912970+0000", 2024-05-08T18:32:00.977 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4722999999999999e-05 2024-05-08T18:32:00.977 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.978 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.978 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:00.978 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.912988+0000", 2024-05-08T18:32:00.978 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7972999999999999e-05 2024-05-08T18:32:00.978 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.978 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.978 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:00.978 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.913127+0000", 2024-05-08T18:32:00.978 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013925600000000001 2024-05-08T18:32:00.978 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.978 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.978 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:00.978 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.913167+0000", 2024-05-08T18:32:00.979 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9928999999999997e-05 2024-05-08T18:32:00.979 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.979 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.979 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:00.979 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.925089+0000", 2024-05-08T18:32:00.979 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011921510999999999 2024-05-08T18:32:00.979 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.979 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.979 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:00.979 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.925229+0000", 2024-05-08T18:32:00.979 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014006899999999999 2024-05-08T18:32:00.979 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:00.979 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:00.980 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:00.980 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.980 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.980 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1370 3.9 3:91bbaad9:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_56:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:32:00.980 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.915888+0000", 2024-05-08T18:32:00.980 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 18.011282025, 2024-05-08T18:32:00.980 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.028543105999999999, 2024-05-08T18:32:00.980 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:00.980 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:00.980 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:00.980 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:00.980 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:00.980 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:00.980 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1370 2024-05-08T18:32:00.980 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.981 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:00.981 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.981 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:00.981 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.915888+0000", 2024-05-08T18:32:00.981 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:00.981 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.981 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.981 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:00.981 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.915888+0000", 2024-05-08T18:32:00.981 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:00.981 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.981 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.981 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:00.982 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.915892+0000", 2024-05-08T18:32:00.982 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1269999999999996e-06 2024-05-08T18:32:00.982 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.982 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.982 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:00.982 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.919887+0000", 2024-05-08T18:32:00.982 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039945529999999996 2024-05-08T18:32:00.982 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.982 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.982 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:00.982 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.919929+0000", 2024-05-08T18:32:00.982 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1832999999999997e-05 2024-05-08T18:32:00.982 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.982 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.983 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:00.983 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.919950+0000", 2024-05-08T18:32:00.983 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1197000000000001e-05 2024-05-08T18:32:00.983 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.983 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.983 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:00.983 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.920108+0000", 2024-05-08T18:32:00.983 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015827899999999999 2024-05-08T18:32:00.983 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.983 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.983 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:00.983 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.920401+0000", 2024-05-08T18:32:00.983 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029259799999999998 2024-05-08T18:32:00.983 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.984 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.984 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-05-08T18:32:00.984 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.920625+0000", 2024-05-08T18:32:00.984 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022383099999999999 2024-05-08T18:32:00.984 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.984 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.984 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:00.984 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.933935+0000", 2024-05-08T18:32:00.984 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013310298999999999 2024-05-08T18:32:00.984 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.984 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.984 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:00.984 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.944330+0000", 2024-05-08T18:32:00.984 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010395107000000001 2024-05-08T18:32:00.985 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.985 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.985 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:00.985 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.944383+0000", 2024-05-08T18:32:00.985 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2772000000000002e-05 2024-05-08T18:32:00.985 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.985 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.985 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:00.985 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.944431+0000", 2024-05-08T18:32:00.985 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8510000000000001e-05 2024-05-08T18:32:00.985 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:00.985 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:00.985 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:00.986 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.986 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.986 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1385 3.1a 3:5abdd61d:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_71:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:32:00.986 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:43.106312+0000", 2024-05-08T18:32:00.986 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 17.820858445999999, 2024-05-08T18:32:00.986 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018362961000000001, 2024-05-08T18:32:00.986 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:00.986 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:00.986 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:00.986 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:00.986 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:00.986 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:00.987 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1385 2024-05-08T18:32:00.987 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.987 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:00.987 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.987 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:00.987 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.106312+0000", 2024-05-08T18:32:00.987 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:00.987 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.987 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.987 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:00.987 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.106312+0000", 2024-05-08T18:32:00.987 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:00.987 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.987 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.988 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:00.988 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.106316+0000", 2024-05-08T18:32:00.988 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8739999999999997e-06 2024-05-08T18:32:00.988 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.988 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.988 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:00.988 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.110250+0000", 2024-05-08T18:32:00.988 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039342600000000002 2024-05-08T18:32:00.988 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.988 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.988 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:00.988 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.110289+0000", 2024-05-08T18:32:00.988 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8782999999999998e-05 2024-05-08T18:32:00.989 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.989 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.989 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:00.989 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.110306+0000", 2024-05-08T18:32:00.989 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7793000000000001e-05 2024-05-08T18:32:00.989 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.989 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.989 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:00.989 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.110454+0000", 2024-05-08T18:32:00.989 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014750899999999999 2024-05-08T18:32:00.989 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.989 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.989 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:00.989 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.110700+0000", 2024-05-08T18:32:00.990 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00024594500000000002 2024-05-08T18:32:00.990 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.990 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.990 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:32:00.990 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.110951+0000", 2024-05-08T18:32:00.990 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00025154499999999999 2024-05-08T18:32:00.990 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.990 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.990 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:00.990 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.120973+0000", 2024-05-08T18:32:00.990 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010021835999999999 2024-05-08T18:32:00.991 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.991 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.991 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:00.991 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.124583+0000", 2024-05-08T18:32:00.991 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0036096840000000002 2024-05-08T18:32:00.991 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.991 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.991 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:00.991 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.124630+0000", 2024-05-08T18:32:00.991 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7419000000000001e-05 2024-05-08T18:32:00.991 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.991 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.991 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:00.991 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.124675+0000", 2024-05-08T18:32:00.991 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4313000000000001e-05 2024-05-08T18:32:00.992 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:00.992 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:00.992 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:00.992 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.992 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.992 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1409 3.3 3:c39a24d8:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_95:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:32:00.992 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:43.363571+0000", 2024-05-08T18:32:00.992 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 17.563598955, 2024-05-08T18:32:00.992 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.021085779999999998, 2024-05-08T18:32:00.992 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:00.992 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:00.992 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:00.992 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:00.993 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:00.993 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:00.993 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1409 2024-05-08T18:32:00.993 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.993 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:00.993 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.993 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:00.993 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.363571+0000", 2024-05-08T18:32:00.993 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:00.993 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.993 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.993 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:00.993 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.363571+0000", 2024-05-08T18:32:00.993 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:00.994 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.994 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.994 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:00.994 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.363575+0000", 2024-05-08T18:32:00.994 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7579999999999998e-06 2024-05-08T18:32:00.994 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.994 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.994 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:00.994 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.368212+0000", 2024-05-08T18:32:00.994 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0046369269999999999 2024-05-08T18:32:00.994 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.994 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.994 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:00.995 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.368236+0000", 2024-05-08T18:32:00.995 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.442e-05 2024-05-08T18:32:00.995 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.995 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.995 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:00.995 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.368249+0000", 2024-05-08T18:32:00.995 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2451e-05 2024-05-08T18:32:00.995 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.995 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.995 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:00.995 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.368370+0000", 2024-05-08T18:32:00.995 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000121166 2024-05-08T18:32:00.995 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.995 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.996 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:00.996 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.368577+0000", 2024-05-08T18:32:00.996 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000207429 2024-05-08T18:32:00.996 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.996 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.996 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:32:00.996 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.368761+0000", 2024-05-08T18:32:00.996 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00018409599999999999 2024-05-08T18:32:00.996 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.996 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.996 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:00.996 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.379675+0000", 2024-05-08T18:32:00.996 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010913058999999999 2024-05-08T18:32:00.997 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.997 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.997 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:00.997 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.384574+0000", 2024-05-08T18:32:00.997 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.004899937 2024-05-08T18:32:00.997 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.997 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.997 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:00.997 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.384616+0000", 2024-05-08T18:32:00.997 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.2035e-05 2024-05-08T18:32:00.997 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.997 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.998 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:00.998 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.384657+0000", 2024-05-08T18:32:00.998 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0501999999999999e-05 2024-05-08T18:32:00.998 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:00.998 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:00.998 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:00.998 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.998 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.998 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1614 3.14 3:284b5d90:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-05-08T18:32:00.998 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:46.708825+0000", 2024-05-08T18:32:00.998 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 14.218344741999999, 2024-05-08T18:32:00.998 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.032864125000000001, 2024-05-08T18:32:00.998 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:00.998 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:00.999 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:00.999 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:00.999 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:00.999 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:00.999 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1614 2024-05-08T18:32:00.999 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.999 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:00.999 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:00.999 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:00.999 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.708825+0000", 2024-05-08T18:32:00.999 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:00.999 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:00.999 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.000 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:01.000 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.708825+0000", 2024-05-08T18:32:01.000 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:01.000 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.000 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.000 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:01.000 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.708828+0000", 2024-05-08T18:32:01.000 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6630000000000002e-06 2024-05-08T18:32:01.000 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.000 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.000 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:01.000 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.715671+0000", 2024-05-08T18:32:01.000 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.006842669 2024-05-08T18:32:01.000 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.001 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.001 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:01.001 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.715706+0000", 2024-05-08T18:32:01.001 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4872000000000001e-05 2024-05-08T18:32:01.001 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.001 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.001 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:01.001 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.715722+0000", 2024-05-08T18:32:01.001 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6670000000000001e-05 2024-05-08T18:32:01.001 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.001 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.001 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:01.001 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.715850+0000", 2024-05-08T18:32:01.002 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000127322 2024-05-08T18:32:01.002 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.002 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.002 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:01.002 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.716102+0000", 2024-05-08T18:32:01.002 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00025211899999999998 2024-05-08T18:32:01.002 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.002 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.002 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 7", 2024-05-08T18:32:01.002 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.716339+0000", 2024-05-08T18:32:01.002 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00023702099999999999 2024-05-08T18:32:01.002 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.003 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.003 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:01.003 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.737899+0000", 2024-05-08T18:32:01.003 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.021560414 2024-05-08T18:32:01.003 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.003 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.003 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:01.003 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.741414+0000", 2024-05-08T18:32:01.003 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0035152669999999999 2024-05-08T18:32:01.003 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.003 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.003 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:01.003 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.741571+0000", 2024-05-08T18:32:01.003 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015644500000000001 2024-05-08T18:32:01.004 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.004 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.004 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:01.004 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.741690+0000", 2024-05-08T18:32:01.004 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000118663 2024-05-08T18:32:01.004 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:01.004 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:01.004 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:01.004 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.004 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.004 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1622 3.11 e83/21 3:8a36e97a:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_10:head v 83'7, mlcod=82'5)", 2024-05-08T18:32:01.004 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:46.797808+0000", 2024-05-08T18:32:01.005 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 14.129362623, 2024-05-08T18:32:01.005 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019395200000000001, 2024-05-08T18:32:01.005 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:01.005 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:01.005 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:01.005 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:01.005 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.005 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:01.005 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.797808+0000", 2024-05-08T18:32:01.005 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:01.005 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.005 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.006 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:01.006 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.797808+0000", 2024-05-08T18:32:01.006 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:01.006 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.006 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.006 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:01.006 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.797810+0000", 2024-05-08T18:32:01.006 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9800000000000001e-06 2024-05-08T18:32:01.006 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.006 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.006 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:01.007 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.801567+0000", 2024-05-08T18:32:01.007 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0037578709999999999 2024-05-08T18:32:01.007 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.007 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.007 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:01.007 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.801610+0000", 2024-05-08T18:32:01.007 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3013000000000003e-05 2024-05-08T18:32:01.007 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.007 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.007 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:01.007 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.801628+0000", 2024-05-08T18:32:01.007 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7677e-05 2024-05-08T18:32:01.007 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.008 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.008 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:01.008 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.801798+0000", 2024-05-08T18:32:01.008 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000169548 2024-05-08T18:32:01.008 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.008 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.008 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:01.008 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.801836+0000", 2024-05-08T18:32:01.008 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.799e-05 2024-05-08T18:32:01.008 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.008 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.008 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:01.009 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.817068+0000", 2024-05-08T18:32:01.009 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015232671999999999 2024-05-08T18:32:01.009 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.009 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.009 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:01.009 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.817203+0000", 2024-05-08T18:32:01.009 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000134449 2024-05-08T18:32:01.009 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:01.009 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:01.009 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:01.009 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.009 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.010 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1629 3.24 e83/21 3:27d2a12f:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_17:head v 83'2, mlcod=0'0)", 2024-05-08T18:32:01.010 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:46.875375+0000", 2024-05-08T18:32:01.010 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 14.051794923999999, 2024-05-08T18:32:01.010 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017035814, 2024-05-08T18:32:01.010 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:01.010 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:01.010 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:01.010 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:01.010 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.010 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:01.010 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.875375+0000", 2024-05-08T18:32:01.010 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:01.010 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.011 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.011 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:01.011 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.875375+0000", 2024-05-08T18:32:01.011 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:01.011 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.011 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.011 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:01.011 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.875378+0000", 2024-05-08T18:32:01.011 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6029999999999999e-06 2024-05-08T18:32:01.011 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.012 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.012 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:01.012 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.880781+0000", 2024-05-08T18:32:01.012 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0054034319999999997 2024-05-08T18:32:01.012 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.012 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.012 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:01.012 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.880818+0000", 2024-05-08T18:32:01.012 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6303000000000001e-05 2024-05-08T18:32:01.012 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.012 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.012 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:01.013 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.880833+0000", 2024-05-08T18:32:01.013 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5852999999999999e-05 2024-05-08T18:32:01.013 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.013 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.013 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:01.013 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.880987+0000", 2024-05-08T18:32:01.013 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015368599999999999 2024-05-08T18:32:01.013 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.013 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.013 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:01.013 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.881053+0000", 2024-05-08T18:32:01.013 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6260000000000006e-05 2024-05-08T18:32:01.014 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.014 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.014 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:01.014 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.892244+0000", 2024-05-08T18:32:01.014 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011191002 2024-05-08T18:32:01.014 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.014 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.014 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:01.014 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.892411+0000", 2024-05-08T18:32:01.014 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000166675 2024-05-08T18:32:01.014 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:01.014 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:01.014 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:01.015 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.015 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.015 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1638 3.9 3:9152f27e:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5_100Mb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-05-08T18:32:01.015 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:46.965638+0000", 2024-05-08T18:32:01.015 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 13.961532252, 2024-05-08T18:32:01.015 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.021363499000000001, 2024-05-08T18:32:01.015 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:01.015 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:01.015 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:01.015 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:01.015 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:01.016 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:01.016 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1638 2024-05-08T18:32:01.016 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.016 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:01.016 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.016 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:01.016 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.965638+0000", 2024-05-08T18:32:01.016 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:01.016 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.016 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.016 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:01.016 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.965638+0000", 2024-05-08T18:32:01.016 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:01.017 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.017 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.017 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:01.017 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.965640+0000", 2024-05-08T18:32:01.017 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.68e-06 2024-05-08T18:32:01.017 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.017 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.017 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:01.017 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.969701+0000", 2024-05-08T18:32:01.017 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0040609870000000003 2024-05-08T18:32:01.017 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.017 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.018 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:01.018 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.969734+0000", 2024-05-08T18:32:01.018 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3460000000000002e-05 2024-05-08T18:32:01.018 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.018 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.018 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:01.018 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.969750+0000", 2024-05-08T18:32:01.018 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5919000000000001e-05 2024-05-08T18:32:01.018 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.018 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.018 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:01.019 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.969886+0000", 2024-05-08T18:32:01.019 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000135759 2024-05-08T18:32:01.019 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.019 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.019 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:01.019 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.970159+0000", 2024-05-08T18:32:01.019 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00027367199999999998 2024-05-08T18:32:01.019 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.019 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.019 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-05-08T18:32:01.019 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.971062+0000", 2024-05-08T18:32:01.019 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00090291000000000004 2024-05-08T18:32:01.019 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.019 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.020 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:01.020 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.983851+0000", 2024-05-08T18:32:01.020 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012788882999999999 2024-05-08T18:32:01.020 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.020 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.020 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:01.020 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.986511+0000", 2024-05-08T18:32:01.020 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0026593530000000002 2024-05-08T18:32:01.020 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.020 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.020 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:01.020 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.986843+0000", 2024-05-08T18:32:01.020 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00033259400000000002 2024-05-08T18:32:01.021 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.021 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.021 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:01.021 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.987001+0000", 2024-05-08T18:32:01.021 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015828199999999999 2024-05-08T18:32:01.021 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:01.021 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:01.021 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:01.021 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.021 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.021 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1823 3.27 e92/21 3:e6e611e5:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_9:head v 92'8, mlcod=82'6)", 2024-05-08T18:32:01.021 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:00.525337+0000", 2024-05-08T18:32:01.021 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.40183300199999999, 2024-05-08T18:32:01.022 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019529722999999999, 2024-05-08T18:32:01.022 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:01.022 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:01.022 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:01.022 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:01.022 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.022 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:01.022 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.525337+0000", 2024-05-08T18:32:01.022 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:01.022 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.022 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.022 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:01.023 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.525337+0000", 2024-05-08T18:32:01.023 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:01.023 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.023 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.023 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:01.023 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.525339+0000", 2024-05-08T18:32:01.023 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0269999999999998e-06 2024-05-08T18:32:01.023 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.023 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.023 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:01.023 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.530485+0000", 2024-05-08T18:32:01.023 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.005145368 2024-05-08T18:32:01.023 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.024 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.024 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:01.024 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.530519+0000", 2024-05-08T18:32:01.024 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4765999999999999e-05 2024-05-08T18:32:01.024 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.024 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.024 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:01.024 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.530534+0000", 2024-05-08T18:32:01.024 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4521999999999999e-05 2024-05-08T18:32:01.024 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.024 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.024 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:01.024 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.530698+0000", 2024-05-08T18:32:01.025 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016412100000000001 2024-05-08T18:32:01.025 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.025 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.025 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:01.025 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.530761+0000", 2024-05-08T18:32:01.025 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3373000000000005e-05 2024-05-08T18:32:01.025 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.025 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.025 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:01.025 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.544760+0000", 2024-05-08T18:32:01.025 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013998696999999999 2024-05-08T18:32:01.025 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.026 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.026 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:01.026 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.544867+0000", 2024-05-08T18:32:01.026 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010684900000000001 2024-05-08T18:32:01.026 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:01.026 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:01.026 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:01.026 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.026 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.026 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1825 3.3 3:c2847c2a:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-05-08T18:32:01.026 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:00.555863+0000", 2024-05-08T18:32:01.026 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.37130731500000003, 2024-05-08T18:32:01.026 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.025211702999999999, 2024-05-08T18:32:01.027 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:01.027 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:01.027 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:01.027 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:01.027 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:01.027 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:01.027 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1825 2024-05-08T18:32:01.027 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.027 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:01.027 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.027 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:01.027 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.555863+0000", 2024-05-08T18:32:01.027 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:01.028 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.028 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.028 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:01.028 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.555863+0000", 2024-05-08T18:32:01.028 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:01.028 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.028 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.028 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:01.028 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.555868+0000", 2024-05-08T18:32:01.028 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6829999999999999e-06 2024-05-08T18:32:01.028 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.028 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.028 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:01.029 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.563352+0000", 2024-05-08T18:32:01.029 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0074842199999999998 2024-05-08T18:32:01.029 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.029 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.029 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:01.029 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.563383+0000", 2024-05-08T18:32:01.029 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1393000000000003e-05 2024-05-08T18:32:01.029 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.029 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.029 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:01.029 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.563399+0000", 2024-05-08T18:32:01.029 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6064000000000001e-05 2024-05-08T18:32:01.030 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.030 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.030 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:01.030 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.563492+0000", 2024-05-08T18:32:01.030 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2532000000000001e-05 2024-05-08T18:32:01.030 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.030 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.030 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:01.030 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.563672+0000", 2024-05-08T18:32:01.030 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000180039 2024-05-08T18:32:01.030 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.030 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.031 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:32:01.031 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.563839+0000", 2024-05-08T18:32:01.031 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000166885 2024-05-08T18:32:01.031 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.031 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.031 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:01.031 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.571019+0000", 2024-05-08T18:32:01.031 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0071807019999999997 2024-05-08T18:32:01.031 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.031 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.031 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:01.031 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.580888+0000", 2024-05-08T18:32:01.032 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0098690099999999992 2024-05-08T18:32:01.032 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.032 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.032 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:01.032 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.580985+0000", 2024-05-08T18:32:01.032 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6809000000000001e-05 2024-05-08T18:32:01.032 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.032 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.032 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:01.032 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.581075+0000", 2024-05-08T18:32:01.032 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.9365999999999998e-05 2024-05-08T18:32:01.032 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:01.032 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:01.033 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:01.033 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.033 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.033 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1828 3.1a 3:5be2bca0:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-05-08T18:32:01.033 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:00.608482+0000", 2024-05-08T18:32:01.033 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.31868807199999999, 2024-05-08T18:32:01.033 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.01966685, 2024-05-08T18:32:01.033 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:01.033 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:01.033 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:01.033 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:01.033 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:01.034 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:01.034 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1828 2024-05-08T18:32:01.034 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.034 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:01.034 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.034 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:01.034 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.608482+0000", 2024-05-08T18:32:01.034 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:01.034 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.034 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.034 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:01.034 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.608482+0000", 2024-05-08T18:32:01.034 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:01.034 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.035 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.035 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:01.035 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.608484+0000", 2024-05-08T18:32:01.035 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.697e-06 2024-05-08T18:32:01.035 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.035 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.035 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:01.035 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.612311+0000", 2024-05-08T18:32:01.035 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0038267370000000002 2024-05-08T18:32:01.035 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.035 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.035 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:01.035 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.612326+0000", 2024-05-08T18:32:01.035 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5699e-05 2024-05-08T18:32:01.036 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.036 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.036 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:01.036 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.612335+0000", 2024-05-08T18:32:01.036 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.7220000000000005e-06 2024-05-08T18:32:01.036 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.036 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.036 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:01.036 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.612394+0000", 2024-05-08T18:32:01.036 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9175999999999997e-05 2024-05-08T18:32:01.036 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.036 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.036 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:01.036 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.612522+0000", 2024-05-08T18:32:01.037 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012789 2024-05-08T18:32:01.037 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.037 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.037 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:32:01.037 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.612637+0000", 2024-05-08T18:32:01.037 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000114929 2024-05-08T18:32:01.037 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.037 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.037 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:01.037 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.620934+0000", 2024-05-08T18:32:01.037 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0082972099999999993 2024-05-08T18:32:01.037 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.038 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.038 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:01.038 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.628071+0000", 2024-05-08T18:32:01.038 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0071364169999999999 2024-05-08T18:32:01.038 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.038 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.038 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:01.038 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.628115+0000", 2024-05-08T18:32:01.038 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.422e-05 2024-05-08T18:32:01.038 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.038 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.038 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:01.038 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.628149+0000", 2024-05-08T18:32:01.039 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4153000000000003e-05 2024-05-08T18:32:01.039 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:01.039 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:01.039 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:01.039 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:01.039 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:01.039 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:32:01.041 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-08T18:32:01.041 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:32:01.038+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:32:01.142 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:32:01.138+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:32:01.239 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:32:01.239 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:32:01.240 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 0 2024-05-08T18:32:01.240 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:32:01.243 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:32:01.241+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:32:01.255 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-08T18:32:01.345 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:32:01.342+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:32:01.426 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:32:01.427 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:32:01.427 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2024-05-08T18:32:01.427 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2024-05-08T18:32:01.427 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:32:01.446 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-08T18:32:01.446 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:32:01.445+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:32:01.546 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:32:01.545+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:32:01.622 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:32:01.622 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2024-05-08T18:32:01.622 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2024-05-08T18:32:01.623 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-05-08T18:32:01.623 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.623 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1234 3.38 e80/21 3:1cb36fa1:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.2__shadow_.fYaqa8o34qSAauLRSqi3iwpmT5NwV5c_1:head v 80'1, mlcod=0'0)", 2024-05-08T18:32:01.623 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:38.217418+0000", 2024-05-08T18:32:01.623 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 23.400882443, 2024-05-08T18:32:01.623 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.02469151, 2024-05-08T18:32:01.623 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:01.623 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:01.623 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:01.623 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:01.623 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.623 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:01.623 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.217418+0000", 2024-05-08T18:32:01.624 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:01.624 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.624 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.624 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:01.624 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.217418+0000", 2024-05-08T18:32:01.624 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:01.624 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.624 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.624 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:01.624 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.217420+0000", 2024-05-08T18:32:01.624 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9970000000000001e-06 2024-05-08T18:32:01.624 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.624 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.624 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:01.625 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.225957+0000", 2024-05-08T18:32:01.625 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0085373180000000003 2024-05-08T18:32:01.625 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.625 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.625 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:01.625 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.226002+0000", 2024-05-08T18:32:01.625 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4462999999999998e-05 2024-05-08T18:32:01.625 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.625 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.625 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:01.625 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.226036+0000", 2024-05-08T18:32:01.625 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4286999999999999e-05 2024-05-08T18:32:01.625 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.625 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.626 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:01.626 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.226204+0000", 2024-05-08T18:32:01.626 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000168219 2024-05-08T18:32:01.626 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.626 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.626 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:01.626 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.226269+0000", 2024-05-08T18:32:01.626 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4858999999999997e-05 2024-05-08T18:32:01.626 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.626 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.626 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:01.626 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.242001+0000", 2024-05-08T18:32:01.626 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015731898000000001 2024-05-08T18:32:01.627 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.627 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.627 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:01.627 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.242109+0000", 2024-05-08T18:32:01.627 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010846899999999999 2024-05-08T18:32:01.627 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:01.627 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:01.627 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:01.627 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.628 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.628 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1237 3.c 3:3156de39:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.2_10Mb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (355) in=17b,setxattr user.rgw.acl (129) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-05-08T18:32:01.628 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:38.244592+0000", 2024-05-08T18:32:01.628 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 23.373708139000001, 2024-05-08T18:32:01.628 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.021467379000000002, 2024-05-08T18:32:01.628 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:01.628 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:01.628 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:01.628 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:01.628 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:01.628 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:01.628 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1237 2024-05-08T18:32:01.628 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.628 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:01.629 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.629 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:01.629 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.244592+0000", 2024-05-08T18:32:01.629 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:01.629 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.629 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.629 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:01.629 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.244592+0000", 2024-05-08T18:32:01.629 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:01.629 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.629 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.629 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:01.630 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.244599+0000", 2024-05-08T18:32:01.630 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3170000000000004e-06 2024-05-08T18:32:01.630 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.630 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.630 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:01.630 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.250239+0000", 2024-05-08T18:32:01.630 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0056396270000000004 2024-05-08T18:32:01.630 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.630 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.630 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:01.630 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.250279+0000", 2024-05-08T18:32:01.630 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0370000000000001e-05 2024-05-08T18:32:01.630 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.631 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.631 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:01.631 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.250305+0000", 2024-05-08T18:32:01.631 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5259999999999999e-05 2024-05-08T18:32:01.631 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.631 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.631 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:01.631 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.250509+0000", 2024-05-08T18:32:01.631 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020390800000000001 2024-05-08T18:32:01.631 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.631 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.631 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:01.631 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.250777+0000", 2024-05-08T18:32:01.631 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00026804200000000002 2024-05-08T18:32:01.632 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.632 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.632 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 3", 2024-05-08T18:32:01.632 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.251654+0000", 2024-05-08T18:32:01.632 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00087763999999999995 2024-05-08T18:32:01.632 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.632 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.632 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:01.632 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.263070+0000", 2024-05-08T18:32:01.632 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011415544 2024-05-08T18:32:01.632 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.632 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.632 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:01.632 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.265866+0000", 2024-05-08T18:32:01.633 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002795699 2024-05-08T18:32:01.633 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.633 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.633 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:01.633 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.265975+0000", 2024-05-08T18:32:01.633 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000109819 2024-05-08T18:32:01.633 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.633 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.633 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:01.633 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.266060+0000", 2024-05-08T18:32:01.633 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4153000000000006e-05 2024-05-08T18:32:01.633 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:01.633 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:01.634 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:01.634 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.634 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.634 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1318 3.c 3:329e59e6:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-08T18:32:01.634 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.337285+0000", 2024-05-08T18:32:01.634 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 19.281015715999999, 2024-05-08T18:32:01.634 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.024126754, 2024-05-08T18:32:01.634 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:01.634 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:01.634 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:01.634 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:01.634 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:01.635 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:01.635 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1318 2024-05-08T18:32:01.635 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.635 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:01.635 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.635 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:01.635 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.337285+0000", 2024-05-08T18:32:01.635 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:01.635 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.635 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.635 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:01.635 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.337285+0000", 2024-05-08T18:32:01.635 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:01.635 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.635 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.636 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:01.636 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.337288+0000", 2024-05-08T18:32:01.636 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6799999999999999e-06 2024-05-08T18:32:01.636 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.636 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.636 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:01.636 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.343559+0000", 2024-05-08T18:32:01.636 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0062709920000000004 2024-05-08T18:32:01.636 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.636 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.636 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:01.636 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.343600+0000", 2024-05-08T18:32:01.636 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0686000000000003e-05 2024-05-08T18:32:01.637 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.637 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.637 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:01.637 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.343621+0000", 2024-05-08T18:32:01.637 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1364000000000001e-05 2024-05-08T18:32:01.637 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.637 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.637 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:01.637 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.343774+0000", 2024-05-08T18:32:01.637 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000152495 2024-05-08T18:32:01.638 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.638 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.638 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:01.638 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.344025+0000", 2024-05-08T18:32:01.638 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00025118800000000001 2024-05-08T18:32:01.638 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.638 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.638 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 3", 2024-05-08T18:32:01.638 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.344259+0000", 2024-05-08T18:32:01.638 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000234455 2024-05-08T18:32:01.638 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.638 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.638 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:01.639 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.357786+0000", 2024-05-08T18:32:01.639 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013526338000000001 2024-05-08T18:32:01.639 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.639 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.639 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:01.639 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.361116+0000", 2024-05-08T18:32:01.639 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0033298619999999998 2024-05-08T18:32:01.639 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.639 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.639 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:01.639 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.361290+0000", 2024-05-08T18:32:01.639 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017451200000000001 2024-05-08T18:32:01.639 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.640 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.640 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:01.640 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.361411+0000", 2024-05-08T18:32:01.640 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012118200000000001 2024-05-08T18:32:01.640 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:01.640 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:01.640 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:01.640 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.640 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.640 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1324 3.3a 3:5fe59963:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-08T18:32:01.640 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.429632+0000", 2024-05-08T18:32:01.640 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 19.188668012000001, 2024-05-08T18:32:01.640 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019556068999999999, 2024-05-08T18:32:01.640 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:01.641 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:01.641 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:01.641 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:01.641 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:01.641 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:01.641 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1324 2024-05-08T18:32:01.641 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.641 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:01.641 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.641 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:01.641 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.429632+0000", 2024-05-08T18:32:01.641 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:01.641 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.641 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.642 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:01.642 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.429632+0000", 2024-05-08T18:32:01.642 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:01.642 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.642 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.642 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:01.642 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.429636+0000", 2024-05-08T18:32:01.642 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9060000000000004e-06 2024-05-08T18:32:01.642 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.642 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.642 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:01.642 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.434488+0000", 2024-05-08T18:32:01.642 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0048521270000000003 2024-05-08T18:32:01.643 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.643 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.643 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:01.643 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.434529+0000", 2024-05-08T18:32:01.643 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0365999999999999e-05 2024-05-08T18:32:01.643 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.643 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.643 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:01.643 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.434548+0000", 2024-05-08T18:32:01.643 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8893999999999999e-05 2024-05-08T18:32:01.643 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.643 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.643 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:01.644 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.434680+0000", 2024-05-08T18:32:01.644 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000132285 2024-05-08T18:32:01.644 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.644 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.644 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:01.644 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.434925+0000", 2024-05-08T18:32:01.644 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00024557799999999999 2024-05-08T18:32:01.644 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.644 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.644 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:32:01.644 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.435148+0000", 2024-05-08T18:32:01.644 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022281800000000001 2024-05-08T18:32:01.644 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.644 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.645 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:01.645 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.447529+0000", 2024-05-08T18:32:01.645 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012380584 2024-05-08T18:32:01.645 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.645 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.645 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:01.645 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.448987+0000", 2024-05-08T18:32:01.645 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0014577189999999999 2024-05-08T18:32:01.645 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.645 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.645 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:01.645 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.449113+0000", 2024-05-08T18:32:01.645 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000126482 2024-05-08T18:32:01.646 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.646 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.646 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:01.646 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.449188+0000", 2024-05-08T18:32:01.646 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5309999999999996e-05 2024-05-08T18:32:01.646 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:01.646 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:01.646 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:01.646 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.646 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.646 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1350 3.3a 3:5caef9cc:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_36:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:32:01.646 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.707170+0000", 2024-05-08T18:32:01.647 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 18.911130409999998, 2024-05-08T18:32:01.647 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.02479787, 2024-05-08T18:32:01.647 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:01.647 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:01.647 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:01.647 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:01.647 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:01.647 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:01.647 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1350 2024-05-08T18:32:01.647 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.647 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:01.647 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.647 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:01.647 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.707170+0000", 2024-05-08T18:32:01.648 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:01.648 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.648 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.648 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:01.648 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.707170+0000", 2024-05-08T18:32:01.648 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:01.648 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.648 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.648 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:01.648 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.707174+0000", 2024-05-08T18:32:01.648 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6629999999999999e-06 2024-05-08T18:32:01.648 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.648 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.648 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:01.649 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.713406+0000", 2024-05-08T18:32:01.649 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0062328030000000003 2024-05-08T18:32:01.649 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.649 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.649 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:01.649 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.713446+0000", 2024-05-08T18:32:01.649 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9990000000000002e-05 2024-05-08T18:32:01.649 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.649 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.649 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:01.649 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.713466+0000", 2024-05-08T18:32:01.649 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0136000000000002e-05 2024-05-08T18:32:01.649 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.650 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.650 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:01.650 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.713609+0000", 2024-05-08T18:32:01.650 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014227599999999999 2024-05-08T18:32:01.650 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.650 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.650 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:01.650 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.713871+0000", 2024-05-08T18:32:01.650 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000261885 2024-05-08T18:32:01.650 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.650 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.650 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:32:01.650 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.714152+0000", 2024-05-08T18:32:01.651 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00028181099999999998 2024-05-08T18:32:01.651 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.651 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.651 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:01.651 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.723750+0000", 2024-05-08T18:32:01.651 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0095972739999999994 2024-05-08T18:32:01.651 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.651 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.651 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:01.651 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.731740+0000", 2024-05-08T18:32:01.651 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0079900969999999998 2024-05-08T18:32:01.651 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.651 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.652 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:01.652 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.731843+0000", 2024-05-08T18:32:01.652 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000103052 2024-05-08T18:32:01.652 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.652 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.652 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:01.652 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.731968+0000", 2024-05-08T18:32:01.652 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000124883 2024-05-08T18:32:01.652 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:01.652 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:01.652 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:01.652 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.652 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.653 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1355 3.28 3:14052413:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_41:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:32:01.653 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.762527+0000", 2024-05-08T18:32:01.653 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 18.855772847000001, 2024-05-08T18:32:01.653 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.026016406999999998, 2024-05-08T18:32:01.653 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:01.653 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:01.653 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:01.653 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:01.653 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:01.653 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:01.653 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1355 2024-05-08T18:32:01.653 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.653 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:01.654 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.654 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:01.654 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.762527+0000", 2024-05-08T18:32:01.654 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:01.654 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.654 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.654 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:01.654 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.762527+0000", 2024-05-08T18:32:01.654 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:01.654 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.654 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.654 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:01.654 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.762545+0000", 2024-05-08T18:32:01.655 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7045999999999999e-05 2024-05-08T18:32:01.655 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.655 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.655 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:01.655 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.767178+0000", 2024-05-08T18:32:01.655 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0046339420000000003 2024-05-08T18:32:01.655 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.655 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.655 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:01.655 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.767214+0000", 2024-05-08T18:32:01.655 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5855999999999997e-05 2024-05-08T18:32:01.655 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.655 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.655 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:01.656 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.767242+0000", 2024-05-08T18:32:01.656 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8113e-05 2024-05-08T18:32:01.656 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.656 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.656 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:01.656 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.767401+0000", 2024-05-08T18:32:01.656 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000158429 2024-05-08T18:32:01.656 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.656 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.656 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:01.656 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.767648+0000", 2024-05-08T18:32:01.656 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000247328 2024-05-08T18:32:01.656 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.657 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.657 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 3", 2024-05-08T18:32:01.657 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.767899+0000", 2024-05-08T18:32:01.657 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00025059799999999999 2024-05-08T18:32:01.657 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.657 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.657 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:01.657 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.780702+0000", 2024-05-08T18:32:01.657 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012803238 2024-05-08T18:32:01.657 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.657 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.657 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:01.657 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.788231+0000", 2024-05-08T18:32:01.657 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0075285090000000001 2024-05-08T18:32:01.658 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.658 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.658 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:01.658 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.788402+0000", 2024-05-08T18:32:01.658 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017113299999999999 2024-05-08T18:32:01.658 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.658 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.658 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:01.658 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.788544+0000", 2024-05-08T18:32:01.658 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014221500000000001 2024-05-08T18:32:01.658 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:01.658 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:01.658 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:01.659 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.659 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.659 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1377 3.28 3:1730bdaf:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_63:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:32:01.659 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.996763+0000", 2024-05-08T18:32:01.659 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 18.621537699000001, 2024-05-08T18:32:01.659 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.02215497, 2024-05-08T18:32:01.659 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:01.659 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:01.659 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:01.659 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:01.659 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:01.659 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:01.659 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1377 2024-05-08T18:32:01.660 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.660 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:01.660 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.660 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:01.660 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.996763+0000", 2024-05-08T18:32:01.660 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:01.660 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.660 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.660 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:01.660 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.996763+0000", 2024-05-08T18:32:01.660 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:01.660 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.660 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.661 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:01.661 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.996766+0000", 2024-05-08T18:32:01.661 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.9299999999999999e-06 2024-05-08T18:32:01.661 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.661 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.661 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:01.661 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.002222+0000", 2024-05-08T18:32:01.661 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0054559819999999998 2024-05-08T18:32:01.661 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.661 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.661 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:01.661 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.002259+0000", 2024-05-08T18:32:01.661 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7222999999999999e-05 2024-05-08T18:32:01.661 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.662 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.662 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:01.662 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.002277+0000", 2024-05-08T18:32:01.662 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8607e-05 2024-05-08T18:32:01.662 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.662 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.662 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:01.662 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.002484+0000", 2024-05-08T18:32:01.662 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020670500000000001 2024-05-08T18:32:01.662 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.662 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.662 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:01.662 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.002843+0000", 2024-05-08T18:32:01.663 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00035888100000000002 2024-05-08T18:32:01.663 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.663 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.663 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 3", 2024-05-08T18:32:01.663 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.003165+0000", 2024-05-08T18:32:01.663 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00032193 2024-05-08T18:32:01.663 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.663 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.663 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:01.663 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.011993+0000", 2024-05-08T18:32:01.663 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.008827718 2024-05-08T18:32:01.663 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.663 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.663 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:01.664 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.018733+0000", 2024-05-08T18:32:01.664 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.006739989 2024-05-08T18:32:01.664 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.664 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.664 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:01.664 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.018840+0000", 2024-05-08T18:32:01.664 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000107799 2024-05-08T18:32:01.664 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.664 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.664 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:01.664 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.018918+0000", 2024-05-08T18:32:01.664 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.7206000000000006e-05 2024-05-08T18:32:01.664 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:01.664 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:01.664 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:01.665 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.665 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.665 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1407 3.22 3:46b64ebe:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_93:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:32:01.665 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:43.343033+0000", 2024-05-08T18:32:01.665 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 18.275267352, 2024-05-08T18:32:01.665 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.022710952, 2024-05-08T18:32:01.665 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:01.665 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:01.665 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:01.665 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:01.665 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:01.665 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:01.665 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1407 2024-05-08T18:32:01.666 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.666 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:01.666 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.666 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:01.666 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.343033+0000", 2024-05-08T18:32:01.666 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:01.666 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.666 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.666 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:01.666 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.343033+0000", 2024-05-08T18:32:01.666 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:01.666 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.666 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.666 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:01.667 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.343035+0000", 2024-05-08T18:32:01.667 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5100000000000001e-06 2024-05-08T18:32:01.667 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.667 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.667 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:01.667 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.346921+0000", 2024-05-08T18:32:01.667 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0038850489999999998 2024-05-08T18:32:01.667 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.667 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.667 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:01.667 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.346943+0000", 2024-05-08T18:32:01.667 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2897000000000001e-05 2024-05-08T18:32:01.667 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.668 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.668 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:01.668 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.346956+0000", 2024-05-08T18:32:01.668 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2159e-05 2024-05-08T18:32:01.668 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.668 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.668 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:01.668 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.347033+0000", 2024-05-08T18:32:01.668 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.7898000000000005e-05 2024-05-08T18:32:01.668 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.668 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.668 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:01.668 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.347179+0000", 2024-05-08T18:32:01.668 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014600400000000001 2024-05-08T18:32:01.668 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.669 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.669 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 3", 2024-05-08T18:32:01.669 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.347304+0000", 2024-05-08T18:32:01.669 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012491100000000001 2024-05-08T18:32:01.669 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.669 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.669 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:01.669 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.355666+0000", 2024-05-08T18:32:01.669 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0083618319999999996 2024-05-08T18:32:01.669 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.669 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.669 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:01.669 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.365667+0000", 2024-05-08T18:32:01.670 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010000289000000001 2024-05-08T18:32:01.670 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.670 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.670 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:01.670 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.365709+0000", 2024-05-08T18:32:01.670 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.2549000000000002e-05 2024-05-08T18:32:01.670 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.670 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.670 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:01.670 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.365744+0000", 2024-05-08T18:32:01.670 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4854000000000002e-05 2024-05-08T18:32:01.670 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:01.670 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:01.670 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:01.671 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.671 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.671 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1413 3.2f 3:f6ed8c1f:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_99:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:32:01.671 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:43.405307+0000", 2024-05-08T18:32:01.671 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 18.212993564000001, 2024-05-08T18:32:01.671 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.025254335999999999, 2024-05-08T18:32:01.671 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:01.671 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:01.671 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:01.671 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:01.671 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:01.671 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:01.671 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1413 2024-05-08T18:32:01.671 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.672 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:01.672 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.672 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:01.672 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.405307+0000", 2024-05-08T18:32:01.672 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:01.672 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.672 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.672 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:01.672 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.405307+0000", 2024-05-08T18:32:01.672 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:01.672 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.672 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.672 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:01.672 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.405310+0000", 2024-05-08T18:32:01.673 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0800000000000002e-06 2024-05-08T18:32:01.673 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.673 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.673 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:01.673 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.411517+0000", 2024-05-08T18:32:01.673 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0062069270000000001 2024-05-08T18:32:01.673 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.673 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.673 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:01.673 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.411551+0000", 2024-05-08T18:32:01.673 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4579000000000002e-05 2024-05-08T18:32:01.673 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.673 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.673 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:01.674 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.411570+0000", 2024-05-08T18:32:01.674 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8179999999999999e-05 2024-05-08T18:32:01.674 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.674 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.674 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:01.674 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.411654+0000", 2024-05-08T18:32:01.674 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4708000000000003e-05 2024-05-08T18:32:01.674 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.674 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.674 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:01.674 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.411768+0000", 2024-05-08T18:32:01.674 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000114176 2024-05-08T18:32:01.674 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.674 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.674 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 7", 2024-05-08T18:32:01.675 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.411864+0000", 2024-05-08T18:32:01.675 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.5637000000000006e-05 2024-05-08T18:32:01.675 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.675 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.675 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:01.675 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.420357+0000", 2024-05-08T18:32:01.675 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0084934529999999998 2024-05-08T18:32:01.675 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.675 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.675 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:01.675 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.430427+0000", 2024-05-08T18:32:01.675 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010069855000000001 2024-05-08T18:32:01.675 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.676 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.676 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:01.676 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.430501+0000", 2024-05-08T18:32:01.676 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3613000000000001e-05 2024-05-08T18:32:01.676 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.676 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.676 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:01.676 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.430561+0000", 2024-05-08T18:32:01.676 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.0127999999999998e-05 2024-05-08T18:32:01.676 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:01.676 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:01.676 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:01.676 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.676 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.677 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1416 3.30 3:0e28688d:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_102:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:32:01.677 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:43.434441+0000", 2024-05-08T18:32:01.677 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 18.183859680000001, 2024-05-08T18:32:01.677 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019457368999999999, 2024-05-08T18:32:01.677 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:01.677 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:01.677 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:01.677 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:01.677 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:01.677 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:01.677 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1416 2024-05-08T18:32:01.677 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.677 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:01.677 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.677 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:01.678 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.434441+0000", 2024-05-08T18:32:01.678 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:01.678 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.678 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.678 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:01.678 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.434441+0000", 2024-05-08T18:32:01.678 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:01.678 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.678 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.678 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:01.678 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.434443+0000", 2024-05-08T18:32:01.678 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6029999999999999e-06 2024-05-08T18:32:01.679 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.679 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.679 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:01.679 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.438597+0000", 2024-05-08T18:32:01.679 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0041532890000000001 2024-05-08T18:32:01.679 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.679 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.679 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:01.679 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.438645+0000", 2024-05-08T18:32:01.679 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8563999999999998e-05 2024-05-08T18:32:01.679 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.679 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.679 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:01.679 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.438673+0000", 2024-05-08T18:32:01.680 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7526e-05 2024-05-08T18:32:01.680 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.680 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.680 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:01.680 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.438775+0000", 2024-05-08T18:32:01.680 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0001024 2024-05-08T18:32:01.680 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.680 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.680 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:01.680 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.438896+0000", 2024-05-08T18:32:01.680 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000121471 2024-05-08T18:32:01.680 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.680 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.680 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:32:01.681 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.438993+0000", 2024-05-08T18:32:01.681 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6689999999999998e-05 2024-05-08T18:32:01.681 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.681 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.681 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:01.681 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.444986+0000", 2024-05-08T18:32:01.681 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0059928250000000002 2024-05-08T18:32:01.681 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.681 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.681 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:01.681 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.453733+0000", 2024-05-08T18:32:01.681 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0087465570000000003 2024-05-08T18:32:01.681 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.681 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.682 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:01.682 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.453823+0000", 2024-05-08T18:32:01.682 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.0044999999999996e-05 2024-05-08T18:32:01.682 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.682 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.682 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:01.682 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.453898+0000", 2024-05-08T18:32:01.682 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5399000000000001e-05 2024-05-08T18:32:01.682 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:01.682 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:01.682 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:01.682 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.682 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.682 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1615 3.35 e83/21 3:ae758c88:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_3:head v 83'7, mlcod=82'5)", 2024-05-08T18:32:01.683 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:46.729645+0000", 2024-05-08T18:32:01.683 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 14.888654921000001, 2024-05-08T18:32:01.683 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.022764072, 2024-05-08T18:32:01.683 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:01.683 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:01.683 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:01.683 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:01.683 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.683 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:01.683 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.729645+0000", 2024-05-08T18:32:01.683 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:01.683 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.683 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.683 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:01.684 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.729645+0000", 2024-05-08T18:32:01.684 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:01.684 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.684 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.684 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:01.684 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.729649+0000", 2024-05-08T18:32:01.684 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3830000000000001e-06 2024-05-08T18:32:01.684 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.684 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.684 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:01.684 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.734571+0000", 2024-05-08T18:32:01.684 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0049222600000000004 2024-05-08T18:32:01.684 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.684 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.685 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:01.685 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.734611+0000", 2024-05-08T18:32:01.685 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9969000000000003e-05 2024-05-08T18:32:01.685 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.685 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.685 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:01.685 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.734629+0000", 2024-05-08T18:32:01.685 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7827000000000001e-05 2024-05-08T18:32:01.685 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.685 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.685 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:01.685 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.734800+0000", 2024-05-08T18:32:01.685 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000170929 2024-05-08T18:32:01.685 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.686 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.686 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:01.686 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.734867+0000", 2024-05-08T18:32:01.686 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6952000000000005e-05 2024-05-08T18:32:01.686 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.686 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.686 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:01.686 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.752282+0000", 2024-05-08T18:32:01.686 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017415669000000002 2024-05-08T18:32:01.686 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.686 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.686 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:01.686 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.752409+0000", 2024-05-08T18:32:01.686 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000127083 2024-05-08T18:32:01.687 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:01.687 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:01.687 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:01.687 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.687 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.687 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1618 3.1c 3:3b36ad14:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-05-08T18:32:01.687 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:46.750394+0000", 2024-05-08T18:32:01.687 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 14.867906726999999, 2024-05-08T18:32:01.687 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.023322207000000001, 2024-05-08T18:32:01.687 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:01.687 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:01.687 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:01.687 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:01.687 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:01.688 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:01.688 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1618 2024-05-08T18:32:01.688 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.688 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:01.688 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.688 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:01.688 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.750394+0000", 2024-05-08T18:32:01.688 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:01.688 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.688 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.688 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:01.688 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.750394+0000", 2024-05-08T18:32:01.688 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:01.688 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.689 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.689 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:01.689 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.750399+0000", 2024-05-08T18:32:01.689 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9760000000000003e-06 2024-05-08T18:32:01.689 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.689 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.689 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:01.689 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.756899+0000", 2024-05-08T18:32:01.689 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0065001809999999998 2024-05-08T18:32:01.689 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.689 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.689 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:01.689 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.756936+0000", 2024-05-08T18:32:01.689 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7716000000000003e-05 2024-05-08T18:32:01.689 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.690 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.690 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:01.690 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.756955+0000", 2024-05-08T18:32:01.690 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8196999999999999e-05 2024-05-08T18:32:01.690 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.690 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.690 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:01.690 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.757132+0000", 2024-05-08T18:32:01.690 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017692200000000001 2024-05-08T18:32:01.690 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.690 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.690 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:01.690 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.757531+0000", 2024-05-08T18:32:01.690 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00039989700000000002 2024-05-08T18:32:01.691 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.691 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.691 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 4", 2024-05-08T18:32:01.691 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.757770+0000", 2024-05-08T18:32:01.691 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000238908 2024-05-08T18:32:01.691 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.691 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.691 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:01.691 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.768339+0000", 2024-05-08T18:32:01.691 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010568394 2024-05-08T18:32:01.691 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.691 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.691 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:01.692 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.773409+0000", 2024-05-08T18:32:01.692 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0050704019999999999 2024-05-08T18:32:01.692 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.692 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.692 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:01.692 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.773584+0000", 2024-05-08T18:32:01.692 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017481500000000001 2024-05-08T18:32:01.692 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.692 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.692 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:01.692 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.773716+0000", 2024-05-08T18:32:01.692 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013179899999999999 2024-05-08T18:32:01.692 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:01.692 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:01.692 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:01.693 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.693 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.693 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1816 3.2f 3:f49f92e1:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-05-08T18:32:01.693 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:00.419070+0000", 2024-05-08T18:32:01.693 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 1.199230534, 2024-05-08T18:32:01.693 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.026961746000000002, 2024-05-08T18:32:01.693 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:01.693 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:01.693 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:01.693 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:01.693 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:01.693 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:01.693 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1816 2024-05-08T18:32:01.694 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.694 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:01.694 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.694 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:01.694 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.419070+0000", 2024-05-08T18:32:01.694 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:01.694 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.694 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.694 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:01.694 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.419070+0000", 2024-05-08T18:32:01.694 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:01.694 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.694 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.695 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:01.695 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.419073+0000", 2024-05-08T18:32:01.695 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3529999999999999e-06 2024-05-08T18:32:01.695 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.695 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.695 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:01.695 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.426045+0000", 2024-05-08T18:32:01.695 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0069723609999999998 2024-05-08T18:32:01.695 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.695 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.695 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:01.695 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.426086+0000", 2024-05-08T18:32:01.695 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.019e-05 2024-05-08T18:32:01.695 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.695 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.696 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:01.696 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.426105+0000", 2024-05-08T18:32:01.696 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9076000000000002e-05 2024-05-08T18:32:01.696 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.696 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.696 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:01.696 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.426263+0000", 2024-05-08T18:32:01.696 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015805600000000001 2024-05-08T18:32:01.696 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.696 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.696 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:01.696 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.426600+0000", 2024-05-08T18:32:01.696 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00033738399999999998 2024-05-08T18:32:01.696 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.697 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.697 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 7", 2024-05-08T18:32:01.697 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.426840+0000", 2024-05-08T18:32:01.697 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000239962 2024-05-08T18:32:01.697 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.697 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.697 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:01.697 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.441632+0000", 2024-05-08T18:32:01.697 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.014792008000000001 2024-05-08T18:32:01.697 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.697 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.697 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:01.697 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.445868+0000", 2024-05-08T18:32:01.697 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0042358880000000002 2024-05-08T18:32:01.698 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.698 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.698 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:01.698 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.445961+0000", 2024-05-08T18:32:01.698 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2474999999999998e-05 2024-05-08T18:32:01.698 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.698 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.698 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:01.698 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.446032+0000", 2024-05-08T18:32:01.698 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0993000000000003e-05 2024-05-08T18:32:01.698 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:01.698 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:01.698 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:01.698 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.699 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.699 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1819 3.30 3:0d002d77:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-05-08T18:32:01.699 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:00.476410+0000", 2024-05-08T18:32:01.699 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 1.1418904539999999, 2024-05-08T18:32:01.699 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.032375058999999998, 2024-05-08T18:32:01.699 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:01.699 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:01.699 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:01.699 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:01.699 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:01.699 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:01.699 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1819 2024-05-08T18:32:01.699 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.699 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:01.700 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.700 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:01.700 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.476410+0000", 2024-05-08T18:32:01.700 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:01.700 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.700 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.700 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:01.700 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.476410+0000", 2024-05-08T18:32:01.700 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:01.700 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.700 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.700 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:01.700 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.476413+0000", 2024-05-08T18:32:01.700 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7070000000000001e-06 2024-05-08T18:32:01.700 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.701 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.701 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:01.701 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.480961+0000", 2024-05-08T18:32:01.701 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0045480690000000001 2024-05-08T18:32:01.701 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.701 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.701 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:01.701 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.481003+0000", 2024-05-08T18:32:01.701 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1943000000000001e-05 2024-05-08T18:32:01.701 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.701 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.701 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:01.701 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.481028+0000", 2024-05-08T18:32:01.701 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5262999999999999e-05 2024-05-08T18:32:01.702 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.702 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.702 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:01.702 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.481144+0000", 2024-05-08T18:32:01.702 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000116087 2024-05-08T18:32:01.702 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.702 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.702 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:01.702 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.481343+0000", 2024-05-08T18:32:01.702 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00019893999999999999 2024-05-08T18:32:01.702 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.702 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.702 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:32:01.702 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.481517+0000", 2024-05-08T18:32:01.703 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000173697 2024-05-08T18:32:01.703 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.703 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.703 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:01.703 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.488942+0000", 2024-05-08T18:32:01.703 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0074250929999999998 2024-05-08T18:32:01.703 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.703 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.703 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:01.703 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.508658+0000", 2024-05-08T18:32:01.703 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019716469 2024-05-08T18:32:01.703 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.703 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.703 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:01.704 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.508729+0000", 2024-05-08T18:32:01.704 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1235000000000005e-05 2024-05-08T18:32:01.704 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.704 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.704 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:01.704 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.508785+0000", 2024-05-08T18:32:01.704 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5556000000000001e-05 2024-05-08T18:32:01.704 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:01.704 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:01.704 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:01.704 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.704 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.704 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1835 3.16 3:699c6ab6:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-05-08T18:32:01.704 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:00.707308+0000", 2024-05-08T18:32:01.705 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.91099195200000005, 2024-05-08T18:32:01.705 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019092260999999999, 2024-05-08T18:32:01.705 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:01.705 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:01.705 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:01.705 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:01.705 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:01.705 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:01.705 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1835 2024-05-08T18:32:01.705 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.705 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:01.705 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.705 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:01.705 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.707308+0000", 2024-05-08T18:32:01.706 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:01.706 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.706 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.706 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:01.706 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.707308+0000", 2024-05-08T18:32:01.706 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:01.706 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.706 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.706 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:01.706 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.707310+0000", 2024-05-08T18:32:01.706 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0449999999999999e-06 2024-05-08T18:32:01.706 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.706 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.706 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:01.707 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.713490+0000", 2024-05-08T18:32:01.707 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0061799020000000001 2024-05-08T18:32:01.707 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.707 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.707 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:01.707 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.713518+0000", 2024-05-08T18:32:01.707 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7974e-05 2024-05-08T18:32:01.707 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.707 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.707 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:01.707 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.713530+0000", 2024-05-08T18:32:01.707 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1780000000000001e-05 2024-05-08T18:32:01.707 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.708 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.708 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:01.708 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.713659+0000", 2024-05-08T18:32:01.708 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012919099999999999 2024-05-08T18:32:01.708 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.708 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.708 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:01.708 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.713937+0000", 2024-05-08T18:32:01.708 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00027779699999999998 2024-05-08T18:32:01.708 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.708 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.708 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 7", 2024-05-08T18:32:01.708 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.714187+0000", 2024-05-08T18:32:01.709 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00025033899999999998 2024-05-08T18:32:01.709 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.709 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.709 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:01.709 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.724672+0000", 2024-05-08T18:32:01.709 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010484200000000001 2024-05-08T18:32:01.709 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.709 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.709 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:01.709 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.726286+0000", 2024-05-08T18:32:01.709 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0016141250000000001 2024-05-08T18:32:01.709 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.709 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.709 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:01.710 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.726337+0000", 2024-05-08T18:32:01.710 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.0797000000000002e-05 2024-05-08T18:32:01.710 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.710 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.710 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:01.710 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.726401+0000", 2024-05-08T18:32:01.710 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4110999999999997e-05 2024-05-08T18:32:01.710 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:01.710 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:01.710 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:01.710 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.710 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.710 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1842 3.1f e93/21 3:fbc21dd9:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_28:head v 93'6, mlcod=84'4)", 2024-05-08T18:32:01.711 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:00.787400+0000", 2024-05-08T18:32:01.714 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.830899901, 2024-05-08T18:32:01.714 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018892874, 2024-05-08T18:32:01.714 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:01.714 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:01.714 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:01.714 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:01.714 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.714 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:01.714 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.787400+0000", 2024-05-08T18:32:01.714 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:01.714 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.714 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.714 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:01.714 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.787400+0000", 2024-05-08T18:32:01.715 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:01.715 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.715 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.715 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:01.715 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.787402+0000", 2024-05-08T18:32:01.715 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4780000000000001e-06 2024-05-08T18:32:01.715 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.715 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.715 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:01.715 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.791197+0000", 2024-05-08T18:32:01.715 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0037953000000000001 2024-05-08T18:32:01.715 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.715 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.715 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:01.716 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.791215+0000", 2024-05-08T18:32:01.716 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7846000000000002e-05 2024-05-08T18:32:01.716 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.716 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.716 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:01.716 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.791224+0000", 2024-05-08T18:32:01.716 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1479999999999995e-06 2024-05-08T18:32:01.716 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.716 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.716 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:01.716 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.791376+0000", 2024-05-08T18:32:01.716 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015229600000000001 2024-05-08T18:32:01.716 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.717 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.717 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:01.717 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.791442+0000", 2024-05-08T18:32:01.717 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5432000000000006e-05 2024-05-08T18:32:01.717 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.717 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.717 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:01.717 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.806229+0000", 2024-05-08T18:32:01.717 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.014787270999999999 2024-05-08T18:32:01.717 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.717 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.717 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:01.717 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.806293+0000", 2024-05-08T18:32:01.717 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4103000000000006e-05 2024-05-08T18:32:01.718 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:01.718 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:01.718 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:01.718 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.718 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.718 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1866 3.17 e93/21 3:e89f8bff:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_52:head v 93'8, mlcod=84'6)", 2024-05-08T18:32:01.718 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:01.059520+0000", 2024-05-08T18:32:01.718 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.55878055299999996, 2024-05-08T18:32:01.718 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019782560000000001, 2024-05-08T18:32:01.718 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:01.718 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:01.718 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:01.718 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:01.719 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.719 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:01.719 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.059520+0000", 2024-05-08T18:32:01.719 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:01.719 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.719 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.719 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:01.719 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.059520+0000", 2024-05-08T18:32:01.719 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:01.719 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.719 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.719 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:01.719 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.059523+0000", 2024-05-08T18:32:01.719 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8229999999999999e-06 2024-05-08T18:32:01.719 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.720 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.720 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:01.720 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.063985+0000", 2024-05-08T18:32:01.720 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0044628460000000003 2024-05-08T18:32:01.720 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.720 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.720 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:01.720 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.064033+0000", 2024-05-08T18:32:01.720 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7825999999999999e-05 2024-05-08T18:32:01.720 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.720 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.720 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:01.720 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.064057+0000", 2024-05-08T18:32:01.721 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3883000000000002e-05 2024-05-08T18:32:01.721 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.721 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.721 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:01.721 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.064232+0000", 2024-05-08T18:32:01.721 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017526600000000001 2024-05-08T18:32:01.721 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.721 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.721 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:01.721 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.064301+0000", 2024-05-08T18:32:01.721 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8429000000000005e-05 2024-05-08T18:32:01.721 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.721 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.721 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:01.722 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.079213+0000", 2024-05-08T18:32:01.722 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.014911938 2024-05-08T18:32:01.722 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.722 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.722 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:01.722 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.079302+0000", 2024-05-08T18:32:01.722 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.9549000000000006e-05 2024-05-08T18:32:01.722 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:01.722 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:01.722 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:01.722 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.722 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.722 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1868 3.2f 3:f4cf47d6:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_54:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:32:01.722 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:01.082779+0000", 2024-05-08T18:32:01.723 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.53552159600000004, 2024-05-08T18:32:01.723 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.023993838999999999, 2024-05-08T18:32:01.723 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:01.723 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:01.723 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:01.723 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:01.723 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:01.723 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:01.723 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1868 2024-05-08T18:32:01.723 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.723 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:01.723 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.723 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:01.723 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.082779+0000", 2024-05-08T18:32:01.724 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:01.724 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.724 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.724 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:01.724 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.082779+0000", 2024-05-08T18:32:01.724 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:01.724 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.724 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.724 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:01.724 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.082782+0000", 2024-05-08T18:32:01.724 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1429999999999998e-06 2024-05-08T18:32:01.724 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.724 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.724 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:01.725 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.086738+0000", 2024-05-08T18:32:01.725 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039560749999999999 2024-05-08T18:32:01.725 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.725 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.725 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:01.725 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.086781+0000", 2024-05-08T18:32:01.725 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3513999999999997e-05 2024-05-08T18:32:01.725 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.725 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.725 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:01.725 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.086803+0000", 2024-05-08T18:32:01.725 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1505000000000002e-05 2024-05-08T18:32:01.725 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.726 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.726 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:01.726 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.086967+0000", 2024-05-08T18:32:01.726 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016404899999999999 2024-05-08T18:32:01.726 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.726 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.726 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:01.726 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.087238+0000", 2024-05-08T18:32:01.726 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00027128800000000001 2024-05-08T18:32:01.726 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.726 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.726 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 7", 2024-05-08T18:32:01.726 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.087500+0000", 2024-05-08T18:32:01.726 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00026215400000000001 2024-05-08T18:32:01.727 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.727 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.727 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:01.727 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.106273+0000", 2024-05-08T18:32:01.727 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018772832 2024-05-08T18:32:01.727 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.727 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.727 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:01.727 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.106605+0000", 2024-05-08T18:32:01.727 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00033141300000000002 2024-05-08T18:32:01.727 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.727 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.727 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:01.727 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.106698+0000", 2024-05-08T18:32:01.728 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.3706e-05 2024-05-08T18:32:01.728 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.728 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.728 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:01.728 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.106773+0000", 2024-05-08T18:32:01.728 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4159999999999995e-05 2024-05-08T18:32:01.728 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:01.728 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:01.728 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:01.728 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.728 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.728 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1872 3.1c 3:38d9a9dd:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_58:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:32:01.728 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:01.131325+0000", 2024-05-08T18:32:01.728 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.48697545399999997, 2024-05-08T18:32:01.729 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.021008104, 2024-05-08T18:32:01.729 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:01.729 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:01.729 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:01.729 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:01.729 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:01.729 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:01.729 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1872 2024-05-08T18:32:01.729 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.729 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:01.729 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.729 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:01.729 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.131325+0000", 2024-05-08T18:32:01.729 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:01.730 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.730 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.730 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:01.730 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.131325+0000", 2024-05-08T18:32:01.730 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:01.730 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.730 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.730 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:01.730 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.131327+0000", 2024-05-08T18:32:01.730 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3719999999999999e-06 2024-05-08T18:32:01.730 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.730 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.730 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:01.730 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.135126+0000", 2024-05-08T18:32:01.731 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003798381 2024-05-08T18:32:01.731 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.731 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.731 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:01.731 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.135146+0000", 2024-05-08T18:32:01.731 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.071e-05 2024-05-08T18:32:01.731 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.731 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.731 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:01.731 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.135161+0000", 2024-05-08T18:32:01.731 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4766000000000001e-05 2024-05-08T18:32:01.731 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.731 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.731 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:01.732 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.135291+0000", 2024-05-08T18:32:01.732 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000129901 2024-05-08T18:32:01.732 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.732 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.732 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:01.732 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.135515+0000", 2024-05-08T18:32:01.732 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000224293 2024-05-08T18:32:01.732 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.732 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.732 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 4", 2024-05-08T18:32:01.732 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.135731+0000", 2024-05-08T18:32:01.732 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00021577 2024-05-08T18:32:01.732 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.732 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.733 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:01.733 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.147443+0000", 2024-05-08T18:32:01.733 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011712323 2024-05-08T18:32:01.733 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.733 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.733 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:01.733 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.152045+0000", 2024-05-08T18:32:01.733 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0046019279999999999 2024-05-08T18:32:01.733 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.733 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.733 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:01.733 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.152200+0000", 2024-05-08T18:32:01.733 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015482399999999999 2024-05-08T18:32:01.733 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.733 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.734 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:01.734 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.152333+0000", 2024-05-08T18:32:01.734 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000132836 2024-05-08T18:32:01.734 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:01.734 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:01.734 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:01.734 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.734 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.734 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1876 3.c 3:31c32d98:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_62:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:32:01.734 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:01.196179+0000", 2024-05-08T18:32:01.734 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 0.42212139300000001, 2024-05-08T18:32:01.734 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.026072768, 2024-05-08T18:32:01.734 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:01.735 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:01.735 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:01.735 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:01.735 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:01.735 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:01.735 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1876 2024-05-08T18:32:01.735 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.735 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:01.735 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.735 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:01.735 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.196179+0000", 2024-05-08T18:32:01.735 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:01.735 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.735 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.735 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:01.736 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.196179+0000", 2024-05-08T18:32:01.736 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:01.736 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.736 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.736 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:01.736 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.196181+0000", 2024-05-08T18:32:01.736 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.367e-06 2024-05-08T18:32:01.736 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.736 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.736 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:01.736 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.200229+0000", 2024-05-08T18:32:01.736 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0040475240000000003 2024-05-08T18:32:01.736 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.736 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.737 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:01.737 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.200256+0000", 2024-05-08T18:32:01.737 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7404000000000001e-05 2024-05-08T18:32:01.737 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.737 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.737 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:01.737 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.200268+0000", 2024-05-08T18:32:01.737 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1813e-05 2024-05-08T18:32:01.737 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.737 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.737 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:01.737 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.200353+0000", 2024-05-08T18:32:01.737 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4474000000000005e-05 2024-05-08T18:32:01.737 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.737 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.738 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:01.738 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.200542+0000", 2024-05-08T18:32:01.738 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000189717 2024-05-08T18:32:01.738 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.738 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.738 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 3", 2024-05-08T18:32:01.738 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.200712+0000", 2024-05-08T18:32:01.738 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016992099999999999 2024-05-08T18:32:01.738 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.738 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.738 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:01.738 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.208663+0000", 2024-05-08T18:32:01.738 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0079506639999999996 2024-05-08T18:32:01.738 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.739 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.739 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:01.739 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.221964+0000", 2024-05-08T18:32:01.739 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013301362000000001 2024-05-08T18:32:01.739 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.739 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.739 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:01.739 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.222142+0000", 2024-05-08T18:32:01.739 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017776599999999999 2024-05-08T18:32:01.739 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:01.739 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:01.739 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:01.739 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.222252+0000", 2024-05-08T18:32:01.739 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000109756 2024-05-08T18:32:01.740 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:01.740 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:01.740 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:01.740 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:01.740 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:01.740 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:32:01.741 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-08T18:32:01.742 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:32:01.741+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:32:01.843 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:32:01.838+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:32:01.865 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-08T18:32:01.879 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:32:01.879 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:32:01.879 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 0 2024-05-08T18:32:01.879 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:32:01.894 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-08T18:32:01.980 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:32:01.978+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:32:02.044 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:32:02.045+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:32:02.073 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:32:02.073 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:32:02.074 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2024-05-08T18:32:02.074 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2024-05-08T18:32:02.074 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:32:02.097 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-08T18:32:02.098 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2024-05-08T18:32:02.098 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:32:02.121 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2024-05-08T18:32:02.121 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:32:02.144 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2024-05-08T18:32:02.144 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:32:02.144 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:32:02.145+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:32:02.167 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2024-05-08T18:32:02.167 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:32:02.203 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2024-05-08T18:32:02.203 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:32:02.230 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2024-05-08T18:32:02.231 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:32:02.245 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:32:02.242+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:32:02.255 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2024-05-08T18:32:02.255 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:32:02.273 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:32:02.273 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:32:02.276 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2024-05-08T18:32:02.277 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:32:02.291 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-08T18:32:02.348 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:32:02.349+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:32:02.448 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:32:02.442+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:32:02.471 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:32:02.471 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:32:02.486 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-08T18:32:02.572 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:32:02.570+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:32:02.650 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:32:02.646+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:32:02.665 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:32:02.665 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:32:02.687 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-08T18:32:02.727 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-08T18:32:02.776 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:32:02.774+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:32:02.851 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:32:02.849+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:32:02.879 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:32:02.879 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:32:02.894 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-08T18:32:02.952 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:32:02.953+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:32:03.045 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:32:03.046 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:32:03.053 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:32:03.053+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:32:03.068 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-08T18:32:03.156 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:32:03.157+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:32:03.243 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:32:03.243 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:32:03.256 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:32:03.250+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:32:03.260 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-08T18:32:03.356 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:32:03.357+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:32:03.445 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:32:03.445 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:32:03.457 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:32:03.454+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:32:03.465 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-08T18:32:03.559 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:32:03.557+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:32:03.651 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:32:03.651 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:32:03.660 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:32:03.658+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:32:03.670 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-08T18:32:03.698 INFO:tasks.workunit.client.0.smithi097.stdout:quota enabled for the user 0.746931095232384 2024-05-08T18:32:03.698 INFO:tasks.workunit.client.0.smithi097.stdout:adding file to bucket buck_2024_04_8_18_31_50: 1Gb. 2024-05-08T18:32:03.698 INFO:tasks.workunit.client.0.smithi097.stdout:upload file successful 2024-05-08T18:32:03.712 INFO:teuthology.orchestra.run.smithi097.stderr:nodeep-scrub is set 2024-05-08T18:32:03.776 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:32:03.777+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:32:03.819 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:32:03.819 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:32:03.835 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-08T18:32:03.862 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:32:03.858+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:32:03.881 INFO:tasks.workunit.client.0.smithi097.stdout:Bucket Created: buck_2024_04_8_18_32_03 2024-05-08T18:32:03.963 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:32:03.958+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:32:03.999 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:32:03.999 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:32:04.013 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-08T18:32:04.064 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:32:04.062+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:32:04.126 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:32:04.126 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:32:04.142 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-08T18:32:04.188 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:32:04.189+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:32:04.259 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:32:04.259 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:32:04.265 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:32:04.265+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:32:04.275 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-08T18:32:04.305 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-08T18:32:04.366 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:32:04.362+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:32:04.437 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:32:04.437 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:32:04.455 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-08T18:32:04.455 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2024-05-08T18:32:04.456 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:32:04.466 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:32:04.466+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:32:04.473 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2024-05-08T18:32:04.473 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:32:04.491 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2024-05-08T18:32:04.491 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:32:04.509 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2024-05-08T18:32:04.509 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:32:04.530 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2024-05-08T18:32:04.530 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:32:04.551 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2024-05-08T18:32:04.552 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:32:04.567 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:32:04.562+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:32:04.573 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:32:04.573 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:32:04.573 INFO:teuthology.orchestra.run.smithi097.stdout: "num_ops": 0 2024-05-08T18:32:04.573 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:32:04.574 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2024-05-08T18:32:04.575 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:32:04.591 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-08T18:32:04.595 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2024-05-08T18:32:04.596 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:32:04.668 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:32:04.666+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:32:04.709 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:32:04.709 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-05-08T18:32:04.709 INFO:teuthology.orchestra.run.smithi097.stdout: "complaint_time": 30, 2024-05-08T18:32:04.709 INFO:teuthology.orchestra.run.smithi097.stdout: "num_blocked_ops": 0 2024-05-08T18:32:04.709 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:32:04.727 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-08T18:32:04.777 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:32:04.777+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:32:04.838 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:32:04.839 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2024-05-08T18:32:04.839 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2024-05-08T18:32:04.839 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-05-08T18:32:04.839 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.839 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1234 3.38 3:1cb36fa1:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.2__shadow_.fYaqa8o34qSAauLRSqi3iwpmT5NwV5c_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-05-08T18:32:04.839 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:38.213439+0000", 2024-05-08T18:32:04.839 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 26.624042131, 2024-05-08T18:32:04.839 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.028973664, 2024-05-08T18:32:04.839 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:32:04.839 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:32:04.839 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:04.839 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:32:04.840 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:32:04.840 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:04.840 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1234 2024-05-08T18:32:04.840 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.840 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:32:04.840 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.840 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:32:04.840 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.213439+0000", 2024-05-08T18:32:04.840 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:04.840 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.840 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.840 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:32:04.840 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.213439+0000", 2024-05-08T18:32:04.840 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:04.841 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.841 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.841 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:32:04.841 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.213442+0000", 2024-05-08T18:32:04.841 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7580000000000001e-06 2024-05-08T18:32:04.841 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.841 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.841 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:32:04.841 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.216804+0000", 2024-05-08T18:32:04.841 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0033619520000000001 2024-05-08T18:32:04.841 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.841 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.841 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:32:04.841 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.216838+0000", 2024-05-08T18:32:04.842 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4437999999999998e-05 2024-05-08T18:32:04.842 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.842 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.842 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:32:04.842 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.216854+0000", 2024-05-08T18:32:04.842 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5823000000000001e-05 2024-05-08T18:32:04.842 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.842 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.842 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:32:04.842 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.216938+0000", 2024-05-08T18:32:04.842 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.3842000000000001e-05 2024-05-08T18:32:04.842 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.842 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.843 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:32:04.843 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.217046+0000", 2024-05-08T18:32:04.843 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000108717 2024-05-08T18:32:04.843 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.843 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.843 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:32:04.843 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.217137+0000", 2024-05-08T18:32:04.843 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0278000000000005e-05 2024-05-08T18:32:04.843 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.843 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.843 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:32:04.843 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.225461+0000", 2024-05-08T18:32:04.843 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0083239330000000004 2024-05-08T18:32:04.844 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.844 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.844 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:04.844 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.242319+0000", 2024-05-08T18:32:04.844 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.016858445999999999 2024-05-08T18:32:04.844 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.844 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.844 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:32:04.844 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.242359+0000", 2024-05-08T18:32:04.844 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9657000000000003e-05 2024-05-08T18:32:04.844 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.844 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.844 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:32:04.844 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.242413+0000", 2024-05-08T18:32:04.845 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3820000000000003e-05 2024-05-08T18:32:04.845 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:04.845 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:32:04.845 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:04.845 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.845 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.845 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1336 3.2 3:42c6ce4f:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:32:04.845 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.558532+0000", 2024-05-08T18:32:04.845 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 22.278948874000001, 2024-05-08T18:32:04.845 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.033214269999999997, 2024-05-08T18:32:04.845 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:32:04.845 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:32:04.845 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:04.845 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:32:04.846 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:32:04.846 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:04.846 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1336 2024-05-08T18:32:04.846 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.846 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:32:04.846 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.846 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:32:04.846 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.558532+0000", 2024-05-08T18:32:04.846 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:04.846 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.846 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.846 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:32:04.846 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.558532+0000", 2024-05-08T18:32:04.847 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:04.847 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.847 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.847 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:32:04.847 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.558535+0000", 2024-05-08T18:32:04.847 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9689999999999999e-06 2024-05-08T18:32:04.847 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.848 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.848 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:32:04.848 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.560549+0000", 2024-05-08T18:32:04.848 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0020142469999999998 2024-05-08T18:32:04.848 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.848 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.848 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:32:04.848 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.560576+0000", 2024-05-08T18:32:04.848 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6908000000000001e-05 2024-05-08T18:32:04.848 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.848 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.848 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:32:04.848 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.560595+0000", 2024-05-08T18:32:04.848 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8383999999999999e-05 2024-05-08T18:32:04.849 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.849 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.849 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:32:04.849 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.560680+0000", 2024-05-08T18:32:04.849 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5424000000000001e-05 2024-05-08T18:32:04.849 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.849 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.849 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-05-08T18:32:04.849 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.560685+0000", 2024-05-08T18:32:04.849 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.327e-06 2024-05-08T18:32:04.849 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.850 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.850 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:32:04.850 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.570079+0000", 2024-05-08T18:32:04.850 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0093940680000000002 2024-05-08T18:32:04.850 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.850 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.850 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:32:04.850 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.570249+0000", 2024-05-08T18:32:04.850 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000169953 2024-05-08T18:32:04.850 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.850 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.850 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-05-08T18:32:04.850 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.570423+0000", 2024-05-08T18:32:04.850 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00017355499999999999 2024-05-08T18:32:04.851 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.851 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.851 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:32:04.851 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.590293+0000", 2024-05-08T18:32:04.851 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019869761999999999 2024-05-08T18:32:04.851 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.851 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.851 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:04.851 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.591628+0000", 2024-05-08T18:32:04.851 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0013351599999999999 2024-05-08T18:32:04.851 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.851 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.851 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:32:04.851 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.591692+0000", 2024-05-08T18:32:04.851 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3822e-05 2024-05-08T18:32:04.852 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.852 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.852 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:32:04.852 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.591746+0000", 2024-05-08T18:32:04.852 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4691000000000002e-05 2024-05-08T18:32:04.852 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:04.852 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:32:04.852 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:04.852 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.852 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.852 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1348 3.38 3:1ca8d3e1:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_34:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:32:04.852 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.684650+0000", 2024-05-08T18:32:04.852 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 22.152830976000001, 2024-05-08T18:32:04.852 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.018994840999999998, 2024-05-08T18:32:04.853 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:32:04.853 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:32:04.853 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:04.853 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:32:04.853 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:32:04.853 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:04.853 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1348 2024-05-08T18:32:04.853 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.853 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:32:04.853 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.853 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:32:04.853 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.684650+0000", 2024-05-08T18:32:04.853 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:04.853 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.853 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.854 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:32:04.854 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.684650+0000", 2024-05-08T18:32:04.854 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:04.854 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.854 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.854 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:32:04.854 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.684652+0000", 2024-05-08T18:32:04.854 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3860000000000001e-06 2024-05-08T18:32:04.854 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.854 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.854 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:32:04.854 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.686933+0000", 2024-05-08T18:32:04.854 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0022806369999999999 2024-05-08T18:32:04.855 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.855 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.855 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:32:04.855 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.686950+0000", 2024-05-08T18:32:04.855 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7377e-05 2024-05-08T18:32:04.855 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.855 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.855 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:32:04.855 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.686962+0000", 2024-05-08T18:32:04.855 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1756000000000001e-05 2024-05-08T18:32:04.855 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.855 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.855 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:32:04.856 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.687038+0000", 2024-05-08T18:32:04.856 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.5623000000000004e-05 2024-05-08T18:32:04.856 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.856 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.856 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:32:04.856 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.687226+0000", 2024-05-08T18:32:04.857 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000188457 2024-05-08T18:32:04.857 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.857 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.857 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:32:04.857 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.687394+0000", 2024-05-08T18:32:04.857 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016753300000000001 2024-05-08T18:32:04.857 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.857 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.857 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:32:04.858 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.694346+0000", 2024-05-08T18:32:04.858 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0069519639999999997 2024-05-08T18:32:04.858 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.858 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.858 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:04.858 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.703479+0000", 2024-05-08T18:32:04.858 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0091331829999999996 2024-05-08T18:32:04.858 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.858 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.858 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:32:04.858 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.703567+0000", 2024-05-08T18:32:04.858 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8294000000000005e-05 2024-05-08T18:32:04.859 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.859 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.859 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:32:04.859 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.703645+0000", 2024-05-08T18:32:04.859 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7631000000000003e-05 2024-05-08T18:32:04.859 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:04.859 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:32:04.859 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:04.859 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.860 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.860 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1349 3.27 3:e5090c80:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_35:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:32:04.860 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.696361+0000", 2024-05-08T18:32:04.860 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 22.141119906, 2024-05-08T18:32:04.860 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019944929, 2024-05-08T18:32:04.860 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:32:04.860 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:32:04.860 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:04.860 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:32:04.860 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:32:04.861 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:04.861 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1349 2024-05-08T18:32:04.861 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.861 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:32:04.861 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.861 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:32:04.861 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.696361+0000", 2024-05-08T18:32:04.861 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:04.861 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.861 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.861 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:32:04.861 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.696361+0000", 2024-05-08T18:32:04.861 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:04.862 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.862 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.862 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:32:04.862 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.696363+0000", 2024-05-08T18:32:04.862 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1160000000000002e-06 2024-05-08T18:32:04.862 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.862 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.862 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:32:04.862 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.698294+0000", 2024-05-08T18:32:04.862 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001931026 2024-05-08T18:32:04.863 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.863 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.863 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:32:04.863 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.698324+0000", 2024-05-08T18:32:04.863 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9658e-05 2024-05-08T18:32:04.863 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.863 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.863 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:32:04.863 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.698339+0000", 2024-05-08T18:32:04.863 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5381000000000001e-05 2024-05-08T18:32:04.864 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.864 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.864 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:32:04.864 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.698430+0000", 2024-05-08T18:32:04.864 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0353999999999996e-05 2024-05-08T18:32:04.864 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.864 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.864 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:32:04.864 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.698591+0000", 2024-05-08T18:32:04.864 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016140999999999999 2024-05-08T18:32:04.865 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.865 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.865 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:32:04.865 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.698741+0000", 2024-05-08T18:32:04.865 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014955099999999999 2024-05-08T18:32:04.865 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.865 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.865 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:32:04.865 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.706987+0000", 2024-05-08T18:32:04.865 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0082466599999999994 2024-05-08T18:32:04.865 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.865 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.866 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:04.866 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.716183+0000", 2024-05-08T18:32:04.866 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0091959529999999998 2024-05-08T18:32:04.866 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.866 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.866 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:32:04.866 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.716252+0000", 2024-05-08T18:32:04.866 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8804000000000001e-05 2024-05-08T18:32:04.866 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.866 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.867 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:32:04.867 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.716306+0000", 2024-05-08T18:32:04.867 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4015999999999999e-05 2024-05-08T18:32:04.867 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:04.867 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:32:04.867 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:04.867 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.867 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.867 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1355 3.28 e82/21 3:14052413:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_41:head v 82'1, mlcod=0'0)", 2024-05-08T18:32:04.867 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.768053+0000", 2024-05-08T18:32:04.867 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 22.069428074000001, 2024-05-08T18:32:04.868 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019664687, 2024-05-08T18:32:04.868 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:32:04.868 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:32:04.868 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:04.868 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:32:04.868 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.868 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:32:04.868 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.768053+0000", 2024-05-08T18:32:04.868 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:04.868 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.868 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.868 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:32:04.868 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.768053+0000", 2024-05-08T18:32:04.868 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:04.869 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.869 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.869 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:32:04.869 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.768055+0000", 2024-05-08T18:32:04.869 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6959999999999999e-06 2024-05-08T18:32:04.869 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.869 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.869 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:32:04.869 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.772115+0000", 2024-05-08T18:32:04.869 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0040600139999999998 2024-05-08T18:32:04.869 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.869 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.869 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:32:04.869 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.772149+0000", 2024-05-08T18:32:04.870 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4638999999999998e-05 2024-05-08T18:32:04.870 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.870 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.870 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:32:04.870 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.772165+0000", 2024-05-08T18:32:04.870 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5435999999999999e-05 2024-05-08T18:32:04.870 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.870 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.870 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:32:04.870 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.772261+0000", 2024-05-08T18:32:04.870 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.6724000000000004e-05 2024-05-08T18:32:04.870 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.871 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.871 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:32:04.871 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.772289+0000", 2024-05-08T18:32:04.871 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7243e-05 2024-05-08T18:32:04.871 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.871 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.871 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:32:04.871 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.787670+0000", 2024-05-08T18:32:04.872 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.015380906 2024-05-08T18:32:04.872 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.872 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.872 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:32:04.872 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.787718+0000", 2024-05-08T18:32:04.872 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8028999999999997e-05 2024-05-08T18:32:04.872 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:04.872 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:32:04.873 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:04.873 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.873 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.873 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1356 3.2 3:41e29af7:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_42:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:32:04.873 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.771157+0000", 2024-05-08T18:32:04.873 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 22.066324092999999, 2024-05-08T18:32:04.873 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.018991331, 2024-05-08T18:32:04.873 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:32:04.873 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:32:04.873 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:04.873 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:32:04.873 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:32:04.874 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:04.874 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1356 2024-05-08T18:32:04.874 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.874 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:32:04.874 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.874 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:32:04.874 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.771157+0000", 2024-05-08T18:32:04.874 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:04.874 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.874 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.874 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:32:04.875 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.771157+0000", 2024-05-08T18:32:04.875 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:04.875 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.875 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.875 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:32:04.875 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.771160+0000", 2024-05-08T18:32:04.875 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1820000000000002e-06 2024-05-08T18:32:04.875 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.875 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.875 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:32:04.875 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.772778+0000", 2024-05-08T18:32:04.875 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001617926 2024-05-08T18:32:04.876 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.876 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.876 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:32:04.876 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.772790+0000", 2024-05-08T18:32:04.876 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1609e-05 2024-05-08T18:32:04.876 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.876 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.876 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:32:04.876 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.772797+0000", 2024-05-08T18:32:04.876 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.3270000000000003e-06 2024-05-08T18:32:04.876 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.876 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.877 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:32:04.877 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.772851+0000", 2024-05-08T18:32:04.877 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3987999999999999e-05 2024-05-08T18:32:04.877 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.877 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.877 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:32:04.877 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.772947+0000", 2024-05-08T18:32:04.877 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.5809000000000004e-05 2024-05-08T18:32:04.877 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.877 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.877 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-05-08T18:32:04.877 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.773040+0000", 2024-05-08T18:32:04.877 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.3422000000000001e-05 2024-05-08T18:32:04.877 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.878 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.878 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:32:04.878 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.786246+0000", 2024-05-08T18:32:04.878 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.013205744 2024-05-08T18:32:04.878 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.878 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.878 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:04.878 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.790017+0000", 2024-05-08T18:32:04.878 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0037707539999999999 2024-05-08T18:32:04.878 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.879 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.879 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:32:04.879 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.790091+0000", 2024-05-08T18:32:04.879 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.4664000000000002e-05 2024-05-08T18:32:04.879 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.879 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.879 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:32:04.879 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.790148+0000", 2024-05-08T18:32:04.879 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6906e-05 2024-05-08T18:32:04.879 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:04.880 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:32:04.880 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:04.880 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.880 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.880 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1616 3.7 3:e2c69de8:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-05-08T18:32:04.880 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:46.728206+0000", 2024-05-08T18:32:04.880 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 18.109274863, 2024-05-08T18:32:04.880 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.024382826, 2024-05-08T18:32:04.880 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:32:04.880 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:32:04.880 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:04.880 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:32:04.880 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:32:04.880 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:04.881 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1616 2024-05-08T18:32:04.881 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.881 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:32:04.881 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.881 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:32:04.881 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.728206+0000", 2024-05-08T18:32:04.881 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:04.881 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.881 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.881 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:32:04.881 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.728206+0000", 2024-05-08T18:32:04.881 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:04.881 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.881 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.882 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:32:04.882 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.728209+0000", 2024-05-08T18:32:04.882 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3060000000000002e-06 2024-05-08T18:32:04.882 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.882 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.882 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:32:04.882 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.730475+0000", 2024-05-08T18:32:04.882 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0022651899999999998 2024-05-08T18:32:04.882 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.882 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.882 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:32:04.883 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.730508+0000", 2024-05-08T18:32:04.883 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3226999999999999e-05 2024-05-08T18:32:04.883 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.883 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.883 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:32:04.883 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.730523+0000", 2024-05-08T18:32:04.883 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4715999999999999e-05 2024-05-08T18:32:04.883 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.883 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.883 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:32:04.883 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.730618+0000", 2024-05-08T18:32:04.884 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.5619999999999996e-05 2024-05-08T18:32:04.884 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.884 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.884 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:32:04.884 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.730831+0000", 2024-05-08T18:32:04.884 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021288599999999999 2024-05-08T18:32:04.884 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.884 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.884 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:32:04.884 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.730970+0000", 2024-05-08T18:32:04.884 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013861400000000001 2024-05-08T18:32:04.884 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.884 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.884 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:32:04.884 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.742595+0000", 2024-05-08T18:32:04.885 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011624951 2024-05-08T18:32:04.885 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.885 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.885 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:04.885 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.752495+0000", 2024-05-08T18:32:04.885 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0098999910000000003 2024-05-08T18:32:04.885 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.885 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.885 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:32:04.885 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.752546+0000", 2024-05-08T18:32:04.885 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.1422999999999999e-05 2024-05-08T18:32:04.885 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.885 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.886 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:32:04.886 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.752589+0000", 2024-05-08T18:32:04.886 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.2901999999999997e-05 2024-05-08T18:32:04.886 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:04.886 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:32:04.886 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:04.886 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.886 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.886 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1625 3.1e 3:798e9c4d:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-05-08T18:32:04.887 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:46.821701+0000", 2024-05-08T18:32:04.887 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 18.015780218, 2024-05-08T18:32:04.887 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019517788000000001, 2024-05-08T18:32:04.887 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:32:04.887 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:32:04.887 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:04.887 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:32:04.887 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:32:04.887 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:04.887 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1625 2024-05-08T18:32:04.887 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.888 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:32:04.888 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.888 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:32:04.888 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.821701+0000", 2024-05-08T18:32:04.888 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:04.888 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.888 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.888 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:32:04.888 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.821701+0000", 2024-05-08T18:32:04.888 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:04.888 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.888 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.888 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:32:04.888 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.821704+0000", 2024-05-08T18:32:04.889 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9450000000000002e-06 2024-05-08T18:32:04.889 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.889 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.889 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:32:04.889 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.824221+0000", 2024-05-08T18:32:04.889 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0025171600000000001 2024-05-08T18:32:04.889 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.889 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.889 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:32:04.889 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.824251+0000", 2024-05-08T18:32:04.889 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0243000000000002e-05 2024-05-08T18:32:04.890 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.890 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.890 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:32:04.890 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.824265+0000", 2024-05-08T18:32:04.890 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3482999999999999e-05 2024-05-08T18:32:04.890 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.890 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.890 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:32:04.890 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.824353+0000", 2024-05-08T18:32:04.890 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8146999999999995e-05 2024-05-08T18:32:04.890 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.890 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.891 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:32:04.891 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.824560+0000", 2024-05-08T18:32:04.891 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00020771400000000001 2024-05-08T18:32:04.891 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.891 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.891 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:32:04.891 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.824720+0000", 2024-05-08T18:32:04.891 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015998799999999999 2024-05-08T18:32:04.891 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.891 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.891 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:32:04.891 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.837381+0000", 2024-05-08T18:32:04.892 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012660803 2024-05-08T18:32:04.892 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.892 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.892 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:04.892 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.841087+0000", 2024-05-08T18:32:04.892 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0037056519999999998 2024-05-08T18:32:04.892 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.892 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.892 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:32:04.892 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.841160+0000", 2024-05-08T18:32:04.892 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.3208999999999997e-05 2024-05-08T18:32:04.892 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.892 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.892 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:32:04.893 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.841219+0000", 2024-05-08T18:32:04.893 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8443999999999998e-05 2024-05-08T18:32:04.893 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:04.893 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:32:04.893 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:04.893 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.893 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.893 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1627 3.b 3:d1c181db:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-05-08T18:32:04.893 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:46.850618+0000", 2024-05-08T18:32:04.893 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 17.986862843000001, 2024-05-08T18:32:04.893 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.027553586000000001, 2024-05-08T18:32:04.894 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:32:04.894 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:32:04.894 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:04.894 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:32:04.894 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:32:04.894 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:04.894 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1627 2024-05-08T18:32:04.894 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.894 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:32:04.894 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.895 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:32:04.895 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.850618+0000", 2024-05-08T18:32:04.895 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:04.895 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.895 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.895 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:32:04.895 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.850618+0000", 2024-05-08T18:32:04.895 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:04.895 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.895 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.895 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:32:04.896 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.850621+0000", 2024-05-08T18:32:04.896 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0299999999999998e-06 2024-05-08T18:32:04.896 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.896 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.896 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:32:04.896 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.852369+0000", 2024-05-08T18:32:04.896 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001748229 2024-05-08T18:32:04.896 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.896 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.896 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:32:04.896 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.852397+0000", 2024-05-08T18:32:04.896 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7542000000000002e-05 2024-05-08T18:32:04.896 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.897 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.897 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:32:04.897 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.852410+0000", 2024-05-08T18:32:04.897 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2798e-05 2024-05-08T18:32:04.897 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.897 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.897 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:32:04.897 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.852537+0000", 2024-05-08T18:32:04.897 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000126756 2024-05-08T18:32:04.898 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.898 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.898 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:32:04.898 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.852785+0000", 2024-05-08T18:32:04.898 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024892099999999998 2024-05-08T18:32:04.898 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.898 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.898 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0", 2024-05-08T18:32:04.899 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.853042+0000", 2024-05-08T18:32:04.899 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00025698799999999999 2024-05-08T18:32:04.899 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.899 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.899 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:32:04.899 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.876145+0000", 2024-05-08T18:32:04.899 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.023102746 2024-05-08T18:32:04.899 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.899 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.899 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:04.899 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.878045+0000", 2024-05-08T18:32:04.899 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0018999850000000001 2024-05-08T18:32:04.899 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.899 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.900 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:32:04.900 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.878117+0000", 2024-05-08T18:32:04.900 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1464000000000006e-05 2024-05-08T18:32:04.900 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.900 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.900 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:32:04.900 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.878172+0000", 2024-05-08T18:32:04.900 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5127000000000003e-05 2024-05-08T18:32:04.900 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:04.900 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:32:04.900 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:04.900 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.900 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.900 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1629 3.24 3:27d2a12f:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-05-08T18:32:04.901 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:46.873022+0000", 2024-05-08T18:32:04.901 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 17.964458838999999, 2024-05-08T18:32:04.901 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019610209, 2024-05-08T18:32:04.901 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:32:04.901 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:32:04.901 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:04.901 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:32:04.901 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:32:04.901 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:04.901 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1629 2024-05-08T18:32:04.901 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.902 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:32:04.902 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.902 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:32:04.902 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.873022+0000", 2024-05-08T18:32:04.902 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:04.902 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.902 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.902 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:32:04.902 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.873022+0000", 2024-05-08T18:32:04.902 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:04.902 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.902 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.902 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:32:04.903 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.873024+0000", 2024-05-08T18:32:04.903 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.826e-06 2024-05-08T18:32:04.903 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.903 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.903 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:32:04.903 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.874556+0000", 2024-05-08T18:32:04.903 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0015321009999999999 2024-05-08T18:32:04.903 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.903 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.903 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:32:04.903 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.874593+0000", 2024-05-08T18:32:04.903 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6696000000000002e-05 2024-05-08T18:32:04.903 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.903 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.904 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:32:04.904 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.874610+0000", 2024-05-08T18:32:04.904 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7374e-05 2024-05-08T18:32:04.904 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.904 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.904 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:32:04.904 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.874687+0000", 2024-05-08T18:32:04.904 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7219999999999996e-05 2024-05-08T18:32:04.904 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.904 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.904 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:32:04.904 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.874823+0000", 2024-05-08T18:32:04.905 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013538600000000001 2024-05-08T18:32:04.905 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.905 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.905 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:32:04.905 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.874921+0000", 2024-05-08T18:32:04.905 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.8679999999999997e-05 2024-05-08T18:32:04.905 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.905 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.905 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:32:04.905 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.883485+0000", 2024-05-08T18:32:04.905 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0085638299999999997 2024-05-08T18:32:04.905 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.905 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.905 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:04.906 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.892549+0000", 2024-05-08T18:32:04.906 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0090635850000000007 2024-05-08T18:32:04.906 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.906 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.906 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:32:04.906 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.892593+0000", 2024-05-08T18:32:04.906 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4566e-05 2024-05-08T18:32:04.906 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.906 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.906 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:32:04.906 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.892632+0000", 2024-05-08T18:32:04.906 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8945000000000001e-05 2024-05-08T18:32:04.906 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:04.907 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:32:04.907 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:04.907 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.907 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.907 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1633 3.15 e83/21 3:ab226f54:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_21:head v 83'2, mlcod=0'0)", 2024-05-08T18:32:04.907 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:46.920100+0000", 2024-05-08T18:32:04.907 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 17.917381449000001, 2024-05-08T18:32:04.907 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.022841956, 2024-05-08T18:32:04.907 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:32:04.907 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:32:04.907 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:04.907 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:32:04.907 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.907 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:32:04.907 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.920100+0000", 2024-05-08T18:32:04.908 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:04.908 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.908 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.908 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:32:04.908 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.920100+0000", 2024-05-08T18:32:04.908 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:04.908 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.908 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.908 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:32:04.908 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.920101+0000", 2024-05-08T18:32:04.908 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4309999999999999e-06 2024-05-08T18:32:04.908 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.908 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.908 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:32:04.908 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.926002+0000", 2024-05-08T18:32:04.909 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0059014820000000004 2024-05-08T18:32:04.909 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.909 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.909 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:32:04.909 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.926041+0000", 2024-05-08T18:32:04.909 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8217999999999999e-05 2024-05-08T18:32:04.909 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.909 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.909 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:32:04.909 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.926057+0000", 2024-05-08T18:32:04.909 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5877000000000001e-05 2024-05-08T18:32:04.909 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.909 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.909 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:32:04.910 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.926149+0000", 2024-05-08T18:32:04.910 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.2361000000000006e-05 2024-05-08T18:32:04.910 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.910 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.910 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:32:04.910 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.926178+0000", 2024-05-08T18:32:04.910 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9544999999999999e-05 2024-05-08T18:32:04.910 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.910 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.910 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:32:04.910 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.942887+0000", 2024-05-08T18:32:04.910 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.016708163000000002 2024-05-08T18:32:04.910 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.911 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.911 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:32:04.911 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.942942+0000", 2024-05-08T18:32:04.911 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4879000000000001e-05 2024-05-08T18:32:04.911 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:04.911 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:32:04.911 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:04.911 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.911 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.911 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1634 3.b 3:d3d25f94:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-05-08T18:32:04.911 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:46.925230+0000", 2024-05-08T18:32:04.911 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 17.912250713999999, 2024-05-08T18:32:04.911 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.022437625999999999, 2024-05-08T18:32:04.911 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:32:04.911 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:32:04.911 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:04.912 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:32:04.912 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:32:04.912 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:04.912 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1634 2024-05-08T18:32:04.912 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.912 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:32:04.912 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.912 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:32:04.912 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.925230+0000", 2024-05-08T18:32:04.912 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:04.912 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.912 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.912 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:32:04.913 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.925230+0000", 2024-05-08T18:32:04.913 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:04.913 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.913 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.913 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:32:04.913 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.925234+0000", 2024-05-08T18:32:04.913 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6789999999999998e-06 2024-05-08T18:32:04.913 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.913 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.913 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:32:04.913 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.927184+0000", 2024-05-08T18:32:04.913 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0019497799999999999 2024-05-08T18:32:04.913 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.913 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.913 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:32:04.914 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.927205+0000", 2024-05-08T18:32:04.914 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1231000000000001e-05 2024-05-08T18:32:04.914 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.914 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.914 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:32:04.914 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.927214+0000", 2024-05-08T18:32:04.914 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0159999999999997e-06 2024-05-08T18:32:04.914 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.914 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.914 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:32:04.914 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.927287+0000", 2024-05-08T18:32:04.914 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.3192e-05 2024-05-08T18:32:04.915 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.915 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.915 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:32:04.915 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.927495+0000", 2024-05-08T18:32:04.915 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00020766099999999999 2024-05-08T18:32:04.915 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.915 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.915 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0", 2024-05-08T18:32:04.915 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.927653+0000", 2024-05-08T18:32:04.915 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015861799999999999 2024-05-08T18:32:04.915 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.915 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.915 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:32:04.915 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.947344+0000", 2024-05-08T18:32:04.915 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019690112999999999 2024-05-08T18:32:04.916 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.916 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.916 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:04.916 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.947572+0000", 2024-05-08T18:32:04.916 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000228292 2024-05-08T18:32:04.916 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.916 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.916 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:32:04.916 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.947618+0000", 2024-05-08T18:32:04.916 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5880000000000001e-05 2024-05-08T18:32:04.916 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.916 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.916 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:32:04.916 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.947668+0000", 2024-05-08T18:32:04.917 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.0164000000000003e-05 2024-05-08T18:32:04.917 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:04.917 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:32:04.917 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:04.917 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.917 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.917 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1823 3.27 3:e6e611e5:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-05-08T18:32:04.917 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:32:00.521693+0000", 2024-05-08T18:32:04.917 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4.3157879770000003, 2024-05-08T18:32:04.917 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.023324290000000001, 2024-05-08T18:32:04.917 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:32:04.917 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:32:04.917 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:04.917 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:32:04.917 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:32:04.918 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:04.918 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1823 2024-05-08T18:32:04.918 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.918 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:32:04.918 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.918 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:32:04.918 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:00.521693+0000", 2024-05-08T18:32:04.918 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:04.918 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.918 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.919 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:32:04.919 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:00.521693+0000", 2024-05-08T18:32:04.919 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:04.919 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.919 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.919 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:32:04.919 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:00.521696+0000", 2024-05-08T18:32:04.919 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7250000000000002e-06 2024-05-08T18:32:04.919 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.919 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.919 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:32:04.919 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:00.524303+0000", 2024-05-08T18:32:04.919 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0026069579999999999 2024-05-08T18:32:04.919 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.920 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.920 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:32:04.920 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:00.524328+0000", 2024-05-08T18:32:04.920 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5369000000000001e-05 2024-05-08T18:32:04.920 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.920 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.920 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:32:04.920 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:00.524342+0000", 2024-05-08T18:32:04.920 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3543999999999999e-05 2024-05-08T18:32:04.920 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.920 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.920 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:32:04.920 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:00.524425+0000", 2024-05-08T18:32:04.920 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.3673999999999999e-05 2024-05-08T18:32:04.921 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.921 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.921 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:32:04.921 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:00.524604+0000", 2024-05-08T18:32:04.921 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00017828899999999999 2024-05-08T18:32:04.921 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.921 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.921 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:32:04.921 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:00.524771+0000", 2024-05-08T18:32:04.921 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016735200000000001 2024-05-08T18:32:04.921 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.921 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.921 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:32:04.921 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:00.531948+0000", 2024-05-08T18:32:04.922 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0071767649999999999 2024-05-08T18:32:04.922 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.922 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.922 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:04.922 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:00.544855+0000", 2024-05-08T18:32:04.922 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012907194 2024-05-08T18:32:04.922 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.922 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.922 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:32:04.922 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:00.544947+0000", 2024-05-08T18:32:04.922 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.2014000000000004e-05 2024-05-08T18:32:04.922 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.922 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.923 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:32:04.923 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:00.545017+0000", 2024-05-08T18:32:04.923 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.0406000000000003e-05 2024-05-08T18:32:04.923 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:04.923 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:32:04.923 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:04.923 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.923 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.923 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1831 3.23 e92/21 3:c66acffb:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_17:head v 92'5, mlcod=82'3)", 2024-05-08T18:32:04.923 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:32:00.648970+0000", 2024-05-08T18:32:04.923 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4.1885110640000001, 2024-05-08T18:32:04.923 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.027198782000000001, 2024-05-08T18:32:04.923 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:32:04.923 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:32:04.924 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:04.924 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:32:04.924 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.924 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:32:04.924 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:00.648970+0000", 2024-05-08T18:32:04.924 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:04.924 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.924 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.924 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:32:04.924 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:00.648970+0000", 2024-05-08T18:32:04.924 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:04.925 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.925 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.925 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:32:04.925 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:00.648973+0000", 2024-05-08T18:32:04.925 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.79e-06 2024-05-08T18:32:04.925 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.925 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.925 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:32:04.925 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:00.652776+0000", 2024-05-08T18:32:04.925 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003803673 2024-05-08T18:32:04.925 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.926 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.926 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:32:04.926 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:00.652806+0000", 2024-05-08T18:32:04.926 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9907e-05 2024-05-08T18:32:04.926 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.926 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.926 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:32:04.926 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:00.652820+0000", 2024-05-08T18:32:04.926 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4148000000000001e-05 2024-05-08T18:32:04.926 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.926 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.926 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:32:04.927 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:00.652947+0000", 2024-05-08T18:32:04.927 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000126496 2024-05-08T18:32:04.927 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.927 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.927 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:32:04.927 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:00.652998+0000", 2024-05-08T18:32:04.927 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.0640999999999998e-05 2024-05-08T18:32:04.927 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.927 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.927 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:32:04.927 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:00.676100+0000", 2024-05-08T18:32:04.927 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.023102257000000001 2024-05-08T18:32:04.927 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.928 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.928 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:32:04.928 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:00.676169+0000", 2024-05-08T18:32:04.928 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8869999999999996e-05 2024-05-08T18:32:04.928 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:04.928 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:32:04.928 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:04.928 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.928 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.928 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1839 3.38 3:1c9a96ef:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_25:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-05-08T18:32:04.928 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:32:00.749493+0000", 2024-05-08T18:32:04.928 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4.087987976, 2024-05-08T18:32:04.928 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021958133000000001, 2024-05-08T18:32:04.928 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:32:04.928 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:32:04.929 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:04.929 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:32:04.929 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:32:04.929 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:04.929 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1839 2024-05-08T18:32:04.929 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.929 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:32:04.929 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.929 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:32:04.929 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:00.749493+0000", 2024-05-08T18:32:04.929 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:04.929 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.929 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.930 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:32:04.930 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:00.749493+0000", 2024-05-08T18:32:04.930 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:04.930 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.930 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.930 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:32:04.930 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:00.749495+0000", 2024-05-08T18:32:04.930 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3860000000000001e-06 2024-05-08T18:32:04.930 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.930 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.930 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:32:04.930 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:00.751661+0000", 2024-05-08T18:32:04.930 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002165854 2024-05-08T18:32:04.930 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.931 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.931 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:32:04.931 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:00.751687+0000", 2024-05-08T18:32:04.931 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5928999999999999e-05 2024-05-08T18:32:04.931 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.931 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.931 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:32:04.931 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:00.751766+0000", 2024-05-08T18:32:04.931 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.8776000000000006e-05 2024-05-08T18:32:04.931 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.931 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.931 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:32:04.931 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:00.751898+0000", 2024-05-08T18:32:04.931 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013232599999999999 2024-05-08T18:32:04.932 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.932 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.932 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:32:04.932 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:00.752069+0000", 2024-05-08T18:32:04.932 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000170688 2024-05-08T18:32:04.932 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.932 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.932 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:32:04.932 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:00.752210+0000", 2024-05-08T18:32:04.932 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000140822 2024-05-08T18:32:04.932 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.933 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.933 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:32:04.933 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:00.760931+0000", 2024-05-08T18:32:04.933 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0087208170000000005 2024-05-08T18:32:04.933 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.933 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.933 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:04.933 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:00.771313+0000", 2024-05-08T18:32:04.933 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010382371 2024-05-08T18:32:04.933 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.933 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.934 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:32:04.934 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:00.771391+0000", 2024-05-08T18:32:04.934 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7904000000000005e-05 2024-05-08T18:32:04.934 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.934 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.934 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:32:04.934 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:00.771451+0000", 2024-05-08T18:32:04.934 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0260000000000002e-05 2024-05-08T18:32:04.934 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:04.934 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:32:04.934 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:04.935 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.935 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.935 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1876 3.c e93/21 3:31c32d98:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_62:head v 93'6, mlcod=82'4)", 2024-05-08T18:32:04.935 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:32:01.200556+0000", 2024-05-08T18:32:04.935 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 3.6369254739999999, 2024-05-08T18:32:04.935 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.020616645999999999, 2024-05-08T18:32:04.935 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:32:04.935 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:32:04.935 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:04.935 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:32:04.935 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.936 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:32:04.936 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.200556+0000", 2024-05-08T18:32:04.936 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:04.936 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.936 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.936 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:32:04.936 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.200556+0000", 2024-05-08T18:32:04.936 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:04.936 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.936 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.936 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:32:04.936 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.200558+0000", 2024-05-08T18:32:04.936 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.503e-06 2024-05-08T18:32:04.936 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.937 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.937 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:32:04.937 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.205556+0000", 2024-05-08T18:32:04.937 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0049976509999999997 2024-05-08T18:32:04.937 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.937 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.937 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:32:04.937 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.205593+0000", 2024-05-08T18:32:04.937 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6865e-05 2024-05-08T18:32:04.937 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.937 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.937 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:32:04.937 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.205611+0000", 2024-05-08T18:32:04.937 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8082999999999999e-05 2024-05-08T18:32:04.938 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.938 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.938 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:32:04.938 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.205750+0000", 2024-05-08T18:32:04.938 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013963800000000001 2024-05-08T18:32:04.938 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.938 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.938 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:32:04.938 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.205789+0000", 2024-05-08T18:32:04.938 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8381999999999999e-05 2024-05-08T18:32:04.938 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.938 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.938 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:32:04.938 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.221131+0000", 2024-05-08T18:32:04.939 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.015342364000000001 2024-05-08T18:32:04.939 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.939 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.939 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:32:04.939 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.221172+0000", 2024-05-08T18:32:04.939 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.1159999999999999e-05 2024-05-08T18:32:04.939 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:04.939 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:32:04.939 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:04.939 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.939 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.939 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1882 3.38 3:1c2fc662:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_68:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:32:04.939 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:32:01.307912+0000", 2024-05-08T18:32:04.939 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 3.5295694910000002, 2024-05-08T18:32:04.940 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019137119000000001, 2024-05-08T18:32:04.940 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:32:04.940 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:32:04.940 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:04.940 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:32:04.940 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:32:04.940 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:04.940 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1882 2024-05-08T18:32:04.940 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.940 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:32:04.940 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.940 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:32:04.940 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.307912+0000", 2024-05-08T18:32:04.940 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:04.940 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.941 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.941 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:32:04.941 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.307912+0000", 2024-05-08T18:32:04.941 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:04.941 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.941 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.941 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:32:04.941 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.307914+0000", 2024-05-08T18:32:04.941 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9660000000000001e-06 2024-05-08T18:32:04.941 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.941 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.942 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:32:04.942 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.311276+0000", 2024-05-08T18:32:04.942 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0033614700000000001 2024-05-08T18:32:04.942 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.942 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.942 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:32:04.942 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.311314+0000", 2024-05-08T18:32:04.942 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7669000000000001e-05 2024-05-08T18:32:04.942 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.943 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.943 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:32:04.943 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.311336+0000", 2024-05-08T18:32:04.943 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2407000000000001e-05 2024-05-08T18:32:04.943 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.943 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.943 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:32:04.943 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.311466+0000", 2024-05-08T18:32:04.943 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000129517 2024-05-08T18:32:04.943 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.943 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.943 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:32:04.943 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.311731+0000", 2024-05-08T18:32:04.943 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00026579099999999998 2024-05-08T18:32:04.944 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.944 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.944 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:32:04.944 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.311957+0000", 2024-05-08T18:32:04.944 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00022544199999999999 2024-05-08T18:32:04.944 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.944 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.944 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:32:04.944 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.322573+0000", 2024-05-08T18:32:04.944 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010615724 2024-05-08T18:32:04.944 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.944 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.945 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:04.945 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.326913+0000", 2024-05-08T18:32:04.945 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0043408250000000004 2024-05-08T18:32:04.945 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.945 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.945 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:32:04.945 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.326988+0000", 2024-05-08T18:32:04.946 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.4475999999999996e-05 2024-05-08T18:32:04.946 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.946 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.946 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:32:04.946 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.327049+0000", 2024-05-08T18:32:04.946 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0832000000000003e-05 2024-05-08T18:32:04.946 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:04.946 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:32:04.946 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:04.946 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.946 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.947 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1886 3.b 3:d2aed5c5:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_72:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:32:04.947 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:32:01.388217+0000", 2024-05-08T18:32:04.947 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 3.4492644349999999, 2024-05-08T18:32:04.947 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.020690119999999999, 2024-05-08T18:32:04.947 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:32:04.947 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:32:04.947 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:04.947 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:32:04.947 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:32:04.947 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:04.947 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1886 2024-05-08T18:32:04.947 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.947 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:32:04.948 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.948 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:32:04.948 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.388217+0000", 2024-05-08T18:32:04.948 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:04.948 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.948 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.948 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:32:04.948 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.388217+0000", 2024-05-08T18:32:04.948 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:04.948 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.948 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.948 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:32:04.948 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.388221+0000", 2024-05-08T18:32:04.948 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7829999999999998e-06 2024-05-08T18:32:04.949 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.949 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.949 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:32:04.949 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.391733+0000", 2024-05-08T18:32:04.949 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003511845 2024-05-08T18:32:04.949 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.949 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.950 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:32:04.950 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.391775+0000", 2024-05-08T18:32:04.950 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.1301000000000003e-05 2024-05-08T18:32:04.950 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.950 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.950 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:32:04.950 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.391794+0000", 2024-05-08T18:32:04.950 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9758999999999998e-05 2024-05-08T18:32:04.950 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.951 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.951 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:32:04.951 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.391956+0000", 2024-05-08T18:32:04.951 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016176799999999999 2024-05-08T18:32:04.951 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.951 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.951 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:32:04.951 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.392265+0000", 2024-05-08T18:32:04.951 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00030906999999999999 2024-05-08T18:32:04.951 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.951 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.951 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0", 2024-05-08T18:32:04.951 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.392509+0000", 2024-05-08T18:32:04.951 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000244322 2024-05-08T18:32:04.952 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.952 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.952 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:32:04.952 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.404331+0000", 2024-05-08T18:32:04.952 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011821485 2024-05-08T18:32:04.952 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.952 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.952 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:04.952 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.408820+0000", 2024-05-08T18:32:04.952 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0044886090000000002 2024-05-08T18:32:04.952 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.952 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.952 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:32:04.953 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.408868+0000", 2024-05-08T18:32:04.953 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8081999999999998e-05 2024-05-08T18:32:04.953 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.953 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.953 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:32:04.953 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.408907+0000", 2024-05-08T18:32:04.953 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9096e-05 2024-05-08T18:32:04.953 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:04.954 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:32:04.954 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:04.954 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.954 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.954 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1902 3.28 e93/21 3:17e1ce0c:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_88:head v 93'8, mlcod=84'6)", 2024-05-08T18:32:04.954 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:32:01.737380+0000", 2024-05-08T18:32:04.954 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 3.100100989, 2024-05-08T18:32:04.954 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.028050545, 2024-05-08T18:32:04.954 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:32:04.954 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:32:04.954 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:04.954 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:32:04.955 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.955 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:32:04.955 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.737380+0000", 2024-05-08T18:32:04.955 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:04.955 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.955 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.955 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:32:04.955 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.737380+0000", 2024-05-08T18:32:04.955 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:04.955 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.955 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.955 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:32:04.955 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.737383+0000", 2024-05-08T18:32:04.955 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0000000000000001e-06 2024-05-08T18:32:04.955 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.956 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.956 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:32:04.956 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.745323+0000", 2024-05-08T18:32:04.956 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0079403059999999994 2024-05-08T18:32:04.956 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.956 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.956 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:32:04.956 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.745364+0000", 2024-05-08T18:32:04.956 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.1012e-05 2024-05-08T18:32:04.956 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.957 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.957 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:32:04.957 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.745382+0000", 2024-05-08T18:32:04.957 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7960000000000001e-05 2024-05-08T18:32:04.957 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.957 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.957 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:32:04.957 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.745535+0000", 2024-05-08T18:32:04.957 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015250300000000001 2024-05-08T18:32:04.957 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.957 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.958 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:32:04.958 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.745577+0000", 2024-05-08T18:32:04.958 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.261e-05 2024-05-08T18:32:04.958 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.958 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.958 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:32:04.958 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.765288+0000", 2024-05-08T18:32:04.958 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019710380999999999 2024-05-08T18:32:04.958 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.958 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.958 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:32:04.958 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.765431+0000", 2024-05-08T18:32:04.959 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014277300000000001 2024-05-08T18:32:04.959 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:04.959 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:32:04.959 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:04.959 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.959 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.959 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1911 3.18 3:1a3a3203:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_97:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:32:04.959 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:32:01.900176+0000", 2024-05-08T18:32:04.959 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 2.9373052259999999, 2024-05-08T18:32:04.960 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.022745015, 2024-05-08T18:32:04.960 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:32:04.960 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:32:04.960 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:04.960 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:32:04.960 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:32:04.960 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:04.960 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1911 2024-05-08T18:32:04.961 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.961 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:32:04.961 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.961 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:32:04.961 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.900176+0000", 2024-05-08T18:32:04.961 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:04.961 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.961 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.961 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:32:04.962 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.900176+0000", 2024-05-08T18:32:04.962 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:04.962 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.962 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.962 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:32:04.962 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.900179+0000", 2024-05-08T18:32:04.962 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1980000000000001e-06 2024-05-08T18:32:04.962 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.962 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.962 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:32:04.962 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.903084+0000", 2024-05-08T18:32:04.962 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0029047249999999999 2024-05-08T18:32:04.962 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.963 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.963 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:32:04.963 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.903119+0000", 2024-05-08T18:32:04.963 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5562000000000003e-05 2024-05-08T18:32:04.963 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.963 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.963 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:32:04.963 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.903135+0000", 2024-05-08T18:32:04.963 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5353999999999999e-05 2024-05-08T18:32:04.963 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.964 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.964 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:32:04.964 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.903274+0000", 2024-05-08T18:32:04.964 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000139648 2024-05-08T18:32:04.964 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.964 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.964 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:32:04.964 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.903508+0000", 2024-05-08T18:32:04.964 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023379499999999999 2024-05-08T18:32:04.964 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.964 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.965 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0", 2024-05-08T18:32:04.965 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.903748+0000", 2024-05-08T18:32:04.965 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024023499999999999 2024-05-08T18:32:04.965 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.965 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.965 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:32:04.965 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.911064+0000", 2024-05-08T18:32:04.965 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0073160960000000002 2024-05-08T18:32:04.965 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.965 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.965 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:04.966 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.922789+0000", 2024-05-08T18:32:04.966 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011724719 2024-05-08T18:32:04.966 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.966 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.966 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:32:04.966 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.922860+0000", 2024-05-08T18:32:04.966 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.0520999999999998e-05 2024-05-08T18:32:04.966 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:04.967 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:04.967 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:32:04.967 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.922921+0000", 2024-05-08T18:32:04.967 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1161999999999995e-05 2024-05-08T18:32:04.967 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:04.968 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:32:04.968 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:04.968 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:04.968 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:32:04.968 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:32:04.970 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-08T18:32:04.971 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:32:04.966+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:32:05.071 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:32:05.066+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:32:05.102 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:32:05.102 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:32:05.102 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 0 2024-05-08T18:32:05.102 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:32:05.115 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-08T18:32:05.172 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:32:05.169+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:32:05.273 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:32:05.270+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:32:05.282 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:32:05.282 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:32:05.282 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2024-05-08T18:32:05.282 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2024-05-08T18:32:05.282 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:32:05.296 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-08T18:32:05.384 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:32:05.382+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:32:05.468 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:32:05.468 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2024-05-08T18:32:05.468 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2024-05-08T18:32:05.468 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-05-08T18:32:05.468 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.468 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1315 3.2c e81/21 3:368ed9cc:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_1:head v 81'1, mlcod=0'0)", 2024-05-08T18:32:05.468 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.310943+0000", 2024-05-08T18:32:05.468 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 23.154129869999998, 2024-05-08T18:32:05.468 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019031756, 2024-05-08T18:32:05.468 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:05.468 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:05.469 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:05.469 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:05.469 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.469 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:05.469 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.310943+0000", 2024-05-08T18:32:05.469 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:05.469 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.469 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.469 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:05.469 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.310943+0000", 2024-05-08T18:32:05.469 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:05.469 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.469 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.470 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:05.470 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.310945+0000", 2024-05-08T18:32:05.470 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7800000000000001e-06 2024-05-08T18:32:05.470 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.470 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.470 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:05.470 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.315838+0000", 2024-05-08T18:32:05.470 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0048930800000000002 2024-05-08T18:32:05.470 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.470 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.470 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:05.470 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.315886+0000", 2024-05-08T18:32:05.470 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7336000000000002e-05 2024-05-08T18:32:05.471 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.471 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.471 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:05.471 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.315912+0000", 2024-05-08T18:32:05.471 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6584000000000002e-05 2024-05-08T18:32:05.471 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.471 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.471 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:05.471 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.316123+0000", 2024-05-08T18:32:05.471 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00021075400000000001 2024-05-08T18:32:05.471 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.471 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.471 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:05.471 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.316165+0000", 2024-05-08T18:32:05.472 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1709999999999999e-05 2024-05-08T18:32:05.472 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.472 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.472 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:05.472 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.329876+0000", 2024-05-08T18:32:05.472 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013710803000000001 2024-05-08T18:32:05.472 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.472 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.472 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:05.472 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.329974+0000", 2024-05-08T18:32:05.472 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8709000000000006e-05 2024-05-08T18:32:05.472 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:05.472 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:05.472 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:05.473 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.473 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.473 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1327 3.1a 3:58da5138:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-08T18:32:05.473 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.463447+0000", 2024-05-08T18:32:05.473 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 23.001625589, 2024-05-08T18:32:05.473 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018677618999999999, 2024-05-08T18:32:05.473 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:05.473 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:05.473 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:05.473 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:05.473 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:05.473 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:05.473 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1327 2024-05-08T18:32:05.473 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.474 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:05.474 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.474 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:05.474 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.463447+0000", 2024-05-08T18:32:05.474 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:05.474 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.474 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.474 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:05.474 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.463447+0000", 2024-05-08T18:32:05.474 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:05.474 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.474 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.474 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:05.475 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.463455+0000", 2024-05-08T18:32:05.475 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2430000000000005e-06 2024-05-08T18:32:05.475 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.475 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.475 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:05.475 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.469224+0000", 2024-05-08T18:32:05.475 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0057690830000000004 2024-05-08T18:32:05.475 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.475 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.475 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:05.475 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.469255+0000", 2024-05-08T18:32:05.475 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1000000000000001e-05 2024-05-08T18:32:05.475 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.475 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.476 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:05.476 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.469273+0000", 2024-05-08T18:32:05.476 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7920000000000001e-05 2024-05-08T18:32:05.476 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.476 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.476 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:05.476 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.469451+0000", 2024-05-08T18:32:05.476 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017836499999999999 2024-05-08T18:32:05.476 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.476 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.476 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:05.476 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.469687+0000", 2024-05-08T18:32:05.476 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000235255 2024-05-08T18:32:05.476 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.477 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.477 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:32:05.477 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.469899+0000", 2024-05-08T18:32:05.477 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00021257200000000001 2024-05-08T18:32:05.477 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.477 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.477 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:05.477 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.480590+0000", 2024-05-08T18:32:05.477 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010690963 2024-05-08T18:32:05.477 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.477 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.477 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:05.477 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.481813+0000", 2024-05-08T18:32:05.477 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001223001 2024-05-08T18:32:05.478 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.478 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.478 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:05.478 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.481982+0000", 2024-05-08T18:32:05.478 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016828500000000001 2024-05-08T18:32:05.478 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.478 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.478 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:05.478 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.482124+0000", 2024-05-08T18:32:05.478 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014293199999999999 2024-05-08T18:32:05.478 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:05.478 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:05.478 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:05.478 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.479 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.479 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1328 3.14 3:2b0d89be:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-08T18:32:05.479 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.473844+0000", 2024-05-08T18:32:05.479 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 22.991228700000001, 2024-05-08T18:32:05.479 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.031713811000000001, 2024-05-08T18:32:05.479 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:05.479 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:05.479 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:05.479 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:05.479 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:05.479 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:05.479 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1328 2024-05-08T18:32:05.479 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.480 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:05.480 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.480 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:05.480 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.473844+0000", 2024-05-08T18:32:05.480 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:05.480 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.480 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.480 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:05.480 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.473844+0000", 2024-05-08T18:32:05.480 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:05.480 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.480 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.480 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:05.480 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.473847+0000", 2024-05-08T18:32:05.481 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3100000000000001e-06 2024-05-08T18:32:05.481 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.481 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.481 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:05.481 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.479452+0000", 2024-05-08T18:32:05.481 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0056046910000000002 2024-05-08T18:32:05.481 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.481 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.481 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:05.481 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.479485+0000", 2024-05-08T18:32:05.481 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2808999999999997e-05 2024-05-08T18:32:05.481 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.481 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.481 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:05.482 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.479508+0000", 2024-05-08T18:32:05.482 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3119999999999999e-05 2024-05-08T18:32:05.482 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.482 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.482 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:05.482 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.479638+0000", 2024-05-08T18:32:05.482 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000130586 2024-05-08T18:32:05.482 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.482 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.482 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:05.482 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.479896+0000", 2024-05-08T18:32:05.482 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00025793799999999998 2024-05-08T18:32:05.482 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.483 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.483 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 7", 2024-05-08T18:32:05.483 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.480111+0000", 2024-05-08T18:32:05.483 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00021487200000000001 2024-05-08T18:32:05.483 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.483 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.483 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:05.483 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.502946+0000", 2024-05-08T18:32:05.483 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.022835101 2024-05-08T18:32:05.483 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.483 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.483 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:05.483 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.505389+0000", 2024-05-08T18:32:05.484 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0024426510000000001 2024-05-08T18:32:05.484 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.484 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.484 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:05.484 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.505479+0000", 2024-05-08T18:32:05.484 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.9863000000000003e-05 2024-05-08T18:32:05.484 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.484 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.484 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:05.484 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.505558+0000", 2024-05-08T18:32:05.484 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8869999999999995e-05 2024-05-08T18:32:05.484 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:05.484 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:05.484 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:05.485 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.485 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.485 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1332 3.14 3:2bdfae75:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-08T18:32:05.485 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.514410+0000", 2024-05-08T18:32:05.485 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 22.950662575999999, 2024-05-08T18:32:05.485 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.026281202, 2024-05-08T18:32:05.485 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:05.485 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:05.485 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:05.485 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:05.485 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:05.485 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:05.485 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1332 2024-05-08T18:32:05.485 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.486 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:05.486 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.486 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:05.486 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.514410+0000", 2024-05-08T18:32:05.486 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:05.486 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.486 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.486 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:05.486 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.514410+0000", 2024-05-08T18:32:05.486 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:05.486 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.486 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.486 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:05.487 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.514413+0000", 2024-05-08T18:32:05.487 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3160000000000001e-06 2024-05-08T18:32:05.487 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.487 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.487 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:05.487 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.519067+0000", 2024-05-08T18:32:05.487 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0046540319999999998 2024-05-08T18:32:05.487 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.487 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.487 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:05.487 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.519104+0000", 2024-05-08T18:32:05.487 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6890000000000001e-05 2024-05-08T18:32:05.487 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.488 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.488 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:05.488 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.519121+0000", 2024-05-08T18:32:05.488 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6583e-05 2024-05-08T18:32:05.488 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.488 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.488 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:05.488 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.519235+0000", 2024-05-08T18:32:05.488 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000114233 2024-05-08T18:32:05.488 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.488 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.488 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:05.488 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.519509+0000", 2024-05-08T18:32:05.489 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000274534 2024-05-08T18:32:05.489 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.489 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.489 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 7", 2024-05-08T18:32:05.489 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.519763+0000", 2024-05-08T18:32:05.489 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000253088 2024-05-08T18:32:05.489 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.489 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.489 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:05.489 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.532461+0000", 2024-05-08T18:32:05.489 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012698134 2024-05-08T18:32:05.489 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.489 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.489 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:05.490 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.540405+0000", 2024-05-08T18:32:05.490 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0079440699999999993 2024-05-08T18:32:05.490 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.490 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.490 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:05.490 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.540577+0000", 2024-05-08T18:32:05.490 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017180299999999999 2024-05-08T18:32:05.490 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.490 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.490 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:05.490 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.540691+0000", 2024-05-08T18:32:05.490 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011451900000000001 2024-05-08T18:32:05.490 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:05.491 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:05.491 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:05.491 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.491 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.491 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1370 3.9 3:91bbaad9:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_56:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:32:05.491 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.915888+0000", 2024-05-08T18:32:05.491 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 22.549184327999999, 2024-05-08T18:32:05.491 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.028543105999999999, 2024-05-08T18:32:05.491 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:05.491 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:05.491 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:05.491 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:05.491 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:05.492 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:05.492 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1370 2024-05-08T18:32:05.492 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.492 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:05.492 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.492 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:05.492 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.915888+0000", 2024-05-08T18:32:05.492 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:05.492 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.492 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.492 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:05.492 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.915888+0000", 2024-05-08T18:32:05.492 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:05.492 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.493 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.493 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:05.493 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.915892+0000", 2024-05-08T18:32:05.493 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1269999999999996e-06 2024-05-08T18:32:05.493 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.493 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.493 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:05.493 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.919887+0000", 2024-05-08T18:32:05.493 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039945529999999996 2024-05-08T18:32:05.493 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.493 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.493 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:05.493 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.919929+0000", 2024-05-08T18:32:05.493 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1832999999999997e-05 2024-05-08T18:32:05.494 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.494 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.494 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:05.494 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.919950+0000", 2024-05-08T18:32:05.494 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1197000000000001e-05 2024-05-08T18:32:05.494 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.494 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.494 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:05.494 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.920108+0000", 2024-05-08T18:32:05.494 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015827899999999999 2024-05-08T18:32:05.494 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.494 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.494 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:05.495 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.920401+0000", 2024-05-08T18:32:05.495 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029259799999999998 2024-05-08T18:32:05.495 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.495 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.495 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-05-08T18:32:05.495 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.920625+0000", 2024-05-08T18:32:05.495 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022383099999999999 2024-05-08T18:32:05.495 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.495 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.495 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:05.495 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.933935+0000", 2024-05-08T18:32:05.495 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013310298999999999 2024-05-08T18:32:05.495 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.496 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.496 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:05.496 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.944330+0000", 2024-05-08T18:32:05.496 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010395107000000001 2024-05-08T18:32:05.496 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.496 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.496 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:05.496 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.944383+0000", 2024-05-08T18:32:05.496 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2772000000000002e-05 2024-05-08T18:32:05.496 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.496 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.496 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:05.496 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.944431+0000", 2024-05-08T18:32:05.496 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8510000000000001e-05 2024-05-08T18:32:05.497 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:05.497 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:05.497 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:05.497 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.497 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.497 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1385 3.1a 3:5abdd61d:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_71:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:32:05.497 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:43.106312+0000", 2024-05-08T18:32:05.497 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 22.358760748999998, 2024-05-08T18:32:05.497 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018362961000000001, 2024-05-08T18:32:05.497 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:05.497 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:05.497 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:05.497 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:05.497 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:05.498 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:05.498 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1385 2024-05-08T18:32:05.498 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.498 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:05.498 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.498 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:05.498 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.106312+0000", 2024-05-08T18:32:05.498 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:05.498 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.498 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.498 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:05.498 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.106312+0000", 2024-05-08T18:32:05.499 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:05.499 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.499 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.499 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:05.499 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.106316+0000", 2024-05-08T18:32:05.499 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8739999999999997e-06 2024-05-08T18:32:05.499 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.499 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.499 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:05.499 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.110250+0000", 2024-05-08T18:32:05.499 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039342600000000002 2024-05-08T18:32:05.499 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.499 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.500 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:05.500 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.110289+0000", 2024-05-08T18:32:05.500 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8782999999999998e-05 2024-05-08T18:32:05.500 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.500 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.500 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:05.500 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.110306+0000", 2024-05-08T18:32:05.500 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7793000000000001e-05 2024-05-08T18:32:05.500 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.500 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.500 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:05.500 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.110454+0000", 2024-05-08T18:32:05.500 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014750899999999999 2024-05-08T18:32:05.501 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.501 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.501 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:05.501 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.110700+0000", 2024-05-08T18:32:05.501 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00024594500000000002 2024-05-08T18:32:05.501 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.501 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.501 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:32:05.501 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.110951+0000", 2024-05-08T18:32:05.501 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00025154499999999999 2024-05-08T18:32:05.501 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.501 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.501 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:05.501 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.120973+0000", 2024-05-08T18:32:05.502 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010021835999999999 2024-05-08T18:32:05.502 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.502 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.502 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:05.502 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.124583+0000", 2024-05-08T18:32:05.502 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0036096840000000002 2024-05-08T18:32:05.502 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.502 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.502 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:05.502 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.124630+0000", 2024-05-08T18:32:05.502 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7419000000000001e-05 2024-05-08T18:32:05.502 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.502 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.503 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:05.503 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.124675+0000", 2024-05-08T18:32:05.503 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4313000000000001e-05 2024-05-08T18:32:05.503 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:05.503 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:05.503 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:05.503 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.503 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.503 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1409 3.3 3:c39a24d8:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_95:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:32:05.503 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:43.363571+0000", 2024-05-08T18:32:05.503 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 22.101501257999999, 2024-05-08T18:32:05.503 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.021085779999999998, 2024-05-08T18:32:05.503 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:05.504 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:05.504 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:05.504 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:05.504 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:05.504 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:05.504 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1409 2024-05-08T18:32:05.504 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.504 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:05.504 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.504 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:05.504 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.363571+0000", 2024-05-08T18:32:05.504 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:05.504 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.505 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.505 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:05.505 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.363571+0000", 2024-05-08T18:32:05.505 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:05.505 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.505 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.505 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:05.505 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.363575+0000", 2024-05-08T18:32:05.505 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7579999999999998e-06 2024-05-08T18:32:05.505 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.505 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.505 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:05.505 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.368212+0000", 2024-05-08T18:32:05.505 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0046369269999999999 2024-05-08T18:32:05.506 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.506 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.506 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:05.506 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.368236+0000", 2024-05-08T18:32:05.506 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.442e-05 2024-05-08T18:32:05.506 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.506 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.506 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:05.506 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.368249+0000", 2024-05-08T18:32:05.506 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2451e-05 2024-05-08T18:32:05.506 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.506 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.506 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:05.506 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.368370+0000", 2024-05-08T18:32:05.507 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000121166 2024-05-08T18:32:05.507 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.507 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.507 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:05.507 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.368577+0000", 2024-05-08T18:32:05.507 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000207429 2024-05-08T18:32:05.507 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.507 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.507 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:32:05.507 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.368761+0000", 2024-05-08T18:32:05.507 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00018409599999999999 2024-05-08T18:32:05.507 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.507 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.507 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:05.508 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.379675+0000", 2024-05-08T18:32:05.508 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010913058999999999 2024-05-08T18:32:05.508 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.508 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.508 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:05.508 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.384574+0000", 2024-05-08T18:32:05.508 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.004899937 2024-05-08T18:32:05.508 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.508 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.508 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:05.508 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.384616+0000", 2024-05-08T18:32:05.508 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.2035e-05 2024-05-08T18:32:05.508 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.508 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.509 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:05.509 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.384657+0000", 2024-05-08T18:32:05.509 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0501999999999999e-05 2024-05-08T18:32:05.509 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:05.509 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:05.509 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:05.509 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.509 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.509 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1614 3.14 3:284b5d90:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-05-08T18:32:05.509 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:46.708825+0000", 2024-05-08T18:32:05.509 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 18.756247044999999, 2024-05-08T18:32:05.509 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.032864125000000001, 2024-05-08T18:32:05.509 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:05.509 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:05.510 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:05.510 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:05.510 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:05.510 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:05.510 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1614 2024-05-08T18:32:05.510 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.510 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:05.510 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.510 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:05.510 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.708825+0000", 2024-05-08T18:32:05.510 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:05.510 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.510 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.511 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:05.511 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.708825+0000", 2024-05-08T18:32:05.511 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:05.511 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.511 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.511 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:05.511 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.708828+0000", 2024-05-08T18:32:05.511 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6630000000000002e-06 2024-05-08T18:32:05.511 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.511 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.511 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:05.511 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.715671+0000", 2024-05-08T18:32:05.511 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.006842669 2024-05-08T18:32:05.511 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.512 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.512 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:05.512 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.715706+0000", 2024-05-08T18:32:05.512 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4872000000000001e-05 2024-05-08T18:32:05.512 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.512 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.512 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:05.512 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.715722+0000", 2024-05-08T18:32:05.512 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6670000000000001e-05 2024-05-08T18:32:05.512 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.512 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.512 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:05.512 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.715850+0000", 2024-05-08T18:32:05.512 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000127322 2024-05-08T18:32:05.513 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.513 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.513 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:05.513 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.716102+0000", 2024-05-08T18:32:05.513 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00025211899999999998 2024-05-08T18:32:05.513 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.513 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.513 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 7", 2024-05-08T18:32:05.513 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.716339+0000", 2024-05-08T18:32:05.513 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00023702099999999999 2024-05-08T18:32:05.513 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.513 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.513 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:05.514 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.737899+0000", 2024-05-08T18:32:05.514 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.021560414 2024-05-08T18:32:05.514 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.514 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.514 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:05.514 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.741414+0000", 2024-05-08T18:32:05.514 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0035152669999999999 2024-05-08T18:32:05.514 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.514 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.514 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:05.514 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.741571+0000", 2024-05-08T18:32:05.514 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015644500000000001 2024-05-08T18:32:05.514 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.514 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.515 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:05.515 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.741690+0000", 2024-05-08T18:32:05.515 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000118663 2024-05-08T18:32:05.515 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:05.515 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:05.515 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:05.515 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.515 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.515 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1622 3.11 e83/21 3:8a36e97a:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_10:head v 83'7, mlcod=82'5)", 2024-05-08T18:32:05.515 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:46.797808+0000", 2024-05-08T18:32:05.515 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 18.667264926000001, 2024-05-08T18:32:05.515 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019395200000000001, 2024-05-08T18:32:05.515 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:05.515 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:05.516 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:05.516 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:05.516 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.516 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:05.516 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.797808+0000", 2024-05-08T18:32:05.516 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:05.516 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.516 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.516 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:05.516 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.797808+0000", 2024-05-08T18:32:05.516 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:05.516 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.516 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.516 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:05.517 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.797810+0000", 2024-05-08T18:32:05.517 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9800000000000001e-06 2024-05-08T18:32:05.517 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.517 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.517 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:05.517 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.801567+0000", 2024-05-08T18:32:05.517 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0037578709999999999 2024-05-08T18:32:05.517 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.517 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.517 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:05.517 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.801610+0000", 2024-05-08T18:32:05.517 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3013000000000003e-05 2024-05-08T18:32:05.517 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.517 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.517 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:05.518 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.801628+0000", 2024-05-08T18:32:05.518 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7677e-05 2024-05-08T18:32:05.518 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.518 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.518 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:05.518 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.801798+0000", 2024-05-08T18:32:05.518 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000169548 2024-05-08T18:32:05.518 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.518 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.518 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:05.518 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.801836+0000", 2024-05-08T18:32:05.518 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.799e-05 2024-05-08T18:32:05.518 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.519 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.519 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:05.519 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.817068+0000", 2024-05-08T18:32:05.519 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015232671999999999 2024-05-08T18:32:05.519 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.519 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.519 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:05.519 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.817203+0000", 2024-05-08T18:32:05.519 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000134449 2024-05-08T18:32:05.519 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:05.519 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:05.519 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:05.519 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.519 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.520 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1629 3.24 e83/21 3:27d2a12f:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_17:head v 83'2, mlcod=0'0)", 2024-05-08T18:32:05.520 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:46.875375+0000", 2024-05-08T18:32:05.520 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 18.589697226999998, 2024-05-08T18:32:05.520 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017035814, 2024-05-08T18:32:05.520 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:05.520 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:05.520 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:05.520 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:05.520 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.520 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:05.520 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.875375+0000", 2024-05-08T18:32:05.520 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:05.520 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.520 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.521 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:05.521 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.875375+0000", 2024-05-08T18:32:05.521 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:05.521 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.521 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.521 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:05.521 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.875378+0000", 2024-05-08T18:32:05.521 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6029999999999999e-06 2024-05-08T18:32:05.521 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.521 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.521 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:05.521 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.880781+0000", 2024-05-08T18:32:05.521 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0054034319999999997 2024-05-08T18:32:05.521 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.522 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.522 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:05.522 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.880818+0000", 2024-05-08T18:32:05.522 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6303000000000001e-05 2024-05-08T18:32:05.522 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.522 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.522 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:05.522 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.880833+0000", 2024-05-08T18:32:05.522 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5852999999999999e-05 2024-05-08T18:32:05.522 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.522 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.522 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:05.522 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.880987+0000", 2024-05-08T18:32:05.522 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015368599999999999 2024-05-08T18:32:05.523 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.523 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.523 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:05.523 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.881053+0000", 2024-05-08T18:32:05.523 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6260000000000006e-05 2024-05-08T18:32:05.523 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.523 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.523 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:05.523 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.892244+0000", 2024-05-08T18:32:05.523 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011191002 2024-05-08T18:32:05.523 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.523 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.523 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:05.523 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.892411+0000", 2024-05-08T18:32:05.523 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000166675 2024-05-08T18:32:05.524 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:05.524 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:05.524 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:05.524 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.524 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.524 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1638 3.9 3:9152f27e:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5_100Mb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-05-08T18:32:05.524 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:46.965638+0000", 2024-05-08T18:32:05.524 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 18.499434555000001, 2024-05-08T18:32:05.524 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.021363499000000001, 2024-05-08T18:32:05.524 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:05.524 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:05.524 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:05.524 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:05.525 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:05.525 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:05.525 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1638 2024-05-08T18:32:05.525 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.525 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:05.525 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.525 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:05.525 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.965638+0000", 2024-05-08T18:32:05.525 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:05.525 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.525 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.525 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:05.525 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.965638+0000", 2024-05-08T18:32:05.525 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:05.525 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.526 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.526 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:05.526 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.965640+0000", 2024-05-08T18:32:05.526 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.68e-06 2024-05-08T18:32:05.526 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.526 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.526 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:05.526 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.969701+0000", 2024-05-08T18:32:05.526 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0040609870000000003 2024-05-08T18:32:05.526 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.526 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.526 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:05.526 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.969734+0000", 2024-05-08T18:32:05.527 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3460000000000002e-05 2024-05-08T18:32:05.527 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.527 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.527 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:05.527 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.969750+0000", 2024-05-08T18:32:05.527 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5919000000000001e-05 2024-05-08T18:32:05.527 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.527 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.527 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:05.527 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.969886+0000", 2024-05-08T18:32:05.527 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000135759 2024-05-08T18:32:05.527 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.527 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.527 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:05.528 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.970159+0000", 2024-05-08T18:32:05.528 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00027367199999999998 2024-05-08T18:32:05.528 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.528 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.528 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-05-08T18:32:05.528 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.971062+0000", 2024-05-08T18:32:05.528 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00090291000000000004 2024-05-08T18:32:05.528 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.528 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.528 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:05.528 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.983851+0000", 2024-05-08T18:32:05.529 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012788882999999999 2024-05-08T18:32:05.529 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.529 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.529 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:05.529 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.986511+0000", 2024-05-08T18:32:05.529 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0026593530000000002 2024-05-08T18:32:05.529 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.529 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.529 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:05.529 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.986843+0000", 2024-05-08T18:32:05.529 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00033259400000000002 2024-05-08T18:32:05.529 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.529 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.529 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:05.529 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.987001+0000", 2024-05-08T18:32:05.530 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015828199999999999 2024-05-08T18:32:05.530 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:05.530 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:05.530 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:05.530 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.530 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.530 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1823 3.27 e92/21 3:e6e611e5:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_9:head v 92'8, mlcod=82'6)", 2024-05-08T18:32:05.530 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:00.525337+0000", 2024-05-08T18:32:05.530 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4.9397353050000001, 2024-05-08T18:32:05.530 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019529722999999999, 2024-05-08T18:32:05.530 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:05.530 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:05.530 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:05.531 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:05.531 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.531 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:05.531 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.525337+0000", 2024-05-08T18:32:05.531 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:05.531 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.531 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.531 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:05.531 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.525337+0000", 2024-05-08T18:32:05.531 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:05.531 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.531 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.531 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:05.531 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.525339+0000", 2024-05-08T18:32:05.532 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0269999999999998e-06 2024-05-08T18:32:05.532 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.532 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.532 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:05.532 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.530485+0000", 2024-05-08T18:32:05.532 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.005145368 2024-05-08T18:32:05.532 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.532 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.532 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:05.532 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.530519+0000", 2024-05-08T18:32:05.532 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4765999999999999e-05 2024-05-08T18:32:05.532 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.532 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.532 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:05.532 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.530534+0000", 2024-05-08T18:32:05.533 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4521999999999999e-05 2024-05-08T18:32:05.533 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.533 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.533 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:05.533 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.530698+0000", 2024-05-08T18:32:05.533 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016412100000000001 2024-05-08T18:32:05.533 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.533 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.533 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:05.533 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.530761+0000", 2024-05-08T18:32:05.533 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3373000000000005e-05 2024-05-08T18:32:05.533 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.533 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.533 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:05.534 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.544760+0000", 2024-05-08T18:32:05.534 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013998696999999999 2024-05-08T18:32:05.534 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.534 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.534 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:05.534 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.544867+0000", 2024-05-08T18:32:05.534 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010684900000000001 2024-05-08T18:32:05.534 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:05.534 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:05.534 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:05.534 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.534 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.534 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1825 3.3 3:c2847c2a:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-05-08T18:32:05.535 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:00.555863+0000", 2024-05-08T18:32:05.535 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4.9092096180000002, 2024-05-08T18:32:05.535 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.025211702999999999, 2024-05-08T18:32:05.535 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:05.535 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:05.535 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:05.535 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:05.535 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:05.535 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:05.535 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1825 2024-05-08T18:32:05.535 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.535 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:05.535 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.535 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:05.536 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.555863+0000", 2024-05-08T18:32:05.536 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:05.536 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.536 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.536 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:05.536 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.555863+0000", 2024-05-08T18:32:05.536 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:05.536 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.536 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.536 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:05.536 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.555868+0000", 2024-05-08T18:32:05.536 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6829999999999999e-06 2024-05-08T18:32:05.536 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.536 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.537 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:05.537 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.563352+0000", 2024-05-08T18:32:05.537 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0074842199999999998 2024-05-08T18:32:05.537 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.537 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.537 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:05.537 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.563383+0000", 2024-05-08T18:32:05.537 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1393000000000003e-05 2024-05-08T18:32:05.537 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.537 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.537 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:05.537 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.563399+0000", 2024-05-08T18:32:05.537 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6064000000000001e-05 2024-05-08T18:32:05.538 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.538 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.538 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:05.538 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.563492+0000", 2024-05-08T18:32:05.538 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2532000000000001e-05 2024-05-08T18:32:05.538 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.538 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.538 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:05.538 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.563672+0000", 2024-05-08T18:32:05.538 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000180039 2024-05-08T18:32:05.538 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.538 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.538 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:32:05.539 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.563839+0000", 2024-05-08T18:32:05.539 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000166885 2024-05-08T18:32:05.539 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.539 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.539 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:05.539 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.571019+0000", 2024-05-08T18:32:05.539 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0071807019999999997 2024-05-08T18:32:05.539 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.539 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.539 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:05.539 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.580888+0000", 2024-05-08T18:32:05.539 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0098690099999999992 2024-05-08T18:32:05.539 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.539 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.540 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:05.540 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.580985+0000", 2024-05-08T18:32:05.540 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6809000000000001e-05 2024-05-08T18:32:05.540 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.540 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.540 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:05.540 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.581075+0000", 2024-05-08T18:32:05.540 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.9365999999999998e-05 2024-05-08T18:32:05.540 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:05.540 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:05.540 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:05.540 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.540 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.540 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1828 3.1a 3:5be2bca0:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-05-08T18:32:05.541 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:00.608482+0000", 2024-05-08T18:32:05.541 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4.8565903749999997, 2024-05-08T18:32:05.541 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.01966685, 2024-05-08T18:32:05.541 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:05.541 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:05.541 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:05.541 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:05.541 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:05.541 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:05.541 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1828 2024-05-08T18:32:05.542 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.542 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:05.542 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.542 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:05.542 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.608482+0000", 2024-05-08T18:32:05.542 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:05.542 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.542 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.542 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:05.542 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.608482+0000", 2024-05-08T18:32:05.542 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:05.542 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.542 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.542 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:05.543 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.608484+0000", 2024-05-08T18:32:05.543 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.697e-06 2024-05-08T18:32:05.543 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.543 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.543 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:05.543 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.612311+0000", 2024-05-08T18:32:05.543 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0038267370000000002 2024-05-08T18:32:05.543 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.543 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.543 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:05.543 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.612326+0000", 2024-05-08T18:32:05.543 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5699e-05 2024-05-08T18:32:05.543 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.543 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.544 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:05.544 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.612335+0000", 2024-05-08T18:32:05.544 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.7220000000000005e-06 2024-05-08T18:32:05.544 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.544 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.544 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:05.544 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.612394+0000", 2024-05-08T18:32:05.544 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9175999999999997e-05 2024-05-08T18:32:05.544 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.544 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.544 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:05.544 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.612522+0000", 2024-05-08T18:32:05.544 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012789 2024-05-08T18:32:05.544 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.545 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.545 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:32:05.545 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.612637+0000", 2024-05-08T18:32:05.545 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000114929 2024-05-08T18:32:05.545 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.545 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.545 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:05.545 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.620934+0000", 2024-05-08T18:32:05.545 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0082972099999999993 2024-05-08T18:32:05.545 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.545 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.545 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:05.545 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.628071+0000", 2024-05-08T18:32:05.545 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0071364169999999999 2024-05-08T18:32:05.546 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.546 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.546 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:05.546 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.628115+0000", 2024-05-08T18:32:05.546 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.422e-05 2024-05-08T18:32:05.546 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.546 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.546 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:05.546 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.628149+0000", 2024-05-08T18:32:05.546 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4153000000000003e-05 2024-05-08T18:32:05.546 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:05.546 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:05.547 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:05.547 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.547 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.547 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1849 3.3 3:c2346235:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_35:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:32:05.547 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:00.854822+0000", 2024-05-08T18:32:05.547 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4.6102504060000005, 2024-05-08T18:32:05.547 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017280277, 2024-05-08T18:32:05.547 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:05.547 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:05.547 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:05.547 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:05.547 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:05.547 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:05.548 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1849 2024-05-08T18:32:05.548 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.548 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:05.548 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.548 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:05.548 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.854822+0000", 2024-05-08T18:32:05.548 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:05.548 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.548 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.548 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:05.548 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.854822+0000", 2024-05-08T18:32:05.549 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:05.549 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.549 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.549 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:05.549 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.854825+0000", 2024-05-08T18:32:05.549 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2619999999999999e-06 2024-05-08T18:32:05.549 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.549 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.549 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:05.549 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.859589+0000", 2024-05-08T18:32:05.549 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0047639229999999998 2024-05-08T18:32:05.549 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.549 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.550 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:05.550 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.859608+0000", 2024-05-08T18:32:05.550 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8403e-05 2024-05-08T18:32:05.550 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.550 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.550 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:05.550 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.859617+0000", 2024-05-08T18:32:05.550 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7450000000000007e-06 2024-05-08T18:32:05.550 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.550 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.550 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:05.550 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.859696+0000", 2024-05-08T18:32:05.550 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8203999999999999e-05 2024-05-08T18:32:05.551 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.551 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.551 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:05.551 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.859833+0000", 2024-05-08T18:32:05.551 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013787200000000001 2024-05-08T18:32:05.551 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.551 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.551 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:32:05.551 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.859963+0000", 2024-05-08T18:32:05.551 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012955900000000001 2024-05-08T18:32:05.551 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.551 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.552 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:05.552 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.867417+0000", 2024-05-08T18:32:05.552 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0074540830000000002 2024-05-08T18:32:05.552 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.552 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.552 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:05.552 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.871952+0000", 2024-05-08T18:32:05.552 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0045347260000000002 2024-05-08T18:32:05.552 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.552 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.552 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:05.552 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.872040+0000", 2024-05-08T18:32:05.552 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.7733999999999997e-05 2024-05-08T18:32:05.552 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.553 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.553 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:05.553 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.872102+0000", 2024-05-08T18:32:05.553 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2766000000000002e-05 2024-05-08T18:32:05.553 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:05.553 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:05.553 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:05.553 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.553 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.553 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1861 3.f e93/21 3:f0b8f9d8:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_47:head v 93'9, mlcod=82'7)", 2024-05-08T18:32:05.553 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:01.007487+0000", 2024-05-08T18:32:05.553 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4.4575857230000002, 2024-05-08T18:32:05.553 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019094574, 2024-05-08T18:32:05.553 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:05.553 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:05.554 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:05.554 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:05.554 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.554 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:05.554 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.007487+0000", 2024-05-08T18:32:05.554 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:05.554 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.554 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.554 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:05.554 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.007487+0000", 2024-05-08T18:32:05.554 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:05.554 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.554 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.555 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:05.555 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.007489+0000", 2024-05-08T18:32:05.555 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3e-06 2024-05-08T18:32:05.555 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.555 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.555 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:05.555 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.012420+0000", 2024-05-08T18:32:05.555 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0049307969999999998 2024-05-08T18:32:05.555 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.555 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.555 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:05.555 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.012459+0000", 2024-05-08T18:32:05.555 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9409000000000002e-05 2024-05-08T18:32:05.555 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.556 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.556 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:05.556 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.012485+0000", 2024-05-08T18:32:05.556 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5497e-05 2024-05-08T18:32:05.556 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.556 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.556 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:05.556 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.012689+0000", 2024-05-08T18:32:05.556 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000204305 2024-05-08T18:32:05.556 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.556 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.556 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:05.556 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.012743+0000", 2024-05-08T18:32:05.557 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3720000000000001e-05 2024-05-08T18:32:05.557 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.557 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.557 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:05.557 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.026516+0000", 2024-05-08T18:32:05.557 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013773453999999999 2024-05-08T18:32:05.557 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.557 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.557 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:05.557 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.026581+0000", 2024-05-08T18:32:05.557 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5092000000000006e-05 2024-05-08T18:32:05.557 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:05.557 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:05.557 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:05.558 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.558 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.558 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1862 3.1a 3:58694483:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_48:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:32:05.558 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:01.012507+0000", 2024-05-08T18:32:05.558 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4.4525653609999996, 2024-05-08T18:32:05.558 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018337019, 2024-05-08T18:32:05.558 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:05.558 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:05.558 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:05.558 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:05.558 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:05.558 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:05.558 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1862 2024-05-08T18:32:05.559 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.559 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:05.559 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.559 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:05.559 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.012507+0000", 2024-05-08T18:32:05.559 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:05.559 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.559 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.559 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:05.559 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.012507+0000", 2024-05-08T18:32:05.559 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:05.559 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.559 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.559 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:05.560 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.012511+0000", 2024-05-08T18:32:05.560 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5889999999999999e-06 2024-05-08T18:32:05.560 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.560 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.560 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:05.560 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.016612+0000", 2024-05-08T18:32:05.560 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0041009239999999997 2024-05-08T18:32:05.560 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.560 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.560 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:05.560 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.016645+0000", 2024-05-08T18:32:05.560 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3599999999999997e-05 2024-05-08T18:32:05.560 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.561 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.561 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:05.561 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.016658+0000", 2024-05-08T18:32:05.561 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2836e-05 2024-05-08T18:32:05.561 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.561 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.561 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:05.561 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.016856+0000", 2024-05-08T18:32:05.561 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00019782900000000001 2024-05-08T18:32:05.561 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.561 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.561 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:05.561 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.017128+0000", 2024-05-08T18:32:05.561 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00027170200000000002 2024-05-08T18:32:05.562 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.562 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.562 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:32:05.562 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.017364+0000", 2024-05-08T18:32:05.562 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00023630799999999999 2024-05-08T18:32:05.562 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.562 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.562 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:05.562 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.029283+0000", 2024-05-08T18:32:05.562 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011919585999999999 2024-05-08T18:32:05.562 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.562 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.562 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:05.562 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.030640+0000", 2024-05-08T18:32:05.563 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001356033 2024-05-08T18:32:05.563 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.563 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.563 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:05.563 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.030736+0000", 2024-05-08T18:32:05.563 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6323000000000006e-05 2024-05-08T18:32:05.563 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.563 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.563 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:05.563 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.030844+0000", 2024-05-08T18:32:05.563 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010828900000000001 2024-05-08T18:32:05.563 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:05.563 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:05.563 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:05.564 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.564 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.564 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1864 3.9 3:93a63578:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_50:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:32:05.564 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:01.032831+0000", 2024-05-08T18:32:05.564 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4.4322419069999999, 2024-05-08T18:32:05.564 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018526417, 2024-05-08T18:32:05.564 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:05.564 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:05.564 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:05.564 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:05.564 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:05.564 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:05.564 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1864 2024-05-08T18:32:05.564 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.565 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:05.565 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.565 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:05.565 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.032831+0000", 2024-05-08T18:32:05.565 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:05.565 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.565 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.565 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:05.565 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.032831+0000", 2024-05-08T18:32:05.565 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:05.565 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.565 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.565 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:05.565 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.032835+0000", 2024-05-08T18:32:05.565 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1529999999999999e-06 2024-05-08T18:32:05.566 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.566 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.566 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:05.566 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.036974+0000", 2024-05-08T18:32:05.566 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0041391049999999997 2024-05-08T18:32:05.566 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.566 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.566 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:05.566 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.037010+0000", 2024-05-08T18:32:05.566 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6253e-05 2024-05-08T18:32:05.566 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.566 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.566 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:05.567 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.037029+0000", 2024-05-08T18:32:05.567 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9334000000000002e-05 2024-05-08T18:32:05.567 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.567 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.567 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:05.567 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.037196+0000", 2024-05-08T18:32:05.567 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000166312 2024-05-08T18:32:05.567 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.567 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.567 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:05.567 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.037506+0000", 2024-05-08T18:32:05.567 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00030996700000000002 2024-05-08T18:32:05.567 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.567 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.567 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-05-08T18:32:05.568 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.037742+0000", 2024-05-08T18:32:05.568 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000236419 2024-05-08T18:32:05.568 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.568 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.568 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:05.568 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.049950+0000", 2024-05-08T18:32:05.568 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012207697999999999 2024-05-08T18:32:05.568 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.568 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.568 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:05.568 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.051181+0000", 2024-05-08T18:32:05.568 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001231408 2024-05-08T18:32:05.568 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.568 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.569 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:05.569 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.051281+0000", 2024-05-08T18:32:05.569 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.9499000000000004e-05 2024-05-08T18:32:05.569 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.569 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.569 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:05.569 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.051357+0000", 2024-05-08T18:32:05.569 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6268999999999998e-05 2024-05-08T18:32:05.569 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:05.569 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:05.569 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:05.569 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.569 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.569 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1900 3.34 3:2eec0dc7:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_86:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:32:05.570 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:01.684180+0000", 2024-05-08T18:32:05.570 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 3.780892916, 2024-05-08T18:32:05.570 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.021863239, 2024-05-08T18:32:05.570 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:05.570 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:05.570 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:05.570 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:05.570 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:05.570 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:05.570 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1900 2024-05-08T18:32:05.570 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.570 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:05.570 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.570 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:05.571 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.684180+0000", 2024-05-08T18:32:05.571 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:05.571 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.571 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.571 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:05.571 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.684180+0000", 2024-05-08T18:32:05.571 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:05.571 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.571 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.571 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:05.571 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.684183+0000", 2024-05-08T18:32:05.571 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3160000000000001e-06 2024-05-08T18:32:05.571 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.571 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.572 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:05.572 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.689191+0000", 2024-05-08T18:32:05.572 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.005008317 2024-05-08T18:32:05.572 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.572 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.572 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:05.572 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.689231+0000", 2024-05-08T18:32:05.572 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9663000000000003e-05 2024-05-08T18:32:05.572 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.572 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.572 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:05.572 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.689255+0000", 2024-05-08T18:32:05.572 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.4275999999999999e-05 2024-05-08T18:32:05.572 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.572 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.573 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:05.573 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.689371+0000", 2024-05-08T18:32:05.573 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011611 2024-05-08T18:32:05.573 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.573 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.573 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:05.573 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.689488+0000", 2024-05-08T18:32:05.573 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000117063 2024-05-08T18:32:05.573 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.573 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.573 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:32:05.573 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.689585+0000", 2024-05-08T18:32:05.573 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6941000000000006e-05 2024-05-08T18:32:05.574 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.574 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.574 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:05.574 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.703523+0000", 2024-05-08T18:32:05.574 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013938061999999999 2024-05-08T18:32:05.574 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.574 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.574 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:05.574 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.705847+0000", 2024-05-08T18:32:05.574 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0023240719999999999 2024-05-08T18:32:05.574 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.574 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.574 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:05.574 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.705966+0000", 2024-05-08T18:32:05.575 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011906899999999999 2024-05-08T18:32:05.575 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.575 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.575 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:05.575 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.706043+0000", 2024-05-08T18:32:05.575 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6349999999999999e-05 2024-05-08T18:32:05.575 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:05.575 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:05.575 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:05.575 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.575 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.575 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1907 3.34 3:2f5137c7:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_93:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:32:05.575 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:01.831860+0000", 2024-05-08T18:32:05.575 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 3.6332122739999999, 2024-05-08T18:32:05.575 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.030884407999999999, 2024-05-08T18:32:05.576 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:05.576 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:05.576 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:05.576 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:05.576 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:05.576 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:05.576 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1907 2024-05-08T18:32:05.576 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.576 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:05.576 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.576 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:05.576 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.831860+0000", 2024-05-08T18:32:05.576 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:05.576 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.577 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.577 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:05.577 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.831860+0000", 2024-05-08T18:32:05.577 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:05.577 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.577 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.577 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:05.577 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.831863+0000", 2024-05-08T18:32:05.577 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6989999999999999e-06 2024-05-08T18:32:05.577 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.577 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.577 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:05.577 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.836003+0000", 2024-05-08T18:32:05.577 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0041399799999999997 2024-05-08T18:32:05.578 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.578 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.578 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:05.578 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.836043+0000", 2024-05-08T18:32:05.578 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0216999999999998e-05 2024-05-08T18:32:05.578 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.578 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.578 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:05.578 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.836062+0000", 2024-05-08T18:32:05.578 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8612999999999999e-05 2024-05-08T18:32:05.578 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.578 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.578 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:05.578 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.836256+0000", 2024-05-08T18:32:05.579 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00019403500000000001 2024-05-08T18:32:05.579 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.579 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.579 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:05.579 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.836501+0000", 2024-05-08T18:32:05.579 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00024500500000000002 2024-05-08T18:32:05.579 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.579 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.579 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:32:05.579 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.836731+0000", 2024-05-08T18:32:05.579 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00023071800000000001 2024-05-08T18:32:05.579 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.579 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.579 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:05.579 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.861762+0000", 2024-05-08T18:32:05.580 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.025030793999999999 2024-05-08T18:32:05.580 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.580 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.580 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:05.580 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.862626+0000", 2024-05-08T18:32:05.580 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00086390100000000004 2024-05-08T18:32:05.580 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.580 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.580 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:05.580 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.862694+0000", 2024-05-08T18:32:05.580 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7384000000000004e-05 2024-05-08T18:32:05.580 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:05.580 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:05.580 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:05.580 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.862745+0000", 2024-05-08T18:32:05.581 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1062e-05 2024-05-08T18:32:05.581 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:05.581 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:05.581 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:05.581 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:05.581 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:05.581 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:32:05.582 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-08T18:32:05.583 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:32:05.581+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:32:05.684 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:32:05.678+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:32:05.733 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-08T18:32:05.754 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:32:05.755 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:32:05.755 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 0 2024-05-08T18:32:05.755 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:32:05.769 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-08T18:32:05.784 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:32:05.785+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:32:05.886 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:32:05.882+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:32:05.943 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:32:05.943 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:32:05.943 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2024-05-08T18:32:05.944 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2024-05-08T18:32:05.944 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:32:05.957 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-08T18:32:06.001 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:32:05.998+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:32:06.088 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:32:06.082+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:32:06.125 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:32:06.126 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2024-05-08T18:32:06.126 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2024-05-08T18:32:06.126 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-05-08T18:32:06.126 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.126 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1234 3.38 e80/21 3:1cb36fa1:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.2__shadow_.fYaqa8o34qSAauLRSqi3iwpmT5NwV5c_1:head v 80'1, mlcod=0'0)", 2024-05-08T18:32:06.126 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:38.217418+0000", 2024-05-08T18:32:06.126 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 27.905791318999999, 2024-05-08T18:32:06.126 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.02469151, 2024-05-08T18:32:06.126 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:06.126 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:06.126 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:06.126 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:06.127 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.127 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:06.127 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.217418+0000", 2024-05-08T18:32:06.127 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:06.127 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.127 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.127 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:06.127 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.217418+0000", 2024-05-08T18:32:06.127 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:06.127 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.127 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.127 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:06.127 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.217420+0000", 2024-05-08T18:32:06.127 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9970000000000001e-06 2024-05-08T18:32:06.128 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.128 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.128 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:06.128 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.225957+0000", 2024-05-08T18:32:06.128 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0085373180000000003 2024-05-08T18:32:06.128 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.128 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.128 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:06.128 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.226002+0000", 2024-05-08T18:32:06.128 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4462999999999998e-05 2024-05-08T18:32:06.128 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.128 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.128 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:06.129 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.226036+0000", 2024-05-08T18:32:06.129 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4286999999999999e-05 2024-05-08T18:32:06.129 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.129 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.129 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:06.129 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.226204+0000", 2024-05-08T18:32:06.129 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000168219 2024-05-08T18:32:06.129 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.130 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.130 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:06.130 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.226269+0000", 2024-05-08T18:32:06.130 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4858999999999997e-05 2024-05-08T18:32:06.130 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.130 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.130 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:06.130 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.242001+0000", 2024-05-08T18:32:06.130 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015731898000000001 2024-05-08T18:32:06.130 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.130 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.130 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:06.130 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.242109+0000", 2024-05-08T18:32:06.130 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010846899999999999 2024-05-08T18:32:06.131 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:06.131 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:06.131 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:06.131 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.131 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.131 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1237 3.c 3:3156de39:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.2_10Mb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (355) in=17b,setxattr user.rgw.acl (129) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-05-08T18:32:06.131 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:38.244592+0000", 2024-05-08T18:32:06.131 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 27.878617015, 2024-05-08T18:32:06.131 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.021467379000000002, 2024-05-08T18:32:06.131 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:06.131 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:06.131 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:06.131 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:06.132 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:06.132 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:06.132 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1237 2024-05-08T18:32:06.132 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.132 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:06.132 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.132 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:06.132 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.244592+0000", 2024-05-08T18:32:06.132 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:06.132 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.132 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.132 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:06.133 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.244592+0000", 2024-05-08T18:32:06.133 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:06.133 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.133 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.133 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:06.133 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.244599+0000", 2024-05-08T18:32:06.133 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3170000000000004e-06 2024-05-08T18:32:06.133 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.133 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.133 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:06.133 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.250239+0000", 2024-05-08T18:32:06.133 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0056396270000000004 2024-05-08T18:32:06.133 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.133 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.134 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:06.134 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.250279+0000", 2024-05-08T18:32:06.134 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0370000000000001e-05 2024-05-08T18:32:06.134 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.134 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.134 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:06.134 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.250305+0000", 2024-05-08T18:32:06.134 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5259999999999999e-05 2024-05-08T18:32:06.134 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.134 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.134 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:06.134 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.250509+0000", 2024-05-08T18:32:06.134 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020390800000000001 2024-05-08T18:32:06.135 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.135 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.135 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:06.135 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.250777+0000", 2024-05-08T18:32:06.135 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00026804200000000002 2024-05-08T18:32:06.135 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.135 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.135 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 3", 2024-05-08T18:32:06.135 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.251654+0000", 2024-05-08T18:32:06.135 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00087763999999999995 2024-05-08T18:32:06.135 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.135 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.135 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:06.136 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.263070+0000", 2024-05-08T18:32:06.136 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011415544 2024-05-08T18:32:06.136 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.136 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.136 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:06.136 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.265866+0000", 2024-05-08T18:32:06.136 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002795699 2024-05-08T18:32:06.136 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.136 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.136 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:06.136 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.265975+0000", 2024-05-08T18:32:06.136 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000109819 2024-05-08T18:32:06.136 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.136 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.136 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:06.137 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.266060+0000", 2024-05-08T18:32:06.137 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4153000000000006e-05 2024-05-08T18:32:06.137 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:06.137 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:06.137 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:06.137 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.137 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.137 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1318 3.c 3:329e59e6:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-08T18:32:06.137 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.337285+0000", 2024-05-08T18:32:06.137 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 23.785924592000001, 2024-05-08T18:32:06.137 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.024126754, 2024-05-08T18:32:06.137 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:06.137 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:06.137 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:06.138 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:06.138 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:06.138 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:06.138 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1318 2024-05-08T18:32:06.138 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.138 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:06.138 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.138 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:06.138 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.337285+0000", 2024-05-08T18:32:06.138 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:06.138 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.138 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.138 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:06.138 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.337285+0000", 2024-05-08T18:32:06.139 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:06.139 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.139 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.139 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:06.139 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.337288+0000", 2024-05-08T18:32:06.139 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6799999999999999e-06 2024-05-08T18:32:06.139 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.139 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.139 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:06.139 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.343559+0000", 2024-05-08T18:32:06.139 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0062709920000000004 2024-05-08T18:32:06.139 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.140 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.140 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:06.140 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.343600+0000", 2024-05-08T18:32:06.140 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0686000000000003e-05 2024-05-08T18:32:06.140 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.140 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.140 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:06.140 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.343621+0000", 2024-05-08T18:32:06.140 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1364000000000001e-05 2024-05-08T18:32:06.140 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.140 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.140 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:06.140 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.343774+0000", 2024-05-08T18:32:06.141 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000152495 2024-05-08T18:32:06.141 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.141 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.141 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:06.141 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.344025+0000", 2024-05-08T18:32:06.141 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00025118800000000001 2024-05-08T18:32:06.141 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.141 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.141 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 3", 2024-05-08T18:32:06.141 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.344259+0000", 2024-05-08T18:32:06.141 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000234455 2024-05-08T18:32:06.141 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.141 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.141 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:06.142 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.357786+0000", 2024-05-08T18:32:06.142 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013526338000000001 2024-05-08T18:32:06.142 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.142 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.142 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:06.142 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.361116+0000", 2024-05-08T18:32:06.142 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0033298619999999998 2024-05-08T18:32:06.142 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.142 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.142 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:06.142 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.361290+0000", 2024-05-08T18:32:06.142 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017451200000000001 2024-05-08T18:32:06.142 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.143 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.143 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:06.143 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.361411+0000", 2024-05-08T18:32:06.143 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012118200000000001 2024-05-08T18:32:06.143 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:06.143 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:06.143 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:06.143 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.143 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.143 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1324 3.3a 3:5fe59963:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-08T18:32:06.143 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.429632+0000", 2024-05-08T18:32:06.143 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 23.693576887999999, 2024-05-08T18:32:06.143 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019556068999999999, 2024-05-08T18:32:06.143 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:06.144 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:06.144 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:06.144 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:06.144 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:06.144 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:06.144 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1324 2024-05-08T18:32:06.144 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.144 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:06.144 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.144 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:06.144 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.429632+0000", 2024-05-08T18:32:06.144 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:06.144 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.145 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.145 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:06.145 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.429632+0000", 2024-05-08T18:32:06.145 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:06.145 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.145 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.145 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:06.145 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.429636+0000", 2024-05-08T18:32:06.145 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9060000000000004e-06 2024-05-08T18:32:06.145 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.145 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.145 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:06.145 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.434488+0000", 2024-05-08T18:32:06.145 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0048521270000000003 2024-05-08T18:32:06.146 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.146 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.146 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:06.146 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.434529+0000", 2024-05-08T18:32:06.146 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0365999999999999e-05 2024-05-08T18:32:06.146 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.146 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.146 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:06.146 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.434548+0000", 2024-05-08T18:32:06.146 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8893999999999999e-05 2024-05-08T18:32:06.146 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.146 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.146 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:06.146 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.434680+0000", 2024-05-08T18:32:06.147 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000132285 2024-05-08T18:32:06.147 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.147 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.147 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:06.147 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.434925+0000", 2024-05-08T18:32:06.147 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00024557799999999999 2024-05-08T18:32:06.147 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.147 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.147 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:32:06.147 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.435148+0000", 2024-05-08T18:32:06.147 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022281800000000001 2024-05-08T18:32:06.147 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.147 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.148 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:06.148 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.447529+0000", 2024-05-08T18:32:06.148 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012380584 2024-05-08T18:32:06.148 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.148 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.148 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:06.148 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.448987+0000", 2024-05-08T18:32:06.148 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0014577189999999999 2024-05-08T18:32:06.148 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.148 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.148 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:06.148 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.449113+0000", 2024-05-08T18:32:06.148 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000126482 2024-05-08T18:32:06.149 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.149 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.149 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:06.149 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.449188+0000", 2024-05-08T18:32:06.149 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5309999999999996e-05 2024-05-08T18:32:06.149 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:06.149 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:06.149 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:06.149 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.149 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.149 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1350 3.3a 3:5caef9cc:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_36:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:32:06.149 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.707170+0000", 2024-05-08T18:32:06.149 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 23.416039286, 2024-05-08T18:32:06.150 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.02479787, 2024-05-08T18:32:06.150 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:06.150 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:06.150 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:06.150 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:06.150 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:06.150 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:06.150 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1350 2024-05-08T18:32:06.150 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.150 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:06.150 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.150 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:06.150 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.707170+0000", 2024-05-08T18:32:06.151 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:06.151 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.151 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.151 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:06.151 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.707170+0000", 2024-05-08T18:32:06.151 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:06.151 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.151 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.151 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:06.151 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.707174+0000", 2024-05-08T18:32:06.151 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6629999999999999e-06 2024-05-08T18:32:06.151 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.151 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.151 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:06.152 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.713406+0000", 2024-05-08T18:32:06.152 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0062328030000000003 2024-05-08T18:32:06.152 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.152 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.152 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:06.152 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.713446+0000", 2024-05-08T18:32:06.152 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9990000000000002e-05 2024-05-08T18:32:06.152 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.152 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.152 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:06.152 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.713466+0000", 2024-05-08T18:32:06.152 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0136000000000002e-05 2024-05-08T18:32:06.152 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.152 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.152 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:06.153 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.713609+0000", 2024-05-08T18:32:06.153 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014227599999999999 2024-05-08T18:32:06.153 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.153 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.153 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:06.153 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.713871+0000", 2024-05-08T18:32:06.153 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000261885 2024-05-08T18:32:06.153 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.153 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.153 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:32:06.153 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.714152+0000", 2024-05-08T18:32:06.153 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00028181099999999998 2024-05-08T18:32:06.153 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.153 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.154 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:06.154 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.723750+0000", 2024-05-08T18:32:06.154 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0095972739999999994 2024-05-08T18:32:06.154 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.154 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.154 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:06.154 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.731740+0000", 2024-05-08T18:32:06.154 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0079900969999999998 2024-05-08T18:32:06.154 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.154 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.154 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:06.155 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.731843+0000", 2024-05-08T18:32:06.155 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000103052 2024-05-08T18:32:06.155 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.155 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.155 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:06.155 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.731968+0000", 2024-05-08T18:32:06.155 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000124883 2024-05-08T18:32:06.155 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:06.155 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:06.155 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:06.155 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.155 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.155 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1355 3.28 3:14052413:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_41:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:32:06.155 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.762527+0000", 2024-05-08T18:32:06.156 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 23.360681722999999, 2024-05-08T18:32:06.156 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.026016406999999998, 2024-05-08T18:32:06.156 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:06.156 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:06.156 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:06.156 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:06.156 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:06.156 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:06.156 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1355 2024-05-08T18:32:06.156 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.156 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:06.156 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.156 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:06.157 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.762527+0000", 2024-05-08T18:32:06.157 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:06.157 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.157 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.157 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:06.157 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.762527+0000", 2024-05-08T18:32:06.157 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:06.157 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.157 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.157 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:06.157 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.762545+0000", 2024-05-08T18:32:06.157 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7045999999999999e-05 2024-05-08T18:32:06.157 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.157 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.157 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:06.158 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.767178+0000", 2024-05-08T18:32:06.158 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0046339420000000003 2024-05-08T18:32:06.158 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.158 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.158 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:06.158 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.767214+0000", 2024-05-08T18:32:06.158 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5855999999999997e-05 2024-05-08T18:32:06.158 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.158 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.158 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:06.158 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.767242+0000", 2024-05-08T18:32:06.158 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8113e-05 2024-05-08T18:32:06.158 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.159 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.159 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:06.159 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.767401+0000", 2024-05-08T18:32:06.159 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000158429 2024-05-08T18:32:06.159 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.159 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.159 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:06.159 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.767648+0000", 2024-05-08T18:32:06.159 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000247328 2024-05-08T18:32:06.159 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.159 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.159 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 3", 2024-05-08T18:32:06.159 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.767899+0000", 2024-05-08T18:32:06.159 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00025059799999999999 2024-05-08T18:32:06.160 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.160 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.160 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:06.160 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.780702+0000", 2024-05-08T18:32:06.160 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012803238 2024-05-08T18:32:06.160 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.160 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.160 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:06.160 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.788231+0000", 2024-05-08T18:32:06.160 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0075285090000000001 2024-05-08T18:32:06.160 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.160 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.160 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:06.160 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.788402+0000", 2024-05-08T18:32:06.161 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017113299999999999 2024-05-08T18:32:06.161 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.161 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.161 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:06.161 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.788544+0000", 2024-05-08T18:32:06.161 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014221500000000001 2024-05-08T18:32:06.161 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:06.161 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:06.161 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:06.161 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.161 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.161 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1377 3.28 3:1730bdaf:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_63:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:32:06.161 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.996763+0000", 2024-05-08T18:32:06.162 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 23.126446574999999, 2024-05-08T18:32:06.162 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.02215497, 2024-05-08T18:32:06.162 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:06.162 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:06.162 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:06.162 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:06.162 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:06.162 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:06.162 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1377 2024-05-08T18:32:06.162 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.162 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:06.162 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.162 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:06.163 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.996763+0000", 2024-05-08T18:32:06.163 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:06.163 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.163 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.163 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:06.163 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.996763+0000", 2024-05-08T18:32:06.163 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:06.163 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.163 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.163 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:06.163 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.996766+0000", 2024-05-08T18:32:06.163 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.9299999999999999e-06 2024-05-08T18:32:06.163 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.163 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.164 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:06.164 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.002222+0000", 2024-05-08T18:32:06.164 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0054559819999999998 2024-05-08T18:32:06.164 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.164 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.164 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:06.164 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.002259+0000", 2024-05-08T18:32:06.164 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7222999999999999e-05 2024-05-08T18:32:06.164 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.164 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.164 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:06.164 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.002277+0000", 2024-05-08T18:32:06.164 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8607e-05 2024-05-08T18:32:06.164 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.165 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.165 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:06.165 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.002484+0000", 2024-05-08T18:32:06.165 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020670500000000001 2024-05-08T18:32:06.165 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.165 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.165 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:06.165 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.002843+0000", 2024-05-08T18:32:06.165 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00035888100000000002 2024-05-08T18:32:06.165 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.165 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.165 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 3", 2024-05-08T18:32:06.165 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.003165+0000", 2024-05-08T18:32:06.165 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00032193 2024-05-08T18:32:06.166 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.166 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.166 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:06.166 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.011993+0000", 2024-05-08T18:32:06.166 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.008827718 2024-05-08T18:32:06.166 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.166 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.166 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:06.166 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.018733+0000", 2024-05-08T18:32:06.166 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.006739989 2024-05-08T18:32:06.166 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.166 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.166 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:06.166 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.018840+0000", 2024-05-08T18:32:06.167 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000107799 2024-05-08T18:32:06.167 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.167 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.167 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:06.167 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.018918+0000", 2024-05-08T18:32:06.167 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.7206000000000006e-05 2024-05-08T18:32:06.167 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:06.167 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:06.167 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:06.167 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.167 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.167 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1407 3.22 3:46b64ebe:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_93:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:32:06.167 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:43.343033+0000", 2024-05-08T18:32:06.168 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 22.780176227999998, 2024-05-08T18:32:06.168 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.022710952, 2024-05-08T18:32:06.168 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:06.168 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:06.168 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:06.168 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:06.168 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:06.168 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:06.168 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1407 2024-05-08T18:32:06.168 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.168 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:06.168 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.168 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:06.168 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.343033+0000", 2024-05-08T18:32:06.168 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:06.169 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.169 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.169 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:06.169 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.343033+0000", 2024-05-08T18:32:06.169 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:06.169 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.169 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.169 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:06.169 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.343035+0000", 2024-05-08T18:32:06.169 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5100000000000001e-06 2024-05-08T18:32:06.169 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.169 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.169 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:06.169 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.346921+0000", 2024-05-08T18:32:06.170 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0038850489999999998 2024-05-08T18:32:06.170 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.170 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.170 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:06.170 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.346943+0000", 2024-05-08T18:32:06.170 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2897000000000001e-05 2024-05-08T18:32:06.170 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.170 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.170 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:06.170 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.346956+0000", 2024-05-08T18:32:06.170 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2159e-05 2024-05-08T18:32:06.170 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.170 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.171 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:06.171 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.347033+0000", 2024-05-08T18:32:06.171 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.7898000000000005e-05 2024-05-08T18:32:06.171 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.171 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.171 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:06.171 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.347179+0000", 2024-05-08T18:32:06.171 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014600400000000001 2024-05-08T18:32:06.171 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.171 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.171 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 3", 2024-05-08T18:32:06.171 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.347304+0000", 2024-05-08T18:32:06.171 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012491100000000001 2024-05-08T18:32:06.171 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.172 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.172 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:06.172 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.355666+0000", 2024-05-08T18:32:06.172 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0083618319999999996 2024-05-08T18:32:06.172 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.172 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.172 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:06.172 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.365667+0000", 2024-05-08T18:32:06.172 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010000289000000001 2024-05-08T18:32:06.172 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.172 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.172 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:06.172 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.365709+0000", 2024-05-08T18:32:06.172 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.2549000000000002e-05 2024-05-08T18:32:06.173 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.173 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.173 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:06.173 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.365744+0000", 2024-05-08T18:32:06.173 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4854000000000002e-05 2024-05-08T18:32:06.173 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:06.173 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:06.173 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:06.173 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.173 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.173 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1413 3.2f 3:f6ed8c1f:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_99:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:32:06.173 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:43.405307+0000", 2024-05-08T18:32:06.173 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 22.71790244, 2024-05-08T18:32:06.173 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.025254335999999999, 2024-05-08T18:32:06.174 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:06.174 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:06.174 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:06.174 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:06.174 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:06.174 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:06.174 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1413 2024-05-08T18:32:06.174 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.174 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:06.174 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.174 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:06.174 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.405307+0000", 2024-05-08T18:32:06.174 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:06.175 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.175 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.175 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:06.175 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.405307+0000", 2024-05-08T18:32:06.175 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:06.175 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.175 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.175 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:06.175 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.405310+0000", 2024-05-08T18:32:06.175 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0800000000000002e-06 2024-05-08T18:32:06.175 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.175 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.175 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:06.175 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.411517+0000", 2024-05-08T18:32:06.175 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0062069270000000001 2024-05-08T18:32:06.176 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.176 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.176 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:06.176 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.411551+0000", 2024-05-08T18:32:06.176 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4579000000000002e-05 2024-05-08T18:32:06.176 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.176 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.176 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:06.176 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.411570+0000", 2024-05-08T18:32:06.176 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8179999999999999e-05 2024-05-08T18:32:06.176 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.176 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.176 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:06.176 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.411654+0000", 2024-05-08T18:32:06.176 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4708000000000003e-05 2024-05-08T18:32:06.177 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.177 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.177 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:06.177 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.411768+0000", 2024-05-08T18:32:06.177 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000114176 2024-05-08T18:32:06.177 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.177 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.177 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 7", 2024-05-08T18:32:06.177 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.411864+0000", 2024-05-08T18:32:06.177 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.5637000000000006e-05 2024-05-08T18:32:06.177 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.177 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.177 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:06.178 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.420357+0000", 2024-05-08T18:32:06.178 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0084934529999999998 2024-05-08T18:32:06.178 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.178 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.178 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:06.178 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.430427+0000", 2024-05-08T18:32:06.178 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010069855000000001 2024-05-08T18:32:06.178 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.178 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.178 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:06.178 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.430501+0000", 2024-05-08T18:32:06.178 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3613000000000001e-05 2024-05-08T18:32:06.178 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.179 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.179 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:06.179 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.430561+0000", 2024-05-08T18:32:06.179 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.0127999999999998e-05 2024-05-08T18:32:06.179 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:06.179 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:06.179 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:06.179 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.179 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.179 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1615 3.35 e83/21 3:ae758c88:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_3:head v 83'7, mlcod=82'5)", 2024-05-08T18:32:06.179 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:46.729645+0000", 2024-05-08T18:32:06.179 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 19.393563796999999, 2024-05-08T18:32:06.179 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.022764072, 2024-05-08T18:32:06.179 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:06.180 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:06.180 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:06.180 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:06.180 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.180 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:06.180 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.729645+0000", 2024-05-08T18:32:06.180 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:06.180 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.180 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.180 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:06.180 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.729645+0000", 2024-05-08T18:32:06.180 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:06.180 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.180 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.181 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:06.181 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.729649+0000", 2024-05-08T18:32:06.181 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3830000000000001e-06 2024-05-08T18:32:06.181 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.181 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.181 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:06.181 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.734571+0000", 2024-05-08T18:32:06.181 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0049222600000000004 2024-05-08T18:32:06.181 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.181 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.181 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:06.181 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.734611+0000", 2024-05-08T18:32:06.181 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9969000000000003e-05 2024-05-08T18:32:06.181 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.182 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.182 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:06.182 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.734629+0000", 2024-05-08T18:32:06.182 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7827000000000001e-05 2024-05-08T18:32:06.182 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.182 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.182 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:06.182 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.734800+0000", 2024-05-08T18:32:06.182 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000170929 2024-05-08T18:32:06.182 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.182 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.182 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:06.182 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.734867+0000", 2024-05-08T18:32:06.183 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6952000000000005e-05 2024-05-08T18:32:06.183 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.183 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.183 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:06.183 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.752282+0000", 2024-05-08T18:32:06.183 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017415669000000002 2024-05-08T18:32:06.183 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.183 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.183 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:06.183 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.752409+0000", 2024-05-08T18:32:06.183 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000127083 2024-05-08T18:32:06.183 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:06.183 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:06.183 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:06.183 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.184 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.184 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1618 3.1c 3:3b36ad14:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-05-08T18:32:06.184 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:46.750394+0000", 2024-05-08T18:32:06.184 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 19.372815602999999, 2024-05-08T18:32:06.184 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.023322207000000001, 2024-05-08T18:32:06.184 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:06.184 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:06.184 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:06.184 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:06.184 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:06.184 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:06.184 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1618 2024-05-08T18:32:06.184 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.184 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:06.185 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.185 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:06.185 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.750394+0000", 2024-05-08T18:32:06.185 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:06.185 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.185 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.185 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:06.185 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.750394+0000", 2024-05-08T18:32:06.185 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:06.185 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.185 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.185 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:06.185 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.750399+0000", 2024-05-08T18:32:06.185 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9760000000000003e-06 2024-05-08T18:32:06.186 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.186 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.186 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:06.186 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.756899+0000", 2024-05-08T18:32:06.186 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0065001809999999998 2024-05-08T18:32:06.186 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.186 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.186 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:06.186 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.756936+0000", 2024-05-08T18:32:06.186 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7716000000000003e-05 2024-05-08T18:32:06.186 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.186 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.186 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:06.187 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.756955+0000", 2024-05-08T18:32:06.187 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8196999999999999e-05 2024-05-08T18:32:06.187 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.187 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.187 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:06.187 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.757132+0000", 2024-05-08T18:32:06.187 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017692200000000001 2024-05-08T18:32:06.187 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.187 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.187 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:06.187 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.757531+0000", 2024-05-08T18:32:06.187 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00039989700000000002 2024-05-08T18:32:06.187 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.187 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.188 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 4", 2024-05-08T18:32:06.188 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.757770+0000", 2024-05-08T18:32:06.188 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000238908 2024-05-08T18:32:06.188 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.188 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.188 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:06.188 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.768339+0000", 2024-05-08T18:32:06.188 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010568394 2024-05-08T18:32:06.188 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.188 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.188 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:06.188 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.773409+0000", 2024-05-08T18:32:06.188 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0050704019999999999 2024-05-08T18:32:06.188 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.189 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.189 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:06.189 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.773584+0000", 2024-05-08T18:32:06.189 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017481500000000001 2024-05-08T18:32:06.189 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.189 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.189 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:06.189 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.773716+0000", 2024-05-08T18:32:06.189 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013179899999999999 2024-05-08T18:32:06.189 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:06.189 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:06.189 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:06.189 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.190 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.190 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1816 3.2f 3:f49f92e1:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-05-08T18:32:06.190 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:00.419070+0000", 2024-05-08T18:32:06.190 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 5.7041394099999998, 2024-05-08T18:32:06.190 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.026961746000000002, 2024-05-08T18:32:06.190 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:06.190 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:06.190 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:06.190 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:06.190 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:06.190 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:06.190 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1816 2024-05-08T18:32:06.190 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.190 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:06.191 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.191 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:06.191 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.419070+0000", 2024-05-08T18:32:06.191 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:06.191 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.191 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.191 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:06.191 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.419070+0000", 2024-05-08T18:32:06.191 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:06.191 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.191 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.191 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:06.191 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.419073+0000", 2024-05-08T18:32:06.192 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3529999999999999e-06 2024-05-08T18:32:06.192 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.192 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.192 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:06.192 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.426045+0000", 2024-05-08T18:32:06.192 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0069723609999999998 2024-05-08T18:32:06.192 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.192 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.192 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:06.192 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.426086+0000", 2024-05-08T18:32:06.192 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.019e-05 2024-05-08T18:32:06.192 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.192 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.192 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:06.193 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.426105+0000", 2024-05-08T18:32:06.193 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9076000000000002e-05 2024-05-08T18:32:06.193 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.193 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.193 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:06.193 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.426263+0000", 2024-05-08T18:32:06.193 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015805600000000001 2024-05-08T18:32:06.193 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.193 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.193 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:06.193 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.426600+0000", 2024-05-08T18:32:06.193 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00033738399999999998 2024-05-08T18:32:06.193 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.193 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.194 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 7", 2024-05-08T18:32:06.194 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.426840+0000", 2024-05-08T18:32:06.194 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000239962 2024-05-08T18:32:06.194 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.194 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.194 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:06.194 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.441632+0000", 2024-05-08T18:32:06.194 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.014792008000000001 2024-05-08T18:32:06.194 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.194 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.194 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:06.194 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.445868+0000", 2024-05-08T18:32:06.194 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0042358880000000002 2024-05-08T18:32:06.195 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.195 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.195 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:06.195 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.445961+0000", 2024-05-08T18:32:06.195 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2474999999999998e-05 2024-05-08T18:32:06.195 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.195 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.195 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:06.195 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.446032+0000", 2024-05-08T18:32:06.195 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0993000000000003e-05 2024-05-08T18:32:06.195 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:06.195 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:06.195 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:06.196 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.196 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.196 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1819 3.30 3:0d002d77:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-05-08T18:32:06.196 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:00.476410+0000", 2024-05-08T18:32:06.196 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 5.6467993300000003, 2024-05-08T18:32:06.196 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.032375058999999998, 2024-05-08T18:32:06.196 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:06.196 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:06.196 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:06.196 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:06.196 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:06.196 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:06.196 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1819 2024-05-08T18:32:06.196 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.197 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:06.197 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.197 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:06.197 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.476410+0000", 2024-05-08T18:32:06.197 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:06.197 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.197 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.197 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:06.197 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.476410+0000", 2024-05-08T18:32:06.197 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:06.197 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.197 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.197 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:06.197 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.476413+0000", 2024-05-08T18:32:06.197 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7070000000000001e-06 2024-05-08T18:32:06.198 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.198 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.198 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:06.198 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.480961+0000", 2024-05-08T18:32:06.198 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0045480690000000001 2024-05-08T18:32:06.198 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.198 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.198 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:06.198 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.481003+0000", 2024-05-08T18:32:06.198 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1943000000000001e-05 2024-05-08T18:32:06.198 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.198 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.198 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:06.199 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.481028+0000", 2024-05-08T18:32:06.199 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5262999999999999e-05 2024-05-08T18:32:06.199 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.199 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.199 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:06.199 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.481144+0000", 2024-05-08T18:32:06.199 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000116087 2024-05-08T18:32:06.199 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.199 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.199 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:06.199 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.481343+0000", 2024-05-08T18:32:06.199 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00019893999999999999 2024-05-08T18:32:06.199 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.199 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.200 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:32:06.200 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.481517+0000", 2024-05-08T18:32:06.200 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000173697 2024-05-08T18:32:06.200 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.200 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.200 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:06.200 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.488942+0000", 2024-05-08T18:32:06.200 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0074250929999999998 2024-05-08T18:32:06.200 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.200 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.200 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:06.200 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.508658+0000", 2024-05-08T18:32:06.200 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019716469 2024-05-08T18:32:06.201 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.201 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.201 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:06.201 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.508729+0000", 2024-05-08T18:32:06.201 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1235000000000005e-05 2024-05-08T18:32:06.201 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.201 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.201 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:06.201 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.508785+0000", 2024-05-08T18:32:06.201 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5556000000000001e-05 2024-05-08T18:32:06.201 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:06.201 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:06.201 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:06.201 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.202 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.202 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1866 3.17 e93/21 3:e89f8bff:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_52:head v 93'8, mlcod=84'6)", 2024-05-08T18:32:06.202 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:01.059520+0000", 2024-05-08T18:32:06.202 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 5.0636894290000001, 2024-05-08T18:32:06.202 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019782560000000001, 2024-05-08T18:32:06.202 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:06.202 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:06.202 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:06.202 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:06.202 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.202 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:06.202 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.059520+0000", 2024-05-08T18:32:06.202 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:06.202 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.203 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.203 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:06.203 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.059520+0000", 2024-05-08T18:32:06.203 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:06.203 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.203 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.203 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:06.203 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.059523+0000", 2024-05-08T18:32:06.203 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8229999999999999e-06 2024-05-08T18:32:06.203 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.203 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.203 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:06.203 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.063985+0000", 2024-05-08T18:32:06.204 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0044628460000000003 2024-05-08T18:32:06.204 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.204 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.204 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:06.204 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.064033+0000", 2024-05-08T18:32:06.204 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7825999999999999e-05 2024-05-08T18:32:06.204 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.204 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.204 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:06.204 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.064057+0000", 2024-05-08T18:32:06.204 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3883000000000002e-05 2024-05-08T18:32:06.204 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.204 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.204 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:06.205 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.064232+0000", 2024-05-08T18:32:06.205 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017526600000000001 2024-05-08T18:32:06.205 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.205 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.205 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:06.205 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.064301+0000", 2024-05-08T18:32:06.205 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8429000000000005e-05 2024-05-08T18:32:06.205 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.205 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.205 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:06.205 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.079213+0000", 2024-05-08T18:32:06.205 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.014911938 2024-05-08T18:32:06.205 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.205 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.206 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:06.206 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.079302+0000", 2024-05-08T18:32:06.206 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.9549000000000006e-05 2024-05-08T18:32:06.206 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:06.206 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:06.206 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:06.206 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.206 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.206 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1868 3.2f 3:f4cf47d6:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_54:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:32:06.206 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:01.082779+0000", 2024-05-08T18:32:06.206 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 5.0404304719999997, 2024-05-08T18:32:06.206 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.023993838999999999, 2024-05-08T18:32:06.206 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:06.206 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:06.207 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:06.207 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:06.207 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:06.207 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:06.207 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1868 2024-05-08T18:32:06.207 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.207 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:06.207 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.207 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:06.207 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.082779+0000", 2024-05-08T18:32:06.207 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:06.207 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.207 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.207 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:06.208 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.082779+0000", 2024-05-08T18:32:06.208 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:06.208 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.208 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.208 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:06.208 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.082782+0000", 2024-05-08T18:32:06.208 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1429999999999998e-06 2024-05-08T18:32:06.208 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.208 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.208 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:06.208 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.086738+0000", 2024-05-08T18:32:06.208 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039560749999999999 2024-05-08T18:32:06.208 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.208 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.209 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:06.209 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.086781+0000", 2024-05-08T18:32:06.209 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3513999999999997e-05 2024-05-08T18:32:06.209 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.209 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.209 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:06.209 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.086803+0000", 2024-05-08T18:32:06.209 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1505000000000002e-05 2024-05-08T18:32:06.209 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.209 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.209 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:06.209 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.086967+0000", 2024-05-08T18:32:06.209 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016404899999999999 2024-05-08T18:32:06.209 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.210 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.210 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:06.210 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.087238+0000", 2024-05-08T18:32:06.210 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00027128800000000001 2024-05-08T18:32:06.210 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.210 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.210 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 7", 2024-05-08T18:32:06.210 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.087500+0000", 2024-05-08T18:32:06.210 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00026215400000000001 2024-05-08T18:32:06.211 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.211 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.211 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:06.211 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.106273+0000", 2024-05-08T18:32:06.211 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018772832 2024-05-08T18:32:06.211 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.211 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.211 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:06.211 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.106605+0000", 2024-05-08T18:32:06.211 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00033141300000000002 2024-05-08T18:32:06.211 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.211 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.211 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:06.211 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.106698+0000", 2024-05-08T18:32:06.212 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.3706e-05 2024-05-08T18:32:06.212 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.212 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.212 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:06.212 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.106773+0000", 2024-05-08T18:32:06.212 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4159999999999995e-05 2024-05-08T18:32:06.212 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:06.212 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:06.212 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:06.212 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.212 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.212 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1872 3.1c 3:38d9a9dd:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_58:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:32:06.212 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:01.131325+0000", 2024-05-08T18:32:06.212 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4.9918843299999995, 2024-05-08T18:32:06.213 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.021008104, 2024-05-08T18:32:06.213 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:06.213 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:06.213 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:06.213 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:06.213 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:06.213 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:06.213 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1872 2024-05-08T18:32:06.213 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.213 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:06.213 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.213 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:06.213 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.131325+0000", 2024-05-08T18:32:06.214 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:06.214 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.214 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.214 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:06.214 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.131325+0000", 2024-05-08T18:32:06.214 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:06.214 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.214 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.214 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:06.214 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.131327+0000", 2024-05-08T18:32:06.214 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3719999999999999e-06 2024-05-08T18:32:06.214 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.214 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.215 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:06.215 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.135126+0000", 2024-05-08T18:32:06.215 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003798381 2024-05-08T18:32:06.215 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.215 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.215 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:06.215 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.135146+0000", 2024-05-08T18:32:06.215 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.071e-05 2024-05-08T18:32:06.215 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.215 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.215 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:06.215 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.135161+0000", 2024-05-08T18:32:06.215 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4766000000000001e-05 2024-05-08T18:32:06.215 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.215 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.216 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:06.216 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.135291+0000", 2024-05-08T18:32:06.216 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000129901 2024-05-08T18:32:06.216 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.216 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.216 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:06.216 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.135515+0000", 2024-05-08T18:32:06.216 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000224293 2024-05-08T18:32:06.216 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.216 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.216 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 4", 2024-05-08T18:32:06.216 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.135731+0000", 2024-05-08T18:32:06.216 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00021577 2024-05-08T18:32:06.216 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.217 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.217 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:06.217 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.147443+0000", 2024-05-08T18:32:06.217 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011712323 2024-05-08T18:32:06.217 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.217 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.217 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:06.217 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.152045+0000", 2024-05-08T18:32:06.217 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0046019279999999999 2024-05-08T18:32:06.217 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.217 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.217 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:06.217 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.152200+0000", 2024-05-08T18:32:06.217 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015482399999999999 2024-05-08T18:32:06.217 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.218 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.218 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:06.218 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.152333+0000", 2024-05-08T18:32:06.218 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000132836 2024-05-08T18:32:06.218 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:06.218 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:06.218 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:06.218 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.218 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.218 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1876 3.c 3:31c32d98:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_62:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:32:06.218 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:01.196179+0000", 2024-05-08T18:32:06.218 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4.9270302690000003, 2024-05-08T18:32:06.218 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.026072768, 2024-05-08T18:32:06.218 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:06.219 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:06.219 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:06.219 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:06.219 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:06.219 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:06.219 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1876 2024-05-08T18:32:06.219 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.219 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:06.219 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.219 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:06.219 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.196179+0000", 2024-05-08T18:32:06.219 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:06.219 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.219 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.219 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:06.220 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.196179+0000", 2024-05-08T18:32:06.220 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:06.220 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.220 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.220 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:06.220 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.196181+0000", 2024-05-08T18:32:06.220 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.367e-06 2024-05-08T18:32:06.220 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.220 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.220 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:06.220 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.200229+0000", 2024-05-08T18:32:06.220 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0040475240000000003 2024-05-08T18:32:06.220 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.220 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.221 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:06.221 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.200256+0000", 2024-05-08T18:32:06.221 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7404000000000001e-05 2024-05-08T18:32:06.221 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.221 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.221 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:06.221 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.200268+0000", 2024-05-08T18:32:06.221 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1813e-05 2024-05-08T18:32:06.221 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.221 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.221 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:06.221 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.200353+0000", 2024-05-08T18:32:06.221 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4474000000000005e-05 2024-05-08T18:32:06.221 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.222 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.222 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:06.222 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.200542+0000", 2024-05-08T18:32:06.222 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000189717 2024-05-08T18:32:06.222 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.222 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.222 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 3", 2024-05-08T18:32:06.222 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.200712+0000", 2024-05-08T18:32:06.222 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016992099999999999 2024-05-08T18:32:06.222 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.222 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.222 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:06.222 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.208663+0000", 2024-05-08T18:32:06.223 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0079506639999999996 2024-05-08T18:32:06.223 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.223 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.223 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:06.223 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.221964+0000", 2024-05-08T18:32:06.223 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013301362000000001 2024-05-08T18:32:06.223 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.223 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.226 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:06.226 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.222142+0000", 2024-05-08T18:32:06.226 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017776599999999999 2024-05-08T18:32:06.226 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.226 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.226 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:06.226 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.222252+0000", 2024-05-08T18:32:06.226 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000109756 2024-05-08T18:32:06.226 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:06.226 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:06.226 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:06.227 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.227 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.227 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1902 3.28 3:17e1ce0c:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_88:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:32:06.227 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:01.732067+0000", 2024-05-08T18:32:06.227 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4.391142608, 2024-05-08T18:32:06.227 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.034055580000000002, 2024-05-08T18:32:06.227 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:06.227 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:06.227 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:06.227 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:06.227 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:06.227 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:06.227 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1902 2024-05-08T18:32:06.227 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.228 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:06.228 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.228 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:06.228 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.732067+0000", 2024-05-08T18:32:06.228 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:06.228 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.228 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.228 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:06.228 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.732067+0000", 2024-05-08T18:32:06.228 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:06.228 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.228 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.228 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:06.228 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.732070+0000", 2024-05-08T18:32:06.229 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5300000000000001e-06 2024-05-08T18:32:06.229 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.229 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.229 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:06.229 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.736601+0000", 2024-05-08T18:32:06.229 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0045306160000000003 2024-05-08T18:32:06.229 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.229 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.229 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:06.229 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.736640+0000", 2024-05-08T18:32:06.229 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9663000000000003e-05 2024-05-08T18:32:06.229 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.229 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.230 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:06.230 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.736659+0000", 2024-05-08T18:32:06.230 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8652999999999999e-05 2024-05-08T18:32:06.230 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.230 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.230 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:06.230 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.736832+0000", 2024-05-08T18:32:06.230 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017339800000000001 2024-05-08T18:32:06.230 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.230 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.230 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:06.230 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.737091+0000", 2024-05-08T18:32:06.230 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00025841500000000001 2024-05-08T18:32:06.231 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.231 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.231 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 3", 2024-05-08T18:32:06.231 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.737330+0000", 2024-05-08T18:32:06.231 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00023942200000000001 2024-05-08T18:32:06.231 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.231 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.231 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:06.231 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.749415+0000", 2024-05-08T18:32:06.231 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012085024 2024-05-08T18:32:06.231 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.231 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.231 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:06.232 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.766035+0000", 2024-05-08T18:32:06.232 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016619842999999999 2024-05-08T18:32:06.232 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.232 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.232 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:06.232 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.766078+0000", 2024-05-08T18:32:06.232 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.2735999999999999e-05 2024-05-08T18:32:06.232 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.232 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.232 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:06.232 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.766122+0000", 2024-05-08T18:32:06.232 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4280000000000003e-05 2024-05-08T18:32:06.232 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:06.232 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:06.232 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:06.233 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.233 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.233 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1923 3.22 3:469de645:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_109:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:32:06.233 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:02.073868+0000", 2024-05-08T18:32:06.233 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4.0493415050000001, 2024-05-08T18:32:06.233 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019693196999999999, 2024-05-08T18:32:06.233 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:06.233 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:06.233 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:06.233 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:06.233 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:06.233 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:06.233 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1923 2024-05-08T18:32:06.233 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.234 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:06.234 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.234 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:06.234 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.073868+0000", 2024-05-08T18:32:06.234 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:06.234 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.234 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.234 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:06.234 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.073868+0000", 2024-05-08T18:32:06.234 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:06.234 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.234 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.234 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:06.235 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.073900+0000", 2024-05-08T18:32:06.235 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2252999999999998e-05 2024-05-08T18:32:06.235 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.235 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.235 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:06.235 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.078035+0000", 2024-05-08T18:32:06.235 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0041348929999999997 2024-05-08T18:32:06.235 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.235 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.235 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:06.235 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.078075+0000", 2024-05-08T18:32:06.235 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0040000000000003e-05 2024-05-08T18:32:06.235 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.235 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.235 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:06.236 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.078093+0000", 2024-05-08T18:32:06.236 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8626000000000001e-05 2024-05-08T18:32:06.236 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.236 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.236 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:06.236 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.078198+0000", 2024-05-08T18:32:06.236 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000104632 2024-05-08T18:32:06.236 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.236 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.236 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:06.236 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.078364+0000", 2024-05-08T18:32:06.236 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000165551 2024-05-08T18:32:06.236 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.236 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.237 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 3", 2024-05-08T18:32:06.237 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.078526+0000", 2024-05-08T18:32:06.237 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016216900000000001 2024-05-08T18:32:06.237 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.237 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.237 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:06.237 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.085095+0000", 2024-05-08T18:32:06.237 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0065693790000000002 2024-05-08T18:32:06.237 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.237 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.237 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:06.237 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.093441+0000", 2024-05-08T18:32:06.237 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0083460940000000001 2024-05-08T18:32:06.237 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.238 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.238 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:06.238 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.093507+0000", 2024-05-08T18:32:06.238 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5650999999999999e-05 2024-05-08T18:32:06.238 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.238 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.238 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:06.238 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.093561+0000", 2024-05-08T18:32:06.238 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3909000000000002e-05 2024-05-08T18:32:06.238 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:06.238 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:06.238 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:06.238 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.239 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.239 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1927 3.22 3:460f723f:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_113:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:32:06.239 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:02.122319+0000", 2024-05-08T18:32:06.239 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4.0008902559999999, 2024-05-08T18:32:06.239 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.020582304999999999, 2024-05-08T18:32:06.239 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:06.239 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:06.239 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:06.239 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:06.239 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:06.239 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:06.239 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1927 2024-05-08T18:32:06.239 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.239 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:06.240 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.240 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:06.240 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.122319+0000", 2024-05-08T18:32:06.240 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:06.240 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.240 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.240 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:06.240 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.122319+0000", 2024-05-08T18:32:06.240 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:06.240 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.240 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.240 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:06.240 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.122322+0000", 2024-05-08T18:32:06.240 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.9119999999999998e-06 2024-05-08T18:32:06.241 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.241 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.241 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:06.241 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.126667+0000", 2024-05-08T18:32:06.241 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0043456299999999996 2024-05-08T18:32:06.241 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.241 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.241 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:06.241 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.126690+0000", 2024-05-08T18:32:06.241 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2643e-05 2024-05-08T18:32:06.241 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.241 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.241 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:06.241 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.126702+0000", 2024-05-08T18:32:06.242 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2193e-05 2024-05-08T18:32:06.242 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.242 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.242 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:06.242 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.126771+0000", 2024-05-08T18:32:06.242 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8354000000000003e-05 2024-05-08T18:32:06.242 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.242 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.242 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:06.242 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.126893+0000", 2024-05-08T18:32:06.242 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012245100000000001 2024-05-08T18:32:06.242 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.242 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.242 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 3", 2024-05-08T18:32:06.243 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.126993+0000", 2024-05-08T18:32:06.243 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.9637999999999997e-05 2024-05-08T18:32:06.243 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.243 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.243 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:06.243 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.131140+0000", 2024-05-08T18:32:06.243 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0041468090000000004 2024-05-08T18:32:06.243 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.243 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.243 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:06.243 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.142794+0000", 2024-05-08T18:32:06.243 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011654822 2024-05-08T18:32:06.243 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.243 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.244 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:06.244 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.142854+0000", 2024-05-08T18:32:06.244 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9346999999999999e-05 2024-05-08T18:32:06.244 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.244 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.244 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:06.244 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.142901+0000", 2024-05-08T18:32:06.244 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7506000000000002e-05 2024-05-08T18:32:06.244 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:06.244 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:06.244 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:06.244 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:06.244 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:06.244 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:32:06.246 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-08T18:32:06.247 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:32:06.245+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:32:06.347 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:32:06.345+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:32:06.415 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:32:06.415 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:32:06.415 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 0 2024-05-08T18:32:06.415 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:32:06.429 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-08T18:32:06.447 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:32:06.445+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:32:06.548 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:32:06.549+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:32:06.562 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:32:06.562 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:32:06.562 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2024-05-08T18:32:06.562 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2024-05-08T18:32:06.562 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:32:06.577 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-08T18:32:06.617 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-08T18:32:06.665 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:32:06.665+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:32:06.705 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:32:06.705 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2024-05-08T18:32:06.705 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2024-05-08T18:32:06.705 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-05-08T18:32:06.705 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.706 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1315 3.2c 3:368ed9cc:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-08T18:32:06.706 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.301720+0000", 2024-05-08T18:32:06.706 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 24.400998679000001, 2024-05-08T18:32:06.706 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.028850259, 2024-05-08T18:32:06.706 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:06.706 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:06.706 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:06.706 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:06.706 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:06.706 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:06.707 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1315 2024-05-08T18:32:06.707 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.707 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:06.707 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.707 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:06.707 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.301720+0000", 2024-05-08T18:32:06.707 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:06.707 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.707 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.707 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:06.707 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.301720+0000", 2024-05-08T18:32:06.707 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:06.708 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.708 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.708 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:06.708 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.301723+0000", 2024-05-08T18:32:06.708 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2369999999999999e-06 2024-05-08T18:32:06.708 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.708 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.708 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:06.708 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.309609+0000", 2024-05-08T18:32:06.708 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0078867369999999996 2024-05-08T18:32:06.708 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.708 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.708 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:06.708 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.309647+0000", 2024-05-08T18:32:06.709 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7849999999999998e-05 2024-05-08T18:32:06.709 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.709 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.709 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:06.709 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.309665+0000", 2024-05-08T18:32:06.709 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8346e-05 2024-05-08T18:32:06.709 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.709 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.709 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:06.709 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.309846+0000", 2024-05-08T18:32:06.709 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000180056 2024-05-08T18:32:06.709 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.709 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.709 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:06.709 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.310231+0000", 2024-05-08T18:32:06.710 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00038542999999999997 2024-05-08T18:32:06.710 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.710 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.710 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 4", 2024-05-08T18:32:06.710 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.310628+0000", 2024-05-08T18:32:06.710 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00039685099999999999 2024-05-08T18:32:06.710 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.710 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.710 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:06.710 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.329116+0000", 2024-05-08T18:32:06.711 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018488279999999999 2024-05-08T18:32:06.711 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.711 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.711 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:06.711 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.330334+0000", 2024-05-08T18:32:06.711 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001217734 2024-05-08T18:32:06.711 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.711 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.711 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:06.711 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.330450+0000", 2024-05-08T18:32:06.711 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000116439 2024-05-08T18:32:06.711 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.711 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.712 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:06.712 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.330571+0000", 2024-05-08T18:32:06.712 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012029899999999999 2024-05-08T18:32:06.712 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:06.712 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:06.712 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:06.712 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.712 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.712 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1319 3.35 3:add64cdc:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-08T18:32:06.712 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.358042+0000", 2024-05-08T18:32:06.712 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 24.344676762999999, 2024-05-08T18:32:06.712 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.023806130000000002, 2024-05-08T18:32:06.712 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:06.712 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:06.712 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:06.713 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:06.713 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:06.713 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:06.713 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1319 2024-05-08T18:32:06.713 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.713 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:06.713 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.713 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:06.713 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.358042+0000", 2024-05-08T18:32:06.713 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:06.713 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.713 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.713 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:06.713 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.358042+0000", 2024-05-08T18:32:06.714 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:06.714 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.714 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.714 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:06.714 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.358045+0000", 2024-05-08T18:32:06.714 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.813e-06 2024-05-08T18:32:06.714 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.714 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.714 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:06.714 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.362893+0000", 2024-05-08T18:32:06.714 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0048481569999999996 2024-05-08T18:32:06.715 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.715 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.715 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:06.715 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.362932+0000", 2024-05-08T18:32:06.715 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8788999999999997e-05 2024-05-08T18:32:06.715 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.715 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.715 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:06.715 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.362949+0000", 2024-05-08T18:32:06.715 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7289999999999999e-05 2024-05-08T18:32:06.715 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.715 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.715 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:06.715 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.363084+0000", 2024-05-08T18:32:06.716 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000134552 2024-05-08T18:32:06.716 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.716 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.716 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:06.716 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.363324+0000", 2024-05-08T18:32:06.716 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000239702 2024-05-08T18:32:06.716 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.716 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.716 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 5", 2024-05-08T18:32:06.716 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.363553+0000", 2024-05-08T18:32:06.716 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000229519 2024-05-08T18:32:06.716 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.716 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.716 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:06.716 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.373958+0000", 2024-05-08T18:32:06.717 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010404821 2024-05-08T18:32:06.717 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.717 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.717 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:06.717 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.381549+0000", 2024-05-08T18:32:06.717 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0075911930000000004 2024-05-08T18:32:06.717 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.717 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.717 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:06.717 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.381715+0000", 2024-05-08T18:32:06.718 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016614900000000001 2024-05-08T18:32:06.718 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.718 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.718 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:06.718 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.381848+0000", 2024-05-08T18:32:06.718 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013314499999999999 2024-05-08T18:32:06.718 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:06.718 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:06.718 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:06.718 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.718 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.718 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1337 3.36 3:6e6c3d09:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:32:06.718 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.570209+0000", 2024-05-08T18:32:06.718 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 24.132510461999999, 2024-05-08T18:32:06.719 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.031066623000000002, 2024-05-08T18:32:06.719 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:06.719 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:06.719 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:06.719 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:06.719 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:06.719 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:06.719 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1337 2024-05-08T18:32:06.719 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.719 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:06.719 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.719 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:06.719 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.570209+0000", 2024-05-08T18:32:06.719 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:06.720 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.720 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.720 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:06.720 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.570209+0000", 2024-05-08T18:32:06.720 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:06.720 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.720 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.720 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:06.720 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.570212+0000", 2024-05-08T18:32:06.720 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0800000000000002e-06 2024-05-08T18:32:06.720 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.720 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.720 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:06.720 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.575559+0000", 2024-05-08T18:32:06.721 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0053471300000000003 2024-05-08T18:32:06.721 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.721 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.721 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:06.721 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.575591+0000", 2024-05-08T18:32:06.721 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2143e-05 2024-05-08T18:32:06.721 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.721 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.721 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:06.721 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.575609+0000", 2024-05-08T18:32:06.721 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8139999999999999e-05 2024-05-08T18:32:06.721 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.721 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.721 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:06.722 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.575744+0000", 2024-05-08T18:32:06.722 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013482199999999999 2024-05-08T18:32:06.722 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.722 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.722 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op must wait for map", 2024-05-08T18:32:06.722 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.575763+0000", 2024-05-08T18:32:06.722 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.963e-05 2024-05-08T18:32:06.722 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.722 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.722 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:06.722 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.583603+0000", 2024-05-08T18:32:06.722 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0078395970000000002 2024-05-08T18:32:06.722 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.722 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.723 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:06.723 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.583943+0000", 2024-05-08T18:32:06.723 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00034006800000000001 2024-05-08T18:32:06.723 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.723 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.723 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 5", 2024-05-08T18:32:06.723 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.584214+0000", 2024-05-08T18:32:06.723 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00027059399999999998 2024-05-08T18:32:06.723 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.723 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.723 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:06.723 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.600111+0000", 2024-05-08T18:32:06.723 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015897521000000001 2024-05-08T18:32:06.723 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.724 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.724 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:06.724 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.600967+0000", 2024-05-08T18:32:06.724 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00085548000000000004 2024-05-08T18:32:06.724 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.724 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.724 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:06.724 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.601137+0000", 2024-05-08T18:32:06.724 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017063500000000001 2024-05-08T18:32:06.724 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.724 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.724 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:06.724 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.601275+0000", 2024-05-08T18:32:06.724 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013778299999999999 2024-05-08T18:32:06.725 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:06.725 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:06.725 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:06.725 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.725 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.725 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1360 3.20 3:0629b24f:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_46:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:32:06.725 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.812182+0000", 2024-05-08T18:32:06.725 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 23.890537261999999, 2024-05-08T18:32:06.725 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.020673025000000001, 2024-05-08T18:32:06.725 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:06.725 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:06.725 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:06.725 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:06.725 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:06.726 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:06.726 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1360 2024-05-08T18:32:06.726 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.726 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:06.726 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.726 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:06.726 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.812182+0000", 2024-05-08T18:32:06.726 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:06.726 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.726 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.726 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:06.726 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.812182+0000", 2024-05-08T18:32:06.726 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:06.727 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.727 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.727 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:06.727 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.812186+0000", 2024-05-08T18:32:06.727 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.267e-06 2024-05-08T18:32:06.727 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.727 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.727 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:06.727 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.816498+0000", 2024-05-08T18:32:06.727 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0043117110000000002 2024-05-08T18:32:06.727 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.727 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.728 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:06.728 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.816537+0000", 2024-05-08T18:32:06.728 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9082999999999998e-05 2024-05-08T18:32:06.728 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.728 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.728 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:06.728 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.816554+0000", 2024-05-08T18:32:06.728 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7549000000000001e-05 2024-05-08T18:32:06.728 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.728 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.728 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:06.728 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.816696+0000", 2024-05-08T18:32:06.728 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014152300000000001 2024-05-08T18:32:06.729 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.729 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.729 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:06.729 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.816956+0000", 2024-05-08T18:32:06.729 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00026039800000000001 2024-05-08T18:32:06.729 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.729 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.729 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:32:06.729 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.817186+0000", 2024-05-08T18:32:06.729 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00023018800000000001 2024-05-08T18:32:06.729 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.729 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.729 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:06.729 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.826298+0000", 2024-05-08T18:32:06.729 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0091116549999999998 2024-05-08T18:32:06.730 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.730 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.730 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:06.730 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.832553+0000", 2024-05-08T18:32:06.730 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0062545029999999998 2024-05-08T18:32:06.730 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.730 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.730 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:06.730 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.832725+0000", 2024-05-08T18:32:06.730 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000172065 2024-05-08T18:32:06.730 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.731 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.731 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:06.731 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.832855+0000", 2024-05-08T18:32:06.731 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013008299999999999 2024-05-08T18:32:06.731 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:06.731 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:06.731 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:06.731 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.731 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.731 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1361 3.26 3:65dd6def:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_47:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:32:06.731 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.822918+0000", 2024-05-08T18:32:06.731 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 23.879801096000001, 2024-05-08T18:32:06.731 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.023073703000000001, 2024-05-08T18:32:06.731 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:06.731 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:06.732 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:06.732 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:06.732 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:06.732 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:06.732 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1361 2024-05-08T18:32:06.732 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.732 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:06.733 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.733 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:06.733 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.822918+0000", 2024-05-08T18:32:06.733 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:06.733 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.733 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.733 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:06.733 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.822918+0000", 2024-05-08T18:32:06.733 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:06.733 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.733 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.733 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:06.733 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.822921+0000", 2024-05-08T18:32:06.734 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.9270000000000001e-06 2024-05-08T18:32:06.734 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.734 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.734 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:06.734 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.827328+0000", 2024-05-08T18:32:06.734 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0044071199999999996 2024-05-08T18:32:06.734 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.734 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.734 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:06.734 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.827364+0000", 2024-05-08T18:32:06.734 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5963000000000001e-05 2024-05-08T18:32:06.734 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.734 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.735 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:06.735 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.827382+0000", 2024-05-08T18:32:06.735 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8533e-05 2024-05-08T18:32:06.735 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.735 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.735 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:06.735 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.827547+0000", 2024-05-08T18:32:06.735 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016492899999999999 2024-05-08T18:32:06.735 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.735 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.735 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:06.735 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.827949+0000", 2024-05-08T18:32:06.735 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00040151 2024-05-08T18:32:06.735 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.736 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.736 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 7", 2024-05-08T18:32:06.736 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.828334+0000", 2024-05-08T18:32:06.736 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00038469399999999999 2024-05-08T18:32:06.736 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.736 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.736 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:06.736 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.845540+0000", 2024-05-08T18:32:06.736 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017206117 2024-05-08T18:32:06.736 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.737 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.737 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:06.737 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.845825+0000", 2024-05-08T18:32:06.737 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000285555 2024-05-08T18:32:06.737 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.737 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.737 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:06.737 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.845917+0000", 2024-05-08T18:32:06.737 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1498999999999999e-05 2024-05-08T18:32:06.737 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.737 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.737 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:06.737 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.845992+0000", 2024-05-08T18:32:06.737 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4856000000000003e-05 2024-05-08T18:32:06.738 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:06.738 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:06.738 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:06.738 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.738 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.738 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1365 3.35 3:adc1c29f:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_51:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:32:06.738 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.864570+0000", 2024-05-08T18:32:06.738 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 23.838148563000001, 2024-05-08T18:32:06.738 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.021718316000000001, 2024-05-08T18:32:06.738 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:06.738 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:06.738 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:06.738 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:06.739 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:06.739 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:06.739 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1365 2024-05-08T18:32:06.739 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.739 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:06.739 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.739 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:06.739 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.864570+0000", 2024-05-08T18:32:06.739 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:06.739 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.739 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.739 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:06.739 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.864570+0000", 2024-05-08T18:32:06.739 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:06.740 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.740 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.740 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:06.740 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.864574+0000", 2024-05-08T18:32:06.740 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.433e-06 2024-05-08T18:32:06.740 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.740 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.740 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:06.740 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.869145+0000", 2024-05-08T18:32:06.740 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0045706790000000002 2024-05-08T18:32:06.740 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.740 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.740 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:06.740 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.869181+0000", 2024-05-08T18:32:06.741 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.68e-05 2024-05-08T18:32:06.741 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.741 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.741 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:06.741 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.869200+0000", 2024-05-08T18:32:06.741 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8453000000000001e-05 2024-05-08T18:32:06.741 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.741 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.741 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:06.741 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.869328+0000", 2024-05-08T18:32:06.741 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000128102 2024-05-08T18:32:06.741 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.741 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.741 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:06.742 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.869601+0000", 2024-05-08T18:32:06.742 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00027359200000000002 2024-05-08T18:32:06.742 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.742 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.742 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 5", 2024-05-08T18:32:06.742 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.869847+0000", 2024-05-08T18:32:06.742 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00024531800000000001 2024-05-08T18:32:06.742 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.742 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.742 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:06.742 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.885442+0000", 2024-05-08T18:32:06.742 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015595079 2024-05-08T18:32:06.742 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.742 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.743 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:06.743 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.886110+0000", 2024-05-08T18:32:06.743 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00066779100000000004 2024-05-08T18:32:06.743 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.743 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.743 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:06.743 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.886209+0000", 2024-05-08T18:32:06.743 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8967000000000003e-05 2024-05-08T18:32:06.743 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.743 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.743 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:06.743 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.886289+0000", 2024-05-08T18:32:06.743 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.0102e-05 2024-05-08T18:32:06.744 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:06.744 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:06.744 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:06.744 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.744 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.744 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1381 3.20 3:07260bee:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_67:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:32:06.744 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:43.057073+0000", 2024-05-08T18:32:06.744 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 23.6456461, 2024-05-08T18:32:06.744 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.020966242999999999, 2024-05-08T18:32:06.744 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:06.744 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:06.744 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:06.744 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:06.744 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:06.745 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:06.745 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1381 2024-05-08T18:32:06.745 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.745 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:06.745 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.745 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:06.745 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.057073+0000", 2024-05-08T18:32:06.745 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:06.745 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.745 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.745 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:06.745 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.057073+0000", 2024-05-08T18:32:06.745 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:06.745 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.745 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.746 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:06.746 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.057076+0000", 2024-05-08T18:32:06.746 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4230000000000001e-06 2024-05-08T18:32:06.746 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.746 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.746 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:06.746 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.063772+0000", 2024-05-08T18:32:06.746 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0066957960000000004 2024-05-08T18:32:06.746 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.746 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.746 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:06.746 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.063817+0000", 2024-05-08T18:32:06.746 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4883999999999999e-05 2024-05-08T18:32:06.747 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.747 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.747 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:06.747 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.063838+0000", 2024-05-08T18:32:06.747 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0622999999999999e-05 2024-05-08T18:32:06.747 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.747 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.747 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:06.747 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.063943+0000", 2024-05-08T18:32:06.747 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010529100000000001 2024-05-08T18:32:06.747 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.747 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.747 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:06.747 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.064116+0000", 2024-05-08T18:32:06.748 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017287699999999999 2024-05-08T18:32:06.748 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.748 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.748 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:32:06.748 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.064267+0000", 2024-05-08T18:32:06.748 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015107799999999999 2024-05-08T18:32:06.748 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.748 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.748 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:06.748 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.074658+0000", 2024-05-08T18:32:06.748 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010391473 2024-05-08T18:32:06.748 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.748 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.749 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:06.749 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.077919+0000", 2024-05-08T18:32:06.749 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032607080000000002 2024-05-08T18:32:06.749 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.749 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.749 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:06.749 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.077986+0000", 2024-05-08T18:32:06.749 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7151999999999997e-05 2024-05-08T18:32:06.749 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.749 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.749 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:06.749 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.078039+0000", 2024-05-08T18:32:06.749 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2938e-05 2024-05-08T18:32:06.749 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:06.750 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:06.750 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:06.750 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.750 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.750 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1406 3.35 3:acb4ebf3:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_92:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:32:06.750 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:43.333886+0000", 2024-05-08T18:32:06.750 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 23.368832507, 2024-05-08T18:32:06.750 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018425136000000002, 2024-05-08T18:32:06.750 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:06.750 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:06.750 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:06.750 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:06.750 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:06.751 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:06.751 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1406 2024-05-08T18:32:06.751 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.751 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:06.751 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.751 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:06.751 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.333886+0000", 2024-05-08T18:32:06.751 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:06.751 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.751 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.751 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:06.751 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.333886+0000", 2024-05-08T18:32:06.751 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:06.752 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.752 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.752 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:06.752 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.333889+0000", 2024-05-08T18:32:06.752 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6879999999999999e-06 2024-05-08T18:32:06.752 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.752 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.752 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:06.752 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.337554+0000", 2024-05-08T18:32:06.752 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0036647609999999999 2024-05-08T18:32:06.752 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.752 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.752 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:06.753 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.337574+0000", 2024-05-08T18:32:06.753 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9830000000000002e-05 2024-05-08T18:32:06.753 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.753 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.753 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:06.753 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.337583+0000", 2024-05-08T18:32:06.753 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.0599999999999997e-06 2024-05-08T18:32:06.753 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.753 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.753 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:06.753 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.337661+0000", 2024-05-08T18:32:06.753 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.7931999999999999e-05 2024-05-08T18:32:06.753 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.753 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.754 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:06.754 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.337818+0000", 2024-05-08T18:32:06.754 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015687000000000001 2024-05-08T18:32:06.754 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.754 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.754 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 5", 2024-05-08T18:32:06.754 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.337942+0000", 2024-05-08T18:32:06.754 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000124206 2024-05-08T18:32:06.754 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.754 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.754 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:06.754 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.350659+0000", 2024-05-08T18:32:06.754 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012717282 2024-05-08T18:32:06.754 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.755 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.755 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:06.755 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.352231+0000", 2024-05-08T18:32:06.755 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001571512 2024-05-08T18:32:06.755 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.755 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.755 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:06.755 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.352274+0000", 2024-05-08T18:32:06.755 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3371999999999997e-05 2024-05-08T18:32:06.755 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.755 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.755 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:06.755 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.352312+0000", 2024-05-08T18:32:06.755 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7623000000000002e-05 2024-05-08T18:32:06.756 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:06.756 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:06.756 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:06.756 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.756 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.756 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1412 3.36 3:6db491e0:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_98:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:32:06.756 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:43.394092+0000", 2024-05-08T18:32:06.756 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 23.308627229999999, 2024-05-08T18:32:06.756 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.021120863, 2024-05-08T18:32:06.756 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:06.756 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:06.756 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:06.756 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:06.756 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:06.757 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:06.757 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1412 2024-05-08T18:32:06.757 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.757 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:06.757 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.757 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:06.757 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.394092+0000", 2024-05-08T18:32:06.757 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:06.757 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.757 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.757 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:06.757 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.394092+0000", 2024-05-08T18:32:06.757 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:06.757 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.758 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.758 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:06.758 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.394094+0000", 2024-05-08T18:32:06.758 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.305e-06 2024-05-08T18:32:06.758 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.758 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.758 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:06.758 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.397860+0000", 2024-05-08T18:32:06.758 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0037662239999999999 2024-05-08T18:32:06.758 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.758 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.758 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:06.758 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.397890+0000", 2024-05-08T18:32:06.758 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.9274000000000001e-05 2024-05-08T18:32:06.759 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.759 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.759 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:06.759 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.397905+0000", 2024-05-08T18:32:06.759 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5398999999999999e-05 2024-05-08T18:32:06.759 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.759 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.759 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:06.759 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.398094+0000", 2024-05-08T18:32:06.759 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00018897799999999999 2024-05-08T18:32:06.759 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.759 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.759 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:06.759 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.398337+0000", 2024-05-08T18:32:06.760 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00024258799999999999 2024-05-08T18:32:06.760 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.760 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.760 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 5", 2024-05-08T18:32:06.760 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.398593+0000", 2024-05-08T18:32:06.760 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00025631500000000002 2024-05-08T18:32:06.760 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.760 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.760 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:06.760 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.413998+0000", 2024-05-08T18:32:06.760 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015405663999999999 2024-05-08T18:32:06.760 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.760 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.760 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:06.760 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.415077+0000", 2024-05-08T18:32:06.761 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001078063 2024-05-08T18:32:06.761 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.761 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.761 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:06.761 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.415149+0000", 2024-05-08T18:32:06.761 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.2878000000000003e-05 2024-05-08T18:32:06.761 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.761 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.761 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:06.761 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.415213+0000", 2024-05-08T18:32:06.761 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3175000000000004e-05 2024-05-08T18:32:06.761 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:06.761 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:06.762 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:06.762 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.762 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.762 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1615 3.35 3:ae758c88:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-05-08T18:32:06.762 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:46.719155+0000", 2024-05-08T18:32:06.762 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 19.983564472000001, 2024-05-08T18:32:06.762 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.038329020999999998, 2024-05-08T18:32:06.762 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:06.762 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:06.762 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:06.762 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:06.762 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:06.762 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:06.763 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1615 2024-05-08T18:32:06.763 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.763 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:06.763 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.763 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:06.763 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.719155+0000", 2024-05-08T18:32:06.763 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:06.763 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.763 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.763 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:06.763 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.719155+0000", 2024-05-08T18:32:06.763 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:06.763 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.763 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.764 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:06.764 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.719159+0000", 2024-05-08T18:32:06.764 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4259999999999996e-06 2024-05-08T18:32:06.764 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.764 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.764 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:06.764 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.728715+0000", 2024-05-08T18:32:06.764 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0095562549999999996 2024-05-08T18:32:06.764 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.764 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.764 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:06.764 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.728764+0000", 2024-05-08T18:32:06.764 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9262999999999999e-05 2024-05-08T18:32:06.764 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.765 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.765 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:06.765 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.728785+0000", 2024-05-08T18:32:06.765 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0339999999999998e-05 2024-05-08T18:32:06.765 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.765 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.765 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:06.765 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.728951+0000", 2024-05-08T18:32:06.765 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000166105 2024-05-08T18:32:06.765 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.765 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.765 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:06.765 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.729206+0000", 2024-05-08T18:32:06.765 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00025512499999999998 2024-05-08T18:32:06.766 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.766 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.766 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 5", 2024-05-08T18:32:06.766 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.729436+0000", 2024-05-08T18:32:06.766 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022991099999999999 2024-05-08T18:32:06.766 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.766 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.766 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:06.766 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.754118+0000", 2024-05-08T18:32:06.766 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.024682511000000001 2024-05-08T18:32:06.766 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.766 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.766 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:06.767 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.757310+0000", 2024-05-08T18:32:06.767 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0031911890000000001 2024-05-08T18:32:06.767 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.767 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.767 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:06.767 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.757408+0000", 2024-05-08T18:32:06.767 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8826000000000006e-05 2024-05-08T18:32:06.767 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.767 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.767 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:06.767 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.757484+0000", 2024-05-08T18:32:06.767 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5069999999999998e-05 2024-05-08T18:32:06.767 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:06.767 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:06.768 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:06.768 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.768 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.768 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1623 3.20 3:0496c987:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-05-08T18:32:06.768 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:46.802136+0000", 2024-05-08T18:32:06.768 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 19.900583147999999, 2024-05-08T18:32:06.768 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.026548796999999999, 2024-05-08T18:32:06.768 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:06.768 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:06.768 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:06.768 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:06.768 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:06.768 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:06.768 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1623 2024-05-08T18:32:06.769 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.769 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:06.769 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.769 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:06.769 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.802136+0000", 2024-05-08T18:32:06.769 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:06.769 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.769 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.769 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:06.769 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.802136+0000", 2024-05-08T18:32:06.769 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:06.769 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.769 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.769 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:06.769 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.802140+0000", 2024-05-08T18:32:06.770 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8469999999999998e-06 2024-05-08T18:32:06.770 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.770 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.770 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:06.770 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.806310+0000", 2024-05-08T18:32:06.770 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0041703449999999998 2024-05-08T18:32:06.770 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.770 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.770 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:06.770 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.806362+0000", 2024-05-08T18:32:06.770 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2113000000000001e-05 2024-05-08T18:32:06.770 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.770 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.771 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:06.771 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.806409+0000", 2024-05-08T18:32:06.771 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6505999999999998e-05 2024-05-08T18:32:06.771 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.771 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.771 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:06.771 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.806614+0000", 2024-05-08T18:32:06.771 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000205572 2024-05-08T18:32:06.771 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.771 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.771 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:06.771 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.807056+0000", 2024-05-08T18:32:06.771 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00044176300000000002 2024-05-08T18:32:06.771 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.772 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.772 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:32:06.772 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.807458+0000", 2024-05-08T18:32:06.772 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00040168000000000002 2024-05-08T18:32:06.772 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.772 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.772 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:06.772 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.819075+0000", 2024-05-08T18:32:06.772 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011616903 2024-05-08T18:32:06.772 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.772 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.772 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:06.772 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.828505+0000", 2024-05-08T18:32:06.772 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0094299759999999996 2024-05-08T18:32:06.773 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.773 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.773 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:06.773 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.828605+0000", 2024-05-08T18:32:06.773 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000100152 2024-05-08T18:32:06.773 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.773 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.773 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:06.773 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.828685+0000", 2024-05-08T18:32:06.773 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9939999999999997e-05 2024-05-08T18:32:06.773 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:06.773 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:06.773 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:06.773 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.773 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.774 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1626 3.20 3:04d2d7da:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-05-08T18:32:06.774 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:46.841165+0000", 2024-05-08T18:32:06.774 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 19.861554382000001, 2024-05-08T18:32:06.774 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.028115448000000001, 2024-05-08T18:32:06.774 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:06.774 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:06.774 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:06.774 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:06.774 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:06.774 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:06.774 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1626 2024-05-08T18:32:06.774 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.774 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:06.775 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.775 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:06.775 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.841165+0000", 2024-05-08T18:32:06.775 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:06.775 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.775 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.775 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:06.775 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.841165+0000", 2024-05-08T18:32:06.775 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:06.775 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.775 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.775 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:06.775 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.841167+0000", 2024-05-08T18:32:06.775 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5900000000000002e-06 2024-05-08T18:32:06.776 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.776 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.776 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:06.776 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.845166+0000", 2024-05-08T18:32:06.776 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039988760000000002 2024-05-08T18:32:06.776 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.776 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.776 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:06.776 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.845199+0000", 2024-05-08T18:32:06.776 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2950000000000001e-05 2024-05-08T18:32:06.776 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.776 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.776 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:06.776 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.845223+0000", 2024-05-08T18:32:06.777 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.4074e-05 2024-05-08T18:32:06.777 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.777 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.777 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:06.777 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.845360+0000", 2024-05-08T18:32:06.777 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013671899999999999 2024-05-08T18:32:06.777 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.777 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.777 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:06.777 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.845619+0000", 2024-05-08T18:32:06.777 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00025912800000000002 2024-05-08T18:32:06.777 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.777 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.777 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:32:06.778 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.845856+0000", 2024-05-08T18:32:06.778 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00023749099999999999 2024-05-08T18:32:06.778 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.778 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.778 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:06.778 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.856156+0000", 2024-05-08T18:32:06.778 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010299536 2024-05-08T18:32:06.778 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.778 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.778 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:06.778 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.868964+0000", 2024-05-08T18:32:06.778 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012808083 2024-05-08T18:32:06.778 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.779 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.779 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:06.779 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.869142+0000", 2024-05-08T18:32:06.779 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017771599999999999 2024-05-08T18:32:06.779 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.779 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.779 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:06.779 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.869280+0000", 2024-05-08T18:32:06.779 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013828500000000001 2024-05-08T18:32:06.779 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:06.779 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:06.779 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:06.779 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.779 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.780 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1824 3.2c 3:36a4dac4:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-05-08T18:32:06.780 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:00.541071+0000", 2024-05-08T18:32:06.780 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 6.161647758, 2024-05-08T18:32:06.780 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.021251051999999999, 2024-05-08T18:32:06.780 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:06.780 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:06.780 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:06.780 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:06.780 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:06.780 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:06.780 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1824 2024-05-08T18:32:06.780 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.780 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:06.780 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.781 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:06.781 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.541071+0000", 2024-05-08T18:32:06.781 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:06.781 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.781 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.781 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:06.781 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.541071+0000", 2024-05-08T18:32:06.781 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:06.781 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.781 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.781 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:06.781 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.541076+0000", 2024-05-08T18:32:06.781 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8760000000000004e-06 2024-05-08T18:32:06.781 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.782 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.782 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:06.782 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.546258+0000", 2024-05-08T18:32:06.782 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0051822439999999999 2024-05-08T18:32:06.782 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.782 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.782 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:06.782 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.546297+0000", 2024-05-08T18:32:06.782 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8460000000000001e-05 2024-05-08T18:32:06.782 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.782 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.782 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:06.782 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.546316+0000", 2024-05-08T18:32:06.782 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8853000000000001e-05 2024-05-08T18:32:06.783 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.783 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.783 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:06.783 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.546424+0000", 2024-05-08T18:32:06.783 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000108597 2024-05-08T18:32:06.783 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.783 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.783 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:06.783 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.546605+0000", 2024-05-08T18:32:06.783 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00018060099999999999 2024-05-08T18:32:06.783 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.783 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.783 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 4", 2024-05-08T18:32:06.783 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.546781+0000", 2024-05-08T18:32:06.784 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017653300000000001 2024-05-08T18:32:06.784 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.784 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.784 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:06.784 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.556391+0000", 2024-05-08T18:32:06.784 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0096097460000000006 2024-05-08T18:32:06.784 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.784 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.784 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:06.784 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.562196+0000", 2024-05-08T18:32:06.784 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0058047840000000003 2024-05-08T18:32:06.784 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.784 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.784 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:06.785 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.562267+0000", 2024-05-08T18:32:06.785 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1179000000000004e-05 2024-05-08T18:32:06.785 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.785 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.785 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:06.785 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.562322+0000", 2024-05-08T18:32:06.785 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5179000000000001e-05 2024-05-08T18:32:06.785 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:06.785 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:06.785 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:06.785 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.785 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.785 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1827 3.a 3:523d931b:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-05-08T18:32:06.785 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:00.589747+0000", 2024-05-08T18:32:06.786 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 6.1129716160000003, 2024-05-08T18:32:06.786 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019404434000000002, 2024-05-08T18:32:06.786 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:06.786 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:06.786 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:06.786 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:06.786 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:06.786 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:06.786 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1827 2024-05-08T18:32:06.786 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.786 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:06.786 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.786 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:06.786 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.589747+0000", 2024-05-08T18:32:06.787 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:06.787 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.787 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.787 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:06.787 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.589747+0000", 2024-05-08T18:32:06.787 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:06.787 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.787 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.787 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:06.787 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.589750+0000", 2024-05-08T18:32:06.787 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.627e-06 2024-05-08T18:32:06.787 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.787 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.787 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:06.788 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.593876+0000", 2024-05-08T18:32:06.788 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0041264020000000004 2024-05-08T18:32:06.788 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.788 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.788 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:06.788 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.593913+0000", 2024-05-08T18:32:06.788 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6489000000000002e-05 2024-05-08T18:32:06.788 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.788 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.788 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:06.788 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.593934+0000", 2024-05-08T18:32:06.788 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0647000000000001e-05 2024-05-08T18:32:06.788 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.789 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.789 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:06.789 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.594098+0000", 2024-05-08T18:32:06.789 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016424500000000001 2024-05-08T18:32:06.789 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.789 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.789 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:06.789 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.594519+0000", 2024-05-08T18:32:06.789 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00042162699999999999 2024-05-08T18:32:06.789 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.789 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.789 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 4", 2024-05-08T18:32:06.789 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.594920+0000", 2024-05-08T18:32:06.789 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00040058699999999999 2024-05-08T18:32:06.790 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.790 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.790 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:06.790 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.605419+0000", 2024-05-08T18:32:06.790 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010499338 2024-05-08T18:32:06.790 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.790 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.790 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:06.790 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.608968+0000", 2024-05-08T18:32:06.790 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0035482000000000001 2024-05-08T18:32:06.790 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.790 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.790 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:06.790 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.609072+0000", 2024-05-08T18:32:06.791 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010433300000000001 2024-05-08T18:32:06.791 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.791 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.791 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:06.791 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.609152+0000", 2024-05-08T18:32:06.791 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9938999999999995e-05 2024-05-08T18:32:06.791 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:06.791 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:06.791 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:06.791 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.791 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.791 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1865 3.3f e93/21 3:ffe43b13:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_51:head v 93'5, mlcod=82'3)", 2024-05-08T18:32:06.791 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:01.052358+0000", 2024-05-08T18:32:06.791 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 5.6503614330000005, 2024-05-08T18:32:06.792 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.026338456999999999, 2024-05-08T18:32:06.792 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:06.792 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:06.792 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:06.792 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:06.792 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.792 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:06.792 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.052358+0000", 2024-05-08T18:32:06.792 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:06.792 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.792 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.792 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:06.792 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.052358+0000", 2024-05-08T18:32:06.792 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:06.793 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.793 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.793 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:06.793 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.052360+0000", 2024-05-08T18:32:06.793 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.604e-06 2024-05-08T18:32:06.793 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.793 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.793 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:06.793 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.058761+0000", 2024-05-08T18:32:06.793 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0064009770000000004 2024-05-08T18:32:06.793 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.793 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.793 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:06.794 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.058816+0000", 2024-05-08T18:32:06.794 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4413999999999998e-05 2024-05-08T18:32:06.794 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.794 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.794 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:06.794 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.058842+0000", 2024-05-08T18:32:06.794 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6063000000000001e-05 2024-05-08T18:32:06.794 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.794 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.794 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:06.794 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.059001+0000", 2024-05-08T18:32:06.794 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000159452 2024-05-08T18:32:06.794 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.794 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.795 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:06.795 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.059067+0000", 2024-05-08T18:32:06.795 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6079000000000002e-05 2024-05-08T18:32:06.795 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.795 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.795 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:06.795 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.078590+0000", 2024-05-08T18:32:06.795 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019522445999999999 2024-05-08T18:32:06.795 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.795 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.795 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:06.795 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.078696+0000", 2024-05-08T18:32:06.795 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010642200000000001 2024-05-08T18:32:06.795 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:06.796 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:06.796 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:06.796 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.796 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.796 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1869 3.35 3:ac4c2d5c:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_55:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:32:06.796 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:01.092235+0000", 2024-05-08T18:32:06.796 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 5.6104836999999996, 2024-05-08T18:32:06.796 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.028692921, 2024-05-08T18:32:06.796 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:06.796 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:06.796 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:06.796 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:06.796 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:06.797 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:06.797 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1869 2024-05-08T18:32:06.797 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.797 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:06.797 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.797 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:06.797 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.092235+0000", 2024-05-08T18:32:06.797 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:06.797 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.797 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.797 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:06.797 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.092235+0000", 2024-05-08T18:32:06.797 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:06.797 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.798 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.798 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:06.798 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.092239+0000", 2024-05-08T18:32:06.798 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.143e-06 2024-05-08T18:32:06.798 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.798 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.798 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:06.798 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.099610+0000", 2024-05-08T18:32:06.798 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0073708410000000004 2024-05-08T18:32:06.798 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.798 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.798 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:06.798 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.099636+0000", 2024-05-08T18:32:06.798 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5354000000000002e-05 2024-05-08T18:32:06.799 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.799 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.799 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:06.799 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.099650+0000", 2024-05-08T18:32:06.799 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3926e-05 2024-05-08T18:32:06.799 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.799 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.799 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:06.799 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.099935+0000", 2024-05-08T18:32:06.799 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00028528100000000002 2024-05-08T18:32:06.799 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.799 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.799 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:06.799 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.100371+0000", 2024-05-08T18:32:06.800 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00043653399999999998 2024-05-08T18:32:06.800 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.800 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.800 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 5", 2024-05-08T18:32:06.800 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.100635+0000", 2024-05-08T18:32:06.800 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00026408300000000003 2024-05-08T18:32:06.800 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.800 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.800 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:06.800 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.120504+0000", 2024-05-08T18:32:06.800 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019868061999999999 2024-05-08T18:32:06.800 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.800 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.800 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:06.801 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.120565+0000", 2024-05-08T18:32:06.801 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1951000000000004e-05 2024-05-08T18:32:06.801 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.801 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.801 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:06.801 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.120691+0000", 2024-05-08T18:32:06.801 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000125687 2024-05-08T18:32:06.801 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.801 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.801 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:06.801 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.120928+0000", 2024-05-08T18:32:06.801 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00023705899999999999 2024-05-08T18:32:06.801 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:06.801 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:06.802 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:06.802 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.802 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.802 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1870 3.35 3:ae4fe6ec:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_56:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:32:06.802 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:01.102476+0000", 2024-05-08T18:32:06.802 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 5.6002429239999998, 2024-05-08T18:32:06.802 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.026237963999999999, 2024-05-08T18:32:06.802 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:06.802 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:06.802 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:06.802 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:06.802 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:06.802 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:06.803 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1870 2024-05-08T18:32:06.803 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.803 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:06.803 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.803 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:06.803 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.102476+0000", 2024-05-08T18:32:06.803 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:06.803 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.803 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.803 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:06.803 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.102476+0000", 2024-05-08T18:32:06.803 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:06.803 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.803 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.804 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:06.804 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.102478+0000", 2024-05-08T18:32:06.804 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1670000000000002e-06 2024-05-08T18:32:06.804 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.804 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.804 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:06.804 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.106606+0000", 2024-05-08T18:32:06.804 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0041281369999999996 2024-05-08T18:32:06.804 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.804 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.804 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:06.804 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.106630+0000", 2024-05-08T18:32:06.804 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3972999999999999e-05 2024-05-08T18:32:06.804 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.805 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.805 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:06.805 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.106643+0000", 2024-05-08T18:32:06.805 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2167999999999999e-05 2024-05-08T18:32:06.805 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.805 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.805 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:06.805 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.112414+0000", 2024-05-08T18:32:06.805 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.005771712 2024-05-08T18:32:06.805 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.805 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.805 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:06.805 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.112627+0000", 2024-05-08T18:32:06.805 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00021261300000000001 2024-05-08T18:32:06.806 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.806 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.806 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 5", 2024-05-08T18:32:06.806 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.112854+0000", 2024-05-08T18:32:06.806 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022747800000000001 2024-05-08T18:32:06.806 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.806 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.806 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:06.806 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.123928+0000", 2024-05-08T18:32:06.806 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011074083 2024-05-08T18:32:06.806 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.806 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.806 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:06.806 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.128565+0000", 2024-05-08T18:32:06.807 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0046363619999999998 2024-05-08T18:32:06.807 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.807 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.807 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:06.807 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.128648+0000", 2024-05-08T18:32:06.807 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2917999999999995e-05 2024-05-08T18:32:06.807 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.807 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.807 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:06.807 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.128714+0000", 2024-05-08T18:32:06.807 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6353000000000007e-05 2024-05-08T18:32:06.807 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:06.807 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:06.807 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:06.808 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.808 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.808 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1880 3.2c 3:37adcf73:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_66:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:32:06.808 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:01.273251+0000", 2024-05-08T18:32:06.808 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 5.4294679730000004, 2024-05-08T18:32:06.808 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.021420284000000001, 2024-05-08T18:32:06.808 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:06.808 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:06.808 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:06.808 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:06.808 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:06.808 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:06.808 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1880 2024-05-08T18:32:06.808 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.809 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:06.809 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.809 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:06.809 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.273251+0000", 2024-05-08T18:32:06.809 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:06.809 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.809 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.809 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:06.809 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.273251+0000", 2024-05-08T18:32:06.809 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:06.809 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.809 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.809 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:06.809 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.273254+0000", 2024-05-08T18:32:06.810 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8200000000000001e-06 2024-05-08T18:32:06.810 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.810 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.810 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:06.810 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.277791+0000", 2024-05-08T18:32:06.810 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0045372520000000003 2024-05-08T18:32:06.810 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.810 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.810 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:06.810 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.277828+0000", 2024-05-08T18:32:06.810 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6882999999999999e-05 2024-05-08T18:32:06.810 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.810 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.810 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:06.811 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.277854+0000", 2024-05-08T18:32:06.811 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6063000000000001e-05 2024-05-08T18:32:06.811 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.811 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.811 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:06.811 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.277947+0000", 2024-05-08T18:32:06.811 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.3367000000000002e-05 2024-05-08T18:32:06.811 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.811 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.811 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:06.811 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.278063+0000", 2024-05-08T18:32:06.811 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011535399999999999 2024-05-08T18:32:06.811 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.812 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.812 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 4", 2024-05-08T18:32:06.812 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.278162+0000", 2024-05-08T18:32:06.812 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.9463999999999995e-05 2024-05-08T18:32:06.812 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.812 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.812 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:06.812 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.284604+0000", 2024-05-08T18:32:06.812 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0064413109999999999 2024-05-08T18:32:06.812 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.812 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.812 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:06.812 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.294593+0000", 2024-05-08T18:32:06.812 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0099896640000000005 2024-05-08T18:32:06.813 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.813 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.813 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:06.813 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.294637+0000", 2024-05-08T18:32:06.813 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3640999999999998e-05 2024-05-08T18:32:06.813 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.813 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.813 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:06.813 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.294671+0000", 2024-05-08T18:32:06.813 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4465000000000003e-05 2024-05-08T18:32:06.813 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:06.813 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:06.813 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:06.813 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.814 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.814 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1907 3.34 e93/21 3:2f5137c7:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_93:head v 93'5, mlcod=84'3)", 2024-05-08T18:32:06.814 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:01.836973+0000", 2024-05-08T18:32:06.814 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4.8657459640000003, 2024-05-08T18:32:06.814 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.025279401999999999, 2024-05-08T18:32:06.814 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:06.814 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:06.814 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:06.814 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:06.814 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.814 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:06.814 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.836973+0000", 2024-05-08T18:32:06.814 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:06.815 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.815 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.815 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:06.815 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.836973+0000", 2024-05-08T18:32:06.815 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:06.815 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.815 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.815 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:06.815 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.836976+0000", 2024-05-08T18:32:06.815 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5399999999999998e-06 2024-05-08T18:32:06.815 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.815 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.815 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:06.815 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.840092+0000", 2024-05-08T18:32:06.816 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0031165899999999998 2024-05-08T18:32:06.816 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.816 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.816 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:06.816 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.840132+0000", 2024-05-08T18:32:06.816 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9922999999999997e-05 2024-05-08T18:32:06.816 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.816 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.816 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:06.816 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.840151+0000", 2024-05-08T18:32:06.816 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9046999999999999e-05 2024-05-08T18:32:06.816 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.816 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.816 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:06.817 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.840313+0000", 2024-05-08T18:32:06.817 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016207099999999999 2024-05-08T18:32:06.817 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.817 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.817 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:06.817 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.840383+0000", 2024-05-08T18:32:06.817 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0129999999999994e-05 2024-05-08T18:32:06.817 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.817 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.817 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:06.817 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.862123+0000", 2024-05-08T18:32:06.817 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.021740038 2024-05-08T18:32:06.817 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.817 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.818 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:06.818 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.862252+0000", 2024-05-08T18:32:06.818 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012906300000000001 2024-05-08T18:32:06.818 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:06.818 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:06.818 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:06.818 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.818 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.818 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1922 3.10 3:08161f34:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_108:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:32:06.818 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:02.062130+0000", 2024-05-08T18:32:06.818 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 4.6405886770000002, 2024-05-08T18:32:06.818 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.020646504999999999, 2024-05-08T18:32:06.818 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:06.819 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:06.819 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:06.819 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:06.819 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:06.819 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:06.819 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1922 2024-05-08T18:32:06.819 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.819 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:06.819 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.819 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:06.819 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.062130+0000", 2024-05-08T18:32:06.819 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:06.819 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.819 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.820 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:06.820 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.062130+0000", 2024-05-08T18:32:06.820 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:06.820 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.820 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.820 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:06.820 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.062134+0000", 2024-05-08T18:32:06.820 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0969999999999999e-06 2024-05-08T18:32:06.820 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.820 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.820 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:06.820 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.068395+0000", 2024-05-08T18:32:06.820 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.006260336 2024-05-08T18:32:06.820 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.821 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.821 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:06.821 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.068435+0000", 2024-05-08T18:32:06.821 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0453e-05 2024-05-08T18:32:06.821 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.821 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.821 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:06.821 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.068456+0000", 2024-05-08T18:32:06.821 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0686000000000002e-05 2024-05-08T18:32:06.821 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.821 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.821 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:06.821 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.068554+0000", 2024-05-08T18:32:06.821 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8006999999999999e-05 2024-05-08T18:32:06.822 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.822 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.822 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:06.822 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.068735+0000", 2024-05-08T18:32:06.822 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00018081400000000001 2024-05-08T18:32:06.822 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.822 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.822 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:32:06.822 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.068912+0000", 2024-05-08T18:32:06.822 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017739399999999999 2024-05-08T18:32:06.822 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.822 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.822 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:06.822 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.078319+0000", 2024-05-08T18:32:06.823 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0094067339999999999 2024-05-08T18:32:06.823 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.823 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.823 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:06.823 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.082607+0000", 2024-05-08T18:32:06.823 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0042881250000000003 2024-05-08T18:32:06.823 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.823 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.823 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:06.823 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.082708+0000", 2024-05-08T18:32:06.823 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000100649 2024-05-08T18:32:06.823 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:06.823 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:06.824 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:06.824 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.082777+0000", 2024-05-08T18:32:06.824 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9209999999999996e-05 2024-05-08T18:32:06.824 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:06.824 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:06.824 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:06.824 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:06.824 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:06.824 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:32:06.826 INFO:teuthology.orchestra.run.smithi097.stderr:noscrub is unset 2024-05-08T18:32:06.826 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-08T18:32:06.827 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2024-05-08T18:32:06.827 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:32:06.827 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2024-05-08T18:32:06.828 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:32:06.828 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2024-05-08T18:32:06.828 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:32:06.829 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2024-05-08T18:32:06.829 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:32:06.829 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:32:06.825+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:32:06.840 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2024-05-08T18:32:06.840 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:32:06.858 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2024-05-08T18:32:06.859 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:32:06.877 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2024-05-08T18:32:06.878 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:32:06.897 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2024-05-08T18:32:06.897 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:32:06.956 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:32:06.957+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:32:06.958 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:32:06.958 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:32:06.972 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-08T18:32:07.027 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:32:07.025+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:32:07.093 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:32:07.093 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:32:07.107 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-08T18:32:07.128 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:32:07.129+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:32:07.224 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:32:07.225 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:32:07.229 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:32:07.226+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:32:07.239 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-08T18:32:07.330 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:32:07.329+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:32:07.371 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:32:07.371 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:32:07.385 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-08T18:32:07.430 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:32:07.429+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:32:07.531 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:32:07.529+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:32:07.552 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:32:07.552 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:32:07.566 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-08T18:32:07.662 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:32:07.661+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:32:07.733 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:32:07.733+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:32:07.736 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:32:07.736 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:32:07.751 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-08T18:32:07.836 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:32:07.837+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:32:07.919 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:32:07.919 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:32:07.933 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-08T18:32:07.976 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:32:07.977+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:32:08.036 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:32:08.033+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:32:08.096 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:32:08.096 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:32:08.110 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-08T18:32:08.152 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:32:08.153+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:32:08.237 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:32:08.238+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:32:08.269 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:32:08.270 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:32:08.285 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-08T18:32:08.339 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:32:08.334+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:32:08.408 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:32:08.408 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:32:08.422 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-08T18:32:08.468 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:32:08.469+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:32:08.540 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:32:08.538+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:32:08.546 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:32:08.546 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:32:08.560 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-08T18:32:08.641 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:32:08.638+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:32:08.726 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:32:08.726 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:32:08.740 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-08T18:32:08.741 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:32:08.741+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:32:08.828 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-08T18:32:08.843 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:32:08.838+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:32:08.862 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:32:08.862 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:32:08.877 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-08T18:32:08.913 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-08T18:32:08.968 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:32:08.969+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:32:09.045 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:32:09.042+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:32:09.048 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:32:09.048 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:32:09.062 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-08T18:32:09.064 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2024-05-08T18:32:09.065 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:32:09.083 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2024-05-08T18:32:09.084 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:32:09.101 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2024-05-08T18:32:09.101 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:32:09.119 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2024-05-08T18:32:09.119 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:32:09.140 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2024-05-08T18:32:09.140 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:32:09.145 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:32:09.142+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:32:09.160 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2024-05-08T18:32:09.160 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:32:09.182 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:32:09.182 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2024-05-08T18:32:09.182 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2024-05-08T18:32:09.182 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-05-08T18:32:09.182 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.182 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1234 3.38 3:1cb36fa1:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.2__shadow_.fYaqa8o34qSAauLRSqi3iwpmT5NwV5c_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-05-08T18:32:09.182 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:38.213439+0000", 2024-05-08T18:32:09.182 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 30.966871084000001, 2024-05-08T18:32:09.182 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.028973664, 2024-05-08T18:32:09.182 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:32:09.183 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:32:09.183 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:09.183 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:32:09.183 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:32:09.183 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:09.183 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1234 2024-05-08T18:32:09.183 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.183 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:32:09.183 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.183 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:32:09.183 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.213439+0000", 2024-05-08T18:32:09.183 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:09.183 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.183 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.184 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:32:09.184 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.213439+0000", 2024-05-08T18:32:09.184 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:09.184 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.184 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.184 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:32:09.184 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.213442+0000", 2024-05-08T18:32:09.184 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7580000000000001e-06 2024-05-08T18:32:09.184 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.184 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.184 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:32:09.184 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.216804+0000", 2024-05-08T18:32:09.184 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0033619520000000001 2024-05-08T18:32:09.184 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.185 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.185 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:32:09.185 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.216838+0000", 2024-05-08T18:32:09.185 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4437999999999998e-05 2024-05-08T18:32:09.185 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.185 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.185 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:32:09.185 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.216854+0000", 2024-05-08T18:32:09.185 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5823000000000001e-05 2024-05-08T18:32:09.185 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.185 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.185 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:32:09.185 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.216938+0000", 2024-05-08T18:32:09.186 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.3842000000000001e-05 2024-05-08T18:32:09.186 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.186 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.186 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:32:09.186 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.217046+0000", 2024-05-08T18:32:09.186 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000108717 2024-05-08T18:32:09.186 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.186 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.186 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:32:09.187 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.217137+0000", 2024-05-08T18:32:09.187 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0278000000000005e-05 2024-05-08T18:32:09.187 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.187 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.187 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:32:09.187 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.225461+0000", 2024-05-08T18:32:09.187 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0083239330000000004 2024-05-08T18:32:09.187 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.187 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.187 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:09.187 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.242319+0000", 2024-05-08T18:32:09.187 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.016858445999999999 2024-05-08T18:32:09.187 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.188 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.188 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:32:09.188 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.242359+0000", 2024-05-08T18:32:09.188 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9657000000000003e-05 2024-05-08T18:32:09.188 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.188 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.188 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:32:09.188 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:38.242413+0000", 2024-05-08T18:32:09.188 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3820000000000003e-05 2024-05-08T18:32:09.188 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:09.188 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:32:09.188 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:09.188 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.189 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.189 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1336 3.2 3:42c6ce4f:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:32:09.189 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.558532+0000", 2024-05-08T18:32:09.189 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 26.621777826999999, 2024-05-08T18:32:09.189 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.033214269999999997, 2024-05-08T18:32:09.189 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:32:09.189 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:32:09.189 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:09.189 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:32:09.189 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:32:09.189 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:09.189 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1336 2024-05-08T18:32:09.189 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.190 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:32:09.190 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.190 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:32:09.190 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.558532+0000", 2024-05-08T18:32:09.190 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:09.190 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.190 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.190 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:32:09.190 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.558532+0000", 2024-05-08T18:32:09.190 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:09.190 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.190 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.190 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:32:09.190 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.558535+0000", 2024-05-08T18:32:09.191 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9689999999999999e-06 2024-05-08T18:32:09.191 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.191 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.191 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:32:09.191 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.560549+0000", 2024-05-08T18:32:09.191 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0020142469999999998 2024-05-08T18:32:09.191 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.191 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.191 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:32:09.191 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.560576+0000", 2024-05-08T18:32:09.191 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6908000000000001e-05 2024-05-08T18:32:09.191 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.191 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.192 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:32:09.192 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.560595+0000", 2024-05-08T18:32:09.192 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8383999999999999e-05 2024-05-08T18:32:09.192 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.192 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.192 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:32:09.192 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.560680+0000", 2024-05-08T18:32:09.192 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5424000000000001e-05 2024-05-08T18:32:09.192 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.192 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.192 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-05-08T18:32:09.192 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.560685+0000", 2024-05-08T18:32:09.193 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.327e-06 2024-05-08T18:32:09.193 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.193 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.193 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:32:09.193 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.570079+0000", 2024-05-08T18:32:09.193 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0093940680000000002 2024-05-08T18:32:09.193 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.193 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.193 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:32:09.193 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.570249+0000", 2024-05-08T18:32:09.193 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000169953 2024-05-08T18:32:09.193 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.193 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.193 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-05-08T18:32:09.194 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.570423+0000", 2024-05-08T18:32:09.194 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00017355499999999999 2024-05-08T18:32:09.194 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.194 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.194 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:32:09.194 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.590293+0000", 2024-05-08T18:32:09.194 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019869761999999999 2024-05-08T18:32:09.194 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.194 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.194 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:09.194 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.591628+0000", 2024-05-08T18:32:09.194 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0013351599999999999 2024-05-08T18:32:09.194 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.194 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.195 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:32:09.195 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.591692+0000", 2024-05-08T18:32:09.195 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3822e-05 2024-05-08T18:32:09.195 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.195 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.195 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:32:09.195 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.591746+0000", 2024-05-08T18:32:09.195 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4691000000000002e-05 2024-05-08T18:32:09.195 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:09.195 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:32:09.195 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:09.195 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.195 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.196 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1348 3.38 3:1ca8d3e1:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_34:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:32:09.196 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.684650+0000", 2024-05-08T18:32:09.196 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 26.495659928999999, 2024-05-08T18:32:09.196 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.018994840999999998, 2024-05-08T18:32:09.196 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:32:09.196 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:32:09.196 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:09.196 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:32:09.196 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:32:09.196 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:09.196 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1348 2024-05-08T18:32:09.196 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.196 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:32:09.196 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.197 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:32:09.197 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.684650+0000", 2024-05-08T18:32:09.197 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:09.197 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.197 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.197 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:32:09.197 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.684650+0000", 2024-05-08T18:32:09.197 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:09.197 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.197 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.197 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:32:09.197 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.684652+0000", 2024-05-08T18:32:09.197 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3860000000000001e-06 2024-05-08T18:32:09.197 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.198 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.198 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:32:09.198 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.686933+0000", 2024-05-08T18:32:09.198 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0022806369999999999 2024-05-08T18:32:09.198 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.198 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.198 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:32:09.198 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.686950+0000", 2024-05-08T18:32:09.198 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7377e-05 2024-05-08T18:32:09.198 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.198 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.198 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:32:09.198 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.686962+0000", 2024-05-08T18:32:09.199 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1756000000000001e-05 2024-05-08T18:32:09.199 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.199 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.199 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:32:09.199 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.687038+0000", 2024-05-08T18:32:09.199 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.5623000000000004e-05 2024-05-08T18:32:09.199 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.199 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.199 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:32:09.199 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.687226+0000", 2024-05-08T18:32:09.199 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000188457 2024-05-08T18:32:09.199 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.199 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.200 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:32:09.200 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.687394+0000", 2024-05-08T18:32:09.200 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016753300000000001 2024-05-08T18:32:09.200 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.200 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.200 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:32:09.200 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.694346+0000", 2024-05-08T18:32:09.200 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0069519639999999997 2024-05-08T18:32:09.200 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.200 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.200 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:09.200 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.703479+0000", 2024-05-08T18:32:09.200 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0091331829999999996 2024-05-08T18:32:09.200 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.201 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.201 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:32:09.201 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.703567+0000", 2024-05-08T18:32:09.201 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8294000000000005e-05 2024-05-08T18:32:09.201 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.201 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.201 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:32:09.201 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.703645+0000", 2024-05-08T18:32:09.201 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7631000000000003e-05 2024-05-08T18:32:09.201 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:09.201 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:32:09.201 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:09.201 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.201 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.202 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1349 3.27 3:e5090c80:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_35:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:32:09.202 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.696361+0000", 2024-05-08T18:32:09.202 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 26.483948859000002, 2024-05-08T18:32:09.202 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019944929, 2024-05-08T18:32:09.202 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:32:09.202 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:32:09.202 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:09.202 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:32:09.202 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:32:09.203 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:09.203 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1349 2024-05-08T18:32:09.203 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.203 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:32:09.203 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.203 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:32:09.203 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.696361+0000", 2024-05-08T18:32:09.203 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:09.203 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.203 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.203 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:32:09.203 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.696361+0000", 2024-05-08T18:32:09.203 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:09.203 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.204 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.204 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:32:09.204 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.696363+0000", 2024-05-08T18:32:09.204 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1160000000000002e-06 2024-05-08T18:32:09.204 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.204 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.204 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:32:09.204 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.698294+0000", 2024-05-08T18:32:09.204 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001931026 2024-05-08T18:32:09.204 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.204 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.204 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:32:09.204 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.698324+0000", 2024-05-08T18:32:09.205 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9658e-05 2024-05-08T18:32:09.205 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.205 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.205 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:32:09.205 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.698339+0000", 2024-05-08T18:32:09.205 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5381000000000001e-05 2024-05-08T18:32:09.205 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.205 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.205 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:32:09.205 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.698430+0000", 2024-05-08T18:32:09.205 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0353999999999996e-05 2024-05-08T18:32:09.205 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.205 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.206 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:32:09.206 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.698591+0000", 2024-05-08T18:32:09.206 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016140999999999999 2024-05-08T18:32:09.206 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.206 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.206 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:32:09.206 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.698741+0000", 2024-05-08T18:32:09.206 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014955099999999999 2024-05-08T18:32:09.206 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.206 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.207 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:32:09.207 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.706987+0000", 2024-05-08T18:32:09.207 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0082466599999999994 2024-05-08T18:32:09.207 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.207 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.207 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:09.207 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.716183+0000", 2024-05-08T18:32:09.207 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0091959529999999998 2024-05-08T18:32:09.207 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.207 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.207 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:32:09.207 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.716252+0000", 2024-05-08T18:32:09.207 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8804000000000001e-05 2024-05-08T18:32:09.208 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.208 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.208 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:32:09.208 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.716306+0000", 2024-05-08T18:32:09.208 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4015999999999999e-05 2024-05-08T18:32:09.208 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:09.208 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:32:09.208 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:09.208 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.208 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.208 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1355 3.28 e82/21 3:14052413:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_41:head v 82'1, mlcod=0'0)", 2024-05-08T18:32:09.208 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.768053+0000", 2024-05-08T18:32:09.208 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 26.412257026999999, 2024-05-08T18:32:09.208 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019664687, 2024-05-08T18:32:09.209 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:32:09.209 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:32:09.209 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:09.209 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:32:09.209 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.209 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:32:09.209 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.768053+0000", 2024-05-08T18:32:09.209 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:09.209 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.209 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.209 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:32:09.209 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.768053+0000", 2024-05-08T18:32:09.209 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:09.210 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.210 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.210 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:32:09.210 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.768055+0000", 2024-05-08T18:32:09.210 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6959999999999999e-06 2024-05-08T18:32:09.210 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.210 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.210 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:32:09.210 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.772115+0000", 2024-05-08T18:32:09.210 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0040600139999999998 2024-05-08T18:32:09.210 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.210 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.210 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:32:09.211 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.772149+0000", 2024-05-08T18:32:09.211 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4638999999999998e-05 2024-05-08T18:32:09.211 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.211 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.211 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:32:09.211 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.772165+0000", 2024-05-08T18:32:09.211 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5435999999999999e-05 2024-05-08T18:32:09.211 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.211 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.211 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:32:09.211 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.772261+0000", 2024-05-08T18:32:09.211 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.6724000000000004e-05 2024-05-08T18:32:09.211 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.212 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.212 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:32:09.212 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.772289+0000", 2024-05-08T18:32:09.212 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7243e-05 2024-05-08T18:32:09.212 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.212 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.212 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:32:09.212 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.787670+0000", 2024-05-08T18:32:09.212 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.015380906 2024-05-08T18:32:09.212 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.212 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.212 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:32:09.212 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.787718+0000", 2024-05-08T18:32:09.213 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8028999999999997e-05 2024-05-08T18:32:09.213 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:09.213 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:32:09.213 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:09.213 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.213 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.213 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1356 3.2 3:41e29af7:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_42:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:32:09.213 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:42.771157+0000", 2024-05-08T18:32:09.213 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 26.409153046, 2024-05-08T18:32:09.213 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.018991331, 2024-05-08T18:32:09.213 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:32:09.213 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:32:09.213 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:09.213 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:32:09.214 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:32:09.214 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:09.214 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1356 2024-05-08T18:32:09.214 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.214 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:32:09.214 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.214 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:32:09.214 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.771157+0000", 2024-05-08T18:32:09.214 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:09.214 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.214 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.214 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:32:09.214 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.771157+0000", 2024-05-08T18:32:09.215 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:09.215 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.215 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.215 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:32:09.215 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.771160+0000", 2024-05-08T18:32:09.215 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1820000000000002e-06 2024-05-08T18:32:09.215 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.215 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.215 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:32:09.215 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.772778+0000", 2024-05-08T18:32:09.215 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001617926 2024-05-08T18:32:09.215 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.215 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.216 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:32:09.216 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.772790+0000", 2024-05-08T18:32:09.216 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1609e-05 2024-05-08T18:32:09.216 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.216 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.216 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:32:09.216 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.772797+0000", 2024-05-08T18:32:09.216 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.3270000000000003e-06 2024-05-08T18:32:09.216 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.216 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.216 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:32:09.216 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.772851+0000", 2024-05-08T18:32:09.216 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3987999999999999e-05 2024-05-08T18:32:09.216 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.217 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.217 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:32:09.217 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.772947+0000", 2024-05-08T18:32:09.217 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.5809000000000004e-05 2024-05-08T18:32:09.217 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.217 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.217 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-05-08T18:32:09.217 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.773040+0000", 2024-05-08T18:32:09.217 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.3422000000000001e-05 2024-05-08T18:32:09.217 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.217 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.217 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:32:09.217 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.786246+0000", 2024-05-08T18:32:09.217 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.013205744 2024-05-08T18:32:09.217 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.218 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.218 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:09.218 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.790017+0000", 2024-05-08T18:32:09.218 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0037707539999999999 2024-05-08T18:32:09.218 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.218 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.218 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:32:09.218 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.790091+0000", 2024-05-08T18:32:09.218 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.4664000000000002e-05 2024-05-08T18:32:09.218 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.219 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.219 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:32:09.219 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:42.790148+0000", 2024-05-08T18:32:09.219 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6906e-05 2024-05-08T18:32:09.219 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:09.219 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:32:09.219 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:09.219 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.219 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.220 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1616 3.7 3:e2c69de8:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-05-08T18:32:09.220 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:46.728206+0000", 2024-05-08T18:32:09.220 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 22.452103816000001, 2024-05-08T18:32:09.220 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.024382826, 2024-05-08T18:32:09.220 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:32:09.220 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:32:09.220 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:09.220 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:32:09.220 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:32:09.220 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:09.220 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1616 2024-05-08T18:32:09.220 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.221 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:32:09.221 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.221 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:32:09.221 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.728206+0000", 2024-05-08T18:32:09.221 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:09.221 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.221 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.221 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:32:09.221 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.728206+0000", 2024-05-08T18:32:09.221 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:09.221 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.221 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.221 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:32:09.221 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.728209+0000", 2024-05-08T18:32:09.222 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3060000000000002e-06 2024-05-08T18:32:09.222 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.222 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.222 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:32:09.222 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.730475+0000", 2024-05-08T18:32:09.222 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0022651899999999998 2024-05-08T18:32:09.222 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.222 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.222 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:32:09.222 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.730508+0000", 2024-05-08T18:32:09.222 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3226999999999999e-05 2024-05-08T18:32:09.222 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.222 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.223 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:32:09.223 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.730523+0000", 2024-05-08T18:32:09.223 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4715999999999999e-05 2024-05-08T18:32:09.223 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.223 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.223 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:32:09.223 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.730618+0000", 2024-05-08T18:32:09.223 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.5619999999999996e-05 2024-05-08T18:32:09.223 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.223 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.223 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:32:09.223 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.730831+0000", 2024-05-08T18:32:09.223 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021288599999999999 2024-05-08T18:32:09.223 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.224 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.224 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 7", 2024-05-08T18:32:09.224 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.730970+0000", 2024-05-08T18:32:09.224 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013861400000000001 2024-05-08T18:32:09.224 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.224 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.224 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:32:09.224 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.742595+0000", 2024-05-08T18:32:09.224 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011624951 2024-05-08T18:32:09.224 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.224 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.224 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:09.224 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.752495+0000", 2024-05-08T18:32:09.224 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0098999910000000003 2024-05-08T18:32:09.225 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.225 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.225 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:32:09.225 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.752546+0000", 2024-05-08T18:32:09.225 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.1422999999999999e-05 2024-05-08T18:32:09.225 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.225 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.225 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:32:09.225 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.752589+0000", 2024-05-08T18:32:09.225 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.2901999999999997e-05 2024-05-08T18:32:09.225 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:09.225 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:32:09.225 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:09.225 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.226 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.226 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1625 3.1e 3:798e9c4d:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-05-08T18:32:09.226 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:46.821701+0000", 2024-05-08T18:32:09.226 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 22.358609171000001, 2024-05-08T18:32:09.226 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019517788000000001, 2024-05-08T18:32:09.227 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:32:09.227 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:32:09.227 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:09.227 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:32:09.227 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:32:09.227 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:09.227 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1625 2024-05-08T18:32:09.227 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.227 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:32:09.227 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.227 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:32:09.227 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.821701+0000", 2024-05-08T18:32:09.227 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:09.227 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.228 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.228 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:32:09.228 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.821701+0000", 2024-05-08T18:32:09.228 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:09.228 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.228 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.228 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:32:09.228 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.821704+0000", 2024-05-08T18:32:09.228 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9450000000000002e-06 2024-05-08T18:32:09.228 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.228 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.228 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:32:09.228 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.824221+0000", 2024-05-08T18:32:09.228 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0025171600000000001 2024-05-08T18:32:09.229 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.229 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.229 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:32:09.229 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.824251+0000", 2024-05-08T18:32:09.229 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0243000000000002e-05 2024-05-08T18:32:09.229 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.229 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.229 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:32:09.229 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.824265+0000", 2024-05-08T18:32:09.229 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3482999999999999e-05 2024-05-08T18:32:09.229 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.229 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.230 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:32:09.230 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.824353+0000", 2024-05-08T18:32:09.230 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8146999999999995e-05 2024-05-08T18:32:09.230 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.230 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.230 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:32:09.230 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.824560+0000", 2024-05-08T18:32:09.230 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00020771400000000001 2024-05-08T18:32:09.230 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.230 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.230 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 6", 2024-05-08T18:32:09.230 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.824720+0000", 2024-05-08T18:32:09.231 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015998799999999999 2024-05-08T18:32:09.231 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.231 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.231 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:32:09.231 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.837381+0000", 2024-05-08T18:32:09.231 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012660803 2024-05-08T18:32:09.231 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.231 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.231 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:09.231 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.841087+0000", 2024-05-08T18:32:09.231 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0037056519999999998 2024-05-08T18:32:09.231 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.231 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.231 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:32:09.231 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.841160+0000", 2024-05-08T18:32:09.232 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.3208999999999997e-05 2024-05-08T18:32:09.232 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.232 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.232 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:32:09.232 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.841219+0000", 2024-05-08T18:32:09.232 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8443999999999998e-05 2024-05-08T18:32:09.232 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:09.232 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:32:09.232 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:09.232 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.232 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.232 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1627 3.b 3:d1c181db:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-05-08T18:32:09.232 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:46.850618+0000", 2024-05-08T18:32:09.233 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 22.329691795999999, 2024-05-08T18:32:09.233 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.027553586000000001, 2024-05-08T18:32:09.233 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:32:09.233 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:32:09.233 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:09.233 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:32:09.233 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:32:09.233 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:09.233 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1627 2024-05-08T18:32:09.233 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.233 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:32:09.233 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.233 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:32:09.233 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.850618+0000", 2024-05-08T18:32:09.233 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:09.234 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.234 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.234 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:32:09.234 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.850618+0000", 2024-05-08T18:32:09.234 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:09.234 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.234 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.234 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:32:09.234 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.850621+0000", 2024-05-08T18:32:09.234 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0299999999999998e-06 2024-05-08T18:32:09.234 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.234 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.234 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:32:09.235 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.852369+0000", 2024-05-08T18:32:09.235 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001748229 2024-05-08T18:32:09.235 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.235 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.235 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:32:09.235 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.852397+0000", 2024-05-08T18:32:09.235 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7542000000000002e-05 2024-05-08T18:32:09.235 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.235 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.235 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:32:09.235 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.852410+0000", 2024-05-08T18:32:09.235 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2798e-05 2024-05-08T18:32:09.235 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.235 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.236 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:32:09.236 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.852537+0000", 2024-05-08T18:32:09.236 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000126756 2024-05-08T18:32:09.236 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.236 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.236 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:32:09.236 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.852785+0000", 2024-05-08T18:32:09.236 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024892099999999998 2024-05-08T18:32:09.236 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.236 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.236 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0", 2024-05-08T18:32:09.236 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.853042+0000", 2024-05-08T18:32:09.237 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00025698799999999999 2024-05-08T18:32:09.237 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.237 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.237 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:32:09.237 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.876145+0000", 2024-05-08T18:32:09.237 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.023102746 2024-05-08T18:32:09.237 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.237 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.237 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:09.237 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.878045+0000", 2024-05-08T18:32:09.237 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0018999850000000001 2024-05-08T18:32:09.237 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.237 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.237 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:32:09.238 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.878117+0000", 2024-05-08T18:32:09.238 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1464000000000006e-05 2024-05-08T18:32:09.238 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.238 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.238 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:32:09.238 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.878172+0000", 2024-05-08T18:32:09.238 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5127000000000003e-05 2024-05-08T18:32:09.238 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:09.238 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:32:09.238 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:09.238 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.238 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.238 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1629 3.24 3:27d2a12f:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-05-08T18:32:09.239 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:46.873022+0000", 2024-05-08T18:32:09.239 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 22.307287792, 2024-05-08T18:32:09.239 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019610209, 2024-05-08T18:32:09.239 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:32:09.239 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:32:09.239 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:09.239 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:32:09.239 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:32:09.239 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:09.239 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1629 2024-05-08T18:32:09.239 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.239 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:32:09.239 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.240 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:32:09.240 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.873022+0000", 2024-05-08T18:32:09.240 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:09.240 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.240 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.240 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:32:09.240 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.873022+0000", 2024-05-08T18:32:09.240 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:09.240 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.240 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.240 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:32:09.240 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.873024+0000", 2024-05-08T18:32:09.240 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.826e-06 2024-05-08T18:32:09.240 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.241 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.241 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:32:09.241 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.874556+0000", 2024-05-08T18:32:09.241 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0015321009999999999 2024-05-08T18:32:09.241 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.241 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.241 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:32:09.241 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.874593+0000", 2024-05-08T18:32:09.241 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6696000000000002e-05 2024-05-08T18:32:09.241 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.241 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.241 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:32:09.241 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.874610+0000", 2024-05-08T18:32:09.242 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7374e-05 2024-05-08T18:32:09.242 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.242 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.242 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:32:09.242 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.874687+0000", 2024-05-08T18:32:09.242 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7219999999999996e-05 2024-05-08T18:32:09.242 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.242 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.242 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:32:09.242 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.874823+0000", 2024-05-08T18:32:09.242 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013538600000000001 2024-05-08T18:32:09.242 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.243 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.243 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:32:09.243 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.874921+0000", 2024-05-08T18:32:09.243 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.8679999999999997e-05 2024-05-08T18:32:09.243 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.243 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.243 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:32:09.243 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.883485+0000", 2024-05-08T18:32:09.243 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0085638299999999997 2024-05-08T18:32:09.243 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.243 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.243 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:09.243 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.892549+0000", 2024-05-08T18:32:09.243 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0090635850000000007 2024-05-08T18:32:09.243 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.244 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.244 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:32:09.244 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.892593+0000", 2024-05-08T18:32:09.244 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4566e-05 2024-05-08T18:32:09.244 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.244 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.244 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:32:09.244 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.892632+0000", 2024-05-08T18:32:09.244 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8945000000000001e-05 2024-05-08T18:32:09.244 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:09.244 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:32:09.244 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:09.244 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.245 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.245 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1633 3.15 e83/21 3:ab226f54:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_21:head v 83'2, mlcod=0'0)", 2024-05-08T18:32:09.245 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:46.920100+0000", 2024-05-08T18:32:09.245 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 22.260210401999998, 2024-05-08T18:32:09.245 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.022841956, 2024-05-08T18:32:09.245 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:32:09.245 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:32:09.245 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:09.245 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:32:09.245 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.245 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:32:09.245 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.920100+0000", 2024-05-08T18:32:09.245 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:09.246 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.246 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.246 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:32:09.246 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.920100+0000", 2024-05-08T18:32:09.246 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:09.246 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.246 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.246 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:32:09.246 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.920101+0000", 2024-05-08T18:32:09.246 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4309999999999999e-06 2024-05-08T18:32:09.246 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.246 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.246 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:32:09.247 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.926002+0000", 2024-05-08T18:32:09.247 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0059014820000000004 2024-05-08T18:32:09.247 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.247 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.247 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:32:09.247 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.926041+0000", 2024-05-08T18:32:09.247 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8217999999999999e-05 2024-05-08T18:32:09.247 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.247 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.247 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:32:09.247 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.926057+0000", 2024-05-08T18:32:09.247 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5877000000000001e-05 2024-05-08T18:32:09.247 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.248 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.248 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:32:09.248 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.926149+0000", 2024-05-08T18:32:09.248 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.2361000000000006e-05 2024-05-08T18:32:09.248 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.248 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.248 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:32:09.248 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.926178+0000", 2024-05-08T18:32:09.248 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9544999999999999e-05 2024-05-08T18:32:09.248 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.248 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.248 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:32:09.249 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.942887+0000", 2024-05-08T18:32:09.249 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.016708163000000002 2024-05-08T18:32:09.249 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.249 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.249 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:32:09.249 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.942942+0000", 2024-05-08T18:32:09.249 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4879000000000001e-05 2024-05-08T18:32:09.249 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:09.249 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:32:09.249 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:09.249 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.249 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.249 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1634 3.b 3:d3d25f94:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-05-08T18:32:09.250 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:31:46.925230+0000", 2024-05-08T18:32:09.250 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 22.255079667, 2024-05-08T18:32:09.250 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.022437625999999999, 2024-05-08T18:32:09.250 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:32:09.250 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:32:09.250 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:09.250 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:32:09.250 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:32:09.250 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:09.250 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1634 2024-05-08T18:32:09.250 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.250 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:32:09.250 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.251 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:32:09.251 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.925230+0000", 2024-05-08T18:32:09.251 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:09.251 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.251 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.251 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:32:09.251 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.925230+0000", 2024-05-08T18:32:09.251 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:09.251 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.251 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.251 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:32:09.251 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.925234+0000", 2024-05-08T18:32:09.251 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6789999999999998e-06 2024-05-08T18:32:09.252 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.252 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.252 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:32:09.252 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.927184+0000", 2024-05-08T18:32:09.252 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0019497799999999999 2024-05-08T18:32:09.252 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.252 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.252 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:32:09.252 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.927205+0000", 2024-05-08T18:32:09.252 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1231000000000001e-05 2024-05-08T18:32:09.252 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.252 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.252 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:32:09.252 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.927214+0000", 2024-05-08T18:32:09.252 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0159999999999997e-06 2024-05-08T18:32:09.253 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.253 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.253 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:32:09.253 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.927287+0000", 2024-05-08T18:32:09.253 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.3192e-05 2024-05-08T18:32:09.253 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.253 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.253 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:32:09.253 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.927495+0000", 2024-05-08T18:32:09.253 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00020766099999999999 2024-05-08T18:32:09.253 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.253 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.253 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0", 2024-05-08T18:32:09.253 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.927653+0000", 2024-05-08T18:32:09.254 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015861799999999999 2024-05-08T18:32:09.254 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.254 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.254 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:32:09.254 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.947344+0000", 2024-05-08T18:32:09.254 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019690112999999999 2024-05-08T18:32:09.254 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.254 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.254 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:09.254 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.947572+0000", 2024-05-08T18:32:09.254 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000228292 2024-05-08T18:32:09.254 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.254 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.254 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:32:09.255 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.947618+0000", 2024-05-08T18:32:09.255 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5880000000000001e-05 2024-05-08T18:32:09.255 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.255 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.255 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:32:09.255 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:31:46.947668+0000", 2024-05-08T18:32:09.255 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.0164000000000003e-05 2024-05-08T18:32:09.255 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:09.255 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:32:09.255 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:09.255 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.255 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.255 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1823 3.27 3:e6e611e5:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-05-08T18:32:09.256 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:32:00.521693+0000", 2024-05-08T18:32:09.256 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 8.6586169300000009, 2024-05-08T18:32:09.256 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.023324290000000001, 2024-05-08T18:32:09.256 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:32:09.256 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:32:09.256 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:09.256 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:32:09.256 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:32:09.256 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:09.256 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1823 2024-05-08T18:32:09.256 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.257 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:32:09.257 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.257 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:32:09.257 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:00.521693+0000", 2024-05-08T18:32:09.257 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:09.257 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.257 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.257 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:32:09.257 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:00.521693+0000", 2024-05-08T18:32:09.257 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:09.257 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.257 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.257 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:32:09.257 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:00.521696+0000", 2024-05-08T18:32:09.258 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7250000000000002e-06 2024-05-08T18:32:09.258 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.258 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.258 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:32:09.258 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:00.524303+0000", 2024-05-08T18:32:09.258 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0026069579999999999 2024-05-08T18:32:09.258 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.258 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.258 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:32:09.258 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:00.524328+0000", 2024-05-08T18:32:09.258 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5369000000000001e-05 2024-05-08T18:32:09.258 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.258 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.259 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:32:09.259 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:00.524342+0000", 2024-05-08T18:32:09.259 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3543999999999999e-05 2024-05-08T18:32:09.259 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.259 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.259 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:32:09.259 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:00.524425+0000", 2024-05-08T18:32:09.259 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.3673999999999999e-05 2024-05-08T18:32:09.259 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.259 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.259 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:32:09.259 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:00.524604+0000", 2024-05-08T18:32:09.259 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00017828899999999999 2024-05-08T18:32:09.259 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.260 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.260 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 4", 2024-05-08T18:32:09.260 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:00.524771+0000", 2024-05-08T18:32:09.260 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016735200000000001 2024-05-08T18:32:09.260 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.260 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.260 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:32:09.260 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:00.531948+0000", 2024-05-08T18:32:09.260 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0071767649999999999 2024-05-08T18:32:09.260 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.260 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.260 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:09.260 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:00.544855+0000", 2024-05-08T18:32:09.260 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012907194 2024-05-08T18:32:09.261 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.261 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.261 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:32:09.261 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:00.544947+0000", 2024-05-08T18:32:09.261 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.2014000000000004e-05 2024-05-08T18:32:09.261 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.261 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.261 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:32:09.261 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:00.545017+0000", 2024-05-08T18:32:09.261 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.0406000000000003e-05 2024-05-08T18:32:09.261 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:09.261 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:32:09.261 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:09.261 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.262 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.262 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1831 3.23 e92/21 3:c66acffb:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_17:head v 92'5, mlcod=82'3)", 2024-05-08T18:32:09.262 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:32:00.648970+0000", 2024-05-08T18:32:09.262 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 8.5313400169999998, 2024-05-08T18:32:09.262 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.027198782000000001, 2024-05-08T18:32:09.262 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:32:09.262 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:32:09.262 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:09.262 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:32:09.262 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.262 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:32:09.262 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:00.648970+0000", 2024-05-08T18:32:09.263 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:09.263 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.263 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.263 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:32:09.263 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:00.648970+0000", 2024-05-08T18:32:09.263 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:09.263 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.263 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.263 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:32:09.263 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:00.648973+0000", 2024-05-08T18:32:09.263 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.79e-06 2024-05-08T18:32:09.263 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.263 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.264 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:32:09.264 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:00.652776+0000", 2024-05-08T18:32:09.264 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003803673 2024-05-08T18:32:09.264 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.264 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.264 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:32:09.264 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:00.652806+0000", 2024-05-08T18:32:09.264 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9907e-05 2024-05-08T18:32:09.264 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.264 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.264 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:32:09.264 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:00.652820+0000", 2024-05-08T18:32:09.264 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4148000000000001e-05 2024-05-08T18:32:09.264 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.264 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.265 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:32:09.265 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:00.652947+0000", 2024-05-08T18:32:09.265 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000126496 2024-05-08T18:32:09.265 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.265 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.265 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:32:09.265 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:00.652998+0000", 2024-05-08T18:32:09.265 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.0640999999999998e-05 2024-05-08T18:32:09.265 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.265 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.265 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:32:09.265 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:00.676100+0000", 2024-05-08T18:32:09.265 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.023102257000000001 2024-05-08T18:32:09.265 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.266 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.266 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:32:09.266 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:00.676169+0000", 2024-05-08T18:32:09.266 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8869999999999996e-05 2024-05-08T18:32:09.266 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:09.266 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:32:09.266 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:09.266 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.266 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.266 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1839 3.38 3:1c9a96ef:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_25:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-05-08T18:32:09.266 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:32:00.749493+0000", 2024-05-08T18:32:09.266 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 8.4308169290000006, 2024-05-08T18:32:09.267 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021958133000000001, 2024-05-08T18:32:09.267 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:32:09.267 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:32:09.267 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:09.267 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:32:09.267 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:32:09.267 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:09.268 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1839 2024-05-08T18:32:09.268 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.268 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:32:09.268 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.268 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:32:09.268 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:00.749493+0000", 2024-05-08T18:32:09.268 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:09.268 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.269 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.269 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:32:09.269 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:00.749493+0000", 2024-05-08T18:32:09.269 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:09.269 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.269 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.269 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:32:09.269 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:00.749495+0000", 2024-05-08T18:32:09.270 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3860000000000001e-06 2024-05-08T18:32:09.270 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.270 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.270 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:32:09.270 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:00.751661+0000", 2024-05-08T18:32:09.270 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002165854 2024-05-08T18:32:09.270 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.271 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.271 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:32:09.271 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:00.751687+0000", 2024-05-08T18:32:09.271 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5928999999999999e-05 2024-05-08T18:32:09.271 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.271 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.272 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:32:09.272 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:00.751766+0000", 2024-05-08T18:32:09.272 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.8776000000000006e-05 2024-05-08T18:32:09.272 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.272 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.272 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:32:09.273 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:00.751898+0000", 2024-05-08T18:32:09.273 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013232599999999999 2024-05-08T18:32:09.273 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.273 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.273 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:32:09.273 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:00.752069+0000", 2024-05-08T18:32:09.273 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000170688 2024-05-08T18:32:09.274 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.274 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.274 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:32:09.274 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:00.752210+0000", 2024-05-08T18:32:09.274 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000140822 2024-05-08T18:32:09.274 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.274 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.275 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:32:09.275 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:00.760931+0000", 2024-05-08T18:32:09.275 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0087208170000000005 2024-05-08T18:32:09.275 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.275 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.275 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:09.275 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:00.771313+0000", 2024-05-08T18:32:09.275 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010382371 2024-05-08T18:32:09.276 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.276 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.276 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:32:09.276 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:00.771391+0000", 2024-05-08T18:32:09.276 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7904000000000005e-05 2024-05-08T18:32:09.276 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.277 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.277 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:32:09.277 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:00.771451+0000", 2024-05-08T18:32:09.277 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0260000000000002e-05 2024-05-08T18:32:09.277 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:09.277 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:32:09.277 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:09.278 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.278 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.278 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1876 3.c e93/21 3:31c32d98:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_62:head v 93'6, mlcod=82'4)", 2024-05-08T18:32:09.278 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:32:01.200556+0000", 2024-05-08T18:32:09.278 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 7.9797544269999996, 2024-05-08T18:32:09.279 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.020616645999999999, 2024-05-08T18:32:09.279 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:32:09.279 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:32:09.279 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:09.279 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:32:09.279 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.279 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:32:09.279 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.200556+0000", 2024-05-08T18:32:09.279 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:09.279 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.280 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.280 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:32:09.280 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.200556+0000", 2024-05-08T18:32:09.280 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:09.280 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.280 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.280 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:32:09.280 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.200558+0000", 2024-05-08T18:32:09.280 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.503e-06 2024-05-08T18:32:09.280 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.280 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.280 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:32:09.281 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.205556+0000", 2024-05-08T18:32:09.281 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0049976509999999997 2024-05-08T18:32:09.281 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.281 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.281 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:32:09.281 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.205593+0000", 2024-05-08T18:32:09.281 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6865e-05 2024-05-08T18:32:09.281 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.281 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.281 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:32:09.281 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.205611+0000", 2024-05-08T18:32:09.281 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8082999999999999e-05 2024-05-08T18:32:09.281 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.282 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.282 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:32:09.282 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.205750+0000", 2024-05-08T18:32:09.282 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013963800000000001 2024-05-08T18:32:09.282 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.282 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.282 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:32:09.282 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.205789+0000", 2024-05-08T18:32:09.282 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8381999999999999e-05 2024-05-08T18:32:09.282 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.282 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.282 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:32:09.282 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.221131+0000", 2024-05-08T18:32:09.283 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.015342364000000001 2024-05-08T18:32:09.283 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.283 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.283 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:32:09.283 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.221172+0000", 2024-05-08T18:32:09.283 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.1159999999999999e-05 2024-05-08T18:32:09.283 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:09.283 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:32:09.283 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:09.283 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.283 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.283 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1882 3.38 3:1c2fc662:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_68:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:32:09.283 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:32:01.307912+0000", 2024-05-08T18:32:09.284 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 7.8723984439999999, 2024-05-08T18:32:09.284 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019137119000000001, 2024-05-08T18:32:09.284 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:32:09.284 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:32:09.284 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:09.284 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:32:09.284 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:32:09.284 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:09.284 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1882 2024-05-08T18:32:09.284 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.284 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:32:09.284 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.284 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:32:09.284 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.307912+0000", 2024-05-08T18:32:09.285 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:09.285 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.285 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.285 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:32:09.285 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.307912+0000", 2024-05-08T18:32:09.285 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:09.285 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.285 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.285 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:32:09.285 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.307914+0000", 2024-05-08T18:32:09.285 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9660000000000001e-06 2024-05-08T18:32:09.285 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.285 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.285 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:32:09.286 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.311276+0000", 2024-05-08T18:32:09.286 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0033614700000000001 2024-05-08T18:32:09.286 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.286 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.286 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:32:09.286 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.311314+0000", 2024-05-08T18:32:09.286 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7669000000000001e-05 2024-05-08T18:32:09.286 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.286 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.286 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:32:09.286 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.311336+0000", 2024-05-08T18:32:09.286 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2407000000000001e-05 2024-05-08T18:32:09.286 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.287 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.287 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:32:09.287 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.311466+0000", 2024-05-08T18:32:09.287 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000129517 2024-05-08T18:32:09.287 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.287 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.287 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:32:09.287 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.311731+0000", 2024-05-08T18:32:09.287 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00026579099999999998 2024-05-08T18:32:09.287 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.287 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.287 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 5", 2024-05-08T18:32:09.287 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.311957+0000", 2024-05-08T18:32:09.287 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00022544199999999999 2024-05-08T18:32:09.288 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.288 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.288 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:32:09.288 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.322573+0000", 2024-05-08T18:32:09.288 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010615724 2024-05-08T18:32:09.288 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.288 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.288 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:09.288 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.326913+0000", 2024-05-08T18:32:09.288 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0043408250000000004 2024-05-08T18:32:09.288 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.288 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.288 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:32:09.289 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.326988+0000", 2024-05-08T18:32:09.289 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.4475999999999996e-05 2024-05-08T18:32:09.289 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.289 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.289 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:32:09.289 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.327049+0000", 2024-05-08T18:32:09.289 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0832000000000003e-05 2024-05-08T18:32:09.289 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:09.289 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:32:09.289 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:09.289 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.289 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.289 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1886 3.b 3:d2aed5c5:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_72:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:32:09.290 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:32:01.388217+0000", 2024-05-08T18:32:09.290 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 7.7920933879999996, 2024-05-08T18:32:09.290 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.020690119999999999, 2024-05-08T18:32:09.290 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:32:09.290 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:32:09.290 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:09.290 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:32:09.290 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:32:09.290 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:09.290 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1886 2024-05-08T18:32:09.291 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.291 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:32:09.291 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.291 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:32:09.291 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.388217+0000", 2024-05-08T18:32:09.291 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:09.291 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.291 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.291 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:32:09.291 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.388217+0000", 2024-05-08T18:32:09.291 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:09.291 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.291 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.292 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:32:09.292 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.388221+0000", 2024-05-08T18:32:09.292 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7829999999999998e-06 2024-05-08T18:32:09.292 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.292 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.292 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:32:09.292 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.391733+0000", 2024-05-08T18:32:09.292 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003511845 2024-05-08T18:32:09.292 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.292 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.292 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:32:09.292 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.391775+0000", 2024-05-08T18:32:09.292 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.1301000000000003e-05 2024-05-08T18:32:09.293 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.293 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.293 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:32:09.293 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.391794+0000", 2024-05-08T18:32:09.293 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9758999999999998e-05 2024-05-08T18:32:09.293 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.293 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.293 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:32:09.293 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.391956+0000", 2024-05-08T18:32:09.293 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016176799999999999 2024-05-08T18:32:09.293 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.293 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.293 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:32:09.294 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.392265+0000", 2024-05-08T18:32:09.294 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00030906999999999999 2024-05-08T18:32:09.294 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.294 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.294 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0", 2024-05-08T18:32:09.294 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.392509+0000", 2024-05-08T18:32:09.294 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000244322 2024-05-08T18:32:09.294 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.294 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.294 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:32:09.294 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.404331+0000", 2024-05-08T18:32:09.294 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011821485 2024-05-08T18:32:09.295 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.295 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.295 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:09.295 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.408820+0000", 2024-05-08T18:32:09.295 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0044886090000000002 2024-05-08T18:32:09.295 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.295 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.295 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:32:09.295 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.408868+0000", 2024-05-08T18:32:09.295 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8081999999999998e-05 2024-05-08T18:32:09.295 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.295 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.296 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:32:09.296 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.408907+0000", 2024-05-08T18:32:09.296 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9096e-05 2024-05-08T18:32:09.296 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:09.296 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:32:09.296 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:09.296 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.296 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.296 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4400.0:1902 3.28 e93/21 3:17e1ce0c:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_88:head v 93'8, mlcod=84'6)", 2024-05-08T18:32:09.296 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:32:01.737380+0000", 2024-05-08T18:32:09.296 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 7.4429299420000001, 2024-05-08T18:32:09.296 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.028050545, 2024-05-08T18:32:09.296 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:32:09.296 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:32:09.297 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:09.297 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:32:09.297 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.297 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:32:09.297 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.737380+0000", 2024-05-08T18:32:09.297 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:09.297 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.297 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.297 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:32:09.297 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.737380+0000", 2024-05-08T18:32:09.297 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:09.297 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.297 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.297 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:32:09.298 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.737383+0000", 2024-05-08T18:32:09.298 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0000000000000001e-06 2024-05-08T18:32:09.298 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.298 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.298 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:32:09.298 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.745323+0000", 2024-05-08T18:32:09.298 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0079403059999999994 2024-05-08T18:32:09.298 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.298 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.298 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:32:09.298 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.745364+0000", 2024-05-08T18:32:09.298 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.1012e-05 2024-05-08T18:32:09.298 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.299 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.299 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:32:09.299 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.745382+0000", 2024-05-08T18:32:09.299 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7960000000000001e-05 2024-05-08T18:32:09.299 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.299 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.299 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:32:09.299 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.745535+0000", 2024-05-08T18:32:09.299 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015250300000000001 2024-05-08T18:32:09.299 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.299 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.299 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:32:09.299 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.745577+0000", 2024-05-08T18:32:09.299 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.261e-05 2024-05-08T18:32:09.300 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.300 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.300 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:32:09.300 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.765288+0000", 2024-05-08T18:32:09.300 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019710380999999999 2024-05-08T18:32:09.300 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.300 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.300 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:32:09.300 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.765431+0000", 2024-05-08T18:32:09.300 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014277300000000001 2024-05-08T18:32:09.300 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:09.300 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:32:09.300 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:09.300 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.301 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.301 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4400.0:1911 3.18 3:1a3a3203:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_97:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:32:09.301 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-05-08T18:32:01.900176+0000", 2024-05-08T18:32:09.301 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 7.280134179, 2024-05-08T18:32:09.301 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.022745015, 2024-05-08T18:32:09.301 INFO:teuthology.orchestra.run.smithi097.stdout: "continuous": false, 2024-05-08T18:32:09.301 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-05-08T18:32:09.301 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:09.301 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-05-08T18:32:09.301 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4400", 2024-05-08T18:32:09.301 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:09.301 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1911 2024-05-08T18:32:09.301 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.302 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-05-08T18:32:09.302 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.302 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-05-08T18:32:09.302 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.900176+0000", 2024-05-08T18:32:09.302 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:09.302 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.302 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.302 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-05-08T18:32:09.302 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.900176+0000", 2024-05-08T18:32:09.302 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-05-08T18:32:09.302 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.302 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.302 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-05-08T18:32:09.303 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.900179+0000", 2024-05-08T18:32:09.303 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1980000000000001e-06 2024-05-08T18:32:09.303 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.303 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.303 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-05-08T18:32:09.303 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.903084+0000", 2024-05-08T18:32:09.303 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0029047249999999999 2024-05-08T18:32:09.303 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.303 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.304 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-05-08T18:32:09.304 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.903119+0000", 2024-05-08T18:32:09.304 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5562000000000003e-05 2024-05-08T18:32:09.304 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.304 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.304 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-05-08T18:32:09.304 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.903135+0000", 2024-05-08T18:32:09.304 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5353999999999999e-05 2024-05-08T18:32:09.304 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.304 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.304 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-05-08T18:32:09.304 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.903274+0000", 2024-05-08T18:32:09.304 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000139648 2024-05-08T18:32:09.304 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.305 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.305 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-05-08T18:32:09.305 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.903508+0000", 2024-05-08T18:32:09.305 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023379499999999999 2024-05-08T18:32:09.305 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.305 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.305 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 0", 2024-05-08T18:32:09.305 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.903748+0000", 2024-05-08T18:32:09.305 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024023499999999999 2024-05-08T18:32:09.305 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.305 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.305 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-05-08T18:32:09.305 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.911064+0000", 2024-05-08T18:32:09.305 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0073160960000000002 2024-05-08T18:32:09.306 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.306 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.306 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:09.306 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.922789+0000", 2024-05-08T18:32:09.306 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011724719 2024-05-08T18:32:09.306 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.306 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.306 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-05-08T18:32:09.306 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.922860+0000", 2024-05-08T18:32:09.306 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.0520999999999998e-05 2024-05-08T18:32:09.306 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-05-08T18:32:09.306 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-05-08T18:32:09.306 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-05-08T18:32:09.307 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-05-08T18:32:01.922921+0000", 2024-05-08T18:32:09.307 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1161999999999995e-05 2024-05-08T18:32:09.307 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:09.307 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:32:09.307 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:09.307 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-05-08T18:32:09.307 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-05-08T18:32:09.307 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:32:09.307 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2024-05-08T18:32:09.308 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:32:09.309 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-08T18:32:09.309 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2024-05-08T18:32:09.310 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:32:09.353 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:32:09.352+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:32:09.413 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:32:09.412+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:32:09.443 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:32:09.443 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:32:09.443 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 0 2024-05-08T18:32:09.443 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:32:09.457 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-08T18:32:09.514 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:32:09.512+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:32:09.575 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:32:09.575 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:32:09.575 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2024-05-08T18:32:09.575 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2024-05-08T18:32:09.575 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:32:09.589 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-08T18:32:09.615 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:32:09.612+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:32:09.716 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:32:09.717 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2024-05-08T18:32:09.717 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2024-05-08T18:32:09.717 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-05-08T18:32:09.717 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.717 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1315 3.2c e81/21 3:368ed9cc:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_1:head v 81'1, mlcod=0'0)", 2024-05-08T18:32:09.717 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.310943+0000", 2024-05-08T18:32:09.717 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 27.403289110999999, 2024-05-08T18:32:09.717 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019031756, 2024-05-08T18:32:09.717 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:09.717 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:09.717 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:09.717 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:09.718 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.718 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:09.718 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.310943+0000", 2024-05-08T18:32:09.718 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:09.718 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.718 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.718 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:09.718 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.310943+0000", 2024-05-08T18:32:09.718 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:09.718 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.718 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.718 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:09.718 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.310945+0000", 2024-05-08T18:32:09.718 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7800000000000001e-06 2024-05-08T18:32:09.719 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.719 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.719 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:09.719 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.315838+0000", 2024-05-08T18:32:09.719 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0048930800000000002 2024-05-08T18:32:09.719 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.719 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.719 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:09.719 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.315886+0000", 2024-05-08T18:32:09.719 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7336000000000002e-05 2024-05-08T18:32:09.720 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.720 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.720 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:09.720 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.315912+0000", 2024-05-08T18:32:09.720 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6584000000000002e-05 2024-05-08T18:32:09.720 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.720 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.720 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:09.720 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.316123+0000", 2024-05-08T18:32:09.720 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00021075400000000001 2024-05-08T18:32:09.721 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.721 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.721 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:09.721 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.316165+0000", 2024-05-08T18:32:09.721 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1709999999999999e-05 2024-05-08T18:32:09.721 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.721 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.721 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:09.721 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.329876+0000", 2024-05-08T18:32:09.721 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013710803000000001 2024-05-08T18:32:09.721 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.721 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.721 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:09.721 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.329974+0000", 2024-05-08T18:32:09.722 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8709000000000006e-05 2024-05-08T18:32:09.722 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:09.722 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:09.722 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:09.722 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.722 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.722 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1327 3.1a 3:58da5138:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-08T18:32:09.722 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.463447+0000", 2024-05-08T18:32:09.722 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 27.250784830000001, 2024-05-08T18:32:09.722 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018677618999999999, 2024-05-08T18:32:09.723 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:09.723 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:09.723 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:09.723 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:09.723 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:09.723 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:09.723 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1327 2024-05-08T18:32:09.723 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.723 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:09.723 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.723 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:09.723 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.463447+0000", 2024-05-08T18:32:09.723 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:09.724 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.724 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.724 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:09.724 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.463447+0000", 2024-05-08T18:32:09.724 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:09.724 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.724 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.724 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:09.724 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.463455+0000", 2024-05-08T18:32:09.724 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2430000000000005e-06 2024-05-08T18:32:09.724 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.724 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.724 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:09.724 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.469224+0000", 2024-05-08T18:32:09.725 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0057690830000000004 2024-05-08T18:32:09.725 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.725 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.725 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:09.725 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.469255+0000", 2024-05-08T18:32:09.725 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1000000000000001e-05 2024-05-08T18:32:09.725 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.725 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.725 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:09.725 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.469273+0000", 2024-05-08T18:32:09.725 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7920000000000001e-05 2024-05-08T18:32:09.725 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.725 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.725 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:09.726 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.469451+0000", 2024-05-08T18:32:09.726 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017836499999999999 2024-05-08T18:32:09.726 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.726 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.726 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:09.726 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.469687+0000", 2024-05-08T18:32:09.726 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000235255 2024-05-08T18:32:09.726 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.726 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.726 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:32:09.726 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.469899+0000", 2024-05-08T18:32:09.726 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00021257200000000001 2024-05-08T18:32:09.726 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.726 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.727 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:09.727 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.480590+0000", 2024-05-08T18:32:09.727 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010690963 2024-05-08T18:32:09.727 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.727 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.727 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:09.727 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.481813+0000", 2024-05-08T18:32:09.727 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001223001 2024-05-08T18:32:09.727 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.727 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.727 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:09.727 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.481982+0000", 2024-05-08T18:32:09.727 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016828500000000001 2024-05-08T18:32:09.727 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.728 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.728 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:09.728 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.482124+0000", 2024-05-08T18:32:09.728 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014293199999999999 2024-05-08T18:32:09.728 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:09.728 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:09.728 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:09.728 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.728 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.728 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1328 3.14 3:2b0d89be:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-08T18:32:09.728 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.473844+0000", 2024-05-08T18:32:09.728 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 27.240387941000002, 2024-05-08T18:32:09.728 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.031713811000000001, 2024-05-08T18:32:09.728 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:09.729 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:09.729 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:09.729 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:09.729 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:09.729 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:09.729 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1328 2024-05-08T18:32:09.729 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.729 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:09.729 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.729 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:09.730 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.473844+0000", 2024-05-08T18:32:09.730 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:09.730 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.730 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.730 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:09.730 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.473844+0000", 2024-05-08T18:32:09.730 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:09.730 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.731 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.731 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:09.731 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.473847+0000", 2024-05-08T18:32:09.731 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3100000000000001e-06 2024-05-08T18:32:09.731 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.731 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.731 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:09.731 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.479452+0000", 2024-05-08T18:32:09.732 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0056046910000000002 2024-05-08T18:32:09.732 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.732 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.732 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:09.732 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.479485+0000", 2024-05-08T18:32:09.732 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2808999999999997e-05 2024-05-08T18:32:09.732 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.732 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.733 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:09.733 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.479508+0000", 2024-05-08T18:32:09.733 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3119999999999999e-05 2024-05-08T18:32:09.733 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.733 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.733 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:09.733 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.479638+0000", 2024-05-08T18:32:09.733 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000130586 2024-05-08T18:32:09.734 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.734 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.734 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:09.734 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.479896+0000", 2024-05-08T18:32:09.734 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00025793799999999998 2024-05-08T18:32:09.734 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.734 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.734 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 7", 2024-05-08T18:32:09.735 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.480111+0000", 2024-05-08T18:32:09.735 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00021487200000000001 2024-05-08T18:32:09.735 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.735 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.735 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:09.735 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.502946+0000", 2024-05-08T18:32:09.735 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.022835101 2024-05-08T18:32:09.735 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.736 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.736 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:09.736 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.505389+0000", 2024-05-08T18:32:09.736 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0024426510000000001 2024-05-08T18:32:09.736 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.736 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.736 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:09.736 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.505479+0000", 2024-05-08T18:32:09.737 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.9863000000000003e-05 2024-05-08T18:32:09.737 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.737 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.737 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:09.737 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.505558+0000", 2024-05-08T18:32:09.737 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8869999999999995e-05 2024-05-08T18:32:09.737 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:09.737 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:09.738 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:09.738 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.738 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.738 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1332 3.14 3:2bdfae75:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-08T18:32:09.738 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.514410+0000", 2024-05-08T18:32:09.738 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 27.199821817, 2024-05-08T18:32:09.738 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.026281202, 2024-05-08T18:32:09.739 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:09.739 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:09.739 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:09.739 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:09.739 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:09.739 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:09.739 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1332 2024-05-08T18:32:09.739 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.739 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:09.740 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.740 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:09.740 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.514410+0000", 2024-05-08T18:32:09.740 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:09.740 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.740 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.740 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:09.740 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.514410+0000", 2024-05-08T18:32:09.741 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:09.741 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.741 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.741 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:09.741 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.514413+0000", 2024-05-08T18:32:09.741 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3160000000000001e-06 2024-05-08T18:32:09.741 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.741 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.742 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:09.742 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.519067+0000", 2024-05-08T18:32:09.742 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0046540319999999998 2024-05-08T18:32:09.742 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.742 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.742 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:09.742 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.519104+0000", 2024-05-08T18:32:09.742 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6890000000000001e-05 2024-05-08T18:32:09.743 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.743 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.743 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:09.743 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.519121+0000", 2024-05-08T18:32:09.743 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6583e-05 2024-05-08T18:32:09.743 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.743 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.743 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:09.743 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.519235+0000", 2024-05-08T18:32:09.744 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000114233 2024-05-08T18:32:09.744 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.744 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.744 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:09.744 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.519509+0000", 2024-05-08T18:32:09.744 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000274534 2024-05-08T18:32:09.744 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.744 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.744 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 7", 2024-05-08T18:32:09.744 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.519763+0000", 2024-05-08T18:32:09.744 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000253088 2024-05-08T18:32:09.744 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.744 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.745 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:09.745 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.532461+0000", 2024-05-08T18:32:09.745 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012698134 2024-05-08T18:32:09.745 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.745 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.745 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:09.745 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.540405+0000", 2024-05-08T18:32:09.745 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0079440699999999993 2024-05-08T18:32:09.745 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.745 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.745 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:09.745 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.540577+0000", 2024-05-08T18:32:09.745 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017180299999999999 2024-05-08T18:32:09.745 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.745 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.746 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:09.746 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.540691+0000", 2024-05-08T18:32:09.746 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011451900000000001 2024-05-08T18:32:09.746 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:09.746 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:09.746 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:09.746 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.746 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.746 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1370 3.9 3:91bbaad9:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_56:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:32:09.746 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.915888+0000", 2024-05-08T18:32:09.746 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 26.798343569, 2024-05-08T18:32:09.746 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.028543105999999999, 2024-05-08T18:32:09.747 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:09.747 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:09.747 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:09.747 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:09.747 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:09.747 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:09.747 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1370 2024-05-08T18:32:09.747 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.747 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:09.747 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.747 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:09.747 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.915888+0000", 2024-05-08T18:32:09.747 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:09.747 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.748 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.748 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:09.748 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.915888+0000", 2024-05-08T18:32:09.748 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:09.748 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.748 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.748 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:09.748 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.915892+0000", 2024-05-08T18:32:09.748 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1269999999999996e-06 2024-05-08T18:32:09.748 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.748 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.748 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:09.748 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.919887+0000", 2024-05-08T18:32:09.748 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039945529999999996 2024-05-08T18:32:09.749 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.749 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.749 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:09.749 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.919929+0000", 2024-05-08T18:32:09.749 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1832999999999997e-05 2024-05-08T18:32:09.749 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.749 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.749 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:09.749 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.919950+0000", 2024-05-08T18:32:09.749 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1197000000000001e-05 2024-05-08T18:32:09.749 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.749 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.749 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:09.749 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.920108+0000", 2024-05-08T18:32:09.750 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015827899999999999 2024-05-08T18:32:09.750 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.750 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.750 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:09.750 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.920401+0000", 2024-05-08T18:32:09.750 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029259799999999998 2024-05-08T18:32:09.750 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.750 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.750 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-05-08T18:32:09.750 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.920625+0000", 2024-05-08T18:32:09.750 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022383099999999999 2024-05-08T18:32:09.750 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.751 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.751 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:09.751 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.933935+0000", 2024-05-08T18:32:09.751 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013310298999999999 2024-05-08T18:32:09.751 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.751 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.751 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:09.751 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.944330+0000", 2024-05-08T18:32:09.751 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010395107000000001 2024-05-08T18:32:09.751 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.751 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.751 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:09.751 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.944383+0000", 2024-05-08T18:32:09.751 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2772000000000002e-05 2024-05-08T18:32:09.752 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.752 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.752 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:09.752 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.944431+0000", 2024-05-08T18:32:09.752 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8510000000000001e-05 2024-05-08T18:32:09.752 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:09.752 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:09.752 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:09.752 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.752 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.752 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1385 3.1a 3:5abdd61d:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_71:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:32:09.752 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:43.106312+0000", 2024-05-08T18:32:09.752 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 26.607919989999999, 2024-05-08T18:32:09.753 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018362961000000001, 2024-05-08T18:32:09.753 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:09.753 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:09.753 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:09.753 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:09.753 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:09.753 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:09.753 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1385 2024-05-08T18:32:09.753 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.753 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:09.753 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.753 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:09.753 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.106312+0000", 2024-05-08T18:32:09.753 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:09.753 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.754 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.754 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:09.754 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.106312+0000", 2024-05-08T18:32:09.754 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:09.754 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.754 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.754 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:09.754 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.106316+0000", 2024-05-08T18:32:09.754 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8739999999999997e-06 2024-05-08T18:32:09.754 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.754 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.754 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:09.754 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.110250+0000", 2024-05-08T18:32:09.755 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039342600000000002 2024-05-08T18:32:09.755 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.755 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.755 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:09.755 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.110289+0000", 2024-05-08T18:32:09.755 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8782999999999998e-05 2024-05-08T18:32:09.755 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.755 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.755 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:09.755 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.110306+0000", 2024-05-08T18:32:09.755 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7793000000000001e-05 2024-05-08T18:32:09.755 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.755 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.756 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:09.756 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.110454+0000", 2024-05-08T18:32:09.756 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014750899999999999 2024-05-08T18:32:09.756 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.756 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.756 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:09.756 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.110700+0000", 2024-05-08T18:32:09.756 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00024594500000000002 2024-05-08T18:32:09.756 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.756 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.756 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:32:09.756 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.110951+0000", 2024-05-08T18:32:09.756 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00025154499999999999 2024-05-08T18:32:09.756 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.757 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.757 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:09.757 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.120973+0000", 2024-05-08T18:32:09.757 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010021835999999999 2024-05-08T18:32:09.757 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.757 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.757 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:09.757 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.124583+0000", 2024-05-08T18:32:09.757 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0036096840000000002 2024-05-08T18:32:09.757 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.757 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.757 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:09.757 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.124630+0000", 2024-05-08T18:32:09.757 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7419000000000001e-05 2024-05-08T18:32:09.758 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.758 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.758 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:09.758 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.124675+0000", 2024-05-08T18:32:09.758 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4313000000000001e-05 2024-05-08T18:32:09.758 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:09.758 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:09.758 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:09.758 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.758 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.758 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1409 3.3 3:c39a24d8:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_95:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:32:09.758 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:43.363571+0000", 2024-05-08T18:32:09.759 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 26.350660499, 2024-05-08T18:32:09.759 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.021085779999999998, 2024-05-08T18:32:09.759 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:09.759 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:09.759 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:09.759 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:09.759 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:09.759 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:09.759 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1409 2024-05-08T18:32:09.760 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.760 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:09.760 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.760 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:09.760 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.363571+0000", 2024-05-08T18:32:09.760 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:09.760 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.760 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.760 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:09.760 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.363571+0000", 2024-05-08T18:32:09.760 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:09.760 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.761 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.761 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:09.761 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.363575+0000", 2024-05-08T18:32:09.761 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7579999999999998e-06 2024-05-08T18:32:09.761 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.761 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.761 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:09.761 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.368212+0000", 2024-05-08T18:32:09.761 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0046369269999999999 2024-05-08T18:32:09.761 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.761 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.761 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:09.761 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.368236+0000", 2024-05-08T18:32:09.762 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.442e-05 2024-05-08T18:32:09.762 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.762 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.762 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:09.762 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.368249+0000", 2024-05-08T18:32:09.762 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2451e-05 2024-05-08T18:32:09.762 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.762 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.762 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:09.762 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.368370+0000", 2024-05-08T18:32:09.762 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000121166 2024-05-08T18:32:09.762 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.762 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.762 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:09.763 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.368577+0000", 2024-05-08T18:32:09.763 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000207429 2024-05-08T18:32:09.763 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.763 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.763 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:32:09.763 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.368761+0000", 2024-05-08T18:32:09.763 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00018409599999999999 2024-05-08T18:32:09.763 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.763 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.763 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:09.763 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.379675+0000", 2024-05-08T18:32:09.763 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010913058999999999 2024-05-08T18:32:09.763 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.764 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.764 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:09.764 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.384574+0000", 2024-05-08T18:32:09.764 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.004899937 2024-05-08T18:32:09.764 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.764 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.764 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:09.764 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.384616+0000", 2024-05-08T18:32:09.764 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.2035e-05 2024-05-08T18:32:09.764 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.764 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.764 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:09.764 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.384657+0000", 2024-05-08T18:32:09.765 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0501999999999999e-05 2024-05-08T18:32:09.765 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:09.765 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:09.765 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:09.765 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.765 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.765 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1614 3.14 3:284b5d90:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-05-08T18:32:09.765 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:46.708825+0000", 2024-05-08T18:32:09.765 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 23.005406285999999, 2024-05-08T18:32:09.765 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.032864125000000001, 2024-05-08T18:32:09.765 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:09.765 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:09.765 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:09.766 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:09.766 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:09.766 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:09.766 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1614 2024-05-08T18:32:09.766 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.766 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:09.766 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.766 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:09.766 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.708825+0000", 2024-05-08T18:32:09.766 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:09.766 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.766 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.767 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:09.767 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.708825+0000", 2024-05-08T18:32:09.767 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:09.767 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.767 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.767 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:09.767 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.708828+0000", 2024-05-08T18:32:09.767 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6630000000000002e-06 2024-05-08T18:32:09.767 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.767 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.767 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:09.767 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.715671+0000", 2024-05-08T18:32:09.768 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.006842669 2024-05-08T18:32:09.768 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.768 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.768 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:09.768 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.715706+0000", 2024-05-08T18:32:09.768 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4872000000000001e-05 2024-05-08T18:32:09.768 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.768 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.768 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:09.768 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.715722+0000", 2024-05-08T18:32:09.768 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6670000000000001e-05 2024-05-08T18:32:09.768 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.768 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.768 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:09.769 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.715850+0000", 2024-05-08T18:32:09.769 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000127322 2024-05-08T18:32:09.769 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.769 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.769 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:09.769 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.716102+0000", 2024-05-08T18:32:09.769 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00025211899999999998 2024-05-08T18:32:09.769 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.769 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.769 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 7", 2024-05-08T18:32:09.769 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.716339+0000", 2024-05-08T18:32:09.769 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00023702099999999999 2024-05-08T18:32:09.769 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.770 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.770 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:09.770 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.737899+0000", 2024-05-08T18:32:09.770 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.021560414 2024-05-08T18:32:09.770 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.770 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.770 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:09.770 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.741414+0000", 2024-05-08T18:32:09.770 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0035152669999999999 2024-05-08T18:32:09.770 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.770 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.770 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:09.770 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.741571+0000", 2024-05-08T18:32:09.771 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015644500000000001 2024-05-08T18:32:09.771 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.771 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.771 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:09.771 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.741690+0000", 2024-05-08T18:32:09.771 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000118663 2024-05-08T18:32:09.771 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:09.771 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:09.771 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:09.771 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.771 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.771 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1622 3.11 e83/21 3:8a36e97a:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_10:head v 83'7, mlcod=82'5)", 2024-05-08T18:32:09.771 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:46.797808+0000", 2024-05-08T18:32:09.771 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 22.916424166999999, 2024-05-08T18:32:09.772 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019395200000000001, 2024-05-08T18:32:09.772 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:09.772 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:09.772 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:09.772 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:09.772 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.772 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:09.772 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.797808+0000", 2024-05-08T18:32:09.772 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:09.772 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.772 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.772 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:09.772 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.797808+0000", 2024-05-08T18:32:09.772 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:09.773 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.773 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.773 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:09.773 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.797810+0000", 2024-05-08T18:32:09.773 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9800000000000001e-06 2024-05-08T18:32:09.773 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.773 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.773 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:09.773 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.801567+0000", 2024-05-08T18:32:09.773 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0037578709999999999 2024-05-08T18:32:09.773 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.773 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.773 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:09.774 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.801610+0000", 2024-05-08T18:32:09.774 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3013000000000003e-05 2024-05-08T18:32:09.774 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.774 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.774 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:09.774 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.801628+0000", 2024-05-08T18:32:09.774 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7677e-05 2024-05-08T18:32:09.774 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.774 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.774 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:09.774 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.801798+0000", 2024-05-08T18:32:09.774 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000169548 2024-05-08T18:32:09.774 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.774 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.775 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:09.775 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.801836+0000", 2024-05-08T18:32:09.775 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.799e-05 2024-05-08T18:32:09.775 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.775 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.775 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:09.775 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.817068+0000", 2024-05-08T18:32:09.775 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015232671999999999 2024-05-08T18:32:09.775 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.775 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.775 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:09.775 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.817203+0000", 2024-05-08T18:32:09.775 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000134449 2024-05-08T18:32:09.775 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:09.776 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:09.776 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:09.776 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.776 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.776 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1629 3.24 e83/21 3:27d2a12f:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_17:head v 83'2, mlcod=0'0)", 2024-05-08T18:32:09.776 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:46.875375+0000", 2024-05-08T18:32:09.776 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 22.838856467999999, 2024-05-08T18:32:09.776 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017035814, 2024-05-08T18:32:09.776 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:09.776 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:09.776 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:09.776 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:09.776 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.776 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:09.777 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.875375+0000", 2024-05-08T18:32:09.777 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:09.777 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.777 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.777 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:09.777 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.875375+0000", 2024-05-08T18:32:09.777 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:09.777 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.777 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.777 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:09.777 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.875378+0000", 2024-05-08T18:32:09.777 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6029999999999999e-06 2024-05-08T18:32:09.777 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.777 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.778 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:09.778 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.880781+0000", 2024-05-08T18:32:09.778 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0054034319999999997 2024-05-08T18:32:09.778 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.778 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.778 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:09.778 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.880818+0000", 2024-05-08T18:32:09.778 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6303000000000001e-05 2024-05-08T18:32:09.778 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.778 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.778 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:09.778 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.880833+0000", 2024-05-08T18:32:09.778 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5852999999999999e-05 2024-05-08T18:32:09.778 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.779 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.779 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:09.779 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.880987+0000", 2024-05-08T18:32:09.779 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015368599999999999 2024-05-08T18:32:09.779 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.779 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.779 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:09.779 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.881053+0000", 2024-05-08T18:32:09.779 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6260000000000006e-05 2024-05-08T18:32:09.779 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.779 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.779 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:09.779 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.892244+0000", 2024-05-08T18:32:09.780 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011191002 2024-05-08T18:32:09.780 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.780 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.780 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:09.780 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.892411+0000", 2024-05-08T18:32:09.780 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000166675 2024-05-08T18:32:09.780 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:09.780 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:09.780 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:09.780 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.780 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.780 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1638 3.9 3:9152f27e:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5_100Mb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-05-08T18:32:09.780 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:46.965638+0000", 2024-05-08T18:32:09.781 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 22.748593796000002, 2024-05-08T18:32:09.781 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.021363499000000001, 2024-05-08T18:32:09.781 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:09.781 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:09.781 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:09.781 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:09.781 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:09.781 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:09.781 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1638 2024-05-08T18:32:09.781 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.782 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:09.782 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.782 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:09.782 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.965638+0000", 2024-05-08T18:32:09.782 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:09.782 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.782 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.782 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:09.782 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.965638+0000", 2024-05-08T18:32:09.782 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:09.783 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.783 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.783 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:09.783 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.965640+0000", 2024-05-08T18:32:09.783 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.68e-06 2024-05-08T18:32:09.783 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.783 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.783 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:09.783 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.969701+0000", 2024-05-08T18:32:09.783 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0040609870000000003 2024-05-08T18:32:09.783 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.783 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.783 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:09.783 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.969734+0000", 2024-05-08T18:32:09.784 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3460000000000002e-05 2024-05-08T18:32:09.784 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.784 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.784 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:09.784 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.969750+0000", 2024-05-08T18:32:09.784 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5919000000000001e-05 2024-05-08T18:32:09.784 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.784 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.784 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:09.784 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.969886+0000", 2024-05-08T18:32:09.784 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000135759 2024-05-08T18:32:09.784 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.784 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.784 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:09.785 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.970159+0000", 2024-05-08T18:32:09.785 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00027367199999999998 2024-05-08T18:32:09.785 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.785 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.785 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-05-08T18:32:09.785 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.971062+0000", 2024-05-08T18:32:09.785 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00090291000000000004 2024-05-08T18:32:09.785 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.785 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.785 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:09.785 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.983851+0000", 2024-05-08T18:32:09.785 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012788882999999999 2024-05-08T18:32:09.785 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.786 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.786 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:09.786 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.986511+0000", 2024-05-08T18:32:09.786 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0026593530000000002 2024-05-08T18:32:09.786 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.786 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.786 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:09.786 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.986843+0000", 2024-05-08T18:32:09.786 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00033259400000000002 2024-05-08T18:32:09.786 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.786 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.786 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:09.786 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.987001+0000", 2024-05-08T18:32:09.787 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015828199999999999 2024-05-08T18:32:09.787 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:09.787 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:09.787 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:09.787 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.787 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.787 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1823 3.27 e92/21 3:e6e611e5:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_9:head v 92'8, mlcod=82'6)", 2024-05-08T18:32:09.787 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:00.525337+0000", 2024-05-08T18:32:09.787 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 9.1888945460000002, 2024-05-08T18:32:09.787 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019529722999999999, 2024-05-08T18:32:09.787 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:09.787 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:09.787 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:09.787 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:09.788 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.788 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:09.788 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.525337+0000", 2024-05-08T18:32:09.788 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:09.788 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.788 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.788 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:09.788 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.525337+0000", 2024-05-08T18:32:09.788 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:09.788 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.788 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.788 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:09.788 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.525339+0000", 2024-05-08T18:32:09.788 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0269999999999998e-06 2024-05-08T18:32:09.789 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.789 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.789 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:09.789 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.530485+0000", 2024-05-08T18:32:09.789 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.005145368 2024-05-08T18:32:09.789 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.789 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.789 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:09.789 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.530519+0000", 2024-05-08T18:32:09.789 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4765999999999999e-05 2024-05-08T18:32:09.789 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.789 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.789 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:09.789 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.530534+0000", 2024-05-08T18:32:09.790 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4521999999999999e-05 2024-05-08T18:32:09.790 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.790 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.790 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:09.790 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.530698+0000", 2024-05-08T18:32:09.790 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016412100000000001 2024-05-08T18:32:09.790 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.790 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.790 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:09.790 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.530761+0000", 2024-05-08T18:32:09.790 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3373000000000005e-05 2024-05-08T18:32:09.790 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.790 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.790 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:09.791 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.544760+0000", 2024-05-08T18:32:09.791 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013998696999999999 2024-05-08T18:32:09.791 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.791 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.791 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:09.791 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.544867+0000", 2024-05-08T18:32:09.791 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010684900000000001 2024-05-08T18:32:09.791 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:09.791 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:09.791 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:09.791 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.791 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.791 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1825 3.3 3:c2847c2a:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-05-08T18:32:09.791 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:00.555863+0000", 2024-05-08T18:32:09.792 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 9.1583688589999994, 2024-05-08T18:32:09.792 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.025211702999999999, 2024-05-08T18:32:09.792 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:09.792 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:09.792 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:09.792 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:09.792 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:09.792 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:09.792 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1825 2024-05-08T18:32:09.792 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.792 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:09.792 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.792 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:09.792 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.555863+0000", 2024-05-08T18:32:09.793 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:09.793 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.793 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.793 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:09.793 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.555863+0000", 2024-05-08T18:32:09.793 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:09.793 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.793 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.793 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:09.793 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.555868+0000", 2024-05-08T18:32:09.793 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6829999999999999e-06 2024-05-08T18:32:09.793 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.794 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.794 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:09.794 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.563352+0000", 2024-05-08T18:32:09.794 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0074842199999999998 2024-05-08T18:32:09.794 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.794 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.794 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:09.794 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.563383+0000", 2024-05-08T18:32:09.794 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1393000000000003e-05 2024-05-08T18:32:09.794 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.794 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.794 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:09.794 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.563399+0000", 2024-05-08T18:32:09.795 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6064000000000001e-05 2024-05-08T18:32:09.795 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.795 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.795 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:09.795 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.563492+0000", 2024-05-08T18:32:09.795 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2532000000000001e-05 2024-05-08T18:32:09.795 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.795 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.795 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:09.795 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.563672+0000", 2024-05-08T18:32:09.795 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000180039 2024-05-08T18:32:09.795 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.796 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.796 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:32:09.796 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.563839+0000", 2024-05-08T18:32:09.796 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000166885 2024-05-08T18:32:09.796 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.796 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.796 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:09.796 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.571019+0000", 2024-05-08T18:32:09.796 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0071807019999999997 2024-05-08T18:32:09.796 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.796 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.796 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:09.796 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.580888+0000", 2024-05-08T18:32:09.796 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0098690099999999992 2024-05-08T18:32:09.797 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.797 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.797 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:09.797 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.580985+0000", 2024-05-08T18:32:09.797 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6809000000000001e-05 2024-05-08T18:32:09.797 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.797 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.797 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:09.797 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.581075+0000", 2024-05-08T18:32:09.797 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.9365999999999998e-05 2024-05-08T18:32:09.797 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:09.797 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:09.797 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:09.797 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.798 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.798 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1828 3.1a 3:5be2bca0:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-05-08T18:32:09.798 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:00.608482+0000", 2024-05-08T18:32:09.798 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 9.1057496160000007, 2024-05-08T18:32:09.798 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.01966685, 2024-05-08T18:32:09.798 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:09.798 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:09.798 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:09.798 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:09.798 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:09.798 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:09.798 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1828 2024-05-08T18:32:09.799 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.799 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:09.799 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.799 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:09.799 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.608482+0000", 2024-05-08T18:32:09.799 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:09.799 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.799 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.799 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:09.799 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.608482+0000", 2024-05-08T18:32:09.799 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:09.799 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.799 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.800 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:09.800 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.608484+0000", 2024-05-08T18:32:09.800 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.697e-06 2024-05-08T18:32:09.800 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.800 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.800 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:09.800 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.612311+0000", 2024-05-08T18:32:09.800 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0038267370000000002 2024-05-08T18:32:09.800 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.800 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.800 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:09.800 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.612326+0000", 2024-05-08T18:32:09.800 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5699e-05 2024-05-08T18:32:09.800 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.800 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.801 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:09.801 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.612335+0000", 2024-05-08T18:32:09.801 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.7220000000000005e-06 2024-05-08T18:32:09.801 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.801 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.801 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:09.801 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.612394+0000", 2024-05-08T18:32:09.801 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9175999999999997e-05 2024-05-08T18:32:09.801 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.801 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.801 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:09.801 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.612522+0000", 2024-05-08T18:32:09.801 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012789 2024-05-08T18:32:09.801 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.802 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.802 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:32:09.802 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.612637+0000", 2024-05-08T18:32:09.802 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000114929 2024-05-08T18:32:09.802 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.802 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.802 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:09.802 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.620934+0000", 2024-05-08T18:32:09.802 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0082972099999999993 2024-05-08T18:32:09.802 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.802 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.802 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:09.802 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.628071+0000", 2024-05-08T18:32:09.802 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0071364169999999999 2024-05-08T18:32:09.803 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.803 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.803 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:09.803 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.628115+0000", 2024-05-08T18:32:09.803 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.422e-05 2024-05-08T18:32:09.803 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.803 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.803 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:09.803 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.628149+0000", 2024-05-08T18:32:09.803 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4153000000000003e-05 2024-05-08T18:32:09.803 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:09.803 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:09.803 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:09.803 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.804 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.804 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1849 3.3 3:c2346235:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_35:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:32:09.804 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:00.854822+0000", 2024-05-08T18:32:09.804 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 8.8594096469999997, 2024-05-08T18:32:09.804 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017280277, 2024-05-08T18:32:09.804 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:09.804 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:09.804 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:09.804 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:09.804 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:09.804 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:09.804 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1849 2024-05-08T18:32:09.804 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.804 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:09.805 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.805 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:09.805 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.854822+0000", 2024-05-08T18:32:09.805 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:09.805 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.805 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.805 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:09.805 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.854822+0000", 2024-05-08T18:32:09.805 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:09.805 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.805 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.805 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:09.805 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.854825+0000", 2024-05-08T18:32:09.805 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2619999999999999e-06 2024-05-08T18:32:09.805 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.806 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.806 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:09.806 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.859589+0000", 2024-05-08T18:32:09.806 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0047639229999999998 2024-05-08T18:32:09.806 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.806 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.806 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:09.806 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.859608+0000", 2024-05-08T18:32:09.806 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8403e-05 2024-05-08T18:32:09.806 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.806 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.806 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:09.806 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.859617+0000", 2024-05-08T18:32:09.807 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7450000000000007e-06 2024-05-08T18:32:09.807 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.807 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.807 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:09.807 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.859696+0000", 2024-05-08T18:32:09.807 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8203999999999999e-05 2024-05-08T18:32:09.807 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.807 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.807 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:09.807 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.859833+0000", 2024-05-08T18:32:09.807 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013787200000000001 2024-05-08T18:32:09.807 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.808 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.808 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:32:09.808 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.859963+0000", 2024-05-08T18:32:09.808 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012955900000000001 2024-05-08T18:32:09.808 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.808 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.808 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:09.808 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.867417+0000", 2024-05-08T18:32:09.809 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0074540830000000002 2024-05-08T18:32:09.809 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.809 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.809 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:09.809 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.871952+0000", 2024-05-08T18:32:09.809 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0045347260000000002 2024-05-08T18:32:09.809 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.809 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.809 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:09.809 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.872040+0000", 2024-05-08T18:32:09.809 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.7733999999999997e-05 2024-05-08T18:32:09.809 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.809 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.810 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:09.810 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.872102+0000", 2024-05-08T18:32:09.810 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2766000000000002e-05 2024-05-08T18:32:09.810 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:09.810 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:09.810 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:09.810 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.810 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.810 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1861 3.f e93/21 3:f0b8f9d8:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_47:head v 93'9, mlcod=82'7)", 2024-05-08T18:32:09.810 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:01.007487+0000", 2024-05-08T18:32:09.810 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 8.7067449640000003, 2024-05-08T18:32:09.810 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019094574, 2024-05-08T18:32:09.811 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:09.811 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:09.811 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:09.811 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:09.811 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.811 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:09.811 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.007487+0000", 2024-05-08T18:32:09.811 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:09.811 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.811 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.811 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:09.811 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.007487+0000", 2024-05-08T18:32:09.811 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:09.811 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.812 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.812 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:09.812 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.007489+0000", 2024-05-08T18:32:09.812 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3e-06 2024-05-08T18:32:09.812 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.812 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.812 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:09.812 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.012420+0000", 2024-05-08T18:32:09.812 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0049307969999999998 2024-05-08T18:32:09.812 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.812 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.812 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:09.812 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.012459+0000", 2024-05-08T18:32:09.813 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9409000000000002e-05 2024-05-08T18:32:09.813 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.813 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.813 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:09.813 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.012485+0000", 2024-05-08T18:32:09.813 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5497e-05 2024-05-08T18:32:09.813 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.813 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.813 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:09.813 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.012689+0000", 2024-05-08T18:32:09.813 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000204305 2024-05-08T18:32:09.813 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.813 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.813 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:09.814 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.012743+0000", 2024-05-08T18:32:09.814 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3720000000000001e-05 2024-05-08T18:32:09.814 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.814 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.814 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:09.814 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.026516+0000", 2024-05-08T18:32:09.814 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013773453999999999 2024-05-08T18:32:09.814 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.814 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.814 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:09.814 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.026581+0000", 2024-05-08T18:32:09.814 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5092000000000006e-05 2024-05-08T18:32:09.814 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:09.815 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:09.815 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:09.815 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.815 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.815 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1862 3.1a 3:58694483:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_48:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:32:09.815 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:01.012507+0000", 2024-05-08T18:32:09.815 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 8.7017246020000005, 2024-05-08T18:32:09.815 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018337019, 2024-05-08T18:32:09.815 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:09.815 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:09.815 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:09.816 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:09.816 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:09.816 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:09.816 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1862 2024-05-08T18:32:09.816 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.816 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:09.816 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.816 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:09.816 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.012507+0000", 2024-05-08T18:32:09.816 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:09.816 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.816 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.816 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:09.816 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.012507+0000", 2024-05-08T18:32:09.817 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:09.817 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.817 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.817 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:09.817 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.012511+0000", 2024-05-08T18:32:09.817 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5889999999999999e-06 2024-05-08T18:32:09.817 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.817 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.817 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:09.817 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.016612+0000", 2024-05-08T18:32:09.817 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0041009239999999997 2024-05-08T18:32:09.817 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.817 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.817 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:09.817 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.016645+0000", 2024-05-08T18:32:09.818 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3599999999999997e-05 2024-05-08T18:32:09.818 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.818 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.818 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:09.818 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.016658+0000", 2024-05-08T18:32:09.818 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2836e-05 2024-05-08T18:32:09.818 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.818 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.818 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:09.818 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.016856+0000", 2024-05-08T18:32:09.818 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00019782900000000001 2024-05-08T18:32:09.818 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.818 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.819 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:09.819 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.017128+0000", 2024-05-08T18:32:09.819 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00027170200000000002 2024-05-08T18:32:09.819 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.819 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.819 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:32:09.819 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.017364+0000", 2024-05-08T18:32:09.819 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00023630799999999999 2024-05-08T18:32:09.819 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.819 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.819 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:09.819 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.029283+0000", 2024-05-08T18:32:09.819 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011919585999999999 2024-05-08T18:32:09.819 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.819 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.820 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:09.820 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.030640+0000", 2024-05-08T18:32:09.820 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001356033 2024-05-08T18:32:09.820 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.820 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.820 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:09.820 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.030736+0000", 2024-05-08T18:32:09.820 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6323000000000006e-05 2024-05-08T18:32:09.820 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.820 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.820 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:09.820 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.030844+0000", 2024-05-08T18:32:09.820 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010828900000000001 2024-05-08T18:32:09.821 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:09.821 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:09.821 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:09.821 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.821 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.821 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1864 3.9 3:93a63578:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_50:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:32:09.821 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:01.032831+0000", 2024-05-08T18:32:09.821 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 8.6814011479999991, 2024-05-08T18:32:09.821 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018526417, 2024-05-08T18:32:09.821 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:09.821 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:09.821 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:09.821 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:09.822 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:09.822 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:09.822 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1864 2024-05-08T18:32:09.822 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.822 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:09.822 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.822 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:09.822 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.032831+0000", 2024-05-08T18:32:09.822 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:09.822 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.822 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.822 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:09.823 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.032831+0000", 2024-05-08T18:32:09.823 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:09.823 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.823 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.823 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:09.823 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.032835+0000", 2024-05-08T18:32:09.823 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1529999999999999e-06 2024-05-08T18:32:09.823 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.823 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.823 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:09.823 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.036974+0000", 2024-05-08T18:32:09.823 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0041391049999999997 2024-05-08T18:32:09.824 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.824 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.824 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:09.824 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.037010+0000", 2024-05-08T18:32:09.824 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6253e-05 2024-05-08T18:32:09.824 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.824 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.824 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:09.824 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.037029+0000", 2024-05-08T18:32:09.824 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9334000000000002e-05 2024-05-08T18:32:09.824 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.824 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.824 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:09.825 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.037196+0000", 2024-05-08T18:32:09.825 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000166312 2024-05-08T18:32:09.825 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.825 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.825 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:09.825 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.037506+0000", 2024-05-08T18:32:09.825 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00030996700000000002 2024-05-08T18:32:09.825 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.825 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.825 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-05-08T18:32:09.825 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.037742+0000", 2024-05-08T18:32:09.825 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000236419 2024-05-08T18:32:09.825 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.825 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.826 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:09.826 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.049950+0000", 2024-05-08T18:32:09.826 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012207697999999999 2024-05-08T18:32:09.826 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.826 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.826 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:09.826 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.051181+0000", 2024-05-08T18:32:09.826 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001231408 2024-05-08T18:32:09.826 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.826 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.826 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:09.826 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.051281+0000", 2024-05-08T18:32:09.827 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.9499000000000004e-05 2024-05-08T18:32:09.827 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.827 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.827 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:09.827 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.051357+0000", 2024-05-08T18:32:09.827 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6268999999999998e-05 2024-05-08T18:32:09.827 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:09.827 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:09.827 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:09.827 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.827 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.827 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1900 3.34 3:2eec0dc7:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_86:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:32:09.827 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:01.684180+0000", 2024-05-08T18:32:09.827 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 8.0300521570000001, 2024-05-08T18:32:09.827 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.021863239, 2024-05-08T18:32:09.828 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:09.828 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:09.828 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:09.828 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:09.828 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:09.828 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:09.828 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1900 2024-05-08T18:32:09.828 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.828 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:09.828 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.828 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:09.828 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.684180+0000", 2024-05-08T18:32:09.828 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:09.828 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.829 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.829 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:09.829 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.684180+0000", 2024-05-08T18:32:09.829 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:09.829 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.829 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.829 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:09.829 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.684183+0000", 2024-05-08T18:32:09.829 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3160000000000001e-06 2024-05-08T18:32:09.829 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.829 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.829 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:09.829 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.689191+0000", 2024-05-08T18:32:09.829 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.005008317 2024-05-08T18:32:09.830 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.830 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.830 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:09.830 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.689231+0000", 2024-05-08T18:32:09.830 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9663000000000003e-05 2024-05-08T18:32:09.830 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.830 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.830 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:09.830 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.689255+0000", 2024-05-08T18:32:09.830 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.4275999999999999e-05 2024-05-08T18:32:09.830 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.830 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.830 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:09.830 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.689371+0000", 2024-05-08T18:32:09.831 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011611 2024-05-08T18:32:09.831 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.831 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.831 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:09.831 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.689488+0000", 2024-05-08T18:32:09.831 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000117063 2024-05-08T18:32:09.831 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.831 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.831 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:32:09.831 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.689585+0000", 2024-05-08T18:32:09.831 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6941000000000006e-05 2024-05-08T18:32:09.831 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.831 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.831 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:09.832 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.703523+0000", 2024-05-08T18:32:09.832 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013938061999999999 2024-05-08T18:32:09.832 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.832 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.832 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:09.832 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.705847+0000", 2024-05-08T18:32:09.832 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0023240719999999999 2024-05-08T18:32:09.832 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.832 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.832 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:09.832 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.705966+0000", 2024-05-08T18:32:09.832 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011906899999999999 2024-05-08T18:32:09.832 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.833 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.833 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:09.833 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.706043+0000", 2024-05-08T18:32:09.833 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6349999999999999e-05 2024-05-08T18:32:09.833 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:09.833 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:09.833 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:09.833 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.833 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.833 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1907 3.34 3:2f5137c7:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_93:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:32:09.833 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:01.831860+0000", 2024-05-08T18:32:09.833 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 7.882371515, 2024-05-08T18:32:09.833 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.030884407999999999, 2024-05-08T18:32:09.833 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:09.834 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:09.834 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:09.834 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:09.834 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:09.834 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:09.834 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1907 2024-05-08T18:32:09.834 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.834 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:09.834 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.834 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:09.834 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.831860+0000", 2024-05-08T18:32:09.834 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:09.834 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.835 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.835 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:09.835 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.831860+0000", 2024-05-08T18:32:09.835 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:09.835 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.835 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.835 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:09.835 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.831863+0000", 2024-05-08T18:32:09.835 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6989999999999999e-06 2024-05-08T18:32:09.835 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.835 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.835 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:09.835 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.836003+0000", 2024-05-08T18:32:09.835 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0041399799999999997 2024-05-08T18:32:09.836 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.836 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.836 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:09.836 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.836043+0000", 2024-05-08T18:32:09.836 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0216999999999998e-05 2024-05-08T18:32:09.836 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.836 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.836 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:09.836 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.836062+0000", 2024-05-08T18:32:09.836 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8612999999999999e-05 2024-05-08T18:32:09.836 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.836 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.836 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:09.836 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.836256+0000", 2024-05-08T18:32:09.837 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00019403500000000001 2024-05-08T18:32:09.837 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.837 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.837 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:09.837 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.836501+0000", 2024-05-08T18:32:09.837 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00024500500000000002 2024-05-08T18:32:09.837 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.837 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.837 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:32:09.837 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.836731+0000", 2024-05-08T18:32:09.837 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00023071800000000001 2024-05-08T18:32:09.837 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.837 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.837 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:09.838 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.861762+0000", 2024-05-08T18:32:09.838 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.025030793999999999 2024-05-08T18:32:09.838 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.838 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.838 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:09.838 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.862626+0000", 2024-05-08T18:32:09.838 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00086390100000000004 2024-05-08T18:32:09.838 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.838 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.838 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:09.838 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.862694+0000", 2024-05-08T18:32:09.838 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7384000000000004e-05 2024-05-08T18:32:09.838 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:09.839 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:09.839 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:09.839 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.862745+0000", 2024-05-08T18:32:09.839 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1062e-05 2024-05-08T18:32:09.839 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:09.839 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:09.839 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:09.839 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:09.839 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:09.839 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:32:09.840 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:32:09.716+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:32:09.842 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-08T18:32:09.842 INFO:teuthology.orchestra.run.smithi097.stderr:nodeep-scrub is unset 2024-05-08T18:32:09.842 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:32:09.840+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:32:09.942 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:32:09.940+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:32:09.968 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:32:09.968 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:32:09.968 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 0 2024-05-08T18:32:09.968 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:32:09.982 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-08T18:32:10.043 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:32:10.040+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:32:10.098 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:32:10.098 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:32:10.098 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2024-05-08T18:32:10.098 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2024-05-08T18:32:10.098 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:32:10.112 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-08T18:32:10.143 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:32:10.140+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:32:10.231 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:32:10.232 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2024-05-08T18:32:10.232 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2024-05-08T18:32:10.232 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-05-08T18:32:10.232 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.232 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1234 3.38 e80/21 3:1cb36fa1:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.2__shadow_.fYaqa8o34qSAauLRSqi3iwpmT5NwV5c_1:head v 80'1, mlcod=0'0)", 2024-05-08T18:32:10.232 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:38.217418+0000", 2024-05-08T18:32:10.232 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 32.014053351000001, 2024-05-08T18:32:10.232 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.02469151, 2024-05-08T18:32:10.232 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:10.232 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:10.232 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:10.232 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:10.232 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.232 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:10.233 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.217418+0000", 2024-05-08T18:32:10.233 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:10.233 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.233 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.233 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:10.233 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.217418+0000", 2024-05-08T18:32:10.233 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:10.233 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.233 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.233 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:10.233 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.217420+0000", 2024-05-08T18:32:10.233 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9970000000000001e-06 2024-05-08T18:32:10.233 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.233 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.234 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:10.234 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.225957+0000", 2024-05-08T18:32:10.234 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0085373180000000003 2024-05-08T18:32:10.234 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.234 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.234 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:10.234 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.226002+0000", 2024-05-08T18:32:10.234 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4462999999999998e-05 2024-05-08T18:32:10.234 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.234 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.234 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:10.234 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.226036+0000", 2024-05-08T18:32:10.234 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4286999999999999e-05 2024-05-08T18:32:10.235 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.235 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.235 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:10.235 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.226204+0000", 2024-05-08T18:32:10.235 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000168219 2024-05-08T18:32:10.235 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.235 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.235 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:10.235 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.226269+0000", 2024-05-08T18:32:10.235 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4858999999999997e-05 2024-05-08T18:32:10.235 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.235 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.235 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:10.235 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.242001+0000", 2024-05-08T18:32:10.236 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015731898000000001 2024-05-08T18:32:10.236 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.236 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.236 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:10.236 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.242109+0000", 2024-05-08T18:32:10.236 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010846899999999999 2024-05-08T18:32:10.236 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:10.236 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:10.236 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:10.236 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.236 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.236 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1237 3.c 3:3156de39:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.2_10Mb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (355) in=17b,setxattr user.rgw.acl (129) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-05-08T18:32:10.236 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:38.244592+0000", 2024-05-08T18:32:10.236 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 31.986879046999999, 2024-05-08T18:32:10.236 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.021467379000000002, 2024-05-08T18:32:10.237 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:10.237 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:10.237 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:10.237 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:10.237 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:10.237 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:10.237 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1237 2024-05-08T18:32:10.237 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.237 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:10.237 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.237 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:10.237 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.244592+0000", 2024-05-08T18:32:10.238 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:10.238 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.238 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.238 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:10.238 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.244592+0000", 2024-05-08T18:32:10.238 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:10.238 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.238 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.238 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:10.238 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.244599+0000", 2024-05-08T18:32:10.238 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3170000000000004e-06 2024-05-08T18:32:10.238 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.238 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.239 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:10.239 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.250239+0000", 2024-05-08T18:32:10.239 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0056396270000000004 2024-05-08T18:32:10.239 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.239 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.239 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:10.239 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.250279+0000", 2024-05-08T18:32:10.239 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0370000000000001e-05 2024-05-08T18:32:10.239 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.239 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.239 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:10.239 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.250305+0000", 2024-05-08T18:32:10.239 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5259999999999999e-05 2024-05-08T18:32:10.239 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.239 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.240 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:10.240 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.250509+0000", 2024-05-08T18:32:10.240 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020390800000000001 2024-05-08T18:32:10.240 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.240 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.240 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:10.240 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.250777+0000", 2024-05-08T18:32:10.240 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00026804200000000002 2024-05-08T18:32:10.240 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.240 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.240 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 3", 2024-05-08T18:32:10.240 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.251654+0000", 2024-05-08T18:32:10.240 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00087763999999999995 2024-05-08T18:32:10.241 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.241 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.241 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:10.241 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.263070+0000", 2024-05-08T18:32:10.241 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011415544 2024-05-08T18:32:10.241 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.241 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.241 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:10.241 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.265866+0000", 2024-05-08T18:32:10.241 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002795699 2024-05-08T18:32:10.241 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.241 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.241 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:10.241 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.265975+0000", 2024-05-08T18:32:10.242 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000109819 2024-05-08T18:32:10.242 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.242 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.242 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:10.242 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.266060+0000", 2024-05-08T18:32:10.242 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4153000000000006e-05 2024-05-08T18:32:10.242 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:10.242 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:10.242 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:10.242 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.242 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.242 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1318 3.c 3:329e59e6:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-08T18:32:10.242 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.337285+0000", 2024-05-08T18:32:10.243 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 27.894186624, 2024-05-08T18:32:10.243 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.024126754, 2024-05-08T18:32:10.243 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:10.243 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:10.243 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:10.243 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:10.243 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:10.243 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:10.243 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1318 2024-05-08T18:32:10.243 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.243 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:10.243 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.243 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:10.243 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.337285+0000", 2024-05-08T18:32:10.244 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:10.244 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.244 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.244 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:10.244 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.337285+0000", 2024-05-08T18:32:10.244 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:10.244 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.244 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.245 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:10.245 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.337288+0000", 2024-05-08T18:32:10.245 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6799999999999999e-06 2024-05-08T18:32:10.245 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.245 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.245 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:10.245 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.343559+0000", 2024-05-08T18:32:10.245 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0062709920000000004 2024-05-08T18:32:10.245 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.245 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.245 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:10.245 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.343600+0000", 2024-05-08T18:32:10.246 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0686000000000003e-05 2024-05-08T18:32:10.246 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.246 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.246 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:10.246 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.343621+0000", 2024-05-08T18:32:10.246 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1364000000000001e-05 2024-05-08T18:32:10.246 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.246 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.246 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:10.246 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.343774+0000", 2024-05-08T18:32:10.246 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000152495 2024-05-08T18:32:10.246 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.246 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.246 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:10.247 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.344025+0000", 2024-05-08T18:32:10.247 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00025118800000000001 2024-05-08T18:32:10.247 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.247 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.247 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 3", 2024-05-08T18:32:10.247 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.344259+0000", 2024-05-08T18:32:10.247 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000234455 2024-05-08T18:32:10.247 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.247 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.247 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:10.247 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.357786+0000", 2024-05-08T18:32:10.247 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013526338000000001 2024-05-08T18:32:10.247 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.248 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.248 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:10.248 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.361116+0000", 2024-05-08T18:32:10.248 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0033298619999999998 2024-05-08T18:32:10.248 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.248 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.248 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:10.248 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.361290+0000", 2024-05-08T18:32:10.248 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017451200000000001 2024-05-08T18:32:10.249 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.249 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.249 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:10.249 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.361411+0000", 2024-05-08T18:32:10.249 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012118200000000001 2024-05-08T18:32:10.249 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:10.249 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:10.249 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:10.249 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.249 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.249 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1324 3.3a 3:5fe59963:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-08T18:32:10.249 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.429632+0000", 2024-05-08T18:32:10.249 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 27.801838920000002, 2024-05-08T18:32:10.250 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019556068999999999, 2024-05-08T18:32:10.250 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:10.250 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:10.250 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:10.250 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:10.250 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:10.250 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:10.250 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1324 2024-05-08T18:32:10.250 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.250 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:10.250 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.250 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:10.250 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.429632+0000", 2024-05-08T18:32:10.251 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:10.251 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.251 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.251 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:10.251 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.429632+0000", 2024-05-08T18:32:10.251 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:10.251 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.251 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.251 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:10.251 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.429636+0000", 2024-05-08T18:32:10.251 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9060000000000004e-06 2024-05-08T18:32:10.251 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.251 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.251 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:10.252 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.434488+0000", 2024-05-08T18:32:10.252 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0048521270000000003 2024-05-08T18:32:10.252 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.252 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.252 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:10.252 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.434529+0000", 2024-05-08T18:32:10.252 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0365999999999999e-05 2024-05-08T18:32:10.252 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.252 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.252 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:10.252 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.434548+0000", 2024-05-08T18:32:10.252 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8893999999999999e-05 2024-05-08T18:32:10.252 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.252 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.253 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:10.253 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.434680+0000", 2024-05-08T18:32:10.253 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000132285 2024-05-08T18:32:10.253 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.253 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.253 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:10.253 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.434925+0000", 2024-05-08T18:32:10.253 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00024557799999999999 2024-05-08T18:32:10.253 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.253 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.253 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:32:10.253 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.435148+0000", 2024-05-08T18:32:10.253 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022281800000000001 2024-05-08T18:32:10.254 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.254 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.254 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:10.254 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.447529+0000", 2024-05-08T18:32:10.254 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012380584 2024-05-08T18:32:10.254 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.254 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.254 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:10.254 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.448987+0000", 2024-05-08T18:32:10.254 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0014577189999999999 2024-05-08T18:32:10.254 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.254 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.254 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:10.254 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.449113+0000", 2024-05-08T18:32:10.255 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000126482 2024-05-08T18:32:10.255 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.255 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.255 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:10.255 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.449188+0000", 2024-05-08T18:32:10.255 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5309999999999996e-05 2024-05-08T18:32:10.255 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:10.255 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:10.255 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:10.255 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.255 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.255 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1350 3.3a 3:5caef9cc:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_36:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:32:10.255 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.707170+0000", 2024-05-08T18:32:10.255 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 27.524301317999999, 2024-05-08T18:32:10.256 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.02479787, 2024-05-08T18:32:10.256 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:10.256 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:10.256 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:10.256 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:10.256 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:10.256 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:10.258 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1350 2024-05-08T18:32:10.258 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.258 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:10.258 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.258 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:10.259 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.707170+0000", 2024-05-08T18:32:10.259 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:10.259 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.259 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.259 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:10.259 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.707170+0000", 2024-05-08T18:32:10.259 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:10.259 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.259 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.259 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:10.259 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.707174+0000", 2024-05-08T18:32:10.259 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6629999999999999e-06 2024-05-08T18:32:10.259 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.259 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.260 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:10.260 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.713406+0000", 2024-05-08T18:32:10.260 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0062328030000000003 2024-05-08T18:32:10.260 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.260 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.260 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:10.260 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.713446+0000", 2024-05-08T18:32:10.260 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9990000000000002e-05 2024-05-08T18:32:10.260 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.260 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.260 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:10.260 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.713466+0000", 2024-05-08T18:32:10.261 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0136000000000002e-05 2024-05-08T18:32:10.261 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.261 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.261 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:10.261 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.713609+0000", 2024-05-08T18:32:10.261 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014227599999999999 2024-05-08T18:32:10.261 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.261 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.261 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:10.261 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.713871+0000", 2024-05-08T18:32:10.261 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000261885 2024-05-08T18:32:10.261 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.261 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.262 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:32:10.262 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.714152+0000", 2024-05-08T18:32:10.262 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00028181099999999998 2024-05-08T18:32:10.262 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.262 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.262 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:10.262 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.723750+0000", 2024-05-08T18:32:10.262 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0095972739999999994 2024-05-08T18:32:10.262 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.262 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.262 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:10.262 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.731740+0000", 2024-05-08T18:32:10.262 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0079900969999999998 2024-05-08T18:32:10.263 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.263 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.263 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:10.263 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.731843+0000", 2024-05-08T18:32:10.263 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000103052 2024-05-08T18:32:10.263 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.263 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.263 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:10.263 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.731968+0000", 2024-05-08T18:32:10.263 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000124883 2024-05-08T18:32:10.263 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:10.263 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:10.263 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:10.263 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.264 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.264 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1355 3.28 3:14052413:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_41:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:32:10.264 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.762527+0000", 2024-05-08T18:32:10.264 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 27.468943755000002, 2024-05-08T18:32:10.264 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.026016406999999998, 2024-05-08T18:32:10.264 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:10.264 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:10.264 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:10.264 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:10.264 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:10.264 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:10.264 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1355 2024-05-08T18:32:10.264 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.264 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:10.265 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.265 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:10.265 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.762527+0000", 2024-05-08T18:32:10.265 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:10.265 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.265 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.265 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:10.265 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.762527+0000", 2024-05-08T18:32:10.265 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:10.265 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.265 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.265 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:10.265 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.762545+0000", 2024-05-08T18:32:10.265 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7045999999999999e-05 2024-05-08T18:32:10.266 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.266 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.266 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:10.266 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.767178+0000", 2024-05-08T18:32:10.266 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0046339420000000003 2024-05-08T18:32:10.266 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.266 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.266 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:10.266 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.767214+0000", 2024-05-08T18:32:10.266 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5855999999999997e-05 2024-05-08T18:32:10.266 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.266 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.266 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:10.266 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.767242+0000", 2024-05-08T18:32:10.267 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8113e-05 2024-05-08T18:32:10.267 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.267 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.267 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:10.267 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.767401+0000", 2024-05-08T18:32:10.267 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000158429 2024-05-08T18:32:10.267 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.267 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.267 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:10.267 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.767648+0000", 2024-05-08T18:32:10.267 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000247328 2024-05-08T18:32:10.267 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.267 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.267 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 3", 2024-05-08T18:32:10.268 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.767899+0000", 2024-05-08T18:32:10.268 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00025059799999999999 2024-05-08T18:32:10.268 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.268 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.268 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:10.268 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.780702+0000", 2024-05-08T18:32:10.268 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012803238 2024-05-08T18:32:10.268 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.268 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.268 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:10.268 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.788231+0000", 2024-05-08T18:32:10.268 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0075285090000000001 2024-05-08T18:32:10.268 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.269 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.269 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:10.269 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.788402+0000", 2024-05-08T18:32:10.269 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017113299999999999 2024-05-08T18:32:10.269 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.269 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.269 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:10.269 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.788544+0000", 2024-05-08T18:32:10.269 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014221500000000001 2024-05-08T18:32:10.269 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:10.269 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:10.269 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:10.269 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.269 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.269 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1377 3.28 3:1730bdaf:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_63:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:32:10.270 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.996763+0000", 2024-05-08T18:32:10.270 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 27.234708607000002, 2024-05-08T18:32:10.270 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.02215497, 2024-05-08T18:32:10.270 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:10.270 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:10.270 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:10.270 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:10.270 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:10.270 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:10.270 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1377 2024-05-08T18:32:10.270 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.270 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:10.270 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.271 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:10.271 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.996763+0000", 2024-05-08T18:32:10.271 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:10.271 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.271 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.271 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:10.271 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.996763+0000", 2024-05-08T18:32:10.271 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:10.271 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.271 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.271 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:10.271 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.996766+0000", 2024-05-08T18:32:10.271 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.9299999999999999e-06 2024-05-08T18:32:10.271 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.272 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.272 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:10.272 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.002222+0000", 2024-05-08T18:32:10.272 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0054559819999999998 2024-05-08T18:32:10.272 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.272 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.272 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:10.272 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.002259+0000", 2024-05-08T18:32:10.272 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7222999999999999e-05 2024-05-08T18:32:10.272 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.272 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.272 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:10.272 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.002277+0000", 2024-05-08T18:32:10.272 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8607e-05 2024-05-08T18:32:10.273 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.273 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.273 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:10.273 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.002484+0000", 2024-05-08T18:32:10.273 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020670500000000001 2024-05-08T18:32:10.273 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.273 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.273 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:10.273 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.002843+0000", 2024-05-08T18:32:10.273 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00035888100000000002 2024-05-08T18:32:10.273 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.273 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.273 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 3", 2024-05-08T18:32:10.274 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.003165+0000", 2024-05-08T18:32:10.274 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00032193 2024-05-08T18:32:10.274 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.274 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.274 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:10.274 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.011993+0000", 2024-05-08T18:32:10.274 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.008827718 2024-05-08T18:32:10.274 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.274 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.274 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:10.274 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.018733+0000", 2024-05-08T18:32:10.274 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.006739989 2024-05-08T18:32:10.274 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.275 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.275 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:10.275 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.018840+0000", 2024-05-08T18:32:10.275 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000107799 2024-05-08T18:32:10.275 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.275 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.275 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:10.275 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.018918+0000", 2024-05-08T18:32:10.275 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.7206000000000006e-05 2024-05-08T18:32:10.275 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:10.275 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:10.275 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:10.275 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.276 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.276 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1407 3.22 3:46b64ebe:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_93:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:32:10.276 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:43.343033+0000", 2024-05-08T18:32:10.276 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 26.888438260000001, 2024-05-08T18:32:10.276 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.022710952, 2024-05-08T18:32:10.276 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:10.276 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:10.276 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:10.276 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:10.276 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:10.276 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:10.276 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1407 2024-05-08T18:32:10.276 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.276 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:10.277 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.277 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:10.277 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.343033+0000", 2024-05-08T18:32:10.277 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:10.277 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.277 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.277 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:10.277 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.343033+0000", 2024-05-08T18:32:10.277 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:10.277 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.277 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.277 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:10.277 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.343035+0000", 2024-05-08T18:32:10.277 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5100000000000001e-06 2024-05-08T18:32:10.278 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.278 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.278 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:10.278 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.346921+0000", 2024-05-08T18:32:10.278 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0038850489999999998 2024-05-08T18:32:10.278 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.278 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.278 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:10.278 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.346943+0000", 2024-05-08T18:32:10.278 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2897000000000001e-05 2024-05-08T18:32:10.278 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.278 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.279 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:10.279 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.346956+0000", 2024-05-08T18:32:10.279 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2159e-05 2024-05-08T18:32:10.279 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.279 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.279 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:10.279 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.347033+0000", 2024-05-08T18:32:10.279 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.7898000000000005e-05 2024-05-08T18:32:10.279 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.279 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.279 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:10.279 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.347179+0000", 2024-05-08T18:32:10.279 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014600400000000001 2024-05-08T18:32:10.280 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.280 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.280 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 3", 2024-05-08T18:32:10.280 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.347304+0000", 2024-05-08T18:32:10.280 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012491100000000001 2024-05-08T18:32:10.280 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.280 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.280 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:10.280 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.355666+0000", 2024-05-08T18:32:10.280 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0083618319999999996 2024-05-08T18:32:10.280 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.280 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.280 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:10.281 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.365667+0000", 2024-05-08T18:32:10.281 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010000289000000001 2024-05-08T18:32:10.281 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.281 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.281 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:10.281 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.365709+0000", 2024-05-08T18:32:10.281 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.2549000000000002e-05 2024-05-08T18:32:10.281 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.281 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.281 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:10.281 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.365744+0000", 2024-05-08T18:32:10.281 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4854000000000002e-05 2024-05-08T18:32:10.281 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:10.281 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:10.282 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:10.282 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.282 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.282 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1413 3.2f 3:f6ed8c1f:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_99:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:32:10.282 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:43.405307+0000", 2024-05-08T18:32:10.282 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 26.826164471999999, 2024-05-08T18:32:10.282 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.025254335999999999, 2024-05-08T18:32:10.282 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:10.282 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:10.282 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:10.282 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:10.282 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:10.282 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:10.283 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1413 2024-05-08T18:32:10.283 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.283 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:10.283 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.283 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:10.283 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.405307+0000", 2024-05-08T18:32:10.283 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:10.283 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.283 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.283 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:10.283 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.405307+0000", 2024-05-08T18:32:10.283 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:10.283 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.283 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.284 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:10.284 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.405310+0000", 2024-05-08T18:32:10.284 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0800000000000002e-06 2024-05-08T18:32:10.284 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.284 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.284 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:10.284 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.411517+0000", 2024-05-08T18:32:10.284 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0062069270000000001 2024-05-08T18:32:10.284 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.284 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.284 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:10.284 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.411551+0000", 2024-05-08T18:32:10.285 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4579000000000002e-05 2024-05-08T18:32:10.285 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.285 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.285 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:10.285 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.411570+0000", 2024-05-08T18:32:10.285 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8179999999999999e-05 2024-05-08T18:32:10.285 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.285 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.285 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:10.285 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.411654+0000", 2024-05-08T18:32:10.285 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4708000000000003e-05 2024-05-08T18:32:10.285 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.285 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.286 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:10.286 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.411768+0000", 2024-05-08T18:32:10.286 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000114176 2024-05-08T18:32:10.286 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.286 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.286 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 7", 2024-05-08T18:32:10.286 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.411864+0000", 2024-05-08T18:32:10.286 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.5637000000000006e-05 2024-05-08T18:32:10.286 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.286 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.286 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:10.286 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.420357+0000", 2024-05-08T18:32:10.286 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0084934529999999998 2024-05-08T18:32:10.286 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.287 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.287 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:10.287 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.430427+0000", 2024-05-08T18:32:10.287 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010069855000000001 2024-05-08T18:32:10.287 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.287 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.287 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:10.287 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.430501+0000", 2024-05-08T18:32:10.287 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3613000000000001e-05 2024-05-08T18:32:10.287 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.287 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.287 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:10.287 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.430561+0000", 2024-05-08T18:32:10.288 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.0127999999999998e-05 2024-05-08T18:32:10.288 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:10.288 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:10.288 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:10.288 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.288 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.288 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1615 3.35 e83/21 3:ae758c88:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_3:head v 83'7, mlcod=82'5)", 2024-05-08T18:32:10.288 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:46.729645+0000", 2024-05-08T18:32:10.288 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 23.501825829000001, 2024-05-08T18:32:10.288 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.022764072, 2024-05-08T18:32:10.288 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:10.288 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:10.288 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:10.289 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:10.289 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.289 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:10.289 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.729645+0000", 2024-05-08T18:32:10.289 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:10.289 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.289 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.289 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:10.289 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.729645+0000", 2024-05-08T18:32:10.289 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:10.289 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.289 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.290 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:10.290 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.729649+0000", 2024-05-08T18:32:10.290 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3830000000000001e-06 2024-05-08T18:32:10.290 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.290 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.290 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:10.290 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.734571+0000", 2024-05-08T18:32:10.290 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0049222600000000004 2024-05-08T18:32:10.290 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.290 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.290 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:10.290 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.734611+0000", 2024-05-08T18:32:10.291 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9969000000000003e-05 2024-05-08T18:32:10.291 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.291 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.291 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:10.291 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.734629+0000", 2024-05-08T18:32:10.291 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7827000000000001e-05 2024-05-08T18:32:10.291 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.291 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.291 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:10.291 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.734800+0000", 2024-05-08T18:32:10.291 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000170929 2024-05-08T18:32:10.291 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.291 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.292 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:10.292 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.734867+0000", 2024-05-08T18:32:10.292 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6952000000000005e-05 2024-05-08T18:32:10.292 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.292 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.292 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:10.292 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.752282+0000", 2024-05-08T18:32:10.292 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017415669000000002 2024-05-08T18:32:10.292 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.292 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.292 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:10.292 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.752409+0000", 2024-05-08T18:32:10.292 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000127083 2024-05-08T18:32:10.292 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:10.293 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:10.293 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:10.293 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.293 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.293 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1618 3.1c 3:3b36ad14:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-05-08T18:32:10.293 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:46.750394+0000", 2024-05-08T18:32:10.293 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 23.481077634999998, 2024-05-08T18:32:10.293 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.023322207000000001, 2024-05-08T18:32:10.293 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:10.293 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:10.293 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:10.293 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:10.293 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:10.293 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:10.293 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1618 2024-05-08T18:32:10.294 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.294 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:10.294 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.294 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:10.294 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.750394+0000", 2024-05-08T18:32:10.294 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:10.294 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.294 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.294 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:10.294 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.750394+0000", 2024-05-08T18:32:10.294 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:10.294 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.294 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.294 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:10.295 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.750399+0000", 2024-05-08T18:32:10.295 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9760000000000003e-06 2024-05-08T18:32:10.295 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.295 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.295 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:10.295 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.756899+0000", 2024-05-08T18:32:10.295 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0065001809999999998 2024-05-08T18:32:10.295 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.295 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.295 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:10.295 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.756936+0000", 2024-05-08T18:32:10.295 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7716000000000003e-05 2024-05-08T18:32:10.295 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.295 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.295 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:10.296 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.756955+0000", 2024-05-08T18:32:10.296 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8196999999999999e-05 2024-05-08T18:32:10.296 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.296 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.296 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:10.296 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.757132+0000", 2024-05-08T18:32:10.296 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017692200000000001 2024-05-08T18:32:10.296 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.296 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.296 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:10.296 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.757531+0000", 2024-05-08T18:32:10.296 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00039989700000000002 2024-05-08T18:32:10.296 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.296 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.297 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 4", 2024-05-08T18:32:10.297 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.757770+0000", 2024-05-08T18:32:10.297 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000238908 2024-05-08T18:32:10.297 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.297 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.297 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:10.297 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.768339+0000", 2024-05-08T18:32:10.297 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010568394 2024-05-08T18:32:10.297 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.297 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.297 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:10.297 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.773409+0000", 2024-05-08T18:32:10.297 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0050704019999999999 2024-05-08T18:32:10.298 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.298 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.298 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:10.298 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.773584+0000", 2024-05-08T18:32:10.298 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017481500000000001 2024-05-08T18:32:10.298 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.298 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.298 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:10.298 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.773716+0000", 2024-05-08T18:32:10.298 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013179899999999999 2024-05-08T18:32:10.298 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:10.298 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:10.298 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:10.299 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.299 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.299 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1816 3.2f 3:f49f92e1:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-05-08T18:32:10.299 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:00.419070+0000", 2024-05-08T18:32:10.299 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 9.8124014420000005, 2024-05-08T18:32:10.299 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.026961746000000002, 2024-05-08T18:32:10.299 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:10.299 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:10.299 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:10.299 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:10.299 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:10.299 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:10.299 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1816 2024-05-08T18:32:10.299 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.300 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:10.300 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.300 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:10.300 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.419070+0000", 2024-05-08T18:32:10.300 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:10.300 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.300 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.300 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:10.300 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.419070+0000", 2024-05-08T18:32:10.300 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:10.300 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.300 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.300 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:10.300 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.419073+0000", 2024-05-08T18:32:10.300 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3529999999999999e-06 2024-05-08T18:32:10.301 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.301 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.301 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:10.301 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.426045+0000", 2024-05-08T18:32:10.301 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0069723609999999998 2024-05-08T18:32:10.301 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.301 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.301 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:10.301 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.426086+0000", 2024-05-08T18:32:10.301 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.019e-05 2024-05-08T18:32:10.301 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.301 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.301 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:10.301 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.426105+0000", 2024-05-08T18:32:10.302 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9076000000000002e-05 2024-05-08T18:32:10.302 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.302 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.302 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:10.302 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.426263+0000", 2024-05-08T18:32:10.302 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015805600000000001 2024-05-08T18:32:10.302 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.302 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.302 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:10.302 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.426600+0000", 2024-05-08T18:32:10.302 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00033738399999999998 2024-05-08T18:32:10.302 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.302 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.302 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 7", 2024-05-08T18:32:10.303 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.426840+0000", 2024-05-08T18:32:10.303 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000239962 2024-05-08T18:32:10.303 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.303 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.303 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:10.303 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.441632+0000", 2024-05-08T18:32:10.303 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.014792008000000001 2024-05-08T18:32:10.303 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.303 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.303 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:10.303 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.445868+0000", 2024-05-08T18:32:10.303 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0042358880000000002 2024-05-08T18:32:10.303 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.303 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.304 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:10.304 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.445961+0000", 2024-05-08T18:32:10.304 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2474999999999998e-05 2024-05-08T18:32:10.304 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.304 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.304 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:10.304 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.446032+0000", 2024-05-08T18:32:10.304 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0993000000000003e-05 2024-05-08T18:32:10.304 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:10.304 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:10.304 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:10.304 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.304 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.304 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1819 3.30 3:0d002d77:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-05-08T18:32:10.304 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:00.476410+0000", 2024-05-08T18:32:10.305 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 9.7550613619999993, 2024-05-08T18:32:10.305 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.032375058999999998, 2024-05-08T18:32:10.305 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:10.305 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:10.305 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:10.305 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:10.305 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:10.305 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:10.305 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1819 2024-05-08T18:32:10.305 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.305 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:10.305 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.305 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:10.306 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.476410+0000", 2024-05-08T18:32:10.306 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:10.306 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.306 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.306 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:10.306 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.476410+0000", 2024-05-08T18:32:10.306 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:10.306 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.306 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.306 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:10.306 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.476413+0000", 2024-05-08T18:32:10.306 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7070000000000001e-06 2024-05-08T18:32:10.307 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.307 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.307 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:10.307 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.480961+0000", 2024-05-08T18:32:10.307 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0045480690000000001 2024-05-08T18:32:10.307 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.307 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.307 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:10.307 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.481003+0000", 2024-05-08T18:32:10.307 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1943000000000001e-05 2024-05-08T18:32:10.307 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.307 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.307 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:10.307 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.481028+0000", 2024-05-08T18:32:10.307 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5262999999999999e-05 2024-05-08T18:32:10.308 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.308 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.308 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:10.308 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.481144+0000", 2024-05-08T18:32:10.308 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000116087 2024-05-08T18:32:10.308 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.308 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.308 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:10.308 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.481343+0000", 2024-05-08T18:32:10.308 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00019893999999999999 2024-05-08T18:32:10.308 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.308 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.308 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:32:10.308 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.481517+0000", 2024-05-08T18:32:10.308 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000173697 2024-05-08T18:32:10.308 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.309 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.309 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:10.309 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.488942+0000", 2024-05-08T18:32:10.309 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0074250929999999998 2024-05-08T18:32:10.309 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.309 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.309 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:10.309 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.508658+0000", 2024-05-08T18:32:10.309 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019716469 2024-05-08T18:32:10.309 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.309 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.309 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:10.309 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.508729+0000", 2024-05-08T18:32:10.309 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1235000000000005e-05 2024-05-08T18:32:10.309 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.310 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.310 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:10.310 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.508785+0000", 2024-05-08T18:32:10.310 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5556000000000001e-05 2024-05-08T18:32:10.310 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:10.310 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:10.310 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:10.310 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.310 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.310 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1866 3.17 e93/21 3:e89f8bff:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_52:head v 93'8, mlcod=84'6)", 2024-05-08T18:32:10.310 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:01.059520+0000", 2024-05-08T18:32:10.310 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 9.1719514610000008, 2024-05-08T18:32:10.310 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019782560000000001, 2024-05-08T18:32:10.310 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:10.311 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:10.311 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:10.311 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:10.311 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.311 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:10.311 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.059520+0000", 2024-05-08T18:32:10.311 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:10.311 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.311 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.311 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:10.311 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.059520+0000", 2024-05-08T18:32:10.311 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:10.311 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.312 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.312 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:10.312 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.059523+0000", 2024-05-08T18:32:10.312 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8229999999999999e-06 2024-05-08T18:32:10.312 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.312 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.312 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:10.312 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.063985+0000", 2024-05-08T18:32:10.312 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0044628460000000003 2024-05-08T18:32:10.312 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.312 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.312 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:10.312 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.064033+0000", 2024-05-08T18:32:10.313 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7825999999999999e-05 2024-05-08T18:32:10.313 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.313 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.313 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:10.313 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.064057+0000", 2024-05-08T18:32:10.313 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3883000000000002e-05 2024-05-08T18:32:10.313 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.313 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.313 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:10.313 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.064232+0000", 2024-05-08T18:32:10.313 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017526600000000001 2024-05-08T18:32:10.313 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.313 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.313 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:10.313 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.064301+0000", 2024-05-08T18:32:10.314 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8429000000000005e-05 2024-05-08T18:32:10.314 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.314 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.314 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:10.314 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.079213+0000", 2024-05-08T18:32:10.314 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.014911938 2024-05-08T18:32:10.314 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.314 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.314 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:10.314 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.079302+0000", 2024-05-08T18:32:10.314 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.9549000000000006e-05 2024-05-08T18:32:10.314 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:10.314 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:10.314 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:10.315 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.315 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.315 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1868 3.2f 3:f4cf47d6:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_54:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:32:10.315 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:01.082779+0000", 2024-05-08T18:32:10.315 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 9.1486925039999996, 2024-05-08T18:32:10.315 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.023993838999999999, 2024-05-08T18:32:10.315 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:10.315 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:10.315 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:10.315 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:10.315 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:10.315 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:10.315 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1868 2024-05-08T18:32:10.315 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.315 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:10.316 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.316 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:10.316 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.082779+0000", 2024-05-08T18:32:10.316 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:10.316 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.316 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.316 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:10.316 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.082779+0000", 2024-05-08T18:32:10.316 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:10.316 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.316 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.316 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:10.316 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.082782+0000", 2024-05-08T18:32:10.317 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1429999999999998e-06 2024-05-08T18:32:10.317 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.317 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.317 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:10.317 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.086738+0000", 2024-05-08T18:32:10.317 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039560749999999999 2024-05-08T18:32:10.317 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.317 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.317 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:10.317 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.086781+0000", 2024-05-08T18:32:10.317 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3513999999999997e-05 2024-05-08T18:32:10.317 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.317 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.317 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:10.318 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.086803+0000", 2024-05-08T18:32:10.318 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1505000000000002e-05 2024-05-08T18:32:10.318 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.318 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.318 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:10.318 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.086967+0000", 2024-05-08T18:32:10.318 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016404899999999999 2024-05-08T18:32:10.318 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.318 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.318 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:10.318 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.087238+0000", 2024-05-08T18:32:10.318 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00027128800000000001 2024-05-08T18:32:10.318 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.319 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.319 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 7", 2024-05-08T18:32:10.319 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.087500+0000", 2024-05-08T18:32:10.319 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00026215400000000001 2024-05-08T18:32:10.319 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.319 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.319 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:10.319 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.106273+0000", 2024-05-08T18:32:10.319 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018772832 2024-05-08T18:32:10.319 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.319 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.319 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:10.319 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.106605+0000", 2024-05-08T18:32:10.319 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00033141300000000002 2024-05-08T18:32:10.319 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.320 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.320 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:10.320 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.106698+0000", 2024-05-08T18:32:10.320 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.3706e-05 2024-05-08T18:32:10.320 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.320 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.320 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:10.320 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.106773+0000", 2024-05-08T18:32:10.320 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4159999999999995e-05 2024-05-08T18:32:10.320 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:10.320 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:10.320 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:10.320 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.320 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.321 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1872 3.1c 3:38d9a9dd:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_58:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:32:10.321 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:01.131325+0000", 2024-05-08T18:32:10.321 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 9.1001463620000003, 2024-05-08T18:32:10.321 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.021008104, 2024-05-08T18:32:10.321 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:10.321 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:10.321 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:10.321 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:10.321 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:10.321 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:10.321 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1872 2024-05-08T18:32:10.321 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.321 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:10.321 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.321 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:10.322 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.131325+0000", 2024-05-08T18:32:10.322 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:10.322 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.322 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.322 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:10.322 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.131325+0000", 2024-05-08T18:32:10.322 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:10.322 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.322 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.322 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:10.322 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.131327+0000", 2024-05-08T18:32:10.322 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3719999999999999e-06 2024-05-08T18:32:10.322 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.323 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.323 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:10.323 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.135126+0000", 2024-05-08T18:32:10.323 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003798381 2024-05-08T18:32:10.323 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.323 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.323 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:10.323 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.135146+0000", 2024-05-08T18:32:10.323 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.071e-05 2024-05-08T18:32:10.323 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.323 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.323 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:10.323 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.135161+0000", 2024-05-08T18:32:10.323 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4766000000000001e-05 2024-05-08T18:32:10.324 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.324 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.324 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:10.324 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.135291+0000", 2024-05-08T18:32:10.324 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000129901 2024-05-08T18:32:10.324 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.324 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.324 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:10.324 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.135515+0000", 2024-05-08T18:32:10.324 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000224293 2024-05-08T18:32:10.324 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.324 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.324 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 4", 2024-05-08T18:32:10.325 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.135731+0000", 2024-05-08T18:32:10.325 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00021577 2024-05-08T18:32:10.325 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.325 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.325 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:10.325 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.147443+0000", 2024-05-08T18:32:10.325 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011712323 2024-05-08T18:32:10.325 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.325 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.325 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:10.325 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.152045+0000", 2024-05-08T18:32:10.325 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0046019279999999999 2024-05-08T18:32:10.325 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.325 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.326 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:10.326 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.152200+0000", 2024-05-08T18:32:10.326 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015482399999999999 2024-05-08T18:32:10.326 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.326 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.326 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:10.326 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.152333+0000", 2024-05-08T18:32:10.326 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000132836 2024-05-08T18:32:10.326 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:10.326 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:10.326 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:10.326 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.327 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.327 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1876 3.c 3:31c32d98:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_62:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:32:10.327 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:01.196179+0000", 2024-05-08T18:32:10.327 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 9.0352923010000001, 2024-05-08T18:32:10.327 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.026072768, 2024-05-08T18:32:10.327 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:10.327 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:10.327 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:10.327 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:10.327 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:10.327 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:10.327 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1876 2024-05-08T18:32:10.327 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.327 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:10.328 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.328 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:10.328 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.196179+0000", 2024-05-08T18:32:10.328 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:10.328 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.328 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.328 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:10.328 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.196179+0000", 2024-05-08T18:32:10.328 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:10.328 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.328 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.328 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:10.328 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.196181+0000", 2024-05-08T18:32:10.328 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.367e-06 2024-05-08T18:32:10.329 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.329 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.329 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:10.329 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.200229+0000", 2024-05-08T18:32:10.329 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0040475240000000003 2024-05-08T18:32:10.329 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.329 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.329 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:10.329 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.200256+0000", 2024-05-08T18:32:10.329 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7404000000000001e-05 2024-05-08T18:32:10.329 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.329 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.329 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:10.330 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.200268+0000", 2024-05-08T18:32:10.330 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1813e-05 2024-05-08T18:32:10.330 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.330 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.330 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:10.330 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.200353+0000", 2024-05-08T18:32:10.330 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4474000000000005e-05 2024-05-08T18:32:10.330 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.330 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.330 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:10.330 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.200542+0000", 2024-05-08T18:32:10.330 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000189717 2024-05-08T18:32:10.330 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.331 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.331 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 3", 2024-05-08T18:32:10.331 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.200712+0000", 2024-05-08T18:32:10.331 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016992099999999999 2024-05-08T18:32:10.331 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.331 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.331 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:10.331 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.208663+0000", 2024-05-08T18:32:10.331 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0079506639999999996 2024-05-08T18:32:10.331 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.331 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.331 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:10.331 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.221964+0000", 2024-05-08T18:32:10.331 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013301362000000001 2024-05-08T18:32:10.332 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.332 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.332 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:10.332 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.222142+0000", 2024-05-08T18:32:10.332 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017776599999999999 2024-05-08T18:32:10.332 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.332 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.332 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:10.332 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.222252+0000", 2024-05-08T18:32:10.332 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000109756 2024-05-08T18:32:10.332 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:10.332 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:10.332 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:10.333 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.333 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.333 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1902 3.28 3:17e1ce0c:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_88:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:32:10.333 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:01.732067+0000", 2024-05-08T18:32:10.333 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 8.4994046399999998, 2024-05-08T18:32:10.333 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.034055580000000002, 2024-05-08T18:32:10.333 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:10.333 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:10.333 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:10.333 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:10.333 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:10.333 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:10.333 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1902 2024-05-08T18:32:10.334 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.334 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:10.334 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.334 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:10.334 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.732067+0000", 2024-05-08T18:32:10.334 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:10.334 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.334 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.334 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:10.334 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.732067+0000", 2024-05-08T18:32:10.334 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:10.334 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.334 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.335 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:10.335 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.732070+0000", 2024-05-08T18:32:10.335 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5300000000000001e-06 2024-05-08T18:32:10.335 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.335 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.335 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:10.335 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.736601+0000", 2024-05-08T18:32:10.335 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0045306160000000003 2024-05-08T18:32:10.335 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.335 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.335 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:10.335 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.736640+0000", 2024-05-08T18:32:10.335 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9663000000000003e-05 2024-05-08T18:32:10.335 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.336 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.336 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:10.336 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.736659+0000", 2024-05-08T18:32:10.336 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8652999999999999e-05 2024-05-08T18:32:10.336 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.336 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.336 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:10.336 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.736832+0000", 2024-05-08T18:32:10.336 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017339800000000001 2024-05-08T18:32:10.336 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.336 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.336 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:10.336 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.737091+0000", 2024-05-08T18:32:10.336 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00025841500000000001 2024-05-08T18:32:10.337 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.337 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.337 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 3", 2024-05-08T18:32:10.337 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.737330+0000", 2024-05-08T18:32:10.337 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00023942200000000001 2024-05-08T18:32:10.337 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.337 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.337 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:10.337 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.749415+0000", 2024-05-08T18:32:10.337 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012085024 2024-05-08T18:32:10.337 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.337 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.337 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:10.337 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.766035+0000", 2024-05-08T18:32:10.338 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016619842999999999 2024-05-08T18:32:10.338 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.338 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.338 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:10.338 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.766078+0000", 2024-05-08T18:32:10.338 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.2735999999999999e-05 2024-05-08T18:32:10.338 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.338 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.338 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:10.338 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.766122+0000", 2024-05-08T18:32:10.338 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4280000000000003e-05 2024-05-08T18:32:10.338 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:10.338 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:10.338 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:10.339 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.339 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.339 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1923 3.22 3:469de645:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_109:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:32:10.339 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:02.073868+0000", 2024-05-08T18:32:10.339 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 8.157603537, 2024-05-08T18:32:10.339 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019693196999999999, 2024-05-08T18:32:10.339 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:10.339 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:10.339 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:10.339 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:10.339 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:10.339 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:10.339 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1923 2024-05-08T18:32:10.340 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.340 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:10.340 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.340 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:10.340 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.073868+0000", 2024-05-08T18:32:10.340 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:10.340 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.340 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.340 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:10.340 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.073868+0000", 2024-05-08T18:32:10.340 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:10.340 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.340 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.341 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:10.341 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.073900+0000", 2024-05-08T18:32:10.341 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2252999999999998e-05 2024-05-08T18:32:10.341 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.341 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.341 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:10.341 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.078035+0000", 2024-05-08T18:32:10.341 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0041348929999999997 2024-05-08T18:32:10.341 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.341 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.341 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:10.341 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.078075+0000", 2024-05-08T18:32:10.341 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0040000000000003e-05 2024-05-08T18:32:10.341 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.341 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.341 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:10.342 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.078093+0000", 2024-05-08T18:32:10.342 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8626000000000001e-05 2024-05-08T18:32:10.342 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.342 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.342 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:10.342 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.078198+0000", 2024-05-08T18:32:10.342 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000104632 2024-05-08T18:32:10.342 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.342 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.342 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:10.342 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.078364+0000", 2024-05-08T18:32:10.342 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000165551 2024-05-08T18:32:10.342 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.343 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.343 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 3", 2024-05-08T18:32:10.343 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.078526+0000", 2024-05-08T18:32:10.343 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016216900000000001 2024-05-08T18:32:10.343 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.343 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.343 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:10.343 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.085095+0000", 2024-05-08T18:32:10.343 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0065693790000000002 2024-05-08T18:32:10.343 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.343 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.343 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:10.343 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.093441+0000", 2024-05-08T18:32:10.343 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0083460940000000001 2024-05-08T18:32:10.344 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.344 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.344 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:10.344 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.093507+0000", 2024-05-08T18:32:10.344 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5650999999999999e-05 2024-05-08T18:32:10.344 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.344 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.344 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:10.344 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.093561+0000", 2024-05-08T18:32:10.344 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3909000000000002e-05 2024-05-08T18:32:10.344 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:10.344 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:10.344 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:10.344 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.345 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.345 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1927 3.22 3:460f723f:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_113:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:32:10.345 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:02.122319+0000", 2024-05-08T18:32:10.345 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 8.1091522880000007, 2024-05-08T18:32:10.345 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.020582304999999999, 2024-05-08T18:32:10.345 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:10.345 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:10.345 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:10.345 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:10.345 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:10.345 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:10.345 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1927 2024-05-08T18:32:10.345 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.346 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:10.346 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.346 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:10.346 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.122319+0000", 2024-05-08T18:32:10.346 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:10.346 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.346 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.346 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:10.346 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.122319+0000", 2024-05-08T18:32:10.346 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:10.346 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.346 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.346 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:10.346 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.122322+0000", 2024-05-08T18:32:10.347 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.9119999999999998e-06 2024-05-08T18:32:10.347 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.347 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.347 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:10.347 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.126667+0000", 2024-05-08T18:32:10.347 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0043456299999999996 2024-05-08T18:32:10.347 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.347 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.347 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:10.347 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.126690+0000", 2024-05-08T18:32:10.347 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2643e-05 2024-05-08T18:32:10.347 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.347 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.348 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:10.348 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.126702+0000", 2024-05-08T18:32:10.348 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2193e-05 2024-05-08T18:32:10.348 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.348 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.348 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:10.348 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.126771+0000", 2024-05-08T18:32:10.348 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8354000000000003e-05 2024-05-08T18:32:10.348 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.348 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.348 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:10.348 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.126893+0000", 2024-05-08T18:32:10.348 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012245100000000001 2024-05-08T18:32:10.349 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.349 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.349 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 3", 2024-05-08T18:32:10.349 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.126993+0000", 2024-05-08T18:32:10.349 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.9637999999999997e-05 2024-05-08T18:32:10.349 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.349 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.349 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:10.349 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.131140+0000", 2024-05-08T18:32:10.349 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0041468090000000004 2024-05-08T18:32:10.349 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.349 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.349 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:10.349 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.142794+0000", 2024-05-08T18:32:10.349 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011654822 2024-05-08T18:32:10.350 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.350 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.350 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:10.350 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.142854+0000", 2024-05-08T18:32:10.350 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9346999999999999e-05 2024-05-08T18:32:10.350 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.350 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.350 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:10.350 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.142901+0000", 2024-05-08T18:32:10.350 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7506000000000002e-05 2024-05-08T18:32:10.350 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:10.350 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:10.350 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:10.351 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:10.351 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:10.351 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:32:10.352 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-08T18:32:10.353 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:32:10.350+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:32:10.453 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:32:10.450+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:32:10.525 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:32:10.526 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:32:10.526 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 0 2024-05-08T18:32:10.526 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:32:10.540 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-08T18:32:10.554 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:32:10.552+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:32:10.654 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:32:10.650+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:32:10.712 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:32:10.712 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:32:10.713 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2024-05-08T18:32:10.713 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2024-05-08T18:32:10.713 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:32:10.728 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-08T18:32:10.755 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:32:10.752+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:32:10.856 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:32:10.854+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:32:10.900 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:32:10.900 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2024-05-08T18:32:10.901 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2024-05-08T18:32:10.901 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-05-08T18:32:10.901 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.901 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1315 3.2c 3:368ed9cc:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-08T18:32:10.901 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.301720+0000", 2024-05-08T18:32:10.902 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 28.595538357999999, 2024-05-08T18:32:10.902 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.028850259, 2024-05-08T18:32:10.902 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:10.902 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:10.902 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:10.902 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:10.903 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:10.903 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:10.903 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1315 2024-05-08T18:32:10.903 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.903 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:10.903 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.903 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:10.904 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.301720+0000", 2024-05-08T18:32:10.904 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:10.904 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.904 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.904 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:10.904 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.301720+0000", 2024-05-08T18:32:10.904 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:10.904 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.904 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.905 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:10.905 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.301723+0000", 2024-05-08T18:32:10.905 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2369999999999999e-06 2024-05-08T18:32:10.905 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.905 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.905 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:10.905 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.309609+0000", 2024-05-08T18:32:10.905 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0078867369999999996 2024-05-08T18:32:10.905 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.905 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.906 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:10.906 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.309647+0000", 2024-05-08T18:32:10.906 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7849999999999998e-05 2024-05-08T18:32:10.906 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.906 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.906 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:10.906 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.309665+0000", 2024-05-08T18:32:10.906 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8346e-05 2024-05-08T18:32:10.906 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.907 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.907 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:10.907 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.309846+0000", 2024-05-08T18:32:10.907 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000180056 2024-05-08T18:32:10.907 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.907 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.907 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:10.907 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.310231+0000", 2024-05-08T18:32:10.907 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00038542999999999997 2024-05-08T18:32:10.908 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.908 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.908 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 4", 2024-05-08T18:32:10.908 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.310628+0000", 2024-05-08T18:32:10.908 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00039685099999999999 2024-05-08T18:32:10.908 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.908 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.908 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:10.908 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.329116+0000", 2024-05-08T18:32:10.909 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018488279999999999 2024-05-08T18:32:10.909 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.909 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.909 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:10.909 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.330334+0000", 2024-05-08T18:32:10.909 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001217734 2024-05-08T18:32:10.909 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.909 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.910 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:10.910 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.330450+0000", 2024-05-08T18:32:10.910 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000116439 2024-05-08T18:32:10.910 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.910 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.910 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:10.910 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.330571+0000", 2024-05-08T18:32:10.910 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012029899999999999 2024-05-08T18:32:10.910 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:10.911 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:10.911 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:10.911 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.911 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.911 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1319 3.35 3:add64cdc:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-08T18:32:10.911 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.358042+0000", 2024-05-08T18:32:10.911 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 28.539216442000001, 2024-05-08T18:32:10.911 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.023806130000000002, 2024-05-08T18:32:10.911 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:10.912 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:10.912 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:10.912 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:10.912 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:10.912 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:10.912 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1319 2024-05-08T18:32:10.912 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.912 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:10.912 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.913 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:10.913 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.358042+0000", 2024-05-08T18:32:10.913 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:10.913 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.913 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.913 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:10.913 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.358042+0000", 2024-05-08T18:32:10.913 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:10.913 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.914 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.914 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:10.914 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.358045+0000", 2024-05-08T18:32:10.914 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.813e-06 2024-05-08T18:32:10.914 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.914 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.914 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:10.914 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.362893+0000", 2024-05-08T18:32:10.914 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0048481569999999996 2024-05-08T18:32:10.915 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.915 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.915 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:10.915 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.362932+0000", 2024-05-08T18:32:10.915 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8788999999999997e-05 2024-05-08T18:32:10.915 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.915 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.915 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:10.916 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.362949+0000", 2024-05-08T18:32:10.916 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7289999999999999e-05 2024-05-08T18:32:10.916 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.916 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.916 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:10.916 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.363084+0000", 2024-05-08T18:32:10.916 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000134552 2024-05-08T18:32:10.917 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.917 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.917 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:10.917 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.363324+0000", 2024-05-08T18:32:10.917 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000239702 2024-05-08T18:32:10.917 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.918 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.918 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 5", 2024-05-08T18:32:10.918 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.363553+0000", 2024-05-08T18:32:10.918 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000229519 2024-05-08T18:32:10.918 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.918 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.919 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:10.919 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.373958+0000", 2024-05-08T18:32:10.919 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010404821 2024-05-08T18:32:10.919 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.919 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.919 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:10.920 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.381549+0000", 2024-05-08T18:32:10.920 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0075911930000000004 2024-05-08T18:32:10.920 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.920 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.920 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:10.921 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.381715+0000", 2024-05-08T18:32:10.921 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016614900000000001 2024-05-08T18:32:10.921 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.921 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.921 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:10.921 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.381848+0000", 2024-05-08T18:32:10.922 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013314499999999999 2024-05-08T18:32:10.922 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:10.922 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:10.922 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:10.922 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.923 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.923 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1337 3.36 3:6e6c3d09:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:32:10.923 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.570209+0000", 2024-05-08T18:32:10.923 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 28.327050141000001, 2024-05-08T18:32:10.923 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.031066623000000002, 2024-05-08T18:32:10.923 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:10.924 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:10.924 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:10.924 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:10.924 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:10.924 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:10.924 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1337 2024-05-08T18:32:10.925 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.925 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:10.925 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.925 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:10.925 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.570209+0000", 2024-05-08T18:32:10.925 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:10.926 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.926 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.926 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:10.926 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.570209+0000", 2024-05-08T18:32:10.926 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:10.926 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.927 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.927 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:10.927 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.570212+0000", 2024-05-08T18:32:10.927 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0800000000000002e-06 2024-05-08T18:32:10.927 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.928 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.928 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:10.928 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.575559+0000", 2024-05-08T18:32:10.928 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0053471300000000003 2024-05-08T18:32:10.928 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.928 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.929 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:10.929 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.575591+0000", 2024-05-08T18:32:10.929 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2143e-05 2024-05-08T18:32:10.929 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.929 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.930 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:10.930 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.575609+0000", 2024-05-08T18:32:10.930 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8139999999999999e-05 2024-05-08T18:32:10.930 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.930 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.931 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:10.931 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.575744+0000", 2024-05-08T18:32:10.931 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013482199999999999 2024-05-08T18:32:10.931 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.931 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.931 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op must wait for map", 2024-05-08T18:32:10.932 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.575763+0000", 2024-05-08T18:32:10.932 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.963e-05 2024-05-08T18:32:10.932 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.932 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.932 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:10.932 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.583603+0000", 2024-05-08T18:32:10.933 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0078395970000000002 2024-05-08T18:32:10.933 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.933 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.933 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:10.933 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.583943+0000", 2024-05-08T18:32:10.933 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00034006800000000001 2024-05-08T18:32:10.934 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.934 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.934 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 5", 2024-05-08T18:32:10.934 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.584214+0000", 2024-05-08T18:32:10.934 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00027059399999999998 2024-05-08T18:32:10.934 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.935 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.935 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:10.935 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.600111+0000", 2024-05-08T18:32:10.935 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015897521000000001 2024-05-08T18:32:10.935 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.935 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.936 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:10.936 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.600967+0000", 2024-05-08T18:32:10.936 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00085548000000000004 2024-05-08T18:32:10.936 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.936 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.937 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:10.937 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.601137+0000", 2024-05-08T18:32:10.937 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017063500000000001 2024-05-08T18:32:10.937 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.937 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.937 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:10.938 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.601275+0000", 2024-05-08T18:32:10.938 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013778299999999999 2024-05-08T18:32:10.938 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:10.938 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:10.938 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:10.938 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.939 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.939 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1360 3.20 3:0629b24f:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_46:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:32:10.939 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.812182+0000", 2024-05-08T18:32:10.939 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 28.085076941000001, 2024-05-08T18:32:10.939 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.020673025000000001, 2024-05-08T18:32:10.939 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:10.940 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:10.940 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:10.940 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:10.940 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:10.940 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:10.940 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1360 2024-05-08T18:32:10.941 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.941 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:10.941 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.941 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:10.941 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.812182+0000", 2024-05-08T18:32:10.941 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:10.942 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.942 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.942 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:10.942 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.812182+0000", 2024-05-08T18:32:10.942 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:10.942 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.942 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.942 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:10.942 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.812186+0000", 2024-05-08T18:32:10.942 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.267e-06 2024-05-08T18:32:10.942 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.943 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.943 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:10.943 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.816498+0000", 2024-05-08T18:32:10.943 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0043117110000000002 2024-05-08T18:32:10.943 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.943 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.943 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:10.943 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.816537+0000", 2024-05-08T18:32:10.943 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9082999999999998e-05 2024-05-08T18:32:10.943 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.943 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.943 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:10.943 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.816554+0000", 2024-05-08T18:32:10.944 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7549000000000001e-05 2024-05-08T18:32:10.944 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.944 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.944 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:10.944 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.816696+0000", 2024-05-08T18:32:10.944 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014152300000000001 2024-05-08T18:32:10.944 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.944 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.944 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:10.944 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.816956+0000", 2024-05-08T18:32:10.944 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00026039800000000001 2024-05-08T18:32:10.944 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.944 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.944 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:32:10.945 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.817186+0000", 2024-05-08T18:32:10.945 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00023018800000000001 2024-05-08T18:32:10.945 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.945 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.945 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:10.945 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.826298+0000", 2024-05-08T18:32:10.945 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0091116549999999998 2024-05-08T18:32:10.945 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.945 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.945 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:10.945 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.832553+0000", 2024-05-08T18:32:10.945 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0062545029999999998 2024-05-08T18:32:10.945 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.945 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.946 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:10.946 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.832725+0000", 2024-05-08T18:32:10.946 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000172065 2024-05-08T18:32:10.946 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.946 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.946 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:10.946 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.832855+0000", 2024-05-08T18:32:10.946 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013008299999999999 2024-05-08T18:32:10.946 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:10.946 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:10.946 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:10.946 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.946 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.946 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1361 3.26 3:65dd6def:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_47:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:32:10.947 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.822918+0000", 2024-05-08T18:32:10.947 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 28.074340775, 2024-05-08T18:32:10.947 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.023073703000000001, 2024-05-08T18:32:10.947 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:10.947 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:10.947 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:10.947 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:10.947 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:10.947 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:10.947 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1361 2024-05-08T18:32:10.947 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.947 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:10.947 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.948 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:10.948 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.822918+0000", 2024-05-08T18:32:10.948 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:10.948 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.948 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.948 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:10.948 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.822918+0000", 2024-05-08T18:32:10.948 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:10.948 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.948 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.948 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:10.948 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.822921+0000", 2024-05-08T18:32:10.948 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.9270000000000001e-06 2024-05-08T18:32:10.948 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.948 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.949 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:10.949 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.827328+0000", 2024-05-08T18:32:10.949 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0044071199999999996 2024-05-08T18:32:10.949 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.949 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.949 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:10.949 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.827364+0000", 2024-05-08T18:32:10.949 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5963000000000001e-05 2024-05-08T18:32:10.949 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.949 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.949 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:10.949 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.827382+0000", 2024-05-08T18:32:10.949 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8533e-05 2024-05-08T18:32:10.949 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.950 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.950 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:10.950 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.827547+0000", 2024-05-08T18:32:10.950 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016492899999999999 2024-05-08T18:32:10.950 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.950 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.950 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:10.950 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.827949+0000", 2024-05-08T18:32:10.950 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00040151 2024-05-08T18:32:10.950 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.950 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.950 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 7", 2024-05-08T18:32:10.950 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.828334+0000", 2024-05-08T18:32:10.950 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00038469399999999999 2024-05-08T18:32:10.951 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.951 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.951 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:10.951 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.845540+0000", 2024-05-08T18:32:10.951 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017206117 2024-05-08T18:32:10.951 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.951 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.951 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:10.951 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.845825+0000", 2024-05-08T18:32:10.951 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000285555 2024-05-08T18:32:10.951 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.951 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.951 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:10.951 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.845917+0000", 2024-05-08T18:32:10.952 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1498999999999999e-05 2024-05-08T18:32:10.952 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.952 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.952 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:10.952 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.845992+0000", 2024-05-08T18:32:10.952 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4856000000000003e-05 2024-05-08T18:32:10.952 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:10.952 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:10.952 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:10.952 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.952 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.952 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1365 3.35 3:adc1c29f:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_51:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:32:10.952 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.864570+0000", 2024-05-08T18:32:10.953 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 28.032688241999999, 2024-05-08T18:32:10.953 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.021718316000000001, 2024-05-08T18:32:10.953 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:10.953 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:10.953 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:10.953 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:10.953 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:10.953 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:10.953 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1365 2024-05-08T18:32:10.953 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.953 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:10.953 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.953 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:10.953 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.864570+0000", 2024-05-08T18:32:10.954 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:10.954 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.954 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.954 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:10.954 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.864570+0000", 2024-05-08T18:32:10.954 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:10.954 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.954 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.954 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:10.954 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.864574+0000", 2024-05-08T18:32:10.954 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.433e-06 2024-05-08T18:32:10.954 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.954 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.954 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:10.955 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.869145+0000", 2024-05-08T18:32:10.955 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0045706790000000002 2024-05-08T18:32:10.955 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.955 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.955 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:10.955 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.869181+0000", 2024-05-08T18:32:10.955 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.68e-05 2024-05-08T18:32:10.955 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.955 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.955 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:10.955 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.869200+0000", 2024-05-08T18:32:10.955 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8453000000000001e-05 2024-05-08T18:32:10.955 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.956 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.956 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:10.956 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.869328+0000", 2024-05-08T18:32:10.956 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000128102 2024-05-08T18:32:10.956 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.956 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.956 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:10.956 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.869601+0000", 2024-05-08T18:32:10.956 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00027359200000000002 2024-05-08T18:32:10.956 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.956 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.956 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 5", 2024-05-08T18:32:10.956 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.869847+0000", 2024-05-08T18:32:10.956 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00024531800000000001 2024-05-08T18:32:10.957 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.957 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.957 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:10.957 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.885442+0000", 2024-05-08T18:32:10.957 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015595079 2024-05-08T18:32:10.957 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.957 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.957 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:10.957 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.886110+0000", 2024-05-08T18:32:10.957 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00066779100000000004 2024-05-08T18:32:10.957 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.957 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.957 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:10.957 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.886209+0000", 2024-05-08T18:32:10.957 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8967000000000003e-05 2024-05-08T18:32:10.958 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.958 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.958 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:10.958 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.886289+0000", 2024-05-08T18:32:10.958 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.0102e-05 2024-05-08T18:32:10.958 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:10.958 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:10.958 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:10.958 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.958 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.958 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1381 3.20 3:07260bee:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_67:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:32:10.958 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:43.057073+0000", 2024-05-08T18:32:10.958 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 27.840185778999999, 2024-05-08T18:32:10.959 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.020966242999999999, 2024-05-08T18:32:10.959 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:10.959 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:10.959 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:10.959 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:10.959 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:10.959 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:10.959 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1381 2024-05-08T18:32:10.959 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.959 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:10.959 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.959 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:10.959 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.057073+0000", 2024-05-08T18:32:10.959 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:10.960 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.960 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.960 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:10.960 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.057073+0000", 2024-05-08T18:32:10.960 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:10.960 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.960 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.960 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:10.960 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.057076+0000", 2024-05-08T18:32:10.960 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4230000000000001e-06 2024-05-08T18:32:10.960 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.960 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.960 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:10.960 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.063772+0000", 2024-05-08T18:32:10.961 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0066957960000000004 2024-05-08T18:32:10.961 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.961 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.961 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:10.961 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.063817+0000", 2024-05-08T18:32:10.961 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4883999999999999e-05 2024-05-08T18:32:10.961 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.961 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.961 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:10.961 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.063838+0000", 2024-05-08T18:32:10.961 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0622999999999999e-05 2024-05-08T18:32:10.961 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.961 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.961 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:10.962 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.063943+0000", 2024-05-08T18:32:10.962 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010529100000000001 2024-05-08T18:32:10.962 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.962 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.962 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:10.962 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.064116+0000", 2024-05-08T18:32:10.962 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017287699999999999 2024-05-08T18:32:10.962 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.962 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.962 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:32:10.962 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.064267+0000", 2024-05-08T18:32:10.962 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015107799999999999 2024-05-08T18:32:10.962 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.963 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.963 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:10.963 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.074658+0000", 2024-05-08T18:32:10.963 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010391473 2024-05-08T18:32:10.963 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.963 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.963 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:10.963 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.077919+0000", 2024-05-08T18:32:10.963 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032607080000000002 2024-05-08T18:32:10.963 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.963 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.963 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:10.963 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.077986+0000", 2024-05-08T18:32:10.963 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7151999999999997e-05 2024-05-08T18:32:10.964 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.964 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.964 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:10.964 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.078039+0000", 2024-05-08T18:32:10.964 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2938e-05 2024-05-08T18:32:10.964 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:10.964 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:10.964 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:10.964 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.964 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.964 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1406 3.35 3:acb4ebf3:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_92:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:32:10.964 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:43.333886+0000", 2024-05-08T18:32:10.964 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 27.563372185999999, 2024-05-08T18:32:10.964 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018425136000000002, 2024-05-08T18:32:10.965 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:10.965 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:10.965 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:10.965 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:10.965 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:10.965 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:10.965 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1406 2024-05-08T18:32:10.965 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.965 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:10.965 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.965 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:10.965 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.333886+0000", 2024-05-08T18:32:10.965 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:10.965 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.966 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.966 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:10.966 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.333886+0000", 2024-05-08T18:32:10.966 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:10.966 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.966 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.966 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:10.966 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.333889+0000", 2024-05-08T18:32:10.966 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6879999999999999e-06 2024-05-08T18:32:10.966 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.966 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.966 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:10.966 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.337554+0000", 2024-05-08T18:32:10.966 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0036647609999999999 2024-05-08T18:32:10.967 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.967 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.967 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:10.967 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.337574+0000", 2024-05-08T18:32:10.967 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9830000000000002e-05 2024-05-08T18:32:10.967 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.967 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.967 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:10.967 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.337583+0000", 2024-05-08T18:32:10.967 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.0599999999999997e-06 2024-05-08T18:32:10.967 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.967 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.967 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:10.967 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.337661+0000", 2024-05-08T18:32:10.968 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.7931999999999999e-05 2024-05-08T18:32:10.968 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.968 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.968 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:10.968 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.337818+0000", 2024-05-08T18:32:10.968 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015687000000000001 2024-05-08T18:32:10.968 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.968 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.968 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 5", 2024-05-08T18:32:10.968 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.337942+0000", 2024-05-08T18:32:10.968 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000124206 2024-05-08T18:32:10.968 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.968 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.968 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:10.968 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.350659+0000", 2024-05-08T18:32:10.969 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012717282 2024-05-08T18:32:10.969 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.969 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.969 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:10.969 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.352231+0000", 2024-05-08T18:32:10.969 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001571512 2024-05-08T18:32:10.969 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.969 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.969 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:10.969 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.352274+0000", 2024-05-08T18:32:10.969 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3371999999999997e-05 2024-05-08T18:32:10.969 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.969 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.969 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:10.969 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.352312+0000", 2024-05-08T18:32:10.970 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7623000000000002e-05 2024-05-08T18:32:10.970 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:10.970 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:10.970 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:10.970 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.970 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.970 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1412 3.36 3:6db491e0:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_98:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:32:10.970 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:43.394092+0000", 2024-05-08T18:32:10.970 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 27.503166909000001, 2024-05-08T18:32:10.970 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.021120863, 2024-05-08T18:32:10.970 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:10.970 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:10.970 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:10.970 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:10.971 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:10.971 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:10.971 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1412 2024-05-08T18:32:10.971 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.971 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:10.971 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.971 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:10.971 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.394092+0000", 2024-05-08T18:32:10.971 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:10.971 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.971 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.971 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:10.971 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.394092+0000", 2024-05-08T18:32:10.971 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:10.971 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.972 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.972 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:10.972 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.394094+0000", 2024-05-08T18:32:10.972 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.305e-06 2024-05-08T18:32:10.972 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.972 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.972 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:10.972 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.397860+0000", 2024-05-08T18:32:10.972 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0037662239999999999 2024-05-08T18:32:10.972 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.972 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.972 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:10.972 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.397890+0000", 2024-05-08T18:32:10.972 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.9274000000000001e-05 2024-05-08T18:32:10.973 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.973 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.973 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:10.973 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.397905+0000", 2024-05-08T18:32:10.973 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5398999999999999e-05 2024-05-08T18:32:10.973 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.973 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.973 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:10.973 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.398094+0000", 2024-05-08T18:32:10.973 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00018897799999999999 2024-05-08T18:32:10.973 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.973 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.973 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:10.973 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.398337+0000", 2024-05-08T18:32:10.974 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00024258799999999999 2024-05-08T18:32:10.974 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.974 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.974 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 5", 2024-05-08T18:32:10.974 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.398593+0000", 2024-05-08T18:32:10.974 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00025631500000000002 2024-05-08T18:32:10.974 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.974 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.974 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:10.974 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.413998+0000", 2024-05-08T18:32:10.974 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015405663999999999 2024-05-08T18:32:10.974 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.974 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.974 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:10.975 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.415077+0000", 2024-05-08T18:32:10.975 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001078063 2024-05-08T18:32:10.975 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.975 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.975 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:10.975 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.415149+0000", 2024-05-08T18:32:10.975 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.2878000000000003e-05 2024-05-08T18:32:10.975 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.975 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.975 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:10.975 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.415213+0000", 2024-05-08T18:32:10.975 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3175000000000004e-05 2024-05-08T18:32:10.975 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:10.976 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:10.976 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:10.976 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.976 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.976 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1615 3.35 3:ae758c88:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-05-08T18:32:10.976 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:46.719155+0000", 2024-05-08T18:32:10.976 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 24.178104150999999, 2024-05-08T18:32:10.976 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.038329020999999998, 2024-05-08T18:32:10.976 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:10.976 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:10.976 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:10.976 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:10.976 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:10.976 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:10.977 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1615 2024-05-08T18:32:10.977 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.977 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:10.977 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.977 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:10.977 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.719155+0000", 2024-05-08T18:32:10.977 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:10.977 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.977 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.977 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:10.977 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.719155+0000", 2024-05-08T18:32:10.977 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:10.977 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.978 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.978 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:10.978 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.719159+0000", 2024-05-08T18:32:10.978 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4259999999999996e-06 2024-05-08T18:32:10.978 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.978 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.978 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:10.978 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.728715+0000", 2024-05-08T18:32:10.978 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0095562549999999996 2024-05-08T18:32:10.978 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.978 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.978 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:10.978 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.728764+0000", 2024-05-08T18:32:10.978 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9262999999999999e-05 2024-05-08T18:32:10.979 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.979 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.979 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:10.979 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.728785+0000", 2024-05-08T18:32:10.979 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0339999999999998e-05 2024-05-08T18:32:10.979 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.979 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.979 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:10.979 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.728951+0000", 2024-05-08T18:32:10.979 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000166105 2024-05-08T18:32:10.979 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.979 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.979 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:10.980 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.729206+0000", 2024-05-08T18:32:10.980 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00025512499999999998 2024-05-08T18:32:10.980 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.980 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.980 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 5", 2024-05-08T18:32:10.980 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.729436+0000", 2024-05-08T18:32:10.980 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022991099999999999 2024-05-08T18:32:10.980 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.980 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.980 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:10.980 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.754118+0000", 2024-05-08T18:32:10.980 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.024682511000000001 2024-05-08T18:32:10.980 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.980 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.981 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:10.981 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.757310+0000", 2024-05-08T18:32:10.981 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0031911890000000001 2024-05-08T18:32:10.981 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.981 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.981 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:10.981 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.757408+0000", 2024-05-08T18:32:10.981 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8826000000000006e-05 2024-05-08T18:32:10.981 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.981 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.981 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:10.981 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.757484+0000", 2024-05-08T18:32:10.981 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5069999999999998e-05 2024-05-08T18:32:10.981 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:10.982 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:10.982 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:10.982 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.982 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.982 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1623 3.20 3:0496c987:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-05-08T18:32:10.982 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:46.802136+0000", 2024-05-08T18:32:10.982 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 24.095122827000001, 2024-05-08T18:32:10.982 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.026548796999999999, 2024-05-08T18:32:10.982 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:10.982 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:10.982 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:10.982 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:10.982 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:10.982 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:10.983 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1623 2024-05-08T18:32:10.983 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.983 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:10.983 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.983 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:10.983 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.802136+0000", 2024-05-08T18:32:10.983 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:10.983 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.983 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.983 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:10.983 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.802136+0000", 2024-05-08T18:32:10.983 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:10.983 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.983 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.984 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:10.984 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.802140+0000", 2024-05-08T18:32:10.984 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8469999999999998e-06 2024-05-08T18:32:10.984 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.984 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.984 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:10.984 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.806310+0000", 2024-05-08T18:32:10.984 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0041703449999999998 2024-05-08T18:32:10.984 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.984 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.984 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:10.984 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.806362+0000", 2024-05-08T18:32:10.984 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2113000000000001e-05 2024-05-08T18:32:10.984 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.985 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.985 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:10.985 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.806409+0000", 2024-05-08T18:32:10.985 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6505999999999998e-05 2024-05-08T18:32:10.985 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.985 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.985 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:10.985 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.806614+0000", 2024-05-08T18:32:10.985 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000205572 2024-05-08T18:32:10.985 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.985 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.985 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:10.985 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.807056+0000", 2024-05-08T18:32:10.985 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00044176300000000002 2024-05-08T18:32:10.986 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.986 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.986 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:32:10.986 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.807458+0000", 2024-05-08T18:32:10.986 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00040168000000000002 2024-05-08T18:32:10.986 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.986 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.986 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:10.986 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.819075+0000", 2024-05-08T18:32:10.986 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011616903 2024-05-08T18:32:10.986 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.986 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.986 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:10.987 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.828505+0000", 2024-05-08T18:32:10.987 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0094299759999999996 2024-05-08T18:32:10.987 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.987 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.987 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:10.987 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.828605+0000", 2024-05-08T18:32:10.987 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000100152 2024-05-08T18:32:10.987 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.987 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.987 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:10.987 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.828685+0000", 2024-05-08T18:32:10.987 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9939999999999997e-05 2024-05-08T18:32:10.987 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:10.988 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:10.988 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:10.988 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.988 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.988 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1626 3.20 3:04d2d7da:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-05-08T18:32:10.988 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:46.841165+0000", 2024-05-08T18:32:10.988 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 24.056094061, 2024-05-08T18:32:10.988 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.028115448000000001, 2024-05-08T18:32:10.988 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:10.988 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:10.989 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:10.989 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:10.989 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:10.989 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:10.989 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1626 2024-05-08T18:32:10.989 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.989 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:10.989 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.989 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:10.989 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.841165+0000", 2024-05-08T18:32:10.989 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:10.989 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.989 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.989 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:10.990 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.841165+0000", 2024-05-08T18:32:10.990 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:10.990 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.990 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.990 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:10.990 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.841167+0000", 2024-05-08T18:32:10.990 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5900000000000002e-06 2024-05-08T18:32:10.990 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.990 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.990 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:10.990 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.845166+0000", 2024-05-08T18:32:10.990 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039988760000000002 2024-05-08T18:32:10.990 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.991 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.991 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:10.991 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.845199+0000", 2024-05-08T18:32:10.991 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2950000000000001e-05 2024-05-08T18:32:10.991 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.991 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.991 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:10.991 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.845223+0000", 2024-05-08T18:32:10.991 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.4074e-05 2024-05-08T18:32:10.991 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.992 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.992 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:10.992 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.845360+0000", 2024-05-08T18:32:10.992 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013671899999999999 2024-05-08T18:32:10.992 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.992 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.992 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:10.992 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.845619+0000", 2024-05-08T18:32:10.992 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00025912800000000002 2024-05-08T18:32:10.992 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.992 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.992 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:32:10.992 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.845856+0000", 2024-05-08T18:32:10.993 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00023749099999999999 2024-05-08T18:32:10.993 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.993 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.993 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:10.993 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.856156+0000", 2024-05-08T18:32:10.993 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010299536 2024-05-08T18:32:10.993 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.993 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.993 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:10.993 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.868964+0000", 2024-05-08T18:32:10.993 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012808083 2024-05-08T18:32:10.993 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.993 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.994 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:10.994 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.869142+0000", 2024-05-08T18:32:10.994 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017771599999999999 2024-05-08T18:32:10.994 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.994 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.994 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:10.994 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.869280+0000", 2024-05-08T18:32:10.994 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013828500000000001 2024-05-08T18:32:10.994 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:10.995 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:10.995 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:10.995 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.995 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.995 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1824 3.2c 3:36a4dac4:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-05-08T18:32:10.995 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:00.541071+0000", 2024-05-08T18:32:10.995 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 10.356187436999999, 2024-05-08T18:32:10.995 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.021251051999999999, 2024-05-08T18:32:10.995 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:10.995 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:10.995 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:10.995 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:10.995 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:10.995 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:10.996 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1824 2024-05-08T18:32:10.996 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.996 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:10.996 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.996 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:10.996 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.541071+0000", 2024-05-08T18:32:10.996 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:10.996 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.996 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.996 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:10.996 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.541071+0000", 2024-05-08T18:32:10.996 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:10.996 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.996 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.996 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:10.997 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.541076+0000", 2024-05-08T18:32:10.997 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8760000000000004e-06 2024-05-08T18:32:10.997 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.997 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.997 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:10.997 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.546258+0000", 2024-05-08T18:32:10.997 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0051822439999999999 2024-05-08T18:32:10.997 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.997 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.997 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:10.997 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.546297+0000", 2024-05-08T18:32:10.997 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8460000000000001e-05 2024-05-08T18:32:10.997 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.997 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.998 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:10.998 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.546316+0000", 2024-05-08T18:32:10.998 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8853000000000001e-05 2024-05-08T18:32:10.998 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.998 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.998 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:10.998 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.546424+0000", 2024-05-08T18:32:10.998 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000108597 2024-05-08T18:32:10.998 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.998 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.998 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:10.998 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.546605+0000", 2024-05-08T18:32:10.998 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00018060099999999999 2024-05-08T18:32:10.999 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.999 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.999 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 4", 2024-05-08T18:32:10.999 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.546781+0000", 2024-05-08T18:32:10.999 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017653300000000001 2024-05-08T18:32:10.999 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.999 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.999 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:10.999 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.556391+0000", 2024-05-08T18:32:10.999 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0096097460000000006 2024-05-08T18:32:10.999 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:10.999 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:10.999 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:10.999 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.562196+0000", 2024-05-08T18:32:11.000 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0058047840000000003 2024-05-08T18:32:11.000 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.000 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.000 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:11.000 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.562267+0000", 2024-05-08T18:32:11.000 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1179000000000004e-05 2024-05-08T18:32:11.000 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.000 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.000 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:11.000 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.562322+0000", 2024-05-08T18:32:11.000 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5179000000000001e-05 2024-05-08T18:32:11.000 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:11.000 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:11.000 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:11.000 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.001 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.001 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1827 3.a 3:523d931b:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-05-08T18:32:11.001 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:00.589747+0000", 2024-05-08T18:32:11.001 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 10.307511294999999, 2024-05-08T18:32:11.001 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019404434000000002, 2024-05-08T18:32:11.001 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:11.001 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:11.001 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:11.001 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:11.001 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:11.001 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:11.001 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1827 2024-05-08T18:32:11.001 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.001 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:11.002 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.002 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:11.002 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.589747+0000", 2024-05-08T18:32:11.002 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:11.002 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.002 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.002 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:11.002 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.589747+0000", 2024-05-08T18:32:11.002 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:11.002 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.002 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.002 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:11.002 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.589750+0000", 2024-05-08T18:32:11.003 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.627e-06 2024-05-08T18:32:11.003 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.003 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.003 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:11.003 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.593876+0000", 2024-05-08T18:32:11.003 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0041264020000000004 2024-05-08T18:32:11.003 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.003 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.003 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:11.003 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.593913+0000", 2024-05-08T18:32:11.003 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6489000000000002e-05 2024-05-08T18:32:11.003 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.003 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.004 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:11.004 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.593934+0000", 2024-05-08T18:32:11.004 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0647000000000001e-05 2024-05-08T18:32:11.004 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.004 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.004 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:11.004 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.594098+0000", 2024-05-08T18:32:11.004 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016424500000000001 2024-05-08T18:32:11.004 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.004 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.004 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:11.004 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.594519+0000", 2024-05-08T18:32:11.004 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00042162699999999999 2024-05-08T18:32:11.005 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.005 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.005 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 4", 2024-05-08T18:32:11.005 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.594920+0000", 2024-05-08T18:32:11.005 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00040058699999999999 2024-05-08T18:32:11.005 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.005 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.005 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:11.005 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.605419+0000", 2024-05-08T18:32:11.005 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010499338 2024-05-08T18:32:11.005 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.005 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.005 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:11.005 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.608968+0000", 2024-05-08T18:32:11.005 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0035482000000000001 2024-05-08T18:32:11.006 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.006 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.006 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:11.006 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.609072+0000", 2024-05-08T18:32:11.006 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010433300000000001 2024-05-08T18:32:11.006 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.006 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.006 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:11.006 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.609152+0000", 2024-05-08T18:32:11.006 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9938999999999995e-05 2024-05-08T18:32:11.006 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:11.006 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:11.006 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:11.007 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.007 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.007 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1865 3.3f e93/21 3:ffe43b13:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_51:head v 93'5, mlcod=82'3)", 2024-05-08T18:32:11.007 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:01.052358+0000", 2024-05-08T18:32:11.007 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 9.8449011120000005, 2024-05-08T18:32:11.007 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.026338456999999999, 2024-05-08T18:32:11.007 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:11.007 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:11.007 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:11.007 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:11.007 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.007 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:11.007 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.052358+0000", 2024-05-08T18:32:11.008 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:11.008 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.008 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.008 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:11.008 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.052358+0000", 2024-05-08T18:32:11.008 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:11.008 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.008 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.008 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:11.008 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.052360+0000", 2024-05-08T18:32:11.008 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.604e-06 2024-05-08T18:32:11.008 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.008 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.008 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:11.009 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.058761+0000", 2024-05-08T18:32:11.009 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0064009770000000004 2024-05-08T18:32:11.009 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.009 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.009 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:11.009 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.058816+0000", 2024-05-08T18:32:11.009 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4413999999999998e-05 2024-05-08T18:32:11.009 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.009 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.009 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:11.009 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.058842+0000", 2024-05-08T18:32:11.009 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6063000000000001e-05 2024-05-08T18:32:11.009 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.009 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.010 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:11.010 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.059001+0000", 2024-05-08T18:32:11.010 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000159452 2024-05-08T18:32:11.010 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.010 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.010 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:11.010 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.059067+0000", 2024-05-08T18:32:11.010 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6079000000000002e-05 2024-05-08T18:32:11.010 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.010 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.010 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:11.010 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.078590+0000", 2024-05-08T18:32:11.010 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019522445999999999 2024-05-08T18:32:11.010 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.011 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.011 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:11.011 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.078696+0000", 2024-05-08T18:32:11.011 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010642200000000001 2024-05-08T18:32:11.011 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:11.011 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:11.011 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:11.011 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.011 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.011 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1869 3.35 3:ac4c2d5c:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_55:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:32:11.011 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:01.092235+0000", 2024-05-08T18:32:11.011 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 9.8050233789999997, 2024-05-08T18:32:11.011 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.028692921, 2024-05-08T18:32:11.012 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:11.012 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:11.012 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:11.012 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:11.012 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:11.012 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:11.012 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1869 2024-05-08T18:32:11.012 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.012 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:11.012 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.012 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:11.012 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.092235+0000", 2024-05-08T18:32:11.012 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:11.012 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.012 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.013 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:11.013 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.092235+0000", 2024-05-08T18:32:11.013 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:11.013 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.013 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.013 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:11.013 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.092239+0000", 2024-05-08T18:32:11.013 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.143e-06 2024-05-08T18:32:11.013 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.013 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.013 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:11.013 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.099610+0000", 2024-05-08T18:32:11.013 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0073708410000000004 2024-05-08T18:32:11.013 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.014 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.014 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:11.014 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.099636+0000", 2024-05-08T18:32:11.014 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5354000000000002e-05 2024-05-08T18:32:11.014 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.014 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.014 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:11.014 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.099650+0000", 2024-05-08T18:32:11.014 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3926e-05 2024-05-08T18:32:11.014 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.014 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.014 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:11.014 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.099935+0000", 2024-05-08T18:32:11.014 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00028528100000000002 2024-05-08T18:32:11.015 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.015 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.015 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:11.015 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.100371+0000", 2024-05-08T18:32:11.015 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00043653399999999998 2024-05-08T18:32:11.015 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.015 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.015 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 5", 2024-05-08T18:32:11.015 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.100635+0000", 2024-05-08T18:32:11.015 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00026408300000000003 2024-05-08T18:32:11.015 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.015 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.015 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:11.016 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.120504+0000", 2024-05-08T18:32:11.016 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019868061999999999 2024-05-08T18:32:11.016 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.016 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.016 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:11.016 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.120565+0000", 2024-05-08T18:32:11.016 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1951000000000004e-05 2024-05-08T18:32:11.016 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.016 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.016 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:11.016 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.120691+0000", 2024-05-08T18:32:11.016 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000125687 2024-05-08T18:32:11.016 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.016 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.017 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:11.017 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.120928+0000", 2024-05-08T18:32:11.017 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00023705899999999999 2024-05-08T18:32:11.017 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:11.017 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:11.017 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:11.017 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.017 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.017 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1870 3.35 3:ae4fe6ec:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_56:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:32:11.017 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:01.102476+0000", 2024-05-08T18:32:11.017 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 9.7947826029999998, 2024-05-08T18:32:11.017 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.026237963999999999, 2024-05-08T18:32:11.017 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:11.018 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:11.018 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:11.018 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:11.018 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:11.018 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:11.018 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1870 2024-05-08T18:32:11.018 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.018 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:11.018 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.018 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:11.018 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.102476+0000", 2024-05-08T18:32:11.018 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:11.018 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.018 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.019 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:11.019 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.102476+0000", 2024-05-08T18:32:11.019 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:11.019 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.019 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.019 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:11.019 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.102478+0000", 2024-05-08T18:32:11.019 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1670000000000002e-06 2024-05-08T18:32:11.019 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.019 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.019 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:11.019 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.106606+0000", 2024-05-08T18:32:11.019 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0041281369999999996 2024-05-08T18:32:11.019 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.020 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.020 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:11.020 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.106630+0000", 2024-05-08T18:32:11.020 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3972999999999999e-05 2024-05-08T18:32:11.020 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.020 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.020 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:11.020 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.106643+0000", 2024-05-08T18:32:11.020 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2167999999999999e-05 2024-05-08T18:32:11.020 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.020 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.020 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:11.020 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.112414+0000", 2024-05-08T18:32:11.020 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.005771712 2024-05-08T18:32:11.021 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.021 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.021 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:11.021 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.112627+0000", 2024-05-08T18:32:11.021 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00021261300000000001 2024-05-08T18:32:11.021 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.021 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.021 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 5", 2024-05-08T18:32:11.021 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.112854+0000", 2024-05-08T18:32:11.021 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022747800000000001 2024-05-08T18:32:11.021 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.021 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.021 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:11.022 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.123928+0000", 2024-05-08T18:32:11.022 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011074083 2024-05-08T18:32:11.022 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.022 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.022 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:11.022 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.128565+0000", 2024-05-08T18:32:11.022 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0046363619999999998 2024-05-08T18:32:11.022 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.022 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.022 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:11.022 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.128648+0000", 2024-05-08T18:32:11.022 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2917999999999995e-05 2024-05-08T18:32:11.022 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.022 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.023 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:11.023 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.128714+0000", 2024-05-08T18:32:11.023 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6353000000000007e-05 2024-05-08T18:32:11.023 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:11.023 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:11.023 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:11.023 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.023 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.023 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1880 3.2c 3:37adcf73:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_66:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:32:11.023 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:01.273251+0000", 2024-05-08T18:32:11.023 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 9.6240076519999995, 2024-05-08T18:32:11.023 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.021420284000000001, 2024-05-08T18:32:11.023 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:11.023 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:11.024 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:11.024 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:11.024 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:11.024 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:11.024 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1880 2024-05-08T18:32:11.024 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.024 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:11.024 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.024 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:11.024 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.273251+0000", 2024-05-08T18:32:11.024 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:11.024 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.024 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.024 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:11.025 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.273251+0000", 2024-05-08T18:32:11.025 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:11.025 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.025 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.025 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:11.025 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.273254+0000", 2024-05-08T18:32:11.025 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8200000000000001e-06 2024-05-08T18:32:11.025 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.025 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.025 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:11.025 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.277791+0000", 2024-05-08T18:32:11.025 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0045372520000000003 2024-05-08T18:32:11.025 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.026 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.026 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:11.026 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.277828+0000", 2024-05-08T18:32:11.026 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6882999999999999e-05 2024-05-08T18:32:11.026 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.026 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.026 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:11.026 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.277854+0000", 2024-05-08T18:32:11.026 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6063000000000001e-05 2024-05-08T18:32:11.026 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.026 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.026 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:11.026 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.277947+0000", 2024-05-08T18:32:11.027 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.3367000000000002e-05 2024-05-08T18:32:11.027 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.027 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.027 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:11.027 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.278063+0000", 2024-05-08T18:32:11.027 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011535399999999999 2024-05-08T18:32:11.027 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.027 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.027 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 4", 2024-05-08T18:32:11.027 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.278162+0000", 2024-05-08T18:32:11.027 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.9463999999999995e-05 2024-05-08T18:32:11.027 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.027 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.027 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:11.027 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.284604+0000", 2024-05-08T18:32:11.028 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0064413109999999999 2024-05-08T18:32:11.028 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.028 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.028 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:11.028 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.294593+0000", 2024-05-08T18:32:11.028 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0099896640000000005 2024-05-08T18:32:11.028 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.028 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.028 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:11.028 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.294637+0000", 2024-05-08T18:32:11.028 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3640999999999998e-05 2024-05-08T18:32:11.028 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.028 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.028 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:11.028 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.294671+0000", 2024-05-08T18:32:11.029 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4465000000000003e-05 2024-05-08T18:32:11.029 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:11.029 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:11.029 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:11.029 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.029 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.029 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1907 3.34 e93/21 3:2f5137c7:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_93:head v 93'5, mlcod=84'3)", 2024-05-08T18:32:11.029 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:01.836973+0000", 2024-05-08T18:32:11.029 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 9.0602856430000003, 2024-05-08T18:32:11.029 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.025279401999999999, 2024-05-08T18:32:11.029 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:11.029 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:11.029 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:11.029 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:11.030 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.030 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:11.030 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.836973+0000", 2024-05-08T18:32:11.030 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:11.030 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.030 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.030 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:11.030 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.836973+0000", 2024-05-08T18:32:11.030 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:11.030 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.030 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.030 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:11.030 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.836976+0000", 2024-05-08T18:32:11.031 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5399999999999998e-06 2024-05-08T18:32:11.031 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.031 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.031 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:11.031 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.840092+0000", 2024-05-08T18:32:11.031 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0031165899999999998 2024-05-08T18:32:11.031 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.031 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.031 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:11.031 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.840132+0000", 2024-05-08T18:32:11.031 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9922999999999997e-05 2024-05-08T18:32:11.031 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.031 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.031 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:11.032 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.840151+0000", 2024-05-08T18:32:11.032 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9046999999999999e-05 2024-05-08T18:32:11.032 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.032 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.032 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:11.032 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.840313+0000", 2024-05-08T18:32:11.032 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016207099999999999 2024-05-08T18:32:11.032 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.032 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.032 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:11.032 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.840383+0000", 2024-05-08T18:32:11.032 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0129999999999994e-05 2024-05-08T18:32:11.032 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.032 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.032 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:11.033 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.862123+0000", 2024-05-08T18:32:11.033 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.021740038 2024-05-08T18:32:11.033 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.033 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.033 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:11.033 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.862252+0000", 2024-05-08T18:32:11.033 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012906300000000001 2024-05-08T18:32:11.033 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:11.033 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:11.033 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:11.033 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.033 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.033 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1922 3.10 3:08161f34:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_108:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:32:11.033 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:02.062130+0000", 2024-05-08T18:32:11.033 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 8.8351283560000002, 2024-05-08T18:32:11.034 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.020646504999999999, 2024-05-08T18:32:11.034 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:11.034 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:11.034 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:11.034 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:11.034 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:11.034 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:11.034 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1922 2024-05-08T18:32:11.034 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.034 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:11.034 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.034 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:11.034 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.062130+0000", 2024-05-08T18:32:11.035 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:11.035 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.035 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.035 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:11.035 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.062130+0000", 2024-05-08T18:32:11.035 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:11.035 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.035 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.035 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:11.035 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.062134+0000", 2024-05-08T18:32:11.035 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0969999999999999e-06 2024-05-08T18:32:11.035 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.035 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.035 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:11.035 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.068395+0000", 2024-05-08T18:32:11.036 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.006260336 2024-05-08T18:32:11.036 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.036 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.036 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:11.036 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.068435+0000", 2024-05-08T18:32:11.036 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0453e-05 2024-05-08T18:32:11.036 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.036 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.036 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:11.036 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.068456+0000", 2024-05-08T18:32:11.036 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0686000000000002e-05 2024-05-08T18:32:11.036 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.036 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.037 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:11.037 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.068554+0000", 2024-05-08T18:32:11.037 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8006999999999999e-05 2024-05-08T18:32:11.037 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.037 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.037 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:11.037 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.068735+0000", 2024-05-08T18:32:11.037 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00018081400000000001 2024-05-08T18:32:11.037 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.037 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.037 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:32:11.037 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.068912+0000", 2024-05-08T18:32:11.037 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017739399999999999 2024-05-08T18:32:11.037 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.037 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.038 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:11.038 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.078319+0000", 2024-05-08T18:32:11.038 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0094067339999999999 2024-05-08T18:32:11.038 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.038 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.038 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:11.038 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.082607+0000", 2024-05-08T18:32:11.038 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0042881250000000003 2024-05-08T18:32:11.038 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.038 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.038 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:11.038 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.082708+0000", 2024-05-08T18:32:11.038 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000100649 2024-05-08T18:32:11.039 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.039 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.039 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:11.039 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.082777+0000", 2024-05-08T18:32:11.039 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9209999999999996e-05 2024-05-08T18:32:11.039 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:11.039 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:11.039 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:11.039 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:11.039 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:11.039 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:32:11.041 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-08T18:32:11.041 INFO:tasks.ceph.osd.1.smithi097.stderr:2024-05-08T18:32:11.040+0000 7f67eac7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25210) UID: 0 2024-05-08T18:32:11.142 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:32:11.140+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:32:11.213 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:32:11.213 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:32:11.213 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 0 2024-05-08T18:32:11.213 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:32:11.227 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-08T18:32:11.272 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:32:11.270+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:32:11.311 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-08T18:32:11.350 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:32:11.350 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:32:11.350 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2024-05-08T18:32:11.350 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2024-05-08T18:32:11.350 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:32:11.356 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:32:11.356+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:32:11.364 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-08T18:32:11.452 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:32:11.450+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:32:11.472 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2024-05-08T18:32:11.472 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:32:11.488 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2024-05-08T18:32:11.489 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:32:11.507 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2024-05-08T18:32:11.507 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:32:11.524 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2024-05-08T18:32:11.525 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:32:11.535 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:32:11.535 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2024-05-08T18:32:11.535 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2024-05-08T18:32:11.535 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-05-08T18:32:11.535 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.535 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:32:11.535 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.248003+0000", 2024-05-08T18:32:11.535 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 164.28485693799999, 2024-05-08T18:32:11.536 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.020859638999999999, 2024-05-08T18:32:11.536 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:11.536 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:11.536 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:11.536 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:11.536 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:32:11.536 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:32:11.536 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 50 2024-05-08T18:32:11.536 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.536 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:11.536 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.536 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:11.536 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248003+0000", 2024-05-08T18:32:11.536 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:11.537 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.537 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.537 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:11.537 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248003+0000", 2024-05-08T18:32:11.537 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:11.537 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.537 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.537 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:11.537 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248004+0000", 2024-05-08T18:32:11.537 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5300000000000003e-07 2024-05-08T18:32:11.537 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.537 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.537 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:11.537 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248139+0000", 2024-05-08T18:32:11.538 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000135193 2024-05-08T18:32:11.538 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.538 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.538 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:11.538 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248151+0000", 2024-05-08T18:32:11.538 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.19e-05 2024-05-08T18:32:11.538 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.538 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.538 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:11.538 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248161+0000", 2024-05-08T18:32:11.538 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4599999999999992e-06 2024-05-08T18:32:11.538 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.539 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.539 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:11.539 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.263961+0000", 2024-05-08T18:32:11.539 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015800844000000001 2024-05-08T18:32:11.539 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.539 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.539 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:11.539 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.264091+0000", 2024-05-08T18:32:11.539 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012952300000000001 2024-05-08T18:32:11.539 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.539 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.539 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:32:11.539 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.264306+0000", 2024-05-08T18:32:11.539 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000215541 2024-05-08T18:32:11.540 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.540 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.540 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:11.540 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.267205+0000", 2024-05-08T18:32:11.540 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0028989910000000001 2024-05-08T18:32:11.540 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.540 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.540 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:11.540 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.268631+0000", 2024-05-08T18:32:11.540 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0014257320000000001 2024-05-08T18:32:11.540 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.540 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.540 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:11.541 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.268781+0000", 2024-05-08T18:32:11.541 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000149939 2024-05-08T18:32:11.541 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.541 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.541 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:11.541 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.268863+0000", 2024-05-08T18:32:11.541 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1762999999999996e-05 2024-05-08T18:32:11.541 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:11.541 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:11.541 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:11.541 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.541 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.541 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:32:11.541 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.248201+0000", 2024-05-08T18:32:11.542 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 164.284659183, 2024-05-08T18:32:11.542 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.022909783, 2024-05-08T18:32:11.542 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:11.542 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:11.542 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:11.542 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:11.542 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:32:11.542 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:32:11.542 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 51 2024-05-08T18:32:11.542 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.542 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:11.542 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.542 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:11.543 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248201+0000", 2024-05-08T18:32:11.543 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:11.543 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.543 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.543 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:11.543 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248201+0000", 2024-05-08T18:32:11.543 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:11.543 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.543 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.543 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:11.543 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248202+0000", 2024-05-08T18:32:11.543 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2999999999999999e-07 2024-05-08T18:32:11.543 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.543 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.544 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:11.544 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248209+0000", 2024-05-08T18:32:11.544 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5769999999999996e-06 2024-05-08T18:32:11.544 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.544 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.544 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:11.544 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248221+0000", 2024-05-08T18:32:11.544 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1165999999999999e-05 2024-05-08T18:32:11.544 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.544 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.544 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:11.544 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248229+0000", 2024-05-08T18:32:11.544 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1529999999999997e-06 2024-05-08T18:32:11.544 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.545 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.545 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:11.545 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.265146+0000", 2024-05-08T18:32:11.545 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016917492999999999 2024-05-08T18:32:11.545 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.545 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.545 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:11.545 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.265282+0000", 2024-05-08T18:32:11.545 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013597199999999999 2024-05-08T18:32:11.545 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.545 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.545 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:32:11.546 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.265488+0000", 2024-05-08T18:32:11.546 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000206212 2024-05-08T18:32:11.546 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.546 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.546 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:11.546 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.268442+0000", 2024-05-08T18:32:11.546 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002953841 2024-05-08T18:32:11.546 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.546 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.546 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:11.546 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.270951+0000", 2024-05-08T18:32:11.546 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0025085670000000002 2024-05-08T18:32:11.546 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.546 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.547 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:11.547 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.271042+0000", 2024-05-08T18:32:11.547 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1485999999999998e-05 2024-05-08T18:32:11.547 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.547 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.547 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:11.547 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.271111+0000", 2024-05-08T18:32:11.547 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8386000000000006e-05 2024-05-08T18:32:11.547 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:11.547 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:11.547 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:11.547 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.547 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.548 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:32:11.548 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.248244+0000", 2024-05-08T18:32:11.548 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 164.28461662699999, 2024-05-08T18:32:11.548 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.023010806000000002, 2024-05-08T18:32:11.548 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:11.548 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:11.548 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:11.548 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:11.548 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:32:11.548 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:32:11.548 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 52 2024-05-08T18:32:11.548 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.548 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:11.548 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.549 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:11.549 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248244+0000", 2024-05-08T18:32:11.549 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:11.549 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.549 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.549 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:11.549 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248244+0000", 2024-05-08T18:32:11.549 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:11.549 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.549 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.549 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:11.549 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248244+0000", 2024-05-08T18:32:11.549 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0999999999999998e-07 2024-05-08T18:32:11.549 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.550 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.550 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:11.550 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248251+0000", 2024-05-08T18:32:11.550 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9639999999999997e-06 2024-05-08T18:32:11.550 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.550 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.550 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:11.550 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248266+0000", 2024-05-08T18:32:11.550 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4996e-05 2024-05-08T18:32:11.550 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.550 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.550 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:11.550 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248274+0000", 2024-05-08T18:32:11.550 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8299999999999996e-06 2024-05-08T18:32:11.551 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.551 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.551 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:11.551 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266367+0000", 2024-05-08T18:32:11.551 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018092607 2024-05-08T18:32:11.551 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.551 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.551 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:11.551 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266532+0000", 2024-05-08T18:32:11.551 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016569600000000001 2024-05-08T18:32:11.551 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.551 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.551 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:32:11.552 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266729+0000", 2024-05-08T18:32:11.552 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00019630099999999999 2024-05-08T18:32:11.552 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.552 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.552 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:11.552 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.268574+0000", 2024-05-08T18:32:11.552 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0018452329999999999 2024-05-08T18:32:11.552 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.552 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.552 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:11.552 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.271128+0000", 2024-05-08T18:32:11.552 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00255369 2024-05-08T18:32:11.552 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.553 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.553 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:11.553 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.271199+0000", 2024-05-08T18:32:11.553 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1712999999999996e-05 2024-05-08T18:32:11.553 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.553 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.553 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:11.553 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.271254+0000", 2024-05-08T18:32:11.553 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5065999999999998e-05 2024-05-08T18:32:11.553 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:11.553 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:11.553 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:11.553 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.553 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.554 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1317 3.2d 3:b70e9396:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-08T18:32:11.554 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.323924+0000", 2024-05-08T18:32:11.554 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 29.208935864000001, 2024-05-08T18:32:11.554 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.027663854000000002, 2024-05-08T18:32:11.554 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:11.554 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:11.554 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:11.554 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:11.554 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:11.554 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:11.554 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1317 2024-05-08T18:32:11.554 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.554 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:11.554 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.555 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:11.555 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.323924+0000", 2024-05-08T18:32:11.555 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:11.555 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.555 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.555 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:11.555 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.323924+0000", 2024-05-08T18:32:11.555 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:11.555 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.555 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.555 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:11.555 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.323928+0000", 2024-05-08T18:32:11.555 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2329999999999998e-06 2024-05-08T18:32:11.555 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.555 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.556 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:11.556 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.330311+0000", 2024-05-08T18:32:11.556 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0063831290000000004 2024-05-08T18:32:11.556 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.556 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.556 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:11.556 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.330352+0000", 2024-05-08T18:32:11.556 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1162000000000003e-05 2024-05-08T18:32:11.556 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.556 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.556 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:11.556 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.330370+0000", 2024-05-08T18:32:11.556 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8050000000000002e-05 2024-05-08T18:32:11.557 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.557 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.557 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:11.557 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.330516+0000", 2024-05-08T18:32:11.557 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000146432 2024-05-08T18:32:11.557 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.557 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.557 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:11.557 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.330769+0000", 2024-05-08T18:32:11.557 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00025228499999999999 2024-05-08T18:32:11.557 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.557 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.557 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-05-08T18:32:11.557 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.330984+0000", 2024-05-08T18:32:11.557 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00021582200000000001 2024-05-08T18:32:11.558 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.558 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.558 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:11.558 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.345755+0000", 2024-05-08T18:32:11.558 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.014770521999999999 2024-05-08T18:32:11.558 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.558 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.558 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:11.558 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.351319+0000", 2024-05-08T18:32:11.558 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0055641650000000003 2024-05-08T18:32:11.558 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.558 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.558 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:11.559 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.351468+0000", 2024-05-08T18:32:11.559 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014938500000000001 2024-05-08T18:32:11.559 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.559 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.559 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:11.559 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.351588+0000", 2024-05-08T18:32:11.559 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000119669 2024-05-08T18:32:11.559 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:11.559 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:11.559 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:11.559 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.559 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.559 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1320 3.37 3:ee001392:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-08T18:32:11.559 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.373350+0000", 2024-05-08T18:32:11.560 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 29.159509773, 2024-05-08T18:32:11.560 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.021273095999999998, 2024-05-08T18:32:11.560 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:11.560 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:11.561 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:11.561 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:11.561 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:11.561 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:11.561 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1320 2024-05-08T18:32:11.561 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.561 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:11.561 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.561 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:11.562 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.373350+0000", 2024-05-08T18:32:11.562 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:11.562 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.562 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.562 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:11.562 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.373350+0000", 2024-05-08T18:32:11.562 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:11.562 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.562 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.562 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:11.562 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.373354+0000", 2024-05-08T18:32:11.562 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7960000000000002e-06 2024-05-08T18:32:11.562 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.563 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.563 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:11.563 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.377339+0000", 2024-05-08T18:32:11.563 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039847839999999999 2024-05-08T18:32:11.563 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.563 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.563 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:11.563 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.377378+0000", 2024-05-08T18:32:11.563 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9110000000000003e-05 2024-05-08T18:32:11.563 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.563 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.563 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:11.563 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.377397+0000", 2024-05-08T18:32:11.563 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8943000000000001e-05 2024-05-08T18:32:11.564 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.564 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.564 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:11.564 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.377531+0000", 2024-05-08T18:32:11.564 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000134339 2024-05-08T18:32:11.564 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.564 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.564 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:11.564 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.377782+0000", 2024-05-08T18:32:11.564 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000250802 2024-05-08T18:32:11.564 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.564 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.564 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 5", 2024-05-08T18:32:11.565 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.378007+0000", 2024-05-08T18:32:11.565 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022504799999999999 2024-05-08T18:32:11.565 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.565 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.565 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:11.565 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.385156+0000", 2024-05-08T18:32:11.565 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0071491760000000001 2024-05-08T18:32:11.565 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.565 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.565 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:11.565 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.394443+0000", 2024-05-08T18:32:11.565 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0092870130000000002 2024-05-08T18:32:11.565 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.565 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.566 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:11.566 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.394540+0000", 2024-05-08T18:32:11.566 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6708999999999999e-05 2024-05-08T18:32:11.566 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.566 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.566 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:11.566 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.394623+0000", 2024-05-08T18:32:11.566 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3375999999999996e-05 2024-05-08T18:32:11.566 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:11.566 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:11.566 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:11.566 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.567 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.567 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1322 3.f 3:f3016725:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-08T18:32:11.567 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.399465+0000", 2024-05-08T18:32:11.567 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 29.133395506999999, 2024-05-08T18:32:11.567 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.022350351000000001, 2024-05-08T18:32:11.567 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:11.567 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:11.567 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:11.567 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:11.567 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:11.567 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:11.567 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1322 2024-05-08T18:32:11.567 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.567 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:11.568 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.568 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:11.568 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.399465+0000", 2024-05-08T18:32:11.568 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:11.568 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.568 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.568 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:11.568 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.399465+0000", 2024-05-08T18:32:11.568 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:11.568 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.568 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.568 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:11.568 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.399468+0000", 2024-05-08T18:32:11.568 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7740000000000002e-06 2024-05-08T18:32:11.569 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.569 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.569 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:11.569 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.403500+0000", 2024-05-08T18:32:11.569 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0040316900000000001 2024-05-08T18:32:11.569 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.569 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.569 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:11.569 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.403550+0000", 2024-05-08T18:32:11.569 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9869e-05 2024-05-08T18:32:11.569 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.569 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.569 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:11.569 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.403576+0000", 2024-05-08T18:32:11.569 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5780000000000001e-05 2024-05-08T18:32:11.570 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.570 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.570 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:11.570 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.403741+0000", 2024-05-08T18:32:11.570 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016564499999999999 2024-05-08T18:32:11.570 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.570 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.570 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:11.570 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.403991+0000", 2024-05-08T18:32:11.570 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00024923799999999999 2024-05-08T18:32:11.570 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.570 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.570 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 4", 2024-05-08T18:32:11.570 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.404231+0000", 2024-05-08T18:32:11.571 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000240535 2024-05-08T18:32:11.571 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.571 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.571 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:11.571 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.415279+0000", 2024-05-08T18:32:11.571 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011048254 2024-05-08T18:32:11.571 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.571 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.571 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:11.571 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.421627+0000", 2024-05-08T18:32:11.571 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0063480050000000003 2024-05-08T18:32:11.571 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.571 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.571 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:11.572 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.421724+0000", 2024-05-08T18:32:11.572 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6911999999999996e-05 2024-05-08T18:32:11.572 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.572 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.572 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:11.572 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.421815+0000", 2024-05-08T18:32:11.572 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.0649000000000006e-05 2024-05-08T18:32:11.572 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:11.572 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:11.572 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:11.572 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.572 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.572 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1328 3.14 e81/21 3:2b0d89be:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_14:head v 81'1, mlcod=0'0)", 2024-05-08T18:32:11.572 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.480334+0000", 2024-05-08T18:32:11.572 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 29.052525926000001, 2024-05-08T18:32:11.573 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.02475223, 2024-05-08T18:32:11.573 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:11.573 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:11.573 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:11.573 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:11.573 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.573 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:11.573 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.480334+0000", 2024-05-08T18:32:11.573 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:11.573 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.573 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.573 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:11.573 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.480334+0000", 2024-05-08T18:32:11.574 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:11.574 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.574 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.574 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:11.574 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.480338+0000", 2024-05-08T18:32:11.574 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5999999999999998e-06 2024-05-08T18:32:11.574 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.574 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.574 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:11.574 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.483911+0000", 2024-05-08T18:32:11.574 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0035727269999999999 2024-05-08T18:32:11.574 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.574 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.574 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:11.575 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.483964+0000", 2024-05-08T18:32:11.575 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3766e-05 2024-05-08T18:32:11.575 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.575 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.575 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:11.575 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.483991+0000", 2024-05-08T18:32:11.575 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6386000000000001e-05 2024-05-08T18:32:11.575 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.575 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.575 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:11.575 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.484195+0000", 2024-05-08T18:32:11.575 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020458600000000001 2024-05-08T18:32:11.575 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.576 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.576 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:11.576 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.484237+0000", 2024-05-08T18:32:11.576 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1912000000000001e-05 2024-05-08T18:32:11.576 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.576 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.576 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:11.576 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.504965+0000", 2024-05-08T18:32:11.576 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.020728024000000001 2024-05-08T18:32:11.576 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.576 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.576 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:11.576 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.505086+0000", 2024-05-08T18:32:11.576 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000121229 2024-05-08T18:32:11.577 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:11.577 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:11.577 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:11.577 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.577 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.577 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1334 3.f 3:f1b2aee4:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_20:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-08T18:32:11.577 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.534497+0000", 2024-05-08T18:32:11.577 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 28.998363564000002, 2024-05-08T18:32:11.577 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.022526750000000002, 2024-05-08T18:32:11.577 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:11.577 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:11.577 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:11.577 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:11.578 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:11.578 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:11.578 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1334 2024-05-08T18:32:11.578 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.578 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:11.578 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.578 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:11.578 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.534497+0000", 2024-05-08T18:32:11.578 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:11.578 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.578 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.578 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:11.578 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.534497+0000", 2024-05-08T18:32:11.579 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:11.579 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.579 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.579 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:11.579 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.534501+0000", 2024-05-08T18:32:11.579 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9299999999999996e-06 2024-05-08T18:32:11.579 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.579 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.579 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:11.579 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.539860+0000", 2024-05-08T18:32:11.579 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0053598630000000003 2024-05-08T18:32:11.579 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.579 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.579 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:11.580 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.539899+0000", 2024-05-08T18:32:11.580 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8973000000000001e-05 2024-05-08T18:32:11.580 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.580 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.580 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:11.580 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.539919+0000", 2024-05-08T18:32:11.580 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.963e-05 2024-05-08T18:32:11.580 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.580 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.580 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:11.580 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.540078+0000", 2024-05-08T18:32:11.580 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015917199999999999 2024-05-08T18:32:11.580 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.580 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.581 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:11.581 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.540381+0000", 2024-05-08T18:32:11.581 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00030268100000000001 2024-05-08T18:32:11.581 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.581 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.581 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 4", 2024-05-08T18:32:11.581 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.540686+0000", 2024-05-08T18:32:11.581 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00030511399999999999 2024-05-08T18:32:11.581 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.581 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.581 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:11.581 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.549808+0000", 2024-05-08T18:32:11.581 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0091219679999999994 2024-05-08T18:32:11.581 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.582 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.582 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:11.582 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.556737+0000", 2024-05-08T18:32:11.582 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0069289850000000004 2024-05-08T18:32:11.582 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.582 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.582 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:11.582 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.556904+0000", 2024-05-08T18:32:11.582 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016715499999999999 2024-05-08T18:32:11.582 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.582 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.582 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:11.582 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.557023+0000", 2024-05-08T18:32:11.583 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011927899999999999 2024-05-08T18:32:11.583 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:11.583 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:11.583 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:11.583 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.583 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.583 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1357 3.f 3:f2d0b7b2:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_43:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:32:11.583 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.781836+0000", 2024-05-08T18:32:11.583 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 28.751024270999999, 2024-05-08T18:32:11.583 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.022799851999999999, 2024-05-08T18:32:11.583 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:11.583 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:11.583 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:11.584 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:11.584 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:11.584 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:11.584 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1357 2024-05-08T18:32:11.584 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.584 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:11.584 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.584 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:11.584 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.781836+0000", 2024-05-08T18:32:11.584 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:11.584 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.584 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.584 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:11.585 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.781836+0000", 2024-05-08T18:32:11.585 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:11.585 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.585 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.585 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:11.585 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.781839+0000", 2024-05-08T18:32:11.585 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.864e-06 2024-05-08T18:32:11.585 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.585 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.585 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:11.585 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.785867+0000", 2024-05-08T18:32:11.585 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0040287459999999997 2024-05-08T18:32:11.585 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.585 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.585 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:11.586 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.785906+0000", 2024-05-08T18:32:11.586 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8606000000000003e-05 2024-05-08T18:32:11.586 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.586 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.586 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:11.586 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.785926+0000", 2024-05-08T18:32:11.586 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0137e-05 2024-05-08T18:32:11.586 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.586 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.586 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:11.586 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.786061+0000", 2024-05-08T18:32:11.586 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013521200000000001 2024-05-08T18:32:11.587 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.587 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.587 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:11.587 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.786333+0000", 2024-05-08T18:32:11.587 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000271215 2024-05-08T18:32:11.587 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.587 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.587 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 4", 2024-05-08T18:32:11.587 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.786608+0000", 2024-05-08T18:32:11.587 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00027538699999999998 2024-05-08T18:32:11.587 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.587 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.587 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:11.587 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.804208+0000", 2024-05-08T18:32:11.588 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017599674999999999 2024-05-08T18:32:11.588 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.588 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.588 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:11.588 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.804331+0000", 2024-05-08T18:32:11.588 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012313600000000001 2024-05-08T18:32:11.588 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.588 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.588 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:11.588 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.804495+0000", 2024-05-08T18:32:11.588 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000164592 2024-05-08T18:32:11.588 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.588 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.588 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:11.588 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.804636+0000", 2024-05-08T18:32:11.589 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014028200000000001 2024-05-08T18:32:11.589 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:11.589 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:11.589 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:11.589 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.589 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.589 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1614 3.14 e83/21 3:284b5d90:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_2:head v 83'7, mlcod=82'5)", 2024-05-08T18:32:11.589 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:46.716647+0000", 2024-05-08T18:32:11.589 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 24.816213478000002, 2024-05-08T18:32:11.589 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.024320554000000001, 2024-05-08T18:32:11.589 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:11.589 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:11.589 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:11.590 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:11.590 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.590 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:11.590 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.716647+0000", 2024-05-08T18:32:11.590 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:11.590 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.590 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.590 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:11.590 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.716647+0000", 2024-05-08T18:32:11.590 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:11.590 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.590 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.590 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:11.590 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.716648+0000", 2024-05-08T18:32:11.591 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3699999999999999e-07 2024-05-08T18:32:11.591 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.591 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.591 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:11.591 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.721652+0000", 2024-05-08T18:32:11.591 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0050045360000000004 2024-05-08T18:32:11.591 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.591 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.591 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:11.591 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.721711+0000", 2024-05-08T18:32:11.591 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9419000000000001e-05 2024-05-08T18:32:11.591 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.592 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.592 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:11.592 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.721740+0000", 2024-05-08T18:32:11.592 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8707000000000001e-05 2024-05-08T18:32:11.592 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.592 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.592 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:11.592 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.721978+0000", 2024-05-08T18:32:11.592 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00023769500000000001 2024-05-08T18:32:11.592 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.592 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.592 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:11.592 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.722054+0000", 2024-05-08T18:32:11.592 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6441999999999998e-05 2024-05-08T18:32:11.592 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.593 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.593 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:11.593 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.740830+0000", 2024-05-08T18:32:11.593 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018775399000000002 2024-05-08T18:32:11.593 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.593 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.593 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:11.593 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.740967+0000", 2024-05-08T18:32:11.593 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013751900000000001 2024-05-08T18:32:11.593 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:11.593 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:11.593 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:11.594 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.594 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.594 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1616 3.7 e83/21 3:e2c69de8:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_4:head v 83'5, mlcod=82'3)", 2024-05-08T18:32:11.594 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:46.731352+0000", 2024-05-08T18:32:11.594 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 24.801508632000001, 2024-05-08T18:32:11.594 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.021059544999999999, 2024-05-08T18:32:11.594 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:11.594 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:11.594 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:11.594 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:11.594 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.594 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:11.594 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.731352+0000", 2024-05-08T18:32:11.595 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:11.595 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.595 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.595 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:11.595 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.731352+0000", 2024-05-08T18:32:11.595 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:11.595 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.595 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.595 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:11.595 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.731354+0000", 2024-05-08T18:32:11.595 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.897e-06 2024-05-08T18:32:11.595 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.595 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.595 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:11.596 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.737876+0000", 2024-05-08T18:32:11.596 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0065220499999999997 2024-05-08T18:32:11.596 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.596 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.596 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:11.596 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.737915+0000", 2024-05-08T18:32:11.596 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8575999999999998e-05 2024-05-08T18:32:11.596 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.596 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.596 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:11.596 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.737939+0000", 2024-05-08T18:32:11.596 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3799999999999999e-05 2024-05-08T18:32:11.596 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.596 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.597 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:11.597 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.738108+0000", 2024-05-08T18:32:11.597 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000168753 2024-05-08T18:32:11.597 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.597 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.597 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:11.597 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.738150+0000", 2024-05-08T18:32:11.597 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.2222999999999999e-05 2024-05-08T18:32:11.597 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.597 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.597 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:11.597 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.752280+0000", 2024-05-08T18:32:11.597 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.01413 2024-05-08T18:32:11.597 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.598 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.598 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:11.598 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.752411+0000", 2024-05-08T18:32:11.598 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013124600000000001 2024-05-08T18:32:11.598 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:11.598 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:11.598 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:11.598 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.598 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.598 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1620 3.e 3:7209acbb:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-05-08T18:32:11.598 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:46.773106+0000", 2024-05-08T18:32:11.598 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 24.759754445999999, 2024-05-08T18:32:11.599 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.02423749, 2024-05-08T18:32:11.599 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:11.599 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:11.599 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:11.599 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:11.599 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:11.599 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:11.599 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1620 2024-05-08T18:32:11.599 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.599 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:11.599 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.599 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:11.599 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.773106+0000", 2024-05-08T18:32:11.599 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:11.599 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.600 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.600 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:11.600 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.773106+0000", 2024-05-08T18:32:11.600 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:11.600 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.600 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.600 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:11.600 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.773110+0000", 2024-05-08T18:32:11.600 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.07e-06 2024-05-08T18:32:11.600 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.600 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.600 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:11.600 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.778353+0000", 2024-05-08T18:32:11.601 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0052432199999999998 2024-05-08T18:32:11.601 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.601 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.601 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:11.601 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.778407+0000", 2024-05-08T18:32:11.601 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3792999999999998e-05 2024-05-08T18:32:11.601 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.601 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.601 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:11.601 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.778426+0000", 2024-05-08T18:32:11.601 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9476000000000001e-05 2024-05-08T18:32:11.601 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.601 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.601 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:11.602 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.778583+0000", 2024-05-08T18:32:11.602 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000156489 2024-05-08T18:32:11.602 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.602 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.602 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:11.602 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.778844+0000", 2024-05-08T18:32:11.602 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00026110499999999997 2024-05-08T18:32:11.602 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.602 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.602 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 4", 2024-05-08T18:32:11.602 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.779084+0000", 2024-05-08T18:32:11.602 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000240621 2024-05-08T18:32:11.602 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.603 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.603 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:11.603 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.791772+0000", 2024-05-08T18:32:11.603 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012687855 2024-05-08T18:32:11.603 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.603 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.603 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:11.603 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.797162+0000", 2024-05-08T18:32:11.603 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0053901419999999997 2024-05-08T18:32:11.603 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.603 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.603 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:11.603 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.797263+0000", 2024-05-08T18:32:11.603 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010066299999999999 2024-05-08T18:32:11.604 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.604 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.604 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:11.604 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.797343+0000", 2024-05-08T18:32:11.604 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.0055999999999994e-05 2024-05-08T18:32:11.604 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:11.604 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:11.604 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:11.604 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.604 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.604 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1622 3.11 3:8a36e97a:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-05-08T18:32:11.604 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:46.790971+0000", 2024-05-08T18:32:11.604 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 24.741888887999998, 2024-05-08T18:32:11.604 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.026781425000000001, 2024-05-08T18:32:11.605 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:11.605 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:11.605 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:11.605 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:11.605 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:11.605 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:11.605 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1622 2024-05-08T18:32:11.605 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.605 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:11.606 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.606 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:11.606 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.790971+0000", 2024-05-08T18:32:11.606 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:11.606 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.606 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.606 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:11.606 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.790971+0000", 2024-05-08T18:32:11.606 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:11.606 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.606 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.606 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:11.606 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.790974+0000", 2024-05-08T18:32:11.607 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6860000000000002e-06 2024-05-08T18:32:11.607 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.607 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.607 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:11.607 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.796777+0000", 2024-05-08T18:32:11.607 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0058027269999999997 2024-05-08T18:32:11.607 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.607 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.607 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:11.607 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.796820+0000", 2024-05-08T18:32:11.607 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3439999999999997e-05 2024-05-08T18:32:11.607 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.607 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.607 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:11.608 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.796840+0000", 2024-05-08T18:32:11.608 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.942e-05 2024-05-08T18:32:11.608 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.608 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.608 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:11.608 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.797010+0000", 2024-05-08T18:32:11.608 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016999199999999999 2024-05-08T18:32:11.608 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.608 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.608 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:11.608 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.797333+0000", 2024-05-08T18:32:11.608 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00032329400000000001 2024-05-08T18:32:11.609 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.609 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.609 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 4", 2024-05-08T18:32:11.609 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.797605+0000", 2024-05-08T18:32:11.609 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00027210800000000002 2024-05-08T18:32:11.609 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.609 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.609 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:11.609 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.817018+0000", 2024-05-08T18:32:11.609 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019413079999999999 2024-05-08T18:32:11.609 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.609 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.609 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:11.609 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.817574+0000", 2024-05-08T18:32:11.610 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00055607599999999997 2024-05-08T18:32:11.610 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.610 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.610 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:11.610 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.817678+0000", 2024-05-08T18:32:11.610 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010399300000000001 2024-05-08T18:32:11.610 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.610 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.610 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:11.610 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.817753+0000", 2024-05-08T18:32:11.610 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4609000000000003e-05 2024-05-08T18:32:11.610 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:11.610 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:11.611 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:11.611 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.611 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.611 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1633 3.15 3:ab226f54:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-05-08T18:32:11.611 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:46.914872+0000", 2024-05-08T18:32:11.611 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 24.617987835000001, 2024-05-08T18:32:11.611 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.028767053000000001, 2024-05-08T18:32:11.611 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:11.611 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:11.611 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:11.611 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:11.611 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:11.611 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:11.611 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1633 2024-05-08T18:32:11.611 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.612 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:11.612 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.612 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:11.612 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.914872+0000", 2024-05-08T18:32:11.612 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:11.612 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.612 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.612 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:11.612 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.914872+0000", 2024-05-08T18:32:11.612 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:11.612 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.612 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.612 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:11.612 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.914877+0000", 2024-05-08T18:32:11.613 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8160000000000001e-06 2024-05-08T18:32:11.613 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.613 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.613 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:11.613 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.919320+0000", 2024-05-08T18:32:11.613 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0044431870000000004 2024-05-08T18:32:11.613 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.613 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.613 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:11.613 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.919359+0000", 2024-05-08T18:32:11.613 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8572999999999998e-05 2024-05-08T18:32:11.613 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.613 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.613 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:11.614 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.919385+0000", 2024-05-08T18:32:11.614 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5792999999999999e-05 2024-05-08T18:32:11.614 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.614 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.614 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:11.614 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.919530+0000", 2024-05-08T18:32:11.614 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014553600000000001 2024-05-08T18:32:11.614 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.614 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.614 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:11.614 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.919799+0000", 2024-05-08T18:32:11.614 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00026923399999999998 2024-05-08T18:32:11.614 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.615 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.615 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 3", 2024-05-08T18:32:11.615 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.920044+0000", 2024-05-08T18:32:11.615 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00024442499999999999 2024-05-08T18:32:11.615 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.615 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.615 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:11.615 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.928865+0000", 2024-05-08T18:32:11.615 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0088214509999999993 2024-05-08T18:32:11.615 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.615 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.615 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:11.615 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.943462+0000", 2024-05-08T18:32:11.615 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.014596408999999999 2024-05-08T18:32:11.616 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.616 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.616 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:11.616 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.943564+0000", 2024-05-08T18:32:11.616 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000101863 2024-05-08T18:32:11.616 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.616 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.616 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:11.616 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.943639+0000", 2024-05-08T18:32:11.616 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5766000000000006e-05 2024-05-08T18:32:11.616 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:11.616 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:11.616 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:11.616 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.617 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.617 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1830 3.2d 3:b5a6fb7d:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-05-08T18:32:11.617 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:00.635702+0000", 2024-05-08T18:32:11.617 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 10.897158470000001, 2024-05-08T18:32:11.617 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.039838612000000002, 2024-05-08T18:32:11.617 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:11.617 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:11.617 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:11.617 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:11.617 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:11.617 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:11.617 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1830 2024-05-08T18:32:11.617 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.618 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:11.618 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.618 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:11.618 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.635702+0000", 2024-05-08T18:32:11.618 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:11.618 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.618 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.618 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:11.618 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.635702+0000", 2024-05-08T18:32:11.618 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:11.618 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.618 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.618 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:11.619 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.635705+0000", 2024-05-08T18:32:11.619 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.937e-06 2024-05-08T18:32:11.619 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.619 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.619 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:11.619 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.644814+0000", 2024-05-08T18:32:11.619 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0091098780000000001 2024-05-08T18:32:11.619 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.619 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.619 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:11.619 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.644843+0000", 2024-05-08T18:32:11.619 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8439e-05 2024-05-08T18:32:11.619 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.620 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.620 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:11.620 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.644859+0000", 2024-05-08T18:32:11.620 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6460000000000002e-05 2024-05-08T18:32:11.620 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.620 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.620 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:11.620 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.644940+0000", 2024-05-08T18:32:11.620 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1031000000000004e-05 2024-05-08T18:32:11.620 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.620 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.620 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:11.620 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.645103+0000", 2024-05-08T18:32:11.620 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016295599999999999 2024-05-08T18:32:11.621 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.621 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.621 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-05-08T18:32:11.621 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.645218+0000", 2024-05-08T18:32:11.621 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011441499999999999 2024-05-08T18:32:11.621 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.621 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.621 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:11.621 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.651600+0000", 2024-05-08T18:32:11.621 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0063818900000000003 2024-05-08T18:32:11.621 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.621 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.621 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:11.621 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.675451+0000", 2024-05-08T18:32:11.622 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.023850865999999998 2024-05-08T18:32:11.622 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.622 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.622 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:11.622 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.675500+0000", 2024-05-08T18:32:11.622 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9623999999999998e-05 2024-05-08T18:32:11.622 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.622 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.622 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:11.622 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.675540+0000", 2024-05-08T18:32:11.622 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0116e-05 2024-05-08T18:32:11.622 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:11.622 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:11.623 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:11.623 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.623 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.623 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1861 3.f 3:f0b8f9d8:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_47:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:32:11.623 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:01.002850+0000", 2024-05-08T18:32:11.623 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 10.530010387000001, 2024-05-08T18:32:11.623 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.024823504, 2024-05-08T18:32:11.623 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:11.623 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:11.623 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:11.623 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:11.623 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:11.623 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:11.624 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1861 2024-05-08T18:32:11.624 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.624 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:11.624 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.624 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:11.624 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.002850+0000", 2024-05-08T18:32:11.624 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:11.624 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.624 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.624 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:11.624 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.002850+0000", 2024-05-08T18:32:11.624 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:11.625 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.625 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.625 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:11.625 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.002852+0000", 2024-05-08T18:32:11.625 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.04e-06 2024-05-08T18:32:11.625 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.625 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.625 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:11.625 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.006630+0000", 2024-05-08T18:32:11.625 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0037778019999999998 2024-05-08T18:32:11.625 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.625 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.625 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:11.625 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.006655+0000", 2024-05-08T18:32:11.626 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.4916999999999999e-05 2024-05-08T18:32:11.626 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.626 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.626 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:11.626 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.006668+0000", 2024-05-08T18:32:11.626 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.348e-05 2024-05-08T18:32:11.626 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.626 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.626 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:11.626 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.006819+0000", 2024-05-08T18:32:11.626 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015059700000000001 2024-05-08T18:32:11.626 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.626 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.627 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:11.627 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.007076+0000", 2024-05-08T18:32:11.627 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000257058 2024-05-08T18:32:11.627 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.627 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.627 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 4", 2024-05-08T18:32:11.627 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.007329+0000", 2024-05-08T18:32:11.627 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000253718 2024-05-08T18:32:11.627 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.627 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.627 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:11.627 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.018105+0000", 2024-05-08T18:32:11.627 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010775778 2024-05-08T18:32:11.627 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.628 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.628 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:11.628 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.027519+0000", 2024-05-08T18:32:11.628 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0094135220000000006 2024-05-08T18:32:11.628 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.628 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.628 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:11.628 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.027606+0000", 2024-05-08T18:32:11.628 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.7001000000000003e-05 2024-05-08T18:32:11.628 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.628 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.628 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:11.628 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.027673+0000", 2024-05-08T18:32:11.628 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7590999999999997e-05 2024-05-08T18:32:11.629 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:11.629 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:11.629 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:11.629 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.629 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.629 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1865 3.3f 3:ffe43b13:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_51:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:32:11.629 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:01.047109+0000", 2024-05-08T18:32:11.629 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 10.485751391000001, 2024-05-08T18:32:11.629 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.032239539999999997, 2024-05-08T18:32:11.629 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:11.629 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:11.629 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:11.629 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:11.629 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:11.629 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:11.629 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1865 2024-05-08T18:32:11.630 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.630 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:11.630 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.630 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:11.630 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.047109+0000", 2024-05-08T18:32:11.630 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:11.630 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.630 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.630 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:11.630 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.047109+0000", 2024-05-08T18:32:11.630 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:11.630 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.630 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.630 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:11.631 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.047112+0000", 2024-05-08T18:32:11.631 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1099999999999999e-06 2024-05-08T18:32:11.631 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.631 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.631 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:11.631 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.051447+0000", 2024-05-08T18:32:11.631 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0043346679999999999 2024-05-08T18:32:11.631 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.631 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.631 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:11.631 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.051479+0000", 2024-05-08T18:32:11.631 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2619000000000001e-05 2024-05-08T18:32:11.631 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.631 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.632 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:11.632 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.051495+0000", 2024-05-08T18:32:11.632 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5993000000000001e-05 2024-05-08T18:32:11.632 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.632 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.632 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:11.632 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.051627+0000", 2024-05-08T18:32:11.632 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000132132 2024-05-08T18:32:11.632 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.632 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.632 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:11.632 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.051888+0000", 2024-05-08T18:32:11.632 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00026025499999999998 2024-05-08T18:32:11.632 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.632 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.632 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:32:11.633 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.052129+0000", 2024-05-08T18:32:11.633 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000241079 2024-05-08T18:32:11.633 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.633 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.633 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:11.633 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.067226+0000", 2024-05-08T18:32:11.633 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015097462000000001 2024-05-08T18:32:11.633 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.633 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.633 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:11.633 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.079073+0000", 2024-05-08T18:32:11.633 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011846617 2024-05-08T18:32:11.633 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.634 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.634 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:11.634 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.079236+0000", 2024-05-08T18:32:11.634 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016313699999999999 2024-05-08T18:32:11.634 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.634 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.634 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:11.634 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.079348+0000", 2024-05-08T18:32:11.634 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011246799999999999 2024-05-08T18:32:11.634 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:11.634 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:11.634 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:11.634 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.635 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.635 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1896 3.11 3:88e8a458:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_82:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:32:11.635 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:01.591489+0000", 2024-05-08T18:32:11.635 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 9.9413712590000003, 2024-05-08T18:32:11.635 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.021292352000000001, 2024-05-08T18:32:11.635 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:11.635 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:11.635 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:11.635 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:11.635 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:11.635 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:11.635 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1896 2024-05-08T18:32:11.635 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.635 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:11.636 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.636 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:11.636 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.591489+0000", 2024-05-08T18:32:11.636 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:11.636 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.636 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.636 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:11.636 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.591489+0000", 2024-05-08T18:32:11.636 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:11.636 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.636 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.636 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:11.636 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.591493+0000", 2024-05-08T18:32:11.636 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0960000000000003e-06 2024-05-08T18:32:11.636 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.636 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.637 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:11.637 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.595850+0000", 2024-05-08T18:32:11.637 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0043569539999999997 2024-05-08T18:32:11.637 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.637 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.637 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:11.637 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.595888+0000", 2024-05-08T18:32:11.637 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8207000000000002e-05 2024-05-08T18:32:11.637 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.637 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.637 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:11.637 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.595907+0000", 2024-05-08T18:32:11.637 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8899999999999999e-05 2024-05-08T18:32:11.637 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.637 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.638 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:11.638 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.596036+0000", 2024-05-08T18:32:11.638 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000128682 2024-05-08T18:32:11.638 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.638 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.638 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:11.638 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.596292+0000", 2024-05-08T18:32:11.638 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00025657099999999998 2024-05-08T18:32:11.638 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.638 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.638 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 4", 2024-05-08T18:32:11.638 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.596526+0000", 2024-05-08T18:32:11.639 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000233212 2024-05-08T18:32:11.639 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.639 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.639 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:11.639 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.610742+0000", 2024-05-08T18:32:11.639 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.014216522000000001 2024-05-08T18:32:11.639 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.639 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.639 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:11.639 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.612559+0000", 2024-05-08T18:32:11.639 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001817433 2024-05-08T18:32:11.639 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.639 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.639 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:11.639 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.612655+0000", 2024-05-08T18:32:11.640 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.5552999999999998e-05 2024-05-08T18:32:11.640 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.640 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.640 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:11.640 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.612781+0000", 2024-05-08T18:32:11.640 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000126222 2024-05-08T18:32:11.640 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:11.640 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:11.640 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:11.640 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.640 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.640 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1908 3.37 3:ec666de2:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_94:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:32:11.640 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:01.843287+0000", 2024-05-08T18:32:11.640 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 9.6895730429999993, 2024-05-08T18:32:11.640 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.023042806999999998, 2024-05-08T18:32:11.641 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:11.641 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:11.641 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:11.641 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:11.641 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:11.641 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:11.641 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1908 2024-05-08T18:32:11.641 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.641 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:11.641 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.641 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:11.641 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.843287+0000", 2024-05-08T18:32:11.641 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:11.641 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.642 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.642 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:11.642 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.843287+0000", 2024-05-08T18:32:11.642 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:11.642 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.642 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.642 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:11.642 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.843292+0000", 2024-05-08T18:32:11.642 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8199999999999996e-06 2024-05-08T18:32:11.642 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.642 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.642 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:11.642 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.847349+0000", 2024-05-08T18:32:11.643 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0040571160000000004 2024-05-08T18:32:11.643 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.643 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.643 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:11.643 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.847392+0000", 2024-05-08T18:32:11.643 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.2899999999999999e-05 2024-05-08T18:32:11.643 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.643 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.643 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:11.643 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.847411+0000", 2024-05-08T18:32:11.643 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8940000000000002e-05 2024-05-08T18:32:11.643 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.643 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.643 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:11.643 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.847544+0000", 2024-05-08T18:32:11.644 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000133039 2024-05-08T18:32:11.644 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.644 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.644 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:11.644 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.847801+0000", 2024-05-08T18:32:11.644 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00025721799999999998 2024-05-08T18:32:11.644 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.644 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.644 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 5", 2024-05-08T18:32:11.644 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.848073+0000", 2024-05-08T18:32:11.644 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00027179500000000002 2024-05-08T18:32:11.644 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.644 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.644 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:11.645 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.862878+0000", 2024-05-08T18:32:11.645 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.014804777999999999 2024-05-08T18:32:11.645 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.645 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.645 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:11.645 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.866260+0000", 2024-05-08T18:32:11.645 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0033819290000000001 2024-05-08T18:32:11.645 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.645 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.645 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:11.645 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.866300+0000", 2024-05-08T18:32:11.645 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0323e-05 2024-05-08T18:32:11.645 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.645 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.646 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:11.646 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.866330+0000", 2024-05-08T18:32:11.646 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.9949000000000001e-05 2024-05-08T18:32:11.646 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:11.646 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:11.646 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:11.646 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.646 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.646 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1913 3.3b 3:dfe6dfd2:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_99:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:32:11.646 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:01.923898+0000", 2024-05-08T18:32:11.646 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 9.6089617860000001, 2024-05-08T18:32:11.646 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.02072742, 2024-05-08T18:32:11.646 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:11.647 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:11.647 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:11.647 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:11.647 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:11.647 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:11.647 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1913 2024-05-08T18:32:11.647 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.647 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:11.647 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.647 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:11.647 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.923898+0000", 2024-05-08T18:32:11.647 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:11.647 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.647 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.648 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:11.648 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.923898+0000", 2024-05-08T18:32:11.648 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:11.648 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.648 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.648 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:11.648 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.923901+0000", 2024-05-08T18:32:11.648 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.9849999999999998e-06 2024-05-08T18:32:11.648 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.648 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.648 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:11.648 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.927833+0000", 2024-05-08T18:32:11.648 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039317429999999997 2024-05-08T18:32:11.648 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.649 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.649 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:11.649 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.927858+0000", 2024-05-08T18:32:11.649 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.4697000000000001e-05 2024-05-08T18:32:11.649 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.649 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.649 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:11.649 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.927869+0000", 2024-05-08T18:32:11.649 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1575e-05 2024-05-08T18:32:11.649 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.649 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.649 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:11.649 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.927946+0000", 2024-05-08T18:32:11.649 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6817999999999995e-05 2024-05-08T18:32:11.650 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.650 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.650 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:11.650 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.928089+0000", 2024-05-08T18:32:11.650 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000143289 2024-05-08T18:32:11.650 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.650 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.650 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-05-08T18:32:11.650 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.928220+0000", 2024-05-08T18:32:11.650 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013052100000000001 2024-05-08T18:32:11.650 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.650 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.650 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:11.651 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.934683+0000", 2024-05-08T18:32:11.651 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0064635020000000003 2024-05-08T18:32:11.651 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.651 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.651 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:11.651 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.944426+0000", 2024-05-08T18:32:11.651 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0097427499999999997 2024-05-08T18:32:11.651 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.651 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.651 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:11.651 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.944539+0000", 2024-05-08T18:32:11.651 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000112316 2024-05-08T18:32:11.651 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:11.651 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:11.652 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:11.652 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.944626+0000", 2024-05-08T18:32:11.652 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.7224000000000004e-05 2024-05-08T18:32:11.652 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:11.652 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:11.652 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:11.652 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:11.652 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:11.652 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:32:11.653 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2024-05-08T18:32:11.654 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:32:11.654 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2024-05-08T18:32:11.655 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:32:11.655 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:32:11.654+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:32:11.655 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-08T18:32:11.656 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2024-05-08T18:32:11.656 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:32:11.656 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2024-05-08T18:32:11.657 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:32:11.754 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:32:11.750+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:32:11.832 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:32:11.832 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:32:11.843 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-08T18:32:11.847 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-08T18:32:11.855 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:32:11.850+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:32:11.957 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:32:11.956+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:32:12.010 INFO:tasks.workunit.client.0.smithi097.stderr:100+0 records in 2024-05-08T18:32:12.010 INFO:tasks.workunit.client.0.smithi097.stderr:100+0 records out 2024-05-08T18:32:12.010 INFO:tasks.workunit.client.0.smithi097.stderr:1048576000 bytes (1.0 GB, 1000 MiB) copied, 7.88329 s, 133 MB/s 2024-05-08T18:32:12.012 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:32:12.012 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:32:12.027 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-08T18:32:12.057 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:32:12.054+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:32:12.159 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:32:12.154+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:32:12.195 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:32:12.195 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:32:12.209 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-08T18:32:12.260 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:32:12.254+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:32:12.325 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:32:12.325 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:32:12.338 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-08T18:32:12.384 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:32:12.384+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:32:12.450 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:32:12.450 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:32:12.461 INFO:tasks.ceph.osd.3.smithi097.stderr:2024-05-08T18:32:12.460+0000 7ff867ca9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25214) UID: 0 2024-05-08T18:32:12.463 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-08T18:32:12.562 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:32:12.560+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:32:12.621 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:32:12.621 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:32:12.634 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-08T18:32:12.663 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:32:12.658+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:32:12.764 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:32:12.762+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:32:12.767 INFO:teuthology.orchestra.run.smithi097.stderr:noscrub is set 2024-05-08T18:32:12.793 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:32:12.793 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:32:12.807 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-08T18:32:12.892 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:32:12.892+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:32:12.966 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:32:12.962+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:32:12.966 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:32:12.967 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:32:12.980 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-08T18:32:13.067 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:32:13.062+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:32:13.143 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:32:13.143 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:32:13.158 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-08T18:32:13.168 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:32:13.166+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:32:13.269 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:32:13.270+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:32:13.272 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:32:13.272 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:32:13.287 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-08T18:32:13.370 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:32:13.366+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:32:13.411 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:32:13.411 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:32:13.424 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-08T18:32:13.471 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-05-08T18:32:13.466+0000 7fcf3b19d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25264) UID: 0 2024-05-08T18:32:13.544 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-05-08T18:32:13.544 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:32:13.558 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-08T18:32:13.605 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-05-08T18:32:13.602+0000 7f5a60bdd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25268) UID: 0 2024-05-08T18:32:13.658 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-08T18:32:13.673 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:32:13.670+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:32:13.691 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:32:13.691 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:32:13.705 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-08T18:32:13.792 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:32:13.790+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:32:13.806 INFO:teuthology.orchestra.run.smithi097.stdout:osd.0: {} 2024-05-08T18:32:13.806 INFO:teuthology.orchestra.run.smithi097.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-08T18:32:13.822 INFO:teuthology.orchestra.run.smithi097.stdout:osd.1: {} 2024-05-08T18:32:13.823 INFO:teuthology.orchestra.run.smithi097.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-08T18:32:13.839 INFO:teuthology.orchestra.run.smithi097.stdout:osd.2: {} 2024-05-08T18:32:13.839 INFO:teuthology.orchestra.run.smithi097.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-08T18:32:13.855 INFO:teuthology.orchestra.run.smithi097.stdout:osd.3: {} 2024-05-08T18:32:13.855 INFO:teuthology.orchestra.run.smithi097.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-08T18:32:13.870 INFO:teuthology.orchestra.run.smithi151.stdout:ERROR: (22) Invalid argument 2024-05-08T18:32:13.870 INFO:teuthology.orchestra.run.smithi151.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-08T18:32:13.874 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:32:13.870+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:32:13.875 INFO:teuthology.orchestra.run.smithi097.stdout:osd.4: {} 2024-05-08T18:32:13.875 INFO:teuthology.orchestra.run.smithi097.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-08T18:32:13.886 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-08T18:32:13.894 INFO:teuthology.orchestra.run.smithi097.stdout:osd.5: {} 2024-05-08T18:32:13.894 INFO:teuthology.orchestra.run.smithi097.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-08T18:32:13.913 INFO:teuthology.orchestra.run.smithi097.stdout:osd.6: {} 2024-05-08T18:32:13.913 INFO:teuthology.orchestra.run.smithi097.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-08T18:32:13.932 INFO:teuthology.orchestra.run.smithi097.stdout:osd.7: {} 2024-05-08T18:32:13.933 INFO:teuthology.orchestra.run.smithi097.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-08T18:32:13.975 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-05-08T18:32:13.972+0000 7f626c07b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25208) UID: 0 2024-05-08T18:32:14.056 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:32:14.057 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2024-05-08T18:32:14.057 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2024-05-08T18:32:14.057 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-05-08T18:32:14.057 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.057 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1315 3.2c e81/21 3:368ed9cc:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_1:head v 81'1, mlcod=0'0)", 2024-05-08T18:32:14.057 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.310943+0000", 2024-05-08T18:32:14.057 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 31.743476903000001, 2024-05-08T18:32:14.057 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019031756, 2024-05-08T18:32:14.057 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:14.057 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:14.057 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:14.058 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:14.058 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.058 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:14.058 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.310943+0000", 2024-05-08T18:32:14.058 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:14.058 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.058 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.058 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:14.058 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.310943+0000", 2024-05-08T18:32:14.058 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:14.059 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.059 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.059 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:14.059 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.310945+0000", 2024-05-08T18:32:14.059 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7800000000000001e-06 2024-05-08T18:32:14.059 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.059 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.059 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:14.059 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.315838+0000", 2024-05-08T18:32:14.059 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0048930800000000002 2024-05-08T18:32:14.060 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.060 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.060 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:14.060 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.315886+0000", 2024-05-08T18:32:14.060 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7336000000000002e-05 2024-05-08T18:32:14.060 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.060 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.060 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:14.060 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.315912+0000", 2024-05-08T18:32:14.060 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6584000000000002e-05 2024-05-08T18:32:14.060 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.060 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.060 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:14.061 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.316123+0000", 2024-05-08T18:32:14.061 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00021075400000000001 2024-05-08T18:32:14.061 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.061 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.061 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:14.061 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.316165+0000", 2024-05-08T18:32:14.061 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1709999999999999e-05 2024-05-08T18:32:14.061 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.061 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.061 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:14.062 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.329876+0000", 2024-05-08T18:32:14.062 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013710803000000001 2024-05-08T18:32:14.062 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.062 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.062 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:14.063 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.329974+0000", 2024-05-08T18:32:14.063 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8709000000000006e-05 2024-05-08T18:32:14.063 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:14.063 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:14.063 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:14.063 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.063 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.063 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1327 3.1a 3:58da5138:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-08T18:32:14.063 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.463447+0000", 2024-05-08T18:32:14.063 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 31.590972621999999, 2024-05-08T18:32:14.063 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018677618999999999, 2024-05-08T18:32:14.063 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:14.064 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:14.064 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:14.064 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:14.064 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:14.064 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:14.064 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1327 2024-05-08T18:32:14.064 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.064 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:14.064 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.064 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:14.064 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.463447+0000", 2024-05-08T18:32:14.064 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:14.065 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.065 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.065 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:14.065 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.463447+0000", 2024-05-08T18:32:14.065 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:14.065 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.065 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.065 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:14.065 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.463455+0000", 2024-05-08T18:32:14.065 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2430000000000005e-06 2024-05-08T18:32:14.065 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.065 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.066 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:14.066 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.469224+0000", 2024-05-08T18:32:14.066 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0057690830000000004 2024-05-08T18:32:14.066 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.066 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.066 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:14.066 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.469255+0000", 2024-05-08T18:32:14.066 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1000000000000001e-05 2024-05-08T18:32:14.066 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.067 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.067 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:14.067 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.469273+0000", 2024-05-08T18:32:14.067 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7920000000000001e-05 2024-05-08T18:32:14.067 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.067 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.067 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:14.067 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.469451+0000", 2024-05-08T18:32:14.067 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017836499999999999 2024-05-08T18:32:14.067 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.067 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.067 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:14.068 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.469687+0000", 2024-05-08T18:32:14.068 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000235255 2024-05-08T18:32:14.068 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.068 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.068 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:32:14.068 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.469899+0000", 2024-05-08T18:32:14.068 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00021257200000000001 2024-05-08T18:32:14.068 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.068 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.068 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:14.068 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.480590+0000", 2024-05-08T18:32:14.068 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010690963 2024-05-08T18:32:14.069 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.069 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.069 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:14.069 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.481813+0000", 2024-05-08T18:32:14.069 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001223001 2024-05-08T18:32:14.069 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.069 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.069 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:14.069 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.481982+0000", 2024-05-08T18:32:14.069 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016828500000000001 2024-05-08T18:32:14.070 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.070 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.070 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:14.070 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.482124+0000", 2024-05-08T18:32:14.070 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014293199999999999 2024-05-08T18:32:14.070 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:14.070 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:14.070 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:14.070 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.070 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.071 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1328 3.14 3:2b0d89be:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-08T18:32:14.071 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.473844+0000", 2024-05-08T18:32:14.071 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 31.580575733, 2024-05-08T18:32:14.071 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.031713811000000001, 2024-05-08T18:32:14.071 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:14.071 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:14.071 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:14.071 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:14.071 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:14.071 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:14.072 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1328 2024-05-08T18:32:14.072 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.072 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:14.072 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.072 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:14.072 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.473844+0000", 2024-05-08T18:32:14.072 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:14.072 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.072 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.073 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:14.073 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.473844+0000", 2024-05-08T18:32:14.073 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:14.073 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.073 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.073 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:14.073 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.473847+0000", 2024-05-08T18:32:14.073 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3100000000000001e-06 2024-05-08T18:32:14.073 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.073 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.074 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:14.074 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.479452+0000", 2024-05-08T18:32:14.074 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0056046910000000002 2024-05-08T18:32:14.074 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.074 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.074 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:14.074 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.479485+0000", 2024-05-08T18:32:14.074 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2808999999999997e-05 2024-05-08T18:32:14.074 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.074 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.074 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:14.074 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.479508+0000", 2024-05-08T18:32:14.075 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3119999999999999e-05 2024-05-08T18:32:14.075 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.075 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.075 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:14.075 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.479638+0000", 2024-05-08T18:32:14.075 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000130586 2024-05-08T18:32:14.075 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.075 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.075 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:14.075 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.479896+0000", 2024-05-08T18:32:14.076 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00025793799999999998 2024-05-08T18:32:14.076 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.076 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.076 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 7", 2024-05-08T18:32:14.076 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.480111+0000", 2024-05-08T18:32:14.076 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00021487200000000001 2024-05-08T18:32:14.076 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.076 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.077 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:14.077 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.502946+0000", 2024-05-08T18:32:14.077 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.022835101 2024-05-08T18:32:14.077 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.077 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.077 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:14.077 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.505389+0000", 2024-05-08T18:32:14.077 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0024426510000000001 2024-05-08T18:32:14.077 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.077 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.077 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:14.077 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.505479+0000", 2024-05-08T18:32:14.077 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.9863000000000003e-05 2024-05-08T18:32:14.078 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.078 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.078 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:14.078 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.505558+0000", 2024-05-08T18:32:14.078 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8869999999999995e-05 2024-05-08T18:32:14.078 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:14.078 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:14.078 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:14.078 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.078 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.078 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1332 3.14 3:2bdfae75:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-08T18:32:14.079 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.514410+0000", 2024-05-08T18:32:14.079 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 31.540009608999998, 2024-05-08T18:32:14.079 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.026281202, 2024-05-08T18:32:14.079 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:14.079 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:14.079 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:14.079 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:14.079 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:14.079 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:14.080 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1332 2024-05-08T18:32:14.080 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.080 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:14.080 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.080 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:14.080 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.514410+0000", 2024-05-08T18:32:14.080 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:14.080 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.080 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.080 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:14.080 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.514410+0000", 2024-05-08T18:32:14.081 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:14.081 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.081 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.081 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:14.081 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.514413+0000", 2024-05-08T18:32:14.081 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3160000000000001e-06 2024-05-08T18:32:14.081 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.081 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.081 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:14.081 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.519067+0000", 2024-05-08T18:32:14.081 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0046540319999999998 2024-05-08T18:32:14.081 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.082 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.082 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:14.082 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.519104+0000", 2024-05-08T18:32:14.082 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6890000000000001e-05 2024-05-08T18:32:14.082 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.082 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.082 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:14.082 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.519121+0000", 2024-05-08T18:32:14.082 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6583e-05 2024-05-08T18:32:14.082 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.082 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.082 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:14.083 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.519235+0000", 2024-05-08T18:32:14.083 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000114233 2024-05-08T18:32:14.083 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.083 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.083 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:14.083 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.519509+0000", 2024-05-08T18:32:14.083 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000274534 2024-05-08T18:32:14.083 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.083 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.084 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 7", 2024-05-08T18:32:14.084 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.519763+0000", 2024-05-08T18:32:14.084 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000253088 2024-05-08T18:32:14.084 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.084 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.084 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:14.084 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.532461+0000", 2024-05-08T18:32:14.084 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012698134 2024-05-08T18:32:14.084 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.084 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.085 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:14.085 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.540405+0000", 2024-05-08T18:32:14.085 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0079440699999999993 2024-05-08T18:32:14.085 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.085 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.085 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:14.085 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.540577+0000", 2024-05-08T18:32:14.085 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017180299999999999 2024-05-08T18:32:14.085 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.085 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.085 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:14.085 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.540691+0000", 2024-05-08T18:32:14.085 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011451900000000001 2024-05-08T18:32:14.086 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:14.086 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:14.086 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:14.086 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.086 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.086 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1370 3.9 3:91bbaad9:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_56:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:32:14.086 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.915888+0000", 2024-05-08T18:32:14.086 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 31.138531360999998, 2024-05-08T18:32:14.086 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.028543105999999999, 2024-05-08T18:32:14.086 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:14.086 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:14.086 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:14.087 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:14.087 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:14.087 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:14.087 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1370 2024-05-08T18:32:14.087 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.087 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:14.088 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.088 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:14.088 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.915888+0000", 2024-05-08T18:32:14.088 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:14.088 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.088 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.089 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:14.089 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.915888+0000", 2024-05-08T18:32:14.089 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:14.089 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.089 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.089 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:14.089 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.915892+0000", 2024-05-08T18:32:14.089 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1269999999999996e-06 2024-05-08T18:32:14.090 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.090 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.090 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:14.090 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.919887+0000", 2024-05-08T18:32:14.090 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039945529999999996 2024-05-08T18:32:14.091 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.091 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.091 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:14.091 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.919929+0000", 2024-05-08T18:32:14.091 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1832999999999997e-05 2024-05-08T18:32:14.091 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.092 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.092 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:14.092 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.919950+0000", 2024-05-08T18:32:14.092 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1197000000000001e-05 2024-05-08T18:32:14.092 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.092 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.093 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:14.093 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.920108+0000", 2024-05-08T18:32:14.093 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015827899999999999 2024-05-08T18:32:14.093 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.093 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.093 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:14.094 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.920401+0000", 2024-05-08T18:32:14.094 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00029259799999999998 2024-05-08T18:32:14.094 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.094 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.094 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-05-08T18:32:14.094 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.920625+0000", 2024-05-08T18:32:14.094 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022383099999999999 2024-05-08T18:32:14.094 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.094 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.095 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:14.095 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.933935+0000", 2024-05-08T18:32:14.095 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013310298999999999 2024-05-08T18:32:14.095 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.095 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.096 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:14.096 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.944330+0000", 2024-05-08T18:32:14.096 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010395107000000001 2024-05-08T18:32:14.096 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.096 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.096 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:14.097 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.944383+0000", 2024-05-08T18:32:14.097 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2772000000000002e-05 2024-05-08T18:32:14.097 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.097 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.097 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:14.097 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.944431+0000", 2024-05-08T18:32:14.097 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8510000000000001e-05 2024-05-08T18:32:14.097 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:14.097 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:14.098 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:14.098 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.098 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.098 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1385 3.1a 3:5abdd61d:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_71:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:32:14.098 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:43.106312+0000", 2024-05-08T18:32:14.099 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 30.948107782000001, 2024-05-08T18:32:14.099 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018362961000000001, 2024-05-08T18:32:14.099 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:14.099 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:14.099 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:14.099 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:14.099 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:14.099 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:14.099 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1385 2024-05-08T18:32:14.099 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.100 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:14.100 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.100 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:14.100 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.106312+0000", 2024-05-08T18:32:14.100 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:14.100 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.101 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.101 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:14.101 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.106312+0000", 2024-05-08T18:32:14.101 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:14.101 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.101 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.102 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:14.102 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.106316+0000", 2024-05-08T18:32:14.102 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8739999999999997e-06 2024-05-08T18:32:14.102 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.102 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.103 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:14.103 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.110250+0000", 2024-05-08T18:32:14.103 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039342600000000002 2024-05-08T18:32:14.103 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.103 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.103 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:14.103 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.110289+0000", 2024-05-08T18:32:14.103 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8782999999999998e-05 2024-05-08T18:32:14.104 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.104 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.104 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:14.104 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.110306+0000", 2024-05-08T18:32:14.104 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7793000000000001e-05 2024-05-08T18:32:14.104 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.105 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.105 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:14.105 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.110454+0000", 2024-05-08T18:32:14.105 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014750899999999999 2024-05-08T18:32:14.105 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.105 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.105 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:14.105 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.110700+0000", 2024-05-08T18:32:14.106 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00024594500000000002 2024-05-08T18:32:14.106 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.106 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.106 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:32:14.106 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.110951+0000", 2024-05-08T18:32:14.106 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00025154499999999999 2024-05-08T18:32:14.107 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.107 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.107 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:14.107 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.120973+0000", 2024-05-08T18:32:14.107 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010021835999999999 2024-05-08T18:32:14.108 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.108 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.108 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:14.108 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.124583+0000", 2024-05-08T18:32:14.108 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0036096840000000002 2024-05-08T18:32:14.108 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.108 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.108 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:14.109 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.124630+0000", 2024-05-08T18:32:14.109 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7419000000000001e-05 2024-05-08T18:32:14.109 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.109 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.109 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:14.109 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.124675+0000", 2024-05-08T18:32:14.109 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4313000000000001e-05 2024-05-08T18:32:14.109 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:14.110 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:14.110 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:14.110 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.110 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.110 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1409 3.3 3:c39a24d8:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_95:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:32:14.110 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:43.363571+0000", 2024-05-08T18:32:14.110 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 30.690848291000002, 2024-05-08T18:32:14.111 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.021085779999999998, 2024-05-08T18:32:14.111 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:14.111 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:14.111 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:14.111 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:14.111 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:14.112 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:14.112 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1409 2024-05-08T18:32:14.112 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.112 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:14.112 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.112 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:14.113 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.363571+0000", 2024-05-08T18:32:14.113 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:14.113 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.113 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.113 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:14.113 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.363571+0000", 2024-05-08T18:32:14.114 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:14.114 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.114 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.114 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:14.114 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.363575+0000", 2024-05-08T18:32:14.114 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7579999999999998e-06 2024-05-08T18:32:14.114 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.115 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.115 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:14.115 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.368212+0000", 2024-05-08T18:32:14.115 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0046369269999999999 2024-05-08T18:32:14.115 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.115 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.115 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:14.115 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.368236+0000", 2024-05-08T18:32:14.115 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.442e-05 2024-05-08T18:32:14.116 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.116 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.116 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:14.116 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.368249+0000", 2024-05-08T18:32:14.116 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2451e-05 2024-05-08T18:32:14.116 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.117 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.117 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:14.117 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.368370+0000", 2024-05-08T18:32:14.117 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000121166 2024-05-08T18:32:14.117 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.117 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.118 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:14.118 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.368577+0000", 2024-05-08T18:32:14.118 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000207429 2024-05-08T18:32:14.118 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.118 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.118 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:32:14.119 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.368761+0000", 2024-05-08T18:32:14.119 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00018409599999999999 2024-05-08T18:32:14.119 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.119 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.119 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:14.119 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.379675+0000", 2024-05-08T18:32:14.120 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010913058999999999 2024-05-08T18:32:14.120 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.120 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.120 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:14.120 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.384574+0000", 2024-05-08T18:32:14.120 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.004899937 2024-05-08T18:32:14.120 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.120 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.121 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:14.121 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.384616+0000", 2024-05-08T18:32:14.121 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.2035e-05 2024-05-08T18:32:14.121 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.121 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.121 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:14.122 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.384657+0000", 2024-05-08T18:32:14.122 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0501999999999999e-05 2024-05-08T18:32:14.122 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:14.122 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:14.122 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:14.123 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.123 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.123 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1614 3.14 3:284b5d90:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-05-08T18:32:14.123 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:46.708825+0000", 2024-05-08T18:32:14.123 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 27.345594078000001, 2024-05-08T18:32:14.123 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.032864125000000001, 2024-05-08T18:32:14.123 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:14.124 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:14.124 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:14.124 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:14.124 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:14.124 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:14.124 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1614 2024-05-08T18:32:14.124 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.125 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:14.125 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.125 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:14.125 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.708825+0000", 2024-05-08T18:32:14.125 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:14.125 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.125 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.126 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:14.126 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.708825+0000", 2024-05-08T18:32:14.126 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:14.126 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.126 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.127 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:14.127 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.708828+0000", 2024-05-08T18:32:14.127 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6630000000000002e-06 2024-05-08T18:32:14.127 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.127 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.127 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:14.128 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.715671+0000", 2024-05-08T18:32:14.128 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.006842669 2024-05-08T18:32:14.128 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.128 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.128 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:14.128 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.715706+0000", 2024-05-08T18:32:14.128 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4872000000000001e-05 2024-05-08T18:32:14.129 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.129 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.129 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:14.129 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.715722+0000", 2024-05-08T18:32:14.129 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6670000000000001e-05 2024-05-08T18:32:14.129 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.129 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.129 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:14.129 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.715850+0000", 2024-05-08T18:32:14.129 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000127322 2024-05-08T18:32:14.130 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.130 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.130 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:14.130 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.716102+0000", 2024-05-08T18:32:14.130 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00025211899999999998 2024-05-08T18:32:14.131 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.131 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.131 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 7", 2024-05-08T18:32:14.131 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.716339+0000", 2024-05-08T18:32:14.131 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00023702099999999999 2024-05-08T18:32:14.132 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.132 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.132 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:14.132 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.737899+0000", 2024-05-08T18:32:14.132 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.021560414 2024-05-08T18:32:14.132 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.133 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.133 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:14.133 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.741414+0000", 2024-05-08T18:32:14.133 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0035152669999999999 2024-05-08T18:32:14.133 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.133 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.134 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:14.134 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.741571+0000", 2024-05-08T18:32:14.134 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015644500000000001 2024-05-08T18:32:14.134 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.134 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.134 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:14.134 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.741690+0000", 2024-05-08T18:32:14.134 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000118663 2024-05-08T18:32:14.134 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:14.135 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:14.135 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:14.135 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.135 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.135 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1622 3.11 e83/21 3:8a36e97a:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_10:head v 83'7, mlcod=82'5)", 2024-05-08T18:32:14.136 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:46.797808+0000", 2024-05-08T18:32:14.136 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 27.256611959000001, 2024-05-08T18:32:14.136 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019395200000000001, 2024-05-08T18:32:14.136 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:14.136 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:14.136 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:14.137 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:14.137 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.137 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:14.137 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.797808+0000", 2024-05-08T18:32:14.137 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:14.137 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.138 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.138 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:14.138 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.797808+0000", 2024-05-08T18:32:14.138 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:14.138 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.138 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.138 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:14.139 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.797810+0000", 2024-05-08T18:32:14.139 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9800000000000001e-06 2024-05-08T18:32:14.139 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.139 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.139 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:14.139 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.801567+0000", 2024-05-08T18:32:14.139 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0037578709999999999 2024-05-08T18:32:14.139 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.139 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.140 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:14.140 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.801610+0000", 2024-05-08T18:32:14.140 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3013000000000003e-05 2024-05-08T18:32:14.140 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.140 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.141 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:14.141 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.801628+0000", 2024-05-08T18:32:14.141 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7677e-05 2024-05-08T18:32:14.141 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.141 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.141 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:14.142 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.801798+0000", 2024-05-08T18:32:14.142 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000169548 2024-05-08T18:32:14.142 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.142 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.142 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:14.142 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.801836+0000", 2024-05-08T18:32:14.142 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.799e-05 2024-05-08T18:32:14.142 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.142 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.142 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:14.143 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.817068+0000", 2024-05-08T18:32:14.143 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015232671999999999 2024-05-08T18:32:14.143 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.143 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.143 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:14.143 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.817203+0000", 2024-05-08T18:32:14.143 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000134449 2024-05-08T18:32:14.143 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:14.144 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:14.144 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:14.144 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.144 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.144 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1629 3.24 e83/21 3:27d2a12f:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_17:head v 83'2, mlcod=0'0)", 2024-05-08T18:32:14.144 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:46.875375+0000", 2024-05-08T18:32:14.144 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 27.179044260000001, 2024-05-08T18:32:14.144 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017035814, 2024-05-08T18:32:14.144 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:14.145 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:14.145 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:14.145 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:14.145 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.145 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:14.145 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.875375+0000", 2024-05-08T18:32:14.146 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:14.146 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.146 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.146 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:14.146 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.875375+0000", 2024-05-08T18:32:14.147 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:14.147 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.147 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.147 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:14.147 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.875378+0000", 2024-05-08T18:32:14.147 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6029999999999999e-06 2024-05-08T18:32:14.148 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.148 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.148 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:14.148 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.880781+0000", 2024-05-08T18:32:14.148 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0054034319999999997 2024-05-08T18:32:14.148 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.148 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.148 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:14.149 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.880818+0000", 2024-05-08T18:32:14.149 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6303000000000001e-05 2024-05-08T18:32:14.149 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.149 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.149 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:14.149 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.880833+0000", 2024-05-08T18:32:14.149 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5852999999999999e-05 2024-05-08T18:32:14.149 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.149 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.149 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:14.149 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.880987+0000", 2024-05-08T18:32:14.149 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015368599999999999 2024-05-08T18:32:14.149 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.150 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.150 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:14.150 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.881053+0000", 2024-05-08T18:32:14.150 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6260000000000006e-05 2024-05-08T18:32:14.150 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.150 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.150 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:14.150 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.892244+0000", 2024-05-08T18:32:14.150 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011191002 2024-05-08T18:32:14.150 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.150 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.150 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:14.151 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.892411+0000", 2024-05-08T18:32:14.151 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000166675 2024-05-08T18:32:14.151 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:14.151 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:14.151 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:14.151 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.151 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.151 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1638 3.9 3:9152f27e:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5_100Mb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-05-08T18:32:14.151 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:46.965638+0000", 2024-05-08T18:32:14.151 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 27.088781588, 2024-05-08T18:32:14.151 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.021363499000000001, 2024-05-08T18:32:14.151 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:14.151 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:14.151 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:14.152 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:14.152 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:14.152 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:14.152 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1638 2024-05-08T18:32:14.152 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.152 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:14.152 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.152 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:14.152 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.965638+0000", 2024-05-08T18:32:14.152 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:14.152 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.152 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.152 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:14.152 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.965638+0000", 2024-05-08T18:32:14.153 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:14.153 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.153 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.153 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:14.153 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.965640+0000", 2024-05-08T18:32:14.153 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.68e-06 2024-05-08T18:32:14.153 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.153 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.153 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:14.153 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.969701+0000", 2024-05-08T18:32:14.153 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0040609870000000003 2024-05-08T18:32:14.153 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.153 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.154 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:14.154 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.969734+0000", 2024-05-08T18:32:14.154 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3460000000000002e-05 2024-05-08T18:32:14.154 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.154 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.154 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:14.154 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.969750+0000", 2024-05-08T18:32:14.154 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5919000000000001e-05 2024-05-08T18:32:14.154 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.154 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.154 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:14.154 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.969886+0000", 2024-05-08T18:32:14.154 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000135759 2024-05-08T18:32:14.154 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.155 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.155 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:14.155 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.970159+0000", 2024-05-08T18:32:14.155 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00027367199999999998 2024-05-08T18:32:14.155 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.155 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.155 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-05-08T18:32:14.155 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.971062+0000", 2024-05-08T18:32:14.155 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00090291000000000004 2024-05-08T18:32:14.155 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.155 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.155 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:14.155 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.983851+0000", 2024-05-08T18:32:14.156 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012788882999999999 2024-05-08T18:32:14.156 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.156 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.156 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:14.156 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.986511+0000", 2024-05-08T18:32:14.156 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0026593530000000002 2024-05-08T18:32:14.156 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.156 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.156 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:14.156 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.986843+0000", 2024-05-08T18:32:14.156 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00033259400000000002 2024-05-08T18:32:14.156 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.156 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.157 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:14.157 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.987001+0000", 2024-05-08T18:32:14.157 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015828199999999999 2024-05-08T18:32:14.157 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:14.157 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:14.157 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:14.157 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.157 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.157 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1823 3.27 e92/21 3:e6e611e5:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_9:head v 92'8, mlcod=82'6)", 2024-05-08T18:32:14.157 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:00.525337+0000", 2024-05-08T18:32:14.157 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 13.529082338, 2024-05-08T18:32:14.157 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019529722999999999, 2024-05-08T18:32:14.157 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:14.157 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:14.157 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:14.158 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:14.158 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.158 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:14.158 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.525337+0000", 2024-05-08T18:32:14.158 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:14.158 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.158 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.158 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:14.158 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.525337+0000", 2024-05-08T18:32:14.158 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:14.158 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.158 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.158 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:14.158 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.525339+0000", 2024-05-08T18:32:14.159 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0269999999999998e-06 2024-05-08T18:32:14.159 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.159 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.159 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:14.159 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.530485+0000", 2024-05-08T18:32:14.159 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.005145368 2024-05-08T18:32:14.159 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.159 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.159 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:14.159 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.530519+0000", 2024-05-08T18:32:14.159 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4765999999999999e-05 2024-05-08T18:32:14.159 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.159 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.159 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:14.160 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.530534+0000", 2024-05-08T18:32:14.160 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4521999999999999e-05 2024-05-08T18:32:14.160 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.160 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.160 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:14.160 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.530698+0000", 2024-05-08T18:32:14.160 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016412100000000001 2024-05-08T18:32:14.160 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.160 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.160 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:14.160 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.530761+0000", 2024-05-08T18:32:14.160 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3373000000000005e-05 2024-05-08T18:32:14.160 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.160 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.161 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:14.161 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.544760+0000", 2024-05-08T18:32:14.161 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013998696999999999 2024-05-08T18:32:14.161 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.161 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.161 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:14.161 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.544867+0000", 2024-05-08T18:32:14.161 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010684900000000001 2024-05-08T18:32:14.161 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:14.161 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:14.161 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:14.161 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.161 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.162 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1825 3.3 3:c2847c2a:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-05-08T18:32:14.162 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:00.555863+0000", 2024-05-08T18:32:14.162 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 13.498556650999999, 2024-05-08T18:32:14.162 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.025211702999999999, 2024-05-08T18:32:14.162 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:14.162 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:14.162 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:14.162 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:14.162 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:14.162 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:14.162 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1825 2024-05-08T18:32:14.162 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.162 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:14.163 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.163 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:14.163 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.555863+0000", 2024-05-08T18:32:14.163 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:14.163 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.163 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.163 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:14.163 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.555863+0000", 2024-05-08T18:32:14.163 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:14.163 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.163 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.163 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:14.163 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.555868+0000", 2024-05-08T18:32:14.164 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6829999999999999e-06 2024-05-08T18:32:14.164 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.164 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.164 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:14.164 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.563352+0000", 2024-05-08T18:32:14.164 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0074842199999999998 2024-05-08T18:32:14.164 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.164 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.164 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:14.164 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.563383+0000", 2024-05-08T18:32:14.164 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1393000000000003e-05 2024-05-08T18:32:14.164 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.164 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.164 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:14.165 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.563399+0000", 2024-05-08T18:32:14.165 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6064000000000001e-05 2024-05-08T18:32:14.165 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.165 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.165 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:14.165 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.563492+0000", 2024-05-08T18:32:14.165 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2532000000000001e-05 2024-05-08T18:32:14.165 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.165 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.165 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:14.165 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.563672+0000", 2024-05-08T18:32:14.165 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000180039 2024-05-08T18:32:14.165 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.166 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.166 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:32:14.166 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.563839+0000", 2024-05-08T18:32:14.166 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000166885 2024-05-08T18:32:14.166 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.166 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.166 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:14.166 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.571019+0000", 2024-05-08T18:32:14.166 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0071807019999999997 2024-05-08T18:32:14.166 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.166 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.166 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:14.166 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.580888+0000", 2024-05-08T18:32:14.167 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0098690099999999992 2024-05-08T18:32:14.167 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.167 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.167 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:14.167 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.580985+0000", 2024-05-08T18:32:14.167 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6809000000000001e-05 2024-05-08T18:32:14.167 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.167 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.167 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:14.167 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.581075+0000", 2024-05-08T18:32:14.167 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.9365999999999998e-05 2024-05-08T18:32:14.167 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:14.167 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:14.167 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:14.168 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.168 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.168 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1828 3.1a 3:5be2bca0:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-05-08T18:32:14.168 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:00.608482+0000", 2024-05-08T18:32:14.168 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 13.445937408000001, 2024-05-08T18:32:14.168 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.01966685, 2024-05-08T18:32:14.168 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:14.168 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:14.168 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:14.168 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:14.168 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:14.168 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:14.168 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1828 2024-05-08T18:32:14.168 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.169 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:14.169 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.169 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:14.169 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.608482+0000", 2024-05-08T18:32:14.169 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:14.169 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.169 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.169 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:14.169 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.608482+0000", 2024-05-08T18:32:14.169 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:14.169 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.169 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.169 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:14.169 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.608484+0000", 2024-05-08T18:32:14.170 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.697e-06 2024-05-08T18:32:14.170 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.170 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.170 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:14.170 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.612311+0000", 2024-05-08T18:32:14.170 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0038267370000000002 2024-05-08T18:32:14.170 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.170 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.170 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:14.170 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.612326+0000", 2024-05-08T18:32:14.170 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5699e-05 2024-05-08T18:32:14.170 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.170 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.171 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:14.171 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.612335+0000", 2024-05-08T18:32:14.171 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.7220000000000005e-06 2024-05-08T18:32:14.171 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.171 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.171 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:14.171 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.612394+0000", 2024-05-08T18:32:14.171 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9175999999999997e-05 2024-05-08T18:32:14.171 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.171 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.171 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:14.171 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.612522+0000", 2024-05-08T18:32:14.171 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012789 2024-05-08T18:32:14.172 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.172 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.172 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:32:14.172 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.612637+0000", 2024-05-08T18:32:14.172 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000114929 2024-05-08T18:32:14.172 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.172 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.172 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:14.172 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.620934+0000", 2024-05-08T18:32:14.172 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0082972099999999993 2024-05-08T18:32:14.172 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.172 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.172 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:14.172 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.628071+0000", 2024-05-08T18:32:14.173 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0071364169999999999 2024-05-08T18:32:14.173 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.173 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.173 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:14.173 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.628115+0000", 2024-05-08T18:32:14.173 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.422e-05 2024-05-08T18:32:14.173 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.173 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.173 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:14.173 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.628149+0000", 2024-05-08T18:32:14.173 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4153000000000003e-05 2024-05-08T18:32:14.173 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:14.173 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:14.173 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:14.174 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.174 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.174 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1849 3.3 3:c2346235:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_35:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:32:14.174 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:00.854822+0000", 2024-05-08T18:32:14.174 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 13.199597439, 2024-05-08T18:32:14.174 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017280277, 2024-05-08T18:32:14.174 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:14.174 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:14.174 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:14.174 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:14.174 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:14.174 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:14.174 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1849 2024-05-08T18:32:14.175 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.175 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:14.175 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.175 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:14.175 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.854822+0000", 2024-05-08T18:32:14.175 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:14.175 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.175 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.175 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:14.175 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.854822+0000", 2024-05-08T18:32:14.175 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:14.175 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.175 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.175 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:14.176 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.854825+0000", 2024-05-08T18:32:14.176 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2619999999999999e-06 2024-05-08T18:32:14.176 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.176 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.176 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:14.176 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.859589+0000", 2024-05-08T18:32:14.176 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0047639229999999998 2024-05-08T18:32:14.176 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.176 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.176 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:14.176 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.859608+0000", 2024-05-08T18:32:14.176 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8403e-05 2024-05-08T18:32:14.176 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.176 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.176 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:14.177 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.859617+0000", 2024-05-08T18:32:14.177 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.7450000000000007e-06 2024-05-08T18:32:14.177 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.177 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.177 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:14.177 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.859696+0000", 2024-05-08T18:32:14.177 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8203999999999999e-05 2024-05-08T18:32:14.177 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.177 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.177 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:14.177 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.859833+0000", 2024-05-08T18:32:14.177 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013787200000000001 2024-05-08T18:32:14.177 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.177 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.178 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:32:14.178 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.859963+0000", 2024-05-08T18:32:14.178 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012955900000000001 2024-05-08T18:32:14.178 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.178 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.178 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:14.178 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.867417+0000", 2024-05-08T18:32:14.178 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0074540830000000002 2024-05-08T18:32:14.178 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.178 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.178 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:14.178 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.871952+0000", 2024-05-08T18:32:14.178 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0045347260000000002 2024-05-08T18:32:14.179 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.179 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.179 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:14.179 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.872040+0000", 2024-05-08T18:32:14.179 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.7733999999999997e-05 2024-05-08T18:32:14.179 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.179 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.179 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:14.179 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.872102+0000", 2024-05-08T18:32:14.179 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.2766000000000002e-05 2024-05-08T18:32:14.179 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:14.179 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:14.179 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:14.179 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.180 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.180 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1861 3.f e93/21 3:f0b8f9d8:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_47:head v 93'9, mlcod=82'7)", 2024-05-08T18:32:14.180 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:01.007487+0000", 2024-05-08T18:32:14.180 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 13.046932756, 2024-05-08T18:32:14.180 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019094574, 2024-05-08T18:32:14.180 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:14.180 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:14.180 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:14.180 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:14.180 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.180 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:14.180 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.007487+0000", 2024-05-08T18:32:14.180 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:14.180 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.181 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.181 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:14.181 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.007487+0000", 2024-05-08T18:32:14.181 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:14.181 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.181 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.181 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:14.181 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.007489+0000", 2024-05-08T18:32:14.181 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3e-06 2024-05-08T18:32:14.181 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.181 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.181 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:14.181 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.012420+0000", 2024-05-08T18:32:14.181 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0049307969999999998 2024-05-08T18:32:14.182 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.182 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.182 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:14.182 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.012459+0000", 2024-05-08T18:32:14.182 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9409000000000002e-05 2024-05-08T18:32:14.182 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.182 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.182 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:14.182 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.012485+0000", 2024-05-08T18:32:14.182 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5497e-05 2024-05-08T18:32:14.182 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.182 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.182 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:14.182 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.012689+0000", 2024-05-08T18:32:14.183 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000204305 2024-05-08T18:32:14.183 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.183 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.183 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:14.183 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.012743+0000", 2024-05-08T18:32:14.183 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3720000000000001e-05 2024-05-08T18:32:14.183 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.183 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.183 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:14.183 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.026516+0000", 2024-05-08T18:32:14.183 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013773453999999999 2024-05-08T18:32:14.183 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.183 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.183 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:14.184 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.026581+0000", 2024-05-08T18:32:14.184 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5092000000000006e-05 2024-05-08T18:32:14.184 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:14.184 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:14.184 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:14.184 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.184 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.184 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1862 3.1a 3:58694483:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_48:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:32:14.184 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:01.012507+0000", 2024-05-08T18:32:14.184 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 13.041912394000001, 2024-05-08T18:32:14.184 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018337019, 2024-05-08T18:32:14.184 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:14.184 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:14.185 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:14.185 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:14.185 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:14.185 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:14.185 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1862 2024-05-08T18:32:14.185 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.185 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:14.185 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.185 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:14.185 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.012507+0000", 2024-05-08T18:32:14.185 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:14.185 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.185 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.185 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:14.186 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.012507+0000", 2024-05-08T18:32:14.186 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:14.186 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.186 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.186 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:14.186 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.012511+0000", 2024-05-08T18:32:14.186 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5889999999999999e-06 2024-05-08T18:32:14.186 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.186 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.186 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:14.186 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.016612+0000", 2024-05-08T18:32:14.186 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0041009239999999997 2024-05-08T18:32:14.186 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.186 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.187 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:14.187 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.016645+0000", 2024-05-08T18:32:14.187 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3599999999999997e-05 2024-05-08T18:32:14.187 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.187 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.187 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:14.187 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.016658+0000", 2024-05-08T18:32:14.187 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2836e-05 2024-05-08T18:32:14.187 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.187 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.187 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:14.187 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.016856+0000", 2024-05-08T18:32:14.187 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00019782900000000001 2024-05-08T18:32:14.188 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.188 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.188 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:14.188 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.017128+0000", 2024-05-08T18:32:14.188 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00027170200000000002 2024-05-08T18:32:14.188 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.188 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.188 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 1", 2024-05-08T18:32:14.188 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.017364+0000", 2024-05-08T18:32:14.188 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00023630799999999999 2024-05-08T18:32:14.188 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.188 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.188 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:14.188 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.029283+0000", 2024-05-08T18:32:14.189 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011919585999999999 2024-05-08T18:32:14.189 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.189 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.189 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:14.189 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.030640+0000", 2024-05-08T18:32:14.189 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001356033 2024-05-08T18:32:14.189 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.189 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.189 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:14.189 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.030736+0000", 2024-05-08T18:32:14.189 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6323000000000006e-05 2024-05-08T18:32:14.189 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.189 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.189 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:14.189 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.030844+0000", 2024-05-08T18:32:14.190 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010828900000000001 2024-05-08T18:32:14.190 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:14.190 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:14.190 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:14.190 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.190 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.190 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1864 3.9 3:93a63578:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_50:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:32:14.190 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:01.032831+0000", 2024-05-08T18:32:14.190 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 13.021588940000001, 2024-05-08T18:32:14.190 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018526417, 2024-05-08T18:32:14.190 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:14.190 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:14.190 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:14.191 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:14.191 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:14.191 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:14.191 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1864 2024-05-08T18:32:14.191 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.191 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:14.191 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.191 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:14.191 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.032831+0000", 2024-05-08T18:32:14.191 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:14.191 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.191 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.191 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:14.191 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.032831+0000", 2024-05-08T18:32:14.192 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:14.192 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.192 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.192 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:14.192 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.032835+0000", 2024-05-08T18:32:14.192 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1529999999999999e-06 2024-05-08T18:32:14.192 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.192 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.192 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:14.192 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.036974+0000", 2024-05-08T18:32:14.192 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0041391049999999997 2024-05-08T18:32:14.192 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.192 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.192 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:14.193 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.037010+0000", 2024-05-08T18:32:14.193 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6253e-05 2024-05-08T18:32:14.193 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.193 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.193 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:14.193 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.037029+0000", 2024-05-08T18:32:14.193 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9334000000000002e-05 2024-05-08T18:32:14.193 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.193 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.193 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:14.193 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.037196+0000", 2024-05-08T18:32:14.193 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000166312 2024-05-08T18:32:14.193 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.193 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.194 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:14.194 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.037506+0000", 2024-05-08T18:32:14.194 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00030996700000000002 2024-05-08T18:32:14.194 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.194 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.194 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-05-08T18:32:14.194 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.037742+0000", 2024-05-08T18:32:14.194 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000236419 2024-05-08T18:32:14.194 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.194 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.194 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:14.194 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.049950+0000", 2024-05-08T18:32:14.194 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012207697999999999 2024-05-08T18:32:14.194 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.195 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.195 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:14.195 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.051181+0000", 2024-05-08T18:32:14.195 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001231408 2024-05-08T18:32:14.195 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.195 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.195 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:14.195 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.051281+0000", 2024-05-08T18:32:14.195 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.9499000000000004e-05 2024-05-08T18:32:14.195 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.195 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.195 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:14.195 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.051357+0000", 2024-05-08T18:32:14.196 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6268999999999998e-05 2024-05-08T18:32:14.196 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:14.196 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:14.196 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:14.196 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.196 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.196 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1900 3.34 3:2eec0dc7:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_86:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:32:14.196 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:01.684180+0000", 2024-05-08T18:32:14.196 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 12.370239949, 2024-05-08T18:32:14.196 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.021863239, 2024-05-08T18:32:14.196 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:14.196 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:14.196 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:14.196 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:14.196 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:14.197 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:14.197 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1900 2024-05-08T18:32:14.197 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.197 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:14.197 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.197 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:14.197 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.684180+0000", 2024-05-08T18:32:14.197 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:14.197 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.197 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.197 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:14.197 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.684180+0000", 2024-05-08T18:32:14.197 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:14.197 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.198 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.198 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:14.198 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.684183+0000", 2024-05-08T18:32:14.198 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3160000000000001e-06 2024-05-08T18:32:14.198 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.198 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.198 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:14.198 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.689191+0000", 2024-05-08T18:32:14.198 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.005008317 2024-05-08T18:32:14.198 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.198 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.198 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:14.198 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.689231+0000", 2024-05-08T18:32:14.198 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9663000000000003e-05 2024-05-08T18:32:14.199 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.199 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.199 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:14.199 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.689255+0000", 2024-05-08T18:32:14.199 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.4275999999999999e-05 2024-05-08T18:32:14.199 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.199 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.199 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:14.199 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.689371+0000", 2024-05-08T18:32:14.199 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011611 2024-05-08T18:32:14.199 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.199 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.199 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:14.199 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.689488+0000", 2024-05-08T18:32:14.199 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000117063 2024-05-08T18:32:14.200 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.200 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.200 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:32:14.200 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.689585+0000", 2024-05-08T18:32:14.200 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6941000000000006e-05 2024-05-08T18:32:14.200 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.200 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.200 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:14.200 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.703523+0000", 2024-05-08T18:32:14.200 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013938061999999999 2024-05-08T18:32:14.200 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.200 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.200 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:14.200 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.705847+0000", 2024-05-08T18:32:14.201 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0023240719999999999 2024-05-08T18:32:14.201 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.201 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.201 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:14.201 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.705966+0000", 2024-05-08T18:32:14.201 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011906899999999999 2024-05-08T18:32:14.201 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.201 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.201 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:14.201 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.706043+0000", 2024-05-08T18:32:14.201 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6349999999999999e-05 2024-05-08T18:32:14.201 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:14.201 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:14.201 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:14.202 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.202 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.202 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1907 3.34 3:2f5137c7:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_93:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:32:14.202 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:01.831860+0000", 2024-05-08T18:32:14.202 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 12.222559306999999, 2024-05-08T18:32:14.202 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.030884407999999999, 2024-05-08T18:32:14.202 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:14.202 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:14.202 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:14.202 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:14.202 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:14.202 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:14.202 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1907 2024-05-08T18:32:14.202 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.203 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:14.203 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.203 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:14.203 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.831860+0000", 2024-05-08T18:32:14.203 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:14.203 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.203 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.203 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:14.203 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.831860+0000", 2024-05-08T18:32:14.203 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:14.203 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.203 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.203 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:14.203 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.831863+0000", 2024-05-08T18:32:14.203 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6989999999999999e-06 2024-05-08T18:32:14.204 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.204 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.204 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:14.204 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.836003+0000", 2024-05-08T18:32:14.204 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0041399799999999997 2024-05-08T18:32:14.204 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.204 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.204 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:14.204 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.836043+0000", 2024-05-08T18:32:14.204 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0216999999999998e-05 2024-05-08T18:32:14.204 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.204 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.204 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:14.205 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.836062+0000", 2024-05-08T18:32:14.205 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8612999999999999e-05 2024-05-08T18:32:14.205 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.205 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.205 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:14.205 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.836256+0000", 2024-05-08T18:32:14.205 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00019403500000000001 2024-05-08T18:32:14.205 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.205 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.205 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:14.205 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.836501+0000", 2024-05-08T18:32:14.205 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00024500500000000002 2024-05-08T18:32:14.205 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.206 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.206 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:32:14.206 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.836731+0000", 2024-05-08T18:32:14.206 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00023071800000000001 2024-05-08T18:32:14.206 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.206 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.206 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:14.206 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.861762+0000", 2024-05-08T18:32:14.206 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.025030793999999999 2024-05-08T18:32:14.206 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.206 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.206 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:14.206 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.862626+0000", 2024-05-08T18:32:14.206 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00086390100000000004 2024-05-08T18:32:14.207 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.207 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.207 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:14.207 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.862694+0000", 2024-05-08T18:32:14.207 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7384000000000004e-05 2024-05-08T18:32:14.207 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.207 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.207 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:14.207 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.862745+0000", 2024-05-08T18:32:14.207 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.1062e-05 2024-05-08T18:32:14.207 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:14.207 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:14.207 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:14.207 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:14.208 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:14.208 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:32:14.208 INFO:tasks.workunit.client.0.smithi097.stdout:quota enabled for the user 0.746931095232384 2024-05-08T18:32:14.209 INFO:tasks.workunit.client.0.smithi097.stdout:adding file to bucket buck_2024_04_8_18_32_03: 1Gb. 2024-05-08T18:32:14.209 INFO:tasks.workunit.client.0.smithi097.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-08T18:32:14.209 INFO:tasks.workunit.client.0.smithi097.stdout:Test case: PASSED - user quota max size for 0.746931095232384 passed on 2 buckets 2024-05-08T18:32:14.209 INFO:tasks.workunit.client.0.smithi097.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-08T18:32:14.210 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-08T18:32:14.210 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:32:14.208+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:32:14.310 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:32:14.306+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:32:14.358 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:32:14.358 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:32:14.358 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 0 2024-05-08T18:32:14.358 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:32:14.370 INFO:tasks.workunit.client.0.smithi097.stdout:user 0.746931095232384 deleted 2024-05-08T18:32:14.372 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-08T18:32:14.375 INFO:tasks.workunit.client.0.smithi097.stdout:OK 2024-05-08T18:32:14.375 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-05-08T18:32:14.376 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-05-08T18:32:14.420 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:32:14.418+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:32:14.427 INFO:tasks.workunit:Stopping ['rgw/s3_user_quota.pl'] on client.0... 2024-05-08T18:32:14.427 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-05-08T18:32:14.516 INFO:tasks.ceph.osd.2.smithi097.stderr:2024-05-08T18:32:14.516+0000 7f0b1ecff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25212) UID: 0 2024-05-08T18:32:14.541 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:32:14.541 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:32:14.541 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2024-05-08T18:32:14.542 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2024-05-08T18:32:14.542 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:32:14.556 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-08T18:32:14.613 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:32:14.610+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:32:14.685 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:32:14.685 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2024-05-08T18:32:14.685 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2024-05-08T18:32:14.685 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-05-08T18:32:14.685 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.685 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1234 3.38 e80/21 3:1cb36fa1:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.2__shadow_.fYaqa8o34qSAauLRSqi3iwpmT5NwV5c_1:head v 80'1, mlcod=0'0)", 2024-05-08T18:32:14.685 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:38.217418+0000", 2024-05-08T18:32:14.685 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 36.464995973999997, 2024-05-08T18:32:14.686 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.02469151, 2024-05-08T18:32:14.686 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:14.686 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:14.686 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:14.686 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:14.686 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.686 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:14.686 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.217418+0000", 2024-05-08T18:32:14.686 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:14.686 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.687 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.687 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:14.687 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.217418+0000", 2024-05-08T18:32:14.687 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:14.687 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.687 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.687 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:14.687 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.217420+0000", 2024-05-08T18:32:14.687 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9970000000000001e-06 2024-05-08T18:32:14.687 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.687 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.687 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:14.687 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.225957+0000", 2024-05-08T18:32:14.688 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0085373180000000003 2024-05-08T18:32:14.688 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.688 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.688 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:14.688 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.226002+0000", 2024-05-08T18:32:14.688 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4462999999999998e-05 2024-05-08T18:32:14.688 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.688 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.688 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:14.688 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.226036+0000", 2024-05-08T18:32:14.688 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4286999999999999e-05 2024-05-08T18:32:14.688 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.688 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.689 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:14.689 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.226204+0000", 2024-05-08T18:32:14.689 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000168219 2024-05-08T18:32:14.689 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.689 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.689 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:14.689 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.226269+0000", 2024-05-08T18:32:14.689 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.4858999999999997e-05 2024-05-08T18:32:14.689 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.689 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.689 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:14.690 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.242001+0000", 2024-05-08T18:32:14.690 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015731898000000001 2024-05-08T18:32:14.690 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.690 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.690 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:14.690 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.242109+0000", 2024-05-08T18:32:14.690 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010846899999999999 2024-05-08T18:32:14.690 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:14.690 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:14.690 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:14.690 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.690 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.690 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1237 3.c 3:3156de39:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.2_10Mb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (355) in=17b,setxattr user.rgw.acl (129) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-05-08T18:32:14.691 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:38.244592+0000", 2024-05-08T18:32:14.691 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 36.437821669999998, 2024-05-08T18:32:14.691 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.021467379000000002, 2024-05-08T18:32:14.691 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:14.691 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:14.691 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:14.691 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:14.691 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:14.692 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:14.692 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1237 2024-05-08T18:32:14.692 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.692 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:14.692 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.692 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:14.692 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.244592+0000", 2024-05-08T18:32:14.693 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:14.693 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.693 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.693 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:14.693 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.244592+0000", 2024-05-08T18:32:14.693 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:14.693 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.694 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.694 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:14.694 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.244599+0000", 2024-05-08T18:32:14.694 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3170000000000004e-06 2024-05-08T18:32:14.694 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.695 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.695 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:14.695 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.250239+0000", 2024-05-08T18:32:14.695 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0056396270000000004 2024-05-08T18:32:14.695 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.695 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.695 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:14.696 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.250279+0000", 2024-05-08T18:32:14.696 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0370000000000001e-05 2024-05-08T18:32:14.696 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.696 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.696 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:14.696 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.250305+0000", 2024-05-08T18:32:14.697 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5259999999999999e-05 2024-05-08T18:32:14.697 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.697 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.697 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:14.697 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.250509+0000", 2024-05-08T18:32:14.697 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020390800000000001 2024-05-08T18:32:14.697 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.697 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.698 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:14.698 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.250777+0000", 2024-05-08T18:32:14.698 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00026804200000000002 2024-05-08T18:32:14.698 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.698 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.699 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 3", 2024-05-08T18:32:14.699 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.251654+0000", 2024-05-08T18:32:14.699 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00087763999999999995 2024-05-08T18:32:14.699 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.699 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.700 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:14.700 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.263070+0000", 2024-05-08T18:32:14.700 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011415544 2024-05-08T18:32:14.700 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.700 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.701 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:14.701 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.265866+0000", 2024-05-08T18:32:14.701 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002795699 2024-05-08T18:32:14.701 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.701 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.701 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:14.701 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.265975+0000", 2024-05-08T18:32:14.702 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000109819 2024-05-08T18:32:14.702 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.702 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.702 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:14.702 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:38.266060+0000", 2024-05-08T18:32:14.702 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4153000000000006e-05 2024-05-08T18:32:14.702 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:14.702 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:14.702 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:14.702 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.702 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.702 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1318 3.c 3:329e59e6:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-08T18:32:14.703 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.337285+0000", 2024-05-08T18:32:14.703 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 32.345129247000003, 2024-05-08T18:32:14.703 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.024126754, 2024-05-08T18:32:14.703 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:14.703 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:14.703 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:14.703 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:14.703 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:14.703 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:14.703 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1318 2024-05-08T18:32:14.703 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.703 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:14.703 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.703 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:14.703 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.337285+0000", 2024-05-08T18:32:14.704 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:14.704 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.704 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.704 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:14.704 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.337285+0000", 2024-05-08T18:32:14.704 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:14.704 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.704 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.704 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:14.704 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.337288+0000", 2024-05-08T18:32:14.704 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6799999999999999e-06 2024-05-08T18:32:14.704 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.704 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.705 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:14.705 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.343559+0000", 2024-05-08T18:32:14.705 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0062709920000000004 2024-05-08T18:32:14.705 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.705 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.705 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:14.705 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.343600+0000", 2024-05-08T18:32:14.705 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0686000000000003e-05 2024-05-08T18:32:14.705 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.705 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.706 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:14.706 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.343621+0000", 2024-05-08T18:32:14.706 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1364000000000001e-05 2024-05-08T18:32:14.706 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.706 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.706 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:14.706 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.343774+0000", 2024-05-08T18:32:14.706 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000152495 2024-05-08T18:32:14.706 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.706 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.706 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:14.706 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.344025+0000", 2024-05-08T18:32:14.707 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00025118800000000001 2024-05-08T18:32:14.707 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.707 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.707 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 3", 2024-05-08T18:32:14.707 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.344259+0000", 2024-05-08T18:32:14.707 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000234455 2024-05-08T18:32:14.707 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.707 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.707 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:14.707 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.357786+0000", 2024-05-08T18:32:14.707 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013526338000000001 2024-05-08T18:32:14.707 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.707 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.707 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:14.708 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.361116+0000", 2024-05-08T18:32:14.708 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0033298619999999998 2024-05-08T18:32:14.708 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.708 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.708 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:14.708 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.361290+0000", 2024-05-08T18:32:14.708 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017451200000000001 2024-05-08T18:32:14.708 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.708 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.709 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:14.709 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.361411+0000", 2024-05-08T18:32:14.709 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012118200000000001 2024-05-08T18:32:14.709 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:14.709 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:14.709 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:14.710 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.710 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.710 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1324 3.3a 3:5fe59963:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-08T18:32:14.710 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.429632+0000", 2024-05-08T18:32:14.710 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 32.252781542999998, 2024-05-08T18:32:14.710 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019556068999999999, 2024-05-08T18:32:14.710 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:14.710 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:14.710 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:14.710 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:14.711 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:14.711 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:14.711 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1324 2024-05-08T18:32:14.711 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.711 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:14.711 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.711 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:14.711 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.429632+0000", 2024-05-08T18:32:14.711 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:14.711 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.711 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.711 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:14.711 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.429632+0000", 2024-05-08T18:32:14.712 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:14.712 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.712 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.712 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:14.712 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.429636+0000", 2024-05-08T18:32:14.712 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9060000000000004e-06 2024-05-08T18:32:14.712 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.712 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.712 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:14.712 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.434488+0000", 2024-05-08T18:32:14.712 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0048521270000000003 2024-05-08T18:32:14.712 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.713 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.713 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:14.713 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.434529+0000", 2024-05-08T18:32:14.713 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0365999999999999e-05 2024-05-08T18:32:14.713 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.713 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.713 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:14.713 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.434548+0000", 2024-05-08T18:32:14.713 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8893999999999999e-05 2024-05-08T18:32:14.713 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.713 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.713 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:14.713 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.434680+0000", 2024-05-08T18:32:14.714 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000132285 2024-05-08T18:32:14.714 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.714 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.714 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:14.714 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.434925+0000", 2024-05-08T18:32:14.714 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00024557799999999999 2024-05-08T18:32:14.714 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.714 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.714 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:32:14.714 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.435148+0000", 2024-05-08T18:32:14.714 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022281800000000001 2024-05-08T18:32:14.714 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.714 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.715 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:14.715 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.447529+0000", 2024-05-08T18:32:14.715 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012380584 2024-05-08T18:32:14.715 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.715 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.715 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:14.715 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.448987+0000", 2024-05-08T18:32:14.715 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0014577189999999999 2024-05-08T18:32:14.715 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.715 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.715 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:14.715 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.449113+0000", 2024-05-08T18:32:14.715 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000126482 2024-05-08T18:32:14.716 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.716 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.716 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:14.716 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.449188+0000", 2024-05-08T18:32:14.716 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5309999999999996e-05 2024-05-08T18:32:14.716 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:14.716 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:14.716 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:14.716 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.716 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.716 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1350 3.3a 3:5caef9cc:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_36:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:32:14.716 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.707170+0000", 2024-05-08T18:32:14.716 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 31.975243940999999, 2024-05-08T18:32:14.717 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.02479787, 2024-05-08T18:32:14.717 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:14.717 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:14.717 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:14.717 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:14.717 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:14.717 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:14.717 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1350 2024-05-08T18:32:14.717 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.717 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:14.717 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.717 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:14.717 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.707170+0000", 2024-05-08T18:32:14.717 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:14.718 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.718 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.718 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:14.718 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.707170+0000", 2024-05-08T18:32:14.718 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:14.718 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.718 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.718 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:14.718 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.707174+0000", 2024-05-08T18:32:14.718 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6629999999999999e-06 2024-05-08T18:32:14.718 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.718 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.718 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:14.719 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.713406+0000", 2024-05-08T18:32:14.719 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0062328030000000003 2024-05-08T18:32:14.719 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.719 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.719 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:14.719 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.713446+0000", 2024-05-08T18:32:14.719 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9990000000000002e-05 2024-05-08T18:32:14.719 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.719 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.719 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:14.719 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.713466+0000", 2024-05-08T18:32:14.719 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0136000000000002e-05 2024-05-08T18:32:14.719 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.719 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.720 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:14.720 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.713609+0000", 2024-05-08T18:32:14.720 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014227599999999999 2024-05-08T18:32:14.720 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.720 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.720 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:14.720 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.713871+0000", 2024-05-08T18:32:14.720 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000261885 2024-05-08T18:32:14.720 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.720 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.720 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:32:14.720 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.714152+0000", 2024-05-08T18:32:14.720 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00028181099999999998 2024-05-08T18:32:14.720 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.721 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.721 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:14.721 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.723750+0000", 2024-05-08T18:32:14.721 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0095972739999999994 2024-05-08T18:32:14.721 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.721 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.721 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:14.721 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.731740+0000", 2024-05-08T18:32:14.721 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0079900969999999998 2024-05-08T18:32:14.721 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.721 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.721 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:14.722 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.731843+0000", 2024-05-08T18:32:14.722 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000103052 2024-05-08T18:32:14.722 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.722 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.722 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:14.722 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.731968+0000", 2024-05-08T18:32:14.722 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000124883 2024-05-08T18:32:14.722 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:14.722 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:14.722 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:14.722 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.722 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.723 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1355 3.28 3:14052413:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_41:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:32:14.723 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.762527+0000", 2024-05-08T18:32:14.723 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 31.919886378000001, 2024-05-08T18:32:14.723 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.026016406999999998, 2024-05-08T18:32:14.723 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:14.723 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:14.723 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:14.723 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:14.723 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:14.723 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:14.723 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1355 2024-05-08T18:32:14.723 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.723 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:14.723 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.724 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:14.724 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.762527+0000", 2024-05-08T18:32:14.724 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:14.724 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.724 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.724 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:14.724 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.762527+0000", 2024-05-08T18:32:14.724 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:14.724 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.724 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.724 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:14.724 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.762545+0000", 2024-05-08T18:32:14.725 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7045999999999999e-05 2024-05-08T18:32:14.725 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.725 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.725 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:14.725 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.767178+0000", 2024-05-08T18:32:14.725 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0046339420000000003 2024-05-08T18:32:14.725 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.725 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.725 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:14.725 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.767214+0000", 2024-05-08T18:32:14.725 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5855999999999997e-05 2024-05-08T18:32:14.725 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.725 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.726 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:14.726 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.767242+0000", 2024-05-08T18:32:14.726 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8113e-05 2024-05-08T18:32:14.726 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.726 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.726 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:14.726 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.767401+0000", 2024-05-08T18:32:14.726 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000158429 2024-05-08T18:32:14.726 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.726 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.726 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:14.726 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.767648+0000", 2024-05-08T18:32:14.727 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000247328 2024-05-08T18:32:14.727 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.727 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.727 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 3", 2024-05-08T18:32:14.727 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.767899+0000", 2024-05-08T18:32:14.727 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00025059799999999999 2024-05-08T18:32:14.727 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.727 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.727 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:14.727 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.780702+0000", 2024-05-08T18:32:14.727 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012803238 2024-05-08T18:32:14.727 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.727 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.727 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:14.728 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.788231+0000", 2024-05-08T18:32:14.728 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0075285090000000001 2024-05-08T18:32:14.728 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.728 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.728 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:14.728 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.788402+0000", 2024-05-08T18:32:14.728 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017113299999999999 2024-05-08T18:32:14.728 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.728 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.728 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:14.728 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.788544+0000", 2024-05-08T18:32:14.728 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014221500000000001 2024-05-08T18:32:14.728 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:14.729 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:14.729 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:14.729 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.729 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.729 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1377 3.28 3:1730bdaf:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_63:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:32:14.729 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.996763+0000", 2024-05-08T18:32:14.729 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 31.685651230000001, 2024-05-08T18:32:14.729 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.02215497, 2024-05-08T18:32:14.729 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:14.729 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:14.729 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:14.729 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:14.729 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:14.729 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:14.730 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1377 2024-05-08T18:32:14.730 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.730 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:14.730 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.730 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:14.730 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.996763+0000", 2024-05-08T18:32:14.730 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:14.730 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.730 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.730 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:14.730 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.996763+0000", 2024-05-08T18:32:14.730 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:14.730 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.731 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.731 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:14.731 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.996766+0000", 2024-05-08T18:32:14.731 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.9299999999999999e-06 2024-05-08T18:32:14.731 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.731 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.731 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:14.731 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.002222+0000", 2024-05-08T18:32:14.731 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0054559819999999998 2024-05-08T18:32:14.731 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.731 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.731 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:14.731 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.002259+0000", 2024-05-08T18:32:14.731 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7222999999999999e-05 2024-05-08T18:32:14.732 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.732 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.732 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:14.732 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.002277+0000", 2024-05-08T18:32:14.732 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8607e-05 2024-05-08T18:32:14.732 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.732 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.732 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:14.732 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.002484+0000", 2024-05-08T18:32:14.732 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020670500000000001 2024-05-08T18:32:14.732 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.732 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.732 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:14.733 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.002843+0000", 2024-05-08T18:32:14.733 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00035888100000000002 2024-05-08T18:32:14.733 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.733 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.733 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 3", 2024-05-08T18:32:14.733 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.003165+0000", 2024-05-08T18:32:14.733 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00032193 2024-05-08T18:32:14.733 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.733 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.733 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:14.733 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.011993+0000", 2024-05-08T18:32:14.733 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.008827718 2024-05-08T18:32:14.733 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.733 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.734 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:14.734 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.018733+0000", 2024-05-08T18:32:14.734 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.006739989 2024-05-08T18:32:14.734 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.734 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.734 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:14.734 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.018840+0000", 2024-05-08T18:32:14.734 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000107799 2024-05-08T18:32:14.734 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.734 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.734 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:14.734 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.018918+0000", 2024-05-08T18:32:14.734 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.7206000000000006e-05 2024-05-08T18:32:14.735 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:14.735 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:14.735 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:14.735 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.735 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.735 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1407 3.22 3:46b64ebe:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_93:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:32:14.735 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:43.343033+0000", 2024-05-08T18:32:14.735 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 31.339380883, 2024-05-08T18:32:14.735 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.022710952, 2024-05-08T18:32:14.735 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:14.735 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:14.735 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:14.735 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:14.735 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:14.736 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:14.736 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1407 2024-05-08T18:32:14.736 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.736 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:14.736 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.736 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:14.736 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.343033+0000", 2024-05-08T18:32:14.736 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:14.736 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.736 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.736 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:14.736 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.343033+0000", 2024-05-08T18:32:14.737 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:14.737 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.737 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.737 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:14.737 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.343035+0000", 2024-05-08T18:32:14.737 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5100000000000001e-06 2024-05-08T18:32:14.737 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.737 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.737 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:14.737 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.346921+0000", 2024-05-08T18:32:14.737 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0038850489999999998 2024-05-08T18:32:14.737 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.737 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.738 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:14.738 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.346943+0000", 2024-05-08T18:32:14.738 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2897000000000001e-05 2024-05-08T18:32:14.738 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.738 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.738 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:14.738 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.346956+0000", 2024-05-08T18:32:14.738 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2159e-05 2024-05-08T18:32:14.738 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.738 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.738 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:14.738 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.347033+0000", 2024-05-08T18:32:14.738 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.7898000000000005e-05 2024-05-08T18:32:14.739 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.739 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.739 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:14.739 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.347179+0000", 2024-05-08T18:32:14.739 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014600400000000001 2024-05-08T18:32:14.739 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.739 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.739 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 3", 2024-05-08T18:32:14.739 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.347304+0000", 2024-05-08T18:32:14.739 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012491100000000001 2024-05-08T18:32:14.739 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.740 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.740 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:14.740 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.355666+0000", 2024-05-08T18:32:14.740 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0083618319999999996 2024-05-08T18:32:14.740 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.740 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.740 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:14.740 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.365667+0000", 2024-05-08T18:32:14.740 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010000289000000001 2024-05-08T18:32:14.740 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.740 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.740 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:14.740 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.365709+0000", 2024-05-08T18:32:14.741 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.2549000000000002e-05 2024-05-08T18:32:14.741 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.741 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.741 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:14.741 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.365744+0000", 2024-05-08T18:32:14.741 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4854000000000002e-05 2024-05-08T18:32:14.741 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:14.741 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:14.741 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:14.741 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.741 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.741 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1413 3.2f 3:f6ed8c1f:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_99:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:32:14.742 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:43.405307+0000", 2024-05-08T18:32:14.742 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 31.277107095000002, 2024-05-08T18:32:14.742 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.025254335999999999, 2024-05-08T18:32:14.742 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:14.742 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:14.742 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:14.742 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:14.742 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:14.742 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:14.742 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1413 2024-05-08T18:32:14.742 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.742 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:14.742 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.742 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:14.743 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.405307+0000", 2024-05-08T18:32:14.743 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:14.743 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.743 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.743 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:14.743 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.405307+0000", 2024-05-08T18:32:14.743 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:14.743 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.743 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.743 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:14.743 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.405310+0000", 2024-05-08T18:32:14.743 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0800000000000002e-06 2024-05-08T18:32:14.743 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.744 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.744 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:14.744 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.411517+0000", 2024-05-08T18:32:14.744 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0062069270000000001 2024-05-08T18:32:14.744 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.744 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.744 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:14.744 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.411551+0000", 2024-05-08T18:32:14.744 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4579000000000002e-05 2024-05-08T18:32:14.744 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.744 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.744 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:14.744 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.411570+0000", 2024-05-08T18:32:14.744 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8179999999999999e-05 2024-05-08T18:32:14.745 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.745 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.745 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:14.745 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.411654+0000", 2024-05-08T18:32:14.745 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4708000000000003e-05 2024-05-08T18:32:14.745 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.745 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.745 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:14.745 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.411768+0000", 2024-05-08T18:32:14.745 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000114176 2024-05-08T18:32:14.745 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.745 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.745 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 7", 2024-05-08T18:32:14.745 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.411864+0000", 2024-05-08T18:32:14.746 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.5637000000000006e-05 2024-05-08T18:32:14.746 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.746 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.746 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:14.746 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.420357+0000", 2024-05-08T18:32:14.746 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0084934529999999998 2024-05-08T18:32:14.746 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.746 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.746 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:14.746 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.430427+0000", 2024-05-08T18:32:14.746 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010069855000000001 2024-05-08T18:32:14.746 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.746 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.747 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:14.747 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.430501+0000", 2024-05-08T18:32:14.747 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.3613000000000001e-05 2024-05-08T18:32:14.747 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.747 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.747 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:14.747 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.430561+0000", 2024-05-08T18:32:14.747 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.0127999999999998e-05 2024-05-08T18:32:14.747 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:14.747 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:14.747 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:14.747 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.747 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.747 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1615 3.35 e83/21 3:ae758c88:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_3:head v 83'7, mlcod=82'5)", 2024-05-08T18:32:14.747 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:46.729645+0000", 2024-05-08T18:32:14.748 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 27.952768452000001, 2024-05-08T18:32:14.748 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.022764072, 2024-05-08T18:32:14.748 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:14.748 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:14.748 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:14.748 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:14.748 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.748 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:14.748 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.729645+0000", 2024-05-08T18:32:14.748 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:14.748 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.748 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.748 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:14.749 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.729645+0000", 2024-05-08T18:32:14.749 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:14.749 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.749 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.749 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:14.749 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.729649+0000", 2024-05-08T18:32:14.749 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3830000000000001e-06 2024-05-08T18:32:14.749 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.749 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.749 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:14.749 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.734571+0000", 2024-05-08T18:32:14.749 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0049222600000000004 2024-05-08T18:32:14.749 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.750 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.750 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:14.750 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.734611+0000", 2024-05-08T18:32:14.750 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9969000000000003e-05 2024-05-08T18:32:14.750 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.750 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.750 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:14.750 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.734629+0000", 2024-05-08T18:32:14.750 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7827000000000001e-05 2024-05-08T18:32:14.750 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.750 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.750 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:14.750 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.734800+0000", 2024-05-08T18:32:14.751 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000170929 2024-05-08T18:32:14.751 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.751 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.751 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:14.751 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.734867+0000", 2024-05-08T18:32:14.751 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6952000000000005e-05 2024-05-08T18:32:14.751 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.751 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.751 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:14.751 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.752282+0000", 2024-05-08T18:32:14.751 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017415669000000002 2024-05-08T18:32:14.751 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.751 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.752 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:14.752 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.752409+0000", 2024-05-08T18:32:14.752 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000127083 2024-05-08T18:32:14.752 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:14.752 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:14.752 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:14.752 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.752 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.752 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1618 3.1c 3:3b36ad14:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-05-08T18:32:14.752 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:46.750394+0000", 2024-05-08T18:32:14.752 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 27.932020258000001, 2024-05-08T18:32:14.752 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.023322207000000001, 2024-05-08T18:32:14.752 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:14.753 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:14.753 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:14.753 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:14.753 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:14.753 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:14.753 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1618 2024-05-08T18:32:14.753 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.753 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:14.753 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.753 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:14.753 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.750394+0000", 2024-05-08T18:32:14.753 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:14.753 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.753 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.754 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:14.754 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.750394+0000", 2024-05-08T18:32:14.754 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:14.754 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.754 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.754 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:14.754 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.750399+0000", 2024-05-08T18:32:14.754 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9760000000000003e-06 2024-05-08T18:32:14.754 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.754 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.754 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:14.754 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.756899+0000", 2024-05-08T18:32:14.754 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0065001809999999998 2024-05-08T18:32:14.755 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.755 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.755 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:14.755 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.756936+0000", 2024-05-08T18:32:14.755 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7716000000000003e-05 2024-05-08T18:32:14.755 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.755 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.755 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:14.755 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.756955+0000", 2024-05-08T18:32:14.755 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8196999999999999e-05 2024-05-08T18:32:14.755 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.755 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.756 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:14.756 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.757132+0000", 2024-05-08T18:32:14.756 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017692200000000001 2024-05-08T18:32:14.756 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.756 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.756 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:14.756 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.757531+0000", 2024-05-08T18:32:14.756 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00039989700000000002 2024-05-08T18:32:14.756 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.756 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.756 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 4", 2024-05-08T18:32:14.756 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.757770+0000", 2024-05-08T18:32:14.756 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000238908 2024-05-08T18:32:14.756 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.757 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.757 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:14.757 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.768339+0000", 2024-05-08T18:32:14.757 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010568394 2024-05-08T18:32:14.757 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.757 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.757 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:14.757 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.773409+0000", 2024-05-08T18:32:14.757 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0050704019999999999 2024-05-08T18:32:14.757 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.757 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.757 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:14.757 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.773584+0000", 2024-05-08T18:32:14.757 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017481500000000001 2024-05-08T18:32:14.758 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.758 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.758 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:14.758 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.773716+0000", 2024-05-08T18:32:14.758 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013179899999999999 2024-05-08T18:32:14.758 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:14.758 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:14.758 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:14.758 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.758 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.758 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1816 3.2f 3:f49f92e1:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-05-08T18:32:14.758 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:00.419070+0000", 2024-05-08T18:32:14.758 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 14.263344065, 2024-05-08T18:32:14.759 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.026961746000000002, 2024-05-08T18:32:14.759 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:14.759 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:14.759 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:14.759 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:14.759 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:14.759 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:14.759 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1816 2024-05-08T18:32:14.759 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.759 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:14.759 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.759 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:14.759 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.419070+0000", 2024-05-08T18:32:14.759 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:14.760 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.760 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.760 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:14.760 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.419070+0000", 2024-05-08T18:32:14.760 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:14.760 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.760 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.760 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:14.760 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.419073+0000", 2024-05-08T18:32:14.760 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.3529999999999999e-06 2024-05-08T18:32:14.760 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.760 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.760 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:14.761 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.426045+0000", 2024-05-08T18:32:14.761 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0069723609999999998 2024-05-08T18:32:14.761 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.761 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.761 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:14.761 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.426086+0000", 2024-05-08T18:32:14.761 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.019e-05 2024-05-08T18:32:14.761 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.761 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.761 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:14.761 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.426105+0000", 2024-05-08T18:32:14.761 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9076000000000002e-05 2024-05-08T18:32:14.761 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.761 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.762 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:14.762 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.426263+0000", 2024-05-08T18:32:14.762 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015805600000000001 2024-05-08T18:32:14.762 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.762 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.762 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:14.762 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.426600+0000", 2024-05-08T18:32:14.762 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00033738399999999998 2024-05-08T18:32:14.762 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.762 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.762 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 7", 2024-05-08T18:32:14.762 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.426840+0000", 2024-05-08T18:32:14.762 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000239962 2024-05-08T18:32:14.762 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.763 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.763 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:14.763 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.441632+0000", 2024-05-08T18:32:14.763 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.014792008000000001 2024-05-08T18:32:14.763 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.763 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.763 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:14.763 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.445868+0000", 2024-05-08T18:32:14.763 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0042358880000000002 2024-05-08T18:32:14.763 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.763 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.763 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:14.764 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.445961+0000", 2024-05-08T18:32:14.764 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2474999999999998e-05 2024-05-08T18:32:14.764 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.764 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.764 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:14.764 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.446032+0000", 2024-05-08T18:32:14.764 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0993000000000003e-05 2024-05-08T18:32:14.764 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:14.764 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:14.764 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:14.764 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.764 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.764 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1819 3.30 3:0d002d77:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-05-08T18:32:14.765 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:00.476410+0000", 2024-05-08T18:32:14.765 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 14.206003985000001, 2024-05-08T18:32:14.765 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.032375058999999998, 2024-05-08T18:32:14.765 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:14.765 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:14.765 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:14.765 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:14.765 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:14.765 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:14.765 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1819 2024-05-08T18:32:14.765 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.765 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:14.765 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.766 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:14.766 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.476410+0000", 2024-05-08T18:32:14.766 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:14.766 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.766 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.766 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:14.766 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.476410+0000", 2024-05-08T18:32:14.766 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:14.766 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.766 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.766 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:14.766 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.476413+0000", 2024-05-08T18:32:14.766 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7070000000000001e-06 2024-05-08T18:32:14.767 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.767 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.767 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:14.767 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.480961+0000", 2024-05-08T18:32:14.767 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0045480690000000001 2024-05-08T18:32:14.767 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.767 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.767 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:14.767 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.481003+0000", 2024-05-08T18:32:14.767 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1943000000000001e-05 2024-05-08T18:32:14.767 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.767 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.767 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:14.768 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.481028+0000", 2024-05-08T18:32:14.768 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5262999999999999e-05 2024-05-08T18:32:14.768 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.768 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.768 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:14.768 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.481144+0000", 2024-05-08T18:32:14.768 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000116087 2024-05-08T18:32:14.768 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.768 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.768 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:14.768 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.481343+0000", 2024-05-08T18:32:14.768 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00019893999999999999 2024-05-08T18:32:14.769 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.769 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.769 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:32:14.769 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.481517+0000", 2024-05-08T18:32:14.769 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000173697 2024-05-08T18:32:14.769 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.769 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.769 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:14.769 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.488942+0000", 2024-05-08T18:32:14.769 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0074250929999999998 2024-05-08T18:32:14.769 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.769 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.769 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:14.770 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.508658+0000", 2024-05-08T18:32:14.770 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019716469 2024-05-08T18:32:14.770 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.770 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.770 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:14.770 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.508729+0000", 2024-05-08T18:32:14.770 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1235000000000005e-05 2024-05-08T18:32:14.770 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.770 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.770 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:14.770 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.508785+0000", 2024-05-08T18:32:14.770 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5556000000000001e-05 2024-05-08T18:32:14.771 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:14.771 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:14.771 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:14.771 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.771 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.771 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1866 3.17 e93/21 3:e89f8bff:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_52:head v 93'8, mlcod=84'6)", 2024-05-08T18:32:14.771 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:01.059520+0000", 2024-05-08T18:32:14.771 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 13.622894084, 2024-05-08T18:32:14.771 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019782560000000001, 2024-05-08T18:32:14.771 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:14.771 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:14.771 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:14.771 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:14.772 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.772 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:14.772 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.059520+0000", 2024-05-08T18:32:14.772 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:14.772 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.772 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.772 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:14.772 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.059520+0000", 2024-05-08T18:32:14.772 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:14.772 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.772 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.772 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:14.772 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.059523+0000", 2024-05-08T18:32:14.773 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8229999999999999e-06 2024-05-08T18:32:14.773 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.773 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.773 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:14.773 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.063985+0000", 2024-05-08T18:32:14.773 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0044628460000000003 2024-05-08T18:32:14.773 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.773 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.773 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:14.773 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.064033+0000", 2024-05-08T18:32:14.773 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7825999999999999e-05 2024-05-08T18:32:14.773 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.773 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.773 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:14.774 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.064057+0000", 2024-05-08T18:32:14.774 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3883000000000002e-05 2024-05-08T18:32:14.774 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.774 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.774 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:14.774 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.064232+0000", 2024-05-08T18:32:14.774 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017526600000000001 2024-05-08T18:32:14.774 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.774 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.774 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:14.774 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.064301+0000", 2024-05-08T18:32:14.774 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8429000000000005e-05 2024-05-08T18:32:14.774 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.775 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.775 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:14.775 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.079213+0000", 2024-05-08T18:32:14.775 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.014911938 2024-05-08T18:32:14.775 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.775 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.775 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:14.775 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.079302+0000", 2024-05-08T18:32:14.775 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.9549000000000006e-05 2024-05-08T18:32:14.775 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:14.775 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:14.775 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:14.775 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.776 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.776 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1868 3.2f 3:f4cf47d6:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_54:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:32:14.776 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:01.082779+0000", 2024-05-08T18:32:14.776 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 13.599635126999999, 2024-05-08T18:32:14.776 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.023993838999999999, 2024-05-08T18:32:14.776 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:14.776 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:14.776 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:14.776 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:14.776 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:14.776 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:14.776 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1868 2024-05-08T18:32:14.776 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.777 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:14.777 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.777 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:14.777 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.082779+0000", 2024-05-08T18:32:14.777 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:14.777 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.777 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.777 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:14.777 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.082779+0000", 2024-05-08T18:32:14.777 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:14.777 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.777 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.777 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:14.778 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.082782+0000", 2024-05-08T18:32:14.778 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1429999999999998e-06 2024-05-08T18:32:14.778 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.778 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.778 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:14.778 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.086738+0000", 2024-05-08T18:32:14.778 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039560749999999999 2024-05-08T18:32:14.778 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.778 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.778 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:14.778 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.086781+0000", 2024-05-08T18:32:14.778 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3513999999999997e-05 2024-05-08T18:32:14.778 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.778 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.779 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:14.779 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.086803+0000", 2024-05-08T18:32:14.779 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1505000000000002e-05 2024-05-08T18:32:14.779 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.779 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.779 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:14.779 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.086967+0000", 2024-05-08T18:32:14.779 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016404899999999999 2024-05-08T18:32:14.779 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.779 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.779 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:14.779 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.087238+0000", 2024-05-08T18:32:14.780 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00027128800000000001 2024-05-08T18:32:14.780 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.780 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.780 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 7", 2024-05-08T18:32:14.780 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.087500+0000", 2024-05-08T18:32:14.780 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00026215400000000001 2024-05-08T18:32:14.780 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.780 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.780 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:14.780 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.106273+0000", 2024-05-08T18:32:14.780 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018772832 2024-05-08T18:32:14.780 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.781 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.781 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:14.781 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.106605+0000", 2024-05-08T18:32:14.781 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00033141300000000002 2024-05-08T18:32:14.781 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.781 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.781 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:14.781 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.106698+0000", 2024-05-08T18:32:14.781 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.3706e-05 2024-05-08T18:32:14.781 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.781 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.781 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:14.782 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.106773+0000", 2024-05-08T18:32:14.782 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4159999999999995e-05 2024-05-08T18:32:14.782 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:14.782 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:14.782 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:14.782 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.782 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.782 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1872 3.1c 3:38d9a9dd:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_58:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:32:14.782 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:01.131325+0000", 2024-05-08T18:32:14.782 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 13.551088985, 2024-05-08T18:32:14.782 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.021008104, 2024-05-08T18:32:14.782 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:14.782 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:14.783 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:14.783 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:14.783 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:14.783 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:14.783 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1872 2024-05-08T18:32:14.783 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.783 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:14.783 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.783 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:14.783 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.131325+0000", 2024-05-08T18:32:14.783 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:14.783 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.783 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.784 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:14.784 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.131325+0000", 2024-05-08T18:32:14.784 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:14.784 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.784 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.784 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:14.784 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.131327+0000", 2024-05-08T18:32:14.784 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3719999999999999e-06 2024-05-08T18:32:14.784 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.784 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.784 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:14.784 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.135126+0000", 2024-05-08T18:32:14.784 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.003798381 2024-05-08T18:32:14.785 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.785 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.785 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:14.785 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.135146+0000", 2024-05-08T18:32:14.785 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.071e-05 2024-05-08T18:32:14.785 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.785 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.785 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:14.785 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.135161+0000", 2024-05-08T18:32:14.785 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4766000000000001e-05 2024-05-08T18:32:14.785 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.785 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.785 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:14.786 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.135291+0000", 2024-05-08T18:32:14.786 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000129901 2024-05-08T18:32:14.786 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.786 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.786 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:14.786 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.135515+0000", 2024-05-08T18:32:14.786 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000224293 2024-05-08T18:32:14.786 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.786 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.786 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 4", 2024-05-08T18:32:14.786 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.135731+0000", 2024-05-08T18:32:14.786 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00021577 2024-05-08T18:32:14.786 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.787 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.787 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:14.787 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.147443+0000", 2024-05-08T18:32:14.787 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011712323 2024-05-08T18:32:14.787 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.787 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.787 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:14.787 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.152045+0000", 2024-05-08T18:32:14.787 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0046019279999999999 2024-05-08T18:32:14.787 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.787 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.787 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:14.788 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.152200+0000", 2024-05-08T18:32:14.788 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015482399999999999 2024-05-08T18:32:14.788 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.788 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.788 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:14.788 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.152333+0000", 2024-05-08T18:32:14.788 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000132836 2024-05-08T18:32:14.788 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:14.788 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:14.788 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:14.788 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.788 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.789 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1876 3.c 3:31c32d98:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_62:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:32:14.789 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:01.196179+0000", 2024-05-08T18:32:14.789 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 13.486234924, 2024-05-08T18:32:14.789 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.026072768, 2024-05-08T18:32:14.789 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:14.789 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:14.789 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:14.789 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:14.789 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:14.789 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:14.789 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1876 2024-05-08T18:32:14.789 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.789 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:14.789 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.790 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:14.790 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.196179+0000", 2024-05-08T18:32:14.790 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:14.790 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.790 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.790 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:14.790 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.196179+0000", 2024-05-08T18:32:14.790 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:14.790 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.790 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.790 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:14.791 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.196181+0000", 2024-05-08T18:32:14.791 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.367e-06 2024-05-08T18:32:14.791 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.791 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.791 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:14.791 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.200229+0000", 2024-05-08T18:32:14.791 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0040475240000000003 2024-05-08T18:32:14.791 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.791 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.791 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:14.791 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.200256+0000", 2024-05-08T18:32:14.791 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.7404000000000001e-05 2024-05-08T18:32:14.791 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.792 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.792 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:14.792 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.200268+0000", 2024-05-08T18:32:14.792 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1813e-05 2024-05-08T18:32:14.792 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.792 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.792 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:14.792 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.200353+0000", 2024-05-08T18:32:14.792 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.4474000000000005e-05 2024-05-08T18:32:14.792 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.792 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.792 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:14.792 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.200542+0000", 2024-05-08T18:32:14.793 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000189717 2024-05-08T18:32:14.793 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.793 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.793 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 3", 2024-05-08T18:32:14.793 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.200712+0000", 2024-05-08T18:32:14.793 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016992099999999999 2024-05-08T18:32:14.793 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.793 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.793 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:14.793 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.208663+0000", 2024-05-08T18:32:14.793 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0079506639999999996 2024-05-08T18:32:14.793 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.793 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.794 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:14.794 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.221964+0000", 2024-05-08T18:32:14.794 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.013301362000000001 2024-05-08T18:32:14.794 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.794 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.794 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:14.794 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.222142+0000", 2024-05-08T18:32:14.794 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017776599999999999 2024-05-08T18:32:14.794 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.794 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.794 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:14.794 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.222252+0000", 2024-05-08T18:32:14.794 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000109756 2024-05-08T18:32:14.795 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:14.795 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:14.795 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:14.795 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.795 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.795 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1902 3.28 3:17e1ce0c:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_88:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:32:14.795 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:01.732067+0000", 2024-05-08T18:32:14.795 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 12.950347262999999, 2024-05-08T18:32:14.795 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.034055580000000002, 2024-05-08T18:32:14.795 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:14.795 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:14.795 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:14.796 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:14.796 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:14.796 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:14.796 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1902 2024-05-08T18:32:14.796 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.796 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:14.796 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.796 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:14.796 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.732067+0000", 2024-05-08T18:32:14.796 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:14.796 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.796 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.796 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:14.797 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.732067+0000", 2024-05-08T18:32:14.797 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:14.797 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.797 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.797 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:14.797 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.732070+0000", 2024-05-08T18:32:14.797 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5300000000000001e-06 2024-05-08T18:32:14.797 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.797 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.797 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:14.797 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.736601+0000", 2024-05-08T18:32:14.797 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0045306160000000003 2024-05-08T18:32:14.797 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.798 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.798 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:14.798 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.736640+0000", 2024-05-08T18:32:14.798 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9663000000000003e-05 2024-05-08T18:32:14.798 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.798 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.798 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:14.798 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.736659+0000", 2024-05-08T18:32:14.798 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8652999999999999e-05 2024-05-08T18:32:14.798 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.798 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.799 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:14.799 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.736832+0000", 2024-05-08T18:32:14.799 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017339800000000001 2024-05-08T18:32:14.799 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.799 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.799 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:14.799 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.737091+0000", 2024-05-08T18:32:14.799 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00025841500000000001 2024-05-08T18:32:14.799 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.799 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.799 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 3", 2024-05-08T18:32:14.799 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.737330+0000", 2024-05-08T18:32:14.799 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00023942200000000001 2024-05-08T18:32:14.800 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.800 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.800 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:14.800 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.749415+0000", 2024-05-08T18:32:14.800 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012085024 2024-05-08T18:32:14.800 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.800 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.800 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:14.800 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.766035+0000", 2024-05-08T18:32:14.800 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016619842999999999 2024-05-08T18:32:14.800 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.800 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.800 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:14.801 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.766078+0000", 2024-05-08T18:32:14.801 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.2735999999999999e-05 2024-05-08T18:32:14.801 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.801 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.801 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:14.801 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.766122+0000", 2024-05-08T18:32:14.801 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4280000000000003e-05 2024-05-08T18:32:14.801 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:14.801 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:14.801 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:14.801 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.801 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.801 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1923 3.22 3:469de645:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_109:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:32:14.802 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:02.073868+0000", 2024-05-08T18:32:14.802 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 12.60854616, 2024-05-08T18:32:14.802 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019693196999999999, 2024-05-08T18:32:14.802 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:14.802 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:14.802 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:14.802 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:14.802 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:14.802 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:14.802 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1923 2024-05-08T18:32:14.802 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.802 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:14.803 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.803 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:14.803 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.073868+0000", 2024-05-08T18:32:14.803 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:14.803 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.803 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.803 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:14.803 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.073868+0000", 2024-05-08T18:32:14.803 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:14.803 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.803 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.803 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:14.803 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.073900+0000", 2024-05-08T18:32:14.803 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2252999999999998e-05 2024-05-08T18:32:14.804 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.804 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.804 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:14.804 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.078035+0000", 2024-05-08T18:32:14.804 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0041348929999999997 2024-05-08T18:32:14.804 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.804 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.804 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:14.804 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.078075+0000", 2024-05-08T18:32:14.804 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0040000000000003e-05 2024-05-08T18:32:14.804 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.804 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.804 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:14.805 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.078093+0000", 2024-05-08T18:32:14.805 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8626000000000001e-05 2024-05-08T18:32:14.805 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.805 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.805 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:14.805 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.078198+0000", 2024-05-08T18:32:14.805 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000104632 2024-05-08T18:32:14.805 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.805 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.805 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:14.805 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.078364+0000", 2024-05-08T18:32:14.805 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000165551 2024-05-08T18:32:14.806 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.806 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.806 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 3", 2024-05-08T18:32:14.806 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.078526+0000", 2024-05-08T18:32:14.806 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016216900000000001 2024-05-08T18:32:14.806 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.806 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.806 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:14.806 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.085095+0000", 2024-05-08T18:32:14.806 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0065693790000000002 2024-05-08T18:32:14.806 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.806 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.807 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:14.807 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.093441+0000", 2024-05-08T18:32:14.807 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0083460940000000001 2024-05-08T18:32:14.807 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.807 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.807 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:14.807 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.093507+0000", 2024-05-08T18:32:14.807 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.5650999999999999e-05 2024-05-08T18:32:14.807 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.807 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.807 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:14.807 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.093561+0000", 2024-05-08T18:32:14.808 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3909000000000002e-05 2024-05-08T18:32:14.808 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:14.808 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:14.808 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:14.808 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.808 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.808 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1927 3.22 3:460f723f:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_113:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:32:14.808 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:02.122319+0000", 2024-05-08T18:32:14.808 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 12.560094911, 2024-05-08T18:32:14.808 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.020582304999999999, 2024-05-08T18:32:14.808 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:14.808 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:14.808 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:14.808 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:14.809 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:14.809 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:14.809 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1927 2024-05-08T18:32:14.809 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.809 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:14.809 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.809 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:14.809 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.122319+0000", 2024-05-08T18:32:14.809 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:14.809 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.809 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.809 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:14.809 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.122319+0000", 2024-05-08T18:32:14.809 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:14.810 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.810 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.810 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:14.810 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.122322+0000", 2024-05-08T18:32:14.810 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.9119999999999998e-06 2024-05-08T18:32:14.810 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.810 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.810 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:14.810 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.126667+0000", 2024-05-08T18:32:14.810 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0043456299999999996 2024-05-08T18:32:14.810 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.810 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.811 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:14.811 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.126690+0000", 2024-05-08T18:32:14.811 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2643e-05 2024-05-08T18:32:14.811 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.811 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.811 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:14.811 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.126702+0000", 2024-05-08T18:32:14.811 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2193e-05 2024-05-08T18:32:14.811 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.811 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.811 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:14.811 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.126771+0000", 2024-05-08T18:32:14.811 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8354000000000003e-05 2024-05-08T18:32:14.812 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.812 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.812 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:14.812 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.126893+0000", 2024-05-08T18:32:14.812 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012245100000000001 2024-05-08T18:32:14.812 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.812 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.812 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 3", 2024-05-08T18:32:14.812 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.126993+0000", 2024-05-08T18:32:14.812 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.9637999999999997e-05 2024-05-08T18:32:14.812 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.812 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.812 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:14.813 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.131140+0000", 2024-05-08T18:32:14.813 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0041468090000000004 2024-05-08T18:32:14.813 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.813 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.813 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:14.813 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.142794+0000", 2024-05-08T18:32:14.813 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011654822 2024-05-08T18:32:14.813 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.813 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.813 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:14.813 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.142854+0000", 2024-05-08T18:32:14.813 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9346999999999999e-05 2024-05-08T18:32:14.813 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:14.813 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:14.814 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:14.814 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.142901+0000", 2024-05-08T18:32:14.814 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.7506000000000002e-05 2024-05-08T18:32:14.814 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:14.814 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:14.814 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:14.814 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:14.814 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:14.814 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:32:14.815 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-08T18:32:14.817 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-08T18:32:14.817 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-05-08T18:32:14.810+0000 7f090346e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25266) UID: 0 2024-05-08T18:32:14.818 DEBUG:teuthology.parallel:result is None 2024-05-08T18:32:14.818 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-05-08T18:32:14.873 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-05-08T18:32:14.873 DEBUG:teuthology.orchestra.run.smithi097:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-05-08T18:32:14.917 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-05-08T18:32:14.914+0000 7f19ab083640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25262) UID: 0 2024-05-08T18:32:14.932 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-05-08T18:32:14.932 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-05-08T18:32:14.942 INFO:tasks.thrashosds:joining thrashosds 2024-05-08T18:32:14.990 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:32:14.991 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:32:14.991 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 0 2024-05-08T18:32:14.991 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:32:15.005 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-08T18:32:15.174 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:32:15.174 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:32:15.174 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2024-05-08T18:32:15.174 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2024-05-08T18:32:15.174 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:32:15.188 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-08T18:32:15.315 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:32:15.315 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2024-05-08T18:32:15.315 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2024-05-08T18:32:15.315 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-05-08T18:32:15.316 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.316 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1315 3.2c 3:368ed9cc:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-08T18:32:15.316 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.301720+0000", 2024-05-08T18:32:15.316 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 33.010815583000003, 2024-05-08T18:32:15.316 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.028850259, 2024-05-08T18:32:15.316 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:15.316 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:15.316 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:15.316 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:15.316 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:15.317 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:15.317 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1315 2024-05-08T18:32:15.317 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.317 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:15.317 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.317 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:15.317 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.301720+0000", 2024-05-08T18:32:15.317 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:15.317 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.317 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.317 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:15.317 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.301720+0000", 2024-05-08T18:32:15.317 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:15.318 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.318 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.318 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:15.318 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.301723+0000", 2024-05-08T18:32:15.318 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.2369999999999999e-06 2024-05-08T18:32:15.318 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.318 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.318 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:15.318 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.309609+0000", 2024-05-08T18:32:15.318 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0078867369999999996 2024-05-08T18:32:15.318 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.318 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.319 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:15.319 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.309647+0000", 2024-05-08T18:32:15.319 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7849999999999998e-05 2024-05-08T18:32:15.319 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.319 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.319 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:15.319 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.309665+0000", 2024-05-08T18:32:15.319 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8346e-05 2024-05-08T18:32:15.319 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.319 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.319 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:15.319 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.309846+0000", 2024-05-08T18:32:15.319 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000180056 2024-05-08T18:32:15.320 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.320 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.320 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:15.320 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.310231+0000", 2024-05-08T18:32:15.320 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00038542999999999997 2024-05-08T18:32:15.320 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.320 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.320 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 4", 2024-05-08T18:32:15.320 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.310628+0000", 2024-05-08T18:32:15.320 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00039685099999999999 2024-05-08T18:32:15.320 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.320 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.320 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:15.320 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.329116+0000", 2024-05-08T18:32:15.321 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018488279999999999 2024-05-08T18:32:15.321 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.321 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.321 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:15.321 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.330334+0000", 2024-05-08T18:32:15.321 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001217734 2024-05-08T18:32:15.321 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.321 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.321 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:15.321 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.330450+0000", 2024-05-08T18:32:15.321 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000116439 2024-05-08T18:32:15.321 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.321 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.322 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:15.322 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.330571+0000", 2024-05-08T18:32:15.322 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012029899999999999 2024-05-08T18:32:15.322 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:15.322 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:15.322 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:15.322 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.322 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.322 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1319 3.35 3:add64cdc:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-08T18:32:15.322 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.358042+0000", 2024-05-08T18:32:15.322 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 32.954493667000001, 2024-05-08T18:32:15.322 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.023806130000000002, 2024-05-08T18:32:15.322 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:15.323 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:15.323 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:15.323 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:15.323 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:15.323 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:15.323 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1319 2024-05-08T18:32:15.323 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.323 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:15.323 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.323 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:15.323 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.358042+0000", 2024-05-08T18:32:15.323 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:15.323 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.324 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.324 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:15.324 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.358042+0000", 2024-05-08T18:32:15.324 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:15.324 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.324 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.324 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:15.324 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.358045+0000", 2024-05-08T18:32:15.324 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.813e-06 2024-05-08T18:32:15.324 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.324 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.324 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:15.325 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.362893+0000", 2024-05-08T18:32:15.325 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0048481569999999996 2024-05-08T18:32:15.325 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.325 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.325 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:15.325 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.362932+0000", 2024-05-08T18:32:15.325 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8788999999999997e-05 2024-05-08T18:32:15.325 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.325 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.325 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:15.325 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.362949+0000", 2024-05-08T18:32:15.325 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7289999999999999e-05 2024-05-08T18:32:15.325 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.326 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.326 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:15.326 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.363084+0000", 2024-05-08T18:32:15.326 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000134552 2024-05-08T18:32:15.326 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.326 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.326 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:15.326 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.363324+0000", 2024-05-08T18:32:15.326 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000239702 2024-05-08T18:32:15.326 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.326 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.326 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 5", 2024-05-08T18:32:15.326 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.363553+0000", 2024-05-08T18:32:15.327 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000229519 2024-05-08T18:32:15.327 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.327 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.327 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:15.327 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.373958+0000", 2024-05-08T18:32:15.327 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010404821 2024-05-08T18:32:15.327 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.327 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.327 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:15.327 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.381549+0000", 2024-05-08T18:32:15.327 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0075911930000000004 2024-05-08T18:32:15.327 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.327 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.328 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:15.328 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.381715+0000", 2024-05-08T18:32:15.328 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016614900000000001 2024-05-08T18:32:15.328 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.328 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.328 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:15.328 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.381848+0000", 2024-05-08T18:32:15.328 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013314499999999999 2024-05-08T18:32:15.328 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:15.328 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:15.328 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:15.328 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.328 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.328 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1337 3.36 3:6e6c3d09:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:32:15.329 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.570209+0000", 2024-05-08T18:32:15.329 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 32.742327365999998, 2024-05-08T18:32:15.329 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.031066623000000002, 2024-05-08T18:32:15.329 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:15.329 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:15.329 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:15.329 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:15.329 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:15.329 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:15.329 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1337 2024-05-08T18:32:15.329 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.329 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:15.330 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.330 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:15.330 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.570209+0000", 2024-05-08T18:32:15.330 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:15.330 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.330 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.330 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:15.330 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.570209+0000", 2024-05-08T18:32:15.330 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:15.330 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.330 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.330 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:15.330 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.570212+0000", 2024-05-08T18:32:15.331 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.0800000000000002e-06 2024-05-08T18:32:15.331 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.331 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.331 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:15.331 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.575559+0000", 2024-05-08T18:32:15.331 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0053471300000000003 2024-05-08T18:32:15.331 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.331 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.331 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:15.331 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.575591+0000", 2024-05-08T18:32:15.331 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2143e-05 2024-05-08T18:32:15.331 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.331 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.332 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:15.332 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.575609+0000", 2024-05-08T18:32:15.332 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8139999999999999e-05 2024-05-08T18:32:15.332 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.332 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.332 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:15.332 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.575744+0000", 2024-05-08T18:32:15.332 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013482199999999999 2024-05-08T18:32:15.332 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.332 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.332 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op must wait for map", 2024-05-08T18:32:15.332 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.575763+0000", 2024-05-08T18:32:15.332 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.963e-05 2024-05-08T18:32:15.332 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.333 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.333 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:15.333 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.583603+0000", 2024-05-08T18:32:15.333 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0078395970000000002 2024-05-08T18:32:15.333 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.333 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.333 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:15.333 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.583943+0000", 2024-05-08T18:32:15.333 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00034006800000000001 2024-05-08T18:32:15.333 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.333 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.333 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 5", 2024-05-08T18:32:15.333 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.584214+0000", 2024-05-08T18:32:15.334 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00027059399999999998 2024-05-08T18:32:15.334 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.334 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.334 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:15.334 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.600111+0000", 2024-05-08T18:32:15.334 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015897521000000001 2024-05-08T18:32:15.334 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.334 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.334 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:15.334 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.600967+0000", 2024-05-08T18:32:15.334 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00085548000000000004 2024-05-08T18:32:15.334 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.334 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.335 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:15.335 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.601137+0000", 2024-05-08T18:32:15.335 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017063500000000001 2024-05-08T18:32:15.335 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.335 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.335 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:15.335 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.601275+0000", 2024-05-08T18:32:15.335 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013778299999999999 2024-05-08T18:32:15.335 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:15.335 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:15.335 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:15.335 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.335 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.336 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1360 3.20 3:0629b24f:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_46:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:32:15.336 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.812182+0000", 2024-05-08T18:32:15.336 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 32.500354166000001, 2024-05-08T18:32:15.336 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.020673025000000001, 2024-05-08T18:32:15.336 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:15.336 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:15.336 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:15.336 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:15.336 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:15.336 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:15.336 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1360 2024-05-08T18:32:15.336 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.336 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:15.336 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.337 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:15.337 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.812182+0000", 2024-05-08T18:32:15.337 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:15.337 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.337 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.337 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:15.337 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.812182+0000", 2024-05-08T18:32:15.337 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:15.337 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.337 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.337 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:15.337 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.812186+0000", 2024-05-08T18:32:15.337 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.267e-06 2024-05-08T18:32:15.338 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.338 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.338 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:15.338 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.816498+0000", 2024-05-08T18:32:15.338 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0043117110000000002 2024-05-08T18:32:15.338 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.338 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.338 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:15.338 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.816537+0000", 2024-05-08T18:32:15.338 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9082999999999998e-05 2024-05-08T18:32:15.338 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.338 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.338 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:15.338 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.816554+0000", 2024-05-08T18:32:15.339 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.7549000000000001e-05 2024-05-08T18:32:15.339 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.339 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.339 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:15.339 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.816696+0000", 2024-05-08T18:32:15.339 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014152300000000001 2024-05-08T18:32:15.339 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.339 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.339 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:15.339 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.816956+0000", 2024-05-08T18:32:15.339 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00026039800000000001 2024-05-08T18:32:15.339 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.340 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.340 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:32:15.340 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.817186+0000", 2024-05-08T18:32:15.340 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00023018800000000001 2024-05-08T18:32:15.340 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.340 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.340 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:15.340 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.826298+0000", 2024-05-08T18:32:15.340 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0091116549999999998 2024-05-08T18:32:15.340 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.340 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.340 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:15.340 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.832553+0000", 2024-05-08T18:32:15.340 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0062545029999999998 2024-05-08T18:32:15.341 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.341 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.341 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:15.341 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.832725+0000", 2024-05-08T18:32:15.341 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000172065 2024-05-08T18:32:15.341 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.341 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.341 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:15.341 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.832855+0000", 2024-05-08T18:32:15.341 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013008299999999999 2024-05-08T18:32:15.341 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:15.341 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:15.341 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:15.342 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.342 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.342 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1361 3.26 3:65dd6def:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_47:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:32:15.342 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.822918+0000", 2024-05-08T18:32:15.342 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 32.489618, 2024-05-08T18:32:15.342 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.023073703000000001, 2024-05-08T18:32:15.342 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:15.342 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:15.343 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:15.343 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:15.343 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:15.343 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:15.343 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1361 2024-05-08T18:32:15.343 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.343 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:15.344 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.344 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:15.344 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.822918+0000", 2024-05-08T18:32:15.344 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:15.344 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.344 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.344 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:15.344 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.822918+0000", 2024-05-08T18:32:15.344 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:15.344 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.344 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.344 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:15.344 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.822921+0000", 2024-05-08T18:32:15.345 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.9270000000000001e-06 2024-05-08T18:32:15.345 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.345 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.345 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:15.345 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.827328+0000", 2024-05-08T18:32:15.345 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0044071199999999996 2024-05-08T18:32:15.345 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.345 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.345 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:15.345 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.827364+0000", 2024-05-08T18:32:15.345 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5963000000000001e-05 2024-05-08T18:32:15.345 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.346 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.346 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:15.346 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.827382+0000", 2024-05-08T18:32:15.346 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8533e-05 2024-05-08T18:32:15.346 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.346 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.346 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:15.346 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.827547+0000", 2024-05-08T18:32:15.346 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016492899999999999 2024-05-08T18:32:15.346 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.346 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.346 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:15.347 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.827949+0000", 2024-05-08T18:32:15.347 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00040151 2024-05-08T18:32:15.347 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.347 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.347 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 7", 2024-05-08T18:32:15.347 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.828334+0000", 2024-05-08T18:32:15.347 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00038469399999999999 2024-05-08T18:32:15.347 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.347 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.347 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:15.347 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.845540+0000", 2024-05-08T18:32:15.347 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017206117 2024-05-08T18:32:15.347 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.348 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.348 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:15.348 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.845825+0000", 2024-05-08T18:32:15.348 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000285555 2024-05-08T18:32:15.348 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.348 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.348 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:15.348 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.845917+0000", 2024-05-08T18:32:15.348 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1498999999999999e-05 2024-05-08T18:32:15.348 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.348 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.348 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:15.348 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.845992+0000", 2024-05-08T18:32:15.349 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4856000000000003e-05 2024-05-08T18:32:15.349 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:15.349 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:15.349 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:15.349 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.349 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.349 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1365 3.35 3:adc1c29f:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_51:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:32:15.349 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.864570+0000", 2024-05-08T18:32:15.349 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 32.447965467000003, 2024-05-08T18:32:15.349 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.021718316000000001, 2024-05-08T18:32:15.349 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:15.349 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:15.350 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:15.350 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:15.350 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:15.350 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:15.350 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1365 2024-05-08T18:32:15.350 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.350 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:15.350 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.350 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:15.350 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.864570+0000", 2024-05-08T18:32:15.350 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:15.350 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.350 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.351 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:15.351 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.864570+0000", 2024-05-08T18:32:15.351 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:15.351 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.351 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.351 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:15.351 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.864574+0000", 2024-05-08T18:32:15.351 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.433e-06 2024-05-08T18:32:15.351 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.351 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.351 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:15.351 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.869145+0000", 2024-05-08T18:32:15.351 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0045706790000000002 2024-05-08T18:32:15.352 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.352 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.352 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:15.352 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.869181+0000", 2024-05-08T18:32:15.352 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.68e-05 2024-05-08T18:32:15.352 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.352 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.352 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:15.352 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.869200+0000", 2024-05-08T18:32:15.352 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8453000000000001e-05 2024-05-08T18:32:15.352 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.352 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.352 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:15.352 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.869328+0000", 2024-05-08T18:32:15.352 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000128102 2024-05-08T18:32:15.353 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.353 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.353 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:15.353 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.869601+0000", 2024-05-08T18:32:15.353 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00027359200000000002 2024-05-08T18:32:15.353 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.353 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.353 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 5", 2024-05-08T18:32:15.353 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.869847+0000", 2024-05-08T18:32:15.353 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00024531800000000001 2024-05-08T18:32:15.353 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.353 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.354 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:15.354 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.885442+0000", 2024-05-08T18:32:15.354 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015595079 2024-05-08T18:32:15.354 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.354 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.354 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:15.354 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.886110+0000", 2024-05-08T18:32:15.354 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00066779100000000004 2024-05-08T18:32:15.354 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.354 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.354 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:15.354 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.886209+0000", 2024-05-08T18:32:15.354 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8967000000000003e-05 2024-05-08T18:32:15.355 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.355 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.355 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:15.355 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.886289+0000", 2024-05-08T18:32:15.355 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.0102e-05 2024-05-08T18:32:15.355 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:15.355 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:15.355 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:15.355 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.355 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.355 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1381 3.20 3:07260bee:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_67:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:32:15.355 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:43.057073+0000", 2024-05-08T18:32:15.355 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 32.255463003999999, 2024-05-08T18:32:15.355 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.020966242999999999, 2024-05-08T18:32:15.356 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:15.356 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:15.356 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:15.356 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:15.356 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:15.356 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:15.356 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1381 2024-05-08T18:32:15.356 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.356 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:15.356 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.356 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:15.356 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.057073+0000", 2024-05-08T18:32:15.356 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:15.356 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.357 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.357 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:15.357 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.057073+0000", 2024-05-08T18:32:15.357 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:15.357 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.357 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.357 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:15.357 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.057076+0000", 2024-05-08T18:32:15.357 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4230000000000001e-06 2024-05-08T18:32:15.357 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.357 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.357 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:15.357 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.063772+0000", 2024-05-08T18:32:15.357 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0066957960000000004 2024-05-08T18:32:15.358 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.358 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.358 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:15.358 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.063817+0000", 2024-05-08T18:32:15.358 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4883999999999999e-05 2024-05-08T18:32:15.358 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.358 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.358 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:15.358 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.063838+0000", 2024-05-08T18:32:15.358 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0622999999999999e-05 2024-05-08T18:32:15.358 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.358 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.359 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:15.359 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.063943+0000", 2024-05-08T18:32:15.359 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010529100000000001 2024-05-08T18:32:15.359 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.359 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.359 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:15.359 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.064116+0000", 2024-05-08T18:32:15.359 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017287699999999999 2024-05-08T18:32:15.359 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.359 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.359 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:32:15.359 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.064267+0000", 2024-05-08T18:32:15.359 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015107799999999999 2024-05-08T18:32:15.360 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.360 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.360 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:15.360 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.074658+0000", 2024-05-08T18:32:15.360 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010391473 2024-05-08T18:32:15.360 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.360 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.360 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:15.360 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.077919+0000", 2024-05-08T18:32:15.360 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0032607080000000002 2024-05-08T18:32:15.360 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.360 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.360 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:15.361 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.077986+0000", 2024-05-08T18:32:15.361 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7151999999999997e-05 2024-05-08T18:32:15.361 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.361 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.361 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:15.361 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.078039+0000", 2024-05-08T18:32:15.361 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2938e-05 2024-05-08T18:32:15.361 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:15.361 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:15.361 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:15.361 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.361 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.361 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1406 3.35 3:acb4ebf3:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_92:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:32:15.362 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:43.333886+0000", 2024-05-08T18:32:15.362 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 31.978649410999999, 2024-05-08T18:32:15.362 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018425136000000002, 2024-05-08T18:32:15.362 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:15.362 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:15.362 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:15.362 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:15.362 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:15.362 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:15.362 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1406 2024-05-08T18:32:15.362 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.363 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:15.363 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.363 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:15.363 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.333886+0000", 2024-05-08T18:32:15.363 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:15.363 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.363 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.363 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:15.363 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.333886+0000", 2024-05-08T18:32:15.363 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:15.363 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.363 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.363 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:15.363 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.333889+0000", 2024-05-08T18:32:15.364 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6879999999999999e-06 2024-05-08T18:32:15.364 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.364 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.364 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:15.364 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.337554+0000", 2024-05-08T18:32:15.364 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0036647609999999999 2024-05-08T18:32:15.364 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.364 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.364 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:15.364 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.337574+0000", 2024-05-08T18:32:15.364 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9830000000000002e-05 2024-05-08T18:32:15.364 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.364 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.365 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:15.365 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.337583+0000", 2024-05-08T18:32:15.365 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.0599999999999997e-06 2024-05-08T18:32:15.365 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.365 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.365 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:15.365 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.337661+0000", 2024-05-08T18:32:15.365 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.7931999999999999e-05 2024-05-08T18:32:15.365 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.365 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.365 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:15.365 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.337818+0000", 2024-05-08T18:32:15.366 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015687000000000001 2024-05-08T18:32:15.366 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.366 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.366 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 5", 2024-05-08T18:32:15.366 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.337942+0000", 2024-05-08T18:32:15.366 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000124206 2024-05-08T18:32:15.366 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.366 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.366 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:15.366 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.350659+0000", 2024-05-08T18:32:15.366 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012717282 2024-05-08T18:32:15.366 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.367 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.367 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:15.367 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.352231+0000", 2024-05-08T18:32:15.367 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001571512 2024-05-08T18:32:15.367 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.367 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.367 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:15.367 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.352274+0000", 2024-05-08T18:32:15.367 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3371999999999997e-05 2024-05-08T18:32:15.367 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.367 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.367 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:15.367 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.352312+0000", 2024-05-08T18:32:15.368 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7623000000000002e-05 2024-05-08T18:32:15.368 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:15.368 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:15.368 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:15.368 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.368 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.368 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1412 3.36 3:6db491e0:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_98:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:32:15.368 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:43.394092+0000", 2024-05-08T18:32:15.368 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 31.918444134000001, 2024-05-08T18:32:15.368 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.021120863, 2024-05-08T18:32:15.368 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:15.368 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:15.368 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:15.368 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:15.369 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:15.369 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:15.369 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1412 2024-05-08T18:32:15.369 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.369 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:15.369 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.369 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:15.369 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.394092+0000", 2024-05-08T18:32:15.369 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:15.369 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.369 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.369 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:15.369 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.394092+0000", 2024-05-08T18:32:15.370 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:15.370 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.370 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.370 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:15.370 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.394094+0000", 2024-05-08T18:32:15.370 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.305e-06 2024-05-08T18:32:15.370 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.370 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.370 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:15.370 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.397860+0000", 2024-05-08T18:32:15.370 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0037662239999999999 2024-05-08T18:32:15.370 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.371 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.371 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:15.371 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.397890+0000", 2024-05-08T18:32:15.371 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.9274000000000001e-05 2024-05-08T18:32:15.371 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.371 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.371 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:15.371 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.397905+0000", 2024-05-08T18:32:15.371 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5398999999999999e-05 2024-05-08T18:32:15.371 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.371 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.371 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:15.371 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.398094+0000", 2024-05-08T18:32:15.372 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00018897799999999999 2024-05-08T18:32:15.372 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.372 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.372 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:15.372 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.398337+0000", 2024-05-08T18:32:15.372 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00024258799999999999 2024-05-08T18:32:15.372 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.372 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.372 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 5", 2024-05-08T18:32:15.372 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.398593+0000", 2024-05-08T18:32:15.372 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00025631500000000002 2024-05-08T18:32:15.372 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.372 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.372 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:15.373 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.413998+0000", 2024-05-08T18:32:15.373 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015405663999999999 2024-05-08T18:32:15.373 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.373 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.373 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:15.373 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.415077+0000", 2024-05-08T18:32:15.373 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001078063 2024-05-08T18:32:15.373 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.373 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.373 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:15.373 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.415149+0000", 2024-05-08T18:32:15.373 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.2878000000000003e-05 2024-05-08T18:32:15.373 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.373 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.374 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:15.374 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:43.415213+0000", 2024-05-08T18:32:15.374 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.3175000000000004e-05 2024-05-08T18:32:15.374 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:15.374 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:15.374 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:15.374 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.374 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.374 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1615 3.35 3:ae758c88:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-05-08T18:32:15.374 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:46.719155+0000", 2024-05-08T18:32:15.375 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 28.593381376, 2024-05-08T18:32:15.375 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.038329020999999998, 2024-05-08T18:32:15.375 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:15.375 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:15.375 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:15.375 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:15.375 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:15.375 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:15.375 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1615 2024-05-08T18:32:15.375 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.375 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:15.375 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.375 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:15.375 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.719155+0000", 2024-05-08T18:32:15.376 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:15.376 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.376 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.376 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:15.376 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.719155+0000", 2024-05-08T18:32:15.376 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:15.376 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.376 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.376 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:15.376 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.719159+0000", 2024-05-08T18:32:15.376 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.4259999999999996e-06 2024-05-08T18:32:15.376 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.376 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.377 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:15.377 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.728715+0000", 2024-05-08T18:32:15.377 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0095562549999999996 2024-05-08T18:32:15.377 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.377 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.377 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:15.377 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.728764+0000", 2024-05-08T18:32:15.377 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9262999999999999e-05 2024-05-08T18:32:15.377 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.377 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.377 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:15.377 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.728785+0000", 2024-05-08T18:32:15.378 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0339999999999998e-05 2024-05-08T18:32:15.378 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.378 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.378 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:15.378 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.728951+0000", 2024-05-08T18:32:15.378 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000166105 2024-05-08T18:32:15.378 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.378 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.378 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:15.378 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.729206+0000", 2024-05-08T18:32:15.378 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00025512499999999998 2024-05-08T18:32:15.378 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.378 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.379 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 5", 2024-05-08T18:32:15.379 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.729436+0000", 2024-05-08T18:32:15.379 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022991099999999999 2024-05-08T18:32:15.379 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.379 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.379 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:15.379 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.754118+0000", 2024-05-08T18:32:15.379 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.024682511000000001 2024-05-08T18:32:15.379 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.379 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.379 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:15.379 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.757310+0000", 2024-05-08T18:32:15.380 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0031911890000000001 2024-05-08T18:32:15.380 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.380 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.380 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:15.380 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.757408+0000", 2024-05-08T18:32:15.380 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8826000000000006e-05 2024-05-08T18:32:15.380 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.380 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.380 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:15.380 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.757484+0000", 2024-05-08T18:32:15.380 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5069999999999998e-05 2024-05-08T18:32:15.380 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:15.380 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:15.380 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:15.381 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.381 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.381 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1623 3.20 3:0496c987:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-05-08T18:32:15.381 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:46.802136+0000", 2024-05-08T18:32:15.381 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 28.510400052000001, 2024-05-08T18:32:15.381 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.026548796999999999, 2024-05-08T18:32:15.381 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:15.381 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:15.382 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:15.382 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:15.382 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:15.382 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:15.382 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1623 2024-05-08T18:32:15.382 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.382 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:15.382 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.382 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:15.382 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.802136+0000", 2024-05-08T18:32:15.382 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:15.382 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.383 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.383 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:15.383 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.802136+0000", 2024-05-08T18:32:15.383 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:15.383 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.383 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.383 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:15.383 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.802140+0000", 2024-05-08T18:32:15.383 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8469999999999998e-06 2024-05-08T18:32:15.383 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.383 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.383 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:15.383 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.806310+0000", 2024-05-08T18:32:15.383 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0041703449999999998 2024-05-08T18:32:15.383 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.384 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.384 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:15.384 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.806362+0000", 2024-05-08T18:32:15.384 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.2113000000000001e-05 2024-05-08T18:32:15.384 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.384 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.384 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:15.384 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.806409+0000", 2024-05-08T18:32:15.384 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.6505999999999998e-05 2024-05-08T18:32:15.384 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.384 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.384 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:15.384 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.806614+0000", 2024-05-08T18:32:15.385 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000205572 2024-05-08T18:32:15.385 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.385 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.385 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:15.385 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.807056+0000", 2024-05-08T18:32:15.385 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00044176300000000002 2024-05-08T18:32:15.385 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.385 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.385 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:32:15.385 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.807458+0000", 2024-05-08T18:32:15.385 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00040168000000000002 2024-05-08T18:32:15.385 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.385 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.386 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:15.386 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.819075+0000", 2024-05-08T18:32:15.386 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011616903 2024-05-08T18:32:15.386 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.386 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.386 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:15.386 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.828505+0000", 2024-05-08T18:32:15.386 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0094299759999999996 2024-05-08T18:32:15.386 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.386 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.386 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:15.386 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.828605+0000", 2024-05-08T18:32:15.386 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000100152 2024-05-08T18:32:15.387 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.387 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.387 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:15.387 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.828685+0000", 2024-05-08T18:32:15.387 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9939999999999997e-05 2024-05-08T18:32:15.387 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:15.387 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:15.387 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:15.387 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.387 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.387 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1626 3.20 3:04d2d7da:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-05-08T18:32:15.387 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:46.841165+0000", 2024-05-08T18:32:15.387 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 28.471371286, 2024-05-08T18:32:15.388 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.028115448000000001, 2024-05-08T18:32:15.388 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:15.388 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:15.388 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:15.388 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:15.388 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:15.388 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:15.388 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1626 2024-05-08T18:32:15.388 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.388 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:15.388 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.388 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:15.388 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.841165+0000", 2024-05-08T18:32:15.389 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:15.389 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.389 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.389 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:15.389 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.841165+0000", 2024-05-08T18:32:15.389 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:15.389 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.389 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.389 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:15.389 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.841167+0000", 2024-05-08T18:32:15.389 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5900000000000002e-06 2024-05-08T18:32:15.389 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.389 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.389 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:15.390 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.845166+0000", 2024-05-08T18:32:15.390 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039988760000000002 2024-05-08T18:32:15.390 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.390 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.390 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:15.390 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.845199+0000", 2024-05-08T18:32:15.390 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2950000000000001e-05 2024-05-08T18:32:15.390 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.390 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.390 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:15.390 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.845223+0000", 2024-05-08T18:32:15.390 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.4074e-05 2024-05-08T18:32:15.390 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.391 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.391 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:15.391 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.845360+0000", 2024-05-08T18:32:15.391 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013671899999999999 2024-05-08T18:32:15.391 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.391 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.391 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:15.391 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.845619+0000", 2024-05-08T18:32:15.391 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00025912800000000002 2024-05-08T18:32:15.391 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.391 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.391 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:32:15.391 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.845856+0000", 2024-05-08T18:32:15.392 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00023749099999999999 2024-05-08T18:32:15.392 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.392 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.392 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:15.392 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.856156+0000", 2024-05-08T18:32:15.392 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010299536 2024-05-08T18:32:15.392 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.392 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.392 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:15.392 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.868964+0000", 2024-05-08T18:32:15.392 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012808083 2024-05-08T18:32:15.392 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.392 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.393 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:15.393 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.869142+0000", 2024-05-08T18:32:15.393 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017771599999999999 2024-05-08T18:32:15.393 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.393 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.393 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:15.393 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.869280+0000", 2024-05-08T18:32:15.393 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013828500000000001 2024-05-08T18:32:15.393 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:15.393 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:15.393 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:15.393 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.393 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.394 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1824 3.2c 3:36a4dac4:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-05-08T18:32:15.394 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:00.541071+0000", 2024-05-08T18:32:15.394 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 14.771464662, 2024-05-08T18:32:15.394 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.021251051999999999, 2024-05-08T18:32:15.394 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:15.394 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:15.394 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:15.394 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:15.394 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:15.394 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:15.394 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1824 2024-05-08T18:32:15.394 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.394 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:15.395 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.395 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:15.395 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.541071+0000", 2024-05-08T18:32:15.395 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:15.395 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.395 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.395 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:15.395 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.541071+0000", 2024-05-08T18:32:15.395 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:15.395 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.395 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.395 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:15.395 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.541076+0000", 2024-05-08T18:32:15.396 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8760000000000004e-06 2024-05-08T18:32:15.396 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.396 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.396 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:15.396 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.546258+0000", 2024-05-08T18:32:15.396 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0051822439999999999 2024-05-08T18:32:15.396 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.396 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.396 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:15.396 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.546297+0000", 2024-05-08T18:32:15.396 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8460000000000001e-05 2024-05-08T18:32:15.396 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.396 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.396 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:15.397 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.546316+0000", 2024-05-08T18:32:15.397 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8853000000000001e-05 2024-05-08T18:32:15.397 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.397 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.397 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:15.397 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.546424+0000", 2024-05-08T18:32:15.397 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000108597 2024-05-08T18:32:15.397 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.397 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.397 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:15.398 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.546605+0000", 2024-05-08T18:32:15.398 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00018060099999999999 2024-05-08T18:32:15.398 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.398 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.398 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 4", 2024-05-08T18:32:15.398 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.546781+0000", 2024-05-08T18:32:15.398 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017653300000000001 2024-05-08T18:32:15.398 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.398 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.398 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:15.398 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.556391+0000", 2024-05-08T18:32:15.398 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0096097460000000006 2024-05-08T18:32:15.399 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.399 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.399 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:15.399 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.562196+0000", 2024-05-08T18:32:15.399 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0058047840000000003 2024-05-08T18:32:15.399 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.399 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.399 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:15.399 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.562267+0000", 2024-05-08T18:32:15.399 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1179000000000004e-05 2024-05-08T18:32:15.399 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.399 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.399 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:15.400 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.562322+0000", 2024-05-08T18:32:15.400 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5179000000000001e-05 2024-05-08T18:32:15.400 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:15.400 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:15.400 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:15.400 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.400 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.400 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1827 3.a 3:523d931b:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-05-08T18:32:15.400 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:00.589747+0000", 2024-05-08T18:32:15.400 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 14.72278852, 2024-05-08T18:32:15.400 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019404434000000002, 2024-05-08T18:32:15.400 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:15.400 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:15.401 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:15.401 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:15.401 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:15.401 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:15.401 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1827 2024-05-08T18:32:15.401 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.401 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:15.401 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.401 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:15.401 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.589747+0000", 2024-05-08T18:32:15.401 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:15.401 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.401 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.402 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:15.402 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.589747+0000", 2024-05-08T18:32:15.402 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:15.402 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.402 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.402 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:15.402 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.589750+0000", 2024-05-08T18:32:15.402 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.627e-06 2024-05-08T18:32:15.402 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.402 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.402 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:15.402 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.593876+0000", 2024-05-08T18:32:15.402 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0041264020000000004 2024-05-08T18:32:15.403 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.403 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.403 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:15.403 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.593913+0000", 2024-05-08T18:32:15.403 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6489000000000002e-05 2024-05-08T18:32:15.403 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.403 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.403 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:15.403 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.593934+0000", 2024-05-08T18:32:15.403 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0647000000000001e-05 2024-05-08T18:32:15.403 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.403 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.403 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:15.404 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.594098+0000", 2024-05-08T18:32:15.404 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016424500000000001 2024-05-08T18:32:15.404 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.404 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.404 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:15.404 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.594519+0000", 2024-05-08T18:32:15.404 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00042162699999999999 2024-05-08T18:32:15.404 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.404 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.404 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 4", 2024-05-08T18:32:15.404 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.594920+0000", 2024-05-08T18:32:15.404 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00040058699999999999 2024-05-08T18:32:15.404 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.405 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.405 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:15.405 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.605419+0000", 2024-05-08T18:32:15.405 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010499338 2024-05-08T18:32:15.405 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.405 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.405 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:15.405 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.608968+0000", 2024-05-08T18:32:15.405 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0035482000000000001 2024-05-08T18:32:15.405 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.405 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.405 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:15.405 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.609072+0000", 2024-05-08T18:32:15.405 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010433300000000001 2024-05-08T18:32:15.406 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.406 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.406 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:15.406 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.609152+0000", 2024-05-08T18:32:15.406 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.9938999999999995e-05 2024-05-08T18:32:15.406 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:15.406 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:15.406 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:15.406 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.406 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.406 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1865 3.3f e93/21 3:ffe43b13:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_51:head v 93'5, mlcod=82'3)", 2024-05-08T18:32:15.407 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:01.052358+0000", 2024-05-08T18:32:15.407 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 14.260178336999999, 2024-05-08T18:32:15.407 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.026338456999999999, 2024-05-08T18:32:15.407 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:15.407 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:15.407 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:15.407 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:15.407 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.407 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:15.407 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.052358+0000", 2024-05-08T18:32:15.407 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:15.407 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.407 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.408 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:15.408 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.052358+0000", 2024-05-08T18:32:15.408 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:15.408 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.408 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.408 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:15.408 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.052360+0000", 2024-05-08T18:32:15.408 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.604e-06 2024-05-08T18:32:15.408 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.408 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.408 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:15.408 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.058761+0000", 2024-05-08T18:32:15.408 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0064009770000000004 2024-05-08T18:32:15.409 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.409 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.409 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:15.409 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.058816+0000", 2024-05-08T18:32:15.409 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.4413999999999998e-05 2024-05-08T18:32:15.409 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.409 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.409 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:15.409 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.058842+0000", 2024-05-08T18:32:15.409 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6063000000000001e-05 2024-05-08T18:32:15.409 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.409 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.409 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:15.410 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.059001+0000", 2024-05-08T18:32:15.410 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000159452 2024-05-08T18:32:15.410 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.410 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.410 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:15.410 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.059067+0000", 2024-05-08T18:32:15.410 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6079000000000002e-05 2024-05-08T18:32:15.410 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.410 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.410 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:15.410 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.078590+0000", 2024-05-08T18:32:15.410 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019522445999999999 2024-05-08T18:32:15.411 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.411 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.411 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:15.411 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.078696+0000", 2024-05-08T18:32:15.411 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010642200000000001 2024-05-08T18:32:15.411 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:15.411 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:15.411 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:15.411 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.411 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.411 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1869 3.35 3:ac4c2d5c:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_55:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:32:15.412 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:01.092235+0000", 2024-05-08T18:32:15.412 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 14.220300604, 2024-05-08T18:32:15.412 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.028692921, 2024-05-08T18:32:15.412 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:15.412 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:15.412 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:15.412 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:15.412 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:15.412 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:15.412 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1869 2024-05-08T18:32:15.412 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.412 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:15.412 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.413 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:15.413 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.092235+0000", 2024-05-08T18:32:15.413 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:15.413 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.413 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.413 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:15.413 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.092235+0000", 2024-05-08T18:32:15.413 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:15.413 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.413 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.413 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:15.413 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.092239+0000", 2024-05-08T18:32:15.414 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.143e-06 2024-05-08T18:32:15.414 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.414 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.414 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:15.414 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.099610+0000", 2024-05-08T18:32:15.414 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0073708410000000004 2024-05-08T18:32:15.414 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.414 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.414 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:15.414 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.099636+0000", 2024-05-08T18:32:15.414 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5354000000000002e-05 2024-05-08T18:32:15.414 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.414 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.415 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:15.415 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.099650+0000", 2024-05-08T18:32:15.415 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.3926e-05 2024-05-08T18:32:15.415 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.415 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.415 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:15.415 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.099935+0000", 2024-05-08T18:32:15.415 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00028528100000000002 2024-05-08T18:32:15.415 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.415 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.415 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:15.415 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.100371+0000", 2024-05-08T18:32:15.416 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00043653399999999998 2024-05-08T18:32:15.416 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.416 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.416 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 5", 2024-05-08T18:32:15.416 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.100635+0000", 2024-05-08T18:32:15.416 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00026408300000000003 2024-05-08T18:32:15.416 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.416 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.416 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:15.416 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.120504+0000", 2024-05-08T18:32:15.416 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019868061999999999 2024-05-08T18:32:15.416 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.416 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.417 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:15.417 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.120565+0000", 2024-05-08T18:32:15.417 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.1951000000000004e-05 2024-05-08T18:32:15.417 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.417 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.417 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:15.417 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.120691+0000", 2024-05-08T18:32:15.417 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000125687 2024-05-08T18:32:15.417 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.417 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.417 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:15.417 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.120928+0000", 2024-05-08T18:32:15.418 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00023705899999999999 2024-05-08T18:32:15.418 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:15.418 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:15.418 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:15.418 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.418 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.418 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1870 3.35 3:ae4fe6ec:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_56:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:32:15.418 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:01.102476+0000", 2024-05-08T18:32:15.418 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 14.210059828, 2024-05-08T18:32:15.418 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.026237963999999999, 2024-05-08T18:32:15.418 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:15.418 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:15.419 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:15.419 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:15.419 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:15.419 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:15.419 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1870 2024-05-08T18:32:15.419 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.419 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:15.419 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.419 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:15.419 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.102476+0000", 2024-05-08T18:32:15.419 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:15.419 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.419 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.420 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:15.420 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.102476+0000", 2024-05-08T18:32:15.420 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:15.420 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.420 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.420 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:15.420 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.102478+0000", 2024-05-08T18:32:15.420 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.1670000000000002e-06 2024-05-08T18:32:15.420 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.420 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.420 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:15.420 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.106606+0000", 2024-05-08T18:32:15.420 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0041281369999999996 2024-05-08T18:32:15.421 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.421 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.421 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:15.421 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.106630+0000", 2024-05-08T18:32:15.421 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3972999999999999e-05 2024-05-08T18:32:15.421 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.421 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.421 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:15.421 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.106643+0000", 2024-05-08T18:32:15.421 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.2167999999999999e-05 2024-05-08T18:32:15.421 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.421 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.422 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:15.422 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.112414+0000", 2024-05-08T18:32:15.422 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.005771712 2024-05-08T18:32:15.422 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.422 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.422 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:15.422 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.112627+0000", 2024-05-08T18:32:15.422 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00021261300000000001 2024-05-08T18:32:15.422 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.422 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.422 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 5", 2024-05-08T18:32:15.422 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.112854+0000", 2024-05-08T18:32:15.422 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022747800000000001 2024-05-08T18:32:15.423 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.423 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.423 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:15.423 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.123928+0000", 2024-05-08T18:32:15.423 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011074083 2024-05-08T18:32:15.423 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.423 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.423 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:15.423 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.128565+0000", 2024-05-08T18:32:15.423 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0046363619999999998 2024-05-08T18:32:15.423 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.423 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.423 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:15.424 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.128648+0000", 2024-05-08T18:32:15.424 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.2917999999999995e-05 2024-05-08T18:32:15.424 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.424 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.424 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:15.424 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.128714+0000", 2024-05-08T18:32:15.424 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.6353000000000007e-05 2024-05-08T18:32:15.424 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:15.424 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:15.424 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:15.424 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.424 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.424 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1880 3.2c 3:37adcf73:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_66:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:32:15.424 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:01.273251+0000", 2024-05-08T18:32:15.425 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 14.039284877, 2024-05-08T18:32:15.425 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.021420284000000001, 2024-05-08T18:32:15.425 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:15.425 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:15.425 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:15.425 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:15.425 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:15.425 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:15.425 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1880 2024-05-08T18:32:15.425 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.425 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:15.425 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.425 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:15.426 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.273251+0000", 2024-05-08T18:32:15.426 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:15.426 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.426 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.426 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:15.426 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.273251+0000", 2024-05-08T18:32:15.426 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:15.426 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.426 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.426 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:15.426 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.273254+0000", 2024-05-08T18:32:15.426 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8200000000000001e-06 2024-05-08T18:32:15.427 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.427 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.427 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:15.427 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.277791+0000", 2024-05-08T18:32:15.427 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0045372520000000003 2024-05-08T18:32:15.427 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.427 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.427 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:15.427 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.277828+0000", 2024-05-08T18:32:15.427 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.6882999999999999e-05 2024-05-08T18:32:15.427 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.427 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.427 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:15.427 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.277854+0000", 2024-05-08T18:32:15.428 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6063000000000001e-05 2024-05-08T18:32:15.428 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.428 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.428 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:15.428 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.277947+0000", 2024-05-08T18:32:15.428 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.3367000000000002e-05 2024-05-08T18:32:15.428 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.428 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.428 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:15.428 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.278063+0000", 2024-05-08T18:32:15.428 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011535399999999999 2024-05-08T18:32:15.428 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.429 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.429 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 4", 2024-05-08T18:32:15.429 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.278162+0000", 2024-05-08T18:32:15.429 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.9463999999999995e-05 2024-05-08T18:32:15.429 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.429 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.429 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:15.429 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.284604+0000", 2024-05-08T18:32:15.429 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0064413109999999999 2024-05-08T18:32:15.429 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.429 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.429 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:15.429 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.294593+0000", 2024-05-08T18:32:15.429 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0099896640000000005 2024-05-08T18:32:15.430 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.430 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.430 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:15.430 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.294637+0000", 2024-05-08T18:32:15.430 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3640999999999998e-05 2024-05-08T18:32:15.430 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.430 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.430 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:15.430 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.294671+0000", 2024-05-08T18:32:15.430 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.4465000000000003e-05 2024-05-08T18:32:15.430 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:15.430 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:15.431 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:15.431 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.431 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.431 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1907 3.34 e93/21 3:2f5137c7:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_93:head v 93'5, mlcod=84'3)", 2024-05-08T18:32:15.431 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:01.836973+0000", 2024-05-08T18:32:15.431 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 13.475562868000001, 2024-05-08T18:32:15.431 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.025279401999999999, 2024-05-08T18:32:15.431 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:15.431 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:15.431 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:15.431 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:15.431 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.431 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:15.432 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.836973+0000", 2024-05-08T18:32:15.432 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:15.432 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.432 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.432 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:15.432 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.836973+0000", 2024-05-08T18:32:15.432 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:15.432 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.432 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.432 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:15.432 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.836976+0000", 2024-05-08T18:32:15.432 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5399999999999998e-06 2024-05-08T18:32:15.432 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.433 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.433 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:15.433 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.840092+0000", 2024-05-08T18:32:15.433 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0031165899999999998 2024-05-08T18:32:15.433 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.433 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.433 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:15.433 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.840132+0000", 2024-05-08T18:32:15.433 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9922999999999997e-05 2024-05-08T18:32:15.433 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.433 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.433 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:15.434 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.840151+0000", 2024-05-08T18:32:15.434 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9046999999999999e-05 2024-05-08T18:32:15.434 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.434 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.434 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:15.434 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.840313+0000", 2024-05-08T18:32:15.434 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016207099999999999 2024-05-08T18:32:15.434 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.434 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.434 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:15.434 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.840383+0000", 2024-05-08T18:32:15.434 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0129999999999994e-05 2024-05-08T18:32:15.434 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.435 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.435 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:15.435 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.862123+0000", 2024-05-08T18:32:15.435 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.021740038 2024-05-08T18:32:15.435 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.435 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.435 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:15.435 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.862252+0000", 2024-05-08T18:32:15.435 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012906300000000001 2024-05-08T18:32:15.435 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:15.435 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:15.435 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:15.436 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.436 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.436 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1922 3.10 3:08161f34:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_108:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:32:15.436 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:02.062130+0000", 2024-05-08T18:32:15.436 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 13.250405581000001, 2024-05-08T18:32:15.436 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.020646504999999999, 2024-05-08T18:32:15.436 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:15.436 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:15.436 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:15.436 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:15.436 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:15.436 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:15.436 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1922 2024-05-08T18:32:15.437 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.437 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:15.437 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.437 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:15.437 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.062130+0000", 2024-05-08T18:32:15.437 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:15.437 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.437 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.437 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:15.437 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.062130+0000", 2024-05-08T18:32:15.437 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:15.437 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.437 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.438 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:15.438 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.062134+0000", 2024-05-08T18:32:15.438 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0969999999999999e-06 2024-05-08T18:32:15.438 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.438 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.438 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:15.438 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.068395+0000", 2024-05-08T18:32:15.438 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.006260336 2024-05-08T18:32:15.438 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.438 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.438 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:15.438 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.068435+0000", 2024-05-08T18:32:15.438 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0453e-05 2024-05-08T18:32:15.438 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.439 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.439 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:15.439 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.068456+0000", 2024-05-08T18:32:15.439 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0686000000000002e-05 2024-05-08T18:32:15.439 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.439 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.439 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:15.439 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.068554+0000", 2024-05-08T18:32:15.439 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.8006999999999999e-05 2024-05-08T18:32:15.439 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.439 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.439 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:15.439 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.068735+0000", 2024-05-08T18:32:15.439 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00018081400000000001 2024-05-08T18:32:15.440 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.440 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.440 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:32:15.440 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.068912+0000", 2024-05-08T18:32:15.440 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00017739399999999999 2024-05-08T18:32:15.440 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.440 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.440 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:15.440 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.078319+0000", 2024-05-08T18:32:15.440 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0094067339999999999 2024-05-08T18:32:15.440 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.440 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.440 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:15.441 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.082607+0000", 2024-05-08T18:32:15.441 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0042881250000000003 2024-05-08T18:32:15.441 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.441 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.441 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:15.441 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.082708+0000", 2024-05-08T18:32:15.441 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000100649 2024-05-08T18:32:15.441 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.441 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.441 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:15.441 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:02.082777+0000", 2024-05-08T18:32:15.441 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9209999999999996e-05 2024-05-08T18:32:15.441 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:15.441 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:15.442 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:15.442 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:15.442 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:15.442 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:32:15.443 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-08T18:32:15.571 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:32:15.571 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:32:15.571 INFO:teuthology.orchestra.run.smithi151.stdout: "num_ops": 0 2024-05-08T18:32:15.571 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:32:15.585 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-08T18:32:15.702 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:32:15.702 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [], 2024-05-08T18:32:15.702 INFO:teuthology.orchestra.run.smithi151.stdout: "complaint_time": 30, 2024-05-08T18:32:15.702 INFO:teuthology.orchestra.run.smithi151.stdout: "num_blocked_ops": 0 2024-05-08T18:32:15.702 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:32:15.716 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-08T18:32:15.790 INFO:teuthology.orchestra.run.smithi097.stderr:nodeep-scrub is set 2024-05-08T18:32:15.844 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T18:32:15.844 INFO:teuthology.orchestra.run.smithi151.stdout: "size": 20, 2024-05-08T18:32:15.845 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 600, 2024-05-08T18:32:15.845 INFO:teuthology.orchestra.run.smithi151.stdout: "ops": [ 2024-05-08T18:32:15.845 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.845 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:32:15.845 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.248003+0000", 2024-05-08T18:32:15.845 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 168.59419082900001, 2024-05-08T18:32:15.845 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.020859638999999999, 2024-05-08T18:32:15.845 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:15.845 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:15.845 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:15.845 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:15.846 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:32:15.846 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:32:15.846 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 50 2024-05-08T18:32:15.846 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.846 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:15.846 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.846 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:15.846 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248003+0000", 2024-05-08T18:32:15.847 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:15.847 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.847 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.847 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:15.847 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248003+0000", 2024-05-08T18:32:15.847 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:15.847 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.847 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.847 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:15.847 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248004+0000", 2024-05-08T18:32:15.847 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5300000000000003e-07 2024-05-08T18:32:15.847 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.848 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.848 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:15.848 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248139+0000", 2024-05-08T18:32:15.848 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000135193 2024-05-08T18:32:15.848 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.848 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.848 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:15.848 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248151+0000", 2024-05-08T18:32:15.848 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.19e-05 2024-05-08T18:32:15.848 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.848 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.848 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:15.849 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248161+0000", 2024-05-08T18:32:15.849 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.4599999999999992e-06 2024-05-08T18:32:15.849 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.849 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.849 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:15.849 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.263961+0000", 2024-05-08T18:32:15.849 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015800844000000001 2024-05-08T18:32:15.849 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.849 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.849 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:15.849 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.264091+0000", 2024-05-08T18:32:15.849 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012952300000000001 2024-05-08T18:32:15.850 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.850 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.850 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:32:15.850 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.264306+0000", 2024-05-08T18:32:15.850 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000215541 2024-05-08T18:32:15.850 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.850 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.850 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:15.850 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.267205+0000", 2024-05-08T18:32:15.850 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0028989910000000001 2024-05-08T18:32:15.850 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.850 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.851 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:15.851 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.268631+0000", 2024-05-08T18:32:15.851 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0014257320000000001 2024-05-08T18:32:15.851 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.851 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.851 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:15.851 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.268781+0000", 2024-05-08T18:32:15.851 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000149939 2024-05-08T18:32:15.851 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.851 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.851 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:15.851 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.268863+0000", 2024-05-08T18:32:15.851 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1762999999999996e-05 2024-05-08T18:32:15.852 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:15.852 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:15.852 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:15.852 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.852 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.852 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:32:15.852 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.248201+0000", 2024-05-08T18:32:15.852 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 168.593993074, 2024-05-08T18:32:15.852 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.022909783, 2024-05-08T18:32:15.852 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:15.852 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:15.852 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:15.853 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:15.853 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:32:15.853 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:32:15.853 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 51 2024-05-08T18:32:15.853 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.853 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:15.853 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.853 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:15.853 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248201+0000", 2024-05-08T18:32:15.853 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:15.853 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.853 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.853 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:15.853 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248201+0000", 2024-05-08T18:32:15.854 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:15.854 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.854 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.854 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:15.854 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248202+0000", 2024-05-08T18:32:15.854 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.2999999999999999e-07 2024-05-08T18:32:15.854 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.854 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.854 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:15.854 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248209+0000", 2024-05-08T18:32:15.854 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5769999999999996e-06 2024-05-08T18:32:15.855 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.855 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.855 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:15.855 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248221+0000", 2024-05-08T18:32:15.855 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1165999999999999e-05 2024-05-08T18:32:15.855 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.855 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.855 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:15.855 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248229+0000", 2024-05-08T18:32:15.855 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1529999999999997e-06 2024-05-08T18:32:15.855 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.855 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.855 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:15.855 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.265146+0000", 2024-05-08T18:32:15.856 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.016917492999999999 2024-05-08T18:32:15.856 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.856 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.856 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:15.856 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.265282+0000", 2024-05-08T18:32:15.856 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013597199999999999 2024-05-08T18:32:15.856 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.856 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.856 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:32:15.856 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.265488+0000", 2024-05-08T18:32:15.856 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000206212 2024-05-08T18:32:15.856 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.856 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.857 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:15.857 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.268442+0000", 2024-05-08T18:32:15.857 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.002953841 2024-05-08T18:32:15.857 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.857 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.857 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:15.857 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.270951+0000", 2024-05-08T18:32:15.857 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0025085670000000002 2024-05-08T18:32:15.857 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.857 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.857 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:15.857 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.271042+0000", 2024-05-08T18:32:15.858 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.1485999999999998e-05 2024-05-08T18:32:15.858 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.858 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.858 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:15.858 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.271111+0000", 2024-05-08T18:32:15.858 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.8386000000000006e-05 2024-05-08T18:32:15.858 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:15.858 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:15.858 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:15.858 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.858 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.858 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4206.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-08T18:32:15.859 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:29:27.248244+0000", 2024-05-08T18:32:15.859 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 168.59395051800001, 2024-05-08T18:32:15.859 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.023010806000000002, 2024-05-08T18:32:15.859 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:15.859 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:15.859 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:15.859 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:15.859 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4206", 2024-05-08T18:32:15.859 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/2450111859", 2024-05-08T18:32:15.859 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 52 2024-05-08T18:32:15.859 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.859 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:15.860 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.860 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:15.860 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248244+0000", 2024-05-08T18:32:15.860 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:15.860 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.860 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.860 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:15.860 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248244+0000", 2024-05-08T18:32:15.860 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:15.860 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.860 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.860 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:15.861 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248244+0000", 2024-05-08T18:32:15.861 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.0999999999999998e-07 2024-05-08T18:32:15.861 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.861 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.861 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:15.861 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248251+0000", 2024-05-08T18:32:15.861 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.9639999999999997e-06 2024-05-08T18:32:15.861 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.861 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.861 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:15.861 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248266+0000", 2024-05-08T18:32:15.861 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.4996e-05 2024-05-08T18:32:15.861 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.862 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.862 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:15.862 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.248274+0000", 2024-05-08T18:32:15.862 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.8299999999999996e-06 2024-05-08T18:32:15.862 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.862 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.862 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:15.862 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266367+0000", 2024-05-08T18:32:15.862 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018092607 2024-05-08T18:32:15.862 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.862 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.862 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:15.863 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266532+0000", 2024-05-08T18:32:15.863 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016569600000000001 2024-05-08T18:32:15.863 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.863 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.863 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 0", 2024-05-08T18:32:15.863 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.266729+0000", 2024-05-08T18:32:15.863 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00019630099999999999 2024-05-08T18:32:15.863 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.863 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.863 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:15.863 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.268574+0000", 2024-05-08T18:32:15.863 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0018452329999999999 2024-05-08T18:32:15.863 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.863 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.864 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:15.864 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.271128+0000", 2024-05-08T18:32:15.864 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00255369 2024-05-08T18:32:15.864 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.864 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.865 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:15.865 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.271199+0000", 2024-05-08T18:32:15.865 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.1712999999999996e-05 2024-05-08T18:32:15.865 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.865 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.865 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:15.865 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:29:27.271254+0000", 2024-05-08T18:32:15.865 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.5065999999999998e-05 2024-05-08T18:32:15.866 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:15.866 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:15.866 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:15.866 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.866 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.866 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1317 3.2d 3:b70e9396:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-08T18:32:15.866 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.323924+0000", 2024-05-08T18:32:15.866 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 33.518269754999999, 2024-05-08T18:32:15.866 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.027663854000000002, 2024-05-08T18:32:15.866 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:15.866 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:15.866 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:15.867 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:15.867 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:15.867 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:15.867 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1317 2024-05-08T18:32:15.867 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.867 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:15.867 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.867 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:15.867 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.323924+0000", 2024-05-08T18:32:15.867 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:15.867 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.867 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.868 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:15.868 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.323924+0000", 2024-05-08T18:32:15.868 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:15.868 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.868 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.868 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:15.868 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.323928+0000", 2024-05-08T18:32:15.868 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2329999999999998e-06 2024-05-08T18:32:15.868 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.868 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.868 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:15.868 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.330311+0000", 2024-05-08T18:32:15.868 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0063831290000000004 2024-05-08T18:32:15.868 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.869 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.869 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:15.869 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.330352+0000", 2024-05-08T18:32:15.869 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1162000000000003e-05 2024-05-08T18:32:15.869 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.869 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.869 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:15.869 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.330370+0000", 2024-05-08T18:32:15.869 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8050000000000002e-05 2024-05-08T18:32:15.869 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.869 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.870 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:15.870 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.330516+0000", 2024-05-08T18:32:15.870 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000146432 2024-05-08T18:32:15.870 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.870 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.870 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:15.870 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.330769+0000", 2024-05-08T18:32:15.870 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00025228499999999999 2024-05-08T18:32:15.870 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.870 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.870 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-05-08T18:32:15.870 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.330984+0000", 2024-05-08T18:32:15.871 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00021582200000000001 2024-05-08T18:32:15.871 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.871 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.871 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:15.871 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.345755+0000", 2024-05-08T18:32:15.871 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.014770521999999999 2024-05-08T18:32:15.871 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.871 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.871 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:15.871 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.351319+0000", 2024-05-08T18:32:15.871 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0055641650000000003 2024-05-08T18:32:15.871 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.872 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.872 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:15.872 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.351468+0000", 2024-05-08T18:32:15.872 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014938500000000001 2024-05-08T18:32:15.872 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.872 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.872 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:15.872 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.351588+0000", 2024-05-08T18:32:15.872 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000119669 2024-05-08T18:32:15.872 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:15.872 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:15.872 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:15.872 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.873 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.873 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1320 3.37 3:ee001392:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-08T18:32:15.873 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.373350+0000", 2024-05-08T18:32:15.873 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 33.468843663999998, 2024-05-08T18:32:15.873 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.021273095999999998, 2024-05-08T18:32:15.873 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:15.873 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:15.873 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:15.873 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:15.873 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:15.873 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:15.873 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1320 2024-05-08T18:32:15.874 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.874 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:15.874 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.874 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:15.874 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.373350+0000", 2024-05-08T18:32:15.874 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:15.874 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.874 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.874 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:15.874 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.373350+0000", 2024-05-08T18:32:15.874 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:15.874 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.874 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.875 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:15.875 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.373354+0000", 2024-05-08T18:32:15.875 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7960000000000002e-06 2024-05-08T18:32:15.875 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.875 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.875 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:15.875 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.377339+0000", 2024-05-08T18:32:15.875 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039847839999999999 2024-05-08T18:32:15.875 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.875 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.875 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:15.875 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.377378+0000", 2024-05-08T18:32:15.875 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9110000000000003e-05 2024-05-08T18:32:15.876 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.876 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.876 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:15.876 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.377397+0000", 2024-05-08T18:32:15.876 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8943000000000001e-05 2024-05-08T18:32:15.876 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.876 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.876 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:15.876 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.377531+0000", 2024-05-08T18:32:15.876 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000134339 2024-05-08T18:32:15.876 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.876 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.877 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:15.877 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.377782+0000", 2024-05-08T18:32:15.877 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000250802 2024-05-08T18:32:15.877 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.877 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.877 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 5", 2024-05-08T18:32:15.877 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.378007+0000", 2024-05-08T18:32:15.877 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00022504799999999999 2024-05-08T18:32:15.877 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.877 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.877 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:15.877 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.385156+0000", 2024-05-08T18:32:15.877 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0071491760000000001 2024-05-08T18:32:15.878 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.878 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.878 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:15.878 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.394443+0000", 2024-05-08T18:32:15.878 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0092870130000000002 2024-05-08T18:32:15.878 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.878 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.878 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:15.878 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.394540+0000", 2024-05-08T18:32:15.878 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6708999999999999e-05 2024-05-08T18:32:15.878 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.879 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.879 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:15.879 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.394623+0000", 2024-05-08T18:32:15.879 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3375999999999996e-05 2024-05-08T18:32:15.879 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:15.879 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:15.879 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:15.879 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.879 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.879 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1322 3.f 3:f3016725:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-08T18:32:15.879 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.399465+0000", 2024-05-08T18:32:15.880 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 33.442729397999997, 2024-05-08T18:32:15.880 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.022350351000000001, 2024-05-08T18:32:15.880 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:15.880 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:15.880 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:15.880 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:15.880 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:15.880 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:15.880 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1322 2024-05-08T18:32:15.880 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.880 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:15.880 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.880 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:15.881 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.399465+0000", 2024-05-08T18:32:15.881 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:15.881 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.881 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.881 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:15.881 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.399465+0000", 2024-05-08T18:32:15.881 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:15.881 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.881 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.881 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:15.881 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.399468+0000", 2024-05-08T18:32:15.882 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.7740000000000002e-06 2024-05-08T18:32:15.882 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.882 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.882 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:15.882 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.403500+0000", 2024-05-08T18:32:15.882 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0040316900000000001 2024-05-08T18:32:15.882 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.882 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.882 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:15.882 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.403550+0000", 2024-05-08T18:32:15.882 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9869e-05 2024-05-08T18:32:15.882 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.882 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.883 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:15.883 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.403576+0000", 2024-05-08T18:32:15.883 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5780000000000001e-05 2024-05-08T18:32:15.883 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.883 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.883 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:15.883 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.403741+0000", 2024-05-08T18:32:15.883 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016564499999999999 2024-05-08T18:32:15.883 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.883 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.883 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:15.883 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.403991+0000", 2024-05-08T18:32:15.884 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00024923799999999999 2024-05-08T18:32:15.884 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.884 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.884 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 4", 2024-05-08T18:32:15.884 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.404231+0000", 2024-05-08T18:32:15.884 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000240535 2024-05-08T18:32:15.884 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.884 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.884 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:15.884 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.415279+0000", 2024-05-08T18:32:15.884 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011048254 2024-05-08T18:32:15.885 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.885 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.885 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:15.885 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.421627+0000", 2024-05-08T18:32:15.885 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0063480050000000003 2024-05-08T18:32:15.885 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.885 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.885 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:15.885 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.421724+0000", 2024-05-08T18:32:15.885 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.6911999999999996e-05 2024-05-08T18:32:15.885 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.885 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.885 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:15.886 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.421815+0000", 2024-05-08T18:32:15.886 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.0649000000000006e-05 2024-05-08T18:32:15.886 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:15.886 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:15.886 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:15.886 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.886 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.886 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1328 3.14 e81/21 3:2b0d89be:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_14:head v 81'1, mlcod=0'0)", 2024-05-08T18:32:15.886 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.480334+0000", 2024-05-08T18:32:15.886 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 33.361859817000003, 2024-05-08T18:32:15.886 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.02475223, 2024-05-08T18:32:15.886 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:15.886 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:15.887 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:15.887 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:15.887 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.887 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:15.887 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.480334+0000", 2024-05-08T18:32:15.887 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:15.887 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.887 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.887 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:15.887 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.480334+0000", 2024-05-08T18:32:15.887 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:15.887 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.887 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.888 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:15.888 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.480338+0000", 2024-05-08T18:32:15.888 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.5999999999999998e-06 2024-05-08T18:32:15.888 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.888 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.888 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:15.888 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.483911+0000", 2024-05-08T18:32:15.888 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0035727269999999999 2024-05-08T18:32:15.888 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.888 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.888 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:15.888 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.483964+0000", 2024-05-08T18:32:15.888 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3766e-05 2024-05-08T18:32:15.888 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.889 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.889 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:15.889 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.483991+0000", 2024-05-08T18:32:15.889 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6386000000000001e-05 2024-05-08T18:32:15.889 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.889 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.889 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:15.889 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.484195+0000", 2024-05-08T18:32:15.889 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00020458600000000001 2024-05-08T18:32:15.889 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.889 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.889 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:15.889 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.484237+0000", 2024-05-08T18:32:15.890 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.1912000000000001e-05 2024-05-08T18:32:15.890 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.890 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.890 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:15.890 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.504965+0000", 2024-05-08T18:32:15.890 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.020728024000000001 2024-05-08T18:32:15.890 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.890 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.890 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:15.890 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.505086+0000", 2024-05-08T18:32:15.890 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000121229 2024-05-08T18:32:15.890 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:15.891 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:15.891 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:15.891 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.891 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.891 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1334 3.f 3:f1b2aee4:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_20:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-08T18:32:15.891 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.534497+0000", 2024-05-08T18:32:15.891 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 33.307697455000003, 2024-05-08T18:32:15.891 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.022526750000000002, 2024-05-08T18:32:15.891 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:15.891 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:15.891 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:15.891 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:15.892 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:15.892 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:15.892 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1334 2024-05-08T18:32:15.892 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.892 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:15.892 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.892 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:15.892 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.534497+0000", 2024-05-08T18:32:15.892 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:15.892 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.892 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.892 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:15.892 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.534497+0000", 2024-05-08T18:32:15.893 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:15.893 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.893 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.893 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:15.893 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.534501+0000", 2024-05-08T18:32:15.893 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.9299999999999996e-06 2024-05-08T18:32:15.893 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.893 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.893 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:15.893 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.539860+0000", 2024-05-08T18:32:15.893 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0053598630000000003 2024-05-08T18:32:15.893 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.894 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.894 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:15.894 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.539899+0000", 2024-05-08T18:32:15.894 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8973000000000001e-05 2024-05-08T18:32:15.894 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.894 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.894 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:15.894 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.539919+0000", 2024-05-08T18:32:15.894 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.963e-05 2024-05-08T18:32:15.894 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.894 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.894 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:15.894 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.540078+0000", 2024-05-08T18:32:15.895 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015917199999999999 2024-05-08T18:32:15.895 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.895 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.895 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:15.895 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.540381+0000", 2024-05-08T18:32:15.895 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00030268100000000001 2024-05-08T18:32:15.895 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.895 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.895 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 4", 2024-05-08T18:32:15.895 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.540686+0000", 2024-05-08T18:32:15.895 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00030511399999999999 2024-05-08T18:32:15.895 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.895 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.896 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:15.896 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.549808+0000", 2024-05-08T18:32:15.896 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0091219679999999994 2024-05-08T18:32:15.896 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.896 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.896 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:15.896 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.556737+0000", 2024-05-08T18:32:15.896 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0069289850000000004 2024-05-08T18:32:15.896 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.896 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.897 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:15.897 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.556904+0000", 2024-05-08T18:32:15.897 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016715499999999999 2024-05-08T18:32:15.897 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.897 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.897 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:15.897 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.557023+0000", 2024-05-08T18:32:15.897 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011927899999999999 2024-05-08T18:32:15.897 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:15.897 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:15.897 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:15.897 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.898 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.898 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1357 3.f 3:f2d0b7b2:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.4__shadow_.46R6Qjrzqwu5NuYURo3JcksS-JNP1xp_43:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-05-08T18:32:15.898 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:42.781836+0000", 2024-05-08T18:32:15.898 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 33.060358162, 2024-05-08T18:32:15.898 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.022799851999999999, 2024-05-08T18:32:15.898 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:15.898 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:15.898 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:15.898 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:15.898 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:15.898 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:15.898 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1357 2024-05-08T18:32:15.899 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.899 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:15.899 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.899 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:15.899 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.781836+0000", 2024-05-08T18:32:15.899 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:15.899 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.899 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.899 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:15.899 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.781836+0000", 2024-05-08T18:32:15.899 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:15.899 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.899 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.900 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:15.900 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.781839+0000", 2024-05-08T18:32:15.900 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.864e-06 2024-05-08T18:32:15.900 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.900 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.900 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:15.900 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.785867+0000", 2024-05-08T18:32:15.900 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0040287459999999997 2024-05-08T18:32:15.900 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.900 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.900 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:15.900 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.785906+0000", 2024-05-08T18:32:15.900 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8606000000000003e-05 2024-05-08T18:32:15.901 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.901 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.901 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:15.901 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.785926+0000", 2024-05-08T18:32:15.901 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.0137e-05 2024-05-08T18:32:15.901 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.901 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.901 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:15.901 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.786061+0000", 2024-05-08T18:32:15.901 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013521200000000001 2024-05-08T18:32:15.901 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.901 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.901 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:15.902 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.786333+0000", 2024-05-08T18:32:15.902 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000271215 2024-05-08T18:32:15.902 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.902 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.902 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 4", 2024-05-08T18:32:15.902 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.786608+0000", 2024-05-08T18:32:15.902 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00027538699999999998 2024-05-08T18:32:15.902 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.902 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.902 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:15.902 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.804208+0000", 2024-05-08T18:32:15.903 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.017599674999999999 2024-05-08T18:32:15.903 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.903 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.903 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:15.903 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.804331+0000", 2024-05-08T18:32:15.903 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00012313600000000001 2024-05-08T18:32:15.903 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.903 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.903 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:15.903 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.804495+0000", 2024-05-08T18:32:15.903 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000164592 2024-05-08T18:32:15.903 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.903 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.904 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:15.904 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:42.804636+0000", 2024-05-08T18:32:15.904 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014028200000000001 2024-05-08T18:32:15.904 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:15.904 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:15.904 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:15.904 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.904 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.904 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1614 3.14 e83/21 3:284b5d90:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_2:head v 83'7, mlcod=82'5)", 2024-05-08T18:32:15.904 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:46.716647+0000", 2024-05-08T18:32:15.904 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 29.125547369, 2024-05-08T18:32:15.905 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.024320554000000001, 2024-05-08T18:32:15.905 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:15.905 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:15.905 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:15.905 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:15.905 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.905 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:15.905 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.716647+0000", 2024-05-08T18:32:15.905 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:15.905 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.905 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.905 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:15.905 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.716647+0000", 2024-05-08T18:32:15.906 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:15.906 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.906 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.906 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:15.906 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.716648+0000", 2024-05-08T18:32:15.906 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.3699999999999999e-07 2024-05-08T18:32:15.906 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.906 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.906 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:15.906 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.721652+0000", 2024-05-08T18:32:15.906 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0050045360000000004 2024-05-08T18:32:15.906 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.907 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.907 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:15.907 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.721711+0000", 2024-05-08T18:32:15.907 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.9419000000000001e-05 2024-05-08T18:32:15.907 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.907 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.907 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:15.907 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.721740+0000", 2024-05-08T18:32:15.907 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8707000000000001e-05 2024-05-08T18:32:15.907 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.907 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.907 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:15.907 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.721978+0000", 2024-05-08T18:32:15.908 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00023769500000000001 2024-05-08T18:32:15.908 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.908 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.908 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:15.908 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.722054+0000", 2024-05-08T18:32:15.908 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6441999999999998e-05 2024-05-08T18:32:15.908 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.908 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.908 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:15.908 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.740830+0000", 2024-05-08T18:32:15.908 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.018775399000000002 2024-05-08T18:32:15.908 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.909 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.909 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:15.909 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.740967+0000", 2024-05-08T18:32:15.909 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013751900000000001 2024-05-08T18:32:15.909 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:15.909 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:15.909 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:15.909 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.909 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.909 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_repop(client.4400.0:1616 3.7 e83/21 3:e2c69de8:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_4:head v 83'5, mlcod=82'3)", 2024-05-08T18:32:15.909 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:46.731352+0000", 2024-05-08T18:32:15.909 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 29.110842522999999, 2024-05-08T18:32:15.910 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.021059544999999999, 2024-05-08T18:32:15.910 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:15.910 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:15.910 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:15.910 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:15.910 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.910 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:15.910 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.731352+0000", 2024-05-08T18:32:15.910 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:15.910 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.910 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.910 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:15.911 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.731352+0000", 2024-05-08T18:32:15.911 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:15.911 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.911 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.911 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:15.911 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.731354+0000", 2024-05-08T18:32:15.911 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.897e-06 2024-05-08T18:32:15.911 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.911 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.911 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:15.911 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.737876+0000", 2024-05-08T18:32:15.912 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0065220499999999997 2024-05-08T18:32:15.912 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.912 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.912 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:15.912 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.737915+0000", 2024-05-08T18:32:15.912 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8575999999999998e-05 2024-05-08T18:32:15.912 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.912 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.912 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:15.912 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.737939+0000", 2024-05-08T18:32:15.912 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.3799999999999999e-05 2024-05-08T18:32:15.912 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.912 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.912 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:15.913 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.738108+0000", 2024-05-08T18:32:15.913 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000168753 2024-05-08T18:32:15.913 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.913 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.913 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:15.913 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.738150+0000", 2024-05-08T18:32:15.913 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.2222999999999999e-05 2024-05-08T18:32:15.913 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.913 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.913 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:15.913 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.752280+0000", 2024-05-08T18:32:15.913 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.01413 2024-05-08T18:32:15.913 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.914 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.914 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:15.914 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.752411+0000", 2024-05-08T18:32:15.914 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013124600000000001 2024-05-08T18:32:15.914 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:15.914 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:15.914 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:15.914 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.914 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.914 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1620 3.e 3:7209acbb:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-05-08T18:32:15.914 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:46.773106+0000", 2024-05-08T18:32:15.914 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 29.069088337, 2024-05-08T18:32:15.914 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.02423749, 2024-05-08T18:32:15.915 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:15.915 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:15.915 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:15.915 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:15.915 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:15.915 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:15.915 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1620 2024-05-08T18:32:15.915 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.915 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:15.915 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.915 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:15.915 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.773106+0000", 2024-05-08T18:32:15.916 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:15.916 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.916 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.916 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:15.916 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.773106+0000", 2024-05-08T18:32:15.916 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:15.916 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.916 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.916 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:15.916 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.773110+0000", 2024-05-08T18:32:15.916 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.07e-06 2024-05-08T18:32:15.916 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.916 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.916 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:15.917 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.778353+0000", 2024-05-08T18:32:15.917 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0052432199999999998 2024-05-08T18:32:15.917 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.917 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.917 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:15.917 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.778407+0000", 2024-05-08T18:32:15.917 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 5.3792999999999998e-05 2024-05-08T18:32:15.917 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.917 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.917 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:15.917 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.778426+0000", 2024-05-08T18:32:15.917 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.9476000000000001e-05 2024-05-08T18:32:15.918 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.918 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.918 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:15.918 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.778583+0000", 2024-05-08T18:32:15.918 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000156489 2024-05-08T18:32:15.918 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.918 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.918 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:15.918 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.778844+0000", 2024-05-08T18:32:15.918 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00026110499999999997 2024-05-08T18:32:15.918 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.918 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.918 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 4", 2024-05-08T18:32:15.919 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.779084+0000", 2024-05-08T18:32:15.919 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000240621 2024-05-08T18:32:15.919 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.919 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.919 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:15.919 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.791772+0000", 2024-05-08T18:32:15.919 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.012687855 2024-05-08T18:32:15.919 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.919 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.919 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:15.919 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.797162+0000", 2024-05-08T18:32:15.919 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0053901419999999997 2024-05-08T18:32:15.919 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.919 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.920 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:15.920 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.797263+0000", 2024-05-08T18:32:15.920 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010066299999999999 2024-05-08T18:32:15.920 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.920 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.920 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:15.920 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.797343+0000", 2024-05-08T18:32:15.920 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.0055999999999994e-05 2024-05-08T18:32:15.920 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:15.920 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:15.920 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:15.920 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.920 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.921 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1622 3.11 3:8a36e97a:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-05-08T18:32:15.921 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:46.790971+0000", 2024-05-08T18:32:15.921 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 29.051222779, 2024-05-08T18:32:15.921 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.026781425000000001, 2024-05-08T18:32:15.921 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:15.921 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:15.921 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:15.921 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:15.921 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:15.921 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:15.921 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1622 2024-05-08T18:32:15.922 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.922 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:15.922 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.922 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:15.922 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.790971+0000", 2024-05-08T18:32:15.922 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:15.922 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.922 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.922 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:15.922 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.790971+0000", 2024-05-08T18:32:15.922 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:15.922 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.923 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.923 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:15.923 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.790974+0000", 2024-05-08T18:32:15.923 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.6860000000000002e-06 2024-05-08T18:32:15.923 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.923 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.923 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:15.923 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.796777+0000", 2024-05-08T18:32:15.923 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0058027269999999997 2024-05-08T18:32:15.923 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.923 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.923 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:15.923 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.796820+0000", 2024-05-08T18:32:15.923 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.3439999999999997e-05 2024-05-08T18:32:15.924 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.924 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.924 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:15.924 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.796840+0000", 2024-05-08T18:32:15.924 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.942e-05 2024-05-08T18:32:15.924 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.924 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.924 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:15.924 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.797010+0000", 2024-05-08T18:32:15.924 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016999199999999999 2024-05-08T18:32:15.924 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.924 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.924 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:15.925 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.797333+0000", 2024-05-08T18:32:15.925 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00032329400000000001 2024-05-08T18:32:15.925 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.925 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.925 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 4", 2024-05-08T18:32:15.925 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.797605+0000", 2024-05-08T18:32:15.925 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00027210800000000002 2024-05-08T18:32:15.925 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.925 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.925 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:15.925 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.817018+0000", 2024-05-08T18:32:15.925 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.019413079999999999 2024-05-08T18:32:15.926 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.926 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.926 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:15.926 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.817574+0000", 2024-05-08T18:32:15.926 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00055607599999999997 2024-05-08T18:32:15.926 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.926 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.926 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:15.926 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.817678+0000", 2024-05-08T18:32:15.926 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00010399300000000001 2024-05-08T18:32:15.926 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.926 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.927 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:15.927 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.817753+0000", 2024-05-08T18:32:15.927 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.4609000000000003e-05 2024-05-08T18:32:15.927 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:15.927 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:15.927 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:15.927 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.927 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.927 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1633 3.15 3:ab226f54:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.5__shadow_.OJL1ixYdFP9fZ3MWFDAX8AaiklpAJOb_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e83)", 2024-05-08T18:32:15.927 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:31:46.914872+0000", 2024-05-08T18:32:15.927 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 28.927321725999999, 2024-05-08T18:32:15.927 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.028767053000000001, 2024-05-08T18:32:15.928 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:15.928 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:15.928 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:15.928 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:15.928 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:15.928 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:15.928 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1633 2024-05-08T18:32:15.928 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.928 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:15.928 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.928 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:15.928 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.914872+0000", 2024-05-08T18:32:15.928 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:15.928 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.929 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.929 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:15.929 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.914872+0000", 2024-05-08T18:32:15.929 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:15.929 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.929 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.929 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:15.929 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.914877+0000", 2024-05-08T18:32:15.929 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8160000000000001e-06 2024-05-08T18:32:15.929 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.929 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.929 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:15.930 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.919320+0000", 2024-05-08T18:32:15.930 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0044431870000000004 2024-05-08T18:32:15.930 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.930 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.930 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:15.930 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.919359+0000", 2024-05-08T18:32:15.930 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8572999999999998e-05 2024-05-08T18:32:15.930 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.930 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.930 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:15.930 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.919385+0000", 2024-05-08T18:32:15.930 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.5792999999999999e-05 2024-05-08T18:32:15.930 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.931 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.931 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:15.931 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.919530+0000", 2024-05-08T18:32:15.931 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00014553600000000001 2024-05-08T18:32:15.931 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.931 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.931 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:15.931 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.919799+0000", 2024-05-08T18:32:15.931 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00026923399999999998 2024-05-08T18:32:15.931 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.931 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.931 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 3", 2024-05-08T18:32:15.931 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.920044+0000", 2024-05-08T18:32:15.932 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00024442499999999999 2024-05-08T18:32:15.932 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.932 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.932 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:15.932 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.928865+0000", 2024-05-08T18:32:15.932 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0088214509999999993 2024-05-08T18:32:15.932 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.932 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.932 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:15.932 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.943462+0000", 2024-05-08T18:32:15.932 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.014596408999999999 2024-05-08T18:32:15.932 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.932 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.932 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:15.933 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.943564+0000", 2024-05-08T18:32:15.933 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000101863 2024-05-08T18:32:15.933 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.933 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.933 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:15.933 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:31:46.943639+0000", 2024-05-08T18:32:15.933 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.5766000000000006e-05 2024-05-08T18:32:15.933 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:15.933 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:15.933 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:15.933 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.933 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.934 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1830 3.2d 3:b5a6fb7d:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-05-08T18:32:15.934 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:00.635702+0000", 2024-05-08T18:32:15.934 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 15.206492361, 2024-05-08T18:32:15.934 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.039838612000000002, 2024-05-08T18:32:15.934 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:15.934 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:15.934 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:15.934 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:15.934 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:15.934 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:15.934 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1830 2024-05-08T18:32:15.934 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.935 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:15.935 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.935 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:15.935 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.635702+0000", 2024-05-08T18:32:15.935 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:15.935 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.935 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.935 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:15.935 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.635702+0000", 2024-05-08T18:32:15.935 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:15.935 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.935 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.935 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:15.935 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.635705+0000", 2024-05-08T18:32:15.935 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.937e-06 2024-05-08T18:32:15.936 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.936 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.936 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:15.936 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.644814+0000", 2024-05-08T18:32:15.936 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0091098780000000001 2024-05-08T18:32:15.936 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.936 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.936 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:15.936 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.644843+0000", 2024-05-08T18:32:15.936 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.8439e-05 2024-05-08T18:32:15.936 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.937 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.937 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:15.937 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.644859+0000", 2024-05-08T18:32:15.937 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.6460000000000002e-05 2024-05-08T18:32:15.937 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.937 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.937 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:15.937 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.644940+0000", 2024-05-08T18:32:15.937 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.1031000000000004e-05 2024-05-08T18:32:15.937 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.937 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.937 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:15.937 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.645103+0000", 2024-05-08T18:32:15.938 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016295599999999999 2024-05-08T18:32:15.938 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.938 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.938 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-05-08T18:32:15.938 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.645218+0000", 2024-05-08T18:32:15.938 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011441499999999999 2024-05-08T18:32:15.938 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.938 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.938 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:15.938 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.651600+0000", 2024-05-08T18:32:15.938 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0063818900000000003 2024-05-08T18:32:15.938 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.938 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.939 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:15.939 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.675451+0000", 2024-05-08T18:32:15.939 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.023850865999999998 2024-05-08T18:32:15.939 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.939 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.939 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:15.939 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.675500+0000", 2024-05-08T18:32:15.939 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.9623999999999998e-05 2024-05-08T18:32:15.939 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.939 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.939 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:15.939 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:00.675540+0000", 2024-05-08T18:32:15.940 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0116e-05 2024-05-08T18:32:15.940 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:15.940 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:15.940 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:15.940 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.940 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.940 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1861 3.f 3:f0b8f9d8:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_47:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:32:15.940 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:01.002850+0000", 2024-05-08T18:32:15.940 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 14.839344278, 2024-05-08T18:32:15.940 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.024823504, 2024-05-08T18:32:15.940 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:15.940 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:15.940 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:15.941 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:15.941 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:15.941 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:15.941 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1861 2024-05-08T18:32:15.941 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.941 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:15.941 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.941 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:15.941 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.002850+0000", 2024-05-08T18:32:15.941 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:15.941 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.941 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.942 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:15.942 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.002850+0000", 2024-05-08T18:32:15.942 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:15.942 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.942 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.942 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:15.942 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.002852+0000", 2024-05-08T18:32:15.942 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.04e-06 2024-05-08T18:32:15.942 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.942 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.942 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:15.942 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.006630+0000", 2024-05-08T18:32:15.942 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0037778019999999998 2024-05-08T18:32:15.942 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.943 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.943 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:15.943 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.006655+0000", 2024-05-08T18:32:15.943 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.4916999999999999e-05 2024-05-08T18:32:15.943 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.943 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.943 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:15.943 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.006668+0000", 2024-05-08T18:32:15.943 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.348e-05 2024-05-08T18:32:15.943 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.943 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.944 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:15.944 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.006819+0000", 2024-05-08T18:32:15.944 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00015059700000000001 2024-05-08T18:32:15.944 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.944 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.944 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:15.944 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.007076+0000", 2024-05-08T18:32:15.944 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000257058 2024-05-08T18:32:15.944 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.944 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.944 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 4", 2024-05-08T18:32:15.944 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.007329+0000", 2024-05-08T18:32:15.945 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000253718 2024-05-08T18:32:15.945 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.945 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.945 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:15.945 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.018105+0000", 2024-05-08T18:32:15.945 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.010775778 2024-05-08T18:32:15.945 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.945 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.945 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:15.945 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.027519+0000", 2024-05-08T18:32:15.945 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0094135220000000006 2024-05-08T18:32:15.945 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.945 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.945 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:15.946 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.027606+0000", 2024-05-08T18:32:15.946 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.7001000000000003e-05 2024-05-08T18:32:15.946 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.946 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.946 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:15.946 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.027673+0000", 2024-05-08T18:32:15.946 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 6.7590999999999997e-05 2024-05-08T18:32:15.946 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:15.946 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:15.946 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:15.946 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.946 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.947 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1865 3.3f 3:ffe43b13:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_51:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:32:15.947 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:01.047109+0000", 2024-05-08T18:32:15.947 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 14.795085282000001, 2024-05-08T18:32:15.947 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.032239539999999997, 2024-05-08T18:32:15.947 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:15.947 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:15.947 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:15.947 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:15.947 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:15.947 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:15.947 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1865 2024-05-08T18:32:15.947 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.947 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:15.947 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.948 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:15.948 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.047109+0000", 2024-05-08T18:32:15.948 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:15.948 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.948 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.948 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:15.948 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.047109+0000", 2024-05-08T18:32:15.948 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:15.948 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.948 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.948 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:15.948 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.047112+0000", 2024-05-08T18:32:15.948 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.1099999999999999e-06 2024-05-08T18:32:15.949 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.949 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.949 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:15.949 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.051447+0000", 2024-05-08T18:32:15.949 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0043346679999999999 2024-05-08T18:32:15.949 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.949 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.949 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:15.949 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.051479+0000", 2024-05-08T18:32:15.949 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.2619000000000001e-05 2024-05-08T18:32:15.949 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.949 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.950 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:15.950 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.051495+0000", 2024-05-08T18:32:15.950 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.5993000000000001e-05 2024-05-08T18:32:15.950 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.950 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.950 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:15.950 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.051627+0000", 2024-05-08T18:32:15.950 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000132132 2024-05-08T18:32:15.950 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.950 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.950 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:15.950 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.051888+0000", 2024-05-08T18:32:15.950 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00026025499999999998 2024-05-08T18:32:15.950 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.951 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.951 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 6", 2024-05-08T18:32:15.951 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.052129+0000", 2024-05-08T18:32:15.951 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000241079 2024-05-08T18:32:15.951 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.951 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.951 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:15.951 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.067226+0000", 2024-05-08T18:32:15.951 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.015097462000000001 2024-05-08T18:32:15.951 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.951 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.951 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:15.951 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.079073+0000", 2024-05-08T18:32:15.952 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.011846617 2024-05-08T18:32:15.952 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.952 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.952 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:15.952 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.079236+0000", 2024-05-08T18:32:15.952 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00016313699999999999 2024-05-08T18:32:15.952 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.952 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.952 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:15.952 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.079348+0000", 2024-05-08T18:32:15.952 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00011246799999999999 2024-05-08T18:32:15.952 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:15.952 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:15.953 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:15.953 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.953 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.953 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1896 3.11 3:88e8a458:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_82:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:32:15.953 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:01.591489+0000", 2024-05-08T18:32:15.953 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 14.25070515, 2024-05-08T18:32:15.953 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.021292352000000001, 2024-05-08T18:32:15.953 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:15.953 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:15.953 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:15.953 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:15.953 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:15.954 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:15.954 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1896 2024-05-08T18:32:15.954 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.954 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:15.954 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.954 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:15.954 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.591489+0000", 2024-05-08T18:32:15.954 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:15.954 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.954 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.954 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:15.954 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.591489+0000", 2024-05-08T18:32:15.955 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:15.955 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.955 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.955 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:15.955 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.591493+0000", 2024-05-08T18:32:15.955 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0960000000000003e-06 2024-05-08T18:32:15.955 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.955 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.955 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:15.955 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.595850+0000", 2024-05-08T18:32:15.955 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0043569539999999997 2024-05-08T18:32:15.955 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.955 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.956 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:15.956 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.595888+0000", 2024-05-08T18:32:15.956 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 3.8207000000000002e-05 2024-05-08T18:32:15.956 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.956 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.956 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:15.956 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.595907+0000", 2024-05-08T18:32:15.956 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8899999999999999e-05 2024-05-08T18:32:15.956 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.956 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.956 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:15.956 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.596036+0000", 2024-05-08T18:32:15.957 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000128682 2024-05-08T18:32:15.957 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.957 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.957 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:15.957 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.596292+0000", 2024-05-08T18:32:15.957 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00025657099999999998 2024-05-08T18:32:15.957 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.957 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.957 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 4", 2024-05-08T18:32:15.957 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.596526+0000", 2024-05-08T18:32:15.957 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000233212 2024-05-08T18:32:15.957 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.957 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.958 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:15.958 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.610742+0000", 2024-05-08T18:32:15.958 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.014216522000000001 2024-05-08T18:32:15.958 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.958 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.958 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:15.958 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.612559+0000", 2024-05-08T18:32:15.958 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.001817433 2024-05-08T18:32:15.958 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.958 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.958 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:15.958 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.612655+0000", 2024-05-08T18:32:15.958 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 9.5552999999999998e-05 2024-05-08T18:32:15.959 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.959 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.959 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:15.959 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.612781+0000", 2024-05-08T18:32:15.959 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000126222 2024-05-08T18:32:15.959 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:15.959 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:15.959 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:15.959 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.959 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.959 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1908 3.37 3:ec666de2:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_94:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:32:15.959 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:01.843287+0000", 2024-05-08T18:32:15.959 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 13.998906934000001, 2024-05-08T18:32:15.960 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.023042806999999998, 2024-05-08T18:32:15.960 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:15.960 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:15.960 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:15.960 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:15.960 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:15.960 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:15.960 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1908 2024-05-08T18:32:15.960 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.960 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:15.960 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.960 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:15.961 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.843287+0000", 2024-05-08T18:32:15.961 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:15.961 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.961 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.961 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:15.961 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.843287+0000", 2024-05-08T18:32:15.961 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:15.961 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.961 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.961 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:15.961 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.843292+0000", 2024-05-08T18:32:15.961 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.8199999999999996e-06 2024-05-08T18:32:15.961 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.962 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.962 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:15.962 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.847349+0000", 2024-05-08T18:32:15.962 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0040571160000000004 2024-05-08T18:32:15.962 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.962 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.962 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:15.962 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.847392+0000", 2024-05-08T18:32:15.962 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.2899999999999999e-05 2024-05-08T18:32:15.962 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.962 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.962 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:15.962 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.847411+0000", 2024-05-08T18:32:15.962 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.8940000000000002e-05 2024-05-08T18:32:15.963 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.963 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.963 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:15.963 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.847544+0000", 2024-05-08T18:32:15.963 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000133039 2024-05-08T18:32:15.963 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.963 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.963 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:15.963 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.847801+0000", 2024-05-08T18:32:15.963 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00025721799999999998 2024-05-08T18:32:15.963 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.963 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.963 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 5", 2024-05-08T18:32:15.964 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.848073+0000", 2024-05-08T18:32:15.964 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00027179500000000002 2024-05-08T18:32:15.964 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.964 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.964 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:15.964 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.862878+0000", 2024-05-08T18:32:15.964 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.014804777999999999 2024-05-08T18:32:15.964 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.964 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.964 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:15.964 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.866260+0000", 2024-05-08T18:32:15.964 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0033819290000000001 2024-05-08T18:32:15.964 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.965 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.965 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:15.965 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.866300+0000", 2024-05-08T18:32:15.965 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 4.0323e-05 2024-05-08T18:32:15.965 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.965 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.965 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:15.965 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.866330+0000", 2024-05-08T18:32:15.965 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.9949000000000001e-05 2024-05-08T18:32:15.965 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:15.965 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:15.965 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:15.965 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.965 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.966 INFO:teuthology.orchestra.run.smithi151.stdout: "description": "osd_op(client.4400.0:1913 3.3b 3:dfe6dfd2:::3f58ee14-a6cb-4a7f-b0aa-e2ea5a67e2ab.4400.8__shadow_.YPrejFDfhrVzO_vzUP4nZV40lWVUng1_99:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93)", 2024-05-08T18:32:15.966 INFO:teuthology.orchestra.run.smithi151.stdout: "initiated_at": "2024-05-08T18:32:01.923898+0000", 2024-05-08T18:32:15.966 INFO:teuthology.orchestra.run.smithi151.stdout: "age": 13.918295677, 2024-05-08T18:32:15.966 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.02072742, 2024-05-08T18:32:15.966 INFO:teuthology.orchestra.run.smithi151.stdout: "continuous": false, 2024-05-08T18:32:15.966 INFO:teuthology.orchestra.run.smithi151.stdout: "type_data": { 2024-05-08T18:32:15.966 INFO:teuthology.orchestra.run.smithi151.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-08T18:32:15.966 INFO:teuthology.orchestra.run.smithi151.stdout: "client_info": { 2024-05-08T18:32:15.966 INFO:teuthology.orchestra.run.smithi151.stdout: "client": "client.4400", 2024-05-08T18:32:15.966 INFO:teuthology.orchestra.run.smithi151.stdout: "client_addr": "172.21.15.97:0/3980396821", 2024-05-08T18:32:15.966 INFO:teuthology.orchestra.run.smithi151.stdout: "tid": 1913 2024-05-08T18:32:15.967 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.967 INFO:teuthology.orchestra.run.smithi151.stdout: "events": [ 2024-05-08T18:32:15.967 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.967 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "initiated", 2024-05-08T18:32:15.967 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.923898+0000", 2024-05-08T18:32:15.967 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:15.967 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.967 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.967 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "header_read", 2024-05-08T18:32:15.967 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.923898+0000", 2024-05-08T18:32:15.967 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0 2024-05-08T18:32:15.967 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.967 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.968 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "throttled", 2024-05-08T18:32:15.968 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.923901+0000", 2024-05-08T18:32:15.968 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.9849999999999998e-06 2024-05-08T18:32:15.968 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.968 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.968 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "all_read", 2024-05-08T18:32:15.968 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.927833+0000", 2024-05-08T18:32:15.968 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0039317429999999997 2024-05-08T18:32:15.968 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.968 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.968 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "dispatched", 2024-05-08T18:32:15.968 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.927858+0000", 2024-05-08T18:32:15.968 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 2.4697000000000001e-05 2024-05-08T18:32:15.968 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.969 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.969 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "queued_for_pg", 2024-05-08T18:32:15.969 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.927869+0000", 2024-05-08T18:32:15.969 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 1.1575e-05 2024-05-08T18:32:15.969 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.969 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.969 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "reached_pg", 2024-05-08T18:32:15.969 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.927946+0000", 2024-05-08T18:32:15.969 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 7.6817999999999995e-05 2024-05-08T18:32:15.969 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.969 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.969 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "started", 2024-05-08T18:32:15.969 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.928089+0000", 2024-05-08T18:32:15.970 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000143289 2024-05-08T18:32:15.970 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.970 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.970 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "waiting for subops from 2", 2024-05-08T18:32:15.970 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.928220+0000", 2024-05-08T18:32:15.970 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.00013052100000000001 2024-05-08T18:32:15.970 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.970 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.970 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "op_commit", 2024-05-08T18:32:15.970 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.934683+0000", 2024-05-08T18:32:15.970 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0064635020000000003 2024-05-08T18:32:15.970 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.971 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.971 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "sub_op_commit_rec", 2024-05-08T18:32:15.971 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.944426+0000", 2024-05-08T18:32:15.971 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.0097427499999999997 2024-05-08T18:32:15.971 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.971 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.971 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "commit_sent", 2024-05-08T18:32:15.971 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.944539+0000", 2024-05-08T18:32:15.971 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 0.000112316 2024-05-08T18:32:15.971 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T18:32:15.971 INFO:teuthology.orchestra.run.smithi151.stdout: { 2024-05-08T18:32:15.971 INFO:teuthology.orchestra.run.smithi151.stdout: "event": "done", 2024-05-08T18:32:15.971 INFO:teuthology.orchestra.run.smithi151.stdout: "time": "2024-05-08T18:32:01.944626+0000", 2024-05-08T18:32:15.972 INFO:teuthology.orchestra.run.smithi151.stdout: "duration": 8.7224000000000004e-05 2024-05-08T18:32:15.972 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:15.972 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:15.972 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:15.972 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T18:32:15.972 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T18:32:15.972 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T18:32:17.819 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-08T18:32:18.810 INFO:teuthology.orchestra.run.smithi097.stderr:noscrub is unset 2024-05-08T18:32:18.836 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-08T18:32:19.832 INFO:teuthology.orchestra.run.smithi097.stderr:nodeep-scrub is unset 2024-05-08T18:32:29.445 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-05-08T18:32:29.593 INFO:teuthology.orchestra.run.smithi097.stdout:mon.a: {} 2024-05-08T18:32:29.593 INFO:teuthology.orchestra.run.smithi097.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-05-08T18:32:29.605 INFO:teuthology.orchestra.run.smithi097.stdout:mon.b: {} 2024-05-08T18:32:29.606 INFO:teuthology.orchestra.run.smithi097.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-05-08T18:32:29.615 INFO:teuthology.orchestra.run.smithi097.stdout:mon.c: {} 2024-05-08T18:32:29.616 INFO:teuthology.orchestra.run.smithi097.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-05-08T18:32:29.633 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-05-08T18:32:30.845 INFO:teuthology.orchestra.run.smithi097.stderr:reweighted osd.0 to 1 (10000) 2024-05-08T18:32:30.879 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-05-08T18:32:31.874 INFO:teuthology.orchestra.run.smithi097.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-05-08T18:32:31.903 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-05-08T18:32:32.868 INFO:teuthology.orchestra.run.smithi097.stderr:reweighted osd.1 to 1 (10000) 2024-05-08T18:32:32.900 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-05-08T18:32:33.893 INFO:teuthology.orchestra.run.smithi097.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-05-08T18:32:33.919 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-05-08T18:32:34.907 INFO:teuthology.orchestra.run.smithi097.stderr:reweighted osd.2 to 1 (10000) 2024-05-08T18:32:34.933 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-05-08T18:32:35.915 INFO:teuthology.orchestra.run.smithi097.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-05-08T18:32:35.947 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-05-08T18:32:36.918 INFO:teuthology.orchestra.run.smithi097.stderr:reweighted osd.3 to 1 (10000) 2024-05-08T18:32:36.948 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 3 1 2024-05-08T18:32:37.942 INFO:teuthology.orchestra.run.smithi097.stderr:set osd.3 primary-affinity to 1 (8655362) 2024-05-08T18:32:37.967 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-05-08T18:32:38.949 INFO:teuthology.orchestra.run.smithi097.stderr:reweighted osd.4 to 1 (10000) 2024-05-08T18:32:38.977 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 4 1 2024-05-08T18:32:39.974 INFO:teuthology.orchestra.run.smithi097.stderr:set osd.4 primary-affinity to 1 (8655362) 2024-05-08T18:32:39.999 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-05-08T18:32:40.990 INFO:teuthology.orchestra.run.smithi097.stderr:reweighted osd.5 to 1 (10000) 2024-05-08T18:32:41.015 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 5 1 2024-05-08T18:32:41.992 INFO:teuthology.orchestra.run.smithi097.stderr:set osd.5 primary-affinity to 1 (8655362) 2024-05-08T18:32:42.021 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-05-08T18:32:43.016 INFO:teuthology.orchestra.run.smithi097.stderr:reweighted osd.6 to 1 (10000) 2024-05-08T18:32:43.042 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 6 1 2024-05-08T18:32:44.020 INFO:teuthology.orchestra.run.smithi097.stderr:set osd.6 primary-affinity to 1 (8655362) 2024-05-08T18:32:44.049 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-05-08T18:32:45.041 INFO:teuthology.orchestra.run.smithi097.stderr:reweighted osd.7 to 1 (10000) 2024-05-08T18:32:45.068 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 7 1 2024-05-08T18:32:46.063 INFO:teuthology.orchestra.run.smithi097.stderr:set osd.7 primary-affinity to 1 (8655362) 2024-05-08T18:32:46.087 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-05-08T18:32:46.087 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-05-08T18:32:46.087 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-05-08T18:32:46.087 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-05-08T18:32:46.087 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-05-08T18:32:46.087 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T18:32:46.386 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-05-08T18:32:46.387 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":116,"fsid":"f135278e-f589-4ad6-a830-fa767ff99171","created":"2024-05-08T18:29:14.813384+0000","modified":"2024-05-08T18:32:46.043081+0000","last_up_change":"2024-05-08T18:29:26.091102+0000","last_in_change":"2024-05-08T18:29:17.082151+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T18:29:25.443461+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-05-08T18:29:32.943859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-05-08T18:29:39.147224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-05-08T18:29:40.891936+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-05-08T18:29:42.925519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-05-08T18:29:44.727411+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-05-08T18:29:46.621438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-05-08T18:29:48.780230+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f135796c-f80c-43a8-889d-e0927bcc3d0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2064534873},{"type":"v1","addr":"172.21.15.97:6801","nonce":2064534873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":2064534873},{"type":"v1","addr":"172.21.15.97:6803","nonce":2064534873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":2064534873},{"type":"v1","addr":"172.21.15.97:6807","nonce":2064534873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":2064534873},{"type":"v1","addr":"172.21.15.97:6805","nonce":2064534873}]},"public_addr":"172.21.15.97:6801/2064534873","cluster_addr":"172.21.15.97:6803/2064534873","heartbeat_back_addr":"172.21.15.97:6807/2064534873","heartbeat_front_addr":"172.21.15.97:6805/2064534873","state":["exists","up"]},{"osd":1,"uuid":"b91d895a-2b40-45c1-b355-52dba17032cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":34364184},{"type":"v1","addr":"172.21.15.97:6815","nonce":34364184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":34364184},{"type":"v1","addr":"172.21.15.97:6819","nonce":34364184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":34364184},{"type":"v1","addr":"172.21.15.97:6823","nonce":34364184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":34364184},{"type":"v1","addr":"172.21.15.97:6821","nonce":34364184}]},"public_addr":"172.21.15.97:6815/34364184","cluster_addr":"172.21.15.97:6819/34364184","heartbeat_back_addr":"172.21.15.97:6823/34364184","heartbeat_front_addr":"172.21.15.97:6821/34364184","state":["exists","up"]},{"osd":2,"uuid":"35f12106-8d9a-4dcb-a8bc-38e08c81bd5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":3004545111},{"type":"v1","addr":"172.21.15.97:6809","nonce":3004545111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":3004545111},{"type":"v1","addr":"172.21.15.97:6811","nonce":3004545111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3004545111},{"type":"v1","addr":"172.21.15.97:6817","nonce":3004545111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":3004545111},{"type":"v1","addr":"172.21.15.97:6814","nonce":3004545111}]},"public_addr":"172.21.15.97:6809/3004545111","cluster_addr":"172.21.15.97:6811/3004545111","heartbeat_back_addr":"172.21.15.97:6817/3004545111","heartbeat_front_addr":"172.21.15.97:6814/3004545111","state":["exists","up"]},{"osd":3,"uuid":"cd78d341-ec40-457e-a713-555b03bc9f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":1855786157},{"type":"v1","addr":"172.21.15.97:6825","nonce":1855786157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":1855786157},{"type":"v1","addr":"172.21.15.97:6827","nonce":1855786157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":1855786157},{"type":"v1","addr":"172.21.15.97:6831","nonce":1855786157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":1855786157},{"type":"v1","addr":"172.21.15.97:6829","nonce":1855786157}]},"public_addr":"172.21.15.97:6825/1855786157","cluster_addr":"172.21.15.97:6827/1855786157","heartbeat_back_addr":"172.21.15.97:6831/1855786157","heartbeat_front_addr":"172.21.15.97:6829/1855786157","state":["exists","up"]},{"osd":4,"uuid":"469d890e-5e0c-41cd-ac5b-ef987b70abd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":1246653692},{"type":"v1","addr":"172.21.15.151:6810","nonce":1246653692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":1246653692},{"type":"v1","addr":"172.21.15.151:6814","nonce":1246653692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":1246653692},{"type":"v1","addr":"172.21.15.151:6822","nonce":1246653692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":1246653692},{"type":"v1","addr":"172.21.15.151:6818","nonce":1246653692}]},"public_addr":"172.21.15.151:6810/1246653692","cluster_addr":"172.21.15.151:6814/1246653692","heartbeat_back_addr":"172.21.15.151:6822/1246653692","heartbeat_front_addr":"172.21.15.151:6818/1246653692","state":["exists","up"]},{"osd":5,"uuid":"dcb25c08-802c-4140-a3d2-929960319860","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":4257184226},{"type":"v1","addr":"172.21.15.151:6811","nonce":4257184226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6813","nonce":4257184226},{"type":"v1","addr":"172.21.15.151:6815","nonce":4257184226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6821","nonce":4257184226},{"type":"v1","addr":"172.21.15.151:6823","nonce":4257184226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6817","nonce":4257184226},{"type":"v1","addr":"172.21.15.151:6819","nonce":4257184226}]},"public_addr":"172.21.15.151:6811/4257184226","cluster_addr":"172.21.15.151:6815/4257184226","heartbeat_back_addr":"172.21.15.151:6823/4257184226","heartbeat_front_addr":"172.21.15.151:6819/4257184226","state":["exists","up"]},{"osd":6,"uuid":"598ab572-7049-4600-9e91-1792360421d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":974202886},{"type":"v1","addr":"172.21.15.151:6801","nonce":974202886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":974202886},{"type":"v1","addr":"172.21.15.151:6803","nonce":974202886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":974202886},{"type":"v1","addr":"172.21.15.151:6807","nonce":974202886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":974202886},{"type":"v1","addr":"172.21.15.151:6805","nonce":974202886}]},"public_addr":"172.21.15.151:6801/974202886","cluster_addr":"172.21.15.151:6803/974202886","heartbeat_back_addr":"172.21.15.151:6807/974202886","heartbeat_front_addr":"172.21.15.151:6805/974202886","state":["exists","up"]},{"osd":7,"uuid":"c21805e0-4945-4efe-8e65-68bb92d30b69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":2584927373},{"type":"v1","addr":"172.21.15.151:6825","nonce":2584927373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2584927373},{"type":"v1","addr":"172.21.15.151:6827","nonce":2584927373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2584927373},{"type":"v1","addr":"172.21.15.151:6831","nonce":2584927373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2584927373},{"type":"v1","addr":"172.21.15.151:6829","nonce":2584927373}]},"public_addr":"172.21.15.151:6825/2584927373","cluster_addr":"172.21.15.151:6827/2584927373","heartbeat_back_addr":"172.21.15.151:6831/2584927373","heartbeat_front_addr":"172.21.15.151:6829/2584927373","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:29:22.299407+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:29:22.487701+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:29:22.371789+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:29:22.160484+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:29:22.674077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:29:22.713456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:29:22.587563+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:29:22.751830+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"4.4","osds":[1,6]}],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.25","mappings":[{"from":3,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"4.0","mappings":[{"from":3,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T18:32:46.406 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-05-08T18:32:46.406 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T18:32:46.715 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-05-08T18:32:46.715 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":116,"fsid":"f135278e-f589-4ad6-a830-fa767ff99171","created":"2024-05-08T18:29:14.813384+0000","modified":"2024-05-08T18:32:46.043081+0000","last_up_change":"2024-05-08T18:29:26.091102+0000","last_in_change":"2024-05-08T18:29:17.082151+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T18:29:25.443461+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-05-08T18:29:32.943859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-05-08T18:29:39.147224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-05-08T18:29:40.891936+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-05-08T18:29:42.925519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-05-08T18:29:44.727411+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-05-08T18:29:46.621438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-05-08T18:29:48.780230+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f135796c-f80c-43a8-889d-e0927bcc3d0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2064534873},{"type":"v1","addr":"172.21.15.97:6801","nonce":2064534873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":2064534873},{"type":"v1","addr":"172.21.15.97:6803","nonce":2064534873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":2064534873},{"type":"v1","addr":"172.21.15.97:6807","nonce":2064534873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":2064534873},{"type":"v1","addr":"172.21.15.97:6805","nonce":2064534873}]},"public_addr":"172.21.15.97:6801/2064534873","cluster_addr":"172.21.15.97:6803/2064534873","heartbeat_back_addr":"172.21.15.97:6807/2064534873","heartbeat_front_addr":"172.21.15.97:6805/2064534873","state":["exists","up"]},{"osd":1,"uuid":"b91d895a-2b40-45c1-b355-52dba17032cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":34364184},{"type":"v1","addr":"172.21.15.97:6815","nonce":34364184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":34364184},{"type":"v1","addr":"172.21.15.97:6819","nonce":34364184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":34364184},{"type":"v1","addr":"172.21.15.97:6823","nonce":34364184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":34364184},{"type":"v1","addr":"172.21.15.97:6821","nonce":34364184}]},"public_addr":"172.21.15.97:6815/34364184","cluster_addr":"172.21.15.97:6819/34364184","heartbeat_back_addr":"172.21.15.97:6823/34364184","heartbeat_front_addr":"172.21.15.97:6821/34364184","state":["exists","up"]},{"osd":2,"uuid":"35f12106-8d9a-4dcb-a8bc-38e08c81bd5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":3004545111},{"type":"v1","addr":"172.21.15.97:6809","nonce":3004545111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":3004545111},{"type":"v1","addr":"172.21.15.97:6811","nonce":3004545111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3004545111},{"type":"v1","addr":"172.21.15.97:6817","nonce":3004545111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":3004545111},{"type":"v1","addr":"172.21.15.97:6814","nonce":3004545111}]},"public_addr":"172.21.15.97:6809/3004545111","cluster_addr":"172.21.15.97:6811/3004545111","heartbeat_back_addr":"172.21.15.97:6817/3004545111","heartbeat_front_addr":"172.21.15.97:6814/3004545111","state":["exists","up"]},{"osd":3,"uuid":"cd78d341-ec40-457e-a713-555b03bc9f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":1855786157},{"type":"v1","addr":"172.21.15.97:6825","nonce":1855786157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":1855786157},{"type":"v1","addr":"172.21.15.97:6827","nonce":1855786157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":1855786157},{"type":"v1","addr":"172.21.15.97:6831","nonce":1855786157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":1855786157},{"type":"v1","addr":"172.21.15.97:6829","nonce":1855786157}]},"public_addr":"172.21.15.97:6825/1855786157","cluster_addr":"172.21.15.97:6827/1855786157","heartbeat_back_addr":"172.21.15.97:6831/1855786157","heartbeat_front_addr":"172.21.15.97:6829/1855786157","state":["exists","up"]},{"osd":4,"uuid":"469d890e-5e0c-41cd-ac5b-ef987b70abd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":1246653692},{"type":"v1","addr":"172.21.15.151:6810","nonce":1246653692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":1246653692},{"type":"v1","addr":"172.21.15.151:6814","nonce":1246653692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":1246653692},{"type":"v1","addr":"172.21.15.151:6822","nonce":1246653692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":1246653692},{"type":"v1","addr":"172.21.15.151:6818","nonce":1246653692}]},"public_addr":"172.21.15.151:6810/1246653692","cluster_addr":"172.21.15.151:6814/1246653692","heartbeat_back_addr":"172.21.15.151:6822/1246653692","heartbeat_front_addr":"172.21.15.151:6818/1246653692","state":["exists","up"]},{"osd":5,"uuid":"dcb25c08-802c-4140-a3d2-929960319860","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":4257184226},{"type":"v1","addr":"172.21.15.151:6811","nonce":4257184226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6813","nonce":4257184226},{"type":"v1","addr":"172.21.15.151:6815","nonce":4257184226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6821","nonce":4257184226},{"type":"v1","addr":"172.21.15.151:6823","nonce":4257184226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6817","nonce":4257184226},{"type":"v1","addr":"172.21.15.151:6819","nonce":4257184226}]},"public_addr":"172.21.15.151:6811/4257184226","cluster_addr":"172.21.15.151:6815/4257184226","heartbeat_back_addr":"172.21.15.151:6823/4257184226","heartbeat_front_addr":"172.21.15.151:6819/4257184226","state":["exists","up"]},{"osd":6,"uuid":"598ab572-7049-4600-9e91-1792360421d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":974202886},{"type":"v1","addr":"172.21.15.151:6801","nonce":974202886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":974202886},{"type":"v1","addr":"172.21.15.151:6803","nonce":974202886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":974202886},{"type":"v1","addr":"172.21.15.151:6807","nonce":974202886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":974202886},{"type":"v1","addr":"172.21.15.151:6805","nonce":974202886}]},"public_addr":"172.21.15.151:6801/974202886","cluster_addr":"172.21.15.151:6803/974202886","heartbeat_back_addr":"172.21.15.151:6807/974202886","heartbeat_front_addr":"172.21.15.151:6805/974202886","state":["exists","up"]},{"osd":7,"uuid":"c21805e0-4945-4efe-8e65-68bb92d30b69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":2584927373},{"type":"v1","addr":"172.21.15.151:6825","nonce":2584927373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2584927373},{"type":"v1","addr":"172.21.15.151:6827","nonce":2584927373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2584927373},{"type":"v1","addr":"172.21.15.151:6831","nonce":2584927373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2584927373},{"type":"v1","addr":"172.21.15.151:6829","nonce":2584927373}]},"public_addr":"172.21.15.151:6825/2584927373","cluster_addr":"172.21.15.151:6827/2584927373","heartbeat_back_addr":"172.21.15.151:6831/2584927373","heartbeat_front_addr":"172.21.15.151:6829/2584927373","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:29:22.299407+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:29:22.487701+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:29:22.371789+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:29:22.160484+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:29:22.674077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:29:22.713456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:29:22.587563+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:29:22.751830+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"4.4","osds":[1,6]}],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.25","mappings":[{"from":3,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"4.0","mappings":[{"from":3,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T18:32:46.735 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-05-08T18:32:46.736 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-05-08T18:32:46.736 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-05-08T18:32:46.737 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-05-08T18:32:46.737 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-05-08T18:32:46.737 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-05-08T18:32:46.738 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-05-08T18:32:46.738 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-05-08T18:32:47.003 INFO:teuthology.orchestra.run.smithi097.stdout:60129542189 2024-05-08T18:32:47.003 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-08T18:32:47.012 INFO:teuthology.orchestra.run.smithi097.stdout:64424509484 2024-05-08T18:32:47.012 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-08T18:32:47.013 INFO:teuthology.orchestra.run.smithi097.stdout:60129542189 2024-05-08T18:32:47.013 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-08T18:32:47.016 INFO:teuthology.orchestra.run.smithi097.stdout:64424509486 2024-05-08T18:32:47.016 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-08T18:32:47.017 INFO:teuthology.orchestra.run.smithi097.stdout:64424509484 2024-05-08T18:32:47.018 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-08T18:32:47.021 INFO:teuthology.orchestra.run.smithi097.stdout:60129542189 2024-05-08T18:32:47.021 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-08T18:32:47.026 INFO:teuthology.orchestra.run.smithi097.stdout:60129542187 2024-05-08T18:32:47.027 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-08T18:32:47.034 INFO:teuthology.orchestra.run.smithi097.stdout:64424509486 2024-05-08T18:32:47.034 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-08T18:32:47.511 INFO:teuthology.orchestra.run.smithi097.stdout:64424509482 2024-05-08T18:32:47.524 INFO:teuthology.orchestra.run.smithi097.stdout:64424509484 2024-05-08T18:32:47.536 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509484 got 64424509482 for osd.4 2024-05-08T18:32:47.539 INFO:teuthology.orchestra.run.smithi097.stdout:60129542188 2024-05-08T18:32:47.543 INFO:teuthology.orchestra.run.smithi097.stdout:60129542188 2024-05-08T18:32:47.551 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509486 got 64424509484 for osd.6 2024-05-08T18:32:47.552 INFO:teuthology.orchestra.run.smithi097.stdout:60129542188 2024-05-08T18:32:47.567 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542189 got 60129542188 for osd.0 2024-05-08T18:32:47.569 INFO:teuthology.orchestra.run.smithi097.stdout:64424509482 2024-05-08T18:32:47.574 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542189 got 60129542188 for osd.2 2024-05-08T18:32:47.576 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542189 got 60129542188 for osd.3 2024-05-08T18:32:47.587 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509484 got 64424509482 for osd.5 2024-05-08T18:32:47.591 INFO:teuthology.orchestra.run.smithi097.stdout:60129542186 2024-05-08T18:32:47.593 INFO:teuthology.orchestra.run.smithi097.stdout:64424509484 2024-05-08T18:32:47.611 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542187 got 60129542186 for osd.1 2024-05-08T18:32:47.612 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509486 got 64424509484 for osd.7 2024-05-08T18:32:48.537 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-08T18:32:48.551 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-08T18:32:48.568 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-08T18:32:48.575 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-08T18:32:48.577 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-08T18:32:48.588 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-08T18:32:48.612 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-08T18:32:48.613 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-08T18:32:49.036 INFO:teuthology.orchestra.run.smithi097.stdout:64424509484 2024-05-08T18:32:49.059 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509484 got 64424509484 for osd.4 2024-05-08T18:32:49.059 DEBUG:teuthology.parallel:result is None 2024-05-08T18:32:49.110 INFO:teuthology.orchestra.run.smithi097.stdout:64424509486 2024-05-08T18:32:49.114 INFO:teuthology.orchestra.run.smithi097.stdout:60129542189 2024-05-08T18:32:49.121 INFO:teuthology.orchestra.run.smithi097.stdout:60129542189 2024-05-08T18:32:49.122 INFO:teuthology.orchestra.run.smithi097.stdout:60129542189 2024-05-08T18:32:49.133 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509486 got 64424509486 for osd.7 2024-05-08T18:32:49.134 DEBUG:teuthology.parallel:result is None 2024-05-08T18:32:49.138 INFO:teuthology.orchestra.run.smithi097.stdout:64424509486 2024-05-08T18:32:49.149 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542189 got 60129542189 for osd.3 2024-05-08T18:32:49.149 DEBUG:teuthology.parallel:result is None 2024-05-08T18:32:49.153 INFO:teuthology.orchestra.run.smithi097.stdout:60129542187 2024-05-08T18:32:49.154 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542189 got 60129542189 for osd.0 2024-05-08T18:32:49.154 DEBUG:teuthology.parallel:result is None 2024-05-08T18:32:49.156 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542189 got 60129542189 for osd.2 2024-05-08T18:32:49.156 DEBUG:teuthology.parallel:result is None 2024-05-08T18:32:49.162 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509486 got 64424509486 for osd.6 2024-05-08T18:32:49.163 DEBUG:teuthology.parallel:result is None 2024-05-08T18:32:49.163 INFO:teuthology.orchestra.run.smithi097.stdout:64424509484 2024-05-08T18:32:49.175 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542187 got 60129542187 for osd.1 2024-05-08T18:32:49.175 DEBUG:teuthology.parallel:result is None 2024-05-08T18:32:49.182 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509484 got 64424509484 for osd.5 2024-05-08T18:32:49.182 DEBUG:teuthology.parallel:result is None 2024-05-08T18:32:49.186 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-05-08T18:32:49.186 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T18:32:49.506 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-05-08T18:32:49.513 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2024-05-08T18:32:49.521 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":211,"stamp":"2024-05-08T18:32:49.472694+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2397793017,"num_objects":771,"num_object_clones":0,"num_object_copies":1542,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":771,"num_whiteouts":0,"num_read":2061,"num_read_kb":1781,"num_write":1679,"num_write_kb":2367361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2469,"ondisk_log_size":2469,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":4943676,"kb_used_data":4694188,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":750031044,"statfs":{"total":773094113280,"available":768031789056,"internally_reserved":0,"allocated":4806848512,"data_stored":4801967693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002606"},"pg_stats":[{"pgid":"3.3f","version":"93'10","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.938099+0000","last_change":"2024-05-08T18:29:40.574221+0000","last_active":"2024-05-08T18:32:46.938099+0000","last_peered":"2024-05-08T18:32:46.938099+0000","last_clean":"2024-05-08T18:32:46.938099+0000","last_became_active":"2024-05-08T18:29:40.573543+0000","last_became_peered":"2024-05-08T18:29:40.573543+0000","last_unstale":"2024-05-08T18:32:46.938099+0000","last_undegraded":"2024-05-08T18:32:46.938099+0000","last_fullsized":"2024-05-08T18:32:46.938099+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:57.223609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39845888,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"97'2","reported_seq":195,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-08T18:32:45.237855+0000","last_change":"2024-05-08T18:29:42.563773+0000","last_active":"2024-05-08T18:32:45.237855+0000","last_peered":"2024-05-08T18:32:45.237855+0000","last_clean":"2024-05-08T18:32:45.237855+0000","last_became_active":"2024-05-08T18:29:42.561201+0000","last_became_peered":"2024-05-08T18:29:42.561201+0000","last_unstale":"2024-05-08T18:32:45.237855+0000","last_undegraded":"2024-05-08T18:32:45.237855+0000","last_fullsized":"2024-05-08T18:32:45.237855+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:55.055481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"93'10","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.919609+0000","last_change":"2024-05-08T18:29:40.549299+0000","last_active":"2024-05-08T18:32:46.919609+0000","last_peered":"2024-05-08T18:32:46.919609+0000","last_clean":"2024-05-08T18:32:46.919609+0000","last_became_active":"2024-05-08T18:29:40.548930+0000","last_became_peered":"2024-05-08T18:29:40.548930+0000","last_unstale":"2024-05-08T18:32:46.919609+0000","last_undegraded":"2024-05-08T18:32:46.919609+0000","last_fullsized":"2024-05-08T18:32:46.919609+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:06:36.198647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"84'2","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.936351+0000","last_change":"2024-05-08T18:29:42.572074+0000","last_active":"2024-05-08T18:32:46.936351+0000","last_peered":"2024-05-08T18:32:46.936351+0000","last_clean":"2024-05-08T18:32:46.936351+0000","last_became_active":"2024-05-08T18:29:42.571344+0000","last_became_peered":"2024-05-08T18:29:42.571344+0000","last_unstale":"2024-05-08T18:32:46.936351+0000","last_undegraded":"2024-05-08T18:32:46.936351+0000","last_fullsized":"2024-05-08T18:32:46.936351+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:36.890277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"97'14","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863310+0000","last_change":"2024-05-08T18:29:40.539048+0000","last_active":"2024-05-08T18:32:46.863310+0000","last_peered":"2024-05-08T18:32:46.863310+0000","last_clean":"2024-05-08T18:32:46.863310+0000","last_became_active":"2024-05-08T18:29:40.538458+0000","last_became_peered":"2024-05-08T18:29:40.538458+0000","last_unstale":"2024-05-08T18:32:46.863310+0000","last_undegraded":"2024-05-08T18:32:46.863310+0000","last_fullsized":"2024-05-08T18:32:46.863310+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:36:37.796095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":3,"num_read_kb":4,"num_write":24,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.058600+0000","last_change":"2024-05-08T18:29:42.569718+0000","last_active":"2024-05-08T18:32:46.058600+0000","last_peered":"2024-05-08T18:32:46.058600+0000","last_clean":"2024-05-08T18:32:46.058600+0000","last_became_active":"2024-05-08T18:29:42.569026+0000","last_became_peered":"2024-05-08T18:29:42.569026+0000","last_unstale":"2024-05-08T18:32:46.058600+0000","last_undegraded":"2024-05-08T18:32:46.058600+0000","last_fullsized":"2024-05-08T18:32:46.058600+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:42.045615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"84'8","reported_seq":202,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-08T18:32:45.242814+0000","last_change":"2024-05-08T18:29:40.557700+0000","last_active":"2024-05-08T18:32:45.242814+0000","last_peered":"2024-05-08T18:32:45.242814+0000","last_clean":"2024-05-08T18:32:45.242814+0000","last_became_active":"2024-05-08T18:29:40.556884+0000","last_became_peered":"2024-05-08T18:29:40.556884+0000","last_unstale":"2024-05-08T18:32:45.242814+0000","last_undegraded":"2024-05-08T18:32:45.242814+0000","last_fullsized":"2024-05-08T18:32:45.242814+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:21:38.354933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.861228+0000","last_change":"2024-05-08T18:29:42.566448+0000","last_active":"2024-05-08T18:32:46.861228+0000","last_peered":"2024-05-08T18:32:46.861228+0000","last_clean":"2024-05-08T18:32:46.861228+0000","last_became_active":"2024-05-08T18:29:42.566058+0000","last_became_peered":"2024-05-08T18:29:42.566058+0000","last_unstale":"2024-05-08T18:32:46.861228+0000","last_undegraded":"2024-05-08T18:32:46.861228+0000","last_fullsized":"2024-05-08T18:32:46.861228+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:53:03.097704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"93'5","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.936864+0000","last_change":"2024-05-08T18:29:40.571195+0000","last_active":"2024-05-08T18:32:46.936864+0000","last_peered":"2024-05-08T18:32:46.936864+0000","last_clean":"2024-05-08T18:32:46.936864+0000","last_became_active":"2024-05-08T18:29:40.570467+0000","last_became_peered":"2024-05-08T18:29:40.570467+0000","last_unstale":"2024-05-08T18:32:46.936864+0000","last_undegraded":"2024-05-08T18:32:46.936864+0000","last_fullsized":"2024-05-08T18:32:46.936864+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:39.986094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.849586+0000","last_change":"2024-05-08T18:29:42.566506+0000","last_active":"2024-05-08T18:32:46.849586+0000","last_peered":"2024-05-08T18:32:46.849586+0000","last_clean":"2024-05-08T18:32:46.849586+0000","last_became_active":"2024-05-08T18:29:42.565740+0000","last_became_peered":"2024-05-08T18:29:42.565740+0000","last_unstale":"2024-05-08T18:32:46.849586+0000","last_undegraded":"2024-05-08T18:32:46.849586+0000","last_fullsized":"2024-05-08T18:32:46.849586+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:58.320701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"93'7","reported_seq":201,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-08T18:32:45.240501+0000","last_change":"2024-05-08T18:29:40.538314+0000","last_active":"2024-05-08T18:32:45.240501+0000","last_peered":"2024-05-08T18:32:45.240501+0000","last_clean":"2024-05-08T18:32:45.240501+0000","last_became_active":"2024-05-08T18:29:40.537458+0000","last_became_peered":"2024-05-08T18:29:40.537458+0000","last_unstale":"2024-05-08T18:32:45.240501+0000","last_undegraded":"2024-05-08T18:32:45.240501+0000","last_fullsized":"2024-05-08T18:32:45.240501+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:56.300986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.059543+0000","last_change":"2024-05-08T18:29:42.570054+0000","last_active":"2024-05-08T18:32:46.059543+0000","last_peered":"2024-05-08T18:32:46.059543+0000","last_clean":"2024-05-08T18:32:46.059543+0000","last_became_active":"2024-05-08T18:29:42.569255+0000","last_became_peered":"2024-05-08T18:29:42.569255+0000","last_unstale":"2024-05-08T18:32:46.059543+0000","last_undegraded":"2024-05-08T18:32:46.059543+0000","last_fullsized":"2024-05-08T18:32:46.059543+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:11:01.702482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"93'18","reported_seq":164,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.060138+0000","last_change":"2024-05-08T18:30:21.210397+0000","last_active":"2024-05-08T18:32:46.060138+0000","last_peered":"2024-05-08T18:32:46.060138+0000","last_clean":"2024-05-08T18:32:46.060138+0000","last_became_active":"2024-05-08T18:30:21.210052+0000","last_became_peered":"2024-05-08T18:30:21.210052+0000","last_unstale":"2024-05-08T18:32:46.060138+0000","last_undegraded":"2024-05-08T18:32:46.060138+0000","last_fullsized":"2024-05-08T18:32:46.060138+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:51:05.355593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"97'4","reported_seq":200,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-08T18:32:45.243476+0000","last_change":"2024-05-08T18:29:42.562084+0000","last_active":"2024-05-08T18:32:45.243476+0000","last_peered":"2024-05-08T18:32:45.243476+0000","last_clean":"2024-05-08T18:32:45.243476+0000","last_became_active":"2024-05-08T18:29:42.560699+0000","last_became_peered":"2024-05-08T18:29:42.560699+0000","last_unstale":"2024-05-08T18:32:45.243476+0000","last_undegraded":"2024-05-08T18:32:45.243476+0000","last_fullsized":"2024-05-08T18:32:45.243476+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:09.787597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"93'13","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.063923+0000","last_change":"2024-05-08T18:29:40.564339+0000","last_active":"2024-05-08T18:32:46.063923+0000","last_peered":"2024-05-08T18:32:46.063923+0000","last_clean":"2024-05-08T18:32:46.063923+0000","last_became_active":"2024-05-08T18:29:40.564038+0000","last_became_peered":"2024-05-08T18:29:40.564038+0000","last_unstale":"2024-05-08T18:32:46.063923+0000","last_undegraded":"2024-05-08T18:32:46.063923+0000","last_fullsized":"2024-05-08T18:32:46.063923+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:40:23.287885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"84'8","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.064487+0000","last_change":"2024-05-08T18:29:42.570253+0000","last_active":"2024-05-08T18:32:46.064487+0000","last_peered":"2024-05-08T18:32:46.064487+0000","last_clean":"2024-05-08T18:32:46.064487+0000","last_became_active":"2024-05-08T18:29:42.569917+0000","last_became_peered":"2024-05-08T18:29:42.569917+0000","last_unstale":"2024-05-08T18:32:46.064487+0000","last_undegraded":"2024-05-08T18:32:46.064487+0000","last_fullsized":"2024-05-08T18:32:46.064487+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:14:45.575219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"84'4","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.057705+0000","last_change":"2024-05-08T18:29:42.568116+0000","last_active":"2024-05-08T18:32:46.057705+0000","last_peered":"2024-05-08T18:32:46.057705+0000","last_clean":"2024-05-08T18:32:46.057705+0000","last_became_active":"2024-05-08T18:29:42.567399+0000","last_became_peered":"2024-05-08T18:29:42.567399+0000","last_unstale":"2024-05-08T18:32:46.057705+0000","last_undegraded":"2024-05-08T18:32:46.057705+0000","last_fullsized":"2024-05-08T18:32:46.057705+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:35.037465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"93'13","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.938102+0000","last_change":"2024-05-08T18:29:40.571982+0000","last_active":"2024-05-08T18:32:46.938102+0000","last_peered":"2024-05-08T18:32:46.938102+0000","last_clean":"2024-05-08T18:32:46.938102+0000","last_became_active":"2024-05-08T18:29:40.570600+0000","last_became_peered":"2024-05-08T18:29:40.570600+0000","last_unstale":"2024-05-08T18:32:46.938102+0000","last_undegraded":"2024-05-08T18:32:46.938102+0000","last_fullsized":"2024-05-08T18:32:46.938102+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:54:14.520118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"80'2","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.936574+0000","last_change":"2024-05-08T18:29:42.578449+0000","last_active":"2024-05-08T18:32:46.936574+0000","last_peered":"2024-05-08T18:32:46.936574+0000","last_clean":"2024-05-08T18:32:46.936574+0000","last_became_active":"2024-05-08T18:29:42.577789+0000","last_became_peered":"2024-05-08T18:29:42.577789+0000","last_unstale":"2024-05-08T18:32:46.936574+0000","last_undegraded":"2024-05-08T18:32:46.936574+0000","last_fullsized":"2024-05-08T18:32:46.936574+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:09.787597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"93'8","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.849942+0000","last_change":"2024-05-08T18:29:40.570618+0000","last_active":"2024-05-08T18:32:46.849942+0000","last_peered":"2024-05-08T18:32:46.849942+0000","last_clean":"2024-05-08T18:32:46.849942+0000","last_became_active":"2024-05-08T18:29:40.569519+0000","last_became_peered":"2024-05-08T18:29:40.569519+0000","last_unstale":"2024-05-08T18:32:46.849942+0000","last_undegraded":"2024-05-08T18:32:46.849942+0000","last_fullsized":"2024-05-08T18:32:46.849942+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:09:42.581976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":190,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-08T18:32:45.240884+0000","last_change":"2024-05-08T18:29:42.563056+0000","last_active":"2024-05-08T18:32:45.240884+0000","last_peered":"2024-05-08T18:32:45.240884+0000","last_clean":"2024-05-08T18:32:45.240884+0000","last_became_active":"2024-05-08T18:29:42.562296+0000","last_became_peered":"2024-05-08T18:29:42.562296+0000","last_unstale":"2024-05-08T18:32:45.240884+0000","last_undegraded":"2024-05-08T18:32:45.240884+0000","last_fullsized":"2024-05-08T18:32:45.240884+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:36.890277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"93'14","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.849998+0000","last_change":"2024-05-08T18:29:40.564353+0000","last_active":"2024-05-08T18:32:46.849998+0000","last_peered":"2024-05-08T18:32:46.849998+0000","last_clean":"2024-05-08T18:32:46.849998+0000","last_became_active":"2024-05-08T18:29:40.563516+0000","last_became_peered":"2024-05-08T18:29:40.563516+0000","last_unstale":"2024-05-08T18:32:46.849998+0000","last_undegraded":"2024-05-08T18:32:46.849998+0000","last_fullsized":"2024-05-08T18:32:46.849998+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:06:36.198647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"97'4","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.061368+0000","last_change":"2024-05-08T18:29:42.567006+0000","last_active":"2024-05-08T18:32:46.061368+0000","last_peered":"2024-05-08T18:32:46.061368+0000","last_clean":"2024-05-08T18:32:46.061368+0000","last_became_active":"2024-05-08T18:29:42.566256+0000","last_became_peered":"2024-05-08T18:29:42.566256+0000","last_unstale":"2024-05-08T18:32:46.061368+0000","last_undegraded":"2024-05-08T18:32:46.061368+0000","last_fullsized":"2024-05-08T18:32:46.061368+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:09:44.601690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"93'7","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.059619+0000","last_change":"2024-05-08T18:29:40.573212+0000","last_active":"2024-05-08T18:32:46.059619+0000","last_peered":"2024-05-08T18:32:46.059619+0000","last_clean":"2024-05-08T18:32:46.059619+0000","last_became_active":"2024-05-08T18:29:40.572250+0000","last_became_peered":"2024-05-08T18:29:40.572250+0000","last_unstale":"2024-05-08T18:32:46.059619+0000","last_undegraded":"2024-05-08T18:32:46.059619+0000","last_fullsized":"2024-05-08T18:32:46.059619+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:25:01.595224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"97'6","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.062431+0000","last_change":"2024-05-08T18:29:42.570847+0000","last_active":"2024-05-08T18:32:46.062431+0000","last_peered":"2024-05-08T18:32:46.062431+0000","last_clean":"2024-05-08T18:32:46.062431+0000","last_became_active":"2024-05-08T18:29:42.570435+0000","last_became_peered":"2024-05-08T18:29:42.570435+0000","last_unstale":"2024-05-08T18:32:46.062431+0000","last_undegraded":"2024-05-08T18:32:46.062431+0000","last_fullsized":"2024-05-08T18:32:46.062431+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:21:40.374647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"93'7","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.063428+0000","last_change":"2024-05-08T18:29:40.566815+0000","last_active":"2024-05-08T18:32:46.063428+0000","last_peered":"2024-05-08T18:32:46.063428+0000","last_clean":"2024-05-08T18:32:46.063428+0000","last_became_active":"2024-05-08T18:29:40.566531+0000","last_became_peered":"2024-05-08T18:29:40.566531+0000","last_unstale":"2024-05-08T18:32:46.063428+0000","last_undegraded":"2024-05-08T18:32:46.063428+0000","last_fullsized":"2024-05-08T18:32:46.063428+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:52.462279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"84'8","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.059681+0000","last_change":"2024-05-08T18:29:42.554846+0000","last_active":"2024-05-08T18:32:46.059681+0000","last_peered":"2024-05-08T18:32:46.059681+0000","last_clean":"2024-05-08T18:32:46.059681+0000","last_became_active":"2024-05-08T18:29:42.554115+0000","last_became_peered":"2024-05-08T18:29:42.554115+0000","last_unstale":"2024-05-08T18:32:46.059681+0000","last_undegraded":"2024-05-08T18:32:46.059681+0000","last_fullsized":"2024-05-08T18:32:46.059681+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:22:14.793035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"93'7","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.862823+0000","last_change":"2024-05-08T18:29:40.547776+0000","last_active":"2024-05-08T18:32:46.862823+0000","last_peered":"2024-05-08T18:32:46.862823+0000","last_clean":"2024-05-08T18:32:46.862823+0000","last_became_active":"2024-05-08T18:29:40.547384+0000","last_became_peered":"2024-05-08T18:29:40.547384+0000","last_unstale":"2024-05-08T18:32:46.862823+0000","last_undegraded":"2024-05-08T18:32:46.862823+0000","last_fullsized":"2024-05-08T18:32:46.862823+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:14:26.628603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"97'10","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.057195+0000","last_change":"2024-05-08T18:29:50.685390+0000","last_active":"2024-05-08T18:32:46.057195+0000","last_peered":"2024-05-08T18:32:46.057195+0000","last_clean":"2024-05-08T18:32:46.057195+0000","last_became_active":"2024-05-08T18:29:50.684644+0000","last_became_peered":"2024-05-08T18:29:50.684644+0000","last_unstale":"2024-05-08T18:32:46.057195+0000","last_undegraded":"2024-05-08T18:32:46.057195+0000","last_fullsized":"2024-05-08T18:32:46.057195+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:10:38.951662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":21,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"84'10","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.066363+0000","last_change":"2024-05-08T18:29:42.573805+0000","last_active":"2024-05-08T18:32:46.066363+0000","last_peered":"2024-05-08T18:32:46.066363+0000","last_clean":"2024-05-08T18:32:46.066363+0000","last_became_active":"2024-05-08T18:29:42.573296+0000","last_became_peered":"2024-05-08T18:29:42.573296+0000","last_unstale":"2024-05-08T18:32:46.066363+0000","last_undegraded":"2024-05-08T18:32:46.066363+0000","last_fullsized":"2024-05-08T18:32:46.066363+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:21.935293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"93'8","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.937043+0000","last_change":"2024-05-08T18:29:40.570733+0000","last_active":"2024-05-08T18:32:46.937043+0000","last_peered":"2024-05-08T18:32:46.937043+0000","last_clean":"2024-05-08T18:32:46.937043+0000","last_became_active":"2024-05-08T18:29:40.569711+0000","last_became_peered":"2024-05-08T18:29:40.569711+0000","last_unstale":"2024-05-08T18:32:46.937043+0000","last_undegraded":"2024-05-08T18:32:46.937043+0000","last_fullsized":"2024-05-08T18:32:46.937043+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:18:08.784274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":186,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-08T18:32:45.242768+0000","last_change":"2024-05-08T18:29:44.594185+0000","last_active":"2024-05-08T18:32:45.242768+0000","last_peered":"2024-05-08T18:32:45.242768+0000","last_clean":"2024-05-08T18:32:45.242768+0000","last_became_active":"2024-05-08T18:29:44.593442+0000","last_became_peered":"2024-05-08T18:29:44.593442+0000","last_unstale":"2024-05-08T18:32:45.242768+0000","last_undegraded":"2024-05-08T18:32:45.242768+0000","last_fullsized":"2024-05-08T18:32:45.242768+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:52:25.736491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"97'15","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863258+0000","last_change":"2024-05-08T18:29:46.594652+0000","last_active":"2024-05-08T18:32:46.863258+0000","last_peered":"2024-05-08T18:32:46.863258+0000","last_clean":"2024-05-08T18:32:46.863258+0000","last_became_active":"2024-05-08T18:29:46.593656+0000","last_became_peered":"2024-05-08T18:29:46.593656+0000","last_unstale":"2024-05-08T18:32:46.863258+0000","last_undegraded":"2024-05-08T18:32:46.863258+0000","last_fullsized":"2024-05-08T18:32:46.863258+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:50:27.608888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.937817+0000","last_change":"2024-05-08T18:29:48.639834+0000","last_active":"2024-05-08T18:32:46.937817+0000","last_peered":"2024-05-08T18:32:46.937817+0000","last_clean":"2024-05-08T18:32:46.937817+0000","last_became_active":"2024-05-08T18:29:48.639122+0000","last_became_peered":"2024-05-08T18:29:48.639122+0000","last_unstale":"2024-05-08T18:32:46.937817+0000","last_undegraded":"2024-05-08T18:32:46.937817+0000","last_fullsized":"2024-05-08T18:32:46.937817+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:14:22.304773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"83'4","reported_seq":179,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-08T18:32:45.239607+0000","last_change":"2024-05-08T18:29:50.672303+0000","last_active":"2024-05-08T18:32:45.239607+0000","last_peered":"2024-05-08T18:32:45.239607+0000","last_clean":"2024-05-08T18:32:45.239607+0000","last_became_active":"2024-05-08T18:29:50.671513+0000","last_became_peered":"2024-05-08T18:29:50.671513+0000","last_unstale":"2024-05-08T18:32:45.239607+0000","last_undegraded":"2024-05-08T18:32:45.239607+0000","last_fullsized":"2024-05-08T18:32:45.239607+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:12:05.780786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"84'4","reported_seq":200,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-08T18:32:45.243275+0000","last_change":"2024-05-08T18:29:42.565462+0000","last_active":"2024-05-08T18:32:45.243275+0000","last_peered":"2024-05-08T18:32:45.243275+0000","last_clean":"2024-05-08T18:32:45.243275+0000","last_became_active":"2024-05-08T18:29:42.564741+0000","last_became_peered":"2024-05-08T18:29:42.564741+0000","last_unstale":"2024-05-08T18:32:45.243275+0000","last_undegraded":"2024-05-08T18:32:45.243275+0000","last_fullsized":"2024-05-08T18:32:45.243275+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:25:56.129785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"93'6","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.862908+0000","last_change":"2024-05-08T18:29:40.564796+0000","last_active":"2024-05-08T18:32:46.862908+0000","last_peered":"2024-05-08T18:32:46.862908+0000","last_clean":"2024-05-08T18:32:46.862908+0000","last_became_active":"2024-05-08T18:29:40.564401+0000","last_became_peered":"2024-05-08T18:29:40.564401+0000","last_unstale":"2024-05-08T18:32:46.862908+0000","last_undegraded":"2024-05-08T18:32:46.862908+0000","last_fullsized":"2024-05-08T18:32:46.862908+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:19:11.492397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":189,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.065935+0000","last_change":"2024-05-08T18:29:44.587689+0000","last_active":"2024-05-08T18:32:46.065935+0000","last_peered":"2024-05-08T18:32:46.065935+0000","last_clean":"2024-05-08T18:32:46.065935+0000","last_became_active":"2024-05-08T18:29:44.586975+0000","last_became_peered":"2024-05-08T18:29:44.586975+0000","last_unstale":"2024-05-08T18:32:46.065935+0000","last_undegraded":"2024-05-08T18:32:46.065935+0000","last_fullsized":"2024-05-08T18:32:46.065935+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:04:49.020450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"83'7","reported_seq":197,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.059952+0000","last_change":"2024-05-08T18:29:46.600906+0000","last_active":"2024-05-08T18:32:46.059952+0000","last_peered":"2024-05-08T18:32:46.059952+0000","last_clean":"2024-05-08T18:32:46.059952+0000","last_became_active":"2024-05-08T18:29:46.599894+0000","last_became_peered":"2024-05-08T18:29:46.599894+0000","last_unstale":"2024-05-08T18:32:46.059952+0000","last_undegraded":"2024-05-08T18:32:46.059952+0000","last_fullsized":"2024-05-08T18:32:46.059952+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:24:13.568294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.059189+0000","last_change":"2024-05-08T18:29:48.614324+0000","last_active":"2024-05-08T18:32:46.059189+0000","last_peered":"2024-05-08T18:32:46.059189+0000","last_clean":"2024-05-08T18:32:46.059189+0000","last_became_active":"2024-05-08T18:29:48.613591+0000","last_became_peered":"2024-05-08T18:29:48.613591+0000","last_unstale":"2024-05-08T18:32:46.059189+0000","last_undegraded":"2024-05-08T18:32:46.059189+0000","last_fullsized":"2024-05-08T18:32:46.059189+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:47:54.034851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.862656+0000","last_change":"2024-05-08T18:29:50.684773+0000","last_active":"2024-05-08T18:32:46.862656+0000","last_peered":"2024-05-08T18:32:46.862656+0000","last_clean":"2024-05-08T18:32:46.862656+0000","last_became_active":"2024-05-08T18:29:50.683931+0000","last_became_peered":"2024-05-08T18:29:50.683931+0000","last_unstale":"2024-05-08T18:32:46.862656+0000","last_undegraded":"2024-05-08T18:32:46.862656+0000","last_fullsized":"2024-05-08T18:32:46.862656+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:17:10.582636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"80'2","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.861209+0000","last_change":"2024-05-08T18:29:42.574437+0000","last_active":"2024-05-08T18:32:46.861209+0000","last_peered":"2024-05-08T18:32:46.861209+0000","last_clean":"2024-05-08T18:32:46.861209+0000","last_became_active":"2024-05-08T18:29:42.574146+0000","last_became_peered":"2024-05-08T18:29:42.574146+0000","last_unstale":"2024-05-08T18:32:46.861209+0000","last_undegraded":"2024-05-08T18:32:46.861209+0000","last_fullsized":"2024-05-08T18:32:46.861209+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:55:30.468069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"93'11","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.936641+0000","last_change":"2024-05-08T18:29:40.559677+0000","last_active":"2024-05-08T18:32:46.936641+0000","last_peered":"2024-05-08T18:32:46.936641+0000","last_clean":"2024-05-08T18:32:46.936641+0000","last_became_active":"2024-05-08T18:29:40.558819+0000","last_became_peered":"2024-05-08T18:29:40.558819+0000","last_unstale":"2024-05-08T18:32:46.936641+0000","last_undegraded":"2024-05-08T18:32:46.936641+0000","last_fullsized":"2024-05-08T18:32:46.936641+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:28.426657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":189,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.067875+0000","last_change":"2024-05-08T18:29:44.596801+0000","last_active":"2024-05-08T18:32:46.067875+0000","last_peered":"2024-05-08T18:32:46.067875+0000","last_clean":"2024-05-08T18:32:46.067875+0000","last_became_active":"2024-05-08T18:29:44.596111+0000","last_became_peered":"2024-05-08T18:29:44.596111+0000","last_unstale":"2024-05-08T18:32:46.067875+0000","last_undegraded":"2024-05-08T18:32:46.067875+0000","last_fullsized":"2024-05-08T18:32:46.067875+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:04.423266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"33'10","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.061447+0000","last_change":"2024-05-08T18:29:46.608330+0000","last_active":"2024-05-08T18:32:46.061447+0000","last_peered":"2024-05-08T18:32:46.061447+0000","last_clean":"2024-05-08T18:32:46.061447+0000","last_became_active":"2024-05-08T18:29:46.607580+0000","last_became_peered":"2024-05-08T18:29:46.607580+0000","last_unstale":"2024-05-08T18:32:46.061447+0000","last_undegraded":"2024-05-08T18:32:46.061447+0000","last_fullsized":"2024-05-08T18:32:46.061447+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:22:18.837103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"97'101","reported_seq":405,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.937262+0000","last_change":"2024-05-08T18:29:48.642718+0000","last_active":"2024-05-08T18:32:46.937262+0000","last_peered":"2024-05-08T18:32:46.937262+0000","last_clean":"2024-05-08T18:32:46.937262+0000","last_became_active":"2024-05-08T18:29:48.641950+0000","last_became_peered":"2024-05-08T18:29:48.641950+0000","last_unstale":"2024-05-08T18:32:46.937262+0000","last_undegraded":"2024-05-08T18:32:46.937262+0000","last_fullsized":"2024-05-08T18:32:46.937262+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:00:11.720096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"84'2","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.058647+0000","last_change":"2024-05-08T18:29:50.660378+0000","last_active":"2024-05-08T18:32:46.058647+0000","last_peered":"2024-05-08T18:32:46.058647+0000","last_clean":"2024-05-08T18:32:46.058647+0000","last_became_active":"2024-05-08T18:29:50.659649+0000","last_became_peered":"2024-05-08T18:29:50.659649+0000","last_unstale":"2024-05-08T18:32:46.058647+0000","last_undegraded":"2024-05-08T18:32:46.058647+0000","last_fullsized":"2024-05-08T18:32:46.058647+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:34:14.488295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"80'2","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.066931+0000","last_change":"2024-05-08T18:29:42.577267+0000","last_active":"2024-05-08T18:32:46.066931+0000","last_peered":"2024-05-08T18:32:46.066931+0000","last_clean":"2024-05-08T18:32:46.066931+0000","last_became_active":"2024-05-08T18:29:42.576740+0000","last_became_peered":"2024-05-08T18:29:42.576740+0000","last_unstale":"2024-05-08T18:32:46.066931+0000","last_undegraded":"2024-05-08T18:32:46.066931+0000","last_fullsized":"2024-05-08T18:32:46.066931+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:57:14.869860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"93'5","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.848368+0000","last_change":"2024-05-08T18:29:40.547524+0000","last_active":"2024-05-08T18:32:46.848368+0000","last_peered":"2024-05-08T18:32:46.848368+0000","last_clean":"2024-05-08T18:32:46.848368+0000","last_became_active":"2024-05-08T18:29:40.545749+0000","last_became_peered":"2024-05-08T18:29:40.545749+0000","last_unstale":"2024-05-08T18:32:46.848368+0000","last_undegraded":"2024-05-08T18:32:46.848368+0000","last_fullsized":"2024-05-08T18:32:46.848368+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:12:59.146887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":186,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-08T18:32:45.243038+0000","last_change":"2024-05-08T18:29:44.579839+0000","last_active":"2024-05-08T18:32:45.243038+0000","last_peered":"2024-05-08T18:32:45.243038+0000","last_clean":"2024-05-08T18:32:45.243038+0000","last_became_active":"2024-05-08T18:29:44.578142+0000","last_became_peered":"2024-05-08T18:29:44.578142+0000","last_unstale":"2024-05-08T18:32:45.243038+0000","last_undegraded":"2024-05-08T18:32:45.243038+0000","last_fullsized":"2024-05-08T18:32:45.243038+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:51:09.413191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"97'15","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.937446+0000","last_change":"2024-05-08T18:29:46.607288+0000","last_active":"2024-05-08T18:32:46.937446+0000","last_peered":"2024-05-08T18:32:46.937446+0000","last_clean":"2024-05-08T18:32:46.937446+0000","last_became_active":"2024-05-08T18:29:46.605154+0000","last_became_peered":"2024-05-08T18:29:46.605154+0000","last_unstale":"2024-05-08T18:32:46.937446+0000","last_undegraded":"2024-05-08T18:32:46.937446+0000","last_fullsized":"2024-05-08T18:32:46.937446+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:23.940519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"97'101","reported_seq":324,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.065609+0000","last_change":"2024-05-08T18:29:48.634956+0000","last_active":"2024-05-08T18:32:46.065609+0000","last_peered":"2024-05-08T18:32:46.065609+0000","last_clean":"2024-05-08T18:32:46.065609+0000","last_became_active":"2024-05-08T18:29:48.633858+0000","last_became_peered":"2024-05-08T18:29:48.633858+0000","last_unstale":"2024-05-08T18:32:46.065609+0000","last_undegraded":"2024-05-08T18:32:46.065609+0000","last_fullsized":"2024-05-08T18:32:46.065609+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:50:48.169666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"84'8","reported_seq":210,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-08T18:32:45.239370+0000","last_change":"2024-05-08T18:29:42.567744+0000","last_active":"2024-05-08T18:32:45.239370+0000","last_peered":"2024-05-08T18:32:45.239370+0000","last_clean":"2024-05-08T18:32:45.239370+0000","last_became_active":"2024-05-08T18:29:42.566974+0000","last_became_peered":"2024-05-08T18:29:42.566974+0000","last_unstale":"2024-05-08T18:32:45.239370+0000","last_undegraded":"2024-05-08T18:32:45.239370+0000","last_fullsized":"2024-05-08T18:32:45.239370+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:42.045615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"93'10","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.938419+0000","last_change":"2024-05-08T18:29:40.572499+0000","last_active":"2024-05-08T18:32:46.938419+0000","last_peered":"2024-05-08T18:32:46.938419+0000","last_clean":"2024-05-08T18:32:46.938419+0000","last_became_active":"2024-05-08T18:29:40.571322+0000","last_became_peered":"2024-05-08T18:29:40.571322+0000","last_unstale":"2024-05-08T18:32:46.938419+0000","last_undegraded":"2024-05-08T18:32:46.938419+0000","last_fullsized":"2024-05-08T18:32:46.938419+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:31.119374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.935697+0000","last_change":"2024-05-08T18:29:44.597045+0000","last_active":"2024-05-08T18:32:46.935697+0000","last_peered":"2024-05-08T18:32:46.935697+0000","last_clean":"2024-05-08T18:32:46.935697+0000","last_became_active":"2024-05-08T18:29:44.596282+0000","last_became_peered":"2024-05-08T18:29:44.596282+0000","last_unstale":"2024-05-08T18:32:46.935697+0000","last_undegraded":"2024-05-08T18:32:46.935697+0000","last_fullsized":"2024-05-08T18:32:46.935697+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:35:51.288126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"97'26","reported_seq":220,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-08T18:32:45.239755+0000","last_change":"2024-05-08T18:29:46.590633+0000","last_active":"2024-05-08T18:32:45.239755+0000","last_peered":"2024-05-08T18:32:45.239755+0000","last_clean":"2024-05-08T18:32:45.239755+0000","last_became_active":"2024-05-08T18:29:46.589600+0000","last_became_peered":"2024-05-08T18:29:46.589600+0000","last_unstale":"2024-05-08T18:32:45.239755+0000","last_undegraded":"2024-05-08T18:32:45.239755+0000","last_fullsized":"2024-05-08T18:32:45.239755+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:23.940519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.917121+0000","last_change":"2024-05-08T18:29:48.630758+0000","last_active":"2024-05-08T18:32:46.917121+0000","last_peered":"2024-05-08T18:32:46.917121+0000","last_clean":"2024-05-08T18:32:46.917121+0000","last_became_active":"2024-05-08T18:29:48.630017+0000","last_became_peered":"2024-05-08T18:29:48.630017+0000","last_unstale":"2024-05-08T18:32:46.917121+0000","last_undegraded":"2024-05-08T18:32:46.917121+0000","last_fullsized":"2024-05-08T18:32:46.917121+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:39.879384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"97'14","reported_seq":197,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-08T18:32:45.242344+0000","last_change":"2024-05-08T18:29:50.672682+0000","last_active":"2024-05-08T18:32:45.242344+0000","last_peered":"2024-05-08T18:32:45.242344+0000","last_clean":"2024-05-08T18:32:45.242344+0000","last_became_active":"2024-05-08T18:29:50.671923+0000","last_became_peered":"2024-05-08T18:29:50.671923+0000","last_unstale":"2024-05-08T18:32:45.242344+0000","last_undegraded":"2024-05-08T18:32:45.242344+0000","last_fullsized":"2024-05-08T18:32:45.242344+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:38.318890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":39,"num_write":35,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"80'2","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.057722+0000","last_change":"2024-05-08T18:29:42.554289+0000","last_active":"2024-05-08T18:32:46.057722+0000","last_peered":"2024-05-08T18:32:46.057722+0000","last_clean":"2024-05-08T18:32:46.057722+0000","last_became_active":"2024-05-08T18:29:42.553574+0000","last_became_peered":"2024-05-08T18:29:42.553574+0000","last_unstale":"2024-05-08T18:32:46.057722+0000","last_undegraded":"2024-05-08T18:32:46.057722+0000","last_fullsized":"2024-05-08T18:32:46.057722+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:42.005809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"93'7","reported_seq":201,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.938183+0000","last_change":"2024-05-08T18:29:40.570169+0000","last_active":"2024-05-08T18:32:46.938183+0000","last_peered":"2024-05-08T18:32:46.938183+0000","last_clean":"2024-05-08T18:32:46.938183+0000","last_became_active":"2024-05-08T18:29:40.569542+0000","last_became_peered":"2024-05-08T18:29:40.569542+0000","last_unstale":"2024-05-08T18:32:46.938183+0000","last_undegraded":"2024-05-08T18:32:46.938183+0000","last_fullsized":"2024-05-08T18:32:46.938183+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:08:13.006752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"26'1","reported_seq":257,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.060325+0000","last_change":"2024-05-08T18:29:44.579659+0000","last_active":"2024-05-08T18:32:46.060325+0000","last_peered":"2024-05-08T18:32:46.060325+0000","last_clean":"2024-05-08T18:32:46.060325+0000","last_became_active":"2024-05-08T18:29:44.579152+0000","last_became_peered":"2024-05-08T18:29:44.579152+0000","last_unstale":"2024-05-08T18:32:46.060325+0000","last_undegraded":"2024-05-08T18:32:46.060325+0000","last_fullsized":"2024-05-08T18:32:46.060325+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:15:00.358583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"97'15","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.064379+0000","last_change":"2024-05-08T18:29:46.600224+0000","last_active":"2024-05-08T18:32:46.064379+0000","last_peered":"2024-05-08T18:32:46.064379+0000","last_clean":"2024-05-08T18:32:46.064379+0000","last_became_active":"2024-05-08T18:29:46.599464+0000","last_became_peered":"2024-05-08T18:29:46.599464+0000","last_unstale":"2024-05-08T18:32:46.064379+0000","last_undegraded":"2024-05-08T18:32:46.064379+0000","last_fullsized":"2024-05-08T18:32:46.064379+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:26:40.238188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.061779+0000","last_change":"2024-05-08T18:29:48.637939+0000","last_active":"2024-05-08T18:32:46.061779+0000","last_peered":"2024-05-08T18:32:46.061779+0000","last_clean":"2024-05-08T18:32:46.061779+0000","last_became_active":"2024-05-08T18:29:48.637231+0000","last_became_peered":"2024-05-08T18:29:48.637231+0000","last_unstale":"2024-05-08T18:32:46.061779+0000","last_undegraded":"2024-05-08T18:32:46.061779+0000","last_fullsized":"2024-05-08T18:32:46.061779+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:04.571608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":174,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.847775+0000","last_change":"2024-05-08T18:29:50.681831+0000","last_active":"2024-05-08T18:32:46.847775+0000","last_peered":"2024-05-08T18:32:46.847775+0000","last_clean":"2024-05-08T18:32:46.847775+0000","last_became_active":"2024-05-08T18:29:50.681287+0000","last_became_peered":"2024-05-08T18:29:50.681287+0000","last_unstale":"2024-05-08T18:32:46.847775+0000","last_undegraded":"2024-05-08T18:32:46.847775+0000","last_fullsized":"2024-05-08T18:32:46.847775+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:30:24.111488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.849322+0000","last_change":"2024-05-08T18:29:42.562975+0000","last_active":"2024-05-08T18:32:46.849322+0000","last_peered":"2024-05-08T18:32:46.849322+0000","last_clean":"2024-05-08T18:32:46.849322+0000","last_became_active":"2024-05-08T18:29:42.562267+0000","last_became_peered":"2024-05-08T18:29:42.562267+0000","last_unstale":"2024-05-08T18:32:46.849322+0000","last_undegraded":"2024-05-08T18:32:46.849322+0000","last_fullsized":"2024-05-08T18:32:46.849322+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:30.446371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"93'7","reported_seq":201,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.938062+0000","last_change":"2024-05-08T18:29:40.570736+0000","last_active":"2024-05-08T18:32:46.938062+0000","last_peered":"2024-05-08T18:32:46.938062+0000","last_clean":"2024-05-08T18:32:46.938062+0000","last_became_active":"2024-05-08T18:29:40.569626+0000","last_became_peered":"2024-05-08T18:29:40.569626+0000","last_unstale":"2024-05-08T18:32:46.938062+0000","last_undegraded":"2024-05-08T18:32:46.938062+0000","last_fullsized":"2024-05-08T18:32:46.938062+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:56.300986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"26'1","reported_seq":257,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.062164+0000","last_change":"2024-05-08T18:29:44.581748+0000","last_active":"2024-05-08T18:32:46.062164+0000","last_peered":"2024-05-08T18:32:46.062164+0000","last_clean":"2024-05-08T18:32:46.062164+0000","last_became_active":"2024-05-08T18:29:44.581067+0000","last_became_peered":"2024-05-08T18:29:44.581067+0000","last_unstale":"2024-05-08T18:32:46.062164+0000","last_undegraded":"2024-05-08T18:32:46.062164+0000","last_fullsized":"2024-05-08T18:32:46.062164+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:44.043691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"97'21","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.936022+0000","last_change":"2024-05-08T18:29:46.605887+0000","last_active":"2024-05-08T18:32:46.936022+0000","last_peered":"2024-05-08T18:32:46.936022+0000","last_clean":"2024-05-08T18:32:46.936022+0000","last_became_active":"2024-05-08T18:29:46.604966+0000","last_became_peered":"2024-05-08T18:29:46.604966+0000","last_unstale":"2024-05-08T18:32:46.936022+0000","last_undegraded":"2024-05-08T18:32:46.936022+0000","last_fullsized":"2024-05-08T18:32:46.936022+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:07:54.654205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"97'101","reported_seq":324,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.862395+0000","last_change":"2024-05-08T18:29:48.638657+0000","last_active":"2024-05-08T18:32:46.862395+0000","last_peered":"2024-05-08T18:32:46.862395+0000","last_clean":"2024-05-08T18:32:46.862395+0000","last_became_active":"2024-05-08T18:29:48.637758+0000","last_became_peered":"2024-05-08T18:29:48.637758+0000","last_unstale":"2024-05-08T18:32:46.862395+0000","last_undegraded":"2024-05-08T18:32:46.862395+0000","last_fullsized":"2024-05-08T18:32:46.862395+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:45:24.153991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"97'2","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863289+0000","last_change":"2024-05-08T18:29:50.684501+0000","last_active":"2024-05-08T18:32:46.863289+0000","last_peered":"2024-05-08T18:32:46.863289+0000","last_clean":"2024-05-08T18:32:46.863289+0000","last_became_active":"2024-05-08T18:29:50.683738+0000","last_became_peered":"2024-05-08T18:29:50.683738+0000","last_unstale":"2024-05-08T18:32:46.863289+0000","last_undegraded":"2024-05-08T18:32:46.863289+0000","last_fullsized":"2024-05-08T18:32:46.863289+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:22.834262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"84'4","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863429+0000","last_change":"2024-05-08T18:29:42.569401+0000","last_active":"2024-05-08T18:32:46.863429+0000","last_peered":"2024-05-08T18:32:46.863429+0000","last_clean":"2024-05-08T18:32:46.863429+0000","last_became_active":"2024-05-08T18:29:42.568659+0000","last_became_peered":"2024-05-08T18:29:42.568659+0000","last_unstale":"2024-05-08T18:32:46.863429+0000","last_undegraded":"2024-05-08T18:32:46.863429+0000","last_fullsized":"2024-05-08T18:32:46.863429+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:35:23.016110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"93'8","reported_seq":203,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-08T18:32:45.243320+0000","last_change":"2024-05-08T18:29:40.557076+0000","last_active":"2024-05-08T18:32:45.243320+0000","last_peered":"2024-05-08T18:32:45.243320+0000","last_clean":"2024-05-08T18:32:45.243320+0000","last_became_active":"2024-05-08T18:29:40.555805+0000","last_became_peered":"2024-05-08T18:29:40.555805+0000","last_unstale":"2024-05-08T18:32:45.243320+0000","last_undegraded":"2024-05-08T18:32:45.243320+0000","last_fullsized":"2024-05-08T18:32:45.243320+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:13.946346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":18,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":189,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.060997+0000","last_change":"2024-05-08T18:29:44.573892+0000","last_active":"2024-05-08T18:32:46.060997+0000","last_peered":"2024-05-08T18:32:46.060997+0000","last_clean":"2024-05-08T18:32:46.060997+0000","last_became_active":"2024-05-08T18:29:44.573308+0000","last_became_peered":"2024-05-08T18:29:44.573308+0000","last_unstale":"2024-05-08T18:32:46.060997+0000","last_undegraded":"2024-05-08T18:32:46.060997+0000","last_fullsized":"2024-05-08T18:32:46.060997+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:37.075348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"97'24","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.862514+0000","last_change":"2024-05-08T18:29:46.595585+0000","last_active":"2024-05-08T18:32:46.862514+0000","last_peered":"2024-05-08T18:32:46.862514+0000","last_clean":"2024-05-08T18:32:46.862514+0000","last_became_active":"2024-05-08T18:29:46.594930+0000","last_became_peered":"2024-05-08T18:29:46.594930+0000","last_unstale":"2024-05-08T18:32:46.862514+0000","last_undegraded":"2024-05-08T18:32:46.862514+0000","last_fullsized":"2024-05-08T18:32:46.862514+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:11.768269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.059998+0000","last_change":"2024-05-08T18:29:48.638137+0000","last_active":"2024-05-08T18:32:46.059998+0000","last_peered":"2024-05-08T18:32:46.059998+0000","last_clean":"2024-05-08T18:32:46.059998+0000","last_became_active":"2024-05-08T18:29:48.637370+0000","last_became_peered":"2024-05-08T18:29:48.637370+0000","last_unstale":"2024-05-08T18:32:46.059998+0000","last_undegraded":"2024-05-08T18:32:46.059998+0000","last_fullsized":"2024-05-08T18:32:46.059998+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:15.859849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"83'2","reported_seq":182,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.916145+0000","last_change":"2024-05-08T18:29:50.688760+0000","last_active":"2024-05-08T18:32:46.916145+0000","last_peered":"2024-05-08T18:32:46.916145+0000","last_clean":"2024-05-08T18:32:46.916145+0000","last_became_active":"2024-05-08T18:29:50.687960+0000","last_became_peered":"2024-05-08T18:29:50.687960+0000","last_unstale":"2024-05-08T18:32:46.916145+0000","last_undegraded":"2024-05-08T18:32:46.916145+0000","last_fullsized":"2024-05-08T18:32:46.916145+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:21:19.624895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"97'4","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.060220+0000","last_change":"2024-05-08T18:29:42.557850+0000","last_active":"2024-05-08T18:32:46.060220+0000","last_peered":"2024-05-08T18:32:46.060220+0000","last_clean":"2024-05-08T18:32:46.060220+0000","last_became_active":"2024-05-08T18:29:42.557119+0000","last_became_peered":"2024-05-08T18:29:42.557119+0000","last_unstale":"2024-05-08T18:32:46.060220+0000","last_undegraded":"2024-05-08T18:32:46.060220+0000","last_fullsized":"2024-05-08T18:32:46.060220+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:25:56.129785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"93'8","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.062755+0000","last_change":"2024-05-08T18:29:40.544530+0000","last_active":"2024-05-08T18:32:46.062755+0000","last_peered":"2024-05-08T18:32:46.062755+0000","last_clean":"2024-05-08T18:32:46.062755+0000","last_became_active":"2024-05-08T18:29:40.544215+0000","last_became_peered":"2024-05-08T18:29:40.544215+0000","last_unstale":"2024-05-08T18:32:46.062755+0000","last_undegraded":"2024-05-08T18:32:46.062755+0000","last_fullsized":"2024-05-08T18:32:46.062755+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:14:26.628603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":189,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.063283+0000","last_change":"2024-05-08T18:29:44.588227+0000","last_active":"2024-05-08T18:32:46.063283+0000","last_peered":"2024-05-08T18:32:46.063283+0000","last_clean":"2024-05-08T18:32:46.063283+0000","last_became_active":"2024-05-08T18:29:44.587822+0000","last_became_peered":"2024-05-08T18:29:44.587822+0000","last_unstale":"2024-05-08T18:32:46.063283+0000","last_undegraded":"2024-05-08T18:32:46.063283+0000","last_fullsized":"2024-05-08T18:32:46.063283+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:18:12.841872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"100'19","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.059596+0000","last_change":"2024-05-08T18:29:46.603563+0000","last_active":"2024-05-08T18:32:46.059596+0000","last_peered":"2024-05-08T18:32:46.059596+0000","last_clean":"2024-05-08T18:32:46.059596+0000","last_became_active":"2024-05-08T18:29:46.602801+0000","last_became_peered":"2024-05-08T18:29:46.602801+0000","last_unstale":"2024-05-08T18:32:46.059596+0000","last_undegraded":"2024-05-08T18:32:46.059596+0000","last_fullsized":"2024-05-08T18:32:46.059596+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:22:36.338527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":17,"num_write":20,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863847+0000","last_change":"2024-05-08T18:29:48.642806+0000","last_active":"2024-05-08T18:32:46.863847+0000","last_peered":"2024-05-08T18:32:46.863847+0000","last_clean":"2024-05-08T18:32:46.863847+0000","last_became_active":"2024-05-08T18:29:48.641813+0000","last_became_peered":"2024-05-08T18:29:48.641813+0000","last_unstale":"2024-05-08T18:32:46.863847+0000","last_undegraded":"2024-05-08T18:32:46.863847+0000","last_fullsized":"2024-05-08T18:32:46.863847+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:50:48.169666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"80'2","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.062631+0000","last_change":"2024-05-08T18:29:50.689819+0000","last_active":"2024-05-08T18:32:46.062631+0000","last_peered":"2024-05-08T18:32:46.062631+0000","last_clean":"2024-05-08T18:32:46.062631+0000","last_became_active":"2024-05-08T18:29:50.686739+0000","last_became_peered":"2024-05-08T18:29:50.686739+0000","last_unstale":"2024-05-08T18:32:46.062631+0000","last_undegraded":"2024-05-08T18:32:46.062631+0000","last_fullsized":"2024-05-08T18:32:46.062631+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:45:34.171402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.060014+0000","last_change":"2024-05-08T18:29:42.552388+0000","last_active":"2024-05-08T18:32:46.060014+0000","last_peered":"2024-05-08T18:32:46.060014+0000","last_clean":"2024-05-08T18:32:46.060014+0000","last_became_active":"2024-05-08T18:29:42.551647+0000","last_became_peered":"2024-05-08T18:29:42.551647+0000","last_unstale":"2024-05-08T18:32:46.060014+0000","last_undegraded":"2024-05-08T18:32:46.060014+0000","last_fullsized":"2024-05-08T18:32:46.060014+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:55.055481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"93'8","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.849557+0000","last_change":"2024-05-08T18:29:40.562946+0000","last_active":"2024-05-08T18:32:46.849557+0000","last_peered":"2024-05-08T18:32:46.849557+0000","last_clean":"2024-05-08T18:32:46.849557+0000","last_became_active":"2024-05-08T18:29:40.550942+0000","last_became_peered":"2024-05-08T18:29:40.550942+0000","last_unstale":"2024-05-08T18:32:46.849557+0000","last_undegraded":"2024-05-08T18:32:46.849557+0000","last_fullsized":"2024-05-08T18:32:46.849557+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:22.579629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.918001+0000","last_change":"2024-05-08T18:29:44.593681+0000","last_active":"2024-05-08T18:32:46.918001+0000","last_peered":"2024-05-08T18:32:46.918001+0000","last_clean":"2024-05-08T18:32:46.918001+0000","last_became_active":"2024-05-08T18:29:44.593242+0000","last_became_peered":"2024-05-08T18:29:44.593242+0000","last_unstale":"2024-05-08T18:32:46.918001+0000","last_undegraded":"2024-05-08T18:32:46.918001+0000","last_fullsized":"2024-05-08T18:32:46.918001+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:57.093364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"97'22","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.064038+0000","last_change":"2024-05-08T18:29:46.589514+0000","last_active":"2024-05-08T18:32:46.064038+0000","last_peered":"2024-05-08T18:32:46.064038+0000","last_clean":"2024-05-08T18:32:46.064038+0000","last_became_active":"2024-05-08T18:29:46.588784+0000","last_became_peered":"2024-05-08T18:29:46.588784+0000","last_unstale":"2024-05-08T18:32:46.064038+0000","last_undegraded":"2024-05-08T18:32:46.064038+0000","last_fullsized":"2024-05-08T18:32:46.064038+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:02:30.355168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":20,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"97'101","reported_seq":336,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.063633+0000","last_change":"2024-05-08T18:29:48.631007+0000","last_active":"2024-05-08T18:32:46.063633+0000","last_peered":"2024-05-08T18:32:46.063633+0000","last_clean":"2024-05-08T18:32:46.063633+0000","last_became_active":"2024-05-08T18:29:48.630229+0000","last_became_peered":"2024-05-08T18:29:48.630229+0000","last_unstale":"2024-05-08T18:32:46.063633+0000","last_undegraded":"2024-05-08T18:32:46.063633+0000","last_fullsized":"2024-05-08T18:32:46.063633+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:44:03.778419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.917498+0000","last_change":"2024-05-08T18:29:50.675105+0000","last_active":"2024-05-08T18:32:46.917498+0000","last_peered":"2024-05-08T18:32:46.917498+0000","last_clean":"2024-05-08T18:32:46.917498+0000","last_became_active":"2024-05-08T18:29:50.674292+0000","last_became_peered":"2024-05-08T18:29:50.674292+0000","last_unstale":"2024-05-08T18:32:46.917498+0000","last_undegraded":"2024-05-08T18:32:46.917498+0000","last_fullsized":"2024-05-08T18:32:46.917498+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:47:15.423647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"84'4","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.060239+0000","last_change":"2024-05-08T18:29:42.579707+0000","last_active":"2024-05-08T18:32:46.060239+0000","last_peered":"2024-05-08T18:32:46.060239+0000","last_clean":"2024-05-08T18:32:46.060239+0000","last_became_active":"2024-05-08T18:29:42.579059+0000","last_became_peered":"2024-05-08T18:29:42.579059+0000","last_unstale":"2024-05-08T18:32:46.060239+0000","last_undegraded":"2024-05-08T18:32:46.060239+0000","last_fullsized":"2024-05-08T18:32:46.060239+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:09.787597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"93'9","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.058163+0000","last_change":"2024-05-08T18:29:40.555327+0000","last_active":"2024-05-08T18:32:46.058163+0000","last_peered":"2024-05-08T18:32:46.058163+0000","last_clean":"2024-05-08T18:32:46.058163+0000","last_became_active":"2024-05-08T18:29:40.554594+0000","last_became_peered":"2024-05-08T18:29:40.554594+0000","last_unstale":"2024-05-08T18:32:46.058163+0000","last_undegraded":"2024-05-08T18:32:46.058163+0000","last_fullsized":"2024-05-08T18:32:46.058163+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:19.841114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":3,"num_read_kb":4,"num_write":19,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"26'2","reported_seq":322,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-08T18:32:45.243018+0000","last_change":"2024-05-08T18:29:44.582434+0000","last_active":"2024-05-08T18:32:45.243018+0000","last_peered":"2024-05-08T18:32:45.243018+0000","last_clean":"2024-05-08T18:32:45.243018+0000","last_became_active":"2024-05-08T18:29:44.581699+0000","last_became_peered":"2024-05-08T18:29:44.581699+0000","last_unstale":"2024-05-08T18:32:45.243018+0000","last_undegraded":"2024-05-08T18:32:45.243018+0000","last_fullsized":"2024-05-08T18:32:45.243018+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:19:29.113643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":134,"num_read_kb":134,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"33'10","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.065642+0000","last_change":"2024-05-08T18:29:46.590860+0000","last_active":"2024-05-08T18:32:46.065642+0000","last_peered":"2024-05-08T18:32:46.065642+0000","last_clean":"2024-05-08T18:32:46.065642+0000","last_became_active":"2024-05-08T18:29:46.590087+0000","last_became_peered":"2024-05-08T18:29:46.590087+0000","last_unstale":"2024-05-08T18:32:46.065642+0000","last_undegraded":"2024-05-08T18:32:46.065642+0000","last_fullsized":"2024-05-08T18:32:46.065642+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:19:58.358449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"97'101","reported_seq":360,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.849450+0000","last_change":"2024-05-08T18:29:48.635548+0000","last_active":"2024-05-08T18:32:46.849450+0000","last_peered":"2024-05-08T18:32:46.849450+0000","last_clean":"2024-05-08T18:32:46.849450+0000","last_became_active":"2024-05-08T18:29:48.634801+0000","last_became_peered":"2024-05-08T18:29:48.634801+0000","last_unstale":"2024-05-08T18:32:46.849450+0000","last_undegraded":"2024-05-08T18:32:46.849450+0000","last_fullsized":"2024-05-08T18:32:46.849450+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:04:20.128031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.058516+0000","last_change":"2024-05-08T18:29:50.668279+0000","last_active":"2024-05-08T18:32:46.058516+0000","last_peered":"2024-05-08T18:32:46.058516+0000","last_clean":"2024-05-08T18:32:46.058516+0000","last_became_active":"2024-05-08T18:29:50.667536+0000","last_became_peered":"2024-05-08T18:29:50.667536+0000","last_unstale":"2024-05-08T18:32:46.058516+0000","last_undegraded":"2024-05-08T18:32:46.058516+0000","last_fullsized":"2024-05-08T18:32:46.058516+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:12:05.780786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"97'14","reported_seq":224,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.916133+0000","last_change":"2024-05-08T18:29:42.563807+0000","last_active":"2024-05-08T18:32:46.916133+0000","last_peered":"2024-05-08T18:32:46.916133+0000","last_clean":"2024-05-08T18:32:46.916133+0000","last_became_active":"2024-05-08T18:29:42.563416+0000","last_became_peered":"2024-05-08T18:29:42.563416+0000","last_unstale":"2024-05-08T18:32:46.916133+0000","last_undegraded":"2024-05-08T18:32:46.916133+0000","last_fullsized":"2024-05-08T18:32:46.916133+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:18:10.803989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"93'12","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.064387+0000","last_change":"2024-05-08T18:29:40.548898+0000","last_active":"2024-05-08T18:32:46.064387+0000","last_peered":"2024-05-08T18:32:46.064387+0000","last_clean":"2024-05-08T18:32:46.064387+0000","last_became_active":"2024-05-08T18:29:40.548591+0000","last_became_peered":"2024-05-08T18:29:40.548591+0000","last_unstale":"2024-05-08T18:32:46.064387+0000","last_undegraded":"2024-05-08T18:32:46.064387+0000","last_fullsized":"2024-05-08T18:32:46.064387+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:27:41.414153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.059932+0000","last_change":"2024-05-08T18:29:44.582578+0000","last_active":"2024-05-08T18:32:46.059932+0000","last_peered":"2024-05-08T18:32:46.059932+0000","last_clean":"2024-05-08T18:32:46.059932+0000","last_became_active":"2024-05-08T18:29:44.581832+0000","last_became_peered":"2024-05-08T18:29:44.581832+0000","last_unstale":"2024-05-08T18:32:46.059932+0000","last_undegraded":"2024-05-08T18:32:46.059932+0000","last_fullsized":"2024-05-08T18:32:46.059932+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:52:25.736491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"97'23","reported_seq":216,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-08T18:32:45.242558+0000","last_change":"2024-05-08T18:29:46.602459+0000","last_active":"2024-05-08T18:32:45.242558+0000","last_peered":"2024-05-08T18:32:45.242558+0000","last_clean":"2024-05-08T18:32:45.242558+0000","last_became_active":"2024-05-08T18:29:46.601740+0000","last_became_peered":"2024-05-08T18:29:46.601740+0000","last_unstale":"2024-05-08T18:32:45.242558+0000","last_undegraded":"2024-05-08T18:32:45.242558+0000","last_fullsized":"2024-05-08T18:32:45.242558+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:58:31.293922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.849235+0000","last_change":"2024-05-08T18:29:48.640046+0000","last_active":"2024-05-08T18:32:46.849235+0000","last_peered":"2024-05-08T18:32:46.849235+0000","last_clean":"2024-05-08T18:32:46.849235+0000","last_became_active":"2024-05-08T18:29:48.639309+0000","last_became_peered":"2024-05-08T18:29:48.639309+0000","last_unstale":"2024-05-08T18:32:46.849235+0000","last_undegraded":"2024-05-08T18:32:46.849235+0000","last_fullsized":"2024-05-08T18:32:46.849235+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:10.533065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.917024+0000","last_change":"2024-05-08T18:29:50.668361+0000","last_active":"2024-05-08T18:32:46.917024+0000","last_peered":"2024-05-08T18:32:46.917024+0000","last_clean":"2024-05-08T18:32:46.917024+0000","last_became_active":"2024-05-08T18:29:50.667636+0000","last_became_peered":"2024-05-08T18:29:50.667636+0000","last_unstale":"2024-05-08T18:32:46.917024+0000","last_undegraded":"2024-05-08T18:32:46.917024+0000","last_fullsized":"2024-05-08T18:32:46.917024+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:58:35.356885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"97'4","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.847440+0000","last_change":"2024-05-08T18:29:42.584098+0000","last_active":"2024-05-08T18:32:46.847440+0000","last_peered":"2024-05-08T18:32:46.847440+0000","last_clean":"2024-05-08T18:32:46.847440+0000","last_became_active":"2024-05-08T18:29:42.583639+0000","last_became_peered":"2024-05-08T18:29:42.583639+0000","last_unstale":"2024-05-08T18:32:46.847440+0000","last_undegraded":"2024-05-08T18:32:46.847440+0000","last_fullsized":"2024-05-08T18:32:46.847440+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:08:15.026467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":296,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.936422+0000","last_change":"2024-05-08T18:29:27.115522+0000","last_active":"2024-05-08T18:32:46.936422+0000","last_peered":"2024-05-08T18:32:46.936422+0000","last_clean":"2024-05-08T18:32:46.936422+0000","last_became_active":"2024-05-08T18:29:27.112960+0000","last_became_peered":"2024-05-08T18:29:27.112960+0000","last_unstale":"2024-05-08T18:32:46.936422+0000","last_undegraded":"2024-05-08T18:32:46.936422+0000","last_fullsized":"2024-05-08T18:32:46.936422+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:26.091102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:26.091102+0000","last_clean_scrub_stamp":"2024-05-08T18:29:26.091102+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:09:50.296961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":200,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-08T18:32:45.241986+0000","last_change":"2024-05-08T18:29:34.496467+0000","last_active":"2024-05-08T18:32:45.241986+0000","last_peered":"2024-05-08T18:32:45.241986+0000","last_clean":"2024-05-08T18:32:45.241986+0000","last_became_active":"2024-05-08T18:29:34.495632+0000","last_became_peered":"2024-05-08T18:29:34.495632+0000","last_unstale":"2024-05-08T18:32:45.241986+0000","last_undegraded":"2024-05-08T18:32:45.241986+0000","last_fullsized":"2024-05-08T18:32:45.241986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:35.917391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"93'5","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.065505+0000","last_change":"2024-05-08T18:30:20.849562+0000","last_active":"2024-05-08T18:32:46.065505+0000","last_peered":"2024-05-08T18:32:46.065505+0000","last_clean":"2024-05-08T18:32:46.065505+0000","last_became_active":"2024-05-08T18:30:20.849160+0000","last_became_peered":"2024-05-08T18:30:20.849160+0000","last_unstale":"2024-05-08T18:32:46.065505+0000","last_undegraded":"2024-05-08T18:32:46.065505+0000","last_fullsized":"2024-05-08T18:32:46.065505+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:29:13.478886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.937166+0000","last_change":"2024-05-08T18:29:44.592445+0000","last_active":"2024-05-08T18:32:46.937166+0000","last_peered":"2024-05-08T18:32:46.937166+0000","last_clean":"2024-05-08T18:32:46.937166+0000","last_became_active":"2024-05-08T18:29:44.587855+0000","last_became_peered":"2024-05-08T18:29:44.587855+0000","last_unstale":"2024-05-08T18:32:46.937166+0000","last_undegraded":"2024-05-08T18:32:46.937166+0000","last_fullsized":"2024-05-08T18:32:46.937166+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:06:05.355648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"97'33","reported_seq":229,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-08T18:32:45.243335+0000","last_change":"2024-05-08T18:29:46.595394+0000","last_active":"2024-05-08T18:32:45.243335+0000","last_peered":"2024-05-08T18:32:45.243335+0000","last_clean":"2024-05-08T18:32:45.243335+0000","last_became_active":"2024-05-08T18:29:46.594573+0000","last_became_peered":"2024-05-08T18:29:46.594573+0000","last_unstale":"2024-05-08T18:32:45.243335+0000","last_undegraded":"2024-05-08T18:32:45.243335+0000","last_fullsized":"2024-05-08T18:32:45.243335+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:47:11.360684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71557,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":23,"num_write":20,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863388+0000","last_change":"2024-05-08T18:29:48.632178+0000","last_active":"2024-05-08T18:32:46.863388+0000","last_peered":"2024-05-08T18:32:46.863388+0000","last_clean":"2024-05-08T18:32:46.863388+0000","last_became_active":"2024-05-08T18:29:48.631481+0000","last_became_peered":"2024-05-08T18:29:48.631481+0000","last_unstale":"2024-05-08T18:32:46.863388+0000","last_undegraded":"2024-05-08T18:32:46.863388+0000","last_fullsized":"2024-05-08T18:32:46.863388+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:34.806539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"80'2","reported_seq":176,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.848444+0000","last_change":"2024-05-08T18:29:50.675319+0000","last_active":"2024-05-08T18:32:46.848444+0000","last_peered":"2024-05-08T18:32:46.848444+0000","last_clean":"2024-05-08T18:32:46.848444+0000","last_became_active":"2024-05-08T18:29:50.674526+0000","last_became_peered":"2024-05-08T18:29:50.674526+0000","last_unstale":"2024-05-08T18:32:46.848444+0000","last_undegraded":"2024-05-08T18:32:46.848444+0000","last_fullsized":"2024-05-08T18:32:46.848444+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:59:06.404586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"84'4","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863527+0000","last_change":"2024-05-08T18:29:42.568584+0000","last_active":"2024-05-08T18:32:46.863527+0000","last_peered":"2024-05-08T18:32:46.863527+0000","last_clean":"2024-05-08T18:32:46.863527+0000","last_became_active":"2024-05-08T18:29:42.568244+0000","last_became_peered":"2024-05-08T18:29:42.568244+0000","last_unstale":"2024-05-08T18:32:46.863527+0000","last_undegraded":"2024-05-08T18:32:46.863527+0000","last_fullsized":"2024-05-08T18:32:46.863527+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:20.397730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.935976+0000","last_change":"2024-05-08T18:29:34.497654+0000","last_active":"2024-05-08T18:32:46.935976+0000","last_peered":"2024-05-08T18:32:46.935976+0000","last_clean":"2024-05-08T18:32:46.935976+0000","last_became_active":"2024-05-08T18:29:34.495812+0000","last_became_peered":"2024-05-08T18:29:34.495812+0000","last_unstale":"2024-05-08T18:32:46.935976+0000","last_undegraded":"2024-05-08T18:32:46.935976+0000","last_fullsized":"2024-05-08T18:32:46.935976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:37:02.202613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"93'7","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.862540+0000","last_change":"2024-05-08T18:29:40.560653+0000","last_active":"2024-05-08T18:32:46.862540+0000","last_peered":"2024-05-08T18:32:46.862540+0000","last_clean":"2024-05-08T18:32:46.862540+0000","last_became_active":"2024-05-08T18:29:40.560296+0000","last_became_peered":"2024-05-08T18:29:40.560296+0000","last_unstale":"2024-05-08T18:32:46.862540+0000","last_undegraded":"2024-05-08T18:32:46.862540+0000","last_fullsized":"2024-05-08T18:32:46.862540+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:52.462279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":186,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-08T18:32:45.243691+0000","last_change":"2024-05-08T18:29:44.594681+0000","last_active":"2024-05-08T18:32:45.243691+0000","last_peered":"2024-05-08T18:32:45.243691+0000","last_clean":"2024-05-08T18:32:45.243691+0000","last_became_active":"2024-05-08T18:29:44.593917+0000","last_became_peered":"2024-05-08T18:29:44.593917+0000","last_unstale":"2024-05-08T18:32:45.243691+0000","last_undegraded":"2024-05-08T18:32:45.243691+0000","last_fullsized":"2024-05-08T18:32:45.243691+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:59:00.335437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"97'108","reported_seq":382,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.917880+0000","last_change":"2024-05-08T18:29:46.599932+0000","last_active":"2024-05-08T18:32:46.917880+0000","last_peered":"2024-05-08T18:32:46.917880+0000","last_clean":"2024-05-08T18:32:46.917880+0000","last_became_active":"2024-05-08T18:29:46.594789+0000","last_became_peered":"2024-05-08T18:29:46.594789+0000","last_unstale":"2024-05-08T18:32:46.917880+0000","last_undegraded":"2024-05-08T18:32:46.917880+0000","last_fullsized":"2024-05-08T18:32:46.917880+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:04:18.099848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9947,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":143,"num_read_kb":128,"num_write":28,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.937370+0000","last_change":"2024-05-08T18:29:48.634661+0000","last_active":"2024-05-08T18:32:46.937370+0000","last_peered":"2024-05-08T18:32:46.937370+0000","last_clean":"2024-05-08T18:32:46.937370+0000","last_became_active":"2024-05-08T18:29:48.634044+0000","last_became_peered":"2024-05-08T18:29:48.634044+0000","last_unstale":"2024-05-08T18:32:46.937370+0000","last_undegraded":"2024-05-08T18:32:46.937370+0000","last_fullsized":"2024-05-08T18:32:46.937370+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:01:46.238076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.916916+0000","last_change":"2024-05-08T18:29:50.676536+0000","last_active":"2024-05-08T18:32:46.916916+0000","last_peered":"2024-05-08T18:32:46.916916+0000","last_clean":"2024-05-08T18:32:46.916916+0000","last_became_active":"2024-05-08T18:29:50.675770+0000","last_became_peered":"2024-05-08T18:29:50.675770+0000","last_unstale":"2024-05-08T18:32:46.916916+0000","last_undegraded":"2024-05-08T18:32:46.916916+0000","last_fullsized":"2024-05-08T18:32:46.916916+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:28.003482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.919578+0000","last_change":"2024-05-08T18:29:42.575253+0000","last_active":"2024-05-08T18:32:46.919578+0000","last_peered":"2024-05-08T18:32:46.919578+0000","last_clean":"2024-05-08T18:32:46.919578+0000","last_became_active":"2024-05-08T18:29:42.573621+0000","last_became_peered":"2024-05-08T18:29:42.573621+0000","last_unstale":"2024-05-08T18:32:46.919578+0000","last_undegraded":"2024-05-08T18:32:46.919578+0000","last_fullsized":"2024-05-08T18:32:46.919578+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:59.243324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.060706+0000","last_change":"2024-05-08T18:29:34.491071+0000","last_active":"2024-05-08T18:32:46.060706+0000","last_peered":"2024-05-08T18:32:46.060706+0000","last_clean":"2024-05-08T18:32:46.060706+0000","last_became_active":"2024-05-08T18:29:34.490717+0000","last_became_peered":"2024-05-08T18:29:34.490717+0000","last_unstale":"2024-05-08T18:32:46.060706+0000","last_undegraded":"2024-05-08T18:32:46.060706+0000","last_fullsized":"2024-05-08T18:32:46.060706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:55.793312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"93'12","reported_seq":211,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.916751+0000","last_change":"2024-05-08T18:29:40.530634+0000","last_active":"2024-05-08T18:32:46.916751+0000","last_peered":"2024-05-08T18:32:46.916751+0000","last_clean":"2024-05-08T18:32:46.916751+0000","last_became_active":"2024-05-08T18:29:40.529804+0000","last_became_peered":"2024-05-08T18:29:40.529804+0000","last_unstale":"2024-05-08T18:32:46.916751+0000","last_undegraded":"2024-05-08T18:32:46.916751+0000","last_fullsized":"2024-05-08T18:32:46.916751+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:59:25.840149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"26'1","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.064037+0000","last_change":"2024-05-08T18:29:44.584678+0000","last_active":"2024-05-08T18:32:46.064037+0000","last_peered":"2024-05-08T18:32:46.064037+0000","last_clean":"2024-05-08T18:32:46.064037+0000","last_became_active":"2024-05-08T18:29:44.584227+0000","last_became_peered":"2024-05-08T18:29:44.584227+0000","last_unstale":"2024-05-08T18:32:46.064037+0000","last_undegraded":"2024-05-08T18:32:46.064037+0000","last_fullsized":"2024-05-08T18:32:46.064037+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:04:01.281207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'15","reported_seq":239,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.937641+0000","last_change":"2024-05-08T18:29:46.608720+0000","last_active":"2024-05-08T18:32:46.937641+0000","last_peered":"2024-05-08T18:32:46.937641+0000","last_clean":"2024-05-08T18:32:46.937641+0000","last_became_active":"2024-05-08T18:29:46.607989+0000","last_became_peered":"2024-05-08T18:29:46.607989+0000","last_unstale":"2024-05-08T18:32:46.937641+0000","last_undegraded":"2024-05-08T18:32:46.937641+0000","last_fullsized":"2024-05-08T18:32:46.937641+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:58:31.293922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863028+0000","last_change":"2024-05-08T18:29:48.625269+0000","last_active":"2024-05-08T18:32:46.863028+0000","last_peered":"2024-05-08T18:32:46.863028+0000","last_clean":"2024-05-08T18:32:46.863028+0000","last_became_active":"2024-05-08T18:29:48.624545+0000","last_became_peered":"2024-05-08T18:29:48.624545+0000","last_unstale":"2024-05-08T18:32:46.863028+0000","last_undegraded":"2024-05-08T18:32:46.863028+0000","last_fullsized":"2024-05-08T18:32:46.863028+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:16:42.799734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"84'12","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.063889+0000","last_change":"2024-05-08T18:29:50.688851+0000","last_active":"2024-05-08T18:32:46.063889+0000","last_peered":"2024-05-08T18:32:46.063889+0000","last_clean":"2024-05-08T18:32:46.063889+0000","last_became_active":"2024-05-08T18:29:50.687978+0000","last_became_peered":"2024-05-08T18:29:50.687978+0000","last_unstale":"2024-05-08T18:32:46.063889+0000","last_undegraded":"2024-05-08T18:32:46.063889+0000","last_fullsized":"2024-05-08T18:32:46.063889+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:28:29.836446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":42,"num_write":31,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"84'4","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.918158+0000","last_change":"2024-05-08T18:31:22.008678+0000","last_active":"2024-05-08T18:32:46.918158+0000","last_peered":"2024-05-08T18:32:46.918158+0000","last_clean":"2024-05-08T18:32:46.918158+0000","last_became_active":"2024-05-08T18:31:22.008342+0000","last_became_peered":"2024-05-08T18:31:22.008342+0000","last_unstale":"2024-05-08T18:32:46.918158+0000","last_undegraded":"2024-05-08T18:32:46.918158+0000","last_fullsized":"2024-05-08T18:32:46.918158+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:40:30.531379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":200,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-08T18:32:45.241642+0000","last_change":"2024-05-08T18:29:34.496942+0000","last_active":"2024-05-08T18:32:45.241642+0000","last_peered":"2024-05-08T18:32:45.241642+0000","last_clean":"2024-05-08T18:32:45.241642+0000","last_became_active":"2024-05-08T18:29:34.495882+0000","last_became_peered":"2024-05-08T18:29:34.495882+0000","last_unstale":"2024-05-08T18:32:45.241642+0000","last_undegraded":"2024-05-08T18:32:45.241642+0000","last_fullsized":"2024-05-08T18:32:45.241642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:55.793312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"93'8","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.059323+0000","last_change":"2024-05-08T18:29:40.554353+0000","last_active":"2024-05-08T18:32:46.059323+0000","last_peered":"2024-05-08T18:32:46.059323+0000","last_clean":"2024-05-08T18:32:46.059323+0000","last_became_active":"2024-05-08T18:29:40.553527+0000","last_became_peered":"2024-05-08T18:29:40.553527+0000","last_unstale":"2024-05-08T18:32:46.059323+0000","last_undegraded":"2024-05-08T18:32:46.059323+0000","last_fullsized":"2024-05-08T18:32:46.059323+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:03:42.148647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":189,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863485+0000","last_change":"2024-05-08T18:29:44.597411+0000","last_active":"2024-05-08T18:32:46.863485+0000","last_peered":"2024-05-08T18:32:46.863485+0000","last_clean":"2024-05-08T18:32:46.863485+0000","last_became_active":"2024-05-08T18:29:44.596678+0000","last_became_peered":"2024-05-08T18:29:44.596678+0000","last_unstale":"2024-05-08T18:32:46.863485+0000","last_undegraded":"2024-05-08T18:32:46.863485+0000","last_fullsized":"2024-05-08T18:32:46.863485+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:37:23.674968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"97'13","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.066095+0000","last_change":"2024-05-08T18:29:46.607040+0000","last_active":"2024-05-08T18:32:46.066095+0000","last_peered":"2024-05-08T18:32:46.066095+0000","last_clean":"2024-05-08T18:32:46.066095+0000","last_became_active":"2024-05-08T18:29:46.606367+0000","last_became_peered":"2024-05-08T18:29:46.606367+0000","last_unstale":"2024-05-08T18:32:46.066095+0000","last_undegraded":"2024-05-08T18:32:46.066095+0000","last_fullsized":"2024-05-08T18:32:46.066095+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:59:26.650126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.850025+0000","last_change":"2024-05-08T18:29:48.632665+0000","last_active":"2024-05-08T18:32:46.850025+0000","last_peered":"2024-05-08T18:32:46.850025+0000","last_clean":"2024-05-08T18:32:46.850025+0000","last_became_active":"2024-05-08T18:29:48.631874+0000","last_became_peered":"2024-05-08T18:29:48.631874+0000","last_unstale":"2024-05-08T18:32:46.850025+0000","last_undegraded":"2024-05-08T18:32:46.850025+0000","last_fullsized":"2024-05-08T18:32:46.850025+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:06:09.390017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":174,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-08T18:32:45.234935+0000","last_change":"2024-05-08T18:29:50.683443+0000","last_active":"2024-05-08T18:32:45.234935+0000","last_peered":"2024-05-08T18:32:45.234935+0000","last_clean":"2024-05-08T18:32:45.234935+0000","last_became_active":"2024-05-08T18:29:50.682634+0000","last_became_peered":"2024-05-08T18:29:50.682634+0000","last_unstale":"2024-05-08T18:32:45.234935+0000","last_undegraded":"2024-05-08T18:32:45.234935+0000","last_fullsized":"2024-05-08T18:32:45.234935+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:10:38.951662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"80'2","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.917272+0000","last_change":"2024-05-08T18:29:42.574593+0000","last_active":"2024-05-08T18:32:46.917272+0000","last_peered":"2024-05-08T18:32:46.917272+0000","last_clean":"2024-05-08T18:32:46.917272+0000","last_became_active":"2024-05-08T18:29:42.574288+0000","last_became_peered":"2024-05-08T18:29:42.574288+0000","last_unstale":"2024-05-08T18:32:46.917272+0000","last_undegraded":"2024-05-08T18:32:46.917272+0000","last_fullsized":"2024-05-08T18:32:46.917272+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:58.320701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"93'11","reported_seq":158,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.063035+0000","last_change":"2024-05-08T18:30:20.850805+0000","last_active":"2024-05-08T18:32:46.063035+0000","last_peered":"2024-05-08T18:32:46.063035+0000","last_clean":"2024-05-08T18:32:46.063035+0000","last_became_active":"2024-05-08T18:30:20.850365+0000","last_became_peered":"2024-05-08T18:30:20.850365+0000","last_unstale":"2024-05-08T18:32:46.063035+0000","last_undegraded":"2024-05-08T18:32:46.063035+0000","last_fullsized":"2024-05-08T18:32:46.063035+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:52:21.678894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.918404+0000","last_change":"2024-05-08T18:29:34.606393+0000","last_active":"2024-05-08T18:32:46.918404+0000","last_peered":"2024-05-08T18:32:46.918404+0000","last_clean":"2024-05-08T18:32:46.918404+0000","last_became_active":"2024-05-08T18:29:34.605574+0000","last_became_peered":"2024-05-08T18:29:34.605574+0000","last_unstale":"2024-05-08T18:32:46.918404+0000","last_undegraded":"2024-05-08T18:32:46.918404+0000","last_fullsized":"2024-05-08T18:32:46.918404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:55.793312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":189,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.862948+0000","last_change":"2024-05-08T18:29:44.595127+0000","last_active":"2024-05-08T18:32:46.862948+0000","last_peered":"2024-05-08T18:32:46.862948+0000","last_clean":"2024-05-08T18:32:46.862948+0000","last_became_active":"2024-05-08T18:29:44.594642+0000","last_became_peered":"2024-05-08T18:29:44.594642+0000","last_unstale":"2024-05-08T18:32:46.862948+0000","last_undegraded":"2024-05-08T18:32:46.862948+0000","last_fullsized":"2024-05-08T18:32:46.862948+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:04:49.020450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"97'32","reported_seq":231,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.862122+0000","last_change":"2024-05-08T18:29:46.602279+0000","last_active":"2024-05-08T18:32:46.862122+0000","last_peered":"2024-05-08T18:32:46.862122+0000","last_clean":"2024-05-08T18:32:46.862122+0000","last_became_active":"2024-05-08T18:29:46.599707+0000","last_became_peered":"2024-05-08T18:29:46.599707+0000","last_unstale":"2024-05-08T18:32:46.862122+0000","last_undegraded":"2024-05-08T18:32:46.862122+0000","last_fullsized":"2024-05-08T18:32:46.862122+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:54:48.654215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62414,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":24,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.057286+0000","last_change":"2024-05-08T18:29:48.639458+0000","last_active":"2024-05-08T18:32:46.057286+0000","last_peered":"2024-05-08T18:32:46.057286+0000","last_clean":"2024-05-08T18:32:46.057286+0000","last_became_active":"2024-05-08T18:29:48.638709+0000","last_became_peered":"2024-05-08T18:29:48.638709+0000","last_unstale":"2024-05-08T18:32:46.057286+0000","last_undegraded":"2024-05-08T18:32:46.057286+0000","last_fullsized":"2024-05-08T18:32:46.057286+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:19:58.182291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"97'6","reported_seq":189,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.861327+0000","last_change":"2024-05-08T18:29:50.681077+0000","last_active":"2024-05-08T18:32:46.861327+0000","last_peered":"2024-05-08T18:32:46.861327+0000","last_clean":"2024-05-08T18:32:46.861327+0000","last_became_active":"2024-05-08T18:29:50.675766+0000","last_became_peered":"2024-05-08T18:29:50.675766+0000","last_unstale":"2024-05-08T18:32:46.861327+0000","last_undegraded":"2024-05-08T18:32:46.861327+0000","last_fullsized":"2024-05-08T18:32:46.861327+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:09:29.641515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"80'2","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863332+0000","last_change":"2024-05-08T18:29:42.571265+0000","last_active":"2024-05-08T18:32:46.863332+0000","last_peered":"2024-05-08T18:32:46.863332+0000","last_clean":"2024-05-08T18:32:46.863332+0000","last_became_active":"2024-05-08T18:29:42.570645+0000","last_became_peered":"2024-05-08T18:29:42.570645+0000","last_unstale":"2024-05-08T18:32:46.863332+0000","last_undegraded":"2024-05-08T18:32:46.863332+0000","last_fullsized":"2024-05-08T18:32:46.863332+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:30:29.452640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"93'3","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.918243+0000","last_change":"2024-05-08T18:29:40.531079+0000","last_active":"2024-05-08T18:32:46.918243+0000","last_peered":"2024-05-08T18:32:46.918243+0000","last_clean":"2024-05-08T18:32:46.918243+0000","last_became_active":"2024-05-08T18:29:40.530256+0000","last_became_peered":"2024-05-08T18:29:40.530256+0000","last_unstale":"2024-05-08T18:32:46.918243+0000","last_undegraded":"2024-05-08T18:32:46.918243+0000","last_fullsized":"2024-05-08T18:32:46.918243+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:09:42.581976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.938519+0000","last_change":"2024-05-08T18:29:34.603292+0000","last_active":"2024-05-08T18:32:46.938519+0000","last_peered":"2024-05-08T18:32:46.938519+0000","last_clean":"2024-05-08T18:32:46.938519+0000","last_became_active":"2024-05-08T18:29:34.602547+0000","last_became_peered":"2024-05-08T18:29:34.602547+0000","last_unstale":"2024-05-08T18:32:46.938519+0000","last_undegraded":"2024-05-08T18:32:46.938519+0000","last_fullsized":"2024-05-08T18:32:46.938519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:24:55.555475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.849004+0000","last_change":"2024-05-08T18:29:44.593275+0000","last_active":"2024-05-08T18:32:46.849004+0000","last_peered":"2024-05-08T18:32:46.849004+0000","last_clean":"2024-05-08T18:32:46.849004+0000","last_became_active":"2024-05-08T18:29:44.591870+0000","last_became_peered":"2024-05-08T18:29:44.591870+0000","last_unstale":"2024-05-08T18:32:46.849004+0000","last_undegraded":"2024-05-08T18:32:46.849004+0000","last_fullsized":"2024-05-08T18:32:46.849004+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:35.176971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"33'14","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.917202+0000","last_change":"2024-05-08T18:29:46.603499+0000","last_active":"2024-05-08T18:32:46.917202+0000","last_peered":"2024-05-08T18:32:46.917202+0000","last_clean":"2024-05-08T18:32:46.917202+0000","last_became_active":"2024-05-08T18:29:46.602920+0000","last_became_peered":"2024-05-08T18:29:46.602920+0000","last_unstale":"2024-05-08T18:32:46.917202+0000","last_undegraded":"2024-05-08T18:32:46.917202+0000","last_fullsized":"2024-05-08T18:32:46.917202+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:08.504882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"97'101","reported_seq":327,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-08T18:32:45.238750+0000","last_change":"2024-05-08T18:29:48.634915+0000","last_active":"2024-05-08T18:32:45.238750+0000","last_peered":"2024-05-08T18:32:45.238750+0000","last_clean":"2024-05-08T18:32:45.238750+0000","last_became_active":"2024-05-08T18:29:48.634280+0000","last_became_peered":"2024-05-08T18:29:48.634280+0000","last_unstale":"2024-05-08T18:32:45.238750+0000","last_undegraded":"2024-05-08T18:32:45.238750+0000","last_fullsized":"2024-05-08T18:32:45.238750+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:19:58.182291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"80'2","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.067407+0000","last_change":"2024-05-08T18:29:50.688742+0000","last_active":"2024-05-08T18:32:46.067407+0000","last_peered":"2024-05-08T18:32:46.067407+0000","last_clean":"2024-05-08T18:32:46.067407+0000","last_became_active":"2024-05-08T18:29:50.687135+0000","last_became_peered":"2024-05-08T18:29:50.687135+0000","last_unstale":"2024-05-08T18:32:46.067407+0000","last_undegraded":"2024-05-08T18:32:46.067407+0000","last_fullsized":"2024-05-08T18:32:46.067407+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:12:49.040807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"80'2","reported_seq":152,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.059948+0000","last_change":"2024-05-08T18:30:21.220561+0000","last_active":"2024-05-08T18:32:46.059948+0000","last_peered":"2024-05-08T18:32:46.059948+0000","last_clean":"2024-05-08T18:32:46.059948+0000","last_became_active":"2024-05-08T18:30:21.220196+0000","last_became_peered":"2024-05-08T18:30:21.220196+0000","last_unstale":"2024-05-08T18:32:46.059948+0000","last_undegraded":"2024-05-08T18:32:46.059948+0000","last_fullsized":"2024-05-08T18:32:46.059948+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:19:27.075761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"83'5","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.066414+0000","last_change":"2024-05-08T18:29:40.565872+0000","last_active":"2024-05-08T18:32:46.066414+0000","last_peered":"2024-05-08T18:32:46.066414+0000","last_clean":"2024-05-08T18:32:46.066414+0000","last_became_active":"2024-05-08T18:29:40.565655+0000","last_became_peered":"2024-05-08T18:29:40.565655+0000","last_unstale":"2024-05-08T18:32:46.066414+0000","last_undegraded":"2024-05-08T18:32:46.066414+0000","last_fullsized":"2024-05-08T18:32:46.066414+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:16:16.521258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.919692+0000","last_change":"2024-05-08T18:29:34.501273+0000","last_active":"2024-05-08T18:32:46.919692+0000","last_peered":"2024-05-08T18:32:46.919692+0000","last_clean":"2024-05-08T18:32:46.919692+0000","last_became_active":"2024-05-08T18:29:34.500933+0000","last_became_peered":"2024-05-08T18:29:34.500933+0000","last_unstale":"2024-05-08T18:32:46.919692+0000","last_undegraded":"2024-05-08T18:32:46.919692+0000","last_fullsized":"2024-05-08T18:32:46.919692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:35.917391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.057534+0000","last_change":"2024-05-08T18:29:44.576227+0000","last_active":"2024-05-08T18:32:46.057534+0000","last_peered":"2024-05-08T18:32:46.057534+0000","last_clean":"2024-05-08T18:32:46.057534+0000","last_became_active":"2024-05-08T18:29:44.575454+0000","last_became_peered":"2024-05-08T18:29:44.575454+0000","last_unstale":"2024-05-08T18:32:46.057534+0000","last_undegraded":"2024-05-08T18:32:46.057534+0000","last_fullsized":"2024-05-08T18:32:46.057534+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:06:05.355648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"80'11","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.058692+0000","last_change":"2024-05-08T18:29:46.609633+0000","last_active":"2024-05-08T18:32:46.058692+0000","last_peered":"2024-05-08T18:32:46.058692+0000","last_clean":"2024-05-08T18:32:46.058692+0000","last_became_active":"2024-05-08T18:29:46.603455+0000","last_became_peered":"2024-05-08T18:29:46.603455+0000","last_unstale":"2024-05-08T18:32:46.058692+0000","last_undegraded":"2024-05-08T18:32:46.058692+0000","last_fullsized":"2024-05-08T18:32:46.058692+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:07:54.654205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"97'101","reported_seq":363,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.065251+0000","last_change":"2024-05-08T18:29:48.637898+0000","last_active":"2024-05-08T18:32:46.065251+0000","last_peered":"2024-05-08T18:32:46.065251+0000","last_clean":"2024-05-08T18:32:46.065251+0000","last_became_active":"2024-05-08T18:29:48.637070+0000","last_became_peered":"2024-05-08T18:29:48.637070+0000","last_unstale":"2024-05-08T18:32:46.065251+0000","last_undegraded":"2024-05-08T18:32:46.065251+0000","last_fullsized":"2024-05-08T18:32:46.065251+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:03:46.392864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"84'10","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.861002+0000","last_change":"2024-05-08T18:29:50.691526+0000","last_active":"2024-05-08T18:32:46.861002+0000","last_peered":"2024-05-08T18:32:46.861002+0000","last_clean":"2024-05-08T18:32:46.861002+0000","last_became_active":"2024-05-08T18:29:50.690767+0000","last_became_peered":"2024-05-08T18:29:50.690767+0000","last_unstale":"2024-05-08T18:32:46.861002+0000","last_undegraded":"2024-05-08T18:32:46.861002+0000","last_fullsized":"2024-05-08T18:32:46.861002+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:32:29.972139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"97'16","reported_seq":229,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.057923+0000","last_change":"2024-05-08T18:29:42.562006+0000","last_active":"2024-05-08T18:32:46.057923+0000","last_peered":"2024-05-08T18:32:46.057923+0000","last_clean":"2024-05-08T18:32:46.057923+0000","last_became_active":"2024-05-08T18:29:42.560861+0000","last_became_peered":"2024-05-08T18:29:42.560861+0000","last_unstale":"2024-05-08T18:32:46.057923+0000","last_undegraded":"2024-05-08T18:32:46.057923+0000","last_fullsized":"2024-05-08T18:32:46.057923+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:36.890277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"93'9","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863638+0000","last_change":"2024-05-08T18:29:40.550529+0000","last_active":"2024-05-08T18:32:46.863638+0000","last_peered":"2024-05-08T18:32:46.863638+0000","last_clean":"2024-05-08T18:32:46.863638+0000","last_became_active":"2024-05-08T18:29:40.550241+0000","last_became_peered":"2024-05-08T18:29:40.550241+0000","last_unstale":"2024-05-08T18:32:46.863638+0000","last_undegraded":"2024-05-08T18:32:46.863638+0000","last_fullsized":"2024-05-08T18:32:46.863638+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:48.294532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.850587+0000","last_change":"2024-05-08T18:29:34.493537+0000","last_active":"2024-05-08T18:32:46.850587+0000","last_peered":"2024-05-08T18:32:46.850587+0000","last_clean":"2024-05-08T18:32:46.850587+0000","last_became_active":"2024-05-08T18:29:34.492891+0000","last_became_peered":"2024-05-08T18:29:34.492891+0000","last_unstale":"2024-05-08T18:32:46.850587+0000","last_undegraded":"2024-05-08T18:32:46.850587+0000","last_fullsized":"2024-05-08T18:32:46.850587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:09:07.992256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":189,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.063279+0000","last_change":"2024-05-08T18:29:44.590102+0000","last_active":"2024-05-08T18:32:46.063279+0000","last_peered":"2024-05-08T18:32:46.063279+0000","last_clean":"2024-05-08T18:32:46.063279+0000","last_became_active":"2024-05-08T18:29:44.589471+0000","last_became_peered":"2024-05-08T18:29:44.589471+0000","last_unstale":"2024-05-08T18:32:46.063279+0000","last_undegraded":"2024-05-08T18:32:46.063279+0000","last_fullsized":"2024-05-08T18:32:46.063279+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:14:04.085401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"97'37","reported_seq":236,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.935847+0000","last_change":"2024-05-08T18:29:46.606967+0000","last_active":"2024-05-08T18:32:46.935847+0000","last_peered":"2024-05-08T18:32:46.935847+0000","last_clean":"2024-05-08T18:32:46.935847+0000","last_became_active":"2024-05-08T18:29:46.605693+0000","last_became_peered":"2024-05-08T18:29:46.605693+0000","last_unstale":"2024-05-08T18:32:46.935847+0000","last_undegraded":"2024-05-08T18:32:46.935847+0000","last_fullsized":"2024-05-08T18:32:46.935847+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:24:13.568294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.061836+0000","last_change":"2024-05-08T18:29:48.634271+0000","last_active":"2024-05-08T18:32:46.061836+0000","last_peered":"2024-05-08T18:32:46.061836+0000","last_clean":"2024-05-08T18:32:46.061836+0000","last_became_active":"2024-05-08T18:29:48.633607+0000","last_became_peered":"2024-05-08T18:29:48.633607+0000","last_unstale":"2024-05-08T18:32:46.061836+0000","last_undegraded":"2024-05-08T18:32:46.061836+0000","last_fullsized":"2024-05-08T18:32:46.061836+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:34.806539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":174,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-08T18:32:45.242486+0000","last_change":"2024-05-08T18:29:50.685494+0000","last_active":"2024-05-08T18:32:45.242486+0000","last_peered":"2024-05-08T18:32:45.242486+0000","last_clean":"2024-05-08T18:32:45.242486+0000","last_became_active":"2024-05-08T18:29:50.684818+0000","last_became_peered":"2024-05-08T18:29:50.684818+0000","last_unstale":"2024-05-08T18:32:45.242486+0000","last_undegraded":"2024-05-08T18:32:45.242486+0000","last_fullsized":"2024-05-08T18:32:45.242486+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:22.220842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863373+0000","last_change":"2024-05-08T18:29:50.682937+0000","last_active":"2024-05-08T18:32:46.863373+0000","last_peered":"2024-05-08T18:32:46.863373+0000","last_clean":"2024-05-08T18:32:46.863373+0000","last_became_active":"2024-05-08T18:29:50.681771+0000","last_became_peered":"2024-05-08T18:29:50.681771+0000","last_unstale":"2024-05-08T18:32:46.863373+0000","last_undegraded":"2024-05-08T18:32:46.863373+0000","last_fullsized":"2024-05-08T18:32:46.863373+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:28:29.836446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"84'4","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.058933+0000","last_change":"2024-05-08T18:29:42.575909+0000","last_active":"2024-05-08T18:32:46.058933+0000","last_peered":"2024-05-08T18:32:46.058933+0000","last_clean":"2024-05-08T18:32:46.058933+0000","last_became_active":"2024-05-08T18:29:42.574877+0000","last_became_peered":"2024-05-08T18:29:42.574877+0000","last_unstale":"2024-05-08T18:32:46.058933+0000","last_undegraded":"2024-05-08T18:32:46.058933+0000","last_fullsized":"2024-05-08T18:32:46.058933+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:33.139089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"93'11","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.059190+0000","last_change":"2024-05-08T18:29:40.566496+0000","last_active":"2024-05-08T18:32:46.059190+0000","last_peered":"2024-05-08T18:32:46.059190+0000","last_clean":"2024-05-08T18:32:46.059190+0000","last_became_active":"2024-05-08T18:29:40.565874+0000","last_became_peered":"2024-05-08T18:29:40.565874+0000","last_unstale":"2024-05-08T18:32:46.059190+0000","last_undegraded":"2024-05-08T18:32:46.059190+0000","last_fullsized":"2024-05-08T18:32:46.059190+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:07.239963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.917412+0000","last_change":"2024-05-08T18:29:44.595410+0000","last_active":"2024-05-08T18:32:46.917412+0000","last_peered":"2024-05-08T18:32:46.917412+0000","last_clean":"2024-05-08T18:32:46.917412+0000","last_became_active":"2024-05-08T18:29:44.594286+0000","last_became_peered":"2024-05-08T18:29:44.594286+0000","last_unstale":"2024-05-08T18:32:46.917412+0000","last_undegraded":"2024-05-08T18:32:46.917412+0000","last_fullsized":"2024-05-08T18:32:46.917412+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:38.928160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"97'18","reported_seq":211,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.064873+0000","last_change":"2024-05-08T18:29:46.591009+0000","last_active":"2024-05-08T18:32:46.064873+0000","last_peered":"2024-05-08T18:32:46.064873+0000","last_clean":"2024-05-08T18:32:46.064873+0000","last_became_active":"2024-05-08T18:29:46.588810+0000","last_became_peered":"2024-05-08T18:29:46.588810+0000","last_unstale":"2024-05-08T18:32:46.064873+0000","last_undegraded":"2024-05-08T18:32:46.064873+0000","last_fullsized":"2024-05-08T18:32:46.064873+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:34:45.745300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.062900+0000","last_change":"2024-05-08T18:29:48.634986+0000","last_active":"2024-05-08T18:32:46.062900+0000","last_peered":"2024-05-08T18:32:46.062900+0000","last_clean":"2024-05-08T18:32:46.062900+0000","last_became_active":"2024-05-08T18:29:48.633866+0000","last_became_peered":"2024-05-08T18:29:48.633866+0000","last_unstale":"2024-05-08T18:32:46.062900+0000","last_undegraded":"2024-05-08T18:32:46.062900+0000","last_fullsized":"2024-05-08T18:32:46.062900+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:46.539830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"83'16","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.065910+0000","last_change":"2024-05-08T18:29:50.693408+0000","last_active":"2024-05-08T18:32:46.065910+0000","last_peered":"2024-05-08T18:32:46.065910+0000","last_clean":"2024-05-08T18:32:46.065910+0000","last_became_active":"2024-05-08T18:29:50.692687+0000","last_became_peered":"2024-05-08T18:29:50.692687+0000","last_unstale":"2024-05-08T18:32:46.065910+0000","last_undegraded":"2024-05-08T18:32:46.065910+0000","last_fullsized":"2024-05-08T18:32:46.065910+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:22.834262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":28,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"83'6","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.917179+0000","last_change":"2024-05-08T18:29:42.581368+0000","last_active":"2024-05-08T18:32:46.917179+0000","last_peered":"2024-05-08T18:32:46.917179+0000","last_clean":"2024-05-08T18:32:46.917179+0000","last_became_active":"2024-05-08T18:29:42.580887+0000","last_became_peered":"2024-05-08T18:29:42.580887+0000","last_unstale":"2024-05-08T18:32:46.917179+0000","last_undegraded":"2024-05-08T18:32:46.917179+0000","last_fullsized":"2024-05-08T18:32:46.917179+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:08:15.026467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"93'7","reported_seq":201,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.938046+0000","last_change":"2024-05-08T18:29:40.572770+0000","last_active":"2024-05-08T18:32:46.938046+0000","last_peered":"2024-05-08T18:32:46.938046+0000","last_clean":"2024-05-08T18:32:46.938046+0000","last_became_active":"2024-05-08T18:29:40.572079+0000","last_became_peered":"2024-05-08T18:29:40.572079+0000","last_unstale":"2024-05-08T18:32:46.938046+0000","last_undegraded":"2024-05-08T18:32:46.938046+0000","last_fullsized":"2024-05-08T18:32:46.938046+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:05.929806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":189,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.063663+0000","last_change":"2024-05-08T18:29:44.581323+0000","last_active":"2024-05-08T18:32:46.063663+0000","last_peered":"2024-05-08T18:32:46.063663+0000","last_clean":"2024-05-08T18:32:46.063663+0000","last_became_active":"2024-05-08T18:29:44.580805+0000","last_became_peered":"2024-05-08T18:29:44.580805+0000","last_unstale":"2024-05-08T18:32:46.063663+0000","last_undegraded":"2024-05-08T18:32:46.063663+0000","last_fullsized":"2024-05-08T18:32:46.063663+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:35:25.591140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"47'5","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.862030+0000","last_change":"2024-05-08T18:29:46.602495+0000","last_active":"2024-05-08T18:32:46.862030+0000","last_peered":"2024-05-08T18:32:46.862030+0000","last_clean":"2024-05-08T18:32:46.862030+0000","last_became_active":"2024-05-08T18:29:46.599789+0000","last_became_peered":"2024-05-08T18:29:46.599789+0000","last_unstale":"2024-05-08T18:32:46.862030+0000","last_undegraded":"2024-05-08T18:32:46.862030+0000","last_fullsized":"2024-05-08T18:32:46.862030+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:18:16.375808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.936013+0000","last_change":"2024-05-08T18:29:48.642994+0000","last_active":"2024-05-08T18:32:46.936013+0000","last_peered":"2024-05-08T18:32:46.936013+0000","last_clean":"2024-05-08T18:32:46.936013+0000","last_became_active":"2024-05-08T18:29:48.642056+0000","last_became_peered":"2024-05-08T18:29:48.642056+0000","last_unstale":"2024-05-08T18:32:46.936013+0000","last_undegraded":"2024-05-08T18:32:46.936013+0000","last_fullsized":"2024-05-08T18:32:46.936013+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:47:54.034851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863166+0000","last_change":"2024-05-08T18:29:50.672513+0000","last_active":"2024-05-08T18:32:46.863166+0000","last_peered":"2024-05-08T18:32:46.863166+0000","last_clean":"2024-05-08T18:32:46.863166+0000","last_became_active":"2024-05-08T18:29:50.671781+0000","last_became_peered":"2024-05-08T18:29:50.671781+0000","last_unstale":"2024-05-08T18:32:46.863166+0000","last_undegraded":"2024-05-08T18:32:46.863166+0000","last_fullsized":"2024-05-08T18:32:46.863166+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:45:34.171402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"97'2","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.062291+0000","last_change":"2024-05-08T18:29:42.576843+0000","last_active":"2024-05-08T18:32:46.062291+0000","last_peered":"2024-05-08T18:32:46.062291+0000","last_clean":"2024-05-08T18:32:46.062291+0000","last_became_active":"2024-05-08T18:29:42.576379+0000","last_became_peered":"2024-05-08T18:29:42.576379+0000","last_unstale":"2024-05-08T18:32:46.062291+0000","last_undegraded":"2024-05-08T18:32:46.062291+0000","last_fullsized":"2024-05-08T18:32:46.062291+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:20.471010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"93'12","reported_seq":206,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-08T18:32:45.243801+0000","last_change":"2024-05-08T18:29:40.542997+0000","last_active":"2024-05-08T18:32:45.243801+0000","last_peered":"2024-05-08T18:32:45.243801+0000","last_clean":"2024-05-08T18:32:45.243801+0000","last_became_active":"2024-05-08T18:29:40.542239+0000","last_became_peered":"2024-05-08T18:29:40.542239+0000","last_unstale":"2024-05-08T18:32:45.243801+0000","last_undegraded":"2024-05-08T18:32:45.243801+0000","last_fullsized":"2024-05-08T18:32:45.243801+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:14:43.555504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.935289+0000","last_change":"2024-05-08T18:29:44.594178+0000","last_active":"2024-05-08T18:32:46.935289+0000","last_peered":"2024-05-08T18:32:46.935289+0000","last_clean":"2024-05-08T18:32:46.935289+0000","last_became_active":"2024-05-08T18:29:44.592476+0000","last_became_peered":"2024-05-08T18:29:44.592476+0000","last_unstale":"2024-05-08T18:32:46.935289+0000","last_undegraded":"2024-05-08T18:32:46.935289+0000","last_fullsized":"2024-05-08T18:32:46.935289+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:04:16.093662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"97'17","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.063156+0000","last_change":"2024-05-08T18:29:46.597288+0000","last_active":"2024-05-08T18:32:46.063156+0000","last_peered":"2024-05-08T18:32:46.063156+0000","last_clean":"2024-05-08T18:32:46.063156+0000","last_became_active":"2024-05-08T18:29:46.596452+0000","last_became_peered":"2024-05-08T18:29:46.596452+0000","last_unstale":"2024-05-08T18:32:46.063156+0000","last_undegraded":"2024-05-08T18:32:46.063156+0000","last_fullsized":"2024-05-08T18:32:46.063156+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:32:43.245753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.848919+0000","last_change":"2024-05-08T18:29:48.635436+0000","last_active":"2024-05-08T18:32:46.848919+0000","last_peered":"2024-05-08T18:32:46.848919+0000","last_clean":"2024-05-08T18:32:46.848919+0000","last_became_active":"2024-05-08T18:29:48.634704+0000","last_became_peered":"2024-05-08T18:29:48.634704+0000","last_unstale":"2024-05-08T18:32:46.848919+0000","last_undegraded":"2024-05-08T18:32:46.848919+0000","last_fullsized":"2024-05-08T18:32:46.848919+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:55:52.238481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"83'2","reported_seq":177,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-08T18:32:45.242253+0000","last_change":"2024-05-08T18:29:50.687974+0000","last_active":"2024-05-08T18:32:45.242253+0000","last_peered":"2024-05-08T18:32:45.242253+0000","last_clean":"2024-05-08T18:32:45.242253+0000","last_became_active":"2024-05-08T18:29:50.687045+0000","last_became_peered":"2024-05-08T18:29:50.687045+0000","last_unstale":"2024-05-08T18:32:45.242253+0000","last_undegraded":"2024-05-08T18:32:45.242253+0000","last_fullsized":"2024-05-08T18:32:45.242253+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:55:01.894779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"97'4","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.063677+0000","last_change":"2024-05-08T18:30:20.850226+0000","last_active":"2024-05-08T18:32:46.063677+0000","last_peered":"2024-05-08T18:32:46.063677+0000","last_clean":"2024-05-08T18:32:46.063677+0000","last_became_active":"2024-05-08T18:30:20.849751+0000","last_became_peered":"2024-05-08T18:30:20.849751+0000","last_unstale":"2024-05-08T18:32:46.063677+0000","last_undegraded":"2024-05-08T18:32:46.063677+0000","last_fullsized":"2024-05-08T18:32:46.063677+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:33:31.550958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"93'13","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863945+0000","last_change":"2024-05-08T18:29:40.541112+0000","last_active":"2024-05-08T18:32:46.863945+0000","last_peered":"2024-05-08T18:32:46.863945+0000","last_clean":"2024-05-08T18:32:46.863945+0000","last_became_active":"2024-05-08T18:29:40.540835+0000","last_became_peered":"2024-05-08T18:29:40.540835+0000","last_unstale":"2024-05-08T18:32:46.863945+0000","last_undegraded":"2024-05-08T18:32:46.863945+0000","last_fullsized":"2024-05-08T18:32:46.863945+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:43:14.995191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.848912+0000","last_change":"2024-05-08T18:29:44.592033+0000","last_active":"2024-05-08T18:32:46.848912+0000","last_peered":"2024-05-08T18:32:46.848912+0000","last_clean":"2024-05-08T18:32:46.848912+0000","last_became_active":"2024-05-08T18:29:44.590454+0000","last_became_peered":"2024-05-08T18:29:44.590454+0000","last_unstale":"2024-05-08T18:32:46.848912+0000","last_undegraded":"2024-05-08T18:32:46.848912+0000","last_fullsized":"2024-05-08T18:32:46.848912+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:11:03.740365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"97'15","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.935727+0000","last_change":"2024-05-08T18:29:46.607002+0000","last_active":"2024-05-08T18:32:46.935727+0000","last_peered":"2024-05-08T18:32:46.935727+0000","last_clean":"2024-05-08T18:32:46.935727+0000","last_became_active":"2024-05-08T18:29:46.606172+0000","last_became_peered":"2024-05-08T18:29:46.606172+0000","last_unstale":"2024-05-08T18:32:46.935727+0000","last_undegraded":"2024-05-08T18:32:46.935727+0000","last_fullsized":"2024-05-08T18:32:46.935727+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:37:35.850414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.862686+0000","last_change":"2024-05-08T18:29:48.632948+0000","last_active":"2024-05-08T18:32:46.862686+0000","last_peered":"2024-05-08T18:32:46.862686+0000","last_clean":"2024-05-08T18:32:46.862686+0000","last_became_active":"2024-05-08T18:29:48.631219+0000","last_became_peered":"2024-05-08T18:29:48.631219+0000","last_unstale":"2024-05-08T18:32:46.862686+0000","last_undegraded":"2024-05-08T18:32:46.862686+0000","last_fullsized":"2024-05-08T18:32:46.862686+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:19:01.454355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.850370+0000","last_change":"2024-05-08T18:29:42.570180+0000","last_active":"2024-05-08T18:32:46.850370+0000","last_peered":"2024-05-08T18:32:46.850370+0000","last_clean":"2024-05-08T18:32:46.850370+0000","last_became_active":"2024-05-08T18:29:42.569425+0000","last_became_peered":"2024-05-08T18:29:42.569425+0000","last_unstale":"2024-05-08T18:32:46.850370+0000","last_undegraded":"2024-05-08T18:32:46.850370+0000","last_fullsized":"2024-05-08T18:32:46.850370+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:35.037465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"93'8","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.064153+0000","last_change":"2024-05-08T18:29:40.547711+0000","last_active":"2024-05-08T18:32:46.064153+0000","last_peered":"2024-05-08T18:32:46.064153+0000","last_clean":"2024-05-08T18:32:46.064153+0000","last_became_active":"2024-05-08T18:29:40.547479+0000","last_became_peered":"2024-05-08T18:29:40.547479+0000","last_unstale":"2024-05-08T18:32:46.064153+0000","last_undegraded":"2024-05-08T18:32:46.064153+0000","last_fullsized":"2024-05-08T18:32:46.064153+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:12:40.901620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":189,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863409+0000","last_change":"2024-05-08T18:29:44.591547+0000","last_active":"2024-05-08T18:32:46.863409+0000","last_peered":"2024-05-08T18:32:46.863409+0000","last_clean":"2024-05-08T18:32:46.863409+0000","last_became_active":"2024-05-08T18:29:44.590498+0000","last_became_peered":"2024-05-08T18:29:44.590498+0000","last_unstale":"2024-05-08T18:32:46.863409+0000","last_undegraded":"2024-05-08T18:32:46.863409+0000","last_fullsized":"2024-05-08T18:32:46.863409+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:14:04.085401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"97'25","reported_seq":223,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.918610+0000","last_change":"2024-05-08T18:29:46.600437+0000","last_active":"2024-05-08T18:32:46.918610+0000","last_peered":"2024-05-08T18:32:46.918610+0000","last_clean":"2024-05-08T18:32:46.918610+0000","last_became_active":"2024-05-08T18:29:46.594672+0000","last_became_peered":"2024-05-08T18:29:46.594672+0000","last_unstale":"2024-05-08T18:32:46.918610+0000","last_undegraded":"2024-05-08T18:32:46.918610+0000","last_fullsized":"2024-05-08T18:32:46.918610+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:35:53.294312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":178,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-08T18:32:45.242537+0000","last_change":"2024-05-08T18:29:48.639840+0000","last_active":"2024-05-08T18:32:45.242537+0000","last_peered":"2024-05-08T18:32:45.242537+0000","last_clean":"2024-05-08T18:32:45.242537+0000","last_became_active":"2024-05-08T18:29:48.639120+0000","last_became_peered":"2024-05-08T18:29:48.639120+0000","last_unstale":"2024-05-08T18:32:45.242537+0000","last_undegraded":"2024-05-08T18:32:45.242537+0000","last_fullsized":"2024-05-08T18:32:45.242537+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:13:50.865474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"84'2","reported_seq":180,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.062460+0000","last_change":"2024-05-08T18:29:50.684843+0000","last_active":"2024-05-08T18:32:46.062460+0000","last_peered":"2024-05-08T18:32:46.062460+0000","last_clean":"2024-05-08T18:32:46.062460+0000","last_became_active":"2024-05-08T18:29:50.684119+0000","last_became_peered":"2024-05-08T18:29:50.684119+0000","last_unstale":"2024-05-08T18:32:46.062460+0000","last_undegraded":"2024-05-08T18:32:46.062460+0000","last_fullsized":"2024-05-08T18:32:46.062460+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:09:29.641515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"80'2","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863501+0000","last_change":"2024-05-08T18:29:42.575763+0000","last_active":"2024-05-08T18:32:46.863501+0000","last_peered":"2024-05-08T18:32:46.863501+0000","last_clean":"2024-05-08T18:32:46.863501+0000","last_became_active":"2024-05-08T18:29:42.575450+0000","last_became_peered":"2024-05-08T18:29:42.575450+0000","last_unstale":"2024-05-08T18:32:46.863501+0000","last_undegraded":"2024-05-08T18:32:46.863501+0000","last_fullsized":"2024-05-08T18:32:46.863501+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:20.471010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"93'10","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.917742+0000","last_change":"2024-05-08T18:29:40.546101+0000","last_active":"2024-05-08T18:32:46.917742+0000","last_peered":"2024-05-08T18:32:46.917742+0000","last_clean":"2024-05-08T18:32:46.917742+0000","last_became_active":"2024-05-08T18:29:40.545814+0000","last_became_peered":"2024-05-08T18:29:40.545814+0000","last_unstale":"2024-05-08T18:32:46.917742+0000","last_undegraded":"2024-05-08T18:32:46.917742+0000","last_fullsized":"2024-05-08T18:32:46.917742+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:22.579629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.850156+0000","last_change":"2024-05-08T18:29:44.591310+0000","last_active":"2024-05-08T18:32:46.850156+0000","last_peered":"2024-05-08T18:32:46.850156+0000","last_clean":"2024-05-08T18:32:46.850156+0000","last_became_active":"2024-05-08T18:29:44.590394+0000","last_became_peered":"2024-05-08T18:29:44.590394+0000","last_unstale":"2024-05-08T18:32:46.850156+0000","last_undegraded":"2024-05-08T18:32:46.850156+0000","last_fullsized":"2024-05-08T18:32:46.850156+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:02:28.348982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"97'21","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.936870+0000","last_change":"2024-05-08T18:29:46.605887+0000","last_active":"2024-05-08T18:32:46.936870+0000","last_peered":"2024-05-08T18:32:46.936870+0000","last_clean":"2024-05-08T18:32:46.936870+0000","last_became_active":"2024-05-08T18:29:46.604917+0000","last_became_peered":"2024-05-08T18:29:46.604917+0000","last_unstale":"2024-05-08T18:32:46.936870+0000","last_undegraded":"2024-05-08T18:32:46.936870+0000","last_fullsized":"2024-05-08T18:32:46.936870+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:22:36.338527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.918794+0000","last_change":"2024-05-08T18:29:48.644420+0000","last_active":"2024-05-08T18:32:46.918794+0000","last_peered":"2024-05-08T18:32:46.918794+0000","last_clean":"2024-05-08T18:32:46.918794+0000","last_became_active":"2024-05-08T18:29:48.643493+0000","last_became_peered":"2024-05-08T18:29:48.643493+0000","last_unstale":"2024-05-08T18:32:46.918794+0000","last_undegraded":"2024-05-08T18:32:46.918794+0000","last_fullsized":"2024-05-08T18:32:46.918794+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:19:33.148012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":174,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.848670+0000","last_change":"2024-05-08T18:29:50.687485+0000","last_active":"2024-05-08T18:32:46.848670+0000","last_peered":"2024-05-08T18:32:46.848670+0000","last_clean":"2024-05-08T18:32:46.848670+0000","last_became_active":"2024-05-08T18:29:50.686750+0000","last_became_peered":"2024-05-08T18:29:50.686750+0000","last_unstale":"2024-05-08T18:32:46.848670+0000","last_undegraded":"2024-05-08T18:32:46.848670+0000","last_fullsized":"2024-05-08T18:32:46.848670+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:41.914164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"97'4","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.066425+0000","last_change":"2024-05-08T18:29:42.566571+0000","last_active":"2024-05-08T18:32:46.066425+0000","last_peered":"2024-05-08T18:32:46.066425+0000","last_clean":"2024-05-08T18:32:46.066425+0000","last_became_active":"2024-05-08T18:29:42.563695+0000","last_became_peered":"2024-05-08T18:29:42.563695+0000","last_unstale":"2024-05-08T18:32:46.066425+0000","last_undegraded":"2024-05-08T18:32:46.066425+0000","last_fullsized":"2024-05-08T18:32:46.066425+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:46.887628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"93'10","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.059150+0000","last_change":"2024-05-08T18:29:40.545512+0000","last_active":"2024-05-08T18:32:46.059150+0000","last_peered":"2024-05-08T18:32:46.059150+0000","last_clean":"2024-05-08T18:32:46.059150+0000","last_became_active":"2024-05-08T18:29:40.544216+0000","last_became_peered":"2024-05-08T18:29:40.544216+0000","last_unstale":"2024-05-08T18:32:46.059150+0000","last_undegraded":"2024-05-08T18:32:46.059150+0000","last_fullsized":"2024-05-08T18:32:46.059150+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:37:08.242362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.060557+0000","last_change":"2024-05-08T18:29:44.576107+0000","last_active":"2024-05-08T18:32:46.060557+0000","last_peered":"2024-05-08T18:32:46.060557+0000","last_clean":"2024-05-08T18:32:46.060557+0000","last_became_active":"2024-05-08T18:29:44.575344+0000","last_became_peered":"2024-05-08T18:29:44.575344+0000","last_unstale":"2024-05-08T18:32:46.060557+0000","last_undegraded":"2024-05-08T18:32:46.060557+0000","last_fullsized":"2024-05-08T18:32:46.060557+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:19.731003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"97'17","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.067703+0000","last_change":"2024-05-08T18:29:46.584785+0000","last_active":"2024-05-08T18:32:46.067703+0000","last_peered":"2024-05-08T18:32:46.067703+0000","last_clean":"2024-05-08T18:32:46.067703+0000","last_became_active":"2024-05-08T18:29:46.583390+0000","last_became_peered":"2024-05-08T18:29:46.583390+0000","last_unstale":"2024-05-08T18:32:46.067703+0000","last_undegraded":"2024-05-08T18:32:46.067703+0000","last_fullsized":"2024-05-08T18:32:46.067703+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:27:01.747339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.919301+0000","last_change":"2024-05-08T18:29:48.643558+0000","last_active":"2024-05-08T18:32:46.919301+0000","last_peered":"2024-05-08T18:32:46.919301+0000","last_clean":"2024-05-08T18:32:46.919301+0000","last_became_active":"2024-05-08T18:29:48.642773+0000","last_became_peered":"2024-05-08T18:29:48.642773+0000","last_unstale":"2024-05-08T18:32:46.919301+0000","last_undegraded":"2024-05-08T18:32:46.919301+0000","last_fullsized":"2024-05-08T18:32:46.919301+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:59:04.369806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":174,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-08T18:32:45.239880+0000","last_change":"2024-05-08T18:29:50.674796+0000","last_active":"2024-05-08T18:32:45.239880+0000","last_peered":"2024-05-08T18:32:45.239880+0000","last_clean":"2024-05-08T18:32:45.239880+0000","last_became_active":"2024-05-08T18:29:50.674057+0000","last_became_peered":"2024-05-08T18:29:50.674057+0000","last_unstale":"2024-05-08T18:32:45.239880+0000","last_undegraded":"2024-05-08T18:32:45.239880+0000","last_fullsized":"2024-05-08T18:32:45.239880+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:34:14.488295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"84'4","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.062561+0000","last_change":"2024-05-08T18:29:42.577642+0000","last_active":"2024-05-08T18:32:46.062561+0000","last_peered":"2024-05-08T18:32:46.062561+0000","last_clean":"2024-05-08T18:32:46.062561+0000","last_became_active":"2024-05-08T18:29:42.577275+0000","last_became_peered":"2024-05-08T18:29:42.577275+0000","last_unstale":"2024-05-08T18:32:46.062561+0000","last_undegraded":"2024-05-08T18:32:46.062561+0000","last_fullsized":"2024-05-08T18:32:46.062561+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:51:45.155037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"93'10","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.862767+0000","last_change":"2024-05-08T18:29:40.562873+0000","last_active":"2024-05-08T18:32:46.862767+0000","last_peered":"2024-05-08T18:32:46.862767+0000","last_clean":"2024-05-08T18:32:46.862767+0000","last_became_active":"2024-05-08T18:29:40.562594+0000","last_became_peered":"2024-05-08T18:29:40.562594+0000","last_unstale":"2024-05-08T18:32:46.862767+0000","last_undegraded":"2024-05-08T18:32:46.862767+0000","last_fullsized":"2024-05-08T18:32:46.862767+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:16:16.521258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.918959+0000","last_change":"2024-05-08T18:29:44.594152+0000","last_active":"2024-05-08T18:32:46.918959+0000","last_peered":"2024-05-08T18:32:46.918959+0000","last_clean":"2024-05-08T18:32:46.918959+0000","last_became_active":"2024-05-08T18:29:44.593398+0000","last_became_peered":"2024-05-08T18:29:44.593398+0000","last_unstale":"2024-05-08T18:32:46.918959+0000","last_undegraded":"2024-05-08T18:32:46.918959+0000","last_fullsized":"2024-05-08T18:32:46.918959+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:11.825480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"85'12","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.059653+0000","last_change":"2024-05-08T18:29:46.602137+0000","last_active":"2024-05-08T18:32:46.059653+0000","last_peered":"2024-05-08T18:32:46.059653+0000","last_clean":"2024-05-08T18:32:46.059653+0000","last_became_active":"2024-05-08T18:29:46.601402+0000","last_became_peered":"2024-05-08T18:29:46.601402+0000","last_unstale":"2024-05-08T18:32:46.059653+0000","last_undegraded":"2024-05-08T18:32:46.059653+0000","last_fullsized":"2024-05-08T18:32:46.059653+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:23.940519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":22,"num_read_kb":17,"num_write":24,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"97'101","reported_seq":327,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.849636+0000","last_change":"2024-05-08T18:29:48.635696+0000","last_active":"2024-05-08T18:32:46.849636+0000","last_peered":"2024-05-08T18:32:46.849636+0000","last_clean":"2024-05-08T18:32:46.849636+0000","last_became_active":"2024-05-08T18:29:48.634859+0000","last_became_peered":"2024-05-08T18:29:48.634859+0000","last_unstale":"2024-05-08T18:32:46.849636+0000","last_undegraded":"2024-05-08T18:32:46.849636+0000","last_fullsized":"2024-05-08T18:32:46.849636+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:35:55.322495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":174,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.935107+0000","last_change":"2024-05-08T18:29:50.679757+0000","last_active":"2024-05-08T18:32:46.935107+0000","last_peered":"2024-05-08T18:32:46.935107+0000","last_clean":"2024-05-08T18:32:46.935107+0000","last_became_active":"2024-05-08T18:29:50.679011+0000","last_became_peered":"2024-05-08T18:29:50.679011+0000","last_unstale":"2024-05-08T18:32:46.935107+0000","last_undegraded":"2024-05-08T18:32:46.935107+0000","last_fullsized":"2024-05-08T18:32:46.935107+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:34:14.488295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"84'8","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.058657+0000","last_change":"2024-05-08T18:29:42.560354+0000","last_active":"2024-05-08T18:32:46.058657+0000","last_peered":"2024-05-08T18:32:46.058657+0000","last_clean":"2024-05-08T18:32:46.058657+0000","last_became_active":"2024-05-08T18:29:42.559647+0000","last_became_peered":"2024-05-08T18:29:42.559647+0000","last_unstale":"2024-05-08T18:32:46.058657+0000","last_undegraded":"2024-05-08T18:32:46.058657+0000","last_fullsized":"2024-05-08T18:32:46.058657+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:18:10.803989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"93'10","reported_seq":204,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-08T18:32:45.242880+0000","last_change":"2024-05-08T18:29:40.557683+0000","last_active":"2024-05-08T18:32:45.242880+0000","last_peered":"2024-05-08T18:32:45.242880+0000","last_clean":"2024-05-08T18:32:45.242880+0000","last_became_active":"2024-05-08T18:29:40.556254+0000","last_became_peered":"2024-05-08T18:29:40.556254+0000","last_unstale":"2024-05-08T18:32:45.242880+0000","last_undegraded":"2024-05-08T18:32:45.242880+0000","last_fullsized":"2024-05-08T18:32:45.242880+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:51:43.135322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.936035+0000","last_change":"2024-05-08T18:29:44.594068+0000","last_active":"2024-05-08T18:32:46.936035+0000","last_peered":"2024-05-08T18:32:46.936035+0000","last_clean":"2024-05-08T18:32:46.936035+0000","last_became_active":"2024-05-08T18:29:44.593322+0000","last_became_peered":"2024-05-08T18:29:44.593322+0000","last_unstale":"2024-05-08T18:32:46.936035+0000","last_undegraded":"2024-05-08T18:32:46.936035+0000","last_fullsized":"2024-05-08T18:32:46.936035+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:19.731003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"97'22","reported_seq":214,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-08T18:32:45.240271+0000","last_change":"2024-05-08T18:29:46.604700+0000","last_active":"2024-05-08T18:32:45.240271+0000","last_peered":"2024-05-08T18:32:45.240271+0000","last_clean":"2024-05-08T18:32:45.240271+0000","last_became_active":"2024-05-08T18:29:46.603885+0000","last_became_peered":"2024-05-08T18:29:46.603885+0000","last_unstale":"2024-05-08T18:32:45.240271+0000","last_undegraded":"2024-05-08T18:32:45.240271+0000","last_fullsized":"2024-05-08T18:32:45.240271+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:22:36.338527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9698,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":18,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.861740+0000","last_change":"2024-05-08T18:29:48.640814+0000","last_active":"2024-05-08T18:32:46.861740+0000","last_peered":"2024-05-08T18:32:46.861740+0000","last_clean":"2024-05-08T18:32:46.861740+0000","last_became_active":"2024-05-08T18:29:48.640046+0000","last_became_peered":"2024-05-08T18:29:48.640046+0000","last_unstale":"2024-05-08T18:32:46.861740+0000","last_undegraded":"2024-05-08T18:32:46.861740+0000","last_fullsized":"2024-05-08T18:32:46.861740+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:53:21.219706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"83'8","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.938436+0000","last_change":"2024-05-08T18:29:50.692688+0000","last_active":"2024-05-08T18:32:46.938436+0000","last_peered":"2024-05-08T18:32:46.938436+0000","last_clean":"2024-05-08T18:32:46.938436+0000","last_became_active":"2024-05-08T18:29:50.692123+0000","last_became_peered":"2024-05-08T18:29:50.692123+0000","last_unstale":"2024-05-08T18:32:46.938436+0000","last_undegraded":"2024-05-08T18:32:46.938436+0000","last_fullsized":"2024-05-08T18:32:46.938436+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:38.318890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"97'2","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.058878+0000","last_change":"2024-05-08T18:29:42.558336+0000","last_active":"2024-05-08T18:32:46.058878+0000","last_peered":"2024-05-08T18:32:46.058878+0000","last_clean":"2024-05-08T18:32:46.058878+0000","last_became_active":"2024-05-08T18:29:42.557570+0000","last_became_peered":"2024-05-08T18:29:42.557570+0000","last_unstale":"2024-05-08T18:32:46.058878+0000","last_undegraded":"2024-05-08T18:32:46.058878+0000","last_fullsized":"2024-05-08T18:32:46.058878+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:54:16.539832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"84'2","reported_seq":196,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-08T18:32:45.243493+0000","last_change":"2024-05-08T18:29:40.537090+0000","last_active":"2024-05-08T18:32:45.243493+0000","last_peered":"2024-05-08T18:32:45.243493+0000","last_clean":"2024-05-08T18:32:45.243493+0000","last_became_active":"2024-05-08T18:29:40.536188+0000","last_became_peered":"2024-05-08T18:29:40.536188+0000","last_unstale":"2024-05-08T18:32:45.243493+0000","last_undegraded":"2024-05-08T18:32:45.243493+0000","last_fullsized":"2024-05-08T18:32:45.243493+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:22:48.880581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":186,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-08T18:32:45.241675+0000","last_change":"2024-05-08T18:29:44.578901+0000","last_active":"2024-05-08T18:32:45.241675+0000","last_peered":"2024-05-08T18:32:45.241675+0000","last_clean":"2024-05-08T18:32:45.241675+0000","last_became_active":"2024-05-08T18:29:44.578171+0000","last_became_peered":"2024-05-08T18:29:44.578171+0000","last_unstale":"2024-05-08T18:32:45.241675+0000","last_undegraded":"2024-05-08T18:32:45.241675+0000","last_fullsized":"2024-05-08T18:32:45.241675+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:19.731003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"97'17","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.861874+0000","last_change":"2024-05-08T18:29:46.604539+0000","last_active":"2024-05-08T18:32:46.861874+0000","last_peered":"2024-05-08T18:32:46.861874+0000","last_clean":"2024-05-08T18:32:46.861874+0000","last_became_active":"2024-05-08T18:29:46.603728+0000","last_became_peered":"2024-05-08T18:29:46.603728+0000","last_unstale":"2024-05-08T18:32:46.861874+0000","last_undegraded":"2024-05-08T18:32:46.861874+0000","last_fullsized":"2024-05-08T18:32:46.861874+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:12:41.226788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.848661+0000","last_change":"2024-05-08T18:29:48.635813+0000","last_active":"2024-05-08T18:32:46.848661+0000","last_peered":"2024-05-08T18:32:46.848661+0000","last_clean":"2024-05-08T18:32:46.848661+0000","last_became_active":"2024-05-08T18:29:48.634664+0000","last_became_peered":"2024-05-08T18:29:48.634664+0000","last_unstale":"2024-05-08T18:32:46.848661+0000","last_undegraded":"2024-05-08T18:32:46.848661+0000","last_fullsized":"2024-05-08T18:32:46.848661+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:27:23.427365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"97'7","reported_seq":187,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.066075+0000","last_change":"2024-05-08T18:29:50.687517+0000","last_active":"2024-05-08T18:32:46.066075+0000","last_peered":"2024-05-08T18:32:46.066075+0000","last_clean":"2024-05-08T18:32:46.066075+0000","last_became_active":"2024-05-08T18:29:50.686662+0000","last_became_peered":"2024-05-08T18:29:50.686662+0000","last_unstale":"2024-05-08T18:32:46.066075+0000","last_undegraded":"2024-05-08T18:32:46.066075+0000","last_fullsized":"2024-05-08T18:32:46.066075+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:58:00.455559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"97'4","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.062709+0000","last_change":"2024-05-08T18:29:42.558848+0000","last_active":"2024-05-08T18:32:46.062709+0000","last_peered":"2024-05-08T18:32:46.062709+0000","last_clean":"2024-05-08T18:32:46.062709+0000","last_became_active":"2024-05-08T18:29:42.558390+0000","last_became_peered":"2024-05-08T18:29:42.558390+0000","last_unstale":"2024-05-08T18:32:46.062709+0000","last_undegraded":"2024-05-08T18:32:46.062709+0000","last_fullsized":"2024-05-08T18:32:46.062709+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:55:30.468069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"93'8","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.066372+0000","last_change":"2024-05-08T18:29:40.567772+0000","last_active":"2024-05-08T18:32:46.066372+0000","last_peered":"2024-05-08T18:32:46.066372+0000","last_clean":"2024-05-08T18:32:46.066372+0000","last_became_active":"2024-05-08T18:29:40.567482+0000","last_became_peered":"2024-05-08T18:29:40.567482+0000","last_unstale":"2024-05-08T18:32:46.066372+0000","last_undegraded":"2024-05-08T18:32:46.066372+0000","last_fullsized":"2024-05-08T18:32:46.066372+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:36:37.796095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":5,"num_write":18,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.057189+0000","last_change":"2024-05-08T18:29:44.596876+0000","last_active":"2024-05-08T18:32:46.057189+0000","last_peered":"2024-05-08T18:32:46.057189+0000","last_clean":"2024-05-08T18:32:46.057189+0000","last_became_active":"2024-05-08T18:29:44.595712+0000","last_became_peered":"2024-05-08T18:29:44.595712+0000","last_unstale":"2024-05-08T18:32:46.057189+0000","last_undegraded":"2024-05-08T18:32:46.057189+0000","last_fullsized":"2024-05-08T18:32:46.057189+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:35:51.288126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"97'11","reported_seq":201,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.064975+0000","last_change":"2024-05-08T18:29:46.598637+0000","last_active":"2024-05-08T18:32:46.064975+0000","last_peered":"2024-05-08T18:32:46.064975+0000","last_clean":"2024-05-08T18:32:46.064975+0000","last_became_active":"2024-05-08T18:29:46.597394+0000","last_became_peered":"2024-05-08T18:29:46.597394+0000","last_unstale":"2024-05-08T18:32:46.064975+0000","last_undegraded":"2024-05-08T18:32:46.064975+0000","last_fullsized":"2024-05-08T18:32:46.064975+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:52:22.540814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.057643+0000","last_change":"2024-05-08T18:29:48.642251+0000","last_active":"2024-05-08T18:32:46.057643+0000","last_peered":"2024-05-08T18:32:46.057643+0000","last_clean":"2024-05-08T18:32:46.057643+0000","last_became_active":"2024-05-08T18:29:48.641666+0000","last_became_peered":"2024-05-08T18:29:48.641666+0000","last_unstale":"2024-05-08T18:32:46.057643+0000","last_undegraded":"2024-05-08T18:32:46.057643+0000","last_fullsized":"2024-05-08T18:32:46.057643+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:13:50.865474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"80'2","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.937644+0000","last_change":"2024-05-08T18:29:50.685668+0000","last_active":"2024-05-08T18:32:46.937644+0000","last_peered":"2024-05-08T18:32:46.937644+0000","last_clean":"2024-05-08T18:32:46.937644+0000","last_became_active":"2024-05-08T18:29:50.684958+0000","last_became_peered":"2024-05-08T18:29:50.684958+0000","last_unstale":"2024-05-08T18:32:46.937644+0000","last_undegraded":"2024-05-08T18:32:46.937644+0000","last_fullsized":"2024-05-08T18:32:46.937644+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:55:01.894779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.057760+0000","last_change":"2024-05-08T18:29:42.562063+0000","last_active":"2024-05-08T18:32:46.057760+0000","last_peered":"2024-05-08T18:32:46.057760+0000","last_clean":"2024-05-08T18:32:46.057760+0000","last_became_active":"2024-05-08T18:29:42.558871+0000","last_became_peered":"2024-05-08T18:29:42.558871+0000","last_unstale":"2024-05-08T18:32:46.057760+0000","last_undegraded":"2024-05-08T18:32:46.057760+0000","last_fullsized":"2024-05-08T18:32:46.057760+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:59.243324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"93'13","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863884+0000","last_change":"2024-05-08T18:29:40.541070+0000","last_active":"2024-05-08T18:32:46.863884+0000","last_peered":"2024-05-08T18:32:46.863884+0000","last_clean":"2024-05-08T18:32:46.863884+0000","last_became_active":"2024-05-08T18:29:40.540767+0000","last_became_peered":"2024-05-08T18:29:40.540767+0000","last_unstale":"2024-05-08T18:32:46.863884+0000","last_undegraded":"2024-05-08T18:32:46.863884+0000","last_fullsized":"2024-05-08T18:32:46.863884+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:09:39.835826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"26'1","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.917294+0000","last_change":"2024-05-08T18:29:44.592737+0000","last_active":"2024-05-08T18:32:46.917294+0000","last_peered":"2024-05-08T18:32:46.917294+0000","last_clean":"2024-05-08T18:32:46.917294+0000","last_became_active":"2024-05-08T18:29:44.592243+0000","last_became_peered":"2024-05-08T18:29:44.592243+0000","last_unstale":"2024-05-08T18:32:46.917294+0000","last_undegraded":"2024-05-08T18:32:46.917294+0000","last_fullsized":"2024-05-08T18:32:46.917294+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:59.744050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"97'16","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.058346+0000","last_change":"2024-05-08T18:29:46.610835+0000","last_active":"2024-05-08T18:32:46.058346+0000","last_peered":"2024-05-08T18:32:46.058346+0000","last_clean":"2024-05-08T18:32:46.058346+0000","last_became_active":"2024-05-08T18:29:46.609903+0000","last_became_peered":"2024-05-08T18:29:46.609903+0000","last_unstale":"2024-05-08T18:32:46.058346+0000","last_undegraded":"2024-05-08T18:32:46.058346+0000","last_fullsized":"2024-05-08T18:32:46.058346+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:37:35.850414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.862608+0000","last_change":"2024-05-08T18:29:48.629822+0000","last_active":"2024-05-08T18:32:46.862608+0000","last_peered":"2024-05-08T18:32:46.862608+0000","last_clean":"2024-05-08T18:32:46.862608+0000","last_became_active":"2024-05-08T18:29:48.629204+0000","last_became_peered":"2024-05-08T18:29:48.629204+0000","last_unstale":"2024-05-08T18:32:46.862608+0000","last_undegraded":"2024-05-08T18:32:46.862608+0000","last_fullsized":"2024-05-08T18:32:46.862608+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:04.571608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"84'6","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.060640+0000","last_change":"2024-05-08T18:29:50.668101+0000","last_active":"2024-05-08T18:32:46.060640+0000","last_peered":"2024-05-08T18:32:46.060640+0000","last_clean":"2024-05-08T18:32:46.060640+0000","last_became_active":"2024-05-08T18:29:50.667357+0000","last_became_peered":"2024-05-08T18:29:50.667357+0000","last_unstale":"2024-05-08T18:32:46.060640+0000","last_undegraded":"2024-05-08T18:32:46.060640+0000","last_fullsized":"2024-05-08T18:32:46.060640+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:55:01.894779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"97'4","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.919471+0000","last_change":"2024-05-08T18:29:42.581366+0000","last_active":"2024-05-08T18:32:46.919471+0000","last_peered":"2024-05-08T18:32:46.919471+0000","last_clean":"2024-05-08T18:32:46.919471+0000","last_became_active":"2024-05-08T18:29:42.580988+0000","last_became_peered":"2024-05-08T18:29:42.580988+0000","last_unstale":"2024-05-08T18:32:46.919471+0000","last_undegraded":"2024-05-08T18:32:46.919471+0000","last_fullsized":"2024-05-08T18:32:46.919471+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:42.005809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"84'9","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.848329+0000","last_change":"2024-05-08T18:29:40.562025+0000","last_active":"2024-05-08T18:32:46.848329+0000","last_peered":"2024-05-08T18:32:46.848329+0000","last_clean":"2024-05-08T18:32:46.848329+0000","last_became_active":"2024-05-08T18:29:40.561277+0000","last_became_peered":"2024-05-08T18:29:40.561277+0000","last_unstale":"2024-05-08T18:32:46.848329+0000","last_undegraded":"2024-05-08T18:32:46.848329+0000","last_fullsized":"2024-05-08T18:32:46.848329+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:59:25.840149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":19,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.916111+0000","last_change":"2024-05-08T18:29:42.573832+0000","last_active":"2024-05-08T18:32:46.916111+0000","last_peered":"2024-05-08T18:32:46.916111+0000","last_clean":"2024-05-08T18:32:46.916111+0000","last_became_active":"2024-05-08T18:29:42.573502+0000","last_became_peered":"2024-05-08T18:29:42.573502+0000","last_unstale":"2024-05-08T18:32:46.916111+0000","last_undegraded":"2024-05-08T18:32:46.916111+0000","last_fullsized":"2024-05-08T18:32:46.916111+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:35.037465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"93'8","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.060494+0000","last_change":"2024-05-08T18:29:40.533094+0000","last_active":"2024-05-08T18:32:46.060494+0000","last_peered":"2024-05-08T18:32:46.060494+0000","last_clean":"2024-05-08T18:32:46.060494+0000","last_became_active":"2024-05-08T18:29:40.532246+0000","last_became_peered":"2024-05-08T18:29:40.532246+0000","last_unstale":"2024-05-08T18:32:46.060494+0000","last_undegraded":"2024-05-08T18:32:46.060494+0000","last_fullsized":"2024-05-08T18:32:46.060494+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:37:08.242362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":190,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-08T18:32:45.242871+0000","last_change":"2024-05-08T18:29:42.565298+0000","last_active":"2024-05-08T18:32:45.242871+0000","last_peered":"2024-05-08T18:32:45.242871+0000","last_clean":"2024-05-08T18:32:45.242871+0000","last_became_active":"2024-05-08T18:29:42.564542+0000","last_became_peered":"2024-05-08T18:29:42.564542+0000","last_unstale":"2024-05-08T18:32:45.242871+0000","last_undegraded":"2024-05-08T18:32:45.242871+0000","last_fullsized":"2024-05-08T18:32:45.242871+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:57.706167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"93'14","reported_seq":208,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-08T18:32:45.241385+0000","last_change":"2024-05-08T18:29:40.556958+0000","last_active":"2024-05-08T18:32:45.241385+0000","last_peered":"2024-05-08T18:32:45.241385+0000","last_clean":"2024-05-08T18:32:45.241385+0000","last_became_active":"2024-05-08T18:29:40.556091+0000","last_became_peered":"2024-05-08T18:29:40.556091+0000","last_unstale":"2024-05-08T18:32:45.241385+0000","last_undegraded":"2024-05-08T18:32:45.241385+0000","last_fullsized":"2024-05-08T18:32:45.241385+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:39.986094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"97'6","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.918325+0000","last_change":"2024-05-08T18:29:42.574619+0000","last_active":"2024-05-08T18:32:46.918325+0000","last_peered":"2024-05-08T18:32:46.918325+0000","last_clean":"2024-05-08T18:32:46.918325+0000","last_became_active":"2024-05-08T18:29:42.573178+0000","last_became_peered":"2024-05-08T18:29:42.573178+0000","last_unstale":"2024-05-08T18:32:46.918325+0000","last_undegraded":"2024-05-08T18:32:46.918325+0000","last_fullsized":"2024-05-08T18:32:46.918325+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:33.139089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"92'5","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.862863+0000","last_change":"2024-05-08T18:29:40.544338+0000","last_active":"2024-05-08T18:32:46.862863+0000","last_peered":"2024-05-08T18:32:46.862863+0000","last_clean":"2024-05-08T18:32:46.862863+0000","last_became_active":"2024-05-08T18:29:40.544107+0000","last_became_peered":"2024-05-08T18:29:40.544107+0000","last_unstale":"2024-05-08T18:32:46.862863+0000","last_undegraded":"2024-05-08T18:32:46.862863+0000","last_fullsized":"2024-05-08T18:32:46.862863+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:54.200883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"84'2","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.064285+0000","last_change":"2024-05-08T18:29:42.576979+0000","last_active":"2024-05-08T18:32:46.064285+0000","last_peered":"2024-05-08T18:32:46.064285+0000","last_clean":"2024-05-08T18:32:46.064285+0000","last_became_active":"2024-05-08T18:29:42.576395+0000","last_became_peered":"2024-05-08T18:29:42.576395+0000","last_unstale":"2024-05-08T18:32:46.064285+0000","last_undegraded":"2024-05-08T18:32:46.064285+0000","last_fullsized":"2024-05-08T18:32:46.064285+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:53:03.097704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"93'5","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.066660+0000","last_change":"2024-05-08T18:29:40.558142+0000","last_active":"2024-05-08T18:32:46.066660+0000","last_peered":"2024-05-08T18:32:46.066660+0000","last_clean":"2024-05-08T18:32:46.066660+0000","last_became_active":"2024-05-08T18:29:40.557874+0000","last_became_peered":"2024-05-08T18:29:40.557874+0000","last_unstale":"2024-05-08T18:32:46.066660+0000","last_undegraded":"2024-05-08T18:32:46.066660+0000","last_fullsized":"2024-05-08T18:32:46.066660+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:54.200883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"97'2","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.059136+0000","last_change":"2024-05-08T18:29:42.558324+0000","last_active":"2024-05-08T18:32:46.059136+0000","last_peered":"2024-05-08T18:32:46.059136+0000","last_clean":"2024-05-08T18:32:46.059136+0000","last_became_active":"2024-05-08T18:29:42.556774+0000","last_became_peered":"2024-05-08T18:29:42.556774+0000","last_unstale":"2024-05-08T18:32:46.059136+0000","last_undegraded":"2024-05-08T18:32:46.059136+0000","last_fullsized":"2024-05-08T18:32:46.059136+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:02:26.311100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"93'11","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.919113+0000","last_change":"2024-05-08T18:30:20.858467+0000","last_active":"2024-05-08T18:32:46.919113+0000","last_peered":"2024-05-08T18:32:46.919113+0000","last_clean":"2024-05-08T18:32:46.919113+0000","last_became_active":"2024-05-08T18:30:20.858016+0000","last_became_peered":"2024-05-08T18:30:20.858016+0000","last_unstale":"2024-05-08T18:32:46.919113+0000","last_undegraded":"2024-05-08T18:32:46.919113+0000","last_fullsized":"2024-05-08T18:32:46.919113+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:10:28.824915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"84'4","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.062025+0000","last_change":"2024-05-08T18:29:42.562772+0000","last_active":"2024-05-08T18:32:46.062025+0000","last_peered":"2024-05-08T18:32:46.062025+0000","last_clean":"2024-05-08T18:32:46.062025+0000","last_became_active":"2024-05-08T18:29:42.562420+0000","last_became_peered":"2024-05-08T18:29:42.562420+0000","last_unstale":"2024-05-08T18:32:46.062025+0000","last_undegraded":"2024-05-08T18:32:46.062025+0000","last_fullsized":"2024-05-08T18:32:46.062025+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:30:29.452640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"93'5","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.850198+0000","last_change":"2024-05-08T18:29:40.562024+0000","last_active":"2024-05-08T18:32:46.850198+0000","last_peered":"2024-05-08T18:32:46.850198+0000","last_clean":"2024-05-08T18:32:46.850198+0000","last_became_active":"2024-05-08T18:29:40.561326+0000","last_became_peered":"2024-05-08T18:29:40.561326+0000","last_unstale":"2024-05-08T18:32:46.850198+0000","last_undegraded":"2024-05-08T18:32:46.850198+0000","last_fullsized":"2024-05-08T18:32:46.850198+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:21:38.354933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"97'4","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.847229+0000","last_change":"2024-05-08T18:29:42.561419+0000","last_active":"2024-05-08T18:32:46.847229+0000","last_peered":"2024-05-08T18:32:46.847229+0000","last_clean":"2024-05-08T18:32:46.847229+0000","last_became_active":"2024-05-08T18:29:42.560520+0000","last_became_peered":"2024-05-08T18:29:42.560520+0000","last_unstale":"2024-05-08T18:32:46.847229+0000","last_undegraded":"2024-05-08T18:32:46.847229+0000","last_fullsized":"2024-05-08T18:32:46.847229+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:07.949520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"93'11","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.067225+0000","last_change":"2024-05-08T18:29:40.554884+0000","last_active":"2024-05-08T18:32:46.067225+0000","last_peered":"2024-05-08T18:32:46.067225+0000","last_clean":"2024-05-08T18:32:46.067225+0000","last_became_active":"2024-05-08T18:29:40.554603+0000","last_became_peered":"2024-05-08T18:29:40.554603+0000","last_unstale":"2024-05-08T18:32:46.067225+0000","last_undegraded":"2024-05-08T18:32:46.067225+0000","last_fullsized":"2024-05-08T18:32:46.067225+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:09:39.835826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"84'4","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.861066+0000","last_change":"2024-05-08T18:29:42.574689+0000","last_active":"2024-05-08T18:32:46.861066+0000","last_peered":"2024-05-08T18:32:46.861066+0000","last_clean":"2024-05-08T18:32:46.861066+0000","last_became_active":"2024-05-08T18:29:42.573947+0000","last_became_peered":"2024-05-08T18:29:42.573947+0000","last_unstale":"2024-05-08T18:32:46.861066+0000","last_undegraded":"2024-05-08T18:32:46.861066+0000","last_fullsized":"2024-05-08T18:32:46.861066+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:57:14.869860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"93'10","reported_seq":204,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-08T18:32:45.239870+0000","last_change":"2024-05-08T18:29:40.554005+0000","last_active":"2024-05-08T18:32:45.239870+0000","last_peered":"2024-05-08T18:32:45.239870+0000","last_clean":"2024-05-08T18:32:45.239870+0000","last_became_active":"2024-05-08T18:29:40.553356+0000","last_became_peered":"2024-05-08T18:29:40.553356+0000","last_unstale":"2024-05-08T18:32:45.239870+0000","last_undegraded":"2024-05-08T18:32:45.239870+0000","last_fullsized":"2024-05-08T18:32:45.239870+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:08:13.006752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"84'2","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.059942+0000","last_change":"2024-05-08T18:29:42.566487+0000","last_active":"2024-05-08T18:32:46.059942+0000","last_peered":"2024-05-08T18:32:46.059942+0000","last_clean":"2024-05-08T18:32:46.059942+0000","last_became_active":"2024-05-08T18:29:42.565760+0000","last_became_peered":"2024-05-08T18:29:42.565760+0000","last_unstale":"2024-05-08T18:32:46.059942+0000","last_undegraded":"2024-05-08T18:32:46.059942+0000","last_fullsized":"2024-05-08T18:32:46.059942+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:57.706167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"93'8","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.062985+0000","last_change":"2024-05-08T18:29:40.552543+0000","last_active":"2024-05-08T18:32:46.062985+0000","last_peered":"2024-05-08T18:32:46.062985+0000","last_clean":"2024-05-08T18:32:46.062985+0000","last_became_active":"2024-05-08T18:29:40.552307+0000","last_became_peered":"2024-05-08T18:29:40.552307+0000","last_unstale":"2024-05-08T18:32:46.062985+0000","last_undegraded":"2024-05-08T18:32:46.062985+0000","last_fullsized":"2024-05-08T18:32:46.062985+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:48.294532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"84'4","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.063759+0000","last_change":"2024-05-08T18:29:42.561658+0000","last_active":"2024-05-08T18:32:46.063759+0000","last_peered":"2024-05-08T18:32:46.063759+0000","last_clean":"2024-05-08T18:32:46.063759+0000","last_became_active":"2024-05-08T18:29:42.561171+0000","last_became_peered":"2024-05-08T18:29:42.561171+0000","last_unstale":"2024-05-08T18:32:46.063759+0000","last_undegraded":"2024-05-08T18:32:46.063759+0000","last_fullsized":"2024-05-08T18:32:46.063759+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:15.966061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"93'10","reported_seq":204,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-08T18:32:45.241123+0000","last_change":"2024-05-08T18:29:40.543041+0000","last_active":"2024-05-08T18:32:45.241123+0000","last_peered":"2024-05-08T18:32:45.241123+0000","last_clean":"2024-05-08T18:32:45.241123+0000","last_became_active":"2024-05-08T18:29:40.542398+0000","last_became_peered":"2024-05-08T18:29:40.542398+0000","last_unstale":"2024-05-08T18:32:45.241123+0000","last_undegraded":"2024-05-08T18:32:45.241123+0000","last_fullsized":"2024-05-08T18:32:45.241123+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:33.017750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"97'6","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.060280+0000","last_change":"2024-05-08T18:29:42.579690+0000","last_active":"2024-05-08T18:32:46.060280+0000","last_peered":"2024-05-08T18:32:46.060280+0000","last_clean":"2024-05-08T18:32:46.060280+0000","last_became_active":"2024-05-08T18:29:42.578981+0000","last_became_peered":"2024-05-08T18:29:42.578981+0000","last_unstale":"2024-05-08T18:32:46.060280+0000","last_undegraded":"2024-05-08T18:32:46.060280+0000","last_fullsized":"2024-05-08T18:32:46.060280+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:36:03.084561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"93'11","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.862989+0000","last_change":"2024-05-08T18:29:40.548499+0000","last_active":"2024-05-08T18:32:46.862989+0000","last_peered":"2024-05-08T18:32:46.862989+0000","last_clean":"2024-05-08T18:32:46.862989+0000","last_became_active":"2024-05-08T18:29:40.548177+0000","last_became_peered":"2024-05-08T18:29:40.548177+0000","last_unstale":"2024-05-08T18:32:46.862989+0000","last_undegraded":"2024-05-08T18:32:46.862989+0000","last_fullsized":"2024-05-08T18:32:46.862989+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:27:41.414153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"80'2","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.934939+0000","last_change":"2024-05-08T18:29:42.575892+0000","last_active":"2024-05-08T18:32:46.934939+0000","last_peered":"2024-05-08T18:32:46.934939+0000","last_clean":"2024-05-08T18:32:46.934939+0000","last_became_active":"2024-05-08T18:29:42.573384+0000","last_became_peered":"2024-05-08T18:29:42.573384+0000","last_unstale":"2024-05-08T18:32:46.934939+0000","last_undegraded":"2024-05-08T18:32:46.934939+0000","last_fullsized":"2024-05-08T18:32:46.934939+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:55.055481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"93'9","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.849826+0000","last_change":"2024-05-08T18:29:40.565068+0000","last_active":"2024-05-08T18:32:46.849826+0000","last_peered":"2024-05-08T18:32:46.849826+0000","last_clean":"2024-05-08T18:32:46.849826+0000","last_became_active":"2024-05-08T18:29:40.563231+0000","last_became_peered":"2024-05-08T18:29:40.563231+0000","last_unstale":"2024-05-08T18:32:46.849826+0000","last_undegraded":"2024-05-08T18:32:46.849826+0000","last_fullsized":"2024-05-08T18:32:46.849826+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:17:47.828990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.862573+0000","last_change":"2024-05-08T18:29:42.564338+0000","last_active":"2024-05-08T18:32:46.862573+0000","last_peered":"2024-05-08T18:32:46.862573+0000","last_clean":"2024-05-08T18:32:46.862573+0000","last_became_active":"2024-05-08T18:29:42.563822+0000","last_became_peered":"2024-05-08T18:29:42.563822+0000","last_unstale":"2024-05-08T18:32:46.862573+0000","last_undegraded":"2024-05-08T18:32:46.862573+0000","last_fullsized":"2024-05-08T18:32:46.862573+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:23.397435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"93'14","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.938359+0000","last_change":"2024-05-08T18:29:40.573333+0000","last_active":"2024-05-08T18:32:46.938359+0000","last_peered":"2024-05-08T18:32:46.938359+0000","last_clean":"2024-05-08T18:32:46.938359+0000","last_became_active":"2024-05-08T18:29:40.571195+0000","last_became_peered":"2024-05-08T18:29:40.571195+0000","last_unstale":"2024-05-08T18:32:46.938359+0000","last_undegraded":"2024-05-08T18:32:46.938359+0000","last_fullsized":"2024-05-08T18:32:46.938359+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:33.017750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.061746+0000","last_change":"2024-05-08T18:29:42.563085+0000","last_active":"2024-05-08T18:32:46.061746+0000","last_peered":"2024-05-08T18:32:46.061746+0000","last_clean":"2024-05-08T18:32:46.061746+0000","last_became_active":"2024-05-08T18:29:42.560419+0000","last_became_peered":"2024-05-08T18:29:42.560419+0000","last_unstale":"2024-05-08T18:32:46.061746+0000","last_undegraded":"2024-05-08T18:32:46.061746+0000","last_fullsized":"2024-05-08T18:32:46.061746+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:20.397730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"93'10","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.064712+0000","last_change":"2024-05-08T18:29:40.568890+0000","last_active":"2024-05-08T18:32:46.064712+0000","last_peered":"2024-05-08T18:32:46.064712+0000","last_clean":"2024-05-08T18:32:46.064712+0000","last_became_active":"2024-05-08T18:29:40.568584+0000","last_became_peered":"2024-05-08T18:29:40.568584+0000","last_unstale":"2024-05-08T18:32:46.064712+0000","last_undegraded":"2024-05-08T18:32:46.064712+0000","last_fullsized":"2024-05-08T18:32:46.064712+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:25:01.595224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"83'6","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.934923+0000","last_change":"2024-05-08T18:29:42.574277+0000","last_active":"2024-05-08T18:32:46.934923+0000","last_peered":"2024-05-08T18:32:46.934923+0000","last_clean":"2024-05-08T18:32:46.934923+0000","last_became_active":"2024-05-08T18:29:42.573563+0000","last_became_peered":"2024-05-08T18:29:42.573563+0000","last_unstale":"2024-05-08T18:32:46.934923+0000","last_undegraded":"2024-05-08T18:32:46.934923+0000","last_fullsized":"2024-05-08T18:32:46.934923+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:57.706167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"93'8","reported_seq":202,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-08T18:32:45.243891+0000","last_change":"2024-05-08T18:29:40.562058+0000","last_active":"2024-05-08T18:32:45.243891+0000","last_peered":"2024-05-08T18:32:45.243891+0000","last_clean":"2024-05-08T18:32:45.243891+0000","last_became_active":"2024-05-08T18:29:40.561360+0000","last_became_peered":"2024-05-08T18:29:40.561360+0000","last_unstale":"2024-05-08T18:32:45.243891+0000","last_undegraded":"2024-05-08T18:32:45.243891+0000","last_fullsized":"2024-05-08T18:32:45.243891+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:05.929806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"93'12","reported_seq":207,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-08T18:32:45.239599+0000","last_change":"2024-05-08T18:29:40.538728+0000","last_active":"2024-05-08T18:32:45.239599+0000","last_peered":"2024-05-08T18:32:45.239599+0000","last_clean":"2024-05-08T18:32:45.239599+0000","last_became_active":"2024-05-08T18:29:40.537925+0000","last_became_peered":"2024-05-08T18:29:40.537925+0000","last_unstale":"2024-05-08T18:32:45.239599+0000","last_undegraded":"2024-05-08T18:32:45.239599+0000","last_fullsized":"2024-05-08T18:32:45.239599+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:28.426657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":3,"num_read_kb":4,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"97'8","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.861235+0000","last_change":"2024-05-08T18:29:42.574941+0000","last_active":"2024-05-08T18:32:46.861235+0000","last_peered":"2024-05-08T18:32:46.861235+0000","last_clean":"2024-05-08T18:32:46.861235+0000","last_became_active":"2024-05-08T18:29:42.574351+0000","last_became_peered":"2024-05-08T18:29:42.574351+0000","last_unstale":"2024-05-08T18:32:46.861235+0000","last_undegraded":"2024-05-08T18:32:46.861235+0000","last_fullsized":"2024-05-08T18:32:46.861235+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:21.935293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"93'10","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.917647+0000","last_change":"2024-05-08T18:29:40.543714+0000","last_active":"2024-05-08T18:32:46.917647+0000","last_peered":"2024-05-08T18:32:46.917647+0000","last_clean":"2024-05-08T18:32:46.917647+0000","last_became_active":"2024-05-08T18:29:40.542965+0000","last_became_peered":"2024-05-08T18:29:40.542965+0000","last_unstale":"2024-05-08T18:32:46.917647+0000","last_undegraded":"2024-05-08T18:32:46.917647+0000","last_fullsized":"2024-05-08T18:32:46.917647+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:12:59.146887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":190,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-08T18:32:45.243562+0000","last_change":"2024-05-08T18:29:42.560007+0000","last_active":"2024-05-08T18:32:45.243562+0000","last_peered":"2024-05-08T18:32:45.243562+0000","last_clean":"2024-05-08T18:32:45.243562+0000","last_became_active":"2024-05-08T18:29:42.559028+0000","last_became_peered":"2024-05-08T18:29:42.559028+0000","last_unstale":"2024-05-08T18:32:45.243562+0000","last_undegraded":"2024-05-08T18:32:45.243562+0000","last_fullsized":"2024-05-08T18:32:45.243562+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:36:03.084561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":247,"num_read_kb":238,"num_write":231,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":808,"ondisk_log_size":808,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":156300,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":814,"num_read_kb":576,"num_write":459,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":272740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":666,"ondisk_log_size":666,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":334,"num_read_kb":334,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":579,"num_read_kb":555,"num_write":234,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":222,"ondisk_log_size":222,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":2397044736,"num_objects":572,"num_object_clones":0,"num_object_copies":1144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":572,"num_whiteouts":0,"num_read":21,"num_read_kb":23,"num_write":644,"num_write_kb":2365440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4794089472,"data_stored":4794089472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":584,"ondisk_log_size":584,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509486,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":686464,"kb_used_data":655276,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93685376,"statfs":{"total":96636764160,"available":95933825024,"internally_reserved":0,"allocated":671002624,"data_stored":670383066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509486,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":423716,"kb_used_data":392528,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93948124,"statfs":{"total":96636764160,"available":96202878976,"internally_reserved":0,"allocated":401948672,"data_stored":401356582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509484,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":794532,"kb_used_data":763344,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93577308,"statfs":{"total":96636764160,"available":95823163392,"internally_reserved":0,"allocated":781664256,"data_stored":781016382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509484,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":683812,"kb_used_data":652624,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93688028,"statfs":{"total":96636764160,"available":95936540672,"internally_reserved":0,"allocated":668286976,"data_stored":667702261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542189,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":683964,"kb_used_data":652780,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93687876,"statfs":{"total":96636764160,"available":95936385024,"internally_reserved":0,"allocated":668446720,"data_stored":667824622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542189,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":487204,"kb_used_data":456024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93884636,"statfs":{"total":96636764160,"available":96137867264,"internally_reserved":0,"allocated":466968576,"data_stored":466377162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542187,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":438084,"kb_used_data":406896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93933756,"statfs":{"total":96636764160,"available":96188166144,"internally_reserved":0,"allocated":416661504,"data_stored":416048101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542189,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":745900,"kb_used_data":714716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93625940,"statfs":{"total":96636764160,"available":95872962560,"internally_reserved":0,"allocated":731869184,"data_stored":731259517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":729808896,"data_stored":729808896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":415236096,"data_stored":415236096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":465567744,"data_stored":465567744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":666894336,"data_stored":666894336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":666894336,"data_stored":666894336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":780140544,"data_stored":780140544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":400556032,"data_stored":400556032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":668991488,"data_stored":668991488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":59088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":12223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":176128,"data_stored":122673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":75918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T18:32:49.533 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T18:32:49.865 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-05-08T18:32:49.872 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2024-05-08T18:32:49.880 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":211,"stamp":"2024-05-08T18:32:49.472694+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2397793017,"num_objects":771,"num_object_clones":0,"num_object_copies":1542,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":771,"num_whiteouts":0,"num_read":2061,"num_read_kb":1781,"num_write":1679,"num_write_kb":2367361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2469,"ondisk_log_size":2469,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":4943676,"kb_used_data":4694188,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":750031044,"statfs":{"total":773094113280,"available":768031789056,"internally_reserved":0,"allocated":4806848512,"data_stored":4801967693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002606"},"pg_stats":[{"pgid":"3.3f","version":"93'10","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.938099+0000","last_change":"2024-05-08T18:29:40.574221+0000","last_active":"2024-05-08T18:32:46.938099+0000","last_peered":"2024-05-08T18:32:46.938099+0000","last_clean":"2024-05-08T18:32:46.938099+0000","last_became_active":"2024-05-08T18:29:40.573543+0000","last_became_peered":"2024-05-08T18:29:40.573543+0000","last_unstale":"2024-05-08T18:32:46.938099+0000","last_undegraded":"2024-05-08T18:32:46.938099+0000","last_fullsized":"2024-05-08T18:32:46.938099+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:57.223609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39845888,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"97'2","reported_seq":195,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-08T18:32:45.237855+0000","last_change":"2024-05-08T18:29:42.563773+0000","last_active":"2024-05-08T18:32:45.237855+0000","last_peered":"2024-05-08T18:32:45.237855+0000","last_clean":"2024-05-08T18:32:45.237855+0000","last_became_active":"2024-05-08T18:29:42.561201+0000","last_became_peered":"2024-05-08T18:29:42.561201+0000","last_unstale":"2024-05-08T18:32:45.237855+0000","last_undegraded":"2024-05-08T18:32:45.237855+0000","last_fullsized":"2024-05-08T18:32:45.237855+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:55.055481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"93'10","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.919609+0000","last_change":"2024-05-08T18:29:40.549299+0000","last_active":"2024-05-08T18:32:46.919609+0000","last_peered":"2024-05-08T18:32:46.919609+0000","last_clean":"2024-05-08T18:32:46.919609+0000","last_became_active":"2024-05-08T18:29:40.548930+0000","last_became_peered":"2024-05-08T18:29:40.548930+0000","last_unstale":"2024-05-08T18:32:46.919609+0000","last_undegraded":"2024-05-08T18:32:46.919609+0000","last_fullsized":"2024-05-08T18:32:46.919609+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:06:36.198647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"84'2","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.936351+0000","last_change":"2024-05-08T18:29:42.572074+0000","last_active":"2024-05-08T18:32:46.936351+0000","last_peered":"2024-05-08T18:32:46.936351+0000","last_clean":"2024-05-08T18:32:46.936351+0000","last_became_active":"2024-05-08T18:29:42.571344+0000","last_became_peered":"2024-05-08T18:29:42.571344+0000","last_unstale":"2024-05-08T18:32:46.936351+0000","last_undegraded":"2024-05-08T18:32:46.936351+0000","last_fullsized":"2024-05-08T18:32:46.936351+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:36.890277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"97'14","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863310+0000","last_change":"2024-05-08T18:29:40.539048+0000","last_active":"2024-05-08T18:32:46.863310+0000","last_peered":"2024-05-08T18:32:46.863310+0000","last_clean":"2024-05-08T18:32:46.863310+0000","last_became_active":"2024-05-08T18:29:40.538458+0000","last_became_peered":"2024-05-08T18:29:40.538458+0000","last_unstale":"2024-05-08T18:32:46.863310+0000","last_undegraded":"2024-05-08T18:32:46.863310+0000","last_fullsized":"2024-05-08T18:32:46.863310+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:36:37.796095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":3,"num_read_kb":4,"num_write":24,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.058600+0000","last_change":"2024-05-08T18:29:42.569718+0000","last_active":"2024-05-08T18:32:46.058600+0000","last_peered":"2024-05-08T18:32:46.058600+0000","last_clean":"2024-05-08T18:32:46.058600+0000","last_became_active":"2024-05-08T18:29:42.569026+0000","last_became_peered":"2024-05-08T18:29:42.569026+0000","last_unstale":"2024-05-08T18:32:46.058600+0000","last_undegraded":"2024-05-08T18:32:46.058600+0000","last_fullsized":"2024-05-08T18:32:46.058600+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:42.045615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"84'8","reported_seq":202,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-08T18:32:45.242814+0000","last_change":"2024-05-08T18:29:40.557700+0000","last_active":"2024-05-08T18:32:45.242814+0000","last_peered":"2024-05-08T18:32:45.242814+0000","last_clean":"2024-05-08T18:32:45.242814+0000","last_became_active":"2024-05-08T18:29:40.556884+0000","last_became_peered":"2024-05-08T18:29:40.556884+0000","last_unstale":"2024-05-08T18:32:45.242814+0000","last_undegraded":"2024-05-08T18:32:45.242814+0000","last_fullsized":"2024-05-08T18:32:45.242814+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:21:38.354933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.861228+0000","last_change":"2024-05-08T18:29:42.566448+0000","last_active":"2024-05-08T18:32:46.861228+0000","last_peered":"2024-05-08T18:32:46.861228+0000","last_clean":"2024-05-08T18:32:46.861228+0000","last_became_active":"2024-05-08T18:29:42.566058+0000","last_became_peered":"2024-05-08T18:29:42.566058+0000","last_unstale":"2024-05-08T18:32:46.861228+0000","last_undegraded":"2024-05-08T18:32:46.861228+0000","last_fullsized":"2024-05-08T18:32:46.861228+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:53:03.097704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"93'5","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.936864+0000","last_change":"2024-05-08T18:29:40.571195+0000","last_active":"2024-05-08T18:32:46.936864+0000","last_peered":"2024-05-08T18:32:46.936864+0000","last_clean":"2024-05-08T18:32:46.936864+0000","last_became_active":"2024-05-08T18:29:40.570467+0000","last_became_peered":"2024-05-08T18:29:40.570467+0000","last_unstale":"2024-05-08T18:32:46.936864+0000","last_undegraded":"2024-05-08T18:32:46.936864+0000","last_fullsized":"2024-05-08T18:32:46.936864+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:39.986094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.849586+0000","last_change":"2024-05-08T18:29:42.566506+0000","last_active":"2024-05-08T18:32:46.849586+0000","last_peered":"2024-05-08T18:32:46.849586+0000","last_clean":"2024-05-08T18:32:46.849586+0000","last_became_active":"2024-05-08T18:29:42.565740+0000","last_became_peered":"2024-05-08T18:29:42.565740+0000","last_unstale":"2024-05-08T18:32:46.849586+0000","last_undegraded":"2024-05-08T18:32:46.849586+0000","last_fullsized":"2024-05-08T18:32:46.849586+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:58.320701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"93'7","reported_seq":201,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-08T18:32:45.240501+0000","last_change":"2024-05-08T18:29:40.538314+0000","last_active":"2024-05-08T18:32:45.240501+0000","last_peered":"2024-05-08T18:32:45.240501+0000","last_clean":"2024-05-08T18:32:45.240501+0000","last_became_active":"2024-05-08T18:29:40.537458+0000","last_became_peered":"2024-05-08T18:29:40.537458+0000","last_unstale":"2024-05-08T18:32:45.240501+0000","last_undegraded":"2024-05-08T18:32:45.240501+0000","last_fullsized":"2024-05-08T18:32:45.240501+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:56.300986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.059543+0000","last_change":"2024-05-08T18:29:42.570054+0000","last_active":"2024-05-08T18:32:46.059543+0000","last_peered":"2024-05-08T18:32:46.059543+0000","last_clean":"2024-05-08T18:32:46.059543+0000","last_became_active":"2024-05-08T18:29:42.569255+0000","last_became_peered":"2024-05-08T18:29:42.569255+0000","last_unstale":"2024-05-08T18:32:46.059543+0000","last_undegraded":"2024-05-08T18:32:46.059543+0000","last_fullsized":"2024-05-08T18:32:46.059543+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:11:01.702482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"93'18","reported_seq":164,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.060138+0000","last_change":"2024-05-08T18:30:21.210397+0000","last_active":"2024-05-08T18:32:46.060138+0000","last_peered":"2024-05-08T18:32:46.060138+0000","last_clean":"2024-05-08T18:32:46.060138+0000","last_became_active":"2024-05-08T18:30:21.210052+0000","last_became_peered":"2024-05-08T18:30:21.210052+0000","last_unstale":"2024-05-08T18:32:46.060138+0000","last_undegraded":"2024-05-08T18:32:46.060138+0000","last_fullsized":"2024-05-08T18:32:46.060138+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:51:05.355593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"97'4","reported_seq":200,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-08T18:32:45.243476+0000","last_change":"2024-05-08T18:29:42.562084+0000","last_active":"2024-05-08T18:32:45.243476+0000","last_peered":"2024-05-08T18:32:45.243476+0000","last_clean":"2024-05-08T18:32:45.243476+0000","last_became_active":"2024-05-08T18:29:42.560699+0000","last_became_peered":"2024-05-08T18:29:42.560699+0000","last_unstale":"2024-05-08T18:32:45.243476+0000","last_undegraded":"2024-05-08T18:32:45.243476+0000","last_fullsized":"2024-05-08T18:32:45.243476+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:09.787597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"93'13","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.063923+0000","last_change":"2024-05-08T18:29:40.564339+0000","last_active":"2024-05-08T18:32:46.063923+0000","last_peered":"2024-05-08T18:32:46.063923+0000","last_clean":"2024-05-08T18:32:46.063923+0000","last_became_active":"2024-05-08T18:29:40.564038+0000","last_became_peered":"2024-05-08T18:29:40.564038+0000","last_unstale":"2024-05-08T18:32:46.063923+0000","last_undegraded":"2024-05-08T18:32:46.063923+0000","last_fullsized":"2024-05-08T18:32:46.063923+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:40:23.287885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"84'8","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.064487+0000","last_change":"2024-05-08T18:29:42.570253+0000","last_active":"2024-05-08T18:32:46.064487+0000","last_peered":"2024-05-08T18:32:46.064487+0000","last_clean":"2024-05-08T18:32:46.064487+0000","last_became_active":"2024-05-08T18:29:42.569917+0000","last_became_peered":"2024-05-08T18:29:42.569917+0000","last_unstale":"2024-05-08T18:32:46.064487+0000","last_undegraded":"2024-05-08T18:32:46.064487+0000","last_fullsized":"2024-05-08T18:32:46.064487+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:14:45.575219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"84'4","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.057705+0000","last_change":"2024-05-08T18:29:42.568116+0000","last_active":"2024-05-08T18:32:46.057705+0000","last_peered":"2024-05-08T18:32:46.057705+0000","last_clean":"2024-05-08T18:32:46.057705+0000","last_became_active":"2024-05-08T18:29:42.567399+0000","last_became_peered":"2024-05-08T18:29:42.567399+0000","last_unstale":"2024-05-08T18:32:46.057705+0000","last_undegraded":"2024-05-08T18:32:46.057705+0000","last_fullsized":"2024-05-08T18:32:46.057705+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:35.037465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"93'13","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.938102+0000","last_change":"2024-05-08T18:29:40.571982+0000","last_active":"2024-05-08T18:32:46.938102+0000","last_peered":"2024-05-08T18:32:46.938102+0000","last_clean":"2024-05-08T18:32:46.938102+0000","last_became_active":"2024-05-08T18:29:40.570600+0000","last_became_peered":"2024-05-08T18:29:40.570600+0000","last_unstale":"2024-05-08T18:32:46.938102+0000","last_undegraded":"2024-05-08T18:32:46.938102+0000","last_fullsized":"2024-05-08T18:32:46.938102+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:54:14.520118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"80'2","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.936574+0000","last_change":"2024-05-08T18:29:42.578449+0000","last_active":"2024-05-08T18:32:46.936574+0000","last_peered":"2024-05-08T18:32:46.936574+0000","last_clean":"2024-05-08T18:32:46.936574+0000","last_became_active":"2024-05-08T18:29:42.577789+0000","last_became_peered":"2024-05-08T18:29:42.577789+0000","last_unstale":"2024-05-08T18:32:46.936574+0000","last_undegraded":"2024-05-08T18:32:46.936574+0000","last_fullsized":"2024-05-08T18:32:46.936574+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:09.787597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"93'8","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.849942+0000","last_change":"2024-05-08T18:29:40.570618+0000","last_active":"2024-05-08T18:32:46.849942+0000","last_peered":"2024-05-08T18:32:46.849942+0000","last_clean":"2024-05-08T18:32:46.849942+0000","last_became_active":"2024-05-08T18:29:40.569519+0000","last_became_peered":"2024-05-08T18:29:40.569519+0000","last_unstale":"2024-05-08T18:32:46.849942+0000","last_undegraded":"2024-05-08T18:32:46.849942+0000","last_fullsized":"2024-05-08T18:32:46.849942+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:09:42.581976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":190,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-08T18:32:45.240884+0000","last_change":"2024-05-08T18:29:42.563056+0000","last_active":"2024-05-08T18:32:45.240884+0000","last_peered":"2024-05-08T18:32:45.240884+0000","last_clean":"2024-05-08T18:32:45.240884+0000","last_became_active":"2024-05-08T18:29:42.562296+0000","last_became_peered":"2024-05-08T18:29:42.562296+0000","last_unstale":"2024-05-08T18:32:45.240884+0000","last_undegraded":"2024-05-08T18:32:45.240884+0000","last_fullsized":"2024-05-08T18:32:45.240884+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:36.890277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"93'14","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.849998+0000","last_change":"2024-05-08T18:29:40.564353+0000","last_active":"2024-05-08T18:32:46.849998+0000","last_peered":"2024-05-08T18:32:46.849998+0000","last_clean":"2024-05-08T18:32:46.849998+0000","last_became_active":"2024-05-08T18:29:40.563516+0000","last_became_peered":"2024-05-08T18:29:40.563516+0000","last_unstale":"2024-05-08T18:32:46.849998+0000","last_undegraded":"2024-05-08T18:32:46.849998+0000","last_fullsized":"2024-05-08T18:32:46.849998+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:06:36.198647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"97'4","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.061368+0000","last_change":"2024-05-08T18:29:42.567006+0000","last_active":"2024-05-08T18:32:46.061368+0000","last_peered":"2024-05-08T18:32:46.061368+0000","last_clean":"2024-05-08T18:32:46.061368+0000","last_became_active":"2024-05-08T18:29:42.566256+0000","last_became_peered":"2024-05-08T18:29:42.566256+0000","last_unstale":"2024-05-08T18:32:46.061368+0000","last_undegraded":"2024-05-08T18:32:46.061368+0000","last_fullsized":"2024-05-08T18:32:46.061368+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:09:44.601690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"93'7","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.059619+0000","last_change":"2024-05-08T18:29:40.573212+0000","last_active":"2024-05-08T18:32:46.059619+0000","last_peered":"2024-05-08T18:32:46.059619+0000","last_clean":"2024-05-08T18:32:46.059619+0000","last_became_active":"2024-05-08T18:29:40.572250+0000","last_became_peered":"2024-05-08T18:29:40.572250+0000","last_unstale":"2024-05-08T18:32:46.059619+0000","last_undegraded":"2024-05-08T18:32:46.059619+0000","last_fullsized":"2024-05-08T18:32:46.059619+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:25:01.595224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"97'6","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.062431+0000","last_change":"2024-05-08T18:29:42.570847+0000","last_active":"2024-05-08T18:32:46.062431+0000","last_peered":"2024-05-08T18:32:46.062431+0000","last_clean":"2024-05-08T18:32:46.062431+0000","last_became_active":"2024-05-08T18:29:42.570435+0000","last_became_peered":"2024-05-08T18:29:42.570435+0000","last_unstale":"2024-05-08T18:32:46.062431+0000","last_undegraded":"2024-05-08T18:32:46.062431+0000","last_fullsized":"2024-05-08T18:32:46.062431+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:21:40.374647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"93'7","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.063428+0000","last_change":"2024-05-08T18:29:40.566815+0000","last_active":"2024-05-08T18:32:46.063428+0000","last_peered":"2024-05-08T18:32:46.063428+0000","last_clean":"2024-05-08T18:32:46.063428+0000","last_became_active":"2024-05-08T18:29:40.566531+0000","last_became_peered":"2024-05-08T18:29:40.566531+0000","last_unstale":"2024-05-08T18:32:46.063428+0000","last_undegraded":"2024-05-08T18:32:46.063428+0000","last_fullsized":"2024-05-08T18:32:46.063428+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:52.462279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"84'8","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.059681+0000","last_change":"2024-05-08T18:29:42.554846+0000","last_active":"2024-05-08T18:32:46.059681+0000","last_peered":"2024-05-08T18:32:46.059681+0000","last_clean":"2024-05-08T18:32:46.059681+0000","last_became_active":"2024-05-08T18:29:42.554115+0000","last_became_peered":"2024-05-08T18:29:42.554115+0000","last_unstale":"2024-05-08T18:32:46.059681+0000","last_undegraded":"2024-05-08T18:32:46.059681+0000","last_fullsized":"2024-05-08T18:32:46.059681+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:22:14.793035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"93'7","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.862823+0000","last_change":"2024-05-08T18:29:40.547776+0000","last_active":"2024-05-08T18:32:46.862823+0000","last_peered":"2024-05-08T18:32:46.862823+0000","last_clean":"2024-05-08T18:32:46.862823+0000","last_became_active":"2024-05-08T18:29:40.547384+0000","last_became_peered":"2024-05-08T18:29:40.547384+0000","last_unstale":"2024-05-08T18:32:46.862823+0000","last_undegraded":"2024-05-08T18:32:46.862823+0000","last_fullsized":"2024-05-08T18:32:46.862823+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:14:26.628603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"97'10","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.057195+0000","last_change":"2024-05-08T18:29:50.685390+0000","last_active":"2024-05-08T18:32:46.057195+0000","last_peered":"2024-05-08T18:32:46.057195+0000","last_clean":"2024-05-08T18:32:46.057195+0000","last_became_active":"2024-05-08T18:29:50.684644+0000","last_became_peered":"2024-05-08T18:29:50.684644+0000","last_unstale":"2024-05-08T18:32:46.057195+0000","last_undegraded":"2024-05-08T18:32:46.057195+0000","last_fullsized":"2024-05-08T18:32:46.057195+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:10:38.951662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":21,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"84'10","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.066363+0000","last_change":"2024-05-08T18:29:42.573805+0000","last_active":"2024-05-08T18:32:46.066363+0000","last_peered":"2024-05-08T18:32:46.066363+0000","last_clean":"2024-05-08T18:32:46.066363+0000","last_became_active":"2024-05-08T18:29:42.573296+0000","last_became_peered":"2024-05-08T18:29:42.573296+0000","last_unstale":"2024-05-08T18:32:46.066363+0000","last_undegraded":"2024-05-08T18:32:46.066363+0000","last_fullsized":"2024-05-08T18:32:46.066363+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:21.935293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"93'8","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.937043+0000","last_change":"2024-05-08T18:29:40.570733+0000","last_active":"2024-05-08T18:32:46.937043+0000","last_peered":"2024-05-08T18:32:46.937043+0000","last_clean":"2024-05-08T18:32:46.937043+0000","last_became_active":"2024-05-08T18:29:40.569711+0000","last_became_peered":"2024-05-08T18:29:40.569711+0000","last_unstale":"2024-05-08T18:32:46.937043+0000","last_undegraded":"2024-05-08T18:32:46.937043+0000","last_fullsized":"2024-05-08T18:32:46.937043+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:18:08.784274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":186,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-08T18:32:45.242768+0000","last_change":"2024-05-08T18:29:44.594185+0000","last_active":"2024-05-08T18:32:45.242768+0000","last_peered":"2024-05-08T18:32:45.242768+0000","last_clean":"2024-05-08T18:32:45.242768+0000","last_became_active":"2024-05-08T18:29:44.593442+0000","last_became_peered":"2024-05-08T18:29:44.593442+0000","last_unstale":"2024-05-08T18:32:45.242768+0000","last_undegraded":"2024-05-08T18:32:45.242768+0000","last_fullsized":"2024-05-08T18:32:45.242768+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:52:25.736491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"97'15","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863258+0000","last_change":"2024-05-08T18:29:46.594652+0000","last_active":"2024-05-08T18:32:46.863258+0000","last_peered":"2024-05-08T18:32:46.863258+0000","last_clean":"2024-05-08T18:32:46.863258+0000","last_became_active":"2024-05-08T18:29:46.593656+0000","last_became_peered":"2024-05-08T18:29:46.593656+0000","last_unstale":"2024-05-08T18:32:46.863258+0000","last_undegraded":"2024-05-08T18:32:46.863258+0000","last_fullsized":"2024-05-08T18:32:46.863258+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:50:27.608888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.937817+0000","last_change":"2024-05-08T18:29:48.639834+0000","last_active":"2024-05-08T18:32:46.937817+0000","last_peered":"2024-05-08T18:32:46.937817+0000","last_clean":"2024-05-08T18:32:46.937817+0000","last_became_active":"2024-05-08T18:29:48.639122+0000","last_became_peered":"2024-05-08T18:29:48.639122+0000","last_unstale":"2024-05-08T18:32:46.937817+0000","last_undegraded":"2024-05-08T18:32:46.937817+0000","last_fullsized":"2024-05-08T18:32:46.937817+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:14:22.304773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"83'4","reported_seq":179,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-08T18:32:45.239607+0000","last_change":"2024-05-08T18:29:50.672303+0000","last_active":"2024-05-08T18:32:45.239607+0000","last_peered":"2024-05-08T18:32:45.239607+0000","last_clean":"2024-05-08T18:32:45.239607+0000","last_became_active":"2024-05-08T18:29:50.671513+0000","last_became_peered":"2024-05-08T18:29:50.671513+0000","last_unstale":"2024-05-08T18:32:45.239607+0000","last_undegraded":"2024-05-08T18:32:45.239607+0000","last_fullsized":"2024-05-08T18:32:45.239607+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:12:05.780786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"84'4","reported_seq":200,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-08T18:32:45.243275+0000","last_change":"2024-05-08T18:29:42.565462+0000","last_active":"2024-05-08T18:32:45.243275+0000","last_peered":"2024-05-08T18:32:45.243275+0000","last_clean":"2024-05-08T18:32:45.243275+0000","last_became_active":"2024-05-08T18:29:42.564741+0000","last_became_peered":"2024-05-08T18:29:42.564741+0000","last_unstale":"2024-05-08T18:32:45.243275+0000","last_undegraded":"2024-05-08T18:32:45.243275+0000","last_fullsized":"2024-05-08T18:32:45.243275+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:25:56.129785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"93'6","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.862908+0000","last_change":"2024-05-08T18:29:40.564796+0000","last_active":"2024-05-08T18:32:46.862908+0000","last_peered":"2024-05-08T18:32:46.862908+0000","last_clean":"2024-05-08T18:32:46.862908+0000","last_became_active":"2024-05-08T18:29:40.564401+0000","last_became_peered":"2024-05-08T18:29:40.564401+0000","last_unstale":"2024-05-08T18:32:46.862908+0000","last_undegraded":"2024-05-08T18:32:46.862908+0000","last_fullsized":"2024-05-08T18:32:46.862908+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:19:11.492397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":189,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.065935+0000","last_change":"2024-05-08T18:29:44.587689+0000","last_active":"2024-05-08T18:32:46.065935+0000","last_peered":"2024-05-08T18:32:46.065935+0000","last_clean":"2024-05-08T18:32:46.065935+0000","last_became_active":"2024-05-08T18:29:44.586975+0000","last_became_peered":"2024-05-08T18:29:44.586975+0000","last_unstale":"2024-05-08T18:32:46.065935+0000","last_undegraded":"2024-05-08T18:32:46.065935+0000","last_fullsized":"2024-05-08T18:32:46.065935+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:04:49.020450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"83'7","reported_seq":197,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.059952+0000","last_change":"2024-05-08T18:29:46.600906+0000","last_active":"2024-05-08T18:32:46.059952+0000","last_peered":"2024-05-08T18:32:46.059952+0000","last_clean":"2024-05-08T18:32:46.059952+0000","last_became_active":"2024-05-08T18:29:46.599894+0000","last_became_peered":"2024-05-08T18:29:46.599894+0000","last_unstale":"2024-05-08T18:32:46.059952+0000","last_undegraded":"2024-05-08T18:32:46.059952+0000","last_fullsized":"2024-05-08T18:32:46.059952+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:24:13.568294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.059189+0000","last_change":"2024-05-08T18:29:48.614324+0000","last_active":"2024-05-08T18:32:46.059189+0000","last_peered":"2024-05-08T18:32:46.059189+0000","last_clean":"2024-05-08T18:32:46.059189+0000","last_became_active":"2024-05-08T18:29:48.613591+0000","last_became_peered":"2024-05-08T18:29:48.613591+0000","last_unstale":"2024-05-08T18:32:46.059189+0000","last_undegraded":"2024-05-08T18:32:46.059189+0000","last_fullsized":"2024-05-08T18:32:46.059189+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:47:54.034851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.862656+0000","last_change":"2024-05-08T18:29:50.684773+0000","last_active":"2024-05-08T18:32:46.862656+0000","last_peered":"2024-05-08T18:32:46.862656+0000","last_clean":"2024-05-08T18:32:46.862656+0000","last_became_active":"2024-05-08T18:29:50.683931+0000","last_became_peered":"2024-05-08T18:29:50.683931+0000","last_unstale":"2024-05-08T18:32:46.862656+0000","last_undegraded":"2024-05-08T18:32:46.862656+0000","last_fullsized":"2024-05-08T18:32:46.862656+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:17:10.582636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"80'2","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.861209+0000","last_change":"2024-05-08T18:29:42.574437+0000","last_active":"2024-05-08T18:32:46.861209+0000","last_peered":"2024-05-08T18:32:46.861209+0000","last_clean":"2024-05-08T18:32:46.861209+0000","last_became_active":"2024-05-08T18:29:42.574146+0000","last_became_peered":"2024-05-08T18:29:42.574146+0000","last_unstale":"2024-05-08T18:32:46.861209+0000","last_undegraded":"2024-05-08T18:32:46.861209+0000","last_fullsized":"2024-05-08T18:32:46.861209+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:55:30.468069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"93'11","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.936641+0000","last_change":"2024-05-08T18:29:40.559677+0000","last_active":"2024-05-08T18:32:46.936641+0000","last_peered":"2024-05-08T18:32:46.936641+0000","last_clean":"2024-05-08T18:32:46.936641+0000","last_became_active":"2024-05-08T18:29:40.558819+0000","last_became_peered":"2024-05-08T18:29:40.558819+0000","last_unstale":"2024-05-08T18:32:46.936641+0000","last_undegraded":"2024-05-08T18:32:46.936641+0000","last_fullsized":"2024-05-08T18:32:46.936641+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:28.426657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":189,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.067875+0000","last_change":"2024-05-08T18:29:44.596801+0000","last_active":"2024-05-08T18:32:46.067875+0000","last_peered":"2024-05-08T18:32:46.067875+0000","last_clean":"2024-05-08T18:32:46.067875+0000","last_became_active":"2024-05-08T18:29:44.596111+0000","last_became_peered":"2024-05-08T18:29:44.596111+0000","last_unstale":"2024-05-08T18:32:46.067875+0000","last_undegraded":"2024-05-08T18:32:46.067875+0000","last_fullsized":"2024-05-08T18:32:46.067875+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:04.423266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"33'10","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.061447+0000","last_change":"2024-05-08T18:29:46.608330+0000","last_active":"2024-05-08T18:32:46.061447+0000","last_peered":"2024-05-08T18:32:46.061447+0000","last_clean":"2024-05-08T18:32:46.061447+0000","last_became_active":"2024-05-08T18:29:46.607580+0000","last_became_peered":"2024-05-08T18:29:46.607580+0000","last_unstale":"2024-05-08T18:32:46.061447+0000","last_undegraded":"2024-05-08T18:32:46.061447+0000","last_fullsized":"2024-05-08T18:32:46.061447+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:22:18.837103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"97'101","reported_seq":405,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.937262+0000","last_change":"2024-05-08T18:29:48.642718+0000","last_active":"2024-05-08T18:32:46.937262+0000","last_peered":"2024-05-08T18:32:46.937262+0000","last_clean":"2024-05-08T18:32:46.937262+0000","last_became_active":"2024-05-08T18:29:48.641950+0000","last_became_peered":"2024-05-08T18:29:48.641950+0000","last_unstale":"2024-05-08T18:32:46.937262+0000","last_undegraded":"2024-05-08T18:32:46.937262+0000","last_fullsized":"2024-05-08T18:32:46.937262+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:00:11.720096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"84'2","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.058647+0000","last_change":"2024-05-08T18:29:50.660378+0000","last_active":"2024-05-08T18:32:46.058647+0000","last_peered":"2024-05-08T18:32:46.058647+0000","last_clean":"2024-05-08T18:32:46.058647+0000","last_became_active":"2024-05-08T18:29:50.659649+0000","last_became_peered":"2024-05-08T18:29:50.659649+0000","last_unstale":"2024-05-08T18:32:46.058647+0000","last_undegraded":"2024-05-08T18:32:46.058647+0000","last_fullsized":"2024-05-08T18:32:46.058647+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:34:14.488295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"80'2","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.066931+0000","last_change":"2024-05-08T18:29:42.577267+0000","last_active":"2024-05-08T18:32:46.066931+0000","last_peered":"2024-05-08T18:32:46.066931+0000","last_clean":"2024-05-08T18:32:46.066931+0000","last_became_active":"2024-05-08T18:29:42.576740+0000","last_became_peered":"2024-05-08T18:29:42.576740+0000","last_unstale":"2024-05-08T18:32:46.066931+0000","last_undegraded":"2024-05-08T18:32:46.066931+0000","last_fullsized":"2024-05-08T18:32:46.066931+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:57:14.869860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"93'5","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.848368+0000","last_change":"2024-05-08T18:29:40.547524+0000","last_active":"2024-05-08T18:32:46.848368+0000","last_peered":"2024-05-08T18:32:46.848368+0000","last_clean":"2024-05-08T18:32:46.848368+0000","last_became_active":"2024-05-08T18:29:40.545749+0000","last_became_peered":"2024-05-08T18:29:40.545749+0000","last_unstale":"2024-05-08T18:32:46.848368+0000","last_undegraded":"2024-05-08T18:32:46.848368+0000","last_fullsized":"2024-05-08T18:32:46.848368+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:12:59.146887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":186,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-08T18:32:45.243038+0000","last_change":"2024-05-08T18:29:44.579839+0000","last_active":"2024-05-08T18:32:45.243038+0000","last_peered":"2024-05-08T18:32:45.243038+0000","last_clean":"2024-05-08T18:32:45.243038+0000","last_became_active":"2024-05-08T18:29:44.578142+0000","last_became_peered":"2024-05-08T18:29:44.578142+0000","last_unstale":"2024-05-08T18:32:45.243038+0000","last_undegraded":"2024-05-08T18:32:45.243038+0000","last_fullsized":"2024-05-08T18:32:45.243038+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:51:09.413191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"97'15","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.937446+0000","last_change":"2024-05-08T18:29:46.607288+0000","last_active":"2024-05-08T18:32:46.937446+0000","last_peered":"2024-05-08T18:32:46.937446+0000","last_clean":"2024-05-08T18:32:46.937446+0000","last_became_active":"2024-05-08T18:29:46.605154+0000","last_became_peered":"2024-05-08T18:29:46.605154+0000","last_unstale":"2024-05-08T18:32:46.937446+0000","last_undegraded":"2024-05-08T18:32:46.937446+0000","last_fullsized":"2024-05-08T18:32:46.937446+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:23.940519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"97'101","reported_seq":324,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.065609+0000","last_change":"2024-05-08T18:29:48.634956+0000","last_active":"2024-05-08T18:32:46.065609+0000","last_peered":"2024-05-08T18:32:46.065609+0000","last_clean":"2024-05-08T18:32:46.065609+0000","last_became_active":"2024-05-08T18:29:48.633858+0000","last_became_peered":"2024-05-08T18:29:48.633858+0000","last_unstale":"2024-05-08T18:32:46.065609+0000","last_undegraded":"2024-05-08T18:32:46.065609+0000","last_fullsized":"2024-05-08T18:32:46.065609+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:50:48.169666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"84'8","reported_seq":210,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-08T18:32:45.239370+0000","last_change":"2024-05-08T18:29:42.567744+0000","last_active":"2024-05-08T18:32:45.239370+0000","last_peered":"2024-05-08T18:32:45.239370+0000","last_clean":"2024-05-08T18:32:45.239370+0000","last_became_active":"2024-05-08T18:29:42.566974+0000","last_became_peered":"2024-05-08T18:29:42.566974+0000","last_unstale":"2024-05-08T18:32:45.239370+0000","last_undegraded":"2024-05-08T18:32:45.239370+0000","last_fullsized":"2024-05-08T18:32:45.239370+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:42.045615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"93'10","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.938419+0000","last_change":"2024-05-08T18:29:40.572499+0000","last_active":"2024-05-08T18:32:46.938419+0000","last_peered":"2024-05-08T18:32:46.938419+0000","last_clean":"2024-05-08T18:32:46.938419+0000","last_became_active":"2024-05-08T18:29:40.571322+0000","last_became_peered":"2024-05-08T18:29:40.571322+0000","last_unstale":"2024-05-08T18:32:46.938419+0000","last_undegraded":"2024-05-08T18:32:46.938419+0000","last_fullsized":"2024-05-08T18:32:46.938419+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:31.119374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.935697+0000","last_change":"2024-05-08T18:29:44.597045+0000","last_active":"2024-05-08T18:32:46.935697+0000","last_peered":"2024-05-08T18:32:46.935697+0000","last_clean":"2024-05-08T18:32:46.935697+0000","last_became_active":"2024-05-08T18:29:44.596282+0000","last_became_peered":"2024-05-08T18:29:44.596282+0000","last_unstale":"2024-05-08T18:32:46.935697+0000","last_undegraded":"2024-05-08T18:32:46.935697+0000","last_fullsized":"2024-05-08T18:32:46.935697+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:35:51.288126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"97'26","reported_seq":220,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-08T18:32:45.239755+0000","last_change":"2024-05-08T18:29:46.590633+0000","last_active":"2024-05-08T18:32:45.239755+0000","last_peered":"2024-05-08T18:32:45.239755+0000","last_clean":"2024-05-08T18:32:45.239755+0000","last_became_active":"2024-05-08T18:29:46.589600+0000","last_became_peered":"2024-05-08T18:29:46.589600+0000","last_unstale":"2024-05-08T18:32:45.239755+0000","last_undegraded":"2024-05-08T18:32:45.239755+0000","last_fullsized":"2024-05-08T18:32:45.239755+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:23.940519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.917121+0000","last_change":"2024-05-08T18:29:48.630758+0000","last_active":"2024-05-08T18:32:46.917121+0000","last_peered":"2024-05-08T18:32:46.917121+0000","last_clean":"2024-05-08T18:32:46.917121+0000","last_became_active":"2024-05-08T18:29:48.630017+0000","last_became_peered":"2024-05-08T18:29:48.630017+0000","last_unstale":"2024-05-08T18:32:46.917121+0000","last_undegraded":"2024-05-08T18:32:46.917121+0000","last_fullsized":"2024-05-08T18:32:46.917121+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:39.879384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"97'14","reported_seq":197,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-08T18:32:45.242344+0000","last_change":"2024-05-08T18:29:50.672682+0000","last_active":"2024-05-08T18:32:45.242344+0000","last_peered":"2024-05-08T18:32:45.242344+0000","last_clean":"2024-05-08T18:32:45.242344+0000","last_became_active":"2024-05-08T18:29:50.671923+0000","last_became_peered":"2024-05-08T18:29:50.671923+0000","last_unstale":"2024-05-08T18:32:45.242344+0000","last_undegraded":"2024-05-08T18:32:45.242344+0000","last_fullsized":"2024-05-08T18:32:45.242344+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:38.318890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":39,"num_write":35,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"80'2","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.057722+0000","last_change":"2024-05-08T18:29:42.554289+0000","last_active":"2024-05-08T18:32:46.057722+0000","last_peered":"2024-05-08T18:32:46.057722+0000","last_clean":"2024-05-08T18:32:46.057722+0000","last_became_active":"2024-05-08T18:29:42.553574+0000","last_became_peered":"2024-05-08T18:29:42.553574+0000","last_unstale":"2024-05-08T18:32:46.057722+0000","last_undegraded":"2024-05-08T18:32:46.057722+0000","last_fullsized":"2024-05-08T18:32:46.057722+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:42.005809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"93'7","reported_seq":201,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.938183+0000","last_change":"2024-05-08T18:29:40.570169+0000","last_active":"2024-05-08T18:32:46.938183+0000","last_peered":"2024-05-08T18:32:46.938183+0000","last_clean":"2024-05-08T18:32:46.938183+0000","last_became_active":"2024-05-08T18:29:40.569542+0000","last_became_peered":"2024-05-08T18:29:40.569542+0000","last_unstale":"2024-05-08T18:32:46.938183+0000","last_undegraded":"2024-05-08T18:32:46.938183+0000","last_fullsized":"2024-05-08T18:32:46.938183+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:08:13.006752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"26'1","reported_seq":257,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.060325+0000","last_change":"2024-05-08T18:29:44.579659+0000","last_active":"2024-05-08T18:32:46.060325+0000","last_peered":"2024-05-08T18:32:46.060325+0000","last_clean":"2024-05-08T18:32:46.060325+0000","last_became_active":"2024-05-08T18:29:44.579152+0000","last_became_peered":"2024-05-08T18:29:44.579152+0000","last_unstale":"2024-05-08T18:32:46.060325+0000","last_undegraded":"2024-05-08T18:32:46.060325+0000","last_fullsized":"2024-05-08T18:32:46.060325+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:15:00.358583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"97'15","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.064379+0000","last_change":"2024-05-08T18:29:46.600224+0000","last_active":"2024-05-08T18:32:46.064379+0000","last_peered":"2024-05-08T18:32:46.064379+0000","last_clean":"2024-05-08T18:32:46.064379+0000","last_became_active":"2024-05-08T18:29:46.599464+0000","last_became_peered":"2024-05-08T18:29:46.599464+0000","last_unstale":"2024-05-08T18:32:46.064379+0000","last_undegraded":"2024-05-08T18:32:46.064379+0000","last_fullsized":"2024-05-08T18:32:46.064379+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:26:40.238188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.061779+0000","last_change":"2024-05-08T18:29:48.637939+0000","last_active":"2024-05-08T18:32:46.061779+0000","last_peered":"2024-05-08T18:32:46.061779+0000","last_clean":"2024-05-08T18:32:46.061779+0000","last_became_active":"2024-05-08T18:29:48.637231+0000","last_became_peered":"2024-05-08T18:29:48.637231+0000","last_unstale":"2024-05-08T18:32:46.061779+0000","last_undegraded":"2024-05-08T18:32:46.061779+0000","last_fullsized":"2024-05-08T18:32:46.061779+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:04.571608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":174,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.847775+0000","last_change":"2024-05-08T18:29:50.681831+0000","last_active":"2024-05-08T18:32:46.847775+0000","last_peered":"2024-05-08T18:32:46.847775+0000","last_clean":"2024-05-08T18:32:46.847775+0000","last_became_active":"2024-05-08T18:29:50.681287+0000","last_became_peered":"2024-05-08T18:29:50.681287+0000","last_unstale":"2024-05-08T18:32:46.847775+0000","last_undegraded":"2024-05-08T18:32:46.847775+0000","last_fullsized":"2024-05-08T18:32:46.847775+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:30:24.111488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.849322+0000","last_change":"2024-05-08T18:29:42.562975+0000","last_active":"2024-05-08T18:32:46.849322+0000","last_peered":"2024-05-08T18:32:46.849322+0000","last_clean":"2024-05-08T18:32:46.849322+0000","last_became_active":"2024-05-08T18:29:42.562267+0000","last_became_peered":"2024-05-08T18:29:42.562267+0000","last_unstale":"2024-05-08T18:32:46.849322+0000","last_undegraded":"2024-05-08T18:32:46.849322+0000","last_fullsized":"2024-05-08T18:32:46.849322+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:30.446371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"93'7","reported_seq":201,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.938062+0000","last_change":"2024-05-08T18:29:40.570736+0000","last_active":"2024-05-08T18:32:46.938062+0000","last_peered":"2024-05-08T18:32:46.938062+0000","last_clean":"2024-05-08T18:32:46.938062+0000","last_became_active":"2024-05-08T18:29:40.569626+0000","last_became_peered":"2024-05-08T18:29:40.569626+0000","last_unstale":"2024-05-08T18:32:46.938062+0000","last_undegraded":"2024-05-08T18:32:46.938062+0000","last_fullsized":"2024-05-08T18:32:46.938062+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:56.300986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"26'1","reported_seq":257,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.062164+0000","last_change":"2024-05-08T18:29:44.581748+0000","last_active":"2024-05-08T18:32:46.062164+0000","last_peered":"2024-05-08T18:32:46.062164+0000","last_clean":"2024-05-08T18:32:46.062164+0000","last_became_active":"2024-05-08T18:29:44.581067+0000","last_became_peered":"2024-05-08T18:29:44.581067+0000","last_unstale":"2024-05-08T18:32:46.062164+0000","last_undegraded":"2024-05-08T18:32:46.062164+0000","last_fullsized":"2024-05-08T18:32:46.062164+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:44.043691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"97'21","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.936022+0000","last_change":"2024-05-08T18:29:46.605887+0000","last_active":"2024-05-08T18:32:46.936022+0000","last_peered":"2024-05-08T18:32:46.936022+0000","last_clean":"2024-05-08T18:32:46.936022+0000","last_became_active":"2024-05-08T18:29:46.604966+0000","last_became_peered":"2024-05-08T18:29:46.604966+0000","last_unstale":"2024-05-08T18:32:46.936022+0000","last_undegraded":"2024-05-08T18:32:46.936022+0000","last_fullsized":"2024-05-08T18:32:46.936022+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:07:54.654205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"97'101","reported_seq":324,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.862395+0000","last_change":"2024-05-08T18:29:48.638657+0000","last_active":"2024-05-08T18:32:46.862395+0000","last_peered":"2024-05-08T18:32:46.862395+0000","last_clean":"2024-05-08T18:32:46.862395+0000","last_became_active":"2024-05-08T18:29:48.637758+0000","last_became_peered":"2024-05-08T18:29:48.637758+0000","last_unstale":"2024-05-08T18:32:46.862395+0000","last_undegraded":"2024-05-08T18:32:46.862395+0000","last_fullsized":"2024-05-08T18:32:46.862395+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:45:24.153991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"97'2","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863289+0000","last_change":"2024-05-08T18:29:50.684501+0000","last_active":"2024-05-08T18:32:46.863289+0000","last_peered":"2024-05-08T18:32:46.863289+0000","last_clean":"2024-05-08T18:32:46.863289+0000","last_became_active":"2024-05-08T18:29:50.683738+0000","last_became_peered":"2024-05-08T18:29:50.683738+0000","last_unstale":"2024-05-08T18:32:46.863289+0000","last_undegraded":"2024-05-08T18:32:46.863289+0000","last_fullsized":"2024-05-08T18:32:46.863289+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:22.834262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"84'4","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863429+0000","last_change":"2024-05-08T18:29:42.569401+0000","last_active":"2024-05-08T18:32:46.863429+0000","last_peered":"2024-05-08T18:32:46.863429+0000","last_clean":"2024-05-08T18:32:46.863429+0000","last_became_active":"2024-05-08T18:29:42.568659+0000","last_became_peered":"2024-05-08T18:29:42.568659+0000","last_unstale":"2024-05-08T18:32:46.863429+0000","last_undegraded":"2024-05-08T18:32:46.863429+0000","last_fullsized":"2024-05-08T18:32:46.863429+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:35:23.016110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"93'8","reported_seq":203,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-08T18:32:45.243320+0000","last_change":"2024-05-08T18:29:40.557076+0000","last_active":"2024-05-08T18:32:45.243320+0000","last_peered":"2024-05-08T18:32:45.243320+0000","last_clean":"2024-05-08T18:32:45.243320+0000","last_became_active":"2024-05-08T18:29:40.555805+0000","last_became_peered":"2024-05-08T18:29:40.555805+0000","last_unstale":"2024-05-08T18:32:45.243320+0000","last_undegraded":"2024-05-08T18:32:45.243320+0000","last_fullsized":"2024-05-08T18:32:45.243320+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:13.946346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":18,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":189,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.060997+0000","last_change":"2024-05-08T18:29:44.573892+0000","last_active":"2024-05-08T18:32:46.060997+0000","last_peered":"2024-05-08T18:32:46.060997+0000","last_clean":"2024-05-08T18:32:46.060997+0000","last_became_active":"2024-05-08T18:29:44.573308+0000","last_became_peered":"2024-05-08T18:29:44.573308+0000","last_unstale":"2024-05-08T18:32:46.060997+0000","last_undegraded":"2024-05-08T18:32:46.060997+0000","last_fullsized":"2024-05-08T18:32:46.060997+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:37.075348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"97'24","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.862514+0000","last_change":"2024-05-08T18:29:46.595585+0000","last_active":"2024-05-08T18:32:46.862514+0000","last_peered":"2024-05-08T18:32:46.862514+0000","last_clean":"2024-05-08T18:32:46.862514+0000","last_became_active":"2024-05-08T18:29:46.594930+0000","last_became_peered":"2024-05-08T18:29:46.594930+0000","last_unstale":"2024-05-08T18:32:46.862514+0000","last_undegraded":"2024-05-08T18:32:46.862514+0000","last_fullsized":"2024-05-08T18:32:46.862514+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:11.768269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.059998+0000","last_change":"2024-05-08T18:29:48.638137+0000","last_active":"2024-05-08T18:32:46.059998+0000","last_peered":"2024-05-08T18:32:46.059998+0000","last_clean":"2024-05-08T18:32:46.059998+0000","last_became_active":"2024-05-08T18:29:48.637370+0000","last_became_peered":"2024-05-08T18:29:48.637370+0000","last_unstale":"2024-05-08T18:32:46.059998+0000","last_undegraded":"2024-05-08T18:32:46.059998+0000","last_fullsized":"2024-05-08T18:32:46.059998+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:15.859849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"83'2","reported_seq":182,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.916145+0000","last_change":"2024-05-08T18:29:50.688760+0000","last_active":"2024-05-08T18:32:46.916145+0000","last_peered":"2024-05-08T18:32:46.916145+0000","last_clean":"2024-05-08T18:32:46.916145+0000","last_became_active":"2024-05-08T18:29:50.687960+0000","last_became_peered":"2024-05-08T18:29:50.687960+0000","last_unstale":"2024-05-08T18:32:46.916145+0000","last_undegraded":"2024-05-08T18:32:46.916145+0000","last_fullsized":"2024-05-08T18:32:46.916145+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:21:19.624895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"97'4","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.060220+0000","last_change":"2024-05-08T18:29:42.557850+0000","last_active":"2024-05-08T18:32:46.060220+0000","last_peered":"2024-05-08T18:32:46.060220+0000","last_clean":"2024-05-08T18:32:46.060220+0000","last_became_active":"2024-05-08T18:29:42.557119+0000","last_became_peered":"2024-05-08T18:29:42.557119+0000","last_unstale":"2024-05-08T18:32:46.060220+0000","last_undegraded":"2024-05-08T18:32:46.060220+0000","last_fullsized":"2024-05-08T18:32:46.060220+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:25:56.129785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"93'8","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.062755+0000","last_change":"2024-05-08T18:29:40.544530+0000","last_active":"2024-05-08T18:32:46.062755+0000","last_peered":"2024-05-08T18:32:46.062755+0000","last_clean":"2024-05-08T18:32:46.062755+0000","last_became_active":"2024-05-08T18:29:40.544215+0000","last_became_peered":"2024-05-08T18:29:40.544215+0000","last_unstale":"2024-05-08T18:32:46.062755+0000","last_undegraded":"2024-05-08T18:32:46.062755+0000","last_fullsized":"2024-05-08T18:32:46.062755+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:14:26.628603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":189,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.063283+0000","last_change":"2024-05-08T18:29:44.588227+0000","last_active":"2024-05-08T18:32:46.063283+0000","last_peered":"2024-05-08T18:32:46.063283+0000","last_clean":"2024-05-08T18:32:46.063283+0000","last_became_active":"2024-05-08T18:29:44.587822+0000","last_became_peered":"2024-05-08T18:29:44.587822+0000","last_unstale":"2024-05-08T18:32:46.063283+0000","last_undegraded":"2024-05-08T18:32:46.063283+0000","last_fullsized":"2024-05-08T18:32:46.063283+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:18:12.841872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"100'19","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.059596+0000","last_change":"2024-05-08T18:29:46.603563+0000","last_active":"2024-05-08T18:32:46.059596+0000","last_peered":"2024-05-08T18:32:46.059596+0000","last_clean":"2024-05-08T18:32:46.059596+0000","last_became_active":"2024-05-08T18:29:46.602801+0000","last_became_peered":"2024-05-08T18:29:46.602801+0000","last_unstale":"2024-05-08T18:32:46.059596+0000","last_undegraded":"2024-05-08T18:32:46.059596+0000","last_fullsized":"2024-05-08T18:32:46.059596+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:22:36.338527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":17,"num_write":20,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863847+0000","last_change":"2024-05-08T18:29:48.642806+0000","last_active":"2024-05-08T18:32:46.863847+0000","last_peered":"2024-05-08T18:32:46.863847+0000","last_clean":"2024-05-08T18:32:46.863847+0000","last_became_active":"2024-05-08T18:29:48.641813+0000","last_became_peered":"2024-05-08T18:29:48.641813+0000","last_unstale":"2024-05-08T18:32:46.863847+0000","last_undegraded":"2024-05-08T18:32:46.863847+0000","last_fullsized":"2024-05-08T18:32:46.863847+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:50:48.169666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"80'2","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.062631+0000","last_change":"2024-05-08T18:29:50.689819+0000","last_active":"2024-05-08T18:32:46.062631+0000","last_peered":"2024-05-08T18:32:46.062631+0000","last_clean":"2024-05-08T18:32:46.062631+0000","last_became_active":"2024-05-08T18:29:50.686739+0000","last_became_peered":"2024-05-08T18:29:50.686739+0000","last_unstale":"2024-05-08T18:32:46.062631+0000","last_undegraded":"2024-05-08T18:32:46.062631+0000","last_fullsized":"2024-05-08T18:32:46.062631+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:45:34.171402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.060014+0000","last_change":"2024-05-08T18:29:42.552388+0000","last_active":"2024-05-08T18:32:46.060014+0000","last_peered":"2024-05-08T18:32:46.060014+0000","last_clean":"2024-05-08T18:32:46.060014+0000","last_became_active":"2024-05-08T18:29:42.551647+0000","last_became_peered":"2024-05-08T18:29:42.551647+0000","last_unstale":"2024-05-08T18:32:46.060014+0000","last_undegraded":"2024-05-08T18:32:46.060014+0000","last_fullsized":"2024-05-08T18:32:46.060014+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:55.055481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"93'8","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.849557+0000","last_change":"2024-05-08T18:29:40.562946+0000","last_active":"2024-05-08T18:32:46.849557+0000","last_peered":"2024-05-08T18:32:46.849557+0000","last_clean":"2024-05-08T18:32:46.849557+0000","last_became_active":"2024-05-08T18:29:40.550942+0000","last_became_peered":"2024-05-08T18:29:40.550942+0000","last_unstale":"2024-05-08T18:32:46.849557+0000","last_undegraded":"2024-05-08T18:32:46.849557+0000","last_fullsized":"2024-05-08T18:32:46.849557+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:22.579629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.918001+0000","last_change":"2024-05-08T18:29:44.593681+0000","last_active":"2024-05-08T18:32:46.918001+0000","last_peered":"2024-05-08T18:32:46.918001+0000","last_clean":"2024-05-08T18:32:46.918001+0000","last_became_active":"2024-05-08T18:29:44.593242+0000","last_became_peered":"2024-05-08T18:29:44.593242+0000","last_unstale":"2024-05-08T18:32:46.918001+0000","last_undegraded":"2024-05-08T18:32:46.918001+0000","last_fullsized":"2024-05-08T18:32:46.918001+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:57.093364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"97'22","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.064038+0000","last_change":"2024-05-08T18:29:46.589514+0000","last_active":"2024-05-08T18:32:46.064038+0000","last_peered":"2024-05-08T18:32:46.064038+0000","last_clean":"2024-05-08T18:32:46.064038+0000","last_became_active":"2024-05-08T18:29:46.588784+0000","last_became_peered":"2024-05-08T18:29:46.588784+0000","last_unstale":"2024-05-08T18:32:46.064038+0000","last_undegraded":"2024-05-08T18:32:46.064038+0000","last_fullsized":"2024-05-08T18:32:46.064038+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:02:30.355168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":20,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"97'101","reported_seq":336,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.063633+0000","last_change":"2024-05-08T18:29:48.631007+0000","last_active":"2024-05-08T18:32:46.063633+0000","last_peered":"2024-05-08T18:32:46.063633+0000","last_clean":"2024-05-08T18:32:46.063633+0000","last_became_active":"2024-05-08T18:29:48.630229+0000","last_became_peered":"2024-05-08T18:29:48.630229+0000","last_unstale":"2024-05-08T18:32:46.063633+0000","last_undegraded":"2024-05-08T18:32:46.063633+0000","last_fullsized":"2024-05-08T18:32:46.063633+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:44:03.778419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.917498+0000","last_change":"2024-05-08T18:29:50.675105+0000","last_active":"2024-05-08T18:32:46.917498+0000","last_peered":"2024-05-08T18:32:46.917498+0000","last_clean":"2024-05-08T18:32:46.917498+0000","last_became_active":"2024-05-08T18:29:50.674292+0000","last_became_peered":"2024-05-08T18:29:50.674292+0000","last_unstale":"2024-05-08T18:32:46.917498+0000","last_undegraded":"2024-05-08T18:32:46.917498+0000","last_fullsized":"2024-05-08T18:32:46.917498+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:47:15.423647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"84'4","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.060239+0000","last_change":"2024-05-08T18:29:42.579707+0000","last_active":"2024-05-08T18:32:46.060239+0000","last_peered":"2024-05-08T18:32:46.060239+0000","last_clean":"2024-05-08T18:32:46.060239+0000","last_became_active":"2024-05-08T18:29:42.579059+0000","last_became_peered":"2024-05-08T18:29:42.579059+0000","last_unstale":"2024-05-08T18:32:46.060239+0000","last_undegraded":"2024-05-08T18:32:46.060239+0000","last_fullsized":"2024-05-08T18:32:46.060239+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:09.787597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"93'9","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.058163+0000","last_change":"2024-05-08T18:29:40.555327+0000","last_active":"2024-05-08T18:32:46.058163+0000","last_peered":"2024-05-08T18:32:46.058163+0000","last_clean":"2024-05-08T18:32:46.058163+0000","last_became_active":"2024-05-08T18:29:40.554594+0000","last_became_peered":"2024-05-08T18:29:40.554594+0000","last_unstale":"2024-05-08T18:32:46.058163+0000","last_undegraded":"2024-05-08T18:32:46.058163+0000","last_fullsized":"2024-05-08T18:32:46.058163+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:19.841114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":3,"num_read_kb":4,"num_write":19,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"26'2","reported_seq":322,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-08T18:32:45.243018+0000","last_change":"2024-05-08T18:29:44.582434+0000","last_active":"2024-05-08T18:32:45.243018+0000","last_peered":"2024-05-08T18:32:45.243018+0000","last_clean":"2024-05-08T18:32:45.243018+0000","last_became_active":"2024-05-08T18:29:44.581699+0000","last_became_peered":"2024-05-08T18:29:44.581699+0000","last_unstale":"2024-05-08T18:32:45.243018+0000","last_undegraded":"2024-05-08T18:32:45.243018+0000","last_fullsized":"2024-05-08T18:32:45.243018+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:19:29.113643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":134,"num_read_kb":134,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"33'10","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.065642+0000","last_change":"2024-05-08T18:29:46.590860+0000","last_active":"2024-05-08T18:32:46.065642+0000","last_peered":"2024-05-08T18:32:46.065642+0000","last_clean":"2024-05-08T18:32:46.065642+0000","last_became_active":"2024-05-08T18:29:46.590087+0000","last_became_peered":"2024-05-08T18:29:46.590087+0000","last_unstale":"2024-05-08T18:32:46.065642+0000","last_undegraded":"2024-05-08T18:32:46.065642+0000","last_fullsized":"2024-05-08T18:32:46.065642+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:19:58.358449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"97'101","reported_seq":360,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.849450+0000","last_change":"2024-05-08T18:29:48.635548+0000","last_active":"2024-05-08T18:32:46.849450+0000","last_peered":"2024-05-08T18:32:46.849450+0000","last_clean":"2024-05-08T18:32:46.849450+0000","last_became_active":"2024-05-08T18:29:48.634801+0000","last_became_peered":"2024-05-08T18:29:48.634801+0000","last_unstale":"2024-05-08T18:32:46.849450+0000","last_undegraded":"2024-05-08T18:32:46.849450+0000","last_fullsized":"2024-05-08T18:32:46.849450+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:04:20.128031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.058516+0000","last_change":"2024-05-08T18:29:50.668279+0000","last_active":"2024-05-08T18:32:46.058516+0000","last_peered":"2024-05-08T18:32:46.058516+0000","last_clean":"2024-05-08T18:32:46.058516+0000","last_became_active":"2024-05-08T18:29:50.667536+0000","last_became_peered":"2024-05-08T18:29:50.667536+0000","last_unstale":"2024-05-08T18:32:46.058516+0000","last_undegraded":"2024-05-08T18:32:46.058516+0000","last_fullsized":"2024-05-08T18:32:46.058516+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:12:05.780786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"97'14","reported_seq":224,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.916133+0000","last_change":"2024-05-08T18:29:42.563807+0000","last_active":"2024-05-08T18:32:46.916133+0000","last_peered":"2024-05-08T18:32:46.916133+0000","last_clean":"2024-05-08T18:32:46.916133+0000","last_became_active":"2024-05-08T18:29:42.563416+0000","last_became_peered":"2024-05-08T18:29:42.563416+0000","last_unstale":"2024-05-08T18:32:46.916133+0000","last_undegraded":"2024-05-08T18:32:46.916133+0000","last_fullsized":"2024-05-08T18:32:46.916133+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:18:10.803989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"93'12","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.064387+0000","last_change":"2024-05-08T18:29:40.548898+0000","last_active":"2024-05-08T18:32:46.064387+0000","last_peered":"2024-05-08T18:32:46.064387+0000","last_clean":"2024-05-08T18:32:46.064387+0000","last_became_active":"2024-05-08T18:29:40.548591+0000","last_became_peered":"2024-05-08T18:29:40.548591+0000","last_unstale":"2024-05-08T18:32:46.064387+0000","last_undegraded":"2024-05-08T18:32:46.064387+0000","last_fullsized":"2024-05-08T18:32:46.064387+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:27:41.414153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.059932+0000","last_change":"2024-05-08T18:29:44.582578+0000","last_active":"2024-05-08T18:32:46.059932+0000","last_peered":"2024-05-08T18:32:46.059932+0000","last_clean":"2024-05-08T18:32:46.059932+0000","last_became_active":"2024-05-08T18:29:44.581832+0000","last_became_peered":"2024-05-08T18:29:44.581832+0000","last_unstale":"2024-05-08T18:32:46.059932+0000","last_undegraded":"2024-05-08T18:32:46.059932+0000","last_fullsized":"2024-05-08T18:32:46.059932+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:52:25.736491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"97'23","reported_seq":216,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-08T18:32:45.242558+0000","last_change":"2024-05-08T18:29:46.602459+0000","last_active":"2024-05-08T18:32:45.242558+0000","last_peered":"2024-05-08T18:32:45.242558+0000","last_clean":"2024-05-08T18:32:45.242558+0000","last_became_active":"2024-05-08T18:29:46.601740+0000","last_became_peered":"2024-05-08T18:29:46.601740+0000","last_unstale":"2024-05-08T18:32:45.242558+0000","last_undegraded":"2024-05-08T18:32:45.242558+0000","last_fullsized":"2024-05-08T18:32:45.242558+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:58:31.293922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.849235+0000","last_change":"2024-05-08T18:29:48.640046+0000","last_active":"2024-05-08T18:32:46.849235+0000","last_peered":"2024-05-08T18:32:46.849235+0000","last_clean":"2024-05-08T18:32:46.849235+0000","last_became_active":"2024-05-08T18:29:48.639309+0000","last_became_peered":"2024-05-08T18:29:48.639309+0000","last_unstale":"2024-05-08T18:32:46.849235+0000","last_undegraded":"2024-05-08T18:32:46.849235+0000","last_fullsized":"2024-05-08T18:32:46.849235+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:10.533065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.917024+0000","last_change":"2024-05-08T18:29:50.668361+0000","last_active":"2024-05-08T18:32:46.917024+0000","last_peered":"2024-05-08T18:32:46.917024+0000","last_clean":"2024-05-08T18:32:46.917024+0000","last_became_active":"2024-05-08T18:29:50.667636+0000","last_became_peered":"2024-05-08T18:29:50.667636+0000","last_unstale":"2024-05-08T18:32:46.917024+0000","last_undegraded":"2024-05-08T18:32:46.917024+0000","last_fullsized":"2024-05-08T18:32:46.917024+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:58:35.356885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"97'4","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.847440+0000","last_change":"2024-05-08T18:29:42.584098+0000","last_active":"2024-05-08T18:32:46.847440+0000","last_peered":"2024-05-08T18:32:46.847440+0000","last_clean":"2024-05-08T18:32:46.847440+0000","last_became_active":"2024-05-08T18:29:42.583639+0000","last_became_peered":"2024-05-08T18:29:42.583639+0000","last_unstale":"2024-05-08T18:32:46.847440+0000","last_undegraded":"2024-05-08T18:32:46.847440+0000","last_fullsized":"2024-05-08T18:32:46.847440+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:08:15.026467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":296,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.936422+0000","last_change":"2024-05-08T18:29:27.115522+0000","last_active":"2024-05-08T18:32:46.936422+0000","last_peered":"2024-05-08T18:32:46.936422+0000","last_clean":"2024-05-08T18:32:46.936422+0000","last_became_active":"2024-05-08T18:29:27.112960+0000","last_became_peered":"2024-05-08T18:29:27.112960+0000","last_unstale":"2024-05-08T18:32:46.936422+0000","last_undegraded":"2024-05-08T18:32:46.936422+0000","last_fullsized":"2024-05-08T18:32:46.936422+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:26.091102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:26.091102+0000","last_clean_scrub_stamp":"2024-05-08T18:29:26.091102+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:09:50.296961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":200,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-08T18:32:45.241986+0000","last_change":"2024-05-08T18:29:34.496467+0000","last_active":"2024-05-08T18:32:45.241986+0000","last_peered":"2024-05-08T18:32:45.241986+0000","last_clean":"2024-05-08T18:32:45.241986+0000","last_became_active":"2024-05-08T18:29:34.495632+0000","last_became_peered":"2024-05-08T18:29:34.495632+0000","last_unstale":"2024-05-08T18:32:45.241986+0000","last_undegraded":"2024-05-08T18:32:45.241986+0000","last_fullsized":"2024-05-08T18:32:45.241986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:35.917391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"93'5","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.065505+0000","last_change":"2024-05-08T18:30:20.849562+0000","last_active":"2024-05-08T18:32:46.065505+0000","last_peered":"2024-05-08T18:32:46.065505+0000","last_clean":"2024-05-08T18:32:46.065505+0000","last_became_active":"2024-05-08T18:30:20.849160+0000","last_became_peered":"2024-05-08T18:30:20.849160+0000","last_unstale":"2024-05-08T18:32:46.065505+0000","last_undegraded":"2024-05-08T18:32:46.065505+0000","last_fullsized":"2024-05-08T18:32:46.065505+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:29:13.478886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.937166+0000","last_change":"2024-05-08T18:29:44.592445+0000","last_active":"2024-05-08T18:32:46.937166+0000","last_peered":"2024-05-08T18:32:46.937166+0000","last_clean":"2024-05-08T18:32:46.937166+0000","last_became_active":"2024-05-08T18:29:44.587855+0000","last_became_peered":"2024-05-08T18:29:44.587855+0000","last_unstale":"2024-05-08T18:32:46.937166+0000","last_undegraded":"2024-05-08T18:32:46.937166+0000","last_fullsized":"2024-05-08T18:32:46.937166+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:06:05.355648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"97'33","reported_seq":229,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-08T18:32:45.243335+0000","last_change":"2024-05-08T18:29:46.595394+0000","last_active":"2024-05-08T18:32:45.243335+0000","last_peered":"2024-05-08T18:32:45.243335+0000","last_clean":"2024-05-08T18:32:45.243335+0000","last_became_active":"2024-05-08T18:29:46.594573+0000","last_became_peered":"2024-05-08T18:29:46.594573+0000","last_unstale":"2024-05-08T18:32:45.243335+0000","last_undegraded":"2024-05-08T18:32:45.243335+0000","last_fullsized":"2024-05-08T18:32:45.243335+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:47:11.360684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71557,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":23,"num_write":20,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863388+0000","last_change":"2024-05-08T18:29:48.632178+0000","last_active":"2024-05-08T18:32:46.863388+0000","last_peered":"2024-05-08T18:32:46.863388+0000","last_clean":"2024-05-08T18:32:46.863388+0000","last_became_active":"2024-05-08T18:29:48.631481+0000","last_became_peered":"2024-05-08T18:29:48.631481+0000","last_unstale":"2024-05-08T18:32:46.863388+0000","last_undegraded":"2024-05-08T18:32:46.863388+0000","last_fullsized":"2024-05-08T18:32:46.863388+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:34.806539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"80'2","reported_seq":176,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.848444+0000","last_change":"2024-05-08T18:29:50.675319+0000","last_active":"2024-05-08T18:32:46.848444+0000","last_peered":"2024-05-08T18:32:46.848444+0000","last_clean":"2024-05-08T18:32:46.848444+0000","last_became_active":"2024-05-08T18:29:50.674526+0000","last_became_peered":"2024-05-08T18:29:50.674526+0000","last_unstale":"2024-05-08T18:32:46.848444+0000","last_undegraded":"2024-05-08T18:32:46.848444+0000","last_fullsized":"2024-05-08T18:32:46.848444+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:59:06.404586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"84'4","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863527+0000","last_change":"2024-05-08T18:29:42.568584+0000","last_active":"2024-05-08T18:32:46.863527+0000","last_peered":"2024-05-08T18:32:46.863527+0000","last_clean":"2024-05-08T18:32:46.863527+0000","last_became_active":"2024-05-08T18:29:42.568244+0000","last_became_peered":"2024-05-08T18:29:42.568244+0000","last_unstale":"2024-05-08T18:32:46.863527+0000","last_undegraded":"2024-05-08T18:32:46.863527+0000","last_fullsized":"2024-05-08T18:32:46.863527+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:20.397730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.935976+0000","last_change":"2024-05-08T18:29:34.497654+0000","last_active":"2024-05-08T18:32:46.935976+0000","last_peered":"2024-05-08T18:32:46.935976+0000","last_clean":"2024-05-08T18:32:46.935976+0000","last_became_active":"2024-05-08T18:29:34.495812+0000","last_became_peered":"2024-05-08T18:29:34.495812+0000","last_unstale":"2024-05-08T18:32:46.935976+0000","last_undegraded":"2024-05-08T18:32:46.935976+0000","last_fullsized":"2024-05-08T18:32:46.935976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:37:02.202613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"93'7","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.862540+0000","last_change":"2024-05-08T18:29:40.560653+0000","last_active":"2024-05-08T18:32:46.862540+0000","last_peered":"2024-05-08T18:32:46.862540+0000","last_clean":"2024-05-08T18:32:46.862540+0000","last_became_active":"2024-05-08T18:29:40.560296+0000","last_became_peered":"2024-05-08T18:29:40.560296+0000","last_unstale":"2024-05-08T18:32:46.862540+0000","last_undegraded":"2024-05-08T18:32:46.862540+0000","last_fullsized":"2024-05-08T18:32:46.862540+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:52.462279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":186,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-08T18:32:45.243691+0000","last_change":"2024-05-08T18:29:44.594681+0000","last_active":"2024-05-08T18:32:45.243691+0000","last_peered":"2024-05-08T18:32:45.243691+0000","last_clean":"2024-05-08T18:32:45.243691+0000","last_became_active":"2024-05-08T18:29:44.593917+0000","last_became_peered":"2024-05-08T18:29:44.593917+0000","last_unstale":"2024-05-08T18:32:45.243691+0000","last_undegraded":"2024-05-08T18:32:45.243691+0000","last_fullsized":"2024-05-08T18:32:45.243691+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:59:00.335437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"97'108","reported_seq":382,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.917880+0000","last_change":"2024-05-08T18:29:46.599932+0000","last_active":"2024-05-08T18:32:46.917880+0000","last_peered":"2024-05-08T18:32:46.917880+0000","last_clean":"2024-05-08T18:32:46.917880+0000","last_became_active":"2024-05-08T18:29:46.594789+0000","last_became_peered":"2024-05-08T18:29:46.594789+0000","last_unstale":"2024-05-08T18:32:46.917880+0000","last_undegraded":"2024-05-08T18:32:46.917880+0000","last_fullsized":"2024-05-08T18:32:46.917880+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:04:18.099848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9947,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":143,"num_read_kb":128,"num_write":28,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.937370+0000","last_change":"2024-05-08T18:29:48.634661+0000","last_active":"2024-05-08T18:32:46.937370+0000","last_peered":"2024-05-08T18:32:46.937370+0000","last_clean":"2024-05-08T18:32:46.937370+0000","last_became_active":"2024-05-08T18:29:48.634044+0000","last_became_peered":"2024-05-08T18:29:48.634044+0000","last_unstale":"2024-05-08T18:32:46.937370+0000","last_undegraded":"2024-05-08T18:32:46.937370+0000","last_fullsized":"2024-05-08T18:32:46.937370+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:01:46.238076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.916916+0000","last_change":"2024-05-08T18:29:50.676536+0000","last_active":"2024-05-08T18:32:46.916916+0000","last_peered":"2024-05-08T18:32:46.916916+0000","last_clean":"2024-05-08T18:32:46.916916+0000","last_became_active":"2024-05-08T18:29:50.675770+0000","last_became_peered":"2024-05-08T18:29:50.675770+0000","last_unstale":"2024-05-08T18:32:46.916916+0000","last_undegraded":"2024-05-08T18:32:46.916916+0000","last_fullsized":"2024-05-08T18:32:46.916916+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:28.003482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.919578+0000","last_change":"2024-05-08T18:29:42.575253+0000","last_active":"2024-05-08T18:32:46.919578+0000","last_peered":"2024-05-08T18:32:46.919578+0000","last_clean":"2024-05-08T18:32:46.919578+0000","last_became_active":"2024-05-08T18:29:42.573621+0000","last_became_peered":"2024-05-08T18:29:42.573621+0000","last_unstale":"2024-05-08T18:32:46.919578+0000","last_undegraded":"2024-05-08T18:32:46.919578+0000","last_fullsized":"2024-05-08T18:32:46.919578+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:59.243324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.060706+0000","last_change":"2024-05-08T18:29:34.491071+0000","last_active":"2024-05-08T18:32:46.060706+0000","last_peered":"2024-05-08T18:32:46.060706+0000","last_clean":"2024-05-08T18:32:46.060706+0000","last_became_active":"2024-05-08T18:29:34.490717+0000","last_became_peered":"2024-05-08T18:29:34.490717+0000","last_unstale":"2024-05-08T18:32:46.060706+0000","last_undegraded":"2024-05-08T18:32:46.060706+0000","last_fullsized":"2024-05-08T18:32:46.060706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:55.793312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"93'12","reported_seq":211,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.916751+0000","last_change":"2024-05-08T18:29:40.530634+0000","last_active":"2024-05-08T18:32:46.916751+0000","last_peered":"2024-05-08T18:32:46.916751+0000","last_clean":"2024-05-08T18:32:46.916751+0000","last_became_active":"2024-05-08T18:29:40.529804+0000","last_became_peered":"2024-05-08T18:29:40.529804+0000","last_unstale":"2024-05-08T18:32:46.916751+0000","last_undegraded":"2024-05-08T18:32:46.916751+0000","last_fullsized":"2024-05-08T18:32:46.916751+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:59:25.840149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"26'1","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.064037+0000","last_change":"2024-05-08T18:29:44.584678+0000","last_active":"2024-05-08T18:32:46.064037+0000","last_peered":"2024-05-08T18:32:46.064037+0000","last_clean":"2024-05-08T18:32:46.064037+0000","last_became_active":"2024-05-08T18:29:44.584227+0000","last_became_peered":"2024-05-08T18:29:44.584227+0000","last_unstale":"2024-05-08T18:32:46.064037+0000","last_undegraded":"2024-05-08T18:32:46.064037+0000","last_fullsized":"2024-05-08T18:32:46.064037+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:04:01.281207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'15","reported_seq":239,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.937641+0000","last_change":"2024-05-08T18:29:46.608720+0000","last_active":"2024-05-08T18:32:46.937641+0000","last_peered":"2024-05-08T18:32:46.937641+0000","last_clean":"2024-05-08T18:32:46.937641+0000","last_became_active":"2024-05-08T18:29:46.607989+0000","last_became_peered":"2024-05-08T18:29:46.607989+0000","last_unstale":"2024-05-08T18:32:46.937641+0000","last_undegraded":"2024-05-08T18:32:46.937641+0000","last_fullsized":"2024-05-08T18:32:46.937641+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:58:31.293922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863028+0000","last_change":"2024-05-08T18:29:48.625269+0000","last_active":"2024-05-08T18:32:46.863028+0000","last_peered":"2024-05-08T18:32:46.863028+0000","last_clean":"2024-05-08T18:32:46.863028+0000","last_became_active":"2024-05-08T18:29:48.624545+0000","last_became_peered":"2024-05-08T18:29:48.624545+0000","last_unstale":"2024-05-08T18:32:46.863028+0000","last_undegraded":"2024-05-08T18:32:46.863028+0000","last_fullsized":"2024-05-08T18:32:46.863028+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:16:42.799734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"84'12","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.063889+0000","last_change":"2024-05-08T18:29:50.688851+0000","last_active":"2024-05-08T18:32:46.063889+0000","last_peered":"2024-05-08T18:32:46.063889+0000","last_clean":"2024-05-08T18:32:46.063889+0000","last_became_active":"2024-05-08T18:29:50.687978+0000","last_became_peered":"2024-05-08T18:29:50.687978+0000","last_unstale":"2024-05-08T18:32:46.063889+0000","last_undegraded":"2024-05-08T18:32:46.063889+0000","last_fullsized":"2024-05-08T18:32:46.063889+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:28:29.836446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":42,"num_write":31,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"84'4","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.918158+0000","last_change":"2024-05-08T18:31:22.008678+0000","last_active":"2024-05-08T18:32:46.918158+0000","last_peered":"2024-05-08T18:32:46.918158+0000","last_clean":"2024-05-08T18:32:46.918158+0000","last_became_active":"2024-05-08T18:31:22.008342+0000","last_became_peered":"2024-05-08T18:31:22.008342+0000","last_unstale":"2024-05-08T18:32:46.918158+0000","last_undegraded":"2024-05-08T18:32:46.918158+0000","last_fullsized":"2024-05-08T18:32:46.918158+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:40:30.531379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":200,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-08T18:32:45.241642+0000","last_change":"2024-05-08T18:29:34.496942+0000","last_active":"2024-05-08T18:32:45.241642+0000","last_peered":"2024-05-08T18:32:45.241642+0000","last_clean":"2024-05-08T18:32:45.241642+0000","last_became_active":"2024-05-08T18:29:34.495882+0000","last_became_peered":"2024-05-08T18:29:34.495882+0000","last_unstale":"2024-05-08T18:32:45.241642+0000","last_undegraded":"2024-05-08T18:32:45.241642+0000","last_fullsized":"2024-05-08T18:32:45.241642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:55.793312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"93'8","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.059323+0000","last_change":"2024-05-08T18:29:40.554353+0000","last_active":"2024-05-08T18:32:46.059323+0000","last_peered":"2024-05-08T18:32:46.059323+0000","last_clean":"2024-05-08T18:32:46.059323+0000","last_became_active":"2024-05-08T18:29:40.553527+0000","last_became_peered":"2024-05-08T18:29:40.553527+0000","last_unstale":"2024-05-08T18:32:46.059323+0000","last_undegraded":"2024-05-08T18:32:46.059323+0000","last_fullsized":"2024-05-08T18:32:46.059323+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:03:42.148647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":189,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863485+0000","last_change":"2024-05-08T18:29:44.597411+0000","last_active":"2024-05-08T18:32:46.863485+0000","last_peered":"2024-05-08T18:32:46.863485+0000","last_clean":"2024-05-08T18:32:46.863485+0000","last_became_active":"2024-05-08T18:29:44.596678+0000","last_became_peered":"2024-05-08T18:29:44.596678+0000","last_unstale":"2024-05-08T18:32:46.863485+0000","last_undegraded":"2024-05-08T18:32:46.863485+0000","last_fullsized":"2024-05-08T18:32:46.863485+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:37:23.674968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"97'13","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.066095+0000","last_change":"2024-05-08T18:29:46.607040+0000","last_active":"2024-05-08T18:32:46.066095+0000","last_peered":"2024-05-08T18:32:46.066095+0000","last_clean":"2024-05-08T18:32:46.066095+0000","last_became_active":"2024-05-08T18:29:46.606367+0000","last_became_peered":"2024-05-08T18:29:46.606367+0000","last_unstale":"2024-05-08T18:32:46.066095+0000","last_undegraded":"2024-05-08T18:32:46.066095+0000","last_fullsized":"2024-05-08T18:32:46.066095+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:59:26.650126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.850025+0000","last_change":"2024-05-08T18:29:48.632665+0000","last_active":"2024-05-08T18:32:46.850025+0000","last_peered":"2024-05-08T18:32:46.850025+0000","last_clean":"2024-05-08T18:32:46.850025+0000","last_became_active":"2024-05-08T18:29:48.631874+0000","last_became_peered":"2024-05-08T18:29:48.631874+0000","last_unstale":"2024-05-08T18:32:46.850025+0000","last_undegraded":"2024-05-08T18:32:46.850025+0000","last_fullsized":"2024-05-08T18:32:46.850025+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:06:09.390017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":174,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-08T18:32:45.234935+0000","last_change":"2024-05-08T18:29:50.683443+0000","last_active":"2024-05-08T18:32:45.234935+0000","last_peered":"2024-05-08T18:32:45.234935+0000","last_clean":"2024-05-08T18:32:45.234935+0000","last_became_active":"2024-05-08T18:29:50.682634+0000","last_became_peered":"2024-05-08T18:29:50.682634+0000","last_unstale":"2024-05-08T18:32:45.234935+0000","last_undegraded":"2024-05-08T18:32:45.234935+0000","last_fullsized":"2024-05-08T18:32:45.234935+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:10:38.951662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"80'2","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.917272+0000","last_change":"2024-05-08T18:29:42.574593+0000","last_active":"2024-05-08T18:32:46.917272+0000","last_peered":"2024-05-08T18:32:46.917272+0000","last_clean":"2024-05-08T18:32:46.917272+0000","last_became_active":"2024-05-08T18:29:42.574288+0000","last_became_peered":"2024-05-08T18:29:42.574288+0000","last_unstale":"2024-05-08T18:32:46.917272+0000","last_undegraded":"2024-05-08T18:32:46.917272+0000","last_fullsized":"2024-05-08T18:32:46.917272+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:58.320701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"93'11","reported_seq":158,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.063035+0000","last_change":"2024-05-08T18:30:20.850805+0000","last_active":"2024-05-08T18:32:46.063035+0000","last_peered":"2024-05-08T18:32:46.063035+0000","last_clean":"2024-05-08T18:32:46.063035+0000","last_became_active":"2024-05-08T18:30:20.850365+0000","last_became_peered":"2024-05-08T18:30:20.850365+0000","last_unstale":"2024-05-08T18:32:46.063035+0000","last_undegraded":"2024-05-08T18:32:46.063035+0000","last_fullsized":"2024-05-08T18:32:46.063035+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:52:21.678894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.918404+0000","last_change":"2024-05-08T18:29:34.606393+0000","last_active":"2024-05-08T18:32:46.918404+0000","last_peered":"2024-05-08T18:32:46.918404+0000","last_clean":"2024-05-08T18:32:46.918404+0000","last_became_active":"2024-05-08T18:29:34.605574+0000","last_became_peered":"2024-05-08T18:29:34.605574+0000","last_unstale":"2024-05-08T18:32:46.918404+0000","last_undegraded":"2024-05-08T18:32:46.918404+0000","last_fullsized":"2024-05-08T18:32:46.918404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:55.793312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":189,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.862948+0000","last_change":"2024-05-08T18:29:44.595127+0000","last_active":"2024-05-08T18:32:46.862948+0000","last_peered":"2024-05-08T18:32:46.862948+0000","last_clean":"2024-05-08T18:32:46.862948+0000","last_became_active":"2024-05-08T18:29:44.594642+0000","last_became_peered":"2024-05-08T18:29:44.594642+0000","last_unstale":"2024-05-08T18:32:46.862948+0000","last_undegraded":"2024-05-08T18:32:46.862948+0000","last_fullsized":"2024-05-08T18:32:46.862948+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:04:49.020450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"97'32","reported_seq":231,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.862122+0000","last_change":"2024-05-08T18:29:46.602279+0000","last_active":"2024-05-08T18:32:46.862122+0000","last_peered":"2024-05-08T18:32:46.862122+0000","last_clean":"2024-05-08T18:32:46.862122+0000","last_became_active":"2024-05-08T18:29:46.599707+0000","last_became_peered":"2024-05-08T18:29:46.599707+0000","last_unstale":"2024-05-08T18:32:46.862122+0000","last_undegraded":"2024-05-08T18:32:46.862122+0000","last_fullsized":"2024-05-08T18:32:46.862122+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:54:48.654215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62414,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":24,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.057286+0000","last_change":"2024-05-08T18:29:48.639458+0000","last_active":"2024-05-08T18:32:46.057286+0000","last_peered":"2024-05-08T18:32:46.057286+0000","last_clean":"2024-05-08T18:32:46.057286+0000","last_became_active":"2024-05-08T18:29:48.638709+0000","last_became_peered":"2024-05-08T18:29:48.638709+0000","last_unstale":"2024-05-08T18:32:46.057286+0000","last_undegraded":"2024-05-08T18:32:46.057286+0000","last_fullsized":"2024-05-08T18:32:46.057286+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:19:58.182291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"97'6","reported_seq":189,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.861327+0000","last_change":"2024-05-08T18:29:50.681077+0000","last_active":"2024-05-08T18:32:46.861327+0000","last_peered":"2024-05-08T18:32:46.861327+0000","last_clean":"2024-05-08T18:32:46.861327+0000","last_became_active":"2024-05-08T18:29:50.675766+0000","last_became_peered":"2024-05-08T18:29:50.675766+0000","last_unstale":"2024-05-08T18:32:46.861327+0000","last_undegraded":"2024-05-08T18:32:46.861327+0000","last_fullsized":"2024-05-08T18:32:46.861327+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:09:29.641515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"80'2","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863332+0000","last_change":"2024-05-08T18:29:42.571265+0000","last_active":"2024-05-08T18:32:46.863332+0000","last_peered":"2024-05-08T18:32:46.863332+0000","last_clean":"2024-05-08T18:32:46.863332+0000","last_became_active":"2024-05-08T18:29:42.570645+0000","last_became_peered":"2024-05-08T18:29:42.570645+0000","last_unstale":"2024-05-08T18:32:46.863332+0000","last_undegraded":"2024-05-08T18:32:46.863332+0000","last_fullsized":"2024-05-08T18:32:46.863332+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:30:29.452640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"93'3","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.918243+0000","last_change":"2024-05-08T18:29:40.531079+0000","last_active":"2024-05-08T18:32:46.918243+0000","last_peered":"2024-05-08T18:32:46.918243+0000","last_clean":"2024-05-08T18:32:46.918243+0000","last_became_active":"2024-05-08T18:29:40.530256+0000","last_became_peered":"2024-05-08T18:29:40.530256+0000","last_unstale":"2024-05-08T18:32:46.918243+0000","last_undegraded":"2024-05-08T18:32:46.918243+0000","last_fullsized":"2024-05-08T18:32:46.918243+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:09:42.581976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.938519+0000","last_change":"2024-05-08T18:29:34.603292+0000","last_active":"2024-05-08T18:32:46.938519+0000","last_peered":"2024-05-08T18:32:46.938519+0000","last_clean":"2024-05-08T18:32:46.938519+0000","last_became_active":"2024-05-08T18:29:34.602547+0000","last_became_peered":"2024-05-08T18:29:34.602547+0000","last_unstale":"2024-05-08T18:32:46.938519+0000","last_undegraded":"2024-05-08T18:32:46.938519+0000","last_fullsized":"2024-05-08T18:32:46.938519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:24:55.555475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.849004+0000","last_change":"2024-05-08T18:29:44.593275+0000","last_active":"2024-05-08T18:32:46.849004+0000","last_peered":"2024-05-08T18:32:46.849004+0000","last_clean":"2024-05-08T18:32:46.849004+0000","last_became_active":"2024-05-08T18:29:44.591870+0000","last_became_peered":"2024-05-08T18:29:44.591870+0000","last_unstale":"2024-05-08T18:32:46.849004+0000","last_undegraded":"2024-05-08T18:32:46.849004+0000","last_fullsized":"2024-05-08T18:32:46.849004+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:35.176971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"33'14","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.917202+0000","last_change":"2024-05-08T18:29:46.603499+0000","last_active":"2024-05-08T18:32:46.917202+0000","last_peered":"2024-05-08T18:32:46.917202+0000","last_clean":"2024-05-08T18:32:46.917202+0000","last_became_active":"2024-05-08T18:29:46.602920+0000","last_became_peered":"2024-05-08T18:29:46.602920+0000","last_unstale":"2024-05-08T18:32:46.917202+0000","last_undegraded":"2024-05-08T18:32:46.917202+0000","last_fullsized":"2024-05-08T18:32:46.917202+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:08.504882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"97'101","reported_seq":327,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-08T18:32:45.238750+0000","last_change":"2024-05-08T18:29:48.634915+0000","last_active":"2024-05-08T18:32:45.238750+0000","last_peered":"2024-05-08T18:32:45.238750+0000","last_clean":"2024-05-08T18:32:45.238750+0000","last_became_active":"2024-05-08T18:29:48.634280+0000","last_became_peered":"2024-05-08T18:29:48.634280+0000","last_unstale":"2024-05-08T18:32:45.238750+0000","last_undegraded":"2024-05-08T18:32:45.238750+0000","last_fullsized":"2024-05-08T18:32:45.238750+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:19:58.182291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"80'2","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.067407+0000","last_change":"2024-05-08T18:29:50.688742+0000","last_active":"2024-05-08T18:32:46.067407+0000","last_peered":"2024-05-08T18:32:46.067407+0000","last_clean":"2024-05-08T18:32:46.067407+0000","last_became_active":"2024-05-08T18:29:50.687135+0000","last_became_peered":"2024-05-08T18:29:50.687135+0000","last_unstale":"2024-05-08T18:32:46.067407+0000","last_undegraded":"2024-05-08T18:32:46.067407+0000","last_fullsized":"2024-05-08T18:32:46.067407+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:12:49.040807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"80'2","reported_seq":152,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.059948+0000","last_change":"2024-05-08T18:30:21.220561+0000","last_active":"2024-05-08T18:32:46.059948+0000","last_peered":"2024-05-08T18:32:46.059948+0000","last_clean":"2024-05-08T18:32:46.059948+0000","last_became_active":"2024-05-08T18:30:21.220196+0000","last_became_peered":"2024-05-08T18:30:21.220196+0000","last_unstale":"2024-05-08T18:32:46.059948+0000","last_undegraded":"2024-05-08T18:32:46.059948+0000","last_fullsized":"2024-05-08T18:32:46.059948+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:19:27.075761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"83'5","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.066414+0000","last_change":"2024-05-08T18:29:40.565872+0000","last_active":"2024-05-08T18:32:46.066414+0000","last_peered":"2024-05-08T18:32:46.066414+0000","last_clean":"2024-05-08T18:32:46.066414+0000","last_became_active":"2024-05-08T18:29:40.565655+0000","last_became_peered":"2024-05-08T18:29:40.565655+0000","last_unstale":"2024-05-08T18:32:46.066414+0000","last_undegraded":"2024-05-08T18:32:46.066414+0000","last_fullsized":"2024-05-08T18:32:46.066414+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:16:16.521258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.919692+0000","last_change":"2024-05-08T18:29:34.501273+0000","last_active":"2024-05-08T18:32:46.919692+0000","last_peered":"2024-05-08T18:32:46.919692+0000","last_clean":"2024-05-08T18:32:46.919692+0000","last_became_active":"2024-05-08T18:29:34.500933+0000","last_became_peered":"2024-05-08T18:29:34.500933+0000","last_unstale":"2024-05-08T18:32:46.919692+0000","last_undegraded":"2024-05-08T18:32:46.919692+0000","last_fullsized":"2024-05-08T18:32:46.919692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:35.917391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.057534+0000","last_change":"2024-05-08T18:29:44.576227+0000","last_active":"2024-05-08T18:32:46.057534+0000","last_peered":"2024-05-08T18:32:46.057534+0000","last_clean":"2024-05-08T18:32:46.057534+0000","last_became_active":"2024-05-08T18:29:44.575454+0000","last_became_peered":"2024-05-08T18:29:44.575454+0000","last_unstale":"2024-05-08T18:32:46.057534+0000","last_undegraded":"2024-05-08T18:32:46.057534+0000","last_fullsized":"2024-05-08T18:32:46.057534+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:06:05.355648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"80'11","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.058692+0000","last_change":"2024-05-08T18:29:46.609633+0000","last_active":"2024-05-08T18:32:46.058692+0000","last_peered":"2024-05-08T18:32:46.058692+0000","last_clean":"2024-05-08T18:32:46.058692+0000","last_became_active":"2024-05-08T18:29:46.603455+0000","last_became_peered":"2024-05-08T18:29:46.603455+0000","last_unstale":"2024-05-08T18:32:46.058692+0000","last_undegraded":"2024-05-08T18:32:46.058692+0000","last_fullsized":"2024-05-08T18:32:46.058692+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:07:54.654205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"97'101","reported_seq":363,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.065251+0000","last_change":"2024-05-08T18:29:48.637898+0000","last_active":"2024-05-08T18:32:46.065251+0000","last_peered":"2024-05-08T18:32:46.065251+0000","last_clean":"2024-05-08T18:32:46.065251+0000","last_became_active":"2024-05-08T18:29:48.637070+0000","last_became_peered":"2024-05-08T18:29:48.637070+0000","last_unstale":"2024-05-08T18:32:46.065251+0000","last_undegraded":"2024-05-08T18:32:46.065251+0000","last_fullsized":"2024-05-08T18:32:46.065251+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:03:46.392864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"84'10","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.861002+0000","last_change":"2024-05-08T18:29:50.691526+0000","last_active":"2024-05-08T18:32:46.861002+0000","last_peered":"2024-05-08T18:32:46.861002+0000","last_clean":"2024-05-08T18:32:46.861002+0000","last_became_active":"2024-05-08T18:29:50.690767+0000","last_became_peered":"2024-05-08T18:29:50.690767+0000","last_unstale":"2024-05-08T18:32:46.861002+0000","last_undegraded":"2024-05-08T18:32:46.861002+0000","last_fullsized":"2024-05-08T18:32:46.861002+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:32:29.972139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"97'16","reported_seq":229,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.057923+0000","last_change":"2024-05-08T18:29:42.562006+0000","last_active":"2024-05-08T18:32:46.057923+0000","last_peered":"2024-05-08T18:32:46.057923+0000","last_clean":"2024-05-08T18:32:46.057923+0000","last_became_active":"2024-05-08T18:29:42.560861+0000","last_became_peered":"2024-05-08T18:29:42.560861+0000","last_unstale":"2024-05-08T18:32:46.057923+0000","last_undegraded":"2024-05-08T18:32:46.057923+0000","last_fullsized":"2024-05-08T18:32:46.057923+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:36.890277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"93'9","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863638+0000","last_change":"2024-05-08T18:29:40.550529+0000","last_active":"2024-05-08T18:32:46.863638+0000","last_peered":"2024-05-08T18:32:46.863638+0000","last_clean":"2024-05-08T18:32:46.863638+0000","last_became_active":"2024-05-08T18:29:40.550241+0000","last_became_peered":"2024-05-08T18:29:40.550241+0000","last_unstale":"2024-05-08T18:32:46.863638+0000","last_undegraded":"2024-05-08T18:32:46.863638+0000","last_fullsized":"2024-05-08T18:32:46.863638+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:48.294532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.850587+0000","last_change":"2024-05-08T18:29:34.493537+0000","last_active":"2024-05-08T18:32:46.850587+0000","last_peered":"2024-05-08T18:32:46.850587+0000","last_clean":"2024-05-08T18:32:46.850587+0000","last_became_active":"2024-05-08T18:29:34.492891+0000","last_became_peered":"2024-05-08T18:29:34.492891+0000","last_unstale":"2024-05-08T18:32:46.850587+0000","last_undegraded":"2024-05-08T18:32:46.850587+0000","last_fullsized":"2024-05-08T18:32:46.850587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:09:07.992256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":189,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.063279+0000","last_change":"2024-05-08T18:29:44.590102+0000","last_active":"2024-05-08T18:32:46.063279+0000","last_peered":"2024-05-08T18:32:46.063279+0000","last_clean":"2024-05-08T18:32:46.063279+0000","last_became_active":"2024-05-08T18:29:44.589471+0000","last_became_peered":"2024-05-08T18:29:44.589471+0000","last_unstale":"2024-05-08T18:32:46.063279+0000","last_undegraded":"2024-05-08T18:32:46.063279+0000","last_fullsized":"2024-05-08T18:32:46.063279+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:14:04.085401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"97'37","reported_seq":236,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.935847+0000","last_change":"2024-05-08T18:29:46.606967+0000","last_active":"2024-05-08T18:32:46.935847+0000","last_peered":"2024-05-08T18:32:46.935847+0000","last_clean":"2024-05-08T18:32:46.935847+0000","last_became_active":"2024-05-08T18:29:46.605693+0000","last_became_peered":"2024-05-08T18:29:46.605693+0000","last_unstale":"2024-05-08T18:32:46.935847+0000","last_undegraded":"2024-05-08T18:32:46.935847+0000","last_fullsized":"2024-05-08T18:32:46.935847+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:24:13.568294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.061836+0000","last_change":"2024-05-08T18:29:48.634271+0000","last_active":"2024-05-08T18:32:46.061836+0000","last_peered":"2024-05-08T18:32:46.061836+0000","last_clean":"2024-05-08T18:32:46.061836+0000","last_became_active":"2024-05-08T18:29:48.633607+0000","last_became_peered":"2024-05-08T18:29:48.633607+0000","last_unstale":"2024-05-08T18:32:46.061836+0000","last_undegraded":"2024-05-08T18:32:46.061836+0000","last_fullsized":"2024-05-08T18:32:46.061836+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:34.806539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":174,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-08T18:32:45.242486+0000","last_change":"2024-05-08T18:29:50.685494+0000","last_active":"2024-05-08T18:32:45.242486+0000","last_peered":"2024-05-08T18:32:45.242486+0000","last_clean":"2024-05-08T18:32:45.242486+0000","last_became_active":"2024-05-08T18:29:50.684818+0000","last_became_peered":"2024-05-08T18:29:50.684818+0000","last_unstale":"2024-05-08T18:32:45.242486+0000","last_undegraded":"2024-05-08T18:32:45.242486+0000","last_fullsized":"2024-05-08T18:32:45.242486+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:22.220842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863373+0000","last_change":"2024-05-08T18:29:50.682937+0000","last_active":"2024-05-08T18:32:46.863373+0000","last_peered":"2024-05-08T18:32:46.863373+0000","last_clean":"2024-05-08T18:32:46.863373+0000","last_became_active":"2024-05-08T18:29:50.681771+0000","last_became_peered":"2024-05-08T18:29:50.681771+0000","last_unstale":"2024-05-08T18:32:46.863373+0000","last_undegraded":"2024-05-08T18:32:46.863373+0000","last_fullsized":"2024-05-08T18:32:46.863373+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:28:29.836446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"84'4","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.058933+0000","last_change":"2024-05-08T18:29:42.575909+0000","last_active":"2024-05-08T18:32:46.058933+0000","last_peered":"2024-05-08T18:32:46.058933+0000","last_clean":"2024-05-08T18:32:46.058933+0000","last_became_active":"2024-05-08T18:29:42.574877+0000","last_became_peered":"2024-05-08T18:29:42.574877+0000","last_unstale":"2024-05-08T18:32:46.058933+0000","last_undegraded":"2024-05-08T18:32:46.058933+0000","last_fullsized":"2024-05-08T18:32:46.058933+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:33.139089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"93'11","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.059190+0000","last_change":"2024-05-08T18:29:40.566496+0000","last_active":"2024-05-08T18:32:46.059190+0000","last_peered":"2024-05-08T18:32:46.059190+0000","last_clean":"2024-05-08T18:32:46.059190+0000","last_became_active":"2024-05-08T18:29:40.565874+0000","last_became_peered":"2024-05-08T18:29:40.565874+0000","last_unstale":"2024-05-08T18:32:46.059190+0000","last_undegraded":"2024-05-08T18:32:46.059190+0000","last_fullsized":"2024-05-08T18:32:46.059190+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:07.239963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.917412+0000","last_change":"2024-05-08T18:29:44.595410+0000","last_active":"2024-05-08T18:32:46.917412+0000","last_peered":"2024-05-08T18:32:46.917412+0000","last_clean":"2024-05-08T18:32:46.917412+0000","last_became_active":"2024-05-08T18:29:44.594286+0000","last_became_peered":"2024-05-08T18:29:44.594286+0000","last_unstale":"2024-05-08T18:32:46.917412+0000","last_undegraded":"2024-05-08T18:32:46.917412+0000","last_fullsized":"2024-05-08T18:32:46.917412+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:38.928160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"97'18","reported_seq":211,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.064873+0000","last_change":"2024-05-08T18:29:46.591009+0000","last_active":"2024-05-08T18:32:46.064873+0000","last_peered":"2024-05-08T18:32:46.064873+0000","last_clean":"2024-05-08T18:32:46.064873+0000","last_became_active":"2024-05-08T18:29:46.588810+0000","last_became_peered":"2024-05-08T18:29:46.588810+0000","last_unstale":"2024-05-08T18:32:46.064873+0000","last_undegraded":"2024-05-08T18:32:46.064873+0000","last_fullsized":"2024-05-08T18:32:46.064873+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:34:45.745300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.062900+0000","last_change":"2024-05-08T18:29:48.634986+0000","last_active":"2024-05-08T18:32:46.062900+0000","last_peered":"2024-05-08T18:32:46.062900+0000","last_clean":"2024-05-08T18:32:46.062900+0000","last_became_active":"2024-05-08T18:29:48.633866+0000","last_became_peered":"2024-05-08T18:29:48.633866+0000","last_unstale":"2024-05-08T18:32:46.062900+0000","last_undegraded":"2024-05-08T18:32:46.062900+0000","last_fullsized":"2024-05-08T18:32:46.062900+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:46.539830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"83'16","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.065910+0000","last_change":"2024-05-08T18:29:50.693408+0000","last_active":"2024-05-08T18:32:46.065910+0000","last_peered":"2024-05-08T18:32:46.065910+0000","last_clean":"2024-05-08T18:32:46.065910+0000","last_became_active":"2024-05-08T18:29:50.692687+0000","last_became_peered":"2024-05-08T18:29:50.692687+0000","last_unstale":"2024-05-08T18:32:46.065910+0000","last_undegraded":"2024-05-08T18:32:46.065910+0000","last_fullsized":"2024-05-08T18:32:46.065910+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:22.834262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":28,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"83'6","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.917179+0000","last_change":"2024-05-08T18:29:42.581368+0000","last_active":"2024-05-08T18:32:46.917179+0000","last_peered":"2024-05-08T18:32:46.917179+0000","last_clean":"2024-05-08T18:32:46.917179+0000","last_became_active":"2024-05-08T18:29:42.580887+0000","last_became_peered":"2024-05-08T18:29:42.580887+0000","last_unstale":"2024-05-08T18:32:46.917179+0000","last_undegraded":"2024-05-08T18:32:46.917179+0000","last_fullsized":"2024-05-08T18:32:46.917179+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:08:15.026467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"93'7","reported_seq":201,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.938046+0000","last_change":"2024-05-08T18:29:40.572770+0000","last_active":"2024-05-08T18:32:46.938046+0000","last_peered":"2024-05-08T18:32:46.938046+0000","last_clean":"2024-05-08T18:32:46.938046+0000","last_became_active":"2024-05-08T18:29:40.572079+0000","last_became_peered":"2024-05-08T18:29:40.572079+0000","last_unstale":"2024-05-08T18:32:46.938046+0000","last_undegraded":"2024-05-08T18:32:46.938046+0000","last_fullsized":"2024-05-08T18:32:46.938046+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:05.929806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":189,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.063663+0000","last_change":"2024-05-08T18:29:44.581323+0000","last_active":"2024-05-08T18:32:46.063663+0000","last_peered":"2024-05-08T18:32:46.063663+0000","last_clean":"2024-05-08T18:32:46.063663+0000","last_became_active":"2024-05-08T18:29:44.580805+0000","last_became_peered":"2024-05-08T18:29:44.580805+0000","last_unstale":"2024-05-08T18:32:46.063663+0000","last_undegraded":"2024-05-08T18:32:46.063663+0000","last_fullsized":"2024-05-08T18:32:46.063663+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:35:25.591140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"47'5","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.862030+0000","last_change":"2024-05-08T18:29:46.602495+0000","last_active":"2024-05-08T18:32:46.862030+0000","last_peered":"2024-05-08T18:32:46.862030+0000","last_clean":"2024-05-08T18:32:46.862030+0000","last_became_active":"2024-05-08T18:29:46.599789+0000","last_became_peered":"2024-05-08T18:29:46.599789+0000","last_unstale":"2024-05-08T18:32:46.862030+0000","last_undegraded":"2024-05-08T18:32:46.862030+0000","last_fullsized":"2024-05-08T18:32:46.862030+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:18:16.375808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.936013+0000","last_change":"2024-05-08T18:29:48.642994+0000","last_active":"2024-05-08T18:32:46.936013+0000","last_peered":"2024-05-08T18:32:46.936013+0000","last_clean":"2024-05-08T18:32:46.936013+0000","last_became_active":"2024-05-08T18:29:48.642056+0000","last_became_peered":"2024-05-08T18:29:48.642056+0000","last_unstale":"2024-05-08T18:32:46.936013+0000","last_undegraded":"2024-05-08T18:32:46.936013+0000","last_fullsized":"2024-05-08T18:32:46.936013+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:47:54.034851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863166+0000","last_change":"2024-05-08T18:29:50.672513+0000","last_active":"2024-05-08T18:32:46.863166+0000","last_peered":"2024-05-08T18:32:46.863166+0000","last_clean":"2024-05-08T18:32:46.863166+0000","last_became_active":"2024-05-08T18:29:50.671781+0000","last_became_peered":"2024-05-08T18:29:50.671781+0000","last_unstale":"2024-05-08T18:32:46.863166+0000","last_undegraded":"2024-05-08T18:32:46.863166+0000","last_fullsized":"2024-05-08T18:32:46.863166+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:45:34.171402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"97'2","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.062291+0000","last_change":"2024-05-08T18:29:42.576843+0000","last_active":"2024-05-08T18:32:46.062291+0000","last_peered":"2024-05-08T18:32:46.062291+0000","last_clean":"2024-05-08T18:32:46.062291+0000","last_became_active":"2024-05-08T18:29:42.576379+0000","last_became_peered":"2024-05-08T18:29:42.576379+0000","last_unstale":"2024-05-08T18:32:46.062291+0000","last_undegraded":"2024-05-08T18:32:46.062291+0000","last_fullsized":"2024-05-08T18:32:46.062291+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:20.471010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"93'12","reported_seq":206,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-08T18:32:45.243801+0000","last_change":"2024-05-08T18:29:40.542997+0000","last_active":"2024-05-08T18:32:45.243801+0000","last_peered":"2024-05-08T18:32:45.243801+0000","last_clean":"2024-05-08T18:32:45.243801+0000","last_became_active":"2024-05-08T18:29:40.542239+0000","last_became_peered":"2024-05-08T18:29:40.542239+0000","last_unstale":"2024-05-08T18:32:45.243801+0000","last_undegraded":"2024-05-08T18:32:45.243801+0000","last_fullsized":"2024-05-08T18:32:45.243801+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:14:43.555504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.935289+0000","last_change":"2024-05-08T18:29:44.594178+0000","last_active":"2024-05-08T18:32:46.935289+0000","last_peered":"2024-05-08T18:32:46.935289+0000","last_clean":"2024-05-08T18:32:46.935289+0000","last_became_active":"2024-05-08T18:29:44.592476+0000","last_became_peered":"2024-05-08T18:29:44.592476+0000","last_unstale":"2024-05-08T18:32:46.935289+0000","last_undegraded":"2024-05-08T18:32:46.935289+0000","last_fullsized":"2024-05-08T18:32:46.935289+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:04:16.093662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"97'17","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.063156+0000","last_change":"2024-05-08T18:29:46.597288+0000","last_active":"2024-05-08T18:32:46.063156+0000","last_peered":"2024-05-08T18:32:46.063156+0000","last_clean":"2024-05-08T18:32:46.063156+0000","last_became_active":"2024-05-08T18:29:46.596452+0000","last_became_peered":"2024-05-08T18:29:46.596452+0000","last_unstale":"2024-05-08T18:32:46.063156+0000","last_undegraded":"2024-05-08T18:32:46.063156+0000","last_fullsized":"2024-05-08T18:32:46.063156+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:32:43.245753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.848919+0000","last_change":"2024-05-08T18:29:48.635436+0000","last_active":"2024-05-08T18:32:46.848919+0000","last_peered":"2024-05-08T18:32:46.848919+0000","last_clean":"2024-05-08T18:32:46.848919+0000","last_became_active":"2024-05-08T18:29:48.634704+0000","last_became_peered":"2024-05-08T18:29:48.634704+0000","last_unstale":"2024-05-08T18:32:46.848919+0000","last_undegraded":"2024-05-08T18:32:46.848919+0000","last_fullsized":"2024-05-08T18:32:46.848919+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:55:52.238481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"83'2","reported_seq":177,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-08T18:32:45.242253+0000","last_change":"2024-05-08T18:29:50.687974+0000","last_active":"2024-05-08T18:32:45.242253+0000","last_peered":"2024-05-08T18:32:45.242253+0000","last_clean":"2024-05-08T18:32:45.242253+0000","last_became_active":"2024-05-08T18:29:50.687045+0000","last_became_peered":"2024-05-08T18:29:50.687045+0000","last_unstale":"2024-05-08T18:32:45.242253+0000","last_undegraded":"2024-05-08T18:32:45.242253+0000","last_fullsized":"2024-05-08T18:32:45.242253+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:55:01.894779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"97'4","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.063677+0000","last_change":"2024-05-08T18:30:20.850226+0000","last_active":"2024-05-08T18:32:46.063677+0000","last_peered":"2024-05-08T18:32:46.063677+0000","last_clean":"2024-05-08T18:32:46.063677+0000","last_became_active":"2024-05-08T18:30:20.849751+0000","last_became_peered":"2024-05-08T18:30:20.849751+0000","last_unstale":"2024-05-08T18:32:46.063677+0000","last_undegraded":"2024-05-08T18:32:46.063677+0000","last_fullsized":"2024-05-08T18:32:46.063677+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:33:31.550958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"93'13","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863945+0000","last_change":"2024-05-08T18:29:40.541112+0000","last_active":"2024-05-08T18:32:46.863945+0000","last_peered":"2024-05-08T18:32:46.863945+0000","last_clean":"2024-05-08T18:32:46.863945+0000","last_became_active":"2024-05-08T18:29:40.540835+0000","last_became_peered":"2024-05-08T18:29:40.540835+0000","last_unstale":"2024-05-08T18:32:46.863945+0000","last_undegraded":"2024-05-08T18:32:46.863945+0000","last_fullsized":"2024-05-08T18:32:46.863945+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:43:14.995191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.848912+0000","last_change":"2024-05-08T18:29:44.592033+0000","last_active":"2024-05-08T18:32:46.848912+0000","last_peered":"2024-05-08T18:32:46.848912+0000","last_clean":"2024-05-08T18:32:46.848912+0000","last_became_active":"2024-05-08T18:29:44.590454+0000","last_became_peered":"2024-05-08T18:29:44.590454+0000","last_unstale":"2024-05-08T18:32:46.848912+0000","last_undegraded":"2024-05-08T18:32:46.848912+0000","last_fullsized":"2024-05-08T18:32:46.848912+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:11:03.740365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"97'15","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.935727+0000","last_change":"2024-05-08T18:29:46.607002+0000","last_active":"2024-05-08T18:32:46.935727+0000","last_peered":"2024-05-08T18:32:46.935727+0000","last_clean":"2024-05-08T18:32:46.935727+0000","last_became_active":"2024-05-08T18:29:46.606172+0000","last_became_peered":"2024-05-08T18:29:46.606172+0000","last_unstale":"2024-05-08T18:32:46.935727+0000","last_undegraded":"2024-05-08T18:32:46.935727+0000","last_fullsized":"2024-05-08T18:32:46.935727+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:37:35.850414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.862686+0000","last_change":"2024-05-08T18:29:48.632948+0000","last_active":"2024-05-08T18:32:46.862686+0000","last_peered":"2024-05-08T18:32:46.862686+0000","last_clean":"2024-05-08T18:32:46.862686+0000","last_became_active":"2024-05-08T18:29:48.631219+0000","last_became_peered":"2024-05-08T18:29:48.631219+0000","last_unstale":"2024-05-08T18:32:46.862686+0000","last_undegraded":"2024-05-08T18:32:46.862686+0000","last_fullsized":"2024-05-08T18:32:46.862686+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:19:01.454355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.850370+0000","last_change":"2024-05-08T18:29:42.570180+0000","last_active":"2024-05-08T18:32:46.850370+0000","last_peered":"2024-05-08T18:32:46.850370+0000","last_clean":"2024-05-08T18:32:46.850370+0000","last_became_active":"2024-05-08T18:29:42.569425+0000","last_became_peered":"2024-05-08T18:29:42.569425+0000","last_unstale":"2024-05-08T18:32:46.850370+0000","last_undegraded":"2024-05-08T18:32:46.850370+0000","last_fullsized":"2024-05-08T18:32:46.850370+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:35.037465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"93'8","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.064153+0000","last_change":"2024-05-08T18:29:40.547711+0000","last_active":"2024-05-08T18:32:46.064153+0000","last_peered":"2024-05-08T18:32:46.064153+0000","last_clean":"2024-05-08T18:32:46.064153+0000","last_became_active":"2024-05-08T18:29:40.547479+0000","last_became_peered":"2024-05-08T18:29:40.547479+0000","last_unstale":"2024-05-08T18:32:46.064153+0000","last_undegraded":"2024-05-08T18:32:46.064153+0000","last_fullsized":"2024-05-08T18:32:46.064153+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:12:40.901620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":189,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863409+0000","last_change":"2024-05-08T18:29:44.591547+0000","last_active":"2024-05-08T18:32:46.863409+0000","last_peered":"2024-05-08T18:32:46.863409+0000","last_clean":"2024-05-08T18:32:46.863409+0000","last_became_active":"2024-05-08T18:29:44.590498+0000","last_became_peered":"2024-05-08T18:29:44.590498+0000","last_unstale":"2024-05-08T18:32:46.863409+0000","last_undegraded":"2024-05-08T18:32:46.863409+0000","last_fullsized":"2024-05-08T18:32:46.863409+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:14:04.085401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"97'25","reported_seq":223,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.918610+0000","last_change":"2024-05-08T18:29:46.600437+0000","last_active":"2024-05-08T18:32:46.918610+0000","last_peered":"2024-05-08T18:32:46.918610+0000","last_clean":"2024-05-08T18:32:46.918610+0000","last_became_active":"2024-05-08T18:29:46.594672+0000","last_became_peered":"2024-05-08T18:29:46.594672+0000","last_unstale":"2024-05-08T18:32:46.918610+0000","last_undegraded":"2024-05-08T18:32:46.918610+0000","last_fullsized":"2024-05-08T18:32:46.918610+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:35:53.294312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":178,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-08T18:32:45.242537+0000","last_change":"2024-05-08T18:29:48.639840+0000","last_active":"2024-05-08T18:32:45.242537+0000","last_peered":"2024-05-08T18:32:45.242537+0000","last_clean":"2024-05-08T18:32:45.242537+0000","last_became_active":"2024-05-08T18:29:48.639120+0000","last_became_peered":"2024-05-08T18:29:48.639120+0000","last_unstale":"2024-05-08T18:32:45.242537+0000","last_undegraded":"2024-05-08T18:32:45.242537+0000","last_fullsized":"2024-05-08T18:32:45.242537+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:13:50.865474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"84'2","reported_seq":180,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.062460+0000","last_change":"2024-05-08T18:29:50.684843+0000","last_active":"2024-05-08T18:32:46.062460+0000","last_peered":"2024-05-08T18:32:46.062460+0000","last_clean":"2024-05-08T18:32:46.062460+0000","last_became_active":"2024-05-08T18:29:50.684119+0000","last_became_peered":"2024-05-08T18:29:50.684119+0000","last_unstale":"2024-05-08T18:32:46.062460+0000","last_undegraded":"2024-05-08T18:32:46.062460+0000","last_fullsized":"2024-05-08T18:32:46.062460+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:09:29.641515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"80'2","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863501+0000","last_change":"2024-05-08T18:29:42.575763+0000","last_active":"2024-05-08T18:32:46.863501+0000","last_peered":"2024-05-08T18:32:46.863501+0000","last_clean":"2024-05-08T18:32:46.863501+0000","last_became_active":"2024-05-08T18:29:42.575450+0000","last_became_peered":"2024-05-08T18:29:42.575450+0000","last_unstale":"2024-05-08T18:32:46.863501+0000","last_undegraded":"2024-05-08T18:32:46.863501+0000","last_fullsized":"2024-05-08T18:32:46.863501+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:20.471010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"93'10","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.917742+0000","last_change":"2024-05-08T18:29:40.546101+0000","last_active":"2024-05-08T18:32:46.917742+0000","last_peered":"2024-05-08T18:32:46.917742+0000","last_clean":"2024-05-08T18:32:46.917742+0000","last_became_active":"2024-05-08T18:29:40.545814+0000","last_became_peered":"2024-05-08T18:29:40.545814+0000","last_unstale":"2024-05-08T18:32:46.917742+0000","last_undegraded":"2024-05-08T18:32:46.917742+0000","last_fullsized":"2024-05-08T18:32:46.917742+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:22.579629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.850156+0000","last_change":"2024-05-08T18:29:44.591310+0000","last_active":"2024-05-08T18:32:46.850156+0000","last_peered":"2024-05-08T18:32:46.850156+0000","last_clean":"2024-05-08T18:32:46.850156+0000","last_became_active":"2024-05-08T18:29:44.590394+0000","last_became_peered":"2024-05-08T18:29:44.590394+0000","last_unstale":"2024-05-08T18:32:46.850156+0000","last_undegraded":"2024-05-08T18:32:46.850156+0000","last_fullsized":"2024-05-08T18:32:46.850156+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:02:28.348982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"97'21","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.936870+0000","last_change":"2024-05-08T18:29:46.605887+0000","last_active":"2024-05-08T18:32:46.936870+0000","last_peered":"2024-05-08T18:32:46.936870+0000","last_clean":"2024-05-08T18:32:46.936870+0000","last_became_active":"2024-05-08T18:29:46.604917+0000","last_became_peered":"2024-05-08T18:29:46.604917+0000","last_unstale":"2024-05-08T18:32:46.936870+0000","last_undegraded":"2024-05-08T18:32:46.936870+0000","last_fullsized":"2024-05-08T18:32:46.936870+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:22:36.338527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.918794+0000","last_change":"2024-05-08T18:29:48.644420+0000","last_active":"2024-05-08T18:32:46.918794+0000","last_peered":"2024-05-08T18:32:46.918794+0000","last_clean":"2024-05-08T18:32:46.918794+0000","last_became_active":"2024-05-08T18:29:48.643493+0000","last_became_peered":"2024-05-08T18:29:48.643493+0000","last_unstale":"2024-05-08T18:32:46.918794+0000","last_undegraded":"2024-05-08T18:32:46.918794+0000","last_fullsized":"2024-05-08T18:32:46.918794+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:19:33.148012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":174,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.848670+0000","last_change":"2024-05-08T18:29:50.687485+0000","last_active":"2024-05-08T18:32:46.848670+0000","last_peered":"2024-05-08T18:32:46.848670+0000","last_clean":"2024-05-08T18:32:46.848670+0000","last_became_active":"2024-05-08T18:29:50.686750+0000","last_became_peered":"2024-05-08T18:29:50.686750+0000","last_unstale":"2024-05-08T18:32:46.848670+0000","last_undegraded":"2024-05-08T18:32:46.848670+0000","last_fullsized":"2024-05-08T18:32:46.848670+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:41.914164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"97'4","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.066425+0000","last_change":"2024-05-08T18:29:42.566571+0000","last_active":"2024-05-08T18:32:46.066425+0000","last_peered":"2024-05-08T18:32:46.066425+0000","last_clean":"2024-05-08T18:32:46.066425+0000","last_became_active":"2024-05-08T18:29:42.563695+0000","last_became_peered":"2024-05-08T18:29:42.563695+0000","last_unstale":"2024-05-08T18:32:46.066425+0000","last_undegraded":"2024-05-08T18:32:46.066425+0000","last_fullsized":"2024-05-08T18:32:46.066425+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:46.887628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"93'10","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.059150+0000","last_change":"2024-05-08T18:29:40.545512+0000","last_active":"2024-05-08T18:32:46.059150+0000","last_peered":"2024-05-08T18:32:46.059150+0000","last_clean":"2024-05-08T18:32:46.059150+0000","last_became_active":"2024-05-08T18:29:40.544216+0000","last_became_peered":"2024-05-08T18:29:40.544216+0000","last_unstale":"2024-05-08T18:32:46.059150+0000","last_undegraded":"2024-05-08T18:32:46.059150+0000","last_fullsized":"2024-05-08T18:32:46.059150+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:37:08.242362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.060557+0000","last_change":"2024-05-08T18:29:44.576107+0000","last_active":"2024-05-08T18:32:46.060557+0000","last_peered":"2024-05-08T18:32:46.060557+0000","last_clean":"2024-05-08T18:32:46.060557+0000","last_became_active":"2024-05-08T18:29:44.575344+0000","last_became_peered":"2024-05-08T18:29:44.575344+0000","last_unstale":"2024-05-08T18:32:46.060557+0000","last_undegraded":"2024-05-08T18:32:46.060557+0000","last_fullsized":"2024-05-08T18:32:46.060557+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:19.731003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"97'17","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.067703+0000","last_change":"2024-05-08T18:29:46.584785+0000","last_active":"2024-05-08T18:32:46.067703+0000","last_peered":"2024-05-08T18:32:46.067703+0000","last_clean":"2024-05-08T18:32:46.067703+0000","last_became_active":"2024-05-08T18:29:46.583390+0000","last_became_peered":"2024-05-08T18:29:46.583390+0000","last_unstale":"2024-05-08T18:32:46.067703+0000","last_undegraded":"2024-05-08T18:32:46.067703+0000","last_fullsized":"2024-05-08T18:32:46.067703+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:27:01.747339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.919301+0000","last_change":"2024-05-08T18:29:48.643558+0000","last_active":"2024-05-08T18:32:46.919301+0000","last_peered":"2024-05-08T18:32:46.919301+0000","last_clean":"2024-05-08T18:32:46.919301+0000","last_became_active":"2024-05-08T18:29:48.642773+0000","last_became_peered":"2024-05-08T18:29:48.642773+0000","last_unstale":"2024-05-08T18:32:46.919301+0000","last_undegraded":"2024-05-08T18:32:46.919301+0000","last_fullsized":"2024-05-08T18:32:46.919301+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:59:04.369806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":174,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-08T18:32:45.239880+0000","last_change":"2024-05-08T18:29:50.674796+0000","last_active":"2024-05-08T18:32:45.239880+0000","last_peered":"2024-05-08T18:32:45.239880+0000","last_clean":"2024-05-08T18:32:45.239880+0000","last_became_active":"2024-05-08T18:29:50.674057+0000","last_became_peered":"2024-05-08T18:29:50.674057+0000","last_unstale":"2024-05-08T18:32:45.239880+0000","last_undegraded":"2024-05-08T18:32:45.239880+0000","last_fullsized":"2024-05-08T18:32:45.239880+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:34:14.488295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"84'4","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.062561+0000","last_change":"2024-05-08T18:29:42.577642+0000","last_active":"2024-05-08T18:32:46.062561+0000","last_peered":"2024-05-08T18:32:46.062561+0000","last_clean":"2024-05-08T18:32:46.062561+0000","last_became_active":"2024-05-08T18:29:42.577275+0000","last_became_peered":"2024-05-08T18:29:42.577275+0000","last_unstale":"2024-05-08T18:32:46.062561+0000","last_undegraded":"2024-05-08T18:32:46.062561+0000","last_fullsized":"2024-05-08T18:32:46.062561+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:51:45.155037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"93'10","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.862767+0000","last_change":"2024-05-08T18:29:40.562873+0000","last_active":"2024-05-08T18:32:46.862767+0000","last_peered":"2024-05-08T18:32:46.862767+0000","last_clean":"2024-05-08T18:32:46.862767+0000","last_became_active":"2024-05-08T18:29:40.562594+0000","last_became_peered":"2024-05-08T18:29:40.562594+0000","last_unstale":"2024-05-08T18:32:46.862767+0000","last_undegraded":"2024-05-08T18:32:46.862767+0000","last_fullsized":"2024-05-08T18:32:46.862767+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:16:16.521258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.918959+0000","last_change":"2024-05-08T18:29:44.594152+0000","last_active":"2024-05-08T18:32:46.918959+0000","last_peered":"2024-05-08T18:32:46.918959+0000","last_clean":"2024-05-08T18:32:46.918959+0000","last_became_active":"2024-05-08T18:29:44.593398+0000","last_became_peered":"2024-05-08T18:29:44.593398+0000","last_unstale":"2024-05-08T18:32:46.918959+0000","last_undegraded":"2024-05-08T18:32:46.918959+0000","last_fullsized":"2024-05-08T18:32:46.918959+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:11.825480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"85'12","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.059653+0000","last_change":"2024-05-08T18:29:46.602137+0000","last_active":"2024-05-08T18:32:46.059653+0000","last_peered":"2024-05-08T18:32:46.059653+0000","last_clean":"2024-05-08T18:32:46.059653+0000","last_became_active":"2024-05-08T18:29:46.601402+0000","last_became_peered":"2024-05-08T18:29:46.601402+0000","last_unstale":"2024-05-08T18:32:46.059653+0000","last_undegraded":"2024-05-08T18:32:46.059653+0000","last_fullsized":"2024-05-08T18:32:46.059653+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:23.940519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":22,"num_read_kb":17,"num_write":24,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"97'101","reported_seq":327,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.849636+0000","last_change":"2024-05-08T18:29:48.635696+0000","last_active":"2024-05-08T18:32:46.849636+0000","last_peered":"2024-05-08T18:32:46.849636+0000","last_clean":"2024-05-08T18:32:46.849636+0000","last_became_active":"2024-05-08T18:29:48.634859+0000","last_became_peered":"2024-05-08T18:29:48.634859+0000","last_unstale":"2024-05-08T18:32:46.849636+0000","last_undegraded":"2024-05-08T18:32:46.849636+0000","last_fullsized":"2024-05-08T18:32:46.849636+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:35:55.322495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":174,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.935107+0000","last_change":"2024-05-08T18:29:50.679757+0000","last_active":"2024-05-08T18:32:46.935107+0000","last_peered":"2024-05-08T18:32:46.935107+0000","last_clean":"2024-05-08T18:32:46.935107+0000","last_became_active":"2024-05-08T18:29:50.679011+0000","last_became_peered":"2024-05-08T18:29:50.679011+0000","last_unstale":"2024-05-08T18:32:46.935107+0000","last_undegraded":"2024-05-08T18:32:46.935107+0000","last_fullsized":"2024-05-08T18:32:46.935107+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:34:14.488295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"84'8","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.058657+0000","last_change":"2024-05-08T18:29:42.560354+0000","last_active":"2024-05-08T18:32:46.058657+0000","last_peered":"2024-05-08T18:32:46.058657+0000","last_clean":"2024-05-08T18:32:46.058657+0000","last_became_active":"2024-05-08T18:29:42.559647+0000","last_became_peered":"2024-05-08T18:29:42.559647+0000","last_unstale":"2024-05-08T18:32:46.058657+0000","last_undegraded":"2024-05-08T18:32:46.058657+0000","last_fullsized":"2024-05-08T18:32:46.058657+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:18:10.803989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"93'10","reported_seq":204,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-08T18:32:45.242880+0000","last_change":"2024-05-08T18:29:40.557683+0000","last_active":"2024-05-08T18:32:45.242880+0000","last_peered":"2024-05-08T18:32:45.242880+0000","last_clean":"2024-05-08T18:32:45.242880+0000","last_became_active":"2024-05-08T18:29:40.556254+0000","last_became_peered":"2024-05-08T18:29:40.556254+0000","last_unstale":"2024-05-08T18:32:45.242880+0000","last_undegraded":"2024-05-08T18:32:45.242880+0000","last_fullsized":"2024-05-08T18:32:45.242880+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:51:43.135322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.936035+0000","last_change":"2024-05-08T18:29:44.594068+0000","last_active":"2024-05-08T18:32:46.936035+0000","last_peered":"2024-05-08T18:32:46.936035+0000","last_clean":"2024-05-08T18:32:46.936035+0000","last_became_active":"2024-05-08T18:29:44.593322+0000","last_became_peered":"2024-05-08T18:29:44.593322+0000","last_unstale":"2024-05-08T18:32:46.936035+0000","last_undegraded":"2024-05-08T18:32:46.936035+0000","last_fullsized":"2024-05-08T18:32:46.936035+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:19.731003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"97'22","reported_seq":214,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-08T18:32:45.240271+0000","last_change":"2024-05-08T18:29:46.604700+0000","last_active":"2024-05-08T18:32:45.240271+0000","last_peered":"2024-05-08T18:32:45.240271+0000","last_clean":"2024-05-08T18:32:45.240271+0000","last_became_active":"2024-05-08T18:29:46.603885+0000","last_became_peered":"2024-05-08T18:29:46.603885+0000","last_unstale":"2024-05-08T18:32:45.240271+0000","last_undegraded":"2024-05-08T18:32:45.240271+0000","last_fullsized":"2024-05-08T18:32:45.240271+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:22:36.338527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9698,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":18,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.861740+0000","last_change":"2024-05-08T18:29:48.640814+0000","last_active":"2024-05-08T18:32:46.861740+0000","last_peered":"2024-05-08T18:32:46.861740+0000","last_clean":"2024-05-08T18:32:46.861740+0000","last_became_active":"2024-05-08T18:29:48.640046+0000","last_became_peered":"2024-05-08T18:29:48.640046+0000","last_unstale":"2024-05-08T18:32:46.861740+0000","last_undegraded":"2024-05-08T18:32:46.861740+0000","last_fullsized":"2024-05-08T18:32:46.861740+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:53:21.219706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"83'8","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.938436+0000","last_change":"2024-05-08T18:29:50.692688+0000","last_active":"2024-05-08T18:32:46.938436+0000","last_peered":"2024-05-08T18:32:46.938436+0000","last_clean":"2024-05-08T18:32:46.938436+0000","last_became_active":"2024-05-08T18:29:50.692123+0000","last_became_peered":"2024-05-08T18:29:50.692123+0000","last_unstale":"2024-05-08T18:32:46.938436+0000","last_undegraded":"2024-05-08T18:32:46.938436+0000","last_fullsized":"2024-05-08T18:32:46.938436+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:38.318890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"97'2","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.058878+0000","last_change":"2024-05-08T18:29:42.558336+0000","last_active":"2024-05-08T18:32:46.058878+0000","last_peered":"2024-05-08T18:32:46.058878+0000","last_clean":"2024-05-08T18:32:46.058878+0000","last_became_active":"2024-05-08T18:29:42.557570+0000","last_became_peered":"2024-05-08T18:29:42.557570+0000","last_unstale":"2024-05-08T18:32:46.058878+0000","last_undegraded":"2024-05-08T18:32:46.058878+0000","last_fullsized":"2024-05-08T18:32:46.058878+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:54:16.539832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"84'2","reported_seq":196,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-08T18:32:45.243493+0000","last_change":"2024-05-08T18:29:40.537090+0000","last_active":"2024-05-08T18:32:45.243493+0000","last_peered":"2024-05-08T18:32:45.243493+0000","last_clean":"2024-05-08T18:32:45.243493+0000","last_became_active":"2024-05-08T18:29:40.536188+0000","last_became_peered":"2024-05-08T18:29:40.536188+0000","last_unstale":"2024-05-08T18:32:45.243493+0000","last_undegraded":"2024-05-08T18:32:45.243493+0000","last_fullsized":"2024-05-08T18:32:45.243493+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:22:48.880581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":186,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-08T18:32:45.241675+0000","last_change":"2024-05-08T18:29:44.578901+0000","last_active":"2024-05-08T18:32:45.241675+0000","last_peered":"2024-05-08T18:32:45.241675+0000","last_clean":"2024-05-08T18:32:45.241675+0000","last_became_active":"2024-05-08T18:29:44.578171+0000","last_became_peered":"2024-05-08T18:29:44.578171+0000","last_unstale":"2024-05-08T18:32:45.241675+0000","last_undegraded":"2024-05-08T18:32:45.241675+0000","last_fullsized":"2024-05-08T18:32:45.241675+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:19.731003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"97'17","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.861874+0000","last_change":"2024-05-08T18:29:46.604539+0000","last_active":"2024-05-08T18:32:46.861874+0000","last_peered":"2024-05-08T18:32:46.861874+0000","last_clean":"2024-05-08T18:32:46.861874+0000","last_became_active":"2024-05-08T18:29:46.603728+0000","last_became_peered":"2024-05-08T18:29:46.603728+0000","last_unstale":"2024-05-08T18:32:46.861874+0000","last_undegraded":"2024-05-08T18:32:46.861874+0000","last_fullsized":"2024-05-08T18:32:46.861874+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:12:41.226788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.848661+0000","last_change":"2024-05-08T18:29:48.635813+0000","last_active":"2024-05-08T18:32:46.848661+0000","last_peered":"2024-05-08T18:32:46.848661+0000","last_clean":"2024-05-08T18:32:46.848661+0000","last_became_active":"2024-05-08T18:29:48.634664+0000","last_became_peered":"2024-05-08T18:29:48.634664+0000","last_unstale":"2024-05-08T18:32:46.848661+0000","last_undegraded":"2024-05-08T18:32:46.848661+0000","last_fullsized":"2024-05-08T18:32:46.848661+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:27:23.427365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"97'7","reported_seq":187,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.066075+0000","last_change":"2024-05-08T18:29:50.687517+0000","last_active":"2024-05-08T18:32:46.066075+0000","last_peered":"2024-05-08T18:32:46.066075+0000","last_clean":"2024-05-08T18:32:46.066075+0000","last_became_active":"2024-05-08T18:29:50.686662+0000","last_became_peered":"2024-05-08T18:29:50.686662+0000","last_unstale":"2024-05-08T18:32:46.066075+0000","last_undegraded":"2024-05-08T18:32:46.066075+0000","last_fullsized":"2024-05-08T18:32:46.066075+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:58:00.455559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"97'4","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.062709+0000","last_change":"2024-05-08T18:29:42.558848+0000","last_active":"2024-05-08T18:32:46.062709+0000","last_peered":"2024-05-08T18:32:46.062709+0000","last_clean":"2024-05-08T18:32:46.062709+0000","last_became_active":"2024-05-08T18:29:42.558390+0000","last_became_peered":"2024-05-08T18:29:42.558390+0000","last_unstale":"2024-05-08T18:32:46.062709+0000","last_undegraded":"2024-05-08T18:32:46.062709+0000","last_fullsized":"2024-05-08T18:32:46.062709+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:55:30.468069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"93'8","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.066372+0000","last_change":"2024-05-08T18:29:40.567772+0000","last_active":"2024-05-08T18:32:46.066372+0000","last_peered":"2024-05-08T18:32:46.066372+0000","last_clean":"2024-05-08T18:32:46.066372+0000","last_became_active":"2024-05-08T18:29:40.567482+0000","last_became_peered":"2024-05-08T18:29:40.567482+0000","last_unstale":"2024-05-08T18:32:46.066372+0000","last_undegraded":"2024-05-08T18:32:46.066372+0000","last_fullsized":"2024-05-08T18:32:46.066372+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:36:37.796095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":5,"num_write":18,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.057189+0000","last_change":"2024-05-08T18:29:44.596876+0000","last_active":"2024-05-08T18:32:46.057189+0000","last_peered":"2024-05-08T18:32:46.057189+0000","last_clean":"2024-05-08T18:32:46.057189+0000","last_became_active":"2024-05-08T18:29:44.595712+0000","last_became_peered":"2024-05-08T18:29:44.595712+0000","last_unstale":"2024-05-08T18:32:46.057189+0000","last_undegraded":"2024-05-08T18:32:46.057189+0000","last_fullsized":"2024-05-08T18:32:46.057189+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:35:51.288126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"97'11","reported_seq":201,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.064975+0000","last_change":"2024-05-08T18:29:46.598637+0000","last_active":"2024-05-08T18:32:46.064975+0000","last_peered":"2024-05-08T18:32:46.064975+0000","last_clean":"2024-05-08T18:32:46.064975+0000","last_became_active":"2024-05-08T18:29:46.597394+0000","last_became_peered":"2024-05-08T18:29:46.597394+0000","last_unstale":"2024-05-08T18:32:46.064975+0000","last_undegraded":"2024-05-08T18:32:46.064975+0000","last_fullsized":"2024-05-08T18:32:46.064975+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:52:22.540814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.057643+0000","last_change":"2024-05-08T18:29:48.642251+0000","last_active":"2024-05-08T18:32:46.057643+0000","last_peered":"2024-05-08T18:32:46.057643+0000","last_clean":"2024-05-08T18:32:46.057643+0000","last_became_active":"2024-05-08T18:29:48.641666+0000","last_became_peered":"2024-05-08T18:29:48.641666+0000","last_unstale":"2024-05-08T18:32:46.057643+0000","last_undegraded":"2024-05-08T18:32:46.057643+0000","last_fullsized":"2024-05-08T18:32:46.057643+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:13:50.865474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"80'2","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.937644+0000","last_change":"2024-05-08T18:29:50.685668+0000","last_active":"2024-05-08T18:32:46.937644+0000","last_peered":"2024-05-08T18:32:46.937644+0000","last_clean":"2024-05-08T18:32:46.937644+0000","last_became_active":"2024-05-08T18:29:50.684958+0000","last_became_peered":"2024-05-08T18:29:50.684958+0000","last_unstale":"2024-05-08T18:32:46.937644+0000","last_undegraded":"2024-05-08T18:32:46.937644+0000","last_fullsized":"2024-05-08T18:32:46.937644+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:55:01.894779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.057760+0000","last_change":"2024-05-08T18:29:42.562063+0000","last_active":"2024-05-08T18:32:46.057760+0000","last_peered":"2024-05-08T18:32:46.057760+0000","last_clean":"2024-05-08T18:32:46.057760+0000","last_became_active":"2024-05-08T18:29:42.558871+0000","last_became_peered":"2024-05-08T18:29:42.558871+0000","last_unstale":"2024-05-08T18:32:46.057760+0000","last_undegraded":"2024-05-08T18:32:46.057760+0000","last_fullsized":"2024-05-08T18:32:46.057760+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:59.243324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"93'13","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863884+0000","last_change":"2024-05-08T18:29:40.541070+0000","last_active":"2024-05-08T18:32:46.863884+0000","last_peered":"2024-05-08T18:32:46.863884+0000","last_clean":"2024-05-08T18:32:46.863884+0000","last_became_active":"2024-05-08T18:29:40.540767+0000","last_became_peered":"2024-05-08T18:29:40.540767+0000","last_unstale":"2024-05-08T18:32:46.863884+0000","last_undegraded":"2024-05-08T18:32:46.863884+0000","last_fullsized":"2024-05-08T18:32:46.863884+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:09:39.835826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"26'1","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.917294+0000","last_change":"2024-05-08T18:29:44.592737+0000","last_active":"2024-05-08T18:32:46.917294+0000","last_peered":"2024-05-08T18:32:46.917294+0000","last_clean":"2024-05-08T18:32:46.917294+0000","last_became_active":"2024-05-08T18:29:44.592243+0000","last_became_peered":"2024-05-08T18:29:44.592243+0000","last_unstale":"2024-05-08T18:32:46.917294+0000","last_undegraded":"2024-05-08T18:32:46.917294+0000","last_fullsized":"2024-05-08T18:32:46.917294+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:59.744050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"97'16","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.058346+0000","last_change":"2024-05-08T18:29:46.610835+0000","last_active":"2024-05-08T18:32:46.058346+0000","last_peered":"2024-05-08T18:32:46.058346+0000","last_clean":"2024-05-08T18:32:46.058346+0000","last_became_active":"2024-05-08T18:29:46.609903+0000","last_became_peered":"2024-05-08T18:29:46.609903+0000","last_unstale":"2024-05-08T18:32:46.058346+0000","last_undegraded":"2024-05-08T18:32:46.058346+0000","last_fullsized":"2024-05-08T18:32:46.058346+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:37:35.850414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.862608+0000","last_change":"2024-05-08T18:29:48.629822+0000","last_active":"2024-05-08T18:32:46.862608+0000","last_peered":"2024-05-08T18:32:46.862608+0000","last_clean":"2024-05-08T18:32:46.862608+0000","last_became_active":"2024-05-08T18:29:48.629204+0000","last_became_peered":"2024-05-08T18:29:48.629204+0000","last_unstale":"2024-05-08T18:32:46.862608+0000","last_undegraded":"2024-05-08T18:32:46.862608+0000","last_fullsized":"2024-05-08T18:32:46.862608+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:04.571608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"84'6","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.060640+0000","last_change":"2024-05-08T18:29:50.668101+0000","last_active":"2024-05-08T18:32:46.060640+0000","last_peered":"2024-05-08T18:32:46.060640+0000","last_clean":"2024-05-08T18:32:46.060640+0000","last_became_active":"2024-05-08T18:29:50.667357+0000","last_became_peered":"2024-05-08T18:29:50.667357+0000","last_unstale":"2024-05-08T18:32:46.060640+0000","last_undegraded":"2024-05-08T18:32:46.060640+0000","last_fullsized":"2024-05-08T18:32:46.060640+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:55:01.894779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"97'4","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.919471+0000","last_change":"2024-05-08T18:29:42.581366+0000","last_active":"2024-05-08T18:32:46.919471+0000","last_peered":"2024-05-08T18:32:46.919471+0000","last_clean":"2024-05-08T18:32:46.919471+0000","last_became_active":"2024-05-08T18:29:42.580988+0000","last_became_peered":"2024-05-08T18:29:42.580988+0000","last_unstale":"2024-05-08T18:32:46.919471+0000","last_undegraded":"2024-05-08T18:32:46.919471+0000","last_fullsized":"2024-05-08T18:32:46.919471+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:42.005809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"84'9","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.848329+0000","last_change":"2024-05-08T18:29:40.562025+0000","last_active":"2024-05-08T18:32:46.848329+0000","last_peered":"2024-05-08T18:32:46.848329+0000","last_clean":"2024-05-08T18:32:46.848329+0000","last_became_active":"2024-05-08T18:29:40.561277+0000","last_became_peered":"2024-05-08T18:29:40.561277+0000","last_unstale":"2024-05-08T18:32:46.848329+0000","last_undegraded":"2024-05-08T18:32:46.848329+0000","last_fullsized":"2024-05-08T18:32:46.848329+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:59:25.840149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":19,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.916111+0000","last_change":"2024-05-08T18:29:42.573832+0000","last_active":"2024-05-08T18:32:46.916111+0000","last_peered":"2024-05-08T18:32:46.916111+0000","last_clean":"2024-05-08T18:32:46.916111+0000","last_became_active":"2024-05-08T18:29:42.573502+0000","last_became_peered":"2024-05-08T18:29:42.573502+0000","last_unstale":"2024-05-08T18:32:46.916111+0000","last_undegraded":"2024-05-08T18:32:46.916111+0000","last_fullsized":"2024-05-08T18:32:46.916111+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:35.037465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"93'8","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.060494+0000","last_change":"2024-05-08T18:29:40.533094+0000","last_active":"2024-05-08T18:32:46.060494+0000","last_peered":"2024-05-08T18:32:46.060494+0000","last_clean":"2024-05-08T18:32:46.060494+0000","last_became_active":"2024-05-08T18:29:40.532246+0000","last_became_peered":"2024-05-08T18:29:40.532246+0000","last_unstale":"2024-05-08T18:32:46.060494+0000","last_undegraded":"2024-05-08T18:32:46.060494+0000","last_fullsized":"2024-05-08T18:32:46.060494+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:37:08.242362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":190,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-08T18:32:45.242871+0000","last_change":"2024-05-08T18:29:42.565298+0000","last_active":"2024-05-08T18:32:45.242871+0000","last_peered":"2024-05-08T18:32:45.242871+0000","last_clean":"2024-05-08T18:32:45.242871+0000","last_became_active":"2024-05-08T18:29:42.564542+0000","last_became_peered":"2024-05-08T18:29:42.564542+0000","last_unstale":"2024-05-08T18:32:45.242871+0000","last_undegraded":"2024-05-08T18:32:45.242871+0000","last_fullsized":"2024-05-08T18:32:45.242871+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:57.706167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"93'14","reported_seq":208,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-08T18:32:45.241385+0000","last_change":"2024-05-08T18:29:40.556958+0000","last_active":"2024-05-08T18:32:45.241385+0000","last_peered":"2024-05-08T18:32:45.241385+0000","last_clean":"2024-05-08T18:32:45.241385+0000","last_became_active":"2024-05-08T18:29:40.556091+0000","last_became_peered":"2024-05-08T18:29:40.556091+0000","last_unstale":"2024-05-08T18:32:45.241385+0000","last_undegraded":"2024-05-08T18:32:45.241385+0000","last_fullsized":"2024-05-08T18:32:45.241385+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:39.986094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"97'6","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.918325+0000","last_change":"2024-05-08T18:29:42.574619+0000","last_active":"2024-05-08T18:32:46.918325+0000","last_peered":"2024-05-08T18:32:46.918325+0000","last_clean":"2024-05-08T18:32:46.918325+0000","last_became_active":"2024-05-08T18:29:42.573178+0000","last_became_peered":"2024-05-08T18:29:42.573178+0000","last_unstale":"2024-05-08T18:32:46.918325+0000","last_undegraded":"2024-05-08T18:32:46.918325+0000","last_fullsized":"2024-05-08T18:32:46.918325+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:33.139089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"92'5","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.862863+0000","last_change":"2024-05-08T18:29:40.544338+0000","last_active":"2024-05-08T18:32:46.862863+0000","last_peered":"2024-05-08T18:32:46.862863+0000","last_clean":"2024-05-08T18:32:46.862863+0000","last_became_active":"2024-05-08T18:29:40.544107+0000","last_became_peered":"2024-05-08T18:29:40.544107+0000","last_unstale":"2024-05-08T18:32:46.862863+0000","last_undegraded":"2024-05-08T18:32:46.862863+0000","last_fullsized":"2024-05-08T18:32:46.862863+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:54.200883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"84'2","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.064285+0000","last_change":"2024-05-08T18:29:42.576979+0000","last_active":"2024-05-08T18:32:46.064285+0000","last_peered":"2024-05-08T18:32:46.064285+0000","last_clean":"2024-05-08T18:32:46.064285+0000","last_became_active":"2024-05-08T18:29:42.576395+0000","last_became_peered":"2024-05-08T18:29:42.576395+0000","last_unstale":"2024-05-08T18:32:46.064285+0000","last_undegraded":"2024-05-08T18:32:46.064285+0000","last_fullsized":"2024-05-08T18:32:46.064285+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:53:03.097704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"93'5","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.066660+0000","last_change":"2024-05-08T18:29:40.558142+0000","last_active":"2024-05-08T18:32:46.066660+0000","last_peered":"2024-05-08T18:32:46.066660+0000","last_clean":"2024-05-08T18:32:46.066660+0000","last_became_active":"2024-05-08T18:29:40.557874+0000","last_became_peered":"2024-05-08T18:29:40.557874+0000","last_unstale":"2024-05-08T18:32:46.066660+0000","last_undegraded":"2024-05-08T18:32:46.066660+0000","last_fullsized":"2024-05-08T18:32:46.066660+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:54.200883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"97'2","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.059136+0000","last_change":"2024-05-08T18:29:42.558324+0000","last_active":"2024-05-08T18:32:46.059136+0000","last_peered":"2024-05-08T18:32:46.059136+0000","last_clean":"2024-05-08T18:32:46.059136+0000","last_became_active":"2024-05-08T18:29:42.556774+0000","last_became_peered":"2024-05-08T18:29:42.556774+0000","last_unstale":"2024-05-08T18:32:46.059136+0000","last_undegraded":"2024-05-08T18:32:46.059136+0000","last_fullsized":"2024-05-08T18:32:46.059136+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:02:26.311100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"93'11","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.919113+0000","last_change":"2024-05-08T18:30:20.858467+0000","last_active":"2024-05-08T18:32:46.919113+0000","last_peered":"2024-05-08T18:32:46.919113+0000","last_clean":"2024-05-08T18:32:46.919113+0000","last_became_active":"2024-05-08T18:30:20.858016+0000","last_became_peered":"2024-05-08T18:30:20.858016+0000","last_unstale":"2024-05-08T18:32:46.919113+0000","last_undegraded":"2024-05-08T18:32:46.919113+0000","last_fullsized":"2024-05-08T18:32:46.919113+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:10:28.824915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"84'4","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.062025+0000","last_change":"2024-05-08T18:29:42.562772+0000","last_active":"2024-05-08T18:32:46.062025+0000","last_peered":"2024-05-08T18:32:46.062025+0000","last_clean":"2024-05-08T18:32:46.062025+0000","last_became_active":"2024-05-08T18:29:42.562420+0000","last_became_peered":"2024-05-08T18:29:42.562420+0000","last_unstale":"2024-05-08T18:32:46.062025+0000","last_undegraded":"2024-05-08T18:32:46.062025+0000","last_fullsized":"2024-05-08T18:32:46.062025+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:30:29.452640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"93'5","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.850198+0000","last_change":"2024-05-08T18:29:40.562024+0000","last_active":"2024-05-08T18:32:46.850198+0000","last_peered":"2024-05-08T18:32:46.850198+0000","last_clean":"2024-05-08T18:32:46.850198+0000","last_became_active":"2024-05-08T18:29:40.561326+0000","last_became_peered":"2024-05-08T18:29:40.561326+0000","last_unstale":"2024-05-08T18:32:46.850198+0000","last_undegraded":"2024-05-08T18:32:46.850198+0000","last_fullsized":"2024-05-08T18:32:46.850198+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:21:38.354933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"97'4","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.847229+0000","last_change":"2024-05-08T18:29:42.561419+0000","last_active":"2024-05-08T18:32:46.847229+0000","last_peered":"2024-05-08T18:32:46.847229+0000","last_clean":"2024-05-08T18:32:46.847229+0000","last_became_active":"2024-05-08T18:29:42.560520+0000","last_became_peered":"2024-05-08T18:29:42.560520+0000","last_unstale":"2024-05-08T18:32:46.847229+0000","last_undegraded":"2024-05-08T18:32:46.847229+0000","last_fullsized":"2024-05-08T18:32:46.847229+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:07.949520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"93'11","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.067225+0000","last_change":"2024-05-08T18:29:40.554884+0000","last_active":"2024-05-08T18:32:46.067225+0000","last_peered":"2024-05-08T18:32:46.067225+0000","last_clean":"2024-05-08T18:32:46.067225+0000","last_became_active":"2024-05-08T18:29:40.554603+0000","last_became_peered":"2024-05-08T18:29:40.554603+0000","last_unstale":"2024-05-08T18:32:46.067225+0000","last_undegraded":"2024-05-08T18:32:46.067225+0000","last_fullsized":"2024-05-08T18:32:46.067225+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:09:39.835826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"84'4","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.861066+0000","last_change":"2024-05-08T18:29:42.574689+0000","last_active":"2024-05-08T18:32:46.861066+0000","last_peered":"2024-05-08T18:32:46.861066+0000","last_clean":"2024-05-08T18:32:46.861066+0000","last_became_active":"2024-05-08T18:29:42.573947+0000","last_became_peered":"2024-05-08T18:29:42.573947+0000","last_unstale":"2024-05-08T18:32:46.861066+0000","last_undegraded":"2024-05-08T18:32:46.861066+0000","last_fullsized":"2024-05-08T18:32:46.861066+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:57:14.869860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"93'10","reported_seq":204,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-08T18:32:45.239870+0000","last_change":"2024-05-08T18:29:40.554005+0000","last_active":"2024-05-08T18:32:45.239870+0000","last_peered":"2024-05-08T18:32:45.239870+0000","last_clean":"2024-05-08T18:32:45.239870+0000","last_became_active":"2024-05-08T18:29:40.553356+0000","last_became_peered":"2024-05-08T18:29:40.553356+0000","last_unstale":"2024-05-08T18:32:45.239870+0000","last_undegraded":"2024-05-08T18:32:45.239870+0000","last_fullsized":"2024-05-08T18:32:45.239870+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:08:13.006752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"84'2","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.059942+0000","last_change":"2024-05-08T18:29:42.566487+0000","last_active":"2024-05-08T18:32:46.059942+0000","last_peered":"2024-05-08T18:32:46.059942+0000","last_clean":"2024-05-08T18:32:46.059942+0000","last_became_active":"2024-05-08T18:29:42.565760+0000","last_became_peered":"2024-05-08T18:29:42.565760+0000","last_unstale":"2024-05-08T18:32:46.059942+0000","last_undegraded":"2024-05-08T18:32:46.059942+0000","last_fullsized":"2024-05-08T18:32:46.059942+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:57.706167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"93'8","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.062985+0000","last_change":"2024-05-08T18:29:40.552543+0000","last_active":"2024-05-08T18:32:46.062985+0000","last_peered":"2024-05-08T18:32:46.062985+0000","last_clean":"2024-05-08T18:32:46.062985+0000","last_became_active":"2024-05-08T18:29:40.552307+0000","last_became_peered":"2024-05-08T18:29:40.552307+0000","last_unstale":"2024-05-08T18:32:46.062985+0000","last_undegraded":"2024-05-08T18:32:46.062985+0000","last_fullsized":"2024-05-08T18:32:46.062985+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:48.294532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"84'4","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.063759+0000","last_change":"2024-05-08T18:29:42.561658+0000","last_active":"2024-05-08T18:32:46.063759+0000","last_peered":"2024-05-08T18:32:46.063759+0000","last_clean":"2024-05-08T18:32:46.063759+0000","last_became_active":"2024-05-08T18:29:42.561171+0000","last_became_peered":"2024-05-08T18:29:42.561171+0000","last_unstale":"2024-05-08T18:32:46.063759+0000","last_undegraded":"2024-05-08T18:32:46.063759+0000","last_fullsized":"2024-05-08T18:32:46.063759+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:15.966061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"93'10","reported_seq":204,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-08T18:32:45.241123+0000","last_change":"2024-05-08T18:29:40.543041+0000","last_active":"2024-05-08T18:32:45.241123+0000","last_peered":"2024-05-08T18:32:45.241123+0000","last_clean":"2024-05-08T18:32:45.241123+0000","last_became_active":"2024-05-08T18:29:40.542398+0000","last_became_peered":"2024-05-08T18:29:40.542398+0000","last_unstale":"2024-05-08T18:32:45.241123+0000","last_undegraded":"2024-05-08T18:32:45.241123+0000","last_fullsized":"2024-05-08T18:32:45.241123+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:33.017750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"97'6","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.060280+0000","last_change":"2024-05-08T18:29:42.579690+0000","last_active":"2024-05-08T18:32:46.060280+0000","last_peered":"2024-05-08T18:32:46.060280+0000","last_clean":"2024-05-08T18:32:46.060280+0000","last_became_active":"2024-05-08T18:29:42.578981+0000","last_became_peered":"2024-05-08T18:29:42.578981+0000","last_unstale":"2024-05-08T18:32:46.060280+0000","last_undegraded":"2024-05-08T18:32:46.060280+0000","last_fullsized":"2024-05-08T18:32:46.060280+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:36:03.084561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"93'11","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.862989+0000","last_change":"2024-05-08T18:29:40.548499+0000","last_active":"2024-05-08T18:32:46.862989+0000","last_peered":"2024-05-08T18:32:46.862989+0000","last_clean":"2024-05-08T18:32:46.862989+0000","last_became_active":"2024-05-08T18:29:40.548177+0000","last_became_peered":"2024-05-08T18:29:40.548177+0000","last_unstale":"2024-05-08T18:32:46.862989+0000","last_undegraded":"2024-05-08T18:32:46.862989+0000","last_fullsized":"2024-05-08T18:32:46.862989+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:27:41.414153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"80'2","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.934939+0000","last_change":"2024-05-08T18:29:42.575892+0000","last_active":"2024-05-08T18:32:46.934939+0000","last_peered":"2024-05-08T18:32:46.934939+0000","last_clean":"2024-05-08T18:32:46.934939+0000","last_became_active":"2024-05-08T18:29:42.573384+0000","last_became_peered":"2024-05-08T18:29:42.573384+0000","last_unstale":"2024-05-08T18:32:46.934939+0000","last_undegraded":"2024-05-08T18:32:46.934939+0000","last_fullsized":"2024-05-08T18:32:46.934939+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:55.055481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"93'9","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.849826+0000","last_change":"2024-05-08T18:29:40.565068+0000","last_active":"2024-05-08T18:32:46.849826+0000","last_peered":"2024-05-08T18:32:46.849826+0000","last_clean":"2024-05-08T18:32:46.849826+0000","last_became_active":"2024-05-08T18:29:40.563231+0000","last_became_peered":"2024-05-08T18:29:40.563231+0000","last_unstale":"2024-05-08T18:32:46.849826+0000","last_undegraded":"2024-05-08T18:32:46.849826+0000","last_fullsized":"2024-05-08T18:32:46.849826+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:17:47.828990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.862573+0000","last_change":"2024-05-08T18:29:42.564338+0000","last_active":"2024-05-08T18:32:46.862573+0000","last_peered":"2024-05-08T18:32:46.862573+0000","last_clean":"2024-05-08T18:32:46.862573+0000","last_became_active":"2024-05-08T18:29:42.563822+0000","last_became_peered":"2024-05-08T18:29:42.563822+0000","last_unstale":"2024-05-08T18:32:46.862573+0000","last_undegraded":"2024-05-08T18:32:46.862573+0000","last_fullsized":"2024-05-08T18:32:46.862573+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:23.397435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"93'14","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.938359+0000","last_change":"2024-05-08T18:29:40.573333+0000","last_active":"2024-05-08T18:32:46.938359+0000","last_peered":"2024-05-08T18:32:46.938359+0000","last_clean":"2024-05-08T18:32:46.938359+0000","last_became_active":"2024-05-08T18:29:40.571195+0000","last_became_peered":"2024-05-08T18:29:40.571195+0000","last_unstale":"2024-05-08T18:32:46.938359+0000","last_undegraded":"2024-05-08T18:32:46.938359+0000","last_fullsized":"2024-05-08T18:32:46.938359+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:33.017750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.061746+0000","last_change":"2024-05-08T18:29:42.563085+0000","last_active":"2024-05-08T18:32:46.061746+0000","last_peered":"2024-05-08T18:32:46.061746+0000","last_clean":"2024-05-08T18:32:46.061746+0000","last_became_active":"2024-05-08T18:29:42.560419+0000","last_became_peered":"2024-05-08T18:29:42.560419+0000","last_unstale":"2024-05-08T18:32:46.061746+0000","last_undegraded":"2024-05-08T18:32:46.061746+0000","last_fullsized":"2024-05-08T18:32:46.061746+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:20.397730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"93'10","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.064712+0000","last_change":"2024-05-08T18:29:40.568890+0000","last_active":"2024-05-08T18:32:46.064712+0000","last_peered":"2024-05-08T18:32:46.064712+0000","last_clean":"2024-05-08T18:32:46.064712+0000","last_became_active":"2024-05-08T18:29:40.568584+0000","last_became_peered":"2024-05-08T18:29:40.568584+0000","last_unstale":"2024-05-08T18:32:46.064712+0000","last_undegraded":"2024-05-08T18:32:46.064712+0000","last_fullsized":"2024-05-08T18:32:46.064712+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:25:01.595224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"83'6","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.934923+0000","last_change":"2024-05-08T18:29:42.574277+0000","last_active":"2024-05-08T18:32:46.934923+0000","last_peered":"2024-05-08T18:32:46.934923+0000","last_clean":"2024-05-08T18:32:46.934923+0000","last_became_active":"2024-05-08T18:29:42.573563+0000","last_became_peered":"2024-05-08T18:29:42.573563+0000","last_unstale":"2024-05-08T18:32:46.934923+0000","last_undegraded":"2024-05-08T18:32:46.934923+0000","last_fullsized":"2024-05-08T18:32:46.934923+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:57.706167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"93'8","reported_seq":202,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-08T18:32:45.243891+0000","last_change":"2024-05-08T18:29:40.562058+0000","last_active":"2024-05-08T18:32:45.243891+0000","last_peered":"2024-05-08T18:32:45.243891+0000","last_clean":"2024-05-08T18:32:45.243891+0000","last_became_active":"2024-05-08T18:29:40.561360+0000","last_became_peered":"2024-05-08T18:29:40.561360+0000","last_unstale":"2024-05-08T18:32:45.243891+0000","last_undegraded":"2024-05-08T18:32:45.243891+0000","last_fullsized":"2024-05-08T18:32:45.243891+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:05.929806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"93'12","reported_seq":207,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-08T18:32:45.239599+0000","last_change":"2024-05-08T18:29:40.538728+0000","last_active":"2024-05-08T18:32:45.239599+0000","last_peered":"2024-05-08T18:32:45.239599+0000","last_clean":"2024-05-08T18:32:45.239599+0000","last_became_active":"2024-05-08T18:29:40.537925+0000","last_became_peered":"2024-05-08T18:29:40.537925+0000","last_unstale":"2024-05-08T18:32:45.239599+0000","last_undegraded":"2024-05-08T18:32:45.239599+0000","last_fullsized":"2024-05-08T18:32:45.239599+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:28.426657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":3,"num_read_kb":4,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"97'8","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.861235+0000","last_change":"2024-05-08T18:29:42.574941+0000","last_active":"2024-05-08T18:32:46.861235+0000","last_peered":"2024-05-08T18:32:46.861235+0000","last_clean":"2024-05-08T18:32:46.861235+0000","last_became_active":"2024-05-08T18:29:42.574351+0000","last_became_peered":"2024-05-08T18:29:42.574351+0000","last_unstale":"2024-05-08T18:32:46.861235+0000","last_undegraded":"2024-05-08T18:32:46.861235+0000","last_fullsized":"2024-05-08T18:32:46.861235+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:21.935293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"93'10","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.917647+0000","last_change":"2024-05-08T18:29:40.543714+0000","last_active":"2024-05-08T18:32:46.917647+0000","last_peered":"2024-05-08T18:32:46.917647+0000","last_clean":"2024-05-08T18:32:46.917647+0000","last_became_active":"2024-05-08T18:29:40.542965+0000","last_became_peered":"2024-05-08T18:29:40.542965+0000","last_unstale":"2024-05-08T18:32:46.917647+0000","last_undegraded":"2024-05-08T18:32:46.917647+0000","last_fullsized":"2024-05-08T18:32:46.917647+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:12:59.146887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":190,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-05-08T18:32:45.243562+0000","last_change":"2024-05-08T18:29:42.560007+0000","last_active":"2024-05-08T18:32:45.243562+0000","last_peered":"2024-05-08T18:32:45.243562+0000","last_clean":"2024-05-08T18:32:45.243562+0000","last_became_active":"2024-05-08T18:29:42.559028+0000","last_became_peered":"2024-05-08T18:29:42.559028+0000","last_unstale":"2024-05-08T18:32:45.243562+0000","last_undegraded":"2024-05-08T18:32:45.243562+0000","last_fullsized":"2024-05-08T18:32:45.243562+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:36:03.084561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":247,"num_read_kb":238,"num_write":231,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":808,"ondisk_log_size":808,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":156300,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":814,"num_read_kb":576,"num_write":459,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":272740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":666,"ondisk_log_size":666,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":334,"num_read_kb":334,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":579,"num_read_kb":555,"num_write":234,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":222,"ondisk_log_size":222,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":2397044736,"num_objects":572,"num_object_clones":0,"num_object_copies":1144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":572,"num_whiteouts":0,"num_read":21,"num_read_kb":23,"num_write":644,"num_write_kb":2365440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4794089472,"data_stored":4794089472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":584,"ondisk_log_size":584,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509486,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":686464,"kb_used_data":655276,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93685376,"statfs":{"total":96636764160,"available":95933825024,"internally_reserved":0,"allocated":671002624,"data_stored":670383066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509486,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":423716,"kb_used_data":392528,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93948124,"statfs":{"total":96636764160,"available":96202878976,"internally_reserved":0,"allocated":401948672,"data_stored":401356582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509484,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":794532,"kb_used_data":763344,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93577308,"statfs":{"total":96636764160,"available":95823163392,"internally_reserved":0,"allocated":781664256,"data_stored":781016382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509484,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":683812,"kb_used_data":652624,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93688028,"statfs":{"total":96636764160,"available":95936540672,"internally_reserved":0,"allocated":668286976,"data_stored":667702261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542189,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":683964,"kb_used_data":652780,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93687876,"statfs":{"total":96636764160,"available":95936385024,"internally_reserved":0,"allocated":668446720,"data_stored":667824622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542189,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":487204,"kb_used_data":456024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93884636,"statfs":{"total":96636764160,"available":96137867264,"internally_reserved":0,"allocated":466968576,"data_stored":466377162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542187,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":438084,"kb_used_data":406896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93933756,"statfs":{"total":96636764160,"available":96188166144,"internally_reserved":0,"allocated":416661504,"data_stored":416048101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542189,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":745900,"kb_used_data":714716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93625940,"statfs":{"total":96636764160,"available":95872962560,"internally_reserved":0,"allocated":731869184,"data_stored":731259517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":729808896,"data_stored":729808896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":415236096,"data_stored":415236096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":465567744,"data_stored":465567744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":666894336,"data_stored":666894336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":666894336,"data_stored":666894336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":780140544,"data_stored":780140544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":400556032,"data_stored":400556032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":668991488,"data_stored":668991488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":59088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":12223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":176128,"data_stored":122673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":75918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T18:32:49.933 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-05-08T18:32:49.933 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-05-08T18:32:50.241 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-05-08T18:32:50.252 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-05-08T18:32:50.252 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T18:32:50.253 INFO:tasks.rgw.client.0.smithi097.stdout:2024-05-08T18:32:50.252+0000 7fe2e7539640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 31079) UID: 0 2024-05-08T18:32:50.253 INFO:tasks.rgw.client.0.smithi097.stdout:2024-05-08T18:32:50.252+0000 7fe2ead81a40 -1 shutting down 2024-05-08T18:32:56.127 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~0s 2024-05-08T18:32:56.353 INFO:tasks.rgw.client.0:Stopped 2024-05-08T18:32:56.354 DEBUG:teuthology.orchestra.run.smithi097:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-05-08T18:32:56.361 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -f /etc/ceph/vault-root-token 2024-05-08T18:32:56.417 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-05-08T18:32:56.472 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-05-08T18:32:56.472 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-05-08T18:32:56.472 DEBUG:teuthology.orchestra.run.smithi097:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-05-08T18:32:57.225 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-05-08T18:32:57.236 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-08T18:32:57.236 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T18:32:57.564 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-05-08T18:32:57.571 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2024-05-08T18:32:57.586 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":215,"stamp":"2024-05-08T18:32:57.476591+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2397793017,"num_objects":771,"num_object_clones":0,"num_object_copies":1542,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":771,"num_whiteouts":0,"num_read":2061,"num_read_kb":1781,"num_write":1679,"num_write_kb":2367361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2479,"ondisk_log_size":2479,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":4943680,"kb_used_data":4694248,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":750031040,"statfs":{"total":773094113280,"available":768031784960,"internally_reserved":0,"allocated":4806909952,"data_stored":4802007078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.419893"},"pg_stats":[{"pgid":"3.3f","version":"93'10","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.938099+0000","last_change":"2024-05-08T18:29:40.574221+0000","last_active":"2024-05-08T18:32:46.938099+0000","last_peered":"2024-05-08T18:32:46.938099+0000","last_clean":"2024-05-08T18:32:46.938099+0000","last_became_active":"2024-05-08T18:29:40.573543+0000","last_became_peered":"2024-05-08T18:29:40.573543+0000","last_unstale":"2024-05-08T18:32:46.938099+0000","last_undegraded":"2024-05-08T18:32:46.938099+0000","last_fullsized":"2024-05-08T18:32:46.938099+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:57.223609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39845888,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"97'2","reported_seq":197,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.077734+0000","last_change":"2024-05-08T18:29:42.563773+0000","last_active":"2024-05-08T18:32:47.077734+0000","last_peered":"2024-05-08T18:32:47.077734+0000","last_clean":"2024-05-08T18:32:47.077734+0000","last_became_active":"2024-05-08T18:29:42.561201+0000","last_became_peered":"2024-05-08T18:29:42.561201+0000","last_unstale":"2024-05-08T18:32:47.077734+0000","last_undegraded":"2024-05-08T18:32:47.077734+0000","last_fullsized":"2024-05-08T18:32:47.077734+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:55.055481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"93'10","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.919609+0000","last_change":"2024-05-08T18:29:40.549299+0000","last_active":"2024-05-08T18:32:46.919609+0000","last_peered":"2024-05-08T18:32:46.919609+0000","last_clean":"2024-05-08T18:32:46.919609+0000","last_became_active":"2024-05-08T18:29:40.548930+0000","last_became_peered":"2024-05-08T18:29:40.548930+0000","last_unstale":"2024-05-08T18:32:46.919609+0000","last_undegraded":"2024-05-08T18:32:46.919609+0000","last_fullsized":"2024-05-08T18:32:46.919609+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:06:36.198647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"84'2","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.936351+0000","last_change":"2024-05-08T18:29:42.572074+0000","last_active":"2024-05-08T18:32:46.936351+0000","last_peered":"2024-05-08T18:32:46.936351+0000","last_clean":"2024-05-08T18:32:46.936351+0000","last_became_active":"2024-05-08T18:29:42.571344+0000","last_became_peered":"2024-05-08T18:29:42.571344+0000","last_unstale":"2024-05-08T18:32:46.936351+0000","last_undegraded":"2024-05-08T18:32:46.936351+0000","last_fullsized":"2024-05-08T18:32:46.936351+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:36.890277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"97'14","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863310+0000","last_change":"2024-05-08T18:29:40.539048+0000","last_active":"2024-05-08T18:32:46.863310+0000","last_peered":"2024-05-08T18:32:46.863310+0000","last_clean":"2024-05-08T18:32:46.863310+0000","last_became_active":"2024-05-08T18:29:40.538458+0000","last_became_peered":"2024-05-08T18:29:40.538458+0000","last_unstale":"2024-05-08T18:32:46.863310+0000","last_undegraded":"2024-05-08T18:32:46.863310+0000","last_fullsized":"2024-05-08T18:32:46.863310+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:36:37.796095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":3,"num_read_kb":4,"num_write":24,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.058600+0000","last_change":"2024-05-08T18:29:42.569718+0000","last_active":"2024-05-08T18:32:46.058600+0000","last_peered":"2024-05-08T18:32:46.058600+0000","last_clean":"2024-05-08T18:32:46.058600+0000","last_became_active":"2024-05-08T18:29:42.569026+0000","last_became_peered":"2024-05-08T18:29:42.569026+0000","last_unstale":"2024-05-08T18:32:46.058600+0000","last_undegraded":"2024-05-08T18:32:46.058600+0000","last_fullsized":"2024-05-08T18:32:46.058600+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:42.045615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"84'8","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.079501+0000","last_change":"2024-05-08T18:29:40.557700+0000","last_active":"2024-05-08T18:32:47.079501+0000","last_peered":"2024-05-08T18:32:47.079501+0000","last_clean":"2024-05-08T18:32:47.079501+0000","last_became_active":"2024-05-08T18:29:40.556884+0000","last_became_peered":"2024-05-08T18:29:40.556884+0000","last_unstale":"2024-05-08T18:32:47.079501+0000","last_undegraded":"2024-05-08T18:32:47.079501+0000","last_fullsized":"2024-05-08T18:32:47.079501+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:21:38.354933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.861228+0000","last_change":"2024-05-08T18:29:42.566448+0000","last_active":"2024-05-08T18:32:46.861228+0000","last_peered":"2024-05-08T18:32:46.861228+0000","last_clean":"2024-05-08T18:32:46.861228+0000","last_became_active":"2024-05-08T18:29:42.566058+0000","last_became_peered":"2024-05-08T18:29:42.566058+0000","last_unstale":"2024-05-08T18:32:46.861228+0000","last_undegraded":"2024-05-08T18:32:46.861228+0000","last_fullsized":"2024-05-08T18:32:46.861228+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:53:03.097704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"93'5","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.936864+0000","last_change":"2024-05-08T18:29:40.571195+0000","last_active":"2024-05-08T18:32:46.936864+0000","last_peered":"2024-05-08T18:32:46.936864+0000","last_clean":"2024-05-08T18:32:46.936864+0000","last_became_active":"2024-05-08T18:29:40.570467+0000","last_became_peered":"2024-05-08T18:29:40.570467+0000","last_unstale":"2024-05-08T18:32:46.936864+0000","last_undegraded":"2024-05-08T18:32:46.936864+0000","last_fullsized":"2024-05-08T18:32:46.936864+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:39.986094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.849586+0000","last_change":"2024-05-08T18:29:42.566506+0000","last_active":"2024-05-08T18:32:46.849586+0000","last_peered":"2024-05-08T18:32:46.849586+0000","last_clean":"2024-05-08T18:32:46.849586+0000","last_became_active":"2024-05-08T18:29:42.565740+0000","last_became_peered":"2024-05-08T18:29:42.565740+0000","last_unstale":"2024-05-08T18:32:46.849586+0000","last_undegraded":"2024-05-08T18:32:46.849586+0000","last_fullsized":"2024-05-08T18:32:46.849586+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:58.320701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"93'7","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.078764+0000","last_change":"2024-05-08T18:29:40.538314+0000","last_active":"2024-05-08T18:32:47.078764+0000","last_peered":"2024-05-08T18:32:47.078764+0000","last_clean":"2024-05-08T18:32:47.078764+0000","last_became_active":"2024-05-08T18:29:40.537458+0000","last_became_peered":"2024-05-08T18:29:40.537458+0000","last_unstale":"2024-05-08T18:32:47.078764+0000","last_undegraded":"2024-05-08T18:32:47.078764+0000","last_fullsized":"2024-05-08T18:32:47.078764+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:56.300986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.059543+0000","last_change":"2024-05-08T18:29:42.570054+0000","last_active":"2024-05-08T18:32:46.059543+0000","last_peered":"2024-05-08T18:32:46.059543+0000","last_clean":"2024-05-08T18:32:46.059543+0000","last_became_active":"2024-05-08T18:29:42.569255+0000","last_became_peered":"2024-05-08T18:29:42.569255+0000","last_unstale":"2024-05-08T18:32:46.059543+0000","last_undegraded":"2024-05-08T18:32:46.059543+0000","last_fullsized":"2024-05-08T18:32:46.059543+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:11:01.702482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"93'18","reported_seq":165,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.060289+0000","last_change":"2024-05-08T18:30:21.210397+0000","last_active":"2024-05-08T18:32:46.060289+0000","last_peered":"2024-05-08T18:32:46.060289+0000","last_clean":"2024-05-08T18:32:46.060289+0000","last_became_active":"2024-05-08T18:30:21.210052+0000","last_became_peered":"2024-05-08T18:30:21.210052+0000","last_unstale":"2024-05-08T18:32:46.060289+0000","last_undegraded":"2024-05-08T18:32:46.060289+0000","last_fullsized":"2024-05-08T18:32:46.060289+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:51:05.355593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"97'4","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.080135+0000","last_change":"2024-05-08T18:29:42.562084+0000","last_active":"2024-05-08T18:32:47.080135+0000","last_peered":"2024-05-08T18:32:47.080135+0000","last_clean":"2024-05-08T18:32:47.080135+0000","last_became_active":"2024-05-08T18:29:42.560699+0000","last_became_peered":"2024-05-08T18:29:42.560699+0000","last_unstale":"2024-05-08T18:32:47.080135+0000","last_undegraded":"2024-05-08T18:32:47.080135+0000","last_fullsized":"2024-05-08T18:32:47.080135+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:09.787597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"93'13","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.063923+0000","last_change":"2024-05-08T18:29:40.564339+0000","last_active":"2024-05-08T18:32:46.063923+0000","last_peered":"2024-05-08T18:32:46.063923+0000","last_clean":"2024-05-08T18:32:46.063923+0000","last_became_active":"2024-05-08T18:29:40.564038+0000","last_became_peered":"2024-05-08T18:29:40.564038+0000","last_unstale":"2024-05-08T18:32:46.063923+0000","last_undegraded":"2024-05-08T18:32:46.063923+0000","last_fullsized":"2024-05-08T18:32:46.063923+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:40:23.287885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"84'8","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.064487+0000","last_change":"2024-05-08T18:29:42.570253+0000","last_active":"2024-05-08T18:32:46.064487+0000","last_peered":"2024-05-08T18:32:46.064487+0000","last_clean":"2024-05-08T18:32:46.064487+0000","last_became_active":"2024-05-08T18:29:42.569917+0000","last_became_peered":"2024-05-08T18:29:42.569917+0000","last_unstale":"2024-05-08T18:32:46.064487+0000","last_undegraded":"2024-05-08T18:32:46.064487+0000","last_fullsized":"2024-05-08T18:32:46.064487+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:14:45.575219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"84'4","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.057705+0000","last_change":"2024-05-08T18:29:42.568116+0000","last_active":"2024-05-08T18:32:46.057705+0000","last_peered":"2024-05-08T18:32:46.057705+0000","last_clean":"2024-05-08T18:32:46.057705+0000","last_became_active":"2024-05-08T18:29:42.567399+0000","last_became_peered":"2024-05-08T18:29:42.567399+0000","last_unstale":"2024-05-08T18:32:46.057705+0000","last_undegraded":"2024-05-08T18:32:46.057705+0000","last_fullsized":"2024-05-08T18:32:46.057705+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:35.037465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"93'13","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.938102+0000","last_change":"2024-05-08T18:29:40.571982+0000","last_active":"2024-05-08T18:32:46.938102+0000","last_peered":"2024-05-08T18:32:46.938102+0000","last_clean":"2024-05-08T18:32:46.938102+0000","last_became_active":"2024-05-08T18:29:40.570600+0000","last_became_peered":"2024-05-08T18:29:40.570600+0000","last_unstale":"2024-05-08T18:32:46.938102+0000","last_undegraded":"2024-05-08T18:32:46.938102+0000","last_fullsized":"2024-05-08T18:32:46.938102+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:54:14.520118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"80'2","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.936574+0000","last_change":"2024-05-08T18:29:42.578449+0000","last_active":"2024-05-08T18:32:46.936574+0000","last_peered":"2024-05-08T18:32:46.936574+0000","last_clean":"2024-05-08T18:32:46.936574+0000","last_became_active":"2024-05-08T18:29:42.577789+0000","last_became_peered":"2024-05-08T18:29:42.577789+0000","last_unstale":"2024-05-08T18:32:46.936574+0000","last_undegraded":"2024-05-08T18:32:46.936574+0000","last_fullsized":"2024-05-08T18:32:46.936574+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:09.787597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"93'8","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.849942+0000","last_change":"2024-05-08T18:29:40.570618+0000","last_active":"2024-05-08T18:32:46.849942+0000","last_peered":"2024-05-08T18:32:46.849942+0000","last_clean":"2024-05-08T18:32:46.849942+0000","last_became_active":"2024-05-08T18:29:40.569519+0000","last_became_peered":"2024-05-08T18:29:40.569519+0000","last_unstale":"2024-05-08T18:32:46.849942+0000","last_undegraded":"2024-05-08T18:32:46.849942+0000","last_fullsized":"2024-05-08T18:32:46.849942+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:09:42.581976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.077696+0000","last_change":"2024-05-08T18:29:42.563056+0000","last_active":"2024-05-08T18:32:47.077696+0000","last_peered":"2024-05-08T18:32:47.077696+0000","last_clean":"2024-05-08T18:32:47.077696+0000","last_became_active":"2024-05-08T18:29:42.562296+0000","last_became_peered":"2024-05-08T18:29:42.562296+0000","last_unstale":"2024-05-08T18:32:47.077696+0000","last_undegraded":"2024-05-08T18:32:47.077696+0000","last_fullsized":"2024-05-08T18:32:47.077696+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:36.890277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"93'14","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.849998+0000","last_change":"2024-05-08T18:29:40.564353+0000","last_active":"2024-05-08T18:32:46.849998+0000","last_peered":"2024-05-08T18:32:46.849998+0000","last_clean":"2024-05-08T18:32:46.849998+0000","last_became_active":"2024-05-08T18:29:40.563516+0000","last_became_peered":"2024-05-08T18:29:40.563516+0000","last_unstale":"2024-05-08T18:32:46.849998+0000","last_undegraded":"2024-05-08T18:32:46.849998+0000","last_fullsized":"2024-05-08T18:32:46.849998+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:06:36.198647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"97'4","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.061368+0000","last_change":"2024-05-08T18:29:42.567006+0000","last_active":"2024-05-08T18:32:46.061368+0000","last_peered":"2024-05-08T18:32:46.061368+0000","last_clean":"2024-05-08T18:32:46.061368+0000","last_became_active":"2024-05-08T18:29:42.566256+0000","last_became_peered":"2024-05-08T18:29:42.566256+0000","last_unstale":"2024-05-08T18:32:46.061368+0000","last_undegraded":"2024-05-08T18:32:46.061368+0000","last_fullsized":"2024-05-08T18:32:46.061368+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:09:44.601690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"93'7","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.059619+0000","last_change":"2024-05-08T18:29:40.573212+0000","last_active":"2024-05-08T18:32:46.059619+0000","last_peered":"2024-05-08T18:32:46.059619+0000","last_clean":"2024-05-08T18:32:46.059619+0000","last_became_active":"2024-05-08T18:29:40.572250+0000","last_became_peered":"2024-05-08T18:29:40.572250+0000","last_unstale":"2024-05-08T18:32:46.059619+0000","last_undegraded":"2024-05-08T18:32:46.059619+0000","last_fullsized":"2024-05-08T18:32:46.059619+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:25:01.595224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"97'6","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.062431+0000","last_change":"2024-05-08T18:29:42.570847+0000","last_active":"2024-05-08T18:32:46.062431+0000","last_peered":"2024-05-08T18:32:46.062431+0000","last_clean":"2024-05-08T18:32:46.062431+0000","last_became_active":"2024-05-08T18:29:42.570435+0000","last_became_peered":"2024-05-08T18:29:42.570435+0000","last_unstale":"2024-05-08T18:32:46.062431+0000","last_undegraded":"2024-05-08T18:32:46.062431+0000","last_fullsized":"2024-05-08T18:32:46.062431+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:21:40.374647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"93'7","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.063428+0000","last_change":"2024-05-08T18:29:40.566815+0000","last_active":"2024-05-08T18:32:46.063428+0000","last_peered":"2024-05-08T18:32:46.063428+0000","last_clean":"2024-05-08T18:32:46.063428+0000","last_became_active":"2024-05-08T18:29:40.566531+0000","last_became_peered":"2024-05-08T18:29:40.566531+0000","last_unstale":"2024-05-08T18:32:46.063428+0000","last_undegraded":"2024-05-08T18:32:46.063428+0000","last_fullsized":"2024-05-08T18:32:46.063428+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:52.462279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"84'8","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.059681+0000","last_change":"2024-05-08T18:29:42.554846+0000","last_active":"2024-05-08T18:32:46.059681+0000","last_peered":"2024-05-08T18:32:46.059681+0000","last_clean":"2024-05-08T18:32:46.059681+0000","last_became_active":"2024-05-08T18:29:42.554115+0000","last_became_peered":"2024-05-08T18:29:42.554115+0000","last_unstale":"2024-05-08T18:32:46.059681+0000","last_undegraded":"2024-05-08T18:32:46.059681+0000","last_fullsized":"2024-05-08T18:32:46.059681+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:22:14.793035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"93'7","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.862823+0000","last_change":"2024-05-08T18:29:40.547776+0000","last_active":"2024-05-08T18:32:46.862823+0000","last_peered":"2024-05-08T18:32:46.862823+0000","last_clean":"2024-05-08T18:32:46.862823+0000","last_became_active":"2024-05-08T18:29:40.547384+0000","last_became_peered":"2024-05-08T18:29:40.547384+0000","last_unstale":"2024-05-08T18:32:46.862823+0000","last_undegraded":"2024-05-08T18:32:46.862823+0000","last_fullsized":"2024-05-08T18:32:46.862823+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:14:26.628603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"97'10","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.057195+0000","last_change":"2024-05-08T18:29:50.685390+0000","last_active":"2024-05-08T18:32:46.057195+0000","last_peered":"2024-05-08T18:32:46.057195+0000","last_clean":"2024-05-08T18:32:46.057195+0000","last_became_active":"2024-05-08T18:29:50.684644+0000","last_became_peered":"2024-05-08T18:29:50.684644+0000","last_unstale":"2024-05-08T18:32:46.057195+0000","last_undegraded":"2024-05-08T18:32:46.057195+0000","last_fullsized":"2024-05-08T18:32:46.057195+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:10:38.951662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":21,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"84'10","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.066363+0000","last_change":"2024-05-08T18:29:42.573805+0000","last_active":"2024-05-08T18:32:46.066363+0000","last_peered":"2024-05-08T18:32:46.066363+0000","last_clean":"2024-05-08T18:32:46.066363+0000","last_became_active":"2024-05-08T18:29:42.573296+0000","last_became_peered":"2024-05-08T18:29:42.573296+0000","last_unstale":"2024-05-08T18:32:46.066363+0000","last_undegraded":"2024-05-08T18:32:46.066363+0000","last_fullsized":"2024-05-08T18:32:46.066363+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:21.935293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"93'8","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.937043+0000","last_change":"2024-05-08T18:29:40.570733+0000","last_active":"2024-05-08T18:32:46.937043+0000","last_peered":"2024-05-08T18:32:46.937043+0000","last_clean":"2024-05-08T18:32:46.937043+0000","last_became_active":"2024-05-08T18:29:40.569711+0000","last_became_peered":"2024-05-08T18:29:40.569711+0000","last_unstale":"2024-05-08T18:32:46.937043+0000","last_undegraded":"2024-05-08T18:32:46.937043+0000","last_fullsized":"2024-05-08T18:32:46.937043+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:18:08.784274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.079758+0000","last_change":"2024-05-08T18:29:44.594185+0000","last_active":"2024-05-08T18:32:47.079758+0000","last_peered":"2024-05-08T18:32:47.079758+0000","last_clean":"2024-05-08T18:32:47.079758+0000","last_became_active":"2024-05-08T18:29:44.593442+0000","last_became_peered":"2024-05-08T18:29:44.593442+0000","last_unstale":"2024-05-08T18:32:47.079758+0000","last_undegraded":"2024-05-08T18:32:47.079758+0000","last_fullsized":"2024-05-08T18:32:47.079758+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:52:25.736491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"97'15","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863258+0000","last_change":"2024-05-08T18:29:46.594652+0000","last_active":"2024-05-08T18:32:46.863258+0000","last_peered":"2024-05-08T18:32:46.863258+0000","last_clean":"2024-05-08T18:32:46.863258+0000","last_became_active":"2024-05-08T18:29:46.593656+0000","last_became_peered":"2024-05-08T18:29:46.593656+0000","last_unstale":"2024-05-08T18:32:46.863258+0000","last_undegraded":"2024-05-08T18:32:46.863258+0000","last_fullsized":"2024-05-08T18:32:46.863258+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:50:27.608888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.937817+0000","last_change":"2024-05-08T18:29:48.639834+0000","last_active":"2024-05-08T18:32:46.937817+0000","last_peered":"2024-05-08T18:32:46.937817+0000","last_clean":"2024-05-08T18:32:46.937817+0000","last_became_active":"2024-05-08T18:29:48.639122+0000","last_became_peered":"2024-05-08T18:29:48.639122+0000","last_unstale":"2024-05-08T18:32:46.937817+0000","last_undegraded":"2024-05-08T18:32:46.937817+0000","last_fullsized":"2024-05-08T18:32:46.937817+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:14:22.304773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"83'4","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.077986+0000","last_change":"2024-05-08T18:29:50.672303+0000","last_active":"2024-05-08T18:32:47.077986+0000","last_peered":"2024-05-08T18:32:47.077986+0000","last_clean":"2024-05-08T18:32:47.077986+0000","last_became_active":"2024-05-08T18:29:50.671513+0000","last_became_peered":"2024-05-08T18:29:50.671513+0000","last_unstale":"2024-05-08T18:32:47.077986+0000","last_undegraded":"2024-05-08T18:32:47.077986+0000","last_fullsized":"2024-05-08T18:32:47.077986+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:12:05.780786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"84'4","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.080615+0000","last_change":"2024-05-08T18:29:42.565462+0000","last_active":"2024-05-08T18:32:47.080615+0000","last_peered":"2024-05-08T18:32:47.080615+0000","last_clean":"2024-05-08T18:32:47.080615+0000","last_became_active":"2024-05-08T18:29:42.564741+0000","last_became_peered":"2024-05-08T18:29:42.564741+0000","last_unstale":"2024-05-08T18:32:47.080615+0000","last_undegraded":"2024-05-08T18:32:47.080615+0000","last_fullsized":"2024-05-08T18:32:47.080615+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:25:56.129785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"93'6","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.862908+0000","last_change":"2024-05-08T18:29:40.564796+0000","last_active":"2024-05-08T18:32:46.862908+0000","last_peered":"2024-05-08T18:32:46.862908+0000","last_clean":"2024-05-08T18:32:46.862908+0000","last_became_active":"2024-05-08T18:29:40.564401+0000","last_became_peered":"2024-05-08T18:29:40.564401+0000","last_unstale":"2024-05-08T18:32:46.862908+0000","last_undegraded":"2024-05-08T18:32:46.862908+0000","last_fullsized":"2024-05-08T18:32:46.862908+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:19:11.492397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":189,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.065935+0000","last_change":"2024-05-08T18:29:44.587689+0000","last_active":"2024-05-08T18:32:46.065935+0000","last_peered":"2024-05-08T18:32:46.065935+0000","last_clean":"2024-05-08T18:32:46.065935+0000","last_became_active":"2024-05-08T18:29:44.586975+0000","last_became_peered":"2024-05-08T18:29:44.586975+0000","last_unstale":"2024-05-08T18:32:46.065935+0000","last_undegraded":"2024-05-08T18:32:46.065935+0000","last_fullsized":"2024-05-08T18:32:46.065935+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:04:49.020450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"83'7","reported_seq":197,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.059952+0000","last_change":"2024-05-08T18:29:46.600906+0000","last_active":"2024-05-08T18:32:46.059952+0000","last_peered":"2024-05-08T18:32:46.059952+0000","last_clean":"2024-05-08T18:32:46.059952+0000","last_became_active":"2024-05-08T18:29:46.599894+0000","last_became_peered":"2024-05-08T18:29:46.599894+0000","last_unstale":"2024-05-08T18:32:46.059952+0000","last_undegraded":"2024-05-08T18:32:46.059952+0000","last_fullsized":"2024-05-08T18:32:46.059952+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:24:13.568294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.059189+0000","last_change":"2024-05-08T18:29:48.614324+0000","last_active":"2024-05-08T18:32:46.059189+0000","last_peered":"2024-05-08T18:32:46.059189+0000","last_clean":"2024-05-08T18:32:46.059189+0000","last_became_active":"2024-05-08T18:29:48.613591+0000","last_became_peered":"2024-05-08T18:29:48.613591+0000","last_unstale":"2024-05-08T18:32:46.059189+0000","last_undegraded":"2024-05-08T18:32:46.059189+0000","last_fullsized":"2024-05-08T18:32:46.059189+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:47:54.034851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.862656+0000","last_change":"2024-05-08T18:29:50.684773+0000","last_active":"2024-05-08T18:32:46.862656+0000","last_peered":"2024-05-08T18:32:46.862656+0000","last_clean":"2024-05-08T18:32:46.862656+0000","last_became_active":"2024-05-08T18:29:50.683931+0000","last_became_peered":"2024-05-08T18:29:50.683931+0000","last_unstale":"2024-05-08T18:32:46.862656+0000","last_undegraded":"2024-05-08T18:32:46.862656+0000","last_fullsized":"2024-05-08T18:32:46.862656+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:17:10.582636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"80'2","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.861209+0000","last_change":"2024-05-08T18:29:42.574437+0000","last_active":"2024-05-08T18:32:46.861209+0000","last_peered":"2024-05-08T18:32:46.861209+0000","last_clean":"2024-05-08T18:32:46.861209+0000","last_became_active":"2024-05-08T18:29:42.574146+0000","last_became_peered":"2024-05-08T18:29:42.574146+0000","last_unstale":"2024-05-08T18:32:46.861209+0000","last_undegraded":"2024-05-08T18:32:46.861209+0000","last_fullsized":"2024-05-08T18:32:46.861209+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:55:30.468069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"93'11","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.936641+0000","last_change":"2024-05-08T18:29:40.559677+0000","last_active":"2024-05-08T18:32:46.936641+0000","last_peered":"2024-05-08T18:32:46.936641+0000","last_clean":"2024-05-08T18:32:46.936641+0000","last_became_active":"2024-05-08T18:29:40.558819+0000","last_became_peered":"2024-05-08T18:29:40.558819+0000","last_unstale":"2024-05-08T18:32:46.936641+0000","last_undegraded":"2024-05-08T18:32:46.936641+0000","last_fullsized":"2024-05-08T18:32:46.936641+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:28.426657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":189,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.067875+0000","last_change":"2024-05-08T18:29:44.596801+0000","last_active":"2024-05-08T18:32:46.067875+0000","last_peered":"2024-05-08T18:32:46.067875+0000","last_clean":"2024-05-08T18:32:46.067875+0000","last_became_active":"2024-05-08T18:29:44.596111+0000","last_became_peered":"2024-05-08T18:29:44.596111+0000","last_unstale":"2024-05-08T18:32:46.067875+0000","last_undegraded":"2024-05-08T18:32:46.067875+0000","last_fullsized":"2024-05-08T18:32:46.067875+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:04.423266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"33'10","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.061447+0000","last_change":"2024-05-08T18:29:46.608330+0000","last_active":"2024-05-08T18:32:46.061447+0000","last_peered":"2024-05-08T18:32:46.061447+0000","last_clean":"2024-05-08T18:32:46.061447+0000","last_became_active":"2024-05-08T18:29:46.607580+0000","last_became_peered":"2024-05-08T18:29:46.607580+0000","last_unstale":"2024-05-08T18:32:46.061447+0000","last_undegraded":"2024-05-08T18:32:46.061447+0000","last_fullsized":"2024-05-08T18:32:46.061447+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:22:18.837103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"116'102","reported_seq":407,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:49.831802+0000","last_change":"2024-05-08T18:29:48.642718+0000","last_active":"2024-05-08T18:32:49.831802+0000","last_peered":"2024-05-08T18:32:49.831802+0000","last_clean":"2024-05-08T18:32:49.831802+0000","last_became_active":"2024-05-08T18:29:48.641950+0000","last_became_peered":"2024-05-08T18:29:48.641950+0000","last_unstale":"2024-05-08T18:32:49.831802+0000","last_undegraded":"2024-05-08T18:32:49.831802+0000","last_fullsized":"2024-05-08T18:32:49.831802+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:00:11.720096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"84'2","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.058647+0000","last_change":"2024-05-08T18:29:50.660378+0000","last_active":"2024-05-08T18:32:46.058647+0000","last_peered":"2024-05-08T18:32:46.058647+0000","last_clean":"2024-05-08T18:32:46.058647+0000","last_became_active":"2024-05-08T18:29:50.659649+0000","last_became_peered":"2024-05-08T18:29:50.659649+0000","last_unstale":"2024-05-08T18:32:46.058647+0000","last_undegraded":"2024-05-08T18:32:46.058647+0000","last_fullsized":"2024-05-08T18:32:46.058647+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:34:14.488295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"80'2","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.066931+0000","last_change":"2024-05-08T18:29:42.577267+0000","last_active":"2024-05-08T18:32:46.066931+0000","last_peered":"2024-05-08T18:32:46.066931+0000","last_clean":"2024-05-08T18:32:46.066931+0000","last_became_active":"2024-05-08T18:29:42.576740+0000","last_became_peered":"2024-05-08T18:29:42.576740+0000","last_unstale":"2024-05-08T18:32:46.066931+0000","last_undegraded":"2024-05-08T18:32:46.066931+0000","last_fullsized":"2024-05-08T18:32:46.066931+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:57:14.869860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"93'5","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.848368+0000","last_change":"2024-05-08T18:29:40.547524+0000","last_active":"2024-05-08T18:32:46.848368+0000","last_peered":"2024-05-08T18:32:46.848368+0000","last_clean":"2024-05-08T18:32:46.848368+0000","last_became_active":"2024-05-08T18:29:40.545749+0000","last_became_peered":"2024-05-08T18:29:40.545749+0000","last_unstale":"2024-05-08T18:32:46.848368+0000","last_undegraded":"2024-05-08T18:32:46.848368+0000","last_fullsized":"2024-05-08T18:32:46.848368+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:12:59.146887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.080004+0000","last_change":"2024-05-08T18:29:44.579839+0000","last_active":"2024-05-08T18:32:47.080004+0000","last_peered":"2024-05-08T18:32:47.080004+0000","last_clean":"2024-05-08T18:32:47.080004+0000","last_became_active":"2024-05-08T18:29:44.578142+0000","last_became_peered":"2024-05-08T18:29:44.578142+0000","last_unstale":"2024-05-08T18:32:47.080004+0000","last_undegraded":"2024-05-08T18:32:47.080004+0000","last_fullsized":"2024-05-08T18:32:47.080004+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:51:09.413191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"97'15","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.937446+0000","last_change":"2024-05-08T18:29:46.607288+0000","last_active":"2024-05-08T18:32:46.937446+0000","last_peered":"2024-05-08T18:32:46.937446+0000","last_clean":"2024-05-08T18:32:46.937446+0000","last_became_active":"2024-05-08T18:29:46.605154+0000","last_became_peered":"2024-05-08T18:29:46.605154+0000","last_unstale":"2024-05-08T18:32:46.937446+0000","last_undegraded":"2024-05-08T18:32:46.937446+0000","last_fullsized":"2024-05-08T18:32:46.937446+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:23.940519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"116'102","reported_seq":326,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:49.830860+0000","last_change":"2024-05-08T18:29:48.634956+0000","last_active":"2024-05-08T18:32:49.830860+0000","last_peered":"2024-05-08T18:32:49.830860+0000","last_clean":"2024-05-08T18:32:49.830860+0000","last_became_active":"2024-05-08T18:29:48.633858+0000","last_became_peered":"2024-05-08T18:29:48.633858+0000","last_unstale":"2024-05-08T18:32:49.830860+0000","last_undegraded":"2024-05-08T18:32:49.830860+0000","last_fullsized":"2024-05-08T18:32:49.830860+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:50:48.169666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"84'8","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.079043+0000","last_change":"2024-05-08T18:29:42.567744+0000","last_active":"2024-05-08T18:32:47.079043+0000","last_peered":"2024-05-08T18:32:47.079043+0000","last_clean":"2024-05-08T18:32:47.079043+0000","last_became_active":"2024-05-08T18:29:42.566974+0000","last_became_peered":"2024-05-08T18:29:42.566974+0000","last_unstale":"2024-05-08T18:32:47.079043+0000","last_undegraded":"2024-05-08T18:32:47.079043+0000","last_fullsized":"2024-05-08T18:32:47.079043+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:42.045615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"93'10","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.938419+0000","last_change":"2024-05-08T18:29:40.572499+0000","last_active":"2024-05-08T18:32:46.938419+0000","last_peered":"2024-05-08T18:32:46.938419+0000","last_clean":"2024-05-08T18:32:46.938419+0000","last_became_active":"2024-05-08T18:29:40.571322+0000","last_became_peered":"2024-05-08T18:29:40.571322+0000","last_unstale":"2024-05-08T18:32:46.938419+0000","last_undegraded":"2024-05-08T18:32:46.938419+0000","last_fullsized":"2024-05-08T18:32:46.938419+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:31.119374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.935697+0000","last_change":"2024-05-08T18:29:44.597045+0000","last_active":"2024-05-08T18:32:46.935697+0000","last_peered":"2024-05-08T18:32:46.935697+0000","last_clean":"2024-05-08T18:32:46.935697+0000","last_became_active":"2024-05-08T18:29:44.596282+0000","last_became_peered":"2024-05-08T18:29:44.596282+0000","last_unstale":"2024-05-08T18:32:46.935697+0000","last_undegraded":"2024-05-08T18:32:46.935697+0000","last_fullsized":"2024-05-08T18:32:46.935697+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:35:51.288126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"97'26","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.078455+0000","last_change":"2024-05-08T18:29:46.590633+0000","last_active":"2024-05-08T18:32:47.078455+0000","last_peered":"2024-05-08T18:32:47.078455+0000","last_clean":"2024-05-08T18:32:47.078455+0000","last_became_active":"2024-05-08T18:29:46.589600+0000","last_became_peered":"2024-05-08T18:29:46.589600+0000","last_unstale":"2024-05-08T18:32:47.078455+0000","last_undegraded":"2024-05-08T18:32:47.078455+0000","last_fullsized":"2024-05-08T18:32:47.078455+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:23.940519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.917121+0000","last_change":"2024-05-08T18:29:48.630758+0000","last_active":"2024-05-08T18:32:46.917121+0000","last_peered":"2024-05-08T18:32:46.917121+0000","last_clean":"2024-05-08T18:32:46.917121+0000","last_became_active":"2024-05-08T18:29:48.630017+0000","last_became_peered":"2024-05-08T18:29:48.630017+0000","last_unstale":"2024-05-08T18:32:46.917121+0000","last_undegraded":"2024-05-08T18:32:46.917121+0000","last_fullsized":"2024-05-08T18:32:46.917121+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:39.879384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"97'14","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.077776+0000","last_change":"2024-05-08T18:29:50.672682+0000","last_active":"2024-05-08T18:32:47.077776+0000","last_peered":"2024-05-08T18:32:47.077776+0000","last_clean":"2024-05-08T18:32:47.077776+0000","last_became_active":"2024-05-08T18:29:50.671923+0000","last_became_peered":"2024-05-08T18:29:50.671923+0000","last_unstale":"2024-05-08T18:32:47.077776+0000","last_undegraded":"2024-05-08T18:32:47.077776+0000","last_fullsized":"2024-05-08T18:32:47.077776+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:38.318890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":39,"num_write":35,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"80'2","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.057722+0000","last_change":"2024-05-08T18:29:42.554289+0000","last_active":"2024-05-08T18:32:46.057722+0000","last_peered":"2024-05-08T18:32:46.057722+0000","last_clean":"2024-05-08T18:32:46.057722+0000","last_became_active":"2024-05-08T18:29:42.553574+0000","last_became_peered":"2024-05-08T18:29:42.553574+0000","last_unstale":"2024-05-08T18:32:46.057722+0000","last_undegraded":"2024-05-08T18:32:46.057722+0000","last_fullsized":"2024-05-08T18:32:46.057722+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:42.005809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"93'7","reported_seq":201,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.938183+0000","last_change":"2024-05-08T18:29:40.570169+0000","last_active":"2024-05-08T18:32:46.938183+0000","last_peered":"2024-05-08T18:32:46.938183+0000","last_clean":"2024-05-08T18:32:46.938183+0000","last_became_active":"2024-05-08T18:29:40.569542+0000","last_became_peered":"2024-05-08T18:29:40.569542+0000","last_unstale":"2024-05-08T18:32:46.938183+0000","last_undegraded":"2024-05-08T18:32:46.938183+0000","last_fullsized":"2024-05-08T18:32:46.938183+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:08:13.006752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"26'1","reported_seq":257,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.060325+0000","last_change":"2024-05-08T18:29:44.579659+0000","last_active":"2024-05-08T18:32:46.060325+0000","last_peered":"2024-05-08T18:32:46.060325+0000","last_clean":"2024-05-08T18:32:46.060325+0000","last_became_active":"2024-05-08T18:29:44.579152+0000","last_became_peered":"2024-05-08T18:29:44.579152+0000","last_unstale":"2024-05-08T18:32:46.060325+0000","last_undegraded":"2024-05-08T18:32:46.060325+0000","last_fullsized":"2024-05-08T18:32:46.060325+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:15:00.358583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"97'15","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.064379+0000","last_change":"2024-05-08T18:29:46.600224+0000","last_active":"2024-05-08T18:32:46.064379+0000","last_peered":"2024-05-08T18:32:46.064379+0000","last_clean":"2024-05-08T18:32:46.064379+0000","last_became_active":"2024-05-08T18:29:46.599464+0000","last_became_peered":"2024-05-08T18:29:46.599464+0000","last_unstale":"2024-05-08T18:32:46.064379+0000","last_undegraded":"2024-05-08T18:32:46.064379+0000","last_fullsized":"2024-05-08T18:32:46.064379+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:26:40.238188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.061779+0000","last_change":"2024-05-08T18:29:48.637939+0000","last_active":"2024-05-08T18:32:46.061779+0000","last_peered":"2024-05-08T18:32:46.061779+0000","last_clean":"2024-05-08T18:32:46.061779+0000","last_became_active":"2024-05-08T18:29:48.637231+0000","last_became_peered":"2024-05-08T18:29:48.637231+0000","last_unstale":"2024-05-08T18:32:46.061779+0000","last_undegraded":"2024-05-08T18:32:46.061779+0000","last_fullsized":"2024-05-08T18:32:46.061779+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:04.571608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":174,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.847775+0000","last_change":"2024-05-08T18:29:50.681831+0000","last_active":"2024-05-08T18:32:46.847775+0000","last_peered":"2024-05-08T18:32:46.847775+0000","last_clean":"2024-05-08T18:32:46.847775+0000","last_became_active":"2024-05-08T18:29:50.681287+0000","last_became_peered":"2024-05-08T18:29:50.681287+0000","last_unstale":"2024-05-08T18:32:46.847775+0000","last_undegraded":"2024-05-08T18:32:46.847775+0000","last_fullsized":"2024-05-08T18:32:46.847775+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:30:24.111488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.849322+0000","last_change":"2024-05-08T18:29:42.562975+0000","last_active":"2024-05-08T18:32:46.849322+0000","last_peered":"2024-05-08T18:32:46.849322+0000","last_clean":"2024-05-08T18:32:46.849322+0000","last_became_active":"2024-05-08T18:29:42.562267+0000","last_became_peered":"2024-05-08T18:29:42.562267+0000","last_unstale":"2024-05-08T18:32:46.849322+0000","last_undegraded":"2024-05-08T18:32:46.849322+0000","last_fullsized":"2024-05-08T18:32:46.849322+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:30.446371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"93'7","reported_seq":201,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.938062+0000","last_change":"2024-05-08T18:29:40.570736+0000","last_active":"2024-05-08T18:32:46.938062+0000","last_peered":"2024-05-08T18:32:46.938062+0000","last_clean":"2024-05-08T18:32:46.938062+0000","last_became_active":"2024-05-08T18:29:40.569626+0000","last_became_peered":"2024-05-08T18:29:40.569626+0000","last_unstale":"2024-05-08T18:32:46.938062+0000","last_undegraded":"2024-05-08T18:32:46.938062+0000","last_fullsized":"2024-05-08T18:32:46.938062+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:56.300986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"26'1","reported_seq":257,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.062164+0000","last_change":"2024-05-08T18:29:44.581748+0000","last_active":"2024-05-08T18:32:46.062164+0000","last_peered":"2024-05-08T18:32:46.062164+0000","last_clean":"2024-05-08T18:32:46.062164+0000","last_became_active":"2024-05-08T18:29:44.581067+0000","last_became_peered":"2024-05-08T18:29:44.581067+0000","last_unstale":"2024-05-08T18:32:46.062164+0000","last_undegraded":"2024-05-08T18:32:46.062164+0000","last_fullsized":"2024-05-08T18:32:46.062164+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:44.043691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"97'21","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.936022+0000","last_change":"2024-05-08T18:29:46.605887+0000","last_active":"2024-05-08T18:32:46.936022+0000","last_peered":"2024-05-08T18:32:46.936022+0000","last_clean":"2024-05-08T18:32:46.936022+0000","last_became_active":"2024-05-08T18:29:46.604966+0000","last_became_peered":"2024-05-08T18:29:46.604966+0000","last_unstale":"2024-05-08T18:32:46.936022+0000","last_undegraded":"2024-05-08T18:32:46.936022+0000","last_fullsized":"2024-05-08T18:32:46.936022+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:07:54.654205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"116'102","reported_seq":326,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:49.830598+0000","last_change":"2024-05-08T18:29:48.638657+0000","last_active":"2024-05-08T18:32:49.830598+0000","last_peered":"2024-05-08T18:32:49.830598+0000","last_clean":"2024-05-08T18:32:49.830598+0000","last_became_active":"2024-05-08T18:29:48.637758+0000","last_became_peered":"2024-05-08T18:29:48.637758+0000","last_unstale":"2024-05-08T18:32:49.830598+0000","last_undegraded":"2024-05-08T18:32:49.830598+0000","last_fullsized":"2024-05-08T18:32:49.830598+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:45:24.153991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"97'2","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863289+0000","last_change":"2024-05-08T18:29:50.684501+0000","last_active":"2024-05-08T18:32:46.863289+0000","last_peered":"2024-05-08T18:32:46.863289+0000","last_clean":"2024-05-08T18:32:46.863289+0000","last_became_active":"2024-05-08T18:29:50.683738+0000","last_became_peered":"2024-05-08T18:29:50.683738+0000","last_unstale":"2024-05-08T18:32:46.863289+0000","last_undegraded":"2024-05-08T18:32:46.863289+0000","last_fullsized":"2024-05-08T18:32:46.863289+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:22.834262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"84'4","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863429+0000","last_change":"2024-05-08T18:29:42.569401+0000","last_active":"2024-05-08T18:32:46.863429+0000","last_peered":"2024-05-08T18:32:46.863429+0000","last_clean":"2024-05-08T18:32:46.863429+0000","last_became_active":"2024-05-08T18:29:42.568659+0000","last_became_peered":"2024-05-08T18:29:42.568659+0000","last_unstale":"2024-05-08T18:32:46.863429+0000","last_undegraded":"2024-05-08T18:32:46.863429+0000","last_fullsized":"2024-05-08T18:32:46.863429+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:35:23.016110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"93'8","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.079924+0000","last_change":"2024-05-08T18:29:40.557076+0000","last_active":"2024-05-08T18:32:47.079924+0000","last_peered":"2024-05-08T18:32:47.079924+0000","last_clean":"2024-05-08T18:32:47.079924+0000","last_became_active":"2024-05-08T18:29:40.555805+0000","last_became_peered":"2024-05-08T18:29:40.555805+0000","last_unstale":"2024-05-08T18:32:47.079924+0000","last_undegraded":"2024-05-08T18:32:47.079924+0000","last_fullsized":"2024-05-08T18:32:47.079924+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:13.946346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":18,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":189,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.060997+0000","last_change":"2024-05-08T18:29:44.573892+0000","last_active":"2024-05-08T18:32:46.060997+0000","last_peered":"2024-05-08T18:32:46.060997+0000","last_clean":"2024-05-08T18:32:46.060997+0000","last_became_active":"2024-05-08T18:29:44.573308+0000","last_became_peered":"2024-05-08T18:29:44.573308+0000","last_unstale":"2024-05-08T18:32:46.060997+0000","last_undegraded":"2024-05-08T18:32:46.060997+0000","last_fullsized":"2024-05-08T18:32:46.060997+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:37.075348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"97'24","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.862514+0000","last_change":"2024-05-08T18:29:46.595585+0000","last_active":"2024-05-08T18:32:46.862514+0000","last_peered":"2024-05-08T18:32:46.862514+0000","last_clean":"2024-05-08T18:32:46.862514+0000","last_became_active":"2024-05-08T18:29:46.594930+0000","last_became_peered":"2024-05-08T18:29:46.594930+0000","last_unstale":"2024-05-08T18:32:46.862514+0000","last_undegraded":"2024-05-08T18:32:46.862514+0000","last_fullsized":"2024-05-08T18:32:46.862514+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:11.768269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.059998+0000","last_change":"2024-05-08T18:29:48.638137+0000","last_active":"2024-05-08T18:32:46.059998+0000","last_peered":"2024-05-08T18:32:46.059998+0000","last_clean":"2024-05-08T18:32:46.059998+0000","last_became_active":"2024-05-08T18:29:48.637370+0000","last_became_peered":"2024-05-08T18:29:48.637370+0000","last_unstale":"2024-05-08T18:32:46.059998+0000","last_undegraded":"2024-05-08T18:32:46.059998+0000","last_fullsized":"2024-05-08T18:32:46.059998+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:15.859849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"83'2","reported_seq":182,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.916145+0000","last_change":"2024-05-08T18:29:50.688760+0000","last_active":"2024-05-08T18:32:46.916145+0000","last_peered":"2024-05-08T18:32:46.916145+0000","last_clean":"2024-05-08T18:32:46.916145+0000","last_became_active":"2024-05-08T18:29:50.687960+0000","last_became_peered":"2024-05-08T18:29:50.687960+0000","last_unstale":"2024-05-08T18:32:46.916145+0000","last_undegraded":"2024-05-08T18:32:46.916145+0000","last_fullsized":"2024-05-08T18:32:46.916145+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:21:19.624895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"97'4","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.060220+0000","last_change":"2024-05-08T18:29:42.557850+0000","last_active":"2024-05-08T18:32:46.060220+0000","last_peered":"2024-05-08T18:32:46.060220+0000","last_clean":"2024-05-08T18:32:46.060220+0000","last_became_active":"2024-05-08T18:29:42.557119+0000","last_became_peered":"2024-05-08T18:29:42.557119+0000","last_unstale":"2024-05-08T18:32:46.060220+0000","last_undegraded":"2024-05-08T18:32:46.060220+0000","last_fullsized":"2024-05-08T18:32:46.060220+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:25:56.129785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"93'8","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.062755+0000","last_change":"2024-05-08T18:29:40.544530+0000","last_active":"2024-05-08T18:32:46.062755+0000","last_peered":"2024-05-08T18:32:46.062755+0000","last_clean":"2024-05-08T18:32:46.062755+0000","last_became_active":"2024-05-08T18:29:40.544215+0000","last_became_peered":"2024-05-08T18:29:40.544215+0000","last_unstale":"2024-05-08T18:32:46.062755+0000","last_undegraded":"2024-05-08T18:32:46.062755+0000","last_fullsized":"2024-05-08T18:32:46.062755+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:14:26.628603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":189,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.063283+0000","last_change":"2024-05-08T18:29:44.588227+0000","last_active":"2024-05-08T18:32:46.063283+0000","last_peered":"2024-05-08T18:32:46.063283+0000","last_clean":"2024-05-08T18:32:46.063283+0000","last_became_active":"2024-05-08T18:29:44.587822+0000","last_became_peered":"2024-05-08T18:29:44.587822+0000","last_unstale":"2024-05-08T18:32:46.063283+0000","last_undegraded":"2024-05-08T18:32:46.063283+0000","last_fullsized":"2024-05-08T18:32:46.063283+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:18:12.841872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"100'19","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.059596+0000","last_change":"2024-05-08T18:29:46.603563+0000","last_active":"2024-05-08T18:32:46.059596+0000","last_peered":"2024-05-08T18:32:46.059596+0000","last_clean":"2024-05-08T18:32:46.059596+0000","last_became_active":"2024-05-08T18:29:46.602801+0000","last_became_peered":"2024-05-08T18:29:46.602801+0000","last_unstale":"2024-05-08T18:32:46.059596+0000","last_undegraded":"2024-05-08T18:32:46.059596+0000","last_fullsized":"2024-05-08T18:32:46.059596+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:22:36.338527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":17,"num_write":20,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863847+0000","last_change":"2024-05-08T18:29:48.642806+0000","last_active":"2024-05-08T18:32:46.863847+0000","last_peered":"2024-05-08T18:32:46.863847+0000","last_clean":"2024-05-08T18:32:46.863847+0000","last_became_active":"2024-05-08T18:29:48.641813+0000","last_became_peered":"2024-05-08T18:29:48.641813+0000","last_unstale":"2024-05-08T18:32:46.863847+0000","last_undegraded":"2024-05-08T18:32:46.863847+0000","last_fullsized":"2024-05-08T18:32:46.863847+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:50:48.169666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"80'2","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.062631+0000","last_change":"2024-05-08T18:29:50.689819+0000","last_active":"2024-05-08T18:32:46.062631+0000","last_peered":"2024-05-08T18:32:46.062631+0000","last_clean":"2024-05-08T18:32:46.062631+0000","last_became_active":"2024-05-08T18:29:50.686739+0000","last_became_peered":"2024-05-08T18:29:50.686739+0000","last_unstale":"2024-05-08T18:32:46.062631+0000","last_undegraded":"2024-05-08T18:32:46.062631+0000","last_fullsized":"2024-05-08T18:32:46.062631+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:45:34.171402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.060014+0000","last_change":"2024-05-08T18:29:42.552388+0000","last_active":"2024-05-08T18:32:46.060014+0000","last_peered":"2024-05-08T18:32:46.060014+0000","last_clean":"2024-05-08T18:32:46.060014+0000","last_became_active":"2024-05-08T18:29:42.551647+0000","last_became_peered":"2024-05-08T18:29:42.551647+0000","last_unstale":"2024-05-08T18:32:46.060014+0000","last_undegraded":"2024-05-08T18:32:46.060014+0000","last_fullsized":"2024-05-08T18:32:46.060014+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:55.055481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"93'8","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.849557+0000","last_change":"2024-05-08T18:29:40.562946+0000","last_active":"2024-05-08T18:32:46.849557+0000","last_peered":"2024-05-08T18:32:46.849557+0000","last_clean":"2024-05-08T18:32:46.849557+0000","last_became_active":"2024-05-08T18:29:40.550942+0000","last_became_peered":"2024-05-08T18:29:40.550942+0000","last_unstale":"2024-05-08T18:32:46.849557+0000","last_undegraded":"2024-05-08T18:32:46.849557+0000","last_fullsized":"2024-05-08T18:32:46.849557+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:22.579629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.918001+0000","last_change":"2024-05-08T18:29:44.593681+0000","last_active":"2024-05-08T18:32:46.918001+0000","last_peered":"2024-05-08T18:32:46.918001+0000","last_clean":"2024-05-08T18:32:46.918001+0000","last_became_active":"2024-05-08T18:29:44.593242+0000","last_became_peered":"2024-05-08T18:29:44.593242+0000","last_unstale":"2024-05-08T18:32:46.918001+0000","last_undegraded":"2024-05-08T18:32:46.918001+0000","last_fullsized":"2024-05-08T18:32:46.918001+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:57.093364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"97'22","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.064038+0000","last_change":"2024-05-08T18:29:46.589514+0000","last_active":"2024-05-08T18:32:46.064038+0000","last_peered":"2024-05-08T18:32:46.064038+0000","last_clean":"2024-05-08T18:32:46.064038+0000","last_became_active":"2024-05-08T18:29:46.588784+0000","last_became_peered":"2024-05-08T18:29:46.588784+0000","last_unstale":"2024-05-08T18:32:46.064038+0000","last_undegraded":"2024-05-08T18:32:46.064038+0000","last_fullsized":"2024-05-08T18:32:46.064038+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:02:30.355168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":20,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"116'102","reported_seq":338,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:49.831491+0000","last_change":"2024-05-08T18:29:48.631007+0000","last_active":"2024-05-08T18:32:49.831491+0000","last_peered":"2024-05-08T18:32:49.831491+0000","last_clean":"2024-05-08T18:32:49.831491+0000","last_became_active":"2024-05-08T18:29:48.630229+0000","last_became_peered":"2024-05-08T18:29:48.630229+0000","last_unstale":"2024-05-08T18:32:49.831491+0000","last_undegraded":"2024-05-08T18:32:49.831491+0000","last_fullsized":"2024-05-08T18:32:49.831491+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:44:03.778419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.917498+0000","last_change":"2024-05-08T18:29:50.675105+0000","last_active":"2024-05-08T18:32:46.917498+0000","last_peered":"2024-05-08T18:32:46.917498+0000","last_clean":"2024-05-08T18:32:46.917498+0000","last_became_active":"2024-05-08T18:29:50.674292+0000","last_became_peered":"2024-05-08T18:29:50.674292+0000","last_unstale":"2024-05-08T18:32:46.917498+0000","last_undegraded":"2024-05-08T18:32:46.917498+0000","last_fullsized":"2024-05-08T18:32:46.917498+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:47:15.423647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"84'4","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.060239+0000","last_change":"2024-05-08T18:29:42.579707+0000","last_active":"2024-05-08T18:32:46.060239+0000","last_peered":"2024-05-08T18:32:46.060239+0000","last_clean":"2024-05-08T18:32:46.060239+0000","last_became_active":"2024-05-08T18:29:42.579059+0000","last_became_peered":"2024-05-08T18:29:42.579059+0000","last_unstale":"2024-05-08T18:32:46.060239+0000","last_undegraded":"2024-05-08T18:32:46.060239+0000","last_fullsized":"2024-05-08T18:32:46.060239+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:09.787597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"93'9","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.058163+0000","last_change":"2024-05-08T18:29:40.555327+0000","last_active":"2024-05-08T18:32:46.058163+0000","last_peered":"2024-05-08T18:32:46.058163+0000","last_clean":"2024-05-08T18:32:46.058163+0000","last_became_active":"2024-05-08T18:29:40.554594+0000","last_became_peered":"2024-05-08T18:29:40.554594+0000","last_unstale":"2024-05-08T18:32:46.058163+0000","last_undegraded":"2024-05-08T18:32:46.058163+0000","last_fullsized":"2024-05-08T18:32:46.058163+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:19.841114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":3,"num_read_kb":4,"num_write":19,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"26'2","reported_seq":324,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.079838+0000","last_change":"2024-05-08T18:29:44.582434+0000","last_active":"2024-05-08T18:32:47.079838+0000","last_peered":"2024-05-08T18:32:47.079838+0000","last_clean":"2024-05-08T18:32:47.079838+0000","last_became_active":"2024-05-08T18:29:44.581699+0000","last_became_peered":"2024-05-08T18:29:44.581699+0000","last_unstale":"2024-05-08T18:32:47.079838+0000","last_undegraded":"2024-05-08T18:32:47.079838+0000","last_fullsized":"2024-05-08T18:32:47.079838+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:19:29.113643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":134,"num_read_kb":134,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"33'10","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.065642+0000","last_change":"2024-05-08T18:29:46.590860+0000","last_active":"2024-05-08T18:32:46.065642+0000","last_peered":"2024-05-08T18:32:46.065642+0000","last_clean":"2024-05-08T18:32:46.065642+0000","last_became_active":"2024-05-08T18:29:46.590087+0000","last_became_peered":"2024-05-08T18:29:46.590087+0000","last_unstale":"2024-05-08T18:32:46.065642+0000","last_undegraded":"2024-05-08T18:32:46.065642+0000","last_fullsized":"2024-05-08T18:32:46.065642+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:19:58.358449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"116'102","reported_seq":362,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:49.831331+0000","last_change":"2024-05-08T18:29:48.635548+0000","last_active":"2024-05-08T18:32:49.831331+0000","last_peered":"2024-05-08T18:32:49.831331+0000","last_clean":"2024-05-08T18:32:49.831331+0000","last_became_active":"2024-05-08T18:29:48.634801+0000","last_became_peered":"2024-05-08T18:29:48.634801+0000","last_unstale":"2024-05-08T18:32:49.831331+0000","last_undegraded":"2024-05-08T18:32:49.831331+0000","last_fullsized":"2024-05-08T18:32:49.831331+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:04:20.128031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.058516+0000","last_change":"2024-05-08T18:29:50.668279+0000","last_active":"2024-05-08T18:32:46.058516+0000","last_peered":"2024-05-08T18:32:46.058516+0000","last_clean":"2024-05-08T18:32:46.058516+0000","last_became_active":"2024-05-08T18:29:50.667536+0000","last_became_peered":"2024-05-08T18:29:50.667536+0000","last_unstale":"2024-05-08T18:32:46.058516+0000","last_undegraded":"2024-05-08T18:32:46.058516+0000","last_fullsized":"2024-05-08T18:32:46.058516+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:12:05.780786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"97'14","reported_seq":224,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.916133+0000","last_change":"2024-05-08T18:29:42.563807+0000","last_active":"2024-05-08T18:32:46.916133+0000","last_peered":"2024-05-08T18:32:46.916133+0000","last_clean":"2024-05-08T18:32:46.916133+0000","last_became_active":"2024-05-08T18:29:42.563416+0000","last_became_peered":"2024-05-08T18:29:42.563416+0000","last_unstale":"2024-05-08T18:32:46.916133+0000","last_undegraded":"2024-05-08T18:32:46.916133+0000","last_fullsized":"2024-05-08T18:32:46.916133+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:18:10.803989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"93'12","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.064387+0000","last_change":"2024-05-08T18:29:40.548898+0000","last_active":"2024-05-08T18:32:46.064387+0000","last_peered":"2024-05-08T18:32:46.064387+0000","last_clean":"2024-05-08T18:32:46.064387+0000","last_became_active":"2024-05-08T18:29:40.548591+0000","last_became_peered":"2024-05-08T18:29:40.548591+0000","last_unstale":"2024-05-08T18:32:46.064387+0000","last_undegraded":"2024-05-08T18:32:46.064387+0000","last_fullsized":"2024-05-08T18:32:46.064387+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:27:41.414153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.059932+0000","last_change":"2024-05-08T18:29:44.582578+0000","last_active":"2024-05-08T18:32:46.059932+0000","last_peered":"2024-05-08T18:32:46.059932+0000","last_clean":"2024-05-08T18:32:46.059932+0000","last_became_active":"2024-05-08T18:29:44.581832+0000","last_became_peered":"2024-05-08T18:29:44.581832+0000","last_unstale":"2024-05-08T18:32:46.059932+0000","last_undegraded":"2024-05-08T18:32:46.059932+0000","last_fullsized":"2024-05-08T18:32:46.059932+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:52:25.736491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"97'23","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.079413+0000","last_change":"2024-05-08T18:29:46.602459+0000","last_active":"2024-05-08T18:32:47.079413+0000","last_peered":"2024-05-08T18:32:47.079413+0000","last_clean":"2024-05-08T18:32:47.079413+0000","last_became_active":"2024-05-08T18:29:46.601740+0000","last_became_peered":"2024-05-08T18:29:46.601740+0000","last_unstale":"2024-05-08T18:32:47.079413+0000","last_undegraded":"2024-05-08T18:32:47.079413+0000","last_fullsized":"2024-05-08T18:32:47.079413+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:58:31.293922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.849235+0000","last_change":"2024-05-08T18:29:48.640046+0000","last_active":"2024-05-08T18:32:46.849235+0000","last_peered":"2024-05-08T18:32:46.849235+0000","last_clean":"2024-05-08T18:32:46.849235+0000","last_became_active":"2024-05-08T18:29:48.639309+0000","last_became_peered":"2024-05-08T18:29:48.639309+0000","last_unstale":"2024-05-08T18:32:46.849235+0000","last_undegraded":"2024-05-08T18:32:46.849235+0000","last_fullsized":"2024-05-08T18:32:46.849235+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:10.533065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.917024+0000","last_change":"2024-05-08T18:29:50.668361+0000","last_active":"2024-05-08T18:32:46.917024+0000","last_peered":"2024-05-08T18:32:46.917024+0000","last_clean":"2024-05-08T18:32:46.917024+0000","last_became_active":"2024-05-08T18:29:50.667636+0000","last_became_peered":"2024-05-08T18:29:50.667636+0000","last_unstale":"2024-05-08T18:32:46.917024+0000","last_undegraded":"2024-05-08T18:32:46.917024+0000","last_fullsized":"2024-05-08T18:32:46.917024+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:58:35.356885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"97'4","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.847440+0000","last_change":"2024-05-08T18:29:42.584098+0000","last_active":"2024-05-08T18:32:46.847440+0000","last_peered":"2024-05-08T18:32:46.847440+0000","last_clean":"2024-05-08T18:32:46.847440+0000","last_became_active":"2024-05-08T18:29:42.583639+0000","last_became_peered":"2024-05-08T18:29:42.583639+0000","last_unstale":"2024-05-08T18:32:46.847440+0000","last_undegraded":"2024-05-08T18:32:46.847440+0000","last_fullsized":"2024-05-08T18:32:46.847440+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:08:15.026467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":296,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.936422+0000","last_change":"2024-05-08T18:29:27.115522+0000","last_active":"2024-05-08T18:32:46.936422+0000","last_peered":"2024-05-08T18:32:46.936422+0000","last_clean":"2024-05-08T18:32:46.936422+0000","last_became_active":"2024-05-08T18:29:27.112960+0000","last_became_peered":"2024-05-08T18:29:27.112960+0000","last_unstale":"2024-05-08T18:32:46.936422+0000","last_undegraded":"2024-05-08T18:32:46.936422+0000","last_fullsized":"2024-05-08T18:32:46.936422+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:26.091102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:26.091102+0000","last_clean_scrub_stamp":"2024-05-08T18:29:26.091102+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:09:50.296961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.077723+0000","last_change":"2024-05-08T18:29:34.496467+0000","last_active":"2024-05-08T18:32:47.077723+0000","last_peered":"2024-05-08T18:32:47.077723+0000","last_clean":"2024-05-08T18:32:47.077723+0000","last_became_active":"2024-05-08T18:29:34.495632+0000","last_became_peered":"2024-05-08T18:29:34.495632+0000","last_unstale":"2024-05-08T18:32:47.077723+0000","last_undegraded":"2024-05-08T18:32:47.077723+0000","last_fullsized":"2024-05-08T18:32:47.077723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:35.917391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"93'5","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.065505+0000","last_change":"2024-05-08T18:30:20.849562+0000","last_active":"2024-05-08T18:32:46.065505+0000","last_peered":"2024-05-08T18:32:46.065505+0000","last_clean":"2024-05-08T18:32:46.065505+0000","last_became_active":"2024-05-08T18:30:20.849160+0000","last_became_peered":"2024-05-08T18:30:20.849160+0000","last_unstale":"2024-05-08T18:32:46.065505+0000","last_undegraded":"2024-05-08T18:32:46.065505+0000","last_fullsized":"2024-05-08T18:32:46.065505+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:29:13.478886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.937166+0000","last_change":"2024-05-08T18:29:44.592445+0000","last_active":"2024-05-08T18:32:46.937166+0000","last_peered":"2024-05-08T18:32:46.937166+0000","last_clean":"2024-05-08T18:32:46.937166+0000","last_became_active":"2024-05-08T18:29:44.587855+0000","last_became_peered":"2024-05-08T18:29:44.587855+0000","last_unstale":"2024-05-08T18:32:46.937166+0000","last_undegraded":"2024-05-08T18:32:46.937166+0000","last_fullsized":"2024-05-08T18:32:46.937166+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:06:05.355648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"97'33","reported_seq":231,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.080401+0000","last_change":"2024-05-08T18:29:46.595394+0000","last_active":"2024-05-08T18:32:47.080401+0000","last_peered":"2024-05-08T18:32:47.080401+0000","last_clean":"2024-05-08T18:32:47.080401+0000","last_became_active":"2024-05-08T18:29:46.594573+0000","last_became_peered":"2024-05-08T18:29:46.594573+0000","last_unstale":"2024-05-08T18:32:47.080401+0000","last_undegraded":"2024-05-08T18:32:47.080401+0000","last_fullsized":"2024-05-08T18:32:47.080401+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:47:11.360684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71557,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":23,"num_write":20,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863388+0000","last_change":"2024-05-08T18:29:48.632178+0000","last_active":"2024-05-08T18:32:46.863388+0000","last_peered":"2024-05-08T18:32:46.863388+0000","last_clean":"2024-05-08T18:32:46.863388+0000","last_became_active":"2024-05-08T18:29:48.631481+0000","last_became_peered":"2024-05-08T18:29:48.631481+0000","last_unstale":"2024-05-08T18:32:46.863388+0000","last_undegraded":"2024-05-08T18:32:46.863388+0000","last_fullsized":"2024-05-08T18:32:46.863388+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:34.806539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"80'2","reported_seq":176,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.848444+0000","last_change":"2024-05-08T18:29:50.675319+0000","last_active":"2024-05-08T18:32:46.848444+0000","last_peered":"2024-05-08T18:32:46.848444+0000","last_clean":"2024-05-08T18:32:46.848444+0000","last_became_active":"2024-05-08T18:29:50.674526+0000","last_became_peered":"2024-05-08T18:29:50.674526+0000","last_unstale":"2024-05-08T18:32:46.848444+0000","last_undegraded":"2024-05-08T18:32:46.848444+0000","last_fullsized":"2024-05-08T18:32:46.848444+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:59:06.404586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"84'4","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863527+0000","last_change":"2024-05-08T18:29:42.568584+0000","last_active":"2024-05-08T18:32:46.863527+0000","last_peered":"2024-05-08T18:32:46.863527+0000","last_clean":"2024-05-08T18:32:46.863527+0000","last_became_active":"2024-05-08T18:29:42.568244+0000","last_became_peered":"2024-05-08T18:29:42.568244+0000","last_unstale":"2024-05-08T18:32:46.863527+0000","last_undegraded":"2024-05-08T18:32:46.863527+0000","last_fullsized":"2024-05-08T18:32:46.863527+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:20.397730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.935976+0000","last_change":"2024-05-08T18:29:34.497654+0000","last_active":"2024-05-08T18:32:46.935976+0000","last_peered":"2024-05-08T18:32:46.935976+0000","last_clean":"2024-05-08T18:32:46.935976+0000","last_became_active":"2024-05-08T18:29:34.495812+0000","last_became_peered":"2024-05-08T18:29:34.495812+0000","last_unstale":"2024-05-08T18:32:46.935976+0000","last_undegraded":"2024-05-08T18:32:46.935976+0000","last_fullsized":"2024-05-08T18:32:46.935976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:37:02.202613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"93'7","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.862540+0000","last_change":"2024-05-08T18:29:40.560653+0000","last_active":"2024-05-08T18:32:46.862540+0000","last_peered":"2024-05-08T18:32:46.862540+0000","last_clean":"2024-05-08T18:32:46.862540+0000","last_became_active":"2024-05-08T18:29:40.560296+0000","last_became_peered":"2024-05-08T18:29:40.560296+0000","last_unstale":"2024-05-08T18:32:46.862540+0000","last_undegraded":"2024-05-08T18:32:46.862540+0000","last_fullsized":"2024-05-08T18:32:46.862540+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:52.462279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.080676+0000","last_change":"2024-05-08T18:29:44.594681+0000","last_active":"2024-05-08T18:32:47.080676+0000","last_peered":"2024-05-08T18:32:47.080676+0000","last_clean":"2024-05-08T18:32:47.080676+0000","last_became_active":"2024-05-08T18:29:44.593917+0000","last_became_peered":"2024-05-08T18:29:44.593917+0000","last_unstale":"2024-05-08T18:32:47.080676+0000","last_undegraded":"2024-05-08T18:32:47.080676+0000","last_fullsized":"2024-05-08T18:32:47.080676+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:59:00.335437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"116'109","reported_seq":384,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:49.831439+0000","last_change":"2024-05-08T18:29:46.599932+0000","last_active":"2024-05-08T18:32:49.831439+0000","last_peered":"2024-05-08T18:32:49.831439+0000","last_clean":"2024-05-08T18:32:49.831439+0000","last_became_active":"2024-05-08T18:29:46.594789+0000","last_became_peered":"2024-05-08T18:29:46.594789+0000","last_unstale":"2024-05-08T18:32:49.831439+0000","last_undegraded":"2024-05-08T18:32:49.831439+0000","last_fullsized":"2024-05-08T18:32:49.831439+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:04:18.099848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9947,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":143,"num_read_kb":128,"num_write":28,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.937370+0000","last_change":"2024-05-08T18:29:48.634661+0000","last_active":"2024-05-08T18:32:46.937370+0000","last_peered":"2024-05-08T18:32:46.937370+0000","last_clean":"2024-05-08T18:32:46.937370+0000","last_became_active":"2024-05-08T18:29:48.634044+0000","last_became_peered":"2024-05-08T18:29:48.634044+0000","last_unstale":"2024-05-08T18:32:46.937370+0000","last_undegraded":"2024-05-08T18:32:46.937370+0000","last_fullsized":"2024-05-08T18:32:46.937370+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:01:46.238076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.916916+0000","last_change":"2024-05-08T18:29:50.676536+0000","last_active":"2024-05-08T18:32:46.916916+0000","last_peered":"2024-05-08T18:32:46.916916+0000","last_clean":"2024-05-08T18:32:46.916916+0000","last_became_active":"2024-05-08T18:29:50.675770+0000","last_became_peered":"2024-05-08T18:29:50.675770+0000","last_unstale":"2024-05-08T18:32:46.916916+0000","last_undegraded":"2024-05-08T18:32:46.916916+0000","last_fullsized":"2024-05-08T18:32:46.916916+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:28.003482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.919578+0000","last_change":"2024-05-08T18:29:42.575253+0000","last_active":"2024-05-08T18:32:46.919578+0000","last_peered":"2024-05-08T18:32:46.919578+0000","last_clean":"2024-05-08T18:32:46.919578+0000","last_became_active":"2024-05-08T18:29:42.573621+0000","last_became_peered":"2024-05-08T18:29:42.573621+0000","last_unstale":"2024-05-08T18:32:46.919578+0000","last_undegraded":"2024-05-08T18:32:46.919578+0000","last_fullsized":"2024-05-08T18:32:46.919578+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:59.243324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.060706+0000","last_change":"2024-05-08T18:29:34.491071+0000","last_active":"2024-05-08T18:32:46.060706+0000","last_peered":"2024-05-08T18:32:46.060706+0000","last_clean":"2024-05-08T18:32:46.060706+0000","last_became_active":"2024-05-08T18:29:34.490717+0000","last_became_peered":"2024-05-08T18:29:34.490717+0000","last_unstale":"2024-05-08T18:32:46.060706+0000","last_undegraded":"2024-05-08T18:32:46.060706+0000","last_fullsized":"2024-05-08T18:32:46.060706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:55.793312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"93'12","reported_seq":211,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.916751+0000","last_change":"2024-05-08T18:29:40.530634+0000","last_active":"2024-05-08T18:32:46.916751+0000","last_peered":"2024-05-08T18:32:46.916751+0000","last_clean":"2024-05-08T18:32:46.916751+0000","last_became_active":"2024-05-08T18:29:40.529804+0000","last_became_peered":"2024-05-08T18:29:40.529804+0000","last_unstale":"2024-05-08T18:32:46.916751+0000","last_undegraded":"2024-05-08T18:32:46.916751+0000","last_fullsized":"2024-05-08T18:32:46.916751+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:59:25.840149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"26'1","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.064037+0000","last_change":"2024-05-08T18:29:44.584678+0000","last_active":"2024-05-08T18:32:46.064037+0000","last_peered":"2024-05-08T18:32:46.064037+0000","last_clean":"2024-05-08T18:32:46.064037+0000","last_became_active":"2024-05-08T18:29:44.584227+0000","last_became_peered":"2024-05-08T18:29:44.584227+0000","last_unstale":"2024-05-08T18:32:46.064037+0000","last_undegraded":"2024-05-08T18:32:46.064037+0000","last_fullsized":"2024-05-08T18:32:46.064037+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:04:01.281207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"116'16","reported_seq":241,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:49.831341+0000","last_change":"2024-05-08T18:29:46.608720+0000","last_active":"2024-05-08T18:32:49.831341+0000","last_peered":"2024-05-08T18:32:49.831341+0000","last_clean":"2024-05-08T18:32:49.831341+0000","last_became_active":"2024-05-08T18:29:46.607989+0000","last_became_peered":"2024-05-08T18:29:46.607989+0000","last_unstale":"2024-05-08T18:32:49.831341+0000","last_undegraded":"2024-05-08T18:32:49.831341+0000","last_fullsized":"2024-05-08T18:32:49.831341+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:58:31.293922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863028+0000","last_change":"2024-05-08T18:29:48.625269+0000","last_active":"2024-05-08T18:32:46.863028+0000","last_peered":"2024-05-08T18:32:46.863028+0000","last_clean":"2024-05-08T18:32:46.863028+0000","last_became_active":"2024-05-08T18:29:48.624545+0000","last_became_peered":"2024-05-08T18:29:48.624545+0000","last_unstale":"2024-05-08T18:32:46.863028+0000","last_undegraded":"2024-05-08T18:32:46.863028+0000","last_fullsized":"2024-05-08T18:32:46.863028+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:16:42.799734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"84'12","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.063889+0000","last_change":"2024-05-08T18:29:50.688851+0000","last_active":"2024-05-08T18:32:46.063889+0000","last_peered":"2024-05-08T18:32:46.063889+0000","last_clean":"2024-05-08T18:32:46.063889+0000","last_became_active":"2024-05-08T18:29:50.687978+0000","last_became_peered":"2024-05-08T18:29:50.687978+0000","last_unstale":"2024-05-08T18:32:46.063889+0000","last_undegraded":"2024-05-08T18:32:46.063889+0000","last_fullsized":"2024-05-08T18:32:46.063889+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:28:29.836446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":42,"num_write":31,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"84'4","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.918158+0000","last_change":"2024-05-08T18:31:22.008678+0000","last_active":"2024-05-08T18:32:46.918158+0000","last_peered":"2024-05-08T18:32:46.918158+0000","last_clean":"2024-05-08T18:32:46.918158+0000","last_became_active":"2024-05-08T18:31:22.008342+0000","last_became_peered":"2024-05-08T18:31:22.008342+0000","last_unstale":"2024-05-08T18:32:46.918158+0000","last_undegraded":"2024-05-08T18:32:46.918158+0000","last_fullsized":"2024-05-08T18:32:46.918158+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:40:30.531379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.079379+0000","last_change":"2024-05-08T18:29:34.496942+0000","last_active":"2024-05-08T18:32:47.079379+0000","last_peered":"2024-05-08T18:32:47.079379+0000","last_clean":"2024-05-08T18:32:47.079379+0000","last_became_active":"2024-05-08T18:29:34.495882+0000","last_became_peered":"2024-05-08T18:29:34.495882+0000","last_unstale":"2024-05-08T18:32:47.079379+0000","last_undegraded":"2024-05-08T18:32:47.079379+0000","last_fullsized":"2024-05-08T18:32:47.079379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:55.793312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"93'8","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.059323+0000","last_change":"2024-05-08T18:29:40.554353+0000","last_active":"2024-05-08T18:32:46.059323+0000","last_peered":"2024-05-08T18:32:46.059323+0000","last_clean":"2024-05-08T18:32:46.059323+0000","last_became_active":"2024-05-08T18:29:40.553527+0000","last_became_peered":"2024-05-08T18:29:40.553527+0000","last_unstale":"2024-05-08T18:32:46.059323+0000","last_undegraded":"2024-05-08T18:32:46.059323+0000","last_fullsized":"2024-05-08T18:32:46.059323+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:03:42.148647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":189,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863485+0000","last_change":"2024-05-08T18:29:44.597411+0000","last_active":"2024-05-08T18:32:46.863485+0000","last_peered":"2024-05-08T18:32:46.863485+0000","last_clean":"2024-05-08T18:32:46.863485+0000","last_became_active":"2024-05-08T18:29:44.596678+0000","last_became_peered":"2024-05-08T18:29:44.596678+0000","last_unstale":"2024-05-08T18:32:46.863485+0000","last_undegraded":"2024-05-08T18:32:46.863485+0000","last_fullsized":"2024-05-08T18:32:46.863485+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:37:23.674968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"97'13","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.066095+0000","last_change":"2024-05-08T18:29:46.607040+0000","last_active":"2024-05-08T18:32:46.066095+0000","last_peered":"2024-05-08T18:32:46.066095+0000","last_clean":"2024-05-08T18:32:46.066095+0000","last_became_active":"2024-05-08T18:29:46.606367+0000","last_became_peered":"2024-05-08T18:29:46.606367+0000","last_unstale":"2024-05-08T18:32:46.066095+0000","last_undegraded":"2024-05-08T18:32:46.066095+0000","last_fullsized":"2024-05-08T18:32:46.066095+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:59:26.650126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.850025+0000","last_change":"2024-05-08T18:29:48.632665+0000","last_active":"2024-05-08T18:32:46.850025+0000","last_peered":"2024-05-08T18:32:46.850025+0000","last_clean":"2024-05-08T18:32:46.850025+0000","last_became_active":"2024-05-08T18:29:48.631874+0000","last_became_peered":"2024-05-08T18:29:48.631874+0000","last_unstale":"2024-05-08T18:32:46.850025+0000","last_undegraded":"2024-05-08T18:32:46.850025+0000","last_fullsized":"2024-05-08T18:32:46.850025+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:06:09.390017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":176,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.078092+0000","last_change":"2024-05-08T18:29:50.683443+0000","last_active":"2024-05-08T18:32:47.078092+0000","last_peered":"2024-05-08T18:32:47.078092+0000","last_clean":"2024-05-08T18:32:47.078092+0000","last_became_active":"2024-05-08T18:29:50.682634+0000","last_became_peered":"2024-05-08T18:29:50.682634+0000","last_unstale":"2024-05-08T18:32:47.078092+0000","last_undegraded":"2024-05-08T18:32:47.078092+0000","last_fullsized":"2024-05-08T18:32:47.078092+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:10:38.951662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"80'2","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.917272+0000","last_change":"2024-05-08T18:29:42.574593+0000","last_active":"2024-05-08T18:32:46.917272+0000","last_peered":"2024-05-08T18:32:46.917272+0000","last_clean":"2024-05-08T18:32:46.917272+0000","last_became_active":"2024-05-08T18:29:42.574288+0000","last_became_peered":"2024-05-08T18:29:42.574288+0000","last_unstale":"2024-05-08T18:32:46.917272+0000","last_undegraded":"2024-05-08T18:32:46.917272+0000","last_fullsized":"2024-05-08T18:32:46.917272+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:58.320701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"93'11","reported_seq":158,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.063035+0000","last_change":"2024-05-08T18:30:20.850805+0000","last_active":"2024-05-08T18:32:46.063035+0000","last_peered":"2024-05-08T18:32:46.063035+0000","last_clean":"2024-05-08T18:32:46.063035+0000","last_became_active":"2024-05-08T18:30:20.850365+0000","last_became_peered":"2024-05-08T18:30:20.850365+0000","last_unstale":"2024-05-08T18:32:46.063035+0000","last_undegraded":"2024-05-08T18:32:46.063035+0000","last_fullsized":"2024-05-08T18:32:46.063035+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:52:21.678894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.918404+0000","last_change":"2024-05-08T18:29:34.606393+0000","last_active":"2024-05-08T18:32:46.918404+0000","last_peered":"2024-05-08T18:32:46.918404+0000","last_clean":"2024-05-08T18:32:46.918404+0000","last_became_active":"2024-05-08T18:29:34.605574+0000","last_became_peered":"2024-05-08T18:29:34.605574+0000","last_unstale":"2024-05-08T18:32:46.918404+0000","last_undegraded":"2024-05-08T18:32:46.918404+0000","last_fullsized":"2024-05-08T18:32:46.918404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:55.793312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":189,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.862948+0000","last_change":"2024-05-08T18:29:44.595127+0000","last_active":"2024-05-08T18:32:46.862948+0000","last_peered":"2024-05-08T18:32:46.862948+0000","last_clean":"2024-05-08T18:32:46.862948+0000","last_became_active":"2024-05-08T18:29:44.594642+0000","last_became_peered":"2024-05-08T18:29:44.594642+0000","last_unstale":"2024-05-08T18:32:46.862948+0000","last_undegraded":"2024-05-08T18:32:46.862948+0000","last_fullsized":"2024-05-08T18:32:46.862948+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:04:49.020450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"97'32","reported_seq":231,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.862122+0000","last_change":"2024-05-08T18:29:46.602279+0000","last_active":"2024-05-08T18:32:46.862122+0000","last_peered":"2024-05-08T18:32:46.862122+0000","last_clean":"2024-05-08T18:32:46.862122+0000","last_became_active":"2024-05-08T18:29:46.599707+0000","last_became_peered":"2024-05-08T18:29:46.599707+0000","last_unstale":"2024-05-08T18:32:46.862122+0000","last_undegraded":"2024-05-08T18:32:46.862122+0000","last_fullsized":"2024-05-08T18:32:46.862122+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:54:48.654215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62414,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":24,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.057286+0000","last_change":"2024-05-08T18:29:48.639458+0000","last_active":"2024-05-08T18:32:46.057286+0000","last_peered":"2024-05-08T18:32:46.057286+0000","last_clean":"2024-05-08T18:32:46.057286+0000","last_became_active":"2024-05-08T18:29:48.638709+0000","last_became_peered":"2024-05-08T18:29:48.638709+0000","last_unstale":"2024-05-08T18:32:46.057286+0000","last_undegraded":"2024-05-08T18:32:46.057286+0000","last_fullsized":"2024-05-08T18:32:46.057286+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:19:58.182291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"97'6","reported_seq":189,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.861327+0000","last_change":"2024-05-08T18:29:50.681077+0000","last_active":"2024-05-08T18:32:46.861327+0000","last_peered":"2024-05-08T18:32:46.861327+0000","last_clean":"2024-05-08T18:32:46.861327+0000","last_became_active":"2024-05-08T18:29:50.675766+0000","last_became_peered":"2024-05-08T18:29:50.675766+0000","last_unstale":"2024-05-08T18:32:46.861327+0000","last_undegraded":"2024-05-08T18:32:46.861327+0000","last_fullsized":"2024-05-08T18:32:46.861327+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:09:29.641515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"80'2","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863332+0000","last_change":"2024-05-08T18:29:42.571265+0000","last_active":"2024-05-08T18:32:46.863332+0000","last_peered":"2024-05-08T18:32:46.863332+0000","last_clean":"2024-05-08T18:32:46.863332+0000","last_became_active":"2024-05-08T18:29:42.570645+0000","last_became_peered":"2024-05-08T18:29:42.570645+0000","last_unstale":"2024-05-08T18:32:46.863332+0000","last_undegraded":"2024-05-08T18:32:46.863332+0000","last_fullsized":"2024-05-08T18:32:46.863332+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:30:29.452640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"93'3","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.918243+0000","last_change":"2024-05-08T18:29:40.531079+0000","last_active":"2024-05-08T18:32:46.918243+0000","last_peered":"2024-05-08T18:32:46.918243+0000","last_clean":"2024-05-08T18:32:46.918243+0000","last_became_active":"2024-05-08T18:29:40.530256+0000","last_became_peered":"2024-05-08T18:29:40.530256+0000","last_unstale":"2024-05-08T18:32:46.918243+0000","last_undegraded":"2024-05-08T18:32:46.918243+0000","last_fullsized":"2024-05-08T18:32:46.918243+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:09:42.581976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.938519+0000","last_change":"2024-05-08T18:29:34.603292+0000","last_active":"2024-05-08T18:32:46.938519+0000","last_peered":"2024-05-08T18:32:46.938519+0000","last_clean":"2024-05-08T18:32:46.938519+0000","last_became_active":"2024-05-08T18:29:34.602547+0000","last_became_peered":"2024-05-08T18:29:34.602547+0000","last_unstale":"2024-05-08T18:32:46.938519+0000","last_undegraded":"2024-05-08T18:32:46.938519+0000","last_fullsized":"2024-05-08T18:32:46.938519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:24:55.555475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.849004+0000","last_change":"2024-05-08T18:29:44.593275+0000","last_active":"2024-05-08T18:32:46.849004+0000","last_peered":"2024-05-08T18:32:46.849004+0000","last_clean":"2024-05-08T18:32:46.849004+0000","last_became_active":"2024-05-08T18:29:44.591870+0000","last_became_peered":"2024-05-08T18:29:44.591870+0000","last_unstale":"2024-05-08T18:32:46.849004+0000","last_undegraded":"2024-05-08T18:32:46.849004+0000","last_fullsized":"2024-05-08T18:32:46.849004+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:35.176971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"33'14","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.917202+0000","last_change":"2024-05-08T18:29:46.603499+0000","last_active":"2024-05-08T18:32:46.917202+0000","last_peered":"2024-05-08T18:32:46.917202+0000","last_clean":"2024-05-08T18:32:46.917202+0000","last_became_active":"2024-05-08T18:29:46.602920+0000","last_became_peered":"2024-05-08T18:29:46.602920+0000","last_unstale":"2024-05-08T18:32:46.917202+0000","last_undegraded":"2024-05-08T18:32:46.917202+0000","last_fullsized":"2024-05-08T18:32:46.917202+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:08.504882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"116'102","reported_seq":331,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:49.831864+0000","last_change":"2024-05-08T18:29:48.634915+0000","last_active":"2024-05-08T18:32:49.831864+0000","last_peered":"2024-05-08T18:32:49.831864+0000","last_clean":"2024-05-08T18:32:49.831864+0000","last_became_active":"2024-05-08T18:29:48.634280+0000","last_became_peered":"2024-05-08T18:29:48.634280+0000","last_unstale":"2024-05-08T18:32:49.831864+0000","last_undegraded":"2024-05-08T18:32:49.831864+0000","last_fullsized":"2024-05-08T18:32:49.831864+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:19:58.182291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"80'2","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.067407+0000","last_change":"2024-05-08T18:29:50.688742+0000","last_active":"2024-05-08T18:32:46.067407+0000","last_peered":"2024-05-08T18:32:46.067407+0000","last_clean":"2024-05-08T18:32:46.067407+0000","last_became_active":"2024-05-08T18:29:50.687135+0000","last_became_peered":"2024-05-08T18:29:50.687135+0000","last_unstale":"2024-05-08T18:32:46.067407+0000","last_undegraded":"2024-05-08T18:32:46.067407+0000","last_fullsized":"2024-05-08T18:32:46.067407+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:12:49.040807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"80'2","reported_seq":152,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.059948+0000","last_change":"2024-05-08T18:30:21.220561+0000","last_active":"2024-05-08T18:32:46.059948+0000","last_peered":"2024-05-08T18:32:46.059948+0000","last_clean":"2024-05-08T18:32:46.059948+0000","last_became_active":"2024-05-08T18:30:21.220196+0000","last_became_peered":"2024-05-08T18:30:21.220196+0000","last_unstale":"2024-05-08T18:32:46.059948+0000","last_undegraded":"2024-05-08T18:32:46.059948+0000","last_fullsized":"2024-05-08T18:32:46.059948+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:19:27.075761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"83'5","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.066414+0000","last_change":"2024-05-08T18:29:40.565872+0000","last_active":"2024-05-08T18:32:46.066414+0000","last_peered":"2024-05-08T18:32:46.066414+0000","last_clean":"2024-05-08T18:32:46.066414+0000","last_became_active":"2024-05-08T18:29:40.565655+0000","last_became_peered":"2024-05-08T18:29:40.565655+0000","last_unstale":"2024-05-08T18:32:46.066414+0000","last_undegraded":"2024-05-08T18:32:46.066414+0000","last_fullsized":"2024-05-08T18:32:46.066414+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:16:16.521258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.919692+0000","last_change":"2024-05-08T18:29:34.501273+0000","last_active":"2024-05-08T18:32:46.919692+0000","last_peered":"2024-05-08T18:32:46.919692+0000","last_clean":"2024-05-08T18:32:46.919692+0000","last_became_active":"2024-05-08T18:29:34.500933+0000","last_became_peered":"2024-05-08T18:29:34.500933+0000","last_unstale":"2024-05-08T18:32:46.919692+0000","last_undegraded":"2024-05-08T18:32:46.919692+0000","last_fullsized":"2024-05-08T18:32:46.919692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:35.917391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.057534+0000","last_change":"2024-05-08T18:29:44.576227+0000","last_active":"2024-05-08T18:32:46.057534+0000","last_peered":"2024-05-08T18:32:46.057534+0000","last_clean":"2024-05-08T18:32:46.057534+0000","last_became_active":"2024-05-08T18:29:44.575454+0000","last_became_peered":"2024-05-08T18:29:44.575454+0000","last_unstale":"2024-05-08T18:32:46.057534+0000","last_undegraded":"2024-05-08T18:32:46.057534+0000","last_fullsized":"2024-05-08T18:32:46.057534+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:06:05.355648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"80'11","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.058692+0000","last_change":"2024-05-08T18:29:46.609633+0000","last_active":"2024-05-08T18:32:46.058692+0000","last_peered":"2024-05-08T18:32:46.058692+0000","last_clean":"2024-05-08T18:32:46.058692+0000","last_became_active":"2024-05-08T18:29:46.603455+0000","last_became_peered":"2024-05-08T18:29:46.603455+0000","last_unstale":"2024-05-08T18:32:46.058692+0000","last_undegraded":"2024-05-08T18:32:46.058692+0000","last_fullsized":"2024-05-08T18:32:46.058692+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:07:54.654205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"116'102","reported_seq":365,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:49.831065+0000","last_change":"2024-05-08T18:29:48.637898+0000","last_active":"2024-05-08T18:32:49.831065+0000","last_peered":"2024-05-08T18:32:49.831065+0000","last_clean":"2024-05-08T18:32:49.831065+0000","last_became_active":"2024-05-08T18:29:48.637070+0000","last_became_peered":"2024-05-08T18:29:48.637070+0000","last_unstale":"2024-05-08T18:32:49.831065+0000","last_undegraded":"2024-05-08T18:32:49.831065+0000","last_fullsized":"2024-05-08T18:32:49.831065+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:03:46.392864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"84'10","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.861002+0000","last_change":"2024-05-08T18:29:50.691526+0000","last_active":"2024-05-08T18:32:46.861002+0000","last_peered":"2024-05-08T18:32:46.861002+0000","last_clean":"2024-05-08T18:32:46.861002+0000","last_became_active":"2024-05-08T18:29:50.690767+0000","last_became_peered":"2024-05-08T18:29:50.690767+0000","last_unstale":"2024-05-08T18:32:46.861002+0000","last_undegraded":"2024-05-08T18:32:46.861002+0000","last_fullsized":"2024-05-08T18:32:46.861002+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:32:29.972139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"97'16","reported_seq":229,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.057923+0000","last_change":"2024-05-08T18:29:42.562006+0000","last_active":"2024-05-08T18:32:46.057923+0000","last_peered":"2024-05-08T18:32:46.057923+0000","last_clean":"2024-05-08T18:32:46.057923+0000","last_became_active":"2024-05-08T18:29:42.560861+0000","last_became_peered":"2024-05-08T18:29:42.560861+0000","last_unstale":"2024-05-08T18:32:46.057923+0000","last_undegraded":"2024-05-08T18:32:46.057923+0000","last_fullsized":"2024-05-08T18:32:46.057923+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:36.890277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"93'9","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863638+0000","last_change":"2024-05-08T18:29:40.550529+0000","last_active":"2024-05-08T18:32:46.863638+0000","last_peered":"2024-05-08T18:32:46.863638+0000","last_clean":"2024-05-08T18:32:46.863638+0000","last_became_active":"2024-05-08T18:29:40.550241+0000","last_became_peered":"2024-05-08T18:29:40.550241+0000","last_unstale":"2024-05-08T18:32:46.863638+0000","last_undegraded":"2024-05-08T18:32:46.863638+0000","last_fullsized":"2024-05-08T18:32:46.863638+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:48.294532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.850587+0000","last_change":"2024-05-08T18:29:34.493537+0000","last_active":"2024-05-08T18:32:46.850587+0000","last_peered":"2024-05-08T18:32:46.850587+0000","last_clean":"2024-05-08T18:32:46.850587+0000","last_became_active":"2024-05-08T18:29:34.492891+0000","last_became_peered":"2024-05-08T18:29:34.492891+0000","last_unstale":"2024-05-08T18:32:46.850587+0000","last_undegraded":"2024-05-08T18:32:46.850587+0000","last_fullsized":"2024-05-08T18:32:46.850587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:09:07.992256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":189,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.063279+0000","last_change":"2024-05-08T18:29:44.590102+0000","last_active":"2024-05-08T18:32:46.063279+0000","last_peered":"2024-05-08T18:32:46.063279+0000","last_clean":"2024-05-08T18:32:46.063279+0000","last_became_active":"2024-05-08T18:29:44.589471+0000","last_became_peered":"2024-05-08T18:29:44.589471+0000","last_unstale":"2024-05-08T18:32:46.063279+0000","last_undegraded":"2024-05-08T18:32:46.063279+0000","last_fullsized":"2024-05-08T18:32:46.063279+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:14:04.085401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"97'37","reported_seq":236,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.935847+0000","last_change":"2024-05-08T18:29:46.606967+0000","last_active":"2024-05-08T18:32:46.935847+0000","last_peered":"2024-05-08T18:32:46.935847+0000","last_clean":"2024-05-08T18:32:46.935847+0000","last_became_active":"2024-05-08T18:29:46.605693+0000","last_became_peered":"2024-05-08T18:29:46.605693+0000","last_unstale":"2024-05-08T18:32:46.935847+0000","last_undegraded":"2024-05-08T18:32:46.935847+0000","last_fullsized":"2024-05-08T18:32:46.935847+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:24:13.568294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.061836+0000","last_change":"2024-05-08T18:29:48.634271+0000","last_active":"2024-05-08T18:32:46.061836+0000","last_peered":"2024-05-08T18:32:46.061836+0000","last_clean":"2024-05-08T18:32:46.061836+0000","last_became_active":"2024-05-08T18:29:48.633607+0000","last_became_peered":"2024-05-08T18:29:48.633607+0000","last_unstale":"2024-05-08T18:32:46.061836+0000","last_undegraded":"2024-05-08T18:32:46.061836+0000","last_fullsized":"2024-05-08T18:32:46.061836+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:34.806539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":176,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.079442+0000","last_change":"2024-05-08T18:29:50.685494+0000","last_active":"2024-05-08T18:32:47.079442+0000","last_peered":"2024-05-08T18:32:47.079442+0000","last_clean":"2024-05-08T18:32:47.079442+0000","last_became_active":"2024-05-08T18:29:50.684818+0000","last_became_peered":"2024-05-08T18:29:50.684818+0000","last_unstale":"2024-05-08T18:32:47.079442+0000","last_undegraded":"2024-05-08T18:32:47.079442+0000","last_fullsized":"2024-05-08T18:32:47.079442+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:22.220842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863373+0000","last_change":"2024-05-08T18:29:50.682937+0000","last_active":"2024-05-08T18:32:46.863373+0000","last_peered":"2024-05-08T18:32:46.863373+0000","last_clean":"2024-05-08T18:32:46.863373+0000","last_became_active":"2024-05-08T18:29:50.681771+0000","last_became_peered":"2024-05-08T18:29:50.681771+0000","last_unstale":"2024-05-08T18:32:46.863373+0000","last_undegraded":"2024-05-08T18:32:46.863373+0000","last_fullsized":"2024-05-08T18:32:46.863373+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:28:29.836446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"84'4","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.058933+0000","last_change":"2024-05-08T18:29:42.575909+0000","last_active":"2024-05-08T18:32:46.058933+0000","last_peered":"2024-05-08T18:32:46.058933+0000","last_clean":"2024-05-08T18:32:46.058933+0000","last_became_active":"2024-05-08T18:29:42.574877+0000","last_became_peered":"2024-05-08T18:29:42.574877+0000","last_unstale":"2024-05-08T18:32:46.058933+0000","last_undegraded":"2024-05-08T18:32:46.058933+0000","last_fullsized":"2024-05-08T18:32:46.058933+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:33.139089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"93'11","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.059190+0000","last_change":"2024-05-08T18:29:40.566496+0000","last_active":"2024-05-08T18:32:46.059190+0000","last_peered":"2024-05-08T18:32:46.059190+0000","last_clean":"2024-05-08T18:32:46.059190+0000","last_became_active":"2024-05-08T18:29:40.565874+0000","last_became_peered":"2024-05-08T18:29:40.565874+0000","last_unstale":"2024-05-08T18:32:46.059190+0000","last_undegraded":"2024-05-08T18:32:46.059190+0000","last_fullsized":"2024-05-08T18:32:46.059190+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:07.239963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.917412+0000","last_change":"2024-05-08T18:29:44.595410+0000","last_active":"2024-05-08T18:32:46.917412+0000","last_peered":"2024-05-08T18:32:46.917412+0000","last_clean":"2024-05-08T18:32:46.917412+0000","last_became_active":"2024-05-08T18:29:44.594286+0000","last_became_peered":"2024-05-08T18:29:44.594286+0000","last_unstale":"2024-05-08T18:32:46.917412+0000","last_undegraded":"2024-05-08T18:32:46.917412+0000","last_fullsized":"2024-05-08T18:32:46.917412+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:38.928160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"97'18","reported_seq":211,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.064873+0000","last_change":"2024-05-08T18:29:46.591009+0000","last_active":"2024-05-08T18:32:46.064873+0000","last_peered":"2024-05-08T18:32:46.064873+0000","last_clean":"2024-05-08T18:32:46.064873+0000","last_became_active":"2024-05-08T18:29:46.588810+0000","last_became_peered":"2024-05-08T18:29:46.588810+0000","last_unstale":"2024-05-08T18:32:46.064873+0000","last_undegraded":"2024-05-08T18:32:46.064873+0000","last_fullsized":"2024-05-08T18:32:46.064873+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:34:45.745300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.062900+0000","last_change":"2024-05-08T18:29:48.634986+0000","last_active":"2024-05-08T18:32:46.062900+0000","last_peered":"2024-05-08T18:32:46.062900+0000","last_clean":"2024-05-08T18:32:46.062900+0000","last_became_active":"2024-05-08T18:29:48.633866+0000","last_became_peered":"2024-05-08T18:29:48.633866+0000","last_unstale":"2024-05-08T18:32:46.062900+0000","last_undegraded":"2024-05-08T18:32:46.062900+0000","last_fullsized":"2024-05-08T18:32:46.062900+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:46.539830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"83'16","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.065910+0000","last_change":"2024-05-08T18:29:50.693408+0000","last_active":"2024-05-08T18:32:46.065910+0000","last_peered":"2024-05-08T18:32:46.065910+0000","last_clean":"2024-05-08T18:32:46.065910+0000","last_became_active":"2024-05-08T18:29:50.692687+0000","last_became_peered":"2024-05-08T18:29:50.692687+0000","last_unstale":"2024-05-08T18:32:46.065910+0000","last_undegraded":"2024-05-08T18:32:46.065910+0000","last_fullsized":"2024-05-08T18:32:46.065910+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:22.834262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":28,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"83'6","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.917179+0000","last_change":"2024-05-08T18:29:42.581368+0000","last_active":"2024-05-08T18:32:46.917179+0000","last_peered":"2024-05-08T18:32:46.917179+0000","last_clean":"2024-05-08T18:32:46.917179+0000","last_became_active":"2024-05-08T18:29:42.580887+0000","last_became_peered":"2024-05-08T18:29:42.580887+0000","last_unstale":"2024-05-08T18:32:46.917179+0000","last_undegraded":"2024-05-08T18:32:46.917179+0000","last_fullsized":"2024-05-08T18:32:46.917179+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:08:15.026467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"93'7","reported_seq":201,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.938046+0000","last_change":"2024-05-08T18:29:40.572770+0000","last_active":"2024-05-08T18:32:46.938046+0000","last_peered":"2024-05-08T18:32:46.938046+0000","last_clean":"2024-05-08T18:32:46.938046+0000","last_became_active":"2024-05-08T18:29:40.572079+0000","last_became_peered":"2024-05-08T18:29:40.572079+0000","last_unstale":"2024-05-08T18:32:46.938046+0000","last_undegraded":"2024-05-08T18:32:46.938046+0000","last_fullsized":"2024-05-08T18:32:46.938046+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:05.929806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":189,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.063663+0000","last_change":"2024-05-08T18:29:44.581323+0000","last_active":"2024-05-08T18:32:46.063663+0000","last_peered":"2024-05-08T18:32:46.063663+0000","last_clean":"2024-05-08T18:32:46.063663+0000","last_became_active":"2024-05-08T18:29:44.580805+0000","last_became_peered":"2024-05-08T18:29:44.580805+0000","last_unstale":"2024-05-08T18:32:46.063663+0000","last_undegraded":"2024-05-08T18:32:46.063663+0000","last_fullsized":"2024-05-08T18:32:46.063663+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:35:25.591140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"47'5","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.862030+0000","last_change":"2024-05-08T18:29:46.602495+0000","last_active":"2024-05-08T18:32:46.862030+0000","last_peered":"2024-05-08T18:32:46.862030+0000","last_clean":"2024-05-08T18:32:46.862030+0000","last_became_active":"2024-05-08T18:29:46.599789+0000","last_became_peered":"2024-05-08T18:29:46.599789+0000","last_unstale":"2024-05-08T18:32:46.862030+0000","last_undegraded":"2024-05-08T18:32:46.862030+0000","last_fullsized":"2024-05-08T18:32:46.862030+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:18:16.375808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.936013+0000","last_change":"2024-05-08T18:29:48.642994+0000","last_active":"2024-05-08T18:32:46.936013+0000","last_peered":"2024-05-08T18:32:46.936013+0000","last_clean":"2024-05-08T18:32:46.936013+0000","last_became_active":"2024-05-08T18:29:48.642056+0000","last_became_peered":"2024-05-08T18:29:48.642056+0000","last_unstale":"2024-05-08T18:32:46.936013+0000","last_undegraded":"2024-05-08T18:32:46.936013+0000","last_fullsized":"2024-05-08T18:32:46.936013+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:47:54.034851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863166+0000","last_change":"2024-05-08T18:29:50.672513+0000","last_active":"2024-05-08T18:32:46.863166+0000","last_peered":"2024-05-08T18:32:46.863166+0000","last_clean":"2024-05-08T18:32:46.863166+0000","last_became_active":"2024-05-08T18:29:50.671781+0000","last_became_peered":"2024-05-08T18:29:50.671781+0000","last_unstale":"2024-05-08T18:32:46.863166+0000","last_undegraded":"2024-05-08T18:32:46.863166+0000","last_fullsized":"2024-05-08T18:32:46.863166+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:45:34.171402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"97'2","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.062291+0000","last_change":"2024-05-08T18:29:42.576843+0000","last_active":"2024-05-08T18:32:46.062291+0000","last_peered":"2024-05-08T18:32:46.062291+0000","last_clean":"2024-05-08T18:32:46.062291+0000","last_became_active":"2024-05-08T18:29:42.576379+0000","last_became_peered":"2024-05-08T18:29:42.576379+0000","last_unstale":"2024-05-08T18:32:46.062291+0000","last_undegraded":"2024-05-08T18:32:46.062291+0000","last_fullsized":"2024-05-08T18:32:46.062291+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:20.471010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"93'12","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.080699+0000","last_change":"2024-05-08T18:29:40.542997+0000","last_active":"2024-05-08T18:32:47.080699+0000","last_peered":"2024-05-08T18:32:47.080699+0000","last_clean":"2024-05-08T18:32:47.080699+0000","last_became_active":"2024-05-08T18:29:40.542239+0000","last_became_peered":"2024-05-08T18:29:40.542239+0000","last_unstale":"2024-05-08T18:32:47.080699+0000","last_undegraded":"2024-05-08T18:32:47.080699+0000","last_fullsized":"2024-05-08T18:32:47.080699+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:14:43.555504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.935289+0000","last_change":"2024-05-08T18:29:44.594178+0000","last_active":"2024-05-08T18:32:46.935289+0000","last_peered":"2024-05-08T18:32:46.935289+0000","last_clean":"2024-05-08T18:32:46.935289+0000","last_became_active":"2024-05-08T18:29:44.592476+0000","last_became_peered":"2024-05-08T18:29:44.592476+0000","last_unstale":"2024-05-08T18:32:46.935289+0000","last_undegraded":"2024-05-08T18:32:46.935289+0000","last_fullsized":"2024-05-08T18:32:46.935289+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:04:16.093662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"97'17","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.063156+0000","last_change":"2024-05-08T18:29:46.597288+0000","last_active":"2024-05-08T18:32:46.063156+0000","last_peered":"2024-05-08T18:32:46.063156+0000","last_clean":"2024-05-08T18:32:46.063156+0000","last_became_active":"2024-05-08T18:29:46.596452+0000","last_became_peered":"2024-05-08T18:29:46.596452+0000","last_unstale":"2024-05-08T18:32:46.063156+0000","last_undegraded":"2024-05-08T18:32:46.063156+0000","last_fullsized":"2024-05-08T18:32:46.063156+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:32:43.245753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.848919+0000","last_change":"2024-05-08T18:29:48.635436+0000","last_active":"2024-05-08T18:32:46.848919+0000","last_peered":"2024-05-08T18:32:46.848919+0000","last_clean":"2024-05-08T18:32:46.848919+0000","last_became_active":"2024-05-08T18:29:48.634704+0000","last_became_peered":"2024-05-08T18:29:48.634704+0000","last_unstale":"2024-05-08T18:32:46.848919+0000","last_undegraded":"2024-05-08T18:32:46.848919+0000","last_fullsized":"2024-05-08T18:32:46.848919+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:55:52.238481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"83'2","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.079126+0000","last_change":"2024-05-08T18:29:50.687974+0000","last_active":"2024-05-08T18:32:47.079126+0000","last_peered":"2024-05-08T18:32:47.079126+0000","last_clean":"2024-05-08T18:32:47.079126+0000","last_became_active":"2024-05-08T18:29:50.687045+0000","last_became_peered":"2024-05-08T18:29:50.687045+0000","last_unstale":"2024-05-08T18:32:47.079126+0000","last_undegraded":"2024-05-08T18:32:47.079126+0000","last_fullsized":"2024-05-08T18:32:47.079126+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:55:01.894779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"97'4","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.063677+0000","last_change":"2024-05-08T18:30:20.850226+0000","last_active":"2024-05-08T18:32:46.063677+0000","last_peered":"2024-05-08T18:32:46.063677+0000","last_clean":"2024-05-08T18:32:46.063677+0000","last_became_active":"2024-05-08T18:30:20.849751+0000","last_became_peered":"2024-05-08T18:30:20.849751+0000","last_unstale":"2024-05-08T18:32:46.063677+0000","last_undegraded":"2024-05-08T18:32:46.063677+0000","last_fullsized":"2024-05-08T18:32:46.063677+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:33:31.550958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"93'13","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863945+0000","last_change":"2024-05-08T18:29:40.541112+0000","last_active":"2024-05-08T18:32:46.863945+0000","last_peered":"2024-05-08T18:32:46.863945+0000","last_clean":"2024-05-08T18:32:46.863945+0000","last_became_active":"2024-05-08T18:29:40.540835+0000","last_became_peered":"2024-05-08T18:29:40.540835+0000","last_unstale":"2024-05-08T18:32:46.863945+0000","last_undegraded":"2024-05-08T18:32:46.863945+0000","last_fullsized":"2024-05-08T18:32:46.863945+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:43:14.995191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.848912+0000","last_change":"2024-05-08T18:29:44.592033+0000","last_active":"2024-05-08T18:32:46.848912+0000","last_peered":"2024-05-08T18:32:46.848912+0000","last_clean":"2024-05-08T18:32:46.848912+0000","last_became_active":"2024-05-08T18:29:44.590454+0000","last_became_peered":"2024-05-08T18:29:44.590454+0000","last_unstale":"2024-05-08T18:32:46.848912+0000","last_undegraded":"2024-05-08T18:32:46.848912+0000","last_fullsized":"2024-05-08T18:32:46.848912+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:11:03.740365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"97'15","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.935727+0000","last_change":"2024-05-08T18:29:46.607002+0000","last_active":"2024-05-08T18:32:46.935727+0000","last_peered":"2024-05-08T18:32:46.935727+0000","last_clean":"2024-05-08T18:32:46.935727+0000","last_became_active":"2024-05-08T18:29:46.606172+0000","last_became_peered":"2024-05-08T18:29:46.606172+0000","last_unstale":"2024-05-08T18:32:46.935727+0000","last_undegraded":"2024-05-08T18:32:46.935727+0000","last_fullsized":"2024-05-08T18:32:46.935727+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:37:35.850414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.862686+0000","last_change":"2024-05-08T18:29:48.632948+0000","last_active":"2024-05-08T18:32:46.862686+0000","last_peered":"2024-05-08T18:32:46.862686+0000","last_clean":"2024-05-08T18:32:46.862686+0000","last_became_active":"2024-05-08T18:29:48.631219+0000","last_became_peered":"2024-05-08T18:29:48.631219+0000","last_unstale":"2024-05-08T18:32:46.862686+0000","last_undegraded":"2024-05-08T18:32:46.862686+0000","last_fullsized":"2024-05-08T18:32:46.862686+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:19:01.454355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.850370+0000","last_change":"2024-05-08T18:29:42.570180+0000","last_active":"2024-05-08T18:32:46.850370+0000","last_peered":"2024-05-08T18:32:46.850370+0000","last_clean":"2024-05-08T18:32:46.850370+0000","last_became_active":"2024-05-08T18:29:42.569425+0000","last_became_peered":"2024-05-08T18:29:42.569425+0000","last_unstale":"2024-05-08T18:32:46.850370+0000","last_undegraded":"2024-05-08T18:32:46.850370+0000","last_fullsized":"2024-05-08T18:32:46.850370+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:35.037465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"93'8","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.064153+0000","last_change":"2024-05-08T18:29:40.547711+0000","last_active":"2024-05-08T18:32:46.064153+0000","last_peered":"2024-05-08T18:32:46.064153+0000","last_clean":"2024-05-08T18:32:46.064153+0000","last_became_active":"2024-05-08T18:29:40.547479+0000","last_became_peered":"2024-05-08T18:29:40.547479+0000","last_unstale":"2024-05-08T18:32:46.064153+0000","last_undegraded":"2024-05-08T18:32:46.064153+0000","last_fullsized":"2024-05-08T18:32:46.064153+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:12:40.901620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":189,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863409+0000","last_change":"2024-05-08T18:29:44.591547+0000","last_active":"2024-05-08T18:32:46.863409+0000","last_peered":"2024-05-08T18:32:46.863409+0000","last_clean":"2024-05-08T18:32:46.863409+0000","last_became_active":"2024-05-08T18:29:44.590498+0000","last_became_peered":"2024-05-08T18:29:44.590498+0000","last_unstale":"2024-05-08T18:32:46.863409+0000","last_undegraded":"2024-05-08T18:32:46.863409+0000","last_fullsized":"2024-05-08T18:32:46.863409+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:14:04.085401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"97'25","reported_seq":223,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.918610+0000","last_change":"2024-05-08T18:29:46.600437+0000","last_active":"2024-05-08T18:32:46.918610+0000","last_peered":"2024-05-08T18:32:46.918610+0000","last_clean":"2024-05-08T18:32:46.918610+0000","last_became_active":"2024-05-08T18:29:46.594672+0000","last_became_peered":"2024-05-08T18:29:46.594672+0000","last_unstale":"2024-05-08T18:32:46.918610+0000","last_undegraded":"2024-05-08T18:32:46.918610+0000","last_fullsized":"2024-05-08T18:32:46.918610+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:35:53.294312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":180,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.079232+0000","last_change":"2024-05-08T18:29:48.639840+0000","last_active":"2024-05-08T18:32:47.079232+0000","last_peered":"2024-05-08T18:32:47.079232+0000","last_clean":"2024-05-08T18:32:47.079232+0000","last_became_active":"2024-05-08T18:29:48.639120+0000","last_became_peered":"2024-05-08T18:29:48.639120+0000","last_unstale":"2024-05-08T18:32:47.079232+0000","last_undegraded":"2024-05-08T18:32:47.079232+0000","last_fullsized":"2024-05-08T18:32:47.079232+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:13:50.865474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"84'2","reported_seq":180,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.062460+0000","last_change":"2024-05-08T18:29:50.684843+0000","last_active":"2024-05-08T18:32:46.062460+0000","last_peered":"2024-05-08T18:32:46.062460+0000","last_clean":"2024-05-08T18:32:46.062460+0000","last_became_active":"2024-05-08T18:29:50.684119+0000","last_became_peered":"2024-05-08T18:29:50.684119+0000","last_unstale":"2024-05-08T18:32:46.062460+0000","last_undegraded":"2024-05-08T18:32:46.062460+0000","last_fullsized":"2024-05-08T18:32:46.062460+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:09:29.641515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"80'2","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863501+0000","last_change":"2024-05-08T18:29:42.575763+0000","last_active":"2024-05-08T18:32:46.863501+0000","last_peered":"2024-05-08T18:32:46.863501+0000","last_clean":"2024-05-08T18:32:46.863501+0000","last_became_active":"2024-05-08T18:29:42.575450+0000","last_became_peered":"2024-05-08T18:29:42.575450+0000","last_unstale":"2024-05-08T18:32:46.863501+0000","last_undegraded":"2024-05-08T18:32:46.863501+0000","last_fullsized":"2024-05-08T18:32:46.863501+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:20.471010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"93'10","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.917742+0000","last_change":"2024-05-08T18:29:40.546101+0000","last_active":"2024-05-08T18:32:46.917742+0000","last_peered":"2024-05-08T18:32:46.917742+0000","last_clean":"2024-05-08T18:32:46.917742+0000","last_became_active":"2024-05-08T18:29:40.545814+0000","last_became_peered":"2024-05-08T18:29:40.545814+0000","last_unstale":"2024-05-08T18:32:46.917742+0000","last_undegraded":"2024-05-08T18:32:46.917742+0000","last_fullsized":"2024-05-08T18:32:46.917742+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:22.579629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.850156+0000","last_change":"2024-05-08T18:29:44.591310+0000","last_active":"2024-05-08T18:32:46.850156+0000","last_peered":"2024-05-08T18:32:46.850156+0000","last_clean":"2024-05-08T18:32:46.850156+0000","last_became_active":"2024-05-08T18:29:44.590394+0000","last_became_peered":"2024-05-08T18:29:44.590394+0000","last_unstale":"2024-05-08T18:32:46.850156+0000","last_undegraded":"2024-05-08T18:32:46.850156+0000","last_fullsized":"2024-05-08T18:32:46.850156+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:02:28.348982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"97'21","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.936870+0000","last_change":"2024-05-08T18:29:46.605887+0000","last_active":"2024-05-08T18:32:46.936870+0000","last_peered":"2024-05-08T18:32:46.936870+0000","last_clean":"2024-05-08T18:32:46.936870+0000","last_became_active":"2024-05-08T18:29:46.604917+0000","last_became_peered":"2024-05-08T18:29:46.604917+0000","last_unstale":"2024-05-08T18:32:46.936870+0000","last_undegraded":"2024-05-08T18:32:46.936870+0000","last_fullsized":"2024-05-08T18:32:46.936870+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:22:36.338527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.918794+0000","last_change":"2024-05-08T18:29:48.644420+0000","last_active":"2024-05-08T18:32:46.918794+0000","last_peered":"2024-05-08T18:32:46.918794+0000","last_clean":"2024-05-08T18:32:46.918794+0000","last_became_active":"2024-05-08T18:29:48.643493+0000","last_became_peered":"2024-05-08T18:29:48.643493+0000","last_unstale":"2024-05-08T18:32:46.918794+0000","last_undegraded":"2024-05-08T18:32:46.918794+0000","last_fullsized":"2024-05-08T18:32:46.918794+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:19:33.148012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":174,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.848670+0000","last_change":"2024-05-08T18:29:50.687485+0000","last_active":"2024-05-08T18:32:46.848670+0000","last_peered":"2024-05-08T18:32:46.848670+0000","last_clean":"2024-05-08T18:32:46.848670+0000","last_became_active":"2024-05-08T18:29:50.686750+0000","last_became_peered":"2024-05-08T18:29:50.686750+0000","last_unstale":"2024-05-08T18:32:46.848670+0000","last_undegraded":"2024-05-08T18:32:46.848670+0000","last_fullsized":"2024-05-08T18:32:46.848670+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:41.914164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"97'4","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.066425+0000","last_change":"2024-05-08T18:29:42.566571+0000","last_active":"2024-05-08T18:32:46.066425+0000","last_peered":"2024-05-08T18:32:46.066425+0000","last_clean":"2024-05-08T18:32:46.066425+0000","last_became_active":"2024-05-08T18:29:42.563695+0000","last_became_peered":"2024-05-08T18:29:42.563695+0000","last_unstale":"2024-05-08T18:32:46.066425+0000","last_undegraded":"2024-05-08T18:32:46.066425+0000","last_fullsized":"2024-05-08T18:32:46.066425+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:46.887628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"93'10","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.059150+0000","last_change":"2024-05-08T18:29:40.545512+0000","last_active":"2024-05-08T18:32:46.059150+0000","last_peered":"2024-05-08T18:32:46.059150+0000","last_clean":"2024-05-08T18:32:46.059150+0000","last_became_active":"2024-05-08T18:29:40.544216+0000","last_became_peered":"2024-05-08T18:29:40.544216+0000","last_unstale":"2024-05-08T18:32:46.059150+0000","last_undegraded":"2024-05-08T18:32:46.059150+0000","last_fullsized":"2024-05-08T18:32:46.059150+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:37:08.242362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.060557+0000","last_change":"2024-05-08T18:29:44.576107+0000","last_active":"2024-05-08T18:32:46.060557+0000","last_peered":"2024-05-08T18:32:46.060557+0000","last_clean":"2024-05-08T18:32:46.060557+0000","last_became_active":"2024-05-08T18:29:44.575344+0000","last_became_peered":"2024-05-08T18:29:44.575344+0000","last_unstale":"2024-05-08T18:32:46.060557+0000","last_undegraded":"2024-05-08T18:32:46.060557+0000","last_fullsized":"2024-05-08T18:32:46.060557+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:19.731003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"97'17","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.067703+0000","last_change":"2024-05-08T18:29:46.584785+0000","last_active":"2024-05-08T18:32:46.067703+0000","last_peered":"2024-05-08T18:32:46.067703+0000","last_clean":"2024-05-08T18:32:46.067703+0000","last_became_active":"2024-05-08T18:29:46.583390+0000","last_became_peered":"2024-05-08T18:29:46.583390+0000","last_unstale":"2024-05-08T18:32:46.067703+0000","last_undegraded":"2024-05-08T18:32:46.067703+0000","last_fullsized":"2024-05-08T18:32:46.067703+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:27:01.747339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.919301+0000","last_change":"2024-05-08T18:29:48.643558+0000","last_active":"2024-05-08T18:32:46.919301+0000","last_peered":"2024-05-08T18:32:46.919301+0000","last_clean":"2024-05-08T18:32:46.919301+0000","last_became_active":"2024-05-08T18:29:48.642773+0000","last_became_peered":"2024-05-08T18:29:48.642773+0000","last_unstale":"2024-05-08T18:32:46.919301+0000","last_undegraded":"2024-05-08T18:32:46.919301+0000","last_fullsized":"2024-05-08T18:32:46.919301+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:59:04.369806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":176,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.078353+0000","last_change":"2024-05-08T18:29:50.674796+0000","last_active":"2024-05-08T18:32:47.078353+0000","last_peered":"2024-05-08T18:32:47.078353+0000","last_clean":"2024-05-08T18:32:47.078353+0000","last_became_active":"2024-05-08T18:29:50.674057+0000","last_became_peered":"2024-05-08T18:29:50.674057+0000","last_unstale":"2024-05-08T18:32:47.078353+0000","last_undegraded":"2024-05-08T18:32:47.078353+0000","last_fullsized":"2024-05-08T18:32:47.078353+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:34:14.488295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"84'4","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.062561+0000","last_change":"2024-05-08T18:29:42.577642+0000","last_active":"2024-05-08T18:32:46.062561+0000","last_peered":"2024-05-08T18:32:46.062561+0000","last_clean":"2024-05-08T18:32:46.062561+0000","last_became_active":"2024-05-08T18:29:42.577275+0000","last_became_peered":"2024-05-08T18:29:42.577275+0000","last_unstale":"2024-05-08T18:32:46.062561+0000","last_undegraded":"2024-05-08T18:32:46.062561+0000","last_fullsized":"2024-05-08T18:32:46.062561+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:51:45.155037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"93'10","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.862767+0000","last_change":"2024-05-08T18:29:40.562873+0000","last_active":"2024-05-08T18:32:46.862767+0000","last_peered":"2024-05-08T18:32:46.862767+0000","last_clean":"2024-05-08T18:32:46.862767+0000","last_became_active":"2024-05-08T18:29:40.562594+0000","last_became_peered":"2024-05-08T18:29:40.562594+0000","last_unstale":"2024-05-08T18:32:46.862767+0000","last_undegraded":"2024-05-08T18:32:46.862767+0000","last_fullsized":"2024-05-08T18:32:46.862767+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:16:16.521258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.918959+0000","last_change":"2024-05-08T18:29:44.594152+0000","last_active":"2024-05-08T18:32:46.918959+0000","last_peered":"2024-05-08T18:32:46.918959+0000","last_clean":"2024-05-08T18:32:46.918959+0000","last_became_active":"2024-05-08T18:29:44.593398+0000","last_became_peered":"2024-05-08T18:29:44.593398+0000","last_unstale":"2024-05-08T18:32:46.918959+0000","last_undegraded":"2024-05-08T18:32:46.918959+0000","last_fullsized":"2024-05-08T18:32:46.918959+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:11.825480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"85'12","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.059653+0000","last_change":"2024-05-08T18:29:46.602137+0000","last_active":"2024-05-08T18:32:46.059653+0000","last_peered":"2024-05-08T18:32:46.059653+0000","last_clean":"2024-05-08T18:32:46.059653+0000","last_became_active":"2024-05-08T18:29:46.601402+0000","last_became_peered":"2024-05-08T18:29:46.601402+0000","last_unstale":"2024-05-08T18:32:46.059653+0000","last_undegraded":"2024-05-08T18:32:46.059653+0000","last_fullsized":"2024-05-08T18:32:46.059653+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:23.940519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":22,"num_read_kb":17,"num_write":24,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"116'102","reported_seq":329,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:49.831643+0000","last_change":"2024-05-08T18:29:48.635696+0000","last_active":"2024-05-08T18:32:49.831643+0000","last_peered":"2024-05-08T18:32:49.831643+0000","last_clean":"2024-05-08T18:32:49.831643+0000","last_became_active":"2024-05-08T18:29:48.634859+0000","last_became_peered":"2024-05-08T18:29:48.634859+0000","last_unstale":"2024-05-08T18:32:49.831643+0000","last_undegraded":"2024-05-08T18:32:49.831643+0000","last_fullsized":"2024-05-08T18:32:49.831643+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:35:55.322495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":174,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.935107+0000","last_change":"2024-05-08T18:29:50.679757+0000","last_active":"2024-05-08T18:32:46.935107+0000","last_peered":"2024-05-08T18:32:46.935107+0000","last_clean":"2024-05-08T18:32:46.935107+0000","last_became_active":"2024-05-08T18:29:50.679011+0000","last_became_peered":"2024-05-08T18:29:50.679011+0000","last_unstale":"2024-05-08T18:32:46.935107+0000","last_undegraded":"2024-05-08T18:32:46.935107+0000","last_fullsized":"2024-05-08T18:32:46.935107+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:34:14.488295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"84'8","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.058657+0000","last_change":"2024-05-08T18:29:42.560354+0000","last_active":"2024-05-08T18:32:46.058657+0000","last_peered":"2024-05-08T18:32:46.058657+0000","last_clean":"2024-05-08T18:32:46.058657+0000","last_became_active":"2024-05-08T18:29:42.559647+0000","last_became_peered":"2024-05-08T18:29:42.559647+0000","last_unstale":"2024-05-08T18:32:46.058657+0000","last_undegraded":"2024-05-08T18:32:46.058657+0000","last_fullsized":"2024-05-08T18:32:46.058657+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:18:10.803989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"93'10","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.079570+0000","last_change":"2024-05-08T18:29:40.557683+0000","last_active":"2024-05-08T18:32:47.079570+0000","last_peered":"2024-05-08T18:32:47.079570+0000","last_clean":"2024-05-08T18:32:47.079570+0000","last_became_active":"2024-05-08T18:29:40.556254+0000","last_became_peered":"2024-05-08T18:29:40.556254+0000","last_unstale":"2024-05-08T18:32:47.079570+0000","last_undegraded":"2024-05-08T18:32:47.079570+0000","last_fullsized":"2024-05-08T18:32:47.079570+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:51:43.135322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.936035+0000","last_change":"2024-05-08T18:29:44.594068+0000","last_active":"2024-05-08T18:32:46.936035+0000","last_peered":"2024-05-08T18:32:46.936035+0000","last_clean":"2024-05-08T18:32:46.936035+0000","last_became_active":"2024-05-08T18:29:44.593322+0000","last_became_peered":"2024-05-08T18:29:44.593322+0000","last_unstale":"2024-05-08T18:32:46.936035+0000","last_undegraded":"2024-05-08T18:32:46.936035+0000","last_fullsized":"2024-05-08T18:32:46.936035+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:19.731003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"97'22","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.078642+0000","last_change":"2024-05-08T18:29:46.604700+0000","last_active":"2024-05-08T18:32:47.078642+0000","last_peered":"2024-05-08T18:32:47.078642+0000","last_clean":"2024-05-08T18:32:47.078642+0000","last_became_active":"2024-05-08T18:29:46.603885+0000","last_became_peered":"2024-05-08T18:29:46.603885+0000","last_unstale":"2024-05-08T18:32:47.078642+0000","last_undegraded":"2024-05-08T18:32:47.078642+0000","last_fullsized":"2024-05-08T18:32:47.078642+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:22:36.338527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9698,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":18,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.861740+0000","last_change":"2024-05-08T18:29:48.640814+0000","last_active":"2024-05-08T18:32:46.861740+0000","last_peered":"2024-05-08T18:32:46.861740+0000","last_clean":"2024-05-08T18:32:46.861740+0000","last_became_active":"2024-05-08T18:29:48.640046+0000","last_became_peered":"2024-05-08T18:29:48.640046+0000","last_unstale":"2024-05-08T18:32:46.861740+0000","last_undegraded":"2024-05-08T18:32:46.861740+0000","last_fullsized":"2024-05-08T18:32:46.861740+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:53:21.219706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"83'8","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.938436+0000","last_change":"2024-05-08T18:29:50.692688+0000","last_active":"2024-05-08T18:32:46.938436+0000","last_peered":"2024-05-08T18:32:46.938436+0000","last_clean":"2024-05-08T18:32:46.938436+0000","last_became_active":"2024-05-08T18:29:50.692123+0000","last_became_peered":"2024-05-08T18:29:50.692123+0000","last_unstale":"2024-05-08T18:32:46.938436+0000","last_undegraded":"2024-05-08T18:32:46.938436+0000","last_fullsized":"2024-05-08T18:32:46.938436+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:38.318890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"97'2","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.058878+0000","last_change":"2024-05-08T18:29:42.558336+0000","last_active":"2024-05-08T18:32:46.058878+0000","last_peered":"2024-05-08T18:32:46.058878+0000","last_clean":"2024-05-08T18:32:46.058878+0000","last_became_active":"2024-05-08T18:29:42.557570+0000","last_became_peered":"2024-05-08T18:29:42.557570+0000","last_unstale":"2024-05-08T18:32:46.058878+0000","last_undegraded":"2024-05-08T18:32:46.058878+0000","last_fullsized":"2024-05-08T18:32:46.058878+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:54:16.539832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"84'2","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.080664+0000","last_change":"2024-05-08T18:29:40.537090+0000","last_active":"2024-05-08T18:32:47.080664+0000","last_peered":"2024-05-08T18:32:47.080664+0000","last_clean":"2024-05-08T18:32:47.080664+0000","last_became_active":"2024-05-08T18:29:40.536188+0000","last_became_peered":"2024-05-08T18:29:40.536188+0000","last_unstale":"2024-05-08T18:32:47.080664+0000","last_undegraded":"2024-05-08T18:32:47.080664+0000","last_fullsized":"2024-05-08T18:32:47.080664+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:22:48.880581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.078799+0000","last_change":"2024-05-08T18:29:44.578901+0000","last_active":"2024-05-08T18:32:47.078799+0000","last_peered":"2024-05-08T18:32:47.078799+0000","last_clean":"2024-05-08T18:32:47.078799+0000","last_became_active":"2024-05-08T18:29:44.578171+0000","last_became_peered":"2024-05-08T18:29:44.578171+0000","last_unstale":"2024-05-08T18:32:47.078799+0000","last_undegraded":"2024-05-08T18:32:47.078799+0000","last_fullsized":"2024-05-08T18:32:47.078799+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:19.731003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"97'17","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.861874+0000","last_change":"2024-05-08T18:29:46.604539+0000","last_active":"2024-05-08T18:32:46.861874+0000","last_peered":"2024-05-08T18:32:46.861874+0000","last_clean":"2024-05-08T18:32:46.861874+0000","last_became_active":"2024-05-08T18:29:46.603728+0000","last_became_peered":"2024-05-08T18:29:46.603728+0000","last_unstale":"2024-05-08T18:32:46.861874+0000","last_undegraded":"2024-05-08T18:32:46.861874+0000","last_fullsized":"2024-05-08T18:32:46.861874+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:12:41.226788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.848661+0000","last_change":"2024-05-08T18:29:48.635813+0000","last_active":"2024-05-08T18:32:46.848661+0000","last_peered":"2024-05-08T18:32:46.848661+0000","last_clean":"2024-05-08T18:32:46.848661+0000","last_became_active":"2024-05-08T18:29:48.634664+0000","last_became_peered":"2024-05-08T18:29:48.634664+0000","last_unstale":"2024-05-08T18:32:46.848661+0000","last_undegraded":"2024-05-08T18:32:46.848661+0000","last_fullsized":"2024-05-08T18:32:46.848661+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:27:23.427365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"97'7","reported_seq":187,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.066075+0000","last_change":"2024-05-08T18:29:50.687517+0000","last_active":"2024-05-08T18:32:46.066075+0000","last_peered":"2024-05-08T18:32:46.066075+0000","last_clean":"2024-05-08T18:32:46.066075+0000","last_became_active":"2024-05-08T18:29:50.686662+0000","last_became_peered":"2024-05-08T18:29:50.686662+0000","last_unstale":"2024-05-08T18:32:46.066075+0000","last_undegraded":"2024-05-08T18:32:46.066075+0000","last_fullsized":"2024-05-08T18:32:46.066075+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:58:00.455559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"97'4","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.062709+0000","last_change":"2024-05-08T18:29:42.558848+0000","last_active":"2024-05-08T18:32:46.062709+0000","last_peered":"2024-05-08T18:32:46.062709+0000","last_clean":"2024-05-08T18:32:46.062709+0000","last_became_active":"2024-05-08T18:29:42.558390+0000","last_became_peered":"2024-05-08T18:29:42.558390+0000","last_unstale":"2024-05-08T18:32:46.062709+0000","last_undegraded":"2024-05-08T18:32:46.062709+0000","last_fullsized":"2024-05-08T18:32:46.062709+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:55:30.468069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"93'8","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.066372+0000","last_change":"2024-05-08T18:29:40.567772+0000","last_active":"2024-05-08T18:32:46.066372+0000","last_peered":"2024-05-08T18:32:46.066372+0000","last_clean":"2024-05-08T18:32:46.066372+0000","last_became_active":"2024-05-08T18:29:40.567482+0000","last_became_peered":"2024-05-08T18:29:40.567482+0000","last_unstale":"2024-05-08T18:32:46.066372+0000","last_undegraded":"2024-05-08T18:32:46.066372+0000","last_fullsized":"2024-05-08T18:32:46.066372+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:36:37.796095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":5,"num_write":18,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.057189+0000","last_change":"2024-05-08T18:29:44.596876+0000","last_active":"2024-05-08T18:32:46.057189+0000","last_peered":"2024-05-08T18:32:46.057189+0000","last_clean":"2024-05-08T18:32:46.057189+0000","last_became_active":"2024-05-08T18:29:44.595712+0000","last_became_peered":"2024-05-08T18:29:44.595712+0000","last_unstale":"2024-05-08T18:32:46.057189+0000","last_undegraded":"2024-05-08T18:32:46.057189+0000","last_fullsized":"2024-05-08T18:32:46.057189+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:35:51.288126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"97'11","reported_seq":201,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.064975+0000","last_change":"2024-05-08T18:29:46.598637+0000","last_active":"2024-05-08T18:32:46.064975+0000","last_peered":"2024-05-08T18:32:46.064975+0000","last_clean":"2024-05-08T18:32:46.064975+0000","last_became_active":"2024-05-08T18:29:46.597394+0000","last_became_peered":"2024-05-08T18:29:46.597394+0000","last_unstale":"2024-05-08T18:32:46.064975+0000","last_undegraded":"2024-05-08T18:32:46.064975+0000","last_fullsized":"2024-05-08T18:32:46.064975+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:52:22.540814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.057643+0000","last_change":"2024-05-08T18:29:48.642251+0000","last_active":"2024-05-08T18:32:46.057643+0000","last_peered":"2024-05-08T18:32:46.057643+0000","last_clean":"2024-05-08T18:32:46.057643+0000","last_became_active":"2024-05-08T18:29:48.641666+0000","last_became_peered":"2024-05-08T18:29:48.641666+0000","last_unstale":"2024-05-08T18:32:46.057643+0000","last_undegraded":"2024-05-08T18:32:46.057643+0000","last_fullsized":"2024-05-08T18:32:46.057643+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:13:50.865474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"80'2","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.937644+0000","last_change":"2024-05-08T18:29:50.685668+0000","last_active":"2024-05-08T18:32:46.937644+0000","last_peered":"2024-05-08T18:32:46.937644+0000","last_clean":"2024-05-08T18:32:46.937644+0000","last_became_active":"2024-05-08T18:29:50.684958+0000","last_became_peered":"2024-05-08T18:29:50.684958+0000","last_unstale":"2024-05-08T18:32:46.937644+0000","last_undegraded":"2024-05-08T18:32:46.937644+0000","last_fullsized":"2024-05-08T18:32:46.937644+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:55:01.894779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.057760+0000","last_change":"2024-05-08T18:29:42.562063+0000","last_active":"2024-05-08T18:32:46.057760+0000","last_peered":"2024-05-08T18:32:46.057760+0000","last_clean":"2024-05-08T18:32:46.057760+0000","last_became_active":"2024-05-08T18:29:42.558871+0000","last_became_peered":"2024-05-08T18:29:42.558871+0000","last_unstale":"2024-05-08T18:32:46.057760+0000","last_undegraded":"2024-05-08T18:32:46.057760+0000","last_fullsized":"2024-05-08T18:32:46.057760+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:59.243324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"93'13","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863884+0000","last_change":"2024-05-08T18:29:40.541070+0000","last_active":"2024-05-08T18:32:46.863884+0000","last_peered":"2024-05-08T18:32:46.863884+0000","last_clean":"2024-05-08T18:32:46.863884+0000","last_became_active":"2024-05-08T18:29:40.540767+0000","last_became_peered":"2024-05-08T18:29:40.540767+0000","last_unstale":"2024-05-08T18:32:46.863884+0000","last_undegraded":"2024-05-08T18:32:46.863884+0000","last_fullsized":"2024-05-08T18:32:46.863884+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:09:39.835826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"26'1","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.917294+0000","last_change":"2024-05-08T18:29:44.592737+0000","last_active":"2024-05-08T18:32:46.917294+0000","last_peered":"2024-05-08T18:32:46.917294+0000","last_clean":"2024-05-08T18:32:46.917294+0000","last_became_active":"2024-05-08T18:29:44.592243+0000","last_became_peered":"2024-05-08T18:29:44.592243+0000","last_unstale":"2024-05-08T18:32:46.917294+0000","last_undegraded":"2024-05-08T18:32:46.917294+0000","last_fullsized":"2024-05-08T18:32:46.917294+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:59.744050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"97'16","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.058346+0000","last_change":"2024-05-08T18:29:46.610835+0000","last_active":"2024-05-08T18:32:46.058346+0000","last_peered":"2024-05-08T18:32:46.058346+0000","last_clean":"2024-05-08T18:32:46.058346+0000","last_became_active":"2024-05-08T18:29:46.609903+0000","last_became_peered":"2024-05-08T18:29:46.609903+0000","last_unstale":"2024-05-08T18:32:46.058346+0000","last_undegraded":"2024-05-08T18:32:46.058346+0000","last_fullsized":"2024-05-08T18:32:46.058346+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:37:35.850414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.862608+0000","last_change":"2024-05-08T18:29:48.629822+0000","last_active":"2024-05-08T18:32:46.862608+0000","last_peered":"2024-05-08T18:32:46.862608+0000","last_clean":"2024-05-08T18:32:46.862608+0000","last_became_active":"2024-05-08T18:29:48.629204+0000","last_became_peered":"2024-05-08T18:29:48.629204+0000","last_unstale":"2024-05-08T18:32:46.862608+0000","last_undegraded":"2024-05-08T18:32:46.862608+0000","last_fullsized":"2024-05-08T18:32:46.862608+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:04.571608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"84'6","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.060640+0000","last_change":"2024-05-08T18:29:50.668101+0000","last_active":"2024-05-08T18:32:46.060640+0000","last_peered":"2024-05-08T18:32:46.060640+0000","last_clean":"2024-05-08T18:32:46.060640+0000","last_became_active":"2024-05-08T18:29:50.667357+0000","last_became_peered":"2024-05-08T18:29:50.667357+0000","last_unstale":"2024-05-08T18:32:46.060640+0000","last_undegraded":"2024-05-08T18:32:46.060640+0000","last_fullsized":"2024-05-08T18:32:46.060640+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:55:01.894779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"97'4","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.919471+0000","last_change":"2024-05-08T18:29:42.581366+0000","last_active":"2024-05-08T18:32:46.919471+0000","last_peered":"2024-05-08T18:32:46.919471+0000","last_clean":"2024-05-08T18:32:46.919471+0000","last_became_active":"2024-05-08T18:29:42.580988+0000","last_became_peered":"2024-05-08T18:29:42.580988+0000","last_unstale":"2024-05-08T18:32:46.919471+0000","last_undegraded":"2024-05-08T18:32:46.919471+0000","last_fullsized":"2024-05-08T18:32:46.919471+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:42.005809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"84'9","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.848329+0000","last_change":"2024-05-08T18:29:40.562025+0000","last_active":"2024-05-08T18:32:46.848329+0000","last_peered":"2024-05-08T18:32:46.848329+0000","last_clean":"2024-05-08T18:32:46.848329+0000","last_became_active":"2024-05-08T18:29:40.561277+0000","last_became_peered":"2024-05-08T18:29:40.561277+0000","last_unstale":"2024-05-08T18:32:46.848329+0000","last_undegraded":"2024-05-08T18:32:46.848329+0000","last_fullsized":"2024-05-08T18:32:46.848329+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:59:25.840149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":19,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.916111+0000","last_change":"2024-05-08T18:29:42.573832+0000","last_active":"2024-05-08T18:32:46.916111+0000","last_peered":"2024-05-08T18:32:46.916111+0000","last_clean":"2024-05-08T18:32:46.916111+0000","last_became_active":"2024-05-08T18:29:42.573502+0000","last_became_peered":"2024-05-08T18:29:42.573502+0000","last_unstale":"2024-05-08T18:32:46.916111+0000","last_undegraded":"2024-05-08T18:32:46.916111+0000","last_fullsized":"2024-05-08T18:32:46.916111+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:35.037465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"93'8","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.060494+0000","last_change":"2024-05-08T18:29:40.533094+0000","last_active":"2024-05-08T18:32:46.060494+0000","last_peered":"2024-05-08T18:32:46.060494+0000","last_clean":"2024-05-08T18:32:46.060494+0000","last_became_active":"2024-05-08T18:29:40.532246+0000","last_became_peered":"2024-05-08T18:29:40.532246+0000","last_unstale":"2024-05-08T18:32:46.060494+0000","last_undegraded":"2024-05-08T18:32:46.060494+0000","last_fullsized":"2024-05-08T18:32:46.060494+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:37:08.242362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.080244+0000","last_change":"2024-05-08T18:29:42.565298+0000","last_active":"2024-05-08T18:32:47.080244+0000","last_peered":"2024-05-08T18:32:47.080244+0000","last_clean":"2024-05-08T18:32:47.080244+0000","last_became_active":"2024-05-08T18:29:42.564542+0000","last_became_peered":"2024-05-08T18:29:42.564542+0000","last_unstale":"2024-05-08T18:32:47.080244+0000","last_undegraded":"2024-05-08T18:32:47.080244+0000","last_fullsized":"2024-05-08T18:32:47.080244+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:57.706167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"93'14","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.079157+0000","last_change":"2024-05-08T18:29:40.556958+0000","last_active":"2024-05-08T18:32:47.079157+0000","last_peered":"2024-05-08T18:32:47.079157+0000","last_clean":"2024-05-08T18:32:47.079157+0000","last_became_active":"2024-05-08T18:29:40.556091+0000","last_became_peered":"2024-05-08T18:29:40.556091+0000","last_unstale":"2024-05-08T18:32:47.079157+0000","last_undegraded":"2024-05-08T18:32:47.079157+0000","last_fullsized":"2024-05-08T18:32:47.079157+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:39.986094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"97'6","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.918325+0000","last_change":"2024-05-08T18:29:42.574619+0000","last_active":"2024-05-08T18:32:46.918325+0000","last_peered":"2024-05-08T18:32:46.918325+0000","last_clean":"2024-05-08T18:32:46.918325+0000","last_became_active":"2024-05-08T18:29:42.573178+0000","last_became_peered":"2024-05-08T18:29:42.573178+0000","last_unstale":"2024-05-08T18:32:46.918325+0000","last_undegraded":"2024-05-08T18:32:46.918325+0000","last_fullsized":"2024-05-08T18:32:46.918325+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:33.139089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"92'5","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.862863+0000","last_change":"2024-05-08T18:29:40.544338+0000","last_active":"2024-05-08T18:32:46.862863+0000","last_peered":"2024-05-08T18:32:46.862863+0000","last_clean":"2024-05-08T18:32:46.862863+0000","last_became_active":"2024-05-08T18:29:40.544107+0000","last_became_peered":"2024-05-08T18:29:40.544107+0000","last_unstale":"2024-05-08T18:32:46.862863+0000","last_undegraded":"2024-05-08T18:32:46.862863+0000","last_fullsized":"2024-05-08T18:32:46.862863+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:54.200883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"84'2","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.064285+0000","last_change":"2024-05-08T18:29:42.576979+0000","last_active":"2024-05-08T18:32:46.064285+0000","last_peered":"2024-05-08T18:32:46.064285+0000","last_clean":"2024-05-08T18:32:46.064285+0000","last_became_active":"2024-05-08T18:29:42.576395+0000","last_became_peered":"2024-05-08T18:29:42.576395+0000","last_unstale":"2024-05-08T18:32:46.064285+0000","last_undegraded":"2024-05-08T18:32:46.064285+0000","last_fullsized":"2024-05-08T18:32:46.064285+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:53:03.097704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"93'5","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.066660+0000","last_change":"2024-05-08T18:29:40.558142+0000","last_active":"2024-05-08T18:32:46.066660+0000","last_peered":"2024-05-08T18:32:46.066660+0000","last_clean":"2024-05-08T18:32:46.066660+0000","last_became_active":"2024-05-08T18:29:40.557874+0000","last_became_peered":"2024-05-08T18:29:40.557874+0000","last_unstale":"2024-05-08T18:32:46.066660+0000","last_undegraded":"2024-05-08T18:32:46.066660+0000","last_fullsized":"2024-05-08T18:32:46.066660+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:54.200883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"97'2","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.059136+0000","last_change":"2024-05-08T18:29:42.558324+0000","last_active":"2024-05-08T18:32:46.059136+0000","last_peered":"2024-05-08T18:32:46.059136+0000","last_clean":"2024-05-08T18:32:46.059136+0000","last_became_active":"2024-05-08T18:29:42.556774+0000","last_became_peered":"2024-05-08T18:29:42.556774+0000","last_unstale":"2024-05-08T18:32:46.059136+0000","last_undegraded":"2024-05-08T18:32:46.059136+0000","last_fullsized":"2024-05-08T18:32:46.059136+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:02:26.311100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"93'11","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.919113+0000","last_change":"2024-05-08T18:30:20.858467+0000","last_active":"2024-05-08T18:32:46.919113+0000","last_peered":"2024-05-08T18:32:46.919113+0000","last_clean":"2024-05-08T18:32:46.919113+0000","last_became_active":"2024-05-08T18:30:20.858016+0000","last_became_peered":"2024-05-08T18:30:20.858016+0000","last_unstale":"2024-05-08T18:32:46.919113+0000","last_undegraded":"2024-05-08T18:32:46.919113+0000","last_fullsized":"2024-05-08T18:32:46.919113+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:10:28.824915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"84'4","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.062025+0000","last_change":"2024-05-08T18:29:42.562772+0000","last_active":"2024-05-08T18:32:46.062025+0000","last_peered":"2024-05-08T18:32:46.062025+0000","last_clean":"2024-05-08T18:32:46.062025+0000","last_became_active":"2024-05-08T18:29:42.562420+0000","last_became_peered":"2024-05-08T18:29:42.562420+0000","last_unstale":"2024-05-08T18:32:46.062025+0000","last_undegraded":"2024-05-08T18:32:46.062025+0000","last_fullsized":"2024-05-08T18:32:46.062025+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:30:29.452640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"93'5","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.850198+0000","last_change":"2024-05-08T18:29:40.562024+0000","last_active":"2024-05-08T18:32:46.850198+0000","last_peered":"2024-05-08T18:32:46.850198+0000","last_clean":"2024-05-08T18:32:46.850198+0000","last_became_active":"2024-05-08T18:29:40.561326+0000","last_became_peered":"2024-05-08T18:29:40.561326+0000","last_unstale":"2024-05-08T18:32:46.850198+0000","last_undegraded":"2024-05-08T18:32:46.850198+0000","last_fullsized":"2024-05-08T18:32:46.850198+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:21:38.354933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"97'4","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.847229+0000","last_change":"2024-05-08T18:29:42.561419+0000","last_active":"2024-05-08T18:32:46.847229+0000","last_peered":"2024-05-08T18:32:46.847229+0000","last_clean":"2024-05-08T18:32:46.847229+0000","last_became_active":"2024-05-08T18:29:42.560520+0000","last_became_peered":"2024-05-08T18:29:42.560520+0000","last_unstale":"2024-05-08T18:32:46.847229+0000","last_undegraded":"2024-05-08T18:32:46.847229+0000","last_fullsized":"2024-05-08T18:32:46.847229+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:07.949520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"93'11","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.067225+0000","last_change":"2024-05-08T18:29:40.554884+0000","last_active":"2024-05-08T18:32:46.067225+0000","last_peered":"2024-05-08T18:32:46.067225+0000","last_clean":"2024-05-08T18:32:46.067225+0000","last_became_active":"2024-05-08T18:29:40.554603+0000","last_became_peered":"2024-05-08T18:29:40.554603+0000","last_unstale":"2024-05-08T18:32:46.067225+0000","last_undegraded":"2024-05-08T18:32:46.067225+0000","last_fullsized":"2024-05-08T18:32:46.067225+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:09:39.835826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"84'4","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.861066+0000","last_change":"2024-05-08T18:29:42.574689+0000","last_active":"2024-05-08T18:32:46.861066+0000","last_peered":"2024-05-08T18:32:46.861066+0000","last_clean":"2024-05-08T18:32:46.861066+0000","last_became_active":"2024-05-08T18:29:42.573947+0000","last_became_peered":"2024-05-08T18:29:42.573947+0000","last_unstale":"2024-05-08T18:32:46.861066+0000","last_undegraded":"2024-05-08T18:32:46.861066+0000","last_fullsized":"2024-05-08T18:32:46.861066+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:57:14.869860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"93'10","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.079768+0000","last_change":"2024-05-08T18:29:40.554005+0000","last_active":"2024-05-08T18:32:47.079768+0000","last_peered":"2024-05-08T18:32:47.079768+0000","last_clean":"2024-05-08T18:32:47.079768+0000","last_became_active":"2024-05-08T18:29:40.553356+0000","last_became_peered":"2024-05-08T18:29:40.553356+0000","last_unstale":"2024-05-08T18:32:47.079768+0000","last_undegraded":"2024-05-08T18:32:47.079768+0000","last_fullsized":"2024-05-08T18:32:47.079768+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:08:13.006752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"84'2","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.059942+0000","last_change":"2024-05-08T18:29:42.566487+0000","last_active":"2024-05-08T18:32:46.059942+0000","last_peered":"2024-05-08T18:32:46.059942+0000","last_clean":"2024-05-08T18:32:46.059942+0000","last_became_active":"2024-05-08T18:29:42.565760+0000","last_became_peered":"2024-05-08T18:29:42.565760+0000","last_unstale":"2024-05-08T18:32:46.059942+0000","last_undegraded":"2024-05-08T18:32:46.059942+0000","last_fullsized":"2024-05-08T18:32:46.059942+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:57.706167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"93'8","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.062985+0000","last_change":"2024-05-08T18:29:40.552543+0000","last_active":"2024-05-08T18:32:46.062985+0000","last_peered":"2024-05-08T18:32:46.062985+0000","last_clean":"2024-05-08T18:32:46.062985+0000","last_became_active":"2024-05-08T18:29:40.552307+0000","last_became_peered":"2024-05-08T18:29:40.552307+0000","last_unstale":"2024-05-08T18:32:46.062985+0000","last_undegraded":"2024-05-08T18:32:46.062985+0000","last_fullsized":"2024-05-08T18:32:46.062985+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:48.294532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"84'4","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.063759+0000","last_change":"2024-05-08T18:29:42.561658+0000","last_active":"2024-05-08T18:32:46.063759+0000","last_peered":"2024-05-08T18:32:46.063759+0000","last_clean":"2024-05-08T18:32:46.063759+0000","last_became_active":"2024-05-08T18:29:42.561171+0000","last_became_peered":"2024-05-08T18:29:42.561171+0000","last_unstale":"2024-05-08T18:32:46.063759+0000","last_undegraded":"2024-05-08T18:32:46.063759+0000","last_fullsized":"2024-05-08T18:32:46.063759+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:15.966061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"93'10","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.079096+0000","last_change":"2024-05-08T18:29:40.543041+0000","last_active":"2024-05-08T18:32:47.079096+0000","last_peered":"2024-05-08T18:32:47.079096+0000","last_clean":"2024-05-08T18:32:47.079096+0000","last_became_active":"2024-05-08T18:29:40.542398+0000","last_became_peered":"2024-05-08T18:29:40.542398+0000","last_unstale":"2024-05-08T18:32:47.079096+0000","last_undegraded":"2024-05-08T18:32:47.079096+0000","last_fullsized":"2024-05-08T18:32:47.079096+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:33.017750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"97'6","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.060280+0000","last_change":"2024-05-08T18:29:42.579690+0000","last_active":"2024-05-08T18:32:46.060280+0000","last_peered":"2024-05-08T18:32:46.060280+0000","last_clean":"2024-05-08T18:32:46.060280+0000","last_became_active":"2024-05-08T18:29:42.578981+0000","last_became_peered":"2024-05-08T18:29:42.578981+0000","last_unstale":"2024-05-08T18:32:46.060280+0000","last_undegraded":"2024-05-08T18:32:46.060280+0000","last_fullsized":"2024-05-08T18:32:46.060280+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:36:03.084561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"93'11","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.862989+0000","last_change":"2024-05-08T18:29:40.548499+0000","last_active":"2024-05-08T18:32:46.862989+0000","last_peered":"2024-05-08T18:32:46.862989+0000","last_clean":"2024-05-08T18:32:46.862989+0000","last_became_active":"2024-05-08T18:29:40.548177+0000","last_became_peered":"2024-05-08T18:29:40.548177+0000","last_unstale":"2024-05-08T18:32:46.862989+0000","last_undegraded":"2024-05-08T18:32:46.862989+0000","last_fullsized":"2024-05-08T18:32:46.862989+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:27:41.414153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"80'2","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.934939+0000","last_change":"2024-05-08T18:29:42.575892+0000","last_active":"2024-05-08T18:32:46.934939+0000","last_peered":"2024-05-08T18:32:46.934939+0000","last_clean":"2024-05-08T18:32:46.934939+0000","last_became_active":"2024-05-08T18:29:42.573384+0000","last_became_peered":"2024-05-08T18:29:42.573384+0000","last_unstale":"2024-05-08T18:32:46.934939+0000","last_undegraded":"2024-05-08T18:32:46.934939+0000","last_fullsized":"2024-05-08T18:32:46.934939+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:55.055481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"93'9","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.849826+0000","last_change":"2024-05-08T18:29:40.565068+0000","last_active":"2024-05-08T18:32:46.849826+0000","last_peered":"2024-05-08T18:32:46.849826+0000","last_clean":"2024-05-08T18:32:46.849826+0000","last_became_active":"2024-05-08T18:29:40.563231+0000","last_became_peered":"2024-05-08T18:29:40.563231+0000","last_unstale":"2024-05-08T18:32:46.849826+0000","last_undegraded":"2024-05-08T18:32:46.849826+0000","last_fullsized":"2024-05-08T18:32:46.849826+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:17:47.828990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.862573+0000","last_change":"2024-05-08T18:29:42.564338+0000","last_active":"2024-05-08T18:32:46.862573+0000","last_peered":"2024-05-08T18:32:46.862573+0000","last_clean":"2024-05-08T18:32:46.862573+0000","last_became_active":"2024-05-08T18:29:42.563822+0000","last_became_peered":"2024-05-08T18:29:42.563822+0000","last_unstale":"2024-05-08T18:32:46.862573+0000","last_undegraded":"2024-05-08T18:32:46.862573+0000","last_fullsized":"2024-05-08T18:32:46.862573+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:23.397435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"93'14","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.938359+0000","last_change":"2024-05-08T18:29:40.573333+0000","last_active":"2024-05-08T18:32:46.938359+0000","last_peered":"2024-05-08T18:32:46.938359+0000","last_clean":"2024-05-08T18:32:46.938359+0000","last_became_active":"2024-05-08T18:29:40.571195+0000","last_became_peered":"2024-05-08T18:29:40.571195+0000","last_unstale":"2024-05-08T18:32:46.938359+0000","last_undegraded":"2024-05-08T18:32:46.938359+0000","last_fullsized":"2024-05-08T18:32:46.938359+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:33.017750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.061746+0000","last_change":"2024-05-08T18:29:42.563085+0000","last_active":"2024-05-08T18:32:46.061746+0000","last_peered":"2024-05-08T18:32:46.061746+0000","last_clean":"2024-05-08T18:32:46.061746+0000","last_became_active":"2024-05-08T18:29:42.560419+0000","last_became_peered":"2024-05-08T18:29:42.560419+0000","last_unstale":"2024-05-08T18:32:46.061746+0000","last_undegraded":"2024-05-08T18:32:46.061746+0000","last_fullsized":"2024-05-08T18:32:46.061746+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:20.397730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"93'10","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.064712+0000","last_change":"2024-05-08T18:29:40.568890+0000","last_active":"2024-05-08T18:32:46.064712+0000","last_peered":"2024-05-08T18:32:46.064712+0000","last_clean":"2024-05-08T18:32:46.064712+0000","last_became_active":"2024-05-08T18:29:40.568584+0000","last_became_peered":"2024-05-08T18:29:40.568584+0000","last_unstale":"2024-05-08T18:32:46.064712+0000","last_undegraded":"2024-05-08T18:32:46.064712+0000","last_fullsized":"2024-05-08T18:32:46.064712+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:25:01.595224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"83'6","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.934923+0000","last_change":"2024-05-08T18:29:42.574277+0000","last_active":"2024-05-08T18:32:46.934923+0000","last_peered":"2024-05-08T18:32:46.934923+0000","last_clean":"2024-05-08T18:32:46.934923+0000","last_became_active":"2024-05-08T18:29:42.573563+0000","last_became_peered":"2024-05-08T18:29:42.573563+0000","last_unstale":"2024-05-08T18:32:46.934923+0000","last_undegraded":"2024-05-08T18:32:46.934923+0000","last_fullsized":"2024-05-08T18:32:46.934923+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:57.706167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"93'8","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.080783+0000","last_change":"2024-05-08T18:29:40.562058+0000","last_active":"2024-05-08T18:32:47.080783+0000","last_peered":"2024-05-08T18:32:47.080783+0000","last_clean":"2024-05-08T18:32:47.080783+0000","last_became_active":"2024-05-08T18:29:40.561360+0000","last_became_peered":"2024-05-08T18:29:40.561360+0000","last_unstale":"2024-05-08T18:32:47.080783+0000","last_undegraded":"2024-05-08T18:32:47.080783+0000","last_fullsized":"2024-05-08T18:32:47.080783+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:05.929806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"93'12","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.079443+0000","last_change":"2024-05-08T18:29:40.538728+0000","last_active":"2024-05-08T18:32:47.079443+0000","last_peered":"2024-05-08T18:32:47.079443+0000","last_clean":"2024-05-08T18:32:47.079443+0000","last_became_active":"2024-05-08T18:29:40.537925+0000","last_became_peered":"2024-05-08T18:29:40.537925+0000","last_unstale":"2024-05-08T18:32:47.079443+0000","last_undegraded":"2024-05-08T18:32:47.079443+0000","last_fullsized":"2024-05-08T18:32:47.079443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:28.426657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":3,"num_read_kb":4,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"97'8","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.861235+0000","last_change":"2024-05-08T18:29:42.574941+0000","last_active":"2024-05-08T18:32:46.861235+0000","last_peered":"2024-05-08T18:32:46.861235+0000","last_clean":"2024-05-08T18:32:46.861235+0000","last_became_active":"2024-05-08T18:29:42.574351+0000","last_became_peered":"2024-05-08T18:29:42.574351+0000","last_unstale":"2024-05-08T18:32:46.861235+0000","last_undegraded":"2024-05-08T18:32:46.861235+0000","last_fullsized":"2024-05-08T18:32:46.861235+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:21.935293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"93'10","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.917647+0000","last_change":"2024-05-08T18:29:40.543714+0000","last_active":"2024-05-08T18:32:46.917647+0000","last_peered":"2024-05-08T18:32:46.917647+0000","last_clean":"2024-05-08T18:32:46.917647+0000","last_became_active":"2024-05-08T18:29:40.542965+0000","last_became_peered":"2024-05-08T18:29:40.542965+0000","last_unstale":"2024-05-08T18:32:46.917647+0000","last_undegraded":"2024-05-08T18:32:46.917647+0000","last_fullsized":"2024-05-08T18:32:46.917647+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:12:59.146887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.080411+0000","last_change":"2024-05-08T18:29:42.560007+0000","last_active":"2024-05-08T18:32:47.080411+0000","last_peered":"2024-05-08T18:32:47.080411+0000","last_clean":"2024-05-08T18:32:47.080411+0000","last_became_active":"2024-05-08T18:29:42.559028+0000","last_became_peered":"2024-05-08T18:29:42.559028+0000","last_unstale":"2024-05-08T18:32:47.080411+0000","last_undegraded":"2024-05-08T18:32:47.080411+0000","last_fullsized":"2024-05-08T18:32:47.080411+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:36:03.084561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":247,"num_read_kb":238,"num_write":231,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":816,"ondisk_log_size":816,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":156300,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":814,"num_read_kb":576,"num_write":459,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":272740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":668,"ondisk_log_size":668,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":334,"num_read_kb":334,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":579,"num_read_kb":555,"num_write":234,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":222,"ondisk_log_size":222,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":2397044736,"num_objects":572,"num_object_clones":0,"num_object_copies":1144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":572,"num_whiteouts":0,"num_read":21,"num_read_kb":23,"num_write":644,"num_write_kb":2365440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4794089472,"data_stored":4794089472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":584,"ondisk_log_size":584,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509488,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":686464,"kb_used_data":655288,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93685376,"statfs":{"total":96636764160,"available":95933825024,"internally_reserved":0,"allocated":671014912,"data_stored":670390943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509488,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":423716,"kb_used_data":392540,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93948124,"statfs":{"total":96636764160,"available":96202878976,"internally_reserved":0,"allocated":401960960,"data_stored":401364459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509486,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":794532,"kb_used_data":763356,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93577308,"statfs":{"total":96636764160,"available":95823163392,"internally_reserved":0,"allocated":781676544,"data_stored":781024259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509486,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":683812,"kb_used_data":652624,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93688028,"statfs":{"total":96636764160,"available":95936540672,"internally_reserved":0,"allocated":668286976,"data_stored":667702261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542191,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":683956,"kb_used_data":652780,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93687884,"statfs":{"total":96636764160,"available":95936393216,"internally_reserved":0,"allocated":668446720,"data_stored":667824622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542191,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":487200,"kb_used_data":456024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93884640,"statfs":{"total":96636764160,"available":96137871360,"internally_reserved":0,"allocated":466968576,"data_stored":466377162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542189,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":438084,"kb_used_data":406908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93933756,"statfs":{"total":96636764160,"available":96188166144,"internally_reserved":0,"allocated":416673792,"data_stored":416055978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542191,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":745916,"kb_used_data":714728,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93625924,"statfs":{"total":96636764160,"available":95872946176,"internally_reserved":0,"allocated":731881472,"data_stored":731267394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":729808896,"data_stored":729808896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":415236096,"data_stored":415236096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":465567744,"data_stored":465567744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":666894336,"data_stored":666894336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":666894336,"data_stored":666894336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":780140544,"data_stored":780140544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":400556032,"data_stored":400556032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":668991488,"data_stored":668991488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":59088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":12223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":176128,"data_stored":122673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":75918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T18:32:57.596 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T18:32:57.951 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-05-08T18:32:57.958 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2024-05-08T18:32:57.973 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":215,"stamp":"2024-05-08T18:32:57.476591+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2397793017,"num_objects":771,"num_object_clones":0,"num_object_copies":1542,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":771,"num_whiteouts":0,"num_read":2061,"num_read_kb":1781,"num_write":1679,"num_write_kb":2367361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2479,"ondisk_log_size":2479,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":4943680,"kb_used_data":4694248,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":750031040,"statfs":{"total":773094113280,"available":768031784960,"internally_reserved":0,"allocated":4806909952,"data_stored":4802007078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.419893"},"pg_stats":[{"pgid":"3.3f","version":"93'10","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.938099+0000","last_change":"2024-05-08T18:29:40.574221+0000","last_active":"2024-05-08T18:32:46.938099+0000","last_peered":"2024-05-08T18:32:46.938099+0000","last_clean":"2024-05-08T18:32:46.938099+0000","last_became_active":"2024-05-08T18:29:40.573543+0000","last_became_peered":"2024-05-08T18:29:40.573543+0000","last_unstale":"2024-05-08T18:32:46.938099+0000","last_undegraded":"2024-05-08T18:32:46.938099+0000","last_fullsized":"2024-05-08T18:32:46.938099+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:57.223609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39845888,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"97'2","reported_seq":197,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.077734+0000","last_change":"2024-05-08T18:29:42.563773+0000","last_active":"2024-05-08T18:32:47.077734+0000","last_peered":"2024-05-08T18:32:47.077734+0000","last_clean":"2024-05-08T18:32:47.077734+0000","last_became_active":"2024-05-08T18:29:42.561201+0000","last_became_peered":"2024-05-08T18:29:42.561201+0000","last_unstale":"2024-05-08T18:32:47.077734+0000","last_undegraded":"2024-05-08T18:32:47.077734+0000","last_fullsized":"2024-05-08T18:32:47.077734+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:55.055481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"93'10","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.919609+0000","last_change":"2024-05-08T18:29:40.549299+0000","last_active":"2024-05-08T18:32:46.919609+0000","last_peered":"2024-05-08T18:32:46.919609+0000","last_clean":"2024-05-08T18:32:46.919609+0000","last_became_active":"2024-05-08T18:29:40.548930+0000","last_became_peered":"2024-05-08T18:29:40.548930+0000","last_unstale":"2024-05-08T18:32:46.919609+0000","last_undegraded":"2024-05-08T18:32:46.919609+0000","last_fullsized":"2024-05-08T18:32:46.919609+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:06:36.198647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"84'2","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.936351+0000","last_change":"2024-05-08T18:29:42.572074+0000","last_active":"2024-05-08T18:32:46.936351+0000","last_peered":"2024-05-08T18:32:46.936351+0000","last_clean":"2024-05-08T18:32:46.936351+0000","last_became_active":"2024-05-08T18:29:42.571344+0000","last_became_peered":"2024-05-08T18:29:42.571344+0000","last_unstale":"2024-05-08T18:32:46.936351+0000","last_undegraded":"2024-05-08T18:32:46.936351+0000","last_fullsized":"2024-05-08T18:32:46.936351+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:36.890277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"97'14","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863310+0000","last_change":"2024-05-08T18:29:40.539048+0000","last_active":"2024-05-08T18:32:46.863310+0000","last_peered":"2024-05-08T18:32:46.863310+0000","last_clean":"2024-05-08T18:32:46.863310+0000","last_became_active":"2024-05-08T18:29:40.538458+0000","last_became_peered":"2024-05-08T18:29:40.538458+0000","last_unstale":"2024-05-08T18:32:46.863310+0000","last_undegraded":"2024-05-08T18:32:46.863310+0000","last_fullsized":"2024-05-08T18:32:46.863310+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:36:37.796095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":3,"num_read_kb":4,"num_write":24,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.058600+0000","last_change":"2024-05-08T18:29:42.569718+0000","last_active":"2024-05-08T18:32:46.058600+0000","last_peered":"2024-05-08T18:32:46.058600+0000","last_clean":"2024-05-08T18:32:46.058600+0000","last_became_active":"2024-05-08T18:29:42.569026+0000","last_became_peered":"2024-05-08T18:29:42.569026+0000","last_unstale":"2024-05-08T18:32:46.058600+0000","last_undegraded":"2024-05-08T18:32:46.058600+0000","last_fullsized":"2024-05-08T18:32:46.058600+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:42.045615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"84'8","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.079501+0000","last_change":"2024-05-08T18:29:40.557700+0000","last_active":"2024-05-08T18:32:47.079501+0000","last_peered":"2024-05-08T18:32:47.079501+0000","last_clean":"2024-05-08T18:32:47.079501+0000","last_became_active":"2024-05-08T18:29:40.556884+0000","last_became_peered":"2024-05-08T18:29:40.556884+0000","last_unstale":"2024-05-08T18:32:47.079501+0000","last_undegraded":"2024-05-08T18:32:47.079501+0000","last_fullsized":"2024-05-08T18:32:47.079501+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:21:38.354933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.861228+0000","last_change":"2024-05-08T18:29:42.566448+0000","last_active":"2024-05-08T18:32:46.861228+0000","last_peered":"2024-05-08T18:32:46.861228+0000","last_clean":"2024-05-08T18:32:46.861228+0000","last_became_active":"2024-05-08T18:29:42.566058+0000","last_became_peered":"2024-05-08T18:29:42.566058+0000","last_unstale":"2024-05-08T18:32:46.861228+0000","last_undegraded":"2024-05-08T18:32:46.861228+0000","last_fullsized":"2024-05-08T18:32:46.861228+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:53:03.097704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"93'5","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.936864+0000","last_change":"2024-05-08T18:29:40.571195+0000","last_active":"2024-05-08T18:32:46.936864+0000","last_peered":"2024-05-08T18:32:46.936864+0000","last_clean":"2024-05-08T18:32:46.936864+0000","last_became_active":"2024-05-08T18:29:40.570467+0000","last_became_peered":"2024-05-08T18:29:40.570467+0000","last_unstale":"2024-05-08T18:32:46.936864+0000","last_undegraded":"2024-05-08T18:32:46.936864+0000","last_fullsized":"2024-05-08T18:32:46.936864+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:39.986094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.849586+0000","last_change":"2024-05-08T18:29:42.566506+0000","last_active":"2024-05-08T18:32:46.849586+0000","last_peered":"2024-05-08T18:32:46.849586+0000","last_clean":"2024-05-08T18:32:46.849586+0000","last_became_active":"2024-05-08T18:29:42.565740+0000","last_became_peered":"2024-05-08T18:29:42.565740+0000","last_unstale":"2024-05-08T18:32:46.849586+0000","last_undegraded":"2024-05-08T18:32:46.849586+0000","last_fullsized":"2024-05-08T18:32:46.849586+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:58.320701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"93'7","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.078764+0000","last_change":"2024-05-08T18:29:40.538314+0000","last_active":"2024-05-08T18:32:47.078764+0000","last_peered":"2024-05-08T18:32:47.078764+0000","last_clean":"2024-05-08T18:32:47.078764+0000","last_became_active":"2024-05-08T18:29:40.537458+0000","last_became_peered":"2024-05-08T18:29:40.537458+0000","last_unstale":"2024-05-08T18:32:47.078764+0000","last_undegraded":"2024-05-08T18:32:47.078764+0000","last_fullsized":"2024-05-08T18:32:47.078764+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:56.300986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.059543+0000","last_change":"2024-05-08T18:29:42.570054+0000","last_active":"2024-05-08T18:32:46.059543+0000","last_peered":"2024-05-08T18:32:46.059543+0000","last_clean":"2024-05-08T18:32:46.059543+0000","last_became_active":"2024-05-08T18:29:42.569255+0000","last_became_peered":"2024-05-08T18:29:42.569255+0000","last_unstale":"2024-05-08T18:32:46.059543+0000","last_undegraded":"2024-05-08T18:32:46.059543+0000","last_fullsized":"2024-05-08T18:32:46.059543+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:11:01.702482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"93'18","reported_seq":165,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.060289+0000","last_change":"2024-05-08T18:30:21.210397+0000","last_active":"2024-05-08T18:32:46.060289+0000","last_peered":"2024-05-08T18:32:46.060289+0000","last_clean":"2024-05-08T18:32:46.060289+0000","last_became_active":"2024-05-08T18:30:21.210052+0000","last_became_peered":"2024-05-08T18:30:21.210052+0000","last_unstale":"2024-05-08T18:32:46.060289+0000","last_undegraded":"2024-05-08T18:32:46.060289+0000","last_fullsized":"2024-05-08T18:32:46.060289+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:51:05.355593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"97'4","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.080135+0000","last_change":"2024-05-08T18:29:42.562084+0000","last_active":"2024-05-08T18:32:47.080135+0000","last_peered":"2024-05-08T18:32:47.080135+0000","last_clean":"2024-05-08T18:32:47.080135+0000","last_became_active":"2024-05-08T18:29:42.560699+0000","last_became_peered":"2024-05-08T18:29:42.560699+0000","last_unstale":"2024-05-08T18:32:47.080135+0000","last_undegraded":"2024-05-08T18:32:47.080135+0000","last_fullsized":"2024-05-08T18:32:47.080135+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:09.787597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"93'13","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.063923+0000","last_change":"2024-05-08T18:29:40.564339+0000","last_active":"2024-05-08T18:32:46.063923+0000","last_peered":"2024-05-08T18:32:46.063923+0000","last_clean":"2024-05-08T18:32:46.063923+0000","last_became_active":"2024-05-08T18:29:40.564038+0000","last_became_peered":"2024-05-08T18:29:40.564038+0000","last_unstale":"2024-05-08T18:32:46.063923+0000","last_undegraded":"2024-05-08T18:32:46.063923+0000","last_fullsized":"2024-05-08T18:32:46.063923+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:40:23.287885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"84'8","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.064487+0000","last_change":"2024-05-08T18:29:42.570253+0000","last_active":"2024-05-08T18:32:46.064487+0000","last_peered":"2024-05-08T18:32:46.064487+0000","last_clean":"2024-05-08T18:32:46.064487+0000","last_became_active":"2024-05-08T18:29:42.569917+0000","last_became_peered":"2024-05-08T18:29:42.569917+0000","last_unstale":"2024-05-08T18:32:46.064487+0000","last_undegraded":"2024-05-08T18:32:46.064487+0000","last_fullsized":"2024-05-08T18:32:46.064487+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:14:45.575219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"84'4","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.057705+0000","last_change":"2024-05-08T18:29:42.568116+0000","last_active":"2024-05-08T18:32:46.057705+0000","last_peered":"2024-05-08T18:32:46.057705+0000","last_clean":"2024-05-08T18:32:46.057705+0000","last_became_active":"2024-05-08T18:29:42.567399+0000","last_became_peered":"2024-05-08T18:29:42.567399+0000","last_unstale":"2024-05-08T18:32:46.057705+0000","last_undegraded":"2024-05-08T18:32:46.057705+0000","last_fullsized":"2024-05-08T18:32:46.057705+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:35.037465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"93'13","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.938102+0000","last_change":"2024-05-08T18:29:40.571982+0000","last_active":"2024-05-08T18:32:46.938102+0000","last_peered":"2024-05-08T18:32:46.938102+0000","last_clean":"2024-05-08T18:32:46.938102+0000","last_became_active":"2024-05-08T18:29:40.570600+0000","last_became_peered":"2024-05-08T18:29:40.570600+0000","last_unstale":"2024-05-08T18:32:46.938102+0000","last_undegraded":"2024-05-08T18:32:46.938102+0000","last_fullsized":"2024-05-08T18:32:46.938102+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:54:14.520118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"80'2","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.936574+0000","last_change":"2024-05-08T18:29:42.578449+0000","last_active":"2024-05-08T18:32:46.936574+0000","last_peered":"2024-05-08T18:32:46.936574+0000","last_clean":"2024-05-08T18:32:46.936574+0000","last_became_active":"2024-05-08T18:29:42.577789+0000","last_became_peered":"2024-05-08T18:29:42.577789+0000","last_unstale":"2024-05-08T18:32:46.936574+0000","last_undegraded":"2024-05-08T18:32:46.936574+0000","last_fullsized":"2024-05-08T18:32:46.936574+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:09.787597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"93'8","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.849942+0000","last_change":"2024-05-08T18:29:40.570618+0000","last_active":"2024-05-08T18:32:46.849942+0000","last_peered":"2024-05-08T18:32:46.849942+0000","last_clean":"2024-05-08T18:32:46.849942+0000","last_became_active":"2024-05-08T18:29:40.569519+0000","last_became_peered":"2024-05-08T18:29:40.569519+0000","last_unstale":"2024-05-08T18:32:46.849942+0000","last_undegraded":"2024-05-08T18:32:46.849942+0000","last_fullsized":"2024-05-08T18:32:46.849942+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:09:42.581976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.077696+0000","last_change":"2024-05-08T18:29:42.563056+0000","last_active":"2024-05-08T18:32:47.077696+0000","last_peered":"2024-05-08T18:32:47.077696+0000","last_clean":"2024-05-08T18:32:47.077696+0000","last_became_active":"2024-05-08T18:29:42.562296+0000","last_became_peered":"2024-05-08T18:29:42.562296+0000","last_unstale":"2024-05-08T18:32:47.077696+0000","last_undegraded":"2024-05-08T18:32:47.077696+0000","last_fullsized":"2024-05-08T18:32:47.077696+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:36.890277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"93'14","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.849998+0000","last_change":"2024-05-08T18:29:40.564353+0000","last_active":"2024-05-08T18:32:46.849998+0000","last_peered":"2024-05-08T18:32:46.849998+0000","last_clean":"2024-05-08T18:32:46.849998+0000","last_became_active":"2024-05-08T18:29:40.563516+0000","last_became_peered":"2024-05-08T18:29:40.563516+0000","last_unstale":"2024-05-08T18:32:46.849998+0000","last_undegraded":"2024-05-08T18:32:46.849998+0000","last_fullsized":"2024-05-08T18:32:46.849998+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:06:36.198647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"97'4","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.061368+0000","last_change":"2024-05-08T18:29:42.567006+0000","last_active":"2024-05-08T18:32:46.061368+0000","last_peered":"2024-05-08T18:32:46.061368+0000","last_clean":"2024-05-08T18:32:46.061368+0000","last_became_active":"2024-05-08T18:29:42.566256+0000","last_became_peered":"2024-05-08T18:29:42.566256+0000","last_unstale":"2024-05-08T18:32:46.061368+0000","last_undegraded":"2024-05-08T18:32:46.061368+0000","last_fullsized":"2024-05-08T18:32:46.061368+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:09:44.601690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"93'7","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.059619+0000","last_change":"2024-05-08T18:29:40.573212+0000","last_active":"2024-05-08T18:32:46.059619+0000","last_peered":"2024-05-08T18:32:46.059619+0000","last_clean":"2024-05-08T18:32:46.059619+0000","last_became_active":"2024-05-08T18:29:40.572250+0000","last_became_peered":"2024-05-08T18:29:40.572250+0000","last_unstale":"2024-05-08T18:32:46.059619+0000","last_undegraded":"2024-05-08T18:32:46.059619+0000","last_fullsized":"2024-05-08T18:32:46.059619+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:25:01.595224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"97'6","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.062431+0000","last_change":"2024-05-08T18:29:42.570847+0000","last_active":"2024-05-08T18:32:46.062431+0000","last_peered":"2024-05-08T18:32:46.062431+0000","last_clean":"2024-05-08T18:32:46.062431+0000","last_became_active":"2024-05-08T18:29:42.570435+0000","last_became_peered":"2024-05-08T18:29:42.570435+0000","last_unstale":"2024-05-08T18:32:46.062431+0000","last_undegraded":"2024-05-08T18:32:46.062431+0000","last_fullsized":"2024-05-08T18:32:46.062431+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:21:40.374647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"93'7","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.063428+0000","last_change":"2024-05-08T18:29:40.566815+0000","last_active":"2024-05-08T18:32:46.063428+0000","last_peered":"2024-05-08T18:32:46.063428+0000","last_clean":"2024-05-08T18:32:46.063428+0000","last_became_active":"2024-05-08T18:29:40.566531+0000","last_became_peered":"2024-05-08T18:29:40.566531+0000","last_unstale":"2024-05-08T18:32:46.063428+0000","last_undegraded":"2024-05-08T18:32:46.063428+0000","last_fullsized":"2024-05-08T18:32:46.063428+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:52.462279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"84'8","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.059681+0000","last_change":"2024-05-08T18:29:42.554846+0000","last_active":"2024-05-08T18:32:46.059681+0000","last_peered":"2024-05-08T18:32:46.059681+0000","last_clean":"2024-05-08T18:32:46.059681+0000","last_became_active":"2024-05-08T18:29:42.554115+0000","last_became_peered":"2024-05-08T18:29:42.554115+0000","last_unstale":"2024-05-08T18:32:46.059681+0000","last_undegraded":"2024-05-08T18:32:46.059681+0000","last_fullsized":"2024-05-08T18:32:46.059681+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:22:14.793035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"93'7","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.862823+0000","last_change":"2024-05-08T18:29:40.547776+0000","last_active":"2024-05-08T18:32:46.862823+0000","last_peered":"2024-05-08T18:32:46.862823+0000","last_clean":"2024-05-08T18:32:46.862823+0000","last_became_active":"2024-05-08T18:29:40.547384+0000","last_became_peered":"2024-05-08T18:29:40.547384+0000","last_unstale":"2024-05-08T18:32:46.862823+0000","last_undegraded":"2024-05-08T18:32:46.862823+0000","last_fullsized":"2024-05-08T18:32:46.862823+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:14:26.628603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"97'10","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.057195+0000","last_change":"2024-05-08T18:29:50.685390+0000","last_active":"2024-05-08T18:32:46.057195+0000","last_peered":"2024-05-08T18:32:46.057195+0000","last_clean":"2024-05-08T18:32:46.057195+0000","last_became_active":"2024-05-08T18:29:50.684644+0000","last_became_peered":"2024-05-08T18:29:50.684644+0000","last_unstale":"2024-05-08T18:32:46.057195+0000","last_undegraded":"2024-05-08T18:32:46.057195+0000","last_fullsized":"2024-05-08T18:32:46.057195+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:10:38.951662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":21,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"84'10","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.066363+0000","last_change":"2024-05-08T18:29:42.573805+0000","last_active":"2024-05-08T18:32:46.066363+0000","last_peered":"2024-05-08T18:32:46.066363+0000","last_clean":"2024-05-08T18:32:46.066363+0000","last_became_active":"2024-05-08T18:29:42.573296+0000","last_became_peered":"2024-05-08T18:29:42.573296+0000","last_unstale":"2024-05-08T18:32:46.066363+0000","last_undegraded":"2024-05-08T18:32:46.066363+0000","last_fullsized":"2024-05-08T18:32:46.066363+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:21.935293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"93'8","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.937043+0000","last_change":"2024-05-08T18:29:40.570733+0000","last_active":"2024-05-08T18:32:46.937043+0000","last_peered":"2024-05-08T18:32:46.937043+0000","last_clean":"2024-05-08T18:32:46.937043+0000","last_became_active":"2024-05-08T18:29:40.569711+0000","last_became_peered":"2024-05-08T18:29:40.569711+0000","last_unstale":"2024-05-08T18:32:46.937043+0000","last_undegraded":"2024-05-08T18:32:46.937043+0000","last_fullsized":"2024-05-08T18:32:46.937043+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:18:08.784274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.079758+0000","last_change":"2024-05-08T18:29:44.594185+0000","last_active":"2024-05-08T18:32:47.079758+0000","last_peered":"2024-05-08T18:32:47.079758+0000","last_clean":"2024-05-08T18:32:47.079758+0000","last_became_active":"2024-05-08T18:29:44.593442+0000","last_became_peered":"2024-05-08T18:29:44.593442+0000","last_unstale":"2024-05-08T18:32:47.079758+0000","last_undegraded":"2024-05-08T18:32:47.079758+0000","last_fullsized":"2024-05-08T18:32:47.079758+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:52:25.736491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"97'15","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863258+0000","last_change":"2024-05-08T18:29:46.594652+0000","last_active":"2024-05-08T18:32:46.863258+0000","last_peered":"2024-05-08T18:32:46.863258+0000","last_clean":"2024-05-08T18:32:46.863258+0000","last_became_active":"2024-05-08T18:29:46.593656+0000","last_became_peered":"2024-05-08T18:29:46.593656+0000","last_unstale":"2024-05-08T18:32:46.863258+0000","last_undegraded":"2024-05-08T18:32:46.863258+0000","last_fullsized":"2024-05-08T18:32:46.863258+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:50:27.608888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.937817+0000","last_change":"2024-05-08T18:29:48.639834+0000","last_active":"2024-05-08T18:32:46.937817+0000","last_peered":"2024-05-08T18:32:46.937817+0000","last_clean":"2024-05-08T18:32:46.937817+0000","last_became_active":"2024-05-08T18:29:48.639122+0000","last_became_peered":"2024-05-08T18:29:48.639122+0000","last_unstale":"2024-05-08T18:32:46.937817+0000","last_undegraded":"2024-05-08T18:32:46.937817+0000","last_fullsized":"2024-05-08T18:32:46.937817+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:14:22.304773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"83'4","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.077986+0000","last_change":"2024-05-08T18:29:50.672303+0000","last_active":"2024-05-08T18:32:47.077986+0000","last_peered":"2024-05-08T18:32:47.077986+0000","last_clean":"2024-05-08T18:32:47.077986+0000","last_became_active":"2024-05-08T18:29:50.671513+0000","last_became_peered":"2024-05-08T18:29:50.671513+0000","last_unstale":"2024-05-08T18:32:47.077986+0000","last_undegraded":"2024-05-08T18:32:47.077986+0000","last_fullsized":"2024-05-08T18:32:47.077986+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:12:05.780786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"84'4","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.080615+0000","last_change":"2024-05-08T18:29:42.565462+0000","last_active":"2024-05-08T18:32:47.080615+0000","last_peered":"2024-05-08T18:32:47.080615+0000","last_clean":"2024-05-08T18:32:47.080615+0000","last_became_active":"2024-05-08T18:29:42.564741+0000","last_became_peered":"2024-05-08T18:29:42.564741+0000","last_unstale":"2024-05-08T18:32:47.080615+0000","last_undegraded":"2024-05-08T18:32:47.080615+0000","last_fullsized":"2024-05-08T18:32:47.080615+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:25:56.129785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"93'6","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.862908+0000","last_change":"2024-05-08T18:29:40.564796+0000","last_active":"2024-05-08T18:32:46.862908+0000","last_peered":"2024-05-08T18:32:46.862908+0000","last_clean":"2024-05-08T18:32:46.862908+0000","last_became_active":"2024-05-08T18:29:40.564401+0000","last_became_peered":"2024-05-08T18:29:40.564401+0000","last_unstale":"2024-05-08T18:32:46.862908+0000","last_undegraded":"2024-05-08T18:32:46.862908+0000","last_fullsized":"2024-05-08T18:32:46.862908+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:19:11.492397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":189,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.065935+0000","last_change":"2024-05-08T18:29:44.587689+0000","last_active":"2024-05-08T18:32:46.065935+0000","last_peered":"2024-05-08T18:32:46.065935+0000","last_clean":"2024-05-08T18:32:46.065935+0000","last_became_active":"2024-05-08T18:29:44.586975+0000","last_became_peered":"2024-05-08T18:29:44.586975+0000","last_unstale":"2024-05-08T18:32:46.065935+0000","last_undegraded":"2024-05-08T18:32:46.065935+0000","last_fullsized":"2024-05-08T18:32:46.065935+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:04:49.020450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"83'7","reported_seq":197,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.059952+0000","last_change":"2024-05-08T18:29:46.600906+0000","last_active":"2024-05-08T18:32:46.059952+0000","last_peered":"2024-05-08T18:32:46.059952+0000","last_clean":"2024-05-08T18:32:46.059952+0000","last_became_active":"2024-05-08T18:29:46.599894+0000","last_became_peered":"2024-05-08T18:29:46.599894+0000","last_unstale":"2024-05-08T18:32:46.059952+0000","last_undegraded":"2024-05-08T18:32:46.059952+0000","last_fullsized":"2024-05-08T18:32:46.059952+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:24:13.568294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.059189+0000","last_change":"2024-05-08T18:29:48.614324+0000","last_active":"2024-05-08T18:32:46.059189+0000","last_peered":"2024-05-08T18:32:46.059189+0000","last_clean":"2024-05-08T18:32:46.059189+0000","last_became_active":"2024-05-08T18:29:48.613591+0000","last_became_peered":"2024-05-08T18:29:48.613591+0000","last_unstale":"2024-05-08T18:32:46.059189+0000","last_undegraded":"2024-05-08T18:32:46.059189+0000","last_fullsized":"2024-05-08T18:32:46.059189+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:47:54.034851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.862656+0000","last_change":"2024-05-08T18:29:50.684773+0000","last_active":"2024-05-08T18:32:46.862656+0000","last_peered":"2024-05-08T18:32:46.862656+0000","last_clean":"2024-05-08T18:32:46.862656+0000","last_became_active":"2024-05-08T18:29:50.683931+0000","last_became_peered":"2024-05-08T18:29:50.683931+0000","last_unstale":"2024-05-08T18:32:46.862656+0000","last_undegraded":"2024-05-08T18:32:46.862656+0000","last_fullsized":"2024-05-08T18:32:46.862656+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:17:10.582636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"80'2","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.861209+0000","last_change":"2024-05-08T18:29:42.574437+0000","last_active":"2024-05-08T18:32:46.861209+0000","last_peered":"2024-05-08T18:32:46.861209+0000","last_clean":"2024-05-08T18:32:46.861209+0000","last_became_active":"2024-05-08T18:29:42.574146+0000","last_became_peered":"2024-05-08T18:29:42.574146+0000","last_unstale":"2024-05-08T18:32:46.861209+0000","last_undegraded":"2024-05-08T18:32:46.861209+0000","last_fullsized":"2024-05-08T18:32:46.861209+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:55:30.468069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"93'11","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.936641+0000","last_change":"2024-05-08T18:29:40.559677+0000","last_active":"2024-05-08T18:32:46.936641+0000","last_peered":"2024-05-08T18:32:46.936641+0000","last_clean":"2024-05-08T18:32:46.936641+0000","last_became_active":"2024-05-08T18:29:40.558819+0000","last_became_peered":"2024-05-08T18:29:40.558819+0000","last_unstale":"2024-05-08T18:32:46.936641+0000","last_undegraded":"2024-05-08T18:32:46.936641+0000","last_fullsized":"2024-05-08T18:32:46.936641+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:28.426657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":189,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.067875+0000","last_change":"2024-05-08T18:29:44.596801+0000","last_active":"2024-05-08T18:32:46.067875+0000","last_peered":"2024-05-08T18:32:46.067875+0000","last_clean":"2024-05-08T18:32:46.067875+0000","last_became_active":"2024-05-08T18:29:44.596111+0000","last_became_peered":"2024-05-08T18:29:44.596111+0000","last_unstale":"2024-05-08T18:32:46.067875+0000","last_undegraded":"2024-05-08T18:32:46.067875+0000","last_fullsized":"2024-05-08T18:32:46.067875+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:04.423266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"33'10","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.061447+0000","last_change":"2024-05-08T18:29:46.608330+0000","last_active":"2024-05-08T18:32:46.061447+0000","last_peered":"2024-05-08T18:32:46.061447+0000","last_clean":"2024-05-08T18:32:46.061447+0000","last_became_active":"2024-05-08T18:29:46.607580+0000","last_became_peered":"2024-05-08T18:29:46.607580+0000","last_unstale":"2024-05-08T18:32:46.061447+0000","last_undegraded":"2024-05-08T18:32:46.061447+0000","last_fullsized":"2024-05-08T18:32:46.061447+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:22:18.837103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"116'102","reported_seq":407,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:49.831802+0000","last_change":"2024-05-08T18:29:48.642718+0000","last_active":"2024-05-08T18:32:49.831802+0000","last_peered":"2024-05-08T18:32:49.831802+0000","last_clean":"2024-05-08T18:32:49.831802+0000","last_became_active":"2024-05-08T18:29:48.641950+0000","last_became_peered":"2024-05-08T18:29:48.641950+0000","last_unstale":"2024-05-08T18:32:49.831802+0000","last_undegraded":"2024-05-08T18:32:49.831802+0000","last_fullsized":"2024-05-08T18:32:49.831802+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:00:11.720096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"84'2","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.058647+0000","last_change":"2024-05-08T18:29:50.660378+0000","last_active":"2024-05-08T18:32:46.058647+0000","last_peered":"2024-05-08T18:32:46.058647+0000","last_clean":"2024-05-08T18:32:46.058647+0000","last_became_active":"2024-05-08T18:29:50.659649+0000","last_became_peered":"2024-05-08T18:29:50.659649+0000","last_unstale":"2024-05-08T18:32:46.058647+0000","last_undegraded":"2024-05-08T18:32:46.058647+0000","last_fullsized":"2024-05-08T18:32:46.058647+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:34:14.488295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"80'2","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.066931+0000","last_change":"2024-05-08T18:29:42.577267+0000","last_active":"2024-05-08T18:32:46.066931+0000","last_peered":"2024-05-08T18:32:46.066931+0000","last_clean":"2024-05-08T18:32:46.066931+0000","last_became_active":"2024-05-08T18:29:42.576740+0000","last_became_peered":"2024-05-08T18:29:42.576740+0000","last_unstale":"2024-05-08T18:32:46.066931+0000","last_undegraded":"2024-05-08T18:32:46.066931+0000","last_fullsized":"2024-05-08T18:32:46.066931+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:57:14.869860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"93'5","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.848368+0000","last_change":"2024-05-08T18:29:40.547524+0000","last_active":"2024-05-08T18:32:46.848368+0000","last_peered":"2024-05-08T18:32:46.848368+0000","last_clean":"2024-05-08T18:32:46.848368+0000","last_became_active":"2024-05-08T18:29:40.545749+0000","last_became_peered":"2024-05-08T18:29:40.545749+0000","last_unstale":"2024-05-08T18:32:46.848368+0000","last_undegraded":"2024-05-08T18:32:46.848368+0000","last_fullsized":"2024-05-08T18:32:46.848368+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:12:59.146887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.080004+0000","last_change":"2024-05-08T18:29:44.579839+0000","last_active":"2024-05-08T18:32:47.080004+0000","last_peered":"2024-05-08T18:32:47.080004+0000","last_clean":"2024-05-08T18:32:47.080004+0000","last_became_active":"2024-05-08T18:29:44.578142+0000","last_became_peered":"2024-05-08T18:29:44.578142+0000","last_unstale":"2024-05-08T18:32:47.080004+0000","last_undegraded":"2024-05-08T18:32:47.080004+0000","last_fullsized":"2024-05-08T18:32:47.080004+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:51:09.413191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"97'15","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.937446+0000","last_change":"2024-05-08T18:29:46.607288+0000","last_active":"2024-05-08T18:32:46.937446+0000","last_peered":"2024-05-08T18:32:46.937446+0000","last_clean":"2024-05-08T18:32:46.937446+0000","last_became_active":"2024-05-08T18:29:46.605154+0000","last_became_peered":"2024-05-08T18:29:46.605154+0000","last_unstale":"2024-05-08T18:32:46.937446+0000","last_undegraded":"2024-05-08T18:32:46.937446+0000","last_fullsized":"2024-05-08T18:32:46.937446+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:23.940519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"116'102","reported_seq":326,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:49.830860+0000","last_change":"2024-05-08T18:29:48.634956+0000","last_active":"2024-05-08T18:32:49.830860+0000","last_peered":"2024-05-08T18:32:49.830860+0000","last_clean":"2024-05-08T18:32:49.830860+0000","last_became_active":"2024-05-08T18:29:48.633858+0000","last_became_peered":"2024-05-08T18:29:48.633858+0000","last_unstale":"2024-05-08T18:32:49.830860+0000","last_undegraded":"2024-05-08T18:32:49.830860+0000","last_fullsized":"2024-05-08T18:32:49.830860+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:50:48.169666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"84'8","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.079043+0000","last_change":"2024-05-08T18:29:42.567744+0000","last_active":"2024-05-08T18:32:47.079043+0000","last_peered":"2024-05-08T18:32:47.079043+0000","last_clean":"2024-05-08T18:32:47.079043+0000","last_became_active":"2024-05-08T18:29:42.566974+0000","last_became_peered":"2024-05-08T18:29:42.566974+0000","last_unstale":"2024-05-08T18:32:47.079043+0000","last_undegraded":"2024-05-08T18:32:47.079043+0000","last_fullsized":"2024-05-08T18:32:47.079043+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:42.045615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"93'10","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.938419+0000","last_change":"2024-05-08T18:29:40.572499+0000","last_active":"2024-05-08T18:32:46.938419+0000","last_peered":"2024-05-08T18:32:46.938419+0000","last_clean":"2024-05-08T18:32:46.938419+0000","last_became_active":"2024-05-08T18:29:40.571322+0000","last_became_peered":"2024-05-08T18:29:40.571322+0000","last_unstale":"2024-05-08T18:32:46.938419+0000","last_undegraded":"2024-05-08T18:32:46.938419+0000","last_fullsized":"2024-05-08T18:32:46.938419+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:31.119374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.935697+0000","last_change":"2024-05-08T18:29:44.597045+0000","last_active":"2024-05-08T18:32:46.935697+0000","last_peered":"2024-05-08T18:32:46.935697+0000","last_clean":"2024-05-08T18:32:46.935697+0000","last_became_active":"2024-05-08T18:29:44.596282+0000","last_became_peered":"2024-05-08T18:29:44.596282+0000","last_unstale":"2024-05-08T18:32:46.935697+0000","last_undegraded":"2024-05-08T18:32:46.935697+0000","last_fullsized":"2024-05-08T18:32:46.935697+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:35:51.288126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"97'26","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.078455+0000","last_change":"2024-05-08T18:29:46.590633+0000","last_active":"2024-05-08T18:32:47.078455+0000","last_peered":"2024-05-08T18:32:47.078455+0000","last_clean":"2024-05-08T18:32:47.078455+0000","last_became_active":"2024-05-08T18:29:46.589600+0000","last_became_peered":"2024-05-08T18:29:46.589600+0000","last_unstale":"2024-05-08T18:32:47.078455+0000","last_undegraded":"2024-05-08T18:32:47.078455+0000","last_fullsized":"2024-05-08T18:32:47.078455+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:23.940519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.917121+0000","last_change":"2024-05-08T18:29:48.630758+0000","last_active":"2024-05-08T18:32:46.917121+0000","last_peered":"2024-05-08T18:32:46.917121+0000","last_clean":"2024-05-08T18:32:46.917121+0000","last_became_active":"2024-05-08T18:29:48.630017+0000","last_became_peered":"2024-05-08T18:29:48.630017+0000","last_unstale":"2024-05-08T18:32:46.917121+0000","last_undegraded":"2024-05-08T18:32:46.917121+0000","last_fullsized":"2024-05-08T18:32:46.917121+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:39.879384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"97'14","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.077776+0000","last_change":"2024-05-08T18:29:50.672682+0000","last_active":"2024-05-08T18:32:47.077776+0000","last_peered":"2024-05-08T18:32:47.077776+0000","last_clean":"2024-05-08T18:32:47.077776+0000","last_became_active":"2024-05-08T18:29:50.671923+0000","last_became_peered":"2024-05-08T18:29:50.671923+0000","last_unstale":"2024-05-08T18:32:47.077776+0000","last_undegraded":"2024-05-08T18:32:47.077776+0000","last_fullsized":"2024-05-08T18:32:47.077776+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:38.318890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":39,"num_write":35,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"80'2","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.057722+0000","last_change":"2024-05-08T18:29:42.554289+0000","last_active":"2024-05-08T18:32:46.057722+0000","last_peered":"2024-05-08T18:32:46.057722+0000","last_clean":"2024-05-08T18:32:46.057722+0000","last_became_active":"2024-05-08T18:29:42.553574+0000","last_became_peered":"2024-05-08T18:29:42.553574+0000","last_unstale":"2024-05-08T18:32:46.057722+0000","last_undegraded":"2024-05-08T18:32:46.057722+0000","last_fullsized":"2024-05-08T18:32:46.057722+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:42.005809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"93'7","reported_seq":201,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.938183+0000","last_change":"2024-05-08T18:29:40.570169+0000","last_active":"2024-05-08T18:32:46.938183+0000","last_peered":"2024-05-08T18:32:46.938183+0000","last_clean":"2024-05-08T18:32:46.938183+0000","last_became_active":"2024-05-08T18:29:40.569542+0000","last_became_peered":"2024-05-08T18:29:40.569542+0000","last_unstale":"2024-05-08T18:32:46.938183+0000","last_undegraded":"2024-05-08T18:32:46.938183+0000","last_fullsized":"2024-05-08T18:32:46.938183+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:08:13.006752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"26'1","reported_seq":257,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.060325+0000","last_change":"2024-05-08T18:29:44.579659+0000","last_active":"2024-05-08T18:32:46.060325+0000","last_peered":"2024-05-08T18:32:46.060325+0000","last_clean":"2024-05-08T18:32:46.060325+0000","last_became_active":"2024-05-08T18:29:44.579152+0000","last_became_peered":"2024-05-08T18:29:44.579152+0000","last_unstale":"2024-05-08T18:32:46.060325+0000","last_undegraded":"2024-05-08T18:32:46.060325+0000","last_fullsized":"2024-05-08T18:32:46.060325+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:15:00.358583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"97'15","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.064379+0000","last_change":"2024-05-08T18:29:46.600224+0000","last_active":"2024-05-08T18:32:46.064379+0000","last_peered":"2024-05-08T18:32:46.064379+0000","last_clean":"2024-05-08T18:32:46.064379+0000","last_became_active":"2024-05-08T18:29:46.599464+0000","last_became_peered":"2024-05-08T18:29:46.599464+0000","last_unstale":"2024-05-08T18:32:46.064379+0000","last_undegraded":"2024-05-08T18:32:46.064379+0000","last_fullsized":"2024-05-08T18:32:46.064379+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:26:40.238188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.061779+0000","last_change":"2024-05-08T18:29:48.637939+0000","last_active":"2024-05-08T18:32:46.061779+0000","last_peered":"2024-05-08T18:32:46.061779+0000","last_clean":"2024-05-08T18:32:46.061779+0000","last_became_active":"2024-05-08T18:29:48.637231+0000","last_became_peered":"2024-05-08T18:29:48.637231+0000","last_unstale":"2024-05-08T18:32:46.061779+0000","last_undegraded":"2024-05-08T18:32:46.061779+0000","last_fullsized":"2024-05-08T18:32:46.061779+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:04.571608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":174,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.847775+0000","last_change":"2024-05-08T18:29:50.681831+0000","last_active":"2024-05-08T18:32:46.847775+0000","last_peered":"2024-05-08T18:32:46.847775+0000","last_clean":"2024-05-08T18:32:46.847775+0000","last_became_active":"2024-05-08T18:29:50.681287+0000","last_became_peered":"2024-05-08T18:29:50.681287+0000","last_unstale":"2024-05-08T18:32:46.847775+0000","last_undegraded":"2024-05-08T18:32:46.847775+0000","last_fullsized":"2024-05-08T18:32:46.847775+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:30:24.111488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.849322+0000","last_change":"2024-05-08T18:29:42.562975+0000","last_active":"2024-05-08T18:32:46.849322+0000","last_peered":"2024-05-08T18:32:46.849322+0000","last_clean":"2024-05-08T18:32:46.849322+0000","last_became_active":"2024-05-08T18:29:42.562267+0000","last_became_peered":"2024-05-08T18:29:42.562267+0000","last_unstale":"2024-05-08T18:32:46.849322+0000","last_undegraded":"2024-05-08T18:32:46.849322+0000","last_fullsized":"2024-05-08T18:32:46.849322+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:30.446371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"93'7","reported_seq":201,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.938062+0000","last_change":"2024-05-08T18:29:40.570736+0000","last_active":"2024-05-08T18:32:46.938062+0000","last_peered":"2024-05-08T18:32:46.938062+0000","last_clean":"2024-05-08T18:32:46.938062+0000","last_became_active":"2024-05-08T18:29:40.569626+0000","last_became_peered":"2024-05-08T18:29:40.569626+0000","last_unstale":"2024-05-08T18:32:46.938062+0000","last_undegraded":"2024-05-08T18:32:46.938062+0000","last_fullsized":"2024-05-08T18:32:46.938062+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:56.300986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"26'1","reported_seq":257,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.062164+0000","last_change":"2024-05-08T18:29:44.581748+0000","last_active":"2024-05-08T18:32:46.062164+0000","last_peered":"2024-05-08T18:32:46.062164+0000","last_clean":"2024-05-08T18:32:46.062164+0000","last_became_active":"2024-05-08T18:29:44.581067+0000","last_became_peered":"2024-05-08T18:29:44.581067+0000","last_unstale":"2024-05-08T18:32:46.062164+0000","last_undegraded":"2024-05-08T18:32:46.062164+0000","last_fullsized":"2024-05-08T18:32:46.062164+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:44.043691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"97'21","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.936022+0000","last_change":"2024-05-08T18:29:46.605887+0000","last_active":"2024-05-08T18:32:46.936022+0000","last_peered":"2024-05-08T18:32:46.936022+0000","last_clean":"2024-05-08T18:32:46.936022+0000","last_became_active":"2024-05-08T18:29:46.604966+0000","last_became_peered":"2024-05-08T18:29:46.604966+0000","last_unstale":"2024-05-08T18:32:46.936022+0000","last_undegraded":"2024-05-08T18:32:46.936022+0000","last_fullsized":"2024-05-08T18:32:46.936022+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:07:54.654205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"116'102","reported_seq":326,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:49.830598+0000","last_change":"2024-05-08T18:29:48.638657+0000","last_active":"2024-05-08T18:32:49.830598+0000","last_peered":"2024-05-08T18:32:49.830598+0000","last_clean":"2024-05-08T18:32:49.830598+0000","last_became_active":"2024-05-08T18:29:48.637758+0000","last_became_peered":"2024-05-08T18:29:48.637758+0000","last_unstale":"2024-05-08T18:32:49.830598+0000","last_undegraded":"2024-05-08T18:32:49.830598+0000","last_fullsized":"2024-05-08T18:32:49.830598+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:45:24.153991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"97'2","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863289+0000","last_change":"2024-05-08T18:29:50.684501+0000","last_active":"2024-05-08T18:32:46.863289+0000","last_peered":"2024-05-08T18:32:46.863289+0000","last_clean":"2024-05-08T18:32:46.863289+0000","last_became_active":"2024-05-08T18:29:50.683738+0000","last_became_peered":"2024-05-08T18:29:50.683738+0000","last_unstale":"2024-05-08T18:32:46.863289+0000","last_undegraded":"2024-05-08T18:32:46.863289+0000","last_fullsized":"2024-05-08T18:32:46.863289+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:22.834262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"84'4","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863429+0000","last_change":"2024-05-08T18:29:42.569401+0000","last_active":"2024-05-08T18:32:46.863429+0000","last_peered":"2024-05-08T18:32:46.863429+0000","last_clean":"2024-05-08T18:32:46.863429+0000","last_became_active":"2024-05-08T18:29:42.568659+0000","last_became_peered":"2024-05-08T18:29:42.568659+0000","last_unstale":"2024-05-08T18:32:46.863429+0000","last_undegraded":"2024-05-08T18:32:46.863429+0000","last_fullsized":"2024-05-08T18:32:46.863429+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:35:23.016110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"93'8","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.079924+0000","last_change":"2024-05-08T18:29:40.557076+0000","last_active":"2024-05-08T18:32:47.079924+0000","last_peered":"2024-05-08T18:32:47.079924+0000","last_clean":"2024-05-08T18:32:47.079924+0000","last_became_active":"2024-05-08T18:29:40.555805+0000","last_became_peered":"2024-05-08T18:29:40.555805+0000","last_unstale":"2024-05-08T18:32:47.079924+0000","last_undegraded":"2024-05-08T18:32:47.079924+0000","last_fullsized":"2024-05-08T18:32:47.079924+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:13.946346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":18,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":189,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.060997+0000","last_change":"2024-05-08T18:29:44.573892+0000","last_active":"2024-05-08T18:32:46.060997+0000","last_peered":"2024-05-08T18:32:46.060997+0000","last_clean":"2024-05-08T18:32:46.060997+0000","last_became_active":"2024-05-08T18:29:44.573308+0000","last_became_peered":"2024-05-08T18:29:44.573308+0000","last_unstale":"2024-05-08T18:32:46.060997+0000","last_undegraded":"2024-05-08T18:32:46.060997+0000","last_fullsized":"2024-05-08T18:32:46.060997+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:37.075348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"97'24","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.862514+0000","last_change":"2024-05-08T18:29:46.595585+0000","last_active":"2024-05-08T18:32:46.862514+0000","last_peered":"2024-05-08T18:32:46.862514+0000","last_clean":"2024-05-08T18:32:46.862514+0000","last_became_active":"2024-05-08T18:29:46.594930+0000","last_became_peered":"2024-05-08T18:29:46.594930+0000","last_unstale":"2024-05-08T18:32:46.862514+0000","last_undegraded":"2024-05-08T18:32:46.862514+0000","last_fullsized":"2024-05-08T18:32:46.862514+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:11.768269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.059998+0000","last_change":"2024-05-08T18:29:48.638137+0000","last_active":"2024-05-08T18:32:46.059998+0000","last_peered":"2024-05-08T18:32:46.059998+0000","last_clean":"2024-05-08T18:32:46.059998+0000","last_became_active":"2024-05-08T18:29:48.637370+0000","last_became_peered":"2024-05-08T18:29:48.637370+0000","last_unstale":"2024-05-08T18:32:46.059998+0000","last_undegraded":"2024-05-08T18:32:46.059998+0000","last_fullsized":"2024-05-08T18:32:46.059998+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:15.859849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"83'2","reported_seq":182,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.916145+0000","last_change":"2024-05-08T18:29:50.688760+0000","last_active":"2024-05-08T18:32:46.916145+0000","last_peered":"2024-05-08T18:32:46.916145+0000","last_clean":"2024-05-08T18:32:46.916145+0000","last_became_active":"2024-05-08T18:29:50.687960+0000","last_became_peered":"2024-05-08T18:29:50.687960+0000","last_unstale":"2024-05-08T18:32:46.916145+0000","last_undegraded":"2024-05-08T18:32:46.916145+0000","last_fullsized":"2024-05-08T18:32:46.916145+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:21:19.624895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"97'4","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.060220+0000","last_change":"2024-05-08T18:29:42.557850+0000","last_active":"2024-05-08T18:32:46.060220+0000","last_peered":"2024-05-08T18:32:46.060220+0000","last_clean":"2024-05-08T18:32:46.060220+0000","last_became_active":"2024-05-08T18:29:42.557119+0000","last_became_peered":"2024-05-08T18:29:42.557119+0000","last_unstale":"2024-05-08T18:32:46.060220+0000","last_undegraded":"2024-05-08T18:32:46.060220+0000","last_fullsized":"2024-05-08T18:32:46.060220+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:25:56.129785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"93'8","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.062755+0000","last_change":"2024-05-08T18:29:40.544530+0000","last_active":"2024-05-08T18:32:46.062755+0000","last_peered":"2024-05-08T18:32:46.062755+0000","last_clean":"2024-05-08T18:32:46.062755+0000","last_became_active":"2024-05-08T18:29:40.544215+0000","last_became_peered":"2024-05-08T18:29:40.544215+0000","last_unstale":"2024-05-08T18:32:46.062755+0000","last_undegraded":"2024-05-08T18:32:46.062755+0000","last_fullsized":"2024-05-08T18:32:46.062755+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:14:26.628603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":189,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.063283+0000","last_change":"2024-05-08T18:29:44.588227+0000","last_active":"2024-05-08T18:32:46.063283+0000","last_peered":"2024-05-08T18:32:46.063283+0000","last_clean":"2024-05-08T18:32:46.063283+0000","last_became_active":"2024-05-08T18:29:44.587822+0000","last_became_peered":"2024-05-08T18:29:44.587822+0000","last_unstale":"2024-05-08T18:32:46.063283+0000","last_undegraded":"2024-05-08T18:32:46.063283+0000","last_fullsized":"2024-05-08T18:32:46.063283+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:18:12.841872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"100'19","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.059596+0000","last_change":"2024-05-08T18:29:46.603563+0000","last_active":"2024-05-08T18:32:46.059596+0000","last_peered":"2024-05-08T18:32:46.059596+0000","last_clean":"2024-05-08T18:32:46.059596+0000","last_became_active":"2024-05-08T18:29:46.602801+0000","last_became_peered":"2024-05-08T18:29:46.602801+0000","last_unstale":"2024-05-08T18:32:46.059596+0000","last_undegraded":"2024-05-08T18:32:46.059596+0000","last_fullsized":"2024-05-08T18:32:46.059596+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:22:36.338527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":17,"num_write":20,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863847+0000","last_change":"2024-05-08T18:29:48.642806+0000","last_active":"2024-05-08T18:32:46.863847+0000","last_peered":"2024-05-08T18:32:46.863847+0000","last_clean":"2024-05-08T18:32:46.863847+0000","last_became_active":"2024-05-08T18:29:48.641813+0000","last_became_peered":"2024-05-08T18:29:48.641813+0000","last_unstale":"2024-05-08T18:32:46.863847+0000","last_undegraded":"2024-05-08T18:32:46.863847+0000","last_fullsized":"2024-05-08T18:32:46.863847+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:50:48.169666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"80'2","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.062631+0000","last_change":"2024-05-08T18:29:50.689819+0000","last_active":"2024-05-08T18:32:46.062631+0000","last_peered":"2024-05-08T18:32:46.062631+0000","last_clean":"2024-05-08T18:32:46.062631+0000","last_became_active":"2024-05-08T18:29:50.686739+0000","last_became_peered":"2024-05-08T18:29:50.686739+0000","last_unstale":"2024-05-08T18:32:46.062631+0000","last_undegraded":"2024-05-08T18:32:46.062631+0000","last_fullsized":"2024-05-08T18:32:46.062631+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:45:34.171402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.060014+0000","last_change":"2024-05-08T18:29:42.552388+0000","last_active":"2024-05-08T18:32:46.060014+0000","last_peered":"2024-05-08T18:32:46.060014+0000","last_clean":"2024-05-08T18:32:46.060014+0000","last_became_active":"2024-05-08T18:29:42.551647+0000","last_became_peered":"2024-05-08T18:29:42.551647+0000","last_unstale":"2024-05-08T18:32:46.060014+0000","last_undegraded":"2024-05-08T18:32:46.060014+0000","last_fullsized":"2024-05-08T18:32:46.060014+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:55.055481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"93'8","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.849557+0000","last_change":"2024-05-08T18:29:40.562946+0000","last_active":"2024-05-08T18:32:46.849557+0000","last_peered":"2024-05-08T18:32:46.849557+0000","last_clean":"2024-05-08T18:32:46.849557+0000","last_became_active":"2024-05-08T18:29:40.550942+0000","last_became_peered":"2024-05-08T18:29:40.550942+0000","last_unstale":"2024-05-08T18:32:46.849557+0000","last_undegraded":"2024-05-08T18:32:46.849557+0000","last_fullsized":"2024-05-08T18:32:46.849557+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:22.579629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.918001+0000","last_change":"2024-05-08T18:29:44.593681+0000","last_active":"2024-05-08T18:32:46.918001+0000","last_peered":"2024-05-08T18:32:46.918001+0000","last_clean":"2024-05-08T18:32:46.918001+0000","last_became_active":"2024-05-08T18:29:44.593242+0000","last_became_peered":"2024-05-08T18:29:44.593242+0000","last_unstale":"2024-05-08T18:32:46.918001+0000","last_undegraded":"2024-05-08T18:32:46.918001+0000","last_fullsized":"2024-05-08T18:32:46.918001+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:57.093364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"97'22","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.064038+0000","last_change":"2024-05-08T18:29:46.589514+0000","last_active":"2024-05-08T18:32:46.064038+0000","last_peered":"2024-05-08T18:32:46.064038+0000","last_clean":"2024-05-08T18:32:46.064038+0000","last_became_active":"2024-05-08T18:29:46.588784+0000","last_became_peered":"2024-05-08T18:29:46.588784+0000","last_unstale":"2024-05-08T18:32:46.064038+0000","last_undegraded":"2024-05-08T18:32:46.064038+0000","last_fullsized":"2024-05-08T18:32:46.064038+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:02:30.355168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":20,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"116'102","reported_seq":338,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:49.831491+0000","last_change":"2024-05-08T18:29:48.631007+0000","last_active":"2024-05-08T18:32:49.831491+0000","last_peered":"2024-05-08T18:32:49.831491+0000","last_clean":"2024-05-08T18:32:49.831491+0000","last_became_active":"2024-05-08T18:29:48.630229+0000","last_became_peered":"2024-05-08T18:29:48.630229+0000","last_unstale":"2024-05-08T18:32:49.831491+0000","last_undegraded":"2024-05-08T18:32:49.831491+0000","last_fullsized":"2024-05-08T18:32:49.831491+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:44:03.778419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.917498+0000","last_change":"2024-05-08T18:29:50.675105+0000","last_active":"2024-05-08T18:32:46.917498+0000","last_peered":"2024-05-08T18:32:46.917498+0000","last_clean":"2024-05-08T18:32:46.917498+0000","last_became_active":"2024-05-08T18:29:50.674292+0000","last_became_peered":"2024-05-08T18:29:50.674292+0000","last_unstale":"2024-05-08T18:32:46.917498+0000","last_undegraded":"2024-05-08T18:32:46.917498+0000","last_fullsized":"2024-05-08T18:32:46.917498+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:47:15.423647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"84'4","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.060239+0000","last_change":"2024-05-08T18:29:42.579707+0000","last_active":"2024-05-08T18:32:46.060239+0000","last_peered":"2024-05-08T18:32:46.060239+0000","last_clean":"2024-05-08T18:32:46.060239+0000","last_became_active":"2024-05-08T18:29:42.579059+0000","last_became_peered":"2024-05-08T18:29:42.579059+0000","last_unstale":"2024-05-08T18:32:46.060239+0000","last_undegraded":"2024-05-08T18:32:46.060239+0000","last_fullsized":"2024-05-08T18:32:46.060239+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:09.787597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"93'9","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.058163+0000","last_change":"2024-05-08T18:29:40.555327+0000","last_active":"2024-05-08T18:32:46.058163+0000","last_peered":"2024-05-08T18:32:46.058163+0000","last_clean":"2024-05-08T18:32:46.058163+0000","last_became_active":"2024-05-08T18:29:40.554594+0000","last_became_peered":"2024-05-08T18:29:40.554594+0000","last_unstale":"2024-05-08T18:32:46.058163+0000","last_undegraded":"2024-05-08T18:32:46.058163+0000","last_fullsized":"2024-05-08T18:32:46.058163+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:19.841114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":3,"num_read_kb":4,"num_write":19,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"26'2","reported_seq":324,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.079838+0000","last_change":"2024-05-08T18:29:44.582434+0000","last_active":"2024-05-08T18:32:47.079838+0000","last_peered":"2024-05-08T18:32:47.079838+0000","last_clean":"2024-05-08T18:32:47.079838+0000","last_became_active":"2024-05-08T18:29:44.581699+0000","last_became_peered":"2024-05-08T18:29:44.581699+0000","last_unstale":"2024-05-08T18:32:47.079838+0000","last_undegraded":"2024-05-08T18:32:47.079838+0000","last_fullsized":"2024-05-08T18:32:47.079838+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:19:29.113643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":134,"num_read_kb":134,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"33'10","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.065642+0000","last_change":"2024-05-08T18:29:46.590860+0000","last_active":"2024-05-08T18:32:46.065642+0000","last_peered":"2024-05-08T18:32:46.065642+0000","last_clean":"2024-05-08T18:32:46.065642+0000","last_became_active":"2024-05-08T18:29:46.590087+0000","last_became_peered":"2024-05-08T18:29:46.590087+0000","last_unstale":"2024-05-08T18:32:46.065642+0000","last_undegraded":"2024-05-08T18:32:46.065642+0000","last_fullsized":"2024-05-08T18:32:46.065642+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:19:58.358449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"116'102","reported_seq":362,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:49.831331+0000","last_change":"2024-05-08T18:29:48.635548+0000","last_active":"2024-05-08T18:32:49.831331+0000","last_peered":"2024-05-08T18:32:49.831331+0000","last_clean":"2024-05-08T18:32:49.831331+0000","last_became_active":"2024-05-08T18:29:48.634801+0000","last_became_peered":"2024-05-08T18:29:48.634801+0000","last_unstale":"2024-05-08T18:32:49.831331+0000","last_undegraded":"2024-05-08T18:32:49.831331+0000","last_fullsized":"2024-05-08T18:32:49.831331+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:04:20.128031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.058516+0000","last_change":"2024-05-08T18:29:50.668279+0000","last_active":"2024-05-08T18:32:46.058516+0000","last_peered":"2024-05-08T18:32:46.058516+0000","last_clean":"2024-05-08T18:32:46.058516+0000","last_became_active":"2024-05-08T18:29:50.667536+0000","last_became_peered":"2024-05-08T18:29:50.667536+0000","last_unstale":"2024-05-08T18:32:46.058516+0000","last_undegraded":"2024-05-08T18:32:46.058516+0000","last_fullsized":"2024-05-08T18:32:46.058516+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:12:05.780786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"97'14","reported_seq":224,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.916133+0000","last_change":"2024-05-08T18:29:42.563807+0000","last_active":"2024-05-08T18:32:46.916133+0000","last_peered":"2024-05-08T18:32:46.916133+0000","last_clean":"2024-05-08T18:32:46.916133+0000","last_became_active":"2024-05-08T18:29:42.563416+0000","last_became_peered":"2024-05-08T18:29:42.563416+0000","last_unstale":"2024-05-08T18:32:46.916133+0000","last_undegraded":"2024-05-08T18:32:46.916133+0000","last_fullsized":"2024-05-08T18:32:46.916133+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:18:10.803989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"93'12","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.064387+0000","last_change":"2024-05-08T18:29:40.548898+0000","last_active":"2024-05-08T18:32:46.064387+0000","last_peered":"2024-05-08T18:32:46.064387+0000","last_clean":"2024-05-08T18:32:46.064387+0000","last_became_active":"2024-05-08T18:29:40.548591+0000","last_became_peered":"2024-05-08T18:29:40.548591+0000","last_unstale":"2024-05-08T18:32:46.064387+0000","last_undegraded":"2024-05-08T18:32:46.064387+0000","last_fullsized":"2024-05-08T18:32:46.064387+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:27:41.414153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.059932+0000","last_change":"2024-05-08T18:29:44.582578+0000","last_active":"2024-05-08T18:32:46.059932+0000","last_peered":"2024-05-08T18:32:46.059932+0000","last_clean":"2024-05-08T18:32:46.059932+0000","last_became_active":"2024-05-08T18:29:44.581832+0000","last_became_peered":"2024-05-08T18:29:44.581832+0000","last_unstale":"2024-05-08T18:32:46.059932+0000","last_undegraded":"2024-05-08T18:32:46.059932+0000","last_fullsized":"2024-05-08T18:32:46.059932+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:52:25.736491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"97'23","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.079413+0000","last_change":"2024-05-08T18:29:46.602459+0000","last_active":"2024-05-08T18:32:47.079413+0000","last_peered":"2024-05-08T18:32:47.079413+0000","last_clean":"2024-05-08T18:32:47.079413+0000","last_became_active":"2024-05-08T18:29:46.601740+0000","last_became_peered":"2024-05-08T18:29:46.601740+0000","last_unstale":"2024-05-08T18:32:47.079413+0000","last_undegraded":"2024-05-08T18:32:47.079413+0000","last_fullsized":"2024-05-08T18:32:47.079413+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:58:31.293922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.849235+0000","last_change":"2024-05-08T18:29:48.640046+0000","last_active":"2024-05-08T18:32:46.849235+0000","last_peered":"2024-05-08T18:32:46.849235+0000","last_clean":"2024-05-08T18:32:46.849235+0000","last_became_active":"2024-05-08T18:29:48.639309+0000","last_became_peered":"2024-05-08T18:29:48.639309+0000","last_unstale":"2024-05-08T18:32:46.849235+0000","last_undegraded":"2024-05-08T18:32:46.849235+0000","last_fullsized":"2024-05-08T18:32:46.849235+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:10.533065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.917024+0000","last_change":"2024-05-08T18:29:50.668361+0000","last_active":"2024-05-08T18:32:46.917024+0000","last_peered":"2024-05-08T18:32:46.917024+0000","last_clean":"2024-05-08T18:32:46.917024+0000","last_became_active":"2024-05-08T18:29:50.667636+0000","last_became_peered":"2024-05-08T18:29:50.667636+0000","last_unstale":"2024-05-08T18:32:46.917024+0000","last_undegraded":"2024-05-08T18:32:46.917024+0000","last_fullsized":"2024-05-08T18:32:46.917024+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:58:35.356885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"97'4","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.847440+0000","last_change":"2024-05-08T18:29:42.584098+0000","last_active":"2024-05-08T18:32:46.847440+0000","last_peered":"2024-05-08T18:32:46.847440+0000","last_clean":"2024-05-08T18:32:46.847440+0000","last_became_active":"2024-05-08T18:29:42.583639+0000","last_became_peered":"2024-05-08T18:29:42.583639+0000","last_unstale":"2024-05-08T18:32:46.847440+0000","last_undegraded":"2024-05-08T18:32:46.847440+0000","last_fullsized":"2024-05-08T18:32:46.847440+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:08:15.026467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":296,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.936422+0000","last_change":"2024-05-08T18:29:27.115522+0000","last_active":"2024-05-08T18:32:46.936422+0000","last_peered":"2024-05-08T18:32:46.936422+0000","last_clean":"2024-05-08T18:32:46.936422+0000","last_became_active":"2024-05-08T18:29:27.112960+0000","last_became_peered":"2024-05-08T18:29:27.112960+0000","last_unstale":"2024-05-08T18:32:46.936422+0000","last_undegraded":"2024-05-08T18:32:46.936422+0000","last_fullsized":"2024-05-08T18:32:46.936422+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:26.091102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:26.091102+0000","last_clean_scrub_stamp":"2024-05-08T18:29:26.091102+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:09:50.296961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.077723+0000","last_change":"2024-05-08T18:29:34.496467+0000","last_active":"2024-05-08T18:32:47.077723+0000","last_peered":"2024-05-08T18:32:47.077723+0000","last_clean":"2024-05-08T18:32:47.077723+0000","last_became_active":"2024-05-08T18:29:34.495632+0000","last_became_peered":"2024-05-08T18:29:34.495632+0000","last_unstale":"2024-05-08T18:32:47.077723+0000","last_undegraded":"2024-05-08T18:32:47.077723+0000","last_fullsized":"2024-05-08T18:32:47.077723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:35.917391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"93'5","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.065505+0000","last_change":"2024-05-08T18:30:20.849562+0000","last_active":"2024-05-08T18:32:46.065505+0000","last_peered":"2024-05-08T18:32:46.065505+0000","last_clean":"2024-05-08T18:32:46.065505+0000","last_became_active":"2024-05-08T18:30:20.849160+0000","last_became_peered":"2024-05-08T18:30:20.849160+0000","last_unstale":"2024-05-08T18:32:46.065505+0000","last_undegraded":"2024-05-08T18:32:46.065505+0000","last_fullsized":"2024-05-08T18:32:46.065505+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:29:13.478886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.937166+0000","last_change":"2024-05-08T18:29:44.592445+0000","last_active":"2024-05-08T18:32:46.937166+0000","last_peered":"2024-05-08T18:32:46.937166+0000","last_clean":"2024-05-08T18:32:46.937166+0000","last_became_active":"2024-05-08T18:29:44.587855+0000","last_became_peered":"2024-05-08T18:29:44.587855+0000","last_unstale":"2024-05-08T18:32:46.937166+0000","last_undegraded":"2024-05-08T18:32:46.937166+0000","last_fullsized":"2024-05-08T18:32:46.937166+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:06:05.355648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"97'33","reported_seq":231,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.080401+0000","last_change":"2024-05-08T18:29:46.595394+0000","last_active":"2024-05-08T18:32:47.080401+0000","last_peered":"2024-05-08T18:32:47.080401+0000","last_clean":"2024-05-08T18:32:47.080401+0000","last_became_active":"2024-05-08T18:29:46.594573+0000","last_became_peered":"2024-05-08T18:29:46.594573+0000","last_unstale":"2024-05-08T18:32:47.080401+0000","last_undegraded":"2024-05-08T18:32:47.080401+0000","last_fullsized":"2024-05-08T18:32:47.080401+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:47:11.360684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71557,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":23,"num_write":20,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863388+0000","last_change":"2024-05-08T18:29:48.632178+0000","last_active":"2024-05-08T18:32:46.863388+0000","last_peered":"2024-05-08T18:32:46.863388+0000","last_clean":"2024-05-08T18:32:46.863388+0000","last_became_active":"2024-05-08T18:29:48.631481+0000","last_became_peered":"2024-05-08T18:29:48.631481+0000","last_unstale":"2024-05-08T18:32:46.863388+0000","last_undegraded":"2024-05-08T18:32:46.863388+0000","last_fullsized":"2024-05-08T18:32:46.863388+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:34.806539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"80'2","reported_seq":176,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.848444+0000","last_change":"2024-05-08T18:29:50.675319+0000","last_active":"2024-05-08T18:32:46.848444+0000","last_peered":"2024-05-08T18:32:46.848444+0000","last_clean":"2024-05-08T18:32:46.848444+0000","last_became_active":"2024-05-08T18:29:50.674526+0000","last_became_peered":"2024-05-08T18:29:50.674526+0000","last_unstale":"2024-05-08T18:32:46.848444+0000","last_undegraded":"2024-05-08T18:32:46.848444+0000","last_fullsized":"2024-05-08T18:32:46.848444+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:59:06.404586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"84'4","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863527+0000","last_change":"2024-05-08T18:29:42.568584+0000","last_active":"2024-05-08T18:32:46.863527+0000","last_peered":"2024-05-08T18:32:46.863527+0000","last_clean":"2024-05-08T18:32:46.863527+0000","last_became_active":"2024-05-08T18:29:42.568244+0000","last_became_peered":"2024-05-08T18:29:42.568244+0000","last_unstale":"2024-05-08T18:32:46.863527+0000","last_undegraded":"2024-05-08T18:32:46.863527+0000","last_fullsized":"2024-05-08T18:32:46.863527+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:20.397730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.935976+0000","last_change":"2024-05-08T18:29:34.497654+0000","last_active":"2024-05-08T18:32:46.935976+0000","last_peered":"2024-05-08T18:32:46.935976+0000","last_clean":"2024-05-08T18:32:46.935976+0000","last_became_active":"2024-05-08T18:29:34.495812+0000","last_became_peered":"2024-05-08T18:29:34.495812+0000","last_unstale":"2024-05-08T18:32:46.935976+0000","last_undegraded":"2024-05-08T18:32:46.935976+0000","last_fullsized":"2024-05-08T18:32:46.935976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:37:02.202613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"93'7","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.862540+0000","last_change":"2024-05-08T18:29:40.560653+0000","last_active":"2024-05-08T18:32:46.862540+0000","last_peered":"2024-05-08T18:32:46.862540+0000","last_clean":"2024-05-08T18:32:46.862540+0000","last_became_active":"2024-05-08T18:29:40.560296+0000","last_became_peered":"2024-05-08T18:29:40.560296+0000","last_unstale":"2024-05-08T18:32:46.862540+0000","last_undegraded":"2024-05-08T18:32:46.862540+0000","last_fullsized":"2024-05-08T18:32:46.862540+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:52.462279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.080676+0000","last_change":"2024-05-08T18:29:44.594681+0000","last_active":"2024-05-08T18:32:47.080676+0000","last_peered":"2024-05-08T18:32:47.080676+0000","last_clean":"2024-05-08T18:32:47.080676+0000","last_became_active":"2024-05-08T18:29:44.593917+0000","last_became_peered":"2024-05-08T18:29:44.593917+0000","last_unstale":"2024-05-08T18:32:47.080676+0000","last_undegraded":"2024-05-08T18:32:47.080676+0000","last_fullsized":"2024-05-08T18:32:47.080676+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:59:00.335437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"116'109","reported_seq":384,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:49.831439+0000","last_change":"2024-05-08T18:29:46.599932+0000","last_active":"2024-05-08T18:32:49.831439+0000","last_peered":"2024-05-08T18:32:49.831439+0000","last_clean":"2024-05-08T18:32:49.831439+0000","last_became_active":"2024-05-08T18:29:46.594789+0000","last_became_peered":"2024-05-08T18:29:46.594789+0000","last_unstale":"2024-05-08T18:32:49.831439+0000","last_undegraded":"2024-05-08T18:32:49.831439+0000","last_fullsized":"2024-05-08T18:32:49.831439+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:04:18.099848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9947,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":143,"num_read_kb":128,"num_write":28,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.937370+0000","last_change":"2024-05-08T18:29:48.634661+0000","last_active":"2024-05-08T18:32:46.937370+0000","last_peered":"2024-05-08T18:32:46.937370+0000","last_clean":"2024-05-08T18:32:46.937370+0000","last_became_active":"2024-05-08T18:29:48.634044+0000","last_became_peered":"2024-05-08T18:29:48.634044+0000","last_unstale":"2024-05-08T18:32:46.937370+0000","last_undegraded":"2024-05-08T18:32:46.937370+0000","last_fullsized":"2024-05-08T18:32:46.937370+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:01:46.238076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.916916+0000","last_change":"2024-05-08T18:29:50.676536+0000","last_active":"2024-05-08T18:32:46.916916+0000","last_peered":"2024-05-08T18:32:46.916916+0000","last_clean":"2024-05-08T18:32:46.916916+0000","last_became_active":"2024-05-08T18:29:50.675770+0000","last_became_peered":"2024-05-08T18:29:50.675770+0000","last_unstale":"2024-05-08T18:32:46.916916+0000","last_undegraded":"2024-05-08T18:32:46.916916+0000","last_fullsized":"2024-05-08T18:32:46.916916+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:28.003482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.919578+0000","last_change":"2024-05-08T18:29:42.575253+0000","last_active":"2024-05-08T18:32:46.919578+0000","last_peered":"2024-05-08T18:32:46.919578+0000","last_clean":"2024-05-08T18:32:46.919578+0000","last_became_active":"2024-05-08T18:29:42.573621+0000","last_became_peered":"2024-05-08T18:29:42.573621+0000","last_unstale":"2024-05-08T18:32:46.919578+0000","last_undegraded":"2024-05-08T18:32:46.919578+0000","last_fullsized":"2024-05-08T18:32:46.919578+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:59.243324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.060706+0000","last_change":"2024-05-08T18:29:34.491071+0000","last_active":"2024-05-08T18:32:46.060706+0000","last_peered":"2024-05-08T18:32:46.060706+0000","last_clean":"2024-05-08T18:32:46.060706+0000","last_became_active":"2024-05-08T18:29:34.490717+0000","last_became_peered":"2024-05-08T18:29:34.490717+0000","last_unstale":"2024-05-08T18:32:46.060706+0000","last_undegraded":"2024-05-08T18:32:46.060706+0000","last_fullsized":"2024-05-08T18:32:46.060706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:55.793312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"93'12","reported_seq":211,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.916751+0000","last_change":"2024-05-08T18:29:40.530634+0000","last_active":"2024-05-08T18:32:46.916751+0000","last_peered":"2024-05-08T18:32:46.916751+0000","last_clean":"2024-05-08T18:32:46.916751+0000","last_became_active":"2024-05-08T18:29:40.529804+0000","last_became_peered":"2024-05-08T18:29:40.529804+0000","last_unstale":"2024-05-08T18:32:46.916751+0000","last_undegraded":"2024-05-08T18:32:46.916751+0000","last_fullsized":"2024-05-08T18:32:46.916751+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:59:25.840149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"26'1","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.064037+0000","last_change":"2024-05-08T18:29:44.584678+0000","last_active":"2024-05-08T18:32:46.064037+0000","last_peered":"2024-05-08T18:32:46.064037+0000","last_clean":"2024-05-08T18:32:46.064037+0000","last_became_active":"2024-05-08T18:29:44.584227+0000","last_became_peered":"2024-05-08T18:29:44.584227+0000","last_unstale":"2024-05-08T18:32:46.064037+0000","last_undegraded":"2024-05-08T18:32:46.064037+0000","last_fullsized":"2024-05-08T18:32:46.064037+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:04:01.281207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"116'16","reported_seq":241,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:49.831341+0000","last_change":"2024-05-08T18:29:46.608720+0000","last_active":"2024-05-08T18:32:49.831341+0000","last_peered":"2024-05-08T18:32:49.831341+0000","last_clean":"2024-05-08T18:32:49.831341+0000","last_became_active":"2024-05-08T18:29:46.607989+0000","last_became_peered":"2024-05-08T18:29:46.607989+0000","last_unstale":"2024-05-08T18:32:49.831341+0000","last_undegraded":"2024-05-08T18:32:49.831341+0000","last_fullsized":"2024-05-08T18:32:49.831341+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:58:31.293922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863028+0000","last_change":"2024-05-08T18:29:48.625269+0000","last_active":"2024-05-08T18:32:46.863028+0000","last_peered":"2024-05-08T18:32:46.863028+0000","last_clean":"2024-05-08T18:32:46.863028+0000","last_became_active":"2024-05-08T18:29:48.624545+0000","last_became_peered":"2024-05-08T18:29:48.624545+0000","last_unstale":"2024-05-08T18:32:46.863028+0000","last_undegraded":"2024-05-08T18:32:46.863028+0000","last_fullsized":"2024-05-08T18:32:46.863028+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:16:42.799734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"84'12","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.063889+0000","last_change":"2024-05-08T18:29:50.688851+0000","last_active":"2024-05-08T18:32:46.063889+0000","last_peered":"2024-05-08T18:32:46.063889+0000","last_clean":"2024-05-08T18:32:46.063889+0000","last_became_active":"2024-05-08T18:29:50.687978+0000","last_became_peered":"2024-05-08T18:29:50.687978+0000","last_unstale":"2024-05-08T18:32:46.063889+0000","last_undegraded":"2024-05-08T18:32:46.063889+0000","last_fullsized":"2024-05-08T18:32:46.063889+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:28:29.836446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":42,"num_write":31,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"84'4","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.918158+0000","last_change":"2024-05-08T18:31:22.008678+0000","last_active":"2024-05-08T18:32:46.918158+0000","last_peered":"2024-05-08T18:32:46.918158+0000","last_clean":"2024-05-08T18:32:46.918158+0000","last_became_active":"2024-05-08T18:31:22.008342+0000","last_became_peered":"2024-05-08T18:31:22.008342+0000","last_unstale":"2024-05-08T18:32:46.918158+0000","last_undegraded":"2024-05-08T18:32:46.918158+0000","last_fullsized":"2024-05-08T18:32:46.918158+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:40:30.531379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.079379+0000","last_change":"2024-05-08T18:29:34.496942+0000","last_active":"2024-05-08T18:32:47.079379+0000","last_peered":"2024-05-08T18:32:47.079379+0000","last_clean":"2024-05-08T18:32:47.079379+0000","last_became_active":"2024-05-08T18:29:34.495882+0000","last_became_peered":"2024-05-08T18:29:34.495882+0000","last_unstale":"2024-05-08T18:32:47.079379+0000","last_undegraded":"2024-05-08T18:32:47.079379+0000","last_fullsized":"2024-05-08T18:32:47.079379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:55.793312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"93'8","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.059323+0000","last_change":"2024-05-08T18:29:40.554353+0000","last_active":"2024-05-08T18:32:46.059323+0000","last_peered":"2024-05-08T18:32:46.059323+0000","last_clean":"2024-05-08T18:32:46.059323+0000","last_became_active":"2024-05-08T18:29:40.553527+0000","last_became_peered":"2024-05-08T18:29:40.553527+0000","last_unstale":"2024-05-08T18:32:46.059323+0000","last_undegraded":"2024-05-08T18:32:46.059323+0000","last_fullsized":"2024-05-08T18:32:46.059323+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:03:42.148647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":189,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863485+0000","last_change":"2024-05-08T18:29:44.597411+0000","last_active":"2024-05-08T18:32:46.863485+0000","last_peered":"2024-05-08T18:32:46.863485+0000","last_clean":"2024-05-08T18:32:46.863485+0000","last_became_active":"2024-05-08T18:29:44.596678+0000","last_became_peered":"2024-05-08T18:29:44.596678+0000","last_unstale":"2024-05-08T18:32:46.863485+0000","last_undegraded":"2024-05-08T18:32:46.863485+0000","last_fullsized":"2024-05-08T18:32:46.863485+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:37:23.674968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"97'13","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.066095+0000","last_change":"2024-05-08T18:29:46.607040+0000","last_active":"2024-05-08T18:32:46.066095+0000","last_peered":"2024-05-08T18:32:46.066095+0000","last_clean":"2024-05-08T18:32:46.066095+0000","last_became_active":"2024-05-08T18:29:46.606367+0000","last_became_peered":"2024-05-08T18:29:46.606367+0000","last_unstale":"2024-05-08T18:32:46.066095+0000","last_undegraded":"2024-05-08T18:32:46.066095+0000","last_fullsized":"2024-05-08T18:32:46.066095+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:59:26.650126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.850025+0000","last_change":"2024-05-08T18:29:48.632665+0000","last_active":"2024-05-08T18:32:46.850025+0000","last_peered":"2024-05-08T18:32:46.850025+0000","last_clean":"2024-05-08T18:32:46.850025+0000","last_became_active":"2024-05-08T18:29:48.631874+0000","last_became_peered":"2024-05-08T18:29:48.631874+0000","last_unstale":"2024-05-08T18:32:46.850025+0000","last_undegraded":"2024-05-08T18:32:46.850025+0000","last_fullsized":"2024-05-08T18:32:46.850025+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:06:09.390017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":176,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.078092+0000","last_change":"2024-05-08T18:29:50.683443+0000","last_active":"2024-05-08T18:32:47.078092+0000","last_peered":"2024-05-08T18:32:47.078092+0000","last_clean":"2024-05-08T18:32:47.078092+0000","last_became_active":"2024-05-08T18:29:50.682634+0000","last_became_peered":"2024-05-08T18:29:50.682634+0000","last_unstale":"2024-05-08T18:32:47.078092+0000","last_undegraded":"2024-05-08T18:32:47.078092+0000","last_fullsized":"2024-05-08T18:32:47.078092+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:10:38.951662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"80'2","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.917272+0000","last_change":"2024-05-08T18:29:42.574593+0000","last_active":"2024-05-08T18:32:46.917272+0000","last_peered":"2024-05-08T18:32:46.917272+0000","last_clean":"2024-05-08T18:32:46.917272+0000","last_became_active":"2024-05-08T18:29:42.574288+0000","last_became_peered":"2024-05-08T18:29:42.574288+0000","last_unstale":"2024-05-08T18:32:46.917272+0000","last_undegraded":"2024-05-08T18:32:46.917272+0000","last_fullsized":"2024-05-08T18:32:46.917272+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:58.320701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"93'11","reported_seq":158,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.063035+0000","last_change":"2024-05-08T18:30:20.850805+0000","last_active":"2024-05-08T18:32:46.063035+0000","last_peered":"2024-05-08T18:32:46.063035+0000","last_clean":"2024-05-08T18:32:46.063035+0000","last_became_active":"2024-05-08T18:30:20.850365+0000","last_became_peered":"2024-05-08T18:30:20.850365+0000","last_unstale":"2024-05-08T18:32:46.063035+0000","last_undegraded":"2024-05-08T18:32:46.063035+0000","last_fullsized":"2024-05-08T18:32:46.063035+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:52:21.678894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.918404+0000","last_change":"2024-05-08T18:29:34.606393+0000","last_active":"2024-05-08T18:32:46.918404+0000","last_peered":"2024-05-08T18:32:46.918404+0000","last_clean":"2024-05-08T18:32:46.918404+0000","last_became_active":"2024-05-08T18:29:34.605574+0000","last_became_peered":"2024-05-08T18:29:34.605574+0000","last_unstale":"2024-05-08T18:32:46.918404+0000","last_undegraded":"2024-05-08T18:32:46.918404+0000","last_fullsized":"2024-05-08T18:32:46.918404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:55.793312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":189,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.862948+0000","last_change":"2024-05-08T18:29:44.595127+0000","last_active":"2024-05-08T18:32:46.862948+0000","last_peered":"2024-05-08T18:32:46.862948+0000","last_clean":"2024-05-08T18:32:46.862948+0000","last_became_active":"2024-05-08T18:29:44.594642+0000","last_became_peered":"2024-05-08T18:29:44.594642+0000","last_unstale":"2024-05-08T18:32:46.862948+0000","last_undegraded":"2024-05-08T18:32:46.862948+0000","last_fullsized":"2024-05-08T18:32:46.862948+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:04:49.020450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"97'32","reported_seq":231,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.862122+0000","last_change":"2024-05-08T18:29:46.602279+0000","last_active":"2024-05-08T18:32:46.862122+0000","last_peered":"2024-05-08T18:32:46.862122+0000","last_clean":"2024-05-08T18:32:46.862122+0000","last_became_active":"2024-05-08T18:29:46.599707+0000","last_became_peered":"2024-05-08T18:29:46.599707+0000","last_unstale":"2024-05-08T18:32:46.862122+0000","last_undegraded":"2024-05-08T18:32:46.862122+0000","last_fullsized":"2024-05-08T18:32:46.862122+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:54:48.654215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62414,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":24,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.057286+0000","last_change":"2024-05-08T18:29:48.639458+0000","last_active":"2024-05-08T18:32:46.057286+0000","last_peered":"2024-05-08T18:32:46.057286+0000","last_clean":"2024-05-08T18:32:46.057286+0000","last_became_active":"2024-05-08T18:29:48.638709+0000","last_became_peered":"2024-05-08T18:29:48.638709+0000","last_unstale":"2024-05-08T18:32:46.057286+0000","last_undegraded":"2024-05-08T18:32:46.057286+0000","last_fullsized":"2024-05-08T18:32:46.057286+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:19:58.182291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"97'6","reported_seq":189,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.861327+0000","last_change":"2024-05-08T18:29:50.681077+0000","last_active":"2024-05-08T18:32:46.861327+0000","last_peered":"2024-05-08T18:32:46.861327+0000","last_clean":"2024-05-08T18:32:46.861327+0000","last_became_active":"2024-05-08T18:29:50.675766+0000","last_became_peered":"2024-05-08T18:29:50.675766+0000","last_unstale":"2024-05-08T18:32:46.861327+0000","last_undegraded":"2024-05-08T18:32:46.861327+0000","last_fullsized":"2024-05-08T18:32:46.861327+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:09:29.641515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"80'2","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863332+0000","last_change":"2024-05-08T18:29:42.571265+0000","last_active":"2024-05-08T18:32:46.863332+0000","last_peered":"2024-05-08T18:32:46.863332+0000","last_clean":"2024-05-08T18:32:46.863332+0000","last_became_active":"2024-05-08T18:29:42.570645+0000","last_became_peered":"2024-05-08T18:29:42.570645+0000","last_unstale":"2024-05-08T18:32:46.863332+0000","last_undegraded":"2024-05-08T18:32:46.863332+0000","last_fullsized":"2024-05-08T18:32:46.863332+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:30:29.452640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"93'3","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.918243+0000","last_change":"2024-05-08T18:29:40.531079+0000","last_active":"2024-05-08T18:32:46.918243+0000","last_peered":"2024-05-08T18:32:46.918243+0000","last_clean":"2024-05-08T18:32:46.918243+0000","last_became_active":"2024-05-08T18:29:40.530256+0000","last_became_peered":"2024-05-08T18:29:40.530256+0000","last_unstale":"2024-05-08T18:32:46.918243+0000","last_undegraded":"2024-05-08T18:32:46.918243+0000","last_fullsized":"2024-05-08T18:32:46.918243+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:09:42.581976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.938519+0000","last_change":"2024-05-08T18:29:34.603292+0000","last_active":"2024-05-08T18:32:46.938519+0000","last_peered":"2024-05-08T18:32:46.938519+0000","last_clean":"2024-05-08T18:32:46.938519+0000","last_became_active":"2024-05-08T18:29:34.602547+0000","last_became_peered":"2024-05-08T18:29:34.602547+0000","last_unstale":"2024-05-08T18:32:46.938519+0000","last_undegraded":"2024-05-08T18:32:46.938519+0000","last_fullsized":"2024-05-08T18:32:46.938519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:24:55.555475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.849004+0000","last_change":"2024-05-08T18:29:44.593275+0000","last_active":"2024-05-08T18:32:46.849004+0000","last_peered":"2024-05-08T18:32:46.849004+0000","last_clean":"2024-05-08T18:32:46.849004+0000","last_became_active":"2024-05-08T18:29:44.591870+0000","last_became_peered":"2024-05-08T18:29:44.591870+0000","last_unstale":"2024-05-08T18:32:46.849004+0000","last_undegraded":"2024-05-08T18:32:46.849004+0000","last_fullsized":"2024-05-08T18:32:46.849004+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:35.176971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"33'14","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.917202+0000","last_change":"2024-05-08T18:29:46.603499+0000","last_active":"2024-05-08T18:32:46.917202+0000","last_peered":"2024-05-08T18:32:46.917202+0000","last_clean":"2024-05-08T18:32:46.917202+0000","last_became_active":"2024-05-08T18:29:46.602920+0000","last_became_peered":"2024-05-08T18:29:46.602920+0000","last_unstale":"2024-05-08T18:32:46.917202+0000","last_undegraded":"2024-05-08T18:32:46.917202+0000","last_fullsized":"2024-05-08T18:32:46.917202+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:08.504882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"116'102","reported_seq":331,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:49.831864+0000","last_change":"2024-05-08T18:29:48.634915+0000","last_active":"2024-05-08T18:32:49.831864+0000","last_peered":"2024-05-08T18:32:49.831864+0000","last_clean":"2024-05-08T18:32:49.831864+0000","last_became_active":"2024-05-08T18:29:48.634280+0000","last_became_peered":"2024-05-08T18:29:48.634280+0000","last_unstale":"2024-05-08T18:32:49.831864+0000","last_undegraded":"2024-05-08T18:32:49.831864+0000","last_fullsized":"2024-05-08T18:32:49.831864+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:19:58.182291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"80'2","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.067407+0000","last_change":"2024-05-08T18:29:50.688742+0000","last_active":"2024-05-08T18:32:46.067407+0000","last_peered":"2024-05-08T18:32:46.067407+0000","last_clean":"2024-05-08T18:32:46.067407+0000","last_became_active":"2024-05-08T18:29:50.687135+0000","last_became_peered":"2024-05-08T18:29:50.687135+0000","last_unstale":"2024-05-08T18:32:46.067407+0000","last_undegraded":"2024-05-08T18:32:46.067407+0000","last_fullsized":"2024-05-08T18:32:46.067407+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:12:49.040807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"80'2","reported_seq":152,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.059948+0000","last_change":"2024-05-08T18:30:21.220561+0000","last_active":"2024-05-08T18:32:46.059948+0000","last_peered":"2024-05-08T18:32:46.059948+0000","last_clean":"2024-05-08T18:32:46.059948+0000","last_became_active":"2024-05-08T18:30:21.220196+0000","last_became_peered":"2024-05-08T18:30:21.220196+0000","last_unstale":"2024-05-08T18:32:46.059948+0000","last_undegraded":"2024-05-08T18:32:46.059948+0000","last_fullsized":"2024-05-08T18:32:46.059948+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:19:27.075761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"83'5","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.066414+0000","last_change":"2024-05-08T18:29:40.565872+0000","last_active":"2024-05-08T18:32:46.066414+0000","last_peered":"2024-05-08T18:32:46.066414+0000","last_clean":"2024-05-08T18:32:46.066414+0000","last_became_active":"2024-05-08T18:29:40.565655+0000","last_became_peered":"2024-05-08T18:29:40.565655+0000","last_unstale":"2024-05-08T18:32:46.066414+0000","last_undegraded":"2024-05-08T18:32:46.066414+0000","last_fullsized":"2024-05-08T18:32:46.066414+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:16:16.521258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.919692+0000","last_change":"2024-05-08T18:29:34.501273+0000","last_active":"2024-05-08T18:32:46.919692+0000","last_peered":"2024-05-08T18:32:46.919692+0000","last_clean":"2024-05-08T18:32:46.919692+0000","last_became_active":"2024-05-08T18:29:34.500933+0000","last_became_peered":"2024-05-08T18:29:34.500933+0000","last_unstale":"2024-05-08T18:32:46.919692+0000","last_undegraded":"2024-05-08T18:32:46.919692+0000","last_fullsized":"2024-05-08T18:32:46.919692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:35.917391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.057534+0000","last_change":"2024-05-08T18:29:44.576227+0000","last_active":"2024-05-08T18:32:46.057534+0000","last_peered":"2024-05-08T18:32:46.057534+0000","last_clean":"2024-05-08T18:32:46.057534+0000","last_became_active":"2024-05-08T18:29:44.575454+0000","last_became_peered":"2024-05-08T18:29:44.575454+0000","last_unstale":"2024-05-08T18:32:46.057534+0000","last_undegraded":"2024-05-08T18:32:46.057534+0000","last_fullsized":"2024-05-08T18:32:46.057534+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:06:05.355648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"80'11","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.058692+0000","last_change":"2024-05-08T18:29:46.609633+0000","last_active":"2024-05-08T18:32:46.058692+0000","last_peered":"2024-05-08T18:32:46.058692+0000","last_clean":"2024-05-08T18:32:46.058692+0000","last_became_active":"2024-05-08T18:29:46.603455+0000","last_became_peered":"2024-05-08T18:29:46.603455+0000","last_unstale":"2024-05-08T18:32:46.058692+0000","last_undegraded":"2024-05-08T18:32:46.058692+0000","last_fullsized":"2024-05-08T18:32:46.058692+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:07:54.654205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"116'102","reported_seq":365,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:49.831065+0000","last_change":"2024-05-08T18:29:48.637898+0000","last_active":"2024-05-08T18:32:49.831065+0000","last_peered":"2024-05-08T18:32:49.831065+0000","last_clean":"2024-05-08T18:32:49.831065+0000","last_became_active":"2024-05-08T18:29:48.637070+0000","last_became_peered":"2024-05-08T18:29:48.637070+0000","last_unstale":"2024-05-08T18:32:49.831065+0000","last_undegraded":"2024-05-08T18:32:49.831065+0000","last_fullsized":"2024-05-08T18:32:49.831065+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:03:46.392864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"84'10","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.861002+0000","last_change":"2024-05-08T18:29:50.691526+0000","last_active":"2024-05-08T18:32:46.861002+0000","last_peered":"2024-05-08T18:32:46.861002+0000","last_clean":"2024-05-08T18:32:46.861002+0000","last_became_active":"2024-05-08T18:29:50.690767+0000","last_became_peered":"2024-05-08T18:29:50.690767+0000","last_unstale":"2024-05-08T18:32:46.861002+0000","last_undegraded":"2024-05-08T18:32:46.861002+0000","last_fullsized":"2024-05-08T18:32:46.861002+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:32:29.972139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"97'16","reported_seq":229,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.057923+0000","last_change":"2024-05-08T18:29:42.562006+0000","last_active":"2024-05-08T18:32:46.057923+0000","last_peered":"2024-05-08T18:32:46.057923+0000","last_clean":"2024-05-08T18:32:46.057923+0000","last_became_active":"2024-05-08T18:29:42.560861+0000","last_became_peered":"2024-05-08T18:29:42.560861+0000","last_unstale":"2024-05-08T18:32:46.057923+0000","last_undegraded":"2024-05-08T18:32:46.057923+0000","last_fullsized":"2024-05-08T18:32:46.057923+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:36.890277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"93'9","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863638+0000","last_change":"2024-05-08T18:29:40.550529+0000","last_active":"2024-05-08T18:32:46.863638+0000","last_peered":"2024-05-08T18:32:46.863638+0000","last_clean":"2024-05-08T18:32:46.863638+0000","last_became_active":"2024-05-08T18:29:40.550241+0000","last_became_peered":"2024-05-08T18:29:40.550241+0000","last_unstale":"2024-05-08T18:32:46.863638+0000","last_undegraded":"2024-05-08T18:32:46.863638+0000","last_fullsized":"2024-05-08T18:32:46.863638+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:48.294532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.850587+0000","last_change":"2024-05-08T18:29:34.493537+0000","last_active":"2024-05-08T18:32:46.850587+0000","last_peered":"2024-05-08T18:32:46.850587+0000","last_clean":"2024-05-08T18:32:46.850587+0000","last_became_active":"2024-05-08T18:29:34.492891+0000","last_became_peered":"2024-05-08T18:29:34.492891+0000","last_unstale":"2024-05-08T18:32:46.850587+0000","last_undegraded":"2024-05-08T18:32:46.850587+0000","last_fullsized":"2024-05-08T18:32:46.850587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:09:07.992256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":189,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.063279+0000","last_change":"2024-05-08T18:29:44.590102+0000","last_active":"2024-05-08T18:32:46.063279+0000","last_peered":"2024-05-08T18:32:46.063279+0000","last_clean":"2024-05-08T18:32:46.063279+0000","last_became_active":"2024-05-08T18:29:44.589471+0000","last_became_peered":"2024-05-08T18:29:44.589471+0000","last_unstale":"2024-05-08T18:32:46.063279+0000","last_undegraded":"2024-05-08T18:32:46.063279+0000","last_fullsized":"2024-05-08T18:32:46.063279+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:14:04.085401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"97'37","reported_seq":236,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.935847+0000","last_change":"2024-05-08T18:29:46.606967+0000","last_active":"2024-05-08T18:32:46.935847+0000","last_peered":"2024-05-08T18:32:46.935847+0000","last_clean":"2024-05-08T18:32:46.935847+0000","last_became_active":"2024-05-08T18:29:46.605693+0000","last_became_peered":"2024-05-08T18:29:46.605693+0000","last_unstale":"2024-05-08T18:32:46.935847+0000","last_undegraded":"2024-05-08T18:32:46.935847+0000","last_fullsized":"2024-05-08T18:32:46.935847+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:24:13.568294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.061836+0000","last_change":"2024-05-08T18:29:48.634271+0000","last_active":"2024-05-08T18:32:46.061836+0000","last_peered":"2024-05-08T18:32:46.061836+0000","last_clean":"2024-05-08T18:32:46.061836+0000","last_became_active":"2024-05-08T18:29:48.633607+0000","last_became_peered":"2024-05-08T18:29:48.633607+0000","last_unstale":"2024-05-08T18:32:46.061836+0000","last_undegraded":"2024-05-08T18:32:46.061836+0000","last_fullsized":"2024-05-08T18:32:46.061836+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:34.806539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":176,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.079442+0000","last_change":"2024-05-08T18:29:50.685494+0000","last_active":"2024-05-08T18:32:47.079442+0000","last_peered":"2024-05-08T18:32:47.079442+0000","last_clean":"2024-05-08T18:32:47.079442+0000","last_became_active":"2024-05-08T18:29:50.684818+0000","last_became_peered":"2024-05-08T18:29:50.684818+0000","last_unstale":"2024-05-08T18:32:47.079442+0000","last_undegraded":"2024-05-08T18:32:47.079442+0000","last_fullsized":"2024-05-08T18:32:47.079442+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:22.220842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863373+0000","last_change":"2024-05-08T18:29:50.682937+0000","last_active":"2024-05-08T18:32:46.863373+0000","last_peered":"2024-05-08T18:32:46.863373+0000","last_clean":"2024-05-08T18:32:46.863373+0000","last_became_active":"2024-05-08T18:29:50.681771+0000","last_became_peered":"2024-05-08T18:29:50.681771+0000","last_unstale":"2024-05-08T18:32:46.863373+0000","last_undegraded":"2024-05-08T18:32:46.863373+0000","last_fullsized":"2024-05-08T18:32:46.863373+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:28:29.836446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"84'4","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.058933+0000","last_change":"2024-05-08T18:29:42.575909+0000","last_active":"2024-05-08T18:32:46.058933+0000","last_peered":"2024-05-08T18:32:46.058933+0000","last_clean":"2024-05-08T18:32:46.058933+0000","last_became_active":"2024-05-08T18:29:42.574877+0000","last_became_peered":"2024-05-08T18:29:42.574877+0000","last_unstale":"2024-05-08T18:32:46.058933+0000","last_undegraded":"2024-05-08T18:32:46.058933+0000","last_fullsized":"2024-05-08T18:32:46.058933+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:33.139089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"93'11","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.059190+0000","last_change":"2024-05-08T18:29:40.566496+0000","last_active":"2024-05-08T18:32:46.059190+0000","last_peered":"2024-05-08T18:32:46.059190+0000","last_clean":"2024-05-08T18:32:46.059190+0000","last_became_active":"2024-05-08T18:29:40.565874+0000","last_became_peered":"2024-05-08T18:29:40.565874+0000","last_unstale":"2024-05-08T18:32:46.059190+0000","last_undegraded":"2024-05-08T18:32:46.059190+0000","last_fullsized":"2024-05-08T18:32:46.059190+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:07.239963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.917412+0000","last_change":"2024-05-08T18:29:44.595410+0000","last_active":"2024-05-08T18:32:46.917412+0000","last_peered":"2024-05-08T18:32:46.917412+0000","last_clean":"2024-05-08T18:32:46.917412+0000","last_became_active":"2024-05-08T18:29:44.594286+0000","last_became_peered":"2024-05-08T18:29:44.594286+0000","last_unstale":"2024-05-08T18:32:46.917412+0000","last_undegraded":"2024-05-08T18:32:46.917412+0000","last_fullsized":"2024-05-08T18:32:46.917412+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:38.928160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"97'18","reported_seq":211,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.064873+0000","last_change":"2024-05-08T18:29:46.591009+0000","last_active":"2024-05-08T18:32:46.064873+0000","last_peered":"2024-05-08T18:32:46.064873+0000","last_clean":"2024-05-08T18:32:46.064873+0000","last_became_active":"2024-05-08T18:29:46.588810+0000","last_became_peered":"2024-05-08T18:29:46.588810+0000","last_unstale":"2024-05-08T18:32:46.064873+0000","last_undegraded":"2024-05-08T18:32:46.064873+0000","last_fullsized":"2024-05-08T18:32:46.064873+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:34:45.745300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.062900+0000","last_change":"2024-05-08T18:29:48.634986+0000","last_active":"2024-05-08T18:32:46.062900+0000","last_peered":"2024-05-08T18:32:46.062900+0000","last_clean":"2024-05-08T18:32:46.062900+0000","last_became_active":"2024-05-08T18:29:48.633866+0000","last_became_peered":"2024-05-08T18:29:48.633866+0000","last_unstale":"2024-05-08T18:32:46.062900+0000","last_undegraded":"2024-05-08T18:32:46.062900+0000","last_fullsized":"2024-05-08T18:32:46.062900+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:46.539830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"83'16","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.065910+0000","last_change":"2024-05-08T18:29:50.693408+0000","last_active":"2024-05-08T18:32:46.065910+0000","last_peered":"2024-05-08T18:32:46.065910+0000","last_clean":"2024-05-08T18:32:46.065910+0000","last_became_active":"2024-05-08T18:29:50.692687+0000","last_became_peered":"2024-05-08T18:29:50.692687+0000","last_unstale":"2024-05-08T18:32:46.065910+0000","last_undegraded":"2024-05-08T18:32:46.065910+0000","last_fullsized":"2024-05-08T18:32:46.065910+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:22.834262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":28,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"83'6","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.917179+0000","last_change":"2024-05-08T18:29:42.581368+0000","last_active":"2024-05-08T18:32:46.917179+0000","last_peered":"2024-05-08T18:32:46.917179+0000","last_clean":"2024-05-08T18:32:46.917179+0000","last_became_active":"2024-05-08T18:29:42.580887+0000","last_became_peered":"2024-05-08T18:29:42.580887+0000","last_unstale":"2024-05-08T18:32:46.917179+0000","last_undegraded":"2024-05-08T18:32:46.917179+0000","last_fullsized":"2024-05-08T18:32:46.917179+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:08:15.026467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"93'7","reported_seq":201,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.938046+0000","last_change":"2024-05-08T18:29:40.572770+0000","last_active":"2024-05-08T18:32:46.938046+0000","last_peered":"2024-05-08T18:32:46.938046+0000","last_clean":"2024-05-08T18:32:46.938046+0000","last_became_active":"2024-05-08T18:29:40.572079+0000","last_became_peered":"2024-05-08T18:29:40.572079+0000","last_unstale":"2024-05-08T18:32:46.938046+0000","last_undegraded":"2024-05-08T18:32:46.938046+0000","last_fullsized":"2024-05-08T18:32:46.938046+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:05.929806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":189,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.063663+0000","last_change":"2024-05-08T18:29:44.581323+0000","last_active":"2024-05-08T18:32:46.063663+0000","last_peered":"2024-05-08T18:32:46.063663+0000","last_clean":"2024-05-08T18:32:46.063663+0000","last_became_active":"2024-05-08T18:29:44.580805+0000","last_became_peered":"2024-05-08T18:29:44.580805+0000","last_unstale":"2024-05-08T18:32:46.063663+0000","last_undegraded":"2024-05-08T18:32:46.063663+0000","last_fullsized":"2024-05-08T18:32:46.063663+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:35:25.591140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"47'5","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.862030+0000","last_change":"2024-05-08T18:29:46.602495+0000","last_active":"2024-05-08T18:32:46.862030+0000","last_peered":"2024-05-08T18:32:46.862030+0000","last_clean":"2024-05-08T18:32:46.862030+0000","last_became_active":"2024-05-08T18:29:46.599789+0000","last_became_peered":"2024-05-08T18:29:46.599789+0000","last_unstale":"2024-05-08T18:32:46.862030+0000","last_undegraded":"2024-05-08T18:32:46.862030+0000","last_fullsized":"2024-05-08T18:32:46.862030+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:18:16.375808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.936013+0000","last_change":"2024-05-08T18:29:48.642994+0000","last_active":"2024-05-08T18:32:46.936013+0000","last_peered":"2024-05-08T18:32:46.936013+0000","last_clean":"2024-05-08T18:32:46.936013+0000","last_became_active":"2024-05-08T18:29:48.642056+0000","last_became_peered":"2024-05-08T18:29:48.642056+0000","last_unstale":"2024-05-08T18:32:46.936013+0000","last_undegraded":"2024-05-08T18:32:46.936013+0000","last_fullsized":"2024-05-08T18:32:46.936013+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:47:54.034851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863166+0000","last_change":"2024-05-08T18:29:50.672513+0000","last_active":"2024-05-08T18:32:46.863166+0000","last_peered":"2024-05-08T18:32:46.863166+0000","last_clean":"2024-05-08T18:32:46.863166+0000","last_became_active":"2024-05-08T18:29:50.671781+0000","last_became_peered":"2024-05-08T18:29:50.671781+0000","last_unstale":"2024-05-08T18:32:46.863166+0000","last_undegraded":"2024-05-08T18:32:46.863166+0000","last_fullsized":"2024-05-08T18:32:46.863166+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:45:34.171402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"97'2","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.062291+0000","last_change":"2024-05-08T18:29:42.576843+0000","last_active":"2024-05-08T18:32:46.062291+0000","last_peered":"2024-05-08T18:32:46.062291+0000","last_clean":"2024-05-08T18:32:46.062291+0000","last_became_active":"2024-05-08T18:29:42.576379+0000","last_became_peered":"2024-05-08T18:29:42.576379+0000","last_unstale":"2024-05-08T18:32:46.062291+0000","last_undegraded":"2024-05-08T18:32:46.062291+0000","last_fullsized":"2024-05-08T18:32:46.062291+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:20.471010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"93'12","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.080699+0000","last_change":"2024-05-08T18:29:40.542997+0000","last_active":"2024-05-08T18:32:47.080699+0000","last_peered":"2024-05-08T18:32:47.080699+0000","last_clean":"2024-05-08T18:32:47.080699+0000","last_became_active":"2024-05-08T18:29:40.542239+0000","last_became_peered":"2024-05-08T18:29:40.542239+0000","last_unstale":"2024-05-08T18:32:47.080699+0000","last_undegraded":"2024-05-08T18:32:47.080699+0000","last_fullsized":"2024-05-08T18:32:47.080699+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:14:43.555504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.935289+0000","last_change":"2024-05-08T18:29:44.594178+0000","last_active":"2024-05-08T18:32:46.935289+0000","last_peered":"2024-05-08T18:32:46.935289+0000","last_clean":"2024-05-08T18:32:46.935289+0000","last_became_active":"2024-05-08T18:29:44.592476+0000","last_became_peered":"2024-05-08T18:29:44.592476+0000","last_unstale":"2024-05-08T18:32:46.935289+0000","last_undegraded":"2024-05-08T18:32:46.935289+0000","last_fullsized":"2024-05-08T18:32:46.935289+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:04:16.093662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"97'17","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.063156+0000","last_change":"2024-05-08T18:29:46.597288+0000","last_active":"2024-05-08T18:32:46.063156+0000","last_peered":"2024-05-08T18:32:46.063156+0000","last_clean":"2024-05-08T18:32:46.063156+0000","last_became_active":"2024-05-08T18:29:46.596452+0000","last_became_peered":"2024-05-08T18:29:46.596452+0000","last_unstale":"2024-05-08T18:32:46.063156+0000","last_undegraded":"2024-05-08T18:32:46.063156+0000","last_fullsized":"2024-05-08T18:32:46.063156+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:32:43.245753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.848919+0000","last_change":"2024-05-08T18:29:48.635436+0000","last_active":"2024-05-08T18:32:46.848919+0000","last_peered":"2024-05-08T18:32:46.848919+0000","last_clean":"2024-05-08T18:32:46.848919+0000","last_became_active":"2024-05-08T18:29:48.634704+0000","last_became_peered":"2024-05-08T18:29:48.634704+0000","last_unstale":"2024-05-08T18:32:46.848919+0000","last_undegraded":"2024-05-08T18:32:46.848919+0000","last_fullsized":"2024-05-08T18:32:46.848919+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:55:52.238481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"83'2","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.079126+0000","last_change":"2024-05-08T18:29:50.687974+0000","last_active":"2024-05-08T18:32:47.079126+0000","last_peered":"2024-05-08T18:32:47.079126+0000","last_clean":"2024-05-08T18:32:47.079126+0000","last_became_active":"2024-05-08T18:29:50.687045+0000","last_became_peered":"2024-05-08T18:29:50.687045+0000","last_unstale":"2024-05-08T18:32:47.079126+0000","last_undegraded":"2024-05-08T18:32:47.079126+0000","last_fullsized":"2024-05-08T18:32:47.079126+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:55:01.894779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"97'4","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.063677+0000","last_change":"2024-05-08T18:30:20.850226+0000","last_active":"2024-05-08T18:32:46.063677+0000","last_peered":"2024-05-08T18:32:46.063677+0000","last_clean":"2024-05-08T18:32:46.063677+0000","last_became_active":"2024-05-08T18:30:20.849751+0000","last_became_peered":"2024-05-08T18:30:20.849751+0000","last_unstale":"2024-05-08T18:32:46.063677+0000","last_undegraded":"2024-05-08T18:32:46.063677+0000","last_fullsized":"2024-05-08T18:32:46.063677+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:33:31.550958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"93'13","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863945+0000","last_change":"2024-05-08T18:29:40.541112+0000","last_active":"2024-05-08T18:32:46.863945+0000","last_peered":"2024-05-08T18:32:46.863945+0000","last_clean":"2024-05-08T18:32:46.863945+0000","last_became_active":"2024-05-08T18:29:40.540835+0000","last_became_peered":"2024-05-08T18:29:40.540835+0000","last_unstale":"2024-05-08T18:32:46.863945+0000","last_undegraded":"2024-05-08T18:32:46.863945+0000","last_fullsized":"2024-05-08T18:32:46.863945+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:43:14.995191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.848912+0000","last_change":"2024-05-08T18:29:44.592033+0000","last_active":"2024-05-08T18:32:46.848912+0000","last_peered":"2024-05-08T18:32:46.848912+0000","last_clean":"2024-05-08T18:32:46.848912+0000","last_became_active":"2024-05-08T18:29:44.590454+0000","last_became_peered":"2024-05-08T18:29:44.590454+0000","last_unstale":"2024-05-08T18:32:46.848912+0000","last_undegraded":"2024-05-08T18:32:46.848912+0000","last_fullsized":"2024-05-08T18:32:46.848912+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:11:03.740365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"97'15","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.935727+0000","last_change":"2024-05-08T18:29:46.607002+0000","last_active":"2024-05-08T18:32:46.935727+0000","last_peered":"2024-05-08T18:32:46.935727+0000","last_clean":"2024-05-08T18:32:46.935727+0000","last_became_active":"2024-05-08T18:29:46.606172+0000","last_became_peered":"2024-05-08T18:29:46.606172+0000","last_unstale":"2024-05-08T18:32:46.935727+0000","last_undegraded":"2024-05-08T18:32:46.935727+0000","last_fullsized":"2024-05-08T18:32:46.935727+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:37:35.850414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.862686+0000","last_change":"2024-05-08T18:29:48.632948+0000","last_active":"2024-05-08T18:32:46.862686+0000","last_peered":"2024-05-08T18:32:46.862686+0000","last_clean":"2024-05-08T18:32:46.862686+0000","last_became_active":"2024-05-08T18:29:48.631219+0000","last_became_peered":"2024-05-08T18:29:48.631219+0000","last_unstale":"2024-05-08T18:32:46.862686+0000","last_undegraded":"2024-05-08T18:32:46.862686+0000","last_fullsized":"2024-05-08T18:32:46.862686+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:19:01.454355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.850370+0000","last_change":"2024-05-08T18:29:42.570180+0000","last_active":"2024-05-08T18:32:46.850370+0000","last_peered":"2024-05-08T18:32:46.850370+0000","last_clean":"2024-05-08T18:32:46.850370+0000","last_became_active":"2024-05-08T18:29:42.569425+0000","last_became_peered":"2024-05-08T18:29:42.569425+0000","last_unstale":"2024-05-08T18:32:46.850370+0000","last_undegraded":"2024-05-08T18:32:46.850370+0000","last_fullsized":"2024-05-08T18:32:46.850370+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:35.037465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"93'8","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.064153+0000","last_change":"2024-05-08T18:29:40.547711+0000","last_active":"2024-05-08T18:32:46.064153+0000","last_peered":"2024-05-08T18:32:46.064153+0000","last_clean":"2024-05-08T18:32:46.064153+0000","last_became_active":"2024-05-08T18:29:40.547479+0000","last_became_peered":"2024-05-08T18:29:40.547479+0000","last_unstale":"2024-05-08T18:32:46.064153+0000","last_undegraded":"2024-05-08T18:32:46.064153+0000","last_fullsized":"2024-05-08T18:32:46.064153+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:12:40.901620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":189,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863409+0000","last_change":"2024-05-08T18:29:44.591547+0000","last_active":"2024-05-08T18:32:46.863409+0000","last_peered":"2024-05-08T18:32:46.863409+0000","last_clean":"2024-05-08T18:32:46.863409+0000","last_became_active":"2024-05-08T18:29:44.590498+0000","last_became_peered":"2024-05-08T18:29:44.590498+0000","last_unstale":"2024-05-08T18:32:46.863409+0000","last_undegraded":"2024-05-08T18:32:46.863409+0000","last_fullsized":"2024-05-08T18:32:46.863409+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:14:04.085401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"97'25","reported_seq":223,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.918610+0000","last_change":"2024-05-08T18:29:46.600437+0000","last_active":"2024-05-08T18:32:46.918610+0000","last_peered":"2024-05-08T18:32:46.918610+0000","last_clean":"2024-05-08T18:32:46.918610+0000","last_became_active":"2024-05-08T18:29:46.594672+0000","last_became_peered":"2024-05-08T18:29:46.594672+0000","last_unstale":"2024-05-08T18:32:46.918610+0000","last_undegraded":"2024-05-08T18:32:46.918610+0000","last_fullsized":"2024-05-08T18:32:46.918610+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:35:53.294312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":180,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.079232+0000","last_change":"2024-05-08T18:29:48.639840+0000","last_active":"2024-05-08T18:32:47.079232+0000","last_peered":"2024-05-08T18:32:47.079232+0000","last_clean":"2024-05-08T18:32:47.079232+0000","last_became_active":"2024-05-08T18:29:48.639120+0000","last_became_peered":"2024-05-08T18:29:48.639120+0000","last_unstale":"2024-05-08T18:32:47.079232+0000","last_undegraded":"2024-05-08T18:32:47.079232+0000","last_fullsized":"2024-05-08T18:32:47.079232+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:13:50.865474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"84'2","reported_seq":180,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.062460+0000","last_change":"2024-05-08T18:29:50.684843+0000","last_active":"2024-05-08T18:32:46.062460+0000","last_peered":"2024-05-08T18:32:46.062460+0000","last_clean":"2024-05-08T18:32:46.062460+0000","last_became_active":"2024-05-08T18:29:50.684119+0000","last_became_peered":"2024-05-08T18:29:50.684119+0000","last_unstale":"2024-05-08T18:32:46.062460+0000","last_undegraded":"2024-05-08T18:32:46.062460+0000","last_fullsized":"2024-05-08T18:32:46.062460+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:09:29.641515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"80'2","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863501+0000","last_change":"2024-05-08T18:29:42.575763+0000","last_active":"2024-05-08T18:32:46.863501+0000","last_peered":"2024-05-08T18:32:46.863501+0000","last_clean":"2024-05-08T18:32:46.863501+0000","last_became_active":"2024-05-08T18:29:42.575450+0000","last_became_peered":"2024-05-08T18:29:42.575450+0000","last_unstale":"2024-05-08T18:32:46.863501+0000","last_undegraded":"2024-05-08T18:32:46.863501+0000","last_fullsized":"2024-05-08T18:32:46.863501+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:20.471010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"93'10","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.917742+0000","last_change":"2024-05-08T18:29:40.546101+0000","last_active":"2024-05-08T18:32:46.917742+0000","last_peered":"2024-05-08T18:32:46.917742+0000","last_clean":"2024-05-08T18:32:46.917742+0000","last_became_active":"2024-05-08T18:29:40.545814+0000","last_became_peered":"2024-05-08T18:29:40.545814+0000","last_unstale":"2024-05-08T18:32:46.917742+0000","last_undegraded":"2024-05-08T18:32:46.917742+0000","last_fullsized":"2024-05-08T18:32:46.917742+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:22.579629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.850156+0000","last_change":"2024-05-08T18:29:44.591310+0000","last_active":"2024-05-08T18:32:46.850156+0000","last_peered":"2024-05-08T18:32:46.850156+0000","last_clean":"2024-05-08T18:32:46.850156+0000","last_became_active":"2024-05-08T18:29:44.590394+0000","last_became_peered":"2024-05-08T18:29:44.590394+0000","last_unstale":"2024-05-08T18:32:46.850156+0000","last_undegraded":"2024-05-08T18:32:46.850156+0000","last_fullsized":"2024-05-08T18:32:46.850156+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:02:28.348982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"97'21","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.936870+0000","last_change":"2024-05-08T18:29:46.605887+0000","last_active":"2024-05-08T18:32:46.936870+0000","last_peered":"2024-05-08T18:32:46.936870+0000","last_clean":"2024-05-08T18:32:46.936870+0000","last_became_active":"2024-05-08T18:29:46.604917+0000","last_became_peered":"2024-05-08T18:29:46.604917+0000","last_unstale":"2024-05-08T18:32:46.936870+0000","last_undegraded":"2024-05-08T18:32:46.936870+0000","last_fullsized":"2024-05-08T18:32:46.936870+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:22:36.338527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.918794+0000","last_change":"2024-05-08T18:29:48.644420+0000","last_active":"2024-05-08T18:32:46.918794+0000","last_peered":"2024-05-08T18:32:46.918794+0000","last_clean":"2024-05-08T18:32:46.918794+0000","last_became_active":"2024-05-08T18:29:48.643493+0000","last_became_peered":"2024-05-08T18:29:48.643493+0000","last_unstale":"2024-05-08T18:32:46.918794+0000","last_undegraded":"2024-05-08T18:32:46.918794+0000","last_fullsized":"2024-05-08T18:32:46.918794+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:19:33.148012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":174,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.848670+0000","last_change":"2024-05-08T18:29:50.687485+0000","last_active":"2024-05-08T18:32:46.848670+0000","last_peered":"2024-05-08T18:32:46.848670+0000","last_clean":"2024-05-08T18:32:46.848670+0000","last_became_active":"2024-05-08T18:29:50.686750+0000","last_became_peered":"2024-05-08T18:29:50.686750+0000","last_unstale":"2024-05-08T18:32:46.848670+0000","last_undegraded":"2024-05-08T18:32:46.848670+0000","last_fullsized":"2024-05-08T18:32:46.848670+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:41.914164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"97'4","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.066425+0000","last_change":"2024-05-08T18:29:42.566571+0000","last_active":"2024-05-08T18:32:46.066425+0000","last_peered":"2024-05-08T18:32:46.066425+0000","last_clean":"2024-05-08T18:32:46.066425+0000","last_became_active":"2024-05-08T18:29:42.563695+0000","last_became_peered":"2024-05-08T18:29:42.563695+0000","last_unstale":"2024-05-08T18:32:46.066425+0000","last_undegraded":"2024-05-08T18:32:46.066425+0000","last_fullsized":"2024-05-08T18:32:46.066425+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:46.887628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"93'10","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.059150+0000","last_change":"2024-05-08T18:29:40.545512+0000","last_active":"2024-05-08T18:32:46.059150+0000","last_peered":"2024-05-08T18:32:46.059150+0000","last_clean":"2024-05-08T18:32:46.059150+0000","last_became_active":"2024-05-08T18:29:40.544216+0000","last_became_peered":"2024-05-08T18:29:40.544216+0000","last_unstale":"2024-05-08T18:32:46.059150+0000","last_undegraded":"2024-05-08T18:32:46.059150+0000","last_fullsized":"2024-05-08T18:32:46.059150+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:37:08.242362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.060557+0000","last_change":"2024-05-08T18:29:44.576107+0000","last_active":"2024-05-08T18:32:46.060557+0000","last_peered":"2024-05-08T18:32:46.060557+0000","last_clean":"2024-05-08T18:32:46.060557+0000","last_became_active":"2024-05-08T18:29:44.575344+0000","last_became_peered":"2024-05-08T18:29:44.575344+0000","last_unstale":"2024-05-08T18:32:46.060557+0000","last_undegraded":"2024-05-08T18:32:46.060557+0000","last_fullsized":"2024-05-08T18:32:46.060557+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:19.731003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"97'17","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.067703+0000","last_change":"2024-05-08T18:29:46.584785+0000","last_active":"2024-05-08T18:32:46.067703+0000","last_peered":"2024-05-08T18:32:46.067703+0000","last_clean":"2024-05-08T18:32:46.067703+0000","last_became_active":"2024-05-08T18:29:46.583390+0000","last_became_peered":"2024-05-08T18:29:46.583390+0000","last_unstale":"2024-05-08T18:32:46.067703+0000","last_undegraded":"2024-05-08T18:32:46.067703+0000","last_fullsized":"2024-05-08T18:32:46.067703+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:27:01.747339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.919301+0000","last_change":"2024-05-08T18:29:48.643558+0000","last_active":"2024-05-08T18:32:46.919301+0000","last_peered":"2024-05-08T18:32:46.919301+0000","last_clean":"2024-05-08T18:32:46.919301+0000","last_became_active":"2024-05-08T18:29:48.642773+0000","last_became_peered":"2024-05-08T18:29:48.642773+0000","last_unstale":"2024-05-08T18:32:46.919301+0000","last_undegraded":"2024-05-08T18:32:46.919301+0000","last_fullsized":"2024-05-08T18:32:46.919301+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:59:04.369806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":176,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.078353+0000","last_change":"2024-05-08T18:29:50.674796+0000","last_active":"2024-05-08T18:32:47.078353+0000","last_peered":"2024-05-08T18:32:47.078353+0000","last_clean":"2024-05-08T18:32:47.078353+0000","last_became_active":"2024-05-08T18:29:50.674057+0000","last_became_peered":"2024-05-08T18:29:50.674057+0000","last_unstale":"2024-05-08T18:32:47.078353+0000","last_undegraded":"2024-05-08T18:32:47.078353+0000","last_fullsized":"2024-05-08T18:32:47.078353+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:34:14.488295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"84'4","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.062561+0000","last_change":"2024-05-08T18:29:42.577642+0000","last_active":"2024-05-08T18:32:46.062561+0000","last_peered":"2024-05-08T18:32:46.062561+0000","last_clean":"2024-05-08T18:32:46.062561+0000","last_became_active":"2024-05-08T18:29:42.577275+0000","last_became_peered":"2024-05-08T18:29:42.577275+0000","last_unstale":"2024-05-08T18:32:46.062561+0000","last_undegraded":"2024-05-08T18:32:46.062561+0000","last_fullsized":"2024-05-08T18:32:46.062561+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:51:45.155037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"93'10","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.862767+0000","last_change":"2024-05-08T18:29:40.562873+0000","last_active":"2024-05-08T18:32:46.862767+0000","last_peered":"2024-05-08T18:32:46.862767+0000","last_clean":"2024-05-08T18:32:46.862767+0000","last_became_active":"2024-05-08T18:29:40.562594+0000","last_became_peered":"2024-05-08T18:29:40.562594+0000","last_unstale":"2024-05-08T18:32:46.862767+0000","last_undegraded":"2024-05-08T18:32:46.862767+0000","last_fullsized":"2024-05-08T18:32:46.862767+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:16:16.521258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.918959+0000","last_change":"2024-05-08T18:29:44.594152+0000","last_active":"2024-05-08T18:32:46.918959+0000","last_peered":"2024-05-08T18:32:46.918959+0000","last_clean":"2024-05-08T18:32:46.918959+0000","last_became_active":"2024-05-08T18:29:44.593398+0000","last_became_peered":"2024-05-08T18:29:44.593398+0000","last_unstale":"2024-05-08T18:32:46.918959+0000","last_undegraded":"2024-05-08T18:32:46.918959+0000","last_fullsized":"2024-05-08T18:32:46.918959+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:11.825480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"85'12","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.059653+0000","last_change":"2024-05-08T18:29:46.602137+0000","last_active":"2024-05-08T18:32:46.059653+0000","last_peered":"2024-05-08T18:32:46.059653+0000","last_clean":"2024-05-08T18:32:46.059653+0000","last_became_active":"2024-05-08T18:29:46.601402+0000","last_became_peered":"2024-05-08T18:29:46.601402+0000","last_unstale":"2024-05-08T18:32:46.059653+0000","last_undegraded":"2024-05-08T18:32:46.059653+0000","last_fullsized":"2024-05-08T18:32:46.059653+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:23.940519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":22,"num_read_kb":17,"num_write":24,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"116'102","reported_seq":329,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:49.831643+0000","last_change":"2024-05-08T18:29:48.635696+0000","last_active":"2024-05-08T18:32:49.831643+0000","last_peered":"2024-05-08T18:32:49.831643+0000","last_clean":"2024-05-08T18:32:49.831643+0000","last_became_active":"2024-05-08T18:29:48.634859+0000","last_became_peered":"2024-05-08T18:29:48.634859+0000","last_unstale":"2024-05-08T18:32:49.831643+0000","last_undegraded":"2024-05-08T18:32:49.831643+0000","last_fullsized":"2024-05-08T18:32:49.831643+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:35:55.322495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":174,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.935107+0000","last_change":"2024-05-08T18:29:50.679757+0000","last_active":"2024-05-08T18:32:46.935107+0000","last_peered":"2024-05-08T18:32:46.935107+0000","last_clean":"2024-05-08T18:32:46.935107+0000","last_became_active":"2024-05-08T18:29:50.679011+0000","last_became_peered":"2024-05-08T18:29:50.679011+0000","last_unstale":"2024-05-08T18:32:46.935107+0000","last_undegraded":"2024-05-08T18:32:46.935107+0000","last_fullsized":"2024-05-08T18:32:46.935107+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:34:14.488295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"84'8","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.058657+0000","last_change":"2024-05-08T18:29:42.560354+0000","last_active":"2024-05-08T18:32:46.058657+0000","last_peered":"2024-05-08T18:32:46.058657+0000","last_clean":"2024-05-08T18:32:46.058657+0000","last_became_active":"2024-05-08T18:29:42.559647+0000","last_became_peered":"2024-05-08T18:29:42.559647+0000","last_unstale":"2024-05-08T18:32:46.058657+0000","last_undegraded":"2024-05-08T18:32:46.058657+0000","last_fullsized":"2024-05-08T18:32:46.058657+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:18:10.803989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"93'10","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.079570+0000","last_change":"2024-05-08T18:29:40.557683+0000","last_active":"2024-05-08T18:32:47.079570+0000","last_peered":"2024-05-08T18:32:47.079570+0000","last_clean":"2024-05-08T18:32:47.079570+0000","last_became_active":"2024-05-08T18:29:40.556254+0000","last_became_peered":"2024-05-08T18:29:40.556254+0000","last_unstale":"2024-05-08T18:32:47.079570+0000","last_undegraded":"2024-05-08T18:32:47.079570+0000","last_fullsized":"2024-05-08T18:32:47.079570+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:51:43.135322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.936035+0000","last_change":"2024-05-08T18:29:44.594068+0000","last_active":"2024-05-08T18:32:46.936035+0000","last_peered":"2024-05-08T18:32:46.936035+0000","last_clean":"2024-05-08T18:32:46.936035+0000","last_became_active":"2024-05-08T18:29:44.593322+0000","last_became_peered":"2024-05-08T18:29:44.593322+0000","last_unstale":"2024-05-08T18:32:46.936035+0000","last_undegraded":"2024-05-08T18:32:46.936035+0000","last_fullsized":"2024-05-08T18:32:46.936035+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:19.731003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"97'22","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.078642+0000","last_change":"2024-05-08T18:29:46.604700+0000","last_active":"2024-05-08T18:32:47.078642+0000","last_peered":"2024-05-08T18:32:47.078642+0000","last_clean":"2024-05-08T18:32:47.078642+0000","last_became_active":"2024-05-08T18:29:46.603885+0000","last_became_peered":"2024-05-08T18:29:46.603885+0000","last_unstale":"2024-05-08T18:32:47.078642+0000","last_undegraded":"2024-05-08T18:32:47.078642+0000","last_fullsized":"2024-05-08T18:32:47.078642+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:22:36.338527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9698,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":18,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.861740+0000","last_change":"2024-05-08T18:29:48.640814+0000","last_active":"2024-05-08T18:32:46.861740+0000","last_peered":"2024-05-08T18:32:46.861740+0000","last_clean":"2024-05-08T18:32:46.861740+0000","last_became_active":"2024-05-08T18:29:48.640046+0000","last_became_peered":"2024-05-08T18:29:48.640046+0000","last_unstale":"2024-05-08T18:32:46.861740+0000","last_undegraded":"2024-05-08T18:32:46.861740+0000","last_fullsized":"2024-05-08T18:32:46.861740+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:53:21.219706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"83'8","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.938436+0000","last_change":"2024-05-08T18:29:50.692688+0000","last_active":"2024-05-08T18:32:46.938436+0000","last_peered":"2024-05-08T18:32:46.938436+0000","last_clean":"2024-05-08T18:32:46.938436+0000","last_became_active":"2024-05-08T18:29:50.692123+0000","last_became_peered":"2024-05-08T18:29:50.692123+0000","last_unstale":"2024-05-08T18:32:46.938436+0000","last_undegraded":"2024-05-08T18:32:46.938436+0000","last_fullsized":"2024-05-08T18:32:46.938436+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:38.318890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"97'2","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.058878+0000","last_change":"2024-05-08T18:29:42.558336+0000","last_active":"2024-05-08T18:32:46.058878+0000","last_peered":"2024-05-08T18:32:46.058878+0000","last_clean":"2024-05-08T18:32:46.058878+0000","last_became_active":"2024-05-08T18:29:42.557570+0000","last_became_peered":"2024-05-08T18:29:42.557570+0000","last_unstale":"2024-05-08T18:32:46.058878+0000","last_undegraded":"2024-05-08T18:32:46.058878+0000","last_fullsized":"2024-05-08T18:32:46.058878+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:54:16.539832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"84'2","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.080664+0000","last_change":"2024-05-08T18:29:40.537090+0000","last_active":"2024-05-08T18:32:47.080664+0000","last_peered":"2024-05-08T18:32:47.080664+0000","last_clean":"2024-05-08T18:32:47.080664+0000","last_became_active":"2024-05-08T18:29:40.536188+0000","last_became_peered":"2024-05-08T18:29:40.536188+0000","last_unstale":"2024-05-08T18:32:47.080664+0000","last_undegraded":"2024-05-08T18:32:47.080664+0000","last_fullsized":"2024-05-08T18:32:47.080664+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:22:48.880581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.078799+0000","last_change":"2024-05-08T18:29:44.578901+0000","last_active":"2024-05-08T18:32:47.078799+0000","last_peered":"2024-05-08T18:32:47.078799+0000","last_clean":"2024-05-08T18:32:47.078799+0000","last_became_active":"2024-05-08T18:29:44.578171+0000","last_became_peered":"2024-05-08T18:29:44.578171+0000","last_unstale":"2024-05-08T18:32:47.078799+0000","last_undegraded":"2024-05-08T18:32:47.078799+0000","last_fullsized":"2024-05-08T18:32:47.078799+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:19.731003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"97'17","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.861874+0000","last_change":"2024-05-08T18:29:46.604539+0000","last_active":"2024-05-08T18:32:46.861874+0000","last_peered":"2024-05-08T18:32:46.861874+0000","last_clean":"2024-05-08T18:32:46.861874+0000","last_became_active":"2024-05-08T18:29:46.603728+0000","last_became_peered":"2024-05-08T18:29:46.603728+0000","last_unstale":"2024-05-08T18:32:46.861874+0000","last_undegraded":"2024-05-08T18:32:46.861874+0000","last_fullsized":"2024-05-08T18:32:46.861874+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:12:41.226788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.848661+0000","last_change":"2024-05-08T18:29:48.635813+0000","last_active":"2024-05-08T18:32:46.848661+0000","last_peered":"2024-05-08T18:32:46.848661+0000","last_clean":"2024-05-08T18:32:46.848661+0000","last_became_active":"2024-05-08T18:29:48.634664+0000","last_became_peered":"2024-05-08T18:29:48.634664+0000","last_unstale":"2024-05-08T18:32:46.848661+0000","last_undegraded":"2024-05-08T18:32:46.848661+0000","last_fullsized":"2024-05-08T18:32:46.848661+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:27:23.427365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"97'7","reported_seq":187,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.066075+0000","last_change":"2024-05-08T18:29:50.687517+0000","last_active":"2024-05-08T18:32:46.066075+0000","last_peered":"2024-05-08T18:32:46.066075+0000","last_clean":"2024-05-08T18:32:46.066075+0000","last_became_active":"2024-05-08T18:29:50.686662+0000","last_became_peered":"2024-05-08T18:29:50.686662+0000","last_unstale":"2024-05-08T18:32:46.066075+0000","last_undegraded":"2024-05-08T18:32:46.066075+0000","last_fullsized":"2024-05-08T18:32:46.066075+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:58:00.455559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"97'4","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.062709+0000","last_change":"2024-05-08T18:29:42.558848+0000","last_active":"2024-05-08T18:32:46.062709+0000","last_peered":"2024-05-08T18:32:46.062709+0000","last_clean":"2024-05-08T18:32:46.062709+0000","last_became_active":"2024-05-08T18:29:42.558390+0000","last_became_peered":"2024-05-08T18:29:42.558390+0000","last_unstale":"2024-05-08T18:32:46.062709+0000","last_undegraded":"2024-05-08T18:32:46.062709+0000","last_fullsized":"2024-05-08T18:32:46.062709+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:55:30.468069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"93'8","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.066372+0000","last_change":"2024-05-08T18:29:40.567772+0000","last_active":"2024-05-08T18:32:46.066372+0000","last_peered":"2024-05-08T18:32:46.066372+0000","last_clean":"2024-05-08T18:32:46.066372+0000","last_became_active":"2024-05-08T18:29:40.567482+0000","last_became_peered":"2024-05-08T18:29:40.567482+0000","last_unstale":"2024-05-08T18:32:46.066372+0000","last_undegraded":"2024-05-08T18:32:46.066372+0000","last_fullsized":"2024-05-08T18:32:46.066372+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:36:37.796095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":5,"num_write":18,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.057189+0000","last_change":"2024-05-08T18:29:44.596876+0000","last_active":"2024-05-08T18:32:46.057189+0000","last_peered":"2024-05-08T18:32:46.057189+0000","last_clean":"2024-05-08T18:32:46.057189+0000","last_became_active":"2024-05-08T18:29:44.595712+0000","last_became_peered":"2024-05-08T18:29:44.595712+0000","last_unstale":"2024-05-08T18:32:46.057189+0000","last_undegraded":"2024-05-08T18:32:46.057189+0000","last_fullsized":"2024-05-08T18:32:46.057189+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:35:51.288126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"97'11","reported_seq":201,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.064975+0000","last_change":"2024-05-08T18:29:46.598637+0000","last_active":"2024-05-08T18:32:46.064975+0000","last_peered":"2024-05-08T18:32:46.064975+0000","last_clean":"2024-05-08T18:32:46.064975+0000","last_became_active":"2024-05-08T18:29:46.597394+0000","last_became_peered":"2024-05-08T18:29:46.597394+0000","last_unstale":"2024-05-08T18:32:46.064975+0000","last_undegraded":"2024-05-08T18:32:46.064975+0000","last_fullsized":"2024-05-08T18:32:46.064975+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:52:22.540814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.057643+0000","last_change":"2024-05-08T18:29:48.642251+0000","last_active":"2024-05-08T18:32:46.057643+0000","last_peered":"2024-05-08T18:32:46.057643+0000","last_clean":"2024-05-08T18:32:46.057643+0000","last_became_active":"2024-05-08T18:29:48.641666+0000","last_became_peered":"2024-05-08T18:29:48.641666+0000","last_unstale":"2024-05-08T18:32:46.057643+0000","last_undegraded":"2024-05-08T18:32:46.057643+0000","last_fullsized":"2024-05-08T18:32:46.057643+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:13:50.865474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"80'2","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.937644+0000","last_change":"2024-05-08T18:29:50.685668+0000","last_active":"2024-05-08T18:32:46.937644+0000","last_peered":"2024-05-08T18:32:46.937644+0000","last_clean":"2024-05-08T18:32:46.937644+0000","last_became_active":"2024-05-08T18:29:50.684958+0000","last_became_peered":"2024-05-08T18:29:50.684958+0000","last_unstale":"2024-05-08T18:32:46.937644+0000","last_undegraded":"2024-05-08T18:32:46.937644+0000","last_fullsized":"2024-05-08T18:32:46.937644+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:55:01.894779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.057760+0000","last_change":"2024-05-08T18:29:42.562063+0000","last_active":"2024-05-08T18:32:46.057760+0000","last_peered":"2024-05-08T18:32:46.057760+0000","last_clean":"2024-05-08T18:32:46.057760+0000","last_became_active":"2024-05-08T18:29:42.558871+0000","last_became_peered":"2024-05-08T18:29:42.558871+0000","last_unstale":"2024-05-08T18:32:46.057760+0000","last_undegraded":"2024-05-08T18:32:46.057760+0000","last_fullsized":"2024-05-08T18:32:46.057760+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:59.243324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"93'13","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863884+0000","last_change":"2024-05-08T18:29:40.541070+0000","last_active":"2024-05-08T18:32:46.863884+0000","last_peered":"2024-05-08T18:32:46.863884+0000","last_clean":"2024-05-08T18:32:46.863884+0000","last_became_active":"2024-05-08T18:29:40.540767+0000","last_became_peered":"2024-05-08T18:29:40.540767+0000","last_unstale":"2024-05-08T18:32:46.863884+0000","last_undegraded":"2024-05-08T18:32:46.863884+0000","last_fullsized":"2024-05-08T18:32:46.863884+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:09:39.835826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"26'1","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.917294+0000","last_change":"2024-05-08T18:29:44.592737+0000","last_active":"2024-05-08T18:32:46.917294+0000","last_peered":"2024-05-08T18:32:46.917294+0000","last_clean":"2024-05-08T18:32:46.917294+0000","last_became_active":"2024-05-08T18:29:44.592243+0000","last_became_peered":"2024-05-08T18:29:44.592243+0000","last_unstale":"2024-05-08T18:32:46.917294+0000","last_undegraded":"2024-05-08T18:32:46.917294+0000","last_fullsized":"2024-05-08T18:32:46.917294+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:59.744050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"97'16","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.058346+0000","last_change":"2024-05-08T18:29:46.610835+0000","last_active":"2024-05-08T18:32:46.058346+0000","last_peered":"2024-05-08T18:32:46.058346+0000","last_clean":"2024-05-08T18:32:46.058346+0000","last_became_active":"2024-05-08T18:29:46.609903+0000","last_became_peered":"2024-05-08T18:29:46.609903+0000","last_unstale":"2024-05-08T18:32:46.058346+0000","last_undegraded":"2024-05-08T18:32:46.058346+0000","last_fullsized":"2024-05-08T18:32:46.058346+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:37:35.850414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.862608+0000","last_change":"2024-05-08T18:29:48.629822+0000","last_active":"2024-05-08T18:32:46.862608+0000","last_peered":"2024-05-08T18:32:46.862608+0000","last_clean":"2024-05-08T18:32:46.862608+0000","last_became_active":"2024-05-08T18:29:48.629204+0000","last_became_peered":"2024-05-08T18:29:48.629204+0000","last_unstale":"2024-05-08T18:32:46.862608+0000","last_undegraded":"2024-05-08T18:32:46.862608+0000","last_fullsized":"2024-05-08T18:32:46.862608+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:04.571608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"84'6","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.060640+0000","last_change":"2024-05-08T18:29:50.668101+0000","last_active":"2024-05-08T18:32:46.060640+0000","last_peered":"2024-05-08T18:32:46.060640+0000","last_clean":"2024-05-08T18:32:46.060640+0000","last_became_active":"2024-05-08T18:29:50.667357+0000","last_became_peered":"2024-05-08T18:29:50.667357+0000","last_unstale":"2024-05-08T18:32:46.060640+0000","last_undegraded":"2024-05-08T18:32:46.060640+0000","last_fullsized":"2024-05-08T18:32:46.060640+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:55:01.894779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"97'4","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.919471+0000","last_change":"2024-05-08T18:29:42.581366+0000","last_active":"2024-05-08T18:32:46.919471+0000","last_peered":"2024-05-08T18:32:46.919471+0000","last_clean":"2024-05-08T18:32:46.919471+0000","last_became_active":"2024-05-08T18:29:42.580988+0000","last_became_peered":"2024-05-08T18:29:42.580988+0000","last_unstale":"2024-05-08T18:32:46.919471+0000","last_undegraded":"2024-05-08T18:32:46.919471+0000","last_fullsized":"2024-05-08T18:32:46.919471+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:42.005809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"84'9","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.848329+0000","last_change":"2024-05-08T18:29:40.562025+0000","last_active":"2024-05-08T18:32:46.848329+0000","last_peered":"2024-05-08T18:32:46.848329+0000","last_clean":"2024-05-08T18:32:46.848329+0000","last_became_active":"2024-05-08T18:29:40.561277+0000","last_became_peered":"2024-05-08T18:29:40.561277+0000","last_unstale":"2024-05-08T18:32:46.848329+0000","last_undegraded":"2024-05-08T18:32:46.848329+0000","last_fullsized":"2024-05-08T18:32:46.848329+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:59:25.840149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":19,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.916111+0000","last_change":"2024-05-08T18:29:42.573832+0000","last_active":"2024-05-08T18:32:46.916111+0000","last_peered":"2024-05-08T18:32:46.916111+0000","last_clean":"2024-05-08T18:32:46.916111+0000","last_became_active":"2024-05-08T18:29:42.573502+0000","last_became_peered":"2024-05-08T18:29:42.573502+0000","last_unstale":"2024-05-08T18:32:46.916111+0000","last_undegraded":"2024-05-08T18:32:46.916111+0000","last_fullsized":"2024-05-08T18:32:46.916111+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:35.037465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"93'8","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.060494+0000","last_change":"2024-05-08T18:29:40.533094+0000","last_active":"2024-05-08T18:32:46.060494+0000","last_peered":"2024-05-08T18:32:46.060494+0000","last_clean":"2024-05-08T18:32:46.060494+0000","last_became_active":"2024-05-08T18:29:40.532246+0000","last_became_peered":"2024-05-08T18:29:40.532246+0000","last_unstale":"2024-05-08T18:32:46.060494+0000","last_undegraded":"2024-05-08T18:32:46.060494+0000","last_fullsized":"2024-05-08T18:32:46.060494+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:37:08.242362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.080244+0000","last_change":"2024-05-08T18:29:42.565298+0000","last_active":"2024-05-08T18:32:47.080244+0000","last_peered":"2024-05-08T18:32:47.080244+0000","last_clean":"2024-05-08T18:32:47.080244+0000","last_became_active":"2024-05-08T18:29:42.564542+0000","last_became_peered":"2024-05-08T18:29:42.564542+0000","last_unstale":"2024-05-08T18:32:47.080244+0000","last_undegraded":"2024-05-08T18:32:47.080244+0000","last_fullsized":"2024-05-08T18:32:47.080244+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:57.706167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"93'14","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.079157+0000","last_change":"2024-05-08T18:29:40.556958+0000","last_active":"2024-05-08T18:32:47.079157+0000","last_peered":"2024-05-08T18:32:47.079157+0000","last_clean":"2024-05-08T18:32:47.079157+0000","last_became_active":"2024-05-08T18:29:40.556091+0000","last_became_peered":"2024-05-08T18:29:40.556091+0000","last_unstale":"2024-05-08T18:32:47.079157+0000","last_undegraded":"2024-05-08T18:32:47.079157+0000","last_fullsized":"2024-05-08T18:32:47.079157+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:39.986094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"97'6","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.918325+0000","last_change":"2024-05-08T18:29:42.574619+0000","last_active":"2024-05-08T18:32:46.918325+0000","last_peered":"2024-05-08T18:32:46.918325+0000","last_clean":"2024-05-08T18:32:46.918325+0000","last_became_active":"2024-05-08T18:29:42.573178+0000","last_became_peered":"2024-05-08T18:29:42.573178+0000","last_unstale":"2024-05-08T18:32:46.918325+0000","last_undegraded":"2024-05-08T18:32:46.918325+0000","last_fullsized":"2024-05-08T18:32:46.918325+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:33.139089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"92'5","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.862863+0000","last_change":"2024-05-08T18:29:40.544338+0000","last_active":"2024-05-08T18:32:46.862863+0000","last_peered":"2024-05-08T18:32:46.862863+0000","last_clean":"2024-05-08T18:32:46.862863+0000","last_became_active":"2024-05-08T18:29:40.544107+0000","last_became_peered":"2024-05-08T18:29:40.544107+0000","last_unstale":"2024-05-08T18:32:46.862863+0000","last_undegraded":"2024-05-08T18:32:46.862863+0000","last_fullsized":"2024-05-08T18:32:46.862863+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:54.200883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"84'2","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.064285+0000","last_change":"2024-05-08T18:29:42.576979+0000","last_active":"2024-05-08T18:32:46.064285+0000","last_peered":"2024-05-08T18:32:46.064285+0000","last_clean":"2024-05-08T18:32:46.064285+0000","last_became_active":"2024-05-08T18:29:42.576395+0000","last_became_peered":"2024-05-08T18:29:42.576395+0000","last_unstale":"2024-05-08T18:32:46.064285+0000","last_undegraded":"2024-05-08T18:32:46.064285+0000","last_fullsized":"2024-05-08T18:32:46.064285+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:53:03.097704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"93'5","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.066660+0000","last_change":"2024-05-08T18:29:40.558142+0000","last_active":"2024-05-08T18:32:46.066660+0000","last_peered":"2024-05-08T18:32:46.066660+0000","last_clean":"2024-05-08T18:32:46.066660+0000","last_became_active":"2024-05-08T18:29:40.557874+0000","last_became_peered":"2024-05-08T18:29:40.557874+0000","last_unstale":"2024-05-08T18:32:46.066660+0000","last_undegraded":"2024-05-08T18:32:46.066660+0000","last_fullsized":"2024-05-08T18:32:46.066660+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:54.200883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"97'2","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.059136+0000","last_change":"2024-05-08T18:29:42.558324+0000","last_active":"2024-05-08T18:32:46.059136+0000","last_peered":"2024-05-08T18:32:46.059136+0000","last_clean":"2024-05-08T18:32:46.059136+0000","last_became_active":"2024-05-08T18:29:42.556774+0000","last_became_peered":"2024-05-08T18:29:42.556774+0000","last_unstale":"2024-05-08T18:32:46.059136+0000","last_undegraded":"2024-05-08T18:32:46.059136+0000","last_fullsized":"2024-05-08T18:32:46.059136+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:02:26.311100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"93'11","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.919113+0000","last_change":"2024-05-08T18:30:20.858467+0000","last_active":"2024-05-08T18:32:46.919113+0000","last_peered":"2024-05-08T18:32:46.919113+0000","last_clean":"2024-05-08T18:32:46.919113+0000","last_became_active":"2024-05-08T18:30:20.858016+0000","last_became_peered":"2024-05-08T18:30:20.858016+0000","last_unstale":"2024-05-08T18:32:46.919113+0000","last_undegraded":"2024-05-08T18:32:46.919113+0000","last_fullsized":"2024-05-08T18:32:46.919113+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:10:28.824915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"84'4","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.062025+0000","last_change":"2024-05-08T18:29:42.562772+0000","last_active":"2024-05-08T18:32:46.062025+0000","last_peered":"2024-05-08T18:32:46.062025+0000","last_clean":"2024-05-08T18:32:46.062025+0000","last_became_active":"2024-05-08T18:29:42.562420+0000","last_became_peered":"2024-05-08T18:29:42.562420+0000","last_unstale":"2024-05-08T18:32:46.062025+0000","last_undegraded":"2024-05-08T18:32:46.062025+0000","last_fullsized":"2024-05-08T18:32:46.062025+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:30:29.452640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"93'5","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.850198+0000","last_change":"2024-05-08T18:29:40.562024+0000","last_active":"2024-05-08T18:32:46.850198+0000","last_peered":"2024-05-08T18:32:46.850198+0000","last_clean":"2024-05-08T18:32:46.850198+0000","last_became_active":"2024-05-08T18:29:40.561326+0000","last_became_peered":"2024-05-08T18:29:40.561326+0000","last_unstale":"2024-05-08T18:32:46.850198+0000","last_undegraded":"2024-05-08T18:32:46.850198+0000","last_fullsized":"2024-05-08T18:32:46.850198+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:21:38.354933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"97'4","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.847229+0000","last_change":"2024-05-08T18:29:42.561419+0000","last_active":"2024-05-08T18:32:46.847229+0000","last_peered":"2024-05-08T18:32:46.847229+0000","last_clean":"2024-05-08T18:32:46.847229+0000","last_became_active":"2024-05-08T18:29:42.560520+0000","last_became_peered":"2024-05-08T18:29:42.560520+0000","last_unstale":"2024-05-08T18:32:46.847229+0000","last_undegraded":"2024-05-08T18:32:46.847229+0000","last_fullsized":"2024-05-08T18:32:46.847229+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:07.949520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"93'11","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.067225+0000","last_change":"2024-05-08T18:29:40.554884+0000","last_active":"2024-05-08T18:32:46.067225+0000","last_peered":"2024-05-08T18:32:46.067225+0000","last_clean":"2024-05-08T18:32:46.067225+0000","last_became_active":"2024-05-08T18:29:40.554603+0000","last_became_peered":"2024-05-08T18:29:40.554603+0000","last_unstale":"2024-05-08T18:32:46.067225+0000","last_undegraded":"2024-05-08T18:32:46.067225+0000","last_fullsized":"2024-05-08T18:32:46.067225+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:09:39.835826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"84'4","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.861066+0000","last_change":"2024-05-08T18:29:42.574689+0000","last_active":"2024-05-08T18:32:46.861066+0000","last_peered":"2024-05-08T18:32:46.861066+0000","last_clean":"2024-05-08T18:32:46.861066+0000","last_became_active":"2024-05-08T18:29:42.573947+0000","last_became_peered":"2024-05-08T18:29:42.573947+0000","last_unstale":"2024-05-08T18:32:46.861066+0000","last_undegraded":"2024-05-08T18:32:46.861066+0000","last_fullsized":"2024-05-08T18:32:46.861066+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:57:14.869860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"93'10","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.079768+0000","last_change":"2024-05-08T18:29:40.554005+0000","last_active":"2024-05-08T18:32:47.079768+0000","last_peered":"2024-05-08T18:32:47.079768+0000","last_clean":"2024-05-08T18:32:47.079768+0000","last_became_active":"2024-05-08T18:29:40.553356+0000","last_became_peered":"2024-05-08T18:29:40.553356+0000","last_unstale":"2024-05-08T18:32:47.079768+0000","last_undegraded":"2024-05-08T18:32:47.079768+0000","last_fullsized":"2024-05-08T18:32:47.079768+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:08:13.006752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"84'2","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.059942+0000","last_change":"2024-05-08T18:29:42.566487+0000","last_active":"2024-05-08T18:32:46.059942+0000","last_peered":"2024-05-08T18:32:46.059942+0000","last_clean":"2024-05-08T18:32:46.059942+0000","last_became_active":"2024-05-08T18:29:42.565760+0000","last_became_peered":"2024-05-08T18:29:42.565760+0000","last_unstale":"2024-05-08T18:32:46.059942+0000","last_undegraded":"2024-05-08T18:32:46.059942+0000","last_fullsized":"2024-05-08T18:32:46.059942+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:57.706167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"93'8","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.062985+0000","last_change":"2024-05-08T18:29:40.552543+0000","last_active":"2024-05-08T18:32:46.062985+0000","last_peered":"2024-05-08T18:32:46.062985+0000","last_clean":"2024-05-08T18:32:46.062985+0000","last_became_active":"2024-05-08T18:29:40.552307+0000","last_became_peered":"2024-05-08T18:29:40.552307+0000","last_unstale":"2024-05-08T18:32:46.062985+0000","last_undegraded":"2024-05-08T18:32:46.062985+0000","last_fullsized":"2024-05-08T18:32:46.062985+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:48.294532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"84'4","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.063759+0000","last_change":"2024-05-08T18:29:42.561658+0000","last_active":"2024-05-08T18:32:46.063759+0000","last_peered":"2024-05-08T18:32:46.063759+0000","last_clean":"2024-05-08T18:32:46.063759+0000","last_became_active":"2024-05-08T18:29:42.561171+0000","last_became_peered":"2024-05-08T18:29:42.561171+0000","last_unstale":"2024-05-08T18:32:46.063759+0000","last_undegraded":"2024-05-08T18:32:46.063759+0000","last_fullsized":"2024-05-08T18:32:46.063759+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:15.966061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"93'10","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.079096+0000","last_change":"2024-05-08T18:29:40.543041+0000","last_active":"2024-05-08T18:32:47.079096+0000","last_peered":"2024-05-08T18:32:47.079096+0000","last_clean":"2024-05-08T18:32:47.079096+0000","last_became_active":"2024-05-08T18:29:40.542398+0000","last_became_peered":"2024-05-08T18:29:40.542398+0000","last_unstale":"2024-05-08T18:32:47.079096+0000","last_undegraded":"2024-05-08T18:32:47.079096+0000","last_fullsized":"2024-05-08T18:32:47.079096+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:33.017750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"97'6","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.060280+0000","last_change":"2024-05-08T18:29:42.579690+0000","last_active":"2024-05-08T18:32:46.060280+0000","last_peered":"2024-05-08T18:32:46.060280+0000","last_clean":"2024-05-08T18:32:46.060280+0000","last_became_active":"2024-05-08T18:29:42.578981+0000","last_became_peered":"2024-05-08T18:29:42.578981+0000","last_unstale":"2024-05-08T18:32:46.060280+0000","last_undegraded":"2024-05-08T18:32:46.060280+0000","last_fullsized":"2024-05-08T18:32:46.060280+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:36:03.084561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"93'11","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.862989+0000","last_change":"2024-05-08T18:29:40.548499+0000","last_active":"2024-05-08T18:32:46.862989+0000","last_peered":"2024-05-08T18:32:46.862989+0000","last_clean":"2024-05-08T18:32:46.862989+0000","last_became_active":"2024-05-08T18:29:40.548177+0000","last_became_peered":"2024-05-08T18:29:40.548177+0000","last_unstale":"2024-05-08T18:32:46.862989+0000","last_undegraded":"2024-05-08T18:32:46.862989+0000","last_fullsized":"2024-05-08T18:32:46.862989+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:27:41.414153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"80'2","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.934939+0000","last_change":"2024-05-08T18:29:42.575892+0000","last_active":"2024-05-08T18:32:46.934939+0000","last_peered":"2024-05-08T18:32:46.934939+0000","last_clean":"2024-05-08T18:32:46.934939+0000","last_became_active":"2024-05-08T18:29:42.573384+0000","last_became_peered":"2024-05-08T18:29:42.573384+0000","last_unstale":"2024-05-08T18:32:46.934939+0000","last_undegraded":"2024-05-08T18:32:46.934939+0000","last_fullsized":"2024-05-08T18:32:46.934939+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:55.055481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"93'9","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.849826+0000","last_change":"2024-05-08T18:29:40.565068+0000","last_active":"2024-05-08T18:32:46.849826+0000","last_peered":"2024-05-08T18:32:46.849826+0000","last_clean":"2024-05-08T18:32:46.849826+0000","last_became_active":"2024-05-08T18:29:40.563231+0000","last_became_peered":"2024-05-08T18:29:40.563231+0000","last_unstale":"2024-05-08T18:32:46.849826+0000","last_undegraded":"2024-05-08T18:32:46.849826+0000","last_fullsized":"2024-05-08T18:32:46.849826+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:17:47.828990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.862573+0000","last_change":"2024-05-08T18:29:42.564338+0000","last_active":"2024-05-08T18:32:46.862573+0000","last_peered":"2024-05-08T18:32:46.862573+0000","last_clean":"2024-05-08T18:32:46.862573+0000","last_became_active":"2024-05-08T18:29:42.563822+0000","last_became_peered":"2024-05-08T18:29:42.563822+0000","last_unstale":"2024-05-08T18:32:46.862573+0000","last_undegraded":"2024-05-08T18:32:46.862573+0000","last_fullsized":"2024-05-08T18:32:46.862573+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:23.397435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"93'14","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.938359+0000","last_change":"2024-05-08T18:29:40.573333+0000","last_active":"2024-05-08T18:32:46.938359+0000","last_peered":"2024-05-08T18:32:46.938359+0000","last_clean":"2024-05-08T18:32:46.938359+0000","last_became_active":"2024-05-08T18:29:40.571195+0000","last_became_peered":"2024-05-08T18:29:40.571195+0000","last_unstale":"2024-05-08T18:32:46.938359+0000","last_undegraded":"2024-05-08T18:32:46.938359+0000","last_fullsized":"2024-05-08T18:32:46.938359+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:33.017750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.061746+0000","last_change":"2024-05-08T18:29:42.563085+0000","last_active":"2024-05-08T18:32:46.061746+0000","last_peered":"2024-05-08T18:32:46.061746+0000","last_clean":"2024-05-08T18:32:46.061746+0000","last_became_active":"2024-05-08T18:29:42.560419+0000","last_became_peered":"2024-05-08T18:29:42.560419+0000","last_unstale":"2024-05-08T18:32:46.061746+0000","last_undegraded":"2024-05-08T18:32:46.061746+0000","last_fullsized":"2024-05-08T18:32:46.061746+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:20.397730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"93'10","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.064712+0000","last_change":"2024-05-08T18:29:40.568890+0000","last_active":"2024-05-08T18:32:46.064712+0000","last_peered":"2024-05-08T18:32:46.064712+0000","last_clean":"2024-05-08T18:32:46.064712+0000","last_became_active":"2024-05-08T18:29:40.568584+0000","last_became_peered":"2024-05-08T18:29:40.568584+0000","last_unstale":"2024-05-08T18:32:46.064712+0000","last_undegraded":"2024-05-08T18:32:46.064712+0000","last_fullsized":"2024-05-08T18:32:46.064712+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:25:01.595224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"83'6","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.934923+0000","last_change":"2024-05-08T18:29:42.574277+0000","last_active":"2024-05-08T18:32:46.934923+0000","last_peered":"2024-05-08T18:32:46.934923+0000","last_clean":"2024-05-08T18:32:46.934923+0000","last_became_active":"2024-05-08T18:29:42.573563+0000","last_became_peered":"2024-05-08T18:29:42.573563+0000","last_unstale":"2024-05-08T18:32:46.934923+0000","last_undegraded":"2024-05-08T18:32:46.934923+0000","last_fullsized":"2024-05-08T18:32:46.934923+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:57.706167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"93'8","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.080783+0000","last_change":"2024-05-08T18:29:40.562058+0000","last_active":"2024-05-08T18:32:47.080783+0000","last_peered":"2024-05-08T18:32:47.080783+0000","last_clean":"2024-05-08T18:32:47.080783+0000","last_became_active":"2024-05-08T18:29:40.561360+0000","last_became_peered":"2024-05-08T18:29:40.561360+0000","last_unstale":"2024-05-08T18:32:47.080783+0000","last_undegraded":"2024-05-08T18:32:47.080783+0000","last_fullsized":"2024-05-08T18:32:47.080783+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:05.929806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"93'12","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.079443+0000","last_change":"2024-05-08T18:29:40.538728+0000","last_active":"2024-05-08T18:32:47.079443+0000","last_peered":"2024-05-08T18:32:47.079443+0000","last_clean":"2024-05-08T18:32:47.079443+0000","last_became_active":"2024-05-08T18:29:40.537925+0000","last_became_peered":"2024-05-08T18:29:40.537925+0000","last_unstale":"2024-05-08T18:32:47.079443+0000","last_undegraded":"2024-05-08T18:32:47.079443+0000","last_fullsized":"2024-05-08T18:32:47.079443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:28.426657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":3,"num_read_kb":4,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"97'8","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.861235+0000","last_change":"2024-05-08T18:29:42.574941+0000","last_active":"2024-05-08T18:32:46.861235+0000","last_peered":"2024-05-08T18:32:46.861235+0000","last_clean":"2024-05-08T18:32:46.861235+0000","last_became_active":"2024-05-08T18:29:42.574351+0000","last_became_peered":"2024-05-08T18:29:42.574351+0000","last_unstale":"2024-05-08T18:32:46.861235+0000","last_undegraded":"2024-05-08T18:32:46.861235+0000","last_fullsized":"2024-05-08T18:32:46.861235+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:21.935293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"93'10","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.917647+0000","last_change":"2024-05-08T18:29:40.543714+0000","last_active":"2024-05-08T18:32:46.917647+0000","last_peered":"2024-05-08T18:32:46.917647+0000","last_clean":"2024-05-08T18:32:46.917647+0000","last_became_active":"2024-05-08T18:29:40.542965+0000","last_became_peered":"2024-05-08T18:29:40.542965+0000","last_unstale":"2024-05-08T18:32:46.917647+0000","last_undegraded":"2024-05-08T18:32:46.917647+0000","last_fullsized":"2024-05-08T18:32:46.917647+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:12:59.146887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.080411+0000","last_change":"2024-05-08T18:29:42.560007+0000","last_active":"2024-05-08T18:32:47.080411+0000","last_peered":"2024-05-08T18:32:47.080411+0000","last_clean":"2024-05-08T18:32:47.080411+0000","last_became_active":"2024-05-08T18:29:42.559028+0000","last_became_peered":"2024-05-08T18:29:42.559028+0000","last_unstale":"2024-05-08T18:32:47.080411+0000","last_undegraded":"2024-05-08T18:32:47.080411+0000","last_fullsized":"2024-05-08T18:32:47.080411+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:36:03.084561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":247,"num_read_kb":238,"num_write":231,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":816,"ondisk_log_size":816,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":156300,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":814,"num_read_kb":576,"num_write":459,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":272740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":668,"ondisk_log_size":668,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":334,"num_read_kb":334,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":579,"num_read_kb":555,"num_write":234,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":222,"ondisk_log_size":222,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":2397044736,"num_objects":572,"num_object_clones":0,"num_object_copies":1144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":572,"num_whiteouts":0,"num_read":21,"num_read_kb":23,"num_write":644,"num_write_kb":2365440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4794089472,"data_stored":4794089472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":584,"ondisk_log_size":584,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509488,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":686464,"kb_used_data":655288,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93685376,"statfs":{"total":96636764160,"available":95933825024,"internally_reserved":0,"allocated":671014912,"data_stored":670390943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509488,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":423716,"kb_used_data":392540,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93948124,"statfs":{"total":96636764160,"available":96202878976,"internally_reserved":0,"allocated":401960960,"data_stored":401364459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509486,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":794532,"kb_used_data":763356,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93577308,"statfs":{"total":96636764160,"available":95823163392,"internally_reserved":0,"allocated":781676544,"data_stored":781024259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509486,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":683812,"kb_used_data":652624,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93688028,"statfs":{"total":96636764160,"available":95936540672,"internally_reserved":0,"allocated":668286976,"data_stored":667702261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542191,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":683956,"kb_used_data":652780,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93687884,"statfs":{"total":96636764160,"available":95936393216,"internally_reserved":0,"allocated":668446720,"data_stored":667824622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542191,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":487200,"kb_used_data":456024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93884640,"statfs":{"total":96636764160,"available":96137871360,"internally_reserved":0,"allocated":466968576,"data_stored":466377162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542189,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":438084,"kb_used_data":406908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93933756,"statfs":{"total":96636764160,"available":96188166144,"internally_reserved":0,"allocated":416673792,"data_stored":416055978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542191,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":745916,"kb_used_data":714728,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93625924,"statfs":{"total":96636764160,"available":95872946176,"internally_reserved":0,"allocated":731881472,"data_stored":731267394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":729808896,"data_stored":729808896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":415236096,"data_stored":415236096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":465567744,"data_stored":465567744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":666894336,"data_stored":666894336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":666894336,"data_stored":666894336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":780140544,"data_stored":780140544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":400556032,"data_stored":400556032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":668991488,"data_stored":668991488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":59088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":12223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":176128,"data_stored":122673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":75918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T18:32:57.983 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-08T18:32:57.983 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T18:32:58.359 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-05-08T18:32:58.367 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2024-05-08T18:32:58.384 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":215,"stamp":"2024-05-08T18:32:57.476591+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2397793017,"num_objects":771,"num_object_clones":0,"num_object_copies":1542,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":771,"num_whiteouts":0,"num_read":2061,"num_read_kb":1781,"num_write":1679,"num_write_kb":2367361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2479,"ondisk_log_size":2479,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":4943680,"kb_used_data":4694248,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":750031040,"statfs":{"total":773094113280,"available":768031784960,"internally_reserved":0,"allocated":4806909952,"data_stored":4802007078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.419893"},"pg_stats":[{"pgid":"3.3f","version":"93'10","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.938099+0000","last_change":"2024-05-08T18:29:40.574221+0000","last_active":"2024-05-08T18:32:46.938099+0000","last_peered":"2024-05-08T18:32:46.938099+0000","last_clean":"2024-05-08T18:32:46.938099+0000","last_became_active":"2024-05-08T18:29:40.573543+0000","last_became_peered":"2024-05-08T18:29:40.573543+0000","last_unstale":"2024-05-08T18:32:46.938099+0000","last_undegraded":"2024-05-08T18:32:46.938099+0000","last_fullsized":"2024-05-08T18:32:46.938099+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:57.223609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39845888,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"97'2","reported_seq":197,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.077734+0000","last_change":"2024-05-08T18:29:42.563773+0000","last_active":"2024-05-08T18:32:47.077734+0000","last_peered":"2024-05-08T18:32:47.077734+0000","last_clean":"2024-05-08T18:32:47.077734+0000","last_became_active":"2024-05-08T18:29:42.561201+0000","last_became_peered":"2024-05-08T18:29:42.561201+0000","last_unstale":"2024-05-08T18:32:47.077734+0000","last_undegraded":"2024-05-08T18:32:47.077734+0000","last_fullsized":"2024-05-08T18:32:47.077734+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:55.055481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"93'10","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.919609+0000","last_change":"2024-05-08T18:29:40.549299+0000","last_active":"2024-05-08T18:32:46.919609+0000","last_peered":"2024-05-08T18:32:46.919609+0000","last_clean":"2024-05-08T18:32:46.919609+0000","last_became_active":"2024-05-08T18:29:40.548930+0000","last_became_peered":"2024-05-08T18:29:40.548930+0000","last_unstale":"2024-05-08T18:32:46.919609+0000","last_undegraded":"2024-05-08T18:32:46.919609+0000","last_fullsized":"2024-05-08T18:32:46.919609+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:06:36.198647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"84'2","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.936351+0000","last_change":"2024-05-08T18:29:42.572074+0000","last_active":"2024-05-08T18:32:46.936351+0000","last_peered":"2024-05-08T18:32:46.936351+0000","last_clean":"2024-05-08T18:32:46.936351+0000","last_became_active":"2024-05-08T18:29:42.571344+0000","last_became_peered":"2024-05-08T18:29:42.571344+0000","last_unstale":"2024-05-08T18:32:46.936351+0000","last_undegraded":"2024-05-08T18:32:46.936351+0000","last_fullsized":"2024-05-08T18:32:46.936351+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:36.890277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"97'14","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863310+0000","last_change":"2024-05-08T18:29:40.539048+0000","last_active":"2024-05-08T18:32:46.863310+0000","last_peered":"2024-05-08T18:32:46.863310+0000","last_clean":"2024-05-08T18:32:46.863310+0000","last_became_active":"2024-05-08T18:29:40.538458+0000","last_became_peered":"2024-05-08T18:29:40.538458+0000","last_unstale":"2024-05-08T18:32:46.863310+0000","last_undegraded":"2024-05-08T18:32:46.863310+0000","last_fullsized":"2024-05-08T18:32:46.863310+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:36:37.796095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":3,"num_read_kb":4,"num_write":24,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.058600+0000","last_change":"2024-05-08T18:29:42.569718+0000","last_active":"2024-05-08T18:32:46.058600+0000","last_peered":"2024-05-08T18:32:46.058600+0000","last_clean":"2024-05-08T18:32:46.058600+0000","last_became_active":"2024-05-08T18:29:42.569026+0000","last_became_peered":"2024-05-08T18:29:42.569026+0000","last_unstale":"2024-05-08T18:32:46.058600+0000","last_undegraded":"2024-05-08T18:32:46.058600+0000","last_fullsized":"2024-05-08T18:32:46.058600+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:42.045615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"84'8","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.079501+0000","last_change":"2024-05-08T18:29:40.557700+0000","last_active":"2024-05-08T18:32:47.079501+0000","last_peered":"2024-05-08T18:32:47.079501+0000","last_clean":"2024-05-08T18:32:47.079501+0000","last_became_active":"2024-05-08T18:29:40.556884+0000","last_became_peered":"2024-05-08T18:29:40.556884+0000","last_unstale":"2024-05-08T18:32:47.079501+0000","last_undegraded":"2024-05-08T18:32:47.079501+0000","last_fullsized":"2024-05-08T18:32:47.079501+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:21:38.354933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.861228+0000","last_change":"2024-05-08T18:29:42.566448+0000","last_active":"2024-05-08T18:32:46.861228+0000","last_peered":"2024-05-08T18:32:46.861228+0000","last_clean":"2024-05-08T18:32:46.861228+0000","last_became_active":"2024-05-08T18:29:42.566058+0000","last_became_peered":"2024-05-08T18:29:42.566058+0000","last_unstale":"2024-05-08T18:32:46.861228+0000","last_undegraded":"2024-05-08T18:32:46.861228+0000","last_fullsized":"2024-05-08T18:32:46.861228+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:53:03.097704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"93'5","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.936864+0000","last_change":"2024-05-08T18:29:40.571195+0000","last_active":"2024-05-08T18:32:46.936864+0000","last_peered":"2024-05-08T18:32:46.936864+0000","last_clean":"2024-05-08T18:32:46.936864+0000","last_became_active":"2024-05-08T18:29:40.570467+0000","last_became_peered":"2024-05-08T18:29:40.570467+0000","last_unstale":"2024-05-08T18:32:46.936864+0000","last_undegraded":"2024-05-08T18:32:46.936864+0000","last_fullsized":"2024-05-08T18:32:46.936864+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:39.986094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.849586+0000","last_change":"2024-05-08T18:29:42.566506+0000","last_active":"2024-05-08T18:32:46.849586+0000","last_peered":"2024-05-08T18:32:46.849586+0000","last_clean":"2024-05-08T18:32:46.849586+0000","last_became_active":"2024-05-08T18:29:42.565740+0000","last_became_peered":"2024-05-08T18:29:42.565740+0000","last_unstale":"2024-05-08T18:32:46.849586+0000","last_undegraded":"2024-05-08T18:32:46.849586+0000","last_fullsized":"2024-05-08T18:32:46.849586+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:58.320701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"93'7","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.078764+0000","last_change":"2024-05-08T18:29:40.538314+0000","last_active":"2024-05-08T18:32:47.078764+0000","last_peered":"2024-05-08T18:32:47.078764+0000","last_clean":"2024-05-08T18:32:47.078764+0000","last_became_active":"2024-05-08T18:29:40.537458+0000","last_became_peered":"2024-05-08T18:29:40.537458+0000","last_unstale":"2024-05-08T18:32:47.078764+0000","last_undegraded":"2024-05-08T18:32:47.078764+0000","last_fullsized":"2024-05-08T18:32:47.078764+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:56.300986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.059543+0000","last_change":"2024-05-08T18:29:42.570054+0000","last_active":"2024-05-08T18:32:46.059543+0000","last_peered":"2024-05-08T18:32:46.059543+0000","last_clean":"2024-05-08T18:32:46.059543+0000","last_became_active":"2024-05-08T18:29:42.569255+0000","last_became_peered":"2024-05-08T18:29:42.569255+0000","last_unstale":"2024-05-08T18:32:46.059543+0000","last_undegraded":"2024-05-08T18:32:46.059543+0000","last_fullsized":"2024-05-08T18:32:46.059543+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:11:01.702482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"93'18","reported_seq":165,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.060289+0000","last_change":"2024-05-08T18:30:21.210397+0000","last_active":"2024-05-08T18:32:46.060289+0000","last_peered":"2024-05-08T18:32:46.060289+0000","last_clean":"2024-05-08T18:32:46.060289+0000","last_became_active":"2024-05-08T18:30:21.210052+0000","last_became_peered":"2024-05-08T18:30:21.210052+0000","last_unstale":"2024-05-08T18:32:46.060289+0000","last_undegraded":"2024-05-08T18:32:46.060289+0000","last_fullsized":"2024-05-08T18:32:46.060289+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:51:05.355593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"97'4","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.080135+0000","last_change":"2024-05-08T18:29:42.562084+0000","last_active":"2024-05-08T18:32:47.080135+0000","last_peered":"2024-05-08T18:32:47.080135+0000","last_clean":"2024-05-08T18:32:47.080135+0000","last_became_active":"2024-05-08T18:29:42.560699+0000","last_became_peered":"2024-05-08T18:29:42.560699+0000","last_unstale":"2024-05-08T18:32:47.080135+0000","last_undegraded":"2024-05-08T18:32:47.080135+0000","last_fullsized":"2024-05-08T18:32:47.080135+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:09.787597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"93'13","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.063923+0000","last_change":"2024-05-08T18:29:40.564339+0000","last_active":"2024-05-08T18:32:46.063923+0000","last_peered":"2024-05-08T18:32:46.063923+0000","last_clean":"2024-05-08T18:32:46.063923+0000","last_became_active":"2024-05-08T18:29:40.564038+0000","last_became_peered":"2024-05-08T18:29:40.564038+0000","last_unstale":"2024-05-08T18:32:46.063923+0000","last_undegraded":"2024-05-08T18:32:46.063923+0000","last_fullsized":"2024-05-08T18:32:46.063923+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:40:23.287885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"84'8","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.064487+0000","last_change":"2024-05-08T18:29:42.570253+0000","last_active":"2024-05-08T18:32:46.064487+0000","last_peered":"2024-05-08T18:32:46.064487+0000","last_clean":"2024-05-08T18:32:46.064487+0000","last_became_active":"2024-05-08T18:29:42.569917+0000","last_became_peered":"2024-05-08T18:29:42.569917+0000","last_unstale":"2024-05-08T18:32:46.064487+0000","last_undegraded":"2024-05-08T18:32:46.064487+0000","last_fullsized":"2024-05-08T18:32:46.064487+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:14:45.575219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"84'4","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.057705+0000","last_change":"2024-05-08T18:29:42.568116+0000","last_active":"2024-05-08T18:32:46.057705+0000","last_peered":"2024-05-08T18:32:46.057705+0000","last_clean":"2024-05-08T18:32:46.057705+0000","last_became_active":"2024-05-08T18:29:42.567399+0000","last_became_peered":"2024-05-08T18:29:42.567399+0000","last_unstale":"2024-05-08T18:32:46.057705+0000","last_undegraded":"2024-05-08T18:32:46.057705+0000","last_fullsized":"2024-05-08T18:32:46.057705+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:35.037465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"93'13","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.938102+0000","last_change":"2024-05-08T18:29:40.571982+0000","last_active":"2024-05-08T18:32:46.938102+0000","last_peered":"2024-05-08T18:32:46.938102+0000","last_clean":"2024-05-08T18:32:46.938102+0000","last_became_active":"2024-05-08T18:29:40.570600+0000","last_became_peered":"2024-05-08T18:29:40.570600+0000","last_unstale":"2024-05-08T18:32:46.938102+0000","last_undegraded":"2024-05-08T18:32:46.938102+0000","last_fullsized":"2024-05-08T18:32:46.938102+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:54:14.520118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"80'2","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.936574+0000","last_change":"2024-05-08T18:29:42.578449+0000","last_active":"2024-05-08T18:32:46.936574+0000","last_peered":"2024-05-08T18:32:46.936574+0000","last_clean":"2024-05-08T18:32:46.936574+0000","last_became_active":"2024-05-08T18:29:42.577789+0000","last_became_peered":"2024-05-08T18:29:42.577789+0000","last_unstale":"2024-05-08T18:32:46.936574+0000","last_undegraded":"2024-05-08T18:32:46.936574+0000","last_fullsized":"2024-05-08T18:32:46.936574+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:09.787597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"93'8","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.849942+0000","last_change":"2024-05-08T18:29:40.570618+0000","last_active":"2024-05-08T18:32:46.849942+0000","last_peered":"2024-05-08T18:32:46.849942+0000","last_clean":"2024-05-08T18:32:46.849942+0000","last_became_active":"2024-05-08T18:29:40.569519+0000","last_became_peered":"2024-05-08T18:29:40.569519+0000","last_unstale":"2024-05-08T18:32:46.849942+0000","last_undegraded":"2024-05-08T18:32:46.849942+0000","last_fullsized":"2024-05-08T18:32:46.849942+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:09:42.581976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.077696+0000","last_change":"2024-05-08T18:29:42.563056+0000","last_active":"2024-05-08T18:32:47.077696+0000","last_peered":"2024-05-08T18:32:47.077696+0000","last_clean":"2024-05-08T18:32:47.077696+0000","last_became_active":"2024-05-08T18:29:42.562296+0000","last_became_peered":"2024-05-08T18:29:42.562296+0000","last_unstale":"2024-05-08T18:32:47.077696+0000","last_undegraded":"2024-05-08T18:32:47.077696+0000","last_fullsized":"2024-05-08T18:32:47.077696+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:36.890277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"93'14","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.849998+0000","last_change":"2024-05-08T18:29:40.564353+0000","last_active":"2024-05-08T18:32:46.849998+0000","last_peered":"2024-05-08T18:32:46.849998+0000","last_clean":"2024-05-08T18:32:46.849998+0000","last_became_active":"2024-05-08T18:29:40.563516+0000","last_became_peered":"2024-05-08T18:29:40.563516+0000","last_unstale":"2024-05-08T18:32:46.849998+0000","last_undegraded":"2024-05-08T18:32:46.849998+0000","last_fullsized":"2024-05-08T18:32:46.849998+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:06:36.198647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"97'4","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.061368+0000","last_change":"2024-05-08T18:29:42.567006+0000","last_active":"2024-05-08T18:32:46.061368+0000","last_peered":"2024-05-08T18:32:46.061368+0000","last_clean":"2024-05-08T18:32:46.061368+0000","last_became_active":"2024-05-08T18:29:42.566256+0000","last_became_peered":"2024-05-08T18:29:42.566256+0000","last_unstale":"2024-05-08T18:32:46.061368+0000","last_undegraded":"2024-05-08T18:32:46.061368+0000","last_fullsized":"2024-05-08T18:32:46.061368+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:09:44.601690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"93'7","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.059619+0000","last_change":"2024-05-08T18:29:40.573212+0000","last_active":"2024-05-08T18:32:46.059619+0000","last_peered":"2024-05-08T18:32:46.059619+0000","last_clean":"2024-05-08T18:32:46.059619+0000","last_became_active":"2024-05-08T18:29:40.572250+0000","last_became_peered":"2024-05-08T18:29:40.572250+0000","last_unstale":"2024-05-08T18:32:46.059619+0000","last_undegraded":"2024-05-08T18:32:46.059619+0000","last_fullsized":"2024-05-08T18:32:46.059619+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:25:01.595224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"97'6","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.062431+0000","last_change":"2024-05-08T18:29:42.570847+0000","last_active":"2024-05-08T18:32:46.062431+0000","last_peered":"2024-05-08T18:32:46.062431+0000","last_clean":"2024-05-08T18:32:46.062431+0000","last_became_active":"2024-05-08T18:29:42.570435+0000","last_became_peered":"2024-05-08T18:29:42.570435+0000","last_unstale":"2024-05-08T18:32:46.062431+0000","last_undegraded":"2024-05-08T18:32:46.062431+0000","last_fullsized":"2024-05-08T18:32:46.062431+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:21:40.374647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"93'7","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.063428+0000","last_change":"2024-05-08T18:29:40.566815+0000","last_active":"2024-05-08T18:32:46.063428+0000","last_peered":"2024-05-08T18:32:46.063428+0000","last_clean":"2024-05-08T18:32:46.063428+0000","last_became_active":"2024-05-08T18:29:40.566531+0000","last_became_peered":"2024-05-08T18:29:40.566531+0000","last_unstale":"2024-05-08T18:32:46.063428+0000","last_undegraded":"2024-05-08T18:32:46.063428+0000","last_fullsized":"2024-05-08T18:32:46.063428+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:52.462279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"84'8","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.059681+0000","last_change":"2024-05-08T18:29:42.554846+0000","last_active":"2024-05-08T18:32:46.059681+0000","last_peered":"2024-05-08T18:32:46.059681+0000","last_clean":"2024-05-08T18:32:46.059681+0000","last_became_active":"2024-05-08T18:29:42.554115+0000","last_became_peered":"2024-05-08T18:29:42.554115+0000","last_unstale":"2024-05-08T18:32:46.059681+0000","last_undegraded":"2024-05-08T18:32:46.059681+0000","last_fullsized":"2024-05-08T18:32:46.059681+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:22:14.793035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"93'7","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.862823+0000","last_change":"2024-05-08T18:29:40.547776+0000","last_active":"2024-05-08T18:32:46.862823+0000","last_peered":"2024-05-08T18:32:46.862823+0000","last_clean":"2024-05-08T18:32:46.862823+0000","last_became_active":"2024-05-08T18:29:40.547384+0000","last_became_peered":"2024-05-08T18:29:40.547384+0000","last_unstale":"2024-05-08T18:32:46.862823+0000","last_undegraded":"2024-05-08T18:32:46.862823+0000","last_fullsized":"2024-05-08T18:32:46.862823+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:14:26.628603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"97'10","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.057195+0000","last_change":"2024-05-08T18:29:50.685390+0000","last_active":"2024-05-08T18:32:46.057195+0000","last_peered":"2024-05-08T18:32:46.057195+0000","last_clean":"2024-05-08T18:32:46.057195+0000","last_became_active":"2024-05-08T18:29:50.684644+0000","last_became_peered":"2024-05-08T18:29:50.684644+0000","last_unstale":"2024-05-08T18:32:46.057195+0000","last_undegraded":"2024-05-08T18:32:46.057195+0000","last_fullsized":"2024-05-08T18:32:46.057195+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:10:38.951662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":21,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"84'10","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.066363+0000","last_change":"2024-05-08T18:29:42.573805+0000","last_active":"2024-05-08T18:32:46.066363+0000","last_peered":"2024-05-08T18:32:46.066363+0000","last_clean":"2024-05-08T18:32:46.066363+0000","last_became_active":"2024-05-08T18:29:42.573296+0000","last_became_peered":"2024-05-08T18:29:42.573296+0000","last_unstale":"2024-05-08T18:32:46.066363+0000","last_undegraded":"2024-05-08T18:32:46.066363+0000","last_fullsized":"2024-05-08T18:32:46.066363+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:21.935293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"93'8","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.937043+0000","last_change":"2024-05-08T18:29:40.570733+0000","last_active":"2024-05-08T18:32:46.937043+0000","last_peered":"2024-05-08T18:32:46.937043+0000","last_clean":"2024-05-08T18:32:46.937043+0000","last_became_active":"2024-05-08T18:29:40.569711+0000","last_became_peered":"2024-05-08T18:29:40.569711+0000","last_unstale":"2024-05-08T18:32:46.937043+0000","last_undegraded":"2024-05-08T18:32:46.937043+0000","last_fullsized":"2024-05-08T18:32:46.937043+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:18:08.784274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.079758+0000","last_change":"2024-05-08T18:29:44.594185+0000","last_active":"2024-05-08T18:32:47.079758+0000","last_peered":"2024-05-08T18:32:47.079758+0000","last_clean":"2024-05-08T18:32:47.079758+0000","last_became_active":"2024-05-08T18:29:44.593442+0000","last_became_peered":"2024-05-08T18:29:44.593442+0000","last_unstale":"2024-05-08T18:32:47.079758+0000","last_undegraded":"2024-05-08T18:32:47.079758+0000","last_fullsized":"2024-05-08T18:32:47.079758+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:52:25.736491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"97'15","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863258+0000","last_change":"2024-05-08T18:29:46.594652+0000","last_active":"2024-05-08T18:32:46.863258+0000","last_peered":"2024-05-08T18:32:46.863258+0000","last_clean":"2024-05-08T18:32:46.863258+0000","last_became_active":"2024-05-08T18:29:46.593656+0000","last_became_peered":"2024-05-08T18:29:46.593656+0000","last_unstale":"2024-05-08T18:32:46.863258+0000","last_undegraded":"2024-05-08T18:32:46.863258+0000","last_fullsized":"2024-05-08T18:32:46.863258+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:50:27.608888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.937817+0000","last_change":"2024-05-08T18:29:48.639834+0000","last_active":"2024-05-08T18:32:46.937817+0000","last_peered":"2024-05-08T18:32:46.937817+0000","last_clean":"2024-05-08T18:32:46.937817+0000","last_became_active":"2024-05-08T18:29:48.639122+0000","last_became_peered":"2024-05-08T18:29:48.639122+0000","last_unstale":"2024-05-08T18:32:46.937817+0000","last_undegraded":"2024-05-08T18:32:46.937817+0000","last_fullsized":"2024-05-08T18:32:46.937817+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:14:22.304773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"83'4","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.077986+0000","last_change":"2024-05-08T18:29:50.672303+0000","last_active":"2024-05-08T18:32:47.077986+0000","last_peered":"2024-05-08T18:32:47.077986+0000","last_clean":"2024-05-08T18:32:47.077986+0000","last_became_active":"2024-05-08T18:29:50.671513+0000","last_became_peered":"2024-05-08T18:29:50.671513+0000","last_unstale":"2024-05-08T18:32:47.077986+0000","last_undegraded":"2024-05-08T18:32:47.077986+0000","last_fullsized":"2024-05-08T18:32:47.077986+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:12:05.780786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"84'4","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.080615+0000","last_change":"2024-05-08T18:29:42.565462+0000","last_active":"2024-05-08T18:32:47.080615+0000","last_peered":"2024-05-08T18:32:47.080615+0000","last_clean":"2024-05-08T18:32:47.080615+0000","last_became_active":"2024-05-08T18:29:42.564741+0000","last_became_peered":"2024-05-08T18:29:42.564741+0000","last_unstale":"2024-05-08T18:32:47.080615+0000","last_undegraded":"2024-05-08T18:32:47.080615+0000","last_fullsized":"2024-05-08T18:32:47.080615+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:25:56.129785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"93'6","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.862908+0000","last_change":"2024-05-08T18:29:40.564796+0000","last_active":"2024-05-08T18:32:46.862908+0000","last_peered":"2024-05-08T18:32:46.862908+0000","last_clean":"2024-05-08T18:32:46.862908+0000","last_became_active":"2024-05-08T18:29:40.564401+0000","last_became_peered":"2024-05-08T18:29:40.564401+0000","last_unstale":"2024-05-08T18:32:46.862908+0000","last_undegraded":"2024-05-08T18:32:46.862908+0000","last_fullsized":"2024-05-08T18:32:46.862908+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:19:11.492397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":189,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.065935+0000","last_change":"2024-05-08T18:29:44.587689+0000","last_active":"2024-05-08T18:32:46.065935+0000","last_peered":"2024-05-08T18:32:46.065935+0000","last_clean":"2024-05-08T18:32:46.065935+0000","last_became_active":"2024-05-08T18:29:44.586975+0000","last_became_peered":"2024-05-08T18:29:44.586975+0000","last_unstale":"2024-05-08T18:32:46.065935+0000","last_undegraded":"2024-05-08T18:32:46.065935+0000","last_fullsized":"2024-05-08T18:32:46.065935+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:04:49.020450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"83'7","reported_seq":197,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.059952+0000","last_change":"2024-05-08T18:29:46.600906+0000","last_active":"2024-05-08T18:32:46.059952+0000","last_peered":"2024-05-08T18:32:46.059952+0000","last_clean":"2024-05-08T18:32:46.059952+0000","last_became_active":"2024-05-08T18:29:46.599894+0000","last_became_peered":"2024-05-08T18:29:46.599894+0000","last_unstale":"2024-05-08T18:32:46.059952+0000","last_undegraded":"2024-05-08T18:32:46.059952+0000","last_fullsized":"2024-05-08T18:32:46.059952+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:24:13.568294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.059189+0000","last_change":"2024-05-08T18:29:48.614324+0000","last_active":"2024-05-08T18:32:46.059189+0000","last_peered":"2024-05-08T18:32:46.059189+0000","last_clean":"2024-05-08T18:32:46.059189+0000","last_became_active":"2024-05-08T18:29:48.613591+0000","last_became_peered":"2024-05-08T18:29:48.613591+0000","last_unstale":"2024-05-08T18:32:46.059189+0000","last_undegraded":"2024-05-08T18:32:46.059189+0000","last_fullsized":"2024-05-08T18:32:46.059189+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:47:54.034851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.862656+0000","last_change":"2024-05-08T18:29:50.684773+0000","last_active":"2024-05-08T18:32:46.862656+0000","last_peered":"2024-05-08T18:32:46.862656+0000","last_clean":"2024-05-08T18:32:46.862656+0000","last_became_active":"2024-05-08T18:29:50.683931+0000","last_became_peered":"2024-05-08T18:29:50.683931+0000","last_unstale":"2024-05-08T18:32:46.862656+0000","last_undegraded":"2024-05-08T18:32:46.862656+0000","last_fullsized":"2024-05-08T18:32:46.862656+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:17:10.582636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"80'2","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.861209+0000","last_change":"2024-05-08T18:29:42.574437+0000","last_active":"2024-05-08T18:32:46.861209+0000","last_peered":"2024-05-08T18:32:46.861209+0000","last_clean":"2024-05-08T18:32:46.861209+0000","last_became_active":"2024-05-08T18:29:42.574146+0000","last_became_peered":"2024-05-08T18:29:42.574146+0000","last_unstale":"2024-05-08T18:32:46.861209+0000","last_undegraded":"2024-05-08T18:32:46.861209+0000","last_fullsized":"2024-05-08T18:32:46.861209+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:55:30.468069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"93'11","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.936641+0000","last_change":"2024-05-08T18:29:40.559677+0000","last_active":"2024-05-08T18:32:46.936641+0000","last_peered":"2024-05-08T18:32:46.936641+0000","last_clean":"2024-05-08T18:32:46.936641+0000","last_became_active":"2024-05-08T18:29:40.558819+0000","last_became_peered":"2024-05-08T18:29:40.558819+0000","last_unstale":"2024-05-08T18:32:46.936641+0000","last_undegraded":"2024-05-08T18:32:46.936641+0000","last_fullsized":"2024-05-08T18:32:46.936641+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:28.426657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":189,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.067875+0000","last_change":"2024-05-08T18:29:44.596801+0000","last_active":"2024-05-08T18:32:46.067875+0000","last_peered":"2024-05-08T18:32:46.067875+0000","last_clean":"2024-05-08T18:32:46.067875+0000","last_became_active":"2024-05-08T18:29:44.596111+0000","last_became_peered":"2024-05-08T18:29:44.596111+0000","last_unstale":"2024-05-08T18:32:46.067875+0000","last_undegraded":"2024-05-08T18:32:46.067875+0000","last_fullsized":"2024-05-08T18:32:46.067875+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:04.423266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"33'10","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.061447+0000","last_change":"2024-05-08T18:29:46.608330+0000","last_active":"2024-05-08T18:32:46.061447+0000","last_peered":"2024-05-08T18:32:46.061447+0000","last_clean":"2024-05-08T18:32:46.061447+0000","last_became_active":"2024-05-08T18:29:46.607580+0000","last_became_peered":"2024-05-08T18:29:46.607580+0000","last_unstale":"2024-05-08T18:32:46.061447+0000","last_undegraded":"2024-05-08T18:32:46.061447+0000","last_fullsized":"2024-05-08T18:32:46.061447+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:22:18.837103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"116'102","reported_seq":407,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:49.831802+0000","last_change":"2024-05-08T18:29:48.642718+0000","last_active":"2024-05-08T18:32:49.831802+0000","last_peered":"2024-05-08T18:32:49.831802+0000","last_clean":"2024-05-08T18:32:49.831802+0000","last_became_active":"2024-05-08T18:29:48.641950+0000","last_became_peered":"2024-05-08T18:29:48.641950+0000","last_unstale":"2024-05-08T18:32:49.831802+0000","last_undegraded":"2024-05-08T18:32:49.831802+0000","last_fullsized":"2024-05-08T18:32:49.831802+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:00:11.720096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"84'2","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.058647+0000","last_change":"2024-05-08T18:29:50.660378+0000","last_active":"2024-05-08T18:32:46.058647+0000","last_peered":"2024-05-08T18:32:46.058647+0000","last_clean":"2024-05-08T18:32:46.058647+0000","last_became_active":"2024-05-08T18:29:50.659649+0000","last_became_peered":"2024-05-08T18:29:50.659649+0000","last_unstale":"2024-05-08T18:32:46.058647+0000","last_undegraded":"2024-05-08T18:32:46.058647+0000","last_fullsized":"2024-05-08T18:32:46.058647+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:34:14.488295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"80'2","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.066931+0000","last_change":"2024-05-08T18:29:42.577267+0000","last_active":"2024-05-08T18:32:46.066931+0000","last_peered":"2024-05-08T18:32:46.066931+0000","last_clean":"2024-05-08T18:32:46.066931+0000","last_became_active":"2024-05-08T18:29:42.576740+0000","last_became_peered":"2024-05-08T18:29:42.576740+0000","last_unstale":"2024-05-08T18:32:46.066931+0000","last_undegraded":"2024-05-08T18:32:46.066931+0000","last_fullsized":"2024-05-08T18:32:46.066931+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:57:14.869860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"93'5","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.848368+0000","last_change":"2024-05-08T18:29:40.547524+0000","last_active":"2024-05-08T18:32:46.848368+0000","last_peered":"2024-05-08T18:32:46.848368+0000","last_clean":"2024-05-08T18:32:46.848368+0000","last_became_active":"2024-05-08T18:29:40.545749+0000","last_became_peered":"2024-05-08T18:29:40.545749+0000","last_unstale":"2024-05-08T18:32:46.848368+0000","last_undegraded":"2024-05-08T18:32:46.848368+0000","last_fullsized":"2024-05-08T18:32:46.848368+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:12:59.146887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.080004+0000","last_change":"2024-05-08T18:29:44.579839+0000","last_active":"2024-05-08T18:32:47.080004+0000","last_peered":"2024-05-08T18:32:47.080004+0000","last_clean":"2024-05-08T18:32:47.080004+0000","last_became_active":"2024-05-08T18:29:44.578142+0000","last_became_peered":"2024-05-08T18:29:44.578142+0000","last_unstale":"2024-05-08T18:32:47.080004+0000","last_undegraded":"2024-05-08T18:32:47.080004+0000","last_fullsized":"2024-05-08T18:32:47.080004+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:51:09.413191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"97'15","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.937446+0000","last_change":"2024-05-08T18:29:46.607288+0000","last_active":"2024-05-08T18:32:46.937446+0000","last_peered":"2024-05-08T18:32:46.937446+0000","last_clean":"2024-05-08T18:32:46.937446+0000","last_became_active":"2024-05-08T18:29:46.605154+0000","last_became_peered":"2024-05-08T18:29:46.605154+0000","last_unstale":"2024-05-08T18:32:46.937446+0000","last_undegraded":"2024-05-08T18:32:46.937446+0000","last_fullsized":"2024-05-08T18:32:46.937446+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:23.940519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"116'102","reported_seq":326,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:49.830860+0000","last_change":"2024-05-08T18:29:48.634956+0000","last_active":"2024-05-08T18:32:49.830860+0000","last_peered":"2024-05-08T18:32:49.830860+0000","last_clean":"2024-05-08T18:32:49.830860+0000","last_became_active":"2024-05-08T18:29:48.633858+0000","last_became_peered":"2024-05-08T18:29:48.633858+0000","last_unstale":"2024-05-08T18:32:49.830860+0000","last_undegraded":"2024-05-08T18:32:49.830860+0000","last_fullsized":"2024-05-08T18:32:49.830860+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:50:48.169666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"84'8","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.079043+0000","last_change":"2024-05-08T18:29:42.567744+0000","last_active":"2024-05-08T18:32:47.079043+0000","last_peered":"2024-05-08T18:32:47.079043+0000","last_clean":"2024-05-08T18:32:47.079043+0000","last_became_active":"2024-05-08T18:29:42.566974+0000","last_became_peered":"2024-05-08T18:29:42.566974+0000","last_unstale":"2024-05-08T18:32:47.079043+0000","last_undegraded":"2024-05-08T18:32:47.079043+0000","last_fullsized":"2024-05-08T18:32:47.079043+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:42.045615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"93'10","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.938419+0000","last_change":"2024-05-08T18:29:40.572499+0000","last_active":"2024-05-08T18:32:46.938419+0000","last_peered":"2024-05-08T18:32:46.938419+0000","last_clean":"2024-05-08T18:32:46.938419+0000","last_became_active":"2024-05-08T18:29:40.571322+0000","last_became_peered":"2024-05-08T18:29:40.571322+0000","last_unstale":"2024-05-08T18:32:46.938419+0000","last_undegraded":"2024-05-08T18:32:46.938419+0000","last_fullsized":"2024-05-08T18:32:46.938419+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:31.119374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.935697+0000","last_change":"2024-05-08T18:29:44.597045+0000","last_active":"2024-05-08T18:32:46.935697+0000","last_peered":"2024-05-08T18:32:46.935697+0000","last_clean":"2024-05-08T18:32:46.935697+0000","last_became_active":"2024-05-08T18:29:44.596282+0000","last_became_peered":"2024-05-08T18:29:44.596282+0000","last_unstale":"2024-05-08T18:32:46.935697+0000","last_undegraded":"2024-05-08T18:32:46.935697+0000","last_fullsized":"2024-05-08T18:32:46.935697+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:35:51.288126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"97'26","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.078455+0000","last_change":"2024-05-08T18:29:46.590633+0000","last_active":"2024-05-08T18:32:47.078455+0000","last_peered":"2024-05-08T18:32:47.078455+0000","last_clean":"2024-05-08T18:32:47.078455+0000","last_became_active":"2024-05-08T18:29:46.589600+0000","last_became_peered":"2024-05-08T18:29:46.589600+0000","last_unstale":"2024-05-08T18:32:47.078455+0000","last_undegraded":"2024-05-08T18:32:47.078455+0000","last_fullsized":"2024-05-08T18:32:47.078455+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:23.940519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.917121+0000","last_change":"2024-05-08T18:29:48.630758+0000","last_active":"2024-05-08T18:32:46.917121+0000","last_peered":"2024-05-08T18:32:46.917121+0000","last_clean":"2024-05-08T18:32:46.917121+0000","last_became_active":"2024-05-08T18:29:48.630017+0000","last_became_peered":"2024-05-08T18:29:48.630017+0000","last_unstale":"2024-05-08T18:32:46.917121+0000","last_undegraded":"2024-05-08T18:32:46.917121+0000","last_fullsized":"2024-05-08T18:32:46.917121+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:39.879384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"97'14","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.077776+0000","last_change":"2024-05-08T18:29:50.672682+0000","last_active":"2024-05-08T18:32:47.077776+0000","last_peered":"2024-05-08T18:32:47.077776+0000","last_clean":"2024-05-08T18:32:47.077776+0000","last_became_active":"2024-05-08T18:29:50.671923+0000","last_became_peered":"2024-05-08T18:29:50.671923+0000","last_unstale":"2024-05-08T18:32:47.077776+0000","last_undegraded":"2024-05-08T18:32:47.077776+0000","last_fullsized":"2024-05-08T18:32:47.077776+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:38.318890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":39,"num_write":35,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"80'2","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.057722+0000","last_change":"2024-05-08T18:29:42.554289+0000","last_active":"2024-05-08T18:32:46.057722+0000","last_peered":"2024-05-08T18:32:46.057722+0000","last_clean":"2024-05-08T18:32:46.057722+0000","last_became_active":"2024-05-08T18:29:42.553574+0000","last_became_peered":"2024-05-08T18:29:42.553574+0000","last_unstale":"2024-05-08T18:32:46.057722+0000","last_undegraded":"2024-05-08T18:32:46.057722+0000","last_fullsized":"2024-05-08T18:32:46.057722+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:42.005809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"93'7","reported_seq":201,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.938183+0000","last_change":"2024-05-08T18:29:40.570169+0000","last_active":"2024-05-08T18:32:46.938183+0000","last_peered":"2024-05-08T18:32:46.938183+0000","last_clean":"2024-05-08T18:32:46.938183+0000","last_became_active":"2024-05-08T18:29:40.569542+0000","last_became_peered":"2024-05-08T18:29:40.569542+0000","last_unstale":"2024-05-08T18:32:46.938183+0000","last_undegraded":"2024-05-08T18:32:46.938183+0000","last_fullsized":"2024-05-08T18:32:46.938183+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:08:13.006752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"26'1","reported_seq":257,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.060325+0000","last_change":"2024-05-08T18:29:44.579659+0000","last_active":"2024-05-08T18:32:46.060325+0000","last_peered":"2024-05-08T18:32:46.060325+0000","last_clean":"2024-05-08T18:32:46.060325+0000","last_became_active":"2024-05-08T18:29:44.579152+0000","last_became_peered":"2024-05-08T18:29:44.579152+0000","last_unstale":"2024-05-08T18:32:46.060325+0000","last_undegraded":"2024-05-08T18:32:46.060325+0000","last_fullsized":"2024-05-08T18:32:46.060325+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:15:00.358583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"97'15","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.064379+0000","last_change":"2024-05-08T18:29:46.600224+0000","last_active":"2024-05-08T18:32:46.064379+0000","last_peered":"2024-05-08T18:32:46.064379+0000","last_clean":"2024-05-08T18:32:46.064379+0000","last_became_active":"2024-05-08T18:29:46.599464+0000","last_became_peered":"2024-05-08T18:29:46.599464+0000","last_unstale":"2024-05-08T18:32:46.064379+0000","last_undegraded":"2024-05-08T18:32:46.064379+0000","last_fullsized":"2024-05-08T18:32:46.064379+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:26:40.238188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.061779+0000","last_change":"2024-05-08T18:29:48.637939+0000","last_active":"2024-05-08T18:32:46.061779+0000","last_peered":"2024-05-08T18:32:46.061779+0000","last_clean":"2024-05-08T18:32:46.061779+0000","last_became_active":"2024-05-08T18:29:48.637231+0000","last_became_peered":"2024-05-08T18:29:48.637231+0000","last_unstale":"2024-05-08T18:32:46.061779+0000","last_undegraded":"2024-05-08T18:32:46.061779+0000","last_fullsized":"2024-05-08T18:32:46.061779+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:04.571608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":174,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.847775+0000","last_change":"2024-05-08T18:29:50.681831+0000","last_active":"2024-05-08T18:32:46.847775+0000","last_peered":"2024-05-08T18:32:46.847775+0000","last_clean":"2024-05-08T18:32:46.847775+0000","last_became_active":"2024-05-08T18:29:50.681287+0000","last_became_peered":"2024-05-08T18:29:50.681287+0000","last_unstale":"2024-05-08T18:32:46.847775+0000","last_undegraded":"2024-05-08T18:32:46.847775+0000","last_fullsized":"2024-05-08T18:32:46.847775+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:30:24.111488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.849322+0000","last_change":"2024-05-08T18:29:42.562975+0000","last_active":"2024-05-08T18:32:46.849322+0000","last_peered":"2024-05-08T18:32:46.849322+0000","last_clean":"2024-05-08T18:32:46.849322+0000","last_became_active":"2024-05-08T18:29:42.562267+0000","last_became_peered":"2024-05-08T18:29:42.562267+0000","last_unstale":"2024-05-08T18:32:46.849322+0000","last_undegraded":"2024-05-08T18:32:46.849322+0000","last_fullsized":"2024-05-08T18:32:46.849322+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:30.446371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"93'7","reported_seq":201,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.938062+0000","last_change":"2024-05-08T18:29:40.570736+0000","last_active":"2024-05-08T18:32:46.938062+0000","last_peered":"2024-05-08T18:32:46.938062+0000","last_clean":"2024-05-08T18:32:46.938062+0000","last_became_active":"2024-05-08T18:29:40.569626+0000","last_became_peered":"2024-05-08T18:29:40.569626+0000","last_unstale":"2024-05-08T18:32:46.938062+0000","last_undegraded":"2024-05-08T18:32:46.938062+0000","last_fullsized":"2024-05-08T18:32:46.938062+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:56.300986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"26'1","reported_seq":257,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.062164+0000","last_change":"2024-05-08T18:29:44.581748+0000","last_active":"2024-05-08T18:32:46.062164+0000","last_peered":"2024-05-08T18:32:46.062164+0000","last_clean":"2024-05-08T18:32:46.062164+0000","last_became_active":"2024-05-08T18:29:44.581067+0000","last_became_peered":"2024-05-08T18:29:44.581067+0000","last_unstale":"2024-05-08T18:32:46.062164+0000","last_undegraded":"2024-05-08T18:32:46.062164+0000","last_fullsized":"2024-05-08T18:32:46.062164+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:44.043691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"97'21","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.936022+0000","last_change":"2024-05-08T18:29:46.605887+0000","last_active":"2024-05-08T18:32:46.936022+0000","last_peered":"2024-05-08T18:32:46.936022+0000","last_clean":"2024-05-08T18:32:46.936022+0000","last_became_active":"2024-05-08T18:29:46.604966+0000","last_became_peered":"2024-05-08T18:29:46.604966+0000","last_unstale":"2024-05-08T18:32:46.936022+0000","last_undegraded":"2024-05-08T18:32:46.936022+0000","last_fullsized":"2024-05-08T18:32:46.936022+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:07:54.654205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"116'102","reported_seq":326,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:49.830598+0000","last_change":"2024-05-08T18:29:48.638657+0000","last_active":"2024-05-08T18:32:49.830598+0000","last_peered":"2024-05-08T18:32:49.830598+0000","last_clean":"2024-05-08T18:32:49.830598+0000","last_became_active":"2024-05-08T18:29:48.637758+0000","last_became_peered":"2024-05-08T18:29:48.637758+0000","last_unstale":"2024-05-08T18:32:49.830598+0000","last_undegraded":"2024-05-08T18:32:49.830598+0000","last_fullsized":"2024-05-08T18:32:49.830598+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:45:24.153991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"97'2","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863289+0000","last_change":"2024-05-08T18:29:50.684501+0000","last_active":"2024-05-08T18:32:46.863289+0000","last_peered":"2024-05-08T18:32:46.863289+0000","last_clean":"2024-05-08T18:32:46.863289+0000","last_became_active":"2024-05-08T18:29:50.683738+0000","last_became_peered":"2024-05-08T18:29:50.683738+0000","last_unstale":"2024-05-08T18:32:46.863289+0000","last_undegraded":"2024-05-08T18:32:46.863289+0000","last_fullsized":"2024-05-08T18:32:46.863289+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:22.834262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"84'4","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863429+0000","last_change":"2024-05-08T18:29:42.569401+0000","last_active":"2024-05-08T18:32:46.863429+0000","last_peered":"2024-05-08T18:32:46.863429+0000","last_clean":"2024-05-08T18:32:46.863429+0000","last_became_active":"2024-05-08T18:29:42.568659+0000","last_became_peered":"2024-05-08T18:29:42.568659+0000","last_unstale":"2024-05-08T18:32:46.863429+0000","last_undegraded":"2024-05-08T18:32:46.863429+0000","last_fullsized":"2024-05-08T18:32:46.863429+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:35:23.016110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"93'8","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.079924+0000","last_change":"2024-05-08T18:29:40.557076+0000","last_active":"2024-05-08T18:32:47.079924+0000","last_peered":"2024-05-08T18:32:47.079924+0000","last_clean":"2024-05-08T18:32:47.079924+0000","last_became_active":"2024-05-08T18:29:40.555805+0000","last_became_peered":"2024-05-08T18:29:40.555805+0000","last_unstale":"2024-05-08T18:32:47.079924+0000","last_undegraded":"2024-05-08T18:32:47.079924+0000","last_fullsized":"2024-05-08T18:32:47.079924+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:13.946346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":18,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":189,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.060997+0000","last_change":"2024-05-08T18:29:44.573892+0000","last_active":"2024-05-08T18:32:46.060997+0000","last_peered":"2024-05-08T18:32:46.060997+0000","last_clean":"2024-05-08T18:32:46.060997+0000","last_became_active":"2024-05-08T18:29:44.573308+0000","last_became_peered":"2024-05-08T18:29:44.573308+0000","last_unstale":"2024-05-08T18:32:46.060997+0000","last_undegraded":"2024-05-08T18:32:46.060997+0000","last_fullsized":"2024-05-08T18:32:46.060997+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:37.075348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"97'24","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.862514+0000","last_change":"2024-05-08T18:29:46.595585+0000","last_active":"2024-05-08T18:32:46.862514+0000","last_peered":"2024-05-08T18:32:46.862514+0000","last_clean":"2024-05-08T18:32:46.862514+0000","last_became_active":"2024-05-08T18:29:46.594930+0000","last_became_peered":"2024-05-08T18:29:46.594930+0000","last_unstale":"2024-05-08T18:32:46.862514+0000","last_undegraded":"2024-05-08T18:32:46.862514+0000","last_fullsized":"2024-05-08T18:32:46.862514+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:11.768269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.059998+0000","last_change":"2024-05-08T18:29:48.638137+0000","last_active":"2024-05-08T18:32:46.059998+0000","last_peered":"2024-05-08T18:32:46.059998+0000","last_clean":"2024-05-08T18:32:46.059998+0000","last_became_active":"2024-05-08T18:29:48.637370+0000","last_became_peered":"2024-05-08T18:29:48.637370+0000","last_unstale":"2024-05-08T18:32:46.059998+0000","last_undegraded":"2024-05-08T18:32:46.059998+0000","last_fullsized":"2024-05-08T18:32:46.059998+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:15.859849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"83'2","reported_seq":182,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.916145+0000","last_change":"2024-05-08T18:29:50.688760+0000","last_active":"2024-05-08T18:32:46.916145+0000","last_peered":"2024-05-08T18:32:46.916145+0000","last_clean":"2024-05-08T18:32:46.916145+0000","last_became_active":"2024-05-08T18:29:50.687960+0000","last_became_peered":"2024-05-08T18:29:50.687960+0000","last_unstale":"2024-05-08T18:32:46.916145+0000","last_undegraded":"2024-05-08T18:32:46.916145+0000","last_fullsized":"2024-05-08T18:32:46.916145+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:21:19.624895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"97'4","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.060220+0000","last_change":"2024-05-08T18:29:42.557850+0000","last_active":"2024-05-08T18:32:46.060220+0000","last_peered":"2024-05-08T18:32:46.060220+0000","last_clean":"2024-05-08T18:32:46.060220+0000","last_became_active":"2024-05-08T18:29:42.557119+0000","last_became_peered":"2024-05-08T18:29:42.557119+0000","last_unstale":"2024-05-08T18:32:46.060220+0000","last_undegraded":"2024-05-08T18:32:46.060220+0000","last_fullsized":"2024-05-08T18:32:46.060220+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:25:56.129785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"93'8","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.062755+0000","last_change":"2024-05-08T18:29:40.544530+0000","last_active":"2024-05-08T18:32:46.062755+0000","last_peered":"2024-05-08T18:32:46.062755+0000","last_clean":"2024-05-08T18:32:46.062755+0000","last_became_active":"2024-05-08T18:29:40.544215+0000","last_became_peered":"2024-05-08T18:29:40.544215+0000","last_unstale":"2024-05-08T18:32:46.062755+0000","last_undegraded":"2024-05-08T18:32:46.062755+0000","last_fullsized":"2024-05-08T18:32:46.062755+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:14:26.628603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":189,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.063283+0000","last_change":"2024-05-08T18:29:44.588227+0000","last_active":"2024-05-08T18:32:46.063283+0000","last_peered":"2024-05-08T18:32:46.063283+0000","last_clean":"2024-05-08T18:32:46.063283+0000","last_became_active":"2024-05-08T18:29:44.587822+0000","last_became_peered":"2024-05-08T18:29:44.587822+0000","last_unstale":"2024-05-08T18:32:46.063283+0000","last_undegraded":"2024-05-08T18:32:46.063283+0000","last_fullsized":"2024-05-08T18:32:46.063283+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:18:12.841872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"100'19","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.059596+0000","last_change":"2024-05-08T18:29:46.603563+0000","last_active":"2024-05-08T18:32:46.059596+0000","last_peered":"2024-05-08T18:32:46.059596+0000","last_clean":"2024-05-08T18:32:46.059596+0000","last_became_active":"2024-05-08T18:29:46.602801+0000","last_became_peered":"2024-05-08T18:29:46.602801+0000","last_unstale":"2024-05-08T18:32:46.059596+0000","last_undegraded":"2024-05-08T18:32:46.059596+0000","last_fullsized":"2024-05-08T18:32:46.059596+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:22:36.338527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":17,"num_write":20,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863847+0000","last_change":"2024-05-08T18:29:48.642806+0000","last_active":"2024-05-08T18:32:46.863847+0000","last_peered":"2024-05-08T18:32:46.863847+0000","last_clean":"2024-05-08T18:32:46.863847+0000","last_became_active":"2024-05-08T18:29:48.641813+0000","last_became_peered":"2024-05-08T18:29:48.641813+0000","last_unstale":"2024-05-08T18:32:46.863847+0000","last_undegraded":"2024-05-08T18:32:46.863847+0000","last_fullsized":"2024-05-08T18:32:46.863847+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:50:48.169666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"80'2","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.062631+0000","last_change":"2024-05-08T18:29:50.689819+0000","last_active":"2024-05-08T18:32:46.062631+0000","last_peered":"2024-05-08T18:32:46.062631+0000","last_clean":"2024-05-08T18:32:46.062631+0000","last_became_active":"2024-05-08T18:29:50.686739+0000","last_became_peered":"2024-05-08T18:29:50.686739+0000","last_unstale":"2024-05-08T18:32:46.062631+0000","last_undegraded":"2024-05-08T18:32:46.062631+0000","last_fullsized":"2024-05-08T18:32:46.062631+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:45:34.171402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.060014+0000","last_change":"2024-05-08T18:29:42.552388+0000","last_active":"2024-05-08T18:32:46.060014+0000","last_peered":"2024-05-08T18:32:46.060014+0000","last_clean":"2024-05-08T18:32:46.060014+0000","last_became_active":"2024-05-08T18:29:42.551647+0000","last_became_peered":"2024-05-08T18:29:42.551647+0000","last_unstale":"2024-05-08T18:32:46.060014+0000","last_undegraded":"2024-05-08T18:32:46.060014+0000","last_fullsized":"2024-05-08T18:32:46.060014+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:55.055481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"93'8","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.849557+0000","last_change":"2024-05-08T18:29:40.562946+0000","last_active":"2024-05-08T18:32:46.849557+0000","last_peered":"2024-05-08T18:32:46.849557+0000","last_clean":"2024-05-08T18:32:46.849557+0000","last_became_active":"2024-05-08T18:29:40.550942+0000","last_became_peered":"2024-05-08T18:29:40.550942+0000","last_unstale":"2024-05-08T18:32:46.849557+0000","last_undegraded":"2024-05-08T18:32:46.849557+0000","last_fullsized":"2024-05-08T18:32:46.849557+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:22.579629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.918001+0000","last_change":"2024-05-08T18:29:44.593681+0000","last_active":"2024-05-08T18:32:46.918001+0000","last_peered":"2024-05-08T18:32:46.918001+0000","last_clean":"2024-05-08T18:32:46.918001+0000","last_became_active":"2024-05-08T18:29:44.593242+0000","last_became_peered":"2024-05-08T18:29:44.593242+0000","last_unstale":"2024-05-08T18:32:46.918001+0000","last_undegraded":"2024-05-08T18:32:46.918001+0000","last_fullsized":"2024-05-08T18:32:46.918001+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:57.093364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"97'22","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.064038+0000","last_change":"2024-05-08T18:29:46.589514+0000","last_active":"2024-05-08T18:32:46.064038+0000","last_peered":"2024-05-08T18:32:46.064038+0000","last_clean":"2024-05-08T18:32:46.064038+0000","last_became_active":"2024-05-08T18:29:46.588784+0000","last_became_peered":"2024-05-08T18:29:46.588784+0000","last_unstale":"2024-05-08T18:32:46.064038+0000","last_undegraded":"2024-05-08T18:32:46.064038+0000","last_fullsized":"2024-05-08T18:32:46.064038+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:02:30.355168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":20,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"116'102","reported_seq":338,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:49.831491+0000","last_change":"2024-05-08T18:29:48.631007+0000","last_active":"2024-05-08T18:32:49.831491+0000","last_peered":"2024-05-08T18:32:49.831491+0000","last_clean":"2024-05-08T18:32:49.831491+0000","last_became_active":"2024-05-08T18:29:48.630229+0000","last_became_peered":"2024-05-08T18:29:48.630229+0000","last_unstale":"2024-05-08T18:32:49.831491+0000","last_undegraded":"2024-05-08T18:32:49.831491+0000","last_fullsized":"2024-05-08T18:32:49.831491+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:44:03.778419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.917498+0000","last_change":"2024-05-08T18:29:50.675105+0000","last_active":"2024-05-08T18:32:46.917498+0000","last_peered":"2024-05-08T18:32:46.917498+0000","last_clean":"2024-05-08T18:32:46.917498+0000","last_became_active":"2024-05-08T18:29:50.674292+0000","last_became_peered":"2024-05-08T18:29:50.674292+0000","last_unstale":"2024-05-08T18:32:46.917498+0000","last_undegraded":"2024-05-08T18:32:46.917498+0000","last_fullsized":"2024-05-08T18:32:46.917498+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:47:15.423647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"84'4","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.060239+0000","last_change":"2024-05-08T18:29:42.579707+0000","last_active":"2024-05-08T18:32:46.060239+0000","last_peered":"2024-05-08T18:32:46.060239+0000","last_clean":"2024-05-08T18:32:46.060239+0000","last_became_active":"2024-05-08T18:29:42.579059+0000","last_became_peered":"2024-05-08T18:29:42.579059+0000","last_unstale":"2024-05-08T18:32:46.060239+0000","last_undegraded":"2024-05-08T18:32:46.060239+0000","last_fullsized":"2024-05-08T18:32:46.060239+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:09.787597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"93'9","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.058163+0000","last_change":"2024-05-08T18:29:40.555327+0000","last_active":"2024-05-08T18:32:46.058163+0000","last_peered":"2024-05-08T18:32:46.058163+0000","last_clean":"2024-05-08T18:32:46.058163+0000","last_became_active":"2024-05-08T18:29:40.554594+0000","last_became_peered":"2024-05-08T18:29:40.554594+0000","last_unstale":"2024-05-08T18:32:46.058163+0000","last_undegraded":"2024-05-08T18:32:46.058163+0000","last_fullsized":"2024-05-08T18:32:46.058163+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:19.841114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":3,"num_read_kb":4,"num_write":19,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"26'2","reported_seq":324,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.079838+0000","last_change":"2024-05-08T18:29:44.582434+0000","last_active":"2024-05-08T18:32:47.079838+0000","last_peered":"2024-05-08T18:32:47.079838+0000","last_clean":"2024-05-08T18:32:47.079838+0000","last_became_active":"2024-05-08T18:29:44.581699+0000","last_became_peered":"2024-05-08T18:29:44.581699+0000","last_unstale":"2024-05-08T18:32:47.079838+0000","last_undegraded":"2024-05-08T18:32:47.079838+0000","last_fullsized":"2024-05-08T18:32:47.079838+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:19:29.113643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":134,"num_read_kb":134,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"33'10","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.065642+0000","last_change":"2024-05-08T18:29:46.590860+0000","last_active":"2024-05-08T18:32:46.065642+0000","last_peered":"2024-05-08T18:32:46.065642+0000","last_clean":"2024-05-08T18:32:46.065642+0000","last_became_active":"2024-05-08T18:29:46.590087+0000","last_became_peered":"2024-05-08T18:29:46.590087+0000","last_unstale":"2024-05-08T18:32:46.065642+0000","last_undegraded":"2024-05-08T18:32:46.065642+0000","last_fullsized":"2024-05-08T18:32:46.065642+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:19:58.358449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"116'102","reported_seq":362,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:49.831331+0000","last_change":"2024-05-08T18:29:48.635548+0000","last_active":"2024-05-08T18:32:49.831331+0000","last_peered":"2024-05-08T18:32:49.831331+0000","last_clean":"2024-05-08T18:32:49.831331+0000","last_became_active":"2024-05-08T18:29:48.634801+0000","last_became_peered":"2024-05-08T18:29:48.634801+0000","last_unstale":"2024-05-08T18:32:49.831331+0000","last_undegraded":"2024-05-08T18:32:49.831331+0000","last_fullsized":"2024-05-08T18:32:49.831331+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:04:20.128031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.058516+0000","last_change":"2024-05-08T18:29:50.668279+0000","last_active":"2024-05-08T18:32:46.058516+0000","last_peered":"2024-05-08T18:32:46.058516+0000","last_clean":"2024-05-08T18:32:46.058516+0000","last_became_active":"2024-05-08T18:29:50.667536+0000","last_became_peered":"2024-05-08T18:29:50.667536+0000","last_unstale":"2024-05-08T18:32:46.058516+0000","last_undegraded":"2024-05-08T18:32:46.058516+0000","last_fullsized":"2024-05-08T18:32:46.058516+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:12:05.780786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"97'14","reported_seq":224,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.916133+0000","last_change":"2024-05-08T18:29:42.563807+0000","last_active":"2024-05-08T18:32:46.916133+0000","last_peered":"2024-05-08T18:32:46.916133+0000","last_clean":"2024-05-08T18:32:46.916133+0000","last_became_active":"2024-05-08T18:29:42.563416+0000","last_became_peered":"2024-05-08T18:29:42.563416+0000","last_unstale":"2024-05-08T18:32:46.916133+0000","last_undegraded":"2024-05-08T18:32:46.916133+0000","last_fullsized":"2024-05-08T18:32:46.916133+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:18:10.803989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"93'12","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.064387+0000","last_change":"2024-05-08T18:29:40.548898+0000","last_active":"2024-05-08T18:32:46.064387+0000","last_peered":"2024-05-08T18:32:46.064387+0000","last_clean":"2024-05-08T18:32:46.064387+0000","last_became_active":"2024-05-08T18:29:40.548591+0000","last_became_peered":"2024-05-08T18:29:40.548591+0000","last_unstale":"2024-05-08T18:32:46.064387+0000","last_undegraded":"2024-05-08T18:32:46.064387+0000","last_fullsized":"2024-05-08T18:32:46.064387+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:27:41.414153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.059932+0000","last_change":"2024-05-08T18:29:44.582578+0000","last_active":"2024-05-08T18:32:46.059932+0000","last_peered":"2024-05-08T18:32:46.059932+0000","last_clean":"2024-05-08T18:32:46.059932+0000","last_became_active":"2024-05-08T18:29:44.581832+0000","last_became_peered":"2024-05-08T18:29:44.581832+0000","last_unstale":"2024-05-08T18:32:46.059932+0000","last_undegraded":"2024-05-08T18:32:46.059932+0000","last_fullsized":"2024-05-08T18:32:46.059932+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:52:25.736491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"97'23","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.079413+0000","last_change":"2024-05-08T18:29:46.602459+0000","last_active":"2024-05-08T18:32:47.079413+0000","last_peered":"2024-05-08T18:32:47.079413+0000","last_clean":"2024-05-08T18:32:47.079413+0000","last_became_active":"2024-05-08T18:29:46.601740+0000","last_became_peered":"2024-05-08T18:29:46.601740+0000","last_unstale":"2024-05-08T18:32:47.079413+0000","last_undegraded":"2024-05-08T18:32:47.079413+0000","last_fullsized":"2024-05-08T18:32:47.079413+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:58:31.293922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.849235+0000","last_change":"2024-05-08T18:29:48.640046+0000","last_active":"2024-05-08T18:32:46.849235+0000","last_peered":"2024-05-08T18:32:46.849235+0000","last_clean":"2024-05-08T18:32:46.849235+0000","last_became_active":"2024-05-08T18:29:48.639309+0000","last_became_peered":"2024-05-08T18:29:48.639309+0000","last_unstale":"2024-05-08T18:32:46.849235+0000","last_undegraded":"2024-05-08T18:32:46.849235+0000","last_fullsized":"2024-05-08T18:32:46.849235+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:10.533065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.917024+0000","last_change":"2024-05-08T18:29:50.668361+0000","last_active":"2024-05-08T18:32:46.917024+0000","last_peered":"2024-05-08T18:32:46.917024+0000","last_clean":"2024-05-08T18:32:46.917024+0000","last_became_active":"2024-05-08T18:29:50.667636+0000","last_became_peered":"2024-05-08T18:29:50.667636+0000","last_unstale":"2024-05-08T18:32:46.917024+0000","last_undegraded":"2024-05-08T18:32:46.917024+0000","last_fullsized":"2024-05-08T18:32:46.917024+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:58:35.356885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"97'4","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.847440+0000","last_change":"2024-05-08T18:29:42.584098+0000","last_active":"2024-05-08T18:32:46.847440+0000","last_peered":"2024-05-08T18:32:46.847440+0000","last_clean":"2024-05-08T18:32:46.847440+0000","last_became_active":"2024-05-08T18:29:42.583639+0000","last_became_peered":"2024-05-08T18:29:42.583639+0000","last_unstale":"2024-05-08T18:32:46.847440+0000","last_undegraded":"2024-05-08T18:32:46.847440+0000","last_fullsized":"2024-05-08T18:32:46.847440+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:08:15.026467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":296,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.936422+0000","last_change":"2024-05-08T18:29:27.115522+0000","last_active":"2024-05-08T18:32:46.936422+0000","last_peered":"2024-05-08T18:32:46.936422+0000","last_clean":"2024-05-08T18:32:46.936422+0000","last_became_active":"2024-05-08T18:29:27.112960+0000","last_became_peered":"2024-05-08T18:29:27.112960+0000","last_unstale":"2024-05-08T18:32:46.936422+0000","last_undegraded":"2024-05-08T18:32:46.936422+0000","last_fullsized":"2024-05-08T18:32:46.936422+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:26.091102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:26.091102+0000","last_clean_scrub_stamp":"2024-05-08T18:29:26.091102+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:09:50.296961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.077723+0000","last_change":"2024-05-08T18:29:34.496467+0000","last_active":"2024-05-08T18:32:47.077723+0000","last_peered":"2024-05-08T18:32:47.077723+0000","last_clean":"2024-05-08T18:32:47.077723+0000","last_became_active":"2024-05-08T18:29:34.495632+0000","last_became_peered":"2024-05-08T18:29:34.495632+0000","last_unstale":"2024-05-08T18:32:47.077723+0000","last_undegraded":"2024-05-08T18:32:47.077723+0000","last_fullsized":"2024-05-08T18:32:47.077723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:35.917391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"93'5","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.065505+0000","last_change":"2024-05-08T18:30:20.849562+0000","last_active":"2024-05-08T18:32:46.065505+0000","last_peered":"2024-05-08T18:32:46.065505+0000","last_clean":"2024-05-08T18:32:46.065505+0000","last_became_active":"2024-05-08T18:30:20.849160+0000","last_became_peered":"2024-05-08T18:30:20.849160+0000","last_unstale":"2024-05-08T18:32:46.065505+0000","last_undegraded":"2024-05-08T18:32:46.065505+0000","last_fullsized":"2024-05-08T18:32:46.065505+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:29:13.478886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.937166+0000","last_change":"2024-05-08T18:29:44.592445+0000","last_active":"2024-05-08T18:32:46.937166+0000","last_peered":"2024-05-08T18:32:46.937166+0000","last_clean":"2024-05-08T18:32:46.937166+0000","last_became_active":"2024-05-08T18:29:44.587855+0000","last_became_peered":"2024-05-08T18:29:44.587855+0000","last_unstale":"2024-05-08T18:32:46.937166+0000","last_undegraded":"2024-05-08T18:32:46.937166+0000","last_fullsized":"2024-05-08T18:32:46.937166+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:06:05.355648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"97'33","reported_seq":231,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.080401+0000","last_change":"2024-05-08T18:29:46.595394+0000","last_active":"2024-05-08T18:32:47.080401+0000","last_peered":"2024-05-08T18:32:47.080401+0000","last_clean":"2024-05-08T18:32:47.080401+0000","last_became_active":"2024-05-08T18:29:46.594573+0000","last_became_peered":"2024-05-08T18:29:46.594573+0000","last_unstale":"2024-05-08T18:32:47.080401+0000","last_undegraded":"2024-05-08T18:32:47.080401+0000","last_fullsized":"2024-05-08T18:32:47.080401+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:47:11.360684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71557,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":23,"num_write":20,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863388+0000","last_change":"2024-05-08T18:29:48.632178+0000","last_active":"2024-05-08T18:32:46.863388+0000","last_peered":"2024-05-08T18:32:46.863388+0000","last_clean":"2024-05-08T18:32:46.863388+0000","last_became_active":"2024-05-08T18:29:48.631481+0000","last_became_peered":"2024-05-08T18:29:48.631481+0000","last_unstale":"2024-05-08T18:32:46.863388+0000","last_undegraded":"2024-05-08T18:32:46.863388+0000","last_fullsized":"2024-05-08T18:32:46.863388+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:34.806539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"80'2","reported_seq":176,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.848444+0000","last_change":"2024-05-08T18:29:50.675319+0000","last_active":"2024-05-08T18:32:46.848444+0000","last_peered":"2024-05-08T18:32:46.848444+0000","last_clean":"2024-05-08T18:32:46.848444+0000","last_became_active":"2024-05-08T18:29:50.674526+0000","last_became_peered":"2024-05-08T18:29:50.674526+0000","last_unstale":"2024-05-08T18:32:46.848444+0000","last_undegraded":"2024-05-08T18:32:46.848444+0000","last_fullsized":"2024-05-08T18:32:46.848444+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:59:06.404586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"84'4","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863527+0000","last_change":"2024-05-08T18:29:42.568584+0000","last_active":"2024-05-08T18:32:46.863527+0000","last_peered":"2024-05-08T18:32:46.863527+0000","last_clean":"2024-05-08T18:32:46.863527+0000","last_became_active":"2024-05-08T18:29:42.568244+0000","last_became_peered":"2024-05-08T18:29:42.568244+0000","last_unstale":"2024-05-08T18:32:46.863527+0000","last_undegraded":"2024-05-08T18:32:46.863527+0000","last_fullsized":"2024-05-08T18:32:46.863527+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:20.397730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.935976+0000","last_change":"2024-05-08T18:29:34.497654+0000","last_active":"2024-05-08T18:32:46.935976+0000","last_peered":"2024-05-08T18:32:46.935976+0000","last_clean":"2024-05-08T18:32:46.935976+0000","last_became_active":"2024-05-08T18:29:34.495812+0000","last_became_peered":"2024-05-08T18:29:34.495812+0000","last_unstale":"2024-05-08T18:32:46.935976+0000","last_undegraded":"2024-05-08T18:32:46.935976+0000","last_fullsized":"2024-05-08T18:32:46.935976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:37:02.202613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"93'7","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.862540+0000","last_change":"2024-05-08T18:29:40.560653+0000","last_active":"2024-05-08T18:32:46.862540+0000","last_peered":"2024-05-08T18:32:46.862540+0000","last_clean":"2024-05-08T18:32:46.862540+0000","last_became_active":"2024-05-08T18:29:40.560296+0000","last_became_peered":"2024-05-08T18:29:40.560296+0000","last_unstale":"2024-05-08T18:32:46.862540+0000","last_undegraded":"2024-05-08T18:32:46.862540+0000","last_fullsized":"2024-05-08T18:32:46.862540+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:52.462279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.080676+0000","last_change":"2024-05-08T18:29:44.594681+0000","last_active":"2024-05-08T18:32:47.080676+0000","last_peered":"2024-05-08T18:32:47.080676+0000","last_clean":"2024-05-08T18:32:47.080676+0000","last_became_active":"2024-05-08T18:29:44.593917+0000","last_became_peered":"2024-05-08T18:29:44.593917+0000","last_unstale":"2024-05-08T18:32:47.080676+0000","last_undegraded":"2024-05-08T18:32:47.080676+0000","last_fullsized":"2024-05-08T18:32:47.080676+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:59:00.335437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"116'109","reported_seq":384,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:49.831439+0000","last_change":"2024-05-08T18:29:46.599932+0000","last_active":"2024-05-08T18:32:49.831439+0000","last_peered":"2024-05-08T18:32:49.831439+0000","last_clean":"2024-05-08T18:32:49.831439+0000","last_became_active":"2024-05-08T18:29:46.594789+0000","last_became_peered":"2024-05-08T18:29:46.594789+0000","last_unstale":"2024-05-08T18:32:49.831439+0000","last_undegraded":"2024-05-08T18:32:49.831439+0000","last_fullsized":"2024-05-08T18:32:49.831439+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:04:18.099848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9947,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":143,"num_read_kb":128,"num_write":28,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.937370+0000","last_change":"2024-05-08T18:29:48.634661+0000","last_active":"2024-05-08T18:32:46.937370+0000","last_peered":"2024-05-08T18:32:46.937370+0000","last_clean":"2024-05-08T18:32:46.937370+0000","last_became_active":"2024-05-08T18:29:48.634044+0000","last_became_peered":"2024-05-08T18:29:48.634044+0000","last_unstale":"2024-05-08T18:32:46.937370+0000","last_undegraded":"2024-05-08T18:32:46.937370+0000","last_fullsized":"2024-05-08T18:32:46.937370+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:01:46.238076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.916916+0000","last_change":"2024-05-08T18:29:50.676536+0000","last_active":"2024-05-08T18:32:46.916916+0000","last_peered":"2024-05-08T18:32:46.916916+0000","last_clean":"2024-05-08T18:32:46.916916+0000","last_became_active":"2024-05-08T18:29:50.675770+0000","last_became_peered":"2024-05-08T18:29:50.675770+0000","last_unstale":"2024-05-08T18:32:46.916916+0000","last_undegraded":"2024-05-08T18:32:46.916916+0000","last_fullsized":"2024-05-08T18:32:46.916916+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:28.003482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.919578+0000","last_change":"2024-05-08T18:29:42.575253+0000","last_active":"2024-05-08T18:32:46.919578+0000","last_peered":"2024-05-08T18:32:46.919578+0000","last_clean":"2024-05-08T18:32:46.919578+0000","last_became_active":"2024-05-08T18:29:42.573621+0000","last_became_peered":"2024-05-08T18:29:42.573621+0000","last_unstale":"2024-05-08T18:32:46.919578+0000","last_undegraded":"2024-05-08T18:32:46.919578+0000","last_fullsized":"2024-05-08T18:32:46.919578+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:59.243324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.060706+0000","last_change":"2024-05-08T18:29:34.491071+0000","last_active":"2024-05-08T18:32:46.060706+0000","last_peered":"2024-05-08T18:32:46.060706+0000","last_clean":"2024-05-08T18:32:46.060706+0000","last_became_active":"2024-05-08T18:29:34.490717+0000","last_became_peered":"2024-05-08T18:29:34.490717+0000","last_unstale":"2024-05-08T18:32:46.060706+0000","last_undegraded":"2024-05-08T18:32:46.060706+0000","last_fullsized":"2024-05-08T18:32:46.060706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:55.793312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"93'12","reported_seq":211,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.916751+0000","last_change":"2024-05-08T18:29:40.530634+0000","last_active":"2024-05-08T18:32:46.916751+0000","last_peered":"2024-05-08T18:32:46.916751+0000","last_clean":"2024-05-08T18:32:46.916751+0000","last_became_active":"2024-05-08T18:29:40.529804+0000","last_became_peered":"2024-05-08T18:29:40.529804+0000","last_unstale":"2024-05-08T18:32:46.916751+0000","last_undegraded":"2024-05-08T18:32:46.916751+0000","last_fullsized":"2024-05-08T18:32:46.916751+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:59:25.840149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"26'1","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.064037+0000","last_change":"2024-05-08T18:29:44.584678+0000","last_active":"2024-05-08T18:32:46.064037+0000","last_peered":"2024-05-08T18:32:46.064037+0000","last_clean":"2024-05-08T18:32:46.064037+0000","last_became_active":"2024-05-08T18:29:44.584227+0000","last_became_peered":"2024-05-08T18:29:44.584227+0000","last_unstale":"2024-05-08T18:32:46.064037+0000","last_undegraded":"2024-05-08T18:32:46.064037+0000","last_fullsized":"2024-05-08T18:32:46.064037+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:04:01.281207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"116'16","reported_seq":241,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:49.831341+0000","last_change":"2024-05-08T18:29:46.608720+0000","last_active":"2024-05-08T18:32:49.831341+0000","last_peered":"2024-05-08T18:32:49.831341+0000","last_clean":"2024-05-08T18:32:49.831341+0000","last_became_active":"2024-05-08T18:29:46.607989+0000","last_became_peered":"2024-05-08T18:29:46.607989+0000","last_unstale":"2024-05-08T18:32:49.831341+0000","last_undegraded":"2024-05-08T18:32:49.831341+0000","last_fullsized":"2024-05-08T18:32:49.831341+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:58:31.293922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863028+0000","last_change":"2024-05-08T18:29:48.625269+0000","last_active":"2024-05-08T18:32:46.863028+0000","last_peered":"2024-05-08T18:32:46.863028+0000","last_clean":"2024-05-08T18:32:46.863028+0000","last_became_active":"2024-05-08T18:29:48.624545+0000","last_became_peered":"2024-05-08T18:29:48.624545+0000","last_unstale":"2024-05-08T18:32:46.863028+0000","last_undegraded":"2024-05-08T18:32:46.863028+0000","last_fullsized":"2024-05-08T18:32:46.863028+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:16:42.799734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"84'12","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.063889+0000","last_change":"2024-05-08T18:29:50.688851+0000","last_active":"2024-05-08T18:32:46.063889+0000","last_peered":"2024-05-08T18:32:46.063889+0000","last_clean":"2024-05-08T18:32:46.063889+0000","last_became_active":"2024-05-08T18:29:50.687978+0000","last_became_peered":"2024-05-08T18:29:50.687978+0000","last_unstale":"2024-05-08T18:32:46.063889+0000","last_undegraded":"2024-05-08T18:32:46.063889+0000","last_fullsized":"2024-05-08T18:32:46.063889+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:28:29.836446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":42,"num_write":31,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"84'4","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.918158+0000","last_change":"2024-05-08T18:31:22.008678+0000","last_active":"2024-05-08T18:32:46.918158+0000","last_peered":"2024-05-08T18:32:46.918158+0000","last_clean":"2024-05-08T18:32:46.918158+0000","last_became_active":"2024-05-08T18:31:22.008342+0000","last_became_peered":"2024-05-08T18:31:22.008342+0000","last_unstale":"2024-05-08T18:32:46.918158+0000","last_undegraded":"2024-05-08T18:32:46.918158+0000","last_fullsized":"2024-05-08T18:32:46.918158+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:40:30.531379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.079379+0000","last_change":"2024-05-08T18:29:34.496942+0000","last_active":"2024-05-08T18:32:47.079379+0000","last_peered":"2024-05-08T18:32:47.079379+0000","last_clean":"2024-05-08T18:32:47.079379+0000","last_became_active":"2024-05-08T18:29:34.495882+0000","last_became_peered":"2024-05-08T18:29:34.495882+0000","last_unstale":"2024-05-08T18:32:47.079379+0000","last_undegraded":"2024-05-08T18:32:47.079379+0000","last_fullsized":"2024-05-08T18:32:47.079379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:55.793312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"93'8","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.059323+0000","last_change":"2024-05-08T18:29:40.554353+0000","last_active":"2024-05-08T18:32:46.059323+0000","last_peered":"2024-05-08T18:32:46.059323+0000","last_clean":"2024-05-08T18:32:46.059323+0000","last_became_active":"2024-05-08T18:29:40.553527+0000","last_became_peered":"2024-05-08T18:29:40.553527+0000","last_unstale":"2024-05-08T18:32:46.059323+0000","last_undegraded":"2024-05-08T18:32:46.059323+0000","last_fullsized":"2024-05-08T18:32:46.059323+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:03:42.148647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":189,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863485+0000","last_change":"2024-05-08T18:29:44.597411+0000","last_active":"2024-05-08T18:32:46.863485+0000","last_peered":"2024-05-08T18:32:46.863485+0000","last_clean":"2024-05-08T18:32:46.863485+0000","last_became_active":"2024-05-08T18:29:44.596678+0000","last_became_peered":"2024-05-08T18:29:44.596678+0000","last_unstale":"2024-05-08T18:32:46.863485+0000","last_undegraded":"2024-05-08T18:32:46.863485+0000","last_fullsized":"2024-05-08T18:32:46.863485+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:37:23.674968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"97'13","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.066095+0000","last_change":"2024-05-08T18:29:46.607040+0000","last_active":"2024-05-08T18:32:46.066095+0000","last_peered":"2024-05-08T18:32:46.066095+0000","last_clean":"2024-05-08T18:32:46.066095+0000","last_became_active":"2024-05-08T18:29:46.606367+0000","last_became_peered":"2024-05-08T18:29:46.606367+0000","last_unstale":"2024-05-08T18:32:46.066095+0000","last_undegraded":"2024-05-08T18:32:46.066095+0000","last_fullsized":"2024-05-08T18:32:46.066095+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:59:26.650126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.850025+0000","last_change":"2024-05-08T18:29:48.632665+0000","last_active":"2024-05-08T18:32:46.850025+0000","last_peered":"2024-05-08T18:32:46.850025+0000","last_clean":"2024-05-08T18:32:46.850025+0000","last_became_active":"2024-05-08T18:29:48.631874+0000","last_became_peered":"2024-05-08T18:29:48.631874+0000","last_unstale":"2024-05-08T18:32:46.850025+0000","last_undegraded":"2024-05-08T18:32:46.850025+0000","last_fullsized":"2024-05-08T18:32:46.850025+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:06:09.390017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":176,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.078092+0000","last_change":"2024-05-08T18:29:50.683443+0000","last_active":"2024-05-08T18:32:47.078092+0000","last_peered":"2024-05-08T18:32:47.078092+0000","last_clean":"2024-05-08T18:32:47.078092+0000","last_became_active":"2024-05-08T18:29:50.682634+0000","last_became_peered":"2024-05-08T18:29:50.682634+0000","last_unstale":"2024-05-08T18:32:47.078092+0000","last_undegraded":"2024-05-08T18:32:47.078092+0000","last_fullsized":"2024-05-08T18:32:47.078092+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:10:38.951662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"80'2","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.917272+0000","last_change":"2024-05-08T18:29:42.574593+0000","last_active":"2024-05-08T18:32:46.917272+0000","last_peered":"2024-05-08T18:32:46.917272+0000","last_clean":"2024-05-08T18:32:46.917272+0000","last_became_active":"2024-05-08T18:29:42.574288+0000","last_became_peered":"2024-05-08T18:29:42.574288+0000","last_unstale":"2024-05-08T18:32:46.917272+0000","last_undegraded":"2024-05-08T18:32:46.917272+0000","last_fullsized":"2024-05-08T18:32:46.917272+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:58.320701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"93'11","reported_seq":158,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.063035+0000","last_change":"2024-05-08T18:30:20.850805+0000","last_active":"2024-05-08T18:32:46.063035+0000","last_peered":"2024-05-08T18:32:46.063035+0000","last_clean":"2024-05-08T18:32:46.063035+0000","last_became_active":"2024-05-08T18:30:20.850365+0000","last_became_peered":"2024-05-08T18:30:20.850365+0000","last_unstale":"2024-05-08T18:32:46.063035+0000","last_undegraded":"2024-05-08T18:32:46.063035+0000","last_fullsized":"2024-05-08T18:32:46.063035+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:52:21.678894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.918404+0000","last_change":"2024-05-08T18:29:34.606393+0000","last_active":"2024-05-08T18:32:46.918404+0000","last_peered":"2024-05-08T18:32:46.918404+0000","last_clean":"2024-05-08T18:32:46.918404+0000","last_became_active":"2024-05-08T18:29:34.605574+0000","last_became_peered":"2024-05-08T18:29:34.605574+0000","last_unstale":"2024-05-08T18:32:46.918404+0000","last_undegraded":"2024-05-08T18:32:46.918404+0000","last_fullsized":"2024-05-08T18:32:46.918404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:55.793312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":189,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.862948+0000","last_change":"2024-05-08T18:29:44.595127+0000","last_active":"2024-05-08T18:32:46.862948+0000","last_peered":"2024-05-08T18:32:46.862948+0000","last_clean":"2024-05-08T18:32:46.862948+0000","last_became_active":"2024-05-08T18:29:44.594642+0000","last_became_peered":"2024-05-08T18:29:44.594642+0000","last_unstale":"2024-05-08T18:32:46.862948+0000","last_undegraded":"2024-05-08T18:32:46.862948+0000","last_fullsized":"2024-05-08T18:32:46.862948+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:04:49.020450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"97'32","reported_seq":231,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.862122+0000","last_change":"2024-05-08T18:29:46.602279+0000","last_active":"2024-05-08T18:32:46.862122+0000","last_peered":"2024-05-08T18:32:46.862122+0000","last_clean":"2024-05-08T18:32:46.862122+0000","last_became_active":"2024-05-08T18:29:46.599707+0000","last_became_peered":"2024-05-08T18:29:46.599707+0000","last_unstale":"2024-05-08T18:32:46.862122+0000","last_undegraded":"2024-05-08T18:32:46.862122+0000","last_fullsized":"2024-05-08T18:32:46.862122+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:54:48.654215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62414,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":24,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.057286+0000","last_change":"2024-05-08T18:29:48.639458+0000","last_active":"2024-05-08T18:32:46.057286+0000","last_peered":"2024-05-08T18:32:46.057286+0000","last_clean":"2024-05-08T18:32:46.057286+0000","last_became_active":"2024-05-08T18:29:48.638709+0000","last_became_peered":"2024-05-08T18:29:48.638709+0000","last_unstale":"2024-05-08T18:32:46.057286+0000","last_undegraded":"2024-05-08T18:32:46.057286+0000","last_fullsized":"2024-05-08T18:32:46.057286+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:19:58.182291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"97'6","reported_seq":189,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.861327+0000","last_change":"2024-05-08T18:29:50.681077+0000","last_active":"2024-05-08T18:32:46.861327+0000","last_peered":"2024-05-08T18:32:46.861327+0000","last_clean":"2024-05-08T18:32:46.861327+0000","last_became_active":"2024-05-08T18:29:50.675766+0000","last_became_peered":"2024-05-08T18:29:50.675766+0000","last_unstale":"2024-05-08T18:32:46.861327+0000","last_undegraded":"2024-05-08T18:32:46.861327+0000","last_fullsized":"2024-05-08T18:32:46.861327+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:09:29.641515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"80'2","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863332+0000","last_change":"2024-05-08T18:29:42.571265+0000","last_active":"2024-05-08T18:32:46.863332+0000","last_peered":"2024-05-08T18:32:46.863332+0000","last_clean":"2024-05-08T18:32:46.863332+0000","last_became_active":"2024-05-08T18:29:42.570645+0000","last_became_peered":"2024-05-08T18:29:42.570645+0000","last_unstale":"2024-05-08T18:32:46.863332+0000","last_undegraded":"2024-05-08T18:32:46.863332+0000","last_fullsized":"2024-05-08T18:32:46.863332+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:30:29.452640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"93'3","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.918243+0000","last_change":"2024-05-08T18:29:40.531079+0000","last_active":"2024-05-08T18:32:46.918243+0000","last_peered":"2024-05-08T18:32:46.918243+0000","last_clean":"2024-05-08T18:32:46.918243+0000","last_became_active":"2024-05-08T18:29:40.530256+0000","last_became_peered":"2024-05-08T18:29:40.530256+0000","last_unstale":"2024-05-08T18:32:46.918243+0000","last_undegraded":"2024-05-08T18:32:46.918243+0000","last_fullsized":"2024-05-08T18:32:46.918243+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:09:42.581976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.938519+0000","last_change":"2024-05-08T18:29:34.603292+0000","last_active":"2024-05-08T18:32:46.938519+0000","last_peered":"2024-05-08T18:32:46.938519+0000","last_clean":"2024-05-08T18:32:46.938519+0000","last_became_active":"2024-05-08T18:29:34.602547+0000","last_became_peered":"2024-05-08T18:29:34.602547+0000","last_unstale":"2024-05-08T18:32:46.938519+0000","last_undegraded":"2024-05-08T18:32:46.938519+0000","last_fullsized":"2024-05-08T18:32:46.938519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:24:55.555475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.849004+0000","last_change":"2024-05-08T18:29:44.593275+0000","last_active":"2024-05-08T18:32:46.849004+0000","last_peered":"2024-05-08T18:32:46.849004+0000","last_clean":"2024-05-08T18:32:46.849004+0000","last_became_active":"2024-05-08T18:29:44.591870+0000","last_became_peered":"2024-05-08T18:29:44.591870+0000","last_unstale":"2024-05-08T18:32:46.849004+0000","last_undegraded":"2024-05-08T18:32:46.849004+0000","last_fullsized":"2024-05-08T18:32:46.849004+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:35.176971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"33'14","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.917202+0000","last_change":"2024-05-08T18:29:46.603499+0000","last_active":"2024-05-08T18:32:46.917202+0000","last_peered":"2024-05-08T18:32:46.917202+0000","last_clean":"2024-05-08T18:32:46.917202+0000","last_became_active":"2024-05-08T18:29:46.602920+0000","last_became_peered":"2024-05-08T18:29:46.602920+0000","last_unstale":"2024-05-08T18:32:46.917202+0000","last_undegraded":"2024-05-08T18:32:46.917202+0000","last_fullsized":"2024-05-08T18:32:46.917202+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:08.504882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"116'102","reported_seq":331,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:49.831864+0000","last_change":"2024-05-08T18:29:48.634915+0000","last_active":"2024-05-08T18:32:49.831864+0000","last_peered":"2024-05-08T18:32:49.831864+0000","last_clean":"2024-05-08T18:32:49.831864+0000","last_became_active":"2024-05-08T18:29:48.634280+0000","last_became_peered":"2024-05-08T18:29:48.634280+0000","last_unstale":"2024-05-08T18:32:49.831864+0000","last_undegraded":"2024-05-08T18:32:49.831864+0000","last_fullsized":"2024-05-08T18:32:49.831864+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:19:58.182291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"80'2","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.067407+0000","last_change":"2024-05-08T18:29:50.688742+0000","last_active":"2024-05-08T18:32:46.067407+0000","last_peered":"2024-05-08T18:32:46.067407+0000","last_clean":"2024-05-08T18:32:46.067407+0000","last_became_active":"2024-05-08T18:29:50.687135+0000","last_became_peered":"2024-05-08T18:29:50.687135+0000","last_unstale":"2024-05-08T18:32:46.067407+0000","last_undegraded":"2024-05-08T18:32:46.067407+0000","last_fullsized":"2024-05-08T18:32:46.067407+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:12:49.040807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"80'2","reported_seq":152,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.059948+0000","last_change":"2024-05-08T18:30:21.220561+0000","last_active":"2024-05-08T18:32:46.059948+0000","last_peered":"2024-05-08T18:32:46.059948+0000","last_clean":"2024-05-08T18:32:46.059948+0000","last_became_active":"2024-05-08T18:30:21.220196+0000","last_became_peered":"2024-05-08T18:30:21.220196+0000","last_unstale":"2024-05-08T18:32:46.059948+0000","last_undegraded":"2024-05-08T18:32:46.059948+0000","last_fullsized":"2024-05-08T18:32:46.059948+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:19:27.075761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"83'5","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.066414+0000","last_change":"2024-05-08T18:29:40.565872+0000","last_active":"2024-05-08T18:32:46.066414+0000","last_peered":"2024-05-08T18:32:46.066414+0000","last_clean":"2024-05-08T18:32:46.066414+0000","last_became_active":"2024-05-08T18:29:40.565655+0000","last_became_peered":"2024-05-08T18:29:40.565655+0000","last_unstale":"2024-05-08T18:32:46.066414+0000","last_undegraded":"2024-05-08T18:32:46.066414+0000","last_fullsized":"2024-05-08T18:32:46.066414+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:16:16.521258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.919692+0000","last_change":"2024-05-08T18:29:34.501273+0000","last_active":"2024-05-08T18:32:46.919692+0000","last_peered":"2024-05-08T18:32:46.919692+0000","last_clean":"2024-05-08T18:32:46.919692+0000","last_became_active":"2024-05-08T18:29:34.500933+0000","last_became_peered":"2024-05-08T18:29:34.500933+0000","last_unstale":"2024-05-08T18:32:46.919692+0000","last_undegraded":"2024-05-08T18:32:46.919692+0000","last_fullsized":"2024-05-08T18:32:46.919692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:35.917391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.057534+0000","last_change":"2024-05-08T18:29:44.576227+0000","last_active":"2024-05-08T18:32:46.057534+0000","last_peered":"2024-05-08T18:32:46.057534+0000","last_clean":"2024-05-08T18:32:46.057534+0000","last_became_active":"2024-05-08T18:29:44.575454+0000","last_became_peered":"2024-05-08T18:29:44.575454+0000","last_unstale":"2024-05-08T18:32:46.057534+0000","last_undegraded":"2024-05-08T18:32:46.057534+0000","last_fullsized":"2024-05-08T18:32:46.057534+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:06:05.355648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"80'11","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.058692+0000","last_change":"2024-05-08T18:29:46.609633+0000","last_active":"2024-05-08T18:32:46.058692+0000","last_peered":"2024-05-08T18:32:46.058692+0000","last_clean":"2024-05-08T18:32:46.058692+0000","last_became_active":"2024-05-08T18:29:46.603455+0000","last_became_peered":"2024-05-08T18:29:46.603455+0000","last_unstale":"2024-05-08T18:32:46.058692+0000","last_undegraded":"2024-05-08T18:32:46.058692+0000","last_fullsized":"2024-05-08T18:32:46.058692+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:07:54.654205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"116'102","reported_seq":365,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:49.831065+0000","last_change":"2024-05-08T18:29:48.637898+0000","last_active":"2024-05-08T18:32:49.831065+0000","last_peered":"2024-05-08T18:32:49.831065+0000","last_clean":"2024-05-08T18:32:49.831065+0000","last_became_active":"2024-05-08T18:29:48.637070+0000","last_became_peered":"2024-05-08T18:29:48.637070+0000","last_unstale":"2024-05-08T18:32:49.831065+0000","last_undegraded":"2024-05-08T18:32:49.831065+0000","last_fullsized":"2024-05-08T18:32:49.831065+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:03:46.392864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"84'10","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.861002+0000","last_change":"2024-05-08T18:29:50.691526+0000","last_active":"2024-05-08T18:32:46.861002+0000","last_peered":"2024-05-08T18:32:46.861002+0000","last_clean":"2024-05-08T18:32:46.861002+0000","last_became_active":"2024-05-08T18:29:50.690767+0000","last_became_peered":"2024-05-08T18:29:50.690767+0000","last_unstale":"2024-05-08T18:32:46.861002+0000","last_undegraded":"2024-05-08T18:32:46.861002+0000","last_fullsized":"2024-05-08T18:32:46.861002+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:32:29.972139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"97'16","reported_seq":229,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.057923+0000","last_change":"2024-05-08T18:29:42.562006+0000","last_active":"2024-05-08T18:32:46.057923+0000","last_peered":"2024-05-08T18:32:46.057923+0000","last_clean":"2024-05-08T18:32:46.057923+0000","last_became_active":"2024-05-08T18:29:42.560861+0000","last_became_peered":"2024-05-08T18:29:42.560861+0000","last_unstale":"2024-05-08T18:32:46.057923+0000","last_undegraded":"2024-05-08T18:32:46.057923+0000","last_fullsized":"2024-05-08T18:32:46.057923+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:36.890277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"93'9","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863638+0000","last_change":"2024-05-08T18:29:40.550529+0000","last_active":"2024-05-08T18:32:46.863638+0000","last_peered":"2024-05-08T18:32:46.863638+0000","last_clean":"2024-05-08T18:32:46.863638+0000","last_became_active":"2024-05-08T18:29:40.550241+0000","last_became_peered":"2024-05-08T18:29:40.550241+0000","last_unstale":"2024-05-08T18:32:46.863638+0000","last_undegraded":"2024-05-08T18:32:46.863638+0000","last_fullsized":"2024-05-08T18:32:46.863638+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:48.294532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.850587+0000","last_change":"2024-05-08T18:29:34.493537+0000","last_active":"2024-05-08T18:32:46.850587+0000","last_peered":"2024-05-08T18:32:46.850587+0000","last_clean":"2024-05-08T18:32:46.850587+0000","last_became_active":"2024-05-08T18:29:34.492891+0000","last_became_peered":"2024-05-08T18:29:34.492891+0000","last_unstale":"2024-05-08T18:32:46.850587+0000","last_undegraded":"2024-05-08T18:32:46.850587+0000","last_fullsized":"2024-05-08T18:32:46.850587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:09:07.992256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":189,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.063279+0000","last_change":"2024-05-08T18:29:44.590102+0000","last_active":"2024-05-08T18:32:46.063279+0000","last_peered":"2024-05-08T18:32:46.063279+0000","last_clean":"2024-05-08T18:32:46.063279+0000","last_became_active":"2024-05-08T18:29:44.589471+0000","last_became_peered":"2024-05-08T18:29:44.589471+0000","last_unstale":"2024-05-08T18:32:46.063279+0000","last_undegraded":"2024-05-08T18:32:46.063279+0000","last_fullsized":"2024-05-08T18:32:46.063279+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:14:04.085401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"97'37","reported_seq":236,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.935847+0000","last_change":"2024-05-08T18:29:46.606967+0000","last_active":"2024-05-08T18:32:46.935847+0000","last_peered":"2024-05-08T18:32:46.935847+0000","last_clean":"2024-05-08T18:32:46.935847+0000","last_became_active":"2024-05-08T18:29:46.605693+0000","last_became_peered":"2024-05-08T18:29:46.605693+0000","last_unstale":"2024-05-08T18:32:46.935847+0000","last_undegraded":"2024-05-08T18:32:46.935847+0000","last_fullsized":"2024-05-08T18:32:46.935847+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:24:13.568294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.061836+0000","last_change":"2024-05-08T18:29:48.634271+0000","last_active":"2024-05-08T18:32:46.061836+0000","last_peered":"2024-05-08T18:32:46.061836+0000","last_clean":"2024-05-08T18:32:46.061836+0000","last_became_active":"2024-05-08T18:29:48.633607+0000","last_became_peered":"2024-05-08T18:29:48.633607+0000","last_unstale":"2024-05-08T18:32:46.061836+0000","last_undegraded":"2024-05-08T18:32:46.061836+0000","last_fullsized":"2024-05-08T18:32:46.061836+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:34.806539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":176,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.079442+0000","last_change":"2024-05-08T18:29:50.685494+0000","last_active":"2024-05-08T18:32:47.079442+0000","last_peered":"2024-05-08T18:32:47.079442+0000","last_clean":"2024-05-08T18:32:47.079442+0000","last_became_active":"2024-05-08T18:29:50.684818+0000","last_became_peered":"2024-05-08T18:29:50.684818+0000","last_unstale":"2024-05-08T18:32:47.079442+0000","last_undegraded":"2024-05-08T18:32:47.079442+0000","last_fullsized":"2024-05-08T18:32:47.079442+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:22.220842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863373+0000","last_change":"2024-05-08T18:29:50.682937+0000","last_active":"2024-05-08T18:32:46.863373+0000","last_peered":"2024-05-08T18:32:46.863373+0000","last_clean":"2024-05-08T18:32:46.863373+0000","last_became_active":"2024-05-08T18:29:50.681771+0000","last_became_peered":"2024-05-08T18:29:50.681771+0000","last_unstale":"2024-05-08T18:32:46.863373+0000","last_undegraded":"2024-05-08T18:32:46.863373+0000","last_fullsized":"2024-05-08T18:32:46.863373+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:28:29.836446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"84'4","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.058933+0000","last_change":"2024-05-08T18:29:42.575909+0000","last_active":"2024-05-08T18:32:46.058933+0000","last_peered":"2024-05-08T18:32:46.058933+0000","last_clean":"2024-05-08T18:32:46.058933+0000","last_became_active":"2024-05-08T18:29:42.574877+0000","last_became_peered":"2024-05-08T18:29:42.574877+0000","last_unstale":"2024-05-08T18:32:46.058933+0000","last_undegraded":"2024-05-08T18:32:46.058933+0000","last_fullsized":"2024-05-08T18:32:46.058933+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:33.139089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"93'11","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.059190+0000","last_change":"2024-05-08T18:29:40.566496+0000","last_active":"2024-05-08T18:32:46.059190+0000","last_peered":"2024-05-08T18:32:46.059190+0000","last_clean":"2024-05-08T18:32:46.059190+0000","last_became_active":"2024-05-08T18:29:40.565874+0000","last_became_peered":"2024-05-08T18:29:40.565874+0000","last_unstale":"2024-05-08T18:32:46.059190+0000","last_undegraded":"2024-05-08T18:32:46.059190+0000","last_fullsized":"2024-05-08T18:32:46.059190+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:07.239963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.917412+0000","last_change":"2024-05-08T18:29:44.595410+0000","last_active":"2024-05-08T18:32:46.917412+0000","last_peered":"2024-05-08T18:32:46.917412+0000","last_clean":"2024-05-08T18:32:46.917412+0000","last_became_active":"2024-05-08T18:29:44.594286+0000","last_became_peered":"2024-05-08T18:29:44.594286+0000","last_unstale":"2024-05-08T18:32:46.917412+0000","last_undegraded":"2024-05-08T18:32:46.917412+0000","last_fullsized":"2024-05-08T18:32:46.917412+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:38.928160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"97'18","reported_seq":211,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.064873+0000","last_change":"2024-05-08T18:29:46.591009+0000","last_active":"2024-05-08T18:32:46.064873+0000","last_peered":"2024-05-08T18:32:46.064873+0000","last_clean":"2024-05-08T18:32:46.064873+0000","last_became_active":"2024-05-08T18:29:46.588810+0000","last_became_peered":"2024-05-08T18:29:46.588810+0000","last_unstale":"2024-05-08T18:32:46.064873+0000","last_undegraded":"2024-05-08T18:32:46.064873+0000","last_fullsized":"2024-05-08T18:32:46.064873+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:34:45.745300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.062900+0000","last_change":"2024-05-08T18:29:48.634986+0000","last_active":"2024-05-08T18:32:46.062900+0000","last_peered":"2024-05-08T18:32:46.062900+0000","last_clean":"2024-05-08T18:32:46.062900+0000","last_became_active":"2024-05-08T18:29:48.633866+0000","last_became_peered":"2024-05-08T18:29:48.633866+0000","last_unstale":"2024-05-08T18:32:46.062900+0000","last_undegraded":"2024-05-08T18:32:46.062900+0000","last_fullsized":"2024-05-08T18:32:46.062900+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:46.539830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"83'16","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.065910+0000","last_change":"2024-05-08T18:29:50.693408+0000","last_active":"2024-05-08T18:32:46.065910+0000","last_peered":"2024-05-08T18:32:46.065910+0000","last_clean":"2024-05-08T18:32:46.065910+0000","last_became_active":"2024-05-08T18:29:50.692687+0000","last_became_peered":"2024-05-08T18:29:50.692687+0000","last_unstale":"2024-05-08T18:32:46.065910+0000","last_undegraded":"2024-05-08T18:32:46.065910+0000","last_fullsized":"2024-05-08T18:32:46.065910+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:22.834262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":28,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"83'6","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.917179+0000","last_change":"2024-05-08T18:29:42.581368+0000","last_active":"2024-05-08T18:32:46.917179+0000","last_peered":"2024-05-08T18:32:46.917179+0000","last_clean":"2024-05-08T18:32:46.917179+0000","last_became_active":"2024-05-08T18:29:42.580887+0000","last_became_peered":"2024-05-08T18:29:42.580887+0000","last_unstale":"2024-05-08T18:32:46.917179+0000","last_undegraded":"2024-05-08T18:32:46.917179+0000","last_fullsized":"2024-05-08T18:32:46.917179+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:08:15.026467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"93'7","reported_seq":201,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.938046+0000","last_change":"2024-05-08T18:29:40.572770+0000","last_active":"2024-05-08T18:32:46.938046+0000","last_peered":"2024-05-08T18:32:46.938046+0000","last_clean":"2024-05-08T18:32:46.938046+0000","last_became_active":"2024-05-08T18:29:40.572079+0000","last_became_peered":"2024-05-08T18:29:40.572079+0000","last_unstale":"2024-05-08T18:32:46.938046+0000","last_undegraded":"2024-05-08T18:32:46.938046+0000","last_fullsized":"2024-05-08T18:32:46.938046+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:05.929806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":189,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.063663+0000","last_change":"2024-05-08T18:29:44.581323+0000","last_active":"2024-05-08T18:32:46.063663+0000","last_peered":"2024-05-08T18:32:46.063663+0000","last_clean":"2024-05-08T18:32:46.063663+0000","last_became_active":"2024-05-08T18:29:44.580805+0000","last_became_peered":"2024-05-08T18:29:44.580805+0000","last_unstale":"2024-05-08T18:32:46.063663+0000","last_undegraded":"2024-05-08T18:32:46.063663+0000","last_fullsized":"2024-05-08T18:32:46.063663+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:35:25.591140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"47'5","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.862030+0000","last_change":"2024-05-08T18:29:46.602495+0000","last_active":"2024-05-08T18:32:46.862030+0000","last_peered":"2024-05-08T18:32:46.862030+0000","last_clean":"2024-05-08T18:32:46.862030+0000","last_became_active":"2024-05-08T18:29:46.599789+0000","last_became_peered":"2024-05-08T18:29:46.599789+0000","last_unstale":"2024-05-08T18:32:46.862030+0000","last_undegraded":"2024-05-08T18:32:46.862030+0000","last_fullsized":"2024-05-08T18:32:46.862030+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:18:16.375808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.936013+0000","last_change":"2024-05-08T18:29:48.642994+0000","last_active":"2024-05-08T18:32:46.936013+0000","last_peered":"2024-05-08T18:32:46.936013+0000","last_clean":"2024-05-08T18:32:46.936013+0000","last_became_active":"2024-05-08T18:29:48.642056+0000","last_became_peered":"2024-05-08T18:29:48.642056+0000","last_unstale":"2024-05-08T18:32:46.936013+0000","last_undegraded":"2024-05-08T18:32:46.936013+0000","last_fullsized":"2024-05-08T18:32:46.936013+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:47:54.034851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863166+0000","last_change":"2024-05-08T18:29:50.672513+0000","last_active":"2024-05-08T18:32:46.863166+0000","last_peered":"2024-05-08T18:32:46.863166+0000","last_clean":"2024-05-08T18:32:46.863166+0000","last_became_active":"2024-05-08T18:29:50.671781+0000","last_became_peered":"2024-05-08T18:29:50.671781+0000","last_unstale":"2024-05-08T18:32:46.863166+0000","last_undegraded":"2024-05-08T18:32:46.863166+0000","last_fullsized":"2024-05-08T18:32:46.863166+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:45:34.171402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"97'2","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.062291+0000","last_change":"2024-05-08T18:29:42.576843+0000","last_active":"2024-05-08T18:32:46.062291+0000","last_peered":"2024-05-08T18:32:46.062291+0000","last_clean":"2024-05-08T18:32:46.062291+0000","last_became_active":"2024-05-08T18:29:42.576379+0000","last_became_peered":"2024-05-08T18:29:42.576379+0000","last_unstale":"2024-05-08T18:32:46.062291+0000","last_undegraded":"2024-05-08T18:32:46.062291+0000","last_fullsized":"2024-05-08T18:32:46.062291+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:20.471010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"93'12","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.080699+0000","last_change":"2024-05-08T18:29:40.542997+0000","last_active":"2024-05-08T18:32:47.080699+0000","last_peered":"2024-05-08T18:32:47.080699+0000","last_clean":"2024-05-08T18:32:47.080699+0000","last_became_active":"2024-05-08T18:29:40.542239+0000","last_became_peered":"2024-05-08T18:29:40.542239+0000","last_unstale":"2024-05-08T18:32:47.080699+0000","last_undegraded":"2024-05-08T18:32:47.080699+0000","last_fullsized":"2024-05-08T18:32:47.080699+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:14:43.555504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.935289+0000","last_change":"2024-05-08T18:29:44.594178+0000","last_active":"2024-05-08T18:32:46.935289+0000","last_peered":"2024-05-08T18:32:46.935289+0000","last_clean":"2024-05-08T18:32:46.935289+0000","last_became_active":"2024-05-08T18:29:44.592476+0000","last_became_peered":"2024-05-08T18:29:44.592476+0000","last_unstale":"2024-05-08T18:32:46.935289+0000","last_undegraded":"2024-05-08T18:32:46.935289+0000","last_fullsized":"2024-05-08T18:32:46.935289+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:04:16.093662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"97'17","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.063156+0000","last_change":"2024-05-08T18:29:46.597288+0000","last_active":"2024-05-08T18:32:46.063156+0000","last_peered":"2024-05-08T18:32:46.063156+0000","last_clean":"2024-05-08T18:32:46.063156+0000","last_became_active":"2024-05-08T18:29:46.596452+0000","last_became_peered":"2024-05-08T18:29:46.596452+0000","last_unstale":"2024-05-08T18:32:46.063156+0000","last_undegraded":"2024-05-08T18:32:46.063156+0000","last_fullsized":"2024-05-08T18:32:46.063156+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:32:43.245753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.848919+0000","last_change":"2024-05-08T18:29:48.635436+0000","last_active":"2024-05-08T18:32:46.848919+0000","last_peered":"2024-05-08T18:32:46.848919+0000","last_clean":"2024-05-08T18:32:46.848919+0000","last_became_active":"2024-05-08T18:29:48.634704+0000","last_became_peered":"2024-05-08T18:29:48.634704+0000","last_unstale":"2024-05-08T18:32:46.848919+0000","last_undegraded":"2024-05-08T18:32:46.848919+0000","last_fullsized":"2024-05-08T18:32:46.848919+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:55:52.238481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"83'2","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.079126+0000","last_change":"2024-05-08T18:29:50.687974+0000","last_active":"2024-05-08T18:32:47.079126+0000","last_peered":"2024-05-08T18:32:47.079126+0000","last_clean":"2024-05-08T18:32:47.079126+0000","last_became_active":"2024-05-08T18:29:50.687045+0000","last_became_peered":"2024-05-08T18:29:50.687045+0000","last_unstale":"2024-05-08T18:32:47.079126+0000","last_undegraded":"2024-05-08T18:32:47.079126+0000","last_fullsized":"2024-05-08T18:32:47.079126+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:55:01.894779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"97'4","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.063677+0000","last_change":"2024-05-08T18:30:20.850226+0000","last_active":"2024-05-08T18:32:46.063677+0000","last_peered":"2024-05-08T18:32:46.063677+0000","last_clean":"2024-05-08T18:32:46.063677+0000","last_became_active":"2024-05-08T18:30:20.849751+0000","last_became_peered":"2024-05-08T18:30:20.849751+0000","last_unstale":"2024-05-08T18:32:46.063677+0000","last_undegraded":"2024-05-08T18:32:46.063677+0000","last_fullsized":"2024-05-08T18:32:46.063677+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:33:31.550958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"93'13","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863945+0000","last_change":"2024-05-08T18:29:40.541112+0000","last_active":"2024-05-08T18:32:46.863945+0000","last_peered":"2024-05-08T18:32:46.863945+0000","last_clean":"2024-05-08T18:32:46.863945+0000","last_became_active":"2024-05-08T18:29:40.540835+0000","last_became_peered":"2024-05-08T18:29:40.540835+0000","last_unstale":"2024-05-08T18:32:46.863945+0000","last_undegraded":"2024-05-08T18:32:46.863945+0000","last_fullsized":"2024-05-08T18:32:46.863945+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:43:14.995191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.848912+0000","last_change":"2024-05-08T18:29:44.592033+0000","last_active":"2024-05-08T18:32:46.848912+0000","last_peered":"2024-05-08T18:32:46.848912+0000","last_clean":"2024-05-08T18:32:46.848912+0000","last_became_active":"2024-05-08T18:29:44.590454+0000","last_became_peered":"2024-05-08T18:29:44.590454+0000","last_unstale":"2024-05-08T18:32:46.848912+0000","last_undegraded":"2024-05-08T18:32:46.848912+0000","last_fullsized":"2024-05-08T18:32:46.848912+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:11:03.740365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"97'15","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.935727+0000","last_change":"2024-05-08T18:29:46.607002+0000","last_active":"2024-05-08T18:32:46.935727+0000","last_peered":"2024-05-08T18:32:46.935727+0000","last_clean":"2024-05-08T18:32:46.935727+0000","last_became_active":"2024-05-08T18:29:46.606172+0000","last_became_peered":"2024-05-08T18:29:46.606172+0000","last_unstale":"2024-05-08T18:32:46.935727+0000","last_undegraded":"2024-05-08T18:32:46.935727+0000","last_fullsized":"2024-05-08T18:32:46.935727+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:37:35.850414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.862686+0000","last_change":"2024-05-08T18:29:48.632948+0000","last_active":"2024-05-08T18:32:46.862686+0000","last_peered":"2024-05-08T18:32:46.862686+0000","last_clean":"2024-05-08T18:32:46.862686+0000","last_became_active":"2024-05-08T18:29:48.631219+0000","last_became_peered":"2024-05-08T18:29:48.631219+0000","last_unstale":"2024-05-08T18:32:46.862686+0000","last_undegraded":"2024-05-08T18:32:46.862686+0000","last_fullsized":"2024-05-08T18:32:46.862686+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:19:01.454355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.850370+0000","last_change":"2024-05-08T18:29:42.570180+0000","last_active":"2024-05-08T18:32:46.850370+0000","last_peered":"2024-05-08T18:32:46.850370+0000","last_clean":"2024-05-08T18:32:46.850370+0000","last_became_active":"2024-05-08T18:29:42.569425+0000","last_became_peered":"2024-05-08T18:29:42.569425+0000","last_unstale":"2024-05-08T18:32:46.850370+0000","last_undegraded":"2024-05-08T18:32:46.850370+0000","last_fullsized":"2024-05-08T18:32:46.850370+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:35.037465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"93'8","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.064153+0000","last_change":"2024-05-08T18:29:40.547711+0000","last_active":"2024-05-08T18:32:46.064153+0000","last_peered":"2024-05-08T18:32:46.064153+0000","last_clean":"2024-05-08T18:32:46.064153+0000","last_became_active":"2024-05-08T18:29:40.547479+0000","last_became_peered":"2024-05-08T18:29:40.547479+0000","last_unstale":"2024-05-08T18:32:46.064153+0000","last_undegraded":"2024-05-08T18:32:46.064153+0000","last_fullsized":"2024-05-08T18:32:46.064153+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:12:40.901620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":189,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863409+0000","last_change":"2024-05-08T18:29:44.591547+0000","last_active":"2024-05-08T18:32:46.863409+0000","last_peered":"2024-05-08T18:32:46.863409+0000","last_clean":"2024-05-08T18:32:46.863409+0000","last_became_active":"2024-05-08T18:29:44.590498+0000","last_became_peered":"2024-05-08T18:29:44.590498+0000","last_unstale":"2024-05-08T18:32:46.863409+0000","last_undegraded":"2024-05-08T18:32:46.863409+0000","last_fullsized":"2024-05-08T18:32:46.863409+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:14:04.085401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"97'25","reported_seq":223,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.918610+0000","last_change":"2024-05-08T18:29:46.600437+0000","last_active":"2024-05-08T18:32:46.918610+0000","last_peered":"2024-05-08T18:32:46.918610+0000","last_clean":"2024-05-08T18:32:46.918610+0000","last_became_active":"2024-05-08T18:29:46.594672+0000","last_became_peered":"2024-05-08T18:29:46.594672+0000","last_unstale":"2024-05-08T18:32:46.918610+0000","last_undegraded":"2024-05-08T18:32:46.918610+0000","last_fullsized":"2024-05-08T18:32:46.918610+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:35:53.294312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":180,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.079232+0000","last_change":"2024-05-08T18:29:48.639840+0000","last_active":"2024-05-08T18:32:47.079232+0000","last_peered":"2024-05-08T18:32:47.079232+0000","last_clean":"2024-05-08T18:32:47.079232+0000","last_became_active":"2024-05-08T18:29:48.639120+0000","last_became_peered":"2024-05-08T18:29:48.639120+0000","last_unstale":"2024-05-08T18:32:47.079232+0000","last_undegraded":"2024-05-08T18:32:47.079232+0000","last_fullsized":"2024-05-08T18:32:47.079232+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:13:50.865474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"84'2","reported_seq":180,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.062460+0000","last_change":"2024-05-08T18:29:50.684843+0000","last_active":"2024-05-08T18:32:46.062460+0000","last_peered":"2024-05-08T18:32:46.062460+0000","last_clean":"2024-05-08T18:32:46.062460+0000","last_became_active":"2024-05-08T18:29:50.684119+0000","last_became_peered":"2024-05-08T18:29:50.684119+0000","last_unstale":"2024-05-08T18:32:46.062460+0000","last_undegraded":"2024-05-08T18:32:46.062460+0000","last_fullsized":"2024-05-08T18:32:46.062460+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:09:29.641515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"80'2","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863501+0000","last_change":"2024-05-08T18:29:42.575763+0000","last_active":"2024-05-08T18:32:46.863501+0000","last_peered":"2024-05-08T18:32:46.863501+0000","last_clean":"2024-05-08T18:32:46.863501+0000","last_became_active":"2024-05-08T18:29:42.575450+0000","last_became_peered":"2024-05-08T18:29:42.575450+0000","last_unstale":"2024-05-08T18:32:46.863501+0000","last_undegraded":"2024-05-08T18:32:46.863501+0000","last_fullsized":"2024-05-08T18:32:46.863501+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:20.471010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"93'10","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.917742+0000","last_change":"2024-05-08T18:29:40.546101+0000","last_active":"2024-05-08T18:32:46.917742+0000","last_peered":"2024-05-08T18:32:46.917742+0000","last_clean":"2024-05-08T18:32:46.917742+0000","last_became_active":"2024-05-08T18:29:40.545814+0000","last_became_peered":"2024-05-08T18:29:40.545814+0000","last_unstale":"2024-05-08T18:32:46.917742+0000","last_undegraded":"2024-05-08T18:32:46.917742+0000","last_fullsized":"2024-05-08T18:32:46.917742+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:22.579629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.850156+0000","last_change":"2024-05-08T18:29:44.591310+0000","last_active":"2024-05-08T18:32:46.850156+0000","last_peered":"2024-05-08T18:32:46.850156+0000","last_clean":"2024-05-08T18:32:46.850156+0000","last_became_active":"2024-05-08T18:29:44.590394+0000","last_became_peered":"2024-05-08T18:29:44.590394+0000","last_unstale":"2024-05-08T18:32:46.850156+0000","last_undegraded":"2024-05-08T18:32:46.850156+0000","last_fullsized":"2024-05-08T18:32:46.850156+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:02:28.348982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"97'21","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.936870+0000","last_change":"2024-05-08T18:29:46.605887+0000","last_active":"2024-05-08T18:32:46.936870+0000","last_peered":"2024-05-08T18:32:46.936870+0000","last_clean":"2024-05-08T18:32:46.936870+0000","last_became_active":"2024-05-08T18:29:46.604917+0000","last_became_peered":"2024-05-08T18:29:46.604917+0000","last_unstale":"2024-05-08T18:32:46.936870+0000","last_undegraded":"2024-05-08T18:32:46.936870+0000","last_fullsized":"2024-05-08T18:32:46.936870+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:22:36.338527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.918794+0000","last_change":"2024-05-08T18:29:48.644420+0000","last_active":"2024-05-08T18:32:46.918794+0000","last_peered":"2024-05-08T18:32:46.918794+0000","last_clean":"2024-05-08T18:32:46.918794+0000","last_became_active":"2024-05-08T18:29:48.643493+0000","last_became_peered":"2024-05-08T18:29:48.643493+0000","last_unstale":"2024-05-08T18:32:46.918794+0000","last_undegraded":"2024-05-08T18:32:46.918794+0000","last_fullsized":"2024-05-08T18:32:46.918794+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:19:33.148012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":174,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.848670+0000","last_change":"2024-05-08T18:29:50.687485+0000","last_active":"2024-05-08T18:32:46.848670+0000","last_peered":"2024-05-08T18:32:46.848670+0000","last_clean":"2024-05-08T18:32:46.848670+0000","last_became_active":"2024-05-08T18:29:50.686750+0000","last_became_peered":"2024-05-08T18:29:50.686750+0000","last_unstale":"2024-05-08T18:32:46.848670+0000","last_undegraded":"2024-05-08T18:32:46.848670+0000","last_fullsized":"2024-05-08T18:32:46.848670+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:41.914164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"97'4","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.066425+0000","last_change":"2024-05-08T18:29:42.566571+0000","last_active":"2024-05-08T18:32:46.066425+0000","last_peered":"2024-05-08T18:32:46.066425+0000","last_clean":"2024-05-08T18:32:46.066425+0000","last_became_active":"2024-05-08T18:29:42.563695+0000","last_became_peered":"2024-05-08T18:29:42.563695+0000","last_unstale":"2024-05-08T18:32:46.066425+0000","last_undegraded":"2024-05-08T18:32:46.066425+0000","last_fullsized":"2024-05-08T18:32:46.066425+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:46.887628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"93'10","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.059150+0000","last_change":"2024-05-08T18:29:40.545512+0000","last_active":"2024-05-08T18:32:46.059150+0000","last_peered":"2024-05-08T18:32:46.059150+0000","last_clean":"2024-05-08T18:32:46.059150+0000","last_became_active":"2024-05-08T18:29:40.544216+0000","last_became_peered":"2024-05-08T18:29:40.544216+0000","last_unstale":"2024-05-08T18:32:46.059150+0000","last_undegraded":"2024-05-08T18:32:46.059150+0000","last_fullsized":"2024-05-08T18:32:46.059150+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:37:08.242362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.060557+0000","last_change":"2024-05-08T18:29:44.576107+0000","last_active":"2024-05-08T18:32:46.060557+0000","last_peered":"2024-05-08T18:32:46.060557+0000","last_clean":"2024-05-08T18:32:46.060557+0000","last_became_active":"2024-05-08T18:29:44.575344+0000","last_became_peered":"2024-05-08T18:29:44.575344+0000","last_unstale":"2024-05-08T18:32:46.060557+0000","last_undegraded":"2024-05-08T18:32:46.060557+0000","last_fullsized":"2024-05-08T18:32:46.060557+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:19.731003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"97'17","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.067703+0000","last_change":"2024-05-08T18:29:46.584785+0000","last_active":"2024-05-08T18:32:46.067703+0000","last_peered":"2024-05-08T18:32:46.067703+0000","last_clean":"2024-05-08T18:32:46.067703+0000","last_became_active":"2024-05-08T18:29:46.583390+0000","last_became_peered":"2024-05-08T18:29:46.583390+0000","last_unstale":"2024-05-08T18:32:46.067703+0000","last_undegraded":"2024-05-08T18:32:46.067703+0000","last_fullsized":"2024-05-08T18:32:46.067703+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:27:01.747339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.919301+0000","last_change":"2024-05-08T18:29:48.643558+0000","last_active":"2024-05-08T18:32:46.919301+0000","last_peered":"2024-05-08T18:32:46.919301+0000","last_clean":"2024-05-08T18:32:46.919301+0000","last_became_active":"2024-05-08T18:29:48.642773+0000","last_became_peered":"2024-05-08T18:29:48.642773+0000","last_unstale":"2024-05-08T18:32:46.919301+0000","last_undegraded":"2024-05-08T18:32:46.919301+0000","last_fullsized":"2024-05-08T18:32:46.919301+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:59:04.369806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":176,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.078353+0000","last_change":"2024-05-08T18:29:50.674796+0000","last_active":"2024-05-08T18:32:47.078353+0000","last_peered":"2024-05-08T18:32:47.078353+0000","last_clean":"2024-05-08T18:32:47.078353+0000","last_became_active":"2024-05-08T18:29:50.674057+0000","last_became_peered":"2024-05-08T18:29:50.674057+0000","last_unstale":"2024-05-08T18:32:47.078353+0000","last_undegraded":"2024-05-08T18:32:47.078353+0000","last_fullsized":"2024-05-08T18:32:47.078353+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:34:14.488295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"84'4","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.062561+0000","last_change":"2024-05-08T18:29:42.577642+0000","last_active":"2024-05-08T18:32:46.062561+0000","last_peered":"2024-05-08T18:32:46.062561+0000","last_clean":"2024-05-08T18:32:46.062561+0000","last_became_active":"2024-05-08T18:29:42.577275+0000","last_became_peered":"2024-05-08T18:29:42.577275+0000","last_unstale":"2024-05-08T18:32:46.062561+0000","last_undegraded":"2024-05-08T18:32:46.062561+0000","last_fullsized":"2024-05-08T18:32:46.062561+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:51:45.155037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"93'10","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.862767+0000","last_change":"2024-05-08T18:29:40.562873+0000","last_active":"2024-05-08T18:32:46.862767+0000","last_peered":"2024-05-08T18:32:46.862767+0000","last_clean":"2024-05-08T18:32:46.862767+0000","last_became_active":"2024-05-08T18:29:40.562594+0000","last_became_peered":"2024-05-08T18:29:40.562594+0000","last_unstale":"2024-05-08T18:32:46.862767+0000","last_undegraded":"2024-05-08T18:32:46.862767+0000","last_fullsized":"2024-05-08T18:32:46.862767+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:16:16.521258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.918959+0000","last_change":"2024-05-08T18:29:44.594152+0000","last_active":"2024-05-08T18:32:46.918959+0000","last_peered":"2024-05-08T18:32:46.918959+0000","last_clean":"2024-05-08T18:32:46.918959+0000","last_became_active":"2024-05-08T18:29:44.593398+0000","last_became_peered":"2024-05-08T18:29:44.593398+0000","last_unstale":"2024-05-08T18:32:46.918959+0000","last_undegraded":"2024-05-08T18:32:46.918959+0000","last_fullsized":"2024-05-08T18:32:46.918959+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:11.825480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"85'12","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.059653+0000","last_change":"2024-05-08T18:29:46.602137+0000","last_active":"2024-05-08T18:32:46.059653+0000","last_peered":"2024-05-08T18:32:46.059653+0000","last_clean":"2024-05-08T18:32:46.059653+0000","last_became_active":"2024-05-08T18:29:46.601402+0000","last_became_peered":"2024-05-08T18:29:46.601402+0000","last_unstale":"2024-05-08T18:32:46.059653+0000","last_undegraded":"2024-05-08T18:32:46.059653+0000","last_fullsized":"2024-05-08T18:32:46.059653+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:23.940519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":22,"num_read_kb":17,"num_write":24,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"116'102","reported_seq":329,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:49.831643+0000","last_change":"2024-05-08T18:29:48.635696+0000","last_active":"2024-05-08T18:32:49.831643+0000","last_peered":"2024-05-08T18:32:49.831643+0000","last_clean":"2024-05-08T18:32:49.831643+0000","last_became_active":"2024-05-08T18:29:48.634859+0000","last_became_peered":"2024-05-08T18:29:48.634859+0000","last_unstale":"2024-05-08T18:32:49.831643+0000","last_undegraded":"2024-05-08T18:32:49.831643+0000","last_fullsized":"2024-05-08T18:32:49.831643+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:35:55.322495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":174,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.935107+0000","last_change":"2024-05-08T18:29:50.679757+0000","last_active":"2024-05-08T18:32:46.935107+0000","last_peered":"2024-05-08T18:32:46.935107+0000","last_clean":"2024-05-08T18:32:46.935107+0000","last_became_active":"2024-05-08T18:29:50.679011+0000","last_became_peered":"2024-05-08T18:29:50.679011+0000","last_unstale":"2024-05-08T18:32:46.935107+0000","last_undegraded":"2024-05-08T18:32:46.935107+0000","last_fullsized":"2024-05-08T18:32:46.935107+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:34:14.488295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"84'8","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.058657+0000","last_change":"2024-05-08T18:29:42.560354+0000","last_active":"2024-05-08T18:32:46.058657+0000","last_peered":"2024-05-08T18:32:46.058657+0000","last_clean":"2024-05-08T18:32:46.058657+0000","last_became_active":"2024-05-08T18:29:42.559647+0000","last_became_peered":"2024-05-08T18:29:42.559647+0000","last_unstale":"2024-05-08T18:32:46.058657+0000","last_undegraded":"2024-05-08T18:32:46.058657+0000","last_fullsized":"2024-05-08T18:32:46.058657+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:18:10.803989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"93'10","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.079570+0000","last_change":"2024-05-08T18:29:40.557683+0000","last_active":"2024-05-08T18:32:47.079570+0000","last_peered":"2024-05-08T18:32:47.079570+0000","last_clean":"2024-05-08T18:32:47.079570+0000","last_became_active":"2024-05-08T18:29:40.556254+0000","last_became_peered":"2024-05-08T18:29:40.556254+0000","last_unstale":"2024-05-08T18:32:47.079570+0000","last_undegraded":"2024-05-08T18:32:47.079570+0000","last_fullsized":"2024-05-08T18:32:47.079570+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:51:43.135322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.936035+0000","last_change":"2024-05-08T18:29:44.594068+0000","last_active":"2024-05-08T18:32:46.936035+0000","last_peered":"2024-05-08T18:32:46.936035+0000","last_clean":"2024-05-08T18:32:46.936035+0000","last_became_active":"2024-05-08T18:29:44.593322+0000","last_became_peered":"2024-05-08T18:29:44.593322+0000","last_unstale":"2024-05-08T18:32:46.936035+0000","last_undegraded":"2024-05-08T18:32:46.936035+0000","last_fullsized":"2024-05-08T18:32:46.936035+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:19.731003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"97'22","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.078642+0000","last_change":"2024-05-08T18:29:46.604700+0000","last_active":"2024-05-08T18:32:47.078642+0000","last_peered":"2024-05-08T18:32:47.078642+0000","last_clean":"2024-05-08T18:32:47.078642+0000","last_became_active":"2024-05-08T18:29:46.603885+0000","last_became_peered":"2024-05-08T18:29:46.603885+0000","last_unstale":"2024-05-08T18:32:47.078642+0000","last_undegraded":"2024-05-08T18:32:47.078642+0000","last_fullsized":"2024-05-08T18:32:47.078642+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:22:36.338527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9698,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":18,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.861740+0000","last_change":"2024-05-08T18:29:48.640814+0000","last_active":"2024-05-08T18:32:46.861740+0000","last_peered":"2024-05-08T18:32:46.861740+0000","last_clean":"2024-05-08T18:32:46.861740+0000","last_became_active":"2024-05-08T18:29:48.640046+0000","last_became_peered":"2024-05-08T18:29:48.640046+0000","last_unstale":"2024-05-08T18:32:46.861740+0000","last_undegraded":"2024-05-08T18:32:46.861740+0000","last_fullsized":"2024-05-08T18:32:46.861740+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:53:21.219706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"83'8","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.938436+0000","last_change":"2024-05-08T18:29:50.692688+0000","last_active":"2024-05-08T18:32:46.938436+0000","last_peered":"2024-05-08T18:32:46.938436+0000","last_clean":"2024-05-08T18:32:46.938436+0000","last_became_active":"2024-05-08T18:29:50.692123+0000","last_became_peered":"2024-05-08T18:29:50.692123+0000","last_unstale":"2024-05-08T18:32:46.938436+0000","last_undegraded":"2024-05-08T18:32:46.938436+0000","last_fullsized":"2024-05-08T18:32:46.938436+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:38.318890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"97'2","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.058878+0000","last_change":"2024-05-08T18:29:42.558336+0000","last_active":"2024-05-08T18:32:46.058878+0000","last_peered":"2024-05-08T18:32:46.058878+0000","last_clean":"2024-05-08T18:32:46.058878+0000","last_became_active":"2024-05-08T18:29:42.557570+0000","last_became_peered":"2024-05-08T18:29:42.557570+0000","last_unstale":"2024-05-08T18:32:46.058878+0000","last_undegraded":"2024-05-08T18:32:46.058878+0000","last_fullsized":"2024-05-08T18:32:46.058878+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:54:16.539832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"84'2","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.080664+0000","last_change":"2024-05-08T18:29:40.537090+0000","last_active":"2024-05-08T18:32:47.080664+0000","last_peered":"2024-05-08T18:32:47.080664+0000","last_clean":"2024-05-08T18:32:47.080664+0000","last_became_active":"2024-05-08T18:29:40.536188+0000","last_became_peered":"2024-05-08T18:29:40.536188+0000","last_unstale":"2024-05-08T18:32:47.080664+0000","last_undegraded":"2024-05-08T18:32:47.080664+0000","last_fullsized":"2024-05-08T18:32:47.080664+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:22:48.880581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.078799+0000","last_change":"2024-05-08T18:29:44.578901+0000","last_active":"2024-05-08T18:32:47.078799+0000","last_peered":"2024-05-08T18:32:47.078799+0000","last_clean":"2024-05-08T18:32:47.078799+0000","last_became_active":"2024-05-08T18:29:44.578171+0000","last_became_peered":"2024-05-08T18:29:44.578171+0000","last_unstale":"2024-05-08T18:32:47.078799+0000","last_undegraded":"2024-05-08T18:32:47.078799+0000","last_fullsized":"2024-05-08T18:32:47.078799+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:19.731003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"97'17","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.861874+0000","last_change":"2024-05-08T18:29:46.604539+0000","last_active":"2024-05-08T18:32:46.861874+0000","last_peered":"2024-05-08T18:32:46.861874+0000","last_clean":"2024-05-08T18:32:46.861874+0000","last_became_active":"2024-05-08T18:29:46.603728+0000","last_became_peered":"2024-05-08T18:29:46.603728+0000","last_unstale":"2024-05-08T18:32:46.861874+0000","last_undegraded":"2024-05-08T18:32:46.861874+0000","last_fullsized":"2024-05-08T18:32:46.861874+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:12:41.226788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.848661+0000","last_change":"2024-05-08T18:29:48.635813+0000","last_active":"2024-05-08T18:32:46.848661+0000","last_peered":"2024-05-08T18:32:46.848661+0000","last_clean":"2024-05-08T18:32:46.848661+0000","last_became_active":"2024-05-08T18:29:48.634664+0000","last_became_peered":"2024-05-08T18:29:48.634664+0000","last_unstale":"2024-05-08T18:32:46.848661+0000","last_undegraded":"2024-05-08T18:32:46.848661+0000","last_fullsized":"2024-05-08T18:32:46.848661+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:27:23.427365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"97'7","reported_seq":187,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.066075+0000","last_change":"2024-05-08T18:29:50.687517+0000","last_active":"2024-05-08T18:32:46.066075+0000","last_peered":"2024-05-08T18:32:46.066075+0000","last_clean":"2024-05-08T18:32:46.066075+0000","last_became_active":"2024-05-08T18:29:50.686662+0000","last_became_peered":"2024-05-08T18:29:50.686662+0000","last_unstale":"2024-05-08T18:32:46.066075+0000","last_undegraded":"2024-05-08T18:32:46.066075+0000","last_fullsized":"2024-05-08T18:32:46.066075+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:58:00.455559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"97'4","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.062709+0000","last_change":"2024-05-08T18:29:42.558848+0000","last_active":"2024-05-08T18:32:46.062709+0000","last_peered":"2024-05-08T18:32:46.062709+0000","last_clean":"2024-05-08T18:32:46.062709+0000","last_became_active":"2024-05-08T18:29:42.558390+0000","last_became_peered":"2024-05-08T18:29:42.558390+0000","last_unstale":"2024-05-08T18:32:46.062709+0000","last_undegraded":"2024-05-08T18:32:46.062709+0000","last_fullsized":"2024-05-08T18:32:46.062709+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:55:30.468069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"93'8","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.066372+0000","last_change":"2024-05-08T18:29:40.567772+0000","last_active":"2024-05-08T18:32:46.066372+0000","last_peered":"2024-05-08T18:32:46.066372+0000","last_clean":"2024-05-08T18:32:46.066372+0000","last_became_active":"2024-05-08T18:29:40.567482+0000","last_became_peered":"2024-05-08T18:29:40.567482+0000","last_unstale":"2024-05-08T18:32:46.066372+0000","last_undegraded":"2024-05-08T18:32:46.066372+0000","last_fullsized":"2024-05-08T18:32:46.066372+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:36:37.796095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":5,"num_write":18,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.057189+0000","last_change":"2024-05-08T18:29:44.596876+0000","last_active":"2024-05-08T18:32:46.057189+0000","last_peered":"2024-05-08T18:32:46.057189+0000","last_clean":"2024-05-08T18:32:46.057189+0000","last_became_active":"2024-05-08T18:29:44.595712+0000","last_became_peered":"2024-05-08T18:29:44.595712+0000","last_unstale":"2024-05-08T18:32:46.057189+0000","last_undegraded":"2024-05-08T18:32:46.057189+0000","last_fullsized":"2024-05-08T18:32:46.057189+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:35:51.288126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"97'11","reported_seq":201,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.064975+0000","last_change":"2024-05-08T18:29:46.598637+0000","last_active":"2024-05-08T18:32:46.064975+0000","last_peered":"2024-05-08T18:32:46.064975+0000","last_clean":"2024-05-08T18:32:46.064975+0000","last_became_active":"2024-05-08T18:29:46.597394+0000","last_became_peered":"2024-05-08T18:29:46.597394+0000","last_unstale":"2024-05-08T18:32:46.064975+0000","last_undegraded":"2024-05-08T18:32:46.064975+0000","last_fullsized":"2024-05-08T18:32:46.064975+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:52:22.540814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.057643+0000","last_change":"2024-05-08T18:29:48.642251+0000","last_active":"2024-05-08T18:32:46.057643+0000","last_peered":"2024-05-08T18:32:46.057643+0000","last_clean":"2024-05-08T18:32:46.057643+0000","last_became_active":"2024-05-08T18:29:48.641666+0000","last_became_peered":"2024-05-08T18:29:48.641666+0000","last_unstale":"2024-05-08T18:32:46.057643+0000","last_undegraded":"2024-05-08T18:32:46.057643+0000","last_fullsized":"2024-05-08T18:32:46.057643+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:13:50.865474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"80'2","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.937644+0000","last_change":"2024-05-08T18:29:50.685668+0000","last_active":"2024-05-08T18:32:46.937644+0000","last_peered":"2024-05-08T18:32:46.937644+0000","last_clean":"2024-05-08T18:32:46.937644+0000","last_became_active":"2024-05-08T18:29:50.684958+0000","last_became_peered":"2024-05-08T18:29:50.684958+0000","last_unstale":"2024-05-08T18:32:46.937644+0000","last_undegraded":"2024-05-08T18:32:46.937644+0000","last_fullsized":"2024-05-08T18:32:46.937644+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:55:01.894779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.057760+0000","last_change":"2024-05-08T18:29:42.562063+0000","last_active":"2024-05-08T18:32:46.057760+0000","last_peered":"2024-05-08T18:32:46.057760+0000","last_clean":"2024-05-08T18:32:46.057760+0000","last_became_active":"2024-05-08T18:29:42.558871+0000","last_became_peered":"2024-05-08T18:29:42.558871+0000","last_unstale":"2024-05-08T18:32:46.057760+0000","last_undegraded":"2024-05-08T18:32:46.057760+0000","last_fullsized":"2024-05-08T18:32:46.057760+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:59.243324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"93'13","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863884+0000","last_change":"2024-05-08T18:29:40.541070+0000","last_active":"2024-05-08T18:32:46.863884+0000","last_peered":"2024-05-08T18:32:46.863884+0000","last_clean":"2024-05-08T18:32:46.863884+0000","last_became_active":"2024-05-08T18:29:40.540767+0000","last_became_peered":"2024-05-08T18:29:40.540767+0000","last_unstale":"2024-05-08T18:32:46.863884+0000","last_undegraded":"2024-05-08T18:32:46.863884+0000","last_fullsized":"2024-05-08T18:32:46.863884+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:09:39.835826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"26'1","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.917294+0000","last_change":"2024-05-08T18:29:44.592737+0000","last_active":"2024-05-08T18:32:46.917294+0000","last_peered":"2024-05-08T18:32:46.917294+0000","last_clean":"2024-05-08T18:32:46.917294+0000","last_became_active":"2024-05-08T18:29:44.592243+0000","last_became_peered":"2024-05-08T18:29:44.592243+0000","last_unstale":"2024-05-08T18:32:46.917294+0000","last_undegraded":"2024-05-08T18:32:46.917294+0000","last_fullsized":"2024-05-08T18:32:46.917294+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:59.744050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"97'16","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.058346+0000","last_change":"2024-05-08T18:29:46.610835+0000","last_active":"2024-05-08T18:32:46.058346+0000","last_peered":"2024-05-08T18:32:46.058346+0000","last_clean":"2024-05-08T18:32:46.058346+0000","last_became_active":"2024-05-08T18:29:46.609903+0000","last_became_peered":"2024-05-08T18:29:46.609903+0000","last_unstale":"2024-05-08T18:32:46.058346+0000","last_undegraded":"2024-05-08T18:32:46.058346+0000","last_fullsized":"2024-05-08T18:32:46.058346+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:37:35.850414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.862608+0000","last_change":"2024-05-08T18:29:48.629822+0000","last_active":"2024-05-08T18:32:46.862608+0000","last_peered":"2024-05-08T18:32:46.862608+0000","last_clean":"2024-05-08T18:32:46.862608+0000","last_became_active":"2024-05-08T18:29:48.629204+0000","last_became_peered":"2024-05-08T18:29:48.629204+0000","last_unstale":"2024-05-08T18:32:46.862608+0000","last_undegraded":"2024-05-08T18:32:46.862608+0000","last_fullsized":"2024-05-08T18:32:46.862608+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:04.571608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"84'6","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.060640+0000","last_change":"2024-05-08T18:29:50.668101+0000","last_active":"2024-05-08T18:32:46.060640+0000","last_peered":"2024-05-08T18:32:46.060640+0000","last_clean":"2024-05-08T18:32:46.060640+0000","last_became_active":"2024-05-08T18:29:50.667357+0000","last_became_peered":"2024-05-08T18:29:50.667357+0000","last_unstale":"2024-05-08T18:32:46.060640+0000","last_undegraded":"2024-05-08T18:32:46.060640+0000","last_fullsized":"2024-05-08T18:32:46.060640+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:55:01.894779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"97'4","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.919471+0000","last_change":"2024-05-08T18:29:42.581366+0000","last_active":"2024-05-08T18:32:46.919471+0000","last_peered":"2024-05-08T18:32:46.919471+0000","last_clean":"2024-05-08T18:32:46.919471+0000","last_became_active":"2024-05-08T18:29:42.580988+0000","last_became_peered":"2024-05-08T18:29:42.580988+0000","last_unstale":"2024-05-08T18:32:46.919471+0000","last_undegraded":"2024-05-08T18:32:46.919471+0000","last_fullsized":"2024-05-08T18:32:46.919471+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:42.005809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"84'9","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.848329+0000","last_change":"2024-05-08T18:29:40.562025+0000","last_active":"2024-05-08T18:32:46.848329+0000","last_peered":"2024-05-08T18:32:46.848329+0000","last_clean":"2024-05-08T18:32:46.848329+0000","last_became_active":"2024-05-08T18:29:40.561277+0000","last_became_peered":"2024-05-08T18:29:40.561277+0000","last_unstale":"2024-05-08T18:32:46.848329+0000","last_undegraded":"2024-05-08T18:32:46.848329+0000","last_fullsized":"2024-05-08T18:32:46.848329+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:59:25.840149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":19,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.916111+0000","last_change":"2024-05-08T18:29:42.573832+0000","last_active":"2024-05-08T18:32:46.916111+0000","last_peered":"2024-05-08T18:32:46.916111+0000","last_clean":"2024-05-08T18:32:46.916111+0000","last_became_active":"2024-05-08T18:29:42.573502+0000","last_became_peered":"2024-05-08T18:29:42.573502+0000","last_unstale":"2024-05-08T18:32:46.916111+0000","last_undegraded":"2024-05-08T18:32:46.916111+0000","last_fullsized":"2024-05-08T18:32:46.916111+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:35.037465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"93'8","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.060494+0000","last_change":"2024-05-08T18:29:40.533094+0000","last_active":"2024-05-08T18:32:46.060494+0000","last_peered":"2024-05-08T18:32:46.060494+0000","last_clean":"2024-05-08T18:32:46.060494+0000","last_became_active":"2024-05-08T18:29:40.532246+0000","last_became_peered":"2024-05-08T18:29:40.532246+0000","last_unstale":"2024-05-08T18:32:46.060494+0000","last_undegraded":"2024-05-08T18:32:46.060494+0000","last_fullsized":"2024-05-08T18:32:46.060494+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:37:08.242362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.080244+0000","last_change":"2024-05-08T18:29:42.565298+0000","last_active":"2024-05-08T18:32:47.080244+0000","last_peered":"2024-05-08T18:32:47.080244+0000","last_clean":"2024-05-08T18:32:47.080244+0000","last_became_active":"2024-05-08T18:29:42.564542+0000","last_became_peered":"2024-05-08T18:29:42.564542+0000","last_unstale":"2024-05-08T18:32:47.080244+0000","last_undegraded":"2024-05-08T18:32:47.080244+0000","last_fullsized":"2024-05-08T18:32:47.080244+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:57.706167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"93'14","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.079157+0000","last_change":"2024-05-08T18:29:40.556958+0000","last_active":"2024-05-08T18:32:47.079157+0000","last_peered":"2024-05-08T18:32:47.079157+0000","last_clean":"2024-05-08T18:32:47.079157+0000","last_became_active":"2024-05-08T18:29:40.556091+0000","last_became_peered":"2024-05-08T18:29:40.556091+0000","last_unstale":"2024-05-08T18:32:47.079157+0000","last_undegraded":"2024-05-08T18:32:47.079157+0000","last_fullsized":"2024-05-08T18:32:47.079157+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:39.986094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"97'6","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.918325+0000","last_change":"2024-05-08T18:29:42.574619+0000","last_active":"2024-05-08T18:32:46.918325+0000","last_peered":"2024-05-08T18:32:46.918325+0000","last_clean":"2024-05-08T18:32:46.918325+0000","last_became_active":"2024-05-08T18:29:42.573178+0000","last_became_peered":"2024-05-08T18:29:42.573178+0000","last_unstale":"2024-05-08T18:32:46.918325+0000","last_undegraded":"2024-05-08T18:32:46.918325+0000","last_fullsized":"2024-05-08T18:32:46.918325+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:33.139089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"92'5","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.862863+0000","last_change":"2024-05-08T18:29:40.544338+0000","last_active":"2024-05-08T18:32:46.862863+0000","last_peered":"2024-05-08T18:32:46.862863+0000","last_clean":"2024-05-08T18:32:46.862863+0000","last_became_active":"2024-05-08T18:29:40.544107+0000","last_became_peered":"2024-05-08T18:29:40.544107+0000","last_unstale":"2024-05-08T18:32:46.862863+0000","last_undegraded":"2024-05-08T18:32:46.862863+0000","last_fullsized":"2024-05-08T18:32:46.862863+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:54.200883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"84'2","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.064285+0000","last_change":"2024-05-08T18:29:42.576979+0000","last_active":"2024-05-08T18:32:46.064285+0000","last_peered":"2024-05-08T18:32:46.064285+0000","last_clean":"2024-05-08T18:32:46.064285+0000","last_became_active":"2024-05-08T18:29:42.576395+0000","last_became_peered":"2024-05-08T18:29:42.576395+0000","last_unstale":"2024-05-08T18:32:46.064285+0000","last_undegraded":"2024-05-08T18:32:46.064285+0000","last_fullsized":"2024-05-08T18:32:46.064285+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:53:03.097704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"93'5","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.066660+0000","last_change":"2024-05-08T18:29:40.558142+0000","last_active":"2024-05-08T18:32:46.066660+0000","last_peered":"2024-05-08T18:32:46.066660+0000","last_clean":"2024-05-08T18:32:46.066660+0000","last_became_active":"2024-05-08T18:29:40.557874+0000","last_became_peered":"2024-05-08T18:29:40.557874+0000","last_unstale":"2024-05-08T18:32:46.066660+0000","last_undegraded":"2024-05-08T18:32:46.066660+0000","last_fullsized":"2024-05-08T18:32:46.066660+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:54.200883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"97'2","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.059136+0000","last_change":"2024-05-08T18:29:42.558324+0000","last_active":"2024-05-08T18:32:46.059136+0000","last_peered":"2024-05-08T18:32:46.059136+0000","last_clean":"2024-05-08T18:32:46.059136+0000","last_became_active":"2024-05-08T18:29:42.556774+0000","last_became_peered":"2024-05-08T18:29:42.556774+0000","last_unstale":"2024-05-08T18:32:46.059136+0000","last_undegraded":"2024-05-08T18:32:46.059136+0000","last_fullsized":"2024-05-08T18:32:46.059136+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:02:26.311100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"93'11","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.919113+0000","last_change":"2024-05-08T18:30:20.858467+0000","last_active":"2024-05-08T18:32:46.919113+0000","last_peered":"2024-05-08T18:32:46.919113+0000","last_clean":"2024-05-08T18:32:46.919113+0000","last_became_active":"2024-05-08T18:30:20.858016+0000","last_became_peered":"2024-05-08T18:30:20.858016+0000","last_unstale":"2024-05-08T18:32:46.919113+0000","last_undegraded":"2024-05-08T18:32:46.919113+0000","last_fullsized":"2024-05-08T18:32:46.919113+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:10:28.824915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"84'4","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.062025+0000","last_change":"2024-05-08T18:29:42.562772+0000","last_active":"2024-05-08T18:32:46.062025+0000","last_peered":"2024-05-08T18:32:46.062025+0000","last_clean":"2024-05-08T18:32:46.062025+0000","last_became_active":"2024-05-08T18:29:42.562420+0000","last_became_peered":"2024-05-08T18:29:42.562420+0000","last_unstale":"2024-05-08T18:32:46.062025+0000","last_undegraded":"2024-05-08T18:32:46.062025+0000","last_fullsized":"2024-05-08T18:32:46.062025+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:30:29.452640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"93'5","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.850198+0000","last_change":"2024-05-08T18:29:40.562024+0000","last_active":"2024-05-08T18:32:46.850198+0000","last_peered":"2024-05-08T18:32:46.850198+0000","last_clean":"2024-05-08T18:32:46.850198+0000","last_became_active":"2024-05-08T18:29:40.561326+0000","last_became_peered":"2024-05-08T18:29:40.561326+0000","last_unstale":"2024-05-08T18:32:46.850198+0000","last_undegraded":"2024-05-08T18:32:46.850198+0000","last_fullsized":"2024-05-08T18:32:46.850198+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:21:38.354933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"97'4","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.847229+0000","last_change":"2024-05-08T18:29:42.561419+0000","last_active":"2024-05-08T18:32:46.847229+0000","last_peered":"2024-05-08T18:32:46.847229+0000","last_clean":"2024-05-08T18:32:46.847229+0000","last_became_active":"2024-05-08T18:29:42.560520+0000","last_became_peered":"2024-05-08T18:29:42.560520+0000","last_unstale":"2024-05-08T18:32:46.847229+0000","last_undegraded":"2024-05-08T18:32:46.847229+0000","last_fullsized":"2024-05-08T18:32:46.847229+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:07.949520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"93'11","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.067225+0000","last_change":"2024-05-08T18:29:40.554884+0000","last_active":"2024-05-08T18:32:46.067225+0000","last_peered":"2024-05-08T18:32:46.067225+0000","last_clean":"2024-05-08T18:32:46.067225+0000","last_became_active":"2024-05-08T18:29:40.554603+0000","last_became_peered":"2024-05-08T18:29:40.554603+0000","last_unstale":"2024-05-08T18:32:46.067225+0000","last_undegraded":"2024-05-08T18:32:46.067225+0000","last_fullsized":"2024-05-08T18:32:46.067225+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:09:39.835826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"84'4","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.861066+0000","last_change":"2024-05-08T18:29:42.574689+0000","last_active":"2024-05-08T18:32:46.861066+0000","last_peered":"2024-05-08T18:32:46.861066+0000","last_clean":"2024-05-08T18:32:46.861066+0000","last_became_active":"2024-05-08T18:29:42.573947+0000","last_became_peered":"2024-05-08T18:29:42.573947+0000","last_unstale":"2024-05-08T18:32:46.861066+0000","last_undegraded":"2024-05-08T18:32:46.861066+0000","last_fullsized":"2024-05-08T18:32:46.861066+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:57:14.869860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"93'10","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.079768+0000","last_change":"2024-05-08T18:29:40.554005+0000","last_active":"2024-05-08T18:32:47.079768+0000","last_peered":"2024-05-08T18:32:47.079768+0000","last_clean":"2024-05-08T18:32:47.079768+0000","last_became_active":"2024-05-08T18:29:40.553356+0000","last_became_peered":"2024-05-08T18:29:40.553356+0000","last_unstale":"2024-05-08T18:32:47.079768+0000","last_undegraded":"2024-05-08T18:32:47.079768+0000","last_fullsized":"2024-05-08T18:32:47.079768+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:08:13.006752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"84'2","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.059942+0000","last_change":"2024-05-08T18:29:42.566487+0000","last_active":"2024-05-08T18:32:46.059942+0000","last_peered":"2024-05-08T18:32:46.059942+0000","last_clean":"2024-05-08T18:32:46.059942+0000","last_became_active":"2024-05-08T18:29:42.565760+0000","last_became_peered":"2024-05-08T18:29:42.565760+0000","last_unstale":"2024-05-08T18:32:46.059942+0000","last_undegraded":"2024-05-08T18:32:46.059942+0000","last_fullsized":"2024-05-08T18:32:46.059942+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:57.706167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"93'8","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.062985+0000","last_change":"2024-05-08T18:29:40.552543+0000","last_active":"2024-05-08T18:32:46.062985+0000","last_peered":"2024-05-08T18:32:46.062985+0000","last_clean":"2024-05-08T18:32:46.062985+0000","last_became_active":"2024-05-08T18:29:40.552307+0000","last_became_peered":"2024-05-08T18:29:40.552307+0000","last_unstale":"2024-05-08T18:32:46.062985+0000","last_undegraded":"2024-05-08T18:32:46.062985+0000","last_fullsized":"2024-05-08T18:32:46.062985+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:48.294532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"84'4","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.063759+0000","last_change":"2024-05-08T18:29:42.561658+0000","last_active":"2024-05-08T18:32:46.063759+0000","last_peered":"2024-05-08T18:32:46.063759+0000","last_clean":"2024-05-08T18:32:46.063759+0000","last_became_active":"2024-05-08T18:29:42.561171+0000","last_became_peered":"2024-05-08T18:29:42.561171+0000","last_unstale":"2024-05-08T18:32:46.063759+0000","last_undegraded":"2024-05-08T18:32:46.063759+0000","last_fullsized":"2024-05-08T18:32:46.063759+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:15.966061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"93'10","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.079096+0000","last_change":"2024-05-08T18:29:40.543041+0000","last_active":"2024-05-08T18:32:47.079096+0000","last_peered":"2024-05-08T18:32:47.079096+0000","last_clean":"2024-05-08T18:32:47.079096+0000","last_became_active":"2024-05-08T18:29:40.542398+0000","last_became_peered":"2024-05-08T18:29:40.542398+0000","last_unstale":"2024-05-08T18:32:47.079096+0000","last_undegraded":"2024-05-08T18:32:47.079096+0000","last_fullsized":"2024-05-08T18:32:47.079096+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:33.017750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"97'6","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.060280+0000","last_change":"2024-05-08T18:29:42.579690+0000","last_active":"2024-05-08T18:32:46.060280+0000","last_peered":"2024-05-08T18:32:46.060280+0000","last_clean":"2024-05-08T18:32:46.060280+0000","last_became_active":"2024-05-08T18:29:42.578981+0000","last_became_peered":"2024-05-08T18:29:42.578981+0000","last_unstale":"2024-05-08T18:32:46.060280+0000","last_undegraded":"2024-05-08T18:32:46.060280+0000","last_fullsized":"2024-05-08T18:32:46.060280+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:36:03.084561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"93'11","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.862989+0000","last_change":"2024-05-08T18:29:40.548499+0000","last_active":"2024-05-08T18:32:46.862989+0000","last_peered":"2024-05-08T18:32:46.862989+0000","last_clean":"2024-05-08T18:32:46.862989+0000","last_became_active":"2024-05-08T18:29:40.548177+0000","last_became_peered":"2024-05-08T18:29:40.548177+0000","last_unstale":"2024-05-08T18:32:46.862989+0000","last_undegraded":"2024-05-08T18:32:46.862989+0000","last_fullsized":"2024-05-08T18:32:46.862989+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:27:41.414153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"80'2","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.934939+0000","last_change":"2024-05-08T18:29:42.575892+0000","last_active":"2024-05-08T18:32:46.934939+0000","last_peered":"2024-05-08T18:32:46.934939+0000","last_clean":"2024-05-08T18:32:46.934939+0000","last_became_active":"2024-05-08T18:29:42.573384+0000","last_became_peered":"2024-05-08T18:29:42.573384+0000","last_unstale":"2024-05-08T18:32:46.934939+0000","last_undegraded":"2024-05-08T18:32:46.934939+0000","last_fullsized":"2024-05-08T18:32:46.934939+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:55.055481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"93'9","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.849826+0000","last_change":"2024-05-08T18:29:40.565068+0000","last_active":"2024-05-08T18:32:46.849826+0000","last_peered":"2024-05-08T18:32:46.849826+0000","last_clean":"2024-05-08T18:32:46.849826+0000","last_became_active":"2024-05-08T18:29:40.563231+0000","last_became_peered":"2024-05-08T18:29:40.563231+0000","last_unstale":"2024-05-08T18:32:46.849826+0000","last_undegraded":"2024-05-08T18:32:46.849826+0000","last_fullsized":"2024-05-08T18:32:46.849826+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:17:47.828990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.862573+0000","last_change":"2024-05-08T18:29:42.564338+0000","last_active":"2024-05-08T18:32:46.862573+0000","last_peered":"2024-05-08T18:32:46.862573+0000","last_clean":"2024-05-08T18:32:46.862573+0000","last_became_active":"2024-05-08T18:29:42.563822+0000","last_became_peered":"2024-05-08T18:29:42.563822+0000","last_unstale":"2024-05-08T18:32:46.862573+0000","last_undegraded":"2024-05-08T18:32:46.862573+0000","last_fullsized":"2024-05-08T18:32:46.862573+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:23.397435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"93'14","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.938359+0000","last_change":"2024-05-08T18:29:40.573333+0000","last_active":"2024-05-08T18:32:46.938359+0000","last_peered":"2024-05-08T18:32:46.938359+0000","last_clean":"2024-05-08T18:32:46.938359+0000","last_became_active":"2024-05-08T18:29:40.571195+0000","last_became_peered":"2024-05-08T18:29:40.571195+0000","last_unstale":"2024-05-08T18:32:46.938359+0000","last_undegraded":"2024-05-08T18:32:46.938359+0000","last_fullsized":"2024-05-08T18:32:46.938359+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:33.017750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.061746+0000","last_change":"2024-05-08T18:29:42.563085+0000","last_active":"2024-05-08T18:32:46.061746+0000","last_peered":"2024-05-08T18:32:46.061746+0000","last_clean":"2024-05-08T18:32:46.061746+0000","last_became_active":"2024-05-08T18:29:42.560419+0000","last_became_peered":"2024-05-08T18:29:42.560419+0000","last_unstale":"2024-05-08T18:32:46.061746+0000","last_undegraded":"2024-05-08T18:32:46.061746+0000","last_fullsized":"2024-05-08T18:32:46.061746+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:20.397730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"93'10","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.064712+0000","last_change":"2024-05-08T18:29:40.568890+0000","last_active":"2024-05-08T18:32:46.064712+0000","last_peered":"2024-05-08T18:32:46.064712+0000","last_clean":"2024-05-08T18:32:46.064712+0000","last_became_active":"2024-05-08T18:29:40.568584+0000","last_became_peered":"2024-05-08T18:29:40.568584+0000","last_unstale":"2024-05-08T18:32:46.064712+0000","last_undegraded":"2024-05-08T18:32:46.064712+0000","last_fullsized":"2024-05-08T18:32:46.064712+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:25:01.595224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"83'6","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.934923+0000","last_change":"2024-05-08T18:29:42.574277+0000","last_active":"2024-05-08T18:32:46.934923+0000","last_peered":"2024-05-08T18:32:46.934923+0000","last_clean":"2024-05-08T18:32:46.934923+0000","last_became_active":"2024-05-08T18:29:42.573563+0000","last_became_peered":"2024-05-08T18:29:42.573563+0000","last_unstale":"2024-05-08T18:32:46.934923+0000","last_undegraded":"2024-05-08T18:32:46.934923+0000","last_fullsized":"2024-05-08T18:32:46.934923+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:57.706167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"93'8","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.080783+0000","last_change":"2024-05-08T18:29:40.562058+0000","last_active":"2024-05-08T18:32:47.080783+0000","last_peered":"2024-05-08T18:32:47.080783+0000","last_clean":"2024-05-08T18:32:47.080783+0000","last_became_active":"2024-05-08T18:29:40.561360+0000","last_became_peered":"2024-05-08T18:29:40.561360+0000","last_unstale":"2024-05-08T18:32:47.080783+0000","last_undegraded":"2024-05-08T18:32:47.080783+0000","last_fullsized":"2024-05-08T18:32:47.080783+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:05.929806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"93'12","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.079443+0000","last_change":"2024-05-08T18:29:40.538728+0000","last_active":"2024-05-08T18:32:47.079443+0000","last_peered":"2024-05-08T18:32:47.079443+0000","last_clean":"2024-05-08T18:32:47.079443+0000","last_became_active":"2024-05-08T18:29:40.537925+0000","last_became_peered":"2024-05-08T18:29:40.537925+0000","last_unstale":"2024-05-08T18:32:47.079443+0000","last_undegraded":"2024-05-08T18:32:47.079443+0000","last_fullsized":"2024-05-08T18:32:47.079443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:28.426657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":3,"num_read_kb":4,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"97'8","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.861235+0000","last_change":"2024-05-08T18:29:42.574941+0000","last_active":"2024-05-08T18:32:46.861235+0000","last_peered":"2024-05-08T18:32:46.861235+0000","last_clean":"2024-05-08T18:32:46.861235+0000","last_became_active":"2024-05-08T18:29:42.574351+0000","last_became_peered":"2024-05-08T18:29:42.574351+0000","last_unstale":"2024-05-08T18:32:46.861235+0000","last_undegraded":"2024-05-08T18:32:46.861235+0000","last_fullsized":"2024-05-08T18:32:46.861235+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:21.935293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"93'10","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.917647+0000","last_change":"2024-05-08T18:29:40.543714+0000","last_active":"2024-05-08T18:32:46.917647+0000","last_peered":"2024-05-08T18:32:46.917647+0000","last_clean":"2024-05-08T18:32:46.917647+0000","last_became_active":"2024-05-08T18:29:40.542965+0000","last_became_peered":"2024-05-08T18:29:40.542965+0000","last_unstale":"2024-05-08T18:32:46.917647+0000","last_undegraded":"2024-05-08T18:32:46.917647+0000","last_fullsized":"2024-05-08T18:32:46.917647+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:12:59.146887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.080411+0000","last_change":"2024-05-08T18:29:42.560007+0000","last_active":"2024-05-08T18:32:47.080411+0000","last_peered":"2024-05-08T18:32:47.080411+0000","last_clean":"2024-05-08T18:32:47.080411+0000","last_became_active":"2024-05-08T18:29:42.559028+0000","last_became_peered":"2024-05-08T18:29:42.559028+0000","last_unstale":"2024-05-08T18:32:47.080411+0000","last_undegraded":"2024-05-08T18:32:47.080411+0000","last_fullsized":"2024-05-08T18:32:47.080411+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:36:03.084561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":247,"num_read_kb":238,"num_write":231,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":816,"ondisk_log_size":816,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":156300,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":814,"num_read_kb":576,"num_write":459,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":272740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":668,"ondisk_log_size":668,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":334,"num_read_kb":334,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":579,"num_read_kb":555,"num_write":234,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":222,"ondisk_log_size":222,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":2397044736,"num_objects":572,"num_object_clones":0,"num_object_copies":1144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":572,"num_whiteouts":0,"num_read":21,"num_read_kb":23,"num_write":644,"num_write_kb":2365440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4794089472,"data_stored":4794089472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":584,"ondisk_log_size":584,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509488,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":686464,"kb_used_data":655288,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93685376,"statfs":{"total":96636764160,"available":95933825024,"internally_reserved":0,"allocated":671014912,"data_stored":670390943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509488,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":423716,"kb_used_data":392540,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93948124,"statfs":{"total":96636764160,"available":96202878976,"internally_reserved":0,"allocated":401960960,"data_stored":401364459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509486,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":794532,"kb_used_data":763356,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93577308,"statfs":{"total":96636764160,"available":95823163392,"internally_reserved":0,"allocated":781676544,"data_stored":781024259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509486,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":683812,"kb_used_data":652624,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93688028,"statfs":{"total":96636764160,"available":95936540672,"internally_reserved":0,"allocated":668286976,"data_stored":667702261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542191,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":683956,"kb_used_data":652780,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93687884,"statfs":{"total":96636764160,"available":95936393216,"internally_reserved":0,"allocated":668446720,"data_stored":667824622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542191,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":487200,"kb_used_data":456024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93884640,"statfs":{"total":96636764160,"available":96137871360,"internally_reserved":0,"allocated":466968576,"data_stored":466377162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542189,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":438084,"kb_used_data":406908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93933756,"statfs":{"total":96636764160,"available":96188166144,"internally_reserved":0,"allocated":416673792,"data_stored":416055978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542191,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":745916,"kb_used_data":714728,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93625924,"statfs":{"total":96636764160,"available":95872946176,"internally_reserved":0,"allocated":731881472,"data_stored":731267394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":729808896,"data_stored":729808896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":415236096,"data_stored":415236096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":465567744,"data_stored":465567744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":666894336,"data_stored":666894336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":666894336,"data_stored":666894336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":780140544,"data_stored":780140544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":400556032,"data_stored":400556032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":668991488,"data_stored":668991488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":59088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":12223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":176128,"data_stored":122673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":75918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T18:32:58.394 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T18:32:58.733 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-05-08T18:32:58.733 INFO:teuthology.orchestra.run.smithi097.stdout:{"epoch":116,"fsid":"f135278e-f589-4ad6-a830-fa767ff99171","created":"2024-05-08T18:29:14.813384+0000","modified":"2024-05-08T18:32:46.043081+0000","last_up_change":"2024-05-08T18:29:26.091102+0000","last_in_change":"2024-05-08T18:29:17.082151+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T18:29:25.443461+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-05-08T18:29:32.943859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-05-08T18:29:39.147224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-05-08T18:29:40.891936+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-05-08T18:29:42.925519+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-05-08T18:29:44.727411+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-05-08T18:29:46.621438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-05-08T18:29:48.780230+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f135796c-f80c-43a8-889d-e0927bcc3d0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":2064534873},{"type":"v1","addr":"172.21.15.97:6801","nonce":2064534873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":2064534873},{"type":"v1","addr":"172.21.15.97:6803","nonce":2064534873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":2064534873},{"type":"v1","addr":"172.21.15.97:6807","nonce":2064534873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":2064534873},{"type":"v1","addr":"172.21.15.97:6805","nonce":2064534873}]},"public_addr":"172.21.15.97:6801/2064534873","cluster_addr":"172.21.15.97:6803/2064534873","heartbeat_back_addr":"172.21.15.97:6807/2064534873","heartbeat_front_addr":"172.21.15.97:6805/2064534873","state":["exists","up"]},{"osd":1,"uuid":"b91d895a-2b40-45c1-b355-52dba17032cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6813","nonce":34364184},{"type":"v1","addr":"172.21.15.97:6815","nonce":34364184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6818","nonce":34364184},{"type":"v1","addr":"172.21.15.97:6819","nonce":34364184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6822","nonce":34364184},{"type":"v1","addr":"172.21.15.97:6823","nonce":34364184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6820","nonce":34364184},{"type":"v1","addr":"172.21.15.97:6821","nonce":34364184}]},"public_addr":"172.21.15.97:6815/34364184","cluster_addr":"172.21.15.97:6819/34364184","heartbeat_back_addr":"172.21.15.97:6823/34364184","heartbeat_front_addr":"172.21.15.97:6821/34364184","state":["exists","up"]},{"osd":2,"uuid":"35f12106-8d9a-4dcb-a8bc-38e08c81bd5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6808","nonce":3004545111},{"type":"v1","addr":"172.21.15.97:6809","nonce":3004545111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6810","nonce":3004545111},{"type":"v1","addr":"172.21.15.97:6811","nonce":3004545111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6816","nonce":3004545111},{"type":"v1","addr":"172.21.15.97:6817","nonce":3004545111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6812","nonce":3004545111},{"type":"v1","addr":"172.21.15.97:6814","nonce":3004545111}]},"public_addr":"172.21.15.97:6809/3004545111","cluster_addr":"172.21.15.97:6811/3004545111","heartbeat_back_addr":"172.21.15.97:6817/3004545111","heartbeat_front_addr":"172.21.15.97:6814/3004545111","state":["exists","up"]},{"osd":3,"uuid":"cd78d341-ec40-457e-a713-555b03bc9f16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6824","nonce":1855786157},{"type":"v1","addr":"172.21.15.97:6825","nonce":1855786157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6826","nonce":1855786157},{"type":"v1","addr":"172.21.15.97:6827","nonce":1855786157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6830","nonce":1855786157},{"type":"v1","addr":"172.21.15.97:6831","nonce":1855786157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6828","nonce":1855786157},{"type":"v1","addr":"172.21.15.97:6829","nonce":1855786157}]},"public_addr":"172.21.15.97:6825/1855786157","cluster_addr":"172.21.15.97:6827/1855786157","heartbeat_back_addr":"172.21.15.97:6831/1855786157","heartbeat_front_addr":"172.21.15.97:6829/1855786157","state":["exists","up"]},{"osd":4,"uuid":"469d890e-5e0c-41cd-ac5b-ef987b70abd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":1246653692},{"type":"v1","addr":"172.21.15.151:6810","nonce":1246653692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":1246653692},{"type":"v1","addr":"172.21.15.151:6814","nonce":1246653692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":1246653692},{"type":"v1","addr":"172.21.15.151:6822","nonce":1246653692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":1246653692},{"type":"v1","addr":"172.21.15.151:6818","nonce":1246653692}]},"public_addr":"172.21.15.151:6810/1246653692","cluster_addr":"172.21.15.151:6814/1246653692","heartbeat_back_addr":"172.21.15.151:6822/1246653692","heartbeat_front_addr":"172.21.15.151:6818/1246653692","state":["exists","up"]},{"osd":5,"uuid":"dcb25c08-802c-4140-a3d2-929960319860","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":4257184226},{"type":"v1","addr":"172.21.15.151:6811","nonce":4257184226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6813","nonce":4257184226},{"type":"v1","addr":"172.21.15.151:6815","nonce":4257184226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6821","nonce":4257184226},{"type":"v1","addr":"172.21.15.151:6823","nonce":4257184226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6817","nonce":4257184226},{"type":"v1","addr":"172.21.15.151:6819","nonce":4257184226}]},"public_addr":"172.21.15.151:6811/4257184226","cluster_addr":"172.21.15.151:6815/4257184226","heartbeat_back_addr":"172.21.15.151:6823/4257184226","heartbeat_front_addr":"172.21.15.151:6819/4257184226","state":["exists","up"]},{"osd":6,"uuid":"598ab572-7049-4600-9e91-1792360421d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":974202886},{"type":"v1","addr":"172.21.15.151:6801","nonce":974202886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":974202886},{"type":"v1","addr":"172.21.15.151:6803","nonce":974202886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":974202886},{"type":"v1","addr":"172.21.15.151:6807","nonce":974202886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":974202886},{"type":"v1","addr":"172.21.15.151:6805","nonce":974202886}]},"public_addr":"172.21.15.151:6801/974202886","cluster_addr":"172.21.15.151:6803/974202886","heartbeat_back_addr":"172.21.15.151:6807/974202886","heartbeat_front_addr":"172.21.15.151:6805/974202886","state":["exists","up"]},{"osd":7,"uuid":"c21805e0-4945-4efe-8e65-68bb92d30b69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":2584927373},{"type":"v1","addr":"172.21.15.151:6825","nonce":2584927373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2584927373},{"type":"v1","addr":"172.21.15.151:6827","nonce":2584927373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2584927373},{"type":"v1","addr":"172.21.15.151:6831","nonce":2584927373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2584927373},{"type":"v1","addr":"172.21.15.151:6829","nonce":2584927373}]},"public_addr":"172.21.15.151:6825/2584927373","cluster_addr":"172.21.15.151:6827/2584927373","heartbeat_back_addr":"172.21.15.151:6831/2584927373","heartbeat_front_addr":"172.21.15.151:6829/2584927373","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:29:22.299407+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:29:22.487701+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:29:22.371789+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:29:22.160484+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:29:22.674077+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:29:22.713456+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:29:22.587563+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:29:22.751830+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"4.4","osds":[1,6]}],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.25","mappings":[{"from":3,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"4.0","mappings":[{"from":3,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T18:32:59.752 INFO:tasks.ceph:Scrubbing osd.0 2024-05-08T18:32:59.753 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-05-08T18:32:59.914 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:32:59.914 INFO:teuthology.orchestra.run.smithi097.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T18:32:59.915 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:32:59.931 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-05-08T18:33:00.226 INFO:teuthology.orchestra.run.smithi097.stderr:instructed osd(s) 0 to deep-scrub 2024-05-08T18:33:00.246 INFO:tasks.ceph:Scrubbing osd.1 2024-05-08T18:33:00.247 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-05-08T18:33:00.398 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:33:00.398 INFO:teuthology.orchestra.run.smithi097.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T18:33:00.398 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:33:00.415 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-05-08T18:33:00.707 INFO:teuthology.orchestra.run.smithi097.stderr:instructed osd(s) 1 to deep-scrub 2024-05-08T18:33:00.727 INFO:tasks.ceph:Scrubbing osd.2 2024-05-08T18:33:00.727 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-05-08T18:33:00.873 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:33:00.873 INFO:teuthology.orchestra.run.smithi097.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T18:33:00.873 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:33:00.889 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-05-08T18:33:01.178 INFO:teuthology.orchestra.run.smithi097.stderr:instructed osd(s) 2 to deep-scrub 2024-05-08T18:33:01.198 INFO:tasks.ceph:Scrubbing osd.3 2024-05-08T18:33:01.199 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-05-08T18:33:01.349 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:33:01.349 INFO:teuthology.orchestra.run.smithi097.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T18:33:01.350 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:33:01.366 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-05-08T18:33:01.662 INFO:teuthology.orchestra.run.smithi097.stderr:instructed osd(s) 3 to deep-scrub 2024-05-08T18:33:01.680 INFO:tasks.ceph:Scrubbing osd.4 2024-05-08T18:33:01.680 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-05-08T18:33:01.831 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:33:01.831 INFO:teuthology.orchestra.run.smithi097.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T18:33:01.831 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:33:01.847 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-05-08T18:33:02.124 INFO:teuthology.orchestra.run.smithi097.stderr:instructed osd(s) 4 to deep-scrub 2024-05-08T18:33:02.141 INFO:tasks.ceph:Scrubbing osd.5 2024-05-08T18:33:02.142 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-05-08T18:33:02.295 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:33:02.295 INFO:teuthology.orchestra.run.smithi097.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T18:33:02.295 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:33:02.311 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-05-08T18:33:02.436 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 has been restored 2024-05-08T18:33:02.586 INFO:teuthology.orchestra.run.smithi097.stderr:instructed osd(s) 5 to deep-scrub 2024-05-08T18:33:02.604 INFO:tasks.ceph:Scrubbing osd.6 2024-05-08T18:33:02.604 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-05-08T18:33:02.748 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:33:02.748 INFO:teuthology.orchestra.run.smithi097.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T18:33:02.748 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:33:02.764 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-05-08T18:33:03.054 INFO:teuthology.orchestra.run.smithi097.stderr:instructed osd(s) 6 to deep-scrub 2024-05-08T18:33:03.073 INFO:tasks.ceph:Scrubbing osd.7 2024-05-08T18:33:03.073 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-05-08T18:33:03.216 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-05-08T18:33:03.217 INFO:teuthology.orchestra.run.smithi097.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T18:33:03.217 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-05-08T18:33:03.232 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-05-08T18:33:03.520 INFO:teuthology.orchestra.run.smithi097.stderr:instructed osd(s) 7 to deep-scrub 2024-05-08T18:33:03.540 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T18:33:03.840 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-05-08T18:33:03.852 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2024-05-08T18:33:03.858 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":218,"stamp":"2024-05-08T18:33:03.479774+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":615613,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":2853,"num_read_kb":2285,"num_write":2325,"num_write_kb":2367366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3178,"ondisk_log_size":3178,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":261928,"kb_used_data":12232,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754712792,"statfs":{"total":773094113280,"available":772825899008,"internally_reserved":0,"allocated":12525568,"data_stored":7652270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2397177404,"num_objects":-572,"num_object_clones":0,"num_object_copies":-1144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-572,"num_whiteouts":0,"num_read":792,"num_read_kb":504,"num_write":646,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006498"},"pg_stats":[{"pgid":"3.3f","version":"116'20","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.111829+0000","last_change":"2024-05-08T18:29:40.574221+0000","last_active":"2024-05-08T18:32:57.111829+0000","last_peered":"2024-05-08T18:32:57.111829+0000","last_clean":"2024-05-08T18:32:57.111829+0000","last_became_active":"2024-05-08T18:29:40.573543+0000","last_became_peered":"2024-05-08T18:29:40.573543+0000","last_unstale":"2024-05-08T18:32:57.111829+0000","last_undegraded":"2024-05-08T18:32:57.111829+0000","last_fullsized":"2024-05-08T18:32:57.111829+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:57.223609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":20,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"97'2","reported_seq":197,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.077734+0000","last_change":"2024-05-08T18:29:42.563773+0000","last_active":"2024-05-08T18:32:47.077734+0000","last_peered":"2024-05-08T18:32:47.077734+0000","last_clean":"2024-05-08T18:32:47.077734+0000","last_became_active":"2024-05-08T18:29:42.561201+0000","last_became_peered":"2024-05-08T18:29:42.561201+0000","last_unstale":"2024-05-08T18:32:47.077734+0000","last_undegraded":"2024-05-08T18:32:47.077734+0000","last_fullsized":"2024-05-08T18:32:47.077734+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:55.055481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"116'20","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.101493+0000","last_change":"2024-05-08T18:29:40.549299+0000","last_active":"2024-05-08T18:32:57.101493+0000","last_peered":"2024-05-08T18:32:57.101493+0000","last_clean":"2024-05-08T18:32:57.101493+0000","last_became_active":"2024-05-08T18:29:40.548930+0000","last_became_peered":"2024-05-08T18:29:40.548930+0000","last_unstale":"2024-05-08T18:32:57.101493+0000","last_undegraded":"2024-05-08T18:32:57.101493+0000","last_fullsized":"2024-05-08T18:32:57.101493+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:06:36.198647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"84'2","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.936351+0000","last_change":"2024-05-08T18:29:42.572074+0000","last_active":"2024-05-08T18:32:46.936351+0000","last_peered":"2024-05-08T18:32:46.936351+0000","last_clean":"2024-05-08T18:32:46.936351+0000","last_became_active":"2024-05-08T18:29:42.571344+0000","last_became_peered":"2024-05-08T18:29:42.571344+0000","last_unstale":"2024-05-08T18:32:46.936351+0000","last_undegraded":"2024-05-08T18:32:46.936351+0000","last_fullsized":"2024-05-08T18:32:46.936351+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:36.890277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"116'26","reported_seq":225,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.156070+0000","last_change":"2024-05-08T18:29:40.539048+0000","last_active":"2024-05-08T18:32:57.156070+0000","last_peered":"2024-05-08T18:32:57.156070+0000","last_clean":"2024-05-08T18:32:57.156070+0000","last_became_active":"2024-05-08T18:29:40.538458+0000","last_became_peered":"2024-05-08T18:29:40.538458+0000","last_unstale":"2024-05-08T18:32:57.156070+0000","last_undegraded":"2024-05-08T18:32:57.156070+0000","last_fullsized":"2024-05-08T18:32:57.156070+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":4,"num_write":36,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.058600+0000","last_change":"2024-05-08T18:29:42.569718+0000","last_active":"2024-05-08T18:32:46.058600+0000","last_peered":"2024-05-08T18:32:46.058600+0000","last_clean":"2024-05-08T18:32:46.058600+0000","last_became_active":"2024-05-08T18:29:42.569026+0000","last_became_peered":"2024-05-08T18:29:42.569026+0000","last_unstale":"2024-05-08T18:32:46.058600+0000","last_undegraded":"2024-05-08T18:32:46.058600+0000","last_fullsized":"2024-05-08T18:32:46.058600+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:42.045615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"116'16","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.147242+0000","last_change":"2024-05-08T18:29:40.557700+0000","last_active":"2024-05-08T18:32:57.147242+0000","last_peered":"2024-05-08T18:32:57.147242+0000","last_clean":"2024-05-08T18:32:57.147242+0000","last_became_active":"2024-05-08T18:29:40.556884+0000","last_became_peered":"2024-05-08T18:29:40.556884+0000","last_unstale":"2024-05-08T18:32:57.147242+0000","last_undegraded":"2024-05-08T18:32:57.147242+0000","last_fullsized":"2024-05-08T18:32:57.147242+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:21:38.354933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.861276+0000","last_change":"2024-05-08T18:29:42.566448+0000","last_active":"2024-05-08T18:32:46.861276+0000","last_peered":"2024-05-08T18:32:46.861276+0000","last_clean":"2024-05-08T18:32:46.861276+0000","last_became_active":"2024-05-08T18:29:42.566058+0000","last_became_peered":"2024-05-08T18:29:42.566058+0000","last_unstale":"2024-05-08T18:32:46.861276+0000","last_undegraded":"2024-05-08T18:32:46.861276+0000","last_fullsized":"2024-05-08T18:32:46.861276+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"116'10","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.073120+0000","last_change":"2024-05-08T18:29:40.571195+0000","last_active":"2024-05-08T18:32:57.073120+0000","last_peered":"2024-05-08T18:32:57.073120+0000","last_clean":"2024-05-08T18:32:57.073120+0000","last_became_active":"2024-05-08T18:29:40.570467+0000","last_became_peered":"2024-05-08T18:29:40.570467+0000","last_unstale":"2024-05-08T18:32:57.073120+0000","last_undegraded":"2024-05-08T18:32:57.073120+0000","last_fullsized":"2024-05-08T18:32:57.073120+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:39.986094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.849586+0000","last_change":"2024-05-08T18:29:42.566506+0000","last_active":"2024-05-08T18:32:46.849586+0000","last_peered":"2024-05-08T18:32:46.849586+0000","last_clean":"2024-05-08T18:32:46.849586+0000","last_became_active":"2024-05-08T18:29:42.565740+0000","last_became_peered":"2024-05-08T18:29:42.565740+0000","last_unstale":"2024-05-08T18:32:46.849586+0000","last_undegraded":"2024-05-08T18:32:46.849586+0000","last_fullsized":"2024-05-08T18:32:46.849586+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:58.320701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"116'14","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.056922+0000","last_change":"2024-05-08T18:29:40.538314+0000","last_active":"2024-05-08T18:32:57.056922+0000","last_peered":"2024-05-08T18:32:57.056922+0000","last_clean":"2024-05-08T18:32:57.056922+0000","last_became_active":"2024-05-08T18:29:40.537458+0000","last_became_peered":"2024-05-08T18:29:40.537458+0000","last_unstale":"2024-05-08T18:32:57.056922+0000","last_undegraded":"2024-05-08T18:32:57.056922+0000","last_fullsized":"2024-05-08T18:32:57.056922+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:56.300986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.059543+0000","last_change":"2024-05-08T18:29:42.570054+0000","last_active":"2024-05-08T18:32:46.059543+0000","last_peered":"2024-05-08T18:32:46.059543+0000","last_clean":"2024-05-08T18:32:46.059543+0000","last_became_active":"2024-05-08T18:29:42.569255+0000","last_became_peered":"2024-05-08T18:29:42.569255+0000","last_unstale":"2024-05-08T18:32:46.059543+0000","last_undegraded":"2024-05-08T18:32:46.059543+0000","last_fullsized":"2024-05-08T18:32:46.059543+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:11:01.702482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"116'36","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.106244+0000","last_change":"2024-05-08T18:30:21.210397+0000","last_active":"2024-05-08T18:32:57.106244+0000","last_peered":"2024-05-08T18:32:57.106244+0000","last_clean":"2024-05-08T18:32:57.106244+0000","last_became_active":"2024-05-08T18:30:21.210052+0000","last_became_peered":"2024-05-08T18:30:21.210052+0000","last_unstale":"2024-05-08T18:32:57.106244+0000","last_undegraded":"2024-05-08T18:32:57.106244+0000","last_fullsized":"2024-05-08T18:32:57.106244+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:51:05.355593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"97'4","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.080135+0000","last_change":"2024-05-08T18:29:42.562084+0000","last_active":"2024-05-08T18:32:47.080135+0000","last_peered":"2024-05-08T18:32:47.080135+0000","last_clean":"2024-05-08T18:32:47.080135+0000","last_became_active":"2024-05-08T18:29:42.560699+0000","last_became_peered":"2024-05-08T18:29:42.560699+0000","last_unstale":"2024-05-08T18:32:47.080135+0000","last_undegraded":"2024-05-08T18:32:47.080135+0000","last_fullsized":"2024-05-08T18:32:47.080135+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:09.787597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"116'26","reported_seq":223,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.124676+0000","last_change":"2024-05-08T18:29:40.564339+0000","last_active":"2024-05-08T18:32:57.124676+0000","last_peered":"2024-05-08T18:32:57.124676+0000","last_clean":"2024-05-08T18:32:57.124676+0000","last_became_active":"2024-05-08T18:29:40.564038+0000","last_became_peered":"2024-05-08T18:29:40.564038+0000","last_unstale":"2024-05-08T18:32:57.124676+0000","last_undegraded":"2024-05-08T18:32:57.124676+0000","last_fullsized":"2024-05-08T18:32:57.124676+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:40:23.287885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":26,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"84'8","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.064487+0000","last_change":"2024-05-08T18:29:42.570253+0000","last_active":"2024-05-08T18:32:46.064487+0000","last_peered":"2024-05-08T18:32:46.064487+0000","last_clean":"2024-05-08T18:32:46.064487+0000","last_became_active":"2024-05-08T18:29:42.569917+0000","last_became_peered":"2024-05-08T18:29:42.569917+0000","last_unstale":"2024-05-08T18:32:46.064487+0000","last_undegraded":"2024-05-08T18:32:46.064487+0000","last_fullsized":"2024-05-08T18:32:46.064487+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:14:45.575219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"84'4","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.057705+0000","last_change":"2024-05-08T18:29:42.568116+0000","last_active":"2024-05-08T18:32:46.057705+0000","last_peered":"2024-05-08T18:32:46.057705+0000","last_clean":"2024-05-08T18:32:46.057705+0000","last_became_active":"2024-05-08T18:29:42.567399+0000","last_became_peered":"2024-05-08T18:29:42.567399+0000","last_unstale":"2024-05-08T18:32:46.057705+0000","last_undegraded":"2024-05-08T18:32:46.057705+0000","last_fullsized":"2024-05-08T18:32:46.057705+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:35.037465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"116'26","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.126304+0000","last_change":"2024-05-08T18:29:40.571982+0000","last_active":"2024-05-08T18:32:57.126304+0000","last_peered":"2024-05-08T18:32:57.126304+0000","last_clean":"2024-05-08T18:32:57.126304+0000","last_became_active":"2024-05-08T18:29:40.570600+0000","last_became_peered":"2024-05-08T18:29:40.570600+0000","last_unstale":"2024-05-08T18:32:57.126304+0000","last_undegraded":"2024-05-08T18:32:57.126304+0000","last_fullsized":"2024-05-08T18:32:57.126304+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:54:14.520118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":26,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"80'2","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.936574+0000","last_change":"2024-05-08T18:29:42.578449+0000","last_active":"2024-05-08T18:32:46.936574+0000","last_peered":"2024-05-08T18:32:46.936574+0000","last_clean":"2024-05-08T18:32:46.936574+0000","last_became_active":"2024-05-08T18:29:42.577789+0000","last_became_peered":"2024-05-08T18:29:42.577789+0000","last_unstale":"2024-05-08T18:32:46.936574+0000","last_undegraded":"2024-05-08T18:32:46.936574+0000","last_fullsized":"2024-05-08T18:32:46.936574+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:09.787597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"116'16","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.172115+0000","last_change":"2024-05-08T18:29:40.570618+0000","last_active":"2024-05-08T18:32:57.172115+0000","last_peered":"2024-05-08T18:32:57.172115+0000","last_clean":"2024-05-08T18:32:57.172115+0000","last_became_active":"2024-05-08T18:29:40.569519+0000","last_became_peered":"2024-05-08T18:29:40.569519+0000","last_unstale":"2024-05-08T18:32:57.172115+0000","last_undegraded":"2024-05-08T18:32:57.172115+0000","last_fullsized":"2024-05-08T18:32:57.172115+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:09:42.581976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.077696+0000","last_change":"2024-05-08T18:29:42.563056+0000","last_active":"2024-05-08T18:32:47.077696+0000","last_peered":"2024-05-08T18:32:47.077696+0000","last_clean":"2024-05-08T18:32:47.077696+0000","last_became_active":"2024-05-08T18:29:42.562296+0000","last_became_peered":"2024-05-08T18:29:42.562296+0000","last_unstale":"2024-05-08T18:32:47.077696+0000","last_undegraded":"2024-05-08T18:32:47.077696+0000","last_fullsized":"2024-05-08T18:32:47.077696+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:36.890277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"116'28","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.120500+0000","last_change":"2024-05-08T18:29:40.564353+0000","last_active":"2024-05-08T18:32:57.120500+0000","last_peered":"2024-05-08T18:32:57.120500+0000","last_clean":"2024-05-08T18:32:57.120500+0000","last_became_active":"2024-05-08T18:29:40.563516+0000","last_became_peered":"2024-05-08T18:29:40.563516+0000","last_unstale":"2024-05-08T18:32:57.120500+0000","last_undegraded":"2024-05-08T18:32:57.120500+0000","last_fullsized":"2024-05-08T18:32:57.120500+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:06:36.198647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":28,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"97'4","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.061368+0000","last_change":"2024-05-08T18:29:42.567006+0000","last_active":"2024-05-08T18:32:46.061368+0000","last_peered":"2024-05-08T18:32:46.061368+0000","last_clean":"2024-05-08T18:32:46.061368+0000","last_became_active":"2024-05-08T18:29:42.566256+0000","last_became_peered":"2024-05-08T18:29:42.566256+0000","last_unstale":"2024-05-08T18:32:46.061368+0000","last_undegraded":"2024-05-08T18:32:46.061368+0000","last_fullsized":"2024-05-08T18:32:46.061368+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:09:44.601690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"116'14","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.114000+0000","last_change":"2024-05-08T18:29:40.573212+0000","last_active":"2024-05-08T18:32:57.114000+0000","last_peered":"2024-05-08T18:32:57.114000+0000","last_clean":"2024-05-08T18:32:57.114000+0000","last_became_active":"2024-05-08T18:29:40.572250+0000","last_became_peered":"2024-05-08T18:29:40.572250+0000","last_unstale":"2024-05-08T18:32:57.114000+0000","last_undegraded":"2024-05-08T18:32:57.114000+0000","last_fullsized":"2024-05-08T18:32:57.114000+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:25:01.595224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"97'6","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.062431+0000","last_change":"2024-05-08T18:29:42.570847+0000","last_active":"2024-05-08T18:32:46.062431+0000","last_peered":"2024-05-08T18:32:46.062431+0000","last_clean":"2024-05-08T18:32:46.062431+0000","last_became_active":"2024-05-08T18:29:42.570435+0000","last_became_peered":"2024-05-08T18:29:42.570435+0000","last_unstale":"2024-05-08T18:32:46.062431+0000","last_undegraded":"2024-05-08T18:32:46.062431+0000","last_fullsized":"2024-05-08T18:32:46.062431+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:21:40.374647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"116'14","reported_seq":211,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.146123+0000","last_change":"2024-05-08T18:29:40.566815+0000","last_active":"2024-05-08T18:32:57.146123+0000","last_peered":"2024-05-08T18:32:57.146123+0000","last_clean":"2024-05-08T18:32:57.146123+0000","last_became_active":"2024-05-08T18:29:40.566531+0000","last_became_peered":"2024-05-08T18:29:40.566531+0000","last_unstale":"2024-05-08T18:32:57.146123+0000","last_undegraded":"2024-05-08T18:32:57.146123+0000","last_fullsized":"2024-05-08T18:32:57.146123+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:52.462279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"84'8","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.059681+0000","last_change":"2024-05-08T18:29:42.554846+0000","last_active":"2024-05-08T18:32:46.059681+0000","last_peered":"2024-05-08T18:32:46.059681+0000","last_clean":"2024-05-08T18:32:46.059681+0000","last_became_active":"2024-05-08T18:29:42.554115+0000","last_became_peered":"2024-05-08T18:29:42.554115+0000","last_unstale":"2024-05-08T18:32:46.059681+0000","last_undegraded":"2024-05-08T18:32:46.059681+0000","last_fullsized":"2024-05-08T18:32:46.059681+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:22:14.793035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"116'14","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.031542+0000","last_change":"2024-05-08T18:29:40.547776+0000","last_active":"2024-05-08T18:32:57.031542+0000","last_peered":"2024-05-08T18:32:57.031542+0000","last_clean":"2024-05-08T18:32:57.031542+0000","last_became_active":"2024-05-08T18:29:40.547384+0000","last_became_peered":"2024-05-08T18:29:40.547384+0000","last_unstale":"2024-05-08T18:32:57.031542+0000","last_undegraded":"2024-05-08T18:32:57.031542+0000","last_fullsized":"2024-05-08T18:32:57.031542+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"97'10","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.057195+0000","last_change":"2024-05-08T18:29:50.685390+0000","last_active":"2024-05-08T18:32:46.057195+0000","last_peered":"2024-05-08T18:32:46.057195+0000","last_clean":"2024-05-08T18:32:46.057195+0000","last_became_active":"2024-05-08T18:29:50.684644+0000","last_became_peered":"2024-05-08T18:29:50.684644+0000","last_unstale":"2024-05-08T18:32:46.057195+0000","last_undegraded":"2024-05-08T18:32:46.057195+0000","last_fullsized":"2024-05-08T18:32:46.057195+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:10:38.951662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":21,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"84'10","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.066363+0000","last_change":"2024-05-08T18:29:42.573805+0000","last_active":"2024-05-08T18:32:46.066363+0000","last_peered":"2024-05-08T18:32:46.066363+0000","last_clean":"2024-05-08T18:32:46.066363+0000","last_became_active":"2024-05-08T18:29:42.573296+0000","last_became_peered":"2024-05-08T18:29:42.573296+0000","last_unstale":"2024-05-08T18:32:46.066363+0000","last_undegraded":"2024-05-08T18:32:46.066363+0000","last_fullsized":"2024-05-08T18:32:46.066363+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:21.935293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"116'16","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.119521+0000","last_change":"2024-05-08T18:29:40.570733+0000","last_active":"2024-05-08T18:32:57.119521+0000","last_peered":"2024-05-08T18:32:57.119521+0000","last_clean":"2024-05-08T18:32:57.119521+0000","last_became_active":"2024-05-08T18:29:40.569711+0000","last_became_peered":"2024-05-08T18:29:40.569711+0000","last_unstale":"2024-05-08T18:32:57.119521+0000","last_undegraded":"2024-05-08T18:32:57.119521+0000","last_fullsized":"2024-05-08T18:32:57.119521+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:18:08.784274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.079758+0000","last_change":"2024-05-08T18:29:44.594185+0000","last_active":"2024-05-08T18:32:47.079758+0000","last_peered":"2024-05-08T18:32:47.079758+0000","last_clean":"2024-05-08T18:32:47.079758+0000","last_became_active":"2024-05-08T18:29:44.593442+0000","last_became_peered":"2024-05-08T18:29:44.593442+0000","last_unstale":"2024-05-08T18:32:47.079758+0000","last_undegraded":"2024-05-08T18:32:47.079758+0000","last_fullsized":"2024-05-08T18:32:47.079758+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:52:25.736491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"116'18","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:56.931357+0000","last_change":"2024-05-08T18:29:46.594652+0000","last_active":"2024-05-08T18:32:56.931357+0000","last_peered":"2024-05-08T18:32:56.931357+0000","last_clean":"2024-05-08T18:32:56.931357+0000","last_became_active":"2024-05-08T18:29:46.593656+0000","last_became_peered":"2024-05-08T18:29:46.593656+0000","last_unstale":"2024-05-08T18:32:56.931357+0000","last_undegraded":"2024-05-08T18:32:56.931357+0000","last_fullsized":"2024-05-08T18:32:56.931357+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.937817+0000","last_change":"2024-05-08T18:29:48.639834+0000","last_active":"2024-05-08T18:32:46.937817+0000","last_peered":"2024-05-08T18:32:46.937817+0000","last_clean":"2024-05-08T18:32:46.937817+0000","last_became_active":"2024-05-08T18:29:48.639122+0000","last_became_peered":"2024-05-08T18:29:48.639122+0000","last_unstale":"2024-05-08T18:32:46.937817+0000","last_undegraded":"2024-05-08T18:32:46.937817+0000","last_fullsized":"2024-05-08T18:32:46.937817+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:14:22.304773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"83'4","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.077986+0000","last_change":"2024-05-08T18:29:50.672303+0000","last_active":"2024-05-08T18:32:47.077986+0000","last_peered":"2024-05-08T18:32:47.077986+0000","last_clean":"2024-05-08T18:32:47.077986+0000","last_became_active":"2024-05-08T18:29:50.671513+0000","last_became_peered":"2024-05-08T18:29:50.671513+0000","last_unstale":"2024-05-08T18:32:47.077986+0000","last_undegraded":"2024-05-08T18:32:47.077986+0000","last_fullsized":"2024-05-08T18:32:47.077986+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:12:05.780786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"84'4","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.080615+0000","last_change":"2024-05-08T18:29:42.565462+0000","last_active":"2024-05-08T18:32:47.080615+0000","last_peered":"2024-05-08T18:32:47.080615+0000","last_clean":"2024-05-08T18:32:47.080615+0000","last_became_active":"2024-05-08T18:29:42.564741+0000","last_became_peered":"2024-05-08T18:29:42.564741+0000","last_unstale":"2024-05-08T18:32:47.080615+0000","last_undegraded":"2024-05-08T18:32:47.080615+0000","last_fullsized":"2024-05-08T18:32:47.080615+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:25:56.129785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"116'12","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.080026+0000","last_change":"2024-05-08T18:29:40.564796+0000","last_active":"2024-05-08T18:32:57.080026+0000","last_peered":"2024-05-08T18:32:57.080026+0000","last_clean":"2024-05-08T18:32:57.080026+0000","last_became_active":"2024-05-08T18:29:40.564401+0000","last_became_peered":"2024-05-08T18:29:40.564401+0000","last_unstale":"2024-05-08T18:32:57.080026+0000","last_undegraded":"2024-05-08T18:32:57.080026+0000","last_fullsized":"2024-05-08T18:32:57.080026+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":12,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":189,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.065935+0000","last_change":"2024-05-08T18:29:44.587689+0000","last_active":"2024-05-08T18:32:46.065935+0000","last_peered":"2024-05-08T18:32:46.065935+0000","last_clean":"2024-05-08T18:32:46.065935+0000","last_became_active":"2024-05-08T18:29:44.586975+0000","last_became_peered":"2024-05-08T18:29:44.586975+0000","last_unstale":"2024-05-08T18:32:46.065935+0000","last_undegraded":"2024-05-08T18:32:46.065935+0000","last_fullsized":"2024-05-08T18:32:46.065935+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:04:49.020450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"83'7","reported_seq":197,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.059952+0000","last_change":"2024-05-08T18:29:46.600906+0000","last_active":"2024-05-08T18:32:46.059952+0000","last_peered":"2024-05-08T18:32:46.059952+0000","last_clean":"2024-05-08T18:32:46.059952+0000","last_became_active":"2024-05-08T18:29:46.599894+0000","last_became_peered":"2024-05-08T18:29:46.599894+0000","last_unstale":"2024-05-08T18:32:46.059952+0000","last_undegraded":"2024-05-08T18:32:46.059952+0000","last_fullsized":"2024-05-08T18:32:46.059952+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:24:13.568294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.059189+0000","last_change":"2024-05-08T18:29:48.614324+0000","last_active":"2024-05-08T18:32:46.059189+0000","last_peered":"2024-05-08T18:32:46.059189+0000","last_clean":"2024-05-08T18:32:46.059189+0000","last_became_active":"2024-05-08T18:29:48.613591+0000","last_became_peered":"2024-05-08T18:29:48.613591+0000","last_unstale":"2024-05-08T18:32:46.059189+0000","last_undegraded":"2024-05-08T18:32:46.059189+0000","last_fullsized":"2024-05-08T18:32:46.059189+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:47:54.034851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.862696+0000","last_change":"2024-05-08T18:29:50.684773+0000","last_active":"2024-05-08T18:32:46.862696+0000","last_peered":"2024-05-08T18:32:46.862696+0000","last_clean":"2024-05-08T18:32:46.862696+0000","last_became_active":"2024-05-08T18:29:50.683931+0000","last_became_peered":"2024-05-08T18:29:50.683931+0000","last_unstale":"2024-05-08T18:32:46.862696+0000","last_undegraded":"2024-05-08T18:32:46.862696+0000","last_fullsized":"2024-05-08T18:32:46.862696+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"80'2","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.861259+0000","last_change":"2024-05-08T18:29:42.574437+0000","last_active":"2024-05-08T18:32:46.861259+0000","last_peered":"2024-05-08T18:32:46.861259+0000","last_clean":"2024-05-08T18:32:46.861259+0000","last_became_active":"2024-05-08T18:29:42.574146+0000","last_became_peered":"2024-05-08T18:29:42.574146+0000","last_unstale":"2024-05-08T18:32:46.861259+0000","last_undegraded":"2024-05-08T18:32:46.861259+0000","last_fullsized":"2024-05-08T18:32:46.861259+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"116'22","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.075548+0000","last_change":"2024-05-08T18:29:40.559677+0000","last_active":"2024-05-08T18:32:57.075548+0000","last_peered":"2024-05-08T18:32:57.075548+0000","last_clean":"2024-05-08T18:32:57.075548+0000","last_became_active":"2024-05-08T18:29:40.558819+0000","last_became_peered":"2024-05-08T18:29:40.558819+0000","last_unstale":"2024-05-08T18:32:57.075548+0000","last_undegraded":"2024-05-08T18:32:57.075548+0000","last_fullsized":"2024-05-08T18:32:57.075548+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:28.426657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":189,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.067875+0000","last_change":"2024-05-08T18:29:44.596801+0000","last_active":"2024-05-08T18:32:46.067875+0000","last_peered":"2024-05-08T18:32:46.067875+0000","last_clean":"2024-05-08T18:32:46.067875+0000","last_became_active":"2024-05-08T18:29:44.596111+0000","last_became_peered":"2024-05-08T18:29:44.596111+0000","last_unstale":"2024-05-08T18:32:46.067875+0000","last_undegraded":"2024-05-08T18:32:46.067875+0000","last_fullsized":"2024-05-08T18:32:46.067875+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:04.423266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"33'10","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.061447+0000","last_change":"2024-05-08T18:29:46.608330+0000","last_active":"2024-05-08T18:32:46.061447+0000","last_peered":"2024-05-08T18:32:46.061447+0000","last_clean":"2024-05-08T18:32:46.061447+0000","last_became_active":"2024-05-08T18:29:46.607580+0000","last_became_peered":"2024-05-08T18:29:46.607580+0000","last_unstale":"2024-05-08T18:32:46.061447+0000","last_undegraded":"2024-05-08T18:32:46.061447+0000","last_fullsized":"2024-05-08T18:32:46.061447+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:22:18.837103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"116'105","reported_seq":410,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:56.630417+0000","last_change":"2024-05-08T18:29:48.642718+0000","last_active":"2024-05-08T18:32:56.630417+0000","last_peered":"2024-05-08T18:32:56.630417+0000","last_clean":"2024-05-08T18:32:56.630417+0000","last_became_active":"2024-05-08T18:29:48.641950+0000","last_became_peered":"2024-05-08T18:29:48.641950+0000","last_unstale":"2024-05-08T18:32:56.630417+0000","last_undegraded":"2024-05-08T18:32:56.630417+0000","last_fullsized":"2024-05-08T18:32:56.630417+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:00:11.720096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"84'2","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.058647+0000","last_change":"2024-05-08T18:29:50.660378+0000","last_active":"2024-05-08T18:32:46.058647+0000","last_peered":"2024-05-08T18:32:46.058647+0000","last_clean":"2024-05-08T18:32:46.058647+0000","last_became_active":"2024-05-08T18:29:50.659649+0000","last_became_peered":"2024-05-08T18:29:50.659649+0000","last_unstale":"2024-05-08T18:32:46.058647+0000","last_undegraded":"2024-05-08T18:32:46.058647+0000","last_fullsized":"2024-05-08T18:32:46.058647+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:34:14.488295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"80'2","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.066931+0000","last_change":"2024-05-08T18:29:42.577267+0000","last_active":"2024-05-08T18:32:46.066931+0000","last_peered":"2024-05-08T18:32:46.066931+0000","last_clean":"2024-05-08T18:32:46.066931+0000","last_became_active":"2024-05-08T18:29:42.576740+0000","last_became_peered":"2024-05-08T18:29:42.576740+0000","last_unstale":"2024-05-08T18:32:46.066931+0000","last_undegraded":"2024-05-08T18:32:46.066931+0000","last_fullsized":"2024-05-08T18:32:46.066931+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:57:14.869860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"116'10","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.065866+0000","last_change":"2024-05-08T18:29:40.547524+0000","last_active":"2024-05-08T18:32:57.065866+0000","last_peered":"2024-05-08T18:32:57.065866+0000","last_clean":"2024-05-08T18:32:57.065866+0000","last_became_active":"2024-05-08T18:29:40.545749+0000","last_became_peered":"2024-05-08T18:29:40.545749+0000","last_unstale":"2024-05-08T18:32:57.065866+0000","last_undegraded":"2024-05-08T18:32:57.065866+0000","last_fullsized":"2024-05-08T18:32:57.065866+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:12:59.146887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.080004+0000","last_change":"2024-05-08T18:29:44.579839+0000","last_active":"2024-05-08T18:32:47.080004+0000","last_peered":"2024-05-08T18:32:47.080004+0000","last_clean":"2024-05-08T18:32:47.080004+0000","last_became_active":"2024-05-08T18:29:44.578142+0000","last_became_peered":"2024-05-08T18:29:44.578142+0000","last_unstale":"2024-05-08T18:32:47.080004+0000","last_undegraded":"2024-05-08T18:32:47.080004+0000","last_fullsized":"2024-05-08T18:32:47.080004+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:51:09.413191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"116'18","reported_seq":211,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:56.735403+0000","last_change":"2024-05-08T18:29:46.607288+0000","last_active":"2024-05-08T18:32:56.735403+0000","last_peered":"2024-05-08T18:32:56.735403+0000","last_clean":"2024-05-08T18:32:56.735403+0000","last_became_active":"2024-05-08T18:29:46.605154+0000","last_became_peered":"2024-05-08T18:29:46.605154+0000","last_unstale":"2024-05-08T18:32:56.735403+0000","last_undegraded":"2024-05-08T18:32:56.735403+0000","last_fullsized":"2024-05-08T18:32:56.735403+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:23.940519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"116'105","reported_seq":329,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:56.636598+0000","last_change":"2024-05-08T18:29:48.634956+0000","last_active":"2024-05-08T18:32:56.636598+0000","last_peered":"2024-05-08T18:32:56.636598+0000","last_clean":"2024-05-08T18:32:56.636598+0000","last_became_active":"2024-05-08T18:29:48.633858+0000","last_became_peered":"2024-05-08T18:29:48.633858+0000","last_unstale":"2024-05-08T18:32:56.636598+0000","last_undegraded":"2024-05-08T18:32:56.636598+0000","last_fullsized":"2024-05-08T18:32:56.636598+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:50:48.169666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"84'8","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.079043+0000","last_change":"2024-05-08T18:29:42.567744+0000","last_active":"2024-05-08T18:32:47.079043+0000","last_peered":"2024-05-08T18:32:47.079043+0000","last_clean":"2024-05-08T18:32:47.079043+0000","last_became_active":"2024-05-08T18:29:42.566974+0000","last_became_peered":"2024-05-08T18:29:42.566974+0000","last_unstale":"2024-05-08T18:32:47.079043+0000","last_undegraded":"2024-05-08T18:32:47.079043+0000","last_fullsized":"2024-05-08T18:32:47.079043+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:37:42.045615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"116'20","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.038372+0000","last_change":"2024-05-08T18:29:40.572499+0000","last_active":"2024-05-08T18:32:57.038372+0000","last_peered":"2024-05-08T18:32:57.038372+0000","last_clean":"2024-05-08T18:32:57.038372+0000","last_became_active":"2024-05-08T18:29:40.571322+0000","last_became_peered":"2024-05-08T18:29:40.571322+0000","last_unstale":"2024-05-08T18:32:57.038372+0000","last_undegraded":"2024-05-08T18:32:57.038372+0000","last_fullsized":"2024-05-08T18:32:57.038372+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:31.119374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.935697+0000","last_change":"2024-05-08T18:29:44.597045+0000","last_active":"2024-05-08T18:32:46.935697+0000","last_peered":"2024-05-08T18:32:46.935697+0000","last_clean":"2024-05-08T18:32:46.935697+0000","last_became_active":"2024-05-08T18:29:44.596282+0000","last_became_peered":"2024-05-08T18:29:44.596282+0000","last_unstale":"2024-05-08T18:32:46.935697+0000","last_undegraded":"2024-05-08T18:32:46.935697+0000","last_fullsized":"2024-05-08T18:32:46.935697+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:35:51.288126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"116'29","reported_seq":229,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:56.944684+0000","last_change":"2024-05-08T18:29:46.590633+0000","last_active":"2024-05-08T18:32:56.944684+0000","last_peered":"2024-05-08T18:32:56.944684+0000","last_clean":"2024-05-08T18:32:56.944684+0000","last_became_active":"2024-05-08T18:29:46.589600+0000","last_became_peered":"2024-05-08T18:29:46.589600+0000","last_unstale":"2024-05-08T18:32:56.944684+0000","last_undegraded":"2024-05-08T18:32:56.944684+0000","last_fullsized":"2024-05-08T18:32:56.944684+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:23.940519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":38,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.917121+0000","last_change":"2024-05-08T18:29:48.630758+0000","last_active":"2024-05-08T18:32:46.917121+0000","last_peered":"2024-05-08T18:32:46.917121+0000","last_clean":"2024-05-08T18:32:46.917121+0000","last_became_active":"2024-05-08T18:29:48.630017+0000","last_became_peered":"2024-05-08T18:29:48.630017+0000","last_unstale":"2024-05-08T18:32:46.917121+0000","last_undegraded":"2024-05-08T18:32:46.917121+0000","last_fullsized":"2024-05-08T18:32:46.917121+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:39.879384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"97'14","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.077776+0000","last_change":"2024-05-08T18:29:50.672682+0000","last_active":"2024-05-08T18:32:47.077776+0000","last_peered":"2024-05-08T18:32:47.077776+0000","last_clean":"2024-05-08T18:32:47.077776+0000","last_became_active":"2024-05-08T18:29:50.671923+0000","last_became_peered":"2024-05-08T18:29:50.671923+0000","last_unstale":"2024-05-08T18:32:47.077776+0000","last_undegraded":"2024-05-08T18:32:47.077776+0000","last_fullsized":"2024-05-08T18:32:47.077776+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:38.318890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":39,"num_write":35,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"80'2","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.057722+0000","last_change":"2024-05-08T18:29:42.554289+0000","last_active":"2024-05-08T18:32:46.057722+0000","last_peered":"2024-05-08T18:32:46.057722+0000","last_clean":"2024-05-08T18:32:46.057722+0000","last_became_active":"2024-05-08T18:29:42.553574+0000","last_became_peered":"2024-05-08T18:29:42.553574+0000","last_unstale":"2024-05-08T18:32:46.057722+0000","last_undegraded":"2024-05-08T18:32:46.057722+0000","last_fullsized":"2024-05-08T18:32:46.057722+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:42.005809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"116'14","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.128057+0000","last_change":"2024-05-08T18:29:40.570169+0000","last_active":"2024-05-08T18:32:57.128057+0000","last_peered":"2024-05-08T18:32:57.128057+0000","last_clean":"2024-05-08T18:32:57.128057+0000","last_became_active":"2024-05-08T18:29:40.569542+0000","last_became_peered":"2024-05-08T18:29:40.569542+0000","last_unstale":"2024-05-08T18:32:57.128057+0000","last_undegraded":"2024-05-08T18:32:57.128057+0000","last_fullsized":"2024-05-08T18:32:57.128057+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:08:13.006752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"26'1","reported_seq":259,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:56.583655+0000","last_change":"2024-05-08T18:29:44.579659+0000","last_active":"2024-05-08T18:32:56.583655+0000","last_peered":"2024-05-08T18:32:56.583655+0000","last_clean":"2024-05-08T18:32:56.583655+0000","last_became_active":"2024-05-08T18:29:44.579152+0000","last_became_peered":"2024-05-08T18:29:44.579152+0000","last_unstale":"2024-05-08T18:32:56.583655+0000","last_undegraded":"2024-05-08T18:32:56.583655+0000","last_fullsized":"2024-05-08T18:32:56.583655+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:15:00.358583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":103,"num_read_kb":103,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"116'18","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.163437+0000","last_change":"2024-05-08T18:29:46.600224+0000","last_active":"2024-05-08T18:32:57.163437+0000","last_peered":"2024-05-08T18:32:57.163437+0000","last_clean":"2024-05-08T18:32:57.163437+0000","last_became_active":"2024-05-08T18:29:46.599464+0000","last_became_peered":"2024-05-08T18:29:46.599464+0000","last_unstale":"2024-05-08T18:32:57.163437+0000","last_undegraded":"2024-05-08T18:32:57.163437+0000","last_fullsized":"2024-05-08T18:32:57.163437+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:26:40.238188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.061779+0000","last_change":"2024-05-08T18:29:48.637939+0000","last_active":"2024-05-08T18:32:46.061779+0000","last_peered":"2024-05-08T18:32:46.061779+0000","last_clean":"2024-05-08T18:32:46.061779+0000","last_became_active":"2024-05-08T18:29:48.637231+0000","last_became_peered":"2024-05-08T18:29:48.637231+0000","last_unstale":"2024-05-08T18:32:46.061779+0000","last_undegraded":"2024-05-08T18:32:46.061779+0000","last_fullsized":"2024-05-08T18:32:46.061779+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:04.571608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":174,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.847775+0000","last_change":"2024-05-08T18:29:50.681831+0000","last_active":"2024-05-08T18:32:46.847775+0000","last_peered":"2024-05-08T18:32:46.847775+0000","last_clean":"2024-05-08T18:32:46.847775+0000","last_became_active":"2024-05-08T18:29:50.681287+0000","last_became_peered":"2024-05-08T18:29:50.681287+0000","last_unstale":"2024-05-08T18:32:46.847775+0000","last_undegraded":"2024-05-08T18:32:46.847775+0000","last_fullsized":"2024-05-08T18:32:46.847775+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:30:24.111488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.849322+0000","last_change":"2024-05-08T18:29:42.562975+0000","last_active":"2024-05-08T18:32:46.849322+0000","last_peered":"2024-05-08T18:32:46.849322+0000","last_clean":"2024-05-08T18:32:46.849322+0000","last_became_active":"2024-05-08T18:29:42.562267+0000","last_became_peered":"2024-05-08T18:29:42.562267+0000","last_unstale":"2024-05-08T18:32:46.849322+0000","last_undegraded":"2024-05-08T18:32:46.849322+0000","last_fullsized":"2024-05-08T18:32:46.849322+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:30.446371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"116'14","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.174524+0000","last_change":"2024-05-08T18:29:40.570736+0000","last_active":"2024-05-08T18:32:57.174524+0000","last_peered":"2024-05-08T18:32:57.174524+0000","last_clean":"2024-05-08T18:32:57.174524+0000","last_became_active":"2024-05-08T18:29:40.569626+0000","last_became_peered":"2024-05-08T18:29:40.569626+0000","last_unstale":"2024-05-08T18:32:57.174524+0000","last_undegraded":"2024-05-08T18:32:57.174524+0000","last_fullsized":"2024-05-08T18:32:57.174524+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:56.300986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"26'1","reported_seq":259,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:56.584848+0000","last_change":"2024-05-08T18:29:44.581748+0000","last_active":"2024-05-08T18:32:56.584848+0000","last_peered":"2024-05-08T18:32:56.584848+0000","last_clean":"2024-05-08T18:32:56.584848+0000","last_became_active":"2024-05-08T18:29:44.581067+0000","last_became_peered":"2024-05-08T18:29:44.581067+0000","last_unstale":"2024-05-08T18:32:56.584848+0000","last_undegraded":"2024-05-08T18:32:56.584848+0000","last_fullsized":"2024-05-08T18:32:56.584848+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:44.043691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":103,"num_read_kb":103,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"116'24","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:56.951792+0000","last_change":"2024-05-08T18:29:46.605887+0000","last_active":"2024-05-08T18:32:56.951792+0000","last_peered":"2024-05-08T18:32:56.951792+0000","last_clean":"2024-05-08T18:32:56.951792+0000","last_became_active":"2024-05-08T18:29:46.604966+0000","last_became_peered":"2024-05-08T18:29:46.604966+0000","last_unstale":"2024-05-08T18:32:56.951792+0000","last_undegraded":"2024-05-08T18:32:56.951792+0000","last_fullsized":"2024-05-08T18:32:56.951792+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:07:54.654205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"116'105","reported_seq":330,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.213342+0000","last_change":"2024-05-08T18:29:48.638657+0000","last_active":"2024-05-08T18:32:57.213342+0000","last_peered":"2024-05-08T18:32:57.213342+0000","last_clean":"2024-05-08T18:32:57.213342+0000","last_became_active":"2024-05-08T18:29:48.637758+0000","last_became_peered":"2024-05-08T18:29:48.637758+0000","last_unstale":"2024-05-08T18:32:57.213342+0000","last_undegraded":"2024-05-08T18:32:57.213342+0000","last_fullsized":"2024-05-08T18:32:57.213342+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"97'2","reported_seq":180,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863354+0000","last_change":"2024-05-08T18:29:50.684501+0000","last_active":"2024-05-08T18:32:46.863354+0000","last_peered":"2024-05-08T18:32:46.863354+0000","last_clean":"2024-05-08T18:32:46.863354+0000","last_became_active":"2024-05-08T18:29:50.683738+0000","last_became_peered":"2024-05-08T18:29:50.683738+0000","last_unstale":"2024-05-08T18:32:46.863354+0000","last_undegraded":"2024-05-08T18:32:46.863354+0000","last_fullsized":"2024-05-08T18:32:46.863354+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"84'4","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863472+0000","last_change":"2024-05-08T18:29:42.569401+0000","last_active":"2024-05-08T18:32:46.863472+0000","last_peered":"2024-05-08T18:32:46.863472+0000","last_clean":"2024-05-08T18:32:46.863472+0000","last_became_active":"2024-05-08T18:29:42.568659+0000","last_became_peered":"2024-05-08T18:29:42.568659+0000","last_unstale":"2024-05-08T18:32:46.863472+0000","last_undegraded":"2024-05-08T18:32:46.863472+0000","last_fullsized":"2024-05-08T18:32:46.863472+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"116'14","reported_seq":211,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.097605+0000","last_change":"2024-05-08T18:29:40.557076+0000","last_active":"2024-05-08T18:32:57.097605+0000","last_peered":"2024-05-08T18:32:57.097605+0000","last_clean":"2024-05-08T18:32:57.097605+0000","last_became_active":"2024-05-08T18:29:40.555805+0000","last_became_peered":"2024-05-08T18:29:40.555805+0000","last_unstale":"2024-05-08T18:32:57.097605+0000","last_undegraded":"2024-05-08T18:32:57.097605+0000","last_fullsized":"2024-05-08T18:32:57.097605+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:13.946346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":3,"num_write":24,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":189,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.060997+0000","last_change":"2024-05-08T18:29:44.573892+0000","last_active":"2024-05-08T18:32:46.060997+0000","last_peered":"2024-05-08T18:32:46.060997+0000","last_clean":"2024-05-08T18:32:46.060997+0000","last_became_active":"2024-05-08T18:29:44.573308+0000","last_became_peered":"2024-05-08T18:29:44.573308+0000","last_unstale":"2024-05-08T18:32:46.060997+0000","last_undegraded":"2024-05-08T18:32:46.060997+0000","last_fullsized":"2024-05-08T18:32:46.060997+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:37.075348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"116'30","reported_seq":235,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.187916+0000","last_change":"2024-05-08T18:29:46.595585+0000","last_active":"2024-05-08T18:32:57.187916+0000","last_peered":"2024-05-08T18:32:57.187916+0000","last_clean":"2024-05-08T18:32:57.187916+0000","last_became_active":"2024-05-08T18:29:46.594930+0000","last_became_peered":"2024-05-08T18:29:46.594930+0000","last_unstale":"2024-05-08T18:32:57.187916+0000","last_undegraded":"2024-05-08T18:32:57.187916+0000","last_fullsized":"2024-05-08T18:32:57.187916+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":28,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.059998+0000","last_change":"2024-05-08T18:29:48.638137+0000","last_active":"2024-05-08T18:32:46.059998+0000","last_peered":"2024-05-08T18:32:46.059998+0000","last_clean":"2024-05-08T18:32:46.059998+0000","last_became_active":"2024-05-08T18:29:48.637370+0000","last_became_peered":"2024-05-08T18:29:48.637370+0000","last_unstale":"2024-05-08T18:32:46.059998+0000","last_undegraded":"2024-05-08T18:32:46.059998+0000","last_fullsized":"2024-05-08T18:32:46.059998+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:15.859849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"83'2","reported_seq":182,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.916145+0000","last_change":"2024-05-08T18:29:50.688760+0000","last_active":"2024-05-08T18:32:46.916145+0000","last_peered":"2024-05-08T18:32:46.916145+0000","last_clean":"2024-05-08T18:32:46.916145+0000","last_became_active":"2024-05-08T18:29:50.687960+0000","last_became_peered":"2024-05-08T18:29:50.687960+0000","last_unstale":"2024-05-08T18:32:46.916145+0000","last_undegraded":"2024-05-08T18:32:46.916145+0000","last_fullsized":"2024-05-08T18:32:46.916145+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:21:19.624895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"97'4","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.060220+0000","last_change":"2024-05-08T18:29:42.557850+0000","last_active":"2024-05-08T18:32:46.060220+0000","last_peered":"2024-05-08T18:32:46.060220+0000","last_clean":"2024-05-08T18:32:46.060220+0000","last_became_active":"2024-05-08T18:29:42.557119+0000","last_became_peered":"2024-05-08T18:29:42.557119+0000","last_unstale":"2024-05-08T18:32:46.060220+0000","last_undegraded":"2024-05-08T18:32:46.060220+0000","last_fullsized":"2024-05-08T18:32:46.060220+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:25:56.129785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"116'16","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.135229+0000","last_change":"2024-05-08T18:29:40.544530+0000","last_active":"2024-05-08T18:32:57.135229+0000","last_peered":"2024-05-08T18:32:57.135229+0000","last_clean":"2024-05-08T18:32:57.135229+0000","last_became_active":"2024-05-08T18:29:40.544215+0000","last_became_peered":"2024-05-08T18:29:40.544215+0000","last_unstale":"2024-05-08T18:32:57.135229+0000","last_undegraded":"2024-05-08T18:32:57.135229+0000","last_fullsized":"2024-05-08T18:32:57.135229+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:14:26.628603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":189,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.063283+0000","last_change":"2024-05-08T18:29:44.588227+0000","last_active":"2024-05-08T18:32:46.063283+0000","last_peered":"2024-05-08T18:32:46.063283+0000","last_clean":"2024-05-08T18:32:46.063283+0000","last_became_active":"2024-05-08T18:29:44.587822+0000","last_became_peered":"2024-05-08T18:29:44.587822+0000","last_unstale":"2024-05-08T18:32:46.063283+0000","last_undegraded":"2024-05-08T18:32:46.063283+0000","last_fullsized":"2024-05-08T18:32:46.063283+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:18:12.841872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"116'22","reported_seq":221,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.190336+0000","last_change":"2024-05-08T18:29:46.603563+0000","last_active":"2024-05-08T18:32:57.190336+0000","last_peered":"2024-05-08T18:32:57.190336+0000","last_clean":"2024-05-08T18:32:57.190336+0000","last_became_active":"2024-05-08T18:29:46.602801+0000","last_became_peered":"2024-05-08T18:29:46.602801+0000","last_unstale":"2024-05-08T18:32:57.190336+0000","last_undegraded":"2024-05-08T18:32:57.190336+0000","last_fullsized":"2024-05-08T18:32:57.190336+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:22:36.338527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":30,"num_read_kb":23,"num_write":22,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":182,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863885+0000","last_change":"2024-05-08T18:29:48.642806+0000","last_active":"2024-05-08T18:32:46.863885+0000","last_peered":"2024-05-08T18:32:46.863885+0000","last_clean":"2024-05-08T18:32:46.863885+0000","last_became_active":"2024-05-08T18:29:48.641813+0000","last_became_peered":"2024-05-08T18:29:48.641813+0000","last_unstale":"2024-05-08T18:32:46.863885+0000","last_undegraded":"2024-05-08T18:32:46.863885+0000","last_fullsized":"2024-05-08T18:32:46.863885+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"80'2","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.062631+0000","last_change":"2024-05-08T18:29:50.689819+0000","last_active":"2024-05-08T18:32:46.062631+0000","last_peered":"2024-05-08T18:32:46.062631+0000","last_clean":"2024-05-08T18:32:46.062631+0000","last_became_active":"2024-05-08T18:29:50.686739+0000","last_became_peered":"2024-05-08T18:29:50.686739+0000","last_unstale":"2024-05-08T18:32:46.062631+0000","last_undegraded":"2024-05-08T18:32:46.062631+0000","last_fullsized":"2024-05-08T18:32:46.062631+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:45:34.171402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.060014+0000","last_change":"2024-05-08T18:29:42.552388+0000","last_active":"2024-05-08T18:32:46.060014+0000","last_peered":"2024-05-08T18:32:46.060014+0000","last_clean":"2024-05-08T18:32:46.060014+0000","last_became_active":"2024-05-08T18:29:42.551647+0000","last_became_peered":"2024-05-08T18:29:42.551647+0000","last_unstale":"2024-05-08T18:32:46.060014+0000","last_undegraded":"2024-05-08T18:32:46.060014+0000","last_fullsized":"2024-05-08T18:32:46.060014+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:55.055481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"116'16","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.170981+0000","last_change":"2024-05-08T18:29:40.562946+0000","last_active":"2024-05-08T18:32:57.170981+0000","last_peered":"2024-05-08T18:32:57.170981+0000","last_clean":"2024-05-08T18:32:57.170981+0000","last_became_active":"2024-05-08T18:29:40.550942+0000","last_became_peered":"2024-05-08T18:29:40.550942+0000","last_unstale":"2024-05-08T18:32:57.170981+0000","last_undegraded":"2024-05-08T18:32:57.170981+0000","last_fullsized":"2024-05-08T18:32:57.170981+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:22.579629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.918001+0000","last_change":"2024-05-08T18:29:44.593681+0000","last_active":"2024-05-08T18:32:46.918001+0000","last_peered":"2024-05-08T18:32:46.918001+0000","last_clean":"2024-05-08T18:32:46.918001+0000","last_became_active":"2024-05-08T18:29:44.593242+0000","last_became_peered":"2024-05-08T18:29:44.593242+0000","last_unstale":"2024-05-08T18:32:46.918001+0000","last_undegraded":"2024-05-08T18:32:46.918001+0000","last_fullsized":"2024-05-08T18:32:46.918001+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:57.093364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"116'25","reported_seq":224,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.139765+0000","last_change":"2024-05-08T18:29:46.589514+0000","last_active":"2024-05-08T18:32:57.139765+0000","last_peered":"2024-05-08T18:32:57.139765+0000","last_clean":"2024-05-08T18:32:57.139765+0000","last_became_active":"2024-05-08T18:29:46.588784+0000","last_became_peered":"2024-05-08T18:29:46.588784+0000","last_unstale":"2024-05-08T18:32:57.139765+0000","last_undegraded":"2024-05-08T18:32:57.139765+0000","last_fullsized":"2024-05-08T18:32:57.139765+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:02:30.355168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":35,"num_read_kb":26,"num_write":24,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"116'105","reported_seq":341,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:56.632525+0000","last_change":"2024-05-08T18:29:48.631007+0000","last_active":"2024-05-08T18:32:56.632525+0000","last_peered":"2024-05-08T18:32:56.632525+0000","last_clean":"2024-05-08T18:32:56.632525+0000","last_became_active":"2024-05-08T18:29:48.630229+0000","last_became_peered":"2024-05-08T18:29:48.630229+0000","last_unstale":"2024-05-08T18:32:56.632525+0000","last_undegraded":"2024-05-08T18:32:56.632525+0000","last_fullsized":"2024-05-08T18:32:56.632525+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:44:03.778419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.917498+0000","last_change":"2024-05-08T18:29:50.675105+0000","last_active":"2024-05-08T18:32:46.917498+0000","last_peered":"2024-05-08T18:32:46.917498+0000","last_clean":"2024-05-08T18:32:46.917498+0000","last_became_active":"2024-05-08T18:29:50.674292+0000","last_became_peered":"2024-05-08T18:29:50.674292+0000","last_unstale":"2024-05-08T18:32:46.917498+0000","last_undegraded":"2024-05-08T18:32:46.917498+0000","last_fullsized":"2024-05-08T18:32:46.917498+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:47:15.423647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"84'4","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.060239+0000","last_change":"2024-05-08T18:29:42.579707+0000","last_active":"2024-05-08T18:32:46.060239+0000","last_peered":"2024-05-08T18:32:46.060239+0000","last_clean":"2024-05-08T18:32:46.060239+0000","last_became_active":"2024-05-08T18:29:42.579059+0000","last_became_peered":"2024-05-08T18:29:42.579059+0000","last_unstale":"2024-05-08T18:32:46.060239+0000","last_undegraded":"2024-05-08T18:32:46.060239+0000","last_fullsized":"2024-05-08T18:32:46.060239+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:09.787597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"116'16","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.036607+0000","last_change":"2024-05-08T18:29:40.555327+0000","last_active":"2024-05-08T18:32:57.036607+0000","last_peered":"2024-05-08T18:32:57.036607+0000","last_clean":"2024-05-08T18:32:57.036607+0000","last_became_active":"2024-05-08T18:29:40.554594+0000","last_became_peered":"2024-05-08T18:29:40.554594+0000","last_unstale":"2024-05-08T18:32:57.036607+0000","last_undegraded":"2024-05-08T18:32:57.036607+0000","last_fullsized":"2024-05-08T18:32:57.036607+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:19.841114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4,"num_write":26,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"26'2","reported_seq":328,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:56.598237+0000","last_change":"2024-05-08T18:29:44.582434+0000","last_active":"2024-05-08T18:32:56.598237+0000","last_peered":"2024-05-08T18:32:56.598237+0000","last_clean":"2024-05-08T18:32:56.598237+0000","last_became_active":"2024-05-08T18:29:44.581699+0000","last_became_peered":"2024-05-08T18:29:44.581699+0000","last_unstale":"2024-05-08T18:32:56.598237+0000","last_undegraded":"2024-05-08T18:32:56.598237+0000","last_fullsized":"2024-05-08T18:32:56.598237+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:19:29.113643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":138,"num_read_kb":138,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"33'10","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.065642+0000","last_change":"2024-05-08T18:29:46.590860+0000","last_active":"2024-05-08T18:32:46.065642+0000","last_peered":"2024-05-08T18:32:46.065642+0000","last_clean":"2024-05-08T18:32:46.065642+0000","last_became_active":"2024-05-08T18:29:46.590087+0000","last_became_peered":"2024-05-08T18:29:46.590087+0000","last_unstale":"2024-05-08T18:32:46.065642+0000","last_undegraded":"2024-05-08T18:32:46.065642+0000","last_fullsized":"2024-05-08T18:32:46.065642+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:19:58.358449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"116'105","reported_seq":365,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:56.634514+0000","last_change":"2024-05-08T18:29:48.635548+0000","last_active":"2024-05-08T18:32:56.634514+0000","last_peered":"2024-05-08T18:32:56.634514+0000","last_clean":"2024-05-08T18:32:56.634514+0000","last_became_active":"2024-05-08T18:29:48.634801+0000","last_became_peered":"2024-05-08T18:29:48.634801+0000","last_unstale":"2024-05-08T18:32:56.634514+0000","last_undegraded":"2024-05-08T18:32:56.634514+0000","last_fullsized":"2024-05-08T18:32:56.634514+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:04:20.128031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.058516+0000","last_change":"2024-05-08T18:29:50.668279+0000","last_active":"2024-05-08T18:32:46.058516+0000","last_peered":"2024-05-08T18:32:46.058516+0000","last_clean":"2024-05-08T18:32:46.058516+0000","last_became_active":"2024-05-08T18:29:50.667536+0000","last_became_peered":"2024-05-08T18:29:50.667536+0000","last_unstale":"2024-05-08T18:32:46.058516+0000","last_undegraded":"2024-05-08T18:32:46.058516+0000","last_fullsized":"2024-05-08T18:32:46.058516+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:12:05.780786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"97'14","reported_seq":224,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.916133+0000","last_change":"2024-05-08T18:29:42.563807+0000","last_active":"2024-05-08T18:32:46.916133+0000","last_peered":"2024-05-08T18:32:46.916133+0000","last_clean":"2024-05-08T18:32:46.916133+0000","last_became_active":"2024-05-08T18:29:42.563416+0000","last_became_peered":"2024-05-08T18:29:42.563416+0000","last_unstale":"2024-05-08T18:32:46.916133+0000","last_undegraded":"2024-05-08T18:32:46.916133+0000","last_fullsized":"2024-05-08T18:32:46.916133+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:18:10.803989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"116'24","reported_seq":221,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.135079+0000","last_change":"2024-05-08T18:29:40.548898+0000","last_active":"2024-05-08T18:32:57.135079+0000","last_peered":"2024-05-08T18:32:57.135079+0000","last_clean":"2024-05-08T18:32:57.135079+0000","last_became_active":"2024-05-08T18:29:40.548591+0000","last_became_peered":"2024-05-08T18:29:40.548591+0000","last_unstale":"2024-05-08T18:32:57.135079+0000","last_undegraded":"2024-05-08T18:32:57.135079+0000","last_fullsized":"2024-05-08T18:32:57.135079+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:27:41.414153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":24,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.059932+0000","last_change":"2024-05-08T18:29:44.582578+0000","last_active":"2024-05-08T18:32:46.059932+0000","last_peered":"2024-05-08T18:32:46.059932+0000","last_clean":"2024-05-08T18:32:46.059932+0000","last_became_active":"2024-05-08T18:29:44.581832+0000","last_became_peered":"2024-05-08T18:29:44.581832+0000","last_unstale":"2024-05-08T18:32:46.059932+0000","last_undegraded":"2024-05-08T18:32:46.059932+0000","last_fullsized":"2024-05-08T18:32:46.059932+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:52:25.736491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"116'26","reported_seq":225,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:56.934177+0000","last_change":"2024-05-08T18:29:46.602459+0000","last_active":"2024-05-08T18:32:56.934177+0000","last_peered":"2024-05-08T18:32:56.934177+0000","last_clean":"2024-05-08T18:32:56.934177+0000","last_became_active":"2024-05-08T18:29:46.601740+0000","last_became_peered":"2024-05-08T18:29:46.601740+0000","last_unstale":"2024-05-08T18:32:56.934177+0000","last_undegraded":"2024-05-08T18:32:56.934177+0000","last_fullsized":"2024-05-08T18:32:56.934177+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:58:31.293922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":35,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.849235+0000","last_change":"2024-05-08T18:29:48.640046+0000","last_active":"2024-05-08T18:32:46.849235+0000","last_peered":"2024-05-08T18:32:46.849235+0000","last_clean":"2024-05-08T18:32:46.849235+0000","last_became_active":"2024-05-08T18:29:48.639309+0000","last_became_peered":"2024-05-08T18:29:48.639309+0000","last_unstale":"2024-05-08T18:32:46.849235+0000","last_undegraded":"2024-05-08T18:32:46.849235+0000","last_fullsized":"2024-05-08T18:32:46.849235+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:10.533065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.917024+0000","last_change":"2024-05-08T18:29:50.668361+0000","last_active":"2024-05-08T18:32:46.917024+0000","last_peered":"2024-05-08T18:32:46.917024+0000","last_clean":"2024-05-08T18:32:46.917024+0000","last_became_active":"2024-05-08T18:29:50.667636+0000","last_became_peered":"2024-05-08T18:29:50.667636+0000","last_unstale":"2024-05-08T18:32:46.917024+0000","last_undegraded":"2024-05-08T18:32:46.917024+0000","last_fullsized":"2024-05-08T18:32:46.917024+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:58:35.356885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"97'4","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.847440+0000","last_change":"2024-05-08T18:29:42.584098+0000","last_active":"2024-05-08T18:32:46.847440+0000","last_peered":"2024-05-08T18:32:46.847440+0000","last_clean":"2024-05-08T18:32:46.847440+0000","last_became_active":"2024-05-08T18:29:42.583639+0000","last_became_peered":"2024-05-08T18:29:42.583639+0000","last_unstale":"2024-05-08T18:32:46.847440+0000","last_undegraded":"2024-05-08T18:32:46.847440+0000","last_fullsized":"2024-05-08T18:32:46.847440+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:08:15.026467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":296,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.936422+0000","last_change":"2024-05-08T18:29:27.115522+0000","last_active":"2024-05-08T18:32:46.936422+0000","last_peered":"2024-05-08T18:32:46.936422+0000","last_clean":"2024-05-08T18:32:46.936422+0000","last_became_active":"2024-05-08T18:29:27.112960+0000","last_became_peered":"2024-05-08T18:29:27.112960+0000","last_unstale":"2024-05-08T18:32:46.936422+0000","last_undegraded":"2024-05-08T18:32:46.936422+0000","last_fullsized":"2024-05-08T18:32:46.936422+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:26.091102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:26.091102+0000","last_clean_scrub_stamp":"2024-05-08T18:29:26.091102+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:09:50.296961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.077723+0000","last_change":"2024-05-08T18:29:34.496467+0000","last_active":"2024-05-08T18:32:47.077723+0000","last_peered":"2024-05-08T18:32:47.077723+0000","last_clean":"2024-05-08T18:32:47.077723+0000","last_became_active":"2024-05-08T18:29:34.495632+0000","last_became_peered":"2024-05-08T18:29:34.495632+0000","last_unstale":"2024-05-08T18:32:47.077723+0000","last_undegraded":"2024-05-08T18:32:47.077723+0000","last_fullsized":"2024-05-08T18:32:47.077723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:35.917391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"116'10","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:56.892951+0000","last_change":"2024-05-08T18:30:20.849562+0000","last_active":"2024-05-08T18:32:56.892951+0000","last_peered":"2024-05-08T18:32:56.892951+0000","last_clean":"2024-05-08T18:32:56.892951+0000","last_became_active":"2024-05-08T18:30:20.849160+0000","last_became_peered":"2024-05-08T18:30:20.849160+0000","last_unstale":"2024-05-08T18:32:56.892951+0000","last_undegraded":"2024-05-08T18:32:56.892951+0000","last_fullsized":"2024-05-08T18:32:56.892951+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:29:13.478886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.937166+0000","last_change":"2024-05-08T18:29:44.592445+0000","last_active":"2024-05-08T18:32:46.937166+0000","last_peered":"2024-05-08T18:32:46.937166+0000","last_clean":"2024-05-08T18:32:46.937166+0000","last_became_active":"2024-05-08T18:29:44.587855+0000","last_became_peered":"2024-05-08T18:29:44.587855+0000","last_unstale":"2024-05-08T18:32:46.937166+0000","last_undegraded":"2024-05-08T18:32:46.937166+0000","last_fullsized":"2024-05-08T18:32:46.937166+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:06:05.355648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"116'44","reported_seq":254,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:56.995495+0000","last_change":"2024-05-08T18:29:46.595394+0000","last_active":"2024-05-08T18:32:56.995495+0000","last_peered":"2024-05-08T18:32:56.995495+0000","last_clean":"2024-05-08T18:32:56.995495+0000","last_became_active":"2024-05-08T18:29:46.594573+0000","last_became_peered":"2024-05-08T18:29:46.594573+0000","last_unstale":"2024-05-08T18:32:56.995495+0000","last_undegraded":"2024-05-08T18:32:56.995495+0000","last_fullsized":"2024-05-08T18:32:56.995495+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:47:11.360684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8302,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":58,"num_read_kb":181,"num_write":30,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":182,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863426+0000","last_change":"2024-05-08T18:29:48.632178+0000","last_active":"2024-05-08T18:32:46.863426+0000","last_peered":"2024-05-08T18:32:46.863426+0000","last_clean":"2024-05-08T18:32:46.863426+0000","last_became_active":"2024-05-08T18:29:48.631481+0000","last_became_peered":"2024-05-08T18:29:48.631481+0000","last_unstale":"2024-05-08T18:32:46.863426+0000","last_undegraded":"2024-05-08T18:32:46.863426+0000","last_fullsized":"2024-05-08T18:32:46.863426+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"80'2","reported_seq":176,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.848444+0000","last_change":"2024-05-08T18:29:50.675319+0000","last_active":"2024-05-08T18:32:46.848444+0000","last_peered":"2024-05-08T18:32:46.848444+0000","last_clean":"2024-05-08T18:32:46.848444+0000","last_became_active":"2024-05-08T18:29:50.674526+0000","last_became_peered":"2024-05-08T18:29:50.674526+0000","last_unstale":"2024-05-08T18:32:46.848444+0000","last_undegraded":"2024-05-08T18:32:46.848444+0000","last_fullsized":"2024-05-08T18:32:46.848444+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:59:06.404586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"84'4","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863573+0000","last_change":"2024-05-08T18:29:42.568584+0000","last_active":"2024-05-08T18:32:46.863573+0000","last_peered":"2024-05-08T18:32:46.863573+0000","last_clean":"2024-05-08T18:32:46.863573+0000","last_became_active":"2024-05-08T18:29:42.568244+0000","last_became_peered":"2024-05-08T18:29:42.568244+0000","last_unstale":"2024-05-08T18:32:46.863573+0000","last_undegraded":"2024-05-08T18:32:46.863573+0000","last_fullsized":"2024-05-08T18:32:46.863573+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.935976+0000","last_change":"2024-05-08T18:29:34.497654+0000","last_active":"2024-05-08T18:32:46.935976+0000","last_peered":"2024-05-08T18:32:46.935976+0000","last_clean":"2024-05-08T18:32:46.935976+0000","last_became_active":"2024-05-08T18:29:34.495812+0000","last_became_peered":"2024-05-08T18:29:34.495812+0000","last_unstale":"2024-05-08T18:32:46.935976+0000","last_undegraded":"2024-05-08T18:32:46.935976+0000","last_fullsized":"2024-05-08T18:32:46.935976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:37:02.202613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"116'14","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.148443+0000","last_change":"2024-05-08T18:29:40.560653+0000","last_active":"2024-05-08T18:32:57.148443+0000","last_peered":"2024-05-08T18:32:57.148443+0000","last_clean":"2024-05-08T18:32:57.148443+0000","last_became_active":"2024-05-08T18:29:40.560296+0000","last_became_peered":"2024-05-08T18:29:40.560296+0000","last_unstale":"2024-05-08T18:32:57.148443+0000","last_undegraded":"2024-05-08T18:32:57.148443+0000","last_fullsized":"2024-05-08T18:32:57.148443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.080676+0000","last_change":"2024-05-08T18:29:44.594681+0000","last_active":"2024-05-08T18:32:47.080676+0000","last_peered":"2024-05-08T18:32:47.080676+0000","last_clean":"2024-05-08T18:32:47.080676+0000","last_became_active":"2024-05-08T18:29:44.593917+0000","last_became_peered":"2024-05-08T18:29:44.593917+0000","last_unstale":"2024-05-08T18:32:47.080676+0000","last_undegraded":"2024-05-08T18:32:47.080676+0000","last_fullsized":"2024-05-08T18:32:47.080676+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:59:00.335437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"116'121","reported_seq":409,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.180935+0000","last_change":"2024-05-08T18:29:46.599932+0000","last_active":"2024-05-08T18:32:57.180935+0000","last_peered":"2024-05-08T18:32:57.180935+0000","last_clean":"2024-05-08T18:32:57.180935+0000","last_became_active":"2024-05-08T18:29:46.594789+0000","last_became_peered":"2024-05-08T18:29:46.594789+0000","last_unstale":"2024-05-08T18:32:57.180935+0000","last_undegraded":"2024-05-08T18:32:57.180935+0000","last_fullsized":"2024-05-08T18:32:57.180935+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:04:18.099848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4344,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":167,"num_read_kb":168,"num_write":36,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.937370+0000","last_change":"2024-05-08T18:29:48.634661+0000","last_active":"2024-05-08T18:32:46.937370+0000","last_peered":"2024-05-08T18:32:46.937370+0000","last_clean":"2024-05-08T18:32:46.937370+0000","last_became_active":"2024-05-08T18:29:48.634044+0000","last_became_peered":"2024-05-08T18:29:48.634044+0000","last_unstale":"2024-05-08T18:32:46.937370+0000","last_undegraded":"2024-05-08T18:32:46.937370+0000","last_fullsized":"2024-05-08T18:32:46.937370+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:01:46.238076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.916916+0000","last_change":"2024-05-08T18:29:50.676536+0000","last_active":"2024-05-08T18:32:46.916916+0000","last_peered":"2024-05-08T18:32:46.916916+0000","last_clean":"2024-05-08T18:32:46.916916+0000","last_became_active":"2024-05-08T18:29:50.675770+0000","last_became_peered":"2024-05-08T18:29:50.675770+0000","last_unstale":"2024-05-08T18:32:46.916916+0000","last_undegraded":"2024-05-08T18:32:46.916916+0000","last_fullsized":"2024-05-08T18:32:46.916916+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:28.003482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.919578+0000","last_change":"2024-05-08T18:29:42.575253+0000","last_active":"2024-05-08T18:32:46.919578+0000","last_peered":"2024-05-08T18:32:46.919578+0000","last_clean":"2024-05-08T18:32:46.919578+0000","last_became_active":"2024-05-08T18:29:42.573621+0000","last_became_peered":"2024-05-08T18:29:42.573621+0000","last_unstale":"2024-05-08T18:32:46.919578+0000","last_undegraded":"2024-05-08T18:32:46.919578+0000","last_fullsized":"2024-05-08T18:32:46.919578+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:59.243324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.060706+0000","last_change":"2024-05-08T18:29:34.491071+0000","last_active":"2024-05-08T18:32:46.060706+0000","last_peered":"2024-05-08T18:32:46.060706+0000","last_clean":"2024-05-08T18:32:46.060706+0000","last_became_active":"2024-05-08T18:29:34.490717+0000","last_became_peered":"2024-05-08T18:29:34.490717+0000","last_unstale":"2024-05-08T18:32:46.060706+0000","last_undegraded":"2024-05-08T18:32:46.060706+0000","last_fullsized":"2024-05-08T18:32:46.060706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:55.793312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"116'24","reported_seq":223,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.129245+0000","last_change":"2024-05-08T18:29:40.530634+0000","last_active":"2024-05-08T18:32:57.129245+0000","last_peered":"2024-05-08T18:32:57.129245+0000","last_clean":"2024-05-08T18:32:57.129245+0000","last_became_active":"2024-05-08T18:29:40.529804+0000","last_became_peered":"2024-05-08T18:29:40.529804+0000","last_unstale":"2024-05-08T18:32:57.129245+0000","last_undegraded":"2024-05-08T18:32:57.129245+0000","last_fullsized":"2024-05-08T18:32:57.129245+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:59:25.840149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":24,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"26'1","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.064037+0000","last_change":"2024-05-08T18:29:44.584678+0000","last_active":"2024-05-08T18:32:46.064037+0000","last_peered":"2024-05-08T18:32:46.064037+0000","last_clean":"2024-05-08T18:32:46.064037+0000","last_became_active":"2024-05-08T18:29:44.584227+0000","last_became_peered":"2024-05-08T18:29:44.584227+0000","last_unstale":"2024-05-08T18:32:46.064037+0000","last_undegraded":"2024-05-08T18:32:46.064037+0000","last_fullsized":"2024-05-08T18:32:46.064037+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:04:01.281207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"116'16","reported_seq":241,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:49.831341+0000","last_change":"2024-05-08T18:29:46.608720+0000","last_active":"2024-05-08T18:32:49.831341+0000","last_peered":"2024-05-08T18:32:49.831341+0000","last_clean":"2024-05-08T18:32:49.831341+0000","last_became_active":"2024-05-08T18:29:46.607989+0000","last_became_peered":"2024-05-08T18:29:46.607989+0000","last_unstale":"2024-05-08T18:32:49.831341+0000","last_undegraded":"2024-05-08T18:32:49.831341+0000","last_fullsized":"2024-05-08T18:32:49.831341+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:58:31.293922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":182,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863065+0000","last_change":"2024-05-08T18:29:48.625269+0000","last_active":"2024-05-08T18:32:46.863065+0000","last_peered":"2024-05-08T18:32:46.863065+0000","last_clean":"2024-05-08T18:32:46.863065+0000","last_became_active":"2024-05-08T18:29:48.624545+0000","last_became_peered":"2024-05-08T18:29:48.624545+0000","last_unstale":"2024-05-08T18:32:46.863065+0000","last_undegraded":"2024-05-08T18:32:46.863065+0000","last_fullsized":"2024-05-08T18:32:46.863065+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"84'12","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.063889+0000","last_change":"2024-05-08T18:29:50.688851+0000","last_active":"2024-05-08T18:32:46.063889+0000","last_peered":"2024-05-08T18:32:46.063889+0000","last_clean":"2024-05-08T18:32:46.063889+0000","last_became_active":"2024-05-08T18:29:50.687978+0000","last_became_peered":"2024-05-08T18:29:50.687978+0000","last_unstale":"2024-05-08T18:32:46.063889+0000","last_undegraded":"2024-05-08T18:32:46.063889+0000","last_fullsized":"2024-05-08T18:32:46.063889+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:28:29.836446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":42,"num_write":31,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"84'4","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.918158+0000","last_change":"2024-05-08T18:31:22.008678+0000","last_active":"2024-05-08T18:32:46.918158+0000","last_peered":"2024-05-08T18:32:46.918158+0000","last_clean":"2024-05-08T18:32:46.918158+0000","last_became_active":"2024-05-08T18:31:22.008342+0000","last_became_peered":"2024-05-08T18:31:22.008342+0000","last_unstale":"2024-05-08T18:32:46.918158+0000","last_undegraded":"2024-05-08T18:32:46.918158+0000","last_fullsized":"2024-05-08T18:32:46.918158+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:40:30.531379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.079379+0000","last_change":"2024-05-08T18:29:34.496942+0000","last_active":"2024-05-08T18:32:47.079379+0000","last_peered":"2024-05-08T18:32:47.079379+0000","last_clean":"2024-05-08T18:32:47.079379+0000","last_became_active":"2024-05-08T18:29:34.495882+0000","last_became_peered":"2024-05-08T18:29:34.495882+0000","last_unstale":"2024-05-08T18:32:47.079379+0000","last_undegraded":"2024-05-08T18:32:47.079379+0000","last_fullsized":"2024-05-08T18:32:47.079379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:55.793312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"116'16","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.091934+0000","last_change":"2024-05-08T18:29:40.554353+0000","last_active":"2024-05-08T18:32:57.091934+0000","last_peered":"2024-05-08T18:32:57.091934+0000","last_clean":"2024-05-08T18:32:57.091934+0000","last_became_active":"2024-05-08T18:29:40.553527+0000","last_became_peered":"2024-05-08T18:29:40.553527+0000","last_unstale":"2024-05-08T18:32:57.091934+0000","last_undegraded":"2024-05-08T18:32:57.091934+0000","last_fullsized":"2024-05-08T18:32:57.091934+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:03:42.148647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863528+0000","last_change":"2024-05-08T18:29:44.597411+0000","last_active":"2024-05-08T18:32:46.863528+0000","last_peered":"2024-05-08T18:32:46.863528+0000","last_clean":"2024-05-08T18:32:46.863528+0000","last_became_active":"2024-05-08T18:29:44.596678+0000","last_became_peered":"2024-05-08T18:29:44.596678+0000","last_unstale":"2024-05-08T18:32:46.863528+0000","last_undegraded":"2024-05-08T18:32:46.863528+0000","last_fullsized":"2024-05-08T18:32:46.863528+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"97'13","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.066095+0000","last_change":"2024-05-08T18:29:46.607040+0000","last_active":"2024-05-08T18:32:46.066095+0000","last_peered":"2024-05-08T18:32:46.066095+0000","last_clean":"2024-05-08T18:32:46.066095+0000","last_became_active":"2024-05-08T18:29:46.606367+0000","last_became_peered":"2024-05-08T18:29:46.606367+0000","last_unstale":"2024-05-08T18:32:46.066095+0000","last_undegraded":"2024-05-08T18:32:46.066095+0000","last_fullsized":"2024-05-08T18:32:46.066095+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:59:26.650126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.850025+0000","last_change":"2024-05-08T18:29:48.632665+0000","last_active":"2024-05-08T18:32:46.850025+0000","last_peered":"2024-05-08T18:32:46.850025+0000","last_clean":"2024-05-08T18:32:46.850025+0000","last_became_active":"2024-05-08T18:29:48.631874+0000","last_became_peered":"2024-05-08T18:29:48.631874+0000","last_unstale":"2024-05-08T18:32:46.850025+0000","last_undegraded":"2024-05-08T18:32:46.850025+0000","last_fullsized":"2024-05-08T18:32:46.850025+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:06:09.390017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":176,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.078092+0000","last_change":"2024-05-08T18:29:50.683443+0000","last_active":"2024-05-08T18:32:47.078092+0000","last_peered":"2024-05-08T18:32:47.078092+0000","last_clean":"2024-05-08T18:32:47.078092+0000","last_became_active":"2024-05-08T18:29:50.682634+0000","last_became_peered":"2024-05-08T18:29:50.682634+0000","last_unstale":"2024-05-08T18:32:47.078092+0000","last_undegraded":"2024-05-08T18:32:47.078092+0000","last_fullsized":"2024-05-08T18:32:47.078092+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:10:38.951662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"80'2","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.917272+0000","last_change":"2024-05-08T18:29:42.574593+0000","last_active":"2024-05-08T18:32:46.917272+0000","last_peered":"2024-05-08T18:32:46.917272+0000","last_clean":"2024-05-08T18:32:46.917272+0000","last_became_active":"2024-05-08T18:29:42.574288+0000","last_became_peered":"2024-05-08T18:29:42.574288+0000","last_unstale":"2024-05-08T18:32:46.917272+0000","last_undegraded":"2024-05-08T18:32:46.917272+0000","last_fullsized":"2024-05-08T18:32:46.917272+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:58.320701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"116'22","reported_seq":169,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.078338+0000","last_change":"2024-05-08T18:30:20.850805+0000","last_active":"2024-05-08T18:32:57.078338+0000","last_peered":"2024-05-08T18:32:57.078338+0000","last_clean":"2024-05-08T18:32:57.078338+0000","last_became_active":"2024-05-08T18:30:20.850365+0000","last_became_peered":"2024-05-08T18:30:20.850365+0000","last_unstale":"2024-05-08T18:32:57.078338+0000","last_undegraded":"2024-05-08T18:32:57.078338+0000","last_fullsized":"2024-05-08T18:32:57.078338+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:52:21.678894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.918404+0000","last_change":"2024-05-08T18:29:34.606393+0000","last_active":"2024-05-08T18:32:46.918404+0000","last_peered":"2024-05-08T18:32:46.918404+0000","last_clean":"2024-05-08T18:32:46.918404+0000","last_became_active":"2024-05-08T18:29:34.605574+0000","last_became_peered":"2024-05-08T18:29:34.605574+0000","last_unstale":"2024-05-08T18:32:46.918404+0000","last_undegraded":"2024-05-08T18:32:46.918404+0000","last_fullsized":"2024-05-08T18:32:46.918404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:05:55.793312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863377+0000","last_change":"2024-05-08T18:29:44.595127+0000","last_active":"2024-05-08T18:32:46.863377+0000","last_peered":"2024-05-08T18:32:46.863377+0000","last_clean":"2024-05-08T18:32:46.863377+0000","last_became_active":"2024-05-08T18:29:44.594642+0000","last_became_peered":"2024-05-08T18:29:44.594642+0000","last_unstale":"2024-05-08T18:32:46.863377+0000","last_undegraded":"2024-05-08T18:32:46.863377+0000","last_fullsized":"2024-05-08T18:32:46.863377+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"116'39","reported_seq":247,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.137627+0000","last_change":"2024-05-08T18:29:46.602279+0000","last_active":"2024-05-08T18:32:57.137627+0000","last_peered":"2024-05-08T18:32:57.137627+0000","last_clean":"2024-05-08T18:32:57.137627+0000","last_became_active":"2024-05-08T18:29:46.599707+0000","last_became_peered":"2024-05-08T18:29:46.599707+0000","last_unstale":"2024-05-08T18:32:57.137627+0000","last_undegraded":"2024-05-08T18:32:57.137627+0000","last_fullsized":"2024-05-08T18:32:57.137627+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":53,"num_read_kb":162,"num_write":30,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.057286+0000","last_change":"2024-05-08T18:29:48.639458+0000","last_active":"2024-05-08T18:32:46.057286+0000","last_peered":"2024-05-08T18:32:46.057286+0000","last_clean":"2024-05-08T18:32:46.057286+0000","last_became_active":"2024-05-08T18:29:48.638709+0000","last_became_peered":"2024-05-08T18:29:48.638709+0000","last_unstale":"2024-05-08T18:32:46.057286+0000","last_undegraded":"2024-05-08T18:32:46.057286+0000","last_fullsized":"2024-05-08T18:32:46.057286+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:19:58.182291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"97'6","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.861374+0000","last_change":"2024-05-08T18:29:50.681077+0000","last_active":"2024-05-08T18:32:46.861374+0000","last_peered":"2024-05-08T18:32:46.861374+0000","last_clean":"2024-05-08T18:32:46.861374+0000","last_became_active":"2024-05-08T18:29:50.675766+0000","last_became_peered":"2024-05-08T18:29:50.675766+0000","last_unstale":"2024-05-08T18:32:46.861374+0000","last_undegraded":"2024-05-08T18:32:46.861374+0000","last_fullsized":"2024-05-08T18:32:46.861374+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"80'2","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863637+0000","last_change":"2024-05-08T18:29:42.571265+0000","last_active":"2024-05-08T18:32:46.863637+0000","last_peered":"2024-05-08T18:32:46.863637+0000","last_clean":"2024-05-08T18:32:46.863637+0000","last_became_active":"2024-05-08T18:29:42.570645+0000","last_became_peered":"2024-05-08T18:29:42.570645+0000","last_unstale":"2024-05-08T18:32:46.863637+0000","last_undegraded":"2024-05-08T18:32:46.863637+0000","last_fullsized":"2024-05-08T18:32:46.863637+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"116'6","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.079833+0000","last_change":"2024-05-08T18:29:40.531079+0000","last_active":"2024-05-08T18:32:57.079833+0000","last_peered":"2024-05-08T18:32:57.079833+0000","last_clean":"2024-05-08T18:32:57.079833+0000","last_became_active":"2024-05-08T18:29:40.530256+0000","last_became_peered":"2024-05-08T18:29:40.530256+0000","last_unstale":"2024-05-08T18:32:57.079833+0000","last_undegraded":"2024-05-08T18:32:57.079833+0000","last_fullsized":"2024-05-08T18:32:57.079833+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:09:42.581976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.938519+0000","last_change":"2024-05-08T18:29:34.603292+0000","last_active":"2024-05-08T18:32:46.938519+0000","last_peered":"2024-05-08T18:32:46.938519+0000","last_clean":"2024-05-08T18:32:46.938519+0000","last_became_active":"2024-05-08T18:29:34.602547+0000","last_became_peered":"2024-05-08T18:29:34.602547+0000","last_unstale":"2024-05-08T18:32:46.938519+0000","last_undegraded":"2024-05-08T18:32:46.938519+0000","last_fullsized":"2024-05-08T18:32:46.938519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:24:55.555475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.849004+0000","last_change":"2024-05-08T18:29:44.593275+0000","last_active":"2024-05-08T18:32:46.849004+0000","last_peered":"2024-05-08T18:32:46.849004+0000","last_clean":"2024-05-08T18:32:46.849004+0000","last_became_active":"2024-05-08T18:29:44.591870+0000","last_became_peered":"2024-05-08T18:29:44.591870+0000","last_unstale":"2024-05-08T18:32:46.849004+0000","last_undegraded":"2024-05-08T18:32:46.849004+0000","last_fullsized":"2024-05-08T18:32:46.849004+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:35.176971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"33'14","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.917202+0000","last_change":"2024-05-08T18:29:46.603499+0000","last_active":"2024-05-08T18:32:46.917202+0000","last_peered":"2024-05-08T18:32:46.917202+0000","last_clean":"2024-05-08T18:32:46.917202+0000","last_became_active":"2024-05-08T18:29:46.602920+0000","last_became_peered":"2024-05-08T18:29:46.602920+0000","last_unstale":"2024-05-08T18:32:46.917202+0000","last_undegraded":"2024-05-08T18:32:46.917202+0000","last_fullsized":"2024-05-08T18:32:46.917202+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:08.504882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"116'105","reported_seq":334,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:56.628300+0000","last_change":"2024-05-08T18:29:48.634915+0000","last_active":"2024-05-08T18:32:56.628300+0000","last_peered":"2024-05-08T18:32:56.628300+0000","last_clean":"2024-05-08T18:32:56.628300+0000","last_became_active":"2024-05-08T18:29:48.634280+0000","last_became_peered":"2024-05-08T18:29:48.634280+0000","last_unstale":"2024-05-08T18:32:56.628300+0000","last_undegraded":"2024-05-08T18:32:56.628300+0000","last_fullsized":"2024-05-08T18:32:56.628300+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:19:58.182291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"80'2","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.067407+0000","last_change":"2024-05-08T18:29:50.688742+0000","last_active":"2024-05-08T18:32:46.067407+0000","last_peered":"2024-05-08T18:32:46.067407+0000","last_clean":"2024-05-08T18:32:46.067407+0000","last_became_active":"2024-05-08T18:29:50.687135+0000","last_became_peered":"2024-05-08T18:29:50.687135+0000","last_unstale":"2024-05-08T18:32:46.067407+0000","last_undegraded":"2024-05-08T18:32:46.067407+0000","last_fullsized":"2024-05-08T18:32:46.067407+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:12:49.040807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"80'2","reported_seq":152,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.059948+0000","last_change":"2024-05-08T18:30:21.220561+0000","last_active":"2024-05-08T18:32:46.059948+0000","last_peered":"2024-05-08T18:32:46.059948+0000","last_clean":"2024-05-08T18:32:46.059948+0000","last_became_active":"2024-05-08T18:30:21.220196+0000","last_became_peered":"2024-05-08T18:30:21.220196+0000","last_unstale":"2024-05-08T18:32:46.059948+0000","last_undegraded":"2024-05-08T18:32:46.059948+0000","last_fullsized":"2024-05-08T18:32:46.059948+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:19:27.075761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"116'10","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:56.915335+0000","last_change":"2024-05-08T18:29:40.565872+0000","last_active":"2024-05-08T18:32:56.915335+0000","last_peered":"2024-05-08T18:32:56.915335+0000","last_clean":"2024-05-08T18:32:56.915335+0000","last_became_active":"2024-05-08T18:29:40.565655+0000","last_became_peered":"2024-05-08T18:29:40.565655+0000","last_unstale":"2024-05-08T18:32:56.915335+0000","last_undegraded":"2024-05-08T18:32:56.915335+0000","last_fullsized":"2024-05-08T18:32:56.915335+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:16:16.521258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.919692+0000","last_change":"2024-05-08T18:29:34.501273+0000","last_active":"2024-05-08T18:32:46.919692+0000","last_peered":"2024-05-08T18:32:46.919692+0000","last_clean":"2024-05-08T18:32:46.919692+0000","last_became_active":"2024-05-08T18:29:34.500933+0000","last_became_peered":"2024-05-08T18:29:34.500933+0000","last_unstale":"2024-05-08T18:32:46.919692+0000","last_undegraded":"2024-05-08T18:32:46.919692+0000","last_fullsized":"2024-05-08T18:32:46.919692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:35.917391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.057534+0000","last_change":"2024-05-08T18:29:44.576227+0000","last_active":"2024-05-08T18:32:46.057534+0000","last_peered":"2024-05-08T18:32:46.057534+0000","last_clean":"2024-05-08T18:32:46.057534+0000","last_became_active":"2024-05-08T18:29:44.575454+0000","last_became_peered":"2024-05-08T18:29:44.575454+0000","last_unstale":"2024-05-08T18:32:46.057534+0000","last_undegraded":"2024-05-08T18:32:46.057534+0000","last_fullsized":"2024-05-08T18:32:46.057534+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:06:05.355648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"80'11","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.058692+0000","last_change":"2024-05-08T18:29:46.609633+0000","last_active":"2024-05-08T18:32:46.058692+0000","last_peered":"2024-05-08T18:32:46.058692+0000","last_clean":"2024-05-08T18:32:46.058692+0000","last_became_active":"2024-05-08T18:29:46.603455+0000","last_became_peered":"2024-05-08T18:29:46.603455+0000","last_unstale":"2024-05-08T18:32:46.058692+0000","last_undegraded":"2024-05-08T18:32:46.058692+0000","last_fullsized":"2024-05-08T18:32:46.058692+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:07:54.654205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"116'105","reported_seq":368,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:56.635042+0000","last_change":"2024-05-08T18:29:48.637898+0000","last_active":"2024-05-08T18:32:56.635042+0000","last_peered":"2024-05-08T18:32:56.635042+0000","last_clean":"2024-05-08T18:32:56.635042+0000","last_became_active":"2024-05-08T18:29:48.637070+0000","last_became_peered":"2024-05-08T18:29:48.637070+0000","last_unstale":"2024-05-08T18:32:56.635042+0000","last_undegraded":"2024-05-08T18:32:56.635042+0000","last_fullsized":"2024-05-08T18:32:56.635042+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:03:46.392864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"84'10","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.861066+0000","last_change":"2024-05-08T18:29:50.691526+0000","last_active":"2024-05-08T18:32:46.861066+0000","last_peered":"2024-05-08T18:32:46.861066+0000","last_clean":"2024-05-08T18:32:46.861066+0000","last_became_active":"2024-05-08T18:29:50.690767+0000","last_became_peered":"2024-05-08T18:29:50.690767+0000","last_unstale":"2024-05-08T18:32:46.861066+0000","last_undegraded":"2024-05-08T18:32:46.861066+0000","last_fullsized":"2024-05-08T18:32:46.861066+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"97'16","reported_seq":229,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.057923+0000","last_change":"2024-05-08T18:29:42.562006+0000","last_active":"2024-05-08T18:32:46.057923+0000","last_peered":"2024-05-08T18:32:46.057923+0000","last_clean":"2024-05-08T18:32:46.057923+0000","last_became_active":"2024-05-08T18:29:42.560861+0000","last_became_peered":"2024-05-08T18:29:42.560861+0000","last_unstale":"2024-05-08T18:32:46.057923+0000","last_undegraded":"2024-05-08T18:32:46.057923+0000","last_fullsized":"2024-05-08T18:32:46.057923+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:36.890277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"116'18","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.131053+0000","last_change":"2024-05-08T18:29:40.550529+0000","last_active":"2024-05-08T18:32:57.131053+0000","last_peered":"2024-05-08T18:32:57.131053+0000","last_clean":"2024-05-08T18:32:57.131053+0000","last_became_active":"2024-05-08T18:29:40.550241+0000","last_became_peered":"2024-05-08T18:29:40.550241+0000","last_unstale":"2024-05-08T18:32:57.131053+0000","last_undegraded":"2024-05-08T18:32:57.131053+0000","last_fullsized":"2024-05-08T18:32:57.131053+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.850587+0000","last_change":"2024-05-08T18:29:34.493537+0000","last_active":"2024-05-08T18:32:46.850587+0000","last_peered":"2024-05-08T18:32:46.850587+0000","last_clean":"2024-05-08T18:32:46.850587+0000","last_became_active":"2024-05-08T18:29:34.492891+0000","last_became_peered":"2024-05-08T18:29:34.492891+0000","last_unstale":"2024-05-08T18:32:46.850587+0000","last_undegraded":"2024-05-08T18:32:46.850587+0000","last_fullsized":"2024-05-08T18:32:46.850587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:09:07.992256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":189,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.063279+0000","last_change":"2024-05-08T18:29:44.590102+0000","last_active":"2024-05-08T18:32:46.063279+0000","last_peered":"2024-05-08T18:32:46.063279+0000","last_clean":"2024-05-08T18:32:46.063279+0000","last_became_active":"2024-05-08T18:29:44.589471+0000","last_became_peered":"2024-05-08T18:29:44.589471+0000","last_unstale":"2024-05-08T18:32:46.063279+0000","last_undegraded":"2024-05-08T18:32:46.063279+0000","last_fullsized":"2024-05-08T18:32:46.063279+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:14:04.085401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"116'46","reported_seq":257,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.183509+0000","last_change":"2024-05-08T18:29:46.606967+0000","last_active":"2024-05-08T18:32:57.183509+0000","last_peered":"2024-05-08T18:32:57.183509+0000","last_clean":"2024-05-08T18:32:57.183509+0000","last_became_active":"2024-05-08T18:29:46.605693+0000","last_became_peered":"2024-05-08T18:29:46.605693+0000","last_unstale":"2024-05-08T18:32:57.183509+0000","last_undegraded":"2024-05-08T18:32:57.183509+0000","last_fullsized":"2024-05-08T18:32:57.183509+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:24:13.568294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":57,"num_read_kb":43,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.061836+0000","last_change":"2024-05-08T18:29:48.634271+0000","last_active":"2024-05-08T18:32:46.061836+0000","last_peered":"2024-05-08T18:32:46.061836+0000","last_clean":"2024-05-08T18:32:46.061836+0000","last_became_active":"2024-05-08T18:29:48.633607+0000","last_became_peered":"2024-05-08T18:29:48.633607+0000","last_unstale":"2024-05-08T18:32:46.061836+0000","last_undegraded":"2024-05-08T18:32:46.061836+0000","last_fullsized":"2024-05-08T18:32:46.061836+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:34.806539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":176,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.079442+0000","last_change":"2024-05-08T18:29:50.685494+0000","last_active":"2024-05-08T18:32:47.079442+0000","last_peered":"2024-05-08T18:32:47.079442+0000","last_clean":"2024-05-08T18:32:47.079442+0000","last_became_active":"2024-05-08T18:29:50.684818+0000","last_became_peered":"2024-05-08T18:29:50.684818+0000","last_unstale":"2024-05-08T18:32:47.079442+0000","last_undegraded":"2024-05-08T18:32:47.079442+0000","last_fullsized":"2024-05-08T18:32:47.079442+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:22.220842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863435+0000","last_change":"2024-05-08T18:29:50.682937+0000","last_active":"2024-05-08T18:32:46.863435+0000","last_peered":"2024-05-08T18:32:46.863435+0000","last_clean":"2024-05-08T18:32:46.863435+0000","last_became_active":"2024-05-08T18:29:50.681771+0000","last_became_peered":"2024-05-08T18:29:50.681771+0000","last_unstale":"2024-05-08T18:32:46.863435+0000","last_undegraded":"2024-05-08T18:32:46.863435+0000","last_fullsized":"2024-05-08T18:32:46.863435+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"84'4","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.058933+0000","last_change":"2024-05-08T18:29:42.575909+0000","last_active":"2024-05-08T18:32:46.058933+0000","last_peered":"2024-05-08T18:32:46.058933+0000","last_clean":"2024-05-08T18:32:46.058933+0000","last_became_active":"2024-05-08T18:29:42.574877+0000","last_became_peered":"2024-05-08T18:29:42.574877+0000","last_unstale":"2024-05-08T18:32:46.058933+0000","last_undegraded":"2024-05-08T18:32:46.058933+0000","last_fullsized":"2024-05-08T18:32:46.058933+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:33.139089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"116'22","reported_seq":221,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.119371+0000","last_change":"2024-05-08T18:29:40.566496+0000","last_active":"2024-05-08T18:32:57.119371+0000","last_peered":"2024-05-08T18:32:57.119371+0000","last_clean":"2024-05-08T18:32:57.119371+0000","last_became_active":"2024-05-08T18:29:40.565874+0000","last_became_peered":"2024-05-08T18:29:40.565874+0000","last_unstale":"2024-05-08T18:32:57.119371+0000","last_undegraded":"2024-05-08T18:32:57.119371+0000","last_fullsized":"2024-05-08T18:32:57.119371+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:07.239963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.917412+0000","last_change":"2024-05-08T18:29:44.595410+0000","last_active":"2024-05-08T18:32:46.917412+0000","last_peered":"2024-05-08T18:32:46.917412+0000","last_clean":"2024-05-08T18:32:46.917412+0000","last_became_active":"2024-05-08T18:29:44.594286+0000","last_became_peered":"2024-05-08T18:29:44.594286+0000","last_unstale":"2024-05-08T18:32:46.917412+0000","last_undegraded":"2024-05-08T18:32:46.917412+0000","last_fullsized":"2024-05-08T18:32:46.917412+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:38.928160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"116'21","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:56.948076+0000","last_change":"2024-05-08T18:29:46.591009+0000","last_active":"2024-05-08T18:32:56.948076+0000","last_peered":"2024-05-08T18:32:56.948076+0000","last_clean":"2024-05-08T18:32:56.948076+0000","last_became_active":"2024-05-08T18:29:46.588810+0000","last_became_peered":"2024-05-08T18:29:46.588810+0000","last_unstale":"2024-05-08T18:32:56.948076+0000","last_undegraded":"2024-05-08T18:32:56.948076+0000","last_fullsized":"2024-05-08T18:32:56.948076+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:34:45.745300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.062900+0000","last_change":"2024-05-08T18:29:48.634986+0000","last_active":"2024-05-08T18:32:46.062900+0000","last_peered":"2024-05-08T18:32:46.062900+0000","last_clean":"2024-05-08T18:32:46.062900+0000","last_became_active":"2024-05-08T18:29:48.633866+0000","last_became_peered":"2024-05-08T18:29:48.633866+0000","last_unstale":"2024-05-08T18:32:46.062900+0000","last_undegraded":"2024-05-08T18:32:46.062900+0000","last_fullsized":"2024-05-08T18:32:46.062900+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:46.539830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"83'16","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.065910+0000","last_change":"2024-05-08T18:29:50.693408+0000","last_active":"2024-05-08T18:32:46.065910+0000","last_peered":"2024-05-08T18:32:46.065910+0000","last_clean":"2024-05-08T18:32:46.065910+0000","last_became_active":"2024-05-08T18:29:50.692687+0000","last_became_peered":"2024-05-08T18:29:50.692687+0000","last_unstale":"2024-05-08T18:32:46.065910+0000","last_undegraded":"2024-05-08T18:32:46.065910+0000","last_fullsized":"2024-05-08T18:32:46.065910+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:22.834262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":28,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"83'6","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.917179+0000","last_change":"2024-05-08T18:29:42.581368+0000","last_active":"2024-05-08T18:32:46.917179+0000","last_peered":"2024-05-08T18:32:46.917179+0000","last_clean":"2024-05-08T18:32:46.917179+0000","last_became_active":"2024-05-08T18:29:42.580887+0000","last_became_peered":"2024-05-08T18:29:42.580887+0000","last_unstale":"2024-05-08T18:32:46.917179+0000","last_undegraded":"2024-05-08T18:32:46.917179+0000","last_fullsized":"2024-05-08T18:32:46.917179+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:08:15.026467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"116'14","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.101556+0000","last_change":"2024-05-08T18:29:40.572770+0000","last_active":"2024-05-08T18:32:57.101556+0000","last_peered":"2024-05-08T18:32:57.101556+0000","last_clean":"2024-05-08T18:32:57.101556+0000","last_became_active":"2024-05-08T18:29:40.572079+0000","last_became_peered":"2024-05-08T18:29:40.572079+0000","last_unstale":"2024-05-08T18:32:57.101556+0000","last_undegraded":"2024-05-08T18:32:57.101556+0000","last_fullsized":"2024-05-08T18:32:57.101556+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:05.929806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":189,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.063663+0000","last_change":"2024-05-08T18:29:44.581323+0000","last_active":"2024-05-08T18:32:46.063663+0000","last_peered":"2024-05-08T18:32:46.063663+0000","last_clean":"2024-05-08T18:32:46.063663+0000","last_became_active":"2024-05-08T18:29:44.580805+0000","last_became_peered":"2024-05-08T18:29:44.580805+0000","last_unstale":"2024-05-08T18:32:46.063663+0000","last_undegraded":"2024-05-08T18:32:46.063663+0000","last_fullsized":"2024-05-08T18:32:46.063663+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:35:25.591140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"47'5","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.862071+0000","last_change":"2024-05-08T18:29:46.602495+0000","last_active":"2024-05-08T18:32:46.862071+0000","last_peered":"2024-05-08T18:32:46.862071+0000","last_clean":"2024-05-08T18:32:46.862071+0000","last_became_active":"2024-05-08T18:29:46.599789+0000","last_became_peered":"2024-05-08T18:29:46.599789+0000","last_unstale":"2024-05-08T18:32:46.862071+0000","last_undegraded":"2024-05-08T18:32:46.862071+0000","last_fullsized":"2024-05-08T18:32:46.862071+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.936013+0000","last_change":"2024-05-08T18:29:48.642994+0000","last_active":"2024-05-08T18:32:46.936013+0000","last_peered":"2024-05-08T18:32:46.936013+0000","last_clean":"2024-05-08T18:32:46.936013+0000","last_became_active":"2024-05-08T18:29:48.642056+0000","last_became_peered":"2024-05-08T18:29:48.642056+0000","last_unstale":"2024-05-08T18:32:46.936013+0000","last_undegraded":"2024-05-08T18:32:46.936013+0000","last_fullsized":"2024-05-08T18:32:46.936013+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:47:54.034851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863215+0000","last_change":"2024-05-08T18:29:50.672513+0000","last_active":"2024-05-08T18:32:46.863215+0000","last_peered":"2024-05-08T18:32:46.863215+0000","last_clean":"2024-05-08T18:32:46.863215+0000","last_became_active":"2024-05-08T18:29:50.671781+0000","last_became_peered":"2024-05-08T18:29:50.671781+0000","last_unstale":"2024-05-08T18:32:46.863215+0000","last_undegraded":"2024-05-08T18:32:46.863215+0000","last_fullsized":"2024-05-08T18:32:46.863215+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"97'2","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.062291+0000","last_change":"2024-05-08T18:29:42.576843+0000","last_active":"2024-05-08T18:32:46.062291+0000","last_peered":"2024-05-08T18:32:46.062291+0000","last_clean":"2024-05-08T18:32:46.062291+0000","last_became_active":"2024-05-08T18:29:42.576379+0000","last_became_peered":"2024-05-08T18:29:42.576379+0000","last_unstale":"2024-05-08T18:32:46.062291+0000","last_undegraded":"2024-05-08T18:32:46.062291+0000","last_fullsized":"2024-05-08T18:32:46.062291+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:20.471010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"116'24","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.153603+0000","last_change":"2024-05-08T18:29:40.542997+0000","last_active":"2024-05-08T18:32:57.153603+0000","last_peered":"2024-05-08T18:32:57.153603+0000","last_clean":"2024-05-08T18:32:57.153603+0000","last_became_active":"2024-05-08T18:29:40.542239+0000","last_became_peered":"2024-05-08T18:29:40.542239+0000","last_unstale":"2024-05-08T18:32:57.153603+0000","last_undegraded":"2024-05-08T18:32:57.153603+0000","last_fullsized":"2024-05-08T18:32:57.153603+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:14:43.555504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":24,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.935289+0000","last_change":"2024-05-08T18:29:44.594178+0000","last_active":"2024-05-08T18:32:46.935289+0000","last_peered":"2024-05-08T18:32:46.935289+0000","last_clean":"2024-05-08T18:32:46.935289+0000","last_became_active":"2024-05-08T18:29:44.592476+0000","last_became_peered":"2024-05-08T18:29:44.592476+0000","last_unstale":"2024-05-08T18:32:46.935289+0000","last_undegraded":"2024-05-08T18:32:46.935289+0000","last_fullsized":"2024-05-08T18:32:46.935289+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:04:16.093662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"116'20","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:56.727598+0000","last_change":"2024-05-08T18:29:46.597288+0000","last_active":"2024-05-08T18:32:56.727598+0000","last_peered":"2024-05-08T18:32:56.727598+0000","last_clean":"2024-05-08T18:32:56.727598+0000","last_became_active":"2024-05-08T18:29:46.596452+0000","last_became_peered":"2024-05-08T18:29:46.596452+0000","last_unstale":"2024-05-08T18:32:56.727598+0000","last_undegraded":"2024-05-08T18:32:56.727598+0000","last_fullsized":"2024-05-08T18:32:56.727598+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:32:43.245753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.848919+0000","last_change":"2024-05-08T18:29:48.635436+0000","last_active":"2024-05-08T18:32:46.848919+0000","last_peered":"2024-05-08T18:32:46.848919+0000","last_clean":"2024-05-08T18:32:46.848919+0000","last_became_active":"2024-05-08T18:29:48.634704+0000","last_became_peered":"2024-05-08T18:29:48.634704+0000","last_unstale":"2024-05-08T18:32:46.848919+0000","last_undegraded":"2024-05-08T18:32:46.848919+0000","last_fullsized":"2024-05-08T18:32:46.848919+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:55:52.238481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"83'2","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.079126+0000","last_change":"2024-05-08T18:29:50.687974+0000","last_active":"2024-05-08T18:32:47.079126+0000","last_peered":"2024-05-08T18:32:47.079126+0000","last_clean":"2024-05-08T18:32:47.079126+0000","last_became_active":"2024-05-08T18:29:50.687045+0000","last_became_peered":"2024-05-08T18:29:50.687045+0000","last_unstale":"2024-05-08T18:32:47.079126+0000","last_undegraded":"2024-05-08T18:32:47.079126+0000","last_fullsized":"2024-05-08T18:32:47.079126+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:55:01.894779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"97'4","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.063677+0000","last_change":"2024-05-08T18:30:20.850226+0000","last_active":"2024-05-08T18:32:46.063677+0000","last_peered":"2024-05-08T18:32:46.063677+0000","last_clean":"2024-05-08T18:32:46.063677+0000","last_became_active":"2024-05-08T18:30:20.849751+0000","last_became_peered":"2024-05-08T18:30:20.849751+0000","last_unstale":"2024-05-08T18:32:46.063677+0000","last_undegraded":"2024-05-08T18:32:46.063677+0000","last_fullsized":"2024-05-08T18:32:46.063677+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:33:31.550958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"116'26","reported_seq":224,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.173288+0000","last_change":"2024-05-08T18:29:40.541112+0000","last_active":"2024-05-08T18:32:57.173288+0000","last_peered":"2024-05-08T18:32:57.173288+0000","last_clean":"2024-05-08T18:32:57.173288+0000","last_became_active":"2024-05-08T18:29:40.540835+0000","last_became_peered":"2024-05-08T18:29:40.540835+0000","last_unstale":"2024-05-08T18:32:57.173288+0000","last_undegraded":"2024-05-08T18:32:57.173288+0000","last_fullsized":"2024-05-08T18:32:57.173288+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":26,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.848912+0000","last_change":"2024-05-08T18:29:44.592033+0000","last_active":"2024-05-08T18:32:46.848912+0000","last_peered":"2024-05-08T18:32:46.848912+0000","last_clean":"2024-05-08T18:32:46.848912+0000","last_became_active":"2024-05-08T18:29:44.590454+0000","last_became_peered":"2024-05-08T18:29:44.590454+0000","last_unstale":"2024-05-08T18:32:46.848912+0000","last_undegraded":"2024-05-08T18:32:46.848912+0000","last_fullsized":"2024-05-08T18:32:46.848912+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:11:03.740365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"116'18","reported_seq":211,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.196573+0000","last_change":"2024-05-08T18:29:46.607002+0000","last_active":"2024-05-08T18:32:57.196573+0000","last_peered":"2024-05-08T18:32:57.196573+0000","last_clean":"2024-05-08T18:32:57.196573+0000","last_became_active":"2024-05-08T18:29:46.606172+0000","last_became_peered":"2024-05-08T18:29:46.606172+0000","last_unstale":"2024-05-08T18:32:57.196573+0000","last_undegraded":"2024-05-08T18:32:57.196573+0000","last_fullsized":"2024-05-08T18:32:57.196573+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:37:35.850414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":182,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.862721+0000","last_change":"2024-05-08T18:29:48.632948+0000","last_active":"2024-05-08T18:32:46.862721+0000","last_peered":"2024-05-08T18:32:46.862721+0000","last_clean":"2024-05-08T18:32:46.862721+0000","last_became_active":"2024-05-08T18:29:48.631219+0000","last_became_peered":"2024-05-08T18:29:48.631219+0000","last_unstale":"2024-05-08T18:32:46.862721+0000","last_undegraded":"2024-05-08T18:32:46.862721+0000","last_fullsized":"2024-05-08T18:32:46.862721+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.850370+0000","last_change":"2024-05-08T18:29:42.570180+0000","last_active":"2024-05-08T18:32:46.850370+0000","last_peered":"2024-05-08T18:32:46.850370+0000","last_clean":"2024-05-08T18:32:46.850370+0000","last_became_active":"2024-05-08T18:29:42.569425+0000","last_became_peered":"2024-05-08T18:29:42.569425+0000","last_unstale":"2024-05-08T18:32:46.850370+0000","last_undegraded":"2024-05-08T18:32:46.850370+0000","last_fullsized":"2024-05-08T18:32:46.850370+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:35.037465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"116'16","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.131242+0000","last_change":"2024-05-08T18:29:40.547711+0000","last_active":"2024-05-08T18:32:57.131242+0000","last_peered":"2024-05-08T18:32:57.131242+0000","last_clean":"2024-05-08T18:32:57.131242+0000","last_became_active":"2024-05-08T18:29:40.547479+0000","last_became_peered":"2024-05-08T18:29:40.547479+0000","last_unstale":"2024-05-08T18:32:57.131242+0000","last_undegraded":"2024-05-08T18:32:57.131242+0000","last_fullsized":"2024-05-08T18:32:57.131242+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:12:40.901620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863451+0000","last_change":"2024-05-08T18:29:44.591547+0000","last_active":"2024-05-08T18:32:46.863451+0000","last_peered":"2024-05-08T18:32:46.863451+0000","last_clean":"2024-05-08T18:32:46.863451+0000","last_became_active":"2024-05-08T18:29:44.590498+0000","last_became_peered":"2024-05-08T18:29:44.590498+0000","last_unstale":"2024-05-08T18:32:46.863451+0000","last_undegraded":"2024-05-08T18:32:46.863451+0000","last_fullsized":"2024-05-08T18:32:46.863451+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"116'31","reported_seq":237,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.193137+0000","last_change":"2024-05-08T18:29:46.600437+0000","last_active":"2024-05-08T18:32:57.193137+0000","last_peered":"2024-05-08T18:32:57.193137+0000","last_clean":"2024-05-08T18:32:57.193137+0000","last_became_active":"2024-05-08T18:29:46.594672+0000","last_became_peered":"2024-05-08T18:29:46.594672+0000","last_unstale":"2024-05-08T18:32:57.193137+0000","last_undegraded":"2024-05-08T18:32:57.193137+0000","last_fullsized":"2024-05-08T18:32:57.193137+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:35:53.294312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":28,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":180,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.079232+0000","last_change":"2024-05-08T18:29:48.639840+0000","last_active":"2024-05-08T18:32:47.079232+0000","last_peered":"2024-05-08T18:32:47.079232+0000","last_clean":"2024-05-08T18:32:47.079232+0000","last_became_active":"2024-05-08T18:29:48.639120+0000","last_became_peered":"2024-05-08T18:29:48.639120+0000","last_unstale":"2024-05-08T18:32:47.079232+0000","last_undegraded":"2024-05-08T18:32:47.079232+0000","last_fullsized":"2024-05-08T18:32:47.079232+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:13:50.865474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"84'2","reported_seq":180,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.062460+0000","last_change":"2024-05-08T18:29:50.684843+0000","last_active":"2024-05-08T18:32:46.062460+0000","last_peered":"2024-05-08T18:32:46.062460+0000","last_clean":"2024-05-08T18:32:46.062460+0000","last_became_active":"2024-05-08T18:29:50.684119+0000","last_became_peered":"2024-05-08T18:29:50.684119+0000","last_unstale":"2024-05-08T18:32:46.062460+0000","last_undegraded":"2024-05-08T18:32:46.062460+0000","last_fullsized":"2024-05-08T18:32:46.062460+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:09:29.641515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"80'2","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863545+0000","last_change":"2024-05-08T18:29:42.575763+0000","last_active":"2024-05-08T18:32:46.863545+0000","last_peered":"2024-05-08T18:32:46.863545+0000","last_clean":"2024-05-08T18:32:46.863545+0000","last_became_active":"2024-05-08T18:29:42.575450+0000","last_became_peered":"2024-05-08T18:29:42.575450+0000","last_unstale":"2024-05-08T18:32:46.863545+0000","last_undegraded":"2024-05-08T18:32:46.863545+0000","last_fullsized":"2024-05-08T18:32:46.863545+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"116'20","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.019254+0000","last_change":"2024-05-08T18:29:40.546101+0000","last_active":"2024-05-08T18:32:57.019254+0000","last_peered":"2024-05-08T18:32:57.019254+0000","last_clean":"2024-05-08T18:32:57.019254+0000","last_became_active":"2024-05-08T18:29:40.545814+0000","last_became_peered":"2024-05-08T18:29:40.545814+0000","last_unstale":"2024-05-08T18:32:57.019254+0000","last_undegraded":"2024-05-08T18:32:57.019254+0000","last_fullsized":"2024-05-08T18:32:57.019254+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:22.579629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.850156+0000","last_change":"2024-05-08T18:29:44.591310+0000","last_active":"2024-05-08T18:32:46.850156+0000","last_peered":"2024-05-08T18:32:46.850156+0000","last_clean":"2024-05-08T18:32:46.850156+0000","last_became_active":"2024-05-08T18:29:44.590394+0000","last_became_peered":"2024-05-08T18:29:44.590394+0000","last_unstale":"2024-05-08T18:32:46.850156+0000","last_undegraded":"2024-05-08T18:32:46.850156+0000","last_fullsized":"2024-05-08T18:32:46.850156+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:02:28.348982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"116'24","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.200046+0000","last_change":"2024-05-08T18:29:46.605887+0000","last_active":"2024-05-08T18:32:57.200046+0000","last_peered":"2024-05-08T18:32:57.200046+0000","last_clean":"2024-05-08T18:32:57.200046+0000","last_became_active":"2024-05-08T18:29:46.604917+0000","last_became_peered":"2024-05-08T18:29:46.604917+0000","last_unstale":"2024-05-08T18:32:57.200046+0000","last_undegraded":"2024-05-08T18:32:57.200046+0000","last_fullsized":"2024-05-08T18:32:57.200046+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:22:36.338527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.918794+0000","last_change":"2024-05-08T18:29:48.644420+0000","last_active":"2024-05-08T18:32:46.918794+0000","last_peered":"2024-05-08T18:32:46.918794+0000","last_clean":"2024-05-08T18:32:46.918794+0000","last_became_active":"2024-05-08T18:29:48.643493+0000","last_became_peered":"2024-05-08T18:29:48.643493+0000","last_unstale":"2024-05-08T18:32:46.918794+0000","last_undegraded":"2024-05-08T18:32:46.918794+0000","last_fullsized":"2024-05-08T18:32:46.918794+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:19:33.148012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":174,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.848670+0000","last_change":"2024-05-08T18:29:50.687485+0000","last_active":"2024-05-08T18:32:46.848670+0000","last_peered":"2024-05-08T18:32:46.848670+0000","last_clean":"2024-05-08T18:32:46.848670+0000","last_became_active":"2024-05-08T18:29:50.686750+0000","last_became_peered":"2024-05-08T18:29:50.686750+0000","last_unstale":"2024-05-08T18:32:46.848670+0000","last_undegraded":"2024-05-08T18:32:46.848670+0000","last_fullsized":"2024-05-08T18:32:46.848670+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:41.914164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"97'4","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.066425+0000","last_change":"2024-05-08T18:29:42.566571+0000","last_active":"2024-05-08T18:32:46.066425+0000","last_peered":"2024-05-08T18:32:46.066425+0000","last_clean":"2024-05-08T18:32:46.066425+0000","last_became_active":"2024-05-08T18:29:42.563695+0000","last_became_peered":"2024-05-08T18:29:42.563695+0000","last_unstale":"2024-05-08T18:32:46.066425+0000","last_undegraded":"2024-05-08T18:32:46.066425+0000","last_fullsized":"2024-05-08T18:32:46.066425+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:46.887628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"116'20","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.134698+0000","last_change":"2024-05-08T18:29:40.545512+0000","last_active":"2024-05-08T18:32:57.134698+0000","last_peered":"2024-05-08T18:32:57.134698+0000","last_clean":"2024-05-08T18:32:57.134698+0000","last_became_active":"2024-05-08T18:29:40.544216+0000","last_became_peered":"2024-05-08T18:29:40.544216+0000","last_unstale":"2024-05-08T18:32:57.134698+0000","last_undegraded":"2024-05-08T18:32:57.134698+0000","last_fullsized":"2024-05-08T18:32:57.134698+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:37:08.242362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.060557+0000","last_change":"2024-05-08T18:29:44.576107+0000","last_active":"2024-05-08T18:32:46.060557+0000","last_peered":"2024-05-08T18:32:46.060557+0000","last_clean":"2024-05-08T18:32:46.060557+0000","last_became_active":"2024-05-08T18:29:44.575344+0000","last_became_peered":"2024-05-08T18:29:44.575344+0000","last_unstale":"2024-05-08T18:32:46.060557+0000","last_undegraded":"2024-05-08T18:32:46.060557+0000","last_fullsized":"2024-05-08T18:32:46.060557+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:19.731003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"116'20","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:56.963238+0000","last_change":"2024-05-08T18:29:46.584785+0000","last_active":"2024-05-08T18:32:56.963238+0000","last_peered":"2024-05-08T18:32:56.963238+0000","last_clean":"2024-05-08T18:32:56.963238+0000","last_became_active":"2024-05-08T18:29:46.583390+0000","last_became_peered":"2024-05-08T18:29:46.583390+0000","last_unstale":"2024-05-08T18:32:56.963238+0000","last_undegraded":"2024-05-08T18:32:56.963238+0000","last_fullsized":"2024-05-08T18:32:56.963238+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:27:01.747339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.919301+0000","last_change":"2024-05-08T18:29:48.643558+0000","last_active":"2024-05-08T18:32:46.919301+0000","last_peered":"2024-05-08T18:32:46.919301+0000","last_clean":"2024-05-08T18:32:46.919301+0000","last_became_active":"2024-05-08T18:29:48.642773+0000","last_became_peered":"2024-05-08T18:29:48.642773+0000","last_unstale":"2024-05-08T18:32:46.919301+0000","last_undegraded":"2024-05-08T18:32:46.919301+0000","last_fullsized":"2024-05-08T18:32:46.919301+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:59:04.369806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":176,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.078353+0000","last_change":"2024-05-08T18:29:50.674796+0000","last_active":"2024-05-08T18:32:47.078353+0000","last_peered":"2024-05-08T18:32:47.078353+0000","last_clean":"2024-05-08T18:32:47.078353+0000","last_became_active":"2024-05-08T18:29:50.674057+0000","last_became_peered":"2024-05-08T18:29:50.674057+0000","last_unstale":"2024-05-08T18:32:47.078353+0000","last_undegraded":"2024-05-08T18:32:47.078353+0000","last_fullsized":"2024-05-08T18:32:47.078353+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:34:14.488295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"84'4","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.062561+0000","last_change":"2024-05-08T18:29:42.577642+0000","last_active":"2024-05-08T18:32:46.062561+0000","last_peered":"2024-05-08T18:32:46.062561+0000","last_clean":"2024-05-08T18:32:46.062561+0000","last_became_active":"2024-05-08T18:29:42.577275+0000","last_became_peered":"2024-05-08T18:29:42.577275+0000","last_unstale":"2024-05-08T18:32:46.062561+0000","last_undegraded":"2024-05-08T18:32:46.062561+0000","last_fullsized":"2024-05-08T18:32:46.062561+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:51:45.155037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"116'20","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.132951+0000","last_change":"2024-05-08T18:29:40.562873+0000","last_active":"2024-05-08T18:32:57.132951+0000","last_peered":"2024-05-08T18:32:57.132951+0000","last_clean":"2024-05-08T18:32:57.132951+0000","last_became_active":"2024-05-08T18:29:40.562594+0000","last_became_peered":"2024-05-08T18:29:40.562594+0000","last_unstale":"2024-05-08T18:32:57.132951+0000","last_undegraded":"2024-05-08T18:32:57.132951+0000","last_fullsized":"2024-05-08T18:32:57.132951+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.918959+0000","last_change":"2024-05-08T18:29:44.594152+0000","last_active":"2024-05-08T18:32:46.918959+0000","last_peered":"2024-05-08T18:32:46.918959+0000","last_clean":"2024-05-08T18:32:46.918959+0000","last_became_active":"2024-05-08T18:29:44.593398+0000","last_became_peered":"2024-05-08T18:29:44.593398+0000","last_unstale":"2024-05-08T18:32:46.918959+0000","last_undegraded":"2024-05-08T18:32:46.918959+0000","last_fullsized":"2024-05-08T18:32:46.918959+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:11.825480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"85'12","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.059653+0000","last_change":"2024-05-08T18:29:46.602137+0000","last_active":"2024-05-08T18:32:46.059653+0000","last_peered":"2024-05-08T18:32:46.059653+0000","last_clean":"2024-05-08T18:32:46.059653+0000","last_became_active":"2024-05-08T18:29:46.601402+0000","last_became_peered":"2024-05-08T18:29:46.601402+0000","last_unstale":"2024-05-08T18:32:46.059653+0000","last_undegraded":"2024-05-08T18:32:46.059653+0000","last_fullsized":"2024-05-08T18:32:46.059653+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:23.940519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":22,"num_read_kb":17,"num_write":24,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"116'105","reported_seq":332,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:56.626793+0000","last_change":"2024-05-08T18:29:48.635696+0000","last_active":"2024-05-08T18:32:56.626793+0000","last_peered":"2024-05-08T18:32:56.626793+0000","last_clean":"2024-05-08T18:32:56.626793+0000","last_became_active":"2024-05-08T18:29:48.634859+0000","last_became_peered":"2024-05-08T18:29:48.634859+0000","last_unstale":"2024-05-08T18:32:56.626793+0000","last_undegraded":"2024-05-08T18:32:56.626793+0000","last_fullsized":"2024-05-08T18:32:56.626793+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:35:55.322495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":174,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.935107+0000","last_change":"2024-05-08T18:29:50.679757+0000","last_active":"2024-05-08T18:32:46.935107+0000","last_peered":"2024-05-08T18:32:46.935107+0000","last_clean":"2024-05-08T18:32:46.935107+0000","last_became_active":"2024-05-08T18:29:50.679011+0000","last_became_peered":"2024-05-08T18:29:50.679011+0000","last_unstale":"2024-05-08T18:32:46.935107+0000","last_undegraded":"2024-05-08T18:32:46.935107+0000","last_fullsized":"2024-05-08T18:32:46.935107+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:34:14.488295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"84'8","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.058657+0000","last_change":"2024-05-08T18:29:42.560354+0000","last_active":"2024-05-08T18:32:46.058657+0000","last_peered":"2024-05-08T18:32:46.058657+0000","last_clean":"2024-05-08T18:32:46.058657+0000","last_became_active":"2024-05-08T18:29:42.559647+0000","last_became_peered":"2024-05-08T18:29:42.559647+0000","last_unstale":"2024-05-08T18:32:46.058657+0000","last_undegraded":"2024-05-08T18:32:46.058657+0000","last_fullsized":"2024-05-08T18:32:46.058657+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:18:10.803989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"116'20","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.116344+0000","last_change":"2024-05-08T18:29:40.557683+0000","last_active":"2024-05-08T18:32:57.116344+0000","last_peered":"2024-05-08T18:32:57.116344+0000","last_clean":"2024-05-08T18:32:57.116344+0000","last_became_active":"2024-05-08T18:29:40.556254+0000","last_became_peered":"2024-05-08T18:29:40.556254+0000","last_unstale":"2024-05-08T18:32:57.116344+0000","last_undegraded":"2024-05-08T18:32:57.116344+0000","last_fullsized":"2024-05-08T18:32:57.116344+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:51:43.135322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.936035+0000","last_change":"2024-05-08T18:29:44.594068+0000","last_active":"2024-05-08T18:32:46.936035+0000","last_peered":"2024-05-08T18:32:46.936035+0000","last_clean":"2024-05-08T18:32:46.936035+0000","last_became_active":"2024-05-08T18:29:44.593322+0000","last_became_peered":"2024-05-08T18:29:44.593322+0000","last_unstale":"2024-05-08T18:32:46.936035+0000","last_undegraded":"2024-05-08T18:32:46.936035+0000","last_fullsized":"2024-05-08T18:32:46.936035+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:19.731003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"116'26","reported_seq":224,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.157585+0000","last_change":"2024-05-08T18:29:46.604700+0000","last_active":"2024-05-08T18:32:57.157585+0000","last_peered":"2024-05-08T18:32:57.157585+0000","last_clean":"2024-05-08T18:32:57.157585+0000","last_became_active":"2024-05-08T18:29:46.603885+0000","last_became_peered":"2024-05-08T18:29:46.603885+0000","last_unstale":"2024-05-08T18:32:57.157585+0000","last_undegraded":"2024-05-08T18:32:57.157585+0000","last_fullsized":"2024-05-08T18:32:57.157585+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:22:36.338527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":37,"num_read_kb":44,"num_write":22,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":182,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.861788+0000","last_change":"2024-05-08T18:29:48.640814+0000","last_active":"2024-05-08T18:32:46.861788+0000","last_peered":"2024-05-08T18:32:46.861788+0000","last_clean":"2024-05-08T18:32:46.861788+0000","last_became_active":"2024-05-08T18:29:48.640046+0000","last_became_peered":"2024-05-08T18:29:48.640046+0000","last_unstale":"2024-05-08T18:32:46.861788+0000","last_undegraded":"2024-05-08T18:32:46.861788+0000","last_fullsized":"2024-05-08T18:32:46.861788+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"83'8","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.938436+0000","last_change":"2024-05-08T18:29:50.692688+0000","last_active":"2024-05-08T18:32:46.938436+0000","last_peered":"2024-05-08T18:32:46.938436+0000","last_clean":"2024-05-08T18:32:46.938436+0000","last_became_active":"2024-05-08T18:29:50.692123+0000","last_became_peered":"2024-05-08T18:29:50.692123+0000","last_unstale":"2024-05-08T18:32:46.938436+0000","last_undegraded":"2024-05-08T18:32:46.938436+0000","last_fullsized":"2024-05-08T18:32:46.938436+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:38.318890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"97'2","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.058878+0000","last_change":"2024-05-08T18:29:42.558336+0000","last_active":"2024-05-08T18:32:46.058878+0000","last_peered":"2024-05-08T18:32:46.058878+0000","last_clean":"2024-05-08T18:32:46.058878+0000","last_became_active":"2024-05-08T18:29:42.557570+0000","last_became_peered":"2024-05-08T18:29:42.557570+0000","last_unstale":"2024-05-08T18:32:46.058878+0000","last_undegraded":"2024-05-08T18:32:46.058878+0000","last_fullsized":"2024-05-08T18:32:46.058878+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:54:16.539832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"116'4","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:56.851346+0000","last_change":"2024-05-08T18:29:40.537090+0000","last_active":"2024-05-08T18:32:56.851346+0000","last_peered":"2024-05-08T18:32:56.851346+0000","last_clean":"2024-05-08T18:32:56.851346+0000","last_became_active":"2024-05-08T18:29:40.536188+0000","last_became_peered":"2024-05-08T18:29:40.536188+0000","last_unstale":"2024-05-08T18:32:56.851346+0000","last_undegraded":"2024-05-08T18:32:56.851346+0000","last_fullsized":"2024-05-08T18:32:56.851346+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:22:48.880581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.078799+0000","last_change":"2024-05-08T18:29:44.578901+0000","last_active":"2024-05-08T18:32:47.078799+0000","last_peered":"2024-05-08T18:32:47.078799+0000","last_clean":"2024-05-08T18:32:47.078799+0000","last_became_active":"2024-05-08T18:29:44.578171+0000","last_became_peered":"2024-05-08T18:29:44.578171+0000","last_unstale":"2024-05-08T18:32:47.078799+0000","last_undegraded":"2024-05-08T18:32:47.078799+0000","last_fullsized":"2024-05-08T18:32:47.078799+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:19.731003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"116'20","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.161284+0000","last_change":"2024-05-08T18:29:46.604539+0000","last_active":"2024-05-08T18:32:57.161284+0000","last_peered":"2024-05-08T18:32:57.161284+0000","last_clean":"2024-05-08T18:32:57.161284+0000","last_became_active":"2024-05-08T18:29:46.603728+0000","last_became_peered":"2024-05-08T18:29:46.603728+0000","last_unstale":"2024-05-08T18:32:57.161284+0000","last_undegraded":"2024-05-08T18:32:57.161284+0000","last_fullsized":"2024-05-08T18:32:57.161284+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.848661+0000","last_change":"2024-05-08T18:29:48.635813+0000","last_active":"2024-05-08T18:32:46.848661+0000","last_peered":"2024-05-08T18:32:46.848661+0000","last_clean":"2024-05-08T18:32:46.848661+0000","last_became_active":"2024-05-08T18:29:48.634664+0000","last_became_peered":"2024-05-08T18:29:48.634664+0000","last_unstale":"2024-05-08T18:32:46.848661+0000","last_undegraded":"2024-05-08T18:32:46.848661+0000","last_fullsized":"2024-05-08T18:32:46.848661+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:27:23.427365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"97'7","reported_seq":187,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.066075+0000","last_change":"2024-05-08T18:29:50.687517+0000","last_active":"2024-05-08T18:32:46.066075+0000","last_peered":"2024-05-08T18:32:46.066075+0000","last_clean":"2024-05-08T18:32:46.066075+0000","last_became_active":"2024-05-08T18:29:50.686662+0000","last_became_peered":"2024-05-08T18:29:50.686662+0000","last_unstale":"2024-05-08T18:32:46.066075+0000","last_undegraded":"2024-05-08T18:32:46.066075+0000","last_fullsized":"2024-05-08T18:32:46.066075+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:58:00.455559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"97'4","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.062709+0000","last_change":"2024-05-08T18:29:42.558848+0000","last_active":"2024-05-08T18:32:46.062709+0000","last_peered":"2024-05-08T18:32:46.062709+0000","last_clean":"2024-05-08T18:32:46.062709+0000","last_became_active":"2024-05-08T18:29:42.558390+0000","last_became_peered":"2024-05-08T18:29:42.558390+0000","last_unstale":"2024-05-08T18:32:46.062709+0000","last_undegraded":"2024-05-08T18:32:46.062709+0000","last_fullsized":"2024-05-08T18:32:46.062709+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:55:30.468069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"116'14","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.083582+0000","last_change":"2024-05-08T18:29:40.567772+0000","last_active":"2024-05-08T18:32:57.083582+0000","last_peered":"2024-05-08T18:32:57.083582+0000","last_clean":"2024-05-08T18:32:57.083582+0000","last_became_active":"2024-05-08T18:29:40.567482+0000","last_became_peered":"2024-05-08T18:29:40.567482+0000","last_unstale":"2024-05-08T18:32:57.083582+0000","last_undegraded":"2024-05-08T18:32:57.083582+0000","last_fullsized":"2024-05-08T18:32:57.083582+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:36:37.796095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":5,"num_write":24,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.057189+0000","last_change":"2024-05-08T18:29:44.596876+0000","last_active":"2024-05-08T18:32:46.057189+0000","last_peered":"2024-05-08T18:32:46.057189+0000","last_clean":"2024-05-08T18:32:46.057189+0000","last_became_active":"2024-05-08T18:29:44.595712+0000","last_became_peered":"2024-05-08T18:29:44.595712+0000","last_unstale":"2024-05-08T18:32:46.057189+0000","last_undegraded":"2024-05-08T18:32:46.057189+0000","last_fullsized":"2024-05-08T18:32:46.057189+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:35:51.288126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"116'14","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:56.955974+0000","last_change":"2024-05-08T18:29:46.598637+0000","last_active":"2024-05-08T18:32:56.955974+0000","last_peered":"2024-05-08T18:32:56.955974+0000","last_clean":"2024-05-08T18:32:56.955974+0000","last_became_active":"2024-05-08T18:29:46.597394+0000","last_became_peered":"2024-05-08T18:29:46.597394+0000","last_unstale":"2024-05-08T18:32:56.955974+0000","last_undegraded":"2024-05-08T18:32:56.955974+0000","last_fullsized":"2024-05-08T18:32:56.955974+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:52:22.540814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":13,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.057643+0000","last_change":"2024-05-08T18:29:48.642251+0000","last_active":"2024-05-08T18:32:46.057643+0000","last_peered":"2024-05-08T18:32:46.057643+0000","last_clean":"2024-05-08T18:32:46.057643+0000","last_became_active":"2024-05-08T18:29:48.641666+0000","last_became_peered":"2024-05-08T18:29:48.641666+0000","last_unstale":"2024-05-08T18:32:46.057643+0000","last_undegraded":"2024-05-08T18:32:46.057643+0000","last_fullsized":"2024-05-08T18:32:46.057643+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:13:50.865474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"80'2","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.937644+0000","last_change":"2024-05-08T18:29:50.685668+0000","last_active":"2024-05-08T18:32:46.937644+0000","last_peered":"2024-05-08T18:32:46.937644+0000","last_clean":"2024-05-08T18:32:46.937644+0000","last_became_active":"2024-05-08T18:29:50.684958+0000","last_became_peered":"2024-05-08T18:29:50.684958+0000","last_unstale":"2024-05-08T18:32:46.937644+0000","last_undegraded":"2024-05-08T18:32:46.937644+0000","last_fullsized":"2024-05-08T18:32:46.937644+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:55:01.894779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.057760+0000","last_change":"2024-05-08T18:29:42.562063+0000","last_active":"2024-05-08T18:32:46.057760+0000","last_peered":"2024-05-08T18:32:46.057760+0000","last_clean":"2024-05-08T18:32:46.057760+0000","last_became_active":"2024-05-08T18:29:42.558871+0000","last_became_peered":"2024-05-08T18:29:42.558871+0000","last_unstale":"2024-05-08T18:32:46.057760+0000","last_undegraded":"2024-05-08T18:32:46.057760+0000","last_fullsized":"2024-05-08T18:32:46.057760+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:59.243324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"116'26","reported_seq":224,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.177810+0000","last_change":"2024-05-08T18:29:40.541070+0000","last_active":"2024-05-08T18:32:57.177810+0000","last_peered":"2024-05-08T18:32:57.177810+0000","last_clean":"2024-05-08T18:32:57.177810+0000","last_became_active":"2024-05-08T18:29:40.540767+0000","last_became_peered":"2024-05-08T18:29:40.540767+0000","last_unstale":"2024-05-08T18:32:57.177810+0000","last_undegraded":"2024-05-08T18:32:57.177810+0000","last_fullsized":"2024-05-08T18:32:57.177810+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":26,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"26'1","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.917294+0000","last_change":"2024-05-08T18:29:44.592737+0000","last_active":"2024-05-08T18:32:46.917294+0000","last_peered":"2024-05-08T18:32:46.917294+0000","last_clean":"2024-05-08T18:32:46.917294+0000","last_became_active":"2024-05-08T18:29:44.592243+0000","last_became_peered":"2024-05-08T18:29:44.592243+0000","last_unstale":"2024-05-08T18:32:46.917294+0000","last_undegraded":"2024-05-08T18:32:46.917294+0000","last_fullsized":"2024-05-08T18:32:46.917294+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:59.744050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"116'19","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:56.968253+0000","last_change":"2024-05-08T18:29:46.610835+0000","last_active":"2024-05-08T18:32:56.968253+0000","last_peered":"2024-05-08T18:32:56.968253+0000","last_clean":"2024-05-08T18:32:56.968253+0000","last_became_active":"2024-05-08T18:29:46.609903+0000","last_became_peered":"2024-05-08T18:29:46.609903+0000","last_unstale":"2024-05-08T18:32:56.968253+0000","last_undegraded":"2024-05-08T18:32:56.968253+0000","last_fullsized":"2024-05-08T18:32:56.968253+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:37:35.850414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":182,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.862643+0000","last_change":"2024-05-08T18:29:48.629822+0000","last_active":"2024-05-08T18:32:46.862643+0000","last_peered":"2024-05-08T18:32:46.862643+0000","last_clean":"2024-05-08T18:32:46.862643+0000","last_became_active":"2024-05-08T18:29:48.629204+0000","last_became_peered":"2024-05-08T18:29:48.629204+0000","last_unstale":"2024-05-08T18:32:46.862643+0000","last_undegraded":"2024-05-08T18:32:46.862643+0000","last_fullsized":"2024-05-08T18:32:46.862643+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"84'6","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.060640+0000","last_change":"2024-05-08T18:29:50.668101+0000","last_active":"2024-05-08T18:32:46.060640+0000","last_peered":"2024-05-08T18:32:46.060640+0000","last_clean":"2024-05-08T18:32:46.060640+0000","last_became_active":"2024-05-08T18:29:50.667357+0000","last_became_peered":"2024-05-08T18:29:50.667357+0000","last_unstale":"2024-05-08T18:32:46.060640+0000","last_undegraded":"2024-05-08T18:32:46.060640+0000","last_fullsized":"2024-05-08T18:32:46.060640+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:55:01.894779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"97'4","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.919471+0000","last_change":"2024-05-08T18:29:42.581366+0000","last_active":"2024-05-08T18:32:46.919471+0000","last_peered":"2024-05-08T18:32:46.919471+0000","last_clean":"2024-05-08T18:32:46.919471+0000","last_became_active":"2024-05-08T18:29:42.580988+0000","last_became_peered":"2024-05-08T18:29:42.580988+0000","last_unstale":"2024-05-08T18:32:46.919471+0000","last_undegraded":"2024-05-08T18:32:46.919471+0000","last_fullsized":"2024-05-08T18:32:46.919471+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:42.005809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"116'16","reported_seq":211,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.147377+0000","last_change":"2024-05-08T18:29:40.562025+0000","last_active":"2024-05-08T18:32:57.147377+0000","last_peered":"2024-05-08T18:32:57.147377+0000","last_clean":"2024-05-08T18:32:57.147377+0000","last_became_active":"2024-05-08T18:29:40.561277+0000","last_became_peered":"2024-05-08T18:29:40.561277+0000","last_unstale":"2024-05-08T18:32:57.147377+0000","last_undegraded":"2024-05-08T18:32:57.147377+0000","last_fullsized":"2024-05-08T18:32:57.147377+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:59:25.840149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":3,"num_write":26,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.916111+0000","last_change":"2024-05-08T18:29:42.573832+0000","last_active":"2024-05-08T18:32:46.916111+0000","last_peered":"2024-05-08T18:32:46.916111+0000","last_clean":"2024-05-08T18:32:46.916111+0000","last_became_active":"2024-05-08T18:29:42.573502+0000","last_became_peered":"2024-05-08T18:29:42.573502+0000","last_unstale":"2024-05-08T18:32:46.916111+0000","last_undegraded":"2024-05-08T18:32:46.916111+0000","last_fullsized":"2024-05-08T18:32:46.916111+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:35.037465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"116'16","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.095095+0000","last_change":"2024-05-08T18:29:40.533094+0000","last_active":"2024-05-08T18:32:57.095095+0000","last_peered":"2024-05-08T18:32:57.095095+0000","last_clean":"2024-05-08T18:32:57.095095+0000","last_became_active":"2024-05-08T18:29:40.532246+0000","last_became_peered":"2024-05-08T18:29:40.532246+0000","last_unstale":"2024-05-08T18:32:57.095095+0000","last_undegraded":"2024-05-08T18:32:57.095095+0000","last_fullsized":"2024-05-08T18:32:57.095095+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:37:08.242362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.080244+0000","last_change":"2024-05-08T18:29:42.565298+0000","last_active":"2024-05-08T18:32:47.080244+0000","last_peered":"2024-05-08T18:32:47.080244+0000","last_clean":"2024-05-08T18:32:47.080244+0000","last_became_active":"2024-05-08T18:29:42.564542+0000","last_became_peered":"2024-05-08T18:29:42.564542+0000","last_unstale":"2024-05-08T18:32:47.080244+0000","last_undegraded":"2024-05-08T18:32:47.080244+0000","last_fullsized":"2024-05-08T18:32:47.080244+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:57.706167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"116'28","reported_seq":224,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.153551+0000","last_change":"2024-05-08T18:29:40.556958+0000","last_active":"2024-05-08T18:32:57.153551+0000","last_peered":"2024-05-08T18:32:57.153551+0000","last_clean":"2024-05-08T18:32:57.153551+0000","last_became_active":"2024-05-08T18:29:40.556091+0000","last_became_peered":"2024-05-08T18:29:40.556091+0000","last_unstale":"2024-05-08T18:32:57.153551+0000","last_undegraded":"2024-05-08T18:32:57.153551+0000","last_fullsized":"2024-05-08T18:32:57.153551+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:39.986094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":28,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"97'6","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.918325+0000","last_change":"2024-05-08T18:29:42.574619+0000","last_active":"2024-05-08T18:32:46.918325+0000","last_peered":"2024-05-08T18:32:46.918325+0000","last_clean":"2024-05-08T18:32:46.918325+0000","last_became_active":"2024-05-08T18:29:42.573178+0000","last_became_peered":"2024-05-08T18:29:42.573178+0000","last_unstale":"2024-05-08T18:32:46.918325+0000","last_undegraded":"2024-05-08T18:32:46.918325+0000","last_fullsized":"2024-05-08T18:32:46.918325+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:33.139089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"116'10","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.176913+0000","last_change":"2024-05-08T18:29:40.544338+0000","last_active":"2024-05-08T18:32:57.176913+0000","last_peered":"2024-05-08T18:32:57.176913+0000","last_clean":"2024-05-08T18:32:57.176913+0000","last_became_active":"2024-05-08T18:29:40.544107+0000","last_became_peered":"2024-05-08T18:29:40.544107+0000","last_unstale":"2024-05-08T18:32:57.176913+0000","last_undegraded":"2024-05-08T18:32:57.176913+0000","last_fullsized":"2024-05-08T18:32:57.176913+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"84'2","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.064285+0000","last_change":"2024-05-08T18:29:42.576979+0000","last_active":"2024-05-08T18:32:46.064285+0000","last_peered":"2024-05-08T18:32:46.064285+0000","last_clean":"2024-05-08T18:32:46.064285+0000","last_became_active":"2024-05-08T18:29:42.576395+0000","last_became_peered":"2024-05-08T18:29:42.576395+0000","last_unstale":"2024-05-08T18:32:46.064285+0000","last_undegraded":"2024-05-08T18:32:46.064285+0000","last_fullsized":"2024-05-08T18:32:46.064285+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:53:03.097704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"116'10","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.105126+0000","last_change":"2024-05-08T18:29:40.558142+0000","last_active":"2024-05-08T18:32:57.105126+0000","last_peered":"2024-05-08T18:32:57.105126+0000","last_clean":"2024-05-08T18:32:57.105126+0000","last_became_active":"2024-05-08T18:29:40.557874+0000","last_became_peered":"2024-05-08T18:29:40.557874+0000","last_unstale":"2024-05-08T18:32:57.105126+0000","last_undegraded":"2024-05-08T18:32:57.105126+0000","last_fullsized":"2024-05-08T18:32:57.105126+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:54.200883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"97'2","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.059136+0000","last_change":"2024-05-08T18:29:42.558324+0000","last_active":"2024-05-08T18:32:46.059136+0000","last_peered":"2024-05-08T18:32:46.059136+0000","last_clean":"2024-05-08T18:32:46.059136+0000","last_became_active":"2024-05-08T18:29:42.556774+0000","last_became_peered":"2024-05-08T18:29:42.556774+0000","last_unstale":"2024-05-08T18:32:46.059136+0000","last_undegraded":"2024-05-08T18:32:46.059136+0000","last_fullsized":"2024-05-08T18:32:46.059136+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:02:26.311100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"116'22","reported_seq":226,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.114331+0000","last_change":"2024-05-08T18:30:20.858467+0000","last_active":"2024-05-08T18:32:57.114331+0000","last_peered":"2024-05-08T18:32:57.114331+0000","last_clean":"2024-05-08T18:32:57.114331+0000","last_became_active":"2024-05-08T18:30:20.858016+0000","last_became_peered":"2024-05-08T18:30:20.858016+0000","last_unstale":"2024-05-08T18:32:57.114331+0000","last_undegraded":"2024-05-08T18:32:57.114331+0000","last_fullsized":"2024-05-08T18:32:57.114331+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:10:28.824915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"84'4","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.062025+0000","last_change":"2024-05-08T18:29:42.562772+0000","last_active":"2024-05-08T18:32:46.062025+0000","last_peered":"2024-05-08T18:32:46.062025+0000","last_clean":"2024-05-08T18:32:46.062025+0000","last_became_active":"2024-05-08T18:29:42.562420+0000","last_became_peered":"2024-05-08T18:29:42.562420+0000","last_unstale":"2024-05-08T18:32:46.062025+0000","last_undegraded":"2024-05-08T18:32:46.062025+0000","last_fullsized":"2024-05-08T18:32:46.062025+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:30:29.452640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"116'10","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.101229+0000","last_change":"2024-05-08T18:29:40.562024+0000","last_active":"2024-05-08T18:32:57.101229+0000","last_peered":"2024-05-08T18:32:57.101229+0000","last_clean":"2024-05-08T18:32:57.101229+0000","last_became_active":"2024-05-08T18:29:40.561326+0000","last_became_peered":"2024-05-08T18:29:40.561326+0000","last_unstale":"2024-05-08T18:32:57.101229+0000","last_undegraded":"2024-05-08T18:32:57.101229+0000","last_fullsized":"2024-05-08T18:32:57.101229+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:21:38.354933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"97'4","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.847229+0000","last_change":"2024-05-08T18:29:42.561419+0000","last_active":"2024-05-08T18:32:46.847229+0000","last_peered":"2024-05-08T18:32:46.847229+0000","last_clean":"2024-05-08T18:32:46.847229+0000","last_became_active":"2024-05-08T18:29:42.560520+0000","last_became_peered":"2024-05-08T18:29:42.560520+0000","last_unstale":"2024-05-08T18:32:46.847229+0000","last_undegraded":"2024-05-08T18:32:46.847229+0000","last_fullsized":"2024-05-08T18:32:46.847229+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:07.949520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"116'22","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.117928+0000","last_change":"2024-05-08T18:29:40.554884+0000","last_active":"2024-05-08T18:32:57.117928+0000","last_peered":"2024-05-08T18:32:57.117928+0000","last_clean":"2024-05-08T18:32:57.117928+0000","last_became_active":"2024-05-08T18:29:40.554603+0000","last_became_peered":"2024-05-08T18:29:40.554603+0000","last_unstale":"2024-05-08T18:32:57.117928+0000","last_undegraded":"2024-05-08T18:32:57.117928+0000","last_fullsized":"2024-05-08T18:32:57.117928+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:09:39.835826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"84'4","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.861120+0000","last_change":"2024-05-08T18:29:42.574689+0000","last_active":"2024-05-08T18:32:46.861120+0000","last_peered":"2024-05-08T18:32:46.861120+0000","last_clean":"2024-05-08T18:32:46.861120+0000","last_became_active":"2024-05-08T18:29:42.573947+0000","last_became_peered":"2024-05-08T18:29:42.573947+0000","last_unstale":"2024-05-08T18:32:46.861120+0000","last_undegraded":"2024-05-08T18:32:46.861120+0000","last_fullsized":"2024-05-08T18:32:46.861120+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"116'20","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.153482+0000","last_change":"2024-05-08T18:29:40.554005+0000","last_active":"2024-05-08T18:32:57.153482+0000","last_peered":"2024-05-08T18:32:57.153482+0000","last_clean":"2024-05-08T18:32:57.153482+0000","last_became_active":"2024-05-08T18:29:40.553356+0000","last_became_peered":"2024-05-08T18:29:40.553356+0000","last_unstale":"2024-05-08T18:32:57.153482+0000","last_undegraded":"2024-05-08T18:32:57.153482+0000","last_fullsized":"2024-05-08T18:32:57.153482+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:08:13.006752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"84'2","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.059942+0000","last_change":"2024-05-08T18:29:42.566487+0000","last_active":"2024-05-08T18:32:46.059942+0000","last_peered":"2024-05-08T18:32:46.059942+0000","last_clean":"2024-05-08T18:32:46.059942+0000","last_became_active":"2024-05-08T18:29:42.565760+0000","last_became_peered":"2024-05-08T18:29:42.565760+0000","last_unstale":"2024-05-08T18:32:46.059942+0000","last_undegraded":"2024-05-08T18:32:46.059942+0000","last_fullsized":"2024-05-08T18:32:46.059942+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:57.706167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"116'16","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.097640+0000","last_change":"2024-05-08T18:29:40.552543+0000","last_active":"2024-05-08T18:32:57.097640+0000","last_peered":"2024-05-08T18:32:57.097640+0000","last_clean":"2024-05-08T18:32:57.097640+0000","last_became_active":"2024-05-08T18:29:40.552307+0000","last_became_peered":"2024-05-08T18:29:40.552307+0000","last_unstale":"2024-05-08T18:32:57.097640+0000","last_undegraded":"2024-05-08T18:32:57.097640+0000","last_fullsized":"2024-05-08T18:32:57.097640+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:48.294532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"84'4","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.063759+0000","last_change":"2024-05-08T18:29:42.561658+0000","last_active":"2024-05-08T18:32:46.063759+0000","last_peered":"2024-05-08T18:32:46.063759+0000","last_clean":"2024-05-08T18:32:46.063759+0000","last_became_active":"2024-05-08T18:29:42.561171+0000","last_became_peered":"2024-05-08T18:29:42.561171+0000","last_unstale":"2024-05-08T18:32:46.063759+0000","last_undegraded":"2024-05-08T18:32:46.063759+0000","last_fullsized":"2024-05-08T18:32:46.063759+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:46:15.966061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"116'20","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.109965+0000","last_change":"2024-05-08T18:29:40.543041+0000","last_active":"2024-05-08T18:32:57.109965+0000","last_peered":"2024-05-08T18:32:57.109965+0000","last_clean":"2024-05-08T18:32:57.109965+0000","last_became_active":"2024-05-08T18:29:40.542398+0000","last_became_peered":"2024-05-08T18:29:40.542398+0000","last_unstale":"2024-05-08T18:32:57.109965+0000","last_undegraded":"2024-05-08T18:32:57.109965+0000","last_fullsized":"2024-05-08T18:32:57.109965+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:33.017750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"97'6","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.060280+0000","last_change":"2024-05-08T18:29:42.579690+0000","last_active":"2024-05-08T18:32:46.060280+0000","last_peered":"2024-05-08T18:32:46.060280+0000","last_clean":"2024-05-08T18:32:46.060280+0000","last_became_active":"2024-05-08T18:29:42.578981+0000","last_became_peered":"2024-05-08T18:29:42.578981+0000","last_unstale":"2024-05-08T18:32:46.060280+0000","last_undegraded":"2024-05-08T18:32:46.060280+0000","last_fullsized":"2024-05-08T18:32:46.060280+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:36:03.084561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"116'22","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.068990+0000","last_change":"2024-05-08T18:29:40.548499+0000","last_active":"2024-05-08T18:32:57.068990+0000","last_peered":"2024-05-08T18:32:57.068990+0000","last_clean":"2024-05-08T18:32:57.068990+0000","last_became_active":"2024-05-08T18:29:40.548177+0000","last_became_peered":"2024-05-08T18:29:40.548177+0000","last_unstale":"2024-05-08T18:32:57.068990+0000","last_undegraded":"2024-05-08T18:32:57.068990+0000","last_fullsized":"2024-05-08T18:32:57.068990+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"80'2","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.934939+0000","last_change":"2024-05-08T18:29:42.575892+0000","last_active":"2024-05-08T18:32:46.934939+0000","last_peered":"2024-05-08T18:32:46.934939+0000","last_clean":"2024-05-08T18:32:46.934939+0000","last_became_active":"2024-05-08T18:29:42.573384+0000","last_became_peered":"2024-05-08T18:29:42.573384+0000","last_unstale":"2024-05-08T18:32:46.934939+0000","last_undegraded":"2024-05-08T18:32:46.934939+0000","last_fullsized":"2024-05-08T18:32:46.934939+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:55.055481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"116'18","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.077239+0000","last_change":"2024-05-08T18:29:40.565068+0000","last_active":"2024-05-08T18:32:57.077239+0000","last_peered":"2024-05-08T18:32:57.077239+0000","last_clean":"2024-05-08T18:32:57.077239+0000","last_became_active":"2024-05-08T18:29:40.563231+0000","last_became_peered":"2024-05-08T18:29:40.563231+0000","last_unstale":"2024-05-08T18:32:57.077239+0000","last_undegraded":"2024-05-08T18:32:57.077239+0000","last_fullsized":"2024-05-08T18:32:57.077239+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:17:47.828990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":194,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.862613+0000","last_change":"2024-05-08T18:29:42.564338+0000","last_active":"2024-05-08T18:32:46.862613+0000","last_peered":"2024-05-08T18:32:46.862613+0000","last_clean":"2024-05-08T18:32:46.862613+0000","last_became_active":"2024-05-08T18:29:42.563822+0000","last_became_peered":"2024-05-08T18:29:42.563822+0000","last_unstale":"2024-05-08T18:32:46.862613+0000","last_undegraded":"2024-05-08T18:32:46.862613+0000","last_fullsized":"2024-05-08T18:32:46.862613+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"116'28","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.126350+0000","last_change":"2024-05-08T18:29:40.573333+0000","last_active":"2024-05-08T18:32:57.126350+0000","last_peered":"2024-05-08T18:32:57.126350+0000","last_clean":"2024-05-08T18:32:57.126350+0000","last_became_active":"2024-05-08T18:29:40.571195+0000","last_became_peered":"2024-05-08T18:29:40.571195+0000","last_unstale":"2024-05-08T18:32:57.126350+0000","last_undegraded":"2024-05-08T18:32:57.126350+0000","last_fullsized":"2024-05-08T18:32:57.126350+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:33.017750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":28,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.061746+0000","last_change":"2024-05-08T18:29:42.563085+0000","last_active":"2024-05-08T18:32:46.061746+0000","last_peered":"2024-05-08T18:32:46.061746+0000","last_clean":"2024-05-08T18:32:46.061746+0000","last_became_active":"2024-05-08T18:29:42.560419+0000","last_became_peered":"2024-05-08T18:29:42.560419+0000","last_unstale":"2024-05-08T18:32:46.061746+0000","last_undegraded":"2024-05-08T18:32:46.061746+0000","last_fullsized":"2024-05-08T18:32:46.061746+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:20.397730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"116'20","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.121254+0000","last_change":"2024-05-08T18:29:40.568890+0000","last_active":"2024-05-08T18:32:57.121254+0000","last_peered":"2024-05-08T18:32:57.121254+0000","last_clean":"2024-05-08T18:32:57.121254+0000","last_became_active":"2024-05-08T18:29:40.568584+0000","last_became_peered":"2024-05-08T18:29:40.568584+0000","last_unstale":"2024-05-08T18:32:57.121254+0000","last_undegraded":"2024-05-08T18:32:57.121254+0000","last_fullsized":"2024-05-08T18:32:57.121254+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:25:01.595224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"83'6","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.934923+0000","last_change":"2024-05-08T18:29:42.574277+0000","last_active":"2024-05-08T18:32:46.934923+0000","last_peered":"2024-05-08T18:32:46.934923+0000","last_clean":"2024-05-08T18:32:46.934923+0000","last_became_active":"2024-05-08T18:29:42.573563+0000","last_became_peered":"2024-05-08T18:29:42.573563+0000","last_unstale":"2024-05-08T18:32:46.934923+0000","last_undegraded":"2024-05-08T18:32:46.934923+0000","last_fullsized":"2024-05-08T18:32:46.934923+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:43:57.706167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"116'16","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.111184+0000","last_change":"2024-05-08T18:29:40.562058+0000","last_active":"2024-05-08T18:32:57.111184+0000","last_peered":"2024-05-08T18:32:57.111184+0000","last_clean":"2024-05-08T18:32:57.111184+0000","last_became_active":"2024-05-08T18:29:40.561360+0000","last_became_peered":"2024-05-08T18:29:40.561360+0000","last_unstale":"2024-05-08T18:32:57.111184+0000","last_undegraded":"2024-05-08T18:32:57.111184+0000","last_fullsized":"2024-05-08T18:32:57.111184+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:05.929806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"116'22","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.153558+0000","last_change":"2024-05-08T18:29:40.538728+0000","last_active":"2024-05-08T18:32:57.153558+0000","last_peered":"2024-05-08T18:32:57.153558+0000","last_clean":"2024-05-08T18:32:57.153558+0000","last_became_active":"2024-05-08T18:29:40.537925+0000","last_became_peered":"2024-05-08T18:29:40.537925+0000","last_unstale":"2024-05-08T18:32:57.153558+0000","last_undegraded":"2024-05-08T18:32:57.153558+0000","last_fullsized":"2024-05-08T18:32:57.153558+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:28.426657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":4,"num_write":32,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"97'8","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.861279+0000","last_change":"2024-05-08T18:29:42.574941+0000","last_active":"2024-05-08T18:32:46.861279+0000","last_peered":"2024-05-08T18:32:46.861279+0000","last_clean":"2024-05-08T18:32:46.861279+0000","last_became_active":"2024-05-08T18:29:42.574351+0000","last_became_peered":"2024-05-08T18:29:42.574351+0000","last_unstale":"2024-05-08T18:32:46.861279+0000","last_undegraded":"2024-05-08T18:32:46.861279+0000","last_fullsized":"2024-05-08T18:32:46.861279+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"116'20","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.080390+0000","last_change":"2024-05-08T18:29:40.543714+0000","last_active":"2024-05-08T18:32:57.080390+0000","last_peered":"2024-05-08T18:32:57.080390+0000","last_clean":"2024-05-08T18:32:57.080390+0000","last_became_active":"2024-05-08T18:29:40.542965+0000","last_became_peered":"2024-05-08T18:29:40.542965+0000","last_unstale":"2024-05-08T18:32:57.080390+0000","last_undegraded":"2024-05-08T18:32:57.080390+0000","last_fullsized":"2024-05-08T18:32:57.080390+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:12:59.146887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.080411+0000","last_change":"2024-05-08T18:29:42.560007+0000","last_active":"2024-05-08T18:32:47.080411+0000","last_peered":"2024-05-08T18:32:47.080411+0000","last_clean":"2024-05-08T18:32:47.080411+0000","last_became_active":"2024-05-08T18:29:42.559028+0000","last_became_peered":"2024-05-08T18:29:42.559028+0000","last_unstale":"2024-05-08T18:32:47.080411+0000","last_undegraded":"2024-05-08T18:32:47.080411+0000","last_fullsized":"2024-05-08T18:32:47.080411+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:36:03.084561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":247,"num_read_kb":238,"num_write":231,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":840,"ondisk_log_size":840,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":23632,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1024,"num_read_kb":1070,"num_write":533,"num_write_kb":208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":771,"ondisk_log_size":771,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":344,"num_read_kb":344,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":579,"num_read_kb":555,"num_write":234,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":222,"ondisk_log_size":222,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":593,"num_read_kb":23,"num_write":1216,"num_write_kb":2365440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1156,"ondisk_log_size":1156,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509489,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33152,"kb_used_data":1976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338688,"statfs":{"total":96636764160,"available":96602816512,"internally_reserved":0,"allocated":2023424,"data_stored":1399455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509489,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32548,"kb_used_data":1372,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339292,"statfs":{"total":96636764160,"available":96603435008,"internally_reserved":0,"allocated":1404928,"data_stored":808427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509487,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32676,"kb_used_data":1416,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339164,"statfs":{"total":96636764160,"available":96603303936,"internally_reserved":0,"allocated":1449984,"data_stored":809255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509487,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32536,"kb_used_data":1360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339304,"statfs":{"total":96636764160,"available":96603447296,"internally_reserved":0,"allocated":1392640,"data_stored":807925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542192,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32692,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339148,"statfs":{"total":96636764160,"available":96603287552,"internally_reserved":0,"allocated":1421312,"data_stored":808823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542192,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32544,"kb_used_data":1368,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339296,"statfs":{"total":96636764160,"available":96603439104,"internally_reserved":0,"allocated":1400832,"data_stored":809418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542190,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32580,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339260,"statfs":{"total":96636764160,"available":96603402240,"internally_reserved":0,"allocated":1421312,"data_stored":808677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542192,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33200,"kb_used_data":1964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338640,"statfs":{"total":96636764160,"available":96602767360,"internally_reserved":0,"allocated":2011136,"data_stored":1400290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T18:33:03.872 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.873 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-05-08T18:29:41.517676+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.873 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.873 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-05-08T18:29:41.517676+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.873 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.873 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-05-08T18:29:41.517676+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.873 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.874 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-05-08T18:29:41.517676+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.874 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.874 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-05-08T18:29:41.517676+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.874 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.874 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-05-08T18:29:41.517676+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.874 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.874 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-05-08T18:29:41.517676+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.874 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.875 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-05-08T18:29:41.517676+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.875 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-05-08T18:29:41.517676+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.875 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.875 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-05-08T18:29:41.517676+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.875 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.875 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-05-08T18:29:41.517676+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.875 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.875 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-05-08T18:29:41.517676+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.876 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.876 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-05-08T18:29:41.517676+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.876 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.876 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-05-08T18:29:41.517676+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.876 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.876 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-05-08T18:29:49.624707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=49, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.876 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-05-08T18:29:41.517676+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.876 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.877 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-05-08T18:29:43.555558+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.877 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-05-08T18:29:45.561744+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=45, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.877 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-05-08T18:29:47.589927+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.877 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-05-08T18:29:49.624707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=49, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.878 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-05-08T18:29:41.517676+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.878 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.878 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-05-08T18:29:43.555558+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.878 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-05-08T18:29:45.561744+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=45, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.878 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-05-08T18:29:47.589927+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.878 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-05-08T18:29:49.624707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=49, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.878 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-05-08T18:29:41.517676+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.879 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.879 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-05-08T18:29:43.555558+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.879 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-05-08T18:29:45.561744+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=45, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.879 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-05-08T18:29:47.589927+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.879 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-05-08T18:29:49.624707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=49, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.879 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-05-08T18:29:41.517676+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.879 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.879 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-05-08T18:29:43.555558+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.880 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-05-08T18:29:45.561744+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=45, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.880 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-05-08T18:29:47.589927+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.880 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-05-08T18:29:41.517676+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.880 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.880 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-05-08T18:29:43.555558+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.880 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-05-08T18:29:45.561744+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=45, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.880 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-05-08T18:29:47.589927+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.880 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-05-08T18:29:49.624707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=49, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.881 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-05-08T18:29:41.517676+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.881 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.881 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-05-08T18:29:43.555558+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.881 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-05-08T18:29:45.561744+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=45, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.881 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-05-08T18:29:47.589927+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.881 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-05-08T18:29:49.624707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=49, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.881 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-05-08T18:29:41.517676+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.881 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.882 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-05-08T18:29:43.555558+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.882 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-05-08T18:29:45.561744+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=45, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.882 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-05-08T18:29:47.589927+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.882 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-05-08T18:29:49.624707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=49, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.882 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-05-08T18:29:41.517676+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.882 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.882 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-05-08T18:29:43.555558+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.882 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-05-08T18:29:45.561744+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=45, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.883 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-05-08T18:29:47.589927+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.883 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-05-08T18:29:49.624707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=49, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.883 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-05-08T18:29:41.517676+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.883 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.883 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-05-08T18:29:43.555558+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.883 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-05-08T18:29:45.561744+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=45, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.883 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-05-08T18:29:47.589927+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.883 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-05-08T18:29:49.624707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=49, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.884 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-05-08T18:29:41.517676+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.884 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.884 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-05-08T18:29:43.555558+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.884 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-05-08T18:29:45.561744+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=45, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.884 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-05-08T18:29:47.589927+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.884 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-05-08T18:29:49.624707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=49, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.884 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-05-08T18:29:41.517676+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.884 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.885 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-05-08T18:29:43.555558+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.885 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-05-08T18:29:45.561744+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=45, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.885 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-05-08T18:29:47.589927+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.885 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-05-08T18:29:49.624707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=49, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.885 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-05-08T18:29:41.517676+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.885 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.885 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-05-08T18:29:43.555558+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.885 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-05-08T18:29:45.561744+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=45, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.886 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-05-08T18:29:47.589927+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.886 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-05-08T18:29:49.624707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=49, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.886 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-05-08T18:29:41.517676+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.886 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-05-08T18:29:26.091102+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.886 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-05-08T18:29:33.458212+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.886 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.886 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-05-08T18:29:43.555558+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.887 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-05-08T18:29:45.561744+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=45, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.887 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-05-08T18:29:47.589927+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.887 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-05-08T18:29:49.624707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=49, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.887 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-05-08T18:29:41.517676+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.887 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-05-08T18:29:33.458212+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.887 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.887 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-05-08T18:29:43.555558+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.887 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-05-08T18:29:45.561744+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=45, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.887 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-05-08T18:29:47.589927+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.888 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-05-08T18:29:49.624707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=49, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.888 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-05-08T18:29:41.517676+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.888 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-05-08T18:29:33.458212+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.888 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.888 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-05-08T18:29:43.555558+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.888 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-05-08T18:29:45.561744+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=45, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.888 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-05-08T18:29:47.589927+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.888 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-05-08T18:29:49.624707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=49, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.889 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-05-08T18:29:41.517676+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.889 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-05-08T18:29:33.458212+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.889 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.889 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-05-08T18:29:43.555558+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.889 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-05-08T18:29:45.561744+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=45, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.889 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-05-08T18:29:47.589927+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.889 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-05-08T18:29:49.624707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=49, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.890 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-05-08T18:29:41.517676+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.890 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.890 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-05-08T18:29:33.458212+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.890 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-05-08T18:29:43.555558+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.890 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-05-08T18:29:45.561744+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=45, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.890 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-05-08T18:29:47.589927+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.890 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-05-08T18:29:49.624707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=49, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.891 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-05-08T18:29:41.517676+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.891 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.891 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-05-08T18:29:33.458212+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.891 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-05-08T18:29:43.555558+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.891 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-05-08T18:29:45.561744+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=45, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.891 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-05-08T18:29:47.589927+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.891 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-05-08T18:29:49.624707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=49, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.891 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-05-08T18:29:41.517676+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.892 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.892 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-05-08T18:29:33.458212+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.892 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-05-08T18:29:43.555558+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.892 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-05-08T18:29:45.561744+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=45, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.892 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-05-08T18:29:47.589927+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.892 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-05-08T18:29:49.624707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=49, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.892 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-05-08T18:29:41.517676+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.893 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.893 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-05-08T18:29:33.458212+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.893 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-05-08T18:29:43.555558+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.893 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-05-08T18:29:45.561744+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=45, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.893 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-05-08T18:29:47.589927+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.893 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-05-08T18:29:49.624707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=49, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.893 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-05-08T18:29:49.624707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=49, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.893 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-05-08T18:29:41.517676+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.894 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.894 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-05-08T18:29:43.555558+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.894 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-05-08T18:29:45.561744+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=45, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.894 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-05-08T18:29:47.589927+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.894 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-05-08T18:29:49.624707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=49, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.894 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-05-08T18:29:41.517676+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.894 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.894 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-05-08T18:29:43.555558+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.895 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-05-08T18:29:45.561744+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=45, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.895 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-05-08T18:29:47.589927+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.895 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-05-08T18:29:49.624707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=49, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.895 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-05-08T18:29:41.517676+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.895 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.895 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-05-08T18:29:43.555558+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.896 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-05-08T18:29:45.561744+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=45, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.896 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-05-08T18:29:47.589927+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.896 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-05-08T18:29:49.624707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=49, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.896 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-05-08T18:29:41.517676+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.896 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.896 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-05-08T18:29:43.555558+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.896 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-05-08T18:29:45.561744+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=45, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.897 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-05-08T18:29:47.589927+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.897 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-05-08T18:29:41.517676+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.897 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.897 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-05-08T18:29:43.555558+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.897 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-05-08T18:29:45.561744+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=45, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.897 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-05-08T18:29:47.589927+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.897 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-05-08T18:29:49.624707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=49, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.897 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-05-08T18:29:41.517676+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.898 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.898 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-05-08T18:29:43.555558+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.898 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-05-08T18:29:45.561744+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=45, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.898 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-05-08T18:29:47.589927+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.898 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-05-08T18:29:49.624707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=49, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.898 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-05-08T18:29:41.517676+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.898 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.898 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-05-08T18:29:43.555558+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.899 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-05-08T18:29:45.561744+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=45, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.899 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-05-08T18:29:47.589927+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.899 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-05-08T18:29:49.624707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=49, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.899 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-05-08T18:29:41.517676+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.899 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.899 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-05-08T18:29:43.555558+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.899 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-05-08T18:29:45.561744+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=45, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.899 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-05-08T18:29:47.589927+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.900 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-05-08T18:29:49.624707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=49, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.900 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-05-08T18:29:41.517676+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.900 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.900 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-05-08T18:29:43.555558+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.900 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-05-08T18:29:45.561744+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=45, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.900 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-05-08T18:29:47.589927+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.900 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-05-08T18:29:49.624707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=49, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.900 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-05-08T18:29:41.517676+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.901 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.901 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-05-08T18:29:43.555558+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.901 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-05-08T18:29:45.561744+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=45, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.901 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-05-08T18:29:47.589927+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.901 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-05-08T18:29:49.624707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=49, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.901 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-05-08T18:29:41.517676+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.901 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.901 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-05-08T18:29:43.555558+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.902 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-05-08T18:29:45.561744+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=45, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.902 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-05-08T18:29:47.589927+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.902 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-05-08T18:29:49.624707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=49, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.902 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-05-08T18:29:41.517676+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.902 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.902 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-05-08T18:29:43.555558+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.902 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-05-08T18:29:45.561744+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=45, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.903 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-05-08T18:29:47.589927+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.903 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-05-08T18:29:49.624707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=49, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.903 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-05-08T18:29:41.517676+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.903 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.903 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-05-08T18:29:41.517676+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.903 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.903 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-05-08T18:29:41.517676+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.903 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.904 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-05-08T18:29:41.517676+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.904 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.904 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-05-08T18:29:41.517676+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.904 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.904 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-05-08T18:29:41.517676+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.904 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.904 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-05-08T18:29:41.517676+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.904 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.905 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-05-08T18:29:41.517676+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.905 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.905 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-05-08T18:29:41.517676+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.905 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.905 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-05-08T18:29:41.517676+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.905 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.905 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-05-08T18:29:41.517676+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.906 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.906 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-05-08T18:29:41.517676+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.906 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.906 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-05-08T18:29:41.517676+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.907 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.907 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-05-08T18:29:41.517676+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.907 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.907 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-05-08T18:29:41.517676+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.907 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.907 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-05-08T18:29:41.517676+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.907 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.907 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.907 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-05-08T18:29:41.517676+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.907 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.908 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-05-08T18:29:41.517676+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:03.908 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-08T18:33:23.909 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T18:33:24.244 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-05-08T18:33:24.251 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2024-05-08T18:33:24.265 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":228,"stamp":"2024-05-08T18:33:23.490669+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":615613,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":2853,"num_read_kb":2285,"num_write":2325,"num_write_kb":2367366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6074,"num_omap_keys":28,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3305,"ondisk_log_size":3305,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":265800,"kb_used_data":12232,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754708920,"statfs":{"total":773094113280,"available":772821934080,"internally_reserved":0,"allocated":12525568,"data_stored":7652270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":259575345},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1344,"num_omap_keys":6,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007221"},"pg_stats":[{"pgid":"3.3f","version":"116'20","reported_seq":223,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:12.835806+0000","last_change":"2024-05-08T18:33:12.835866+0000","last_active":"2024-05-08T18:33:12.835806+0000","last_peered":"2024-05-08T18:33:12.835806+0000","last_clean":"2024-05-08T18:33:12.835806+0000","last_became_active":"2024-05-08T18:29:40.573543+0000","last_became_peered":"2024-05-08T18:29:40.573543+0000","last_unstale":"2024-05-08T18:33:12.835806+0000","last_undegraded":"2024-05-08T18:33:12.835806+0000","last_fullsized":"2024-05-08T18:33:12.835806+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'20","last_scrub_stamp":"2024-05-08T18:33:12.835610+0000","last_deep_scrub":"116'20","last_deep_scrub_stamp":"2024-05-08T18:33:12.835610+0000","last_clean_scrub_stamp":"2024-05-08T18:33:12.835610+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:59:53.794662+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":20,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"97'2","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:08.206096+0000","last_change":"2024-05-08T18:33:08.206159+0000","last_active":"2024-05-08T18:33:08.206096+0000","last_peered":"2024-05-08T18:33:08.206096+0000","last_clean":"2024-05-08T18:33:08.206096+0000","last_became_active":"2024-05-08T18:29:42.561201+0000","last_became_peered":"2024-05-08T18:29:42.561201+0000","last_unstale":"2024-05-08T18:33:08.206096+0000","last_undegraded":"2024-05-08T18:33:08.206096+0000","last_fullsized":"2024-05-08T18:33:08.206096+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'2","last_scrub_stamp":"2024-05-08T18:33:08.205846+0000","last_deep_scrub":"97'2","last_deep_scrub_stamp":"2024-05-08T18:33:08.205846+0000","last_clean_scrub_stamp":"2024-05-08T18:33:08.205846+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:09:29.081941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"116'20","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.103789+0000","last_change":"2024-05-08T18:29:40.549299+0000","last_active":"2024-05-08T18:32:57.103789+0000","last_peered":"2024-05-08T18:32:57.103789+0000","last_clean":"2024-05-08T18:32:57.103789+0000","last_became_active":"2024-05-08T18:29:40.548930+0000","last_became_peered":"2024-05-08T18:29:40.548930+0000","last_unstale":"2024-05-08T18:32:57.103789+0000","last_undegraded":"2024-05-08T18:32:57.103789+0000","last_fullsized":"2024-05-08T18:32:57.103789+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"84'2","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:10.887340+0000","last_change":"2024-05-08T18:33:10.887411+0000","last_active":"2024-05-08T18:33:10.887340+0000","last_peered":"2024-05-08T18:33:10.887340+0000","last_clean":"2024-05-08T18:33:10.887340+0000","last_became_active":"2024-05-08T18:29:42.571344+0000","last_became_peered":"2024-05-08T18:29:42.571344+0000","last_unstale":"2024-05-08T18:33:10.887340+0000","last_undegraded":"2024-05-08T18:33:10.887340+0000","last_fullsized":"2024-05-08T18:33:10.887340+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'2","last_scrub_stamp":"2024-05-08T18:33:10.887104+0000","last_deep_scrub":"84'2","last_deep_scrub_stamp":"2024-05-08T18:33:10.887104+0000","last_clean_scrub_stamp":"2024-05-08T18:33:10.887104+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:51:01.201406+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"116'26","reported_seq":225,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.156070+0000","last_change":"2024-05-08T18:29:40.539048+0000","last_active":"2024-05-08T18:32:57.156070+0000","last_peered":"2024-05-08T18:32:57.156070+0000","last_clean":"2024-05-08T18:32:57.156070+0000","last_became_active":"2024-05-08T18:29:40.538458+0000","last_became_peered":"2024-05-08T18:29:40.538458+0000","last_unstale":"2024-05-08T18:32:57.156070+0000","last_undegraded":"2024-05-08T18:32:57.156070+0000","last_fullsized":"2024-05-08T18:32:57.156070+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":4,"num_write":36,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:07.571029+0000","last_change":"2024-05-08T18:33:07.571156+0000","last_active":"2024-05-08T18:33:07.571029+0000","last_peered":"2024-05-08T18:33:07.571029+0000","last_clean":"2024-05-08T18:33:07.571029+0000","last_became_active":"2024-05-08T18:29:42.569026+0000","last_became_peered":"2024-05-08T18:29:42.569026+0000","last_unstale":"2024-05-08T18:33:07.571029+0000","last_undegraded":"2024-05-08T18:33:07.571029+0000","last_fullsized":"2024-05-08T18:33:07.571029+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:07.570804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:07.570804+0000","last_clean_scrub_stamp":"2024-05-08T18:33:07.570804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:31.162982+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"116'16","reported_seq":221,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:17.149444+0000","last_change":"2024-05-08T18:33:17.149603+0000","last_active":"2024-05-08T18:33:17.149444+0000","last_peered":"2024-05-08T18:33:17.149444+0000","last_clean":"2024-05-08T18:33:17.149444+0000","last_became_active":"2024-05-08T18:29:40.556884+0000","last_became_peered":"2024-05-08T18:29:40.556884+0000","last_unstale":"2024-05-08T18:33:17.149444+0000","last_undegraded":"2024-05-08T18:33:17.149444+0000","last_fullsized":"2024-05-08T18:33:17.149444+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'16","last_scrub_stamp":"2024-05-08T18:33:17.149214+0000","last_deep_scrub":"116'16","last_deep_scrub_stamp":"2024-05-08T18:33:17.149214+0000","last_clean_scrub_stamp":"2024-05-08T18:33:17.149214+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:58:12.131775+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:17.971548+0000","last_change":"2024-05-08T18:33:17.971608+0000","last_active":"2024-05-08T18:33:17.971548+0000","last_peered":"2024-05-08T18:33:17.971548+0000","last_clean":"2024-05-08T18:33:17.971548+0000","last_became_active":"2024-05-08T18:29:42.566058+0000","last_became_peered":"2024-05-08T18:29:42.566058+0000","last_unstale":"2024-05-08T18:33:17.971548+0000","last_undegraded":"2024-05-08T18:33:17.971548+0000","last_fullsized":"2024-05-08T18:33:17.971548+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:17.971336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:17.971336+0000","last_clean_scrub_stamp":"2024-05-08T18:33:17.971336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:14:35.541504+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"116'10","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.134331+0000","last_change":"2024-05-08T18:29:40.571195+0000","last_active":"2024-05-08T18:32:57.134331+0000","last_peered":"2024-05-08T18:32:57.134331+0000","last_clean":"2024-05-08T18:32:57.134331+0000","last_became_active":"2024-05-08T18:29:40.570467+0000","last_became_peered":"2024-05-08T18:29:40.570467+0000","last_unstale":"2024-05-08T18:32:57.134331+0000","last_undegraded":"2024-05-08T18:32:57.134331+0000","last_fullsized":"2024-05-08T18:32:57.134331+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:07.631596+0000","last_change":"2024-05-08T18:33:07.631651+0000","last_active":"2024-05-08T18:33:07.631596+0000","last_peered":"2024-05-08T18:33:07.631596+0000","last_clean":"2024-05-08T18:33:07.631596+0000","last_became_active":"2024-05-08T18:29:42.565740+0000","last_became_peered":"2024-05-08T18:29:42.565740+0000","last_unstale":"2024-05-08T18:33:07.631596+0000","last_undegraded":"2024-05-08T18:33:07.631596+0000","last_fullsized":"2024-05-08T18:33:07.631596+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:07.631397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:07.631397+0000","last_clean_scrub_stamp":"2024-05-08T18:33:07.631397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:22:24.824498+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"116'14","reported_seq":211,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.103444+0000","last_change":"2024-05-08T18:29:40.538314+0000","last_active":"2024-05-08T18:32:57.103444+0000","last_peered":"2024-05-08T18:32:57.103444+0000","last_clean":"2024-05-08T18:32:57.103444+0000","last_became_active":"2024-05-08T18:29:40.537458+0000","last_became_peered":"2024-05-08T18:29:40.537458+0000","last_unstale":"2024-05-08T18:32:57.103444+0000","last_undegraded":"2024-05-08T18:32:57.103444+0000","last_fullsized":"2024-05-08T18:32:57.103444+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:09.551255+0000","last_change":"2024-05-08T18:33:09.551309+0000","last_active":"2024-05-08T18:33:09.551255+0000","last_peered":"2024-05-08T18:33:09.551255+0000","last_clean":"2024-05-08T18:33:09.551255+0000","last_became_active":"2024-05-08T18:29:42.569255+0000","last_became_peered":"2024-05-08T18:29:42.569255+0000","last_unstale":"2024-05-08T18:33:09.551255+0000","last_undegraded":"2024-05-08T18:33:09.551255+0000","last_fullsized":"2024-05-08T18:33:09.551255+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:09.551066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:09.551066+0000","last_clean_scrub_stamp":"2024-05-08T18:33:09.551066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:26:59.232592+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"116'36","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:19.859727+0000","last_change":"2024-05-08T18:33:19.859879+0000","last_active":"2024-05-08T18:33:19.859727+0000","last_peered":"2024-05-08T18:33:19.859727+0000","last_clean":"2024-05-08T18:33:19.859727+0000","last_became_active":"2024-05-08T18:30:21.210052+0000","last_became_peered":"2024-05-08T18:30:21.210052+0000","last_unstale":"2024-05-08T18:33:19.859727+0000","last_undegraded":"2024-05-08T18:33:19.859727+0000","last_fullsized":"2024-05-08T18:33:19.859727+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'36","last_scrub_stamp":"2024-05-08T18:33:19.859481+0000","last_deep_scrub":"116'36","last_deep_scrub_stamp":"2024-05-08T18:33:19.859481+0000","last_clean_scrub_stamp":"2024-05-08T18:33:19.859481+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:24.773310+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"97'4","reported_seq":211,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:11.184144+0000","last_change":"2024-05-08T18:33:11.184207+0000","last_active":"2024-05-08T18:33:11.184144+0000","last_peered":"2024-05-08T18:33:11.184144+0000","last_clean":"2024-05-08T18:33:11.184144+0000","last_became_active":"2024-05-08T18:29:42.560699+0000","last_became_peered":"2024-05-08T18:29:42.560699+0000","last_unstale":"2024-05-08T18:33:11.184144+0000","last_undegraded":"2024-05-08T18:33:11.184144+0000","last_fullsized":"2024-05-08T18:33:11.184144+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'4","last_scrub_stamp":"2024-05-08T18:33:11.183948+0000","last_deep_scrub":"97'4","last_deep_scrub_stamp":"2024-05-08T18:33:11.183948+0000","last_clean_scrub_stamp":"2024-05-08T18:33:11.183948+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:04:19.618457+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"116'26","reported_seq":224,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.154085+0000","last_change":"2024-05-08T18:29:40.564339+0000","last_active":"2024-05-08T18:32:57.154085+0000","last_peered":"2024-05-08T18:32:57.154085+0000","last_clean":"2024-05-08T18:32:57.154085+0000","last_became_active":"2024-05-08T18:29:40.564038+0000","last_became_peered":"2024-05-08T18:29:40.564038+0000","last_unstale":"2024-05-08T18:32:57.154085+0000","last_undegraded":"2024-05-08T18:32:57.154085+0000","last_fullsized":"2024-05-08T18:32:57.154085+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":26,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"84'8","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:10.839004+0000","last_change":"2024-05-08T18:33:10.839068+0000","last_active":"2024-05-08T18:33:10.839004+0000","last_peered":"2024-05-08T18:33:10.839004+0000","last_clean":"2024-05-08T18:33:10.839004+0000","last_became_active":"2024-05-08T18:29:42.569917+0000","last_became_peered":"2024-05-08T18:29:42.569917+0000","last_unstale":"2024-05-08T18:33:10.839004+0000","last_undegraded":"2024-05-08T18:33:10.839004+0000","last_fullsized":"2024-05-08T18:33:10.839004+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'8","last_scrub_stamp":"2024-05-08T18:33:10.838811+0000","last_deep_scrub":"84'8","last_deep_scrub_stamp":"2024-05-08T18:33:10.838811+0000","last_clean_scrub_stamp":"2024-05-08T18:33:10.838811+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:56.522874+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"84'4","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:08.594718+0000","last_change":"2024-05-08T18:33:08.594781+0000","last_active":"2024-05-08T18:33:08.594718+0000","last_peered":"2024-05-08T18:33:08.594718+0000","last_clean":"2024-05-08T18:33:08.594718+0000","last_became_active":"2024-05-08T18:29:42.567399+0000","last_became_peered":"2024-05-08T18:29:42.567399+0000","last_unstale":"2024-05-08T18:33:08.594718+0000","last_undegraded":"2024-05-08T18:33:08.594718+0000","last_fullsized":"2024-05-08T18:33:08.594718+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'4","last_scrub_stamp":"2024-05-08T18:33:08.594504+0000","last_deep_scrub":"84'4","last_deep_scrub_stamp":"2024-05-08T18:33:08.594504+0000","last_clean_scrub_stamp":"2024-05-08T18:33:08.594504+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:09:29.470599+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"116'26","reported_seq":229,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:20.767491+0000","last_change":"2024-05-08T18:33:20.767550+0000","last_active":"2024-05-08T18:33:20.767491+0000","last_peered":"2024-05-08T18:33:20.767491+0000","last_clean":"2024-05-08T18:33:20.767491+0000","last_became_active":"2024-05-08T18:29:40.570600+0000","last_became_peered":"2024-05-08T18:29:40.570600+0000","last_unstale":"2024-05-08T18:33:20.767491+0000","last_undegraded":"2024-05-08T18:33:20.767491+0000","last_fullsized":"2024-05-08T18:33:20.767491+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'26","last_scrub_stamp":"2024-05-08T18:33:20.767294+0000","last_deep_scrub":"116'26","last_deep_scrub_stamp":"2024-05-08T18:33:20.767294+0000","last_clean_scrub_stamp":"2024-05-08T18:33:20.767294+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:51.554250+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":26,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"80'2","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.882258+0000","last_change":"2024-05-08T18:33:05.882328+0000","last_active":"2024-05-08T18:33:05.882258+0000","last_peered":"2024-05-08T18:33:05.882258+0000","last_clean":"2024-05-08T18:33:05.882258+0000","last_became_active":"2024-05-08T18:29:42.577789+0000","last_became_peered":"2024-05-08T18:29:42.577789+0000","last_unstale":"2024-05-08T18:33:05.882258+0000","last_undegraded":"2024-05-08T18:33:05.882258+0000","last_fullsized":"2024-05-08T18:33:05.882258+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2","last_scrub_stamp":"2024-05-08T18:33:05.881939+0000","last_deep_scrub":"80'2","last_deep_scrub_stamp":"2024-05-08T18:33:05.881939+0000","last_clean_scrub_stamp":"2024-05-08T18:33:05.881939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:10.795768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"116'16","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:19.650921+0000","last_change":"2024-05-08T18:33:19.650983+0000","last_active":"2024-05-08T18:33:19.650921+0000","last_peered":"2024-05-08T18:33:19.650921+0000","last_clean":"2024-05-08T18:33:19.650921+0000","last_became_active":"2024-05-08T18:29:40.569519+0000","last_became_peered":"2024-05-08T18:29:40.569519+0000","last_unstale":"2024-05-08T18:33:19.650921+0000","last_undegraded":"2024-05-08T18:33:19.650921+0000","last_fullsized":"2024-05-08T18:33:19.650921+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'16","last_scrub_stamp":"2024-05-08T18:33:19.650728+0000","last_deep_scrub":"116'16","last_deep_scrub_stamp":"2024-05-08T18:33:19.650728+0000","last_clean_scrub_stamp":"2024-05-08T18:33:19.650728+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:43.242905+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":201,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:09.203395+0000","last_change":"2024-05-08T18:33:09.203453+0000","last_active":"2024-05-08T18:33:09.203395+0000","last_peered":"2024-05-08T18:33:09.203395+0000","last_clean":"2024-05-08T18:33:09.203395+0000","last_became_active":"2024-05-08T18:29:42.562296+0000","last_became_peered":"2024-05-08T18:29:42.562296+0000","last_unstale":"2024-05-08T18:33:09.203395+0000","last_undegraded":"2024-05-08T18:33:09.203395+0000","last_fullsized":"2024-05-08T18:33:09.203395+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:09.203183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:09.203183+0000","last_clean_scrub_stamp":"2024-05-08T18:33:09.203183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:17:19.757932+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"116'28","reported_seq":231,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:17.577727+0000","last_change":"2024-05-08T18:33:17.577789+0000","last_active":"2024-05-08T18:33:17.577727+0000","last_peered":"2024-05-08T18:33:17.577727+0000","last_clean":"2024-05-08T18:33:17.577727+0000","last_became_active":"2024-05-08T18:29:40.563516+0000","last_became_peered":"2024-05-08T18:29:40.563516+0000","last_unstale":"2024-05-08T18:33:17.577727+0000","last_undegraded":"2024-05-08T18:33:17.577727+0000","last_fullsized":"2024-05-08T18:33:17.577727+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'28","last_scrub_stamp":"2024-05-08T18:33:17.577538+0000","last_deep_scrub":"116'28","last_deep_scrub_stamp":"2024-05-08T18:33:17.577538+0000","last_clean_scrub_stamp":"2024-05-08T18:33:17.577538+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:40:11.429520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":28,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"97'4","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:09.870748+0000","last_change":"2024-05-08T18:33:09.870828+0000","last_active":"2024-05-08T18:33:09.870748+0000","last_peered":"2024-05-08T18:33:09.870748+0000","last_clean":"2024-05-08T18:33:09.870748+0000","last_became_active":"2024-05-08T18:29:42.566256+0000","last_became_peered":"2024-05-08T18:29:42.566256+0000","last_unstale":"2024-05-08T18:33:09.870748+0000","last_undegraded":"2024-05-08T18:33:09.870748+0000","last_fullsized":"2024-05-08T18:33:09.870748+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'4","last_scrub_stamp":"2024-05-08T18:33:09.870499+0000","last_deep_scrub":"97'4","last_deep_scrub_stamp":"2024-05-08T18:33:09.870499+0000","last_clean_scrub_stamp":"2024-05-08T18:33:09.870499+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:20:44.539452+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"116'14","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.152432+0000","last_change":"2024-05-08T18:29:40.573212+0000","last_active":"2024-05-08T18:32:57.152432+0000","last_peered":"2024-05-08T18:32:57.152432+0000","last_clean":"2024-05-08T18:32:57.152432+0000","last_became_active":"2024-05-08T18:29:40.572250+0000","last_became_peered":"2024-05-08T18:29:40.572250+0000","last_unstale":"2024-05-08T18:32:57.152432+0000","last_undegraded":"2024-05-08T18:32:57.152432+0000","last_fullsized":"2024-05-08T18:32:57.152432+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"97'6","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:11.868082+0000","last_change":"2024-05-08T18:33:11.868142+0000","last_active":"2024-05-08T18:33:11.868082+0000","last_peered":"2024-05-08T18:33:11.868082+0000","last_clean":"2024-05-08T18:33:11.868082+0000","last_became_active":"2024-05-08T18:29:42.570435+0000","last_became_peered":"2024-05-08T18:29:42.570435+0000","last_unstale":"2024-05-08T18:33:11.868082+0000","last_undegraded":"2024-05-08T18:33:11.868082+0000","last_fullsized":"2024-05-08T18:33:11.868082+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'6","last_scrub_stamp":"2024-05-08T18:33:11.867888+0000","last_deep_scrub":"97'6","last_deep_scrub_stamp":"2024-05-08T18:33:11.867888+0000","last_clean_scrub_stamp":"2024-05-08T18:33:11.867888+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:50:40.673319+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"116'14","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.170461+0000","last_change":"2024-05-08T18:29:40.566815+0000","last_active":"2024-05-08T18:32:57.170461+0000","last_peered":"2024-05-08T18:32:57.170461+0000","last_clean":"2024-05-08T18:32:57.170461+0000","last_became_active":"2024-05-08T18:29:40.566531+0000","last_became_peered":"2024-05-08T18:29:40.566531+0000","last_unstale":"2024-05-08T18:32:57.170461+0000","last_undegraded":"2024-05-08T18:32:57.170461+0000","last_fullsized":"2024-05-08T18:32:57.170461+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"84'8","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.059809+0000","last_change":"2024-05-08T18:29:42.554846+0000","last_active":"2024-05-08T18:32:46.059809+0000","last_peered":"2024-05-08T18:32:46.059809+0000","last_clean":"2024-05-08T18:32:46.059809+0000","last_became_active":"2024-05-08T18:29:42.554115+0000","last_became_peered":"2024-05-08T18:29:42.554115+0000","last_unstale":"2024-05-08T18:32:46.059809+0000","last_undegraded":"2024-05-08T18:32:46.059809+0000","last_fullsized":"2024-05-08T18:32:46.059809+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"116'14","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.031542+0000","last_change":"2024-05-08T18:29:40.547776+0000","last_active":"2024-05-08T18:32:57.031542+0000","last_peered":"2024-05-08T18:32:57.031542+0000","last_clean":"2024-05-08T18:32:57.031542+0000","last_became_active":"2024-05-08T18:29:40.547384+0000","last_became_peered":"2024-05-08T18:29:40.547384+0000","last_unstale":"2024-05-08T18:32:57.031542+0000","last_undegraded":"2024-05-08T18:32:57.031542+0000","last_fullsized":"2024-05-08T18:32:57.031542+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"97'10","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.057358+0000","last_change":"2024-05-08T18:29:50.685390+0000","last_active":"2024-05-08T18:32:46.057358+0000","last_peered":"2024-05-08T18:32:46.057358+0000","last_clean":"2024-05-08T18:32:46.057358+0000","last_became_active":"2024-05-08T18:29:50.684644+0000","last_became_peered":"2024-05-08T18:29:50.684644+0000","last_unstale":"2024-05-08T18:32:46.057358+0000","last_undegraded":"2024-05-08T18:32:46.057358+0000","last_fullsized":"2024-05-08T18:32:46.057358+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":21,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"84'10","reported_seq":221,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:14.794883+0000","last_change":"2024-05-08T18:33:14.794948+0000","last_active":"2024-05-08T18:33:14.794883+0000","last_peered":"2024-05-08T18:33:14.794883+0000","last_clean":"2024-05-08T18:33:14.794883+0000","last_became_active":"2024-05-08T18:29:42.573296+0000","last_became_peered":"2024-05-08T18:29:42.573296+0000","last_unstale":"2024-05-08T18:33:14.794883+0000","last_undegraded":"2024-05-08T18:33:14.794883+0000","last_fullsized":"2024-05-08T18:33:14.794883+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'10","last_scrub_stamp":"2024-05-08T18:33:14.794677+0000","last_deep_scrub":"84'10","last_deep_scrub_stamp":"2024-05-08T18:33:14.794677+0000","last_clean_scrub_stamp":"2024-05-08T18:33:14.794677+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:08:31.143567+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"116'16","reported_seq":211,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.175593+0000","last_change":"2024-05-08T18:29:40.570733+0000","last_active":"2024-05-08T18:32:57.175593+0000","last_peered":"2024-05-08T18:32:57.175593+0000","last_clean":"2024-05-08T18:32:57.175593+0000","last_became_active":"2024-05-08T18:29:40.569711+0000","last_became_peered":"2024-05-08T18:29:40.569711+0000","last_unstale":"2024-05-08T18:32:57.175593+0000","last_undegraded":"2024-05-08T18:32:57.175593+0000","last_fullsized":"2024-05-08T18:32:57.175593+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":189,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.079880+0000","last_change":"2024-05-08T18:29:44.594185+0000","last_active":"2024-05-08T18:32:47.079880+0000","last_peered":"2024-05-08T18:32:47.079880+0000","last_clean":"2024-05-08T18:32:47.079880+0000","last_became_active":"2024-05-08T18:29:44.593442+0000","last_became_peered":"2024-05-08T18:29:44.593442+0000","last_unstale":"2024-05-08T18:32:47.079880+0000","last_undegraded":"2024-05-08T18:32:47.079880+0000","last_fullsized":"2024-05-08T18:32:47.079880+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"116'18","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:56.931357+0000","last_change":"2024-05-08T18:29:46.594652+0000","last_active":"2024-05-08T18:32:56.931357+0000","last_peered":"2024-05-08T18:32:56.931357+0000","last_clean":"2024-05-08T18:32:56.931357+0000","last_became_active":"2024-05-08T18:29:46.593656+0000","last_became_peered":"2024-05-08T18:29:46.593656+0000","last_unstale":"2024-05-08T18:32:56.931357+0000","last_undegraded":"2024-05-08T18:32:56.931357+0000","last_fullsized":"2024-05-08T18:32:56.931357+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.937923+0000","last_change":"2024-05-08T18:29:48.639834+0000","last_active":"2024-05-08T18:32:46.937923+0000","last_peered":"2024-05-08T18:32:46.937923+0000","last_clean":"2024-05-08T18:32:46.937923+0000","last_became_active":"2024-05-08T18:29:48.639122+0000","last_became_peered":"2024-05-08T18:29:48.639122+0000","last_unstale":"2024-05-08T18:32:46.937923+0000","last_undegraded":"2024-05-08T18:32:46.937923+0000","last_fullsized":"2024-05-08T18:32:46.937923+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"83'4","reported_seq":182,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.078127+0000","last_change":"2024-05-08T18:29:50.672303+0000","last_active":"2024-05-08T18:32:47.078127+0000","last_peered":"2024-05-08T18:32:47.078127+0000","last_clean":"2024-05-08T18:32:47.078127+0000","last_became_active":"2024-05-08T18:29:50.671513+0000","last_became_peered":"2024-05-08T18:29:50.671513+0000","last_unstale":"2024-05-08T18:32:47.078127+0000","last_undegraded":"2024-05-08T18:32:47.078127+0000","last_fullsized":"2024-05-08T18:32:47.078127+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"84'4","reported_seq":211,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:12.184669+0000","last_change":"2024-05-08T18:33:12.184791+0000","last_active":"2024-05-08T18:33:12.184669+0000","last_peered":"2024-05-08T18:33:12.184669+0000","last_clean":"2024-05-08T18:33:12.184669+0000","last_became_active":"2024-05-08T18:29:42.564741+0000","last_became_peered":"2024-05-08T18:29:42.564741+0000","last_unstale":"2024-05-08T18:33:12.184669+0000","last_undegraded":"2024-05-08T18:33:12.184669+0000","last_fullsized":"2024-05-08T18:33:12.184669+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'4","last_scrub_stamp":"2024-05-08T18:33:12.184342+0000","last_deep_scrub":"84'4","last_deep_scrub_stamp":"2024-05-08T18:33:12.184342+0000","last_clean_scrub_stamp":"2024-05-08T18:33:12.184342+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:59:53.143394+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"116'12","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.080026+0000","last_change":"2024-05-08T18:29:40.564796+0000","last_active":"2024-05-08T18:32:57.080026+0000","last_peered":"2024-05-08T18:32:57.080026+0000","last_clean":"2024-05-08T18:32:57.080026+0000","last_became_active":"2024-05-08T18:29:40.564401+0000","last_became_peered":"2024-05-08T18:29:40.564401+0000","last_unstale":"2024-05-08T18:32:57.080026+0000","last_undegraded":"2024-05-08T18:32:57.080026+0000","last_fullsized":"2024-05-08T18:32:57.080026+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":12,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:17.921554+0000","last_change":"2024-05-08T18:33:17.921691+0000","last_active":"2024-05-08T18:33:17.921554+0000","last_peered":"2024-05-08T18:33:17.921554+0000","last_clean":"2024-05-08T18:33:17.921554+0000","last_became_active":"2024-05-08T18:29:44.586975+0000","last_became_peered":"2024-05-08T18:29:44.586975+0000","last_unstale":"2024-05-08T18:33:17.921554+0000","last_undegraded":"2024-05-08T18:33:17.921554+0000","last_fullsized":"2024-05-08T18:33:17.921554+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:17.921326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:17.921326+0000","last_clean_scrub_stamp":"2024-05-08T18:33:17.921326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:14:35.491494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"116'10","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.583315+0000","last_change":"2024-05-08T18:33:06.583387+0000","last_active":"2024-05-08T18:33:06.583315+0000","last_peered":"2024-05-08T18:33:06.583315+0000","last_clean":"2024-05-08T18:33:06.583315+0000","last_became_active":"2024-05-08T18:29:46.599894+0000","last_became_peered":"2024-05-08T18:29:46.599894+0000","last_unstale":"2024-05-08T18:33:06.583315+0000","last_undegraded":"2024-05-08T18:33:06.583315+0000","last_fullsized":"2024-05-08T18:33:06.583315+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'10","last_scrub_stamp":"2024-05-08T18:33:06.583104+0000","last_deep_scrub":"116'10","last_deep_scrub_stamp":"2024-05-08T18:33:06.583104+0000","last_clean_scrub_stamp":"2024-05-08T18:33:06.583104+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:54:55.506347+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":184,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.059326+0000","last_change":"2024-05-08T18:29:48.614324+0000","last_active":"2024-05-08T18:32:46.059326+0000","last_peered":"2024-05-08T18:32:46.059326+0000","last_clean":"2024-05-08T18:32:46.059326+0000","last_became_active":"2024-05-08T18:29:48.613591+0000","last_became_peered":"2024-05-08T18:29:48.613591+0000","last_unstale":"2024-05-08T18:32:46.059326+0000","last_undegraded":"2024-05-08T18:32:46.059326+0000","last_fullsized":"2024-05-08T18:32:46.059326+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.862696+0000","last_change":"2024-05-08T18:29:50.684773+0000","last_active":"2024-05-08T18:32:46.862696+0000","last_peered":"2024-05-08T18:32:46.862696+0000","last_clean":"2024-05-08T18:32:46.862696+0000","last_became_active":"2024-05-08T18:29:50.683931+0000","last_became_peered":"2024-05-08T18:29:50.683931+0000","last_unstale":"2024-05-08T18:32:46.862696+0000","last_undegraded":"2024-05-08T18:32:46.862696+0000","last_fullsized":"2024-05-08T18:32:46.862696+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"80'2","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:09.872452+0000","last_change":"2024-05-08T18:33:09.872511+0000","last_active":"2024-05-08T18:33:09.872452+0000","last_peered":"2024-05-08T18:33:09.872452+0000","last_clean":"2024-05-08T18:33:09.872452+0000","last_became_active":"2024-05-08T18:29:42.574146+0000","last_became_peered":"2024-05-08T18:29:42.574146+0000","last_unstale":"2024-05-08T18:33:09.872452+0000","last_undegraded":"2024-05-08T18:33:09.872452+0000","last_fullsized":"2024-05-08T18:33:09.872452+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2","last_scrub_stamp":"2024-05-08T18:33:09.872256+0000","last_deep_scrub":"80'2","last_deep_scrub_stamp":"2024-05-08T18:33:09.872256+0000","last_clean_scrub_stamp":"2024-05-08T18:33:09.872256+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:30:36.066739+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"116'22","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.120896+0000","last_change":"2024-05-08T18:29:40.559677+0000","last_active":"2024-05-08T18:32:57.120896+0000","last_peered":"2024-05-08T18:32:57.120896+0000","last_clean":"2024-05-08T18:32:57.120896+0000","last_became_active":"2024-05-08T18:29:40.558819+0000","last_became_peered":"2024-05-08T18:29:40.558819+0000","last_unstale":"2024-05-08T18:32:57.120896+0000","last_undegraded":"2024-05-08T18:32:57.120896+0000","last_fullsized":"2024-05-08T18:32:57.120896+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.067944+0000","last_change":"2024-05-08T18:29:44.596801+0000","last_active":"2024-05-08T18:32:46.067944+0000","last_peered":"2024-05-08T18:32:46.067944+0000","last_clean":"2024-05-08T18:32:46.067944+0000","last_became_active":"2024-05-08T18:29:44.596111+0000","last_became_peered":"2024-05-08T18:29:44.596111+0000","last_unstale":"2024-05-08T18:32:46.067944+0000","last_undegraded":"2024-05-08T18:32:46.067944+0000","last_fullsized":"2024-05-08T18:32:46.067944+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"116'15","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:15.807678+0000","last_change":"2024-05-08T18:33:15.807752+0000","last_active":"2024-05-08T18:33:15.807678+0000","last_peered":"2024-05-08T18:33:15.807678+0000","last_clean":"2024-05-08T18:33:15.807678+0000","last_became_active":"2024-05-08T18:29:46.607580+0000","last_became_peered":"2024-05-08T18:29:46.607580+0000","last_unstale":"2024-05-08T18:33:15.807678+0000","last_undegraded":"2024-05-08T18:33:15.807678+0000","last_fullsized":"2024-05-08T18:33:15.807678+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'15","last_scrub_stamp":"2024-05-08T18:33:15.807477+0000","last_deep_scrub":"116'15","last_deep_scrub_stamp":"2024-05-08T18:33:15.807477+0000","last_clean_scrub_stamp":"2024-05-08T18:33:15.807477+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:29:42.418270+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"116'105","reported_seq":411,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.207537+0000","last_change":"2024-05-08T18:29:48.642718+0000","last_active":"2024-05-08T18:32:57.207537+0000","last_peered":"2024-05-08T18:32:57.207537+0000","last_clean":"2024-05-08T18:32:57.207537+0000","last_became_active":"2024-05-08T18:29:48.641950+0000","last_became_peered":"2024-05-08T18:29:48.641950+0000","last_unstale":"2024-05-08T18:32:57.207537+0000","last_undegraded":"2024-05-08T18:32:57.207537+0000","last_fullsized":"2024-05-08T18:32:57.207537+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"84'2","reported_seq":182,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.058791+0000","last_change":"2024-05-08T18:29:50.660378+0000","last_active":"2024-05-08T18:32:46.058791+0000","last_peered":"2024-05-08T18:32:46.058791+0000","last_clean":"2024-05-08T18:32:46.058791+0000","last_became_active":"2024-05-08T18:29:50.659649+0000","last_became_peered":"2024-05-08T18:29:50.659649+0000","last_unstale":"2024-05-08T18:32:46.058791+0000","last_undegraded":"2024-05-08T18:32:46.058791+0000","last_fullsized":"2024-05-08T18:32:46.058791+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"80'2","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:13.752038+0000","last_change":"2024-05-08T18:33:13.752106+0000","last_active":"2024-05-08T18:33:13.752038+0000","last_peered":"2024-05-08T18:33:13.752038+0000","last_clean":"2024-05-08T18:33:13.752038+0000","last_became_active":"2024-05-08T18:29:42.576740+0000","last_became_peered":"2024-05-08T18:29:42.576740+0000","last_unstale":"2024-05-08T18:33:13.752038+0000","last_undegraded":"2024-05-08T18:33:13.752038+0000","last_fullsized":"2024-05-08T18:33:13.752038+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2","last_scrub_stamp":"2024-05-08T18:33:13.751819+0000","last_deep_scrub":"80'2","last_deep_scrub_stamp":"2024-05-08T18:33:13.751819+0000","last_clean_scrub_stamp":"2024-05-08T18:33:13.751819+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:59:49.632385+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"116'10","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:13.497002+0000","last_change":"2024-05-08T18:33:13.497066+0000","last_active":"2024-05-08T18:33:13.497002+0000","last_peered":"2024-05-08T18:33:13.497002+0000","last_clean":"2024-05-08T18:33:13.497002+0000","last_became_active":"2024-05-08T18:29:40.545749+0000","last_became_peered":"2024-05-08T18:29:40.545749+0000","last_unstale":"2024-05-08T18:33:13.497002+0000","last_undegraded":"2024-05-08T18:33:13.497002+0000","last_fullsized":"2024-05-08T18:33:13.497002+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'10","last_scrub_stamp":"2024-05-08T18:33:13.496806+0000","last_deep_scrub":"116'10","last_deep_scrub_stamp":"2024-05-08T18:33:13.496806+0000","last_clean_scrub_stamp":"2024-05-08T18:33:13.496806+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:49:28.691835+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":197,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:18.158846+0000","last_change":"2024-05-08T18:33:18.158948+0000","last_active":"2024-05-08T18:33:18.158846+0000","last_peered":"2024-05-08T18:33:18.158846+0000","last_clean":"2024-05-08T18:33:18.158846+0000","last_became_active":"2024-05-08T18:29:44.578142+0000","last_became_peered":"2024-05-08T18:29:44.578142+0000","last_unstale":"2024-05-08T18:33:18.158846+0000","last_undegraded":"2024-05-08T18:33:18.158846+0000","last_fullsized":"2024-05-08T18:33:18.158846+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:18.158547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:18.158547+0000","last_clean_scrub_stamp":"2024-05-08T18:33:18.158547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:28.957097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"116'21","reported_seq":223,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:04.925986+0000","last_change":"2024-05-08T18:33:04.926174+0000","last_active":"2024-05-08T18:33:04.925986+0000","last_peered":"2024-05-08T18:33:04.925986+0000","last_clean":"2024-05-08T18:33:04.925986+0000","last_became_active":"2024-05-08T18:29:46.605154+0000","last_became_peered":"2024-05-08T18:29:46.605154+0000","last_unstale":"2024-05-08T18:33:04.925986+0000","last_undegraded":"2024-05-08T18:33:04.925986+0000","last_fullsized":"2024-05-08T18:33:04.925986+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'21","last_scrub_stamp":"2024-05-08T18:33:04.925757+0000","last_deep_scrub":"116'21","last_deep_scrub_stamp":"2024-05-08T18:33:04.925757+0000","last_clean_scrub_stamp":"2024-05-08T18:33:04.925757+0000","objects_scrubbed":4,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:00:52.304684+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"116'105","reported_seq":338,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:02.698371+0000","last_change":"2024-05-08T18:33:02.698393+0000","last_active":"2024-05-08T18:33:02.698371+0000","last_peered":"2024-05-08T18:33:02.698371+0000","last_clean":"2024-05-08T18:33:02.698371+0000","last_became_active":"2024-05-08T18:29:48.633858+0000","last_became_peered":"2024-05-08T18:29:48.633858+0000","last_unstale":"2024-05-08T18:33:02.698371+0000","last_undegraded":"2024-05-08T18:33:02.698371+0000","last_fullsized":"2024-05-08T18:33:02.698371+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'105","last_scrub_stamp":"2024-05-08T18:33:02.698295+0000","last_deep_scrub":"116'105","last_deep_scrub_stamp":"2024-05-08T18:33:02.698295+0000","last_clean_scrub_stamp":"2024-05-08T18:33:02.698295+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:16:39.917082+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"84'8","reported_seq":221,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:14.196696+0000","last_change":"2024-05-08T18:33:14.196755+0000","last_active":"2024-05-08T18:33:14.196696+0000","last_peered":"2024-05-08T18:33:14.196696+0000","last_clean":"2024-05-08T18:33:14.196696+0000","last_became_active":"2024-05-08T18:29:42.566974+0000","last_became_peered":"2024-05-08T18:29:42.566974+0000","last_unstale":"2024-05-08T18:33:14.196696+0000","last_undegraded":"2024-05-08T18:33:14.196696+0000","last_fullsized":"2024-05-08T18:33:14.196696+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'8","last_scrub_stamp":"2024-05-08T18:33:14.196495+0000","last_deep_scrub":"84'8","last_deep_scrub_stamp":"2024-05-08T18:33:14.196495+0000","last_clean_scrub_stamp":"2024-05-08T18:33:14.196495+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:27:49.937242+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"116'20","reported_seq":223,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:18.798043+0000","last_change":"2024-05-08T18:33:18.798113+0000","last_active":"2024-05-08T18:33:18.798043+0000","last_peered":"2024-05-08T18:33:18.798043+0000","last_clean":"2024-05-08T18:33:18.798043+0000","last_became_active":"2024-05-08T18:29:40.571322+0000","last_became_peered":"2024-05-08T18:29:40.571322+0000","last_unstale":"2024-05-08T18:33:18.798043+0000","last_undegraded":"2024-05-08T18:33:18.798043+0000","last_fullsized":"2024-05-08T18:33:18.798043+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'20","last_scrub_stamp":"2024-05-08T18:33:18.797835+0000","last_deep_scrub":"116'20","last_deep_scrub_stamp":"2024-05-08T18:33:18.797835+0000","last_clean_scrub_stamp":"2024-05-08T18:33:18.797835+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:29.596385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:13.814686+0000","last_change":"2024-05-08T18:33:13.814845+0000","last_active":"2024-05-08T18:33:13.814686+0000","last_peered":"2024-05-08T18:33:13.814686+0000","last_clean":"2024-05-08T18:33:13.814686+0000","last_became_active":"2024-05-08T18:29:44.596282+0000","last_became_peered":"2024-05-08T18:29:44.596282+0000","last_unstale":"2024-05-08T18:33:13.814686+0000","last_undegraded":"2024-05-08T18:33:13.814686+0000","last_fullsized":"2024-05-08T18:33:13.814686+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:13.814456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:13.814456+0000","last_clean_scrub_stamp":"2024-05-08T18:33:13.814456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:22:28.063238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"116'37","reported_seq":246,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:07.224224+0000","last_change":"2024-05-08T18:33:07.224306+0000","last_active":"2024-05-08T18:33:07.224224+0000","last_peered":"2024-05-08T18:33:07.224224+0000","last_clean":"2024-05-08T18:33:07.224224+0000","last_became_active":"2024-05-08T18:29:46.589600+0000","last_became_peered":"2024-05-08T18:29:46.589600+0000","last_unstale":"2024-05-08T18:33:07.224224+0000","last_undegraded":"2024-05-08T18:33:07.224224+0000","last_fullsized":"2024-05-08T18:33:07.224224+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'37","last_scrub_stamp":"2024-05-08T18:33:07.224017+0000","last_deep_scrub":"116'37","last_deep_scrub_stamp":"2024-05-08T18:33:07.224017+0000","last_clean_scrub_stamp":"2024-05-08T18:33:07.224017+0000","objects_scrubbed":9,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:30.816195+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":38,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:12.794921+0000","last_change":"2024-05-08T18:33:12.794980+0000","last_active":"2024-05-08T18:33:12.794921+0000","last_peered":"2024-05-08T18:33:12.794921+0000","last_clean":"2024-05-08T18:33:12.794921+0000","last_became_active":"2024-05-08T18:29:48.630017+0000","last_became_peered":"2024-05-08T18:29:48.630017+0000","last_unstale":"2024-05-08T18:33:12.794921+0000","last_undegraded":"2024-05-08T18:33:12.794921+0000","last_fullsized":"2024-05-08T18:33:12.794921+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:12.794729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:12.794729+0000","last_clean_scrub_stamp":"2024-05-08T18:33:12.794729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:20:16.477743+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"97'14","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.077934+0000","last_change":"2024-05-08T18:29:50.672682+0000","last_active":"2024-05-08T18:32:47.077934+0000","last_peered":"2024-05-08T18:32:47.077934+0000","last_clean":"2024-05-08T18:32:47.077934+0000","last_became_active":"2024-05-08T18:29:50.671923+0000","last_became_peered":"2024-05-08T18:29:50.671923+0000","last_unstale":"2024-05-08T18:32:47.077934+0000","last_undegraded":"2024-05-08T18:32:47.077934+0000","last_fullsized":"2024-05-08T18:32:47.077934+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":39,"num_write":35,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"80'2","reported_seq":201,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.057841+0000","last_change":"2024-05-08T18:29:42.554289+0000","last_active":"2024-05-08T18:32:46.057841+0000","last_peered":"2024-05-08T18:32:46.057841+0000","last_clean":"2024-05-08T18:32:46.057841+0000","last_became_active":"2024-05-08T18:29:42.553574+0000","last_became_peered":"2024-05-08T18:29:42.553574+0000","last_unstale":"2024-05-08T18:32:46.057841+0000","last_undegraded":"2024-05-08T18:32:46.057841+0000","last_fullsized":"2024-05-08T18:32:46.057841+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"116'14","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.148737+0000","last_change":"2024-05-08T18:29:40.570169+0000","last_active":"2024-05-08T18:32:57.148737+0000","last_peered":"2024-05-08T18:32:57.148737+0000","last_clean":"2024-05-08T18:32:57.148737+0000","last_became_active":"2024-05-08T18:29:40.569542+0000","last_became_peered":"2024-05-08T18:29:40.569542+0000","last_unstale":"2024-05-08T18:32:57.148737+0000","last_undegraded":"2024-05-08T18:32:57.148737+0000","last_fullsized":"2024-05-08T18:32:57.148737+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"116'2","reported_seq":269,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:02.781390+0000","last_change":"2024-05-08T18:33:02.781414+0000","last_active":"2024-05-08T18:33:02.781390+0000","last_peered":"2024-05-08T18:33:02.781390+0000","last_clean":"2024-05-08T18:33:02.781390+0000","last_became_active":"2024-05-08T18:29:44.579152+0000","last_became_peered":"2024-05-08T18:29:44.579152+0000","last_unstale":"2024-05-08T18:33:02.781390+0000","last_undegraded":"2024-05-08T18:33:02.781390+0000","last_fullsized":"2024-05-08T18:33:02.781390+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'2","last_scrub_stamp":"2024-05-08T18:33:02.781323+0000","last_deep_scrub":"116'2","last_deep_scrub_stamp":"2024-05-08T18:33:02.781323+0000","last_clean_scrub_stamp":"2024-05-08T18:33:02.781323+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:11:25.963703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":103,"num_read_kb":103,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"116'21","reported_seq":226,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:07.809440+0000","last_change":"2024-05-08T18:33:07.809524+0000","last_active":"2024-05-08T18:33:07.809440+0000","last_peered":"2024-05-08T18:33:07.809440+0000","last_clean":"2024-05-08T18:33:07.809440+0000","last_became_active":"2024-05-08T18:29:46.599464+0000","last_became_peered":"2024-05-08T18:29:46.599464+0000","last_unstale":"2024-05-08T18:33:07.809440+0000","last_undegraded":"2024-05-08T18:33:07.809440+0000","last_fullsized":"2024-05-08T18:33:07.809440+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'21","last_scrub_stamp":"2024-05-08T18:33:07.809266+0000","last_deep_scrub":"116'21","last_deep_scrub_stamp":"2024-05-08T18:33:07.809266+0000","last_clean_scrub_stamp":"2024-05-08T18:33:07.809266+0000","objects_scrubbed":4,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:24:13.075844+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.734746+0000","last_change":"2024-05-08T18:33:05.734803+0000","last_active":"2024-05-08T18:33:05.734746+0000","last_peered":"2024-05-08T18:33:05.734746+0000","last_clean":"2024-05-08T18:33:05.734746+0000","last_became_active":"2024-05-08T18:29:48.637231+0000","last_became_peered":"2024-05-08T18:29:48.637231+0000","last_unstale":"2024-05-08T18:33:05.734746+0000","last_undegraded":"2024-05-08T18:33:05.734746+0000","last_fullsized":"2024-05-08T18:33:05.734746+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:05.734539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:05.734539+0000","last_clean_scrub_stamp":"2024-05-08T18:33:05.734539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:46:45.338085+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":175,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.847868+0000","last_change":"2024-05-08T18:29:50.681831+0000","last_active":"2024-05-08T18:32:46.847868+0000","last_peered":"2024-05-08T18:32:46.847868+0000","last_clean":"2024-05-08T18:32:46.847868+0000","last_became_active":"2024-05-08T18:29:50.681287+0000","last_became_peered":"2024-05-08T18:29:50.681287+0000","last_unstale":"2024-05-08T18:32:46.847868+0000","last_undegraded":"2024-05-08T18:32:46.847868+0000","last_fullsized":"2024-05-08T18:32:46.847868+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:09.637651+0000","last_change":"2024-05-08T18:33:09.637705+0000","last_active":"2024-05-08T18:33:09.637651+0000","last_peered":"2024-05-08T18:33:09.637651+0000","last_clean":"2024-05-08T18:33:09.637651+0000","last_became_active":"2024-05-08T18:29:42.562267+0000","last_became_peered":"2024-05-08T18:29:42.562267+0000","last_unstale":"2024-05-08T18:33:09.637651+0000","last_undegraded":"2024-05-08T18:33:09.637651+0000","last_fullsized":"2024-05-08T18:33:09.637651+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:09.637432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:09.637432+0000","last_clean_scrub_stamp":"2024-05-08T18:33:09.637432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:55:41.051450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"116'14","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.178694+0000","last_change":"2024-05-08T18:29:40.570736+0000","last_active":"2024-05-08T18:32:57.178694+0000","last_peered":"2024-05-08T18:32:57.178694+0000","last_clean":"2024-05-08T18:32:57.178694+0000","last_became_active":"2024-05-08T18:29:40.569626+0000","last_became_peered":"2024-05-08T18:29:40.569626+0000","last_unstale":"2024-05-08T18:32:57.178694+0000","last_undegraded":"2024-05-08T18:32:57.178694+0000","last_fullsized":"2024-05-08T18:32:57.178694+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"116'2","reported_seq":269,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:01.734830+0000","last_change":"2024-05-08T18:33:01.734888+0000","last_active":"2024-05-08T18:33:01.734830+0000","last_peered":"2024-05-08T18:33:01.734830+0000","last_clean":"2024-05-08T18:33:01.734830+0000","last_became_active":"2024-05-08T18:29:44.581067+0000","last_became_peered":"2024-05-08T18:29:44.581067+0000","last_unstale":"2024-05-08T18:33:01.734830+0000","last_undegraded":"2024-05-08T18:33:01.734830+0000","last_fullsized":"2024-05-08T18:33:01.734830+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'2","last_scrub_stamp":"2024-05-08T18:33:01.734695+0000","last_deep_scrub":"116'2","last_deep_scrub_stamp":"2024-05-08T18:33:01.734695+0000","last_clean_scrub_stamp":"2024-05-08T18:33:01.734695+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:54:31.021761+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":103,"num_read_kb":103,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"116'30","reported_seq":235,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:17.836614+0000","last_change":"2024-05-08T18:33:17.836706+0000","last_active":"2024-05-08T18:33:17.836614+0000","last_peered":"2024-05-08T18:33:17.836614+0000","last_clean":"2024-05-08T18:33:17.836614+0000","last_became_active":"2024-05-08T18:29:46.604966+0000","last_became_peered":"2024-05-08T18:29:46.604966+0000","last_unstale":"2024-05-08T18:33:17.836614+0000","last_undegraded":"2024-05-08T18:33:17.836614+0000","last_fullsized":"2024-05-08T18:33:17.836614+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'30","last_scrub_stamp":"2024-05-08T18:33:17.836365+0000","last_deep_scrub":"116'30","last_deep_scrub_stamp":"2024-05-08T18:33:17.836365+0000","last_clean_scrub_stamp":"2024-05-08T18:33:17.836365+0000","objects_scrubbed":7,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:58:12.818926+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"116'105","reported_seq":338,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:02.926992+0000","last_change":"2024-05-08T18:33:02.927044+0000","last_active":"2024-05-08T18:33:02.926992+0000","last_peered":"2024-05-08T18:33:02.926992+0000","last_clean":"2024-05-08T18:33:02.926992+0000","last_became_active":"2024-05-08T18:29:48.637758+0000","last_became_peered":"2024-05-08T18:29:48.637758+0000","last_unstale":"2024-05-08T18:33:02.926992+0000","last_undegraded":"2024-05-08T18:33:02.926992+0000","last_fullsized":"2024-05-08T18:33:02.926992+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'105","last_scrub_stamp":"2024-05-08T18:33:02.926903+0000","last_deep_scrub":"116'105","last_deep_scrub_stamp":"2024-05-08T18:33:02.926903+0000","last_clean_scrub_stamp":"2024-05-08T18:33:02.926903+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:16:40.145690+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"97'2","reported_seq":180,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863354+0000","last_change":"2024-05-08T18:29:50.684501+0000","last_active":"2024-05-08T18:32:46.863354+0000","last_peered":"2024-05-08T18:32:46.863354+0000","last_clean":"2024-05-08T18:32:46.863354+0000","last_became_active":"2024-05-08T18:29:50.683738+0000","last_became_peered":"2024-05-08T18:29:50.683738+0000","last_unstale":"2024-05-08T18:32:46.863354+0000","last_undegraded":"2024-05-08T18:32:46.863354+0000","last_fullsized":"2024-05-08T18:32:46.863354+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"84'4","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:13.867910+0000","last_change":"2024-05-08T18:33:13.867977+0000","last_active":"2024-05-08T18:33:13.867910+0000","last_peered":"2024-05-08T18:33:13.867910+0000","last_clean":"2024-05-08T18:33:13.867910+0000","last_became_active":"2024-05-08T18:29:42.568659+0000","last_became_peered":"2024-05-08T18:29:42.568659+0000","last_unstale":"2024-05-08T18:33:13.867910+0000","last_undegraded":"2024-05-08T18:33:13.867910+0000","last_fullsized":"2024-05-08T18:33:13.867910+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'4","last_scrub_stamp":"2024-05-08T18:33:13.867699+0000","last_deep_scrub":"84'4","last_deep_scrub_stamp":"2024-05-08T18:33:13.867699+0000","last_clean_scrub_stamp":"2024-05-08T18:33:13.867699+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:59:49.748265+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"116'14","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:21.202198+0000","last_change":"2024-05-08T18:33:21.202257+0000","last_active":"2024-05-08T18:33:21.202198+0000","last_peered":"2024-05-08T18:33:21.202198+0000","last_clean":"2024-05-08T18:33:21.202198+0000","last_became_active":"2024-05-08T18:29:40.555805+0000","last_became_peered":"2024-05-08T18:29:40.555805+0000","last_unstale":"2024-05-08T18:33:21.202198+0000","last_undegraded":"2024-05-08T18:33:21.202198+0000","last_fullsized":"2024-05-08T18:33:21.202198+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'14","last_scrub_stamp":"2024-05-08T18:33:21.201977+0000","last_deep_scrub":"116'14","last_deep_scrub_stamp":"2024-05-08T18:33:21.201977+0000","last_clean_scrub_stamp":"2024-05-08T18:33:21.201977+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:04:12.285635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":3,"num_write":24,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:04.731843+0000","last_change":"2024-05-08T18:33:04.731900+0000","last_active":"2024-05-08T18:33:04.731843+0000","last_peered":"2024-05-08T18:33:04.731843+0000","last_clean":"2024-05-08T18:33:04.731843+0000","last_became_active":"2024-05-08T18:29:44.573308+0000","last_became_peered":"2024-05-08T18:29:44.573308+0000","last_unstale":"2024-05-08T18:33:04.731843+0000","last_undegraded":"2024-05-08T18:33:04.731843+0000","last_fullsized":"2024-05-08T18:33:04.731843+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:04.731641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:04.731641+0000","last_clean_scrub_stamp":"2024-05-08T18:33:04.731641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:30:20.352782+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"116'30","reported_seq":235,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.187916+0000","last_change":"2024-05-08T18:29:46.595585+0000","last_active":"2024-05-08T18:32:57.187916+0000","last_peered":"2024-05-08T18:32:57.187916+0000","last_clean":"2024-05-08T18:32:57.187916+0000","last_became_active":"2024-05-08T18:29:46.594930+0000","last_became_peered":"2024-05-08T18:29:46.594930+0000","last_unstale":"2024-05-08T18:32:57.187916+0000","last_undegraded":"2024-05-08T18:32:57.187916+0000","last_fullsized":"2024-05-08T18:32:57.187916+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":28,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:17.773574+0000","last_change":"2024-05-08T18:33:17.773635+0000","last_active":"2024-05-08T18:33:17.773574+0000","last_peered":"2024-05-08T18:33:17.773574+0000","last_clean":"2024-05-08T18:33:17.773574+0000","last_became_active":"2024-05-08T18:29:48.637370+0000","last_became_peered":"2024-05-08T18:29:48.637370+0000","last_unstale":"2024-05-08T18:33:17.773574+0000","last_undegraded":"2024-05-08T18:33:17.773574+0000","last_fullsized":"2024-05-08T18:33:17.773574+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:17.773375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:17.773375+0000","last_clean_scrub_stamp":"2024-05-08T18:33:17.773375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:46.627777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"83'2","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.916205+0000","last_change":"2024-05-08T18:29:50.688760+0000","last_active":"2024-05-08T18:32:46.916205+0000","last_peered":"2024-05-08T18:32:46.916205+0000","last_clean":"2024-05-08T18:32:46.916205+0000","last_became_active":"2024-05-08T18:29:50.687960+0000","last_became_peered":"2024-05-08T18:29:50.687960+0000","last_unstale":"2024-05-08T18:32:46.916205+0000","last_undegraded":"2024-05-08T18:32:46.916205+0000","last_fullsized":"2024-05-08T18:32:46.916205+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"97'4","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.060356+0000","last_change":"2024-05-08T18:29:42.557850+0000","last_active":"2024-05-08T18:32:46.060356+0000","last_peered":"2024-05-08T18:32:46.060356+0000","last_clean":"2024-05-08T18:32:46.060356+0000","last_became_active":"2024-05-08T18:29:42.557119+0000","last_became_peered":"2024-05-08T18:29:42.557119+0000","last_unstale":"2024-05-08T18:32:46.060356+0000","last_undegraded":"2024-05-08T18:32:46.060356+0000","last_fullsized":"2024-05-08T18:32:46.060356+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"116'16","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.151939+0000","last_change":"2024-05-08T18:29:40.544530+0000","last_active":"2024-05-08T18:32:57.151939+0000","last_peered":"2024-05-08T18:32:57.151939+0000","last_clean":"2024-05-08T18:32:57.151939+0000","last_became_active":"2024-05-08T18:29:40.544215+0000","last_became_peered":"2024-05-08T18:29:40.544215+0000","last_unstale":"2024-05-08T18:32:57.151939+0000","last_undegraded":"2024-05-08T18:32:57.151939+0000","last_fullsized":"2024-05-08T18:32:57.151939+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:13.851808+0000","last_change":"2024-05-08T18:33:13.851866+0000","last_active":"2024-05-08T18:33:13.851808+0000","last_peered":"2024-05-08T18:33:13.851808+0000","last_clean":"2024-05-08T18:33:13.851808+0000","last_became_active":"2024-05-08T18:29:44.587822+0000","last_became_peered":"2024-05-08T18:29:44.587822+0000","last_unstale":"2024-05-08T18:33:13.851808+0000","last_undegraded":"2024-05-08T18:33:13.851808+0000","last_fullsized":"2024-05-08T18:33:13.851808+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:13.851609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:13.851609+0000","last_clean_scrub_stamp":"2024-05-08T18:33:13.851609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:47.600784+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"116'27","reported_seq":235,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:03.645710+0000","last_change":"2024-05-08T18:33:03.645896+0000","last_active":"2024-05-08T18:33:03.645710+0000","last_peered":"2024-05-08T18:33:03.645710+0000","last_clean":"2024-05-08T18:33:03.645710+0000","last_became_active":"2024-05-08T18:29:46.602801+0000","last_became_peered":"2024-05-08T18:29:46.602801+0000","last_unstale":"2024-05-08T18:33:03.645710+0000","last_undegraded":"2024-05-08T18:33:03.645710+0000","last_fullsized":"2024-05-08T18:33:03.645710+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'27","last_scrub_stamp":"2024-05-08T18:33:03.645488+0000","last_deep_scrub":"116'27","last_deep_scrub_stamp":"2024-05-08T18:33:03.645488+0000","last_clean_scrub_stamp":"2024-05-08T18:33:03.645488+0000","objects_scrubbed":6,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:32.499890+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":30,"num_read_kb":23,"num_write":22,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1318,"num_omap_keys":6,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":182,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863885+0000","last_change":"2024-05-08T18:29:48.642806+0000","last_active":"2024-05-08T18:32:46.863885+0000","last_peered":"2024-05-08T18:32:46.863885+0000","last_clean":"2024-05-08T18:32:46.863885+0000","last_became_active":"2024-05-08T18:29:48.641813+0000","last_became_peered":"2024-05-08T18:29:48.641813+0000","last_unstale":"2024-05-08T18:32:46.863885+0000","last_undegraded":"2024-05-08T18:32:46.863885+0000","last_fullsized":"2024-05-08T18:32:46.863885+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"80'2","reported_seq":180,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.062769+0000","last_change":"2024-05-08T18:29:50.689819+0000","last_active":"2024-05-08T18:32:46.062769+0000","last_peered":"2024-05-08T18:32:46.062769+0000","last_clean":"2024-05-08T18:32:46.062769+0000","last_became_active":"2024-05-08T18:29:50.686739+0000","last_became_peered":"2024-05-08T18:29:50.686739+0000","last_unstale":"2024-05-08T18:32:46.062769+0000","last_undegraded":"2024-05-08T18:32:46.062769+0000","last_fullsized":"2024-05-08T18:32:46.062769+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":196,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.060125+0000","last_change":"2024-05-08T18:29:42.552388+0000","last_active":"2024-05-08T18:32:46.060125+0000","last_peered":"2024-05-08T18:32:46.060125+0000","last_clean":"2024-05-08T18:32:46.060125+0000","last_became_active":"2024-05-08T18:29:42.551647+0000","last_became_peered":"2024-05-08T18:29:42.551647+0000","last_unstale":"2024-05-08T18:32:46.060125+0000","last_undegraded":"2024-05-08T18:32:46.060125+0000","last_fullsized":"2024-05-08T18:32:46.060125+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"116'16","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:15.522289+0000","last_change":"2024-05-08T18:33:15.522352+0000","last_active":"2024-05-08T18:33:15.522289+0000","last_peered":"2024-05-08T18:33:15.522289+0000","last_clean":"2024-05-08T18:33:15.522289+0000","last_became_active":"2024-05-08T18:29:40.550942+0000","last_became_peered":"2024-05-08T18:29:40.550942+0000","last_unstale":"2024-05-08T18:33:15.522289+0000","last_undegraded":"2024-05-08T18:33:15.522289+0000","last_fullsized":"2024-05-08T18:33:15.522289+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'16","last_scrub_stamp":"2024-05-08T18:33:15.522093+0000","last_deep_scrub":"116'16","last_deep_scrub_stamp":"2024-05-08T18:33:15.522093+0000","last_clean_scrub_stamp":"2024-05-08T18:33:15.522093+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:21:41.818141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:00.876238+0000","last_change":"2024-05-08T18:33:00.876275+0000","last_active":"2024-05-08T18:33:00.876238+0000","last_peered":"2024-05-08T18:33:00.876238+0000","last_clean":"2024-05-08T18:33:00.876238+0000","last_became_active":"2024-05-08T18:29:44.593242+0000","last_became_peered":"2024-05-08T18:29:44.593242+0000","last_unstale":"2024-05-08T18:33:00.876238+0000","last_undegraded":"2024-05-08T18:33:00.876238+0000","last_fullsized":"2024-05-08T18:33:00.876238+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:00.876136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:00.876136+0000","last_clean_scrub_stamp":"2024-05-08T18:33:00.876136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:46.560199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"116'32","reported_seq":240,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:14.840057+0000","last_change":"2024-05-08T18:33:14.840151+0000","last_active":"2024-05-08T18:33:14.840057+0000","last_peered":"2024-05-08T18:33:14.840057+0000","last_clean":"2024-05-08T18:33:14.840057+0000","last_became_active":"2024-05-08T18:29:46.588784+0000","last_became_peered":"2024-05-08T18:29:46.588784+0000","last_unstale":"2024-05-08T18:33:14.840057+0000","last_undegraded":"2024-05-08T18:33:14.840057+0000","last_fullsized":"2024-05-08T18:33:14.840057+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'32","last_scrub_stamp":"2024-05-08T18:33:14.839870+0000","last_deep_scrub":"116'32","last_deep_scrub_stamp":"2024-05-08T18:33:14.839870+0000","last_clean_scrub_stamp":"2024-05-08T18:33:14.839870+0000","objects_scrubbed":8,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:02:08.637757+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":35,"num_read_kb":26,"num_write":24,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1344,"num_omap_keys":6,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"116'105","reported_seq":350,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:16.815313+0000","last_change":"2024-05-08T18:33:16.815379+0000","last_active":"2024-05-08T18:33:16.815313+0000","last_peered":"2024-05-08T18:33:16.815313+0000","last_clean":"2024-05-08T18:33:16.815313+0000","last_became_active":"2024-05-08T18:29:48.630229+0000","last_became_peered":"2024-05-08T18:29:48.630229+0000","last_unstale":"2024-05-08T18:33:16.815313+0000","last_undegraded":"2024-05-08T18:33:16.815313+0000","last_fullsized":"2024-05-08T18:33:16.815313+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'105","last_scrub_stamp":"2024-05-08T18:33:16.815131+0000","last_deep_scrub":"116'105","last_deep_scrub_stamp":"2024-05-08T18:33:16.815131+0000","last_clean_scrub_stamp":"2024-05-08T18:33:16.815131+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:34:12.059461+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":180,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.917537+0000","last_change":"2024-05-08T18:29:50.675105+0000","last_active":"2024-05-08T18:32:46.917537+0000","last_peered":"2024-05-08T18:32:46.917537+0000","last_clean":"2024-05-08T18:32:46.917537+0000","last_became_active":"2024-05-08T18:29:50.674292+0000","last_became_peered":"2024-05-08T18:29:50.674292+0000","last_unstale":"2024-05-08T18:32:46.917537+0000","last_undegraded":"2024-05-08T18:32:46.917537+0000","last_fullsized":"2024-05-08T18:32:46.917537+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"84'4","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:15.480780+0000","last_change":"2024-05-08T18:33:15.480844+0000","last_active":"2024-05-08T18:33:15.480780+0000","last_peered":"2024-05-08T18:33:15.480780+0000","last_clean":"2024-05-08T18:33:15.480780+0000","last_became_active":"2024-05-08T18:29:42.579059+0000","last_became_peered":"2024-05-08T18:29:42.579059+0000","last_unstale":"2024-05-08T18:33:15.480780+0000","last_undegraded":"2024-05-08T18:33:15.480780+0000","last_fullsized":"2024-05-08T18:33:15.480780+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'4","last_scrub_stamp":"2024-05-08T18:33:15.480579+0000","last_deep_scrub":"84'4","last_deep_scrub_stamp":"2024-05-08T18:33:15.480579+0000","last_clean_scrub_stamp":"2024-05-08T18:33:15.480579+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:10:20.075727+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"116'16","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.105033+0000","last_change":"2024-05-08T18:29:40.555327+0000","last_active":"2024-05-08T18:32:57.105033+0000","last_peered":"2024-05-08T18:32:57.105033+0000","last_clean":"2024-05-08T18:32:57.105033+0000","last_became_active":"2024-05-08T18:29:40.554594+0000","last_became_peered":"2024-05-08T18:29:40.554594+0000","last_unstale":"2024-05-08T18:32:57.105033+0000","last_undegraded":"2024-05-08T18:32:57.105033+0000","last_fullsized":"2024-05-08T18:32:57.105033+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4,"num_write":26,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"116'4","reported_seq":339,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:20.169768+0000","last_change":"2024-05-08T18:33:20.169842+0000","last_active":"2024-05-08T18:33:20.169768+0000","last_peered":"2024-05-08T18:33:20.169768+0000","last_clean":"2024-05-08T18:33:20.169768+0000","last_became_active":"2024-05-08T18:29:44.581699+0000","last_became_peered":"2024-05-08T18:29:44.581699+0000","last_unstale":"2024-05-08T18:33:20.169768+0000","last_undegraded":"2024-05-08T18:33:20.169768+0000","last_fullsized":"2024-05-08T18:33:20.169768+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'4","last_scrub_stamp":"2024-05-08T18:33:20.169559+0000","last_deep_scrub":"116'4","last_deep_scrub_stamp":"2024-05-08T18:33:20.169559+0000","last_clean_scrub_stamp":"2024-05-08T18:33:20.169559+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:50.956515+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":138,"num_read_kb":138,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"33'10","reported_seq":201,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.065695+0000","last_change":"2024-05-08T18:29:46.590860+0000","last_active":"2024-05-08T18:32:46.065695+0000","last_peered":"2024-05-08T18:32:46.065695+0000","last_clean":"2024-05-08T18:32:46.065695+0000","last_became_active":"2024-05-08T18:29:46.590087+0000","last_became_peered":"2024-05-08T18:29:46.590087+0000","last_unstale":"2024-05-08T18:32:46.065695+0000","last_undegraded":"2024-05-08T18:32:46.065695+0000","last_fullsized":"2024-05-08T18:32:46.065695+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"116'105","reported_seq":366,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.210100+0000","last_change":"2024-05-08T18:29:48.635548+0000","last_active":"2024-05-08T18:32:57.210100+0000","last_peered":"2024-05-08T18:32:57.210100+0000","last_clean":"2024-05-08T18:32:57.210100+0000","last_became_active":"2024-05-08T18:29:48.634801+0000","last_became_peered":"2024-05-08T18:29:48.634801+0000","last_unstale":"2024-05-08T18:32:57.210100+0000","last_undegraded":"2024-05-08T18:32:57.210100+0000","last_fullsized":"2024-05-08T18:32:57.210100+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":180,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.058588+0000","last_change":"2024-05-08T18:29:50.668279+0000","last_active":"2024-05-08T18:32:46.058588+0000","last_peered":"2024-05-08T18:32:46.058588+0000","last_clean":"2024-05-08T18:32:46.058588+0000","last_became_active":"2024-05-08T18:29:50.667536+0000","last_became_peered":"2024-05-08T18:29:50.667536+0000","last_unstale":"2024-05-08T18:32:46.058588+0000","last_undegraded":"2024-05-08T18:32:46.058588+0000","last_fullsized":"2024-05-08T18:32:46.058588+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"97'14","reported_seq":225,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.916182+0000","last_change":"2024-05-08T18:29:42.563807+0000","last_active":"2024-05-08T18:32:46.916182+0000","last_peered":"2024-05-08T18:32:46.916182+0000","last_clean":"2024-05-08T18:32:46.916182+0000","last_became_active":"2024-05-08T18:29:42.563416+0000","last_became_peered":"2024-05-08T18:29:42.563416+0000","last_unstale":"2024-05-08T18:32:46.916182+0000","last_undegraded":"2024-05-08T18:32:46.916182+0000","last_fullsized":"2024-05-08T18:32:46.916182+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"116'24","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.177329+0000","last_change":"2024-05-08T18:29:40.548898+0000","last_active":"2024-05-08T18:32:57.177329+0000","last_peered":"2024-05-08T18:32:57.177329+0000","last_clean":"2024-05-08T18:32:57.177329+0000","last_became_active":"2024-05-08T18:29:40.548591+0000","last_became_peered":"2024-05-08T18:29:40.548591+0000","last_unstale":"2024-05-08T18:32:57.177329+0000","last_undegraded":"2024-05-08T18:32:57.177329+0000","last_fullsized":"2024-05-08T18:32:57.177329+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":24,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.060045+0000","last_change":"2024-05-08T18:29:44.582578+0000","last_active":"2024-05-08T18:32:46.060045+0000","last_peered":"2024-05-08T18:32:46.060045+0000","last_clean":"2024-05-08T18:32:46.060045+0000","last_became_active":"2024-05-08T18:29:44.581832+0000","last_became_peered":"2024-05-08T18:29:44.581832+0000","last_unstale":"2024-05-08T18:32:46.060045+0000","last_undegraded":"2024-05-08T18:32:46.060045+0000","last_fullsized":"2024-05-08T18:32:46.060045+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"116'33","reported_seq":241,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:04.133658+0000","last_change":"2024-05-08T18:33:04.133740+0000","last_active":"2024-05-08T18:33:04.133658+0000","last_peered":"2024-05-08T18:33:04.133658+0000","last_clean":"2024-05-08T18:33:04.133658+0000","last_became_active":"2024-05-08T18:29:46.601740+0000","last_became_peered":"2024-05-08T18:29:46.601740+0000","last_unstale":"2024-05-08T18:33:04.133658+0000","last_undegraded":"2024-05-08T18:33:04.133658+0000","last_fullsized":"2024-05-08T18:33:04.133658+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'33","last_scrub_stamp":"2024-05-08T18:33:04.133452+0000","last_deep_scrub":"116'33","last_deep_scrub_stamp":"2024-05-08T18:33:04.133452+0000","last_clean_scrub_stamp":"2024-05-08T18:33:04.133452+0000","objects_scrubbed":8,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:09.047282+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":35,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.849378+0000","last_change":"2024-05-08T18:29:48.640046+0000","last_active":"2024-05-08T18:32:46.849378+0000","last_peered":"2024-05-08T18:32:46.849378+0000","last_clean":"2024-05-08T18:32:46.849378+0000","last_became_active":"2024-05-08T18:29:48.639309+0000","last_became_peered":"2024-05-08T18:29:48.639309+0000","last_unstale":"2024-05-08T18:32:46.849378+0000","last_undegraded":"2024-05-08T18:32:46.849378+0000","last_fullsized":"2024-05-08T18:32:46.849378+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":180,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.917070+0000","last_change":"2024-05-08T18:29:50.668361+0000","last_active":"2024-05-08T18:32:46.917070+0000","last_peered":"2024-05-08T18:32:46.917070+0000","last_clean":"2024-05-08T18:32:46.917070+0000","last_became_active":"2024-05-08T18:29:50.667636+0000","last_became_peered":"2024-05-08T18:29:50.667636+0000","last_unstale":"2024-05-08T18:32:46.917070+0000","last_undegraded":"2024-05-08T18:32:46.917070+0000","last_fullsized":"2024-05-08T18:32:46.917070+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"97'4","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:03.641090+0000","last_change":"2024-05-08T18:33:03.641202+0000","last_active":"2024-05-08T18:33:03.641090+0000","last_peered":"2024-05-08T18:33:03.641090+0000","last_clean":"2024-05-08T18:33:03.641090+0000","last_became_active":"2024-05-08T18:29:42.583639+0000","last_became_peered":"2024-05-08T18:29:42.583639+0000","last_unstale":"2024-05-08T18:33:03.641090+0000","last_undegraded":"2024-05-08T18:33:03.641090+0000","last_fullsized":"2024-05-08T18:33:03.641090+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'4","last_scrub_stamp":"2024-05-08T18:33:03.640783+0000","last_deep_scrub":"97'4","last_deep_scrub_stamp":"2024-05-08T18:33:03.640783+0000","last_clean_scrub_stamp":"2024-05-08T18:33:03.640783+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:40:41.107541+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":297,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.936556+0000","last_change":"2024-05-08T18:29:27.115522+0000","last_active":"2024-05-08T18:32:46.936556+0000","last_peered":"2024-05-08T18:32:46.936556+0000","last_clean":"2024-05-08T18:32:46.936556+0000","last_became_active":"2024-05-08T18:29:27.112960+0000","last_became_peered":"2024-05-08T18:29:27.112960+0000","last_unstale":"2024-05-08T18:32:46.936556+0000","last_undegraded":"2024-05-08T18:32:46.936556+0000","last_fullsized":"2024-05-08T18:32:46.936556+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:26.091102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:26.091102+0000","last_clean_scrub_stamp":"2024-05-08T18:29:26.091102+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.077865+0000","last_change":"2024-05-08T18:29:34.496467+0000","last_active":"2024-05-08T18:32:47.077865+0000","last_peered":"2024-05-08T18:32:47.077865+0000","last_clean":"2024-05-08T18:32:47.077865+0000","last_became_active":"2024-05-08T18:29:34.495632+0000","last_became_peered":"2024-05-08T18:29:34.495632+0000","last_unstale":"2024-05-08T18:32:47.077865+0000","last_undegraded":"2024-05-08T18:32:47.077865+0000","last_fullsized":"2024-05-08T18:32:47.077865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"116'10","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.062846+0000","last_change":"2024-05-08T18:30:20.849562+0000","last_active":"2024-05-08T18:32:57.062846+0000","last_peered":"2024-05-08T18:32:57.062846+0000","last_clean":"2024-05-08T18:32:57.062846+0000","last_became_active":"2024-05-08T18:30:20.849160+0000","last_became_peered":"2024-05-08T18:30:20.849160+0000","last_unstale":"2024-05-08T18:32:57.062846+0000","last_undegraded":"2024-05-08T18:32:57.062846+0000","last_fullsized":"2024-05-08T18:32:57.062846+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:07.951240+0000","last_change":"2024-05-08T18:33:07.951294+0000","last_active":"2024-05-08T18:33:07.951240+0000","last_peered":"2024-05-08T18:33:07.951240+0000","last_clean":"2024-05-08T18:33:07.951240+0000","last_became_active":"2024-05-08T18:29:44.587855+0000","last_became_peered":"2024-05-08T18:29:44.587855+0000","last_unstale":"2024-05-08T18:33:07.951240+0000","last_undegraded":"2024-05-08T18:33:07.951240+0000","last_fullsized":"2024-05-08T18:33:07.951240+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:07.951044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:07.951044+0000","last_clean_scrub_stamp":"2024-05-08T18:33:07.951044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:20:11.634058+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"116'46","reported_seq":265,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.166142+0000","last_change":"2024-05-08T18:33:05.166233+0000","last_active":"2024-05-08T18:33:05.166142+0000","last_peered":"2024-05-08T18:33:05.166142+0000","last_clean":"2024-05-08T18:33:05.166142+0000","last_became_active":"2024-05-08T18:29:46.594573+0000","last_became_peered":"2024-05-08T18:29:46.594573+0000","last_unstale":"2024-05-08T18:33:05.166142+0000","last_undegraded":"2024-05-08T18:33:05.166142+0000","last_fullsized":"2024-05-08T18:33:05.166142+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'46","last_scrub_stamp":"2024-05-08T18:33:05.165944+0000","last_deep_scrub":"116'46","last_deep_scrub_stamp":"2024-05-08T18:33:05.165944+0000","last_clean_scrub_stamp":"2024-05-08T18:33:05.165944+0000","objects_scrubbed":5,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:39:59.017926+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8302,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":58,"num_read_kb":181,"num_write":30,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:01.958893+0000","last_change":"2024-05-08T18:33:01.958941+0000","last_active":"2024-05-08T18:33:01.958893+0000","last_peered":"2024-05-08T18:33:01.958893+0000","last_clean":"2024-05-08T18:33:01.958893+0000","last_became_active":"2024-05-08T18:29:48.631481+0000","last_became_peered":"2024-05-08T18:29:48.631481+0000","last_unstale":"2024-05-08T18:33:01.958893+0000","last_undegraded":"2024-05-08T18:33:01.958893+0000","last_fullsized":"2024-05-08T18:33:01.958893+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:01.958729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:01.958729+0000","last_clean_scrub_stamp":"2024-05-08T18:33:01.958729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:35:11.554040+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"80'2","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.848592+0000","last_change":"2024-05-08T18:29:50.675319+0000","last_active":"2024-05-08T18:32:46.848592+0000","last_peered":"2024-05-08T18:32:46.848592+0000","last_clean":"2024-05-08T18:32:46.848592+0000","last_became_active":"2024-05-08T18:29:50.674526+0000","last_became_peered":"2024-05-08T18:29:50.674526+0000","last_unstale":"2024-05-08T18:32:46.848592+0000","last_undegraded":"2024-05-08T18:32:46.848592+0000","last_fullsized":"2024-05-08T18:32:46.848592+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"84'4","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:15.893416+0000","last_change":"2024-05-08T18:33:15.893484+0000","last_active":"2024-05-08T18:33:15.893416+0000","last_peered":"2024-05-08T18:33:15.893416+0000","last_clean":"2024-05-08T18:33:15.893416+0000","last_became_active":"2024-05-08T18:29:42.568244+0000","last_became_peered":"2024-05-08T18:29:42.568244+0000","last_unstale":"2024-05-08T18:33:15.893416+0000","last_undegraded":"2024-05-08T18:33:15.893416+0000","last_fullsized":"2024-05-08T18:33:15.893416+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'4","last_scrub_stamp":"2024-05-08T18:33:15.893221+0000","last_deep_scrub":"84'4","last_deep_scrub_stamp":"2024-05-08T18:33:15.893221+0000","last_clean_scrub_stamp":"2024-05-08T18:33:15.893221+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:07:54.051709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":201,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.936136+0000","last_change":"2024-05-08T18:29:34.497654+0000","last_active":"2024-05-08T18:32:46.936136+0000","last_peered":"2024-05-08T18:32:46.936136+0000","last_clean":"2024-05-08T18:32:46.936136+0000","last_became_active":"2024-05-08T18:29:34.495812+0000","last_became_peered":"2024-05-08T18:29:34.495812+0000","last_unstale":"2024-05-08T18:32:46.936136+0000","last_undegraded":"2024-05-08T18:32:46.936136+0000","last_fullsized":"2024-05-08T18:32:46.936136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"116'14","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.148443+0000","last_change":"2024-05-08T18:29:40.560653+0000","last_active":"2024-05-08T18:32:57.148443+0000","last_peered":"2024-05-08T18:32:57.148443+0000","last_clean":"2024-05-08T18:32:57.148443+0000","last_became_active":"2024-05-08T18:29:40.560296+0000","last_became_peered":"2024-05-08T18:29:40.560296+0000","last_unstale":"2024-05-08T18:32:57.148443+0000","last_undegraded":"2024-05-08T18:32:57.148443+0000","last_fullsized":"2024-05-08T18:32:57.148443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":189,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.080795+0000","last_change":"2024-05-08T18:29:44.594681+0000","last_active":"2024-05-08T18:32:47.080795+0000","last_peered":"2024-05-08T18:32:47.080795+0000","last_clean":"2024-05-08T18:32:47.080795+0000","last_became_active":"2024-05-08T18:29:44.593917+0000","last_became_peered":"2024-05-08T18:29:44.593917+0000","last_unstale":"2024-05-08T18:32:47.080795+0000","last_undegraded":"2024-05-08T18:32:47.080795+0000","last_fullsized":"2024-05-08T18:32:47.080795+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"116'127","reported_seq":424,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.910703+0000","last_change":"2024-05-08T18:33:06.910796+0000","last_active":"2024-05-08T18:33:06.910703+0000","last_peered":"2024-05-08T18:33:06.910703+0000","last_clean":"2024-05-08T18:33:06.910703+0000","last_became_active":"2024-05-08T18:29:46.594789+0000","last_became_peered":"2024-05-08T18:29:46.594789+0000","last_unstale":"2024-05-08T18:33:06.910703+0000","last_undegraded":"2024-05-08T18:33:06.910703+0000","last_fullsized":"2024-05-08T18:33:06.910703+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'127","last_scrub_stamp":"2024-05-08T18:33:06.910514+0000","last_deep_scrub":"116'127","last_deep_scrub_stamp":"2024-05-08T18:33:06.910514+0000","last_clean_scrub_stamp":"2024-05-08T18:33:06.910514+0000","objects_scrubbed":10,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:34:02.154843+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4344,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":167,"num_read_kb":168,"num_write":36,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.937485+0000","last_change":"2024-05-08T18:29:48.634661+0000","last_active":"2024-05-08T18:32:46.937485+0000","last_peered":"2024-05-08T18:32:46.937485+0000","last_clean":"2024-05-08T18:32:46.937485+0000","last_became_active":"2024-05-08T18:29:48.634044+0000","last_became_peered":"2024-05-08T18:29:48.634044+0000","last_unstale":"2024-05-08T18:32:46.937485+0000","last_undegraded":"2024-05-08T18:32:46.937485+0000","last_fullsized":"2024-05-08T18:32:46.937485+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":180,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.916964+0000","last_change":"2024-05-08T18:29:50.676536+0000","last_active":"2024-05-08T18:32:46.916964+0000","last_peered":"2024-05-08T18:32:46.916964+0000","last_clean":"2024-05-08T18:32:46.916964+0000","last_became_active":"2024-05-08T18:29:50.675770+0000","last_became_peered":"2024-05-08T18:29:50.675770+0000","last_unstale":"2024-05-08T18:32:46.916964+0000","last_undegraded":"2024-05-08T18:32:46.916964+0000","last_fullsized":"2024-05-08T18:32:46.916964+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:07.905828+0000","last_change":"2024-05-08T18:33:07.905974+0000","last_active":"2024-05-08T18:33:07.905828+0000","last_peered":"2024-05-08T18:33:07.905828+0000","last_clean":"2024-05-08T18:33:07.905828+0000","last_became_active":"2024-05-08T18:29:42.573621+0000","last_became_peered":"2024-05-08T18:29:42.573621+0000","last_unstale":"2024-05-08T18:33:07.905828+0000","last_undegraded":"2024-05-08T18:33:07.905828+0000","last_fullsized":"2024-05-08T18:33:07.905828+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:07.905533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:07.905533+0000","last_clean_scrub_stamp":"2024-05-08T18:33:07.905533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:36.759934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.762405+0000","last_change":"2024-05-08T18:33:05.762460+0000","last_active":"2024-05-08T18:33:05.762405+0000","last_peered":"2024-05-08T18:33:05.762405+0000","last_clean":"2024-05-08T18:33:05.762405+0000","last_became_active":"2024-05-08T18:29:34.490717+0000","last_became_peered":"2024-05-08T18:29:34.490717+0000","last_unstale":"2024-05-08T18:33:05.762405+0000","last_undegraded":"2024-05-08T18:33:05.762405+0000","last_fullsized":"2024-05-08T18:33:05.762405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:05.762206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:05.762206+0000","last_clean_scrub_stamp":"2024-05-08T18:33:05.762206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:40:43.228963+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"116'24","reported_seq":232,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:16.780841+0000","last_change":"2024-05-08T18:33:16.780996+0000","last_active":"2024-05-08T18:33:16.780841+0000","last_peered":"2024-05-08T18:33:16.780841+0000","last_clean":"2024-05-08T18:33:16.780841+0000","last_became_active":"2024-05-08T18:29:40.529804+0000","last_became_peered":"2024-05-08T18:29:40.529804+0000","last_unstale":"2024-05-08T18:33:16.780841+0000","last_undegraded":"2024-05-08T18:33:16.780841+0000","last_fullsized":"2024-05-08T18:33:16.780841+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'24","last_scrub_stamp":"2024-05-08T18:33:16.780599+0000","last_deep_scrub":"116'24","last_deep_scrub_stamp":"2024-05-08T18:33:16.780599+0000","last_clean_scrub_stamp":"2024-05-08T18:33:16.780599+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:04:25.215108+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":24,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"116'2","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:03.762329+0000","last_change":"2024-05-08T18:33:03.762464+0000","last_active":"2024-05-08T18:33:03.762329+0000","last_peered":"2024-05-08T18:33:03.762329+0000","last_clean":"2024-05-08T18:33:03.762329+0000","last_became_active":"2024-05-08T18:29:44.584227+0000","last_became_peered":"2024-05-08T18:29:44.584227+0000","last_unstale":"2024-05-08T18:33:03.762329+0000","last_undegraded":"2024-05-08T18:33:03.762329+0000","last_fullsized":"2024-05-08T18:33:03.762329+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'2","last_scrub_stamp":"2024-05-08T18:33:03.762127+0000","last_deep_scrub":"116'2","last_deep_scrub_stamp":"2024-05-08T18:33:03.762127+0000","last_clean_scrub_stamp":"2024-05-08T18:33:03.762127+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:43:25.087022+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"116'23","reported_seq":257,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:03.913061+0000","last_change":"2024-05-08T18:33:03.913151+0000","last_active":"2024-05-08T18:33:03.913061+0000","last_peered":"2024-05-08T18:33:03.913061+0000","last_clean":"2024-05-08T18:33:03.913061+0000","last_became_active":"2024-05-08T18:29:46.607989+0000","last_became_peered":"2024-05-08T18:29:46.607989+0000","last_unstale":"2024-05-08T18:33:03.913061+0000","last_undegraded":"2024-05-08T18:33:03.913061+0000","last_fullsized":"2024-05-08T18:33:03.913061+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'23","last_scrub_stamp":"2024-05-08T18:33:03.912858+0000","last_deep_scrub":"116'23","last_deep_scrub_stamp":"2024-05-08T18:33:03.912858+0000","last_clean_scrub_stamp":"2024-05-08T18:33:03.912858+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:32.767259+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:04.841782+0000","last_change":"2024-05-08T18:33:04.841837+0000","last_active":"2024-05-08T18:33:04.841782+0000","last_peered":"2024-05-08T18:33:04.841782+0000","last_clean":"2024-05-08T18:33:04.841782+0000","last_became_active":"2024-05-08T18:29:48.624545+0000","last_became_peered":"2024-05-08T18:29:48.624545+0000","last_unstale":"2024-05-08T18:33:04.841782+0000","last_undegraded":"2024-05-08T18:33:04.841782+0000","last_fullsized":"2024-05-08T18:33:04.841782+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:04.841580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:04.841580+0000","last_clean_scrub_stamp":"2024-05-08T18:33:04.841580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:09:10.449385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"84'12","reported_seq":201,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.064013+0000","last_change":"2024-05-08T18:29:50.688851+0000","last_active":"2024-05-08T18:32:46.064013+0000","last_peered":"2024-05-08T18:32:46.064013+0000","last_clean":"2024-05-08T18:32:46.064013+0000","last_became_active":"2024-05-08T18:29:50.687978+0000","last_became_peered":"2024-05-08T18:29:50.687978+0000","last_unstale":"2024-05-08T18:32:46.064013+0000","last_undegraded":"2024-05-08T18:32:46.064013+0000","last_fullsized":"2024-05-08T18:32:46.064013+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":42,"num_write":31,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"84'4","reported_seq":211,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.918198+0000","last_change":"2024-05-08T18:31:22.008678+0000","last_active":"2024-05-08T18:32:46.918198+0000","last_peered":"2024-05-08T18:32:46.918198+0000","last_clean":"2024-05-08T18:32:46.918198+0000","last_became_active":"2024-05-08T18:31:22.008342+0000","last_became_peered":"2024-05-08T18:31:22.008342+0000","last_unstale":"2024-05-08T18:32:46.918198+0000","last_undegraded":"2024-05-08T18:32:46.918198+0000","last_fullsized":"2024-05-08T18:32:46.918198+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.079498+0000","last_change":"2024-05-08T18:29:34.496942+0000","last_active":"2024-05-08T18:32:47.079498+0000","last_peered":"2024-05-08T18:32:47.079498+0000","last_clean":"2024-05-08T18:32:47.079498+0000","last_became_active":"2024-05-08T18:29:34.495882+0000","last_became_peered":"2024-05-08T18:29:34.495882+0000","last_unstale":"2024-05-08T18:32:47.079498+0000","last_undegraded":"2024-05-08T18:32:47.079498+0000","last_fullsized":"2024-05-08T18:32:47.079498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"116'16","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.135154+0000","last_change":"2024-05-08T18:29:40.554353+0000","last_active":"2024-05-08T18:32:57.135154+0000","last_peered":"2024-05-08T18:32:57.135154+0000","last_clean":"2024-05-08T18:32:57.135154+0000","last_became_active":"2024-05-08T18:29:40.553527+0000","last_became_peered":"2024-05-08T18:29:40.553527+0000","last_unstale":"2024-05-08T18:32:57.135154+0000","last_undegraded":"2024-05-08T18:32:57.135154+0000","last_fullsized":"2024-05-08T18:32:57.135154+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:19.006678+0000","last_change":"2024-05-08T18:33:19.006743+0000","last_active":"2024-05-08T18:33:19.006678+0000","last_peered":"2024-05-08T18:33:19.006678+0000","last_clean":"2024-05-08T18:33:19.006678+0000","last_became_active":"2024-05-08T18:29:44.596678+0000","last_became_peered":"2024-05-08T18:29:44.596678+0000","last_unstale":"2024-05-08T18:33:19.006678+0000","last_undegraded":"2024-05-08T18:33:19.006678+0000","last_fullsized":"2024-05-08T18:33:19.006678+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:19.006475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:19.006475+0000","last_clean_scrub_stamp":"2024-05-08T18:33:19.006475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:25:42.318338+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"116'19","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.769018+0000","last_change":"2024-05-08T18:33:06.769095+0000","last_active":"2024-05-08T18:33:06.769018+0000","last_peered":"2024-05-08T18:33:06.769018+0000","last_clean":"2024-05-08T18:33:06.769018+0000","last_became_active":"2024-05-08T18:29:46.606367+0000","last_became_peered":"2024-05-08T18:29:46.606367+0000","last_unstale":"2024-05-08T18:33:06.769018+0000","last_undegraded":"2024-05-08T18:33:06.769018+0000","last_fullsized":"2024-05-08T18:33:06.769018+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'19","last_scrub_stamp":"2024-05-08T18:33:06.768818+0000","last_deep_scrub":"116'19","last_deep_scrub_stamp":"2024-05-08T18:33:06.768818+0000","last_clean_scrub_stamp":"2024-05-08T18:33:06.768818+0000","objects_scrubbed":6,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:21:20.078602+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":187,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:10.610648+0000","last_change":"2024-05-08T18:33:10.610711+0000","last_active":"2024-05-08T18:33:10.610648+0000","last_peered":"2024-05-08T18:33:10.610648+0000","last_clean":"2024-05-08T18:33:10.610648+0000","last_became_active":"2024-05-08T18:29:48.631874+0000","last_became_peered":"2024-05-08T18:29:48.631874+0000","last_unstale":"2024-05-08T18:33:10.610648+0000","last_undegraded":"2024-05-08T18:33:10.610648+0000","last_fullsized":"2024-05-08T18:33:10.610648+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:10.610431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:10.610431+0000","last_clean_scrub_stamp":"2024-05-08T18:33:10.610431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:57:11.243206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.078214+0000","last_change":"2024-05-08T18:29:50.683443+0000","last_active":"2024-05-08T18:32:47.078214+0000","last_peered":"2024-05-08T18:32:47.078214+0000","last_clean":"2024-05-08T18:32:47.078214+0000","last_became_active":"2024-05-08T18:29:50.682634+0000","last_became_peered":"2024-05-08T18:29:50.682634+0000","last_unstale":"2024-05-08T18:32:47.078214+0000","last_undegraded":"2024-05-08T18:32:47.078214+0000","last_fullsized":"2024-05-08T18:32:47.078214+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"80'2","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:11.776130+0000","last_change":"2024-05-08T18:33:11.776192+0000","last_active":"2024-05-08T18:33:11.776130+0000","last_peered":"2024-05-08T18:33:11.776130+0000","last_clean":"2024-05-08T18:33:11.776130+0000","last_became_active":"2024-05-08T18:29:42.574288+0000","last_became_peered":"2024-05-08T18:29:42.574288+0000","last_unstale":"2024-05-08T18:33:11.776130+0000","last_undegraded":"2024-05-08T18:33:11.776130+0000","last_fullsized":"2024-05-08T18:33:11.776130+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2","last_scrub_stamp":"2024-05-08T18:33:11.775925+0000","last_deep_scrub":"80'2","last_deep_scrub_stamp":"2024-05-08T18:33:11.775925+0000","last_clean_scrub_stamp":"2024-05-08T18:33:11.775925+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:55:00.699168+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"116'22","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:18.823057+0000","last_change":"2024-05-08T18:33:18.823117+0000","last_active":"2024-05-08T18:33:18.823057+0000","last_peered":"2024-05-08T18:33:18.823057+0000","last_clean":"2024-05-08T18:33:18.823057+0000","last_became_active":"2024-05-08T18:30:20.850365+0000","last_became_peered":"2024-05-08T18:30:20.850365+0000","last_unstale":"2024-05-08T18:33:18.823057+0000","last_undegraded":"2024-05-08T18:33:18.823057+0000","last_fullsized":"2024-05-08T18:33:18.823057+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'22","last_scrub_stamp":"2024-05-08T18:33:18.822863+0000","last_deep_scrub":"116'22","last_deep_scrub_stamp":"2024-05-08T18:33:18.822863+0000","last_clean_scrub_stamp":"2024-05-08T18:33:18.822863+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:26:08.884895+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:15.820342+0000","last_change":"2024-05-08T18:33:15.820399+0000","last_active":"2024-05-08T18:33:15.820342+0000","last_peered":"2024-05-08T18:33:15.820342+0000","last_clean":"2024-05-08T18:33:15.820342+0000","last_became_active":"2024-05-08T18:29:34.605574+0000","last_became_peered":"2024-05-08T18:29:34.605574+0000","last_unstale":"2024-05-08T18:33:15.820342+0000","last_undegraded":"2024-05-08T18:33:15.820342+0000","last_fullsized":"2024-05-08T18:33:15.820342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:15.820133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:15.820133+0000","last_clean_scrub_stamp":"2024-05-08T18:33:15.820133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:51:06.134435+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:16.933397+0000","last_change":"2024-05-08T18:33:16.933456+0000","last_active":"2024-05-08T18:33:16.933397+0000","last_peered":"2024-05-08T18:33:16.933397+0000","last_clean":"2024-05-08T18:33:16.933397+0000","last_became_active":"2024-05-08T18:29:44.594642+0000","last_became_peered":"2024-05-08T18:29:44.594642+0000","last_unstale":"2024-05-08T18:33:16.933397+0000","last_undegraded":"2024-05-08T18:33:16.933397+0000","last_fullsized":"2024-05-08T18:33:16.933397+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:16.933187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:16.933187+0000","last_clean_scrub_stamp":"2024-05-08T18:33:16.933187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:45:39.627830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"116'39","reported_seq":247,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.137627+0000","last_change":"2024-05-08T18:29:46.602279+0000","last_active":"2024-05-08T18:32:57.137627+0000","last_peered":"2024-05-08T18:32:57.137627+0000","last_clean":"2024-05-08T18:32:57.137627+0000","last_became_active":"2024-05-08T18:29:46.599707+0000","last_became_peered":"2024-05-08T18:29:46.599707+0000","last_unstale":"2024-05-08T18:32:57.137627+0000","last_undegraded":"2024-05-08T18:32:57.137627+0000","last_fullsized":"2024-05-08T18:32:57.137627+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":53,"num_read_kb":162,"num_write":30,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":184,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.057369+0000","last_change":"2024-05-08T18:29:48.639458+0000","last_active":"2024-05-08T18:32:46.057369+0000","last_peered":"2024-05-08T18:32:46.057369+0000","last_clean":"2024-05-08T18:32:46.057369+0000","last_became_active":"2024-05-08T18:29:48.638709+0000","last_became_peered":"2024-05-08T18:29:48.638709+0000","last_unstale":"2024-05-08T18:32:46.057369+0000","last_undegraded":"2024-05-08T18:32:46.057369+0000","last_fullsized":"2024-05-08T18:32:46.057369+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"97'6","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.861374+0000","last_change":"2024-05-08T18:29:50.681077+0000","last_active":"2024-05-08T18:32:46.861374+0000","last_peered":"2024-05-08T18:32:46.861374+0000","last_clean":"2024-05-08T18:32:46.861374+0000","last_became_active":"2024-05-08T18:29:50.675766+0000","last_became_peered":"2024-05-08T18:29:50.675766+0000","last_unstale":"2024-05-08T18:32:46.861374+0000","last_undegraded":"2024-05-08T18:32:46.861374+0000","last_fullsized":"2024-05-08T18:32:46.861374+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"80'2","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:11.856967+0000","last_change":"2024-05-08T18:33:11.857034+0000","last_active":"2024-05-08T18:33:11.856967+0000","last_peered":"2024-05-08T18:33:11.856967+0000","last_clean":"2024-05-08T18:33:11.856967+0000","last_became_active":"2024-05-08T18:29:42.570645+0000","last_became_peered":"2024-05-08T18:29:42.570645+0000","last_unstale":"2024-05-08T18:33:11.856967+0000","last_undegraded":"2024-05-08T18:33:11.856967+0000","last_fullsized":"2024-05-08T18:33:11.856967+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2","last_scrub_stamp":"2024-05-08T18:33:11.856766+0000","last_deep_scrub":"80'2","last_deep_scrub_stamp":"2024-05-08T18:33:11.856766+0000","last_clean_scrub_stamp":"2024-05-08T18:33:11.856766+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:47.882638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"116'6","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:17.754246+0000","last_change":"2024-05-08T18:33:17.754306+0000","last_active":"2024-05-08T18:33:17.754246+0000","last_peered":"2024-05-08T18:33:17.754246+0000","last_clean":"2024-05-08T18:33:17.754246+0000","last_became_active":"2024-05-08T18:29:40.530256+0000","last_became_peered":"2024-05-08T18:29:40.530256+0000","last_unstale":"2024-05-08T18:33:17.754246+0000","last_undegraded":"2024-05-08T18:33:17.754246+0000","last_fullsized":"2024-05-08T18:33:17.754246+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'6","last_scrub_stamp":"2024-05-08T18:33:17.754029+0000","last_deep_scrub":"116'6","last_deep_scrub_stamp":"2024-05-08T18:33:17.754029+0000","last_clean_scrub_stamp":"2024-05-08T18:33:17.754029+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:59:58.713080+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":201,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.938632+0000","last_change":"2024-05-08T18:29:34.603292+0000","last_active":"2024-05-08T18:32:46.938632+0000","last_peered":"2024-05-08T18:32:46.938632+0000","last_clean":"2024-05-08T18:32:46.938632+0000","last_became_active":"2024-05-08T18:29:34.602547+0000","last_became_peered":"2024-05-08T18:29:34.602547+0000","last_unstale":"2024-05-08T18:32:46.938632+0000","last_undegraded":"2024-05-08T18:32:46.938632+0000","last_fullsized":"2024-05-08T18:32:46.938632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:33.458212+0000","last_clean_scrub_stamp":"2024-05-08T18:29:33.458212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:08.632123+0000","last_change":"2024-05-08T18:33:08.632177+0000","last_active":"2024-05-08T18:33:08.632123+0000","last_peered":"2024-05-08T18:33:08.632123+0000","last_clean":"2024-05-08T18:33:08.632123+0000","last_became_active":"2024-05-08T18:29:44.591870+0000","last_became_peered":"2024-05-08T18:29:44.591870+0000","last_unstale":"2024-05-08T18:33:08.632123+0000","last_undegraded":"2024-05-08T18:33:08.632123+0000","last_fullsized":"2024-05-08T18:33:08.632123+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:08.631919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:08.631919+0000","last_clean_scrub_stamp":"2024-05-08T18:33:08.631919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:56:39.299991+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"116'21","reported_seq":224,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:10.811207+0000","last_change":"2024-05-08T18:33:10.811356+0000","last_active":"2024-05-08T18:33:10.811207+0000","last_peered":"2024-05-08T18:33:10.811207+0000","last_clean":"2024-05-08T18:33:10.811207+0000","last_became_active":"2024-05-08T18:29:46.602920+0000","last_became_peered":"2024-05-08T18:29:46.602920+0000","last_unstale":"2024-05-08T18:33:10.811207+0000","last_undegraded":"2024-05-08T18:33:10.811207+0000","last_fullsized":"2024-05-08T18:33:10.811207+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'21","last_scrub_stamp":"2024-05-08T18:33:10.810930+0000","last_deep_scrub":"116'21","last_deep_scrub_stamp":"2024-05-08T18:33:10.810930+0000","last_clean_scrub_stamp":"2024-05-08T18:33:10.810930+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:40:04.662911+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"116'105","reported_seq":343,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.203237+0000","last_change":"2024-05-08T18:33:06.203314+0000","last_active":"2024-05-08T18:33:06.203237+0000","last_peered":"2024-05-08T18:33:06.203237+0000","last_clean":"2024-05-08T18:33:06.203237+0000","last_became_active":"2024-05-08T18:29:48.634280+0000","last_became_peered":"2024-05-08T18:29:48.634280+0000","last_unstale":"2024-05-08T18:33:06.203237+0000","last_undegraded":"2024-05-08T18:33:06.203237+0000","last_fullsized":"2024-05-08T18:33:06.203237+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'105","last_scrub_stamp":"2024-05-08T18:33:06.203046+0000","last_deep_scrub":"116'105","last_deep_scrub_stamp":"2024-05-08T18:33:06.203046+0000","last_clean_scrub_stamp":"2024-05-08T18:33:06.203046+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:11:28.565523+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"80'2","reported_seq":180,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.067499+0000","last_change":"2024-05-08T18:29:50.688742+0000","last_active":"2024-05-08T18:32:46.067499+0000","last_peered":"2024-05-08T18:32:46.067499+0000","last_clean":"2024-05-08T18:32:46.067499+0000","last_became_active":"2024-05-08T18:29:50.687135+0000","last_became_peered":"2024-05-08T18:29:50.687135+0000","last_unstale":"2024-05-08T18:32:46.067499+0000","last_undegraded":"2024-05-08T18:32:46.067499+0000","last_fullsized":"2024-05-08T18:32:46.067499+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"80'2","reported_seq":153,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.060102+0000","last_change":"2024-05-08T18:30:21.220561+0000","last_active":"2024-05-08T18:32:46.060102+0000","last_peered":"2024-05-08T18:32:46.060102+0000","last_clean":"2024-05-08T18:32:46.060102+0000","last_became_active":"2024-05-08T18:30:21.220196+0000","last_became_peered":"2024-05-08T18:30:21.220196+0000","last_unstale":"2024-05-08T18:32:46.060102+0000","last_undegraded":"2024-05-08T18:32:46.060102+0000","last_fullsized":"2024-05-08T18:32:46.060102+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"116'10","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:56.980103+0000","last_change":"2024-05-08T18:29:40.565872+0000","last_active":"2024-05-08T18:32:56.980103+0000","last_peered":"2024-05-08T18:32:56.980103+0000","last_clean":"2024-05-08T18:32:56.980103+0000","last_became_active":"2024-05-08T18:29:40.565655+0000","last_became_peered":"2024-05-08T18:29:40.565655+0000","last_unstale":"2024-05-08T18:32:56.980103+0000","last_undegraded":"2024-05-08T18:32:56.980103+0000","last_fullsized":"2024-05-08T18:32:56.980103+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:14.830317+0000","last_change":"2024-05-08T18:33:14.830428+0000","last_active":"2024-05-08T18:33:14.830317+0000","last_peered":"2024-05-08T18:33:14.830317+0000","last_clean":"2024-05-08T18:33:14.830317+0000","last_became_active":"2024-05-08T18:29:34.500933+0000","last_became_peered":"2024-05-08T18:29:34.500933+0000","last_unstale":"2024-05-08T18:33:14.830317+0000","last_undegraded":"2024-05-08T18:33:14.830317+0000","last_fullsized":"2024-05-08T18:33:14.830317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:14.829982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:14.829982+0000","last_clean_scrub_stamp":"2024-05-08T18:33:14.829982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:17:25.384731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:19.531816+0000","last_change":"2024-05-08T18:33:19.531875+0000","last_active":"2024-05-08T18:33:19.531816+0000","last_peered":"2024-05-08T18:33:19.531816+0000","last_clean":"2024-05-08T18:33:19.531816+0000","last_became_active":"2024-05-08T18:29:44.575454+0000","last_became_peered":"2024-05-08T18:29:44.575454+0000","last_unstale":"2024-05-08T18:33:19.531816+0000","last_undegraded":"2024-05-08T18:33:19.531816+0000","last_fullsized":"2024-05-08T18:33:19.531816+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:19.531621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:19.531621+0000","last_clean_scrub_stamp":"2024-05-08T18:33:19.531621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:11:19.253395+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"116'16","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:02.599578+0000","last_change":"2024-05-08T18:33:02.599677+0000","last_active":"2024-05-08T18:33:02.599578+0000","last_peered":"2024-05-08T18:33:02.599578+0000","last_clean":"2024-05-08T18:33:02.599578+0000","last_became_active":"2024-05-08T18:29:46.603455+0000","last_became_peered":"2024-05-08T18:29:46.603455+0000","last_unstale":"2024-05-08T18:33:02.599578+0000","last_undegraded":"2024-05-08T18:33:02.599578+0000","last_fullsized":"2024-05-08T18:33:02.599578+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'16","last_scrub_stamp":"2024-05-08T18:33:02.599369+0000","last_deep_scrub":"116'16","last_deep_scrub_stamp":"2024-05-08T18:33:02.599369+0000","last_clean_scrub_stamp":"2024-05-08T18:33:02.599369+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:24:13.274296+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"116'105","reported_seq":377,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:01.696140+0000","last_change":"2024-05-08T18:33:01.696176+0000","last_active":"2024-05-08T18:33:01.696140+0000","last_peered":"2024-05-08T18:33:01.696140+0000","last_clean":"2024-05-08T18:33:01.696140+0000","last_became_active":"2024-05-08T18:29:48.637070+0000","last_became_peered":"2024-05-08T18:29:48.637070+0000","last_unstale":"2024-05-08T18:33:01.696140+0000","last_undegraded":"2024-05-08T18:33:01.696140+0000","last_fullsized":"2024-05-08T18:33:01.696140+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'105","last_scrub_stamp":"2024-05-08T18:33:01.696035+0000","last_deep_scrub":"116'105","last_deep_scrub_stamp":"2024-05-08T18:33:01.696035+0000","last_clean_scrub_stamp":"2024-05-08T18:33:01.696035+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:36:00.801974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"84'10","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.861066+0000","last_change":"2024-05-08T18:29:50.691526+0000","last_active":"2024-05-08T18:32:46.861066+0000","last_peered":"2024-05-08T18:32:46.861066+0000","last_clean":"2024-05-08T18:32:46.861066+0000","last_became_active":"2024-05-08T18:29:50.690767+0000","last_became_peered":"2024-05-08T18:29:50.690767+0000","last_unstale":"2024-05-08T18:32:46.861066+0000","last_undegraded":"2024-05-08T18:32:46.861066+0000","last_fullsized":"2024-05-08T18:32:46.861066+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"97'16","reported_seq":238,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:14.445429+0000","last_change":"2024-05-08T18:33:14.445551+0000","last_active":"2024-05-08T18:33:14.445429+0000","last_peered":"2024-05-08T18:33:14.445429+0000","last_clean":"2024-05-08T18:33:14.445429+0000","last_became_active":"2024-05-08T18:29:42.560861+0000","last_became_peered":"2024-05-08T18:29:42.560861+0000","last_unstale":"2024-05-08T18:33:14.445429+0000","last_undegraded":"2024-05-08T18:33:14.445429+0000","last_fullsized":"2024-05-08T18:33:14.445429+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'16","last_scrub_stamp":"2024-05-08T18:33:14.445116+0000","last_deep_scrub":"97'16","last_deep_scrub_stamp":"2024-05-08T18:33:14.445116+0000","last_clean_scrub_stamp":"2024-05-08T18:33:14.445116+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:27:50.185862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"116'18","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.131053+0000","last_change":"2024-05-08T18:29:40.550529+0000","last_active":"2024-05-08T18:32:57.131053+0000","last_peered":"2024-05-08T18:32:57.131053+0000","last_clean":"2024-05-08T18:32:57.131053+0000","last_became_active":"2024-05-08T18:29:40.550241+0000","last_became_peered":"2024-05-08T18:29:40.550241+0000","last_unstale":"2024-05-08T18:32:57.131053+0000","last_undegraded":"2024-05-08T18:32:57.131053+0000","last_fullsized":"2024-05-08T18:32:57.131053+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:12.522977+0000","last_change":"2024-05-08T18:33:12.523030+0000","last_active":"2024-05-08T18:33:12.522977+0000","last_peered":"2024-05-08T18:33:12.522977+0000","last_clean":"2024-05-08T18:33:12.522977+0000","last_became_active":"2024-05-08T18:29:34.492891+0000","last_became_peered":"2024-05-08T18:29:34.492891+0000","last_unstale":"2024-05-08T18:33:12.522977+0000","last_undegraded":"2024-05-08T18:33:12.522977+0000","last_fullsized":"2024-05-08T18:33:12.522977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:12.522775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:12.522775+0000","last_clean_scrub_stamp":"2024-05-08T18:33:12.522775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:55:44.584704+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:19.920072+0000","last_change":"2024-05-08T18:33:19.920125+0000","last_active":"2024-05-08T18:33:19.920072+0000","last_peered":"2024-05-08T18:33:19.920072+0000","last_clean":"2024-05-08T18:33:19.920072+0000","last_became_active":"2024-05-08T18:29:44.589471+0000","last_became_peered":"2024-05-08T18:29:44.589471+0000","last_unstale":"2024-05-08T18:33:19.920072+0000","last_undegraded":"2024-05-08T18:33:19.920072+0000","last_fullsized":"2024-05-08T18:33:19.920072+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:19.919859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:19.919859+0000","last_clean_scrub_stamp":"2024-05-08T18:33:19.919859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:39:22.835248+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"116'51","reported_seq":271,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:19.807262+0000","last_change":"2024-05-08T18:33:19.807344+0000","last_active":"2024-05-08T18:33:19.807262+0000","last_peered":"2024-05-08T18:33:19.807262+0000","last_clean":"2024-05-08T18:33:19.807262+0000","last_became_active":"2024-05-08T18:29:46.605693+0000","last_became_peered":"2024-05-08T18:29:46.605693+0000","last_unstale":"2024-05-08T18:33:19.807262+0000","last_undegraded":"2024-05-08T18:33:19.807262+0000","last_fullsized":"2024-05-08T18:33:19.807262+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'51","last_scrub_stamp":"2024-05-08T18:33:19.807007+0000","last_deep_scrub":"116'51","last_deep_scrub_stamp":"2024-05-08T18:33:19.807007+0000","last_clean_scrub_stamp":"2024-05-08T18:33:19.807007+0000","objects_scrubbed":8,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:11:19.528781+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":57,"num_read_kb":43,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:04.773213+0000","last_change":"2024-05-08T18:33:04.773271+0000","last_active":"2024-05-08T18:33:04.773213+0000","last_peered":"2024-05-08T18:33:04.773213+0000","last_clean":"2024-05-08T18:33:04.773213+0000","last_became_active":"2024-05-08T18:29:48.633607+0000","last_became_peered":"2024-05-08T18:29:48.633607+0000","last_unstale":"2024-05-08T18:33:04.773213+0000","last_undegraded":"2024-05-08T18:33:04.773213+0000","last_fullsized":"2024-05-08T18:33:04.773213+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:04.773014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:04.773014+0000","last_clean_scrub_stamp":"2024-05-08T18:33:04.773014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:24:24.320241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.079589+0000","last_change":"2024-05-08T18:29:50.685494+0000","last_active":"2024-05-08T18:32:47.079589+0000","last_peered":"2024-05-08T18:32:47.079589+0000","last_clean":"2024-05-08T18:32:47.079589+0000","last_became_active":"2024-05-08T18:29:50.684818+0000","last_became_peered":"2024-05-08T18:29:50.684818+0000","last_unstale":"2024-05-08T18:32:47.079589+0000","last_undegraded":"2024-05-08T18:32:47.079589+0000","last_fullsized":"2024-05-08T18:32:47.079589+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863435+0000","last_change":"2024-05-08T18:29:50.682937+0000","last_active":"2024-05-08T18:32:46.863435+0000","last_peered":"2024-05-08T18:32:46.863435+0000","last_clean":"2024-05-08T18:32:46.863435+0000","last_became_active":"2024-05-08T18:29:50.681771+0000","last_became_peered":"2024-05-08T18:29:50.681771+0000","last_unstale":"2024-05-08T18:32:46.863435+0000","last_undegraded":"2024-05-08T18:32:46.863435+0000","last_fullsized":"2024-05-08T18:32:46.863435+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"84'4","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:11.516666+0000","last_change":"2024-05-08T18:33:11.516848+0000","last_active":"2024-05-08T18:33:11.516666+0000","last_peered":"2024-05-08T18:33:11.516666+0000","last_clean":"2024-05-08T18:33:11.516666+0000","last_became_active":"2024-05-08T18:29:42.574877+0000","last_became_peered":"2024-05-08T18:29:42.574877+0000","last_unstale":"2024-05-08T18:33:11.516666+0000","last_undegraded":"2024-05-08T18:33:11.516666+0000","last_fullsized":"2024-05-08T18:33:11.516666+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'4","last_scrub_stamp":"2024-05-08T18:33:11.516428+0000","last_deep_scrub":"84'4","last_deep_scrub_stamp":"2024-05-08T18:33:11.516428+0000","last_clean_scrub_stamp":"2024-05-08T18:33:11.516428+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:04:19.950937+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"116'22","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.171531+0000","last_change":"2024-05-08T18:29:40.566496+0000","last_active":"2024-05-08T18:32:57.171531+0000","last_peered":"2024-05-08T18:32:57.171531+0000","last_clean":"2024-05-08T18:32:57.171531+0000","last_became_active":"2024-05-08T18:29:40.565874+0000","last_became_peered":"2024-05-08T18:29:40.565874+0000","last_unstale":"2024-05-08T18:32:57.171531+0000","last_undegraded":"2024-05-08T18:32:57.171531+0000","last_fullsized":"2024-05-08T18:32:57.171531+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:04.850748+0000","last_change":"2024-05-08T18:33:04.850805+0000","last_active":"2024-05-08T18:33:04.850748+0000","last_peered":"2024-05-08T18:33:04.850748+0000","last_clean":"2024-05-08T18:33:04.850748+0000","last_became_active":"2024-05-08T18:29:44.594286+0000","last_became_peered":"2024-05-08T18:29:44.594286+0000","last_unstale":"2024-05-08T18:33:04.850748+0000","last_undegraded":"2024-05-08T18:33:04.850748+0000","last_fullsized":"2024-05-08T18:33:04.850748+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:04.850525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:04.850525+0000","last_clean_scrub_stamp":"2024-05-08T18:33:04.850525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:01:58.648413+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"116'21","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:56.949267+0000","last_change":"2024-05-08T18:29:46.591009+0000","last_active":"2024-05-08T18:32:56.949267+0000","last_peered":"2024-05-08T18:32:56.949267+0000","last_clean":"2024-05-08T18:32:56.949267+0000","last_became_active":"2024-05-08T18:29:46.588810+0000","last_became_peered":"2024-05-08T18:29:46.588810+0000","last_unstale":"2024-05-08T18:32:56.949267+0000","last_undegraded":"2024-05-08T18:32:56.949267+0000","last_fullsized":"2024-05-08T18:32:56.949267+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:03.743861+0000","last_change":"2024-05-08T18:33:03.743896+0000","last_active":"2024-05-08T18:33:03.743861+0000","last_peered":"2024-05-08T18:33:03.743861+0000","last_clean":"2024-05-08T18:33:03.743861+0000","last_became_active":"2024-05-08T18:29:48.633866+0000","last_became_peered":"2024-05-08T18:29:48.633866+0000","last_unstale":"2024-05-08T18:33:03.743861+0000","last_undegraded":"2024-05-08T18:33:03.743861+0000","last_fullsized":"2024-05-08T18:33:03.743861+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:03.743733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:03.743733+0000","last_clean_scrub_stamp":"2024-05-08T18:33:03.743733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:01:58.619258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"83'16","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.065966+0000","last_change":"2024-05-08T18:29:50.693408+0000","last_active":"2024-05-08T18:32:46.065966+0000","last_peered":"2024-05-08T18:32:46.065966+0000","last_clean":"2024-05-08T18:32:46.065966+0000","last_became_active":"2024-05-08T18:29:50.692687+0000","last_became_peered":"2024-05-08T18:29:50.692687+0000","last_unstale":"2024-05-08T18:32:46.065966+0000","last_undegraded":"2024-05-08T18:32:46.065966+0000","last_fullsized":"2024-05-08T18:32:46.065966+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":28,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"83'6","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:03.863340+0000","last_change":"2024-05-08T18:33:03.863365+0000","last_active":"2024-05-08T18:33:03.863340+0000","last_peered":"2024-05-08T18:33:03.863340+0000","last_clean":"2024-05-08T18:33:03.863340+0000","last_became_active":"2024-05-08T18:29:42.580887+0000","last_became_peered":"2024-05-08T18:29:42.580887+0000","last_unstale":"2024-05-08T18:33:03.863340+0000","last_undegraded":"2024-05-08T18:33:03.863340+0000","last_fullsized":"2024-05-08T18:33:03.863340+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'6","last_scrub_stamp":"2024-05-08T18:33:03.863262+0000","last_deep_scrub":"83'6","last_deep_scrub_stamp":"2024-05-08T18:33:03.863262+0000","last_clean_scrub_stamp":"2024-05-08T18:33:03.863262+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:16:10.334188+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"116'14","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:16.799292+0000","last_change":"2024-05-08T18:33:16.799353+0000","last_active":"2024-05-08T18:33:16.799292+0000","last_peered":"2024-05-08T18:33:16.799292+0000","last_clean":"2024-05-08T18:33:16.799292+0000","last_became_active":"2024-05-08T18:29:40.572079+0000","last_became_peered":"2024-05-08T18:29:40.572079+0000","last_unstale":"2024-05-08T18:33:16.799292+0000","last_undegraded":"2024-05-08T18:33:16.799292+0000","last_fullsized":"2024-05-08T18:33:16.799292+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'14","last_scrub_stamp":"2024-05-08T18:33:16.799068+0000","last_deep_scrub":"116'14","last_deep_scrub_stamp":"2024-05-08T18:33:16.799068+0000","last_clean_scrub_stamp":"2024-05-08T18:33:16.799068+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:35:39.535106+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:15.839987+0000","last_change":"2024-05-08T18:33:15.840086+0000","last_active":"2024-05-08T18:33:15.839987+0000","last_peered":"2024-05-08T18:33:15.839987+0000","last_clean":"2024-05-08T18:33:15.839987+0000","last_became_active":"2024-05-08T18:29:44.580805+0000","last_became_peered":"2024-05-08T18:29:44.580805+0000","last_unstale":"2024-05-08T18:33:15.839987+0000","last_undegraded":"2024-05-08T18:33:15.839987+0000","last_fullsized":"2024-05-08T18:33:15.839987+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:15.839695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:15.839695+0000","last_clean_scrub_stamp":"2024-05-08T18:33:15.839695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:07:53.998183+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"116'8","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:07.889630+0000","last_change":"2024-05-08T18:33:07.889705+0000","last_active":"2024-05-08T18:33:07.889630+0000","last_peered":"2024-05-08T18:33:07.889630+0000","last_clean":"2024-05-08T18:33:07.889630+0000","last_became_active":"2024-05-08T18:29:46.599789+0000","last_became_peered":"2024-05-08T18:29:46.599789+0000","last_unstale":"2024-05-08T18:33:07.889630+0000","last_undegraded":"2024-05-08T18:33:07.889630+0000","last_fullsized":"2024-05-08T18:33:07.889630+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'8","last_scrub_stamp":"2024-05-08T18:33:07.889455+0000","last_deep_scrub":"116'8","last_deep_scrub_stamp":"2024-05-08T18:33:07.889455+0000","last_clean_scrub_stamp":"2024-05-08T18:33:07.889455+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:51:04.569065+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.936132+0000","last_change":"2024-05-08T18:29:48.642994+0000","last_active":"2024-05-08T18:32:46.936132+0000","last_peered":"2024-05-08T18:32:46.936132+0000","last_clean":"2024-05-08T18:32:46.936132+0000","last_became_active":"2024-05-08T18:29:48.642056+0000","last_became_peered":"2024-05-08T18:29:48.642056+0000","last_unstale":"2024-05-08T18:32:46.936132+0000","last_undegraded":"2024-05-08T18:32:46.936132+0000","last_fullsized":"2024-05-08T18:32:46.936132+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.863215+0000","last_change":"2024-05-08T18:29:50.672513+0000","last_active":"2024-05-08T18:32:46.863215+0000","last_peered":"2024-05-08T18:32:46.863215+0000","last_clean":"2024-05-08T18:32:46.863215+0000","last_became_active":"2024-05-08T18:29:50.671781+0000","last_became_peered":"2024-05-08T18:29:50.671781+0000","last_unstale":"2024-05-08T18:32:46.863215+0000","last_undegraded":"2024-05-08T18:32:46.863215+0000","last_fullsized":"2024-05-08T18:32:46.863215+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"97'2","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:12.704906+0000","last_change":"2024-05-08T18:33:12.704969+0000","last_active":"2024-05-08T18:33:12.704906+0000","last_peered":"2024-05-08T18:33:12.704906+0000","last_clean":"2024-05-08T18:33:12.704906+0000","last_became_active":"2024-05-08T18:29:42.576379+0000","last_became_peered":"2024-05-08T18:29:42.576379+0000","last_unstale":"2024-05-08T18:33:12.704906+0000","last_undegraded":"2024-05-08T18:33:12.704906+0000","last_fullsized":"2024-05-08T18:33:12.704906+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'2","last_scrub_stamp":"2024-05-08T18:33:12.704698+0000","last_deep_scrub":"97'2","last_deep_scrub_stamp":"2024-05-08T18:33:12.704698+0000","last_clean_scrub_stamp":"2024-05-08T18:33:12.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:39.541544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"116'24","reported_seq":221,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.177243+0000","last_change":"2024-05-08T18:29:40.542997+0000","last_active":"2024-05-08T18:32:57.177243+0000","last_peered":"2024-05-08T18:32:57.177243+0000","last_clean":"2024-05-08T18:32:57.177243+0000","last_became_active":"2024-05-08T18:29:40.542239+0000","last_became_peered":"2024-05-08T18:29:40.542239+0000","last_unstale":"2024-05-08T18:32:57.177243+0000","last_undegraded":"2024-05-08T18:32:57.177243+0000","last_fullsized":"2024-05-08T18:32:57.177243+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":24,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:11.865055+0000","last_change":"2024-05-08T18:33:11.865207+0000","last_active":"2024-05-08T18:33:11.865055+0000","last_peered":"2024-05-08T18:33:11.865055+0000","last_clean":"2024-05-08T18:33:11.865055+0000","last_became_active":"2024-05-08T18:29:44.592476+0000","last_became_peered":"2024-05-08T18:29:44.592476+0000","last_unstale":"2024-05-08T18:33:11.865055+0000","last_undegraded":"2024-05-08T18:33:11.865055+0000","last_fullsized":"2024-05-08T18:33:11.865055+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:11.864822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:11.864822+0000","last_clean_scrub_stamp":"2024-05-08T18:33:11.864822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:04:20.299330+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"116'24","reported_seq":230,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:10.770915+0000","last_change":"2024-05-08T18:33:10.771004+0000","last_active":"2024-05-08T18:33:10.770915+0000","last_peered":"2024-05-08T18:33:10.770915+0000","last_clean":"2024-05-08T18:33:10.770915+0000","last_became_active":"2024-05-08T18:29:46.596452+0000","last_became_peered":"2024-05-08T18:29:46.596452+0000","last_unstale":"2024-05-08T18:33:10.770915+0000","last_undegraded":"2024-05-08T18:33:10.770915+0000","last_fullsized":"2024-05-08T18:33:10.770915+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'24","last_scrub_stamp":"2024-05-08T18:33:10.770722+0000","last_deep_scrub":"116'24","last_deep_scrub_stamp":"2024-05-08T18:33:10.770722+0000","last_clean_scrub_stamp":"2024-05-08T18:33:10.770722+0000","objects_scrubbed":5,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:49:54.138164+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":187,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:20.679900+0000","last_change":"2024-05-08T18:33:20.679959+0000","last_active":"2024-05-08T18:33:20.679900+0000","last_peered":"2024-05-08T18:33:20.679900+0000","last_clean":"2024-05-08T18:33:20.679900+0000","last_became_active":"2024-05-08T18:29:48.634704+0000","last_became_peered":"2024-05-08T18:29:48.634704+0000","last_unstale":"2024-05-08T18:33:20.679900+0000","last_undegraded":"2024-05-08T18:33:20.679900+0000","last_fullsized":"2024-05-08T18:33:20.679900+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:20.679686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:20.679686+0000","last_clean_scrub_stamp":"2024-05-08T18:33:20.679686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:09:41.555781+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"83'2","reported_seq":180,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.079266+0000","last_change":"2024-05-08T18:29:50.687974+0000","last_active":"2024-05-08T18:32:47.079266+0000","last_peered":"2024-05-08T18:32:47.079266+0000","last_clean":"2024-05-08T18:32:47.079266+0000","last_became_active":"2024-05-08T18:29:50.687045+0000","last_became_peered":"2024-05-08T18:29:50.687045+0000","last_unstale":"2024-05-08T18:32:47.079266+0000","last_undegraded":"2024-05-08T18:32:47.079266+0000","last_fullsized":"2024-05-08T18:32:47.079266+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"97'4","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.063787+0000","last_change":"2024-05-08T18:30:20.850226+0000","last_active":"2024-05-08T18:32:46.063787+0000","last_peered":"2024-05-08T18:32:46.063787+0000","last_clean":"2024-05-08T18:32:46.063787+0000","last_became_active":"2024-05-08T18:30:20.849751+0000","last_became_peered":"2024-05-08T18:30:20.849751+0000","last_unstale":"2024-05-08T18:32:46.063787+0000","last_undegraded":"2024-05-08T18:32:46.063787+0000","last_fullsized":"2024-05-08T18:32:46.063787+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"116'26","reported_seq":224,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.173288+0000","last_change":"2024-05-08T18:29:40.541112+0000","last_active":"2024-05-08T18:32:57.173288+0000","last_peered":"2024-05-08T18:32:57.173288+0000","last_clean":"2024-05-08T18:32:57.173288+0000","last_became_active":"2024-05-08T18:29:40.540835+0000","last_became_peered":"2024-05-08T18:29:40.540835+0000","last_unstale":"2024-05-08T18:32:57.173288+0000","last_undegraded":"2024-05-08T18:32:57.173288+0000","last_fullsized":"2024-05-08T18:32:57.173288+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":26,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.623257+0000","last_change":"2024-05-08T18:33:06.623312+0000","last_active":"2024-05-08T18:33:06.623257+0000","last_peered":"2024-05-08T18:33:06.623257+0000","last_clean":"2024-05-08T18:33:06.623257+0000","last_became_active":"2024-05-08T18:29:44.590454+0000","last_became_peered":"2024-05-08T18:29:44.590454+0000","last_unstale":"2024-05-08T18:33:06.623257+0000","last_undegraded":"2024-05-08T18:33:06.623257+0000","last_fullsized":"2024-05-08T18:33:06.623257+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:06.623034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:06.623034+0000","last_clean_scrub_stamp":"2024-05-08T18:33:06.623034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:26:10.851953+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"116'18","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.197603+0000","last_change":"2024-05-08T18:29:46.607002+0000","last_active":"2024-05-08T18:32:57.197603+0000","last_peered":"2024-05-08T18:32:57.197603+0000","last_clean":"2024-05-08T18:32:57.197603+0000","last_became_active":"2024-05-08T18:29:46.606172+0000","last_became_peered":"2024-05-08T18:29:46.606172+0000","last_unstale":"2024-05-08T18:32:57.197603+0000","last_undegraded":"2024-05-08T18:32:57.197603+0000","last_fullsized":"2024-05-08T18:32:57.197603+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:00.946595+0000","last_change":"2024-05-08T18:33:00.946620+0000","last_active":"2024-05-08T18:33:00.946595+0000","last_peered":"2024-05-08T18:33:00.946595+0000","last_clean":"2024-05-08T18:33:00.946595+0000","last_became_active":"2024-05-08T18:29:48.631219+0000","last_became_peered":"2024-05-08T18:29:48.631219+0000","last_unstale":"2024-05-08T18:33:00.946595+0000","last_undegraded":"2024-05-08T18:33:00.946595+0000","last_fullsized":"2024-05-08T18:33:00.946595+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:00.946504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:00.946504+0000","last_clean_scrub_stamp":"2024-05-08T18:33:00.946504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:43:13.162227+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.642050+0000","last_change":"2024-05-08T18:33:05.642167+0000","last_active":"2024-05-08T18:33:05.642050+0000","last_peered":"2024-05-08T18:33:05.642050+0000","last_clean":"2024-05-08T18:33:05.642050+0000","last_became_active":"2024-05-08T18:29:42.569425+0000","last_became_peered":"2024-05-08T18:29:42.569425+0000","last_unstale":"2024-05-08T18:33:05.642050+0000","last_undegraded":"2024-05-08T18:33:05.642050+0000","last_fullsized":"2024-05-08T18:33:05.642050+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:05.641829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:05.641829+0000","last_clean_scrub_stamp":"2024-05-08T18:33:05.641829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:00.182094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"116'16","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.151644+0000","last_change":"2024-05-08T18:29:40.547711+0000","last_active":"2024-05-08T18:32:57.151644+0000","last_peered":"2024-05-08T18:32:57.151644+0000","last_clean":"2024-05-08T18:32:57.151644+0000","last_became_active":"2024-05-08T18:29:40.547479+0000","last_became_peered":"2024-05-08T18:29:40.547479+0000","last_unstale":"2024-05-08T18:32:57.151644+0000","last_undegraded":"2024-05-08T18:32:57.151644+0000","last_fullsized":"2024-05-08T18:32:57.151644+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:14.912267+0000","last_change":"2024-05-08T18:33:14.912371+0000","last_active":"2024-05-08T18:33:14.912267+0000","last_peered":"2024-05-08T18:33:14.912267+0000","last_clean":"2024-05-08T18:33:14.912267+0000","last_became_active":"2024-05-08T18:29:44.590498+0000","last_became_peered":"2024-05-08T18:29:44.590498+0000","last_unstale":"2024-05-08T18:33:14.912267+0000","last_undegraded":"2024-05-08T18:33:14.912267+0000","last_fullsized":"2024-05-08T18:33:14.912267+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:14.911981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:14.911981+0000","last_clean_scrub_stamp":"2024-05-08T18:33:14.911981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:08:31.260871+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"116'34","reported_seq":249,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:08.863245+0000","last_change":"2024-05-08T18:33:08.863393+0000","last_active":"2024-05-08T18:33:08.863245+0000","last_peered":"2024-05-08T18:33:08.863245+0000","last_clean":"2024-05-08T18:33:08.863245+0000","last_became_active":"2024-05-08T18:29:46.594672+0000","last_became_peered":"2024-05-08T18:29:46.594672+0000","last_unstale":"2024-05-08T18:33:08.863245+0000","last_undegraded":"2024-05-08T18:33:08.863245+0000","last_fullsized":"2024-05-08T18:33:08.863245+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'34","last_scrub_stamp":"2024-05-08T18:33:08.863016+0000","last_deep_scrub":"116'34","last_deep_scrub_stamp":"2024-05-08T18:33:08.863016+0000","last_clean_scrub_stamp":"2024-05-08T18:33:08.863016+0000","objects_scrubbed":5,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:25:58.925047+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":28,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":181,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.079372+0000","last_change":"2024-05-08T18:29:48.639840+0000","last_active":"2024-05-08T18:32:47.079372+0000","last_peered":"2024-05-08T18:32:47.079372+0000","last_clean":"2024-05-08T18:32:47.079372+0000","last_became_active":"2024-05-08T18:29:48.639120+0000","last_became_peered":"2024-05-08T18:29:48.639120+0000","last_unstale":"2024-05-08T18:32:47.079372+0000","last_undegraded":"2024-05-08T18:32:47.079372+0000","last_fullsized":"2024-05-08T18:32:47.079372+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"84'2","reported_seq":189,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:09.807214+0000","last_change":"2024-05-08T18:33:09.807280+0000","last_active":"2024-05-08T18:33:09.807214+0000","last_peered":"2024-05-08T18:33:09.807214+0000","last_clean":"2024-05-08T18:33:09.807214+0000","last_became_active":"2024-05-08T18:29:50.684119+0000","last_became_peered":"2024-05-08T18:29:50.684119+0000","last_unstale":"2024-05-08T18:33:09.807214+0000","last_undegraded":"2024-05-08T18:33:09.807214+0000","last_fullsized":"2024-05-08T18:33:09.807214+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'2","last_scrub_stamp":"2024-05-08T18:33:09.807009+0000","last_deep_scrub":"84'2","last_deep_scrub_stamp":"2024-05-08T18:33:09.807009+0000","last_clean_scrub_stamp":"2024-05-08T18:33:09.807009+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:08:54.871793+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"80'2","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:12.823461+0000","last_change":"2024-05-08T18:33:12.823521+0000","last_active":"2024-05-08T18:33:12.823461+0000","last_peered":"2024-05-08T18:33:12.823461+0000","last_clean":"2024-05-08T18:33:12.823461+0000","last_became_active":"2024-05-08T18:29:42.575450+0000","last_became_peered":"2024-05-08T18:29:42.575450+0000","last_unstale":"2024-05-08T18:33:12.823461+0000","last_undegraded":"2024-05-08T18:33:12.823461+0000","last_fullsized":"2024-05-08T18:33:12.823461+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2","last_scrub_stamp":"2024-05-08T18:33:12.823265+0000","last_deep_scrub":"80'2","last_deep_scrub_stamp":"2024-05-08T18:33:12.823265+0000","last_clean_scrub_stamp":"2024-05-08T18:33:12.823265+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:39.660112+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"116'20","reported_seq":228,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:19.821539+0000","last_change":"2024-05-08T18:33:19.821600+0000","last_active":"2024-05-08T18:33:19.821539+0000","last_peered":"2024-05-08T18:33:19.821539+0000","last_clean":"2024-05-08T18:33:19.821539+0000","last_became_active":"2024-05-08T18:29:40.545814+0000","last_became_peered":"2024-05-08T18:29:40.545814+0000","last_unstale":"2024-05-08T18:33:19.821539+0000","last_undegraded":"2024-05-08T18:33:19.821539+0000","last_fullsized":"2024-05-08T18:33:19.821539+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'20","last_scrub_stamp":"2024-05-08T18:33:19.821340+0000","last_deep_scrub":"116'20","last_deep_scrub_stamp":"2024-05-08T18:33:19.821340+0000","last_clean_scrub_stamp":"2024-05-08T18:33:19.821340+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:13:44.745049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:04.613824+0000","last_change":"2024-05-08T18:33:04.613945+0000","last_active":"2024-05-08T18:33:04.613824+0000","last_peered":"2024-05-08T18:33:04.613824+0000","last_clean":"2024-05-08T18:33:04.613824+0000","last_became_active":"2024-05-08T18:29:44.590394+0000","last_became_peered":"2024-05-08T18:29:44.590394+0000","last_unstale":"2024-05-08T18:33:04.613824+0000","last_undegraded":"2024-05-08T18:33:04.613824+0000","last_fullsized":"2024-05-08T18:33:04.613824+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:04.613567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:04.613567+0000","last_clean_scrub_stamp":"2024-05-08T18:33:04.613567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:16:36.059115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"116'30","reported_seq":235,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:15.801699+0000","last_change":"2024-05-08T18:33:15.801788+0000","last_active":"2024-05-08T18:33:15.801699+0000","last_peered":"2024-05-08T18:33:15.801699+0000","last_clean":"2024-05-08T18:33:15.801699+0000","last_became_active":"2024-05-08T18:29:46.604917+0000","last_became_peered":"2024-05-08T18:29:46.604917+0000","last_unstale":"2024-05-08T18:33:15.801699+0000","last_undegraded":"2024-05-08T18:33:15.801699+0000","last_fullsized":"2024-05-08T18:33:15.801699+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'30","last_scrub_stamp":"2024-05-08T18:33:15.801482+0000","last_deep_scrub":"116'30","last_deep_scrub_stamp":"2024-05-08T18:33:15.801482+0000","last_clean_scrub_stamp":"2024-05-08T18:33:15.801482+0000","objects_scrubbed":7,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:10:20.396630+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":184,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.918826+0000","last_change":"2024-05-08T18:29:48.644420+0000","last_active":"2024-05-08T18:32:46.918826+0000","last_peered":"2024-05-08T18:32:46.918826+0000","last_clean":"2024-05-08T18:32:46.918826+0000","last_became_active":"2024-05-08T18:29:48.643493+0000","last_became_peered":"2024-05-08T18:29:48.643493+0000","last_unstale":"2024-05-08T18:32:46.918826+0000","last_undegraded":"2024-05-08T18:32:46.918826+0000","last_fullsized":"2024-05-08T18:32:46.918826+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":175,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.848786+0000","last_change":"2024-05-08T18:29:50.687485+0000","last_active":"2024-05-08T18:32:46.848786+0000","last_peered":"2024-05-08T18:32:46.848786+0000","last_clean":"2024-05-08T18:32:46.848786+0000","last_became_active":"2024-05-08T18:29:50.686750+0000","last_became_peered":"2024-05-08T18:29:50.686750+0000","last_unstale":"2024-05-08T18:32:46.848786+0000","last_undegraded":"2024-05-08T18:32:46.848786+0000","last_fullsized":"2024-05-08T18:32:46.848786+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"97'4","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:16.872227+0000","last_change":"2024-05-08T18:33:16.872286+0000","last_active":"2024-05-08T18:33:16.872227+0000","last_peered":"2024-05-08T18:33:16.872227+0000","last_clean":"2024-05-08T18:33:16.872227+0000","last_became_active":"2024-05-08T18:29:42.563695+0000","last_became_peered":"2024-05-08T18:29:42.563695+0000","last_unstale":"2024-05-08T18:33:16.872227+0000","last_undegraded":"2024-05-08T18:33:16.872227+0000","last_fullsized":"2024-05-08T18:33:16.872227+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'4","last_scrub_stamp":"2024-05-08T18:33:16.872024+0000","last_deep_scrub":"97'4","last_deep_scrub_stamp":"2024-05-08T18:33:16.872024+0000","last_clean_scrub_stamp":"2024-05-08T18:33:16.872024+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:43:07.312322+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"116'20","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.154107+0000","last_change":"2024-05-08T18:29:40.545512+0000","last_active":"2024-05-08T18:32:57.154107+0000","last_peered":"2024-05-08T18:32:57.154107+0000","last_clean":"2024-05-08T18:32:57.154107+0000","last_became_active":"2024-05-08T18:29:40.544216+0000","last_became_peered":"2024-05-08T18:29:40.544216+0000","last_unstale":"2024-05-08T18:32:57.154107+0000","last_undegraded":"2024-05-08T18:32:57.154107+0000","last_fullsized":"2024-05-08T18:32:57.154107+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:17.484593+0000","last_change":"2024-05-08T18:33:17.484650+0000","last_active":"2024-05-08T18:33:17.484593+0000","last_peered":"2024-05-08T18:33:17.484593+0000","last_clean":"2024-05-08T18:33:17.484593+0000","last_became_active":"2024-05-08T18:29:44.575344+0000","last_became_peered":"2024-05-08T18:29:44.575344+0000","last_unstale":"2024-05-08T18:33:17.484593+0000","last_undegraded":"2024-05-08T18:33:17.484593+0000","last_fullsized":"2024-05-08T18:33:17.484593+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:17.484366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:17.484366+0000","last_clean_scrub_stamp":"2024-05-08T18:33:17.484366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:58:12.466927+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"116'20","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:56.964869+0000","last_change":"2024-05-08T18:29:46.584785+0000","last_active":"2024-05-08T18:32:56.964869+0000","last_peered":"2024-05-08T18:32:56.964869+0000","last_clean":"2024-05-08T18:32:56.964869+0000","last_became_active":"2024-05-08T18:29:46.583390+0000","last_became_peered":"2024-05-08T18:29:46.583390+0000","last_unstale":"2024-05-08T18:32:56.964869+0000","last_undegraded":"2024-05-08T18:32:56.964869+0000","last_fullsized":"2024-05-08T18:32:56.964869+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:45.561744+0000","last_clean_scrub_stamp":"2024-05-08T18:29:45.561744+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":184,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.919338+0000","last_change":"2024-05-08T18:29:48.643558+0000","last_active":"2024-05-08T18:32:46.919338+0000","last_peered":"2024-05-08T18:32:46.919338+0000","last_clean":"2024-05-08T18:32:46.919338+0000","last_became_active":"2024-05-08T18:29:48.642773+0000","last_became_peered":"2024-05-08T18:29:48.642773+0000","last_unstale":"2024-05-08T18:32:46.919338+0000","last_undegraded":"2024-05-08T18:32:46.919338+0000","last_fullsized":"2024-05-08T18:32:46.919338+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":177,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:47.078500+0000","last_change":"2024-05-08T18:29:50.674796+0000","last_active":"2024-05-08T18:32:47.078500+0000","last_peered":"2024-05-08T18:32:47.078500+0000","last_clean":"2024-05-08T18:32:47.078500+0000","last_became_active":"2024-05-08T18:29:50.674057+0000","last_became_peered":"2024-05-08T18:29:50.674057+0000","last_unstale":"2024-05-08T18:32:47.078500+0000","last_undegraded":"2024-05-08T18:32:47.078500+0000","last_fullsized":"2024-05-08T18:32:47.078500+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"84'4","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:12.840235+0000","last_change":"2024-05-08T18:33:12.840300+0000","last_active":"2024-05-08T18:33:12.840235+0000","last_peered":"2024-05-08T18:33:12.840235+0000","last_clean":"2024-05-08T18:33:12.840235+0000","last_became_active":"2024-05-08T18:29:42.577275+0000","last_became_peered":"2024-05-08T18:29:42.577275+0000","last_unstale":"2024-05-08T18:33:12.840235+0000","last_undegraded":"2024-05-08T18:33:12.840235+0000","last_fullsized":"2024-05-08T18:33:12.840235+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'4","last_scrub_stamp":"2024-05-08T18:33:12.840024+0000","last_deep_scrub":"84'4","last_deep_scrub_stamp":"2024-05-08T18:33:12.840024+0000","last_clean_scrub_stamp":"2024-05-08T18:33:12.840024+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:22:36.970609+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"116'20","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.132951+0000","last_change":"2024-05-08T18:29:40.562873+0000","last_active":"2024-05-08T18:32:57.132951+0000","last_peered":"2024-05-08T18:32:57.132951+0000","last_clean":"2024-05-08T18:32:57.132951+0000","last_became_active":"2024-05-08T18:29:40.562594+0000","last_became_peered":"2024-05-08T18:29:40.562594+0000","last_unstale":"2024-05-08T18:32:57.132951+0000","last_undegraded":"2024-05-08T18:32:57.132951+0000","last_fullsized":"2024-05-08T18:32:57.132951+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:02.892497+0000","last_change":"2024-05-08T18:33:02.892518+0000","last_active":"2024-05-08T18:33:02.892497+0000","last_peered":"2024-05-08T18:33:02.892497+0000","last_clean":"2024-05-08T18:33:02.892497+0000","last_became_active":"2024-05-08T18:29:44.593398+0000","last_became_peered":"2024-05-08T18:29:44.593398+0000","last_unstale":"2024-05-08T18:33:02.892497+0000","last_undegraded":"2024-05-08T18:33:02.892497+0000","last_fullsized":"2024-05-08T18:33:02.892497+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:02.892415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:02.892415+0000","last_clean_scrub_stamp":"2024-05-08T18:33:02.892415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:22:27.022999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"116'19","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:04.642964+0000","last_change":"2024-05-08T18:33:04.643045+0000","last_active":"2024-05-08T18:33:04.642964+0000","last_peered":"2024-05-08T18:33:04.642964+0000","last_clean":"2024-05-08T18:33:04.642964+0000","last_became_active":"2024-05-08T18:29:46.601402+0000","last_became_peered":"2024-05-08T18:29:46.601402+0000","last_unstale":"2024-05-08T18:33:04.642964+0000","last_undegraded":"2024-05-08T18:33:04.642964+0000","last_fullsized":"2024-05-08T18:33:04.642964+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'19","last_scrub_stamp":"2024-05-08T18:33:04.642767+0000","last_deep_scrub":"116'19","last_deep_scrub_stamp":"2024-05-08T18:33:04.642767+0000","last_clean_scrub_stamp":"2024-05-08T18:33:04.642767+0000","objects_scrubbed":7,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:00:52.021694+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":22,"num_read_kb":17,"num_write":24,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3118,"num_omap_keys":14,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"116'105","reported_seq":333,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.204789+0000","last_change":"2024-05-08T18:29:48.635696+0000","last_active":"2024-05-08T18:32:57.204789+0000","last_peered":"2024-05-08T18:32:57.204789+0000","last_clean":"2024-05-08T18:32:57.204789+0000","last_became_active":"2024-05-08T18:29:48.634859+0000","last_became_peered":"2024-05-08T18:29:48.634859+0000","last_unstale":"2024-05-08T18:32:57.204789+0000","last_undegraded":"2024-05-08T18:32:57.204789+0000","last_fullsized":"2024-05-08T18:32:57.204789+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":175,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.935252+0000","last_change":"2024-05-08T18:29:50.679757+0000","last_active":"2024-05-08T18:32:46.935252+0000","last_peered":"2024-05-08T18:32:46.935252+0000","last_clean":"2024-05-08T18:32:46.935252+0000","last_became_active":"2024-05-08T18:29:50.679011+0000","last_became_peered":"2024-05-08T18:29:50.679011+0000","last_unstale":"2024-05-08T18:32:46.935252+0000","last_undegraded":"2024-05-08T18:32:46.935252+0000","last_fullsized":"2024-05-08T18:32:46.935252+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"84'8","reported_seq":224,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:16.487806+0000","last_change":"2024-05-08T18:33:16.487867+0000","last_active":"2024-05-08T18:33:16.487806+0000","last_peered":"2024-05-08T18:33:16.487806+0000","last_clean":"2024-05-08T18:33:16.487806+0000","last_became_active":"2024-05-08T18:29:42.559647+0000","last_became_peered":"2024-05-08T18:29:42.559647+0000","last_unstale":"2024-05-08T18:33:16.487806+0000","last_undegraded":"2024-05-08T18:33:16.487806+0000","last_fullsized":"2024-05-08T18:33:16.487806+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'8","last_scrub_stamp":"2024-05-08T18:33:16.487609+0000","last_deep_scrub":"84'8","last_deep_scrub_stamp":"2024-05-08T18:33:16.487609+0000","last_clean_scrub_stamp":"2024-05-08T18:33:16.487609+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:35:39.223647+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"116'20","reported_seq":225,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:19.115714+0000","last_change":"2024-05-08T18:33:19.115777+0000","last_active":"2024-05-08T18:33:19.115714+0000","last_peered":"2024-05-08T18:33:19.115714+0000","last_clean":"2024-05-08T18:33:19.115714+0000","last_became_active":"2024-05-08T18:29:40.556254+0000","last_became_peered":"2024-05-08T18:29:40.556254+0000","last_unstale":"2024-05-08T18:33:19.115714+0000","last_undegraded":"2024-05-08T18:33:19.115714+0000","last_fullsized":"2024-05-08T18:33:19.115714+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'20","last_scrub_stamp":"2024-05-08T18:33:19.115512+0000","last_deep_scrub":"116'20","last_deep_scrub_stamp":"2024-05-08T18:33:19.115512+0000","last_clean_scrub_stamp":"2024-05-08T18:33:19.115512+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:11:18.837286+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:09.923190+0000","last_change":"2024-05-08T18:33:09.923244+0000","last_active":"2024-05-08T18:33:09.923190+0000","last_peered":"2024-05-08T18:33:09.923190+0000","last_clean":"2024-05-08T18:33:09.923190+0000","last_became_active":"2024-05-08T18:29:44.593322+0000","last_became_peered":"2024-05-08T18:29:44.593322+0000","last_unstale":"2024-05-08T18:33:09.923190+0000","last_undegraded":"2024-05-08T18:33:09.923190+0000","last_fullsized":"2024-05-08T18:33:09.923190+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:09.922968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:09.922968+0000","last_clean_scrub_stamp":"2024-05-08T18:33:09.922968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:17:20.477717+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"116'32","reported_seq":239,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:03.096508+0000","last_change":"2024-05-08T18:33:03.096597+0000","last_active":"2024-05-08T18:33:03.096508+0000","last_peered":"2024-05-08T18:33:03.096508+0000","last_clean":"2024-05-08T18:33:03.096508+0000","last_became_active":"2024-05-08T18:29:46.603885+0000","last_became_peered":"2024-05-08T18:29:46.603885+0000","last_unstale":"2024-05-08T18:33:03.096508+0000","last_undegraded":"2024-05-08T18:33:03.096508+0000","last_fullsized":"2024-05-08T18:33:03.096508+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'32","last_scrub_stamp":"2024-05-08T18:33:03.096330+0000","last_deep_scrub":"116'32","last_deep_scrub_stamp":"2024-05-08T18:33:03.096330+0000","last_clean_scrub_stamp":"2024-05-08T18:33:03.096330+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:00:50.475257+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":37,"num_read_kb":44,"num_write":22,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.856211+0000","last_change":"2024-05-08T18:33:06.856265+0000","last_active":"2024-05-08T18:33:06.856211+0000","last_peered":"2024-05-08T18:33:06.856211+0000","last_clean":"2024-05-08T18:33:06.856211+0000","last_became_active":"2024-05-08T18:29:48.640046+0000","last_became_peered":"2024-05-08T18:29:48.640046+0000","last_unstale":"2024-05-08T18:33:06.856211+0000","last_undegraded":"2024-05-08T18:33:06.856211+0000","last_fullsized":"2024-05-08T18:33:06.856211+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:06.856012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:06.856012+0000","last_clean_scrub_stamp":"2024-05-08T18:33:06.856012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:46:46.459558+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"83'8","reported_seq":189,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.938572+0000","last_change":"2024-05-08T18:29:50.692688+0000","last_active":"2024-05-08T18:32:46.938572+0000","last_peered":"2024-05-08T18:32:46.938572+0000","last_clean":"2024-05-08T18:32:46.938572+0000","last_became_active":"2024-05-08T18:29:50.692123+0000","last_became_peered":"2024-05-08T18:29:50.692123+0000","last_unstale":"2024-05-08T18:32:46.938572+0000","last_undegraded":"2024-05-08T18:32:46.938572+0000","last_fullsized":"2024-05-08T18:32:46.938572+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"97'2","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:20.552469+0000","last_change":"2024-05-08T18:33:20.552530+0000","last_active":"2024-05-08T18:33:20.552469+0000","last_peered":"2024-05-08T18:33:20.552469+0000","last_clean":"2024-05-08T18:33:20.552469+0000","last_became_active":"2024-05-08T18:29:42.557570+0000","last_became_peered":"2024-05-08T18:29:42.557570+0000","last_unstale":"2024-05-08T18:33:20.552469+0000","last_undegraded":"2024-05-08T18:33:20.552469+0000","last_fullsized":"2024-05-08T18:33:20.552469+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'2","last_scrub_stamp":"2024-05-08T18:33:20.552269+0000","last_deep_scrub":"97'2","last_deep_scrub_stamp":"2024-05-08T18:33:20.552269+0000","last_clean_scrub_stamp":"2024-05-08T18:33:20.552269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:51.339225+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"116'4","reported_seq":201,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.176454+0000","last_change":"2024-05-08T18:29:40.537090+0000","last_active":"2024-05-08T18:32:57.176454+0000","last_peered":"2024-05-08T18:32:57.176454+0000","last_clean":"2024-05-08T18:32:57.176454+0000","last_became_active":"2024-05-08T18:29:40.536188+0000","last_became_peered":"2024-05-08T18:29:40.536188+0000","last_unstale":"2024-05-08T18:32:57.176454+0000","last_undegraded":"2024-05-08T18:32:57.176454+0000","last_fullsized":"2024-05-08T18:32:57.176454+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":197,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:16.171229+0000","last_change":"2024-05-08T18:33:16.171351+0000","last_active":"2024-05-08T18:33:16.171229+0000","last_peered":"2024-05-08T18:33:16.171229+0000","last_clean":"2024-05-08T18:33:16.171229+0000","last_became_active":"2024-05-08T18:29:44.578171+0000","last_became_peered":"2024-05-08T18:29:44.578171+0000","last_unstale":"2024-05-08T18:33:16.171229+0000","last_undegraded":"2024-05-08T18:33:16.171229+0000","last_fullsized":"2024-05-08T18:33:16.171229+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:16.170996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:16.170996+0000","last_clean_scrub_stamp":"2024-05-08T18:33:16.170996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:35:38.907034+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"116'23","reported_seq":228,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.875357+0000","last_change":"2024-05-08T18:33:05.875438+0000","last_active":"2024-05-08T18:33:05.875357+0000","last_peered":"2024-05-08T18:33:05.875357+0000","last_clean":"2024-05-08T18:33:05.875357+0000","last_became_active":"2024-05-08T18:29:46.603728+0000","last_became_peered":"2024-05-08T18:29:46.603728+0000","last_unstale":"2024-05-08T18:33:05.875357+0000","last_undegraded":"2024-05-08T18:33:05.875357+0000","last_fullsized":"2024-05-08T18:33:05.875357+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'23","last_scrub_stamp":"2024-05-08T18:33:05.875140+0000","last_deep_scrub":"116'23","last_deep_scrub_stamp":"2024-05-08T18:33:05.875140+0000","last_clean_scrub_stamp":"2024-05-08T18:33:05.875140+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:24:25.422367+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":179,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.848778+0000","last_change":"2024-05-08T18:29:48.635813+0000","last_active":"2024-05-08T18:32:46.848778+0000","last_peered":"2024-05-08T18:32:46.848778+0000","last_clean":"2024-05-08T18:32:46.848778+0000","last_became_active":"2024-05-08T18:29:48.634664+0000","last_became_peered":"2024-05-08T18:29:48.634664+0000","last_unstale":"2024-05-08T18:32:46.848778+0000","last_undegraded":"2024-05-08T18:32:46.848778+0000","last_fullsized":"2024-05-08T18:32:46.848778+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"97'7","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.066223+0000","last_change":"2024-05-08T18:29:50.687517+0000","last_active":"2024-05-08T18:32:46.066223+0000","last_peered":"2024-05-08T18:32:46.066223+0000","last_clean":"2024-05-08T18:32:46.066223+0000","last_became_active":"2024-05-08T18:29:50.686662+0000","last_became_peered":"2024-05-08T18:29:50.686662+0000","last_unstale":"2024-05-08T18:32:46.066223+0000","last_undegraded":"2024-05-08T18:32:46.066223+0000","last_fullsized":"2024-05-08T18:32:46.066223+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"97'4","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.062836+0000","last_change":"2024-05-08T18:29:42.558848+0000","last_active":"2024-05-08T18:32:46.062836+0000","last_peered":"2024-05-08T18:32:46.062836+0000","last_clean":"2024-05-08T18:32:46.062836+0000","last_became_active":"2024-05-08T18:29:42.558390+0000","last_became_peered":"2024-05-08T18:29:42.558390+0000","last_unstale":"2024-05-08T18:32:46.062836+0000","last_undegraded":"2024-05-08T18:32:46.062836+0000","last_fullsized":"2024-05-08T18:32:46.062836+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"116'14","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.155609+0000","last_change":"2024-05-08T18:29:40.567772+0000","last_active":"2024-05-08T18:32:57.155609+0000","last_peered":"2024-05-08T18:32:57.155609+0000","last_clean":"2024-05-08T18:32:57.155609+0000","last_became_active":"2024-05-08T18:29:40.567482+0000","last_became_peered":"2024-05-08T18:29:40.567482+0000","last_unstale":"2024-05-08T18:32:57.155609+0000","last_undegraded":"2024-05-08T18:32:57.155609+0000","last_fullsized":"2024-05-08T18:32:57.155609+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":5,"num_write":24,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.057332+0000","last_change":"2024-05-08T18:29:44.596876+0000","last_active":"2024-05-08T18:32:46.057332+0000","last_peered":"2024-05-08T18:32:46.057332+0000","last_clean":"2024-05-08T18:32:46.057332+0000","last_became_active":"2024-05-08T18:29:44.595712+0000","last_became_peered":"2024-05-08T18:29:44.595712+0000","last_unstale":"2024-05-08T18:32:46.057332+0000","last_undegraded":"2024-05-08T18:32:46.057332+0000","last_fullsized":"2024-05-08T18:32:46.057332+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:43.555558+0000","last_clean_scrub_stamp":"2024-05-08T18:29:43.555558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"116'15","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:08.788147+0000","last_change":"2024-05-08T18:33:08.788218+0000","last_active":"2024-05-08T18:33:08.788147+0000","last_peered":"2024-05-08T18:33:08.788147+0000","last_clean":"2024-05-08T18:33:08.788147+0000","last_became_active":"2024-05-08T18:29:46.597394+0000","last_became_peered":"2024-05-08T18:29:46.597394+0000","last_unstale":"2024-05-08T18:33:08.788147+0000","last_undegraded":"2024-05-08T18:33:08.788147+0000","last_fullsized":"2024-05-08T18:33:08.788147+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'15","last_scrub_stamp":"2024-05-08T18:33:08.787951+0000","last_deep_scrub":"116'15","last_deep_scrub_stamp":"2024-05-08T18:33:08.787951+0000","last_clean_scrub_stamp":"2024-05-08T18:33:08.787951+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:00:35.606964+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":13,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":184,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.057758+0000","last_change":"2024-05-08T18:29:48.642251+0000","last_active":"2024-05-08T18:32:46.057758+0000","last_peered":"2024-05-08T18:32:46.057758+0000","last_clean":"2024-05-08T18:32:46.057758+0000","last_became_active":"2024-05-08T18:29:48.641666+0000","last_became_peered":"2024-05-08T18:29:48.641666+0000","last_unstale":"2024-05-08T18:32:46.057758+0000","last_undegraded":"2024-05-08T18:32:46.057758+0000","last_fullsized":"2024-05-08T18:32:46.057758+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:47.589927+0000","last_clean_scrub_stamp":"2024-05-08T18:29:47.589927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"80'2","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.937776+0000","last_change":"2024-05-08T18:29:50.685668+0000","last_active":"2024-05-08T18:32:46.937776+0000","last_peered":"2024-05-08T18:32:46.937776+0000","last_clean":"2024-05-08T18:32:46.937776+0000","last_became_active":"2024-05-08T18:29:50.684958+0000","last_became_peered":"2024-05-08T18:29:50.684958+0000","last_unstale":"2024-05-08T18:32:46.937776+0000","last_undegraded":"2024-05-08T18:32:46.937776+0000","last_fullsized":"2024-05-08T18:32:46.937776+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:12.489733+0000","last_change":"2024-05-08T18:33:12.489788+0000","last_active":"2024-05-08T18:33:12.489733+0000","last_peered":"2024-05-08T18:33:12.489733+0000","last_clean":"2024-05-08T18:33:12.489733+0000","last_became_active":"2024-05-08T18:29:42.558871+0000","last_became_peered":"2024-05-08T18:29:42.558871+0000","last_unstale":"2024-05-08T18:33:12.489733+0000","last_undegraded":"2024-05-08T18:33:12.489733+0000","last_fullsized":"2024-05-08T18:33:12.489733+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:12.489544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:12.489544+0000","last_clean_scrub_stamp":"2024-05-08T18:33:12.489544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:59:53.448595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"116'26","reported_seq":224,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.177810+0000","last_change":"2024-05-08T18:29:40.541070+0000","last_active":"2024-05-08T18:32:57.177810+0000","last_peered":"2024-05-08T18:32:57.177810+0000","last_clean":"2024-05-08T18:32:57.177810+0000","last_became_active":"2024-05-08T18:29:40.540767+0000","last_became_peered":"2024-05-08T18:29:40.540767+0000","last_unstale":"2024-05-08T18:32:57.177810+0000","last_undegraded":"2024-05-08T18:32:57.177810+0000","last_fullsized":"2024-05-08T18:32:57.177810+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":26,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"116'2","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:01.923856+0000","last_change":"2024-05-08T18:33:01.923882+0000","last_active":"2024-05-08T18:33:01.923856+0000","last_peered":"2024-05-08T18:33:01.923856+0000","last_clean":"2024-05-08T18:33:01.923856+0000","last_became_active":"2024-05-08T18:29:44.592243+0000","last_became_peered":"2024-05-08T18:29:44.592243+0000","last_unstale":"2024-05-08T18:33:01.923856+0000","last_undegraded":"2024-05-08T18:33:01.923856+0000","last_fullsized":"2024-05-08T18:33:01.923856+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'2","last_scrub_stamp":"2024-05-08T18:33:01.923772+0000","last_deep_scrub":"116'2","last_deep_scrub_stamp":"2024-05-08T18:33:01.923772+0000","last_clean_scrub_stamp":"2024-05-08T18:33:01.923772+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:50:30.729203+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"116'22","reported_seq":229,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.619868+0000","last_change":"2024-05-08T18:33:05.619945+0000","last_active":"2024-05-08T18:33:05.619868+0000","last_peered":"2024-05-08T18:33:05.619868+0000","last_clean":"2024-05-08T18:33:05.619868+0000","last_became_active":"2024-05-08T18:29:46.609903+0000","last_became_peered":"2024-05-08T18:29:46.609903+0000","last_unstale":"2024-05-08T18:33:05.619868+0000","last_undegraded":"2024-05-08T18:33:05.619868+0000","last_fullsized":"2024-05-08T18:33:05.619868+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'22","last_scrub_stamp":"2024-05-08T18:33:05.619687+0000","last_deep_scrub":"116'22","last_deep_scrub_stamp":"2024-05-08T18:33:05.619687+0000","last_clean_scrub_stamp":"2024-05-08T18:33:05.619687+0000","objects_scrubbed":4,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:10.533517+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:03.881406+0000","last_change":"2024-05-08T18:33:03.881434+0000","last_active":"2024-05-08T18:33:03.881406+0000","last_peered":"2024-05-08T18:33:03.881406+0000","last_clean":"2024-05-08T18:33:03.881406+0000","last_became_active":"2024-05-08T18:29:48.629204+0000","last_became_peered":"2024-05-08T18:29:48.629204+0000","last_unstale":"2024-05-08T18:33:03.881406+0000","last_undegraded":"2024-05-08T18:33:03.881406+0000","last_fullsized":"2024-05-08T18:33:03.881406+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:03.881311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:03.881311+0000","last_clean_scrub_stamp":"2024-05-08T18:33:03.881311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:23:16.472058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"84'6","reported_seq":189,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.060710+0000","last_change":"2024-05-08T18:29:50.668101+0000","last_active":"2024-05-08T18:32:46.060710+0000","last_peered":"2024-05-08T18:32:46.060710+0000","last_clean":"2024-05-08T18:32:46.060710+0000","last_became_active":"2024-05-08T18:29:50.667357+0000","last_became_peered":"2024-05-08T18:29:50.667357+0000","last_unstale":"2024-05-08T18:32:46.060710+0000","last_undegraded":"2024-05-08T18:32:46.060710+0000","last_fullsized":"2024-05-08T18:32:46.060710+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"97'4","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.886329+0000","last_change":"2024-05-08T18:33:05.886394+0000","last_active":"2024-05-08T18:33:05.886329+0000","last_peered":"2024-05-08T18:33:05.886329+0000","last_clean":"2024-05-08T18:33:05.886329+0000","last_became_active":"2024-05-08T18:29:42.580988+0000","last_became_peered":"2024-05-08T18:29:42.580988+0000","last_unstale":"2024-05-08T18:33:05.886329+0000","last_undegraded":"2024-05-08T18:33:05.886329+0000","last_fullsized":"2024-05-08T18:33:05.886329+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'4","last_scrub_stamp":"2024-05-08T18:33:05.886129+0000","last_deep_scrub":"97'4","last_deep_scrub_stamp":"2024-05-08T18:33:05.886129+0000","last_clean_scrub_stamp":"2024-05-08T18:33:05.886129+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:29:32.496922+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"116'16","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:14.499274+0000","last_change":"2024-05-08T18:33:14.499338+0000","last_active":"2024-05-08T18:33:14.499274+0000","last_peered":"2024-05-08T18:33:14.499274+0000","last_clean":"2024-05-08T18:33:14.499274+0000","last_became_active":"2024-05-08T18:29:40.561277+0000","last_became_peered":"2024-05-08T18:29:40.561277+0000","last_unstale":"2024-05-08T18:33:14.499274+0000","last_undegraded":"2024-05-08T18:33:14.499274+0000","last_fullsized":"2024-05-08T18:33:14.499274+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'16","last_scrub_stamp":"2024-05-08T18:33:14.499083+0000","last_deep_scrub":"116'16","last_deep_scrub_stamp":"2024-05-08T18:33:14.499083+0000","last_clean_scrub_stamp":"2024-05-08T18:33:14.499083+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:59:51.019008+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":3,"num_write":26,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:13.783798+0000","last_change":"2024-05-08T18:33:13.783860+0000","last_active":"2024-05-08T18:33:13.783798+0000","last_peered":"2024-05-08T18:33:13.783798+0000","last_clean":"2024-05-08T18:33:13.783798+0000","last_became_active":"2024-05-08T18:29:42.573502+0000","last_became_peered":"2024-05-08T18:29:42.573502+0000","last_unstale":"2024-05-08T18:33:13.783798+0000","last_undegraded":"2024-05-08T18:33:13.783798+0000","last_fullsized":"2024-05-08T18:33:13.783798+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:13.783580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:13.783580+0000","last_clean_scrub_stamp":"2024-05-08T18:33:13.783580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:09:34.659675+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"116'16","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.807662+0000","last_change":"2024-05-08T18:33:06.807725+0000","last_active":"2024-05-08T18:33:06.807662+0000","last_peered":"2024-05-08T18:33:06.807662+0000","last_clean":"2024-05-08T18:33:06.807662+0000","last_became_active":"2024-05-08T18:29:40.532246+0000","last_became_peered":"2024-05-08T18:29:40.532246+0000","last_unstale":"2024-05-08T18:33:06.807662+0000","last_undegraded":"2024-05-08T18:33:06.807662+0000","last_fullsized":"2024-05-08T18:33:06.807662+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'16","last_scrub_stamp":"2024-05-08T18:33:06.807472+0000","last_deep_scrub":"116'16","last_deep_scrub_stamp":"2024-05-08T18:33:06.807472+0000","last_clean_scrub_stamp":"2024-05-08T18:33:06.807472+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:16:38.253020+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":201,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:10.209861+0000","last_change":"2024-05-08T18:33:10.209964+0000","last_active":"2024-05-08T18:33:10.209861+0000","last_peered":"2024-05-08T18:33:10.209861+0000","last_clean":"2024-05-08T18:33:10.209861+0000","last_became_active":"2024-05-08T18:29:42.564542+0000","last_became_peered":"2024-05-08T18:29:42.564542+0000","last_unstale":"2024-05-08T18:33:10.209861+0000","last_undegraded":"2024-05-08T18:33:10.209861+0000","last_fullsized":"2024-05-08T18:33:10.209861+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:10.209551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:10.209551+0000","last_clean_scrub_stamp":"2024-05-08T18:33:10.209551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:06:44.894864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"116'28","reported_seq":225,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.154977+0000","last_change":"2024-05-08T18:29:40.556958+0000","last_active":"2024-05-08T18:32:57.154977+0000","last_peered":"2024-05-08T18:32:57.154977+0000","last_clean":"2024-05-08T18:32:57.154977+0000","last_became_active":"2024-05-08T18:29:40.556091+0000","last_became_peered":"2024-05-08T18:29:40.556091+0000","last_unstale":"2024-05-08T18:32:57.154977+0000","last_undegraded":"2024-05-08T18:32:57.154977+0000","last_fullsized":"2024-05-08T18:32:57.154977+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":28,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"97'6","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:09.831793+0000","last_change":"2024-05-08T18:33:09.831861+0000","last_active":"2024-05-08T18:33:09.831793+0000","last_peered":"2024-05-08T18:33:09.831793+0000","last_clean":"2024-05-08T18:33:09.831793+0000","last_became_active":"2024-05-08T18:29:42.573178+0000","last_became_peered":"2024-05-08T18:29:42.573178+0000","last_unstale":"2024-05-08T18:33:09.831793+0000","last_undegraded":"2024-05-08T18:33:09.831793+0000","last_fullsized":"2024-05-08T18:33:09.831793+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'6","last_scrub_stamp":"2024-05-08T18:33:09.831594+0000","last_deep_scrub":"97'6","last_deep_scrub_stamp":"2024-05-08T18:33:09.831594+0000","last_clean_scrub_stamp":"2024-05-08T18:33:09.831594+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:14.745423+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"116'10","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.176913+0000","last_change":"2024-05-08T18:29:40.544338+0000","last_active":"2024-05-08T18:32:57.176913+0000","last_peered":"2024-05-08T18:32:57.176913+0000","last_clean":"2024-05-08T18:32:57.176913+0000","last_became_active":"2024-05-08T18:29:40.544107+0000","last_became_peered":"2024-05-08T18:29:40.544107+0000","last_unstale":"2024-05-08T18:32:57.176913+0000","last_undegraded":"2024-05-08T18:32:57.176913+0000","last_fullsized":"2024-05-08T18:32:57.176913+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"84'2","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:11.748589+0000","last_change":"2024-05-08T18:33:11.748654+0000","last_active":"2024-05-08T18:33:11.748589+0000","last_peered":"2024-05-08T18:33:11.748589+0000","last_clean":"2024-05-08T18:33:11.748589+0000","last_became_active":"2024-05-08T18:29:42.576395+0000","last_became_peered":"2024-05-08T18:29:42.576395+0000","last_unstale":"2024-05-08T18:33:11.748589+0000","last_undegraded":"2024-05-08T18:33:11.748589+0000","last_fullsized":"2024-05-08T18:33:11.748589+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'2","last_scrub_stamp":"2024-05-08T18:33:11.748383+0000","last_deep_scrub":"84'2","last_deep_scrub_stamp":"2024-05-08T18:33:11.748383+0000","last_clean_scrub_stamp":"2024-05-08T18:33:11.748383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:47.774255+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"116'10","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.133374+0000","last_change":"2024-05-08T18:29:40.558142+0000","last_active":"2024-05-08T18:32:57.133374+0000","last_peered":"2024-05-08T18:32:57.133374+0000","last_clean":"2024-05-08T18:32:57.133374+0000","last_became_active":"2024-05-08T18:29:40.557874+0000","last_became_peered":"2024-05-08T18:29:40.557874+0000","last_unstale":"2024-05-08T18:32:57.133374+0000","last_undegraded":"2024-05-08T18:32:57.133374+0000","last_fullsized":"2024-05-08T18:32:57.133374+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"97'2","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:18.527351+0000","last_change":"2024-05-08T18:33:18.527420+0000","last_active":"2024-05-08T18:33:18.527351+0000","last_peered":"2024-05-08T18:33:18.527351+0000","last_clean":"2024-05-08T18:33:18.527351+0000","last_became_active":"2024-05-08T18:29:42.556774+0000","last_became_peered":"2024-05-08T18:29:42.556774+0000","last_unstale":"2024-05-08T18:33:18.527351+0000","last_undegraded":"2024-05-08T18:33:18.527351+0000","last_fullsized":"2024-05-08T18:33:18.527351+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'2","last_scrub_stamp":"2024-05-08T18:33:18.527147+0000","last_deep_scrub":"97'2","last_deep_scrub_stamp":"2024-05-08T18:33:18.527147+0000","last_clean_scrub_stamp":"2024-05-08T18:33:18.527147+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:29.325697+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"116'22","reported_seq":227,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.131622+0000","last_change":"2024-05-08T18:30:20.858467+0000","last_active":"2024-05-08T18:32:57.131622+0000","last_peered":"2024-05-08T18:32:57.131622+0000","last_clean":"2024-05-08T18:32:57.131622+0000","last_became_active":"2024-05-08T18:30:20.858016+0000","last_became_peered":"2024-05-08T18:30:20.858016+0000","last_unstale":"2024-05-08T18:32:57.131622+0000","last_undegraded":"2024-05-08T18:32:57.131622+0000","last_fullsized":"2024-05-08T18:32:57.131622+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"84'4","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.062153+0000","last_change":"2024-05-08T18:29:42.562772+0000","last_active":"2024-05-08T18:32:46.062153+0000","last_peered":"2024-05-08T18:32:46.062153+0000","last_clean":"2024-05-08T18:32:46.062153+0000","last_became_active":"2024-05-08T18:29:42.562420+0000","last_became_peered":"2024-05-08T18:29:42.562420+0000","last_unstale":"2024-05-08T18:32:46.062153+0000","last_undegraded":"2024-05-08T18:32:46.062153+0000","last_fullsized":"2024-05-08T18:32:46.062153+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"116'10","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:16.562367+0000","last_change":"2024-05-08T18:33:16.562520+0000","last_active":"2024-05-08T18:33:16.562367+0000","last_peered":"2024-05-08T18:33:16.562367+0000","last_clean":"2024-05-08T18:33:16.562367+0000","last_became_active":"2024-05-08T18:29:40.561326+0000","last_became_peered":"2024-05-08T18:29:40.561326+0000","last_unstale":"2024-05-08T18:33:16.562367+0000","last_undegraded":"2024-05-08T18:33:16.562367+0000","last_fullsized":"2024-05-08T18:33:16.562367+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'10","last_scrub_stamp":"2024-05-08T18:33:16.562119+0000","last_deep_scrub":"116'10","last_deep_scrub_stamp":"2024-05-08T18:33:16.562119+0000","last_clean_scrub_stamp":"2024-05-08T18:33:16.562119+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:29:20.324924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"97'4","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:11.564568+0000","last_change":"2024-05-08T18:33:11.564628+0000","last_active":"2024-05-08T18:33:11.564568+0000","last_peered":"2024-05-08T18:33:11.564568+0000","last_clean":"2024-05-08T18:33:11.564568+0000","last_became_active":"2024-05-08T18:29:42.560520+0000","last_became_peered":"2024-05-08T18:29:42.560520+0000","last_unstale":"2024-05-08T18:33:11.564568+0000","last_undegraded":"2024-05-08T18:33:11.564568+0000","last_fullsized":"2024-05-08T18:33:11.564568+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'4","last_scrub_stamp":"2024-05-08T18:33:11.564356+0000","last_deep_scrub":"97'4","last_deep_scrub_stamp":"2024-05-08T18:33:11.564356+0000","last_clean_scrub_stamp":"2024-05-08T18:33:11.564356+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:45.313531+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"116'22","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.134021+0000","last_change":"2024-05-08T18:29:40.554884+0000","last_active":"2024-05-08T18:32:57.134021+0000","last_peered":"2024-05-08T18:32:57.134021+0000","last_clean":"2024-05-08T18:32:57.134021+0000","last_became_active":"2024-05-08T18:29:40.554603+0000","last_became_peered":"2024-05-08T18:29:40.554603+0000","last_unstale":"2024-05-08T18:32:57.134021+0000","last_undegraded":"2024-05-08T18:32:57.134021+0000","last_fullsized":"2024-05-08T18:32:57.134021+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"84'4","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:08.883008+0000","last_change":"2024-05-08T18:33:08.883070+0000","last_active":"2024-05-08T18:33:08.883008+0000","last_peered":"2024-05-08T18:33:08.883008+0000","last_clean":"2024-05-08T18:33:08.883008+0000","last_became_active":"2024-05-08T18:29:42.573947+0000","last_became_peered":"2024-05-08T18:29:42.573947+0000","last_unstale":"2024-05-08T18:33:08.883008+0000","last_undegraded":"2024-05-08T18:33:08.883008+0000","last_fullsized":"2024-05-08T18:33:08.883008+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'4","last_scrub_stamp":"2024-05-08T18:33:08.882807+0000","last_deep_scrub":"84'4","last_deep_scrub_stamp":"2024-05-08T18:33:08.882807+0000","last_clean_scrub_stamp":"2024-05-08T18:33:08.882807+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:04:54.998223+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"116'20","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.175172+0000","last_change":"2024-05-08T18:29:40.554005+0000","last_active":"2024-05-08T18:32:57.175172+0000","last_peered":"2024-05-08T18:32:57.175172+0000","last_clean":"2024-05-08T18:32:57.175172+0000","last_became_active":"2024-05-08T18:29:40.553356+0000","last_became_peered":"2024-05-08T18:29:40.553356+0000","last_unstale":"2024-05-08T18:32:57.175172+0000","last_undegraded":"2024-05-08T18:32:57.175172+0000","last_fullsized":"2024-05-08T18:32:57.175172+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"84'2","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:10.552807+0000","last_change":"2024-05-08T18:33:10.552867+0000","last_active":"2024-05-08T18:33:10.552807+0000","last_peered":"2024-05-08T18:33:10.552807+0000","last_clean":"2024-05-08T18:33:10.552807+0000","last_became_active":"2024-05-08T18:29:42.565760+0000","last_became_peered":"2024-05-08T18:29:42.565760+0000","last_unstale":"2024-05-08T18:33:10.552807+0000","last_undegraded":"2024-05-08T18:33:10.552807+0000","last_fullsized":"2024-05-08T18:33:10.552807+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'2","last_scrub_stamp":"2024-05-08T18:33:10.552606+0000","last_deep_scrub":"84'2","last_deep_scrub_stamp":"2024-05-08T18:33:10.552606+0000","last_clean_scrub_stamp":"2024-05-08T18:33:10.552606+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:06:45.237919+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"116'16","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.147613+0000","last_change":"2024-05-08T18:29:40.552543+0000","last_active":"2024-05-08T18:32:57.147613+0000","last_peered":"2024-05-08T18:32:57.147613+0000","last_clean":"2024-05-08T18:32:57.147613+0000","last_became_active":"2024-05-08T18:29:40.552307+0000","last_became_peered":"2024-05-08T18:29:40.552307+0000","last_unstale":"2024-05-08T18:32:57.147613+0000","last_undegraded":"2024-05-08T18:32:57.147613+0000","last_fullsized":"2024-05-08T18:32:57.147613+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"84'4","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:08.822634+0000","last_change":"2024-05-08T18:33:08.822695+0000","last_active":"2024-05-08T18:33:08.822634+0000","last_peered":"2024-05-08T18:33:08.822634+0000","last_clean":"2024-05-08T18:33:08.822634+0000","last_became_active":"2024-05-08T18:29:42.561171+0000","last_became_peered":"2024-05-08T18:29:42.561171+0000","last_unstale":"2024-05-08T18:33:08.822634+0000","last_undegraded":"2024-05-08T18:33:08.822634+0000","last_fullsized":"2024-05-08T18:33:08.822634+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'4","last_scrub_stamp":"2024-05-08T18:33:08.822410+0000","last_deep_scrub":"84'4","last_deep_scrub_stamp":"2024-05-08T18:33:08.822410+0000","last_clean_scrub_stamp":"2024-05-08T18:33:08.822410+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:04:37.332926+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"116'20","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.126526+0000","last_change":"2024-05-08T18:29:40.543041+0000","last_active":"2024-05-08T18:32:57.126526+0000","last_peered":"2024-05-08T18:32:57.126526+0000","last_clean":"2024-05-08T18:32:57.126526+0000","last_became_active":"2024-05-08T18:29:40.542398+0000","last_became_peered":"2024-05-08T18:29:40.542398+0000","last_unstale":"2024-05-08T18:32:57.126526+0000","last_undegraded":"2024-05-08T18:32:57.126526+0000","last_fullsized":"2024-05-08T18:32:57.126526+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"97'6","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:13.444728+0000","last_change":"2024-05-08T18:33:13.444795+0000","last_active":"2024-05-08T18:33:13.444728+0000","last_peered":"2024-05-08T18:33:13.444728+0000","last_clean":"2024-05-08T18:33:13.444728+0000","last_became_active":"2024-05-08T18:29:42.578981+0000","last_became_peered":"2024-05-08T18:29:42.578981+0000","last_unstale":"2024-05-08T18:33:13.444728+0000","last_undegraded":"2024-05-08T18:33:13.444728+0000","last_fullsized":"2024-05-08T18:33:13.444728+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'6","last_scrub_stamp":"2024-05-08T18:33:13.444524+0000","last_deep_scrub":"97'6","last_deep_scrub_stamp":"2024-05-08T18:33:13.444524+0000","last_clean_scrub_stamp":"2024-05-08T18:33:13.444524+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:22:27.693306+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"116'22","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.068990+0000","last_change":"2024-05-08T18:29:40.548499+0000","last_active":"2024-05-08T18:32:57.068990+0000","last_peered":"2024-05-08T18:32:57.068990+0000","last_clean":"2024-05-08T18:32:57.068990+0000","last_became_active":"2024-05-08T18:29:40.548177+0000","last_became_peered":"2024-05-08T18:29:40.548177+0000","last_unstale":"2024-05-08T18:32:57.068990+0000","last_undegraded":"2024-05-08T18:32:57.068990+0000","last_fullsized":"2024-05-08T18:32:57.068990+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"80'2","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.926107+0000","last_change":"2024-05-08T18:33:06.926170+0000","last_active":"2024-05-08T18:33:06.926107+0000","last_peered":"2024-05-08T18:33:06.926107+0000","last_clean":"2024-05-08T18:33:06.926107+0000","last_became_active":"2024-05-08T18:29:42.573384+0000","last_became_peered":"2024-05-08T18:29:42.573384+0000","last_unstale":"2024-05-08T18:33:06.926107+0000","last_undegraded":"2024-05-08T18:33:06.926107+0000","last_fullsized":"2024-05-08T18:33:06.926107+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2","last_scrub_stamp":"2024-05-08T18:33:06.925879+0000","last_deep_scrub":"80'2","last_deep_scrub_stamp":"2024-05-08T18:33:06.925879+0000","last_clean_scrub_stamp":"2024-05-08T18:33:06.925879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:27:06.379974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"116'18","reported_seq":221,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:18.613390+0000","last_change":"2024-05-08T18:33:18.613454+0000","last_active":"2024-05-08T18:33:18.613390+0000","last_peered":"2024-05-08T18:33:18.613390+0000","last_clean":"2024-05-08T18:33:18.613390+0000","last_became_active":"2024-05-08T18:29:40.563231+0000","last_became_peered":"2024-05-08T18:29:40.563231+0000","last_unstale":"2024-05-08T18:33:18.613390+0000","last_undegraded":"2024-05-08T18:33:18.613390+0000","last_fullsized":"2024-05-08T18:33:18.613390+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'18","last_scrub_stamp":"2024-05-08T18:33:18.613120+0000","last_deep_scrub":"116'18","last_deep_scrub_stamp":"2024-05-08T18:33:18.613120+0000","last_clean_scrub_stamp":"2024-05-08T18:33:18.613120+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:11:40.975598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:19.976793+0000","last_change":"2024-05-08T18:33:19.976898+0000","last_active":"2024-05-08T18:33:19.976793+0000","last_peered":"2024-05-08T18:33:19.976793+0000","last_clean":"2024-05-08T18:33:19.976793+0000","last_became_active":"2024-05-08T18:29:42.563822+0000","last_became_peered":"2024-05-08T18:29:42.563822+0000","last_unstale":"2024-05-08T18:33:19.976793+0000","last_undegraded":"2024-05-08T18:33:19.976793+0000","last_fullsized":"2024-05-08T18:33:19.976793+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:19.976557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:19.976557+0000","last_clean_scrub_stamp":"2024-05-08T18:33:19.976557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:41:42.325155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"116'28","reported_seq":231,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:14.818194+0000","last_change":"2024-05-08T18:33:14.818317+0000","last_active":"2024-05-08T18:33:14.818194+0000","last_peered":"2024-05-08T18:33:14.818194+0000","last_clean":"2024-05-08T18:33:14.818194+0000","last_became_active":"2024-05-08T18:29:40.571195+0000","last_became_peered":"2024-05-08T18:29:40.571195+0000","last_unstale":"2024-05-08T18:33:14.818194+0000","last_undegraded":"2024-05-08T18:33:14.818194+0000","last_fullsized":"2024-05-08T18:33:14.818194+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'28","last_scrub_stamp":"2024-05-08T18:33:14.817914+0000","last_deep_scrub":"116'28","last_deep_scrub_stamp":"2024-05-08T18:33:14.817914+0000","last_clean_scrub_stamp":"2024-05-08T18:33:14.817914+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:13:39.741623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":28,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:18.938962+0000","last_change":"2024-05-08T18:33:18.939020+0000","last_active":"2024-05-08T18:33:18.938962+0000","last_peered":"2024-05-08T18:33:18.938962+0000","last_clean":"2024-05-08T18:33:18.938962+0000","last_became_active":"2024-05-08T18:29:42.560419+0000","last_became_peered":"2024-05-08T18:29:42.560419+0000","last_unstale":"2024-05-08T18:33:18.938962+0000","last_undegraded":"2024-05-08T18:33:18.938962+0000","last_fullsized":"2024-05-08T18:33:18.938962+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:18.938772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:18.938772+0000","last_clean_scrub_stamp":"2024-05-08T18:33:18.938772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:25:42.250635+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"116'20","reported_seq":226,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:07.782695+0000","last_change":"2024-05-08T18:33:07.782811+0000","last_active":"2024-05-08T18:33:07.782695+0000","last_peered":"2024-05-08T18:33:07.782695+0000","last_clean":"2024-05-08T18:33:07.782695+0000","last_became_active":"2024-05-08T18:29:40.568584+0000","last_became_peered":"2024-05-08T18:29:40.568584+0000","last_unstale":"2024-05-08T18:33:07.782695+0000","last_undegraded":"2024-05-08T18:33:07.782695+0000","last_fullsized":"2024-05-08T18:33:07.782695+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'20","last_scrub_stamp":"2024-05-08T18:33:07.782380+0000","last_deep_scrub":"116'20","last_deep_scrub_stamp":"2024-05-08T18:33:07.782380+0000","last_clean_scrub_stamp":"2024-05-08T18:33:07.782380+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:02.322645+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"83'6","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:08.972475+0000","last_change":"2024-05-08T18:33:08.972538+0000","last_active":"2024-05-08T18:33:08.972475+0000","last_peered":"2024-05-08T18:33:08.972475+0000","last_clean":"2024-05-08T18:33:08.972475+0000","last_became_active":"2024-05-08T18:29:42.573563+0000","last_became_peered":"2024-05-08T18:29:42.573563+0000","last_unstale":"2024-05-08T18:33:08.972475+0000","last_undegraded":"2024-05-08T18:33:08.972475+0000","last_fullsized":"2024-05-08T18:33:08.972475+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'6","last_scrub_stamp":"2024-05-08T18:33:08.972279+0000","last_deep_scrub":"83'6","last_deep_scrub_stamp":"2024-05-08T18:33:08.972279+0000","last_clean_scrub_stamp":"2024-05-08T18:33:08.972279+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:09:29.848374+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"116'16","reported_seq":221,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:15.187897+0000","last_change":"2024-05-08T18:33:15.187957+0000","last_active":"2024-05-08T18:33:15.187897+0000","last_peered":"2024-05-08T18:33:15.187897+0000","last_clean":"2024-05-08T18:33:15.187897+0000","last_became_active":"2024-05-08T18:29:40.561360+0000","last_became_peered":"2024-05-08T18:29:40.561360+0000","last_unstale":"2024-05-08T18:33:15.187897+0000","last_undegraded":"2024-05-08T18:33:15.187897+0000","last_fullsized":"2024-05-08T18:33:15.187897+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'16","last_scrub_stamp":"2024-05-08T18:33:15.187705+0000","last_deep_scrub":"116'16","last_deep_scrub_stamp":"2024-05-08T18:33:15.187705+0000","last_clean_scrub_stamp":"2024-05-08T18:33:15.187705+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:10:19.782853+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"116'22","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.173943+0000","last_change":"2024-05-08T18:29:40.538728+0000","last_active":"2024-05-08T18:32:57.173943+0000","last_peered":"2024-05-08T18:32:57.173943+0000","last_clean":"2024-05-08T18:32:57.173943+0000","last_became_active":"2024-05-08T18:29:40.537925+0000","last_became_peered":"2024-05-08T18:29:40.537925+0000","last_unstale":"2024-05-08T18:32:57.173943+0000","last_undegraded":"2024-05-08T18:32:57.173943+0000","last_fullsized":"2024-05-08T18:32:57.173943+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":4,"num_write":32,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"97'8","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:10.876750+0000","last_change":"2024-05-08T18:33:10.876812+0000","last_active":"2024-05-08T18:33:10.876750+0000","last_peered":"2024-05-08T18:33:10.876750+0000","last_clean":"2024-05-08T18:33:10.876750+0000","last_became_active":"2024-05-08T18:29:42.574351+0000","last_became_peered":"2024-05-08T18:29:42.574351+0000","last_unstale":"2024-05-08T18:33:10.876750+0000","last_undegraded":"2024-05-08T18:33:10.876750+0000","last_fullsized":"2024-05-08T18:33:10.876750+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'8","last_scrub_stamp":"2024-05-08T18:33:10.876518+0000","last_deep_scrub":"97'8","last_deep_scrub_stamp":"2024-05-08T18:33:10.876518+0000","last_clean_scrub_stamp":"2024-05-08T18:33:10.876518+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:31:05.444966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"116'20","reported_seq":228,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:18.791152+0000","last_change":"2024-05-08T18:33:18.791310+0000","last_active":"2024-05-08T18:33:18.791152+0000","last_peered":"2024-05-08T18:33:18.791152+0000","last_clean":"2024-05-08T18:33:18.791152+0000","last_became_active":"2024-05-08T18:29:40.542965+0000","last_became_peered":"2024-05-08T18:29:40.542965+0000","last_unstale":"2024-05-08T18:33:18.791152+0000","last_undegraded":"2024-05-08T18:33:18.791152+0000","last_fullsized":"2024-05-08T18:33:18.791152+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'20","last_scrub_stamp":"2024-05-08T18:33:18.790907+0000","last_deep_scrub":"116'20","last_deep_scrub_stamp":"2024-05-08T18:33:18.790907+0000","last_clean_scrub_stamp":"2024-05-08T18:33:18.790907+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:22:33.039689+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":201,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:13.211139+0000","last_change":"2024-05-08T18:33:13.211194+0000","last_active":"2024-05-08T18:33:13.211139+0000","last_peered":"2024-05-08T18:33:13.211139+0000","last_clean":"2024-05-08T18:33:13.211139+0000","last_became_active":"2024-05-08T18:29:42.559028+0000","last_became_peered":"2024-05-08T18:29:42.559028+0000","last_unstale":"2024-05-08T18:33:13.211139+0000","last_undegraded":"2024-05-08T18:33:13.211139+0000","last_fullsized":"2024-05-08T18:33:13.211139+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:13.210947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:13.210947+0000","last_clean_scrub_stamp":"2024-05-08T18:33:13.210947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:22:27.459729+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":247,"num_read_kb":238,"num_write":231,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":840,"ondisk_log_size":840,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":23632,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1024,"num_read_kb":1070,"num_write":533,"num_write_kb":208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6074,"num_omap_keys":28,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":892,"ondisk_log_size":892,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":344,"num_read_kb":344,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":579,"num_read_kb":555,"num_write":234,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":222,"ondisk_log_size":222,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":593,"num_read_kb":23,"num_write":1216,"num_write_kb":2365440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1156,"ondisk_log_size":1156,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509493,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33152,"kb_used_data":1976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338688,"statfs":{"total":96636764160,"available":96602816512,"internally_reserved":0,"allocated":2023424,"data_stored":1399455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509493,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32548,"kb_used_data":1372,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339292,"statfs":{"total":96636764160,"available":96603435008,"internally_reserved":0,"allocated":1404928,"data_stored":808427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509491,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36752,"kb_used_data":1416,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335088,"statfs":{"total":96636764160,"available":96599130112,"internally_reserved":0,"allocated":1449984,"data_stored":809255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509491,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32536,"kb_used_data":1360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339304,"statfs":{"total":96636764160,"available":96603447296,"internally_reserved":0,"allocated":1392640,"data_stored":807925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542196,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32564,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339276,"statfs":{"total":96636764160,"available":96603418624,"internally_reserved":0,"allocated":1421312,"data_stored":808823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542196,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32544,"kb_used_data":1368,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339296,"statfs":{"total":96636764160,"available":96603439104,"internally_reserved":0,"allocated":1400832,"data_stored":809418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542194,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32564,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339276,"statfs":{"total":96636764160,"available":96603418624,"internally_reserved":0,"allocated":1421312,"data_stored":808677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542196,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33140,"kb_used_data":1964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338700,"statfs":{"total":96636764160,"available":96602828800,"internally_reserved":0,"allocated":2011136,"data_stored":1400290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T18:33:24.279 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.279 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.279 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.279 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.279 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.280 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.280 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.280 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-05-08T18:29:41.517676+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.280 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.280 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-05-08T18:29:49.624707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=49, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.280 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.280 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-05-08T18:29:43.555558+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.280 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-05-08T18:29:45.561744+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=45, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.280 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-05-08T18:29:47.589927+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.281 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-05-08T18:29:49.624707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=49, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.281 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.281 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-05-08T18:29:47.589927+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.281 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-05-08T18:29:49.624707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=49, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.281 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.281 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-05-08T18:29:43.555558+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.281 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-05-08T18:29:47.589927+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.281 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-05-08T18:29:49.624707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=49, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.282 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-05-08T18:29:49.624707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=49, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.282 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-05-08T18:29:41.517676+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.282 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.282 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-05-08T18:29:49.624707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=49, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.282 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.282 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-05-08T18:29:49.624707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=49, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.283 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-05-08T18:29:45.561744+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=45, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.283 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-05-08T18:29:49.624707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=49, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.283 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-05-08T18:29:41.517676+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.283 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.283 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-05-08T18:29:47.589927+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.283 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-05-08T18:29:49.624707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=49, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.283 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-05-08T18:29:41.517676+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.283 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-05-08T18:29:49.624707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=49, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.284 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.284 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-05-08T18:29:45.561744+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=45, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.284 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-05-08T18:29:47.589927+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.284 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-05-08T18:29:49.624707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=49, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.284 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-05-08T18:29:41.517676+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.284 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.284 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-05-08T18:29:43.555558+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.284 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-05-08T18:29:47.589927+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.284 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-05-08T18:29:49.624707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=49, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.285 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-05-08T18:29:26.091102+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=26, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.285 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-05-08T18:29:33.458212+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.285 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.285 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-05-08T18:29:49.624707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=49, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.285 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-05-08T18:29:33.458212+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.285 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.285 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-05-08T18:29:43.555558+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.285 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-05-08T18:29:47.589927+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.286 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-05-08T18:29:49.624707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=49, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.286 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-05-08T18:29:49.624707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=49, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.286 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-05-08T18:29:41.517676+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.286 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-05-08T18:29:33.458212+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.286 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.286 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-05-08T18:29:49.624707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=49, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.286 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-05-08T18:29:45.561744+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=45, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.287 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-05-08T18:29:47.589927+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.287 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-05-08T18:29:49.624707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=49, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.287 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-05-08T18:29:33.458212+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.287 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-05-08T18:29:49.624707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=49, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.287 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-05-08T18:29:41.517676+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.287 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.287 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-05-08T18:29:49.624707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=49, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.288 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.288 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-05-08T18:29:49.624707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=49, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.288 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-05-08T18:29:49.624707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=49, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.288 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.288 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-05-08T18:29:45.561744+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=45, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.288 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-05-08T18:29:49.624707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=49, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.288 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-05-08T18:29:47.589927+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.289 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-05-08T18:29:49.624707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=49, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.289 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.289 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-05-08T18:29:49.624707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=49, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.289 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-05-08T18:29:41.517676+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.289 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.289 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-05-08T18:29:45.561744+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=45, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.289 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.290 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-05-08T18:29:47.589927+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.290 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-05-08T18:29:47.589927+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.290 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-05-08T18:29:49.624707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=49, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.290 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.290 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-05-08T18:29:45.561744+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=45, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.290 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-05-08T18:29:47.589927+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.290 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-05-08T18:29:49.624707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=49, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.290 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.291 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-05-08T18:29:47.589927+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.291 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-05-08T18:29:49.624707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=49, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.291 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-05-08T18:29:49.624707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=49, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.291 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.291 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-05-08T18:29:47.589927+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.291 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-05-08T18:29:49.624707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=49, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.291 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-05-08T18:29:41.517676+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.291 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.292 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-05-08T18:29:43.555558+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.292 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-05-08T18:29:47.589927+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=47, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.292 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-05-08T18:29:49.624707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=49, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.292 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.292 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-05-08T18:29:49.624707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=49, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.292 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.292 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.293 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.293 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.293 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-05-08T18:29:41.517676+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.293 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.293 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.293 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.293 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.293 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.294 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:24.294 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-08T18:33:44.295 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T18:33:44.653 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-05-08T18:33:44.660 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2024-05-08T18:33:44.672 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":238,"stamp":"2024-05-08T18:33:43.502025+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":615613,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":2853,"num_read_kb":2285,"num_write":2325,"num_write_kb":2367366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6074,"num_omap_keys":28,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3340,"ondisk_log_size":3340,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":265800,"kb_used_data":12232,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754708920,"statfs":{"total":773094113280,"available":772821934080,"internally_reserved":0,"allocated":12525568,"data_stored":7652270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":259575345},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007416"},"pg_stats":[{"pgid":"3.3f","version":"116'20","reported_seq":223,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:12.835806+0000","last_change":"2024-05-08T18:33:12.835866+0000","last_active":"2024-05-08T18:33:12.835806+0000","last_peered":"2024-05-08T18:33:12.835806+0000","last_clean":"2024-05-08T18:33:12.835806+0000","last_became_active":"2024-05-08T18:29:40.573543+0000","last_became_peered":"2024-05-08T18:29:40.573543+0000","last_unstale":"2024-05-08T18:33:12.835806+0000","last_undegraded":"2024-05-08T18:33:12.835806+0000","last_fullsized":"2024-05-08T18:33:12.835806+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'20","last_scrub_stamp":"2024-05-08T18:33:12.835610+0000","last_deep_scrub":"116'20","last_deep_scrub_stamp":"2024-05-08T18:33:12.835610+0000","last_clean_scrub_stamp":"2024-05-08T18:33:12.835610+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:59:53.794662+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":20,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"97'2","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:08.206096+0000","last_change":"2024-05-08T18:33:08.206159+0000","last_active":"2024-05-08T18:33:08.206096+0000","last_peered":"2024-05-08T18:33:08.206096+0000","last_clean":"2024-05-08T18:33:08.206096+0000","last_became_active":"2024-05-08T18:29:42.561201+0000","last_became_peered":"2024-05-08T18:29:42.561201+0000","last_unstale":"2024-05-08T18:33:08.206096+0000","last_undegraded":"2024-05-08T18:33:08.206096+0000","last_fullsized":"2024-05-08T18:33:08.206096+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'2","last_scrub_stamp":"2024-05-08T18:33:08.205846+0000","last_deep_scrub":"97'2","last_deep_scrub_stamp":"2024-05-08T18:33:08.205846+0000","last_clean_scrub_stamp":"2024-05-08T18:33:08.205846+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:09:29.081941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"116'20","reported_seq":228,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:20.802006+0000","last_change":"2024-05-08T18:33:20.802097+0000","last_active":"2024-05-08T18:33:20.802006+0000","last_peered":"2024-05-08T18:33:20.802006+0000","last_clean":"2024-05-08T18:33:20.802006+0000","last_became_active":"2024-05-08T18:29:40.548930+0000","last_became_peered":"2024-05-08T18:29:40.548930+0000","last_unstale":"2024-05-08T18:33:20.802006+0000","last_undegraded":"2024-05-08T18:33:20.802006+0000","last_fullsized":"2024-05-08T18:33:20.802006+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'20","last_scrub_stamp":"2024-05-08T18:33:20.801751+0000","last_deep_scrub":"116'20","last_deep_scrub_stamp":"2024-05-08T18:33:20.801751+0000","last_clean_scrub_stamp":"2024-05-08T18:33:20.801751+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:10:25.396899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"84'2","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:10.887340+0000","last_change":"2024-05-08T18:33:10.887411+0000","last_active":"2024-05-08T18:33:10.887340+0000","last_peered":"2024-05-08T18:33:10.887340+0000","last_clean":"2024-05-08T18:33:10.887340+0000","last_became_active":"2024-05-08T18:29:42.571344+0000","last_became_peered":"2024-05-08T18:29:42.571344+0000","last_unstale":"2024-05-08T18:33:10.887340+0000","last_undegraded":"2024-05-08T18:33:10.887340+0000","last_fullsized":"2024-05-08T18:33:10.887340+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'2","last_scrub_stamp":"2024-05-08T18:33:10.887104+0000","last_deep_scrub":"84'2","last_deep_scrub_stamp":"2024-05-08T18:33:10.887104+0000","last_clean_scrub_stamp":"2024-05-08T18:33:10.887104+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:51:01.201406+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"116'26","reported_seq":233,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:24.974914+0000","last_change":"2024-05-08T18:33:24.974983+0000","last_active":"2024-05-08T18:33:24.974914+0000","last_peered":"2024-05-08T18:33:24.974914+0000","last_clean":"2024-05-08T18:33:24.974914+0000","last_became_active":"2024-05-08T18:29:40.538458+0000","last_became_peered":"2024-05-08T18:29:40.538458+0000","last_unstale":"2024-05-08T18:33:24.974914+0000","last_undegraded":"2024-05-08T18:33:24.974914+0000","last_fullsized":"2024-05-08T18:33:24.974914+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'26","last_scrub_stamp":"2024-05-08T18:33:24.974694+0000","last_deep_scrub":"116'26","last_deep_scrub_stamp":"2024-05-08T18:33:24.974694+0000","last_clean_scrub_stamp":"2024-05-08T18:33:24.974694+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:10:46.096789+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":4,"num_write":36,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:07.571029+0000","last_change":"2024-05-08T18:33:07.571156+0000","last_active":"2024-05-08T18:33:07.571029+0000","last_peered":"2024-05-08T18:33:07.571029+0000","last_clean":"2024-05-08T18:33:07.571029+0000","last_became_active":"2024-05-08T18:29:42.569026+0000","last_became_peered":"2024-05-08T18:29:42.569026+0000","last_unstale":"2024-05-08T18:33:07.571029+0000","last_undegraded":"2024-05-08T18:33:07.571029+0000","last_fullsized":"2024-05-08T18:33:07.571029+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:07.570804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:07.570804+0000","last_clean_scrub_stamp":"2024-05-08T18:33:07.570804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:31.162982+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"116'16","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:17.149603+0000","last_change":"2024-05-08T18:33:17.149603+0000","last_active":"2024-05-08T18:33:17.149603+0000","last_peered":"2024-05-08T18:33:17.149603+0000","last_clean":"2024-05-08T18:33:17.149603+0000","last_became_active":"2024-05-08T18:29:40.556884+0000","last_became_peered":"2024-05-08T18:29:40.556884+0000","last_unstale":"2024-05-08T18:33:17.149603+0000","last_undegraded":"2024-05-08T18:33:17.149603+0000","last_fullsized":"2024-05-08T18:33:17.149603+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'16","last_scrub_stamp":"2024-05-08T18:33:17.149214+0000","last_deep_scrub":"116'16","last_deep_scrub_stamp":"2024-05-08T18:33:17.149214+0000","last_clean_scrub_stamp":"2024-05-08T18:33:17.149214+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:58:12.131775+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:17.971548+0000","last_change":"2024-05-08T18:33:17.971608+0000","last_active":"2024-05-08T18:33:17.971548+0000","last_peered":"2024-05-08T18:33:17.971548+0000","last_clean":"2024-05-08T18:33:17.971548+0000","last_became_active":"2024-05-08T18:29:42.566058+0000","last_became_peered":"2024-05-08T18:29:42.566058+0000","last_unstale":"2024-05-08T18:33:17.971548+0000","last_undegraded":"2024-05-08T18:33:17.971548+0000","last_fullsized":"2024-05-08T18:33:17.971548+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:17.971336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:17.971336+0000","last_clean_scrub_stamp":"2024-05-08T18:33:17.971336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:14:35.541504+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"116'10","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:28.889304+0000","last_change":"2024-05-08T18:33:28.889418+0000","last_active":"2024-05-08T18:33:28.889304+0000","last_peered":"2024-05-08T18:33:28.889304+0000","last_clean":"2024-05-08T18:33:28.889304+0000","last_became_active":"2024-05-08T18:29:40.570467+0000","last_became_peered":"2024-05-08T18:29:40.570467+0000","last_unstale":"2024-05-08T18:33:28.889304+0000","last_undegraded":"2024-05-08T18:33:28.889304+0000","last_fullsized":"2024-05-08T18:33:28.889304+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'10","last_scrub_stamp":"2024-05-08T18:33:28.889093+0000","last_deep_scrub":"116'10","last_deep_scrub_stamp":"2024-05-08T18:33:28.889093+0000","last_clean_scrub_stamp":"2024-05-08T18:33:28.889093+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:44:39.117725+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:07.631596+0000","last_change":"2024-05-08T18:33:07.631651+0000","last_active":"2024-05-08T18:33:07.631596+0000","last_peered":"2024-05-08T18:33:07.631596+0000","last_clean":"2024-05-08T18:33:07.631596+0000","last_became_active":"2024-05-08T18:29:42.565740+0000","last_became_peered":"2024-05-08T18:29:42.565740+0000","last_unstale":"2024-05-08T18:33:07.631596+0000","last_undegraded":"2024-05-08T18:33:07.631596+0000","last_fullsized":"2024-05-08T18:33:07.631596+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:07.631397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:07.631397+0000","last_clean_scrub_stamp":"2024-05-08T18:33:07.631397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:22:24.824498+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"116'14","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:27.239203+0000","last_change":"2024-05-08T18:33:27.239268+0000","last_active":"2024-05-08T18:33:27.239203+0000","last_peered":"2024-05-08T18:33:27.239203+0000","last_clean":"2024-05-08T18:33:27.239203+0000","last_became_active":"2024-05-08T18:29:40.537458+0000","last_became_peered":"2024-05-08T18:29:40.537458+0000","last_unstale":"2024-05-08T18:33:27.239203+0000","last_undegraded":"2024-05-08T18:33:27.239203+0000","last_fullsized":"2024-05-08T18:33:27.239203+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'14","last_scrub_stamp":"2024-05-08T18:33:27.239011+0000","last_deep_scrub":"116'14","last_deep_scrub_stamp":"2024-05-08T18:33:27.239011+0000","last_clean_scrub_stamp":"2024-05-08T18:33:27.239011+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:41:28.234382+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:09.551255+0000","last_change":"2024-05-08T18:33:09.551309+0000","last_active":"2024-05-08T18:33:09.551255+0000","last_peered":"2024-05-08T18:33:09.551255+0000","last_clean":"2024-05-08T18:33:09.551255+0000","last_became_active":"2024-05-08T18:29:42.569255+0000","last_became_peered":"2024-05-08T18:29:42.569255+0000","last_unstale":"2024-05-08T18:33:09.551255+0000","last_undegraded":"2024-05-08T18:33:09.551255+0000","last_fullsized":"2024-05-08T18:33:09.551255+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:09.551066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:09.551066+0000","last_clean_scrub_stamp":"2024-05-08T18:33:09.551066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:26:59.232592+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"116'36","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:19.859727+0000","last_change":"2024-05-08T18:33:19.859879+0000","last_active":"2024-05-08T18:33:19.859727+0000","last_peered":"2024-05-08T18:33:19.859727+0000","last_clean":"2024-05-08T18:33:19.859727+0000","last_became_active":"2024-05-08T18:30:21.210052+0000","last_became_peered":"2024-05-08T18:30:21.210052+0000","last_unstale":"2024-05-08T18:33:19.859727+0000","last_undegraded":"2024-05-08T18:33:19.859727+0000","last_fullsized":"2024-05-08T18:33:19.859727+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'36","last_scrub_stamp":"2024-05-08T18:33:19.859481+0000","last_deep_scrub":"116'36","last_deep_scrub_stamp":"2024-05-08T18:33:19.859481+0000","last_clean_scrub_stamp":"2024-05-08T18:33:19.859481+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:24.773310+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"97'4","reported_seq":211,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:11.184144+0000","last_change":"2024-05-08T18:33:11.184207+0000","last_active":"2024-05-08T18:33:11.184144+0000","last_peered":"2024-05-08T18:33:11.184144+0000","last_clean":"2024-05-08T18:33:11.184144+0000","last_became_active":"2024-05-08T18:29:42.560699+0000","last_became_peered":"2024-05-08T18:29:42.560699+0000","last_unstale":"2024-05-08T18:33:11.184144+0000","last_undegraded":"2024-05-08T18:33:11.184144+0000","last_fullsized":"2024-05-08T18:33:11.184144+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'4","last_scrub_stamp":"2024-05-08T18:33:11.183948+0000","last_deep_scrub":"97'4","last_deep_scrub_stamp":"2024-05-08T18:33:11.183948+0000","last_clean_scrub_stamp":"2024-05-08T18:33:11.183948+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:04:19.618457+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"116'26","reported_seq":232,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:33.882242+0000","last_change":"2024-05-08T18:33:33.882303+0000","last_active":"2024-05-08T18:33:33.882242+0000","last_peered":"2024-05-08T18:33:33.882242+0000","last_clean":"2024-05-08T18:33:33.882242+0000","last_became_active":"2024-05-08T18:29:40.564038+0000","last_became_peered":"2024-05-08T18:29:40.564038+0000","last_unstale":"2024-05-08T18:33:33.882242+0000","last_undegraded":"2024-05-08T18:33:33.882242+0000","last_fullsized":"2024-05-08T18:33:33.882242+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'26","last_scrub_stamp":"2024-05-08T18:33:33.882037+0000","last_deep_scrub":"116'26","last_deep_scrub_stamp":"2024-05-08T18:33:33.882037+0000","last_clean_scrub_stamp":"2024-05-08T18:33:33.882037+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:39:23.547359+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":26,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"84'8","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:10.839004+0000","last_change":"2024-05-08T18:33:10.839068+0000","last_active":"2024-05-08T18:33:10.839004+0000","last_peered":"2024-05-08T18:33:10.839004+0000","last_clean":"2024-05-08T18:33:10.839004+0000","last_became_active":"2024-05-08T18:29:42.569917+0000","last_became_peered":"2024-05-08T18:29:42.569917+0000","last_unstale":"2024-05-08T18:33:10.839004+0000","last_undegraded":"2024-05-08T18:33:10.839004+0000","last_fullsized":"2024-05-08T18:33:10.839004+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'8","last_scrub_stamp":"2024-05-08T18:33:10.838811+0000","last_deep_scrub":"84'8","last_deep_scrub_stamp":"2024-05-08T18:33:10.838811+0000","last_clean_scrub_stamp":"2024-05-08T18:33:10.838811+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:56.522874+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"84'4","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:08.594718+0000","last_change":"2024-05-08T18:33:08.594781+0000","last_active":"2024-05-08T18:33:08.594718+0000","last_peered":"2024-05-08T18:33:08.594718+0000","last_clean":"2024-05-08T18:33:08.594718+0000","last_became_active":"2024-05-08T18:29:42.567399+0000","last_became_peered":"2024-05-08T18:29:42.567399+0000","last_unstale":"2024-05-08T18:33:08.594718+0000","last_undegraded":"2024-05-08T18:33:08.594718+0000","last_fullsized":"2024-05-08T18:33:08.594718+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'4","last_scrub_stamp":"2024-05-08T18:33:08.594504+0000","last_deep_scrub":"84'4","last_deep_scrub_stamp":"2024-05-08T18:33:08.594504+0000","last_clean_scrub_stamp":"2024-05-08T18:33:08.594504+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:09:29.470599+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"116'26","reported_seq":229,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:20.767491+0000","last_change":"2024-05-08T18:33:20.767550+0000","last_active":"2024-05-08T18:33:20.767491+0000","last_peered":"2024-05-08T18:33:20.767491+0000","last_clean":"2024-05-08T18:33:20.767491+0000","last_became_active":"2024-05-08T18:29:40.570600+0000","last_became_peered":"2024-05-08T18:29:40.570600+0000","last_unstale":"2024-05-08T18:33:20.767491+0000","last_undegraded":"2024-05-08T18:33:20.767491+0000","last_fullsized":"2024-05-08T18:33:20.767491+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'26","last_scrub_stamp":"2024-05-08T18:33:20.767294+0000","last_deep_scrub":"116'26","last_deep_scrub_stamp":"2024-05-08T18:33:20.767294+0000","last_clean_scrub_stamp":"2024-05-08T18:33:20.767294+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:51.554250+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":26,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"80'2","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.882258+0000","last_change":"2024-05-08T18:33:05.882328+0000","last_active":"2024-05-08T18:33:05.882258+0000","last_peered":"2024-05-08T18:33:05.882258+0000","last_clean":"2024-05-08T18:33:05.882258+0000","last_became_active":"2024-05-08T18:29:42.577789+0000","last_became_peered":"2024-05-08T18:29:42.577789+0000","last_unstale":"2024-05-08T18:33:05.882258+0000","last_undegraded":"2024-05-08T18:33:05.882258+0000","last_fullsized":"2024-05-08T18:33:05.882258+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2","last_scrub_stamp":"2024-05-08T18:33:05.881939+0000","last_deep_scrub":"80'2","last_deep_scrub_stamp":"2024-05-08T18:33:05.881939+0000","last_clean_scrub_stamp":"2024-05-08T18:33:05.881939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:10.795768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"116'16","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:19.650921+0000","last_change":"2024-05-08T18:33:19.650983+0000","last_active":"2024-05-08T18:33:19.650921+0000","last_peered":"2024-05-08T18:33:19.650921+0000","last_clean":"2024-05-08T18:33:19.650921+0000","last_became_active":"2024-05-08T18:29:40.569519+0000","last_became_peered":"2024-05-08T18:29:40.569519+0000","last_unstale":"2024-05-08T18:33:19.650921+0000","last_undegraded":"2024-05-08T18:33:19.650921+0000","last_fullsized":"2024-05-08T18:33:19.650921+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'16","last_scrub_stamp":"2024-05-08T18:33:19.650728+0000","last_deep_scrub":"116'16","last_deep_scrub_stamp":"2024-05-08T18:33:19.650728+0000","last_clean_scrub_stamp":"2024-05-08T18:33:19.650728+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:43.242905+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":201,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:09.203395+0000","last_change":"2024-05-08T18:33:09.203453+0000","last_active":"2024-05-08T18:33:09.203395+0000","last_peered":"2024-05-08T18:33:09.203395+0000","last_clean":"2024-05-08T18:33:09.203395+0000","last_became_active":"2024-05-08T18:29:42.562296+0000","last_became_peered":"2024-05-08T18:29:42.562296+0000","last_unstale":"2024-05-08T18:33:09.203395+0000","last_undegraded":"2024-05-08T18:33:09.203395+0000","last_fullsized":"2024-05-08T18:33:09.203395+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:09.203183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:09.203183+0000","last_clean_scrub_stamp":"2024-05-08T18:33:09.203183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:17:19.757932+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"116'28","reported_seq":231,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:17.577727+0000","last_change":"2024-05-08T18:33:17.577789+0000","last_active":"2024-05-08T18:33:17.577727+0000","last_peered":"2024-05-08T18:33:17.577727+0000","last_clean":"2024-05-08T18:33:17.577727+0000","last_became_active":"2024-05-08T18:29:40.563516+0000","last_became_peered":"2024-05-08T18:29:40.563516+0000","last_unstale":"2024-05-08T18:33:17.577727+0000","last_undegraded":"2024-05-08T18:33:17.577727+0000","last_fullsized":"2024-05-08T18:33:17.577727+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'28","last_scrub_stamp":"2024-05-08T18:33:17.577538+0000","last_deep_scrub":"116'28","last_deep_scrub_stamp":"2024-05-08T18:33:17.577538+0000","last_clean_scrub_stamp":"2024-05-08T18:33:17.577538+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:40:11.429520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":28,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"97'4","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:09.870748+0000","last_change":"2024-05-08T18:33:09.870828+0000","last_active":"2024-05-08T18:33:09.870748+0000","last_peered":"2024-05-08T18:33:09.870748+0000","last_clean":"2024-05-08T18:33:09.870748+0000","last_became_active":"2024-05-08T18:29:42.566256+0000","last_became_peered":"2024-05-08T18:29:42.566256+0000","last_unstale":"2024-05-08T18:33:09.870748+0000","last_undegraded":"2024-05-08T18:33:09.870748+0000","last_fullsized":"2024-05-08T18:33:09.870748+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'4","last_scrub_stamp":"2024-05-08T18:33:09.870499+0000","last_deep_scrub":"97'4","last_deep_scrub_stamp":"2024-05-08T18:33:09.870499+0000","last_clean_scrub_stamp":"2024-05-08T18:33:09.870499+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:20:44.539452+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"116'14","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:27.585824+0000","last_change":"2024-05-08T18:33:27.585884+0000","last_active":"2024-05-08T18:33:27.585824+0000","last_peered":"2024-05-08T18:33:27.585824+0000","last_clean":"2024-05-08T18:33:27.585824+0000","last_became_active":"2024-05-08T18:29:40.572250+0000","last_became_peered":"2024-05-08T18:29:40.572250+0000","last_unstale":"2024-05-08T18:33:27.585824+0000","last_undegraded":"2024-05-08T18:33:27.585824+0000","last_fullsized":"2024-05-08T18:33:27.585824+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'14","last_scrub_stamp":"2024-05-08T18:33:27.585623+0000","last_deep_scrub":"116'14","last_deep_scrub_stamp":"2024-05-08T18:33:27.585623+0000","last_clean_scrub_stamp":"2024-05-08T18:33:27.585623+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:41:28.580994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"97'6","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:11.868082+0000","last_change":"2024-05-08T18:33:11.868142+0000","last_active":"2024-05-08T18:33:11.868082+0000","last_peered":"2024-05-08T18:33:11.868082+0000","last_clean":"2024-05-08T18:33:11.868082+0000","last_became_active":"2024-05-08T18:29:42.570435+0000","last_became_peered":"2024-05-08T18:29:42.570435+0000","last_unstale":"2024-05-08T18:33:11.868082+0000","last_undegraded":"2024-05-08T18:33:11.868082+0000","last_fullsized":"2024-05-08T18:33:11.868082+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'6","last_scrub_stamp":"2024-05-08T18:33:11.867888+0000","last_deep_scrub":"97'6","last_deep_scrub_stamp":"2024-05-08T18:33:11.867888+0000","last_clean_scrub_stamp":"2024-05-08T18:33:11.867888+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:50:40.673319+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"116'14","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:26.913604+0000","last_change":"2024-05-08T18:33:26.913672+0000","last_active":"2024-05-08T18:33:26.913604+0000","last_peered":"2024-05-08T18:33:26.913604+0000","last_clean":"2024-05-08T18:33:26.913604+0000","last_became_active":"2024-05-08T18:29:40.566531+0000","last_became_peered":"2024-05-08T18:29:40.566531+0000","last_unstale":"2024-05-08T18:33:26.913604+0000","last_undegraded":"2024-05-08T18:33:26.913604+0000","last_fullsized":"2024-05-08T18:33:26.913604+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'14","last_scrub_stamp":"2024-05-08T18:33:26.913376+0000","last_deep_scrub":"116'14","last_deep_scrub_stamp":"2024-05-08T18:33:26.913376+0000","last_clean_scrub_stamp":"2024-05-08T18:33:26.913376+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:38:33.439457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"84'8","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:30.626970+0000","last_change":"2024-05-08T18:33:30.627096+0000","last_active":"2024-05-08T18:33:30.626970+0000","last_peered":"2024-05-08T18:33:30.626970+0000","last_clean":"2024-05-08T18:33:30.626970+0000","last_became_active":"2024-05-08T18:29:42.554115+0000","last_became_peered":"2024-05-08T18:29:42.554115+0000","last_unstale":"2024-05-08T18:33:30.626970+0000","last_undegraded":"2024-05-08T18:33:30.626970+0000","last_fullsized":"2024-05-08T18:33:30.626970+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'8","last_scrub_stamp":"2024-05-08T18:33:30.626667+0000","last_deep_scrub":"84'8","last_deep_scrub_stamp":"2024-05-08T18:33:30.626667+0000","last_clean_scrub_stamp":"2024-05-08T18:33:30.626667+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:34:15.298322+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"116'14","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:28.997133+0000","last_change":"2024-05-08T18:33:28.997202+0000","last_active":"2024-05-08T18:33:28.997133+0000","last_peered":"2024-05-08T18:33:28.997133+0000","last_clean":"2024-05-08T18:33:28.997133+0000","last_became_active":"2024-05-08T18:29:40.547384+0000","last_became_peered":"2024-05-08T18:29:40.547384+0000","last_unstale":"2024-05-08T18:33:28.997133+0000","last_undegraded":"2024-05-08T18:33:28.997133+0000","last_fullsized":"2024-05-08T18:33:28.997133+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'14","last_scrub_stamp":"2024-05-08T18:33:28.996924+0000","last_deep_scrub":"116'14","last_deep_scrub_stamp":"2024-05-08T18:33:28.996924+0000","last_clean_scrub_stamp":"2024-05-08T18:33:28.996924+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:58:20.971538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"97'10","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:38.636200+0000","last_change":"2024-05-08T18:33:38.636262+0000","last_active":"2024-05-08T18:33:38.636200+0000","last_peered":"2024-05-08T18:33:38.636200+0000","last_clean":"2024-05-08T18:33:38.636200+0000","last_became_active":"2024-05-08T18:29:50.684644+0000","last_became_peered":"2024-05-08T18:29:50.684644+0000","last_unstale":"2024-05-08T18:33:38.636200+0000","last_undegraded":"2024-05-08T18:33:38.636200+0000","last_fullsized":"2024-05-08T18:33:38.636200+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'10","last_scrub_stamp":"2024-05-08T18:33:38.635986+0000","last_deep_scrub":"97'10","last_deep_scrub_stamp":"2024-05-08T18:33:38.635986+0000","last_clean_scrub_stamp":"2024-05-08T18:33:38.635986+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:30:56.346909+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":21,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"84'10","reported_seq":221,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:14.794883+0000","last_change":"2024-05-08T18:33:14.794948+0000","last_active":"2024-05-08T18:33:14.794883+0000","last_peered":"2024-05-08T18:33:14.794883+0000","last_clean":"2024-05-08T18:33:14.794883+0000","last_became_active":"2024-05-08T18:29:42.573296+0000","last_became_peered":"2024-05-08T18:29:42.573296+0000","last_unstale":"2024-05-08T18:33:14.794883+0000","last_undegraded":"2024-05-08T18:33:14.794883+0000","last_fullsized":"2024-05-08T18:33:14.794883+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'10","last_scrub_stamp":"2024-05-08T18:33:14.794677+0000","last_deep_scrub":"84'10","last_deep_scrub_stamp":"2024-05-08T18:33:14.794677+0000","last_clean_scrub_stamp":"2024-05-08T18:33:14.794677+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:08:31.143567+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"116'16","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:26.909579+0000","last_change":"2024-05-08T18:33:26.909642+0000","last_active":"2024-05-08T18:33:26.909579+0000","last_peered":"2024-05-08T18:33:26.909579+0000","last_clean":"2024-05-08T18:33:26.909579+0000","last_became_active":"2024-05-08T18:29:40.569711+0000","last_became_peered":"2024-05-08T18:29:40.569711+0000","last_unstale":"2024-05-08T18:33:26.909579+0000","last_undegraded":"2024-05-08T18:33:26.909579+0000","last_fullsized":"2024-05-08T18:33:26.909579+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'16","last_scrub_stamp":"2024-05-08T18:33:26.909368+0000","last_deep_scrub":"116'16","last_deep_scrub_stamp":"2024-05-08T18:33:26.909368+0000","last_clean_scrub_stamp":"2024-05-08T18:33:26.909368+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:46:52.163993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":197,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:22.219620+0000","last_change":"2024-05-08T18:33:22.219676+0000","last_active":"2024-05-08T18:33:22.219620+0000","last_peered":"2024-05-08T18:33:22.219620+0000","last_clean":"2024-05-08T18:33:22.219620+0000","last_became_active":"2024-05-08T18:29:44.593442+0000","last_became_peered":"2024-05-08T18:29:44.593442+0000","last_unstale":"2024-05-08T18:33:22.219620+0000","last_undegraded":"2024-05-08T18:33:22.219620+0000","last_fullsized":"2024-05-08T18:33:22.219620+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:22.219421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:22.219421+0000","last_clean_scrub_stamp":"2024-05-08T18:33:22.219421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:48:23.857807+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"116'21","reported_seq":226,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:20.970599+0000","last_change":"2024-05-08T18:33:20.970765+0000","last_active":"2024-05-08T18:33:20.970599+0000","last_peered":"2024-05-08T18:33:20.970599+0000","last_clean":"2024-05-08T18:33:20.970599+0000","last_became_active":"2024-05-08T18:29:46.593656+0000","last_became_peered":"2024-05-08T18:29:46.593656+0000","last_unstale":"2024-05-08T18:33:20.970599+0000","last_undegraded":"2024-05-08T18:33:20.970599+0000","last_fullsized":"2024-05-08T18:33:20.970599+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'21","last_scrub_stamp":"2024-05-08T18:33:20.970347+0000","last_deep_scrub":"116'21","last_deep_scrub_stamp":"2024-05-08T18:33:20.970347+0000","last_clean_scrub_stamp":"2024-05-08T18:33:20.970347+0000","objects_scrubbed":4,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:30:48.124530+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":187,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:31.796705+0000","last_change":"2024-05-08T18:33:31.796812+0000","last_active":"2024-05-08T18:33:31.796705+0000","last_peered":"2024-05-08T18:33:31.796705+0000","last_clean":"2024-05-08T18:33:31.796705+0000","last_became_active":"2024-05-08T18:29:48.639122+0000","last_became_peered":"2024-05-08T18:29:48.639122+0000","last_unstale":"2024-05-08T18:33:31.796705+0000","last_undegraded":"2024-05-08T18:33:31.796705+0000","last_fullsized":"2024-05-08T18:33:31.796705+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:31.796417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:31.796417+0000","last_clean_scrub_stamp":"2024-05-08T18:33:31.796417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:02:32.410954+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"83'4","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:34.204649+0000","last_change":"2024-05-08T18:33:34.204718+0000","last_active":"2024-05-08T18:33:34.204649+0000","last_peered":"2024-05-08T18:33:34.204649+0000","last_clean":"2024-05-08T18:33:34.204649+0000","last_became_active":"2024-05-08T18:29:50.671513+0000","last_became_peered":"2024-05-08T18:29:50.671513+0000","last_unstale":"2024-05-08T18:33:34.204649+0000","last_undegraded":"2024-05-08T18:33:34.204649+0000","last_fullsized":"2024-05-08T18:33:34.204649+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'4","last_scrub_stamp":"2024-05-08T18:33:34.204444+0000","last_deep_scrub":"83'4","last_deep_scrub_stamp":"2024-05-08T18:33:34.204444+0000","last_clean_scrub_stamp":"2024-05-08T18:33:34.204444+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:05:05.603273+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"84'4","reported_seq":211,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:12.184669+0000","last_change":"2024-05-08T18:33:12.184791+0000","last_active":"2024-05-08T18:33:12.184669+0000","last_peered":"2024-05-08T18:33:12.184669+0000","last_clean":"2024-05-08T18:33:12.184669+0000","last_became_active":"2024-05-08T18:29:42.564741+0000","last_became_peered":"2024-05-08T18:29:42.564741+0000","last_unstale":"2024-05-08T18:33:12.184669+0000","last_undegraded":"2024-05-08T18:33:12.184669+0000","last_fullsized":"2024-05-08T18:33:12.184669+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'4","last_scrub_stamp":"2024-05-08T18:33:12.184342+0000","last_deep_scrub":"84'4","last_deep_scrub_stamp":"2024-05-08T18:33:12.184342+0000","last_clean_scrub_stamp":"2024-05-08T18:33:12.184342+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:59:53.143394+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"116'12","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:21.979037+0000","last_change":"2024-05-08T18:33:21.979109+0000","last_active":"2024-05-08T18:33:21.979037+0000","last_peered":"2024-05-08T18:33:21.979037+0000","last_clean":"2024-05-08T18:33:21.979037+0000","last_became_active":"2024-05-08T18:29:40.564401+0000","last_became_peered":"2024-05-08T18:29:40.564401+0000","last_unstale":"2024-05-08T18:33:21.979037+0000","last_undegraded":"2024-05-08T18:33:21.979037+0000","last_fullsized":"2024-05-08T18:33:21.979037+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'12","last_scrub_stamp":"2024-05-08T18:33:21.978790+0000","last_deep_scrub":"116'12","last_deep_scrub_stamp":"2024-05-08T18:33:21.978790+0000","last_clean_scrub_stamp":"2024-05-08T18:33:21.978790+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:57:21.573789+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":12,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:17.921554+0000","last_change":"2024-05-08T18:33:17.921691+0000","last_active":"2024-05-08T18:33:17.921554+0000","last_peered":"2024-05-08T18:33:17.921554+0000","last_clean":"2024-05-08T18:33:17.921554+0000","last_became_active":"2024-05-08T18:29:44.586975+0000","last_became_peered":"2024-05-08T18:29:44.586975+0000","last_unstale":"2024-05-08T18:33:17.921554+0000","last_undegraded":"2024-05-08T18:33:17.921554+0000","last_fullsized":"2024-05-08T18:33:17.921554+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:17.921326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:17.921326+0000","last_clean_scrub_stamp":"2024-05-08T18:33:17.921326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:14:35.491494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"116'10","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.583315+0000","last_change":"2024-05-08T18:33:06.583387+0000","last_active":"2024-05-08T18:33:06.583315+0000","last_peered":"2024-05-08T18:33:06.583315+0000","last_clean":"2024-05-08T18:33:06.583315+0000","last_became_active":"2024-05-08T18:29:46.599894+0000","last_became_peered":"2024-05-08T18:29:46.599894+0000","last_unstale":"2024-05-08T18:33:06.583315+0000","last_undegraded":"2024-05-08T18:33:06.583315+0000","last_fullsized":"2024-05-08T18:33:06.583315+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'10","last_scrub_stamp":"2024-05-08T18:33:06.583104+0000","last_deep_scrub":"116'10","last_deep_scrub_stamp":"2024-05-08T18:33:06.583104+0000","last_clean_scrub_stamp":"2024-05-08T18:33:06.583104+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:54:55.506347+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:32.629675+0000","last_change":"2024-05-08T18:33:32.629793+0000","last_active":"2024-05-08T18:33:32.629675+0000","last_peered":"2024-05-08T18:33:32.629675+0000","last_clean":"2024-05-08T18:33:32.629675+0000","last_became_active":"2024-05-08T18:29:48.613591+0000","last_became_peered":"2024-05-08T18:29:48.613591+0000","last_unstale":"2024-05-08T18:33:32.629675+0000","last_undegraded":"2024-05-08T18:33:32.629675+0000","last_fullsized":"2024-05-08T18:33:32.629675+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:32.629338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:32.629338+0000","last_clean_scrub_stamp":"2024-05-08T18:33:32.629338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:12:00.347817+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:38.926472+0000","last_change":"2024-05-08T18:33:38.926533+0000","last_active":"2024-05-08T18:33:38.926472+0000","last_peered":"2024-05-08T18:33:38.926472+0000","last_clean":"2024-05-08T18:33:38.926472+0000","last_became_active":"2024-05-08T18:29:50.683931+0000","last_became_peered":"2024-05-08T18:29:50.683931+0000","last_unstale":"2024-05-08T18:33:38.926472+0000","last_undegraded":"2024-05-08T18:33:38.926472+0000","last_fullsized":"2024-05-08T18:33:38.926472+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:38.926271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:38.926271+0000","last_clean_scrub_stamp":"2024-05-08T18:33:38.926271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:11:18.055475+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"80'2","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:09.872452+0000","last_change":"2024-05-08T18:33:09.872511+0000","last_active":"2024-05-08T18:33:09.872452+0000","last_peered":"2024-05-08T18:33:09.872452+0000","last_clean":"2024-05-08T18:33:09.872452+0000","last_became_active":"2024-05-08T18:29:42.574146+0000","last_became_peered":"2024-05-08T18:29:42.574146+0000","last_unstale":"2024-05-08T18:33:09.872452+0000","last_undegraded":"2024-05-08T18:33:09.872452+0000","last_fullsized":"2024-05-08T18:33:09.872452+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2","last_scrub_stamp":"2024-05-08T18:33:09.872256+0000","last_deep_scrub":"80'2","last_deep_scrub_stamp":"2024-05-08T18:33:09.872256+0000","last_clean_scrub_stamp":"2024-05-08T18:33:09.872256+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:30:36.066739+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"116'22","reported_seq":225,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:24.854104+0000","last_change":"2024-05-08T18:33:24.854183+0000","last_active":"2024-05-08T18:33:24.854104+0000","last_peered":"2024-05-08T18:33:24.854104+0000","last_clean":"2024-05-08T18:33:24.854104+0000","last_became_active":"2024-05-08T18:29:40.558819+0000","last_became_peered":"2024-05-08T18:29:40.558819+0000","last_unstale":"2024-05-08T18:33:24.854104+0000","last_undegraded":"2024-05-08T18:33:24.854104+0000","last_fullsized":"2024-05-08T18:33:24.854104+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'22","last_scrub_stamp":"2024-05-08T18:33:24.853877+0000","last_deep_scrub":"116'22","last_deep_scrub_stamp":"2024-05-08T18:33:24.853877+0000","last_clean_scrub_stamp":"2024-05-08T18:33:24.853877+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:17:56.512756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:21.880116+0000","last_change":"2024-05-08T18:33:21.880169+0000","last_active":"2024-05-08T18:33:21.880116+0000","last_peered":"2024-05-08T18:33:21.880116+0000","last_clean":"2024-05-08T18:33:21.880116+0000","last_became_active":"2024-05-08T18:29:44.596111+0000","last_became_peered":"2024-05-08T18:29:44.596111+0000","last_unstale":"2024-05-08T18:33:21.880116+0000","last_undegraded":"2024-05-08T18:33:21.880116+0000","last_fullsized":"2024-05-08T18:33:21.880116+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:21.879917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:21.879917+0000","last_clean_scrub_stamp":"2024-05-08T18:33:21.879917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:21:54.300678+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"116'15","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:15.807678+0000","last_change":"2024-05-08T18:33:15.807752+0000","last_active":"2024-05-08T18:33:15.807678+0000","last_peered":"2024-05-08T18:33:15.807678+0000","last_clean":"2024-05-08T18:33:15.807678+0000","last_became_active":"2024-05-08T18:29:46.607580+0000","last_became_peered":"2024-05-08T18:29:46.607580+0000","last_unstale":"2024-05-08T18:33:15.807678+0000","last_undegraded":"2024-05-08T18:33:15.807678+0000","last_fullsized":"2024-05-08T18:33:15.807678+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'15","last_scrub_stamp":"2024-05-08T18:33:15.807477+0000","last_deep_scrub":"116'15","last_deep_scrub_stamp":"2024-05-08T18:33:15.807477+0000","last_clean_scrub_stamp":"2024-05-08T18:33:15.807477+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:29:42.418270+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"116'106","reported_seq":420,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:32.772140+0000","last_change":"2024-05-08T18:33:32.772213+0000","last_active":"2024-05-08T18:33:32.772140+0000","last_peered":"2024-05-08T18:33:32.772140+0000","last_clean":"2024-05-08T18:33:32.772140+0000","last_became_active":"2024-05-08T18:29:48.641950+0000","last_became_peered":"2024-05-08T18:29:48.641950+0000","last_unstale":"2024-05-08T18:33:32.772140+0000","last_undegraded":"2024-05-08T18:33:32.772140+0000","last_fullsized":"2024-05-08T18:33:32.772140+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'106","last_scrub_stamp":"2024-05-08T18:33:32.771924+0000","last_deep_scrub":"116'106","last_deep_scrub_stamp":"2024-05-08T18:33:32.771924+0000","last_clean_scrub_stamp":"2024-05-08T18:33:32.771924+0000","objects_scrubbed":1,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:12:00.490403+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"84'2","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:35.602397+0000","last_change":"2024-05-08T18:33:35.602461+0000","last_active":"2024-05-08T18:33:35.602397+0000","last_peered":"2024-05-08T18:33:35.602397+0000","last_clean":"2024-05-08T18:33:35.602397+0000","last_became_active":"2024-05-08T18:29:50.659649+0000","last_became_peered":"2024-05-08T18:29:50.659649+0000","last_unstale":"2024-05-08T18:33:35.602397+0000","last_undegraded":"2024-05-08T18:33:35.602397+0000","last_fullsized":"2024-05-08T18:33:35.602397+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'2","last_scrub_stamp":"2024-05-08T18:33:35.602180+0000","last_deep_scrub":"84'2","last_deep_scrub_stamp":"2024-05-08T18:33:35.602180+0000","last_clean_scrub_stamp":"2024-05-08T18:33:35.602180+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:44:39.591161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"80'2","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:13.752038+0000","last_change":"2024-05-08T18:33:13.752106+0000","last_active":"2024-05-08T18:33:13.752038+0000","last_peered":"2024-05-08T18:33:13.752038+0000","last_clean":"2024-05-08T18:33:13.752038+0000","last_became_active":"2024-05-08T18:29:42.576740+0000","last_became_peered":"2024-05-08T18:29:42.576740+0000","last_unstale":"2024-05-08T18:33:13.752038+0000","last_undegraded":"2024-05-08T18:33:13.752038+0000","last_fullsized":"2024-05-08T18:33:13.752038+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2","last_scrub_stamp":"2024-05-08T18:33:13.751819+0000","last_deep_scrub":"80'2","last_deep_scrub_stamp":"2024-05-08T18:33:13.751819+0000","last_clean_scrub_stamp":"2024-05-08T18:33:13.751819+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:59:49.632385+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"116'10","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:13.497002+0000","last_change":"2024-05-08T18:33:13.497066+0000","last_active":"2024-05-08T18:33:13.497002+0000","last_peered":"2024-05-08T18:33:13.497002+0000","last_clean":"2024-05-08T18:33:13.497002+0000","last_became_active":"2024-05-08T18:29:40.545749+0000","last_became_peered":"2024-05-08T18:29:40.545749+0000","last_unstale":"2024-05-08T18:33:13.497002+0000","last_undegraded":"2024-05-08T18:33:13.497002+0000","last_fullsized":"2024-05-08T18:33:13.497002+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'10","last_scrub_stamp":"2024-05-08T18:33:13.496806+0000","last_deep_scrub":"116'10","last_deep_scrub_stamp":"2024-05-08T18:33:13.496806+0000","last_clean_scrub_stamp":"2024-05-08T18:33:13.496806+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:49:28.691835+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":197,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:18.158846+0000","last_change":"2024-05-08T18:33:18.158948+0000","last_active":"2024-05-08T18:33:18.158846+0000","last_peered":"2024-05-08T18:33:18.158846+0000","last_clean":"2024-05-08T18:33:18.158846+0000","last_became_active":"2024-05-08T18:29:44.578142+0000","last_became_peered":"2024-05-08T18:29:44.578142+0000","last_unstale":"2024-05-08T18:33:18.158846+0000","last_undegraded":"2024-05-08T18:33:18.158846+0000","last_fullsized":"2024-05-08T18:33:18.158846+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:18.158547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:18.158547+0000","last_clean_scrub_stamp":"2024-05-08T18:33:18.158547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:28.957097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"116'21","reported_seq":223,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:04.925986+0000","last_change":"2024-05-08T18:33:04.926174+0000","last_active":"2024-05-08T18:33:04.925986+0000","last_peered":"2024-05-08T18:33:04.925986+0000","last_clean":"2024-05-08T18:33:04.925986+0000","last_became_active":"2024-05-08T18:29:46.605154+0000","last_became_peered":"2024-05-08T18:29:46.605154+0000","last_unstale":"2024-05-08T18:33:04.925986+0000","last_undegraded":"2024-05-08T18:33:04.925986+0000","last_fullsized":"2024-05-08T18:33:04.925986+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'21","last_scrub_stamp":"2024-05-08T18:33:04.925757+0000","last_deep_scrub":"116'21","last_deep_scrub_stamp":"2024-05-08T18:33:04.925757+0000","last_clean_scrub_stamp":"2024-05-08T18:33:04.925757+0000","objects_scrubbed":4,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:00:52.304684+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"116'105","reported_seq":338,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:02.698371+0000","last_change":"2024-05-08T18:33:02.698393+0000","last_active":"2024-05-08T18:33:02.698371+0000","last_peered":"2024-05-08T18:33:02.698371+0000","last_clean":"2024-05-08T18:33:02.698371+0000","last_became_active":"2024-05-08T18:29:48.633858+0000","last_became_peered":"2024-05-08T18:29:48.633858+0000","last_unstale":"2024-05-08T18:33:02.698371+0000","last_undegraded":"2024-05-08T18:33:02.698371+0000","last_fullsized":"2024-05-08T18:33:02.698371+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'105","last_scrub_stamp":"2024-05-08T18:33:02.698295+0000","last_deep_scrub":"116'105","last_deep_scrub_stamp":"2024-05-08T18:33:02.698295+0000","last_clean_scrub_stamp":"2024-05-08T18:33:02.698295+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:16:39.917082+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"84'8","reported_seq":221,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:14.196696+0000","last_change":"2024-05-08T18:33:14.196755+0000","last_active":"2024-05-08T18:33:14.196696+0000","last_peered":"2024-05-08T18:33:14.196696+0000","last_clean":"2024-05-08T18:33:14.196696+0000","last_became_active":"2024-05-08T18:29:42.566974+0000","last_became_peered":"2024-05-08T18:29:42.566974+0000","last_unstale":"2024-05-08T18:33:14.196696+0000","last_undegraded":"2024-05-08T18:33:14.196696+0000","last_fullsized":"2024-05-08T18:33:14.196696+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'8","last_scrub_stamp":"2024-05-08T18:33:14.196495+0000","last_deep_scrub":"84'8","last_deep_scrub_stamp":"2024-05-08T18:33:14.196495+0000","last_clean_scrub_stamp":"2024-05-08T18:33:14.196495+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:27:49.937242+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"116'20","reported_seq":223,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:18.798043+0000","last_change":"2024-05-08T18:33:18.798113+0000","last_active":"2024-05-08T18:33:18.798043+0000","last_peered":"2024-05-08T18:33:18.798043+0000","last_clean":"2024-05-08T18:33:18.798043+0000","last_became_active":"2024-05-08T18:29:40.571322+0000","last_became_peered":"2024-05-08T18:29:40.571322+0000","last_unstale":"2024-05-08T18:33:18.798043+0000","last_undegraded":"2024-05-08T18:33:18.798043+0000","last_fullsized":"2024-05-08T18:33:18.798043+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'20","last_scrub_stamp":"2024-05-08T18:33:18.797835+0000","last_deep_scrub":"116'20","last_deep_scrub_stamp":"2024-05-08T18:33:18.797835+0000","last_clean_scrub_stamp":"2024-05-08T18:33:18.797835+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:29.596385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:13.814686+0000","last_change":"2024-05-08T18:33:13.814845+0000","last_active":"2024-05-08T18:33:13.814686+0000","last_peered":"2024-05-08T18:33:13.814686+0000","last_clean":"2024-05-08T18:33:13.814686+0000","last_became_active":"2024-05-08T18:29:44.596282+0000","last_became_peered":"2024-05-08T18:29:44.596282+0000","last_unstale":"2024-05-08T18:33:13.814686+0000","last_undegraded":"2024-05-08T18:33:13.814686+0000","last_fullsized":"2024-05-08T18:33:13.814686+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:13.814456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:13.814456+0000","last_clean_scrub_stamp":"2024-05-08T18:33:13.814456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:22:28.063238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"116'37","reported_seq":246,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:07.224224+0000","last_change":"2024-05-08T18:33:07.224306+0000","last_active":"2024-05-08T18:33:07.224224+0000","last_peered":"2024-05-08T18:33:07.224224+0000","last_clean":"2024-05-08T18:33:07.224224+0000","last_became_active":"2024-05-08T18:29:46.589600+0000","last_became_peered":"2024-05-08T18:29:46.589600+0000","last_unstale":"2024-05-08T18:33:07.224224+0000","last_undegraded":"2024-05-08T18:33:07.224224+0000","last_fullsized":"2024-05-08T18:33:07.224224+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'37","last_scrub_stamp":"2024-05-08T18:33:07.224017+0000","last_deep_scrub":"116'37","last_deep_scrub_stamp":"2024-05-08T18:33:07.224017+0000","last_clean_scrub_stamp":"2024-05-08T18:33:07.224017+0000","objects_scrubbed":9,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:30.816195+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":38,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:12.794921+0000","last_change":"2024-05-08T18:33:12.794980+0000","last_active":"2024-05-08T18:33:12.794921+0000","last_peered":"2024-05-08T18:33:12.794921+0000","last_clean":"2024-05-08T18:33:12.794921+0000","last_became_active":"2024-05-08T18:29:48.630017+0000","last_became_peered":"2024-05-08T18:29:48.630017+0000","last_unstale":"2024-05-08T18:33:12.794921+0000","last_undegraded":"2024-05-08T18:33:12.794921+0000","last_fullsized":"2024-05-08T18:33:12.794921+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:12.794729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:12.794729+0000","last_clean_scrub_stamp":"2024-05-08T18:33:12.794729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:20:16.477743+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"97'14","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:35.194041+0000","last_change":"2024-05-08T18:33:35.194182+0000","last_active":"2024-05-08T18:33:35.194041+0000","last_peered":"2024-05-08T18:33:35.194041+0000","last_clean":"2024-05-08T18:33:35.194041+0000","last_became_active":"2024-05-08T18:29:50.671923+0000","last_became_peered":"2024-05-08T18:29:50.671923+0000","last_unstale":"2024-05-08T18:33:35.194041+0000","last_undegraded":"2024-05-08T18:33:35.194041+0000","last_fullsized":"2024-05-08T18:33:35.194041+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'14","last_scrub_stamp":"2024-05-08T18:33:35.193743+0000","last_deep_scrub":"97'14","last_deep_scrub_stamp":"2024-05-08T18:33:35.193743+0000","last_clean_scrub_stamp":"2024-05-08T18:33:35.193743+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:44:39.182723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":39,"num_write":35,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"80'2","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:29.637016+0000","last_change":"2024-05-08T18:33:29.637105+0000","last_active":"2024-05-08T18:33:29.637016+0000","last_peered":"2024-05-08T18:33:29.637016+0000","last_clean":"2024-05-08T18:33:29.637016+0000","last_became_active":"2024-05-08T18:29:42.553574+0000","last_became_peered":"2024-05-08T18:29:42.553574+0000","last_unstale":"2024-05-08T18:33:29.637016+0000","last_undegraded":"2024-05-08T18:33:29.637016+0000","last_fullsized":"2024-05-08T18:33:29.637016+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2","last_scrub_stamp":"2024-05-08T18:33:29.636811+0000","last_deep_scrub":"80'2","last_deep_scrub_stamp":"2024-05-08T18:33:29.636811+0000","last_clean_scrub_stamp":"2024-05-08T18:33:29.636811+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:09:19.325925+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"116'14","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:25.862988+0000","last_change":"2024-05-08T18:33:25.863116+0000","last_active":"2024-05-08T18:33:25.862988+0000","last_peered":"2024-05-08T18:33:25.862988+0000","last_clean":"2024-05-08T18:33:25.862988+0000","last_became_active":"2024-05-08T18:29:40.569542+0000","last_became_peered":"2024-05-08T18:29:40.569542+0000","last_unstale":"2024-05-08T18:33:25.862988+0000","last_undegraded":"2024-05-08T18:33:25.862988+0000","last_fullsized":"2024-05-08T18:33:25.862988+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'14","last_scrub_stamp":"2024-05-08T18:33:25.862694+0000","last_deep_scrub":"116'14","last_deep_scrub_stamp":"2024-05-08T18:33:25.862694+0000","last_clean_scrub_stamp":"2024-05-08T18:33:25.862694+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:10:45.159561+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"116'2","reported_seq":269,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:02.781390+0000","last_change":"2024-05-08T18:33:02.781414+0000","last_active":"2024-05-08T18:33:02.781390+0000","last_peered":"2024-05-08T18:33:02.781390+0000","last_clean":"2024-05-08T18:33:02.781390+0000","last_became_active":"2024-05-08T18:29:44.579152+0000","last_became_peered":"2024-05-08T18:29:44.579152+0000","last_unstale":"2024-05-08T18:33:02.781390+0000","last_undegraded":"2024-05-08T18:33:02.781390+0000","last_fullsized":"2024-05-08T18:33:02.781390+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'2","last_scrub_stamp":"2024-05-08T18:33:02.781323+0000","last_deep_scrub":"116'2","last_deep_scrub_stamp":"2024-05-08T18:33:02.781323+0000","last_clean_scrub_stamp":"2024-05-08T18:33:02.781323+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:11:25.963703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":103,"num_read_kb":103,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"116'21","reported_seq":226,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:07.809440+0000","last_change":"2024-05-08T18:33:07.809524+0000","last_active":"2024-05-08T18:33:07.809440+0000","last_peered":"2024-05-08T18:33:07.809440+0000","last_clean":"2024-05-08T18:33:07.809440+0000","last_became_active":"2024-05-08T18:29:46.599464+0000","last_became_peered":"2024-05-08T18:29:46.599464+0000","last_unstale":"2024-05-08T18:33:07.809440+0000","last_undegraded":"2024-05-08T18:33:07.809440+0000","last_fullsized":"2024-05-08T18:33:07.809440+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'21","last_scrub_stamp":"2024-05-08T18:33:07.809266+0000","last_deep_scrub":"116'21","last_deep_scrub_stamp":"2024-05-08T18:33:07.809266+0000","last_clean_scrub_stamp":"2024-05-08T18:33:07.809266+0000","objects_scrubbed":4,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:24:13.075844+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.734746+0000","last_change":"2024-05-08T18:33:05.734803+0000","last_active":"2024-05-08T18:33:05.734746+0000","last_peered":"2024-05-08T18:33:05.734746+0000","last_clean":"2024-05-08T18:33:05.734746+0000","last_became_active":"2024-05-08T18:29:48.637231+0000","last_became_peered":"2024-05-08T18:29:48.637231+0000","last_unstale":"2024-05-08T18:33:05.734746+0000","last_undegraded":"2024-05-08T18:33:05.734746+0000","last_fullsized":"2024-05-08T18:33:05.734746+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:05.734539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:05.734539+0000","last_clean_scrub_stamp":"2024-05-08T18:33:05.734539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:46:45.338085+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:26.801435+0000","last_change":"2024-05-08T18:33:26.801493+0000","last_active":"2024-05-08T18:33:26.801435+0000","last_peered":"2024-05-08T18:33:26.801435+0000","last_clean":"2024-05-08T18:33:26.801435+0000","last_became_active":"2024-05-08T18:29:50.681287+0000","last_became_peered":"2024-05-08T18:29:50.681287+0000","last_unstale":"2024-05-08T18:33:26.801435+0000","last_undegraded":"2024-05-08T18:33:26.801435+0000","last_fullsized":"2024-05-08T18:33:26.801435+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:26.801216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:26.801216+0000","last_clean_scrub_stamp":"2024-05-08T18:33:26.801216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:28:02.541962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:09.637651+0000","last_change":"2024-05-08T18:33:09.637705+0000","last_active":"2024-05-08T18:33:09.637651+0000","last_peered":"2024-05-08T18:33:09.637651+0000","last_clean":"2024-05-08T18:33:09.637651+0000","last_became_active":"2024-05-08T18:29:42.562267+0000","last_became_peered":"2024-05-08T18:29:42.562267+0000","last_unstale":"2024-05-08T18:33:09.637651+0000","last_undegraded":"2024-05-08T18:33:09.637651+0000","last_fullsized":"2024-05-08T18:33:09.637651+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:09.637432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:09.637432+0000","last_clean_scrub_stamp":"2024-05-08T18:33:09.637432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:55:41.051450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"116'14","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:27.929308+0000","last_change":"2024-05-08T18:33:27.929373+0000","last_active":"2024-05-08T18:33:27.929308+0000","last_peered":"2024-05-08T18:33:27.929308+0000","last_clean":"2024-05-08T18:33:27.929308+0000","last_became_active":"2024-05-08T18:29:40.569626+0000","last_became_peered":"2024-05-08T18:29:40.569626+0000","last_unstale":"2024-05-08T18:33:27.929308+0000","last_undegraded":"2024-05-08T18:33:27.929308+0000","last_fullsized":"2024-05-08T18:33:27.929308+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'14","last_scrub_stamp":"2024-05-08T18:33:27.929088+0000","last_deep_scrub":"116'14","last_deep_scrub_stamp":"2024-05-08T18:33:27.929088+0000","last_clean_scrub_stamp":"2024-05-08T18:33:27.929088+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:35:05.483754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"116'2","reported_seq":269,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:01.734830+0000","last_change":"2024-05-08T18:33:01.734888+0000","last_active":"2024-05-08T18:33:01.734830+0000","last_peered":"2024-05-08T18:33:01.734830+0000","last_clean":"2024-05-08T18:33:01.734830+0000","last_became_active":"2024-05-08T18:29:44.581067+0000","last_became_peered":"2024-05-08T18:29:44.581067+0000","last_unstale":"2024-05-08T18:33:01.734830+0000","last_undegraded":"2024-05-08T18:33:01.734830+0000","last_fullsized":"2024-05-08T18:33:01.734830+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'2","last_scrub_stamp":"2024-05-08T18:33:01.734695+0000","last_deep_scrub":"116'2","last_deep_scrub_stamp":"2024-05-08T18:33:01.734695+0000","last_clean_scrub_stamp":"2024-05-08T18:33:01.734695+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:54:31.021761+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":103,"num_read_kb":103,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"116'30","reported_seq":235,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:17.836614+0000","last_change":"2024-05-08T18:33:17.836706+0000","last_active":"2024-05-08T18:33:17.836614+0000","last_peered":"2024-05-08T18:33:17.836614+0000","last_clean":"2024-05-08T18:33:17.836614+0000","last_became_active":"2024-05-08T18:29:46.604966+0000","last_became_peered":"2024-05-08T18:29:46.604966+0000","last_unstale":"2024-05-08T18:33:17.836614+0000","last_undegraded":"2024-05-08T18:33:17.836614+0000","last_fullsized":"2024-05-08T18:33:17.836614+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'30","last_scrub_stamp":"2024-05-08T18:33:17.836365+0000","last_deep_scrub":"116'30","last_deep_scrub_stamp":"2024-05-08T18:33:17.836365+0000","last_clean_scrub_stamp":"2024-05-08T18:33:17.836365+0000","objects_scrubbed":7,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:58:12.818926+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"116'105","reported_seq":338,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:02.926992+0000","last_change":"2024-05-08T18:33:02.927044+0000","last_active":"2024-05-08T18:33:02.926992+0000","last_peered":"2024-05-08T18:33:02.926992+0000","last_clean":"2024-05-08T18:33:02.926992+0000","last_became_active":"2024-05-08T18:29:48.637758+0000","last_became_peered":"2024-05-08T18:29:48.637758+0000","last_unstale":"2024-05-08T18:33:02.926992+0000","last_undegraded":"2024-05-08T18:33:02.926992+0000","last_fullsized":"2024-05-08T18:33:02.926992+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'105","last_scrub_stamp":"2024-05-08T18:33:02.926903+0000","last_deep_scrub":"116'105","last_deep_scrub_stamp":"2024-05-08T18:33:02.926903+0000","last_clean_scrub_stamp":"2024-05-08T18:33:02.926903+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:16:40.145690+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"97'2","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:37.923632+0000","last_change":"2024-05-08T18:33:37.923697+0000","last_active":"2024-05-08T18:33:37.923632+0000","last_peered":"2024-05-08T18:33:37.923632+0000","last_clean":"2024-05-08T18:33:37.923632+0000","last_became_active":"2024-05-08T18:29:50.683738+0000","last_became_peered":"2024-05-08T18:29:50.683738+0000","last_unstale":"2024-05-08T18:33:37.923632+0000","last_undegraded":"2024-05-08T18:33:37.923632+0000","last_fullsized":"2024-05-08T18:33:37.923632+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'2","last_scrub_stamp":"2024-05-08T18:33:37.923404+0000","last_deep_scrub":"97'2","last_deep_scrub_stamp":"2024-05-08T18:33:37.923404+0000","last_clean_scrub_stamp":"2024-05-08T18:33:37.923404+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:32:46.407112+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"84'4","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:13.867910+0000","last_change":"2024-05-08T18:33:13.867977+0000","last_active":"2024-05-08T18:33:13.867910+0000","last_peered":"2024-05-08T18:33:13.867910+0000","last_clean":"2024-05-08T18:33:13.867910+0000","last_became_active":"2024-05-08T18:29:42.568659+0000","last_became_peered":"2024-05-08T18:29:42.568659+0000","last_unstale":"2024-05-08T18:33:13.867910+0000","last_undegraded":"2024-05-08T18:33:13.867910+0000","last_fullsized":"2024-05-08T18:33:13.867910+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'4","last_scrub_stamp":"2024-05-08T18:33:13.867699+0000","last_deep_scrub":"84'4","last_deep_scrub_stamp":"2024-05-08T18:33:13.867699+0000","last_clean_scrub_stamp":"2024-05-08T18:33:13.867699+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:59:49.748265+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"116'14","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:21.202198+0000","last_change":"2024-05-08T18:33:21.202257+0000","last_active":"2024-05-08T18:33:21.202198+0000","last_peered":"2024-05-08T18:33:21.202198+0000","last_clean":"2024-05-08T18:33:21.202198+0000","last_became_active":"2024-05-08T18:29:40.555805+0000","last_became_peered":"2024-05-08T18:29:40.555805+0000","last_unstale":"2024-05-08T18:33:21.202198+0000","last_undegraded":"2024-05-08T18:33:21.202198+0000","last_fullsized":"2024-05-08T18:33:21.202198+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'14","last_scrub_stamp":"2024-05-08T18:33:21.201977+0000","last_deep_scrub":"116'14","last_deep_scrub_stamp":"2024-05-08T18:33:21.201977+0000","last_clean_scrub_stamp":"2024-05-08T18:33:21.201977+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:04:12.285635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":3,"num_write":24,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:04.731843+0000","last_change":"2024-05-08T18:33:04.731900+0000","last_active":"2024-05-08T18:33:04.731843+0000","last_peered":"2024-05-08T18:33:04.731843+0000","last_clean":"2024-05-08T18:33:04.731843+0000","last_became_active":"2024-05-08T18:29:44.573308+0000","last_became_peered":"2024-05-08T18:29:44.573308+0000","last_unstale":"2024-05-08T18:33:04.731843+0000","last_undegraded":"2024-05-08T18:33:04.731843+0000","last_fullsized":"2024-05-08T18:33:04.731843+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:04.731641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:04.731641+0000","last_clean_scrub_stamp":"2024-05-08T18:33:04.731641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:30:20.352782+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"116'33","reported_seq":246,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:22.966261+0000","last_change":"2024-05-08T18:33:22.966338+0000","last_active":"2024-05-08T18:33:22.966261+0000","last_peered":"2024-05-08T18:33:22.966261+0000","last_clean":"2024-05-08T18:33:22.966261+0000","last_became_active":"2024-05-08T18:29:46.594930+0000","last_became_peered":"2024-05-08T18:29:46.594930+0000","last_unstale":"2024-05-08T18:33:22.966261+0000","last_undegraded":"2024-05-08T18:33:22.966261+0000","last_fullsized":"2024-05-08T18:33:22.966261+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'33","last_scrub_stamp":"2024-05-08T18:33:22.966074+0000","last_deep_scrub":"116'33","last_deep_scrub_stamp":"2024-05-08T18:33:22.966074+0000","last_clean_scrub_stamp":"2024-05-08T18:33:22.966074+0000","objects_scrubbed":5,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:24:49.380085+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":28,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:17.773574+0000","last_change":"2024-05-08T18:33:17.773635+0000","last_active":"2024-05-08T18:33:17.773574+0000","last_peered":"2024-05-08T18:33:17.773574+0000","last_clean":"2024-05-08T18:33:17.773574+0000","last_became_active":"2024-05-08T18:29:48.637370+0000","last_became_peered":"2024-05-08T18:29:48.637370+0000","last_unstale":"2024-05-08T18:33:17.773574+0000","last_undegraded":"2024-05-08T18:33:17.773574+0000","last_fullsized":"2024-05-08T18:33:17.773574+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:17.773375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:17.773375+0000","last_clean_scrub_stamp":"2024-05-08T18:33:17.773375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:46.627777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"83'2","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:27.770776+0000","last_change":"2024-05-08T18:33:27.770839+0000","last_active":"2024-05-08T18:33:27.770776+0000","last_peered":"2024-05-08T18:33:27.770776+0000","last_clean":"2024-05-08T18:33:27.770776+0000","last_became_active":"2024-05-08T18:29:50.687960+0000","last_became_peered":"2024-05-08T18:29:50.687960+0000","last_unstale":"2024-05-08T18:33:27.770776+0000","last_undegraded":"2024-05-08T18:33:27.770776+0000","last_fullsized":"2024-05-08T18:33:27.770776+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'2","last_scrub_stamp":"2024-05-08T18:33:27.770549+0000","last_deep_scrub":"83'2","last_deep_scrub_stamp":"2024-05-08T18:33:27.770549+0000","last_clean_scrub_stamp":"2024-05-08T18:33:27.770549+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:48:29.408935+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"97'4","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:22.494045+0000","last_change":"2024-05-08T18:33:22.494107+0000","last_active":"2024-05-08T18:33:22.494045+0000","last_peered":"2024-05-08T18:33:22.494045+0000","last_clean":"2024-05-08T18:33:22.494045+0000","last_became_active":"2024-05-08T18:29:42.557119+0000","last_became_peered":"2024-05-08T18:29:42.557119+0000","last_unstale":"2024-05-08T18:33:22.494045+0000","last_undegraded":"2024-05-08T18:33:22.494045+0000","last_fullsized":"2024-05-08T18:33:22.494045+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'4","last_scrub_stamp":"2024-05-08T18:33:22.493832+0000","last_deep_scrub":"97'4","last_deep_scrub_stamp":"2024-05-08T18:33:22.493832+0000","last_clean_scrub_stamp":"2024-05-08T18:33:22.493832+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:48:24.132218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"116'16","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:27.918684+0000","last_change":"2024-05-08T18:33:27.918811+0000","last_active":"2024-05-08T18:33:27.918684+0000","last_peered":"2024-05-08T18:33:27.918684+0000","last_clean":"2024-05-08T18:33:27.918684+0000","last_became_active":"2024-05-08T18:29:40.544215+0000","last_became_peered":"2024-05-08T18:29:40.544215+0000","last_unstale":"2024-05-08T18:33:27.918684+0000","last_undegraded":"2024-05-08T18:33:27.918684+0000","last_fullsized":"2024-05-08T18:33:27.918684+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'16","last_scrub_stamp":"2024-05-08T18:33:27.918395+0000","last_deep_scrub":"116'16","last_deep_scrub_stamp":"2024-05-08T18:33:27.918395+0000","last_clean_scrub_stamp":"2024-05-08T18:33:27.918395+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:24:20.383836+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:13.851808+0000","last_change":"2024-05-08T18:33:13.851866+0000","last_active":"2024-05-08T18:33:13.851808+0000","last_peered":"2024-05-08T18:33:13.851808+0000","last_clean":"2024-05-08T18:33:13.851808+0000","last_became_active":"2024-05-08T18:29:44.587822+0000","last_became_peered":"2024-05-08T18:29:44.587822+0000","last_unstale":"2024-05-08T18:33:13.851808+0000","last_undegraded":"2024-05-08T18:33:13.851808+0000","last_fullsized":"2024-05-08T18:33:13.851808+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:13.851609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:13.851609+0000","last_clean_scrub_stamp":"2024-05-08T18:33:13.851609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:47.600784+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"116'27","reported_seq":235,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:03.645710+0000","last_change":"2024-05-08T18:33:03.645896+0000","last_active":"2024-05-08T18:33:03.645710+0000","last_peered":"2024-05-08T18:33:03.645710+0000","last_clean":"2024-05-08T18:33:03.645710+0000","last_became_active":"2024-05-08T18:29:46.602801+0000","last_became_peered":"2024-05-08T18:29:46.602801+0000","last_unstale":"2024-05-08T18:33:03.645710+0000","last_undegraded":"2024-05-08T18:33:03.645710+0000","last_fullsized":"2024-05-08T18:33:03.645710+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'27","last_scrub_stamp":"2024-05-08T18:33:03.645488+0000","last_deep_scrub":"116'27","last_deep_scrub_stamp":"2024-05-08T18:33:03.645488+0000","last_clean_scrub_stamp":"2024-05-08T18:33:03.645488+0000","objects_scrubbed":6,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:32.499890+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":30,"num_read_kb":23,"num_write":22,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1318,"num_omap_keys":6,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:33.993231+0000","last_change":"2024-05-08T18:33:33.993286+0000","last_active":"2024-05-08T18:33:33.993231+0000","last_peered":"2024-05-08T18:33:33.993231+0000","last_clean":"2024-05-08T18:33:33.993231+0000","last_became_active":"2024-05-08T18:29:48.641813+0000","last_became_peered":"2024-05-08T18:29:48.641813+0000","last_unstale":"2024-05-08T18:33:33.993231+0000","last_undegraded":"2024-05-08T18:33:33.993231+0000","last_fullsized":"2024-05-08T18:33:33.993231+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:33.993024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:33.993024+0000","last_clean_scrub_stamp":"2024-05-08T18:33:33.993024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:45:03.889770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"80'2","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:39.827113+0000","last_change":"2024-05-08T18:33:39.827175+0000","last_active":"2024-05-08T18:33:39.827113+0000","last_peered":"2024-05-08T18:33:39.827113+0000","last_clean":"2024-05-08T18:33:39.827113+0000","last_became_active":"2024-05-08T18:29:50.686739+0000","last_became_peered":"2024-05-08T18:29:50.686739+0000","last_unstale":"2024-05-08T18:33:39.827113+0000","last_undegraded":"2024-05-08T18:33:39.827113+0000","last_fullsized":"2024-05-08T18:33:39.827113+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2","last_scrub_stamp":"2024-05-08T18:33:39.826904+0000","last_deep_scrub":"80'2","last_deep_scrub_stamp":"2024-05-08T18:33:39.826904+0000","last_clean_scrub_stamp":"2024-05-08T18:33:39.826904+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:02.448703+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:28.607424+0000","last_change":"2024-05-08T18:33:28.607482+0000","last_active":"2024-05-08T18:33:28.607424+0000","last_peered":"2024-05-08T18:33:28.607424+0000","last_clean":"2024-05-08T18:33:28.607424+0000","last_became_active":"2024-05-08T18:29:42.551647+0000","last_became_peered":"2024-05-08T18:29:42.551647+0000","last_unstale":"2024-05-08T18:33:28.607424+0000","last_undegraded":"2024-05-08T18:33:28.607424+0000","last_fullsized":"2024-05-08T18:33:28.607424+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:28.607219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:28.607219+0000","last_clean_scrub_stamp":"2024-05-08T18:33:28.607219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:44:38.835851+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"116'16","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:15.522289+0000","last_change":"2024-05-08T18:33:15.522352+0000","last_active":"2024-05-08T18:33:15.522289+0000","last_peered":"2024-05-08T18:33:15.522289+0000","last_clean":"2024-05-08T18:33:15.522289+0000","last_became_active":"2024-05-08T18:29:40.550942+0000","last_became_peered":"2024-05-08T18:29:40.550942+0000","last_unstale":"2024-05-08T18:33:15.522289+0000","last_undegraded":"2024-05-08T18:33:15.522289+0000","last_fullsized":"2024-05-08T18:33:15.522289+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'16","last_scrub_stamp":"2024-05-08T18:33:15.522093+0000","last_deep_scrub":"116'16","last_deep_scrub_stamp":"2024-05-08T18:33:15.522093+0000","last_clean_scrub_stamp":"2024-05-08T18:33:15.522093+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:21:41.818141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:00.876238+0000","last_change":"2024-05-08T18:33:00.876275+0000","last_active":"2024-05-08T18:33:00.876238+0000","last_peered":"2024-05-08T18:33:00.876238+0000","last_clean":"2024-05-08T18:33:00.876238+0000","last_became_active":"2024-05-08T18:29:44.593242+0000","last_became_peered":"2024-05-08T18:29:44.593242+0000","last_unstale":"2024-05-08T18:33:00.876238+0000","last_undegraded":"2024-05-08T18:33:00.876238+0000","last_fullsized":"2024-05-08T18:33:00.876238+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:00.876136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:00.876136+0000","last_clean_scrub_stamp":"2024-05-08T18:33:00.876136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:46.560199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"116'32","reported_seq":240,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:14.840057+0000","last_change":"2024-05-08T18:33:14.840151+0000","last_active":"2024-05-08T18:33:14.840057+0000","last_peered":"2024-05-08T18:33:14.840057+0000","last_clean":"2024-05-08T18:33:14.840057+0000","last_became_active":"2024-05-08T18:29:46.588784+0000","last_became_peered":"2024-05-08T18:29:46.588784+0000","last_unstale":"2024-05-08T18:33:14.840057+0000","last_undegraded":"2024-05-08T18:33:14.840057+0000","last_fullsized":"2024-05-08T18:33:14.840057+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'32","last_scrub_stamp":"2024-05-08T18:33:14.839870+0000","last_deep_scrub":"116'32","last_deep_scrub_stamp":"2024-05-08T18:33:14.839870+0000","last_clean_scrub_stamp":"2024-05-08T18:33:14.839870+0000","objects_scrubbed":8,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:02:08.637757+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":35,"num_read_kb":26,"num_write":24,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1344,"num_omap_keys":6,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"116'105","reported_seq":350,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:16.815313+0000","last_change":"2024-05-08T18:33:16.815379+0000","last_active":"2024-05-08T18:33:16.815313+0000","last_peered":"2024-05-08T18:33:16.815313+0000","last_clean":"2024-05-08T18:33:16.815313+0000","last_became_active":"2024-05-08T18:29:48.630229+0000","last_became_peered":"2024-05-08T18:29:48.630229+0000","last_unstale":"2024-05-08T18:33:16.815313+0000","last_undegraded":"2024-05-08T18:33:16.815313+0000","last_fullsized":"2024-05-08T18:33:16.815313+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'105","last_scrub_stamp":"2024-05-08T18:33:16.815131+0000","last_deep_scrub":"116'105","last_deep_scrub_stamp":"2024-05-08T18:33:16.815131+0000","last_clean_scrub_stamp":"2024-05-08T18:33:16.815131+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:34:12.059461+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:25.769939+0000","last_change":"2024-05-08T18:33:25.769993+0000","last_active":"2024-05-08T18:33:25.769939+0000","last_peered":"2024-05-08T18:33:25.769939+0000","last_clean":"2024-05-08T18:33:25.769939+0000","last_became_active":"2024-05-08T18:29:50.674292+0000","last_became_peered":"2024-05-08T18:29:50.674292+0000","last_unstale":"2024-05-08T18:33:25.769939+0000","last_undegraded":"2024-05-08T18:33:25.769939+0000","last_fullsized":"2024-05-08T18:33:25.769939+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:25.769711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:25.769711+0000","last_clean_scrub_stamp":"2024-05-08T18:33:25.769711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:56.556666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"84'4","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:15.480780+0000","last_change":"2024-05-08T18:33:15.480844+0000","last_active":"2024-05-08T18:33:15.480780+0000","last_peered":"2024-05-08T18:33:15.480780+0000","last_clean":"2024-05-08T18:33:15.480780+0000","last_became_active":"2024-05-08T18:29:42.579059+0000","last_became_peered":"2024-05-08T18:29:42.579059+0000","last_unstale":"2024-05-08T18:33:15.480780+0000","last_undegraded":"2024-05-08T18:33:15.480780+0000","last_fullsized":"2024-05-08T18:33:15.480780+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'4","last_scrub_stamp":"2024-05-08T18:33:15.480579+0000","last_deep_scrub":"84'4","last_deep_scrub_stamp":"2024-05-08T18:33:15.480579+0000","last_clean_scrub_stamp":"2024-05-08T18:33:15.480579+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:10:20.075727+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"116'16","reported_seq":225,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:25.505682+0000","last_change":"2024-05-08T18:33:25.505749+0000","last_active":"2024-05-08T18:33:25.505682+0000","last_peered":"2024-05-08T18:33:25.505682+0000","last_clean":"2024-05-08T18:33:25.505682+0000","last_became_active":"2024-05-08T18:29:40.554594+0000","last_became_peered":"2024-05-08T18:29:40.554594+0000","last_unstale":"2024-05-08T18:33:25.505682+0000","last_undegraded":"2024-05-08T18:33:25.505682+0000","last_fullsized":"2024-05-08T18:33:25.505682+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'16","last_scrub_stamp":"2024-05-08T18:33:25.505479+0000","last_deep_scrub":"116'16","last_deep_scrub_stamp":"2024-05-08T18:33:25.505479+0000","last_clean_scrub_stamp":"2024-05-08T18:33:25.505479+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:10:44.802346+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4,"num_write":26,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"116'4","reported_seq":339,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:20.169768+0000","last_change":"2024-05-08T18:33:20.169842+0000","last_active":"2024-05-08T18:33:20.169768+0000","last_peered":"2024-05-08T18:33:20.169768+0000","last_clean":"2024-05-08T18:33:20.169768+0000","last_became_active":"2024-05-08T18:29:44.581699+0000","last_became_peered":"2024-05-08T18:29:44.581699+0000","last_unstale":"2024-05-08T18:33:20.169768+0000","last_undegraded":"2024-05-08T18:33:20.169768+0000","last_fullsized":"2024-05-08T18:33:20.169768+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'4","last_scrub_stamp":"2024-05-08T18:33:20.169559+0000","last_deep_scrub":"116'4","last_deep_scrub_stamp":"2024-05-08T18:33:20.169559+0000","last_clean_scrub_stamp":"2024-05-08T18:33:20.169559+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:50.956515+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":138,"num_read_kb":138,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"116'15","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:25.874423+0000","last_change":"2024-05-08T18:33:25.874494+0000","last_active":"2024-05-08T18:33:25.874423+0000","last_peered":"2024-05-08T18:33:25.874423+0000","last_clean":"2024-05-08T18:33:25.874423+0000","last_became_active":"2024-05-08T18:29:46.590087+0000","last_became_peered":"2024-05-08T18:29:46.590087+0000","last_unstale":"2024-05-08T18:33:25.874423+0000","last_undegraded":"2024-05-08T18:33:25.874423+0000","last_fullsized":"2024-05-08T18:33:25.874423+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'15","last_scrub_stamp":"2024-05-08T18:33:25.874218+0000","last_deep_scrub":"116'15","last_deep_scrub_stamp":"2024-05-08T18:33:25.874218+0000","last_clean_scrub_stamp":"2024-05-08T18:33:25.874218+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:32:13.833139+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"116'105","reported_seq":374,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:21.713161+0000","last_change":"2024-05-08T18:33:21.713229+0000","last_active":"2024-05-08T18:33:21.713161+0000","last_peered":"2024-05-08T18:33:21.713161+0000","last_clean":"2024-05-08T18:33:21.713161+0000","last_became_active":"2024-05-08T18:29:48.634801+0000","last_became_peered":"2024-05-08T18:29:48.634801+0000","last_unstale":"2024-05-08T18:33:21.713161+0000","last_undegraded":"2024-05-08T18:33:21.713161+0000","last_fullsized":"2024-05-08T18:33:21.713161+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'105","last_scrub_stamp":"2024-05-08T18:33:21.712967+0000","last_deep_scrub":"116'105","last_deep_scrub_stamp":"2024-05-08T18:33:21.712967+0000","last_clean_scrub_stamp":"2024-05-08T18:33:21.712967+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:17:32.267716+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:37.617273+0000","last_change":"2024-05-08T18:33:37.617326+0000","last_active":"2024-05-08T18:33:37.617273+0000","last_peered":"2024-05-08T18:33:37.617273+0000","last_clean":"2024-05-08T18:33:37.617273+0000","last_became_active":"2024-05-08T18:29:50.667536+0000","last_became_peered":"2024-05-08T18:29:50.667536+0000","last_unstale":"2024-05-08T18:33:37.617273+0000","last_undegraded":"2024-05-08T18:33:37.617273+0000","last_fullsized":"2024-05-08T18:33:37.617273+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:37.617077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:37.617077+0000","last_clean_scrub_stamp":"2024-05-08T18:33:37.617077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:50:51.365977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"97'14","reported_seq":233,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:21.769433+0000","last_change":"2024-05-08T18:33:21.769517+0000","last_active":"2024-05-08T18:33:21.769433+0000","last_peered":"2024-05-08T18:33:21.769433+0000","last_clean":"2024-05-08T18:33:21.769433+0000","last_became_active":"2024-05-08T18:29:42.563416+0000","last_became_peered":"2024-05-08T18:29:42.563416+0000","last_unstale":"2024-05-08T18:33:21.769433+0000","last_undegraded":"2024-05-08T18:33:21.769433+0000","last_fullsized":"2024-05-08T18:33:21.769433+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'14","last_scrub_stamp":"2024-05-08T18:33:21.769214+0000","last_deep_scrub":"97'14","last_deep_scrub_stamp":"2024-05-08T18:33:21.769214+0000","last_clean_scrub_stamp":"2024-05-08T18:33:21.769214+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:35:44.505251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"116'24","reported_seq":230,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:29.863747+0000","last_change":"2024-05-08T18:33:29.863866+0000","last_active":"2024-05-08T18:33:29.863747+0000","last_peered":"2024-05-08T18:33:29.863747+0000","last_clean":"2024-05-08T18:33:29.863747+0000","last_became_active":"2024-05-08T18:29:40.548591+0000","last_became_peered":"2024-05-08T18:29:40.548591+0000","last_unstale":"2024-05-08T18:33:29.863747+0000","last_undegraded":"2024-05-08T18:33:29.863747+0000","last_fullsized":"2024-05-08T18:33:29.863747+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'24","last_scrub_stamp":"2024-05-08T18:33:29.863468+0000","last_deep_scrub":"116'24","last_deep_scrub_stamp":"2024-05-08T18:33:29.863468+0000","last_clean_scrub_stamp":"2024-05-08T18:33:29.863468+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:22:33.938003+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":24,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:21.515577+0000","last_change":"2024-05-08T18:33:21.515638+0000","last_active":"2024-05-08T18:33:21.515577+0000","last_peered":"2024-05-08T18:33:21.515577+0000","last_clean":"2024-05-08T18:33:21.515577+0000","last_became_active":"2024-05-08T18:29:44.581832+0000","last_became_peered":"2024-05-08T18:29:44.581832+0000","last_unstale":"2024-05-08T18:33:21.515577+0000","last_undegraded":"2024-05-08T18:33:21.515577+0000","last_fullsized":"2024-05-08T18:33:21.515577+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:21.515374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:21.515374+0000","last_clean_scrub_stamp":"2024-05-08T18:33:21.515374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:04:12.599031+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"116'33","reported_seq":241,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:04.133658+0000","last_change":"2024-05-08T18:33:04.133740+0000","last_active":"2024-05-08T18:33:04.133658+0000","last_peered":"2024-05-08T18:33:04.133658+0000","last_clean":"2024-05-08T18:33:04.133658+0000","last_became_active":"2024-05-08T18:29:46.601740+0000","last_became_peered":"2024-05-08T18:29:46.601740+0000","last_unstale":"2024-05-08T18:33:04.133658+0000","last_undegraded":"2024-05-08T18:33:04.133658+0000","last_fullsized":"2024-05-08T18:33:04.133658+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'33","last_scrub_stamp":"2024-05-08T18:33:04.133452+0000","last_deep_scrub":"116'33","last_deep_scrub_stamp":"2024-05-08T18:33:04.133452+0000","last_clean_scrub_stamp":"2024-05-08T18:33:04.133452+0000","objects_scrubbed":8,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:09.047282+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":35,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":187,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:24.757341+0000","last_change":"2024-05-08T18:33:24.757392+0000","last_active":"2024-05-08T18:33:24.757341+0000","last_peered":"2024-05-08T18:33:24.757341+0000","last_clean":"2024-05-08T18:33:24.757341+0000","last_became_active":"2024-05-08T18:29:48.639309+0000","last_became_peered":"2024-05-08T18:29:48.639309+0000","last_unstale":"2024-05-08T18:33:24.757341+0000","last_undegraded":"2024-05-08T18:33:24.757341+0000","last_fullsized":"2024-05-08T18:33:24.757341+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:24.757186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:24.757186+0000","last_clean_scrub_stamp":"2024-05-08T18:33:24.757186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:00:05.716237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:24.776534+0000","last_change":"2024-05-08T18:33:24.776636+0000","last_active":"2024-05-08T18:33:24.776534+0000","last_peered":"2024-05-08T18:33:24.776534+0000","last_clean":"2024-05-08T18:33:24.776534+0000","last_became_active":"2024-05-08T18:29:50.667636+0000","last_became_peered":"2024-05-08T18:29:50.667636+0000","last_unstale":"2024-05-08T18:33:24.776534+0000","last_undegraded":"2024-05-08T18:33:24.776534+0000","last_fullsized":"2024-05-08T18:33:24.776534+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:24.776214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:24.776214+0000","last_clean_scrub_stamp":"2024-05-08T18:33:24.776214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:11:24.497988+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"97'4","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:03.641090+0000","last_change":"2024-05-08T18:33:03.641202+0000","last_active":"2024-05-08T18:33:03.641090+0000","last_peered":"2024-05-08T18:33:03.641090+0000","last_clean":"2024-05-08T18:33:03.641090+0000","last_became_active":"2024-05-08T18:29:42.583639+0000","last_became_peered":"2024-05-08T18:29:42.583639+0000","last_unstale":"2024-05-08T18:33:03.641090+0000","last_undegraded":"2024-05-08T18:33:03.641090+0000","last_fullsized":"2024-05-08T18:33:03.641090+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'4","last_scrub_stamp":"2024-05-08T18:33:03.640783+0000","last_deep_scrub":"97'4","last_deep_scrub_stamp":"2024-05-08T18:33:03.640783+0000","last_clean_scrub_stamp":"2024-05-08T18:33:03.640783+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:40:41.107541+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"116'74","reported_seq":308,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:21.807158+0000","last_change":"2024-05-08T18:33:21.807158+0000","last_active":"2024-05-08T18:33:21.807158+0000","last_peered":"2024-05-08T18:33:21.807158+0000","last_clean":"2024-05-08T18:33:21.807158+0000","last_became_active":"2024-05-08T18:29:27.112960+0000","last_became_peered":"2024-05-08T18:29:27.112960+0000","last_unstale":"2024-05-08T18:33:21.807158+0000","last_undegraded":"2024-05-08T18:33:21.807158+0000","last_fullsized":"2024-05-08T18:33:21.807158+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'74","last_scrub_stamp":"2024-05-08T18:33:21.806891+0000","last_deep_scrub":"116'74","last_deep_scrub_stamp":"2024-05-08T18:33:21.806891+0000","last_clean_scrub_stamp":"2024-05-08T18:33:21.806891+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:04:12.890549+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":211,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:24.138684+0000","last_change":"2024-05-08T18:33:24.138747+0000","last_active":"2024-05-08T18:33:24.138684+0000","last_peered":"2024-05-08T18:33:24.138684+0000","last_clean":"2024-05-08T18:33:24.138684+0000","last_became_active":"2024-05-08T18:29:34.495632+0000","last_became_peered":"2024-05-08T18:29:34.495632+0000","last_unstale":"2024-05-08T18:33:24.138684+0000","last_undegraded":"2024-05-08T18:33:24.138684+0000","last_fullsized":"2024-05-08T18:33:24.138684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:24.138488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:24.138488+0000","last_clean_scrub_stamp":"2024-05-08T18:33:24.138488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:25:24.580041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"116'10","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:57.062846+0000","last_change":"2024-05-08T18:30:20.849562+0000","last_active":"2024-05-08T18:32:57.062846+0000","last_peered":"2024-05-08T18:32:57.062846+0000","last_clean":"2024-05-08T18:32:57.062846+0000","last_became_active":"2024-05-08T18:30:20.849160+0000","last_became_peered":"2024-05-08T18:30:20.849160+0000","last_unstale":"2024-05-08T18:32:57.062846+0000","last_undegraded":"2024-05-08T18:32:57.062846+0000","last_fullsized":"2024-05-08T18:32:57.062846+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:39.497961+0000","last_clean_scrub_stamp":"2024-05-08T18:29:39.497961+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:07.951240+0000","last_change":"2024-05-08T18:33:07.951294+0000","last_active":"2024-05-08T18:33:07.951240+0000","last_peered":"2024-05-08T18:33:07.951240+0000","last_clean":"2024-05-08T18:33:07.951240+0000","last_became_active":"2024-05-08T18:29:44.587855+0000","last_became_peered":"2024-05-08T18:29:44.587855+0000","last_unstale":"2024-05-08T18:33:07.951240+0000","last_undegraded":"2024-05-08T18:33:07.951240+0000","last_fullsized":"2024-05-08T18:33:07.951240+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:07.951044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:07.951044+0000","last_clean_scrub_stamp":"2024-05-08T18:33:07.951044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:20:11.634058+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"116'46","reported_seq":265,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.166142+0000","last_change":"2024-05-08T18:33:05.166233+0000","last_active":"2024-05-08T18:33:05.166142+0000","last_peered":"2024-05-08T18:33:05.166142+0000","last_clean":"2024-05-08T18:33:05.166142+0000","last_became_active":"2024-05-08T18:29:46.594573+0000","last_became_peered":"2024-05-08T18:29:46.594573+0000","last_unstale":"2024-05-08T18:33:05.166142+0000","last_undegraded":"2024-05-08T18:33:05.166142+0000","last_fullsized":"2024-05-08T18:33:05.166142+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'46","last_scrub_stamp":"2024-05-08T18:33:05.165944+0000","last_deep_scrub":"116'46","last_deep_scrub_stamp":"2024-05-08T18:33:05.165944+0000","last_clean_scrub_stamp":"2024-05-08T18:33:05.165944+0000","objects_scrubbed":5,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:39:59.017926+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8302,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":58,"num_read_kb":181,"num_write":30,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:01.958893+0000","last_change":"2024-05-08T18:33:01.958941+0000","last_active":"2024-05-08T18:33:01.958893+0000","last_peered":"2024-05-08T18:33:01.958893+0000","last_clean":"2024-05-08T18:33:01.958893+0000","last_became_active":"2024-05-08T18:29:48.631481+0000","last_became_peered":"2024-05-08T18:29:48.631481+0000","last_unstale":"2024-05-08T18:33:01.958893+0000","last_undegraded":"2024-05-08T18:33:01.958893+0000","last_fullsized":"2024-05-08T18:33:01.958893+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:01.958729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:01.958729+0000","last_clean_scrub_stamp":"2024-05-08T18:33:01.958729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:35:11.554040+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"80'2","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:25.760858+0000","last_change":"2024-05-08T18:33:25.760924+0000","last_active":"2024-05-08T18:33:25.760858+0000","last_peered":"2024-05-08T18:33:25.760858+0000","last_clean":"2024-05-08T18:33:25.760858+0000","last_became_active":"2024-05-08T18:29:50.674526+0000","last_became_peered":"2024-05-08T18:29:50.674526+0000","last_unstale":"2024-05-08T18:33:25.760858+0000","last_undegraded":"2024-05-08T18:33:25.760858+0000","last_fullsized":"2024-05-08T18:33:25.760858+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2","last_scrub_stamp":"2024-05-08T18:33:25.760643+0000","last_deep_scrub":"80'2","last_deep_scrub_stamp":"2024-05-08T18:33:25.760643+0000","last_clean_scrub_stamp":"2024-05-08T18:33:25.760643+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:22:40.009425+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"84'4","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:15.893416+0000","last_change":"2024-05-08T18:33:15.893484+0000","last_active":"2024-05-08T18:33:15.893416+0000","last_peered":"2024-05-08T18:33:15.893416+0000","last_clean":"2024-05-08T18:33:15.893416+0000","last_became_active":"2024-05-08T18:29:42.568244+0000","last_became_peered":"2024-05-08T18:29:42.568244+0000","last_unstale":"2024-05-08T18:33:15.893416+0000","last_undegraded":"2024-05-08T18:33:15.893416+0000","last_fullsized":"2024-05-08T18:33:15.893416+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'4","last_scrub_stamp":"2024-05-08T18:33:15.893221+0000","last_deep_scrub":"84'4","last_deep_scrub_stamp":"2024-05-08T18:33:15.893221+0000","last_clean_scrub_stamp":"2024-05-08T18:33:15.893221+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:07:54.051709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:22.833090+0000","last_change":"2024-05-08T18:33:22.833090+0000","last_active":"2024-05-08T18:33:22.833090+0000","last_peered":"2024-05-08T18:33:22.833090+0000","last_clean":"2024-05-08T18:33:22.833090+0000","last_became_active":"2024-05-08T18:29:34.495812+0000","last_became_peered":"2024-05-08T18:29:34.495812+0000","last_unstale":"2024-05-08T18:33:22.833090+0000","last_undegraded":"2024-05-08T18:33:22.833090+0000","last_fullsized":"2024-05-08T18:33:22.833090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:22.832836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:22.832836+0000","last_clean_scrub_stamp":"2024-05-08T18:33:22.832836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:48:24.471222+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"116'14","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:32.058351+0000","last_change":"2024-05-08T18:33:32.058411+0000","last_active":"2024-05-08T18:33:32.058351+0000","last_peered":"2024-05-08T18:33:32.058351+0000","last_clean":"2024-05-08T18:33:32.058351+0000","last_became_active":"2024-05-08T18:29:40.560296+0000","last_became_peered":"2024-05-08T18:29:40.560296+0000","last_unstale":"2024-05-08T18:33:32.058351+0000","last_undegraded":"2024-05-08T18:33:32.058351+0000","last_fullsized":"2024-05-08T18:33:32.058351+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'14","last_scrub_stamp":"2024-05-08T18:33:32.058121+0000","last_deep_scrub":"116'14","last_deep_scrub_stamp":"2024-05-08T18:33:32.058121+0000","last_clean_scrub_stamp":"2024-05-08T18:33:32.058121+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:33:41.442244+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":197,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:32.161002+0000","last_change":"2024-05-08T18:33:32.161058+0000","last_active":"2024-05-08T18:33:32.161002+0000","last_peered":"2024-05-08T18:33:32.161002+0000","last_clean":"2024-05-08T18:33:32.161002+0000","last_became_active":"2024-05-08T18:29:44.593917+0000","last_became_peered":"2024-05-08T18:29:44.593917+0000","last_unstale":"2024-05-08T18:33:32.161002+0000","last_undegraded":"2024-05-08T18:33:32.161002+0000","last_fullsized":"2024-05-08T18:33:32.161002+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:32.160799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:32.160799+0000","last_clean_scrub_stamp":"2024-05-08T18:33:32.160799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:11:59.879277+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"116'127","reported_seq":424,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.910703+0000","last_change":"2024-05-08T18:33:06.910796+0000","last_active":"2024-05-08T18:33:06.910703+0000","last_peered":"2024-05-08T18:33:06.910703+0000","last_clean":"2024-05-08T18:33:06.910703+0000","last_became_active":"2024-05-08T18:29:46.594789+0000","last_became_peered":"2024-05-08T18:29:46.594789+0000","last_unstale":"2024-05-08T18:33:06.910703+0000","last_undegraded":"2024-05-08T18:33:06.910703+0000","last_fullsized":"2024-05-08T18:33:06.910703+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'127","last_scrub_stamp":"2024-05-08T18:33:06.910514+0000","last_deep_scrub":"116'127","last_deep_scrub_stamp":"2024-05-08T18:33:06.910514+0000","last_clean_scrub_stamp":"2024-05-08T18:33:06.910514+0000","objects_scrubbed":10,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:34:02.154843+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4344,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":167,"num_read_kb":168,"num_write":36,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":187,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:30.833502+0000","last_change":"2024-05-08T18:33:30.833562+0000","last_active":"2024-05-08T18:33:30.833502+0000","last_peered":"2024-05-08T18:33:30.833502+0000","last_clean":"2024-05-08T18:33:30.833502+0000","last_became_active":"2024-05-08T18:29:48.634044+0000","last_became_peered":"2024-05-08T18:29:48.634044+0000","last_unstale":"2024-05-08T18:33:30.833502+0000","last_undegraded":"2024-05-08T18:33:30.833502+0000","last_fullsized":"2024-05-08T18:33:30.833502+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:30.833306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:30.833306+0000","last_clean_scrub_stamp":"2024-05-08T18:33:30.833306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:23:28.397881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:26.799492+0000","last_change":"2024-05-08T18:33:26.799545+0000","last_active":"2024-05-08T18:33:26.799492+0000","last_peered":"2024-05-08T18:33:26.799492+0000","last_clean":"2024-05-08T18:33:26.799492+0000","last_became_active":"2024-05-08T18:29:50.675770+0000","last_became_peered":"2024-05-08T18:29:50.675770+0000","last_unstale":"2024-05-08T18:33:26.799492+0000","last_undegraded":"2024-05-08T18:33:26.799492+0000","last_fullsized":"2024-05-08T18:33:26.799492+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:26.799261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:26.799261+0000","last_clean_scrub_stamp":"2024-05-08T18:33:26.799261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:04:17.882918+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:07.905828+0000","last_change":"2024-05-08T18:33:07.905974+0000","last_active":"2024-05-08T18:33:07.905828+0000","last_peered":"2024-05-08T18:33:07.905828+0000","last_clean":"2024-05-08T18:33:07.905828+0000","last_became_active":"2024-05-08T18:29:42.573621+0000","last_became_peered":"2024-05-08T18:29:42.573621+0000","last_unstale":"2024-05-08T18:33:07.905828+0000","last_undegraded":"2024-05-08T18:33:07.905828+0000","last_fullsized":"2024-05-08T18:33:07.905828+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:07.905533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:07.905533+0000","last_clean_scrub_stamp":"2024-05-08T18:33:07.905533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:36.759934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.762405+0000","last_change":"2024-05-08T18:33:05.762460+0000","last_active":"2024-05-08T18:33:05.762405+0000","last_peered":"2024-05-08T18:33:05.762405+0000","last_clean":"2024-05-08T18:33:05.762405+0000","last_became_active":"2024-05-08T18:29:34.490717+0000","last_became_peered":"2024-05-08T18:29:34.490717+0000","last_unstale":"2024-05-08T18:33:05.762405+0000","last_undegraded":"2024-05-08T18:33:05.762405+0000","last_fullsized":"2024-05-08T18:33:05.762405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:05.762206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:05.762206+0000","last_clean_scrub_stamp":"2024-05-08T18:33:05.762206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:40:43.228963+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"116'24","reported_seq":233,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:16.780996+0000","last_change":"2024-05-08T18:33:16.780996+0000","last_active":"2024-05-08T18:33:16.780996+0000","last_peered":"2024-05-08T18:33:16.780996+0000","last_clean":"2024-05-08T18:33:16.780996+0000","last_became_active":"2024-05-08T18:29:40.529804+0000","last_became_peered":"2024-05-08T18:29:40.529804+0000","last_unstale":"2024-05-08T18:33:16.780996+0000","last_undegraded":"2024-05-08T18:33:16.780996+0000","last_fullsized":"2024-05-08T18:33:16.780996+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'24","last_scrub_stamp":"2024-05-08T18:33:16.780599+0000","last_deep_scrub":"116'24","last_deep_scrub_stamp":"2024-05-08T18:33:16.780599+0000","last_clean_scrub_stamp":"2024-05-08T18:33:16.780599+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:04:25.215108+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":24,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"116'2","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:03.762329+0000","last_change":"2024-05-08T18:33:03.762464+0000","last_active":"2024-05-08T18:33:03.762329+0000","last_peered":"2024-05-08T18:33:03.762329+0000","last_clean":"2024-05-08T18:33:03.762329+0000","last_became_active":"2024-05-08T18:29:44.584227+0000","last_became_peered":"2024-05-08T18:29:44.584227+0000","last_unstale":"2024-05-08T18:33:03.762329+0000","last_undegraded":"2024-05-08T18:33:03.762329+0000","last_fullsized":"2024-05-08T18:33:03.762329+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'2","last_scrub_stamp":"2024-05-08T18:33:03.762127+0000","last_deep_scrub":"116'2","last_deep_scrub_stamp":"2024-05-08T18:33:03.762127+0000","last_clean_scrub_stamp":"2024-05-08T18:33:03.762127+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:43:25.087022+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"116'23","reported_seq":257,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:03.913061+0000","last_change":"2024-05-08T18:33:03.913151+0000","last_active":"2024-05-08T18:33:03.913061+0000","last_peered":"2024-05-08T18:33:03.913061+0000","last_clean":"2024-05-08T18:33:03.913061+0000","last_became_active":"2024-05-08T18:29:46.607989+0000","last_became_peered":"2024-05-08T18:29:46.607989+0000","last_unstale":"2024-05-08T18:33:03.913061+0000","last_undegraded":"2024-05-08T18:33:03.913061+0000","last_fullsized":"2024-05-08T18:33:03.913061+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'23","last_scrub_stamp":"2024-05-08T18:33:03.912858+0000","last_deep_scrub":"116'23","last_deep_scrub_stamp":"2024-05-08T18:33:03.912858+0000","last_clean_scrub_stamp":"2024-05-08T18:33:03.912858+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:32.767259+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:04.841782+0000","last_change":"2024-05-08T18:33:04.841837+0000","last_active":"2024-05-08T18:33:04.841782+0000","last_peered":"2024-05-08T18:33:04.841782+0000","last_clean":"2024-05-08T18:33:04.841782+0000","last_became_active":"2024-05-08T18:29:48.624545+0000","last_became_peered":"2024-05-08T18:29:48.624545+0000","last_unstale":"2024-05-08T18:33:04.841782+0000","last_undegraded":"2024-05-08T18:33:04.841782+0000","last_fullsized":"2024-05-08T18:33:04.841782+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:04.841580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:04.841580+0000","last_clean_scrub_stamp":"2024-05-08T18:33:04.841580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:09:10.449385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"84'12","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:38.871688+0000","last_change":"2024-05-08T18:33:38.871754+0000","last_active":"2024-05-08T18:33:38.871688+0000","last_peered":"2024-05-08T18:33:38.871688+0000","last_clean":"2024-05-08T18:33:38.871688+0000","last_became_active":"2024-05-08T18:29:50.687978+0000","last_became_peered":"2024-05-08T18:29:50.687978+0000","last_unstale":"2024-05-08T18:33:38.871688+0000","last_undegraded":"2024-05-08T18:33:38.871688+0000","last_fullsized":"2024-05-08T18:33:38.871688+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'12","last_scrub_stamp":"2024-05-08T18:33:38.871479+0000","last_deep_scrub":"84'12","last_deep_scrub_stamp":"2024-05-08T18:33:38.871479+0000","last_clean_scrub_stamp":"2024-05-08T18:33:38.871479+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:11:18.000684+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":42,"num_write":31,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"84'4","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:29.767277+0000","last_change":"2024-05-08T18:33:29.767395+0000","last_active":"2024-05-08T18:33:29.767277+0000","last_peered":"2024-05-08T18:33:29.767277+0000","last_clean":"2024-05-08T18:33:29.767277+0000","last_became_active":"2024-05-08T18:31:22.008342+0000","last_became_peered":"2024-05-08T18:31:22.008342+0000","last_unstale":"2024-05-08T18:33:29.767277+0000","last_undegraded":"2024-05-08T18:33:29.767277+0000","last_fullsized":"2024-05-08T18:33:29.767277+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'4","last_scrub_stamp":"2024-05-08T18:33:29.766970+0000","last_deep_scrub":"84'4","last_deep_scrub_stamp":"2024-05-08T18:33:29.766970+0000","last_clean_scrub_stamp":"2024-05-08T18:33:29.766970+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:18:01.425849+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":211,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:25.155016+0000","last_change":"2024-05-08T18:33:25.155068+0000","last_active":"2024-05-08T18:33:25.155016+0000","last_peered":"2024-05-08T18:33:25.155016+0000","last_clean":"2024-05-08T18:33:25.155016+0000","last_became_active":"2024-05-08T18:29:34.495882+0000","last_became_peered":"2024-05-08T18:29:34.495882+0000","last_unstale":"2024-05-08T18:33:25.155016+0000","last_undegraded":"2024-05-08T18:33:25.155016+0000","last_fullsized":"2024-05-08T18:33:25.155016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:25.154824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:25.154824+0000","last_clean_scrub_stamp":"2024-05-08T18:33:25.154824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:10:44.451691+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"116'16","reported_seq":224,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:24.553221+0000","last_change":"2024-05-08T18:33:24.553297+0000","last_active":"2024-05-08T18:33:24.553221+0000","last_peered":"2024-05-08T18:33:24.553221+0000","last_clean":"2024-05-08T18:33:24.553221+0000","last_became_active":"2024-05-08T18:29:40.553527+0000","last_became_peered":"2024-05-08T18:29:40.553527+0000","last_unstale":"2024-05-08T18:33:24.553221+0000","last_undegraded":"2024-05-08T18:33:24.553221+0000","last_fullsized":"2024-05-08T18:33:24.553221+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'16","last_scrub_stamp":"2024-05-08T18:33:24.553018+0000","last_deep_scrub":"116'16","last_deep_scrub_stamp":"2024-05-08T18:33:24.553018+0000","last_clean_scrub_stamp":"2024-05-08T18:33:24.553018+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:25:24.994572+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:19.006678+0000","last_change":"2024-05-08T18:33:19.006743+0000","last_active":"2024-05-08T18:33:19.006678+0000","last_peered":"2024-05-08T18:33:19.006678+0000","last_clean":"2024-05-08T18:33:19.006678+0000","last_became_active":"2024-05-08T18:29:44.596678+0000","last_became_peered":"2024-05-08T18:29:44.596678+0000","last_unstale":"2024-05-08T18:33:19.006678+0000","last_undegraded":"2024-05-08T18:33:19.006678+0000","last_fullsized":"2024-05-08T18:33:19.006678+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:19.006475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:19.006475+0000","last_clean_scrub_stamp":"2024-05-08T18:33:19.006475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:25:42.318338+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"116'19","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.769018+0000","last_change":"2024-05-08T18:33:06.769095+0000","last_active":"2024-05-08T18:33:06.769018+0000","last_peered":"2024-05-08T18:33:06.769018+0000","last_clean":"2024-05-08T18:33:06.769018+0000","last_became_active":"2024-05-08T18:29:46.606367+0000","last_became_peered":"2024-05-08T18:29:46.606367+0000","last_unstale":"2024-05-08T18:33:06.769018+0000","last_undegraded":"2024-05-08T18:33:06.769018+0000","last_fullsized":"2024-05-08T18:33:06.769018+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'19","last_scrub_stamp":"2024-05-08T18:33:06.768818+0000","last_deep_scrub":"116'19","last_deep_scrub_stamp":"2024-05-08T18:33:06.768818+0000","last_clean_scrub_stamp":"2024-05-08T18:33:06.768818+0000","objects_scrubbed":6,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:21:20.078602+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":187,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:10.610648+0000","last_change":"2024-05-08T18:33:10.610711+0000","last_active":"2024-05-08T18:33:10.610648+0000","last_peered":"2024-05-08T18:33:10.610648+0000","last_clean":"2024-05-08T18:33:10.610648+0000","last_became_active":"2024-05-08T18:29:48.631874+0000","last_became_peered":"2024-05-08T18:29:48.631874+0000","last_unstale":"2024-05-08T18:33:10.610648+0000","last_undegraded":"2024-05-08T18:33:10.610648+0000","last_fullsized":"2024-05-08T18:33:10.610648+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:10.610431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:10.610431+0000","last_clean_scrub_stamp":"2024-05-08T18:33:10.610431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:57:11.243206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:37.251300+0000","last_change":"2024-05-08T18:33:37.251354+0000","last_active":"2024-05-08T18:33:37.251300+0000","last_peered":"2024-05-08T18:33:37.251300+0000","last_clean":"2024-05-08T18:33:37.251300+0000","last_became_active":"2024-05-08T18:29:50.682634+0000","last_became_peered":"2024-05-08T18:29:50.682634+0000","last_unstale":"2024-05-08T18:33:37.251300+0000","last_undegraded":"2024-05-08T18:33:37.251300+0000","last_fullsized":"2024-05-08T18:33:37.251300+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:37.251077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:37.251077+0000","last_clean_scrub_stamp":"2024-05-08T18:33:37.251077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:50:50.999977+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"80'2","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:11.776130+0000","last_change":"2024-05-08T18:33:11.776192+0000","last_active":"2024-05-08T18:33:11.776130+0000","last_peered":"2024-05-08T18:33:11.776130+0000","last_clean":"2024-05-08T18:33:11.776130+0000","last_became_active":"2024-05-08T18:29:42.574288+0000","last_became_peered":"2024-05-08T18:29:42.574288+0000","last_unstale":"2024-05-08T18:33:11.776130+0000","last_undegraded":"2024-05-08T18:33:11.776130+0000","last_fullsized":"2024-05-08T18:33:11.776130+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2","last_scrub_stamp":"2024-05-08T18:33:11.775925+0000","last_deep_scrub":"80'2","last_deep_scrub_stamp":"2024-05-08T18:33:11.775925+0000","last_clean_scrub_stamp":"2024-05-08T18:33:11.775925+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:55:00.699168+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"116'22","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:18.823057+0000","last_change":"2024-05-08T18:33:18.823117+0000","last_active":"2024-05-08T18:33:18.823057+0000","last_peered":"2024-05-08T18:33:18.823057+0000","last_clean":"2024-05-08T18:33:18.823057+0000","last_became_active":"2024-05-08T18:30:20.850365+0000","last_became_peered":"2024-05-08T18:30:20.850365+0000","last_unstale":"2024-05-08T18:33:18.823057+0000","last_undegraded":"2024-05-08T18:33:18.823057+0000","last_fullsized":"2024-05-08T18:33:18.823057+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'22","last_scrub_stamp":"2024-05-08T18:33:18.822863+0000","last_deep_scrub":"116'22","last_deep_scrub_stamp":"2024-05-08T18:33:18.822863+0000","last_clean_scrub_stamp":"2024-05-08T18:33:18.822863+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:26:08.884895+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:15.820342+0000","last_change":"2024-05-08T18:33:15.820399+0000","last_active":"2024-05-08T18:33:15.820342+0000","last_peered":"2024-05-08T18:33:15.820342+0000","last_clean":"2024-05-08T18:33:15.820342+0000","last_became_active":"2024-05-08T18:29:34.605574+0000","last_became_peered":"2024-05-08T18:29:34.605574+0000","last_unstale":"2024-05-08T18:33:15.820342+0000","last_undegraded":"2024-05-08T18:33:15.820342+0000","last_fullsized":"2024-05-08T18:33:15.820342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:15.820133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:15.820133+0000","last_clean_scrub_stamp":"2024-05-08T18:33:15.820133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:51:06.134435+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:16.933397+0000","last_change":"2024-05-08T18:33:16.933456+0000","last_active":"2024-05-08T18:33:16.933397+0000","last_peered":"2024-05-08T18:33:16.933397+0000","last_clean":"2024-05-08T18:33:16.933397+0000","last_became_active":"2024-05-08T18:29:44.594642+0000","last_became_peered":"2024-05-08T18:29:44.594642+0000","last_unstale":"2024-05-08T18:33:16.933397+0000","last_undegraded":"2024-05-08T18:33:16.933397+0000","last_fullsized":"2024-05-08T18:33:16.933397+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:16.933187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:16.933187+0000","last_clean_scrub_stamp":"2024-05-08T18:33:16.933187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:45:39.627830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"116'47","reported_seq":263,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:33.043342+0000","last_change":"2024-05-08T18:33:33.043437+0000","last_active":"2024-05-08T18:33:33.043342+0000","last_peered":"2024-05-08T18:33:33.043342+0000","last_clean":"2024-05-08T18:33:33.043342+0000","last_became_active":"2024-05-08T18:29:46.599707+0000","last_became_peered":"2024-05-08T18:29:46.599707+0000","last_unstale":"2024-05-08T18:33:33.043342+0000","last_undegraded":"2024-05-08T18:33:33.043342+0000","last_fullsized":"2024-05-08T18:33:33.043342+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'47","last_scrub_stamp":"2024-05-08T18:33:33.043135+0000","last_deep_scrub":"116'47","last_deep_scrub_stamp":"2024-05-08T18:33:33.043135+0000","last_clean_scrub_stamp":"2024-05-08T18:33:33.043135+0000","objects_scrubbed":8,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:31:09.581461+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":53,"num_read_kb":162,"num_write":30,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:33.586476+0000","last_change":"2024-05-08T18:33:33.586584+0000","last_active":"2024-05-08T18:33:33.586476+0000","last_peered":"2024-05-08T18:33:33.586476+0000","last_clean":"2024-05-08T18:33:33.586476+0000","last_became_active":"2024-05-08T18:29:48.638709+0000","last_became_peered":"2024-05-08T18:29:48.638709+0000","last_unstale":"2024-05-08T18:33:33.586476+0000","last_undegraded":"2024-05-08T18:33:33.586476+0000","last_fullsized":"2024-05-08T18:33:33.586476+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:33.586196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:33.586196+0000","last_clean_scrub_stamp":"2024-05-08T18:33:33.586196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:16:18.289353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"97'6","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:35.963974+0000","last_change":"2024-05-08T18:33:35.964114+0000","last_active":"2024-05-08T18:33:35.963974+0000","last_peered":"2024-05-08T18:33:35.963974+0000","last_clean":"2024-05-08T18:33:35.963974+0000","last_became_active":"2024-05-08T18:29:50.675766+0000","last_became_peered":"2024-05-08T18:29:50.675766+0000","last_unstale":"2024-05-08T18:33:35.963974+0000","last_undegraded":"2024-05-08T18:33:35.963974+0000","last_fullsized":"2024-05-08T18:33:35.963974+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'6","last_scrub_stamp":"2024-05-08T18:33:35.963673+0000","last_deep_scrub":"97'6","last_deep_scrub_stamp":"2024-05-08T18:33:35.963673+0000","last_clean_scrub_stamp":"2024-05-08T18:33:35.963673+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:05:43.538004+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"80'2","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:11.856967+0000","last_change":"2024-05-08T18:33:11.857034+0000","last_active":"2024-05-08T18:33:11.856967+0000","last_peered":"2024-05-08T18:33:11.856967+0000","last_clean":"2024-05-08T18:33:11.856967+0000","last_became_active":"2024-05-08T18:29:42.570645+0000","last_became_peered":"2024-05-08T18:29:42.570645+0000","last_unstale":"2024-05-08T18:33:11.856967+0000","last_undegraded":"2024-05-08T18:33:11.856967+0000","last_fullsized":"2024-05-08T18:33:11.856967+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2","last_scrub_stamp":"2024-05-08T18:33:11.856766+0000","last_deep_scrub":"80'2","last_deep_scrub_stamp":"2024-05-08T18:33:11.856766+0000","last_clean_scrub_stamp":"2024-05-08T18:33:11.856766+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:47.882638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"116'6","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:17.754246+0000","last_change":"2024-05-08T18:33:17.754306+0000","last_active":"2024-05-08T18:33:17.754246+0000","last_peered":"2024-05-08T18:33:17.754246+0000","last_clean":"2024-05-08T18:33:17.754246+0000","last_became_active":"2024-05-08T18:29:40.530256+0000","last_became_peered":"2024-05-08T18:29:40.530256+0000","last_unstale":"2024-05-08T18:33:17.754246+0000","last_undegraded":"2024-05-08T18:33:17.754246+0000","last_fullsized":"2024-05-08T18:33:17.754246+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'6","last_scrub_stamp":"2024-05-08T18:33:17.754029+0000","last_deep_scrub":"116'6","last_deep_scrub_stamp":"2024-05-08T18:33:17.754029+0000","last_clean_scrub_stamp":"2024-05-08T18:33:17.754029+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:59:58.713080+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:23.853100+0000","last_change":"2024-05-08T18:33:23.853159+0000","last_active":"2024-05-08T18:33:23.853100+0000","last_peered":"2024-05-08T18:33:23.853100+0000","last_clean":"2024-05-08T18:33:23.853100+0000","last_became_active":"2024-05-08T18:29:34.602547+0000","last_became_peered":"2024-05-08T18:29:34.602547+0000","last_unstale":"2024-05-08T18:33:23.853100+0000","last_undegraded":"2024-05-08T18:33:23.853100+0000","last_fullsized":"2024-05-08T18:33:23.853100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:23.852887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:23.852887+0000","last_clean_scrub_stamp":"2024-05-08T18:33:23.852887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:27:37.133276+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:08.632123+0000","last_change":"2024-05-08T18:33:08.632177+0000","last_active":"2024-05-08T18:33:08.632123+0000","last_peered":"2024-05-08T18:33:08.632123+0000","last_clean":"2024-05-08T18:33:08.632123+0000","last_became_active":"2024-05-08T18:29:44.591870+0000","last_became_peered":"2024-05-08T18:29:44.591870+0000","last_unstale":"2024-05-08T18:33:08.632123+0000","last_undegraded":"2024-05-08T18:33:08.632123+0000","last_fullsized":"2024-05-08T18:33:08.632123+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:08.631919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:08.631919+0000","last_clean_scrub_stamp":"2024-05-08T18:33:08.631919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:56:39.299991+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"116'21","reported_seq":224,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:10.811207+0000","last_change":"2024-05-08T18:33:10.811356+0000","last_active":"2024-05-08T18:33:10.811207+0000","last_peered":"2024-05-08T18:33:10.811207+0000","last_clean":"2024-05-08T18:33:10.811207+0000","last_became_active":"2024-05-08T18:29:46.602920+0000","last_became_peered":"2024-05-08T18:29:46.602920+0000","last_unstale":"2024-05-08T18:33:10.811207+0000","last_undegraded":"2024-05-08T18:33:10.811207+0000","last_fullsized":"2024-05-08T18:33:10.811207+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'21","last_scrub_stamp":"2024-05-08T18:33:10.810930+0000","last_deep_scrub":"116'21","last_deep_scrub_stamp":"2024-05-08T18:33:10.810930+0000","last_clean_scrub_stamp":"2024-05-08T18:33:10.810930+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:40:04.662911+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"116'105","reported_seq":343,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.203237+0000","last_change":"2024-05-08T18:33:06.203314+0000","last_active":"2024-05-08T18:33:06.203237+0000","last_peered":"2024-05-08T18:33:06.203237+0000","last_clean":"2024-05-08T18:33:06.203237+0000","last_became_active":"2024-05-08T18:29:48.634280+0000","last_became_peered":"2024-05-08T18:29:48.634280+0000","last_unstale":"2024-05-08T18:33:06.203237+0000","last_undegraded":"2024-05-08T18:33:06.203237+0000","last_fullsized":"2024-05-08T18:33:06.203237+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'105","last_scrub_stamp":"2024-05-08T18:33:06.203046+0000","last_deep_scrub":"116'105","last_deep_scrub_stamp":"2024-05-08T18:33:06.203046+0000","last_clean_scrub_stamp":"2024-05-08T18:33:06.203046+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:11:28.565523+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"80'2","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:37.867330+0000","last_change":"2024-05-08T18:33:37.867398+0000","last_active":"2024-05-08T18:33:37.867330+0000","last_peered":"2024-05-08T18:33:37.867330+0000","last_clean":"2024-05-08T18:33:37.867330+0000","last_became_active":"2024-05-08T18:29:50.687135+0000","last_became_peered":"2024-05-08T18:29:50.687135+0000","last_unstale":"2024-05-08T18:33:37.867330+0000","last_undegraded":"2024-05-08T18:33:37.867330+0000","last_fullsized":"2024-05-08T18:33:37.867330+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2","last_scrub_stamp":"2024-05-08T18:33:37.867115+0000","last_deep_scrub":"80'2","last_deep_scrub_stamp":"2024-05-08T18:33:37.867115+0000","last_clean_scrub_stamp":"2024-05-08T18:33:37.867115+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:32:46.350823+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"80'2","reported_seq":161,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:20.865601+0000","last_change":"2024-05-08T18:33:20.865670+0000","last_active":"2024-05-08T18:33:20.865601+0000","last_peered":"2024-05-08T18:33:20.865601+0000","last_clean":"2024-05-08T18:33:20.865601+0000","last_became_active":"2024-05-08T18:30:21.220196+0000","last_became_peered":"2024-05-08T18:30:21.220196+0000","last_unstale":"2024-05-08T18:33:20.865601+0000","last_undegraded":"2024-05-08T18:33:20.865601+0000","last_fullsized":"2024-05-08T18:33:20.865601+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2","last_scrub_stamp":"2024-05-08T18:33:20.865401+0000","last_deep_scrub":"80'2","last_deep_scrub_stamp":"2024-05-08T18:33:20.865401+0000","last_clean_scrub_stamp":"2024-05-08T18:33:20.865401+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:40:14.717383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"116'10","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:34.925427+0000","last_change":"2024-05-08T18:33:34.925493+0000","last_active":"2024-05-08T18:33:34.925427+0000","last_peered":"2024-05-08T18:33:34.925427+0000","last_clean":"2024-05-08T18:33:34.925427+0000","last_became_active":"2024-05-08T18:29:40.565655+0000","last_became_peered":"2024-05-08T18:29:40.565655+0000","last_unstale":"2024-05-08T18:33:34.925427+0000","last_undegraded":"2024-05-08T18:33:34.925427+0000","last_fullsized":"2024-05-08T18:33:34.925427+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'10","last_scrub_stamp":"2024-05-08T18:33:34.925231+0000","last_deep_scrub":"116'10","last_deep_scrub_stamp":"2024-05-08T18:33:34.925231+0000","last_clean_scrub_stamp":"2024-05-08T18:33:34.925231+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:07:46.364352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:14.830317+0000","last_change":"2024-05-08T18:33:14.830428+0000","last_active":"2024-05-08T18:33:14.830317+0000","last_peered":"2024-05-08T18:33:14.830317+0000","last_clean":"2024-05-08T18:33:14.830317+0000","last_became_active":"2024-05-08T18:29:34.500933+0000","last_became_peered":"2024-05-08T18:29:34.500933+0000","last_unstale":"2024-05-08T18:33:14.830317+0000","last_undegraded":"2024-05-08T18:33:14.830317+0000","last_fullsized":"2024-05-08T18:33:14.830317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:14.829982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:14.829982+0000","last_clean_scrub_stamp":"2024-05-08T18:33:14.829982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:17:25.384731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:19.531816+0000","last_change":"2024-05-08T18:33:19.531875+0000","last_active":"2024-05-08T18:33:19.531816+0000","last_peered":"2024-05-08T18:33:19.531816+0000","last_clean":"2024-05-08T18:33:19.531816+0000","last_became_active":"2024-05-08T18:29:44.575454+0000","last_became_peered":"2024-05-08T18:29:44.575454+0000","last_unstale":"2024-05-08T18:33:19.531816+0000","last_undegraded":"2024-05-08T18:33:19.531816+0000","last_fullsized":"2024-05-08T18:33:19.531816+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:19.531621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:19.531621+0000","last_clean_scrub_stamp":"2024-05-08T18:33:19.531621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:11:19.253395+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"116'16","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:02.599578+0000","last_change":"2024-05-08T18:33:02.599677+0000","last_active":"2024-05-08T18:33:02.599578+0000","last_peered":"2024-05-08T18:33:02.599578+0000","last_clean":"2024-05-08T18:33:02.599578+0000","last_became_active":"2024-05-08T18:29:46.603455+0000","last_became_peered":"2024-05-08T18:29:46.603455+0000","last_unstale":"2024-05-08T18:33:02.599578+0000","last_undegraded":"2024-05-08T18:33:02.599578+0000","last_fullsized":"2024-05-08T18:33:02.599578+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'16","last_scrub_stamp":"2024-05-08T18:33:02.599369+0000","last_deep_scrub":"116'16","last_deep_scrub_stamp":"2024-05-08T18:33:02.599369+0000","last_clean_scrub_stamp":"2024-05-08T18:33:02.599369+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:24:13.274296+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"116'105","reported_seq":377,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:01.696140+0000","last_change":"2024-05-08T18:33:01.696176+0000","last_active":"2024-05-08T18:33:01.696140+0000","last_peered":"2024-05-08T18:33:01.696140+0000","last_clean":"2024-05-08T18:33:01.696140+0000","last_became_active":"2024-05-08T18:29:48.637070+0000","last_became_peered":"2024-05-08T18:29:48.637070+0000","last_unstale":"2024-05-08T18:33:01.696140+0000","last_undegraded":"2024-05-08T18:33:01.696140+0000","last_fullsized":"2024-05-08T18:33:01.696140+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'105","last_scrub_stamp":"2024-05-08T18:33:01.696035+0000","last_deep_scrub":"116'105","last_deep_scrub_stamp":"2024-05-08T18:33:01.696035+0000","last_clean_scrub_stamp":"2024-05-08T18:33:01.696035+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:36:00.801974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"84'10","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:39.917790+0000","last_change":"2024-05-08T18:33:39.917922+0000","last_active":"2024-05-08T18:33:39.917790+0000","last_peered":"2024-05-08T18:33:39.917790+0000","last_clean":"2024-05-08T18:33:39.917790+0000","last_became_active":"2024-05-08T18:29:50.690767+0000","last_became_peered":"2024-05-08T18:29:50.690767+0000","last_unstale":"2024-05-08T18:33:39.917790+0000","last_undegraded":"2024-05-08T18:33:39.917790+0000","last_fullsized":"2024-05-08T18:33:39.917790+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'10","last_scrub_stamp":"2024-05-08T18:33:39.917448+0000","last_deep_scrub":"84'10","last_deep_scrub_stamp":"2024-05-08T18:33:39.917448+0000","last_clean_scrub_stamp":"2024-05-08T18:33:39.917448+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:02.539247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"97'16","reported_seq":238,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:14.445429+0000","last_change":"2024-05-08T18:33:14.445551+0000","last_active":"2024-05-08T18:33:14.445429+0000","last_peered":"2024-05-08T18:33:14.445429+0000","last_clean":"2024-05-08T18:33:14.445429+0000","last_became_active":"2024-05-08T18:29:42.560861+0000","last_became_peered":"2024-05-08T18:29:42.560861+0000","last_unstale":"2024-05-08T18:33:14.445429+0000","last_undegraded":"2024-05-08T18:33:14.445429+0000","last_fullsized":"2024-05-08T18:33:14.445429+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'16","last_scrub_stamp":"2024-05-08T18:33:14.445116+0000","last_deep_scrub":"97'16","last_deep_scrub_stamp":"2024-05-08T18:33:14.445116+0000","last_clean_scrub_stamp":"2024-05-08T18:33:14.445116+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:27:50.185862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"116'18","reported_seq":224,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:31.049715+0000","last_change":"2024-05-08T18:33:31.049841+0000","last_active":"2024-05-08T18:33:31.049715+0000","last_peered":"2024-05-08T18:33:31.049715+0000","last_clean":"2024-05-08T18:33:31.049715+0000","last_became_active":"2024-05-08T18:29:40.550241+0000","last_became_peered":"2024-05-08T18:29:40.550241+0000","last_unstale":"2024-05-08T18:33:31.049715+0000","last_undegraded":"2024-05-08T18:33:31.049715+0000","last_fullsized":"2024-05-08T18:33:31.049715+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'18","last_scrub_stamp":"2024-05-08T18:33:31.049410+0000","last_deep_scrub":"116'18","last_deep_scrub_stamp":"2024-05-08T18:33:31.049410+0000","last_clean_scrub_stamp":"2024-05-08T18:33:31.049410+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:34:22.707751+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:12.522977+0000","last_change":"2024-05-08T18:33:12.523030+0000","last_active":"2024-05-08T18:33:12.522977+0000","last_peered":"2024-05-08T18:33:12.522977+0000","last_clean":"2024-05-08T18:33:12.522977+0000","last_became_active":"2024-05-08T18:29:34.492891+0000","last_became_peered":"2024-05-08T18:29:34.492891+0000","last_unstale":"2024-05-08T18:33:12.522977+0000","last_undegraded":"2024-05-08T18:33:12.522977+0000","last_fullsized":"2024-05-08T18:33:12.522977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:12.522775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:12.522775+0000","last_clean_scrub_stamp":"2024-05-08T18:33:12.522775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:55:44.584704+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:19.920072+0000","last_change":"2024-05-08T18:33:19.920125+0000","last_active":"2024-05-08T18:33:19.920072+0000","last_peered":"2024-05-08T18:33:19.920072+0000","last_clean":"2024-05-08T18:33:19.920072+0000","last_became_active":"2024-05-08T18:29:44.589471+0000","last_became_peered":"2024-05-08T18:29:44.589471+0000","last_unstale":"2024-05-08T18:33:19.920072+0000","last_undegraded":"2024-05-08T18:33:19.920072+0000","last_fullsized":"2024-05-08T18:33:19.920072+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:19.919859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:19.919859+0000","last_clean_scrub_stamp":"2024-05-08T18:33:19.919859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:39:22.835248+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"116'51","reported_seq":271,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:19.807262+0000","last_change":"2024-05-08T18:33:19.807344+0000","last_active":"2024-05-08T18:33:19.807262+0000","last_peered":"2024-05-08T18:33:19.807262+0000","last_clean":"2024-05-08T18:33:19.807262+0000","last_became_active":"2024-05-08T18:29:46.605693+0000","last_became_peered":"2024-05-08T18:29:46.605693+0000","last_unstale":"2024-05-08T18:33:19.807262+0000","last_undegraded":"2024-05-08T18:33:19.807262+0000","last_fullsized":"2024-05-08T18:33:19.807262+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'51","last_scrub_stamp":"2024-05-08T18:33:19.807007+0000","last_deep_scrub":"116'51","last_deep_scrub_stamp":"2024-05-08T18:33:19.807007+0000","last_clean_scrub_stamp":"2024-05-08T18:33:19.807007+0000","objects_scrubbed":8,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:11:19.528781+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":57,"num_read_kb":43,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:04.773213+0000","last_change":"2024-05-08T18:33:04.773271+0000","last_active":"2024-05-08T18:33:04.773213+0000","last_peered":"2024-05-08T18:33:04.773213+0000","last_clean":"2024-05-08T18:33:04.773213+0000","last_became_active":"2024-05-08T18:29:48.633607+0000","last_became_peered":"2024-05-08T18:29:48.633607+0000","last_unstale":"2024-05-08T18:33:04.773213+0000","last_undegraded":"2024-05-08T18:33:04.773213+0000","last_fullsized":"2024-05-08T18:33:04.773213+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:04.773014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:04.773014+0000","last_clean_scrub_stamp":"2024-05-08T18:33:04.773014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:24:24.320241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:38.267048+0000","last_change":"2024-05-08T18:33:38.267112+0000","last_active":"2024-05-08T18:33:38.267048+0000","last_peered":"2024-05-08T18:33:38.267048+0000","last_clean":"2024-05-08T18:33:38.267048+0000","last_became_active":"2024-05-08T18:29:50.684818+0000","last_became_peered":"2024-05-08T18:29:50.684818+0000","last_unstale":"2024-05-08T18:33:38.267048+0000","last_undegraded":"2024-05-08T18:33:38.267048+0000","last_fullsized":"2024-05-08T18:33:38.267048+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:38.266855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:38.266855+0000","last_clean_scrub_stamp":"2024-05-08T18:33:38.266855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:30:55.977778+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:36.923956+0000","last_change":"2024-05-08T18:33:36.924065+0000","last_active":"2024-05-08T18:33:36.923956+0000","last_peered":"2024-05-08T18:33:36.923956+0000","last_clean":"2024-05-08T18:33:36.923956+0000","last_became_active":"2024-05-08T18:29:50.681771+0000","last_became_peered":"2024-05-08T18:29:50.681771+0000","last_unstale":"2024-05-08T18:33:36.923956+0000","last_undegraded":"2024-05-08T18:33:36.923956+0000","last_fullsized":"2024-05-08T18:33:36.923956+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:36.923732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:36.923732+0000","last_clean_scrub_stamp":"2024-05-08T18:33:36.923732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:25:54.216928+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"84'4","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:11.516666+0000","last_change":"2024-05-08T18:33:11.516848+0000","last_active":"2024-05-08T18:33:11.516666+0000","last_peered":"2024-05-08T18:33:11.516666+0000","last_clean":"2024-05-08T18:33:11.516666+0000","last_became_active":"2024-05-08T18:29:42.574877+0000","last_became_peered":"2024-05-08T18:29:42.574877+0000","last_unstale":"2024-05-08T18:33:11.516666+0000","last_undegraded":"2024-05-08T18:33:11.516666+0000","last_fullsized":"2024-05-08T18:33:11.516666+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'4","last_scrub_stamp":"2024-05-08T18:33:11.516428+0000","last_deep_scrub":"84'4","last_deep_scrub_stamp":"2024-05-08T18:33:11.516428+0000","last_clean_scrub_stamp":"2024-05-08T18:33:11.516428+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:04:19.950937+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"116'22","reported_seq":230,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:26.537482+0000","last_change":"2024-05-08T18:33:26.537541+0000","last_active":"2024-05-08T18:33:26.537482+0000","last_peered":"2024-05-08T18:33:26.537482+0000","last_clean":"2024-05-08T18:33:26.537482+0000","last_became_active":"2024-05-08T18:29:40.565874+0000","last_became_peered":"2024-05-08T18:29:40.565874+0000","last_unstale":"2024-05-08T18:33:26.537482+0000","last_undegraded":"2024-05-08T18:33:26.537482+0000","last_fullsized":"2024-05-08T18:33:26.537482+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'22","last_scrub_stamp":"2024-05-08T18:33:26.537286+0000","last_deep_scrub":"116'22","last_deep_scrub_stamp":"2024-05-08T18:33:26.537286+0000","last_clean_scrub_stamp":"2024-05-08T18:33:26.537286+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:00:00.082935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:04.850748+0000","last_change":"2024-05-08T18:33:04.850805+0000","last_active":"2024-05-08T18:33:04.850748+0000","last_peered":"2024-05-08T18:33:04.850748+0000","last_clean":"2024-05-08T18:33:04.850748+0000","last_became_active":"2024-05-08T18:29:44.594286+0000","last_became_peered":"2024-05-08T18:29:44.594286+0000","last_unstale":"2024-05-08T18:33:04.850748+0000","last_undegraded":"2024-05-08T18:33:04.850748+0000","last_fullsized":"2024-05-08T18:33:04.850748+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:04.850525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:04.850525+0000","last_clean_scrub_stamp":"2024-05-08T18:33:04.850525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:01:58.648413+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"116'26","reported_seq":232,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:35.926609+0000","last_change":"2024-05-08T18:33:35.926799+0000","last_active":"2024-05-08T18:33:35.926609+0000","last_peered":"2024-05-08T18:33:35.926609+0000","last_clean":"2024-05-08T18:33:35.926609+0000","last_became_active":"2024-05-08T18:29:46.588810+0000","last_became_peered":"2024-05-08T18:29:46.588810+0000","last_unstale":"2024-05-08T18:33:35.926609+0000","last_undegraded":"2024-05-08T18:33:35.926609+0000","last_fullsized":"2024-05-08T18:33:35.926609+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'26","last_scrub_stamp":"2024-05-08T18:33:35.926356+0000","last_deep_scrub":"116'26","last_deep_scrub_stamp":"2024-05-08T18:33:35.926356+0000","last_clean_scrub_stamp":"2024-05-08T18:33:35.926356+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:05:43.500687+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:03.743861+0000","last_change":"2024-05-08T18:33:03.743896+0000","last_active":"2024-05-08T18:33:03.743861+0000","last_peered":"2024-05-08T18:33:03.743861+0000","last_clean":"2024-05-08T18:33:03.743861+0000","last_became_active":"2024-05-08T18:29:48.633866+0000","last_became_peered":"2024-05-08T18:29:48.633866+0000","last_unstale":"2024-05-08T18:33:03.743861+0000","last_undegraded":"2024-05-08T18:33:03.743861+0000","last_fullsized":"2024-05-08T18:33:03.743861+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:03.743733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:03.743733+0000","last_clean_scrub_stamp":"2024-05-08T18:33:03.743733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:01:58.619258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"83'16","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.065966+0000","last_change":"2024-05-08T18:29:50.693408+0000","last_active":"2024-05-08T18:32:46.065966+0000","last_peered":"2024-05-08T18:32:46.065966+0000","last_clean":"2024-05-08T18:32:46.065966+0000","last_became_active":"2024-05-08T18:29:50.692687+0000","last_became_peered":"2024-05-08T18:29:50.692687+0000","last_unstale":"2024-05-08T18:32:46.065966+0000","last_undegraded":"2024-05-08T18:32:46.065966+0000","last_fullsized":"2024-05-08T18:32:46.065966+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:49.624707+0000","last_clean_scrub_stamp":"2024-05-08T18:29:49.624707+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":28,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"83'6","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:03.863340+0000","last_change":"2024-05-08T18:33:03.863365+0000","last_active":"2024-05-08T18:33:03.863340+0000","last_peered":"2024-05-08T18:33:03.863340+0000","last_clean":"2024-05-08T18:33:03.863340+0000","last_became_active":"2024-05-08T18:29:42.580887+0000","last_became_peered":"2024-05-08T18:29:42.580887+0000","last_unstale":"2024-05-08T18:33:03.863340+0000","last_undegraded":"2024-05-08T18:33:03.863340+0000","last_fullsized":"2024-05-08T18:33:03.863340+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'6","last_scrub_stamp":"2024-05-08T18:33:03.863262+0000","last_deep_scrub":"83'6","last_deep_scrub_stamp":"2024-05-08T18:33:03.863262+0000","last_clean_scrub_stamp":"2024-05-08T18:33:03.863262+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:16:10.334188+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"116'14","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:16.799292+0000","last_change":"2024-05-08T18:33:16.799353+0000","last_active":"2024-05-08T18:33:16.799292+0000","last_peered":"2024-05-08T18:33:16.799292+0000","last_clean":"2024-05-08T18:33:16.799292+0000","last_became_active":"2024-05-08T18:29:40.572079+0000","last_became_peered":"2024-05-08T18:29:40.572079+0000","last_unstale":"2024-05-08T18:33:16.799292+0000","last_undegraded":"2024-05-08T18:33:16.799292+0000","last_fullsized":"2024-05-08T18:33:16.799292+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'14","last_scrub_stamp":"2024-05-08T18:33:16.799068+0000","last_deep_scrub":"116'14","last_deep_scrub_stamp":"2024-05-08T18:33:16.799068+0000","last_clean_scrub_stamp":"2024-05-08T18:33:16.799068+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:35:39.535106+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:15.839987+0000","last_change":"2024-05-08T18:33:15.840086+0000","last_active":"2024-05-08T18:33:15.839987+0000","last_peered":"2024-05-08T18:33:15.839987+0000","last_clean":"2024-05-08T18:33:15.839987+0000","last_became_active":"2024-05-08T18:29:44.580805+0000","last_became_peered":"2024-05-08T18:29:44.580805+0000","last_unstale":"2024-05-08T18:33:15.839987+0000","last_undegraded":"2024-05-08T18:33:15.839987+0000","last_fullsized":"2024-05-08T18:33:15.839987+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:15.839695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:15.839695+0000","last_clean_scrub_stamp":"2024-05-08T18:33:15.839695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:07:53.998183+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"116'8","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:07.889630+0000","last_change":"2024-05-08T18:33:07.889705+0000","last_active":"2024-05-08T18:33:07.889630+0000","last_peered":"2024-05-08T18:33:07.889630+0000","last_clean":"2024-05-08T18:33:07.889630+0000","last_became_active":"2024-05-08T18:29:46.599789+0000","last_became_peered":"2024-05-08T18:29:46.599789+0000","last_unstale":"2024-05-08T18:33:07.889630+0000","last_undegraded":"2024-05-08T18:33:07.889630+0000","last_fullsized":"2024-05-08T18:33:07.889630+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'8","last_scrub_stamp":"2024-05-08T18:33:07.889455+0000","last_deep_scrub":"116'8","last_deep_scrub_stamp":"2024-05-08T18:33:07.889455+0000","last_clean_scrub_stamp":"2024-05-08T18:33:07.889455+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:51:04.569065+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":187,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:33.720465+0000","last_change":"2024-05-08T18:33:33.720519+0000","last_active":"2024-05-08T18:33:33.720465+0000","last_peered":"2024-05-08T18:33:33.720465+0000","last_clean":"2024-05-08T18:33:33.720465+0000","last_became_active":"2024-05-08T18:29:48.642056+0000","last_became_peered":"2024-05-08T18:29:48.642056+0000","last_unstale":"2024-05-08T18:33:33.720465+0000","last_undegraded":"2024-05-08T18:33:33.720465+0000","last_fullsized":"2024-05-08T18:33:33.720465+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:33.720269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:33.720269+0000","last_clean_scrub_stamp":"2024-05-08T18:33:33.720269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:08:32.225703+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:34.986924+0000","last_change":"2024-05-08T18:33:34.986988+0000","last_active":"2024-05-08T18:33:34.986924+0000","last_peered":"2024-05-08T18:33:34.986924+0000","last_clean":"2024-05-08T18:33:34.986924+0000","last_became_active":"2024-05-08T18:29:50.671781+0000","last_became_peered":"2024-05-08T18:29:50.671781+0000","last_unstale":"2024-05-08T18:33:34.986924+0000","last_undegraded":"2024-05-08T18:33:34.986924+0000","last_fullsized":"2024-05-08T18:33:34.986924+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:34.986705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:34.986705+0000","last_clean_scrub_stamp":"2024-05-08T18:33:34.986705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:07:46.425826+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"97'2","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:12.704906+0000","last_change":"2024-05-08T18:33:12.704969+0000","last_active":"2024-05-08T18:33:12.704906+0000","last_peered":"2024-05-08T18:33:12.704906+0000","last_clean":"2024-05-08T18:33:12.704906+0000","last_became_active":"2024-05-08T18:29:42.576379+0000","last_became_peered":"2024-05-08T18:29:42.576379+0000","last_unstale":"2024-05-08T18:33:12.704906+0000","last_undegraded":"2024-05-08T18:33:12.704906+0000","last_fullsized":"2024-05-08T18:33:12.704906+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'2","last_scrub_stamp":"2024-05-08T18:33:12.704698+0000","last_deep_scrub":"97'2","last_deep_scrub_stamp":"2024-05-08T18:33:12.704698+0000","last_clean_scrub_stamp":"2024-05-08T18:33:12.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:39.541544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"116'24","reported_seq":229,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:29.254024+0000","last_change":"2024-05-08T18:33:29.254101+0000","last_active":"2024-05-08T18:33:29.254024+0000","last_peered":"2024-05-08T18:33:29.254024+0000","last_clean":"2024-05-08T18:33:29.254024+0000","last_became_active":"2024-05-08T18:29:40.542239+0000","last_became_peered":"2024-05-08T18:29:40.542239+0000","last_unstale":"2024-05-08T18:33:29.254024+0000","last_undegraded":"2024-05-08T18:33:29.254024+0000","last_fullsized":"2024-05-08T18:33:29.254024+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'24","last_scrub_stamp":"2024-05-08T18:33:29.253789+0000","last_deep_scrub":"116'24","last_deep_scrub_stamp":"2024-05-08T18:33:29.253789+0000","last_clean_scrub_stamp":"2024-05-08T18:33:29.253789+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:09:18.942903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":24,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:11.865055+0000","last_change":"2024-05-08T18:33:11.865207+0000","last_active":"2024-05-08T18:33:11.865055+0000","last_peered":"2024-05-08T18:33:11.865055+0000","last_clean":"2024-05-08T18:33:11.865055+0000","last_became_active":"2024-05-08T18:29:44.592476+0000","last_became_peered":"2024-05-08T18:29:44.592476+0000","last_unstale":"2024-05-08T18:33:11.865055+0000","last_undegraded":"2024-05-08T18:33:11.865055+0000","last_fullsized":"2024-05-08T18:33:11.865055+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:11.864822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:11.864822+0000","last_clean_scrub_stamp":"2024-05-08T18:33:11.864822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:04:20.299330+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"116'24","reported_seq":230,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:10.770915+0000","last_change":"2024-05-08T18:33:10.771004+0000","last_active":"2024-05-08T18:33:10.770915+0000","last_peered":"2024-05-08T18:33:10.770915+0000","last_clean":"2024-05-08T18:33:10.770915+0000","last_became_active":"2024-05-08T18:29:46.596452+0000","last_became_peered":"2024-05-08T18:29:46.596452+0000","last_unstale":"2024-05-08T18:33:10.770915+0000","last_undegraded":"2024-05-08T18:33:10.770915+0000","last_fullsized":"2024-05-08T18:33:10.770915+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'24","last_scrub_stamp":"2024-05-08T18:33:10.770722+0000","last_deep_scrub":"116'24","last_deep_scrub_stamp":"2024-05-08T18:33:10.770722+0000","last_clean_scrub_stamp":"2024-05-08T18:33:10.770722+0000","objects_scrubbed":5,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:49:54.138164+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":187,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:20.679900+0000","last_change":"2024-05-08T18:33:20.679959+0000","last_active":"2024-05-08T18:33:20.679900+0000","last_peered":"2024-05-08T18:33:20.679900+0000","last_clean":"2024-05-08T18:33:20.679900+0000","last_became_active":"2024-05-08T18:29:48.634704+0000","last_became_peered":"2024-05-08T18:29:48.634704+0000","last_unstale":"2024-05-08T18:33:20.679900+0000","last_undegraded":"2024-05-08T18:33:20.679900+0000","last_fullsized":"2024-05-08T18:33:20.679900+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:20.679686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:20.679686+0000","last_clean_scrub_stamp":"2024-05-08T18:33:20.679686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:09:41.555781+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"83'2","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:39.244121+0000","last_change":"2024-05-08T18:33:39.244259+0000","last_active":"2024-05-08T18:33:39.244121+0000","last_peered":"2024-05-08T18:33:39.244121+0000","last_clean":"2024-05-08T18:33:39.244121+0000","last_became_active":"2024-05-08T18:29:50.687045+0000","last_became_peered":"2024-05-08T18:29:50.687045+0000","last_unstale":"2024-05-08T18:33:39.244121+0000","last_undegraded":"2024-05-08T18:33:39.244121+0000","last_fullsized":"2024-05-08T18:33:39.244121+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'2","last_scrub_stamp":"2024-05-08T18:33:39.243851+0000","last_deep_scrub":"83'2","last_deep_scrub_stamp":"2024-05-08T18:33:39.243851+0000","last_clean_scrub_stamp":"2024-05-08T18:33:39.243851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:38.355360+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"97'4","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:32:46.063787+0000","last_change":"2024-05-08T18:30:20.850226+0000","last_active":"2024-05-08T18:32:46.063787+0000","last_peered":"2024-05-08T18:32:46.063787+0000","last_clean":"2024-05-08T18:32:46.063787+0000","last_became_active":"2024-05-08T18:30:20.849751+0000","last_became_peered":"2024-05-08T18:30:20.849751+0000","last_unstale":"2024-05-08T18:32:46.063787+0000","last_undegraded":"2024-05-08T18:32:46.063787+0000","last_fullsized":"2024-05-08T18:32:46.063787+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:29:41.517676+0000","last_clean_scrub_stamp":"2024-05-08T18:29:41.517676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"116'26","reported_seq":232,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:26.997877+0000","last_change":"2024-05-08T18:33:26.998035+0000","last_active":"2024-05-08T18:33:26.997877+0000","last_peered":"2024-05-08T18:33:26.997877+0000","last_clean":"2024-05-08T18:33:26.997877+0000","last_became_active":"2024-05-08T18:29:40.540835+0000","last_became_peered":"2024-05-08T18:29:40.540835+0000","last_unstale":"2024-05-08T18:33:26.997877+0000","last_undegraded":"2024-05-08T18:33:26.997877+0000","last_fullsized":"2024-05-08T18:33:26.997877+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'26","last_scrub_stamp":"2024-05-08T18:33:26.997589+0000","last_deep_scrub":"116'26","last_deep_scrub_stamp":"2024-05-08T18:33:26.997589+0000","last_clean_scrub_stamp":"2024-05-08T18:33:26.997589+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:49:03.114139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":26,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.623257+0000","last_change":"2024-05-08T18:33:06.623312+0000","last_active":"2024-05-08T18:33:06.623257+0000","last_peered":"2024-05-08T18:33:06.623257+0000","last_clean":"2024-05-08T18:33:06.623257+0000","last_became_active":"2024-05-08T18:29:44.590454+0000","last_became_peered":"2024-05-08T18:29:44.590454+0000","last_unstale":"2024-05-08T18:33:06.623257+0000","last_undegraded":"2024-05-08T18:33:06.623257+0000","last_fullsized":"2024-05-08T18:33:06.623257+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:06.623034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:06.623034+0000","last_clean_scrub_stamp":"2024-05-08T18:33:06.623034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:26:10.851953+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"116'22","reported_seq":224,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:29.866011+0000","last_change":"2024-05-08T18:33:29.866098+0000","last_active":"2024-05-08T18:33:29.866011+0000","last_peered":"2024-05-08T18:33:29.866011+0000","last_clean":"2024-05-08T18:33:29.866011+0000","last_became_active":"2024-05-08T18:29:46.606172+0000","last_became_peered":"2024-05-08T18:29:46.606172+0000","last_unstale":"2024-05-08T18:33:29.866011+0000","last_undegraded":"2024-05-08T18:33:29.866011+0000","last_fullsized":"2024-05-08T18:33:29.866011+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'22","last_scrub_stamp":"2024-05-08T18:33:29.865827+0000","last_deep_scrub":"116'22","last_deep_scrub_stamp":"2024-05-08T18:33:29.865827+0000","last_clean_scrub_stamp":"2024-05-08T18:33:29.865827+0000","objects_scrubbed":4,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:09:19.554940+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:00.946595+0000","last_change":"2024-05-08T18:33:00.946620+0000","last_active":"2024-05-08T18:33:00.946595+0000","last_peered":"2024-05-08T18:33:00.946595+0000","last_clean":"2024-05-08T18:33:00.946595+0000","last_became_active":"2024-05-08T18:29:48.631219+0000","last_became_peered":"2024-05-08T18:29:48.631219+0000","last_unstale":"2024-05-08T18:33:00.946595+0000","last_undegraded":"2024-05-08T18:33:00.946595+0000","last_fullsized":"2024-05-08T18:33:00.946595+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:00.946504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:00.946504+0000","last_clean_scrub_stamp":"2024-05-08T18:33:00.946504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:43:13.162227+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.642050+0000","last_change":"2024-05-08T18:33:05.642167+0000","last_active":"2024-05-08T18:33:05.642050+0000","last_peered":"2024-05-08T18:33:05.642050+0000","last_clean":"2024-05-08T18:33:05.642050+0000","last_became_active":"2024-05-08T18:29:42.569425+0000","last_became_peered":"2024-05-08T18:29:42.569425+0000","last_unstale":"2024-05-08T18:33:05.642050+0000","last_undegraded":"2024-05-08T18:33:05.642050+0000","last_fullsized":"2024-05-08T18:33:05.642050+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:05.641829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:05.641829+0000","last_clean_scrub_stamp":"2024-05-08T18:33:05.641829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:00.182094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"116'16","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:28.875693+0000","last_change":"2024-05-08T18:33:28.875832+0000","last_active":"2024-05-08T18:33:28.875693+0000","last_peered":"2024-05-08T18:33:28.875693+0000","last_clean":"2024-05-08T18:33:28.875693+0000","last_became_active":"2024-05-08T18:29:40.547479+0000","last_became_peered":"2024-05-08T18:29:40.547479+0000","last_unstale":"2024-05-08T18:33:28.875693+0000","last_undegraded":"2024-05-08T18:33:28.875693+0000","last_fullsized":"2024-05-08T18:33:28.875693+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'16","last_scrub_stamp":"2024-05-08T18:33:28.875438+0000","last_deep_scrub":"116'16","last_deep_scrub_stamp":"2024-05-08T18:33:28.875438+0000","last_clean_scrub_stamp":"2024-05-08T18:33:28.875438+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:58:20.850052+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:14.912267+0000","last_change":"2024-05-08T18:33:14.912371+0000","last_active":"2024-05-08T18:33:14.912267+0000","last_peered":"2024-05-08T18:33:14.912267+0000","last_clean":"2024-05-08T18:33:14.912267+0000","last_became_active":"2024-05-08T18:29:44.590498+0000","last_became_peered":"2024-05-08T18:29:44.590498+0000","last_unstale":"2024-05-08T18:33:14.912267+0000","last_undegraded":"2024-05-08T18:33:14.912267+0000","last_fullsized":"2024-05-08T18:33:14.912267+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:14.911981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:14.911981+0000","last_clean_scrub_stamp":"2024-05-08T18:33:14.911981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:08:31.260871+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"116'34","reported_seq":249,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:08.863245+0000","last_change":"2024-05-08T18:33:08.863393+0000","last_active":"2024-05-08T18:33:08.863245+0000","last_peered":"2024-05-08T18:33:08.863245+0000","last_clean":"2024-05-08T18:33:08.863245+0000","last_became_active":"2024-05-08T18:29:46.594672+0000","last_became_peered":"2024-05-08T18:29:46.594672+0000","last_unstale":"2024-05-08T18:33:08.863245+0000","last_undegraded":"2024-05-08T18:33:08.863245+0000","last_fullsized":"2024-05-08T18:33:08.863245+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'34","last_scrub_stamp":"2024-05-08T18:33:08.863016+0000","last_deep_scrub":"116'34","last_deep_scrub_stamp":"2024-05-08T18:33:08.863016+0000","last_clean_scrub_stamp":"2024-05-08T18:33:08.863016+0000","objects_scrubbed":5,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:25:58.925047+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":28,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":189,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:33.186526+0000","last_change":"2024-05-08T18:33:33.186582+0000","last_active":"2024-05-08T18:33:33.186526+0000","last_peered":"2024-05-08T18:33:33.186526+0000","last_clean":"2024-05-08T18:33:33.186526+0000","last_became_active":"2024-05-08T18:29:48.639120+0000","last_became_peered":"2024-05-08T18:29:48.639120+0000","last_unstale":"2024-05-08T18:33:33.186526+0000","last_undegraded":"2024-05-08T18:33:33.186526+0000","last_fullsized":"2024-05-08T18:33:33.186526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:33.186314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:33.186314+0000","last_clean_scrub_stamp":"2024-05-08T18:33:33.186314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:16:17.889471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"84'2","reported_seq":189,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:09.807214+0000","last_change":"2024-05-08T18:33:09.807280+0000","last_active":"2024-05-08T18:33:09.807214+0000","last_peered":"2024-05-08T18:33:09.807214+0000","last_clean":"2024-05-08T18:33:09.807214+0000","last_became_active":"2024-05-08T18:29:50.684119+0000","last_became_peered":"2024-05-08T18:29:50.684119+0000","last_unstale":"2024-05-08T18:33:09.807214+0000","last_undegraded":"2024-05-08T18:33:09.807214+0000","last_fullsized":"2024-05-08T18:33:09.807214+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'2","last_scrub_stamp":"2024-05-08T18:33:09.807009+0000","last_deep_scrub":"84'2","last_deep_scrub_stamp":"2024-05-08T18:33:09.807009+0000","last_clean_scrub_stamp":"2024-05-08T18:33:09.807009+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:08:54.871793+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"80'2","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:12.823461+0000","last_change":"2024-05-08T18:33:12.823521+0000","last_active":"2024-05-08T18:33:12.823461+0000","last_peered":"2024-05-08T18:33:12.823461+0000","last_clean":"2024-05-08T18:33:12.823461+0000","last_became_active":"2024-05-08T18:29:42.575450+0000","last_became_peered":"2024-05-08T18:29:42.575450+0000","last_unstale":"2024-05-08T18:33:12.823461+0000","last_undegraded":"2024-05-08T18:33:12.823461+0000","last_fullsized":"2024-05-08T18:33:12.823461+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2","last_scrub_stamp":"2024-05-08T18:33:12.823265+0000","last_deep_scrub":"80'2","last_deep_scrub_stamp":"2024-05-08T18:33:12.823265+0000","last_clean_scrub_stamp":"2024-05-08T18:33:12.823265+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:39.660112+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"116'20","reported_seq":228,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:19.821539+0000","last_change":"2024-05-08T18:33:19.821600+0000","last_active":"2024-05-08T18:33:19.821539+0000","last_peered":"2024-05-08T18:33:19.821539+0000","last_clean":"2024-05-08T18:33:19.821539+0000","last_became_active":"2024-05-08T18:29:40.545814+0000","last_became_peered":"2024-05-08T18:29:40.545814+0000","last_unstale":"2024-05-08T18:33:19.821539+0000","last_undegraded":"2024-05-08T18:33:19.821539+0000","last_fullsized":"2024-05-08T18:33:19.821539+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'20","last_scrub_stamp":"2024-05-08T18:33:19.821340+0000","last_deep_scrub":"116'20","last_deep_scrub_stamp":"2024-05-08T18:33:19.821340+0000","last_clean_scrub_stamp":"2024-05-08T18:33:19.821340+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:13:44.745049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:04.613824+0000","last_change":"2024-05-08T18:33:04.613945+0000","last_active":"2024-05-08T18:33:04.613824+0000","last_peered":"2024-05-08T18:33:04.613824+0000","last_clean":"2024-05-08T18:33:04.613824+0000","last_became_active":"2024-05-08T18:29:44.590394+0000","last_became_peered":"2024-05-08T18:29:44.590394+0000","last_unstale":"2024-05-08T18:33:04.613824+0000","last_undegraded":"2024-05-08T18:33:04.613824+0000","last_fullsized":"2024-05-08T18:33:04.613824+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:04.613567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:04.613567+0000","last_clean_scrub_stamp":"2024-05-08T18:33:04.613567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:16:36.059115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"116'30","reported_seq":235,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:15.801699+0000","last_change":"2024-05-08T18:33:15.801788+0000","last_active":"2024-05-08T18:33:15.801699+0000","last_peered":"2024-05-08T18:33:15.801699+0000","last_clean":"2024-05-08T18:33:15.801699+0000","last_became_active":"2024-05-08T18:29:46.604917+0000","last_became_peered":"2024-05-08T18:29:46.604917+0000","last_unstale":"2024-05-08T18:33:15.801699+0000","last_undegraded":"2024-05-08T18:33:15.801699+0000","last_fullsized":"2024-05-08T18:33:15.801699+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'30","last_scrub_stamp":"2024-05-08T18:33:15.801482+0000","last_deep_scrub":"116'30","last_deep_scrub_stamp":"2024-05-08T18:33:15.801482+0000","last_clean_scrub_stamp":"2024-05-08T18:33:15.801482+0000","objects_scrubbed":7,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:10:20.396630+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:23.799420+0000","last_change":"2024-05-08T18:33:23.799545+0000","last_active":"2024-05-08T18:33:23.799420+0000","last_peered":"2024-05-08T18:33:23.799420+0000","last_clean":"2024-05-08T18:33:23.799420+0000","last_became_active":"2024-05-08T18:29:48.643493+0000","last_became_peered":"2024-05-08T18:29:48.643493+0000","last_unstale":"2024-05-08T18:33:23.799420+0000","last_undegraded":"2024-05-08T18:33:23.799420+0000","last_fullsized":"2024-05-08T18:33:23.799420+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:23.799156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:23.799156+0000","last_clean_scrub_stamp":"2024-05-08T18:33:23.799156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:34.597706+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:27.789447+0000","last_change":"2024-05-08T18:33:27.789508+0000","last_active":"2024-05-08T18:33:27.789447+0000","last_peered":"2024-05-08T18:33:27.789447+0000","last_clean":"2024-05-08T18:33:27.789447+0000","last_became_active":"2024-05-08T18:29:50.686750+0000","last_became_peered":"2024-05-08T18:29:50.686750+0000","last_unstale":"2024-05-08T18:33:27.789447+0000","last_undegraded":"2024-05-08T18:33:27.789447+0000","last_fullsized":"2024-05-08T18:33:27.789447+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:27.789239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:27.789239+0000","last_clean_scrub_stamp":"2024-05-08T18:33:27.789239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:10:32.384388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"97'4","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:16.872227+0000","last_change":"2024-05-08T18:33:16.872286+0000","last_active":"2024-05-08T18:33:16.872227+0000","last_peered":"2024-05-08T18:33:16.872227+0000","last_clean":"2024-05-08T18:33:16.872227+0000","last_became_active":"2024-05-08T18:29:42.563695+0000","last_became_peered":"2024-05-08T18:29:42.563695+0000","last_unstale":"2024-05-08T18:33:16.872227+0000","last_undegraded":"2024-05-08T18:33:16.872227+0000","last_fullsized":"2024-05-08T18:33:16.872227+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'4","last_scrub_stamp":"2024-05-08T18:33:16.872024+0000","last_deep_scrub":"97'4","last_deep_scrub_stamp":"2024-05-08T18:33:16.872024+0000","last_clean_scrub_stamp":"2024-05-08T18:33:16.872024+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:43:07.312322+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"116'20","reported_seq":228,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:23.516228+0000","last_change":"2024-05-08T18:33:23.516288+0000","last_active":"2024-05-08T18:33:23.516228+0000","last_peered":"2024-05-08T18:33:23.516228+0000","last_clean":"2024-05-08T18:33:23.516228+0000","last_became_active":"2024-05-08T18:29:40.544216+0000","last_became_peered":"2024-05-08T18:29:40.544216+0000","last_unstale":"2024-05-08T18:33:23.516228+0000","last_undegraded":"2024-05-08T18:33:23.516228+0000","last_fullsized":"2024-05-08T18:33:23.516228+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'20","last_scrub_stamp":"2024-05-08T18:33:23.516026+0000","last_deep_scrub":"116'20","last_deep_scrub_stamp":"2024-05-08T18:33:23.516026+0000","last_clean_scrub_stamp":"2024-05-08T18:33:23.516026+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:27:36.796416+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:17.484593+0000","last_change":"2024-05-08T18:33:17.484650+0000","last_active":"2024-05-08T18:33:17.484593+0000","last_peered":"2024-05-08T18:33:17.484593+0000","last_clean":"2024-05-08T18:33:17.484593+0000","last_became_active":"2024-05-08T18:29:44.575344+0000","last_became_peered":"2024-05-08T18:29:44.575344+0000","last_unstale":"2024-05-08T18:33:17.484593+0000","last_undegraded":"2024-05-08T18:33:17.484593+0000","last_fullsized":"2024-05-08T18:33:17.484593+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:17.484366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:17.484366+0000","last_clean_scrub_stamp":"2024-05-08T18:33:17.484366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:58:12.466927+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"116'24","reported_seq":230,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:23.899017+0000","last_change":"2024-05-08T18:33:23.899100+0000","last_active":"2024-05-08T18:33:23.899017+0000","last_peered":"2024-05-08T18:33:23.899017+0000","last_clean":"2024-05-08T18:33:23.899017+0000","last_became_active":"2024-05-08T18:29:46.583390+0000","last_became_peered":"2024-05-08T18:29:46.583390+0000","last_unstale":"2024-05-08T18:33:23.899017+0000","last_undegraded":"2024-05-08T18:33:23.899017+0000","last_fullsized":"2024-05-08T18:33:23.899017+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'24","last_scrub_stamp":"2024-05-08T18:33:23.898821+0000","last_deep_scrub":"116'24","last_deep_scrub_stamp":"2024-05-08T18:33:23.898821+0000","last_clean_scrub_stamp":"2024-05-08T18:33:23.898821+0000","objects_scrubbed":5,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:37:30.737404+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:22.771583+0000","last_change":"2024-05-08T18:33:22.771647+0000","last_active":"2024-05-08T18:33:22.771583+0000","last_peered":"2024-05-08T18:33:22.771583+0000","last_clean":"2024-05-08T18:33:22.771583+0000","last_became_active":"2024-05-08T18:29:48.642773+0000","last_became_peered":"2024-05-08T18:29:48.642773+0000","last_unstale":"2024-05-08T18:33:22.771583+0000","last_undegraded":"2024-05-08T18:33:22.771583+0000","last_fullsized":"2024-05-08T18:33:22.771583+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:22.771367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:22.771367+0000","last_clean_scrub_stamp":"2024-05-08T18:33:22.771367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:58:17.753928+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:36.212011+0000","last_change":"2024-05-08T18:33:36.212071+0000","last_active":"2024-05-08T18:33:36.212011+0000","last_peered":"2024-05-08T18:33:36.212011+0000","last_clean":"2024-05-08T18:33:36.212011+0000","last_became_active":"2024-05-08T18:29:50.674057+0000","last_became_peered":"2024-05-08T18:29:50.674057+0000","last_unstale":"2024-05-08T18:33:36.212011+0000","last_undegraded":"2024-05-08T18:33:36.212011+0000","last_fullsized":"2024-05-08T18:33:36.212011+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:36.211804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:36.211804+0000","last_clean_scrub_stamp":"2024-05-08T18:33:36.211804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:07.724846+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"84'4","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:12.840235+0000","last_change":"2024-05-08T18:33:12.840300+0000","last_active":"2024-05-08T18:33:12.840235+0000","last_peered":"2024-05-08T18:33:12.840235+0000","last_clean":"2024-05-08T18:33:12.840235+0000","last_became_active":"2024-05-08T18:29:42.577275+0000","last_became_peered":"2024-05-08T18:29:42.577275+0000","last_unstale":"2024-05-08T18:33:12.840235+0000","last_undegraded":"2024-05-08T18:33:12.840235+0000","last_fullsized":"2024-05-08T18:33:12.840235+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'4","last_scrub_stamp":"2024-05-08T18:33:12.840024+0000","last_deep_scrub":"84'4","last_deep_scrub_stamp":"2024-05-08T18:33:12.840024+0000","last_clean_scrub_stamp":"2024-05-08T18:33:12.840024+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:22:36.970609+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"116'20","reported_seq":226,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:23.956798+0000","last_change":"2024-05-08T18:33:23.956858+0000","last_active":"2024-05-08T18:33:23.956798+0000","last_peered":"2024-05-08T18:33:23.956798+0000","last_clean":"2024-05-08T18:33:23.956798+0000","last_became_active":"2024-05-08T18:29:40.562594+0000","last_became_peered":"2024-05-08T18:29:40.562594+0000","last_unstale":"2024-05-08T18:33:23.956798+0000","last_undegraded":"2024-05-08T18:33:23.956798+0000","last_fullsized":"2024-05-08T18:33:23.956798+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'20","last_scrub_stamp":"2024-05-08T18:33:23.956667+0000","last_deep_scrub":"116'20","last_deep_scrub_stamp":"2024-05-08T18:33:23.956667+0000","last_clean_scrub_stamp":"2024-05-08T18:33:23.956667+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:37:30.795250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:02.892497+0000","last_change":"2024-05-08T18:33:02.892518+0000","last_active":"2024-05-08T18:33:02.892497+0000","last_peered":"2024-05-08T18:33:02.892497+0000","last_clean":"2024-05-08T18:33:02.892497+0000","last_became_active":"2024-05-08T18:29:44.593398+0000","last_became_peered":"2024-05-08T18:29:44.593398+0000","last_unstale":"2024-05-08T18:33:02.892497+0000","last_undegraded":"2024-05-08T18:33:02.892497+0000","last_fullsized":"2024-05-08T18:33:02.892497+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:02.892415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:02.892415+0000","last_clean_scrub_stamp":"2024-05-08T18:33:02.892415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:22:27.022999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"116'19","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:04.642964+0000","last_change":"2024-05-08T18:33:04.643045+0000","last_active":"2024-05-08T18:33:04.642964+0000","last_peered":"2024-05-08T18:33:04.642964+0000","last_clean":"2024-05-08T18:33:04.642964+0000","last_became_active":"2024-05-08T18:29:46.601402+0000","last_became_peered":"2024-05-08T18:29:46.601402+0000","last_unstale":"2024-05-08T18:33:04.642964+0000","last_undegraded":"2024-05-08T18:33:04.642964+0000","last_fullsized":"2024-05-08T18:33:04.642964+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'19","last_scrub_stamp":"2024-05-08T18:33:04.642767+0000","last_deep_scrub":"116'19","last_deep_scrub_stamp":"2024-05-08T18:33:04.642767+0000","last_clean_scrub_stamp":"2024-05-08T18:33:04.642767+0000","objects_scrubbed":7,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:00:52.021694+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":22,"num_read_kb":17,"num_write":24,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3118,"num_omap_keys":14,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"116'105","reported_seq":341,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:22.738868+0000","last_change":"2024-05-08T18:33:22.738929+0000","last_active":"2024-05-08T18:33:22.738868+0000","last_peered":"2024-05-08T18:33:22.738868+0000","last_clean":"2024-05-08T18:33:22.738868+0000","last_became_active":"2024-05-08T18:29:48.634859+0000","last_became_peered":"2024-05-08T18:29:48.634859+0000","last_unstale":"2024-05-08T18:33:22.738868+0000","last_undegraded":"2024-05-08T18:33:22.738868+0000","last_fullsized":"2024-05-08T18:33:22.738868+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'105","last_scrub_stamp":"2024-05-08T18:33:22.738662+0000","last_deep_scrub":"116'105","last_deep_scrub_stamp":"2024-05-08T18:33:22.738662+0000","last_clean_scrub_stamp":"2024-05-08T18:33:22.738662+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:06:57.423975+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:34.703817+0000","last_change":"2024-05-08T18:33:34.703932+0000","last_active":"2024-05-08T18:33:34.703817+0000","last_peered":"2024-05-08T18:33:34.703817+0000","last_clean":"2024-05-08T18:33:34.703817+0000","last_became_active":"2024-05-08T18:29:50.679011+0000","last_became_peered":"2024-05-08T18:29:50.679011+0000","last_unstale":"2024-05-08T18:33:34.703817+0000","last_undegraded":"2024-05-08T18:33:34.703817+0000","last_fullsized":"2024-05-08T18:33:34.703817+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:34.703526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:34.703526+0000","last_clean_scrub_stamp":"2024-05-08T18:33:34.703526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:47:10.490340+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"84'8","reported_seq":224,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:16.487806+0000","last_change":"2024-05-08T18:33:16.487867+0000","last_active":"2024-05-08T18:33:16.487806+0000","last_peered":"2024-05-08T18:33:16.487806+0000","last_clean":"2024-05-08T18:33:16.487806+0000","last_became_active":"2024-05-08T18:29:42.559647+0000","last_became_peered":"2024-05-08T18:29:42.559647+0000","last_unstale":"2024-05-08T18:33:16.487806+0000","last_undegraded":"2024-05-08T18:33:16.487806+0000","last_fullsized":"2024-05-08T18:33:16.487806+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'8","last_scrub_stamp":"2024-05-08T18:33:16.487609+0000","last_deep_scrub":"84'8","last_deep_scrub_stamp":"2024-05-08T18:33:16.487609+0000","last_clean_scrub_stamp":"2024-05-08T18:33:16.487609+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:35:39.223647+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"116'20","reported_seq":225,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:19.115714+0000","last_change":"2024-05-08T18:33:19.115777+0000","last_active":"2024-05-08T18:33:19.115714+0000","last_peered":"2024-05-08T18:33:19.115714+0000","last_clean":"2024-05-08T18:33:19.115714+0000","last_became_active":"2024-05-08T18:29:40.556254+0000","last_became_peered":"2024-05-08T18:29:40.556254+0000","last_unstale":"2024-05-08T18:33:19.115714+0000","last_undegraded":"2024-05-08T18:33:19.115714+0000","last_fullsized":"2024-05-08T18:33:19.115714+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'20","last_scrub_stamp":"2024-05-08T18:33:19.115512+0000","last_deep_scrub":"116'20","last_deep_scrub_stamp":"2024-05-08T18:33:19.115512+0000","last_clean_scrub_stamp":"2024-05-08T18:33:19.115512+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:11:18.837286+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:09.923190+0000","last_change":"2024-05-08T18:33:09.923244+0000","last_active":"2024-05-08T18:33:09.923190+0000","last_peered":"2024-05-08T18:33:09.923190+0000","last_clean":"2024-05-08T18:33:09.923190+0000","last_became_active":"2024-05-08T18:29:44.593322+0000","last_became_peered":"2024-05-08T18:29:44.593322+0000","last_unstale":"2024-05-08T18:33:09.923190+0000","last_undegraded":"2024-05-08T18:33:09.923190+0000","last_fullsized":"2024-05-08T18:33:09.923190+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:09.922968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:09.922968+0000","last_clean_scrub_stamp":"2024-05-08T18:33:09.922968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:17:20.477717+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"116'32","reported_seq":239,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:03.096508+0000","last_change":"2024-05-08T18:33:03.096597+0000","last_active":"2024-05-08T18:33:03.096508+0000","last_peered":"2024-05-08T18:33:03.096508+0000","last_clean":"2024-05-08T18:33:03.096508+0000","last_became_active":"2024-05-08T18:29:46.603885+0000","last_became_peered":"2024-05-08T18:29:46.603885+0000","last_unstale":"2024-05-08T18:33:03.096508+0000","last_undegraded":"2024-05-08T18:33:03.096508+0000","last_fullsized":"2024-05-08T18:33:03.096508+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'32","last_scrub_stamp":"2024-05-08T18:33:03.096330+0000","last_deep_scrub":"116'32","last_deep_scrub_stamp":"2024-05-08T18:33:03.096330+0000","last_clean_scrub_stamp":"2024-05-08T18:33:03.096330+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:00:50.475257+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":37,"num_read_kb":44,"num_write":22,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.856211+0000","last_change":"2024-05-08T18:33:06.856265+0000","last_active":"2024-05-08T18:33:06.856211+0000","last_peered":"2024-05-08T18:33:06.856211+0000","last_clean":"2024-05-08T18:33:06.856211+0000","last_became_active":"2024-05-08T18:29:48.640046+0000","last_became_peered":"2024-05-08T18:29:48.640046+0000","last_unstale":"2024-05-08T18:33:06.856211+0000","last_undegraded":"2024-05-08T18:33:06.856211+0000","last_fullsized":"2024-05-08T18:33:06.856211+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:06.856012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:06.856012+0000","last_clean_scrub_stamp":"2024-05-08T18:33:06.856012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:46:46.459558+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"83'8","reported_seq":197,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:36.766428+0000","last_change":"2024-05-08T18:33:36.766571+0000","last_active":"2024-05-08T18:33:36.766428+0000","last_peered":"2024-05-08T18:33:36.766428+0000","last_clean":"2024-05-08T18:33:36.766428+0000","last_became_active":"2024-05-08T18:29:50.692123+0000","last_became_peered":"2024-05-08T18:29:50.692123+0000","last_unstale":"2024-05-08T18:33:36.766428+0000","last_undegraded":"2024-05-08T18:33:36.766428+0000","last_fullsized":"2024-05-08T18:33:36.766428+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'8","last_scrub_stamp":"2024-05-08T18:33:36.766131+0000","last_deep_scrub":"83'8","last_deep_scrub_stamp":"2024-05-08T18:33:36.766131+0000","last_clean_scrub_stamp":"2024-05-08T18:33:36.766131+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:08.279173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"97'2","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:20.552469+0000","last_change":"2024-05-08T18:33:20.552530+0000","last_active":"2024-05-08T18:33:20.552469+0000","last_peered":"2024-05-08T18:33:20.552469+0000","last_clean":"2024-05-08T18:33:20.552469+0000","last_became_active":"2024-05-08T18:29:42.557570+0000","last_became_peered":"2024-05-08T18:29:42.557570+0000","last_unstale":"2024-05-08T18:33:20.552469+0000","last_undegraded":"2024-05-08T18:33:20.552469+0000","last_fullsized":"2024-05-08T18:33:20.552469+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'2","last_scrub_stamp":"2024-05-08T18:33:20.552269+0000","last_deep_scrub":"97'2","last_deep_scrub_stamp":"2024-05-08T18:33:20.552269+0000","last_clean_scrub_stamp":"2024-05-08T18:33:20.552269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:51.339225+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"116'4","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:26.194463+0000","last_change":"2024-05-08T18:33:26.194526+0000","last_active":"2024-05-08T18:33:26.194463+0000","last_peered":"2024-05-08T18:33:26.194463+0000","last_clean":"2024-05-08T18:33:26.194463+0000","last_became_active":"2024-05-08T18:29:40.536188+0000","last_became_peered":"2024-05-08T18:29:40.536188+0000","last_unstale":"2024-05-08T18:33:26.194463+0000","last_undegraded":"2024-05-08T18:33:26.194463+0000","last_fullsized":"2024-05-08T18:33:26.194463+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'4","last_scrub_stamp":"2024-05-08T18:33:26.194240+0000","last_deep_scrub":"116'4","last_deep_scrub_stamp":"2024-05-08T18:33:26.194240+0000","last_clean_scrub_stamp":"2024-05-08T18:33:26.194240+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:59:59.739889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":197,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:16.171229+0000","last_change":"2024-05-08T18:33:16.171351+0000","last_active":"2024-05-08T18:33:16.171229+0000","last_peered":"2024-05-08T18:33:16.171229+0000","last_clean":"2024-05-08T18:33:16.171229+0000","last_became_active":"2024-05-08T18:29:44.578171+0000","last_became_peered":"2024-05-08T18:29:44.578171+0000","last_unstale":"2024-05-08T18:33:16.171229+0000","last_undegraded":"2024-05-08T18:33:16.171229+0000","last_fullsized":"2024-05-08T18:33:16.171229+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:16.170996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:16.170996+0000","last_clean_scrub_stamp":"2024-05-08T18:33:16.170996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:35:38.907034+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"116'23","reported_seq":228,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.875357+0000","last_change":"2024-05-08T18:33:05.875438+0000","last_active":"2024-05-08T18:33:05.875357+0000","last_peered":"2024-05-08T18:33:05.875357+0000","last_clean":"2024-05-08T18:33:05.875357+0000","last_became_active":"2024-05-08T18:29:46.603728+0000","last_became_peered":"2024-05-08T18:29:46.603728+0000","last_unstale":"2024-05-08T18:33:05.875357+0000","last_undegraded":"2024-05-08T18:33:05.875357+0000","last_fullsized":"2024-05-08T18:33:05.875357+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'23","last_scrub_stamp":"2024-05-08T18:33:05.875140+0000","last_deep_scrub":"116'23","last_deep_scrub_stamp":"2024-05-08T18:33:05.875140+0000","last_clean_scrub_stamp":"2024-05-08T18:33:05.875140+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:24:25.422367+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":187,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:23.731205+0000","last_change":"2024-05-08T18:33:23.731263+0000","last_active":"2024-05-08T18:33:23.731205+0000","last_peered":"2024-05-08T18:33:23.731205+0000","last_clean":"2024-05-08T18:33:23.731205+0000","last_became_active":"2024-05-08T18:29:48.634664+0000","last_became_peered":"2024-05-08T18:29:48.634664+0000","last_unstale":"2024-05-08T18:33:23.731205+0000","last_undegraded":"2024-05-08T18:33:23.731205+0000","last_fullsized":"2024-05-08T18:33:23.731205+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:23.731009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:23.731009+0000","last_clean_scrub_stamp":"2024-05-08T18:33:23.731009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:04:32.165518+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"97'7","reported_seq":196,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:36.888980+0000","last_change":"2024-05-08T18:33:36.889044+0000","last_active":"2024-05-08T18:33:36.888980+0000","last_peered":"2024-05-08T18:33:36.888980+0000","last_clean":"2024-05-08T18:33:36.888980+0000","last_became_active":"2024-05-08T18:29:50.686662+0000","last_became_peered":"2024-05-08T18:29:50.686662+0000","last_unstale":"2024-05-08T18:33:36.888980+0000","last_undegraded":"2024-05-08T18:33:36.888980+0000","last_fullsized":"2024-05-08T18:33:36.888980+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'7","last_scrub_stamp":"2024-05-08T18:33:36.888764+0000","last_deep_scrub":"97'7","last_deep_scrub_stamp":"2024-05-08T18:33:36.888764+0000","last_clean_scrub_stamp":"2024-05-08T18:33:36.888764+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:25:54.181959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"97'4","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:22.919449+0000","last_change":"2024-05-08T18:33:22.919529+0000","last_active":"2024-05-08T18:33:22.919449+0000","last_peered":"2024-05-08T18:33:22.919449+0000","last_clean":"2024-05-08T18:33:22.919449+0000","last_became_active":"2024-05-08T18:29:42.558390+0000","last_became_peered":"2024-05-08T18:29:42.558390+0000","last_unstale":"2024-05-08T18:33:22.919449+0000","last_undegraded":"2024-05-08T18:33:22.919449+0000","last_fullsized":"2024-05-08T18:33:22.919449+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'4","last_scrub_stamp":"2024-05-08T18:33:22.919230+0000","last_deep_scrub":"97'4","last_deep_scrub_stamp":"2024-05-08T18:33:22.919230+0000","last_clean_scrub_stamp":"2024-05-08T18:33:22.919230+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:24:49.333241+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"116'14","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:24.886484+0000","last_change":"2024-05-08T18:33:24.886484+0000","last_active":"2024-05-08T18:33:24.886484+0000","last_peered":"2024-05-08T18:33:24.886484+0000","last_clean":"2024-05-08T18:33:24.886484+0000","last_became_active":"2024-05-08T18:29:40.567482+0000","last_became_peered":"2024-05-08T18:29:40.567482+0000","last_unstale":"2024-05-08T18:33:24.886484+0000","last_undegraded":"2024-05-08T18:33:24.886484+0000","last_fullsized":"2024-05-08T18:33:24.886484+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'14","last_scrub_stamp":"2024-05-08T18:33:24.886178+0000","last_deep_scrub":"116'14","last_deep_scrub_stamp":"2024-05-08T18:33:24.886178+0000","last_clean_scrub_stamp":"2024-05-08T18:33:24.886178+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:15.092204+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":5,"num_write":24,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:31.654745+0000","last_change":"2024-05-08T18:33:31.654884+0000","last_active":"2024-05-08T18:33:31.654745+0000","last_peered":"2024-05-08T18:33:31.654745+0000","last_clean":"2024-05-08T18:33:31.654745+0000","last_became_active":"2024-05-08T18:29:44.595712+0000","last_became_peered":"2024-05-08T18:29:44.595712+0000","last_unstale":"2024-05-08T18:33:31.654745+0000","last_undegraded":"2024-05-08T18:33:31.654745+0000","last_fullsized":"2024-05-08T18:33:31.654745+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:31.654521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:31.654521+0000","last_clean_scrub_stamp":"2024-05-08T18:33:31.654521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:39:40.017626+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"116'15","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:08.788147+0000","last_change":"2024-05-08T18:33:08.788218+0000","last_active":"2024-05-08T18:33:08.788147+0000","last_peered":"2024-05-08T18:33:08.788147+0000","last_clean":"2024-05-08T18:33:08.788147+0000","last_became_active":"2024-05-08T18:29:46.597394+0000","last_became_peered":"2024-05-08T18:29:46.597394+0000","last_unstale":"2024-05-08T18:33:08.788147+0000","last_undegraded":"2024-05-08T18:33:08.788147+0000","last_fullsized":"2024-05-08T18:33:08.788147+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'15","last_scrub_stamp":"2024-05-08T18:33:08.787951+0000","last_deep_scrub":"116'15","last_deep_scrub_stamp":"2024-05-08T18:33:08.787951+0000","last_clean_scrub_stamp":"2024-05-08T18:33:08.787951+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:00:35.606964+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":13,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:34.566795+0000","last_change":"2024-05-08T18:33:34.566899+0000","last_active":"2024-05-08T18:33:34.566795+0000","last_peered":"2024-05-08T18:33:34.566795+0000","last_clean":"2024-05-08T18:33:34.566795+0000","last_became_active":"2024-05-08T18:29:48.641666+0000","last_became_peered":"2024-05-08T18:29:48.641666+0000","last_unstale":"2024-05-08T18:33:34.566795+0000","last_undegraded":"2024-05-08T18:33:34.566795+0000","last_fullsized":"2024-05-08T18:33:34.566795+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:34.566550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:34.566550+0000","last_clean_scrub_stamp":"2024-05-08T18:33:34.566550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:05:05.965379+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"80'2","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:35.751990+0000","last_change":"2024-05-08T18:33:35.752051+0000","last_active":"2024-05-08T18:33:35.751990+0000","last_peered":"2024-05-08T18:33:35.751990+0000","last_clean":"2024-05-08T18:33:35.751990+0000","last_became_active":"2024-05-08T18:29:50.684958+0000","last_became_peered":"2024-05-08T18:29:50.684958+0000","last_unstale":"2024-05-08T18:33:35.751990+0000","last_undegraded":"2024-05-08T18:33:35.751990+0000","last_fullsized":"2024-05-08T18:33:35.751990+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2","last_scrub_stamp":"2024-05-08T18:33:35.751762+0000","last_deep_scrub":"80'2","last_deep_scrub_stamp":"2024-05-08T18:33:35.751762+0000","last_clean_scrub_stamp":"2024-05-08T18:33:35.751762+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:44:39.740743+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:12.489733+0000","last_change":"2024-05-08T18:33:12.489788+0000","last_active":"2024-05-08T18:33:12.489733+0000","last_peered":"2024-05-08T18:33:12.489733+0000","last_clean":"2024-05-08T18:33:12.489733+0000","last_became_active":"2024-05-08T18:29:42.558871+0000","last_became_peered":"2024-05-08T18:29:42.558871+0000","last_unstale":"2024-05-08T18:33:12.489733+0000","last_undegraded":"2024-05-08T18:33:12.489733+0000","last_fullsized":"2024-05-08T18:33:12.489733+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:12.489544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:12.489544+0000","last_clean_scrub_stamp":"2024-05-08T18:33:12.489544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:59:53.448595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"116'26","reported_seq":232,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:26.014981+0000","last_change":"2024-05-08T18:33:26.015123+0000","last_active":"2024-05-08T18:33:26.014981+0000","last_peered":"2024-05-08T18:33:26.014981+0000","last_clean":"2024-05-08T18:33:26.014981+0000","last_became_active":"2024-05-08T18:29:40.540767+0000","last_became_peered":"2024-05-08T18:29:40.540767+0000","last_unstale":"2024-05-08T18:33:26.014981+0000","last_undegraded":"2024-05-08T18:33:26.014981+0000","last_fullsized":"2024-05-08T18:33:26.014981+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'26","last_scrub_stamp":"2024-05-08T18:33:26.014716+0000","last_deep_scrub":"116'26","last_deep_scrub_stamp":"2024-05-08T18:33:26.014716+0000","last_clean_scrub_stamp":"2024-05-08T18:33:26.014716+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:11:56.660233+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":26,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"116'2","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:01.923856+0000","last_change":"2024-05-08T18:33:01.923882+0000","last_active":"2024-05-08T18:33:01.923856+0000","last_peered":"2024-05-08T18:33:01.923856+0000","last_clean":"2024-05-08T18:33:01.923856+0000","last_became_active":"2024-05-08T18:29:44.592243+0000","last_became_peered":"2024-05-08T18:29:44.592243+0000","last_unstale":"2024-05-08T18:33:01.923856+0000","last_undegraded":"2024-05-08T18:33:01.923856+0000","last_fullsized":"2024-05-08T18:33:01.923856+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'2","last_scrub_stamp":"2024-05-08T18:33:01.923772+0000","last_deep_scrub":"116'2","last_deep_scrub_stamp":"2024-05-08T18:33:01.923772+0000","last_clean_scrub_stamp":"2024-05-08T18:33:01.923772+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:50:30.729203+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"116'22","reported_seq":229,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.619868+0000","last_change":"2024-05-08T18:33:05.619945+0000","last_active":"2024-05-08T18:33:05.619868+0000","last_peered":"2024-05-08T18:33:05.619868+0000","last_clean":"2024-05-08T18:33:05.619868+0000","last_became_active":"2024-05-08T18:29:46.609903+0000","last_became_peered":"2024-05-08T18:29:46.609903+0000","last_unstale":"2024-05-08T18:33:05.619868+0000","last_undegraded":"2024-05-08T18:33:05.619868+0000","last_fullsized":"2024-05-08T18:33:05.619868+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'22","last_scrub_stamp":"2024-05-08T18:33:05.619687+0000","last_deep_scrub":"116'22","last_deep_scrub_stamp":"2024-05-08T18:33:05.619687+0000","last_clean_scrub_stamp":"2024-05-08T18:33:05.619687+0000","objects_scrubbed":4,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:10.533517+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:03.881406+0000","last_change":"2024-05-08T18:33:03.881434+0000","last_active":"2024-05-08T18:33:03.881406+0000","last_peered":"2024-05-08T18:33:03.881406+0000","last_clean":"2024-05-08T18:33:03.881406+0000","last_became_active":"2024-05-08T18:29:48.629204+0000","last_became_peered":"2024-05-08T18:29:48.629204+0000","last_unstale":"2024-05-08T18:33:03.881406+0000","last_undegraded":"2024-05-08T18:33:03.881406+0000","last_fullsized":"2024-05-08T18:33:03.881406+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:03.881311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:03.881311+0000","last_clean_scrub_stamp":"2024-05-08T18:33:03.881311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:23:16.472058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"84'6","reported_seq":197,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:36.607311+0000","last_change":"2024-05-08T18:33:36.607378+0000","last_active":"2024-05-08T18:33:36.607311+0000","last_peered":"2024-05-08T18:33:36.607311+0000","last_clean":"2024-05-08T18:33:36.607311+0000","last_became_active":"2024-05-08T18:29:50.667357+0000","last_became_peered":"2024-05-08T18:29:50.667357+0000","last_unstale":"2024-05-08T18:33:36.607311+0000","last_undegraded":"2024-05-08T18:33:36.607311+0000","last_fullsized":"2024-05-08T18:33:36.607311+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'6","last_scrub_stamp":"2024-05-08T18:33:36.607112+0000","last_deep_scrub":"84'6","last_deep_scrub_stamp":"2024-05-08T18:33:36.607112+0000","last_clean_scrub_stamp":"2024-05-08T18:33:36.607112+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:08.120155+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"97'4","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.886329+0000","last_change":"2024-05-08T18:33:05.886394+0000","last_active":"2024-05-08T18:33:05.886329+0000","last_peered":"2024-05-08T18:33:05.886329+0000","last_clean":"2024-05-08T18:33:05.886329+0000","last_became_active":"2024-05-08T18:29:42.580988+0000","last_became_peered":"2024-05-08T18:29:42.580988+0000","last_unstale":"2024-05-08T18:33:05.886329+0000","last_undegraded":"2024-05-08T18:33:05.886329+0000","last_fullsized":"2024-05-08T18:33:05.886329+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'4","last_scrub_stamp":"2024-05-08T18:33:05.886129+0000","last_deep_scrub":"97'4","last_deep_scrub_stamp":"2024-05-08T18:33:05.886129+0000","last_clean_scrub_stamp":"2024-05-08T18:33:05.886129+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:29:32.496922+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"116'16","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:14.499274+0000","last_change":"2024-05-08T18:33:14.499338+0000","last_active":"2024-05-08T18:33:14.499274+0000","last_peered":"2024-05-08T18:33:14.499274+0000","last_clean":"2024-05-08T18:33:14.499274+0000","last_became_active":"2024-05-08T18:29:40.561277+0000","last_became_peered":"2024-05-08T18:29:40.561277+0000","last_unstale":"2024-05-08T18:33:14.499274+0000","last_undegraded":"2024-05-08T18:33:14.499274+0000","last_fullsized":"2024-05-08T18:33:14.499274+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'16","last_scrub_stamp":"2024-05-08T18:33:14.499083+0000","last_deep_scrub":"116'16","last_deep_scrub_stamp":"2024-05-08T18:33:14.499083+0000","last_clean_scrub_stamp":"2024-05-08T18:33:14.499083+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:59:51.019008+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":3,"num_write":26,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:13.783798+0000","last_change":"2024-05-08T18:33:13.783860+0000","last_active":"2024-05-08T18:33:13.783798+0000","last_peered":"2024-05-08T18:33:13.783798+0000","last_clean":"2024-05-08T18:33:13.783798+0000","last_became_active":"2024-05-08T18:29:42.573502+0000","last_became_peered":"2024-05-08T18:29:42.573502+0000","last_unstale":"2024-05-08T18:33:13.783798+0000","last_undegraded":"2024-05-08T18:33:13.783798+0000","last_fullsized":"2024-05-08T18:33:13.783798+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:13.783580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:13.783580+0000","last_clean_scrub_stamp":"2024-05-08T18:33:13.783580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:09:34.659675+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"116'16","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.807662+0000","last_change":"2024-05-08T18:33:06.807725+0000","last_active":"2024-05-08T18:33:06.807662+0000","last_peered":"2024-05-08T18:33:06.807662+0000","last_clean":"2024-05-08T18:33:06.807662+0000","last_became_active":"2024-05-08T18:29:40.532246+0000","last_became_peered":"2024-05-08T18:29:40.532246+0000","last_unstale":"2024-05-08T18:33:06.807662+0000","last_undegraded":"2024-05-08T18:33:06.807662+0000","last_fullsized":"2024-05-08T18:33:06.807662+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'16","last_scrub_stamp":"2024-05-08T18:33:06.807472+0000","last_deep_scrub":"116'16","last_deep_scrub_stamp":"2024-05-08T18:33:06.807472+0000","last_clean_scrub_stamp":"2024-05-08T18:33:06.807472+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:16:38.253020+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":201,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:10.209861+0000","last_change":"2024-05-08T18:33:10.209964+0000","last_active":"2024-05-08T18:33:10.209861+0000","last_peered":"2024-05-08T18:33:10.209861+0000","last_clean":"2024-05-08T18:33:10.209861+0000","last_became_active":"2024-05-08T18:29:42.564542+0000","last_became_peered":"2024-05-08T18:29:42.564542+0000","last_unstale":"2024-05-08T18:33:10.209861+0000","last_undegraded":"2024-05-08T18:33:10.209861+0000","last_fullsized":"2024-05-08T18:33:10.209861+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:10.209551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:10.209551+0000","last_clean_scrub_stamp":"2024-05-08T18:33:10.209551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:06:44.894864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"116'28","reported_seq":233,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:23.171194+0000","last_change":"2024-05-08T18:33:23.171334+0000","last_active":"2024-05-08T18:33:23.171194+0000","last_peered":"2024-05-08T18:33:23.171194+0000","last_clean":"2024-05-08T18:33:23.171194+0000","last_became_active":"2024-05-08T18:29:40.556091+0000","last_became_peered":"2024-05-08T18:29:40.556091+0000","last_unstale":"2024-05-08T18:33:23.171194+0000","last_undegraded":"2024-05-08T18:33:23.171194+0000","last_fullsized":"2024-05-08T18:33:23.171194+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'28","last_scrub_stamp":"2024-05-08T18:33:23.170961+0000","last_deep_scrub":"116'28","last_deep_scrub_stamp":"2024-05-08T18:33:23.170961+0000","last_clean_scrub_stamp":"2024-05-08T18:33:23.170961+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:27:36.451350+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":28,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"97'6","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:09.831793+0000","last_change":"2024-05-08T18:33:09.831861+0000","last_active":"2024-05-08T18:33:09.831793+0000","last_peered":"2024-05-08T18:33:09.831793+0000","last_clean":"2024-05-08T18:33:09.831793+0000","last_became_active":"2024-05-08T18:29:42.573178+0000","last_became_peered":"2024-05-08T18:29:42.573178+0000","last_unstale":"2024-05-08T18:33:09.831793+0000","last_undegraded":"2024-05-08T18:33:09.831793+0000","last_fullsized":"2024-05-08T18:33:09.831793+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'6","last_scrub_stamp":"2024-05-08T18:33:09.831594+0000","last_deep_scrub":"97'6","last_deep_scrub_stamp":"2024-05-08T18:33:09.831594+0000","last_clean_scrub_stamp":"2024-05-08T18:33:09.831594+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:14.745423+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"116'10","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:28.046303+0000","last_change":"2024-05-08T18:33:28.046364+0000","last_active":"2024-05-08T18:33:28.046303+0000","last_peered":"2024-05-08T18:33:28.046303+0000","last_clean":"2024-05-08T18:33:28.046303+0000","last_became_active":"2024-05-08T18:29:40.544107+0000","last_became_peered":"2024-05-08T18:29:40.544107+0000","last_unstale":"2024-05-08T18:33:28.046303+0000","last_undegraded":"2024-05-08T18:33:28.046303+0000","last_fullsized":"2024-05-08T18:33:28.046303+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'10","last_scrub_stamp":"2024-05-08T18:33:28.046099+0000","last_deep_scrub":"116'10","last_deep_scrub_stamp":"2024-05-08T18:33:28.046099+0000","last_clean_scrub_stamp":"2024-05-08T18:33:28.046099+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:07:20.048036+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"84'2","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:11.748589+0000","last_change":"2024-05-08T18:33:11.748654+0000","last_active":"2024-05-08T18:33:11.748589+0000","last_peered":"2024-05-08T18:33:11.748589+0000","last_clean":"2024-05-08T18:33:11.748589+0000","last_became_active":"2024-05-08T18:29:42.576395+0000","last_became_peered":"2024-05-08T18:29:42.576395+0000","last_unstale":"2024-05-08T18:33:11.748589+0000","last_undegraded":"2024-05-08T18:33:11.748589+0000","last_fullsized":"2024-05-08T18:33:11.748589+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'2","last_scrub_stamp":"2024-05-08T18:33:11.748383+0000","last_deep_scrub":"84'2","last_deep_scrub_stamp":"2024-05-08T18:33:11.748383+0000","last_clean_scrub_stamp":"2024-05-08T18:33:11.748383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:47.774255+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"116'10","reported_seq":216,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:32.898614+0000","last_change":"2024-05-08T18:33:32.898677+0000","last_active":"2024-05-08T18:33:32.898614+0000","last_peered":"2024-05-08T18:33:32.898614+0000","last_clean":"2024-05-08T18:33:32.898614+0000","last_became_active":"2024-05-08T18:29:40.557874+0000","last_became_peered":"2024-05-08T18:29:40.557874+0000","last_unstale":"2024-05-08T18:33:32.898614+0000","last_undegraded":"2024-05-08T18:33:32.898614+0000","last_fullsized":"2024-05-08T18:33:32.898614+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'10","last_scrub_stamp":"2024-05-08T18:33:32.898422+0000","last_deep_scrub":"116'10","last_deep_scrub_stamp":"2024-05-08T18:33:32.898422+0000","last_clean_scrub_stamp":"2024-05-08T18:33:32.898422+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:21:03.200190+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"97'2","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:18.527351+0000","last_change":"2024-05-08T18:33:18.527420+0000","last_active":"2024-05-08T18:33:18.527351+0000","last_peered":"2024-05-08T18:33:18.527351+0000","last_clean":"2024-05-08T18:33:18.527351+0000","last_became_active":"2024-05-08T18:29:42.556774+0000","last_became_peered":"2024-05-08T18:29:42.556774+0000","last_unstale":"2024-05-08T18:33:18.527351+0000","last_undegraded":"2024-05-08T18:33:18.527351+0000","last_fullsized":"2024-05-08T18:33:18.527351+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'2","last_scrub_stamp":"2024-05-08T18:33:18.527147+0000","last_deep_scrub":"97'2","last_deep_scrub_stamp":"2024-05-08T18:33:18.527147+0000","last_clean_scrub_stamp":"2024-05-08T18:33:18.527147+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:29.325697+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"116'22","reported_seq":235,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:28.750401+0000","last_change":"2024-05-08T18:33:28.750462+0000","last_active":"2024-05-08T18:33:28.750401+0000","last_peered":"2024-05-08T18:33:28.750401+0000","last_clean":"2024-05-08T18:33:28.750401+0000","last_became_active":"2024-05-08T18:30:20.858016+0000","last_became_peered":"2024-05-08T18:30:20.858016+0000","last_unstale":"2024-05-08T18:33:28.750401+0000","last_undegraded":"2024-05-08T18:33:28.750401+0000","last_fullsized":"2024-05-08T18:33:28.750401+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'22","last_scrub_stamp":"2024-05-08T18:33:28.750194+0000","last_deep_scrub":"116'22","last_deep_scrub_stamp":"2024-05-08T18:33:28.750194+0000","last_clean_scrub_stamp":"2024-05-08T18:33:28.750194+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:27:42.030583+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"84'4","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:20.903561+0000","last_change":"2024-05-08T18:33:20.903630+0000","last_active":"2024-05-08T18:33:20.903561+0000","last_peered":"2024-05-08T18:33:20.903561+0000","last_clean":"2024-05-08T18:33:20.903561+0000","last_became_active":"2024-05-08T18:29:42.562420+0000","last_became_peered":"2024-05-08T18:29:42.562420+0000","last_unstale":"2024-05-08T18:33:20.903561+0000","last_undegraded":"2024-05-08T18:33:20.903561+0000","last_fullsized":"2024-05-08T18:33:20.903561+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'4","last_scrub_stamp":"2024-05-08T18:33:20.903339+0000","last_deep_scrub":"84'4","last_deep_scrub_stamp":"2024-05-08T18:33:20.903339+0000","last_clean_scrub_stamp":"2024-05-08T18:33:20.903339+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:29:56.561721+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"116'10","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:16.562367+0000","last_change":"2024-05-08T18:33:16.562520+0000","last_active":"2024-05-08T18:33:16.562367+0000","last_peered":"2024-05-08T18:33:16.562367+0000","last_clean":"2024-05-08T18:33:16.562367+0000","last_became_active":"2024-05-08T18:29:40.561326+0000","last_became_peered":"2024-05-08T18:29:40.561326+0000","last_unstale":"2024-05-08T18:33:16.562367+0000","last_undegraded":"2024-05-08T18:33:16.562367+0000","last_fullsized":"2024-05-08T18:33:16.562367+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'10","last_scrub_stamp":"2024-05-08T18:33:16.562119+0000","last_deep_scrub":"116'10","last_deep_scrub_stamp":"2024-05-08T18:33:16.562119+0000","last_clean_scrub_stamp":"2024-05-08T18:33:16.562119+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:29:20.324924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"97'4","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:11.564568+0000","last_change":"2024-05-08T18:33:11.564628+0000","last_active":"2024-05-08T18:33:11.564568+0000","last_peered":"2024-05-08T18:33:11.564568+0000","last_clean":"2024-05-08T18:33:11.564568+0000","last_became_active":"2024-05-08T18:29:42.560520+0000","last_became_peered":"2024-05-08T18:29:42.560520+0000","last_unstale":"2024-05-08T18:33:11.564568+0000","last_undegraded":"2024-05-08T18:33:11.564568+0000","last_fullsized":"2024-05-08T18:33:11.564568+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'4","last_scrub_stamp":"2024-05-08T18:33:11.564356+0000","last_deep_scrub":"97'4","last_deep_scrub_stamp":"2024-05-08T18:33:11.564356+0000","last_clean_scrub_stamp":"2024-05-08T18:33:11.564356+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:45.313531+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"116'22","reported_seq":228,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:31.927535+0000","last_change":"2024-05-08T18:33:31.927603+0000","last_active":"2024-05-08T18:33:31.927535+0000","last_peered":"2024-05-08T18:33:31.927535+0000","last_clean":"2024-05-08T18:33:31.927535+0000","last_became_active":"2024-05-08T18:29:40.554603+0000","last_became_peered":"2024-05-08T18:29:40.554603+0000","last_unstale":"2024-05-08T18:33:31.927535+0000","last_undegraded":"2024-05-08T18:33:31.927535+0000","last_fullsized":"2024-05-08T18:33:31.927535+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'22","last_scrub_stamp":"2024-05-08T18:33:31.927332+0000","last_deep_scrub":"116'22","last_deep_scrub_stamp":"2024-05-08T18:33:31.927332+0000","last_clean_scrub_stamp":"2024-05-08T18:33:31.927332+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:33:41.311455+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"84'4","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:08.883008+0000","last_change":"2024-05-08T18:33:08.883070+0000","last_active":"2024-05-08T18:33:08.883008+0000","last_peered":"2024-05-08T18:33:08.883008+0000","last_clean":"2024-05-08T18:33:08.883008+0000","last_became_active":"2024-05-08T18:29:42.573947+0000","last_became_peered":"2024-05-08T18:29:42.573947+0000","last_unstale":"2024-05-08T18:33:08.883008+0000","last_undegraded":"2024-05-08T18:33:08.883008+0000","last_fullsized":"2024-05-08T18:33:08.883008+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'4","last_scrub_stamp":"2024-05-08T18:33:08.882807+0000","last_deep_scrub":"84'4","last_deep_scrub_stamp":"2024-05-08T18:33:08.882807+0000","last_clean_scrub_stamp":"2024-05-08T18:33:08.882807+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:04:54.998223+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"116'20","reported_seq":225,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:31.171585+0000","last_change":"2024-05-08T18:33:31.171715+0000","last_active":"2024-05-08T18:33:31.171585+0000","last_peered":"2024-05-08T18:33:31.171585+0000","last_clean":"2024-05-08T18:33:31.171585+0000","last_became_active":"2024-05-08T18:29:40.553356+0000","last_became_peered":"2024-05-08T18:29:40.553356+0000","last_unstale":"2024-05-08T18:33:31.171585+0000","last_undegraded":"2024-05-08T18:33:31.171585+0000","last_fullsized":"2024-05-08T18:33:31.171585+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'20","last_scrub_stamp":"2024-05-08T18:33:31.171280+0000","last_deep_scrub":"116'20","last_deep_scrub_stamp":"2024-05-08T18:33:31.171280+0000","last_clean_scrub_stamp":"2024-05-08T18:33:31.171280+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:39:39.534385+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"84'2","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:10.552807+0000","last_change":"2024-05-08T18:33:10.552867+0000","last_active":"2024-05-08T18:33:10.552807+0000","last_peered":"2024-05-08T18:33:10.552807+0000","last_clean":"2024-05-08T18:33:10.552807+0000","last_became_active":"2024-05-08T18:29:42.565760+0000","last_became_peered":"2024-05-08T18:29:42.565760+0000","last_unstale":"2024-05-08T18:33:10.552807+0000","last_undegraded":"2024-05-08T18:33:10.552807+0000","last_fullsized":"2024-05-08T18:33:10.552807+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'2","last_scrub_stamp":"2024-05-08T18:33:10.552606+0000","last_deep_scrub":"84'2","last_deep_scrub_stamp":"2024-05-08T18:33:10.552606+0000","last_clean_scrub_stamp":"2024-05-08T18:33:10.552606+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:06:45.237919+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"116'16","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:30.891562+0000","last_change":"2024-05-08T18:33:30.891627+0000","last_active":"2024-05-08T18:33:30.891562+0000","last_peered":"2024-05-08T18:33:30.891562+0000","last_clean":"2024-05-08T18:33:30.891562+0000","last_became_active":"2024-05-08T18:29:40.552307+0000","last_became_peered":"2024-05-08T18:29:40.552307+0000","last_unstale":"2024-05-08T18:33:30.891562+0000","last_undegraded":"2024-05-08T18:33:30.891562+0000","last_fullsized":"2024-05-08T18:33:30.891562+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'16","last_scrub_stamp":"2024-05-08T18:33:30.891368+0000","last_deep_scrub":"116'16","last_deep_scrub_stamp":"2024-05-08T18:33:30.891368+0000","last_clean_scrub_stamp":"2024-05-08T18:33:30.891368+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:34:22.549710+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"84'4","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:08.822634+0000","last_change":"2024-05-08T18:33:08.822695+0000","last_active":"2024-05-08T18:33:08.822634+0000","last_peered":"2024-05-08T18:33:08.822634+0000","last_clean":"2024-05-08T18:33:08.822634+0000","last_became_active":"2024-05-08T18:29:42.561171+0000","last_became_peered":"2024-05-08T18:29:42.561171+0000","last_unstale":"2024-05-08T18:33:08.822634+0000","last_undegraded":"2024-05-08T18:33:08.822634+0000","last_fullsized":"2024-05-08T18:33:08.822634+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'4","last_scrub_stamp":"2024-05-08T18:33:08.822410+0000","last_deep_scrub":"84'4","last_deep_scrub_stamp":"2024-05-08T18:33:08.822410+0000","last_clean_scrub_stamp":"2024-05-08T18:33:08.822410+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:04:37.332926+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"116'20","reported_seq":225,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:30.215231+0000","last_change":"2024-05-08T18:33:30.215390+0000","last_active":"2024-05-08T18:33:30.215231+0000","last_peered":"2024-05-08T18:33:30.215231+0000","last_clean":"2024-05-08T18:33:30.215231+0000","last_became_active":"2024-05-08T18:29:40.542398+0000","last_became_peered":"2024-05-08T18:29:40.542398+0000","last_unstale":"2024-05-08T18:33:30.215231+0000","last_undegraded":"2024-05-08T18:33:30.215231+0000","last_fullsized":"2024-05-08T18:33:30.215231+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'20","last_scrub_stamp":"2024-05-08T18:33:30.215003+0000","last_deep_scrub":"116'20","last_deep_scrub_stamp":"2024-05-08T18:33:30.215003+0000","last_clean_scrub_stamp":"2024-05-08T18:33:30.215003+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:34:14.886658+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"97'6","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:13.444728+0000","last_change":"2024-05-08T18:33:13.444795+0000","last_active":"2024-05-08T18:33:13.444728+0000","last_peered":"2024-05-08T18:33:13.444728+0000","last_clean":"2024-05-08T18:33:13.444728+0000","last_became_active":"2024-05-08T18:29:42.578981+0000","last_became_peered":"2024-05-08T18:29:42.578981+0000","last_unstale":"2024-05-08T18:33:13.444728+0000","last_undegraded":"2024-05-08T18:33:13.444728+0000","last_fullsized":"2024-05-08T18:33:13.444728+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'6","last_scrub_stamp":"2024-05-08T18:33:13.444524+0000","last_deep_scrub":"97'6","last_deep_scrub_stamp":"2024-05-08T18:33:13.444524+0000","last_clean_scrub_stamp":"2024-05-08T18:33:13.444524+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:22:27.693306+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"116'22","reported_seq":228,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:30.018597+0000","last_change":"2024-05-08T18:33:30.018720+0000","last_active":"2024-05-08T18:33:30.018597+0000","last_peered":"2024-05-08T18:33:30.018597+0000","last_clean":"2024-05-08T18:33:30.018597+0000","last_became_active":"2024-05-08T18:29:40.548177+0000","last_became_peered":"2024-05-08T18:29:40.548177+0000","last_unstale":"2024-05-08T18:33:30.018597+0000","last_undegraded":"2024-05-08T18:33:30.018597+0000","last_fullsized":"2024-05-08T18:33:30.018597+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'22","last_scrub_stamp":"2024-05-08T18:33:30.018301+0000","last_deep_scrub":"116'22","last_deep_scrub_stamp":"2024-05-08T18:33:30.018301+0000","last_clean_scrub_stamp":"2024-05-08T18:33:30.018301+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:48:25.628539+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"80'2","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.926107+0000","last_change":"2024-05-08T18:33:06.926170+0000","last_active":"2024-05-08T18:33:06.926107+0000","last_peered":"2024-05-08T18:33:06.926107+0000","last_clean":"2024-05-08T18:33:06.926107+0000","last_became_active":"2024-05-08T18:29:42.573384+0000","last_became_peered":"2024-05-08T18:29:42.573384+0000","last_unstale":"2024-05-08T18:33:06.926107+0000","last_undegraded":"2024-05-08T18:33:06.926107+0000","last_fullsized":"2024-05-08T18:33:06.926107+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2","last_scrub_stamp":"2024-05-08T18:33:06.925879+0000","last_deep_scrub":"80'2","last_deep_scrub_stamp":"2024-05-08T18:33:06.925879+0000","last_clean_scrub_stamp":"2024-05-08T18:33:06.925879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:27:06.379974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"116'18","reported_seq":221,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:18.613390+0000","last_change":"2024-05-08T18:33:18.613454+0000","last_active":"2024-05-08T18:33:18.613390+0000","last_peered":"2024-05-08T18:33:18.613390+0000","last_clean":"2024-05-08T18:33:18.613390+0000","last_became_active":"2024-05-08T18:29:40.563231+0000","last_became_peered":"2024-05-08T18:29:40.563231+0000","last_unstale":"2024-05-08T18:33:18.613390+0000","last_undegraded":"2024-05-08T18:33:18.613390+0000","last_fullsized":"2024-05-08T18:33:18.613390+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'18","last_scrub_stamp":"2024-05-08T18:33:18.613120+0000","last_deep_scrub":"116'18","last_deep_scrub_stamp":"2024-05-08T18:33:18.613120+0000","last_clean_scrub_stamp":"2024-05-08T18:33:18.613120+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:11:40.975598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:19.976793+0000","last_change":"2024-05-08T18:33:19.976898+0000","last_active":"2024-05-08T18:33:19.976793+0000","last_peered":"2024-05-08T18:33:19.976793+0000","last_clean":"2024-05-08T18:33:19.976793+0000","last_became_active":"2024-05-08T18:29:42.563822+0000","last_became_peered":"2024-05-08T18:29:42.563822+0000","last_unstale":"2024-05-08T18:33:19.976793+0000","last_undegraded":"2024-05-08T18:33:19.976793+0000","last_fullsized":"2024-05-08T18:33:19.976793+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:19.976557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:19.976557+0000","last_clean_scrub_stamp":"2024-05-08T18:33:19.976557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:41:42.325155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"116'28","reported_seq":231,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:14.818194+0000","last_change":"2024-05-08T18:33:14.818317+0000","last_active":"2024-05-08T18:33:14.818194+0000","last_peered":"2024-05-08T18:33:14.818194+0000","last_clean":"2024-05-08T18:33:14.818194+0000","last_became_active":"2024-05-08T18:29:40.571195+0000","last_became_peered":"2024-05-08T18:29:40.571195+0000","last_unstale":"2024-05-08T18:33:14.818194+0000","last_undegraded":"2024-05-08T18:33:14.818194+0000","last_fullsized":"2024-05-08T18:33:14.818194+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'28","last_scrub_stamp":"2024-05-08T18:33:14.817914+0000","last_deep_scrub":"116'28","last_deep_scrub_stamp":"2024-05-08T18:33:14.817914+0000","last_clean_scrub_stamp":"2024-05-08T18:33:14.817914+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:13:39.741623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":28,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:18.938962+0000","last_change":"2024-05-08T18:33:18.939020+0000","last_active":"2024-05-08T18:33:18.938962+0000","last_peered":"2024-05-08T18:33:18.938962+0000","last_clean":"2024-05-08T18:33:18.938962+0000","last_became_active":"2024-05-08T18:29:42.560419+0000","last_became_peered":"2024-05-08T18:29:42.560419+0000","last_unstale":"2024-05-08T18:33:18.938962+0000","last_undegraded":"2024-05-08T18:33:18.938962+0000","last_fullsized":"2024-05-08T18:33:18.938962+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:18.938772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:18.938772+0000","last_clean_scrub_stamp":"2024-05-08T18:33:18.938772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:25:42.250635+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"116'20","reported_seq":226,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:07.782695+0000","last_change":"2024-05-08T18:33:07.782811+0000","last_active":"2024-05-08T18:33:07.782695+0000","last_peered":"2024-05-08T18:33:07.782695+0000","last_clean":"2024-05-08T18:33:07.782695+0000","last_became_active":"2024-05-08T18:29:40.568584+0000","last_became_peered":"2024-05-08T18:29:40.568584+0000","last_unstale":"2024-05-08T18:33:07.782695+0000","last_undegraded":"2024-05-08T18:33:07.782695+0000","last_fullsized":"2024-05-08T18:33:07.782695+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'20","last_scrub_stamp":"2024-05-08T18:33:07.782380+0000","last_deep_scrub":"116'20","last_deep_scrub_stamp":"2024-05-08T18:33:07.782380+0000","last_clean_scrub_stamp":"2024-05-08T18:33:07.782380+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:02.322645+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"83'6","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:08.972475+0000","last_change":"2024-05-08T18:33:08.972538+0000","last_active":"2024-05-08T18:33:08.972475+0000","last_peered":"2024-05-08T18:33:08.972475+0000","last_clean":"2024-05-08T18:33:08.972475+0000","last_became_active":"2024-05-08T18:29:42.573563+0000","last_became_peered":"2024-05-08T18:29:42.573563+0000","last_unstale":"2024-05-08T18:33:08.972475+0000","last_undegraded":"2024-05-08T18:33:08.972475+0000","last_fullsized":"2024-05-08T18:33:08.972475+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'6","last_scrub_stamp":"2024-05-08T18:33:08.972279+0000","last_deep_scrub":"83'6","last_deep_scrub_stamp":"2024-05-08T18:33:08.972279+0000","last_clean_scrub_stamp":"2024-05-08T18:33:08.972279+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:09:29.848374+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"116'16","reported_seq":221,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:15.187897+0000","last_change":"2024-05-08T18:33:15.187957+0000","last_active":"2024-05-08T18:33:15.187897+0000","last_peered":"2024-05-08T18:33:15.187897+0000","last_clean":"2024-05-08T18:33:15.187897+0000","last_became_active":"2024-05-08T18:29:40.561360+0000","last_became_peered":"2024-05-08T18:29:40.561360+0000","last_unstale":"2024-05-08T18:33:15.187897+0000","last_undegraded":"2024-05-08T18:33:15.187897+0000","last_fullsized":"2024-05-08T18:33:15.187897+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'16","last_scrub_stamp":"2024-05-08T18:33:15.187705+0000","last_deep_scrub":"116'16","last_deep_scrub_stamp":"2024-05-08T18:33:15.187705+0000","last_clean_scrub_stamp":"2024-05-08T18:33:15.187705+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:10:19.782853+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"116'22","reported_seq":228,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:28.286952+0000","last_change":"2024-05-08T18:33:28.287089+0000","last_active":"2024-05-08T18:33:28.286952+0000","last_peered":"2024-05-08T18:33:28.286952+0000","last_clean":"2024-05-08T18:33:28.286952+0000","last_became_active":"2024-05-08T18:29:40.537925+0000","last_became_peered":"2024-05-08T18:29:40.537925+0000","last_unstale":"2024-05-08T18:33:28.286952+0000","last_undegraded":"2024-05-08T18:33:28.286952+0000","last_fullsized":"2024-05-08T18:33:28.286952+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'22","last_scrub_stamp":"2024-05-08T18:33:28.286720+0000","last_deep_scrub":"116'22","last_deep_scrub_stamp":"2024-05-08T18:33:28.286720+0000","last_clean_scrub_stamp":"2024-05-08T18:33:28.286720+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:44:38.515353+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":4,"num_write":32,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"97'8","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:10.876750+0000","last_change":"2024-05-08T18:33:10.876812+0000","last_active":"2024-05-08T18:33:10.876750+0000","last_peered":"2024-05-08T18:33:10.876750+0000","last_clean":"2024-05-08T18:33:10.876750+0000","last_became_active":"2024-05-08T18:29:42.574351+0000","last_became_peered":"2024-05-08T18:29:42.574351+0000","last_unstale":"2024-05-08T18:33:10.876750+0000","last_undegraded":"2024-05-08T18:33:10.876750+0000","last_fullsized":"2024-05-08T18:33:10.876750+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'8","last_scrub_stamp":"2024-05-08T18:33:10.876518+0000","last_deep_scrub":"97'8","last_deep_scrub_stamp":"2024-05-08T18:33:10.876518+0000","last_clean_scrub_stamp":"2024-05-08T18:33:10.876518+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:31:05.444966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"116'20","reported_seq":228,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:18.791152+0000","last_change":"2024-05-08T18:33:18.791310+0000","last_active":"2024-05-08T18:33:18.791152+0000","last_peered":"2024-05-08T18:33:18.791152+0000","last_clean":"2024-05-08T18:33:18.791152+0000","last_became_active":"2024-05-08T18:29:40.542965+0000","last_became_peered":"2024-05-08T18:29:40.542965+0000","last_unstale":"2024-05-08T18:33:18.791152+0000","last_undegraded":"2024-05-08T18:33:18.791152+0000","last_fullsized":"2024-05-08T18:33:18.791152+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'20","last_scrub_stamp":"2024-05-08T18:33:18.790907+0000","last_deep_scrub":"116'20","last_deep_scrub_stamp":"2024-05-08T18:33:18.790907+0000","last_clean_scrub_stamp":"2024-05-08T18:33:18.790907+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:22:33.039689+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":201,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:13.211139+0000","last_change":"2024-05-08T18:33:13.211194+0000","last_active":"2024-05-08T18:33:13.211139+0000","last_peered":"2024-05-08T18:33:13.211139+0000","last_clean":"2024-05-08T18:33:13.211139+0000","last_became_active":"2024-05-08T18:29:42.559028+0000","last_became_peered":"2024-05-08T18:29:42.559028+0000","last_unstale":"2024-05-08T18:33:13.211139+0000","last_undegraded":"2024-05-08T18:33:13.211139+0000","last_fullsized":"2024-05-08T18:33:13.211139+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:13.210947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:13.210947+0000","last_clean_scrub_stamp":"2024-05-08T18:33:13.210947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:22:27.459729+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":247,"num_read_kb":238,"num_write":231,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":841,"ondisk_log_size":841,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":23632,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1024,"num_read_kb":1070,"num_write":533,"num_write_kb":208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6074,"num_omap_keys":28,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":924,"ondisk_log_size":924,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":344,"num_read_kb":344,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":579,"num_read_kb":555,"num_write":234,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":222,"ondisk_log_size":222,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":593,"num_read_kb":23,"num_write":1216,"num_write_kb":2365440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1156,"ondisk_log_size":1156,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509497,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33152,"kb_used_data":1976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338688,"statfs":{"total":96636764160,"available":96602816512,"internally_reserved":0,"allocated":2023424,"data_stored":1399455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509497,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32548,"kb_used_data":1372,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339292,"statfs":{"total":96636764160,"available":96603435008,"internally_reserved":0,"allocated":1404928,"data_stored":808427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509495,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36752,"kb_used_data":1416,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335088,"statfs":{"total":96636764160,"available":96599130112,"internally_reserved":0,"allocated":1449984,"data_stored":809255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509495,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32536,"kb_used_data":1360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339304,"statfs":{"total":96636764160,"available":96603447296,"internally_reserved":0,"allocated":1392640,"data_stored":807925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542200,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32564,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339276,"statfs":{"total":96636764160,"available":96603418624,"internally_reserved":0,"allocated":1421312,"data_stored":808823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542200,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32544,"kb_used_data":1368,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339296,"statfs":{"total":96636764160,"available":96603439104,"internally_reserved":0,"allocated":1400832,"data_stored":809418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542198,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32564,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339276,"statfs":{"total":96636764160,"available":96603418624,"internally_reserved":0,"allocated":1421312,"data_stored":808677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542200,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33140,"kb_used_data":1964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338700,"statfs":{"total":96636764160,"available":96602828800,"internally_reserved":0,"allocated":2011136,"data_stored":1400290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T18:33:44.684 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-05-08T18:29:39.497961+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=39, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:44.685 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-05-08T18:29:49.624707+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=49, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:44.685 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-05-08T18:29:41.517676+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=29, tm_sec=41, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=32, tm_sec=58, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:33:44.686 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-08T18:34:04.688 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T18:34:05.016 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-05-08T18:34:05.024 INFO:teuthology.orchestra.run.smithi097.stderr:dumped all 2024-05-08T18:34:05.033 INFO:teuthology.orchestra.run.smithi097.stdout:{"pg_ready":true,"pg_map":{"version":248,"stamp":"2024-05-08T18:34:03.513246+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":615613,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":2853,"num_read_kb":2285,"num_write":2325,"num_write_kb":2367366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6074,"num_omap_keys":28,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3340,"ondisk_log_size":3340,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":265800,"kb_used_data":12232,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754708920,"statfs":{"total":773094113280,"available":772821934080,"internally_reserved":0,"allocated":12525568,"data_stored":7652270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":259575345},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007115"},"pg_stats":[{"pgid":"3.3f","version":"116'20","reported_seq":224,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:12.835866+0000","last_change":"2024-05-08T18:33:12.835866+0000","last_active":"2024-05-08T18:33:12.835866+0000","last_peered":"2024-05-08T18:33:12.835866+0000","last_clean":"2024-05-08T18:33:12.835866+0000","last_became_active":"2024-05-08T18:29:40.573543+0000","last_became_peered":"2024-05-08T18:29:40.573543+0000","last_unstale":"2024-05-08T18:33:12.835866+0000","last_undegraded":"2024-05-08T18:33:12.835866+0000","last_fullsized":"2024-05-08T18:33:12.835866+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'20","last_scrub_stamp":"2024-05-08T18:33:12.835610+0000","last_deep_scrub":"116'20","last_deep_scrub_stamp":"2024-05-08T18:33:12.835610+0000","last_clean_scrub_stamp":"2024-05-08T18:33:12.835610+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:59:53.794662+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":20,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"97'2","reported_seq":206,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:08.206096+0000","last_change":"2024-05-08T18:33:08.206159+0000","last_active":"2024-05-08T18:33:08.206096+0000","last_peered":"2024-05-08T18:33:08.206096+0000","last_clean":"2024-05-08T18:33:08.206096+0000","last_became_active":"2024-05-08T18:29:42.561201+0000","last_became_peered":"2024-05-08T18:29:42.561201+0000","last_unstale":"2024-05-08T18:33:08.206096+0000","last_undegraded":"2024-05-08T18:33:08.206096+0000","last_fullsized":"2024-05-08T18:33:08.206096+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'2","last_scrub_stamp":"2024-05-08T18:33:08.205846+0000","last_deep_scrub":"97'2","last_deep_scrub_stamp":"2024-05-08T18:33:08.205846+0000","last_clean_scrub_stamp":"2024-05-08T18:33:08.205846+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:09:29.081941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"116'20","reported_seq":229,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:20.802097+0000","last_change":"2024-05-08T18:33:20.802097+0000","last_active":"2024-05-08T18:33:20.802097+0000","last_peered":"2024-05-08T18:33:20.802097+0000","last_clean":"2024-05-08T18:33:20.802097+0000","last_became_active":"2024-05-08T18:29:40.548930+0000","last_became_peered":"2024-05-08T18:29:40.548930+0000","last_unstale":"2024-05-08T18:33:20.802097+0000","last_undegraded":"2024-05-08T18:33:20.802097+0000","last_fullsized":"2024-05-08T18:33:20.802097+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'20","last_scrub_stamp":"2024-05-08T18:33:20.801751+0000","last_deep_scrub":"116'20","last_deep_scrub_stamp":"2024-05-08T18:33:20.801751+0000","last_clean_scrub_stamp":"2024-05-08T18:33:20.801751+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:10:25.396899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"84'2","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:10.887340+0000","last_change":"2024-05-08T18:33:10.887411+0000","last_active":"2024-05-08T18:33:10.887340+0000","last_peered":"2024-05-08T18:33:10.887340+0000","last_clean":"2024-05-08T18:33:10.887340+0000","last_became_active":"2024-05-08T18:29:42.571344+0000","last_became_peered":"2024-05-08T18:29:42.571344+0000","last_unstale":"2024-05-08T18:33:10.887340+0000","last_undegraded":"2024-05-08T18:33:10.887340+0000","last_fullsized":"2024-05-08T18:33:10.887340+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'2","last_scrub_stamp":"2024-05-08T18:33:10.887104+0000","last_deep_scrub":"84'2","last_deep_scrub_stamp":"2024-05-08T18:33:10.887104+0000","last_clean_scrub_stamp":"2024-05-08T18:33:10.887104+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:51:01.201406+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"116'26","reported_seq":234,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:24.974983+0000","last_change":"2024-05-08T18:33:24.974983+0000","last_active":"2024-05-08T18:33:24.974983+0000","last_peered":"2024-05-08T18:33:24.974983+0000","last_clean":"2024-05-08T18:33:24.974983+0000","last_became_active":"2024-05-08T18:29:40.538458+0000","last_became_peered":"2024-05-08T18:29:40.538458+0000","last_unstale":"2024-05-08T18:33:24.974983+0000","last_undegraded":"2024-05-08T18:33:24.974983+0000","last_fullsized":"2024-05-08T18:33:24.974983+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'26","last_scrub_stamp":"2024-05-08T18:33:24.974694+0000","last_deep_scrub":"116'26","last_deep_scrub_stamp":"2024-05-08T18:33:24.974694+0000","last_clean_scrub_stamp":"2024-05-08T18:33:24.974694+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:10:46.096789+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":4,"num_write":36,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:07.571029+0000","last_change":"2024-05-08T18:33:07.571156+0000","last_active":"2024-05-08T18:33:07.571029+0000","last_peered":"2024-05-08T18:33:07.571029+0000","last_clean":"2024-05-08T18:33:07.571029+0000","last_became_active":"2024-05-08T18:29:42.569026+0000","last_became_peered":"2024-05-08T18:29:42.569026+0000","last_unstale":"2024-05-08T18:33:07.571029+0000","last_undegraded":"2024-05-08T18:33:07.571029+0000","last_fullsized":"2024-05-08T18:33:07.571029+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:07.570804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:07.570804+0000","last_clean_scrub_stamp":"2024-05-08T18:33:07.570804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:31.162982+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"116'16","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:17.149603+0000","last_change":"2024-05-08T18:33:17.149603+0000","last_active":"2024-05-08T18:33:17.149603+0000","last_peered":"2024-05-08T18:33:17.149603+0000","last_clean":"2024-05-08T18:33:17.149603+0000","last_became_active":"2024-05-08T18:29:40.556884+0000","last_became_peered":"2024-05-08T18:29:40.556884+0000","last_unstale":"2024-05-08T18:33:17.149603+0000","last_undegraded":"2024-05-08T18:33:17.149603+0000","last_fullsized":"2024-05-08T18:33:17.149603+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'16","last_scrub_stamp":"2024-05-08T18:33:17.149214+0000","last_deep_scrub":"116'16","last_deep_scrub_stamp":"2024-05-08T18:33:17.149214+0000","last_clean_scrub_stamp":"2024-05-08T18:33:17.149214+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:58:12.131775+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:17.971548+0000","last_change":"2024-05-08T18:33:17.971608+0000","last_active":"2024-05-08T18:33:17.971548+0000","last_peered":"2024-05-08T18:33:17.971548+0000","last_clean":"2024-05-08T18:33:17.971548+0000","last_became_active":"2024-05-08T18:29:42.566058+0000","last_became_peered":"2024-05-08T18:29:42.566058+0000","last_unstale":"2024-05-08T18:33:17.971548+0000","last_undegraded":"2024-05-08T18:33:17.971548+0000","last_fullsized":"2024-05-08T18:33:17.971548+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:17.971336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:17.971336+0000","last_clean_scrub_stamp":"2024-05-08T18:33:17.971336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:14:35.541504+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"116'10","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:28.889304+0000","last_change":"2024-05-08T18:33:28.889418+0000","last_active":"2024-05-08T18:33:28.889304+0000","last_peered":"2024-05-08T18:33:28.889304+0000","last_clean":"2024-05-08T18:33:28.889304+0000","last_became_active":"2024-05-08T18:29:40.570467+0000","last_became_peered":"2024-05-08T18:29:40.570467+0000","last_unstale":"2024-05-08T18:33:28.889304+0000","last_undegraded":"2024-05-08T18:33:28.889304+0000","last_fullsized":"2024-05-08T18:33:28.889304+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'10","last_scrub_stamp":"2024-05-08T18:33:28.889093+0000","last_deep_scrub":"116'10","last_deep_scrub_stamp":"2024-05-08T18:33:28.889093+0000","last_clean_scrub_stamp":"2024-05-08T18:33:28.889093+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:44:39.117725+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:07.631651+0000","last_change":"2024-05-08T18:33:07.631651+0000","last_active":"2024-05-08T18:33:07.631651+0000","last_peered":"2024-05-08T18:33:07.631651+0000","last_clean":"2024-05-08T18:33:07.631651+0000","last_became_active":"2024-05-08T18:29:42.565740+0000","last_became_peered":"2024-05-08T18:29:42.565740+0000","last_unstale":"2024-05-08T18:33:07.631651+0000","last_undegraded":"2024-05-08T18:33:07.631651+0000","last_fullsized":"2024-05-08T18:33:07.631651+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:07.631397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:07.631397+0000","last_clean_scrub_stamp":"2024-05-08T18:33:07.631397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:22:24.824498+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"116'14","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:27.239203+0000","last_change":"2024-05-08T18:33:27.239268+0000","last_active":"2024-05-08T18:33:27.239203+0000","last_peered":"2024-05-08T18:33:27.239203+0000","last_clean":"2024-05-08T18:33:27.239203+0000","last_became_active":"2024-05-08T18:29:40.537458+0000","last_became_peered":"2024-05-08T18:29:40.537458+0000","last_unstale":"2024-05-08T18:33:27.239203+0000","last_undegraded":"2024-05-08T18:33:27.239203+0000","last_fullsized":"2024-05-08T18:33:27.239203+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'14","last_scrub_stamp":"2024-05-08T18:33:27.239011+0000","last_deep_scrub":"116'14","last_deep_scrub_stamp":"2024-05-08T18:33:27.239011+0000","last_clean_scrub_stamp":"2024-05-08T18:33:27.239011+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:41:28.234382+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":205,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:09.551309+0000","last_change":"2024-05-08T18:33:09.551309+0000","last_active":"2024-05-08T18:33:09.551309+0000","last_peered":"2024-05-08T18:33:09.551309+0000","last_clean":"2024-05-08T18:33:09.551309+0000","last_became_active":"2024-05-08T18:29:42.569255+0000","last_became_peered":"2024-05-08T18:29:42.569255+0000","last_unstale":"2024-05-08T18:33:09.551309+0000","last_undegraded":"2024-05-08T18:33:09.551309+0000","last_fullsized":"2024-05-08T18:33:09.551309+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:09.551066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:09.551066+0000","last_clean_scrub_stamp":"2024-05-08T18:33:09.551066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:26:59.232592+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"116'36","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:19.859727+0000","last_change":"2024-05-08T18:33:19.859879+0000","last_active":"2024-05-08T18:33:19.859727+0000","last_peered":"2024-05-08T18:33:19.859727+0000","last_clean":"2024-05-08T18:33:19.859727+0000","last_became_active":"2024-05-08T18:30:21.210052+0000","last_became_peered":"2024-05-08T18:30:21.210052+0000","last_unstale":"2024-05-08T18:33:19.859727+0000","last_undegraded":"2024-05-08T18:33:19.859727+0000","last_fullsized":"2024-05-08T18:33:19.859727+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'36","last_scrub_stamp":"2024-05-08T18:33:19.859481+0000","last_deep_scrub":"116'36","last_deep_scrub_stamp":"2024-05-08T18:33:19.859481+0000","last_clean_scrub_stamp":"2024-05-08T18:33:19.859481+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:24.773310+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"97'4","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:11.184207+0000","last_change":"2024-05-08T18:33:11.184207+0000","last_active":"2024-05-08T18:33:11.184207+0000","last_peered":"2024-05-08T18:33:11.184207+0000","last_clean":"2024-05-08T18:33:11.184207+0000","last_became_active":"2024-05-08T18:29:42.560699+0000","last_became_peered":"2024-05-08T18:29:42.560699+0000","last_unstale":"2024-05-08T18:33:11.184207+0000","last_undegraded":"2024-05-08T18:33:11.184207+0000","last_fullsized":"2024-05-08T18:33:11.184207+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'4","last_scrub_stamp":"2024-05-08T18:33:11.183948+0000","last_deep_scrub":"97'4","last_deep_scrub_stamp":"2024-05-08T18:33:11.183948+0000","last_clean_scrub_stamp":"2024-05-08T18:33:11.183948+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:04:19.618457+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"116'26","reported_seq":232,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:33.882242+0000","last_change":"2024-05-08T18:33:33.882303+0000","last_active":"2024-05-08T18:33:33.882242+0000","last_peered":"2024-05-08T18:33:33.882242+0000","last_clean":"2024-05-08T18:33:33.882242+0000","last_became_active":"2024-05-08T18:29:40.564038+0000","last_became_peered":"2024-05-08T18:29:40.564038+0000","last_unstale":"2024-05-08T18:33:33.882242+0000","last_undegraded":"2024-05-08T18:33:33.882242+0000","last_fullsized":"2024-05-08T18:33:33.882242+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'26","last_scrub_stamp":"2024-05-08T18:33:33.882037+0000","last_deep_scrub":"116'26","last_deep_scrub_stamp":"2024-05-08T18:33:33.882037+0000","last_clean_scrub_stamp":"2024-05-08T18:33:33.882037+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:39:23.547359+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":26,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"84'8","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:10.839068+0000","last_change":"2024-05-08T18:33:10.839068+0000","last_active":"2024-05-08T18:33:10.839068+0000","last_peered":"2024-05-08T18:33:10.839068+0000","last_clean":"2024-05-08T18:33:10.839068+0000","last_became_active":"2024-05-08T18:29:42.569917+0000","last_became_peered":"2024-05-08T18:29:42.569917+0000","last_unstale":"2024-05-08T18:33:10.839068+0000","last_undegraded":"2024-05-08T18:33:10.839068+0000","last_fullsized":"2024-05-08T18:33:10.839068+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'8","last_scrub_stamp":"2024-05-08T18:33:10.838811+0000","last_deep_scrub":"84'8","last_deep_scrub_stamp":"2024-05-08T18:33:10.838811+0000","last_clean_scrub_stamp":"2024-05-08T18:33:10.838811+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:56.522874+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"84'4","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:08.594718+0000","last_change":"2024-05-08T18:33:08.594781+0000","last_active":"2024-05-08T18:33:08.594718+0000","last_peered":"2024-05-08T18:33:08.594718+0000","last_clean":"2024-05-08T18:33:08.594718+0000","last_became_active":"2024-05-08T18:29:42.567399+0000","last_became_peered":"2024-05-08T18:29:42.567399+0000","last_unstale":"2024-05-08T18:33:08.594718+0000","last_undegraded":"2024-05-08T18:33:08.594718+0000","last_fullsized":"2024-05-08T18:33:08.594718+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'4","last_scrub_stamp":"2024-05-08T18:33:08.594504+0000","last_deep_scrub":"84'4","last_deep_scrub_stamp":"2024-05-08T18:33:08.594504+0000","last_clean_scrub_stamp":"2024-05-08T18:33:08.594504+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:09:29.470599+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"116'26","reported_seq":229,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:20.767491+0000","last_change":"2024-05-08T18:33:20.767550+0000","last_active":"2024-05-08T18:33:20.767491+0000","last_peered":"2024-05-08T18:33:20.767491+0000","last_clean":"2024-05-08T18:33:20.767491+0000","last_became_active":"2024-05-08T18:29:40.570600+0000","last_became_peered":"2024-05-08T18:29:40.570600+0000","last_unstale":"2024-05-08T18:33:20.767491+0000","last_undegraded":"2024-05-08T18:33:20.767491+0000","last_fullsized":"2024-05-08T18:33:20.767491+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'26","last_scrub_stamp":"2024-05-08T18:33:20.767294+0000","last_deep_scrub":"116'26","last_deep_scrub_stamp":"2024-05-08T18:33:20.767294+0000","last_clean_scrub_stamp":"2024-05-08T18:33:20.767294+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:51.554250+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":26,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"80'2","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.882258+0000","last_change":"2024-05-08T18:33:05.882328+0000","last_active":"2024-05-08T18:33:05.882258+0000","last_peered":"2024-05-08T18:33:05.882258+0000","last_clean":"2024-05-08T18:33:05.882258+0000","last_became_active":"2024-05-08T18:29:42.577789+0000","last_became_peered":"2024-05-08T18:29:42.577789+0000","last_unstale":"2024-05-08T18:33:05.882258+0000","last_undegraded":"2024-05-08T18:33:05.882258+0000","last_fullsized":"2024-05-08T18:33:05.882258+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2","last_scrub_stamp":"2024-05-08T18:33:05.881939+0000","last_deep_scrub":"80'2","last_deep_scrub_stamp":"2024-05-08T18:33:05.881939+0000","last_clean_scrub_stamp":"2024-05-08T18:33:05.881939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:10.795768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"116'16","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:19.650921+0000","last_change":"2024-05-08T18:33:19.650983+0000","last_active":"2024-05-08T18:33:19.650921+0000","last_peered":"2024-05-08T18:33:19.650921+0000","last_clean":"2024-05-08T18:33:19.650921+0000","last_became_active":"2024-05-08T18:29:40.569519+0000","last_became_peered":"2024-05-08T18:29:40.569519+0000","last_unstale":"2024-05-08T18:33:19.650921+0000","last_undegraded":"2024-05-08T18:33:19.650921+0000","last_fullsized":"2024-05-08T18:33:19.650921+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'16","last_scrub_stamp":"2024-05-08T18:33:19.650728+0000","last_deep_scrub":"116'16","last_deep_scrub_stamp":"2024-05-08T18:33:19.650728+0000","last_clean_scrub_stamp":"2024-05-08T18:33:19.650728+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:43.242905+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":201,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:09.203395+0000","last_change":"2024-05-08T18:33:09.203453+0000","last_active":"2024-05-08T18:33:09.203395+0000","last_peered":"2024-05-08T18:33:09.203395+0000","last_clean":"2024-05-08T18:33:09.203395+0000","last_became_active":"2024-05-08T18:29:42.562296+0000","last_became_peered":"2024-05-08T18:29:42.562296+0000","last_unstale":"2024-05-08T18:33:09.203395+0000","last_undegraded":"2024-05-08T18:33:09.203395+0000","last_fullsized":"2024-05-08T18:33:09.203395+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:09.203183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:09.203183+0000","last_clean_scrub_stamp":"2024-05-08T18:33:09.203183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:17:19.757932+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"116'28","reported_seq":231,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:17.577727+0000","last_change":"2024-05-08T18:33:17.577789+0000","last_active":"2024-05-08T18:33:17.577727+0000","last_peered":"2024-05-08T18:33:17.577727+0000","last_clean":"2024-05-08T18:33:17.577727+0000","last_became_active":"2024-05-08T18:29:40.563516+0000","last_became_peered":"2024-05-08T18:29:40.563516+0000","last_unstale":"2024-05-08T18:33:17.577727+0000","last_undegraded":"2024-05-08T18:33:17.577727+0000","last_fullsized":"2024-05-08T18:33:17.577727+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'28","last_scrub_stamp":"2024-05-08T18:33:17.577538+0000","last_deep_scrub":"116'28","last_deep_scrub_stamp":"2024-05-08T18:33:17.577538+0000","last_clean_scrub_stamp":"2024-05-08T18:33:17.577538+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:40:11.429520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":28,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"97'4","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:09.870748+0000","last_change":"2024-05-08T18:33:09.870828+0000","last_active":"2024-05-08T18:33:09.870748+0000","last_peered":"2024-05-08T18:33:09.870748+0000","last_clean":"2024-05-08T18:33:09.870748+0000","last_became_active":"2024-05-08T18:29:42.566256+0000","last_became_peered":"2024-05-08T18:29:42.566256+0000","last_unstale":"2024-05-08T18:33:09.870748+0000","last_undegraded":"2024-05-08T18:33:09.870748+0000","last_fullsized":"2024-05-08T18:33:09.870748+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'4","last_scrub_stamp":"2024-05-08T18:33:09.870499+0000","last_deep_scrub":"97'4","last_deep_scrub_stamp":"2024-05-08T18:33:09.870499+0000","last_clean_scrub_stamp":"2024-05-08T18:33:09.870499+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:20:44.539452+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"116'14","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:27.585824+0000","last_change":"2024-05-08T18:33:27.585884+0000","last_active":"2024-05-08T18:33:27.585824+0000","last_peered":"2024-05-08T18:33:27.585824+0000","last_clean":"2024-05-08T18:33:27.585824+0000","last_became_active":"2024-05-08T18:29:40.572250+0000","last_became_peered":"2024-05-08T18:29:40.572250+0000","last_unstale":"2024-05-08T18:33:27.585824+0000","last_undegraded":"2024-05-08T18:33:27.585824+0000","last_fullsized":"2024-05-08T18:33:27.585824+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'14","last_scrub_stamp":"2024-05-08T18:33:27.585623+0000","last_deep_scrub":"116'14","last_deep_scrub_stamp":"2024-05-08T18:33:27.585623+0000","last_clean_scrub_stamp":"2024-05-08T18:33:27.585623+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:41:28.580994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"97'6","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:11.868082+0000","last_change":"2024-05-08T18:33:11.868142+0000","last_active":"2024-05-08T18:33:11.868082+0000","last_peered":"2024-05-08T18:33:11.868082+0000","last_clean":"2024-05-08T18:33:11.868082+0000","last_became_active":"2024-05-08T18:29:42.570435+0000","last_became_peered":"2024-05-08T18:29:42.570435+0000","last_unstale":"2024-05-08T18:33:11.868082+0000","last_undegraded":"2024-05-08T18:33:11.868082+0000","last_fullsized":"2024-05-08T18:33:11.868082+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'6","last_scrub_stamp":"2024-05-08T18:33:11.867888+0000","last_deep_scrub":"97'6","last_deep_scrub_stamp":"2024-05-08T18:33:11.867888+0000","last_clean_scrub_stamp":"2024-05-08T18:33:11.867888+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:50:40.673319+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"116'14","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:26.913604+0000","last_change":"2024-05-08T18:33:26.913672+0000","last_active":"2024-05-08T18:33:26.913604+0000","last_peered":"2024-05-08T18:33:26.913604+0000","last_clean":"2024-05-08T18:33:26.913604+0000","last_became_active":"2024-05-08T18:29:40.566531+0000","last_became_peered":"2024-05-08T18:29:40.566531+0000","last_unstale":"2024-05-08T18:33:26.913604+0000","last_undegraded":"2024-05-08T18:33:26.913604+0000","last_fullsized":"2024-05-08T18:33:26.913604+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'14","last_scrub_stamp":"2024-05-08T18:33:26.913376+0000","last_deep_scrub":"116'14","last_deep_scrub_stamp":"2024-05-08T18:33:26.913376+0000","last_clean_scrub_stamp":"2024-05-08T18:33:26.913376+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:38:33.439457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"84'8","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:30.626970+0000","last_change":"2024-05-08T18:33:30.627096+0000","last_active":"2024-05-08T18:33:30.626970+0000","last_peered":"2024-05-08T18:33:30.626970+0000","last_clean":"2024-05-08T18:33:30.626970+0000","last_became_active":"2024-05-08T18:29:42.554115+0000","last_became_peered":"2024-05-08T18:29:42.554115+0000","last_unstale":"2024-05-08T18:33:30.626970+0000","last_undegraded":"2024-05-08T18:33:30.626970+0000","last_fullsized":"2024-05-08T18:33:30.626970+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'8","last_scrub_stamp":"2024-05-08T18:33:30.626667+0000","last_deep_scrub":"84'8","last_deep_scrub_stamp":"2024-05-08T18:33:30.626667+0000","last_clean_scrub_stamp":"2024-05-08T18:33:30.626667+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:34:15.298322+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"116'14","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:28.997133+0000","last_change":"2024-05-08T18:33:28.997202+0000","last_active":"2024-05-08T18:33:28.997133+0000","last_peered":"2024-05-08T18:33:28.997133+0000","last_clean":"2024-05-08T18:33:28.997133+0000","last_became_active":"2024-05-08T18:29:40.547384+0000","last_became_peered":"2024-05-08T18:29:40.547384+0000","last_unstale":"2024-05-08T18:33:28.997133+0000","last_undegraded":"2024-05-08T18:33:28.997133+0000","last_fullsized":"2024-05-08T18:33:28.997133+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'14","last_scrub_stamp":"2024-05-08T18:33:28.996924+0000","last_deep_scrub":"116'14","last_deep_scrub_stamp":"2024-05-08T18:33:28.996924+0000","last_clean_scrub_stamp":"2024-05-08T18:33:28.996924+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:58:20.971538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"97'10","reported_seq":203,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:38.636200+0000","last_change":"2024-05-08T18:33:38.636262+0000","last_active":"2024-05-08T18:33:38.636200+0000","last_peered":"2024-05-08T18:33:38.636200+0000","last_clean":"2024-05-08T18:33:38.636200+0000","last_became_active":"2024-05-08T18:29:50.684644+0000","last_became_peered":"2024-05-08T18:29:50.684644+0000","last_unstale":"2024-05-08T18:33:38.636200+0000","last_undegraded":"2024-05-08T18:33:38.636200+0000","last_fullsized":"2024-05-08T18:33:38.636200+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'10","last_scrub_stamp":"2024-05-08T18:33:38.635986+0000","last_deep_scrub":"97'10","last_deep_scrub_stamp":"2024-05-08T18:33:38.635986+0000","last_clean_scrub_stamp":"2024-05-08T18:33:38.635986+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:30:56.346909+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":21,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"84'10","reported_seq":221,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:14.794883+0000","last_change":"2024-05-08T18:33:14.794948+0000","last_active":"2024-05-08T18:33:14.794883+0000","last_peered":"2024-05-08T18:33:14.794883+0000","last_clean":"2024-05-08T18:33:14.794883+0000","last_became_active":"2024-05-08T18:29:42.573296+0000","last_became_peered":"2024-05-08T18:29:42.573296+0000","last_unstale":"2024-05-08T18:33:14.794883+0000","last_undegraded":"2024-05-08T18:33:14.794883+0000","last_fullsized":"2024-05-08T18:33:14.794883+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'10","last_scrub_stamp":"2024-05-08T18:33:14.794677+0000","last_deep_scrub":"84'10","last_deep_scrub_stamp":"2024-05-08T18:33:14.794677+0000","last_clean_scrub_stamp":"2024-05-08T18:33:14.794677+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:08:31.143567+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"116'16","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:26.909579+0000","last_change":"2024-05-08T18:33:26.909642+0000","last_active":"2024-05-08T18:33:26.909579+0000","last_peered":"2024-05-08T18:33:26.909579+0000","last_clean":"2024-05-08T18:33:26.909579+0000","last_became_active":"2024-05-08T18:29:40.569711+0000","last_became_peered":"2024-05-08T18:29:40.569711+0000","last_unstale":"2024-05-08T18:33:26.909579+0000","last_undegraded":"2024-05-08T18:33:26.909579+0000","last_fullsized":"2024-05-08T18:33:26.909579+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'16","last_scrub_stamp":"2024-05-08T18:33:26.909368+0000","last_deep_scrub":"116'16","last_deep_scrub_stamp":"2024-05-08T18:33:26.909368+0000","last_clean_scrub_stamp":"2024-05-08T18:33:26.909368+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:46:52.163993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":197,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:22.219620+0000","last_change":"2024-05-08T18:33:22.219676+0000","last_active":"2024-05-08T18:33:22.219620+0000","last_peered":"2024-05-08T18:33:22.219620+0000","last_clean":"2024-05-08T18:33:22.219620+0000","last_became_active":"2024-05-08T18:29:44.593442+0000","last_became_peered":"2024-05-08T18:29:44.593442+0000","last_unstale":"2024-05-08T18:33:22.219620+0000","last_undegraded":"2024-05-08T18:33:22.219620+0000","last_fullsized":"2024-05-08T18:33:22.219620+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:22.219421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:22.219421+0000","last_clean_scrub_stamp":"2024-05-08T18:33:22.219421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:48:23.857807+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"116'21","reported_seq":226,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:20.970599+0000","last_change":"2024-05-08T18:33:20.970765+0000","last_active":"2024-05-08T18:33:20.970599+0000","last_peered":"2024-05-08T18:33:20.970599+0000","last_clean":"2024-05-08T18:33:20.970599+0000","last_became_active":"2024-05-08T18:29:46.593656+0000","last_became_peered":"2024-05-08T18:29:46.593656+0000","last_unstale":"2024-05-08T18:33:20.970599+0000","last_undegraded":"2024-05-08T18:33:20.970599+0000","last_fullsized":"2024-05-08T18:33:20.970599+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'21","last_scrub_stamp":"2024-05-08T18:33:20.970347+0000","last_deep_scrub":"116'21","last_deep_scrub_stamp":"2024-05-08T18:33:20.970347+0000","last_clean_scrub_stamp":"2024-05-08T18:33:20.970347+0000","objects_scrubbed":4,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:30:48.124530+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":187,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:31.796705+0000","last_change":"2024-05-08T18:33:31.796812+0000","last_active":"2024-05-08T18:33:31.796705+0000","last_peered":"2024-05-08T18:33:31.796705+0000","last_clean":"2024-05-08T18:33:31.796705+0000","last_became_active":"2024-05-08T18:29:48.639122+0000","last_became_peered":"2024-05-08T18:29:48.639122+0000","last_unstale":"2024-05-08T18:33:31.796705+0000","last_undegraded":"2024-05-08T18:33:31.796705+0000","last_fullsized":"2024-05-08T18:33:31.796705+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:31.796417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:31.796417+0000","last_clean_scrub_stamp":"2024-05-08T18:33:31.796417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:02:32.410954+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"83'4","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:34.204649+0000","last_change":"2024-05-08T18:33:34.204718+0000","last_active":"2024-05-08T18:33:34.204649+0000","last_peered":"2024-05-08T18:33:34.204649+0000","last_clean":"2024-05-08T18:33:34.204649+0000","last_became_active":"2024-05-08T18:29:50.671513+0000","last_became_peered":"2024-05-08T18:29:50.671513+0000","last_unstale":"2024-05-08T18:33:34.204649+0000","last_undegraded":"2024-05-08T18:33:34.204649+0000","last_fullsized":"2024-05-08T18:33:34.204649+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'4","last_scrub_stamp":"2024-05-08T18:33:34.204444+0000","last_deep_scrub":"83'4","last_deep_scrub_stamp":"2024-05-08T18:33:34.204444+0000","last_clean_scrub_stamp":"2024-05-08T18:33:34.204444+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:05:05.603273+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"84'4","reported_seq":211,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:12.184669+0000","last_change":"2024-05-08T18:33:12.184791+0000","last_active":"2024-05-08T18:33:12.184669+0000","last_peered":"2024-05-08T18:33:12.184669+0000","last_clean":"2024-05-08T18:33:12.184669+0000","last_became_active":"2024-05-08T18:29:42.564741+0000","last_became_peered":"2024-05-08T18:29:42.564741+0000","last_unstale":"2024-05-08T18:33:12.184669+0000","last_undegraded":"2024-05-08T18:33:12.184669+0000","last_fullsized":"2024-05-08T18:33:12.184669+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'4","last_scrub_stamp":"2024-05-08T18:33:12.184342+0000","last_deep_scrub":"84'4","last_deep_scrub_stamp":"2024-05-08T18:33:12.184342+0000","last_clean_scrub_stamp":"2024-05-08T18:33:12.184342+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:59:53.143394+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"116'12","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:21.979037+0000","last_change":"2024-05-08T18:33:21.979109+0000","last_active":"2024-05-08T18:33:21.979037+0000","last_peered":"2024-05-08T18:33:21.979037+0000","last_clean":"2024-05-08T18:33:21.979037+0000","last_became_active":"2024-05-08T18:29:40.564401+0000","last_became_peered":"2024-05-08T18:29:40.564401+0000","last_unstale":"2024-05-08T18:33:21.979037+0000","last_undegraded":"2024-05-08T18:33:21.979037+0000","last_fullsized":"2024-05-08T18:33:21.979037+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'12","last_scrub_stamp":"2024-05-08T18:33:21.978790+0000","last_deep_scrub":"116'12","last_deep_scrub_stamp":"2024-05-08T18:33:21.978790+0000","last_clean_scrub_stamp":"2024-05-08T18:33:21.978790+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:57:21.573789+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":12,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:17.921554+0000","last_change":"2024-05-08T18:33:17.921691+0000","last_active":"2024-05-08T18:33:17.921554+0000","last_peered":"2024-05-08T18:33:17.921554+0000","last_clean":"2024-05-08T18:33:17.921554+0000","last_became_active":"2024-05-08T18:29:44.586975+0000","last_became_peered":"2024-05-08T18:29:44.586975+0000","last_unstale":"2024-05-08T18:33:17.921554+0000","last_undegraded":"2024-05-08T18:33:17.921554+0000","last_fullsized":"2024-05-08T18:33:17.921554+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:17.921326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:17.921326+0000","last_clean_scrub_stamp":"2024-05-08T18:33:17.921326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:14:35.491494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"116'10","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.583315+0000","last_change":"2024-05-08T18:33:06.583387+0000","last_active":"2024-05-08T18:33:06.583315+0000","last_peered":"2024-05-08T18:33:06.583315+0000","last_clean":"2024-05-08T18:33:06.583315+0000","last_became_active":"2024-05-08T18:29:46.599894+0000","last_became_peered":"2024-05-08T18:29:46.599894+0000","last_unstale":"2024-05-08T18:33:06.583315+0000","last_undegraded":"2024-05-08T18:33:06.583315+0000","last_fullsized":"2024-05-08T18:33:06.583315+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'10","last_scrub_stamp":"2024-05-08T18:33:06.583104+0000","last_deep_scrub":"116'10","last_deep_scrub_stamp":"2024-05-08T18:33:06.583104+0000","last_clean_scrub_stamp":"2024-05-08T18:33:06.583104+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:54:55.506347+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:32.629675+0000","last_change":"2024-05-08T18:33:32.629793+0000","last_active":"2024-05-08T18:33:32.629675+0000","last_peered":"2024-05-08T18:33:32.629675+0000","last_clean":"2024-05-08T18:33:32.629675+0000","last_became_active":"2024-05-08T18:29:48.613591+0000","last_became_peered":"2024-05-08T18:29:48.613591+0000","last_unstale":"2024-05-08T18:33:32.629675+0000","last_undegraded":"2024-05-08T18:33:32.629675+0000","last_fullsized":"2024-05-08T18:33:32.629675+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:32.629338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:32.629338+0000","last_clean_scrub_stamp":"2024-05-08T18:33:32.629338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:12:00.347817+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:38.926472+0000","last_change":"2024-05-08T18:33:38.926533+0000","last_active":"2024-05-08T18:33:38.926472+0000","last_peered":"2024-05-08T18:33:38.926472+0000","last_clean":"2024-05-08T18:33:38.926472+0000","last_became_active":"2024-05-08T18:29:50.683931+0000","last_became_peered":"2024-05-08T18:29:50.683931+0000","last_unstale":"2024-05-08T18:33:38.926472+0000","last_undegraded":"2024-05-08T18:33:38.926472+0000","last_fullsized":"2024-05-08T18:33:38.926472+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:38.926271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:38.926271+0000","last_clean_scrub_stamp":"2024-05-08T18:33:38.926271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:11:18.055475+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"80'2","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:09.872452+0000","last_change":"2024-05-08T18:33:09.872511+0000","last_active":"2024-05-08T18:33:09.872452+0000","last_peered":"2024-05-08T18:33:09.872452+0000","last_clean":"2024-05-08T18:33:09.872452+0000","last_became_active":"2024-05-08T18:29:42.574146+0000","last_became_peered":"2024-05-08T18:29:42.574146+0000","last_unstale":"2024-05-08T18:33:09.872452+0000","last_undegraded":"2024-05-08T18:33:09.872452+0000","last_fullsized":"2024-05-08T18:33:09.872452+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2","last_scrub_stamp":"2024-05-08T18:33:09.872256+0000","last_deep_scrub":"80'2","last_deep_scrub_stamp":"2024-05-08T18:33:09.872256+0000","last_clean_scrub_stamp":"2024-05-08T18:33:09.872256+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:30:36.066739+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"116'22","reported_seq":225,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:24.854104+0000","last_change":"2024-05-08T18:33:24.854183+0000","last_active":"2024-05-08T18:33:24.854104+0000","last_peered":"2024-05-08T18:33:24.854104+0000","last_clean":"2024-05-08T18:33:24.854104+0000","last_became_active":"2024-05-08T18:29:40.558819+0000","last_became_peered":"2024-05-08T18:29:40.558819+0000","last_unstale":"2024-05-08T18:33:24.854104+0000","last_undegraded":"2024-05-08T18:33:24.854104+0000","last_fullsized":"2024-05-08T18:33:24.854104+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'22","last_scrub_stamp":"2024-05-08T18:33:24.853877+0000","last_deep_scrub":"116'22","last_deep_scrub_stamp":"2024-05-08T18:33:24.853877+0000","last_clean_scrub_stamp":"2024-05-08T18:33:24.853877+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:17:56.512756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:21.880116+0000","last_change":"2024-05-08T18:33:21.880169+0000","last_active":"2024-05-08T18:33:21.880116+0000","last_peered":"2024-05-08T18:33:21.880116+0000","last_clean":"2024-05-08T18:33:21.880116+0000","last_became_active":"2024-05-08T18:29:44.596111+0000","last_became_peered":"2024-05-08T18:29:44.596111+0000","last_unstale":"2024-05-08T18:33:21.880116+0000","last_undegraded":"2024-05-08T18:33:21.880116+0000","last_fullsized":"2024-05-08T18:33:21.880116+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:21.879917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:21.879917+0000","last_clean_scrub_stamp":"2024-05-08T18:33:21.879917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:21:54.300678+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"116'15","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:15.807678+0000","last_change":"2024-05-08T18:33:15.807752+0000","last_active":"2024-05-08T18:33:15.807678+0000","last_peered":"2024-05-08T18:33:15.807678+0000","last_clean":"2024-05-08T18:33:15.807678+0000","last_became_active":"2024-05-08T18:29:46.607580+0000","last_became_peered":"2024-05-08T18:29:46.607580+0000","last_unstale":"2024-05-08T18:33:15.807678+0000","last_undegraded":"2024-05-08T18:33:15.807678+0000","last_fullsized":"2024-05-08T18:33:15.807678+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'15","last_scrub_stamp":"2024-05-08T18:33:15.807477+0000","last_deep_scrub":"116'15","last_deep_scrub_stamp":"2024-05-08T18:33:15.807477+0000","last_clean_scrub_stamp":"2024-05-08T18:33:15.807477+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:29:42.418270+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"116'106","reported_seq":420,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:32.772140+0000","last_change":"2024-05-08T18:33:32.772213+0000","last_active":"2024-05-08T18:33:32.772140+0000","last_peered":"2024-05-08T18:33:32.772140+0000","last_clean":"2024-05-08T18:33:32.772140+0000","last_became_active":"2024-05-08T18:29:48.641950+0000","last_became_peered":"2024-05-08T18:29:48.641950+0000","last_unstale":"2024-05-08T18:33:32.772140+0000","last_undegraded":"2024-05-08T18:33:32.772140+0000","last_fullsized":"2024-05-08T18:33:32.772140+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'106","last_scrub_stamp":"2024-05-08T18:33:32.771924+0000","last_deep_scrub":"116'106","last_deep_scrub_stamp":"2024-05-08T18:33:32.771924+0000","last_clean_scrub_stamp":"2024-05-08T18:33:32.771924+0000","objects_scrubbed":1,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:12:00.490403+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"84'2","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:35.602397+0000","last_change":"2024-05-08T18:33:35.602461+0000","last_active":"2024-05-08T18:33:35.602397+0000","last_peered":"2024-05-08T18:33:35.602397+0000","last_clean":"2024-05-08T18:33:35.602397+0000","last_became_active":"2024-05-08T18:29:50.659649+0000","last_became_peered":"2024-05-08T18:29:50.659649+0000","last_unstale":"2024-05-08T18:33:35.602397+0000","last_undegraded":"2024-05-08T18:33:35.602397+0000","last_fullsized":"2024-05-08T18:33:35.602397+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'2","last_scrub_stamp":"2024-05-08T18:33:35.602180+0000","last_deep_scrub":"84'2","last_deep_scrub_stamp":"2024-05-08T18:33:35.602180+0000","last_clean_scrub_stamp":"2024-05-08T18:33:35.602180+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:44:39.591161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"80'2","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:13.752038+0000","last_change":"2024-05-08T18:33:13.752106+0000","last_active":"2024-05-08T18:33:13.752038+0000","last_peered":"2024-05-08T18:33:13.752038+0000","last_clean":"2024-05-08T18:33:13.752038+0000","last_became_active":"2024-05-08T18:29:42.576740+0000","last_became_peered":"2024-05-08T18:29:42.576740+0000","last_unstale":"2024-05-08T18:33:13.752038+0000","last_undegraded":"2024-05-08T18:33:13.752038+0000","last_fullsized":"2024-05-08T18:33:13.752038+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2","last_scrub_stamp":"2024-05-08T18:33:13.751819+0000","last_deep_scrub":"80'2","last_deep_scrub_stamp":"2024-05-08T18:33:13.751819+0000","last_clean_scrub_stamp":"2024-05-08T18:33:13.751819+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:59:49.632385+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"116'10","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:13.497002+0000","last_change":"2024-05-08T18:33:13.497066+0000","last_active":"2024-05-08T18:33:13.497002+0000","last_peered":"2024-05-08T18:33:13.497002+0000","last_clean":"2024-05-08T18:33:13.497002+0000","last_became_active":"2024-05-08T18:29:40.545749+0000","last_became_peered":"2024-05-08T18:29:40.545749+0000","last_unstale":"2024-05-08T18:33:13.497002+0000","last_undegraded":"2024-05-08T18:33:13.497002+0000","last_fullsized":"2024-05-08T18:33:13.497002+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'10","last_scrub_stamp":"2024-05-08T18:33:13.496806+0000","last_deep_scrub":"116'10","last_deep_scrub_stamp":"2024-05-08T18:33:13.496806+0000","last_clean_scrub_stamp":"2024-05-08T18:33:13.496806+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:49:28.691835+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":197,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:18.158846+0000","last_change":"2024-05-08T18:33:18.158948+0000","last_active":"2024-05-08T18:33:18.158846+0000","last_peered":"2024-05-08T18:33:18.158846+0000","last_clean":"2024-05-08T18:33:18.158846+0000","last_became_active":"2024-05-08T18:29:44.578142+0000","last_became_peered":"2024-05-08T18:29:44.578142+0000","last_unstale":"2024-05-08T18:33:18.158846+0000","last_undegraded":"2024-05-08T18:33:18.158846+0000","last_fullsized":"2024-05-08T18:33:18.158846+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:18.158547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:18.158547+0000","last_clean_scrub_stamp":"2024-05-08T18:33:18.158547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:28.957097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"116'21","reported_seq":223,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:04.925986+0000","last_change":"2024-05-08T18:33:04.926174+0000","last_active":"2024-05-08T18:33:04.925986+0000","last_peered":"2024-05-08T18:33:04.925986+0000","last_clean":"2024-05-08T18:33:04.925986+0000","last_became_active":"2024-05-08T18:29:46.605154+0000","last_became_peered":"2024-05-08T18:29:46.605154+0000","last_unstale":"2024-05-08T18:33:04.925986+0000","last_undegraded":"2024-05-08T18:33:04.925986+0000","last_fullsized":"2024-05-08T18:33:04.925986+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'21","last_scrub_stamp":"2024-05-08T18:33:04.925757+0000","last_deep_scrub":"116'21","last_deep_scrub_stamp":"2024-05-08T18:33:04.925757+0000","last_clean_scrub_stamp":"2024-05-08T18:33:04.925757+0000","objects_scrubbed":4,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:00:52.304684+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"116'105","reported_seq":338,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:02.698371+0000","last_change":"2024-05-08T18:33:02.698393+0000","last_active":"2024-05-08T18:33:02.698371+0000","last_peered":"2024-05-08T18:33:02.698371+0000","last_clean":"2024-05-08T18:33:02.698371+0000","last_became_active":"2024-05-08T18:29:48.633858+0000","last_became_peered":"2024-05-08T18:29:48.633858+0000","last_unstale":"2024-05-08T18:33:02.698371+0000","last_undegraded":"2024-05-08T18:33:02.698371+0000","last_fullsized":"2024-05-08T18:33:02.698371+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'105","last_scrub_stamp":"2024-05-08T18:33:02.698295+0000","last_deep_scrub":"116'105","last_deep_scrub_stamp":"2024-05-08T18:33:02.698295+0000","last_clean_scrub_stamp":"2024-05-08T18:33:02.698295+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:16:39.917082+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"84'8","reported_seq":221,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:14.196696+0000","last_change":"2024-05-08T18:33:14.196755+0000","last_active":"2024-05-08T18:33:14.196696+0000","last_peered":"2024-05-08T18:33:14.196696+0000","last_clean":"2024-05-08T18:33:14.196696+0000","last_became_active":"2024-05-08T18:29:42.566974+0000","last_became_peered":"2024-05-08T18:29:42.566974+0000","last_unstale":"2024-05-08T18:33:14.196696+0000","last_undegraded":"2024-05-08T18:33:14.196696+0000","last_fullsized":"2024-05-08T18:33:14.196696+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'8","last_scrub_stamp":"2024-05-08T18:33:14.196495+0000","last_deep_scrub":"84'8","last_deep_scrub_stamp":"2024-05-08T18:33:14.196495+0000","last_clean_scrub_stamp":"2024-05-08T18:33:14.196495+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:27:49.937242+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"116'20","reported_seq":223,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:18.798043+0000","last_change":"2024-05-08T18:33:18.798113+0000","last_active":"2024-05-08T18:33:18.798043+0000","last_peered":"2024-05-08T18:33:18.798043+0000","last_clean":"2024-05-08T18:33:18.798043+0000","last_became_active":"2024-05-08T18:29:40.571322+0000","last_became_peered":"2024-05-08T18:29:40.571322+0000","last_unstale":"2024-05-08T18:33:18.798043+0000","last_undegraded":"2024-05-08T18:33:18.798043+0000","last_fullsized":"2024-05-08T18:33:18.798043+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'20","last_scrub_stamp":"2024-05-08T18:33:18.797835+0000","last_deep_scrub":"116'20","last_deep_scrub_stamp":"2024-05-08T18:33:18.797835+0000","last_clean_scrub_stamp":"2024-05-08T18:33:18.797835+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:29.596385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:13.814686+0000","last_change":"2024-05-08T18:33:13.814845+0000","last_active":"2024-05-08T18:33:13.814686+0000","last_peered":"2024-05-08T18:33:13.814686+0000","last_clean":"2024-05-08T18:33:13.814686+0000","last_became_active":"2024-05-08T18:29:44.596282+0000","last_became_peered":"2024-05-08T18:29:44.596282+0000","last_unstale":"2024-05-08T18:33:13.814686+0000","last_undegraded":"2024-05-08T18:33:13.814686+0000","last_fullsized":"2024-05-08T18:33:13.814686+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:13.814456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:13.814456+0000","last_clean_scrub_stamp":"2024-05-08T18:33:13.814456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:22:28.063238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"116'37","reported_seq":246,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:07.224224+0000","last_change":"2024-05-08T18:33:07.224306+0000","last_active":"2024-05-08T18:33:07.224224+0000","last_peered":"2024-05-08T18:33:07.224224+0000","last_clean":"2024-05-08T18:33:07.224224+0000","last_became_active":"2024-05-08T18:29:46.589600+0000","last_became_peered":"2024-05-08T18:29:46.589600+0000","last_unstale":"2024-05-08T18:33:07.224224+0000","last_undegraded":"2024-05-08T18:33:07.224224+0000","last_fullsized":"2024-05-08T18:33:07.224224+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'37","last_scrub_stamp":"2024-05-08T18:33:07.224017+0000","last_deep_scrub":"116'37","last_deep_scrub_stamp":"2024-05-08T18:33:07.224017+0000","last_clean_scrub_stamp":"2024-05-08T18:33:07.224017+0000","objects_scrubbed":9,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:30.816195+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":38,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:12.794921+0000","last_change":"2024-05-08T18:33:12.794980+0000","last_active":"2024-05-08T18:33:12.794921+0000","last_peered":"2024-05-08T18:33:12.794921+0000","last_clean":"2024-05-08T18:33:12.794921+0000","last_became_active":"2024-05-08T18:29:48.630017+0000","last_became_peered":"2024-05-08T18:29:48.630017+0000","last_unstale":"2024-05-08T18:33:12.794921+0000","last_undegraded":"2024-05-08T18:33:12.794921+0000","last_fullsized":"2024-05-08T18:33:12.794921+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:12.794729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:12.794729+0000","last_clean_scrub_stamp":"2024-05-08T18:33:12.794729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:20:16.477743+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"97'14","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:35.194182+0000","last_change":"2024-05-08T18:33:35.194182+0000","last_active":"2024-05-08T18:33:35.194182+0000","last_peered":"2024-05-08T18:33:35.194182+0000","last_clean":"2024-05-08T18:33:35.194182+0000","last_became_active":"2024-05-08T18:29:50.671923+0000","last_became_peered":"2024-05-08T18:29:50.671923+0000","last_unstale":"2024-05-08T18:33:35.194182+0000","last_undegraded":"2024-05-08T18:33:35.194182+0000","last_fullsized":"2024-05-08T18:33:35.194182+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'14","last_scrub_stamp":"2024-05-08T18:33:35.193743+0000","last_deep_scrub":"97'14","last_deep_scrub_stamp":"2024-05-08T18:33:35.193743+0000","last_clean_scrub_stamp":"2024-05-08T18:33:35.193743+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:44:39.182723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":39,"num_write":35,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"80'2","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:29.637016+0000","last_change":"2024-05-08T18:33:29.637105+0000","last_active":"2024-05-08T18:33:29.637016+0000","last_peered":"2024-05-08T18:33:29.637016+0000","last_clean":"2024-05-08T18:33:29.637016+0000","last_became_active":"2024-05-08T18:29:42.553574+0000","last_became_peered":"2024-05-08T18:29:42.553574+0000","last_unstale":"2024-05-08T18:33:29.637016+0000","last_undegraded":"2024-05-08T18:33:29.637016+0000","last_fullsized":"2024-05-08T18:33:29.637016+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2","last_scrub_stamp":"2024-05-08T18:33:29.636811+0000","last_deep_scrub":"80'2","last_deep_scrub_stamp":"2024-05-08T18:33:29.636811+0000","last_clean_scrub_stamp":"2024-05-08T18:33:29.636811+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:09:19.325925+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"116'14","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:25.862988+0000","last_change":"2024-05-08T18:33:25.863116+0000","last_active":"2024-05-08T18:33:25.862988+0000","last_peered":"2024-05-08T18:33:25.862988+0000","last_clean":"2024-05-08T18:33:25.862988+0000","last_became_active":"2024-05-08T18:29:40.569542+0000","last_became_peered":"2024-05-08T18:29:40.569542+0000","last_unstale":"2024-05-08T18:33:25.862988+0000","last_undegraded":"2024-05-08T18:33:25.862988+0000","last_fullsized":"2024-05-08T18:33:25.862988+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'14","last_scrub_stamp":"2024-05-08T18:33:25.862694+0000","last_deep_scrub":"116'14","last_deep_scrub_stamp":"2024-05-08T18:33:25.862694+0000","last_clean_scrub_stamp":"2024-05-08T18:33:25.862694+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:10:45.159561+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"116'2","reported_seq":269,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:02.781390+0000","last_change":"2024-05-08T18:33:02.781414+0000","last_active":"2024-05-08T18:33:02.781390+0000","last_peered":"2024-05-08T18:33:02.781390+0000","last_clean":"2024-05-08T18:33:02.781390+0000","last_became_active":"2024-05-08T18:29:44.579152+0000","last_became_peered":"2024-05-08T18:29:44.579152+0000","last_unstale":"2024-05-08T18:33:02.781390+0000","last_undegraded":"2024-05-08T18:33:02.781390+0000","last_fullsized":"2024-05-08T18:33:02.781390+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'2","last_scrub_stamp":"2024-05-08T18:33:02.781323+0000","last_deep_scrub":"116'2","last_deep_scrub_stamp":"2024-05-08T18:33:02.781323+0000","last_clean_scrub_stamp":"2024-05-08T18:33:02.781323+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:11:25.963703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":103,"num_read_kb":103,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"116'21","reported_seq":226,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:07.809440+0000","last_change":"2024-05-08T18:33:07.809524+0000","last_active":"2024-05-08T18:33:07.809440+0000","last_peered":"2024-05-08T18:33:07.809440+0000","last_clean":"2024-05-08T18:33:07.809440+0000","last_became_active":"2024-05-08T18:29:46.599464+0000","last_became_peered":"2024-05-08T18:29:46.599464+0000","last_unstale":"2024-05-08T18:33:07.809440+0000","last_undegraded":"2024-05-08T18:33:07.809440+0000","last_fullsized":"2024-05-08T18:33:07.809440+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'21","last_scrub_stamp":"2024-05-08T18:33:07.809266+0000","last_deep_scrub":"116'21","last_deep_scrub_stamp":"2024-05-08T18:33:07.809266+0000","last_clean_scrub_stamp":"2024-05-08T18:33:07.809266+0000","objects_scrubbed":4,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:24:13.075844+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.734746+0000","last_change":"2024-05-08T18:33:05.734803+0000","last_active":"2024-05-08T18:33:05.734746+0000","last_peered":"2024-05-08T18:33:05.734746+0000","last_clean":"2024-05-08T18:33:05.734746+0000","last_became_active":"2024-05-08T18:29:48.637231+0000","last_became_peered":"2024-05-08T18:29:48.637231+0000","last_unstale":"2024-05-08T18:33:05.734746+0000","last_undegraded":"2024-05-08T18:33:05.734746+0000","last_fullsized":"2024-05-08T18:33:05.734746+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:05.734539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:05.734539+0000","last_clean_scrub_stamp":"2024-05-08T18:33:05.734539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:46:45.338085+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":184,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:26.801493+0000","last_change":"2024-05-08T18:33:26.801493+0000","last_active":"2024-05-08T18:33:26.801493+0000","last_peered":"2024-05-08T18:33:26.801493+0000","last_clean":"2024-05-08T18:33:26.801493+0000","last_became_active":"2024-05-08T18:29:50.681287+0000","last_became_peered":"2024-05-08T18:29:50.681287+0000","last_unstale":"2024-05-08T18:33:26.801493+0000","last_undegraded":"2024-05-08T18:33:26.801493+0000","last_fullsized":"2024-05-08T18:33:26.801493+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:26.801216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:26.801216+0000","last_clean_scrub_stamp":"2024-05-08T18:33:26.801216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:28:02.541962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:09.637651+0000","last_change":"2024-05-08T18:33:09.637705+0000","last_active":"2024-05-08T18:33:09.637651+0000","last_peered":"2024-05-08T18:33:09.637651+0000","last_clean":"2024-05-08T18:33:09.637651+0000","last_became_active":"2024-05-08T18:29:42.562267+0000","last_became_peered":"2024-05-08T18:29:42.562267+0000","last_unstale":"2024-05-08T18:33:09.637651+0000","last_undegraded":"2024-05-08T18:33:09.637651+0000","last_fullsized":"2024-05-08T18:33:09.637651+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:09.637432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:09.637432+0000","last_clean_scrub_stamp":"2024-05-08T18:33:09.637432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:55:41.051450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"116'14","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:27.929308+0000","last_change":"2024-05-08T18:33:27.929373+0000","last_active":"2024-05-08T18:33:27.929308+0000","last_peered":"2024-05-08T18:33:27.929308+0000","last_clean":"2024-05-08T18:33:27.929308+0000","last_became_active":"2024-05-08T18:29:40.569626+0000","last_became_peered":"2024-05-08T18:29:40.569626+0000","last_unstale":"2024-05-08T18:33:27.929308+0000","last_undegraded":"2024-05-08T18:33:27.929308+0000","last_fullsized":"2024-05-08T18:33:27.929308+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'14","last_scrub_stamp":"2024-05-08T18:33:27.929088+0000","last_deep_scrub":"116'14","last_deep_scrub_stamp":"2024-05-08T18:33:27.929088+0000","last_clean_scrub_stamp":"2024-05-08T18:33:27.929088+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:35:05.483754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"116'2","reported_seq":269,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:01.734830+0000","last_change":"2024-05-08T18:33:01.734888+0000","last_active":"2024-05-08T18:33:01.734830+0000","last_peered":"2024-05-08T18:33:01.734830+0000","last_clean":"2024-05-08T18:33:01.734830+0000","last_became_active":"2024-05-08T18:29:44.581067+0000","last_became_peered":"2024-05-08T18:29:44.581067+0000","last_unstale":"2024-05-08T18:33:01.734830+0000","last_undegraded":"2024-05-08T18:33:01.734830+0000","last_fullsized":"2024-05-08T18:33:01.734830+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'2","last_scrub_stamp":"2024-05-08T18:33:01.734695+0000","last_deep_scrub":"116'2","last_deep_scrub_stamp":"2024-05-08T18:33:01.734695+0000","last_clean_scrub_stamp":"2024-05-08T18:33:01.734695+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:54:31.021761+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":103,"num_read_kb":103,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"116'30","reported_seq":235,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:17.836614+0000","last_change":"2024-05-08T18:33:17.836706+0000","last_active":"2024-05-08T18:33:17.836614+0000","last_peered":"2024-05-08T18:33:17.836614+0000","last_clean":"2024-05-08T18:33:17.836614+0000","last_became_active":"2024-05-08T18:29:46.604966+0000","last_became_peered":"2024-05-08T18:29:46.604966+0000","last_unstale":"2024-05-08T18:33:17.836614+0000","last_undegraded":"2024-05-08T18:33:17.836614+0000","last_fullsized":"2024-05-08T18:33:17.836614+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'30","last_scrub_stamp":"2024-05-08T18:33:17.836365+0000","last_deep_scrub":"116'30","last_deep_scrub_stamp":"2024-05-08T18:33:17.836365+0000","last_clean_scrub_stamp":"2024-05-08T18:33:17.836365+0000","objects_scrubbed":7,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:58:12.818926+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"116'105","reported_seq":338,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:02.926992+0000","last_change":"2024-05-08T18:33:02.927044+0000","last_active":"2024-05-08T18:33:02.926992+0000","last_peered":"2024-05-08T18:33:02.926992+0000","last_clean":"2024-05-08T18:33:02.926992+0000","last_became_active":"2024-05-08T18:29:48.637758+0000","last_became_peered":"2024-05-08T18:29:48.637758+0000","last_unstale":"2024-05-08T18:33:02.926992+0000","last_undegraded":"2024-05-08T18:33:02.926992+0000","last_fullsized":"2024-05-08T18:33:02.926992+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'105","last_scrub_stamp":"2024-05-08T18:33:02.926903+0000","last_deep_scrub":"116'105","last_deep_scrub_stamp":"2024-05-08T18:33:02.926903+0000","last_clean_scrub_stamp":"2024-05-08T18:33:02.926903+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:16:40.145690+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"97'2","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:37.923632+0000","last_change":"2024-05-08T18:33:37.923697+0000","last_active":"2024-05-08T18:33:37.923632+0000","last_peered":"2024-05-08T18:33:37.923632+0000","last_clean":"2024-05-08T18:33:37.923632+0000","last_became_active":"2024-05-08T18:29:50.683738+0000","last_became_peered":"2024-05-08T18:29:50.683738+0000","last_unstale":"2024-05-08T18:33:37.923632+0000","last_undegraded":"2024-05-08T18:33:37.923632+0000","last_fullsized":"2024-05-08T18:33:37.923632+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'2","last_scrub_stamp":"2024-05-08T18:33:37.923404+0000","last_deep_scrub":"97'2","last_deep_scrub_stamp":"2024-05-08T18:33:37.923404+0000","last_clean_scrub_stamp":"2024-05-08T18:33:37.923404+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:32:46.407112+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"84'4","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:13.867910+0000","last_change":"2024-05-08T18:33:13.867977+0000","last_active":"2024-05-08T18:33:13.867910+0000","last_peered":"2024-05-08T18:33:13.867910+0000","last_clean":"2024-05-08T18:33:13.867910+0000","last_became_active":"2024-05-08T18:29:42.568659+0000","last_became_peered":"2024-05-08T18:29:42.568659+0000","last_unstale":"2024-05-08T18:33:13.867910+0000","last_undegraded":"2024-05-08T18:33:13.867910+0000","last_fullsized":"2024-05-08T18:33:13.867910+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'4","last_scrub_stamp":"2024-05-08T18:33:13.867699+0000","last_deep_scrub":"84'4","last_deep_scrub_stamp":"2024-05-08T18:33:13.867699+0000","last_clean_scrub_stamp":"2024-05-08T18:33:13.867699+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:59:49.748265+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"116'14","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:21.202198+0000","last_change":"2024-05-08T18:33:21.202257+0000","last_active":"2024-05-08T18:33:21.202198+0000","last_peered":"2024-05-08T18:33:21.202198+0000","last_clean":"2024-05-08T18:33:21.202198+0000","last_became_active":"2024-05-08T18:29:40.555805+0000","last_became_peered":"2024-05-08T18:29:40.555805+0000","last_unstale":"2024-05-08T18:33:21.202198+0000","last_undegraded":"2024-05-08T18:33:21.202198+0000","last_fullsized":"2024-05-08T18:33:21.202198+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'14","last_scrub_stamp":"2024-05-08T18:33:21.201977+0000","last_deep_scrub":"116'14","last_deep_scrub_stamp":"2024-05-08T18:33:21.201977+0000","last_clean_scrub_stamp":"2024-05-08T18:33:21.201977+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:04:12.285635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":3,"num_write":24,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:04.731843+0000","last_change":"2024-05-08T18:33:04.731900+0000","last_active":"2024-05-08T18:33:04.731843+0000","last_peered":"2024-05-08T18:33:04.731843+0000","last_clean":"2024-05-08T18:33:04.731843+0000","last_became_active":"2024-05-08T18:29:44.573308+0000","last_became_peered":"2024-05-08T18:29:44.573308+0000","last_unstale":"2024-05-08T18:33:04.731843+0000","last_undegraded":"2024-05-08T18:33:04.731843+0000","last_fullsized":"2024-05-08T18:33:04.731843+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:04.731641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:04.731641+0000","last_clean_scrub_stamp":"2024-05-08T18:33:04.731641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:30:20.352782+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"116'33","reported_seq":246,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:22.966261+0000","last_change":"2024-05-08T18:33:22.966338+0000","last_active":"2024-05-08T18:33:22.966261+0000","last_peered":"2024-05-08T18:33:22.966261+0000","last_clean":"2024-05-08T18:33:22.966261+0000","last_became_active":"2024-05-08T18:29:46.594930+0000","last_became_peered":"2024-05-08T18:29:46.594930+0000","last_unstale":"2024-05-08T18:33:22.966261+0000","last_undegraded":"2024-05-08T18:33:22.966261+0000","last_fullsized":"2024-05-08T18:33:22.966261+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'33","last_scrub_stamp":"2024-05-08T18:33:22.966074+0000","last_deep_scrub":"116'33","last_deep_scrub_stamp":"2024-05-08T18:33:22.966074+0000","last_clean_scrub_stamp":"2024-05-08T18:33:22.966074+0000","objects_scrubbed":5,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:24:49.380085+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":28,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:17.773574+0000","last_change":"2024-05-08T18:33:17.773635+0000","last_active":"2024-05-08T18:33:17.773574+0000","last_peered":"2024-05-08T18:33:17.773574+0000","last_clean":"2024-05-08T18:33:17.773574+0000","last_became_active":"2024-05-08T18:29:48.637370+0000","last_became_peered":"2024-05-08T18:29:48.637370+0000","last_unstale":"2024-05-08T18:33:17.773574+0000","last_undegraded":"2024-05-08T18:33:17.773574+0000","last_fullsized":"2024-05-08T18:33:17.773574+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:17.773375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:17.773375+0000","last_clean_scrub_stamp":"2024-05-08T18:33:17.773375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:46.627777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"83'2","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:27.770776+0000","last_change":"2024-05-08T18:33:27.770839+0000","last_active":"2024-05-08T18:33:27.770776+0000","last_peered":"2024-05-08T18:33:27.770776+0000","last_clean":"2024-05-08T18:33:27.770776+0000","last_became_active":"2024-05-08T18:29:50.687960+0000","last_became_peered":"2024-05-08T18:29:50.687960+0000","last_unstale":"2024-05-08T18:33:27.770776+0000","last_undegraded":"2024-05-08T18:33:27.770776+0000","last_fullsized":"2024-05-08T18:33:27.770776+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'2","last_scrub_stamp":"2024-05-08T18:33:27.770549+0000","last_deep_scrub":"83'2","last_deep_scrub_stamp":"2024-05-08T18:33:27.770549+0000","last_clean_scrub_stamp":"2024-05-08T18:33:27.770549+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:48:29.408935+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"97'4","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:22.494045+0000","last_change":"2024-05-08T18:33:22.494107+0000","last_active":"2024-05-08T18:33:22.494045+0000","last_peered":"2024-05-08T18:33:22.494045+0000","last_clean":"2024-05-08T18:33:22.494045+0000","last_became_active":"2024-05-08T18:29:42.557119+0000","last_became_peered":"2024-05-08T18:29:42.557119+0000","last_unstale":"2024-05-08T18:33:22.494045+0000","last_undegraded":"2024-05-08T18:33:22.494045+0000","last_fullsized":"2024-05-08T18:33:22.494045+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'4","last_scrub_stamp":"2024-05-08T18:33:22.493832+0000","last_deep_scrub":"97'4","last_deep_scrub_stamp":"2024-05-08T18:33:22.493832+0000","last_clean_scrub_stamp":"2024-05-08T18:33:22.493832+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:48:24.132218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"116'16","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:27.918684+0000","last_change":"2024-05-08T18:33:27.918811+0000","last_active":"2024-05-08T18:33:27.918684+0000","last_peered":"2024-05-08T18:33:27.918684+0000","last_clean":"2024-05-08T18:33:27.918684+0000","last_became_active":"2024-05-08T18:29:40.544215+0000","last_became_peered":"2024-05-08T18:29:40.544215+0000","last_unstale":"2024-05-08T18:33:27.918684+0000","last_undegraded":"2024-05-08T18:33:27.918684+0000","last_fullsized":"2024-05-08T18:33:27.918684+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'16","last_scrub_stamp":"2024-05-08T18:33:27.918395+0000","last_deep_scrub":"116'16","last_deep_scrub_stamp":"2024-05-08T18:33:27.918395+0000","last_clean_scrub_stamp":"2024-05-08T18:33:27.918395+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:24:20.383836+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:13.851808+0000","last_change":"2024-05-08T18:33:13.851866+0000","last_active":"2024-05-08T18:33:13.851808+0000","last_peered":"2024-05-08T18:33:13.851808+0000","last_clean":"2024-05-08T18:33:13.851808+0000","last_became_active":"2024-05-08T18:29:44.587822+0000","last_became_peered":"2024-05-08T18:29:44.587822+0000","last_unstale":"2024-05-08T18:33:13.851808+0000","last_undegraded":"2024-05-08T18:33:13.851808+0000","last_fullsized":"2024-05-08T18:33:13.851808+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:13.851609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:13.851609+0000","last_clean_scrub_stamp":"2024-05-08T18:33:13.851609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:47.600784+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"116'27","reported_seq":235,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:03.645710+0000","last_change":"2024-05-08T18:33:03.645896+0000","last_active":"2024-05-08T18:33:03.645710+0000","last_peered":"2024-05-08T18:33:03.645710+0000","last_clean":"2024-05-08T18:33:03.645710+0000","last_became_active":"2024-05-08T18:29:46.602801+0000","last_became_peered":"2024-05-08T18:29:46.602801+0000","last_unstale":"2024-05-08T18:33:03.645710+0000","last_undegraded":"2024-05-08T18:33:03.645710+0000","last_fullsized":"2024-05-08T18:33:03.645710+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'27","last_scrub_stamp":"2024-05-08T18:33:03.645488+0000","last_deep_scrub":"116'27","last_deep_scrub_stamp":"2024-05-08T18:33:03.645488+0000","last_clean_scrub_stamp":"2024-05-08T18:33:03.645488+0000","objects_scrubbed":6,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:32.499890+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":30,"num_read_kb":23,"num_write":22,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1318,"num_omap_keys":6,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:33.993231+0000","last_change":"2024-05-08T18:33:33.993286+0000","last_active":"2024-05-08T18:33:33.993231+0000","last_peered":"2024-05-08T18:33:33.993231+0000","last_clean":"2024-05-08T18:33:33.993231+0000","last_became_active":"2024-05-08T18:29:48.641813+0000","last_became_peered":"2024-05-08T18:29:48.641813+0000","last_unstale":"2024-05-08T18:33:33.993231+0000","last_undegraded":"2024-05-08T18:33:33.993231+0000","last_fullsized":"2024-05-08T18:33:33.993231+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:33.993024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:33.993024+0000","last_clean_scrub_stamp":"2024-05-08T18:33:33.993024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:45:03.889770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"80'2","reported_seq":189,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:39.827175+0000","last_change":"2024-05-08T18:33:39.827175+0000","last_active":"2024-05-08T18:33:39.827175+0000","last_peered":"2024-05-08T18:33:39.827175+0000","last_clean":"2024-05-08T18:33:39.827175+0000","last_became_active":"2024-05-08T18:29:50.686739+0000","last_became_peered":"2024-05-08T18:29:50.686739+0000","last_unstale":"2024-05-08T18:33:39.827175+0000","last_undegraded":"2024-05-08T18:33:39.827175+0000","last_fullsized":"2024-05-08T18:33:39.827175+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2","last_scrub_stamp":"2024-05-08T18:33:39.826904+0000","last_deep_scrub":"80'2","last_deep_scrub_stamp":"2024-05-08T18:33:39.826904+0000","last_clean_scrub_stamp":"2024-05-08T18:33:39.826904+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:02.448703+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:28.607424+0000","last_change":"2024-05-08T18:33:28.607482+0000","last_active":"2024-05-08T18:33:28.607424+0000","last_peered":"2024-05-08T18:33:28.607424+0000","last_clean":"2024-05-08T18:33:28.607424+0000","last_became_active":"2024-05-08T18:29:42.551647+0000","last_became_peered":"2024-05-08T18:29:42.551647+0000","last_unstale":"2024-05-08T18:33:28.607424+0000","last_undegraded":"2024-05-08T18:33:28.607424+0000","last_fullsized":"2024-05-08T18:33:28.607424+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:28.607219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:28.607219+0000","last_clean_scrub_stamp":"2024-05-08T18:33:28.607219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:44:38.835851+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"116'16","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:15.522352+0000","last_change":"2024-05-08T18:33:15.522352+0000","last_active":"2024-05-08T18:33:15.522352+0000","last_peered":"2024-05-08T18:33:15.522352+0000","last_clean":"2024-05-08T18:33:15.522352+0000","last_became_active":"2024-05-08T18:29:40.550942+0000","last_became_peered":"2024-05-08T18:29:40.550942+0000","last_unstale":"2024-05-08T18:33:15.522352+0000","last_undegraded":"2024-05-08T18:33:15.522352+0000","last_fullsized":"2024-05-08T18:33:15.522352+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'16","last_scrub_stamp":"2024-05-08T18:33:15.522093+0000","last_deep_scrub":"116'16","last_deep_scrub_stamp":"2024-05-08T18:33:15.522093+0000","last_clean_scrub_stamp":"2024-05-08T18:33:15.522093+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:21:41.818141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:00.876238+0000","last_change":"2024-05-08T18:33:00.876275+0000","last_active":"2024-05-08T18:33:00.876238+0000","last_peered":"2024-05-08T18:33:00.876238+0000","last_clean":"2024-05-08T18:33:00.876238+0000","last_became_active":"2024-05-08T18:29:44.593242+0000","last_became_peered":"2024-05-08T18:29:44.593242+0000","last_unstale":"2024-05-08T18:33:00.876238+0000","last_undegraded":"2024-05-08T18:33:00.876238+0000","last_fullsized":"2024-05-08T18:33:00.876238+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:00.876136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:00.876136+0000","last_clean_scrub_stamp":"2024-05-08T18:33:00.876136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:46.560199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"116'32","reported_seq":240,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:14.840057+0000","last_change":"2024-05-08T18:33:14.840151+0000","last_active":"2024-05-08T18:33:14.840057+0000","last_peered":"2024-05-08T18:33:14.840057+0000","last_clean":"2024-05-08T18:33:14.840057+0000","last_became_active":"2024-05-08T18:29:46.588784+0000","last_became_peered":"2024-05-08T18:29:46.588784+0000","last_unstale":"2024-05-08T18:33:14.840057+0000","last_undegraded":"2024-05-08T18:33:14.840057+0000","last_fullsized":"2024-05-08T18:33:14.840057+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'32","last_scrub_stamp":"2024-05-08T18:33:14.839870+0000","last_deep_scrub":"116'32","last_deep_scrub_stamp":"2024-05-08T18:33:14.839870+0000","last_clean_scrub_stamp":"2024-05-08T18:33:14.839870+0000","objects_scrubbed":8,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:02:08.637757+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":35,"num_read_kb":26,"num_write":24,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1344,"num_omap_keys":6,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"116'105","reported_seq":350,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:16.815313+0000","last_change":"2024-05-08T18:33:16.815379+0000","last_active":"2024-05-08T18:33:16.815313+0000","last_peered":"2024-05-08T18:33:16.815313+0000","last_clean":"2024-05-08T18:33:16.815313+0000","last_became_active":"2024-05-08T18:29:48.630229+0000","last_became_peered":"2024-05-08T18:29:48.630229+0000","last_unstale":"2024-05-08T18:33:16.815313+0000","last_undegraded":"2024-05-08T18:33:16.815313+0000","last_fullsized":"2024-05-08T18:33:16.815313+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'105","last_scrub_stamp":"2024-05-08T18:33:16.815131+0000","last_deep_scrub":"116'105","last_deep_scrub_stamp":"2024-05-08T18:33:16.815131+0000","last_clean_scrub_stamp":"2024-05-08T18:33:16.815131+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:34:12.059461+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":189,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:25.769993+0000","last_change":"2024-05-08T18:33:25.769993+0000","last_active":"2024-05-08T18:33:25.769993+0000","last_peered":"2024-05-08T18:33:25.769993+0000","last_clean":"2024-05-08T18:33:25.769993+0000","last_became_active":"2024-05-08T18:29:50.674292+0000","last_became_peered":"2024-05-08T18:29:50.674292+0000","last_unstale":"2024-05-08T18:33:25.769993+0000","last_undegraded":"2024-05-08T18:33:25.769993+0000","last_fullsized":"2024-05-08T18:33:25.769993+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:25.769711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:25.769711+0000","last_clean_scrub_stamp":"2024-05-08T18:33:25.769711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:56.556666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"84'4","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:15.480780+0000","last_change":"2024-05-08T18:33:15.480844+0000","last_active":"2024-05-08T18:33:15.480780+0000","last_peered":"2024-05-08T18:33:15.480780+0000","last_clean":"2024-05-08T18:33:15.480780+0000","last_became_active":"2024-05-08T18:29:42.579059+0000","last_became_peered":"2024-05-08T18:29:42.579059+0000","last_unstale":"2024-05-08T18:33:15.480780+0000","last_undegraded":"2024-05-08T18:33:15.480780+0000","last_fullsized":"2024-05-08T18:33:15.480780+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'4","last_scrub_stamp":"2024-05-08T18:33:15.480579+0000","last_deep_scrub":"84'4","last_deep_scrub_stamp":"2024-05-08T18:33:15.480579+0000","last_clean_scrub_stamp":"2024-05-08T18:33:15.480579+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:10:20.075727+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"116'16","reported_seq":226,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:25.505749+0000","last_change":"2024-05-08T18:33:25.505749+0000","last_active":"2024-05-08T18:33:25.505749+0000","last_peered":"2024-05-08T18:33:25.505749+0000","last_clean":"2024-05-08T18:33:25.505749+0000","last_became_active":"2024-05-08T18:29:40.554594+0000","last_became_peered":"2024-05-08T18:29:40.554594+0000","last_unstale":"2024-05-08T18:33:25.505749+0000","last_undegraded":"2024-05-08T18:33:25.505749+0000","last_fullsized":"2024-05-08T18:33:25.505749+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'16","last_scrub_stamp":"2024-05-08T18:33:25.505479+0000","last_deep_scrub":"116'16","last_deep_scrub_stamp":"2024-05-08T18:33:25.505479+0000","last_clean_scrub_stamp":"2024-05-08T18:33:25.505479+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:10:44.802346+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4,"num_write":26,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"116'4","reported_seq":339,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:20.169768+0000","last_change":"2024-05-08T18:33:20.169842+0000","last_active":"2024-05-08T18:33:20.169768+0000","last_peered":"2024-05-08T18:33:20.169768+0000","last_clean":"2024-05-08T18:33:20.169768+0000","last_became_active":"2024-05-08T18:29:44.581699+0000","last_became_peered":"2024-05-08T18:29:44.581699+0000","last_unstale":"2024-05-08T18:33:20.169768+0000","last_undegraded":"2024-05-08T18:33:20.169768+0000","last_fullsized":"2024-05-08T18:33:20.169768+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'4","last_scrub_stamp":"2024-05-08T18:33:20.169559+0000","last_deep_scrub":"116'4","last_deep_scrub_stamp":"2024-05-08T18:33:20.169559+0000","last_clean_scrub_stamp":"2024-05-08T18:33:20.169559+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:50.956515+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":138,"num_read_kb":138,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"116'15","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:25.874423+0000","last_change":"2024-05-08T18:33:25.874494+0000","last_active":"2024-05-08T18:33:25.874423+0000","last_peered":"2024-05-08T18:33:25.874423+0000","last_clean":"2024-05-08T18:33:25.874423+0000","last_became_active":"2024-05-08T18:29:46.590087+0000","last_became_peered":"2024-05-08T18:29:46.590087+0000","last_unstale":"2024-05-08T18:33:25.874423+0000","last_undegraded":"2024-05-08T18:33:25.874423+0000","last_fullsized":"2024-05-08T18:33:25.874423+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'15","last_scrub_stamp":"2024-05-08T18:33:25.874218+0000","last_deep_scrub":"116'15","last_deep_scrub_stamp":"2024-05-08T18:33:25.874218+0000","last_clean_scrub_stamp":"2024-05-08T18:33:25.874218+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:32:13.833139+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"116'105","reported_seq":374,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:21.713161+0000","last_change":"2024-05-08T18:33:21.713229+0000","last_active":"2024-05-08T18:33:21.713161+0000","last_peered":"2024-05-08T18:33:21.713161+0000","last_clean":"2024-05-08T18:33:21.713161+0000","last_became_active":"2024-05-08T18:29:48.634801+0000","last_became_peered":"2024-05-08T18:29:48.634801+0000","last_unstale":"2024-05-08T18:33:21.713161+0000","last_undegraded":"2024-05-08T18:33:21.713161+0000","last_fullsized":"2024-05-08T18:33:21.713161+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'105","last_scrub_stamp":"2024-05-08T18:33:21.712967+0000","last_deep_scrub":"116'105","last_deep_scrub_stamp":"2024-05-08T18:33:21.712967+0000","last_clean_scrub_stamp":"2024-05-08T18:33:21.712967+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:17:32.267716+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":189,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:37.617326+0000","last_change":"2024-05-08T18:33:37.617326+0000","last_active":"2024-05-08T18:33:37.617326+0000","last_peered":"2024-05-08T18:33:37.617326+0000","last_clean":"2024-05-08T18:33:37.617326+0000","last_became_active":"2024-05-08T18:29:50.667536+0000","last_became_peered":"2024-05-08T18:29:50.667536+0000","last_unstale":"2024-05-08T18:33:37.617326+0000","last_undegraded":"2024-05-08T18:33:37.617326+0000","last_fullsized":"2024-05-08T18:33:37.617326+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:37.617077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:37.617077+0000","last_clean_scrub_stamp":"2024-05-08T18:33:37.617077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:50:51.365977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"97'14","reported_seq":233,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:21.769433+0000","last_change":"2024-05-08T18:33:21.769517+0000","last_active":"2024-05-08T18:33:21.769433+0000","last_peered":"2024-05-08T18:33:21.769433+0000","last_clean":"2024-05-08T18:33:21.769433+0000","last_became_active":"2024-05-08T18:29:42.563416+0000","last_became_peered":"2024-05-08T18:29:42.563416+0000","last_unstale":"2024-05-08T18:33:21.769433+0000","last_undegraded":"2024-05-08T18:33:21.769433+0000","last_fullsized":"2024-05-08T18:33:21.769433+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'14","last_scrub_stamp":"2024-05-08T18:33:21.769214+0000","last_deep_scrub":"97'14","last_deep_scrub_stamp":"2024-05-08T18:33:21.769214+0000","last_clean_scrub_stamp":"2024-05-08T18:33:21.769214+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:35:44.505251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"116'24","reported_seq":231,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:29.863866+0000","last_change":"2024-05-08T18:33:29.863866+0000","last_active":"2024-05-08T18:33:29.863866+0000","last_peered":"2024-05-08T18:33:29.863866+0000","last_clean":"2024-05-08T18:33:29.863866+0000","last_became_active":"2024-05-08T18:29:40.548591+0000","last_became_peered":"2024-05-08T18:29:40.548591+0000","last_unstale":"2024-05-08T18:33:29.863866+0000","last_undegraded":"2024-05-08T18:33:29.863866+0000","last_fullsized":"2024-05-08T18:33:29.863866+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'24","last_scrub_stamp":"2024-05-08T18:33:29.863468+0000","last_deep_scrub":"116'24","last_deep_scrub_stamp":"2024-05-08T18:33:29.863468+0000","last_clean_scrub_stamp":"2024-05-08T18:33:29.863468+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:22:33.938003+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":24,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:21.515577+0000","last_change":"2024-05-08T18:33:21.515638+0000","last_active":"2024-05-08T18:33:21.515577+0000","last_peered":"2024-05-08T18:33:21.515577+0000","last_clean":"2024-05-08T18:33:21.515577+0000","last_became_active":"2024-05-08T18:29:44.581832+0000","last_became_peered":"2024-05-08T18:29:44.581832+0000","last_unstale":"2024-05-08T18:33:21.515577+0000","last_undegraded":"2024-05-08T18:33:21.515577+0000","last_fullsized":"2024-05-08T18:33:21.515577+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:21.515374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:21.515374+0000","last_clean_scrub_stamp":"2024-05-08T18:33:21.515374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:04:12.599031+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"116'33","reported_seq":241,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:04.133658+0000","last_change":"2024-05-08T18:33:04.133740+0000","last_active":"2024-05-08T18:33:04.133658+0000","last_peered":"2024-05-08T18:33:04.133658+0000","last_clean":"2024-05-08T18:33:04.133658+0000","last_became_active":"2024-05-08T18:29:46.601740+0000","last_became_peered":"2024-05-08T18:29:46.601740+0000","last_unstale":"2024-05-08T18:33:04.133658+0000","last_undegraded":"2024-05-08T18:33:04.133658+0000","last_fullsized":"2024-05-08T18:33:04.133658+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'33","last_scrub_stamp":"2024-05-08T18:33:04.133452+0000","last_deep_scrub":"116'33","last_deep_scrub_stamp":"2024-05-08T18:33:04.133452+0000","last_clean_scrub_stamp":"2024-05-08T18:33:04.133452+0000","objects_scrubbed":8,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:09.047282+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":35,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":187,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:24.757341+0000","last_change":"2024-05-08T18:33:24.757392+0000","last_active":"2024-05-08T18:33:24.757341+0000","last_peered":"2024-05-08T18:33:24.757341+0000","last_clean":"2024-05-08T18:33:24.757341+0000","last_became_active":"2024-05-08T18:29:48.639309+0000","last_became_peered":"2024-05-08T18:29:48.639309+0000","last_unstale":"2024-05-08T18:33:24.757341+0000","last_undegraded":"2024-05-08T18:33:24.757341+0000","last_fullsized":"2024-05-08T18:33:24.757341+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:24.757186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:24.757186+0000","last_clean_scrub_stamp":"2024-05-08T18:33:24.757186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:00:05.716237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":189,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:24.776636+0000","last_change":"2024-05-08T18:33:24.776636+0000","last_active":"2024-05-08T18:33:24.776636+0000","last_peered":"2024-05-08T18:33:24.776636+0000","last_clean":"2024-05-08T18:33:24.776636+0000","last_became_active":"2024-05-08T18:29:50.667636+0000","last_became_peered":"2024-05-08T18:29:50.667636+0000","last_unstale":"2024-05-08T18:33:24.776636+0000","last_undegraded":"2024-05-08T18:33:24.776636+0000","last_fullsized":"2024-05-08T18:33:24.776636+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:24.776214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:24.776214+0000","last_clean_scrub_stamp":"2024-05-08T18:33:24.776214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:11:24.497988+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"97'4","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:03.641202+0000","last_change":"2024-05-08T18:33:03.641202+0000","last_active":"2024-05-08T18:33:03.641202+0000","last_peered":"2024-05-08T18:33:03.641202+0000","last_clean":"2024-05-08T18:33:03.641202+0000","last_became_active":"2024-05-08T18:29:42.583639+0000","last_became_peered":"2024-05-08T18:29:42.583639+0000","last_unstale":"2024-05-08T18:33:03.641202+0000","last_undegraded":"2024-05-08T18:33:03.641202+0000","last_fullsized":"2024-05-08T18:33:03.641202+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'4","last_scrub_stamp":"2024-05-08T18:33:03.640783+0000","last_deep_scrub":"97'4","last_deep_scrub_stamp":"2024-05-08T18:33:03.640783+0000","last_clean_scrub_stamp":"2024-05-08T18:33:03.640783+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:40:41.107541+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"116'74","reported_seq":308,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:21.807158+0000","last_change":"2024-05-08T18:33:21.807158+0000","last_active":"2024-05-08T18:33:21.807158+0000","last_peered":"2024-05-08T18:33:21.807158+0000","last_clean":"2024-05-08T18:33:21.807158+0000","last_became_active":"2024-05-08T18:29:27.112960+0000","last_became_peered":"2024-05-08T18:29:27.112960+0000","last_unstale":"2024-05-08T18:33:21.807158+0000","last_undegraded":"2024-05-08T18:33:21.807158+0000","last_fullsized":"2024-05-08T18:33:21.807158+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'74","last_scrub_stamp":"2024-05-08T18:33:21.806891+0000","last_deep_scrub":"116'74","last_deep_scrub_stamp":"2024-05-08T18:33:21.806891+0000","last_clean_scrub_stamp":"2024-05-08T18:33:21.806891+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:04:12.890549+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:24.138747+0000","last_change":"2024-05-08T18:33:24.138747+0000","last_active":"2024-05-08T18:33:24.138747+0000","last_peered":"2024-05-08T18:33:24.138747+0000","last_clean":"2024-05-08T18:33:24.138747+0000","last_became_active":"2024-05-08T18:29:34.495632+0000","last_became_peered":"2024-05-08T18:29:34.495632+0000","last_unstale":"2024-05-08T18:33:24.138747+0000","last_undegraded":"2024-05-08T18:33:24.138747+0000","last_fullsized":"2024-05-08T18:33:24.138747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:24.138488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:24.138488+0000","last_clean_scrub_stamp":"2024-05-08T18:33:24.138488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:25:24.580041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"116'10","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:41.803950+0000","last_change":"2024-05-08T18:33:41.803950+0000","last_active":"2024-05-08T18:33:41.803950+0000","last_peered":"2024-05-08T18:33:41.803950+0000","last_clean":"2024-05-08T18:33:41.803950+0000","last_became_active":"2024-05-08T18:30:20.849160+0000","last_became_peered":"2024-05-08T18:30:20.849160+0000","last_unstale":"2024-05-08T18:33:41.803950+0000","last_undegraded":"2024-05-08T18:33:41.803950+0000","last_fullsized":"2024-05-08T18:33:41.803950+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'10","last_scrub_stamp":"2024-05-08T18:33:41.803689+0000","last_deep_scrub":"116'10","last_deep_scrub_stamp":"2024-05-08T18:33:41.803689+0000","last_clean_scrub_stamp":"2024-05-08T18:33:41.803689+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:50:19.460913+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":196,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:07.951294+0000","last_change":"2024-05-08T18:33:07.951294+0000","last_active":"2024-05-08T18:33:07.951294+0000","last_peered":"2024-05-08T18:33:07.951294+0000","last_clean":"2024-05-08T18:33:07.951294+0000","last_became_active":"2024-05-08T18:29:44.587855+0000","last_became_peered":"2024-05-08T18:29:44.587855+0000","last_unstale":"2024-05-08T18:33:07.951294+0000","last_undegraded":"2024-05-08T18:33:07.951294+0000","last_fullsized":"2024-05-08T18:33:07.951294+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:07.951044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:07.951044+0000","last_clean_scrub_stamp":"2024-05-08T18:33:07.951044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:20:11.634058+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"116'46","reported_seq":265,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.166142+0000","last_change":"2024-05-08T18:33:05.166233+0000","last_active":"2024-05-08T18:33:05.166142+0000","last_peered":"2024-05-08T18:33:05.166142+0000","last_clean":"2024-05-08T18:33:05.166142+0000","last_became_active":"2024-05-08T18:29:46.594573+0000","last_became_peered":"2024-05-08T18:29:46.594573+0000","last_unstale":"2024-05-08T18:33:05.166142+0000","last_undegraded":"2024-05-08T18:33:05.166142+0000","last_fullsized":"2024-05-08T18:33:05.166142+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'46","last_scrub_stamp":"2024-05-08T18:33:05.165944+0000","last_deep_scrub":"116'46","last_deep_scrub_stamp":"2024-05-08T18:33:05.165944+0000","last_clean_scrub_stamp":"2024-05-08T18:33:05.165944+0000","objects_scrubbed":5,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:39:59.017926+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8302,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":58,"num_read_kb":181,"num_write":30,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:01.958893+0000","last_change":"2024-05-08T18:33:01.958941+0000","last_active":"2024-05-08T18:33:01.958893+0000","last_peered":"2024-05-08T18:33:01.958893+0000","last_clean":"2024-05-08T18:33:01.958893+0000","last_became_active":"2024-05-08T18:29:48.631481+0000","last_became_peered":"2024-05-08T18:29:48.631481+0000","last_unstale":"2024-05-08T18:33:01.958893+0000","last_undegraded":"2024-05-08T18:33:01.958893+0000","last_fullsized":"2024-05-08T18:33:01.958893+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:01.958729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:01.958729+0000","last_clean_scrub_stamp":"2024-05-08T18:33:01.958729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:35:11.554040+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"80'2","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:25.760858+0000","last_change":"2024-05-08T18:33:25.760924+0000","last_active":"2024-05-08T18:33:25.760858+0000","last_peered":"2024-05-08T18:33:25.760858+0000","last_clean":"2024-05-08T18:33:25.760858+0000","last_became_active":"2024-05-08T18:29:50.674526+0000","last_became_peered":"2024-05-08T18:29:50.674526+0000","last_unstale":"2024-05-08T18:33:25.760858+0000","last_undegraded":"2024-05-08T18:33:25.760858+0000","last_fullsized":"2024-05-08T18:33:25.760858+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2","last_scrub_stamp":"2024-05-08T18:33:25.760643+0000","last_deep_scrub":"80'2","last_deep_scrub_stamp":"2024-05-08T18:33:25.760643+0000","last_clean_scrub_stamp":"2024-05-08T18:33:25.760643+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:22:40.009425+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"84'4","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:15.893416+0000","last_change":"2024-05-08T18:33:15.893484+0000","last_active":"2024-05-08T18:33:15.893416+0000","last_peered":"2024-05-08T18:33:15.893416+0000","last_clean":"2024-05-08T18:33:15.893416+0000","last_became_active":"2024-05-08T18:29:42.568244+0000","last_became_peered":"2024-05-08T18:29:42.568244+0000","last_unstale":"2024-05-08T18:33:15.893416+0000","last_undegraded":"2024-05-08T18:33:15.893416+0000","last_fullsized":"2024-05-08T18:33:15.893416+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'4","last_scrub_stamp":"2024-05-08T18:33:15.893221+0000","last_deep_scrub":"84'4","last_deep_scrub_stamp":"2024-05-08T18:33:15.893221+0000","last_clean_scrub_stamp":"2024-05-08T18:33:15.893221+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:07:54.051709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:22.833090+0000","last_change":"2024-05-08T18:33:22.833090+0000","last_active":"2024-05-08T18:33:22.833090+0000","last_peered":"2024-05-08T18:33:22.833090+0000","last_clean":"2024-05-08T18:33:22.833090+0000","last_became_active":"2024-05-08T18:29:34.495812+0000","last_became_peered":"2024-05-08T18:29:34.495812+0000","last_unstale":"2024-05-08T18:33:22.833090+0000","last_undegraded":"2024-05-08T18:33:22.833090+0000","last_fullsized":"2024-05-08T18:33:22.833090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:22.832836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:22.832836+0000","last_clean_scrub_stamp":"2024-05-08T18:33:22.832836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:48:24.471222+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"116'14","reported_seq":221,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:32.058411+0000","last_change":"2024-05-08T18:33:32.058411+0000","last_active":"2024-05-08T18:33:32.058411+0000","last_peered":"2024-05-08T18:33:32.058411+0000","last_clean":"2024-05-08T18:33:32.058411+0000","last_became_active":"2024-05-08T18:29:40.560296+0000","last_became_peered":"2024-05-08T18:29:40.560296+0000","last_unstale":"2024-05-08T18:33:32.058411+0000","last_undegraded":"2024-05-08T18:33:32.058411+0000","last_fullsized":"2024-05-08T18:33:32.058411+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'14","last_scrub_stamp":"2024-05-08T18:33:32.058121+0000","last_deep_scrub":"116'14","last_deep_scrub_stamp":"2024-05-08T18:33:32.058121+0000","last_clean_scrub_stamp":"2024-05-08T18:33:32.058121+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:33:41.442244+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":197,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:32.161002+0000","last_change":"2024-05-08T18:33:32.161058+0000","last_active":"2024-05-08T18:33:32.161002+0000","last_peered":"2024-05-08T18:33:32.161002+0000","last_clean":"2024-05-08T18:33:32.161002+0000","last_became_active":"2024-05-08T18:29:44.593917+0000","last_became_peered":"2024-05-08T18:29:44.593917+0000","last_unstale":"2024-05-08T18:33:32.161002+0000","last_undegraded":"2024-05-08T18:33:32.161002+0000","last_fullsized":"2024-05-08T18:33:32.161002+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:32.160799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:32.160799+0000","last_clean_scrub_stamp":"2024-05-08T18:33:32.160799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:11:59.879277+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"116'127","reported_seq":425,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.910796+0000","last_change":"2024-05-08T18:33:06.910796+0000","last_active":"2024-05-08T18:33:06.910796+0000","last_peered":"2024-05-08T18:33:06.910796+0000","last_clean":"2024-05-08T18:33:06.910796+0000","last_became_active":"2024-05-08T18:29:46.594789+0000","last_became_peered":"2024-05-08T18:29:46.594789+0000","last_unstale":"2024-05-08T18:33:06.910796+0000","last_undegraded":"2024-05-08T18:33:06.910796+0000","last_fullsized":"2024-05-08T18:33:06.910796+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'127","last_scrub_stamp":"2024-05-08T18:33:06.910514+0000","last_deep_scrub":"116'127","last_deep_scrub_stamp":"2024-05-08T18:33:06.910514+0000","last_clean_scrub_stamp":"2024-05-08T18:33:06.910514+0000","objects_scrubbed":10,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:34:02.154843+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4344,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":167,"num_read_kb":168,"num_write":36,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:30.833562+0000","last_change":"2024-05-08T18:33:30.833562+0000","last_active":"2024-05-08T18:33:30.833562+0000","last_peered":"2024-05-08T18:33:30.833562+0000","last_clean":"2024-05-08T18:33:30.833562+0000","last_became_active":"2024-05-08T18:29:48.634044+0000","last_became_peered":"2024-05-08T18:29:48.634044+0000","last_unstale":"2024-05-08T18:33:30.833562+0000","last_undegraded":"2024-05-08T18:33:30.833562+0000","last_fullsized":"2024-05-08T18:33:30.833562+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:30.833306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:30.833306+0000","last_clean_scrub_stamp":"2024-05-08T18:33:30.833306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:23:28.397881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:26.799492+0000","last_change":"2024-05-08T18:33:26.799545+0000","last_active":"2024-05-08T18:33:26.799492+0000","last_peered":"2024-05-08T18:33:26.799492+0000","last_clean":"2024-05-08T18:33:26.799492+0000","last_became_active":"2024-05-08T18:29:50.675770+0000","last_became_peered":"2024-05-08T18:29:50.675770+0000","last_unstale":"2024-05-08T18:33:26.799492+0000","last_undegraded":"2024-05-08T18:33:26.799492+0000","last_fullsized":"2024-05-08T18:33:26.799492+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:26.799261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:26.799261+0000","last_clean_scrub_stamp":"2024-05-08T18:33:26.799261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:04:17.882918+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:07.905828+0000","last_change":"2024-05-08T18:33:07.905974+0000","last_active":"2024-05-08T18:33:07.905828+0000","last_peered":"2024-05-08T18:33:07.905828+0000","last_clean":"2024-05-08T18:33:07.905828+0000","last_became_active":"2024-05-08T18:29:42.573621+0000","last_became_peered":"2024-05-08T18:29:42.573621+0000","last_unstale":"2024-05-08T18:33:07.905828+0000","last_undegraded":"2024-05-08T18:33:07.905828+0000","last_fullsized":"2024-05-08T18:33:07.905828+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:07.905533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:07.905533+0000","last_clean_scrub_stamp":"2024-05-08T18:33:07.905533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:36.759934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.762460+0000","last_change":"2024-05-08T18:33:05.762460+0000","last_active":"2024-05-08T18:33:05.762460+0000","last_peered":"2024-05-08T18:33:05.762460+0000","last_clean":"2024-05-08T18:33:05.762460+0000","last_became_active":"2024-05-08T18:29:34.490717+0000","last_became_peered":"2024-05-08T18:29:34.490717+0000","last_unstale":"2024-05-08T18:33:05.762460+0000","last_undegraded":"2024-05-08T18:33:05.762460+0000","last_fullsized":"2024-05-08T18:33:05.762460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:05.762206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:05.762206+0000","last_clean_scrub_stamp":"2024-05-08T18:33:05.762206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:40:43.228963+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"116'24","reported_seq":233,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:16.780996+0000","last_change":"2024-05-08T18:33:16.780996+0000","last_active":"2024-05-08T18:33:16.780996+0000","last_peered":"2024-05-08T18:33:16.780996+0000","last_clean":"2024-05-08T18:33:16.780996+0000","last_became_active":"2024-05-08T18:29:40.529804+0000","last_became_peered":"2024-05-08T18:29:40.529804+0000","last_unstale":"2024-05-08T18:33:16.780996+0000","last_undegraded":"2024-05-08T18:33:16.780996+0000","last_fullsized":"2024-05-08T18:33:16.780996+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'24","last_scrub_stamp":"2024-05-08T18:33:16.780599+0000","last_deep_scrub":"116'24","last_deep_scrub_stamp":"2024-05-08T18:33:16.780599+0000","last_clean_scrub_stamp":"2024-05-08T18:33:16.780599+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:04:25.215108+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":24,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"116'2","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:03.762329+0000","last_change":"2024-05-08T18:33:03.762464+0000","last_active":"2024-05-08T18:33:03.762329+0000","last_peered":"2024-05-08T18:33:03.762329+0000","last_clean":"2024-05-08T18:33:03.762329+0000","last_became_active":"2024-05-08T18:29:44.584227+0000","last_became_peered":"2024-05-08T18:29:44.584227+0000","last_unstale":"2024-05-08T18:33:03.762329+0000","last_undegraded":"2024-05-08T18:33:03.762329+0000","last_fullsized":"2024-05-08T18:33:03.762329+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'2","last_scrub_stamp":"2024-05-08T18:33:03.762127+0000","last_deep_scrub":"116'2","last_deep_scrub_stamp":"2024-05-08T18:33:03.762127+0000","last_clean_scrub_stamp":"2024-05-08T18:33:03.762127+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:43:25.087022+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"116'23","reported_seq":258,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:03.913151+0000","last_change":"2024-05-08T18:33:03.913151+0000","last_active":"2024-05-08T18:33:03.913151+0000","last_peered":"2024-05-08T18:33:03.913151+0000","last_clean":"2024-05-08T18:33:03.913151+0000","last_became_active":"2024-05-08T18:29:46.607989+0000","last_became_peered":"2024-05-08T18:29:46.607989+0000","last_unstale":"2024-05-08T18:33:03.913151+0000","last_undegraded":"2024-05-08T18:33:03.913151+0000","last_fullsized":"2024-05-08T18:33:03.913151+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'23","last_scrub_stamp":"2024-05-08T18:33:03.912858+0000","last_deep_scrub":"116'23","last_deep_scrub_stamp":"2024-05-08T18:33:03.912858+0000","last_clean_scrub_stamp":"2024-05-08T18:33:03.912858+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:15:32.767259+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:04.841837+0000","last_change":"2024-05-08T18:33:04.841837+0000","last_active":"2024-05-08T18:33:04.841837+0000","last_peered":"2024-05-08T18:33:04.841837+0000","last_clean":"2024-05-08T18:33:04.841837+0000","last_became_active":"2024-05-08T18:29:48.624545+0000","last_became_peered":"2024-05-08T18:29:48.624545+0000","last_unstale":"2024-05-08T18:33:04.841837+0000","last_undegraded":"2024-05-08T18:33:04.841837+0000","last_fullsized":"2024-05-08T18:33:04.841837+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:04.841580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:04.841580+0000","last_clean_scrub_stamp":"2024-05-08T18:33:04.841580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:09:10.449385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"84'12","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:38.871688+0000","last_change":"2024-05-08T18:33:38.871754+0000","last_active":"2024-05-08T18:33:38.871688+0000","last_peered":"2024-05-08T18:33:38.871688+0000","last_clean":"2024-05-08T18:33:38.871688+0000","last_became_active":"2024-05-08T18:29:50.687978+0000","last_became_peered":"2024-05-08T18:29:50.687978+0000","last_unstale":"2024-05-08T18:33:38.871688+0000","last_undegraded":"2024-05-08T18:33:38.871688+0000","last_fullsized":"2024-05-08T18:33:38.871688+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'12","last_scrub_stamp":"2024-05-08T18:33:38.871479+0000","last_deep_scrub":"84'12","last_deep_scrub_stamp":"2024-05-08T18:33:38.871479+0000","last_clean_scrub_stamp":"2024-05-08T18:33:38.871479+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:11:18.000684+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":42,"num_write":31,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"84'4","reported_seq":220,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:29.767395+0000","last_change":"2024-05-08T18:33:29.767395+0000","last_active":"2024-05-08T18:33:29.767395+0000","last_peered":"2024-05-08T18:33:29.767395+0000","last_clean":"2024-05-08T18:33:29.767395+0000","last_became_active":"2024-05-08T18:31:22.008342+0000","last_became_peered":"2024-05-08T18:31:22.008342+0000","last_unstale":"2024-05-08T18:33:29.767395+0000","last_undegraded":"2024-05-08T18:33:29.767395+0000","last_fullsized":"2024-05-08T18:33:29.767395+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'4","last_scrub_stamp":"2024-05-08T18:33:29.766970+0000","last_deep_scrub":"84'4","last_deep_scrub_stamp":"2024-05-08T18:33:29.766970+0000","last_clean_scrub_stamp":"2024-05-08T18:33:29.766970+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:18:01.425849+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:25.155068+0000","last_change":"2024-05-08T18:33:25.155068+0000","last_active":"2024-05-08T18:33:25.155068+0000","last_peered":"2024-05-08T18:33:25.155068+0000","last_clean":"2024-05-08T18:33:25.155068+0000","last_became_active":"2024-05-08T18:29:34.495882+0000","last_became_peered":"2024-05-08T18:29:34.495882+0000","last_unstale":"2024-05-08T18:33:25.155068+0000","last_undegraded":"2024-05-08T18:33:25.155068+0000","last_fullsized":"2024-05-08T18:33:25.155068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:25.154824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:25.154824+0000","last_clean_scrub_stamp":"2024-05-08T18:33:25.154824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:10:44.451691+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"116'16","reported_seq":225,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:24.553297+0000","last_change":"2024-05-08T18:33:24.553297+0000","last_active":"2024-05-08T18:33:24.553297+0000","last_peered":"2024-05-08T18:33:24.553297+0000","last_clean":"2024-05-08T18:33:24.553297+0000","last_became_active":"2024-05-08T18:29:40.553527+0000","last_became_peered":"2024-05-08T18:29:40.553527+0000","last_unstale":"2024-05-08T18:33:24.553297+0000","last_undegraded":"2024-05-08T18:33:24.553297+0000","last_fullsized":"2024-05-08T18:33:24.553297+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'16","last_scrub_stamp":"2024-05-08T18:33:24.553018+0000","last_deep_scrub":"116'16","last_deep_scrub_stamp":"2024-05-08T18:33:24.553018+0000","last_clean_scrub_stamp":"2024-05-08T18:33:24.553018+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:25:24.994572+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:19.006743+0000","last_change":"2024-05-08T18:33:19.006743+0000","last_active":"2024-05-08T18:33:19.006743+0000","last_peered":"2024-05-08T18:33:19.006743+0000","last_clean":"2024-05-08T18:33:19.006743+0000","last_became_active":"2024-05-08T18:29:44.596678+0000","last_became_peered":"2024-05-08T18:29:44.596678+0000","last_unstale":"2024-05-08T18:33:19.006743+0000","last_undegraded":"2024-05-08T18:33:19.006743+0000","last_fullsized":"2024-05-08T18:33:19.006743+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:19.006475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:19.006475+0000","last_clean_scrub_stamp":"2024-05-08T18:33:19.006475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:25:42.318338+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"116'19","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.769018+0000","last_change":"2024-05-08T18:33:06.769095+0000","last_active":"2024-05-08T18:33:06.769018+0000","last_peered":"2024-05-08T18:33:06.769018+0000","last_clean":"2024-05-08T18:33:06.769018+0000","last_became_active":"2024-05-08T18:29:46.606367+0000","last_became_peered":"2024-05-08T18:29:46.606367+0000","last_unstale":"2024-05-08T18:33:06.769018+0000","last_undegraded":"2024-05-08T18:33:06.769018+0000","last_fullsized":"2024-05-08T18:33:06.769018+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'19","last_scrub_stamp":"2024-05-08T18:33:06.768818+0000","last_deep_scrub":"116'19","last_deep_scrub_stamp":"2024-05-08T18:33:06.768818+0000","last_clean_scrub_stamp":"2024-05-08T18:33:06.768818+0000","objects_scrubbed":6,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:21:20.078602+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":187,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:10.610648+0000","last_change":"2024-05-08T18:33:10.610711+0000","last_active":"2024-05-08T18:33:10.610648+0000","last_peered":"2024-05-08T18:33:10.610648+0000","last_clean":"2024-05-08T18:33:10.610648+0000","last_became_active":"2024-05-08T18:29:48.631874+0000","last_became_peered":"2024-05-08T18:29:48.631874+0000","last_unstale":"2024-05-08T18:33:10.610648+0000","last_undegraded":"2024-05-08T18:33:10.610648+0000","last_fullsized":"2024-05-08T18:33:10.610648+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:10.610431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:10.610431+0000","last_clean_scrub_stamp":"2024-05-08T18:33:10.610431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:57:11.243206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:37.251300+0000","last_change":"2024-05-08T18:33:37.251354+0000","last_active":"2024-05-08T18:33:37.251300+0000","last_peered":"2024-05-08T18:33:37.251300+0000","last_clean":"2024-05-08T18:33:37.251300+0000","last_became_active":"2024-05-08T18:29:50.682634+0000","last_became_peered":"2024-05-08T18:29:50.682634+0000","last_unstale":"2024-05-08T18:33:37.251300+0000","last_undegraded":"2024-05-08T18:33:37.251300+0000","last_fullsized":"2024-05-08T18:33:37.251300+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:37.251077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:37.251077+0000","last_clean_scrub_stamp":"2024-05-08T18:33:37.251077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:50:50.999977+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"80'2","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:11.776192+0000","last_change":"2024-05-08T18:33:11.776192+0000","last_active":"2024-05-08T18:33:11.776192+0000","last_peered":"2024-05-08T18:33:11.776192+0000","last_clean":"2024-05-08T18:33:11.776192+0000","last_became_active":"2024-05-08T18:29:42.574288+0000","last_became_peered":"2024-05-08T18:29:42.574288+0000","last_unstale":"2024-05-08T18:33:11.776192+0000","last_undegraded":"2024-05-08T18:33:11.776192+0000","last_fullsized":"2024-05-08T18:33:11.776192+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2","last_scrub_stamp":"2024-05-08T18:33:11.775925+0000","last_deep_scrub":"80'2","last_deep_scrub_stamp":"2024-05-08T18:33:11.775925+0000","last_clean_scrub_stamp":"2024-05-08T18:33:11.775925+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:55:00.699168+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"116'22","reported_seq":178,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:18.823057+0000","last_change":"2024-05-08T18:33:18.823117+0000","last_active":"2024-05-08T18:33:18.823057+0000","last_peered":"2024-05-08T18:33:18.823057+0000","last_clean":"2024-05-08T18:33:18.823057+0000","last_became_active":"2024-05-08T18:30:20.850365+0000","last_became_peered":"2024-05-08T18:30:20.850365+0000","last_unstale":"2024-05-08T18:33:18.823057+0000","last_undegraded":"2024-05-08T18:33:18.823057+0000","last_fullsized":"2024-05-08T18:33:18.823057+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'22","last_scrub_stamp":"2024-05-08T18:33:18.822863+0000","last_deep_scrub":"116'22","last_deep_scrub_stamp":"2024-05-08T18:33:18.822863+0000","last_clean_scrub_stamp":"2024-05-08T18:33:18.822863+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:26:08.884895+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:15.820399+0000","last_change":"2024-05-08T18:33:15.820399+0000","last_active":"2024-05-08T18:33:15.820399+0000","last_peered":"2024-05-08T18:33:15.820399+0000","last_clean":"2024-05-08T18:33:15.820399+0000","last_became_active":"2024-05-08T18:29:34.605574+0000","last_became_peered":"2024-05-08T18:29:34.605574+0000","last_unstale":"2024-05-08T18:33:15.820399+0000","last_undegraded":"2024-05-08T18:33:15.820399+0000","last_fullsized":"2024-05-08T18:33:15.820399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:15.820133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:15.820133+0000","last_clean_scrub_stamp":"2024-05-08T18:33:15.820133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:51:06.134435+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:16.933456+0000","last_change":"2024-05-08T18:33:16.933456+0000","last_active":"2024-05-08T18:33:16.933456+0000","last_peered":"2024-05-08T18:33:16.933456+0000","last_clean":"2024-05-08T18:33:16.933456+0000","last_became_active":"2024-05-08T18:29:44.594642+0000","last_became_peered":"2024-05-08T18:29:44.594642+0000","last_unstale":"2024-05-08T18:33:16.933456+0000","last_undegraded":"2024-05-08T18:33:16.933456+0000","last_fullsized":"2024-05-08T18:33:16.933456+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:16.933187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:16.933187+0000","last_clean_scrub_stamp":"2024-05-08T18:33:16.933187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:45:39.627830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"116'47","reported_seq":264,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:33.043437+0000","last_change":"2024-05-08T18:33:33.043437+0000","last_active":"2024-05-08T18:33:33.043437+0000","last_peered":"2024-05-08T18:33:33.043437+0000","last_clean":"2024-05-08T18:33:33.043437+0000","last_became_active":"2024-05-08T18:29:46.599707+0000","last_became_peered":"2024-05-08T18:29:46.599707+0000","last_unstale":"2024-05-08T18:33:33.043437+0000","last_undegraded":"2024-05-08T18:33:33.043437+0000","last_fullsized":"2024-05-08T18:33:33.043437+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'47","last_scrub_stamp":"2024-05-08T18:33:33.043135+0000","last_deep_scrub":"116'47","last_deep_scrub_stamp":"2024-05-08T18:33:33.043135+0000","last_clean_scrub_stamp":"2024-05-08T18:33:33.043135+0000","objects_scrubbed":8,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:31:09.581461+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":53,"num_read_kb":162,"num_write":30,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:33.586584+0000","last_change":"2024-05-08T18:33:33.586584+0000","last_active":"2024-05-08T18:33:33.586584+0000","last_peered":"2024-05-08T18:33:33.586584+0000","last_clean":"2024-05-08T18:33:33.586584+0000","last_became_active":"2024-05-08T18:29:48.638709+0000","last_became_peered":"2024-05-08T18:29:48.638709+0000","last_unstale":"2024-05-08T18:33:33.586584+0000","last_undegraded":"2024-05-08T18:33:33.586584+0000","last_fullsized":"2024-05-08T18:33:33.586584+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:33.586196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:33.586196+0000","last_clean_scrub_stamp":"2024-05-08T18:33:33.586196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:16:18.289353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"97'6","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:35.963974+0000","last_change":"2024-05-08T18:33:35.964114+0000","last_active":"2024-05-08T18:33:35.963974+0000","last_peered":"2024-05-08T18:33:35.963974+0000","last_clean":"2024-05-08T18:33:35.963974+0000","last_became_active":"2024-05-08T18:29:50.675766+0000","last_became_peered":"2024-05-08T18:29:50.675766+0000","last_unstale":"2024-05-08T18:33:35.963974+0000","last_undegraded":"2024-05-08T18:33:35.963974+0000","last_fullsized":"2024-05-08T18:33:35.963974+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'6","last_scrub_stamp":"2024-05-08T18:33:35.963673+0000","last_deep_scrub":"97'6","last_deep_scrub_stamp":"2024-05-08T18:33:35.963673+0000","last_clean_scrub_stamp":"2024-05-08T18:33:35.963673+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:05:43.538004+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"80'2","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:11.857034+0000","last_change":"2024-05-08T18:33:11.857034+0000","last_active":"2024-05-08T18:33:11.857034+0000","last_peered":"2024-05-08T18:33:11.857034+0000","last_clean":"2024-05-08T18:33:11.857034+0000","last_became_active":"2024-05-08T18:29:42.570645+0000","last_became_peered":"2024-05-08T18:29:42.570645+0000","last_unstale":"2024-05-08T18:33:11.857034+0000","last_undegraded":"2024-05-08T18:33:11.857034+0000","last_fullsized":"2024-05-08T18:33:11.857034+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2","last_scrub_stamp":"2024-05-08T18:33:11.856766+0000","last_deep_scrub":"80'2","last_deep_scrub_stamp":"2024-05-08T18:33:11.856766+0000","last_clean_scrub_stamp":"2024-05-08T18:33:11.856766+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:47.882638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"116'6","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:17.754306+0000","last_change":"2024-05-08T18:33:17.754306+0000","last_active":"2024-05-08T18:33:17.754306+0000","last_peered":"2024-05-08T18:33:17.754306+0000","last_clean":"2024-05-08T18:33:17.754306+0000","last_became_active":"2024-05-08T18:29:40.530256+0000","last_became_peered":"2024-05-08T18:29:40.530256+0000","last_unstale":"2024-05-08T18:33:17.754306+0000","last_undegraded":"2024-05-08T18:33:17.754306+0000","last_fullsized":"2024-05-08T18:33:17.754306+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'6","last_scrub_stamp":"2024-05-08T18:33:17.754029+0000","last_deep_scrub":"116'6","last_deep_scrub_stamp":"2024-05-08T18:33:17.754029+0000","last_clean_scrub_stamp":"2024-05-08T18:33:17.754029+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:59:58.713080+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:23.853159+0000","last_change":"2024-05-08T18:33:23.853159+0000","last_active":"2024-05-08T18:33:23.853159+0000","last_peered":"2024-05-08T18:33:23.853159+0000","last_clean":"2024-05-08T18:33:23.853159+0000","last_became_active":"2024-05-08T18:29:34.602547+0000","last_became_peered":"2024-05-08T18:29:34.602547+0000","last_unstale":"2024-05-08T18:33:23.853159+0000","last_undegraded":"2024-05-08T18:33:23.853159+0000","last_fullsized":"2024-05-08T18:33:23.853159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:23.852887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:23.852887+0000","last_clean_scrub_stamp":"2024-05-08T18:33:23.852887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:27:37.133276+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":196,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:08.632177+0000","last_change":"2024-05-08T18:33:08.632177+0000","last_active":"2024-05-08T18:33:08.632177+0000","last_peered":"2024-05-08T18:33:08.632177+0000","last_clean":"2024-05-08T18:33:08.632177+0000","last_became_active":"2024-05-08T18:29:44.591870+0000","last_became_peered":"2024-05-08T18:29:44.591870+0000","last_unstale":"2024-05-08T18:33:08.632177+0000","last_undegraded":"2024-05-08T18:33:08.632177+0000","last_fullsized":"2024-05-08T18:33:08.632177+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:08.631919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:08.631919+0000","last_clean_scrub_stamp":"2024-05-08T18:33:08.631919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:56:39.299991+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"116'21","reported_seq":225,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:10.811356+0000","last_change":"2024-05-08T18:33:10.811356+0000","last_active":"2024-05-08T18:33:10.811356+0000","last_peered":"2024-05-08T18:33:10.811356+0000","last_clean":"2024-05-08T18:33:10.811356+0000","last_became_active":"2024-05-08T18:29:46.602920+0000","last_became_peered":"2024-05-08T18:29:46.602920+0000","last_unstale":"2024-05-08T18:33:10.811356+0000","last_undegraded":"2024-05-08T18:33:10.811356+0000","last_fullsized":"2024-05-08T18:33:10.811356+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'21","last_scrub_stamp":"2024-05-08T18:33:10.810930+0000","last_deep_scrub":"116'21","last_deep_scrub_stamp":"2024-05-08T18:33:10.810930+0000","last_clean_scrub_stamp":"2024-05-08T18:33:10.810930+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:40:04.662911+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"116'105","reported_seq":344,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.203314+0000","last_change":"2024-05-08T18:33:06.203314+0000","last_active":"2024-05-08T18:33:06.203314+0000","last_peered":"2024-05-08T18:33:06.203314+0000","last_clean":"2024-05-08T18:33:06.203314+0000","last_became_active":"2024-05-08T18:29:48.634280+0000","last_became_peered":"2024-05-08T18:29:48.634280+0000","last_unstale":"2024-05-08T18:33:06.203314+0000","last_undegraded":"2024-05-08T18:33:06.203314+0000","last_fullsized":"2024-05-08T18:33:06.203314+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'105","last_scrub_stamp":"2024-05-08T18:33:06.203046+0000","last_deep_scrub":"116'105","last_deep_scrub_stamp":"2024-05-08T18:33:06.203046+0000","last_clean_scrub_stamp":"2024-05-08T18:33:06.203046+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:11:28.565523+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"80'2","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:37.867330+0000","last_change":"2024-05-08T18:33:37.867398+0000","last_active":"2024-05-08T18:33:37.867330+0000","last_peered":"2024-05-08T18:33:37.867330+0000","last_clean":"2024-05-08T18:33:37.867330+0000","last_became_active":"2024-05-08T18:29:50.687135+0000","last_became_peered":"2024-05-08T18:29:50.687135+0000","last_unstale":"2024-05-08T18:33:37.867330+0000","last_undegraded":"2024-05-08T18:33:37.867330+0000","last_fullsized":"2024-05-08T18:33:37.867330+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2","last_scrub_stamp":"2024-05-08T18:33:37.867115+0000","last_deep_scrub":"80'2","last_deep_scrub_stamp":"2024-05-08T18:33:37.867115+0000","last_clean_scrub_stamp":"2024-05-08T18:33:37.867115+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:32:46.350823+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"80'2","reported_seq":161,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:20.865601+0000","last_change":"2024-05-08T18:33:20.865670+0000","last_active":"2024-05-08T18:33:20.865601+0000","last_peered":"2024-05-08T18:33:20.865601+0000","last_clean":"2024-05-08T18:33:20.865601+0000","last_became_active":"2024-05-08T18:30:21.220196+0000","last_became_peered":"2024-05-08T18:30:21.220196+0000","last_unstale":"2024-05-08T18:33:20.865601+0000","last_undegraded":"2024-05-08T18:33:20.865601+0000","last_fullsized":"2024-05-08T18:33:20.865601+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2","last_scrub_stamp":"2024-05-08T18:33:20.865401+0000","last_deep_scrub":"80'2","last_deep_scrub_stamp":"2024-05-08T18:33:20.865401+0000","last_clean_scrub_stamp":"2024-05-08T18:33:20.865401+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:40:14.717383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"116'10","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:34.925493+0000","last_change":"2024-05-08T18:33:34.925493+0000","last_active":"2024-05-08T18:33:34.925493+0000","last_peered":"2024-05-08T18:33:34.925493+0000","last_clean":"2024-05-08T18:33:34.925493+0000","last_became_active":"2024-05-08T18:29:40.565655+0000","last_became_peered":"2024-05-08T18:29:40.565655+0000","last_unstale":"2024-05-08T18:33:34.925493+0000","last_undegraded":"2024-05-08T18:33:34.925493+0000","last_fullsized":"2024-05-08T18:33:34.925493+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'10","last_scrub_stamp":"2024-05-08T18:33:34.925231+0000","last_deep_scrub":"116'10","last_deep_scrub_stamp":"2024-05-08T18:33:34.925231+0000","last_clean_scrub_stamp":"2024-05-08T18:33:34.925231+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:07:46.364352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":215,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:14.830428+0000","last_change":"2024-05-08T18:33:14.830428+0000","last_active":"2024-05-08T18:33:14.830428+0000","last_peered":"2024-05-08T18:33:14.830428+0000","last_clean":"2024-05-08T18:33:14.830428+0000","last_became_active":"2024-05-08T18:29:34.500933+0000","last_became_peered":"2024-05-08T18:29:34.500933+0000","last_unstale":"2024-05-08T18:33:14.830428+0000","last_undegraded":"2024-05-08T18:33:14.830428+0000","last_fullsized":"2024-05-08T18:33:14.830428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:14.829982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:14.829982+0000","last_clean_scrub_stamp":"2024-05-08T18:33:14.829982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:17:25.384731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":201,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:19.531875+0000","last_change":"2024-05-08T18:33:19.531875+0000","last_active":"2024-05-08T18:33:19.531875+0000","last_peered":"2024-05-08T18:33:19.531875+0000","last_clean":"2024-05-08T18:33:19.531875+0000","last_became_active":"2024-05-08T18:29:44.575454+0000","last_became_peered":"2024-05-08T18:29:44.575454+0000","last_unstale":"2024-05-08T18:33:19.531875+0000","last_undegraded":"2024-05-08T18:33:19.531875+0000","last_fullsized":"2024-05-08T18:33:19.531875+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:19.531621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:19.531621+0000","last_clean_scrub_stamp":"2024-05-08T18:33:19.531621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:11:19.253395+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"116'16","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:02.599677+0000","last_change":"2024-05-08T18:33:02.599677+0000","last_active":"2024-05-08T18:33:02.599677+0000","last_peered":"2024-05-08T18:33:02.599677+0000","last_clean":"2024-05-08T18:33:02.599677+0000","last_became_active":"2024-05-08T18:29:46.603455+0000","last_became_peered":"2024-05-08T18:29:46.603455+0000","last_unstale":"2024-05-08T18:33:02.599677+0000","last_undegraded":"2024-05-08T18:33:02.599677+0000","last_fullsized":"2024-05-08T18:33:02.599677+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'16","last_scrub_stamp":"2024-05-08T18:33:02.599369+0000","last_deep_scrub":"116'16","last_deep_scrub_stamp":"2024-05-08T18:33:02.599369+0000","last_clean_scrub_stamp":"2024-05-08T18:33:02.599369+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:24:13.274296+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"116'105","reported_seq":378,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:01.696176+0000","last_change":"2024-05-08T18:33:01.696176+0000","last_active":"2024-05-08T18:33:01.696176+0000","last_peered":"2024-05-08T18:33:01.696176+0000","last_clean":"2024-05-08T18:33:01.696176+0000","last_became_active":"2024-05-08T18:29:48.637070+0000","last_became_peered":"2024-05-08T18:29:48.637070+0000","last_unstale":"2024-05-08T18:33:01.696176+0000","last_undegraded":"2024-05-08T18:33:01.696176+0000","last_fullsized":"2024-05-08T18:33:01.696176+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'105","last_scrub_stamp":"2024-05-08T18:33:01.696035+0000","last_deep_scrub":"116'105","last_deep_scrub_stamp":"2024-05-08T18:33:01.696035+0000","last_clean_scrub_stamp":"2024-05-08T18:33:01.696035+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:36:00.801974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"84'10","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:39.917790+0000","last_change":"2024-05-08T18:33:39.917922+0000","last_active":"2024-05-08T18:33:39.917790+0000","last_peered":"2024-05-08T18:33:39.917790+0000","last_clean":"2024-05-08T18:33:39.917790+0000","last_became_active":"2024-05-08T18:29:50.690767+0000","last_became_peered":"2024-05-08T18:29:50.690767+0000","last_unstale":"2024-05-08T18:33:39.917790+0000","last_undegraded":"2024-05-08T18:33:39.917790+0000","last_fullsized":"2024-05-08T18:33:39.917790+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'10","last_scrub_stamp":"2024-05-08T18:33:39.917448+0000","last_deep_scrub":"84'10","last_deep_scrub_stamp":"2024-05-08T18:33:39.917448+0000","last_clean_scrub_stamp":"2024-05-08T18:33:39.917448+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:02.539247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"97'16","reported_seq":239,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:14.445551+0000","last_change":"2024-05-08T18:33:14.445551+0000","last_active":"2024-05-08T18:33:14.445551+0000","last_peered":"2024-05-08T18:33:14.445551+0000","last_clean":"2024-05-08T18:33:14.445551+0000","last_became_active":"2024-05-08T18:29:42.560861+0000","last_became_peered":"2024-05-08T18:29:42.560861+0000","last_unstale":"2024-05-08T18:33:14.445551+0000","last_undegraded":"2024-05-08T18:33:14.445551+0000","last_fullsized":"2024-05-08T18:33:14.445551+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'16","last_scrub_stamp":"2024-05-08T18:33:14.445116+0000","last_deep_scrub":"97'16","last_deep_scrub_stamp":"2024-05-08T18:33:14.445116+0000","last_clean_scrub_stamp":"2024-05-08T18:33:14.445116+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:27:50.185862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"116'18","reported_seq":225,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:31.049841+0000","last_change":"2024-05-08T18:33:31.049841+0000","last_active":"2024-05-08T18:33:31.049841+0000","last_peered":"2024-05-08T18:33:31.049841+0000","last_clean":"2024-05-08T18:33:31.049841+0000","last_became_active":"2024-05-08T18:29:40.550241+0000","last_became_peered":"2024-05-08T18:29:40.550241+0000","last_unstale":"2024-05-08T18:33:31.049841+0000","last_undegraded":"2024-05-08T18:33:31.049841+0000","last_fullsized":"2024-05-08T18:33:31.049841+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'18","last_scrub_stamp":"2024-05-08T18:33:31.049410+0000","last_deep_scrub":"116'18","last_deep_scrub_stamp":"2024-05-08T18:33:31.049410+0000","last_clean_scrub_stamp":"2024-05-08T18:33:31.049410+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:34:22.707751+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:12.523030+0000","last_change":"2024-05-08T18:33:12.523030+0000","last_active":"2024-05-08T18:33:12.523030+0000","last_peered":"2024-05-08T18:33:12.523030+0000","last_clean":"2024-05-08T18:33:12.523030+0000","last_became_active":"2024-05-08T18:29:34.492891+0000","last_became_peered":"2024-05-08T18:29:34.492891+0000","last_unstale":"2024-05-08T18:33:12.523030+0000","last_undegraded":"2024-05-08T18:33:12.523030+0000","last_fullsized":"2024-05-08T18:33:12.523030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:12.522775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:12.522775+0000","last_clean_scrub_stamp":"2024-05-08T18:33:12.522775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:55:44.584704+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:19.920125+0000","last_change":"2024-05-08T18:33:19.920125+0000","last_active":"2024-05-08T18:33:19.920125+0000","last_peered":"2024-05-08T18:33:19.920125+0000","last_clean":"2024-05-08T18:33:19.920125+0000","last_became_active":"2024-05-08T18:29:44.589471+0000","last_became_peered":"2024-05-08T18:29:44.589471+0000","last_unstale":"2024-05-08T18:33:19.920125+0000","last_undegraded":"2024-05-08T18:33:19.920125+0000","last_fullsized":"2024-05-08T18:33:19.920125+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:19.919859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:19.919859+0000","last_clean_scrub_stamp":"2024-05-08T18:33:19.919859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:39:22.835248+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"116'51","reported_seq":272,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:19.807344+0000","last_change":"2024-05-08T18:33:19.807344+0000","last_active":"2024-05-08T18:33:19.807344+0000","last_peered":"2024-05-08T18:33:19.807344+0000","last_clean":"2024-05-08T18:33:19.807344+0000","last_became_active":"2024-05-08T18:29:46.605693+0000","last_became_peered":"2024-05-08T18:29:46.605693+0000","last_unstale":"2024-05-08T18:33:19.807344+0000","last_undegraded":"2024-05-08T18:33:19.807344+0000","last_fullsized":"2024-05-08T18:33:19.807344+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'51","last_scrub_stamp":"2024-05-08T18:33:19.807007+0000","last_deep_scrub":"116'51","last_deep_scrub_stamp":"2024-05-08T18:33:19.807007+0000","last_clean_scrub_stamp":"2024-05-08T18:33:19.807007+0000","objects_scrubbed":8,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:11:19.528781+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":57,"num_read_kb":43,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":191,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:04.773271+0000","last_change":"2024-05-08T18:33:04.773271+0000","last_active":"2024-05-08T18:33:04.773271+0000","last_peered":"2024-05-08T18:33:04.773271+0000","last_clean":"2024-05-08T18:33:04.773271+0000","last_became_active":"2024-05-08T18:29:48.633607+0000","last_became_peered":"2024-05-08T18:29:48.633607+0000","last_unstale":"2024-05-08T18:33:04.773271+0000","last_undegraded":"2024-05-08T18:33:04.773271+0000","last_fullsized":"2024-05-08T18:33:04.773271+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:04.773014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:04.773014+0000","last_clean_scrub_stamp":"2024-05-08T18:33:04.773014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:24:24.320241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:38.267048+0000","last_change":"2024-05-08T18:33:38.267112+0000","last_active":"2024-05-08T18:33:38.267048+0000","last_peered":"2024-05-08T18:33:38.267048+0000","last_clean":"2024-05-08T18:33:38.267048+0000","last_became_active":"2024-05-08T18:29:50.684818+0000","last_became_peered":"2024-05-08T18:29:50.684818+0000","last_unstale":"2024-05-08T18:33:38.267048+0000","last_undegraded":"2024-05-08T18:33:38.267048+0000","last_fullsized":"2024-05-08T18:33:38.267048+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:38.266855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:38.266855+0000","last_clean_scrub_stamp":"2024-05-08T18:33:38.266855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:30:55.977778+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":187,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:36.924065+0000","last_change":"2024-05-08T18:33:36.924065+0000","last_active":"2024-05-08T18:33:36.924065+0000","last_peered":"2024-05-08T18:33:36.924065+0000","last_clean":"2024-05-08T18:33:36.924065+0000","last_became_active":"2024-05-08T18:29:50.681771+0000","last_became_peered":"2024-05-08T18:29:50.681771+0000","last_unstale":"2024-05-08T18:33:36.924065+0000","last_undegraded":"2024-05-08T18:33:36.924065+0000","last_fullsized":"2024-05-08T18:33:36.924065+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:36.923732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:36.923732+0000","last_clean_scrub_stamp":"2024-05-08T18:33:36.923732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:25:54.216928+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"84'4","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:11.516666+0000","last_change":"2024-05-08T18:33:11.516848+0000","last_active":"2024-05-08T18:33:11.516666+0000","last_peered":"2024-05-08T18:33:11.516666+0000","last_clean":"2024-05-08T18:33:11.516666+0000","last_became_active":"2024-05-08T18:29:42.574877+0000","last_became_peered":"2024-05-08T18:29:42.574877+0000","last_unstale":"2024-05-08T18:33:11.516666+0000","last_undegraded":"2024-05-08T18:33:11.516666+0000","last_fullsized":"2024-05-08T18:33:11.516666+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'4","last_scrub_stamp":"2024-05-08T18:33:11.516428+0000","last_deep_scrub":"84'4","last_deep_scrub_stamp":"2024-05-08T18:33:11.516428+0000","last_clean_scrub_stamp":"2024-05-08T18:33:11.516428+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:04:19.950937+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"116'22","reported_seq":230,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:26.537482+0000","last_change":"2024-05-08T18:33:26.537541+0000","last_active":"2024-05-08T18:33:26.537482+0000","last_peered":"2024-05-08T18:33:26.537482+0000","last_clean":"2024-05-08T18:33:26.537482+0000","last_became_active":"2024-05-08T18:29:40.565874+0000","last_became_peered":"2024-05-08T18:29:40.565874+0000","last_unstale":"2024-05-08T18:33:26.537482+0000","last_undegraded":"2024-05-08T18:33:26.537482+0000","last_fullsized":"2024-05-08T18:33:26.537482+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'22","last_scrub_stamp":"2024-05-08T18:33:26.537286+0000","last_deep_scrub":"116'22","last_deep_scrub_stamp":"2024-05-08T18:33:26.537286+0000","last_clean_scrub_stamp":"2024-05-08T18:33:26.537286+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:00:00.082935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:04.850748+0000","last_change":"2024-05-08T18:33:04.850805+0000","last_active":"2024-05-08T18:33:04.850748+0000","last_peered":"2024-05-08T18:33:04.850748+0000","last_clean":"2024-05-08T18:33:04.850748+0000","last_became_active":"2024-05-08T18:29:44.594286+0000","last_became_peered":"2024-05-08T18:29:44.594286+0000","last_unstale":"2024-05-08T18:33:04.850748+0000","last_undegraded":"2024-05-08T18:33:04.850748+0000","last_fullsized":"2024-05-08T18:33:04.850748+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:04.850525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:04.850525+0000","last_clean_scrub_stamp":"2024-05-08T18:33:04.850525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:01:58.648413+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"116'26","reported_seq":232,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:35.926609+0000","last_change":"2024-05-08T18:33:35.926799+0000","last_active":"2024-05-08T18:33:35.926609+0000","last_peered":"2024-05-08T18:33:35.926609+0000","last_clean":"2024-05-08T18:33:35.926609+0000","last_became_active":"2024-05-08T18:29:46.588810+0000","last_became_peered":"2024-05-08T18:29:46.588810+0000","last_unstale":"2024-05-08T18:33:35.926609+0000","last_undegraded":"2024-05-08T18:33:35.926609+0000","last_fullsized":"2024-05-08T18:33:35.926609+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'26","last_scrub_stamp":"2024-05-08T18:33:35.926356+0000","last_deep_scrub":"116'26","last_deep_scrub_stamp":"2024-05-08T18:33:35.926356+0000","last_clean_scrub_stamp":"2024-05-08T18:33:35.926356+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:05:43.500687+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:03.743861+0000","last_change":"2024-05-08T18:33:03.743896+0000","last_active":"2024-05-08T18:33:03.743861+0000","last_peered":"2024-05-08T18:33:03.743861+0000","last_clean":"2024-05-08T18:33:03.743861+0000","last_became_active":"2024-05-08T18:29:48.633866+0000","last_became_peered":"2024-05-08T18:29:48.633866+0000","last_unstale":"2024-05-08T18:33:03.743861+0000","last_undegraded":"2024-05-08T18:33:03.743861+0000","last_fullsized":"2024-05-08T18:33:03.743861+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:03.743733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:03.743733+0000","last_clean_scrub_stamp":"2024-05-08T18:33:03.743733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:01:58.619258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"83'16","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:40.820954+0000","last_change":"2024-05-08T18:33:40.820954+0000","last_active":"2024-05-08T18:33:40.820954+0000","last_peered":"2024-05-08T18:33:40.820954+0000","last_clean":"2024-05-08T18:33:40.820954+0000","last_became_active":"2024-05-08T18:29:50.692687+0000","last_became_peered":"2024-05-08T18:29:50.692687+0000","last_unstale":"2024-05-08T18:33:40.820954+0000","last_undegraded":"2024-05-08T18:33:40.820954+0000","last_fullsized":"2024-05-08T18:33:40.820954+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'16","last_scrub_stamp":"2024-05-08T18:33:40.820675+0000","last_deep_scrub":"83'16","last_deep_scrub_stamp":"2024-05-08T18:33:40.820675+0000","last_clean_scrub_stamp":"2024-05-08T18:33:40.820675+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:32:34.206319+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":28,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"83'6","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:03.863340+0000","last_change":"2024-05-08T18:33:03.863365+0000","last_active":"2024-05-08T18:33:03.863340+0000","last_peered":"2024-05-08T18:33:03.863340+0000","last_clean":"2024-05-08T18:33:03.863340+0000","last_became_active":"2024-05-08T18:29:42.580887+0000","last_became_peered":"2024-05-08T18:29:42.580887+0000","last_unstale":"2024-05-08T18:33:03.863340+0000","last_undegraded":"2024-05-08T18:33:03.863340+0000","last_fullsized":"2024-05-08T18:33:03.863340+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'6","last_scrub_stamp":"2024-05-08T18:33:03.863262+0000","last_deep_scrub":"83'6","last_deep_scrub_stamp":"2024-05-08T18:33:03.863262+0000","last_clean_scrub_stamp":"2024-05-08T18:33:03.863262+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:16:10.334188+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"116'14","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:16.799292+0000","last_change":"2024-05-08T18:33:16.799353+0000","last_active":"2024-05-08T18:33:16.799292+0000","last_peered":"2024-05-08T18:33:16.799292+0000","last_clean":"2024-05-08T18:33:16.799292+0000","last_became_active":"2024-05-08T18:29:40.572079+0000","last_became_peered":"2024-05-08T18:29:40.572079+0000","last_unstale":"2024-05-08T18:33:16.799292+0000","last_undegraded":"2024-05-08T18:33:16.799292+0000","last_fullsized":"2024-05-08T18:33:16.799292+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'14","last_scrub_stamp":"2024-05-08T18:33:16.799068+0000","last_deep_scrub":"116'14","last_deep_scrub_stamp":"2024-05-08T18:33:16.799068+0000","last_clean_scrub_stamp":"2024-05-08T18:33:16.799068+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:35:39.535106+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":198,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:15.839987+0000","last_change":"2024-05-08T18:33:15.840086+0000","last_active":"2024-05-08T18:33:15.839987+0000","last_peered":"2024-05-08T18:33:15.839987+0000","last_clean":"2024-05-08T18:33:15.839987+0000","last_became_active":"2024-05-08T18:29:44.580805+0000","last_became_peered":"2024-05-08T18:29:44.580805+0000","last_unstale":"2024-05-08T18:33:15.839987+0000","last_undegraded":"2024-05-08T18:33:15.839987+0000","last_fullsized":"2024-05-08T18:33:15.839987+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:15.839695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:15.839695+0000","last_clean_scrub_stamp":"2024-05-08T18:33:15.839695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:07:53.998183+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"116'8","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:07.889630+0000","last_change":"2024-05-08T18:33:07.889705+0000","last_active":"2024-05-08T18:33:07.889630+0000","last_peered":"2024-05-08T18:33:07.889630+0000","last_clean":"2024-05-08T18:33:07.889630+0000","last_became_active":"2024-05-08T18:29:46.599789+0000","last_became_peered":"2024-05-08T18:29:46.599789+0000","last_unstale":"2024-05-08T18:33:07.889630+0000","last_undegraded":"2024-05-08T18:33:07.889630+0000","last_fullsized":"2024-05-08T18:33:07.889630+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'8","last_scrub_stamp":"2024-05-08T18:33:07.889455+0000","last_deep_scrub":"116'8","last_deep_scrub_stamp":"2024-05-08T18:33:07.889455+0000","last_clean_scrub_stamp":"2024-05-08T18:33:07.889455+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:51:04.569065+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":187,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:33.720465+0000","last_change":"2024-05-08T18:33:33.720519+0000","last_active":"2024-05-08T18:33:33.720465+0000","last_peered":"2024-05-08T18:33:33.720465+0000","last_clean":"2024-05-08T18:33:33.720465+0000","last_became_active":"2024-05-08T18:29:48.642056+0000","last_became_peered":"2024-05-08T18:29:48.642056+0000","last_unstale":"2024-05-08T18:33:33.720465+0000","last_undegraded":"2024-05-08T18:33:33.720465+0000","last_fullsized":"2024-05-08T18:33:33.720465+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:33.720269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:33.720269+0000","last_clean_scrub_stamp":"2024-05-08T18:33:33.720269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:08:32.225703+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:34.986924+0000","last_change":"2024-05-08T18:33:34.986988+0000","last_active":"2024-05-08T18:33:34.986924+0000","last_peered":"2024-05-08T18:33:34.986924+0000","last_clean":"2024-05-08T18:33:34.986924+0000","last_became_active":"2024-05-08T18:29:50.671781+0000","last_became_peered":"2024-05-08T18:29:50.671781+0000","last_unstale":"2024-05-08T18:33:34.986924+0000","last_undegraded":"2024-05-08T18:33:34.986924+0000","last_fullsized":"2024-05-08T18:33:34.986924+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:34.986705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:34.986705+0000","last_clean_scrub_stamp":"2024-05-08T18:33:34.986705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:07:46.425826+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"97'2","reported_seq":207,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:12.704906+0000","last_change":"2024-05-08T18:33:12.704969+0000","last_active":"2024-05-08T18:33:12.704906+0000","last_peered":"2024-05-08T18:33:12.704906+0000","last_clean":"2024-05-08T18:33:12.704906+0000","last_became_active":"2024-05-08T18:29:42.576379+0000","last_became_peered":"2024-05-08T18:29:42.576379+0000","last_unstale":"2024-05-08T18:33:12.704906+0000","last_undegraded":"2024-05-08T18:33:12.704906+0000","last_fullsized":"2024-05-08T18:33:12.704906+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'2","last_scrub_stamp":"2024-05-08T18:33:12.704698+0000","last_deep_scrub":"97'2","last_deep_scrub_stamp":"2024-05-08T18:33:12.704698+0000","last_clean_scrub_stamp":"2024-05-08T18:33:12.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:39.541544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"116'24","reported_seq":229,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:29.254024+0000","last_change":"2024-05-08T18:33:29.254101+0000","last_active":"2024-05-08T18:33:29.254024+0000","last_peered":"2024-05-08T18:33:29.254024+0000","last_clean":"2024-05-08T18:33:29.254024+0000","last_became_active":"2024-05-08T18:29:40.542239+0000","last_became_peered":"2024-05-08T18:29:40.542239+0000","last_unstale":"2024-05-08T18:33:29.254024+0000","last_undegraded":"2024-05-08T18:33:29.254024+0000","last_fullsized":"2024-05-08T18:33:29.254024+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'24","last_scrub_stamp":"2024-05-08T18:33:29.253789+0000","last_deep_scrub":"116'24","last_deep_scrub_stamp":"2024-05-08T18:33:29.253789+0000","last_clean_scrub_stamp":"2024-05-08T18:33:29.253789+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:09:18.942903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":24,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:11.865055+0000","last_change":"2024-05-08T18:33:11.865207+0000","last_active":"2024-05-08T18:33:11.865055+0000","last_peered":"2024-05-08T18:33:11.865055+0000","last_clean":"2024-05-08T18:33:11.865055+0000","last_became_active":"2024-05-08T18:29:44.592476+0000","last_became_peered":"2024-05-08T18:29:44.592476+0000","last_unstale":"2024-05-08T18:33:11.865055+0000","last_undegraded":"2024-05-08T18:33:11.865055+0000","last_fullsized":"2024-05-08T18:33:11.865055+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:11.864822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:11.864822+0000","last_clean_scrub_stamp":"2024-05-08T18:33:11.864822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:04:20.299330+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"116'24","reported_seq":230,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:10.770915+0000","last_change":"2024-05-08T18:33:10.771004+0000","last_active":"2024-05-08T18:33:10.770915+0000","last_peered":"2024-05-08T18:33:10.770915+0000","last_clean":"2024-05-08T18:33:10.770915+0000","last_became_active":"2024-05-08T18:29:46.596452+0000","last_became_peered":"2024-05-08T18:29:46.596452+0000","last_unstale":"2024-05-08T18:33:10.770915+0000","last_undegraded":"2024-05-08T18:33:10.770915+0000","last_fullsized":"2024-05-08T18:33:10.770915+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'24","last_scrub_stamp":"2024-05-08T18:33:10.770722+0000","last_deep_scrub":"116'24","last_deep_scrub_stamp":"2024-05-08T18:33:10.770722+0000","last_clean_scrub_stamp":"2024-05-08T18:33:10.770722+0000","objects_scrubbed":5,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:49:54.138164+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":187,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:20.679900+0000","last_change":"2024-05-08T18:33:20.679959+0000","last_active":"2024-05-08T18:33:20.679900+0000","last_peered":"2024-05-08T18:33:20.679900+0000","last_clean":"2024-05-08T18:33:20.679900+0000","last_became_active":"2024-05-08T18:29:48.634704+0000","last_became_peered":"2024-05-08T18:29:48.634704+0000","last_unstale":"2024-05-08T18:33:20.679900+0000","last_undegraded":"2024-05-08T18:33:20.679900+0000","last_fullsized":"2024-05-08T18:33:20.679900+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:20.679686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:20.679686+0000","last_clean_scrub_stamp":"2024-05-08T18:33:20.679686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:09:41.555781+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"83'2","reported_seq":188,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:39.244121+0000","last_change":"2024-05-08T18:33:39.244259+0000","last_active":"2024-05-08T18:33:39.244121+0000","last_peered":"2024-05-08T18:33:39.244121+0000","last_clean":"2024-05-08T18:33:39.244121+0000","last_became_active":"2024-05-08T18:29:50.687045+0000","last_became_peered":"2024-05-08T18:29:50.687045+0000","last_unstale":"2024-05-08T18:33:39.244121+0000","last_undegraded":"2024-05-08T18:33:39.244121+0000","last_fullsized":"2024-05-08T18:33:39.244121+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'2","last_scrub_stamp":"2024-05-08T18:33:39.243851+0000","last_deep_scrub":"83'2","last_deep_scrub_stamp":"2024-05-08T18:33:39.243851+0000","last_clean_scrub_stamp":"2024-05-08T18:33:39.243851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:38.355360+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"97'4","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:42.824479+0000","last_change":"2024-05-08T18:33:42.824630+0000","last_active":"2024-05-08T18:33:42.824479+0000","last_peered":"2024-05-08T18:33:42.824479+0000","last_clean":"2024-05-08T18:33:42.824479+0000","last_became_active":"2024-05-08T18:30:20.849751+0000","last_became_peered":"2024-05-08T18:30:20.849751+0000","last_unstale":"2024-05-08T18:33:42.824479+0000","last_undegraded":"2024-05-08T18:33:42.824479+0000","last_fullsized":"2024-05-08T18:33:42.824479+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'4","last_scrub_stamp":"2024-05-08T18:33:42.824209+0000","last_deep_scrub":"97'4","last_deep_scrub_stamp":"2024-05-08T18:33:42.824209+0000","last_clean_scrub_stamp":"2024-05-08T18:33:42.824209+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:33:49.886063+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"116'26","reported_seq":232,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:26.997877+0000","last_change":"2024-05-08T18:33:26.998035+0000","last_active":"2024-05-08T18:33:26.997877+0000","last_peered":"2024-05-08T18:33:26.997877+0000","last_clean":"2024-05-08T18:33:26.997877+0000","last_became_active":"2024-05-08T18:29:40.540835+0000","last_became_peered":"2024-05-08T18:29:40.540835+0000","last_unstale":"2024-05-08T18:33:26.997877+0000","last_undegraded":"2024-05-08T18:33:26.997877+0000","last_fullsized":"2024-05-08T18:33:26.997877+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'26","last_scrub_stamp":"2024-05-08T18:33:26.997589+0000","last_deep_scrub":"116'26","last_deep_scrub_stamp":"2024-05-08T18:33:26.997589+0000","last_clean_scrub_stamp":"2024-05-08T18:33:26.997589+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:49:03.114139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":26,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.623257+0000","last_change":"2024-05-08T18:33:06.623312+0000","last_active":"2024-05-08T18:33:06.623257+0000","last_peered":"2024-05-08T18:33:06.623257+0000","last_clean":"2024-05-08T18:33:06.623257+0000","last_became_active":"2024-05-08T18:29:44.590454+0000","last_became_peered":"2024-05-08T18:29:44.590454+0000","last_unstale":"2024-05-08T18:33:06.623257+0000","last_undegraded":"2024-05-08T18:33:06.623257+0000","last_fullsized":"2024-05-08T18:33:06.623257+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:06.623034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:06.623034+0000","last_clean_scrub_stamp":"2024-05-08T18:33:06.623034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:26:10.851953+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"116'22","reported_seq":224,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:29.866011+0000","last_change":"2024-05-08T18:33:29.866098+0000","last_active":"2024-05-08T18:33:29.866011+0000","last_peered":"2024-05-08T18:33:29.866011+0000","last_clean":"2024-05-08T18:33:29.866011+0000","last_became_active":"2024-05-08T18:29:46.606172+0000","last_became_peered":"2024-05-08T18:29:46.606172+0000","last_unstale":"2024-05-08T18:33:29.866011+0000","last_undegraded":"2024-05-08T18:33:29.866011+0000","last_fullsized":"2024-05-08T18:33:29.866011+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'22","last_scrub_stamp":"2024-05-08T18:33:29.865827+0000","last_deep_scrub":"116'22","last_deep_scrub_stamp":"2024-05-08T18:33:29.865827+0000","last_clean_scrub_stamp":"2024-05-08T18:33:29.865827+0000","objects_scrubbed":4,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:09:19.554940+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:00.946595+0000","last_change":"2024-05-08T18:33:00.946620+0000","last_active":"2024-05-08T18:33:00.946595+0000","last_peered":"2024-05-08T18:33:00.946595+0000","last_clean":"2024-05-08T18:33:00.946595+0000","last_became_active":"2024-05-08T18:29:48.631219+0000","last_became_peered":"2024-05-08T18:29:48.631219+0000","last_unstale":"2024-05-08T18:33:00.946595+0000","last_undegraded":"2024-05-08T18:33:00.946595+0000","last_fullsized":"2024-05-08T18:33:00.946595+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:00.946504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:00.946504+0000","last_clean_scrub_stamp":"2024-05-08T18:33:00.946504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:43:13.162227+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.642167+0000","last_change":"2024-05-08T18:33:05.642167+0000","last_active":"2024-05-08T18:33:05.642167+0000","last_peered":"2024-05-08T18:33:05.642167+0000","last_clean":"2024-05-08T18:33:05.642167+0000","last_became_active":"2024-05-08T18:29:42.569425+0000","last_became_peered":"2024-05-08T18:29:42.569425+0000","last_unstale":"2024-05-08T18:33:05.642167+0000","last_undegraded":"2024-05-08T18:33:05.642167+0000","last_fullsized":"2024-05-08T18:33:05.642167+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:05.641829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:05.641829+0000","last_clean_scrub_stamp":"2024-05-08T18:33:05.641829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:00.182094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"116'16","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:28.875693+0000","last_change":"2024-05-08T18:33:28.875832+0000","last_active":"2024-05-08T18:33:28.875693+0000","last_peered":"2024-05-08T18:33:28.875693+0000","last_clean":"2024-05-08T18:33:28.875693+0000","last_became_active":"2024-05-08T18:29:40.547479+0000","last_became_peered":"2024-05-08T18:29:40.547479+0000","last_unstale":"2024-05-08T18:33:28.875693+0000","last_undegraded":"2024-05-08T18:33:28.875693+0000","last_fullsized":"2024-05-08T18:33:28.875693+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'16","last_scrub_stamp":"2024-05-08T18:33:28.875438+0000","last_deep_scrub":"116'16","last_deep_scrub_stamp":"2024-05-08T18:33:28.875438+0000","last_clean_scrub_stamp":"2024-05-08T18:33:28.875438+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:58:20.850052+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":199,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:14.912371+0000","last_change":"2024-05-08T18:33:14.912371+0000","last_active":"2024-05-08T18:33:14.912371+0000","last_peered":"2024-05-08T18:33:14.912371+0000","last_clean":"2024-05-08T18:33:14.912371+0000","last_became_active":"2024-05-08T18:29:44.590498+0000","last_became_peered":"2024-05-08T18:29:44.590498+0000","last_unstale":"2024-05-08T18:33:14.912371+0000","last_undegraded":"2024-05-08T18:33:14.912371+0000","last_fullsized":"2024-05-08T18:33:14.912371+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:14.911981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:14.911981+0000","last_clean_scrub_stamp":"2024-05-08T18:33:14.911981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:08:31.260871+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"116'34","reported_seq":249,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:08.863245+0000","last_change":"2024-05-08T18:33:08.863393+0000","last_active":"2024-05-08T18:33:08.863245+0000","last_peered":"2024-05-08T18:33:08.863245+0000","last_clean":"2024-05-08T18:33:08.863245+0000","last_became_active":"2024-05-08T18:29:46.594672+0000","last_became_peered":"2024-05-08T18:29:46.594672+0000","last_unstale":"2024-05-08T18:33:08.863245+0000","last_undegraded":"2024-05-08T18:33:08.863245+0000","last_fullsized":"2024-05-08T18:33:08.863245+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'34","last_scrub_stamp":"2024-05-08T18:33:08.863016+0000","last_deep_scrub":"116'34","last_deep_scrub_stamp":"2024-05-08T18:33:08.863016+0000","last_clean_scrub_stamp":"2024-05-08T18:33:08.863016+0000","objects_scrubbed":5,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:25:58.925047+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":28,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":189,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:33.186526+0000","last_change":"2024-05-08T18:33:33.186582+0000","last_active":"2024-05-08T18:33:33.186526+0000","last_peered":"2024-05-08T18:33:33.186526+0000","last_clean":"2024-05-08T18:33:33.186526+0000","last_became_active":"2024-05-08T18:29:48.639120+0000","last_became_peered":"2024-05-08T18:29:48.639120+0000","last_unstale":"2024-05-08T18:33:33.186526+0000","last_undegraded":"2024-05-08T18:33:33.186526+0000","last_fullsized":"2024-05-08T18:33:33.186526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:33.186314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:33.186314+0000","last_clean_scrub_stamp":"2024-05-08T18:33:33.186314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:16:17.889471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"84'2","reported_seq":189,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:09.807214+0000","last_change":"2024-05-08T18:33:09.807280+0000","last_active":"2024-05-08T18:33:09.807214+0000","last_peered":"2024-05-08T18:33:09.807214+0000","last_clean":"2024-05-08T18:33:09.807214+0000","last_became_active":"2024-05-08T18:29:50.684119+0000","last_became_peered":"2024-05-08T18:29:50.684119+0000","last_unstale":"2024-05-08T18:33:09.807214+0000","last_undegraded":"2024-05-08T18:33:09.807214+0000","last_fullsized":"2024-05-08T18:33:09.807214+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'2","last_scrub_stamp":"2024-05-08T18:33:09.807009+0000","last_deep_scrub":"84'2","last_deep_scrub_stamp":"2024-05-08T18:33:09.807009+0000","last_clean_scrub_stamp":"2024-05-08T18:33:09.807009+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:08:54.871793+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"80'2","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:12.823521+0000","last_change":"2024-05-08T18:33:12.823521+0000","last_active":"2024-05-08T18:33:12.823521+0000","last_peered":"2024-05-08T18:33:12.823521+0000","last_clean":"2024-05-08T18:33:12.823521+0000","last_became_active":"2024-05-08T18:29:42.575450+0000","last_became_peered":"2024-05-08T18:29:42.575450+0000","last_unstale":"2024-05-08T18:33:12.823521+0000","last_undegraded":"2024-05-08T18:33:12.823521+0000","last_fullsized":"2024-05-08T18:33:12.823521+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2","last_scrub_stamp":"2024-05-08T18:33:12.823265+0000","last_deep_scrub":"80'2","last_deep_scrub_stamp":"2024-05-08T18:33:12.823265+0000","last_clean_scrub_stamp":"2024-05-08T18:33:12.823265+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:39.660112+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"116'20","reported_seq":228,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:19.821539+0000","last_change":"2024-05-08T18:33:19.821600+0000","last_active":"2024-05-08T18:33:19.821539+0000","last_peered":"2024-05-08T18:33:19.821539+0000","last_clean":"2024-05-08T18:33:19.821539+0000","last_became_active":"2024-05-08T18:29:40.545814+0000","last_became_peered":"2024-05-08T18:29:40.545814+0000","last_unstale":"2024-05-08T18:33:19.821539+0000","last_undegraded":"2024-05-08T18:33:19.821539+0000","last_fullsized":"2024-05-08T18:33:19.821539+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'20","last_scrub_stamp":"2024-05-08T18:33:19.821340+0000","last_deep_scrub":"116'20","last_deep_scrub_stamp":"2024-05-08T18:33:19.821340+0000","last_clean_scrub_stamp":"2024-05-08T18:33:19.821340+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:13:44.745049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":196,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:04.613945+0000","last_change":"2024-05-08T18:33:04.613945+0000","last_active":"2024-05-08T18:33:04.613945+0000","last_peered":"2024-05-08T18:33:04.613945+0000","last_clean":"2024-05-08T18:33:04.613945+0000","last_became_active":"2024-05-08T18:29:44.590394+0000","last_became_peered":"2024-05-08T18:29:44.590394+0000","last_unstale":"2024-05-08T18:33:04.613945+0000","last_undegraded":"2024-05-08T18:33:04.613945+0000","last_fullsized":"2024-05-08T18:33:04.613945+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:04.613567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:04.613567+0000","last_clean_scrub_stamp":"2024-05-08T18:33:04.613567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:16:36.059115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"116'30","reported_seq":235,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:15.801699+0000","last_change":"2024-05-08T18:33:15.801788+0000","last_active":"2024-05-08T18:33:15.801699+0000","last_peered":"2024-05-08T18:33:15.801699+0000","last_clean":"2024-05-08T18:33:15.801699+0000","last_became_active":"2024-05-08T18:29:46.604917+0000","last_became_peered":"2024-05-08T18:29:46.604917+0000","last_unstale":"2024-05-08T18:33:15.801699+0000","last_undegraded":"2024-05-08T18:33:15.801699+0000","last_fullsized":"2024-05-08T18:33:15.801699+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'30","last_scrub_stamp":"2024-05-08T18:33:15.801482+0000","last_deep_scrub":"116'30","last_deep_scrub_stamp":"2024-05-08T18:33:15.801482+0000","last_clean_scrub_stamp":"2024-05-08T18:33:15.801482+0000","objects_scrubbed":7,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:10:20.396630+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:23.799420+0000","last_change":"2024-05-08T18:33:23.799545+0000","last_active":"2024-05-08T18:33:23.799420+0000","last_peered":"2024-05-08T18:33:23.799420+0000","last_clean":"2024-05-08T18:33:23.799420+0000","last_became_active":"2024-05-08T18:29:48.643493+0000","last_became_peered":"2024-05-08T18:29:48.643493+0000","last_unstale":"2024-05-08T18:33:23.799420+0000","last_undegraded":"2024-05-08T18:33:23.799420+0000","last_fullsized":"2024-05-08T18:33:23.799420+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:23.799156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:23.799156+0000","last_clean_scrub_stamp":"2024-05-08T18:33:23.799156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:34.597706+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:27.789447+0000","last_change":"2024-05-08T18:33:27.789508+0000","last_active":"2024-05-08T18:33:27.789447+0000","last_peered":"2024-05-08T18:33:27.789447+0000","last_clean":"2024-05-08T18:33:27.789447+0000","last_became_active":"2024-05-08T18:29:50.686750+0000","last_became_peered":"2024-05-08T18:29:50.686750+0000","last_unstale":"2024-05-08T18:33:27.789447+0000","last_undegraded":"2024-05-08T18:33:27.789447+0000","last_fullsized":"2024-05-08T18:33:27.789447+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:27.789239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:27.789239+0000","last_clean_scrub_stamp":"2024-05-08T18:33:27.789239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:10:32.384388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"97'4","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:16.872227+0000","last_change":"2024-05-08T18:33:16.872286+0000","last_active":"2024-05-08T18:33:16.872227+0000","last_peered":"2024-05-08T18:33:16.872227+0000","last_clean":"2024-05-08T18:33:16.872227+0000","last_became_active":"2024-05-08T18:29:42.563695+0000","last_became_peered":"2024-05-08T18:29:42.563695+0000","last_unstale":"2024-05-08T18:33:16.872227+0000","last_undegraded":"2024-05-08T18:33:16.872227+0000","last_fullsized":"2024-05-08T18:33:16.872227+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'4","last_scrub_stamp":"2024-05-08T18:33:16.872024+0000","last_deep_scrub":"97'4","last_deep_scrub_stamp":"2024-05-08T18:33:16.872024+0000","last_clean_scrub_stamp":"2024-05-08T18:33:16.872024+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:43:07.312322+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"116'20","reported_seq":228,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:23.516228+0000","last_change":"2024-05-08T18:33:23.516288+0000","last_active":"2024-05-08T18:33:23.516228+0000","last_peered":"2024-05-08T18:33:23.516228+0000","last_clean":"2024-05-08T18:33:23.516228+0000","last_became_active":"2024-05-08T18:29:40.544216+0000","last_became_peered":"2024-05-08T18:29:40.544216+0000","last_unstale":"2024-05-08T18:33:23.516228+0000","last_undegraded":"2024-05-08T18:33:23.516228+0000","last_fullsized":"2024-05-08T18:33:23.516228+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'20","last_scrub_stamp":"2024-05-08T18:33:23.516026+0000","last_deep_scrub":"116'20","last_deep_scrub_stamp":"2024-05-08T18:33:23.516026+0000","last_clean_scrub_stamp":"2024-05-08T18:33:23.516026+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:27:36.796416+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:17.484593+0000","last_change":"2024-05-08T18:33:17.484650+0000","last_active":"2024-05-08T18:33:17.484593+0000","last_peered":"2024-05-08T18:33:17.484593+0000","last_clean":"2024-05-08T18:33:17.484593+0000","last_became_active":"2024-05-08T18:29:44.575344+0000","last_became_peered":"2024-05-08T18:29:44.575344+0000","last_unstale":"2024-05-08T18:33:17.484593+0000","last_undegraded":"2024-05-08T18:33:17.484593+0000","last_fullsized":"2024-05-08T18:33:17.484593+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:17.484366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:17.484366+0000","last_clean_scrub_stamp":"2024-05-08T18:33:17.484366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:58:12.466927+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"116'24","reported_seq":231,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:23.899100+0000","last_change":"2024-05-08T18:33:23.899100+0000","last_active":"2024-05-08T18:33:23.899100+0000","last_peered":"2024-05-08T18:33:23.899100+0000","last_clean":"2024-05-08T18:33:23.899100+0000","last_became_active":"2024-05-08T18:29:46.583390+0000","last_became_peered":"2024-05-08T18:29:46.583390+0000","last_unstale":"2024-05-08T18:33:23.899100+0000","last_undegraded":"2024-05-08T18:33:23.899100+0000","last_fullsized":"2024-05-08T18:33:23.899100+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'24","last_scrub_stamp":"2024-05-08T18:33:23.898821+0000","last_deep_scrub":"116'24","last_deep_scrub_stamp":"2024-05-08T18:33:23.898821+0000","last_clean_scrub_stamp":"2024-05-08T18:33:23.898821+0000","objects_scrubbed":5,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:37:30.737404+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":193,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:22.771647+0000","last_change":"2024-05-08T18:33:22.771647+0000","last_active":"2024-05-08T18:33:22.771647+0000","last_peered":"2024-05-08T18:33:22.771647+0000","last_clean":"2024-05-08T18:33:22.771647+0000","last_became_active":"2024-05-08T18:29:48.642773+0000","last_became_peered":"2024-05-08T18:29:48.642773+0000","last_unstale":"2024-05-08T18:33:22.771647+0000","last_undegraded":"2024-05-08T18:33:22.771647+0000","last_fullsized":"2024-05-08T18:33:22.771647+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:22.771367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:22.771367+0000","last_clean_scrub_stamp":"2024-05-08T18:33:22.771367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:58:17.753928+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":185,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:36.212011+0000","last_change":"2024-05-08T18:33:36.212071+0000","last_active":"2024-05-08T18:33:36.212011+0000","last_peered":"2024-05-08T18:33:36.212011+0000","last_clean":"2024-05-08T18:33:36.212011+0000","last_became_active":"2024-05-08T18:29:50.674057+0000","last_became_peered":"2024-05-08T18:29:50.674057+0000","last_unstale":"2024-05-08T18:33:36.212011+0000","last_undegraded":"2024-05-08T18:33:36.212011+0000","last_fullsized":"2024-05-08T18:33:36.212011+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:36.211804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:36.211804+0000","last_clean_scrub_stamp":"2024-05-08T18:33:36.211804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:07.724846+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"84'4","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:12.840235+0000","last_change":"2024-05-08T18:33:12.840300+0000","last_active":"2024-05-08T18:33:12.840235+0000","last_peered":"2024-05-08T18:33:12.840235+0000","last_clean":"2024-05-08T18:33:12.840235+0000","last_became_active":"2024-05-08T18:29:42.577275+0000","last_became_peered":"2024-05-08T18:29:42.577275+0000","last_unstale":"2024-05-08T18:33:12.840235+0000","last_undegraded":"2024-05-08T18:33:12.840235+0000","last_fullsized":"2024-05-08T18:33:12.840235+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'4","last_scrub_stamp":"2024-05-08T18:33:12.840024+0000","last_deep_scrub":"84'4","last_deep_scrub_stamp":"2024-05-08T18:33:12.840024+0000","last_clean_scrub_stamp":"2024-05-08T18:33:12.840024+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:22:36.970609+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"116'20","reported_seq":226,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:23.956798+0000","last_change":"2024-05-08T18:33:23.956858+0000","last_active":"2024-05-08T18:33:23.956798+0000","last_peered":"2024-05-08T18:33:23.956798+0000","last_clean":"2024-05-08T18:33:23.956798+0000","last_became_active":"2024-05-08T18:29:40.562594+0000","last_became_peered":"2024-05-08T18:29:40.562594+0000","last_unstale":"2024-05-08T18:33:23.956798+0000","last_undegraded":"2024-05-08T18:33:23.956798+0000","last_fullsized":"2024-05-08T18:33:23.956798+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'20","last_scrub_stamp":"2024-05-08T18:33:23.956667+0000","last_deep_scrub":"116'20","last_deep_scrub_stamp":"2024-05-08T18:33:23.956667+0000","last_clean_scrub_stamp":"2024-05-08T18:33:23.956667+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:37:30.795250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:02.892497+0000","last_change":"2024-05-08T18:33:02.892518+0000","last_active":"2024-05-08T18:33:02.892497+0000","last_peered":"2024-05-08T18:33:02.892497+0000","last_clean":"2024-05-08T18:33:02.892497+0000","last_became_active":"2024-05-08T18:29:44.593398+0000","last_became_peered":"2024-05-08T18:29:44.593398+0000","last_unstale":"2024-05-08T18:33:02.892497+0000","last_undegraded":"2024-05-08T18:33:02.892497+0000","last_fullsized":"2024-05-08T18:33:02.892497+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:02.892415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:02.892415+0000","last_clean_scrub_stamp":"2024-05-08T18:33:02.892415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:22:27.022999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"116'19","reported_seq":221,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:04.643045+0000","last_change":"2024-05-08T18:33:04.643045+0000","last_active":"2024-05-08T18:33:04.643045+0000","last_peered":"2024-05-08T18:33:04.643045+0000","last_clean":"2024-05-08T18:33:04.643045+0000","last_became_active":"2024-05-08T18:29:46.601402+0000","last_became_peered":"2024-05-08T18:29:46.601402+0000","last_unstale":"2024-05-08T18:33:04.643045+0000","last_undegraded":"2024-05-08T18:33:04.643045+0000","last_fullsized":"2024-05-08T18:33:04.643045+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'19","last_scrub_stamp":"2024-05-08T18:33:04.642767+0000","last_deep_scrub":"116'19","last_deep_scrub_stamp":"2024-05-08T18:33:04.642767+0000","last_clean_scrub_stamp":"2024-05-08T18:33:04.642767+0000","objects_scrubbed":7,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:00:52.021694+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":22,"num_read_kb":17,"num_write":24,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3118,"num_omap_keys":14,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"116'105","reported_seq":342,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:22.738929+0000","last_change":"2024-05-08T18:33:22.738929+0000","last_active":"2024-05-08T18:33:22.738929+0000","last_peered":"2024-05-08T18:33:22.738929+0000","last_clean":"2024-05-08T18:33:22.738929+0000","last_became_active":"2024-05-08T18:29:48.634859+0000","last_became_peered":"2024-05-08T18:29:48.634859+0000","last_unstale":"2024-05-08T18:33:22.738929+0000","last_undegraded":"2024-05-08T18:33:22.738929+0000","last_fullsized":"2024-05-08T18:33:22.738929+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'105","last_scrub_stamp":"2024-05-08T18:33:22.738662+0000","last_deep_scrub":"116'105","last_deep_scrub_stamp":"2024-05-08T18:33:22.738662+0000","last_clean_scrub_stamp":"2024-05-08T18:33:22.738662+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:06:57.423975+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":183,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:34.703817+0000","last_change":"2024-05-08T18:33:34.703932+0000","last_active":"2024-05-08T18:33:34.703817+0000","last_peered":"2024-05-08T18:33:34.703817+0000","last_clean":"2024-05-08T18:33:34.703817+0000","last_became_active":"2024-05-08T18:29:50.679011+0000","last_became_peered":"2024-05-08T18:29:50.679011+0000","last_unstale":"2024-05-08T18:33:34.703817+0000","last_undegraded":"2024-05-08T18:33:34.703817+0000","last_fullsized":"2024-05-08T18:33:34.703817+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:34.703526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:34.703526+0000","last_clean_scrub_stamp":"2024-05-08T18:33:34.703526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:47:10.490340+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"84'8","reported_seq":224,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:16.487806+0000","last_change":"2024-05-08T18:33:16.487867+0000","last_active":"2024-05-08T18:33:16.487806+0000","last_peered":"2024-05-08T18:33:16.487806+0000","last_clean":"2024-05-08T18:33:16.487806+0000","last_became_active":"2024-05-08T18:29:42.559647+0000","last_became_peered":"2024-05-08T18:29:42.559647+0000","last_unstale":"2024-05-08T18:33:16.487806+0000","last_undegraded":"2024-05-08T18:33:16.487806+0000","last_fullsized":"2024-05-08T18:33:16.487806+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'8","last_scrub_stamp":"2024-05-08T18:33:16.487609+0000","last_deep_scrub":"84'8","last_deep_scrub_stamp":"2024-05-08T18:33:16.487609+0000","last_clean_scrub_stamp":"2024-05-08T18:33:16.487609+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:35:39.223647+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"116'20","reported_seq":225,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:19.115714+0000","last_change":"2024-05-08T18:33:19.115777+0000","last_active":"2024-05-08T18:33:19.115714+0000","last_peered":"2024-05-08T18:33:19.115714+0000","last_clean":"2024-05-08T18:33:19.115714+0000","last_became_active":"2024-05-08T18:29:40.556254+0000","last_became_peered":"2024-05-08T18:29:40.556254+0000","last_unstale":"2024-05-08T18:33:19.115714+0000","last_undegraded":"2024-05-08T18:33:19.115714+0000","last_fullsized":"2024-05-08T18:33:19.115714+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'20","last_scrub_stamp":"2024-05-08T18:33:19.115512+0000","last_deep_scrub":"116'20","last_deep_scrub_stamp":"2024-05-08T18:33:19.115512+0000","last_clean_scrub_stamp":"2024-05-08T18:33:19.115512+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:11:18.837286+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":195,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:09.923190+0000","last_change":"2024-05-08T18:33:09.923244+0000","last_active":"2024-05-08T18:33:09.923190+0000","last_peered":"2024-05-08T18:33:09.923190+0000","last_clean":"2024-05-08T18:33:09.923190+0000","last_became_active":"2024-05-08T18:29:44.593322+0000","last_became_peered":"2024-05-08T18:29:44.593322+0000","last_unstale":"2024-05-08T18:33:09.923190+0000","last_undegraded":"2024-05-08T18:33:09.923190+0000","last_fullsized":"2024-05-08T18:33:09.923190+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:09.922968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:09.922968+0000","last_clean_scrub_stamp":"2024-05-08T18:33:09.922968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:17:20.477717+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"116'32","reported_seq":239,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:03.096508+0000","last_change":"2024-05-08T18:33:03.096597+0000","last_active":"2024-05-08T18:33:03.096508+0000","last_peered":"2024-05-08T18:33:03.096508+0000","last_clean":"2024-05-08T18:33:03.096508+0000","last_became_active":"2024-05-08T18:29:46.603885+0000","last_became_peered":"2024-05-08T18:29:46.603885+0000","last_unstale":"2024-05-08T18:33:03.096508+0000","last_undegraded":"2024-05-08T18:33:03.096508+0000","last_fullsized":"2024-05-08T18:33:03.096508+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'32","last_scrub_stamp":"2024-05-08T18:33:03.096330+0000","last_deep_scrub":"116'32","last_deep_scrub_stamp":"2024-05-08T18:33:03.096330+0000","last_clean_scrub_stamp":"2024-05-08T18:33:03.096330+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:00:50.475257+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":37,"num_read_kb":44,"num_write":22,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.856211+0000","last_change":"2024-05-08T18:33:06.856265+0000","last_active":"2024-05-08T18:33:06.856211+0000","last_peered":"2024-05-08T18:33:06.856211+0000","last_clean":"2024-05-08T18:33:06.856211+0000","last_became_active":"2024-05-08T18:29:48.640046+0000","last_became_peered":"2024-05-08T18:29:48.640046+0000","last_unstale":"2024-05-08T18:33:06.856211+0000","last_undegraded":"2024-05-08T18:33:06.856211+0000","last_fullsized":"2024-05-08T18:33:06.856211+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:06.856012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:06.856012+0000","last_clean_scrub_stamp":"2024-05-08T18:33:06.856012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:46:46.459558+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"83'8","reported_seq":197,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:36.766428+0000","last_change":"2024-05-08T18:33:36.766571+0000","last_active":"2024-05-08T18:33:36.766428+0000","last_peered":"2024-05-08T18:33:36.766428+0000","last_clean":"2024-05-08T18:33:36.766428+0000","last_became_active":"2024-05-08T18:29:50.692123+0000","last_became_peered":"2024-05-08T18:29:50.692123+0000","last_unstale":"2024-05-08T18:33:36.766428+0000","last_undegraded":"2024-05-08T18:33:36.766428+0000","last_fullsized":"2024-05-08T18:33:36.766428+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'8","last_scrub_stamp":"2024-05-08T18:33:36.766131+0000","last_deep_scrub":"83'8","last_deep_scrub_stamp":"2024-05-08T18:33:36.766131+0000","last_clean_scrub_stamp":"2024-05-08T18:33:36.766131+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:08.279173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"97'2","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:20.552469+0000","last_change":"2024-05-08T18:33:20.552530+0000","last_active":"2024-05-08T18:33:20.552469+0000","last_peered":"2024-05-08T18:33:20.552469+0000","last_clean":"2024-05-08T18:33:20.552469+0000","last_became_active":"2024-05-08T18:29:42.557570+0000","last_became_peered":"2024-05-08T18:29:42.557570+0000","last_unstale":"2024-05-08T18:33:20.552469+0000","last_undegraded":"2024-05-08T18:33:20.552469+0000","last_fullsized":"2024-05-08T18:33:20.552469+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'2","last_scrub_stamp":"2024-05-08T18:33:20.552269+0000","last_deep_scrub":"97'2","last_deep_scrub_stamp":"2024-05-08T18:33:20.552269+0000","last_clean_scrub_stamp":"2024-05-08T18:33:20.552269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:51.339225+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"116'4","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:26.194463+0000","last_change":"2024-05-08T18:33:26.194526+0000","last_active":"2024-05-08T18:33:26.194463+0000","last_peered":"2024-05-08T18:33:26.194463+0000","last_clean":"2024-05-08T18:33:26.194463+0000","last_became_active":"2024-05-08T18:29:40.536188+0000","last_became_peered":"2024-05-08T18:29:40.536188+0000","last_unstale":"2024-05-08T18:33:26.194463+0000","last_undegraded":"2024-05-08T18:33:26.194463+0000","last_fullsized":"2024-05-08T18:33:26.194463+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'4","last_scrub_stamp":"2024-05-08T18:33:26.194240+0000","last_deep_scrub":"116'4","last_deep_scrub_stamp":"2024-05-08T18:33:26.194240+0000","last_clean_scrub_stamp":"2024-05-08T18:33:26.194240+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:59:59.739889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":197,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:16.171229+0000","last_change":"2024-05-08T18:33:16.171351+0000","last_active":"2024-05-08T18:33:16.171229+0000","last_peered":"2024-05-08T18:33:16.171229+0000","last_clean":"2024-05-08T18:33:16.171229+0000","last_became_active":"2024-05-08T18:29:44.578171+0000","last_became_peered":"2024-05-08T18:29:44.578171+0000","last_unstale":"2024-05-08T18:33:16.171229+0000","last_undegraded":"2024-05-08T18:33:16.171229+0000","last_fullsized":"2024-05-08T18:33:16.171229+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:16.170996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:16.170996+0000","last_clean_scrub_stamp":"2024-05-08T18:33:16.170996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:35:38.907034+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"116'23","reported_seq":228,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.875357+0000","last_change":"2024-05-08T18:33:05.875438+0000","last_active":"2024-05-08T18:33:05.875357+0000","last_peered":"2024-05-08T18:33:05.875357+0000","last_clean":"2024-05-08T18:33:05.875357+0000","last_became_active":"2024-05-08T18:29:46.603728+0000","last_became_peered":"2024-05-08T18:29:46.603728+0000","last_unstale":"2024-05-08T18:33:05.875357+0000","last_undegraded":"2024-05-08T18:33:05.875357+0000","last_fullsized":"2024-05-08T18:33:05.875357+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'23","last_scrub_stamp":"2024-05-08T18:33:05.875140+0000","last_deep_scrub":"116'23","last_deep_scrub_stamp":"2024-05-08T18:33:05.875140+0000","last_clean_scrub_stamp":"2024-05-08T18:33:05.875140+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:24:25.422367+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":187,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:23.731205+0000","last_change":"2024-05-08T18:33:23.731263+0000","last_active":"2024-05-08T18:33:23.731205+0000","last_peered":"2024-05-08T18:33:23.731205+0000","last_clean":"2024-05-08T18:33:23.731205+0000","last_became_active":"2024-05-08T18:29:48.634664+0000","last_became_peered":"2024-05-08T18:29:48.634664+0000","last_unstale":"2024-05-08T18:33:23.731205+0000","last_undegraded":"2024-05-08T18:33:23.731205+0000","last_fullsized":"2024-05-08T18:33:23.731205+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:23.731009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:23.731009+0000","last_clean_scrub_stamp":"2024-05-08T18:33:23.731009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:04:32.165518+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"97'7","reported_seq":196,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:36.888980+0000","last_change":"2024-05-08T18:33:36.889044+0000","last_active":"2024-05-08T18:33:36.888980+0000","last_peered":"2024-05-08T18:33:36.888980+0000","last_clean":"2024-05-08T18:33:36.888980+0000","last_became_active":"2024-05-08T18:29:50.686662+0000","last_became_peered":"2024-05-08T18:29:50.686662+0000","last_unstale":"2024-05-08T18:33:36.888980+0000","last_undegraded":"2024-05-08T18:33:36.888980+0000","last_fullsized":"2024-05-08T18:33:36.888980+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'7","last_scrub_stamp":"2024-05-08T18:33:36.888764+0000","last_deep_scrub":"97'7","last_deep_scrub_stamp":"2024-05-08T18:33:36.888764+0000","last_clean_scrub_stamp":"2024-05-08T18:33:36.888764+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:25:54.181959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"97'4","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:22.919449+0000","last_change":"2024-05-08T18:33:22.919529+0000","last_active":"2024-05-08T18:33:22.919449+0000","last_peered":"2024-05-08T18:33:22.919449+0000","last_clean":"2024-05-08T18:33:22.919449+0000","last_became_active":"2024-05-08T18:29:42.558390+0000","last_became_peered":"2024-05-08T18:29:42.558390+0000","last_unstale":"2024-05-08T18:33:22.919449+0000","last_undegraded":"2024-05-08T18:33:22.919449+0000","last_fullsized":"2024-05-08T18:33:22.919449+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'4","last_scrub_stamp":"2024-05-08T18:33:22.919230+0000","last_deep_scrub":"97'4","last_deep_scrub_stamp":"2024-05-08T18:33:22.919230+0000","last_clean_scrub_stamp":"2024-05-08T18:33:22.919230+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:24:49.333241+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"116'14","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:24.886484+0000","last_change":"2024-05-08T18:33:24.886484+0000","last_active":"2024-05-08T18:33:24.886484+0000","last_peered":"2024-05-08T18:33:24.886484+0000","last_clean":"2024-05-08T18:33:24.886484+0000","last_became_active":"2024-05-08T18:29:40.567482+0000","last_became_peered":"2024-05-08T18:29:40.567482+0000","last_unstale":"2024-05-08T18:33:24.886484+0000","last_undegraded":"2024-05-08T18:33:24.886484+0000","last_fullsized":"2024-05-08T18:33:24.886484+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'14","last_scrub_stamp":"2024-05-08T18:33:24.886178+0000","last_deep_scrub":"116'14","last_deep_scrub_stamp":"2024-05-08T18:33:24.886178+0000","last_clean_scrub_stamp":"2024-05-08T18:33:24.886178+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:54:15.092204+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":5,"num_write":24,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:31.654745+0000","last_change":"2024-05-08T18:33:31.654884+0000","last_active":"2024-05-08T18:33:31.654745+0000","last_peered":"2024-05-08T18:33:31.654745+0000","last_clean":"2024-05-08T18:33:31.654745+0000","last_became_active":"2024-05-08T18:29:44.595712+0000","last_became_peered":"2024-05-08T18:29:44.595712+0000","last_unstale":"2024-05-08T18:33:31.654745+0000","last_undegraded":"2024-05-08T18:33:31.654745+0000","last_fullsized":"2024-05-08T18:33:31.654745+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:31.654521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:31.654521+0000","last_clean_scrub_stamp":"2024-05-08T18:33:31.654521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:39:40.017626+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"116'15","reported_seq":218,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:08.788147+0000","last_change":"2024-05-08T18:33:08.788218+0000","last_active":"2024-05-08T18:33:08.788147+0000","last_peered":"2024-05-08T18:33:08.788147+0000","last_clean":"2024-05-08T18:33:08.788147+0000","last_became_active":"2024-05-08T18:29:46.597394+0000","last_became_peered":"2024-05-08T18:29:46.597394+0000","last_unstale":"2024-05-08T18:33:08.788147+0000","last_undegraded":"2024-05-08T18:33:08.788147+0000","last_fullsized":"2024-05-08T18:33:08.788147+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'15","last_scrub_stamp":"2024-05-08T18:33:08.787951+0000","last_deep_scrub":"116'15","last_deep_scrub_stamp":"2024-05-08T18:33:08.787951+0000","last_clean_scrub_stamp":"2024-05-08T18:33:08.787951+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:00:35.606964+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":13,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":192,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:34.566795+0000","last_change":"2024-05-08T18:33:34.566899+0000","last_active":"2024-05-08T18:33:34.566795+0000","last_peered":"2024-05-08T18:33:34.566795+0000","last_clean":"2024-05-08T18:33:34.566795+0000","last_became_active":"2024-05-08T18:29:48.641666+0000","last_became_peered":"2024-05-08T18:29:48.641666+0000","last_unstale":"2024-05-08T18:33:34.566795+0000","last_undegraded":"2024-05-08T18:33:34.566795+0000","last_fullsized":"2024-05-08T18:33:34.566795+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:34.566550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:34.566550+0000","last_clean_scrub_stamp":"2024-05-08T18:33:34.566550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:05:05.965379+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"80'2","reported_seq":186,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:35.751990+0000","last_change":"2024-05-08T18:33:35.752051+0000","last_active":"2024-05-08T18:33:35.751990+0000","last_peered":"2024-05-08T18:33:35.751990+0000","last_clean":"2024-05-08T18:33:35.751990+0000","last_became_active":"2024-05-08T18:29:50.684958+0000","last_became_peered":"2024-05-08T18:29:50.684958+0000","last_unstale":"2024-05-08T18:33:35.751990+0000","last_undegraded":"2024-05-08T18:33:35.751990+0000","last_fullsized":"2024-05-08T18:33:35.751990+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2","last_scrub_stamp":"2024-05-08T18:33:35.751762+0000","last_deep_scrub":"80'2","last_deep_scrub_stamp":"2024-05-08T18:33:35.751762+0000","last_clean_scrub_stamp":"2024-05-08T18:33:35.751762+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:44:39.740743+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:12.489733+0000","last_change":"2024-05-08T18:33:12.489788+0000","last_active":"2024-05-08T18:33:12.489733+0000","last_peered":"2024-05-08T18:33:12.489733+0000","last_clean":"2024-05-08T18:33:12.489733+0000","last_became_active":"2024-05-08T18:29:42.558871+0000","last_became_peered":"2024-05-08T18:29:42.558871+0000","last_unstale":"2024-05-08T18:33:12.489733+0000","last_undegraded":"2024-05-08T18:33:12.489733+0000","last_fullsized":"2024-05-08T18:33:12.489733+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:12.489544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:12.489544+0000","last_clean_scrub_stamp":"2024-05-08T18:33:12.489544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:59:53.448595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"116'26","reported_seq":233,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:26.015123+0000","last_change":"2024-05-08T18:33:26.015123+0000","last_active":"2024-05-08T18:33:26.015123+0000","last_peered":"2024-05-08T18:33:26.015123+0000","last_clean":"2024-05-08T18:33:26.015123+0000","last_became_active":"2024-05-08T18:29:40.540767+0000","last_became_peered":"2024-05-08T18:29:40.540767+0000","last_unstale":"2024-05-08T18:33:26.015123+0000","last_undegraded":"2024-05-08T18:33:26.015123+0000","last_fullsized":"2024-05-08T18:33:26.015123+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'26","last_scrub_stamp":"2024-05-08T18:33:26.014716+0000","last_deep_scrub":"116'26","last_deep_scrub_stamp":"2024-05-08T18:33:26.014716+0000","last_clean_scrub_stamp":"2024-05-08T18:33:26.014716+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:11:56.660233+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":26,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"116'2","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:01.923856+0000","last_change":"2024-05-08T18:33:01.923882+0000","last_active":"2024-05-08T18:33:01.923856+0000","last_peered":"2024-05-08T18:33:01.923856+0000","last_clean":"2024-05-08T18:33:01.923856+0000","last_became_active":"2024-05-08T18:29:44.592243+0000","last_became_peered":"2024-05-08T18:29:44.592243+0000","last_unstale":"2024-05-08T18:33:01.923856+0000","last_undegraded":"2024-05-08T18:33:01.923856+0000","last_fullsized":"2024-05-08T18:33:01.923856+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'2","last_scrub_stamp":"2024-05-08T18:33:01.923772+0000","last_deep_scrub":"116'2","last_deep_scrub_stamp":"2024-05-08T18:33:01.923772+0000","last_clean_scrub_stamp":"2024-05-08T18:33:01.923772+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:50:30.729203+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"116'22","reported_seq":229,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.619868+0000","last_change":"2024-05-08T18:33:05.619945+0000","last_active":"2024-05-08T18:33:05.619868+0000","last_peered":"2024-05-08T18:33:05.619868+0000","last_clean":"2024-05-08T18:33:05.619868+0000","last_became_active":"2024-05-08T18:29:46.609903+0000","last_became_peered":"2024-05-08T18:29:46.609903+0000","last_unstale":"2024-05-08T18:33:05.619868+0000","last_undegraded":"2024-05-08T18:33:05.619868+0000","last_fullsized":"2024-05-08T18:33:05.619868+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'22","last_scrub_stamp":"2024-05-08T18:33:05.619687+0000","last_deep_scrub":"116'22","last_deep_scrub_stamp":"2024-05-08T18:33:05.619687+0000","last_clean_scrub_stamp":"2024-05-08T18:33:05.619687+0000","objects_scrubbed":4,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:10.533517+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":190,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:03.881406+0000","last_change":"2024-05-08T18:33:03.881434+0000","last_active":"2024-05-08T18:33:03.881406+0000","last_peered":"2024-05-08T18:33:03.881406+0000","last_clean":"2024-05-08T18:33:03.881406+0000","last_became_active":"2024-05-08T18:29:48.629204+0000","last_became_peered":"2024-05-08T18:29:48.629204+0000","last_unstale":"2024-05-08T18:33:03.881406+0000","last_undegraded":"2024-05-08T18:33:03.881406+0000","last_fullsized":"2024-05-08T18:33:03.881406+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:03.881311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:03.881311+0000","last_clean_scrub_stamp":"2024-05-08T18:33:03.881311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:23:16.472058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"84'6","reported_seq":197,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:36.607311+0000","last_change":"2024-05-08T18:33:36.607378+0000","last_active":"2024-05-08T18:33:36.607311+0000","last_peered":"2024-05-08T18:33:36.607311+0000","last_clean":"2024-05-08T18:33:36.607311+0000","last_became_active":"2024-05-08T18:29:50.667357+0000","last_became_peered":"2024-05-08T18:29:50.667357+0000","last_unstale":"2024-05-08T18:33:36.607311+0000","last_undegraded":"2024-05-08T18:33:36.607311+0000","last_fullsized":"2024-05-08T18:33:36.607311+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'6","last_scrub_stamp":"2024-05-08T18:33:36.607112+0000","last_deep_scrub":"84'6","last_deep_scrub_stamp":"2024-05-08T18:33:36.607112+0000","last_clean_scrub_stamp":"2024-05-08T18:33:36.607112+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:08.120155+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"97'4","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:05.886329+0000","last_change":"2024-05-08T18:33:05.886394+0000","last_active":"2024-05-08T18:33:05.886329+0000","last_peered":"2024-05-08T18:33:05.886329+0000","last_clean":"2024-05-08T18:33:05.886329+0000","last_became_active":"2024-05-08T18:29:42.580988+0000","last_became_peered":"2024-05-08T18:29:42.580988+0000","last_unstale":"2024-05-08T18:33:05.886329+0000","last_undegraded":"2024-05-08T18:33:05.886329+0000","last_fullsized":"2024-05-08T18:33:05.886329+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'4","last_scrub_stamp":"2024-05-08T18:33:05.886129+0000","last_deep_scrub":"97'4","last_deep_scrub_stamp":"2024-05-08T18:33:05.886129+0000","last_clean_scrub_stamp":"2024-05-08T18:33:05.886129+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:29:32.496922+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"116'16","reported_seq":221,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:14.499338+0000","last_change":"2024-05-08T18:33:14.499338+0000","last_active":"2024-05-08T18:33:14.499338+0000","last_peered":"2024-05-08T18:33:14.499338+0000","last_clean":"2024-05-08T18:33:14.499338+0000","last_became_active":"2024-05-08T18:29:40.561277+0000","last_became_peered":"2024-05-08T18:29:40.561277+0000","last_unstale":"2024-05-08T18:33:14.499338+0000","last_undegraded":"2024-05-08T18:33:14.499338+0000","last_fullsized":"2024-05-08T18:33:14.499338+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'16","last_scrub_stamp":"2024-05-08T18:33:14.499083+0000","last_deep_scrub":"116'16","last_deep_scrub_stamp":"2024-05-08T18:33:14.499083+0000","last_clean_scrub_stamp":"2024-05-08T18:33:14.499083+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:59:51.019008+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":3,"num_write":26,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:13.783798+0000","last_change":"2024-05-08T18:33:13.783860+0000","last_active":"2024-05-08T18:33:13.783798+0000","last_peered":"2024-05-08T18:33:13.783798+0000","last_clean":"2024-05-08T18:33:13.783798+0000","last_became_active":"2024-05-08T18:29:42.573502+0000","last_became_peered":"2024-05-08T18:29:42.573502+0000","last_unstale":"2024-05-08T18:33:13.783798+0000","last_undegraded":"2024-05-08T18:33:13.783798+0000","last_fullsized":"2024-05-08T18:33:13.783798+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:13.783580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:13.783580+0000","last_clean_scrub_stamp":"2024-05-08T18:33:13.783580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:09:34.659675+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"116'16","reported_seq":223,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.807725+0000","last_change":"2024-05-08T18:33:06.807725+0000","last_active":"2024-05-08T18:33:06.807725+0000","last_peered":"2024-05-08T18:33:06.807725+0000","last_clean":"2024-05-08T18:33:06.807725+0000","last_became_active":"2024-05-08T18:29:40.532246+0000","last_became_peered":"2024-05-08T18:29:40.532246+0000","last_unstale":"2024-05-08T18:33:06.807725+0000","last_undegraded":"2024-05-08T18:33:06.807725+0000","last_fullsized":"2024-05-08T18:33:06.807725+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'16","last_scrub_stamp":"2024-05-08T18:33:06.807472+0000","last_deep_scrub":"116'16","last_deep_scrub_stamp":"2024-05-08T18:33:06.807472+0000","last_clean_scrub_stamp":"2024-05-08T18:33:06.807472+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:16:38.253020+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":201,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:10.209861+0000","last_change":"2024-05-08T18:33:10.209964+0000","last_active":"2024-05-08T18:33:10.209861+0000","last_peered":"2024-05-08T18:33:10.209861+0000","last_clean":"2024-05-08T18:33:10.209861+0000","last_became_active":"2024-05-08T18:29:42.564542+0000","last_became_peered":"2024-05-08T18:29:42.564542+0000","last_unstale":"2024-05-08T18:33:10.209861+0000","last_undegraded":"2024-05-08T18:33:10.209861+0000","last_fullsized":"2024-05-08T18:33:10.209861+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:10.209551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:10.209551+0000","last_clean_scrub_stamp":"2024-05-08T18:33:10.209551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:06:44.894864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"116'28","reported_seq":234,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:23.171334+0000","last_change":"2024-05-08T18:33:23.171334+0000","last_active":"2024-05-08T18:33:23.171334+0000","last_peered":"2024-05-08T18:33:23.171334+0000","last_clean":"2024-05-08T18:33:23.171334+0000","last_became_active":"2024-05-08T18:29:40.556091+0000","last_became_peered":"2024-05-08T18:29:40.556091+0000","last_unstale":"2024-05-08T18:33:23.171334+0000","last_undegraded":"2024-05-08T18:33:23.171334+0000","last_fullsized":"2024-05-08T18:33:23.171334+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'28","last_scrub_stamp":"2024-05-08T18:33:23.170961+0000","last_deep_scrub":"116'28","last_deep_scrub_stamp":"2024-05-08T18:33:23.170961+0000","last_clean_scrub_stamp":"2024-05-08T18:33:23.170961+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:27:36.451350+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":28,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"97'6","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:09.831793+0000","last_change":"2024-05-08T18:33:09.831861+0000","last_active":"2024-05-08T18:33:09.831793+0000","last_peered":"2024-05-08T18:33:09.831793+0000","last_clean":"2024-05-08T18:33:09.831793+0000","last_became_active":"2024-05-08T18:29:42.573178+0000","last_became_peered":"2024-05-08T18:29:42.573178+0000","last_unstale":"2024-05-08T18:33:09.831793+0000","last_undegraded":"2024-05-08T18:33:09.831793+0000","last_fullsized":"2024-05-08T18:33:09.831793+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'6","last_scrub_stamp":"2024-05-08T18:33:09.831594+0000","last_deep_scrub":"97'6","last_deep_scrub_stamp":"2024-05-08T18:33:09.831594+0000","last_clean_scrub_stamp":"2024-05-08T18:33:09.831594+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:14.745423+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"116'10","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:28.046364+0000","last_change":"2024-05-08T18:33:28.046364+0000","last_active":"2024-05-08T18:33:28.046364+0000","last_peered":"2024-05-08T18:33:28.046364+0000","last_clean":"2024-05-08T18:33:28.046364+0000","last_became_active":"2024-05-08T18:29:40.544107+0000","last_became_peered":"2024-05-08T18:29:40.544107+0000","last_unstale":"2024-05-08T18:33:28.046364+0000","last_undegraded":"2024-05-08T18:33:28.046364+0000","last_fullsized":"2024-05-08T18:33:28.046364+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'10","last_scrub_stamp":"2024-05-08T18:33:28.046099+0000","last_deep_scrub":"116'10","last_deep_scrub_stamp":"2024-05-08T18:33:28.046099+0000","last_clean_scrub_stamp":"2024-05-08T18:33:28.046099+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:07:20.048036+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"84'2","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:11.748654+0000","last_change":"2024-05-08T18:33:11.748654+0000","last_active":"2024-05-08T18:33:11.748654+0000","last_peered":"2024-05-08T18:33:11.748654+0000","last_clean":"2024-05-08T18:33:11.748654+0000","last_became_active":"2024-05-08T18:29:42.576395+0000","last_became_peered":"2024-05-08T18:29:42.576395+0000","last_unstale":"2024-05-08T18:33:11.748654+0000","last_undegraded":"2024-05-08T18:33:11.748654+0000","last_fullsized":"2024-05-08T18:33:11.748654+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'2","last_scrub_stamp":"2024-05-08T18:33:11.748383+0000","last_deep_scrub":"84'2","last_deep_scrub_stamp":"2024-05-08T18:33:11.748383+0000","last_clean_scrub_stamp":"2024-05-08T18:33:11.748383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:10:47.774255+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"116'10","reported_seq":217,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:32.898677+0000","last_change":"2024-05-08T18:33:32.898677+0000","last_active":"2024-05-08T18:33:32.898677+0000","last_peered":"2024-05-08T18:33:32.898677+0000","last_clean":"2024-05-08T18:33:32.898677+0000","last_became_active":"2024-05-08T18:29:40.557874+0000","last_became_peered":"2024-05-08T18:29:40.557874+0000","last_unstale":"2024-05-08T18:33:32.898677+0000","last_undegraded":"2024-05-08T18:33:32.898677+0000","last_fullsized":"2024-05-08T18:33:32.898677+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'10","last_scrub_stamp":"2024-05-08T18:33:32.898422+0000","last_deep_scrub":"116'10","last_deep_scrub_stamp":"2024-05-08T18:33:32.898422+0000","last_clean_scrub_stamp":"2024-05-08T18:33:32.898422+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:21:03.200190+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"97'2","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:18.527420+0000","last_change":"2024-05-08T18:33:18.527420+0000","last_active":"2024-05-08T18:33:18.527420+0000","last_peered":"2024-05-08T18:33:18.527420+0000","last_clean":"2024-05-08T18:33:18.527420+0000","last_became_active":"2024-05-08T18:29:42.556774+0000","last_became_peered":"2024-05-08T18:29:42.556774+0000","last_unstale":"2024-05-08T18:33:18.527420+0000","last_undegraded":"2024-05-08T18:33:18.527420+0000","last_fullsized":"2024-05-08T18:33:18.527420+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'2","last_scrub_stamp":"2024-05-08T18:33:18.527147+0000","last_deep_scrub":"97'2","last_deep_scrub_stamp":"2024-05-08T18:33:18.527147+0000","last_clean_scrub_stamp":"2024-05-08T18:33:18.527147+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:49:29.325697+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"116'22","reported_seq":236,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:28.750462+0000","last_change":"2024-05-08T18:33:28.750462+0000","last_active":"2024-05-08T18:33:28.750462+0000","last_peered":"2024-05-08T18:33:28.750462+0000","last_clean":"2024-05-08T18:33:28.750462+0000","last_became_active":"2024-05-08T18:30:20.858016+0000","last_became_peered":"2024-05-08T18:30:20.858016+0000","last_unstale":"2024-05-08T18:33:28.750462+0000","last_undegraded":"2024-05-08T18:33:28.750462+0000","last_fullsized":"2024-05-08T18:33:28.750462+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'22","last_scrub_stamp":"2024-05-08T18:33:28.750194+0000","last_deep_scrub":"116'22","last_deep_scrub_stamp":"2024-05-08T18:33:28.750194+0000","last_clean_scrub_stamp":"2024-05-08T18:33:28.750194+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:27:42.030583+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"84'4","reported_seq":213,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:20.903630+0000","last_change":"2024-05-08T18:33:20.903630+0000","last_active":"2024-05-08T18:33:20.903630+0000","last_peered":"2024-05-08T18:33:20.903630+0000","last_clean":"2024-05-08T18:33:20.903630+0000","last_became_active":"2024-05-08T18:29:42.562420+0000","last_became_peered":"2024-05-08T18:29:42.562420+0000","last_unstale":"2024-05-08T18:33:20.903630+0000","last_undegraded":"2024-05-08T18:33:20.903630+0000","last_fullsized":"2024-05-08T18:33:20.903630+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'4","last_scrub_stamp":"2024-05-08T18:33:20.903339+0000","last_deep_scrub":"84'4","last_deep_scrub_stamp":"2024-05-08T18:33:20.903339+0000","last_clean_scrub_stamp":"2024-05-08T18:33:20.903339+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:29:56.561721+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"116'10","reported_seq":214,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:16.562520+0000","last_change":"2024-05-08T18:33:16.562520+0000","last_active":"2024-05-08T18:33:16.562520+0000","last_peered":"2024-05-08T18:33:16.562520+0000","last_clean":"2024-05-08T18:33:16.562520+0000","last_became_active":"2024-05-08T18:29:40.561326+0000","last_became_peered":"2024-05-08T18:29:40.561326+0000","last_unstale":"2024-05-08T18:33:16.562520+0000","last_undegraded":"2024-05-08T18:33:16.562520+0000","last_fullsized":"2024-05-08T18:33:16.562520+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'10","last_scrub_stamp":"2024-05-08T18:33:16.562119+0000","last_deep_scrub":"116'10","last_deep_scrub_stamp":"2024-05-08T18:33:16.562119+0000","last_clean_scrub_stamp":"2024-05-08T18:33:16.562119+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:29:20.324924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"97'4","reported_seq":210,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:11.564628+0000","last_change":"2024-05-08T18:33:11.564628+0000","last_active":"2024-05-08T18:33:11.564628+0000","last_peered":"2024-05-08T18:33:11.564628+0000","last_clean":"2024-05-08T18:33:11.564628+0000","last_became_active":"2024-05-08T18:29:42.560520+0000","last_became_peered":"2024-05-08T18:29:42.560520+0000","last_unstale":"2024-05-08T18:33:11.564628+0000","last_undegraded":"2024-05-08T18:33:11.564628+0000","last_fullsized":"2024-05-08T18:33:11.564628+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'4","last_scrub_stamp":"2024-05-08T18:33:11.564356+0000","last_deep_scrub":"97'4","last_deep_scrub_stamp":"2024-05-08T18:33:11.564356+0000","last_clean_scrub_stamp":"2024-05-08T18:33:11.564356+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:45.313531+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"116'22","reported_seq":229,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:31.927603+0000","last_change":"2024-05-08T18:33:31.927603+0000","last_active":"2024-05-08T18:33:31.927603+0000","last_peered":"2024-05-08T18:33:31.927603+0000","last_clean":"2024-05-08T18:33:31.927603+0000","last_became_active":"2024-05-08T18:29:40.554603+0000","last_became_peered":"2024-05-08T18:29:40.554603+0000","last_unstale":"2024-05-08T18:33:31.927603+0000","last_undegraded":"2024-05-08T18:33:31.927603+0000","last_fullsized":"2024-05-08T18:33:31.927603+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'22","last_scrub_stamp":"2024-05-08T18:33:31.927332+0000","last_deep_scrub":"116'22","last_deep_scrub_stamp":"2024-05-08T18:33:31.927332+0000","last_clean_scrub_stamp":"2024-05-08T18:33:31.927332+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:33:41.311455+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"84'4","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:08.883008+0000","last_change":"2024-05-08T18:33:08.883070+0000","last_active":"2024-05-08T18:33:08.883008+0000","last_peered":"2024-05-08T18:33:08.883008+0000","last_clean":"2024-05-08T18:33:08.883008+0000","last_became_active":"2024-05-08T18:29:42.573947+0000","last_became_peered":"2024-05-08T18:29:42.573947+0000","last_unstale":"2024-05-08T18:33:08.883008+0000","last_undegraded":"2024-05-08T18:33:08.883008+0000","last_fullsized":"2024-05-08T18:33:08.883008+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'4","last_scrub_stamp":"2024-05-08T18:33:08.882807+0000","last_deep_scrub":"84'4","last_deep_scrub_stamp":"2024-05-08T18:33:08.882807+0000","last_clean_scrub_stamp":"2024-05-08T18:33:08.882807+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:04:54.998223+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"116'20","reported_seq":226,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:31.171715+0000","last_change":"2024-05-08T18:33:31.171715+0000","last_active":"2024-05-08T18:33:31.171715+0000","last_peered":"2024-05-08T18:33:31.171715+0000","last_clean":"2024-05-08T18:33:31.171715+0000","last_became_active":"2024-05-08T18:29:40.553356+0000","last_became_peered":"2024-05-08T18:29:40.553356+0000","last_unstale":"2024-05-08T18:33:31.171715+0000","last_undegraded":"2024-05-08T18:33:31.171715+0000","last_fullsized":"2024-05-08T18:33:31.171715+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'20","last_scrub_stamp":"2024-05-08T18:33:31.171280+0000","last_deep_scrub":"116'20","last_deep_scrub_stamp":"2024-05-08T18:33:31.171280+0000","last_clean_scrub_stamp":"2024-05-08T18:33:31.171280+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:39:39.534385+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"84'2","reported_seq":209,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:10.552807+0000","last_change":"2024-05-08T18:33:10.552867+0000","last_active":"2024-05-08T18:33:10.552807+0000","last_peered":"2024-05-08T18:33:10.552807+0000","last_clean":"2024-05-08T18:33:10.552807+0000","last_became_active":"2024-05-08T18:29:42.565760+0000","last_became_peered":"2024-05-08T18:29:42.565760+0000","last_unstale":"2024-05-08T18:33:10.552807+0000","last_undegraded":"2024-05-08T18:33:10.552807+0000","last_fullsized":"2024-05-08T18:33:10.552807+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'2","last_scrub_stamp":"2024-05-08T18:33:10.552606+0000","last_deep_scrub":"84'2","last_deep_scrub_stamp":"2024-05-08T18:33:10.552606+0000","last_clean_scrub_stamp":"2024-05-08T18:33:10.552606+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:06:45.237919+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"116'16","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:30.891562+0000","last_change":"2024-05-08T18:33:30.891627+0000","last_active":"2024-05-08T18:33:30.891562+0000","last_peered":"2024-05-08T18:33:30.891562+0000","last_clean":"2024-05-08T18:33:30.891562+0000","last_became_active":"2024-05-08T18:29:40.552307+0000","last_became_peered":"2024-05-08T18:29:40.552307+0000","last_unstale":"2024-05-08T18:33:30.891562+0000","last_undegraded":"2024-05-08T18:33:30.891562+0000","last_fullsized":"2024-05-08T18:33:30.891562+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'16","last_scrub_stamp":"2024-05-08T18:33:30.891368+0000","last_deep_scrub":"116'16","last_deep_scrub_stamp":"2024-05-08T18:33:30.891368+0000","last_clean_scrub_stamp":"2024-05-08T18:33:30.891368+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:34:22.549710+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"84'4","reported_seq":212,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:08.822634+0000","last_change":"2024-05-08T18:33:08.822695+0000","last_active":"2024-05-08T18:33:08.822634+0000","last_peered":"2024-05-08T18:33:08.822634+0000","last_clean":"2024-05-08T18:33:08.822634+0000","last_became_active":"2024-05-08T18:29:42.561171+0000","last_became_peered":"2024-05-08T18:29:42.561171+0000","last_unstale":"2024-05-08T18:33:08.822634+0000","last_undegraded":"2024-05-08T18:33:08.822634+0000","last_fullsized":"2024-05-08T18:33:08.822634+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'4","last_scrub_stamp":"2024-05-08T18:33:08.822410+0000","last_deep_scrub":"84'4","last_deep_scrub_stamp":"2024-05-08T18:33:08.822410+0000","last_clean_scrub_stamp":"2024-05-08T18:33:08.822410+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:04:37.332926+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"116'20","reported_seq":225,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:30.215231+0000","last_change":"2024-05-08T18:33:30.215390+0000","last_active":"2024-05-08T18:33:30.215231+0000","last_peered":"2024-05-08T18:33:30.215231+0000","last_clean":"2024-05-08T18:33:30.215231+0000","last_became_active":"2024-05-08T18:29:40.542398+0000","last_became_peered":"2024-05-08T18:29:40.542398+0000","last_unstale":"2024-05-08T18:33:30.215231+0000","last_undegraded":"2024-05-08T18:33:30.215231+0000","last_fullsized":"2024-05-08T18:33:30.215231+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'20","last_scrub_stamp":"2024-05-08T18:33:30.215003+0000","last_deep_scrub":"116'20","last_deep_scrub_stamp":"2024-05-08T18:33:30.215003+0000","last_clean_scrub_stamp":"2024-05-08T18:33:30.215003+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:34:14.886658+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"97'6","reported_seq":219,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:13.444728+0000","last_change":"2024-05-08T18:33:13.444795+0000","last_active":"2024-05-08T18:33:13.444728+0000","last_peered":"2024-05-08T18:33:13.444728+0000","last_clean":"2024-05-08T18:33:13.444728+0000","last_became_active":"2024-05-08T18:29:42.578981+0000","last_became_peered":"2024-05-08T18:29:42.578981+0000","last_unstale":"2024-05-08T18:33:13.444728+0000","last_undegraded":"2024-05-08T18:33:13.444728+0000","last_fullsized":"2024-05-08T18:33:13.444728+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'6","last_scrub_stamp":"2024-05-08T18:33:13.444524+0000","last_deep_scrub":"97'6","last_deep_scrub_stamp":"2024-05-08T18:33:13.444524+0000","last_clean_scrub_stamp":"2024-05-08T18:33:13.444524+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:22:27.693306+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"116'22","reported_seq":228,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:30.018597+0000","last_change":"2024-05-08T18:33:30.018720+0000","last_active":"2024-05-08T18:33:30.018597+0000","last_peered":"2024-05-08T18:33:30.018597+0000","last_clean":"2024-05-08T18:33:30.018597+0000","last_became_active":"2024-05-08T18:29:40.548177+0000","last_became_peered":"2024-05-08T18:29:40.548177+0000","last_unstale":"2024-05-08T18:33:30.018597+0000","last_undegraded":"2024-05-08T18:33:30.018597+0000","last_fullsized":"2024-05-08T18:33:30.018597+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'22","last_scrub_stamp":"2024-05-08T18:33:30.018301+0000","last_deep_scrub":"116'22","last_deep_scrub_stamp":"2024-05-08T18:33:30.018301+0000","last_clean_scrub_stamp":"2024-05-08T18:33:30.018301+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:48:25.628539+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"80'2","reported_seq":204,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:06.926107+0000","last_change":"2024-05-08T18:33:06.926170+0000","last_active":"2024-05-08T18:33:06.926107+0000","last_peered":"2024-05-08T18:33:06.926107+0000","last_clean":"2024-05-08T18:33:06.926107+0000","last_became_active":"2024-05-08T18:29:42.573384+0000","last_became_peered":"2024-05-08T18:29:42.573384+0000","last_unstale":"2024-05-08T18:33:06.926107+0000","last_undegraded":"2024-05-08T18:33:06.926107+0000","last_fullsized":"2024-05-08T18:33:06.926107+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2","last_scrub_stamp":"2024-05-08T18:33:06.925879+0000","last_deep_scrub":"80'2","last_deep_scrub_stamp":"2024-05-08T18:33:06.925879+0000","last_clean_scrub_stamp":"2024-05-08T18:33:06.925879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:27:06.379974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"116'18","reported_seq":221,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:18.613390+0000","last_change":"2024-05-08T18:33:18.613454+0000","last_active":"2024-05-08T18:33:18.613390+0000","last_peered":"2024-05-08T18:33:18.613390+0000","last_clean":"2024-05-08T18:33:18.613390+0000","last_became_active":"2024-05-08T18:29:40.563231+0000","last_became_peered":"2024-05-08T18:29:40.563231+0000","last_unstale":"2024-05-08T18:33:18.613390+0000","last_undegraded":"2024-05-08T18:33:18.613390+0000","last_fullsized":"2024-05-08T18:33:18.613390+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'18","last_scrub_stamp":"2024-05-08T18:33:18.613120+0000","last_deep_scrub":"116'18","last_deep_scrub_stamp":"2024-05-08T18:33:18.613120+0000","last_clean_scrub_stamp":"2024-05-08T18:33:18.613120+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:11:40.975598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:19.976793+0000","last_change":"2024-05-08T18:33:19.976898+0000","last_active":"2024-05-08T18:33:19.976793+0000","last_peered":"2024-05-08T18:33:19.976793+0000","last_clean":"2024-05-08T18:33:19.976793+0000","last_became_active":"2024-05-08T18:29:42.563822+0000","last_became_peered":"2024-05-08T18:29:42.563822+0000","last_unstale":"2024-05-08T18:33:19.976793+0000","last_undegraded":"2024-05-08T18:33:19.976793+0000","last_fullsized":"2024-05-08T18:33:19.976793+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:19.976557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:19.976557+0000","last_clean_scrub_stamp":"2024-05-08T18:33:19.976557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:41:42.325155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"116'28","reported_seq":231,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:14.818194+0000","last_change":"2024-05-08T18:33:14.818317+0000","last_active":"2024-05-08T18:33:14.818194+0000","last_peered":"2024-05-08T18:33:14.818194+0000","last_clean":"2024-05-08T18:33:14.818194+0000","last_became_active":"2024-05-08T18:29:40.571195+0000","last_became_peered":"2024-05-08T18:29:40.571195+0000","last_unstale":"2024-05-08T18:33:14.818194+0000","last_undegraded":"2024-05-08T18:33:14.818194+0000","last_fullsized":"2024-05-08T18:33:14.818194+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'28","last_scrub_stamp":"2024-05-08T18:33:14.817914+0000","last_deep_scrub":"116'28","last_deep_scrub_stamp":"2024-05-08T18:33:14.817914+0000","last_clean_scrub_stamp":"2024-05-08T18:33:14.817914+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:13:39.741623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":28,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":202,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:18.938962+0000","last_change":"2024-05-08T18:33:18.939020+0000","last_active":"2024-05-08T18:33:18.938962+0000","last_peered":"2024-05-08T18:33:18.938962+0000","last_clean":"2024-05-08T18:33:18.938962+0000","last_became_active":"2024-05-08T18:29:42.560419+0000","last_became_peered":"2024-05-08T18:29:42.560419+0000","last_unstale":"2024-05-08T18:33:18.938962+0000","last_undegraded":"2024-05-08T18:33:18.938962+0000","last_fullsized":"2024-05-08T18:33:18.938962+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:18.938772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:18.938772+0000","last_clean_scrub_stamp":"2024-05-08T18:33:18.938772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:25:42.250635+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"116'20","reported_seq":226,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:07.782695+0000","last_change":"2024-05-08T18:33:07.782811+0000","last_active":"2024-05-08T18:33:07.782695+0000","last_peered":"2024-05-08T18:33:07.782695+0000","last_clean":"2024-05-08T18:33:07.782695+0000","last_became_active":"2024-05-08T18:29:40.568584+0000","last_became_peered":"2024-05-08T18:29:40.568584+0000","last_unstale":"2024-05-08T18:33:07.782695+0000","last_undegraded":"2024-05-08T18:33:07.782695+0000","last_fullsized":"2024-05-08T18:33:07.782695+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'20","last_scrub_stamp":"2024-05-08T18:33:07.782380+0000","last_deep_scrub":"116'20","last_deep_scrub_stamp":"2024-05-08T18:33:07.782380+0000","last_clean_scrub_stamp":"2024-05-08T18:33:07.782380+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:14:02.322645+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"83'6","reported_seq":208,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:08.972475+0000","last_change":"2024-05-08T18:33:08.972538+0000","last_active":"2024-05-08T18:33:08.972475+0000","last_peered":"2024-05-08T18:33:08.972475+0000","last_clean":"2024-05-08T18:33:08.972475+0000","last_became_active":"2024-05-08T18:29:42.573563+0000","last_became_peered":"2024-05-08T18:29:42.573563+0000","last_unstale":"2024-05-08T18:33:08.972475+0000","last_undegraded":"2024-05-08T18:33:08.972475+0000","last_fullsized":"2024-05-08T18:33:08.972475+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"83'6","last_scrub_stamp":"2024-05-08T18:33:08.972279+0000","last_deep_scrub":"83'6","last_deep_scrub_stamp":"2024-05-08T18:33:08.972279+0000","last_clean_scrub_stamp":"2024-05-08T18:33:08.972279+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:09:29.848374+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"116'16","reported_seq":221,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:15.187897+0000","last_change":"2024-05-08T18:33:15.187957+0000","last_active":"2024-05-08T18:33:15.187897+0000","last_peered":"2024-05-08T18:33:15.187897+0000","last_clean":"2024-05-08T18:33:15.187897+0000","last_became_active":"2024-05-08T18:29:40.561360+0000","last_became_peered":"2024-05-08T18:29:40.561360+0000","last_unstale":"2024-05-08T18:33:15.187897+0000","last_undegraded":"2024-05-08T18:33:15.187897+0000","last_fullsized":"2024-05-08T18:33:15.187897+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'16","last_scrub_stamp":"2024-05-08T18:33:15.187705+0000","last_deep_scrub":"116'16","last_deep_scrub_stamp":"2024-05-08T18:33:15.187705+0000","last_clean_scrub_stamp":"2024-05-08T18:33:15.187705+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:10:19.782853+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"116'22","reported_seq":228,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:28.286952+0000","last_change":"2024-05-08T18:33:28.287089+0000","last_active":"2024-05-08T18:33:28.286952+0000","last_peered":"2024-05-08T18:33:28.286952+0000","last_clean":"2024-05-08T18:33:28.286952+0000","last_became_active":"2024-05-08T18:29:40.537925+0000","last_became_peered":"2024-05-08T18:29:40.537925+0000","last_unstale":"2024-05-08T18:33:28.286952+0000","last_undegraded":"2024-05-08T18:33:28.286952+0000","last_fullsized":"2024-05-08T18:33:28.286952+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'22","last_scrub_stamp":"2024-05-08T18:33:28.286720+0000","last_deep_scrub":"116'22","last_deep_scrub_stamp":"2024-05-08T18:33:28.286720+0000","last_clean_scrub_stamp":"2024-05-08T18:33:28.286720+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:44:38.515353+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":4,"num_write":32,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"97'8","reported_seq":222,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:10.876750+0000","last_change":"2024-05-08T18:33:10.876812+0000","last_active":"2024-05-08T18:33:10.876750+0000","last_peered":"2024-05-08T18:33:10.876750+0000","last_clean":"2024-05-08T18:33:10.876750+0000","last_became_active":"2024-05-08T18:29:42.574351+0000","last_became_peered":"2024-05-08T18:29:42.574351+0000","last_unstale":"2024-05-08T18:33:10.876750+0000","last_undegraded":"2024-05-08T18:33:10.876750+0000","last_fullsized":"2024-05-08T18:33:10.876750+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"97'8","last_scrub_stamp":"2024-05-08T18:33:10.876518+0000","last_deep_scrub":"97'8","last_deep_scrub_stamp":"2024-05-08T18:33:10.876518+0000","last_clean_scrub_stamp":"2024-05-08T18:33:10.876518+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:31:05.444966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"116'20","reported_seq":228,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:18.791152+0000","last_change":"2024-05-08T18:33:18.791310+0000","last_active":"2024-05-08T18:33:18.791152+0000","last_peered":"2024-05-08T18:33:18.791152+0000","last_clean":"2024-05-08T18:33:18.791152+0000","last_became_active":"2024-05-08T18:29:40.542965+0000","last_became_peered":"2024-05-08T18:29:40.542965+0000","last_unstale":"2024-05-08T18:33:18.791152+0000","last_undegraded":"2024-05-08T18:33:18.791152+0000","last_fullsized":"2024-05-08T18:33:18.791152+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'20","last_scrub_stamp":"2024-05-08T18:33:18.790907+0000","last_deep_scrub":"116'20","last_deep_scrub_stamp":"2024-05-08T18:33:18.790907+0000","last_clean_scrub_stamp":"2024-05-08T18:33:18.790907+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:22:33.039689+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":201,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-05-08T18:33:13.211139+0000","last_change":"2024-05-08T18:33:13.211194+0000","last_active":"2024-05-08T18:33:13.211139+0000","last_peered":"2024-05-08T18:33:13.211139+0000","last_clean":"2024-05-08T18:33:13.211139+0000","last_became_active":"2024-05-08T18:29:42.559028+0000","last_became_peered":"2024-05-08T18:29:42.559028+0000","last_unstale":"2024-05-08T18:33:13.211139+0000","last_undegraded":"2024-05-08T18:33:13.211139+0000","last_fullsized":"2024-05-08T18:33:13.211139+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:33:13.210947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:33:13.210947+0000","last_clean_scrub_stamp":"2024-05-08T18:33:13.210947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:22:27.459729+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":247,"num_read_kb":238,"num_write":231,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":841,"ondisk_log_size":841,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":23632,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1024,"num_read_kb":1070,"num_write":533,"num_write_kb":208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6074,"num_omap_keys":28,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":924,"ondisk_log_size":924,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":344,"num_read_kb":344,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":579,"num_read_kb":555,"num_write":234,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":222,"ondisk_log_size":222,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":593,"num_read_kb":23,"num_write":1216,"num_write_kb":2365440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1156,"ondisk_log_size":1156,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509501,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33152,"kb_used_data":1976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338688,"statfs":{"total":96636764160,"available":96602816512,"internally_reserved":0,"allocated":2023424,"data_stored":1399455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509501,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32548,"kb_used_data":1372,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339292,"statfs":{"total":96636764160,"available":96603435008,"internally_reserved":0,"allocated":1404928,"data_stored":808427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509499,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36752,"kb_used_data":1416,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335088,"statfs":{"total":96636764160,"available":96599130112,"internally_reserved":0,"allocated":1449984,"data_stored":809255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509499,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32536,"kb_used_data":1360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339304,"statfs":{"total":96636764160,"available":96603447296,"internally_reserved":0,"allocated":1392640,"data_stored":807925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542204,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32564,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339276,"statfs":{"total":96636764160,"available":96603418624,"internally_reserved":0,"allocated":1421312,"data_stored":808823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542204,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32544,"kb_used_data":1368,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339296,"statfs":{"total":96636764160,"available":96603439104,"internally_reserved":0,"allocated":1400832,"data_stored":809418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542202,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32564,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339276,"statfs":{"total":96636764160,"available":96603418624,"internally_reserved":0,"allocated":1421312,"data_stored":808677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542204,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33140,"kb_used_data":1964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338700,"statfs":{"total":96636764160,"available":96602828800,"internally_reserved":0,"allocated":2011136,"data_stored":1400290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T18:34:05.049 DEBUG:teuthology.orchestra.run.smithi097:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-05-08T18:34:05.380 INFO:teuthology.misc:Shutting down mds daemons... 2024-05-08T18:34:05.380 INFO:teuthology.misc:Shutting down osd daemons... 2024-05-08T18:34:05.381 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-05-08T18:34:05.381 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T18:34:05.459 INFO:tasks.ceph.osd.0:Stopped 2024-05-08T18:34:05.459 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-05-08T18:34:05.459 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T18:34:05.548 INFO:tasks.ceph.osd.1:Stopped 2024-05-08T18:34:05.548 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-05-08T18:34:05.548 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T18:34:05.643 INFO:tasks.ceph.osd.2:Stopped 2024-05-08T18:34:05.643 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-05-08T18:34:05.644 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T18:34:05.731 INFO:tasks.ceph.osd.3:Stopped 2024-05-08T18:34:05.732 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-05-08T18:34:05.732 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T18:34:05.818 INFO:tasks.ceph.osd.4:Stopped 2024-05-08T18:34:05.818 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-05-08T18:34:05.818 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T18:34:05.913 INFO:tasks.ceph.osd.5:Stopped 2024-05-08T18:34:05.913 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-05-08T18:34:05.913 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T18:34:05.997 INFO:tasks.ceph.osd.6:Stopped 2024-05-08T18:34:05.997 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-05-08T18:34:05.997 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T18:34:11.058 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-05-08T18:34:12.099 INFO:tasks.ceph.osd.7:Stopped 2024-05-08T18:34:12.099 INFO:teuthology.misc:Shutting down mgr daemons... 2024-05-08T18:34:12.099 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-05-08T18:34:12.099 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T18:34:12.129 INFO:tasks.ceph.mgr.y:Stopped 2024-05-08T18:34:12.129 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-05-08T18:34:12.129 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T18:34:12.157 INFO:tasks.ceph.mgr.x:Stopped 2024-05-08T18:34:12.157 INFO:teuthology.misc:Shutting down mon daemons... 2024-05-08T18:34:12.157 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-05-08T18:34:12.158 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T18:34:12.184 INFO:tasks.ceph.mon.a:Stopped 2024-05-08T18:34:12.184 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-05-08T18:34:12.185 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T18:34:12.240 INFO:tasks.ceph.mon.c:Stopped 2024-05-08T18:34:12.240 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-05-08T18:34:12.241 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T18:34:12.263 INFO:tasks.ceph.mon.b:Stopped 2024-05-08T18:34:12.263 INFO:tasks.ceph:Checking cluster log for badness... 2024-05-08T18:34:12.264 DEBUG:teuthology.orchestra.run.smithi097:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | head -n 1 2024-05-08T18:34:12.302 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi097.front.sepia.ceph.com 2024-05-08T18:34:12.302 DEBUG:teuthology.orchestra.run.smithi097:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-05-08T18:34:12.826 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi097.front.sepia.ceph.com 2024-05-08T18:34:12.826 DEBUG:teuthology.orchestra.run.smithi097:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-05-08T18:34:12.919 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi097.front.sepia.ceph.com 2024-05-08T18:34:12.919 DEBUG:teuthology.orchestra.run.smithi097:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-05-08T18:34:13.102 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi097.front.sepia.ceph.com 2024-05-08T18:34:13.102 DEBUG:teuthology.orchestra.run.smithi097:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-05-08T18:34:13.286 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi151.front.sepia.ceph.com 2024-05-08T18:34:13.286 DEBUG:teuthology.orchestra.run.smithi151:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-05-08T18:34:13.562 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi151.front.sepia.ceph.com 2024-05-08T18:34:13.562 DEBUG:teuthology.orchestra.run.smithi151:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-05-08T18:34:13.784 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi151.front.sepia.ceph.com 2024-05-08T18:34:13.785 DEBUG:teuthology.orchestra.run.smithi151:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-05-08T18:34:13.938 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi151.front.sepia.ceph.com 2024-05-08T18:34:13.938 DEBUG:teuthology.orchestra.run.smithi151:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-05-08T18:34:14.102 INFO:tasks.ceph:Archiving mon data... 2024-05-08T18:34:14.103 DEBUG:teuthology.misc:Transferring archived files from smithi097:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/ivancich-2024-05-08_17:43:43-rgw-wip-eric-testing-1-distro-default-smithi/7697884/data/mon.a.tgz 2024-05-08T18:34:14.103 DEBUG:teuthology.orchestra.run.smithi097:> mktemp 2024-05-08T18:34:14.109 INFO:teuthology.orchestra.run.smithi097.stdout:/tmp/tmp.ZGmNcjU9q8 2024-05-08T18:34:14.110 DEBUG:teuthology.orchestra.run.smithi097:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.ZGmNcjU9q8 2024-05-08T18:34:14.283 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 0666 /tmp/tmp.ZGmNcjU9q8 2024-05-08T18:34:14.347 DEBUG:teuthology.orchestra.remote:smithi097:/tmp/tmp.ZGmNcjU9q8 is 551KB 2024-05-08T18:34:14.413 DEBUG:teuthology.orchestra.run.smithi097:> rm -fr /tmp/tmp.ZGmNcjU9q8 2024-05-08T18:34:14.419 DEBUG:teuthology.misc:Transferring archived files from smithi097:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/ivancich-2024-05-08_17:43:43-rgw-wip-eric-testing-1-distro-default-smithi/7697884/data/mon.c.tgz 2024-05-08T18:34:14.419 DEBUG:teuthology.orchestra.run.smithi097:> mktemp 2024-05-08T18:34:14.468 INFO:teuthology.orchestra.run.smithi097.stdout:/tmp/tmp.9AKziQkEBM 2024-05-08T18:34:14.468 DEBUG:teuthology.orchestra.run.smithi097:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.9AKziQkEBM 2024-05-08T18:34:14.680 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 0666 /tmp/tmp.9AKziQkEBM 2024-05-08T18:34:14.742 DEBUG:teuthology.orchestra.remote:smithi097:/tmp/tmp.9AKziQkEBM is 715KB 2024-05-08T18:34:14.805 DEBUG:teuthology.orchestra.run.smithi097:> rm -fr /tmp/tmp.9AKziQkEBM 2024-05-08T18:34:14.812 DEBUG:teuthology.misc:Transferring archived files from smithi151:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/ivancich-2024-05-08_17:43:43-rgw-wip-eric-testing-1-distro-default-smithi/7697884/data/mon.b.tgz 2024-05-08T18:34:14.813 DEBUG:teuthology.orchestra.run.smithi151:> mktemp 2024-05-08T18:34:14.819 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/tmp.Xl4GDdDT36 2024-05-08T18:34:14.819 DEBUG:teuthology.orchestra.run.smithi151:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.Xl4GDdDT36 2024-05-08T18:34:15.025 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 0666 /tmp/tmp.Xl4GDdDT36 2024-05-08T18:34:15.089 DEBUG:teuthology.orchestra.remote:smithi151:/tmp/tmp.Xl4GDdDT36 is 715KB 2024-05-08T18:34:15.154 DEBUG:teuthology.orchestra.run.smithi151:> rm -fr /tmp/tmp.Xl4GDdDT36 2024-05-08T18:34:15.159 INFO:tasks.ceph:Cleaning ceph cluster... 2024-05-08T18:34:15.160 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-08T18:34:15.162 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-08T18:34:15.221 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-08T18:34:15.265 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-08T18:34:15.265 INFO:tasks.ceph:Archiving crash dumps... 2024-05-08T18:34:15.267 DEBUG:teuthology.misc:Transferring archived files from smithi097:/var/lib/ceph/crash to /home/teuthworker/archive/ivancich-2024-05-08_17:43:43-rgw-wip-eric-testing-1-distro-default-smithi/7697884/remote/smithi097/crash 2024-05-08T18:34:15.267 DEBUG:teuthology.orchestra.run.smithi097:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-08T18:34:15.282 DEBUG:teuthology.misc:Transferring archived files from smithi151:/var/lib/ceph/crash to /home/teuthworker/archive/ivancich-2024-05-08_17:43:43-rgw-wip-eric-testing-1-distro-default-smithi/7697884/remote/smithi151/crash 2024-05-08T18:34:15.283 DEBUG:teuthology.orchestra.run.smithi151:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-08T18:34:15.319 INFO:tasks.ceph:Compressing logs... 2024-05-08T18:34:15.319 DEBUG:teuthology.orchestra.run.smithi097:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-08T18:34:15.325 DEBUG:teuthology.orchestra.run.smithi151:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-08T18:34:15.344 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34289.log 2024-05-08T18:34:15.345 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32161.log 2024-05-08T18:34:15.345 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.34289.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34289.log.gz 2024-05-08T18:34:15.345 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-05-08T18:34:15.345 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.32161.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32161.log.gz 2024-05-08T18:34:15.346 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52266.log 2024-05-08T18:34:15.346 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36334.log 2024-05-08T18:34:15.346 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/rgw.ceph.client.0.log: /var/log/ceph/ceph-client.admin.52266.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52266.log.gz 2024-05-08T18:34:15.346 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33587.log 2024-05-08T18:34:15.347 INFO:teuthology.orchestra.run.smithi097.stderr: 85.1% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-05-08T18:34:15.349 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57990.log 2024-05-08T18:34:15.349 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.33587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25335.log 2024-05-08T18:34:15.349 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.36334.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33587.log.gz 2024-05-08T18:34:15.349 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36334.log.gz 2024-05-08T18:34:15.350 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.57990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51022.log 2024-05-08T18:34:15.350 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57990.log.gz 2024-05-08T18:34:15.350 INFO:teuthology.orchestra.run.smithi097.stderr:gzip/var/log/ceph/ceph-client.admin.25335.log: -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-05-08T18:34:15.350 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.51022.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25335.log.gz 2024-05-08T18:34:15.350 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51022.log.gz 2024-05-08T18:34:15.350 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56944.log 2024-05-08T18:34:15.350 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30282.log 2024-05-08T18:34:15.350 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.56944.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56944.log.gz 2024-05-08T18:34:15.350 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31874.log 2024-05-08T18:34:15.350 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.30282.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30282.log.gz 2024-05-08T18:34:15.350 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58146.log 2024-05-08T18:34:15.356 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.31874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36296.log 2024-05-08T18:34:15.356 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31874.log.gz 2024-05-08T18:34:15.356 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.58146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32513.log 0.0% 2024-05-08T18:34:15.356 INFO:teuthology.orchestra.run.smithi097.stderr: -- replaced with /var/log/ceph/ceph-client.admin.58146.log.gz 2024-05-08T18:34:15.356 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.36296.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36296.log.gz 2024-05-08T18:34:15.356 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59912.log 2024-05-08T18:34:15.356 INFO:teuthology.orchestra.run.smithi097.stderr:gzip/var/log/ceph/ceph-client.admin.32513.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.58147.log 2024-05-08T18:34:15.357 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32513.log.gz 2024-05-08T18:34:15.357 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.59912.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59912.log.gz 2024-05-08T18:34:15.357 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44773.log 2024-05-08T18:34:15.357 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.58147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56124.log 2024-05-08T18:34:15.357 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58147.log.gz 2024-05-08T18:34:15.357 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.44773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42408.log 2024-05-08T18:34:15.357 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44773.log.gz 2024-05-08T18:34:15.357 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.56124.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56124.log.gz 2024-05-08T18:34:15.357 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25219.log 2024-05-08T18:34:15.357 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.42408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32697.log 2024-05-08T18:34:15.357 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42408.log.gz 2024-05-08T18:34:15.357 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.25219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59418.log 2024-05-08T18:34:15.357 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25219.log.gz 2024-05-08T18:34:15.358 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.32697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35338.log 2024-05-08T18:34:15.358 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32697.log.gz 2024-05-08T18:34:15.358 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.59418.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59418.log.gz 2024-05-08T18:34:15.358 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53711.log 2024-05-08T18:34:15.358 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.35338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53514.log 2024-05-08T18:34:15.358 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35338.log.gz 2024-05-08T18:34:15.358 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.53711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32042.log 2024-05-08T18:34:15.358 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53711.log.gz 2024-05-08T18:34:15.358 INFO:teuthology.orchestra.run.smithi097.stderr:gzip/var/log/ceph/ceph-client.admin.53514.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.58140.log 2024-05-08T18:34:15.358 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53514.log.gz 2024-05-08T18:34:15.358 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.32042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30191.log 0.0% 2024-05-08T18:34:15.358 INFO:teuthology.orchestra.run.smithi097.stderr: -- replaced with /var/log/ceph/ceph-client.admin.32042.log.gz 2024-05-08T18:34:15.358 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.58140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58744.log 2024-05-08T18:34:15.359 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58140.log.gz 2024-05-08T18:34:15.359 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.30191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32298.log 2024-05-08T18:34:15.379 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30191.log.gz 2024-05-08T18:34:15.379 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.58744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35208.log 2024-05-08T18:34:15.379 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58744.log.gz 2024-05-08T18:34:15.379 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.32298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54561.log 0.0% 2024-05-08T18:34:15.379 INFO:teuthology.orchestra.run.smithi097.stderr: -- replaced with /var/log/ceph/ceph-client.admin.32298.log.gz 2024-05-08T18:34:15.379 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.35208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53808.log 2024-05-08T18:34:15.379 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35208.log.gz 2024-05-08T18:34:15.379 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.54561.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54561.log.gz 2024-05-08T18:34:15.379 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32067.log 2024-05-08T18:34:15.380 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.53808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53547.log 2024-05-08T18:34:15.380 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53808.log.gz 2024-05-08T18:34:15.380 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.32067.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-05-08T18:34:15.380 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32067.log.gz 2024-05-08T18:34:15.380 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.53547.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.32447.log 2024-05-08T18:34:15.380 INFO:teuthology.orchestra.run.smithi097.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53547.log.gz 2024-05-08T18:34:15.380 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30285.log 2024-05-08T18:34:15.380 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.32447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31877.log 2024-05-08T18:34:15.380 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32447.log.gz 2024-05-08T18:34:15.380 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.30285.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30285.log.gz 2024-05-08T18:34:15.380 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34264.log 2024-05-08T18:34:15.381 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.31877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57652.log 2024-05-08T18:34:15.381 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31877.log.gz 2024-05-08T18:34:15.381 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.34264.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34264.log.gz 2024-05-08T18:34:15.381 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30713.log 2024-05-08T18:34:15.381 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.57652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53548.log 2024-05-08T18:34:15.381 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57652.log.gz 2024-05-08T18:34:15.381 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.30713.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30713.log.gz 2024-05-08T18:34:15.381 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56245.log 2024-05-08T18:34:15.381 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.53548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33513.log 2024-05-08T18:34:15.381 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53548.log.gz 2024-05-08T18:34:15.381 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.56245.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56245.log.gz 2024-05-08T18:34:15.381 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58549.log 2024-05-08T18:34:15.381 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59496.log 2024-05-08T18:34:15.381 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.33513.log: /var/log/ceph/ceph-client.admin.58549.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33513.log.gz 2024-05-08T18:34:15.382 INFO:teuthology.orchestra.run.smithi097.stderr:gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58549.log.gz 2024-05-08T18:34:15.382 INFO:teuthology.orchestra.run.smithi097.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.30491.log 2024-05-08T18:34:15.382 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.59496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59938.log 2024-05-08T18:34:15.382 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59496.log.gz 2024-05-08T18:34:15.382 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.30491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57860.log 2024-05-08T18:34:15.382 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30491.log.gz 2024-05-08T18:34:15.382 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.59938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54761.log 2024-05-08T18:34:15.382 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59938.log.gz 2024-05-08T18:34:15.382 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.57860.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.57860.log.gz 2024-05-08T18:34:15.382 INFO:teuthology.orchestra.run.smithi097.stderr: --verbose -- /var/log/ceph/ceph-client.admin.30505.log 2024-05-08T18:34:15.382 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.54761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32248.log 2024-05-08T18:34:15.382 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54761.log.gz 2024-05-08T18:34:15.382 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.30505.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30505.log.gz 2024-05-08T18:34:15.383 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30995.log 2024-05-08T18:34:15.383 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.32248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58148.log 2024-05-08T18:34:15.383 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32248.log.gz 2024-05-08T18:34:15.383 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.30995.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30995.log.gz 2024-05-08T18:34:15.383 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35949.log 2024-05-08T18:34:15.383 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.58148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47983.log 2024-05-08T18:34:15.383 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58148.log.gz 2024-05-08T18:34:15.383 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.35949.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35949.log.gz 2024-05-08T18:34:15.383 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58139.log 2024-05-08T18:34:15.383 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.47983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58563.log 2024-05-08T18:34:15.383 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47983.log.gz 2024-05-08T18:34:15.383 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.58139.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58139.log.gz 2024-05-08T18:34:15.384 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32568.log 2024-05-08T18:34:15.384 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.58563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33134.log 2024-05-08T18:34:15.384 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58563.log.gz 2024-05-08T18:34:15.384 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.32568.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32568.log.gz 2024-05-08T18:34:15.384 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58536.log 2024-05-08T18:34:15.384 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.33134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52265.log 2024-05-08T18:34:15.384 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33134.log.gz 2024-05-08T18:34:15.384 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.58536.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58536.log.gz 2024-05-08T18:34:15.384 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59860.log 2024-05-08T18:34:15.384 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.52265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58545.log 2024-05-08T18:34:15.384 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52265.log.gz 2024-05-08T18:34:15.384 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.59860.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59860.log.gz 2024-05-08T18:34:15.384 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34561.log 2024-05-08T18:34:15.384 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.58545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34642.log 2024-05-08T18:34:15.385 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58545.log.gz 2024-05-08T18:34:15.385 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.34561.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34561.log.gz 2024-05-08T18:34:15.385 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33043.log 2024-05-08T18:34:15.385 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.34642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30165.log 2024-05-08T18:34:15.385 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34642.log.gz 2024-05-08T18:34:15.385 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.33043.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33043.log.gz 2024-05-08T18:34:15.385 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34420.log 2024-05-08T18:34:15.385 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.30165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57678.log 2024-05-08T18:34:15.385 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30165.log.gz 2024-05-08T18:34:15.385 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.34420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33290.log 2024-05-08T18:34:15.385 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34420.log.gz 2024-05-08T18:34:15.385 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.57678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32421.log 2024-05-08T18:34:15.385 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57678.log.gz 2024-05-08T18:34:15.386 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.33290.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33290.log.gz 2024-05-08T18:34:15.386 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58825.log 2024-05-08T18:34:15.386 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.32421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35671.log 2024-05-08T18:34:15.386 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32421.log.gz 2024-05-08T18:34:15.386 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.0.58825.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.58825.log.gz 2024-05-08T18:34:15.386 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59730.log 2024-05-08T18:34:15.386 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.35671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36099.log 2024-05-08T18:34:15.386 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35671.log.gz 2024-05-08T18:34:15.386 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.59730.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59730.log.gz 2024-05-08T18:34:15.386 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35709.log 2024-05-08T18:34:15.386 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.36099.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36099.log.gz 2024-05-08T18:34:15.386 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32758.log 2024-05-08T18:34:15.387 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.35709.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35709.log.gz -5 2024-05-08T18:34:15.387 INFO:teuthology.orchestra.run.smithi097.stderr: --verbose -- /var/log/ceph/ceph-client.admin.34960.log 2024-05-08T18:34:15.387 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.32758.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-05-08T18:34:15.387 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32758.log.gz 2024-05-08T18:34:15.387 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.34960.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34960.log.gz 2024-05-08T18:34:15.387 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57912.log 2024-05-08T18:34:15.387 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32358.log 2024-05-08T18:34:15.387 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.57912.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.57912.log.gz /var/log/ceph/ceph-client.admin.45433.log 2024-05-08T18:34:15.387 INFO:teuthology.orchestra.run.smithi097.stderr: 2024-05-08T18:34:15.387 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.32358.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32358.log.gz 2024-05-08T18:34:15.387 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35501.log 2024-05-08T18:34:15.387 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57542.log 2024-05-08T18:34:15.387 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.45433.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45433.log.gz 2024-05-08T18:34:15.388 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.35501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30293.log 2024-05-08T18:34:15.388 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35501.log.gz 2024-05-08T18:34:15.388 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.57542.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57542.log.gz 2024-05-08T18:34:15.388 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36410.log 2024-05-08T18:34:15.405 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25091.log 2024-05-08T18:34:15.405 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25211.log 2024-05-08T18:34:15.405 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.25091.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-05-08T18:34:15.405 INFO:teuthology.orchestra.run.smithi151.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25091.log.gz 2024-05-08T18:34:15.405 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.25211.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25211.log.gz 2024-05-08T18:34:15.405 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-05-08T18:34:15.405 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25163.log 2024-05-08T18:34:15.405 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-osd.7.log: /var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-05-08T18:34:15.405 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.25163.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25163.log.gz 2024-05-08T18:34:15.405 INFO:teuthology.orchestra.run.smithi151.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.25139.log 2024-05-08T18:34:15.406 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-05-08T18:34:15.406 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.25139.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25139.log.gz 2024-05-08T18:34:15.406 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25067.log 2024-05-08T18:34:15.406 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-08T18:34:15.406 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-client.admin.25067.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25067.log.gz 2024-05-08T18:34:15.406 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25235.log 2024-05-08T18:34:15.406 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-08T18:34:15.406 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.25235.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25235.log.gz 2024-05-08T18:34:15.406 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25187.log 2024-05-08T18:34:15.406 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25115.log 2024-05-08T18:34:15.406 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.25187.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-05-08T18:34:15.406 INFO:teuthology.orchestra.run.smithi151.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25187.log.gz 2024-05-08T18:34:15.406 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.25115.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-05-08T18:34:15.407 INFO:teuthology.orchestra.run.smithi151.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25115.log.gz 2024-05-08T18:34:15.407 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-mon.b.log: 89.6% 86.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-08T18:34:15.407 INFO:teuthology.orchestra.run.smithi151.stderr: -- replaced with /var/log/ceph/ceph.log.gz 2024-05-08T18:34:15.408 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-osd.4.log: 93.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-05-08T18:34:15.424 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.30293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59522.log 2024-05-08T18:34:15.425 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30293.log.gz 2024-05-08T18:34:15.425 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.36410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33472.log 2024-05-08T18:34:15.425 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36410.log.gz 2024-05-08T18:34:15.425 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.59522.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59522.log.gz 2024-05-08T18:34:15.425 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33949.log 2024-05-08T18:34:15.425 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58562.log 2024-05-08T18:34:15.425 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.33472.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33472.log.gz 2024-05-08T18:34:15.425 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.33949.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33949.log.gz 2024-05-08T18:34:15.425 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56132.log 2024-05-08T18:34:15.425 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.58562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38787.log 2024-05-08T18:34:15.425 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58562.log.gz 2024-05-08T18:34:15.425 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.56132.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56132.log.gz 2024-05-08T18:34:15.425 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36016.log 2024-05-08T18:34:15.426 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35494.log 2024-05-08T18:34:15.426 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.38787.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38787.log.gz 2024-05-08T18:34:15.426 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.36016.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36016.log.gz 2024-05-08T18:34:15.426 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-05-08T18:34:15.426 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.35494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55357.log 2024-05-08T18:34:15.426 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35494.log.gz 2024-05-08T18:34:15.426 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59808.log 2024-05-08T18:34:15.426 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.55357.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.55357.log.gz 2024-05-08T18:34:15.426 INFO:teuthology.orchestra.run.smithi097.stderr: --verbose -- /var/log/ceph/ceph-client.admin.31872.log 2024-05-08T18:34:15.426 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.59808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56200.log 2024-05-08T18:34:15.426 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59808.log.gz 2024-05-08T18:34:15.426 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.31872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35592.log 2024-05-08T18:34:15.426 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31872.log.gz 2024-05-08T18:34:15.427 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.56200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60041.log 2024-05-08T18:34:15.427 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56200.log.gz 2024-05-08T18:34:15.427 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.35592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51625.log 2024-05-08T18:34:15.427 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35592.log.gz 2024-05-08T18:34:15.427 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.60041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35735.log 2024-05-08T18:34:15.427 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60041.log.gz 2024-05-08T18:34:15.427 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.51625.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.35760.log 2024-05-08T18:34:15.427 INFO:teuthology.orchestra.run.smithi097.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51625.log.gz 2024-05-08T18:34:15.427 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.35735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32354.log 2024-05-08T18:34:15.427 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35735.log.gz 2024-05-08T18:34:15.427 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.35760.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35760.log.gz 2024-05-08T18:34:15.427 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33814.log 2024-05-08T18:34:15.427 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58348.log 2024-05-08T18:34:15.428 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.32354.log: /var/log/ceph/ceph-client.admin.33814.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34107.log 2024-05-08T18:34:15.428 INFO:teuthology.orchestra.run.smithi097.stderr: -- replaced with /var/log/ceph/ceph-client.admin.32354.log.gz 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33814.log.gz 2024-05-08T18:34:15.428 INFO:teuthology.orchestra.run.smithi097.stderr: 2024-05-08T18:34:15.428 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.58348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35397.log 2024-05-08T18:34:15.428 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58348.log.gz 2024-05-08T18:34:15.428 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33249.log 2024-05-08T18:34:15.428 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.34107.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34107.log.gz 2024-05-08T18:34:15.428 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34903.log 2024-05-08T18:34:15.428 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.35397.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35397.log.gz 2024-05-08T18:34:15.428 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.33249.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.33249.log.gz 2024-05-08T18:34:15.428 INFO:teuthology.orchestra.run.smithi097.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.30477.log 2024-05-08T18:34:15.428 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.34903.log: -- /var/log/ceph/ceph-client.admin.32978.log 2024-05-08T18:34:15.428 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34903.log.gz 2024-05-08T18:34:15.428 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.30477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45480.log 2024-05-08T18:34:15.429 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30477.log.gz 2024-05-08T18:34:15.429 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.32978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49833.log 2024-05-08T18:34:15.429 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32978.log.gz 2024-05-08T18:34:15.429 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59548.log 2024-05-08T18:34:15.429 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.45480.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45480.log.gz 2024-05-08T18:34:15.429 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.49833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33393.log 2024-05-08T18:34:15.429 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49833.log.gz 2024-05-08T18:34:15.429 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59782.log 2024-05-08T18:34:15.429 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.59548.log: 0.0%/var/log/ceph/ceph-client.admin.33393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33863.log 2024-05-08T18:34:15.429 INFO:teuthology.orchestra.run.smithi097.stderr: -- replaced with /var/log/ceph/ceph-client.admin.59548.log.gz 2024-05-08T18:34:15.429 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33393.log.gz 2024-05-08T18:34:15.429 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.59782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33080.log 2024-05-08T18:34:15.429 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59782.log.gz 2024-05-08T18:34:15.429 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.33863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58068.log 2024-05-08T18:34:15.430 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33863.log.gz 2024-05-08T18:34:15.430 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.33080.log: -- /var/log/ceph/ceph-client.admin.30696.log 2024-05-08T18:34:15.430 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33080.log.gz 2024-05-08T18:34:15.430 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.58068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58345.log 2024-05-08T18:34:15.430 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58068.log.gz 2024-05-08T18:34:15.430 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.30696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59756.log 2024-05-08T18:34:15.430 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30696.log.gz 2024-05-08T18:34:15.430 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30710.log 2024-05-08T18:34:15.430 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.58345.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58345.log.gz 2024-05-08T18:34:15.430 INFO:teuthology.orchestra.run.smithi097.stderr:gzip/var/log/ceph/ceph-client.admin.59756.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.35115.log 2024-05-08T18:34:15.430 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59756.log.gz 2024-05-08T18:34:15.430 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.30710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35857.log 2024-05-08T18:34:15.431 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30710.log.gz 2024-05-08T18:34:15.431 INFO:teuthology.orchestra.run.smithi097.stderr:gzip/var/log/ceph/ceph-client.admin.35115.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.35557.log 2024-05-08T18:34:15.431 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35115.log.gz 2024-05-08T18:34:15.431 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.35857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59886.log 2024-05-08T18:34:15.431 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35857.log.gz 2024-05-08T18:34:15.431 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.35557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33769.log 2024-05-08T18:34:15.431 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35557.log.gz 2024-05-08T18:34:15.431 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5/var/log/ceph/ceph-client.admin.59886.log: --verbose -- /var/log/ceph/ceph-client.admin.35600.log 2024-05-08T18:34:15.431 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59886.log.gz 2024-05-08T18:34:15.431 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.33769.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-05-08T18:34:15.431 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33769.log.gz 2024-05-08T18:34:15.431 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.35600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30893.log 2024-05-08T18:34:15.431 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35600.log.gz 2024-05-08T18:34:15.432 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32890.log 2024-05-08T18:34:15.432 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.30893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30494.log 2024-05-08T18:34:15.432 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30893.log.gz 2024-05-08T18:34:15.432 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.32890.log: gzip 0.0% -5 --verbose -- /var/log/ceph/ceph-client.admin.58145.log 2024-05-08T18:34:15.432 INFO:teuthology.orchestra.run.smithi097.stderr: -- replaced with /var/log/ceph/ceph-client.admin.32890.log.gz 2024-05-08T18:34:15.432 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30685.log 2024-05-08T18:34:15.432 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.30494.log: /var/log/ceph/ceph-client.admin.58145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58132.log 2024-05-08T18:34:15.432 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30494.log.gz 2024-05-08T18:34:15.432 INFO:teuthology.orchestra.run.smithi097.stderr: -- replaced with /var/log/ceph/ceph-client.admin.58145.log.gz 2024-05-08T18:34:15.432 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.30685.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30685.log.gz 2024-05-08T18:34:15.432 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32627.log 2024-05-08T18:34:15.432 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30041.log 2024-05-08T18:34:15.432 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.58132.log: /var/log/ceph/ceph-client.admin.32627.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58132.log.gz 2024-05-08T18:34:15.432 INFO:teuthology.orchestra.run.smithi097.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.32728.log 2024-05-08T18:34:15.433 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32627.log.gz 2024-05-08T18:34:15.433 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.30041.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30041.log.gz 2024-05-08T18:34:15.433 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33674.log 2024-05-08T18:34:15.433 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.32728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58340.log 2024-05-08T18:34:15.433 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32728.log.gz 2024-05-08T18:34:15.433 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.33674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34379.log 2024-05-08T18:34:15.433 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33674.log.gz 2024-05-08T18:34:15.433 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39381.log 2024-05-08T18:34:15.433 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.58340.log: gzip/var/log/ceph/ceph-client.admin.34379.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.57782.log 2024-05-08T18:34:15.433 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34379.log.gz 2024-05-08T18:34:15.433 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58340.log.gz 2024-05-08T18:34:15.433 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.39381.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39381.log.gz 2024-05-08T18:34:15.433 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30286.log 2024-05-08T18:34:15.433 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57730.log 2024-05-08T18:34:15.434 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.57782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32667.log 2024-05-08T18:34:15.434 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0%/var/log/ceph/ceph-client.admin.30286.log: -- replaced with /var/log/ceph/ceph-client.admin.57782.log.gz 2024-05-08T18:34:15.434 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0%/var/log/ceph/ceph-client.admin.57730.log: -- replaced with /var/log/ceph/ceph-client.admin.30286.log.gz 2024-05-08T18:34:15.434 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57730.log.gz 2024-05-08T18:34:15.434 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30697.log 2024-05-08T18:34:15.434 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.32667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36167.log 2024-05-08T18:34:15.434 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32667.log.gz 2024-05-08T18:34:15.434 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.30697.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-05-08T18:34:15.434 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30697.log.gz 2024-05-08T18:34:15.434 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58094.log 2024-05-08T18:34:15.434 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.36167.log: 0.0%gzip/var/log/ceph/ceph-osd.1.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.33138.log 2024-05-08T18:34:15.434 INFO:teuthology.orchestra.run.smithi097.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36167.log.gz 2024-05-08T18:34:15.434 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.58094.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58094.log.gz 2024-05-08T18:34:15.434 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37599.log 2024-05-08T18:34:15.435 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.33138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59652.log 2024-05-08T18:34:15.435 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33138.log.gz 2024-05-08T18:34:15.435 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.37599.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37599.log.gz 2024-05-08T18:34:15.435 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30217.log 2024-05-08T18:34:15.435 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32952.log 2024-05-08T18:34:15.435 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.59652.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59652.log.gz 2024-05-08T18:34:15.435 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.30217.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30217.log.gz 2024-05-08T18:34:15.435 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46189.log 2024-05-08T18:34:15.435 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.32952.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32952.log.gz 2024-05-08T18:34:15.435 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43591.log 2024-05-08T18:34:15.435 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34873.log 2024-05-08T18:34:15.435 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.46189.log: /var/log/ceph/ceph-client.admin.43591.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46189.log.gz 2024-05-08T18:34:15.435 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43591.log.gz 2024-05-08T18:34:15.436 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34028.log 2024-05-08T18:34:15.436 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45377.log 2024-05-08T18:34:15.436 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.34873.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34873.log.gz 2024-05-08T18:34:15.436 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.34028.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34028.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35111.log 2024-05-08T18:34:15.436 INFO:teuthology.orchestra.run.smithi097.stderr: 2024-05-08T18:34:15.436 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.45377.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45377.log.gz 2024-05-08T18:34:15.436 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55963.log 2024-05-08T18:34:15.436 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52861.log 2024-05-08T18:34:15.436 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.35111.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35111.log.gz 2024-05-08T18:34:15.436 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.55963.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55963.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31045.log 2024-05-08T18:34:15.436 INFO:teuthology.orchestra.run.smithi097.stderr: 2024-05-08T18:34:15.436 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.52861.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52861.log.gz 2024-05-08T18:34:15.436 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30711.log 2024-05-08T18:34:15.437 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59470.log 2024-05-08T18:34:15.437 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.31045.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31045.log.gz 2024-05-08T18:34:15.437 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.30711.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30711.log.gz 2024-05-08T18:34:15.437 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56271.log 2024-05-08T18:34:15.437 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.59470.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59470.log.gz 2024-05-08T18:34:15.437 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58329.log 2024-05-08T18:34:15.437 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25072.log 2024-05-08T18:34:15.437 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.56271.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56271.log.gz 2024-05-08T18:34:15.437 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.58329.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58329.log.gz 2024-05-08T18:34:15.437 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53807.log 2024-05-08T18:34:15.437 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.25072.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25072.log.gz 2024-05-08T18:34:15.437 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41762.log 2024-05-08T18:34:15.437 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36073.log 2024-05-08T18:34:15.437 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.53807.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53807.log.gz 2024-05-08T18:34:15.438 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.41762.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41762.log.gz 2024-05-08T18:34:15.438 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58552.log 2024-05-08T18:34:15.438 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.36073.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36073.log.gz 2024-05-08T18:34:15.438 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48574.log 2024-05-08T18:34:15.438 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-08T18:34:15.438 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.58552.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58552.log.gz 2024-05-08T18:34:15.438 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.48574.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48574.log.gz 2024-05-08T18:34:15.438 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57964.log 2024-05-08T18:34:15.458 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph.log: 92.3% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-08T18:34:15.459 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32112.log 2024-05-08T18:34:15.459 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.57964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31802.log 2024-05-08T18:34:15.459 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57964.log.gz 2024-05-08T18:34:15.459 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.32112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57704.log 2024-05-08T18:34:15.459 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32112.log.gz 2024-05-08T18:34:15.459 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.31802.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31802.log.gz 2024-05-08T18:34:15.459 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53854.log 2024-05-08T18:34:15.459 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37004.log 2024-05-08T18:34:15.459 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.57704.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57704.log.gz 2024-05-08T18:34:15.459 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.53854.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53854.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30292.log 2024-05-08T18:34:15.459 INFO:teuthology.orchestra.run.smithi097.stderr: 2024-05-08T18:34:15.460 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.37004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56905.log 2024-05-08T18:34:15.460 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37004.log.gz 2024-05-08T18:34:15.460 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.30292.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30292.log.gz 2024-05-08T18:34:15.460 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54525.log 2024-05-08T18:34:15.460 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35423.log 2024-05-08T18:34:15.460 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.56905.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56905.log.gz 2024-05-08T18:34:15.460 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.54525.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54525.log.gz 2024-05-08T18:34:15.460 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34214.log 2024-05-08T18:34:15.460 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.35423.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35423.log.gz 2024-05-08T18:34:15.460 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54632.log 2024-05-08T18:34:15.460 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41752.log 2024-05-08T18:34:15.460 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.34214.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34214.log.gz 2024-05-08T18:34:15.460 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.54632.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54632.log.gz 2024-05-08T18:34:15.460 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33731.log 2024-05-08T18:34:15.460 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.41752.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41752.log.gz 2024-05-08T18:34:15.461 INFO:teuthology.orchestra.run.smithi097.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-05-08T18:34:15.461 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58564.log 2024-05-08T18:34:15.461 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32505.log 2024-05-08T18:34:15.461 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.33731.log: /var/log/ceph/ceph-client.admin.58564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59704.log 2024-05-08T18:34:15.461 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33731.log.gz 2024-05-08T18:34:15.461 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58564.log.gz 2024-05-08T18:34:15.461 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.32505.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32505.log.gz 2024-05-08T18:34:15.461 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58142.log 2024-05-08T18:34:15.461 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.59704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49178.log 2024-05-08T18:34:15.461 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59704.log.gz 2024-05-08T18:34:15.461 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.58142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30969.log 2024-05-08T18:34:15.461 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58142.log.gz 2024-05-08T18:34:15.461 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.49178.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-05-08T18:34:15.461 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49178.log.gz 2024-05-08T18:34:15.462 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32198.log 2024-05-08T18:34:15.462 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.30969.log: /var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58016.log 2024-05-08T18:34:15.462 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30969.log.gz 2024-05-08T18:34:15.462 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.32198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49232.log 2024-05-08T18:34:15.462 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32198.log.gz 2024-05-08T18:34:15.462 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.58016.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58016.log.gz 2024-05-08T18:34:15.462 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33324.log 2024-05-08T18:34:15.462 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33925.log 2024-05-08T18:34:15.462 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.49232.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49232.log.gz 2024-05-08T18:34:15.462 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.33324.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33324.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35427.log 2024-05-08T18:34:15.462 INFO:teuthology.orchestra.run.smithi097.stderr: 2024-05-08T18:34:15.462 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.33925.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33925.log.gz 2024-05-08T18:34:15.462 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34606.log 2024-05-08T18:34:15.463 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58551.log 2024-05-08T18:34:15.463 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.35427.log: /var/log/ceph/ceph-client.admin.34606.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35427.log.gz 2024-05-08T18:34:15.463 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34606.log.gz 2024-05-08T18:34:15.463 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59626.log 2024-05-08T18:34:15.463 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33431.log 2024-05-08T18:34:15.463 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.58551.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58551.log.gz 2024-05-08T18:34:15.463 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.59626.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59626.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30919.log 2024-05-08T18:34:15.463 INFO:teuthology.orchestra.run.smithi097.stderr: 2024-05-08T18:34:15.463 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.33431.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33431.log.gz 2024-05-08T18:34:15.463 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34519.log 2024-05-08T18:34:15.463 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45555.log 2024-05-08T18:34:15.463 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.30919.log: /var/log/ceph/ceph-client.admin.34519.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30919.log.gz 2024-05-08T18:34:15.463 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34519.log.gz 2024-05-08T18:34:15.464 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57569.log 2024-05-08T18:34:15.464 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44181.log 2024-05-08T18:34:15.464 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.45555.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45555.log.gz 2024-05-08T18:34:15.464 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.57569.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56017.log 2024-05-08T18:34:15.464 INFO:teuthology.orchestra.run.smithi097.stderr: -- replaced with /var/log/ceph/ceph-client.admin.57569.log.gz 2024-05-08T18:34:15.464 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.44181.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44181.log.gz 2024-05-08T18:34:15.464 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35917.log 2024-05-08T18:34:15.464 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-05-08T18:34:15.464 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.56017.log: /var/log/ceph/ceph-client.admin.35917.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56017.log.gz 2024-05-08T18:34:15.464 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35917.log.gz 2024-05-08T18:34:15.464 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54680.log 2024-05-08T18:34:15.464 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34081.log 2024-05-08T18:34:15.464 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ops-log-ceph-client.0.log: /var/log/ceph/ceph-client.admin.54680.log: 0.0% 90.1% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-05-08T18:34:15.464 INFO:teuthology.orchestra.run.smithi097.stderr: -- replaced with /var/log/ceph/ceph-client.admin.54680.log.gz 2024-05-08T18:34:15.465 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53682.log 2024-05-08T18:34:15.465 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.34081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53615.log 2024-05-08T18:34:15.465 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0%/var/log/ceph/ceph-client.admin.53682.log: -- replaced with /var/log/ceph/ceph-client.admin.34081.log.gz 2024-05-08T18:34:15.465 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53682.log.gz 2024-05-08T18:34:15.465 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35250.log 2024-05-08T18:34:15.465 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41164.log 2024-05-08T18:34:15.465 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.53615.log: /var/log/ceph/ceph-client.admin.35250.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53615.log.gz 2024-05-08T18:34:15.465 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35250.log.gz 2024-05-08T18:34:15.465 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-08T18:34:15.466 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30243.log 2024-05-08T18:34:15.466 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.41164.log: /var/log/ceph/ceph.audit.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41164.log.gz 2024-05-08T18:34:15.466 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31019.log 2024-05-08T18:34:15.466 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.30243.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30243.log.gz 2024-05-08T18:34:15.466 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59600.log 2024-05-08T18:34:15.466 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.31019.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31019.log.gz 2024-05-08T18:34:15.466 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57938.log 2024-05-08T18:34:15.466 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.59600.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59600.log.gz 2024-05-08T18:34:15.466 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30497.log 2024-05-08T18:34:15.466 INFO:teuthology.orchestra.run.smithi097.stderr: 94.0% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-08T18:34:15.466 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.57938.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57938.log.gz 2024-05-08T18:34:15.466 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53897.log 2024-05-08T18:34:15.466 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30488.log 2024-05-08T18:34:15.467 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.30497.log: /var/log/ceph/ceph-client.admin.53897.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30497.log.gz 2024-05-08T18:34:15.467 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53897.log.gz 2024-05-08T18:34:15.467 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30114.log 2024-05-08T18:34:15.485 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30297.log 2024-05-08T18:34:15.485 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.30488.log: /var/log/ceph/ceph-client.admin.30114.log: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30488.log.gz 2024-05-08T18:34:15.485 INFO:teuthology.orchestra.run.smithi097.stderr: -- replaced with /var/log/ceph/ceph-client.admin.30114.log.gz 2024-05-08T18:34:15.485 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38191.log 2024-05-08T18:34:15.485 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58796.log 2024-05-08T18:34:15.485 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.30297.log: /var/log/ceph/ceph-client.admin.38191.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30297.log.gz 2024-05-08T18:34:15.486 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38191.log.gz 2024-05-08T18:34:15.486 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41751.log 2024-05-08T18:34:15.486 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53770.log 2024-05-08T18:34:15.486 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.58796.log: /var/log/ceph/ceph-client.admin.41751.log: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58796.log.gz 2024-05-08T18:34:15.486 INFO:teuthology.orchestra.run.smithi097.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41751.log.gz 2024-05-08T18:34:15.486 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32294.log 2024-05-08T18:34:15.486 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34164.log 2024-05-08T18:34:15.486 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.53770.log: /var/log/ceph/ceph-client.admin.32294.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53770.log.gz 2024-05-08T18:34:15.486 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32294.log.gz 2024-05-08T18:34:15.486 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59678.log 2024-05-08T18:34:15.486 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34816.log 2024-05-08T18:34:15.486 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.34164.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34164.log.gz 2024-05-08T18:34:15.487 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.59678.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32796.log 2024-05-08T18:34:15.487 INFO:teuthology.orchestra.run.smithi097.stderr: -- replaced with /var/log/ceph/ceph-client.admin.59678.log.gz 2024-05-08T18:34:15.487 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.34816.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34816.log.gz 2024-05-08T18:34:15.487 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30139.log 2024-05-08T18:34:15.487 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39972.log 2024-05-08T18:34:15.487 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.32796.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32796.log.gz 2024-05-08T18:34:15.487 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.30139.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54597.log 2024-05-08T18:34:15.487 INFO:teuthology.orchestra.run.smithi097.stderr: -- replaced with /var/log/ceph/ceph-client.admin.30139.log.gz 2024-05-08T18:34:15.487 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.39972.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39972.log.gz 2024-05-08T18:34:15.487 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30504.log 2024-05-08T18:34:15.487 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35829.log 2024-05-08T18:34:15.487 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.54597.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54597.log.gz 2024-05-08T18:34:15.487 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.30504.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30504.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60017.log 2024-05-08T18:34:15.487 INFO:teuthology.orchestra.run.smithi097.stderr: 2024-05-08T18:34:15.488 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.35829.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35829.log.gz 2024-05-08T18:34:15.488 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34742.log 2024-05-08T18:34:15.488 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35085.log 2024-05-08T18:34:15.488 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.60017.log: /var/log/ceph/ceph-client.admin.34742.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60017.log.gz 2024-05-08T18:34:15.488 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34742.log.gz 2024-05-08T18:34:15.488 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32837.log 2024-05-08T18:34:15.488 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45558.log 2024-05-08T18:34:15.488 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.35085.log: /var/log/ceph/ceph-client.admin.32837.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35085.log.gz 2024-05-08T18:34:15.488 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32837.log.gz 2024-05-08T18:34:15.488 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32113.log 2024-05-08T18:34:15.488 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43001.log 2024-05-08T18:34:15.488 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.45558.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45558.log.gz 2024-05-08T18:34:15.488 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.32113.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32113.log.gzgzip 2024-05-08T18:34:15.489 INFO:teuthology.orchestra.run.smithi097.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.31832.log 2024-05-08T18:34:15.489 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.43001.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43001.log.gz 2024-05-08T18:34:15.489 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31724.log 2024-05-08T18:34:15.489 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56042.log 2024-05-08T18:34:15.489 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.31832.log: /var/log/ceph/ceph-client.admin.31724.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31832.log.gz 2024-05-08T18:34:15.489 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31724.log.gz 2024-05-08T18:34:15.489 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35055.log 2024-05-08T18:34:15.489 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57595.log 2024-05-08T18:34:15.489 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.56042.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56042.log.gz 2024-05-08T18:34:15.489 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.35055.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34717.log 2024-05-08T18:34:15.489 INFO:teuthology.orchestra.run.smithi097.stderr: -- replaced with /var/log/ceph/ceph-client.admin.35055.log.gz 2024-05-08T18:34:15.489 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.57595.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57595.log.gz 2024-05-08T18:34:15.489 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58042.log 2024-05-08T18:34:15.489 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31776.log 2024-05-08T18:34:15.490 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.34717.log: /var/log/ceph/ceph-client.admin.58042.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34717.log.gz 2024-05-08T18:34:15.490 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58042.log.gz 2024-05-08T18:34:15.490 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30294.log 2024-05-08T18:34:15.490 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58334.log 2024-05-08T18:34:15.490 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.31776.log: /var/log/ceph/ceph-client.admin.30294.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31776.log.gz 2024-05-08T18:34:15.490 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30294.log.gz 2024-05-08T18:34:15.490 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57756.log 2024-05-08T18:34:15.490 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47381.log 2024-05-08T18:34:15.490 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.58334.log: /var/log/ceph/ceph-client.admin.57756.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58334.log.gz 2024-05-08T18:34:15.490 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57756.log.gz 2024-05-08T18:34:15.490 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58355.log 2024-05-08T18:34:15.490 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58770.log 2024-05-08T18:34:15.490 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.47381.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47381.log.gz 2024-05-08T18:34:15.491 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.58355.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58355.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59444.log 2024-05-08T18:34:15.491 INFO:teuthology.orchestra.run.smithi097.stderr: 2024-05-08T18:34:15.491 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.58770.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58770.log.gz 2024-05-08T18:34:15.491 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50423.log 2024-05-08T18:34:15.491 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34449.log 2024-05-08T18:34:15.491 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.59444.log: /var/log/ceph/ceph-client.admin.50423.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59444.log.gz 2024-05-08T18:34:15.491 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50423.log.gz 2024-05-08T18:34:15.491 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58341.log 2024-05-08T18:34:15.491 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33591.log 2024-05-08T18:34:15.491 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.34449.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34449.log.gz 2024-05-08T18:34:15.491 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.58341.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58341.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30284.log 2024-05-08T18:34:15.491 INFO:teuthology.orchestra.run.smithi097.stderr: 2024-05-08T18:34:15.491 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.33591.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33591.log.gz 2024-05-08T18:34:15.492 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36215.log 2024-05-08T18:34:15.492 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49202.log 2024-05-08T18:34:15.492 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.30284.log: /var/log/ceph/ceph-client.admin.36215.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30284.log.gz 2024-05-08T18:34:15.492 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36215.log.gz 2024-05-08T18:34:15.492 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32480.log 2024-05-08T18:34:15.492 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59991.log 2024-05-08T18:34:15.492 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.49202.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49202.log.gz 2024-05-08T18:34:15.504 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.32480.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35336.log 2024-05-08T18:34:15.504 INFO:teuthology.orchestra.run.smithi097.stderr: -- replaced with /var/log/ceph/ceph-client.admin.32480.log.gz 2024-05-08T18:34:15.504 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.59991.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59991.log.gz 2024-05-08T18:34:15.504 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35159.log 2024-05-08T18:34:15.504 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30712.log 2024-05-08T18:34:15.504 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.35336.log: /var/log/ceph/ceph-client.admin.35159.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35336.log.gz 2024-05-08T18:34:15.504 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35159.log.gz 2024-05-08T18:34:15.504 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31750.log 2024-05-08T18:34:15.504 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59574.log 2024-05-08T18:34:15.504 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.30712.log: /var/log/ceph/ceph-client.admin.31750.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30712.log.gz 2024-05-08T18:34:15.505 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31750.log.gz 2024-05-08T18:34:15.505 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35001.log 2024-05-08T18:34:15.505 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53611.log 2024-05-08T18:34:15.505 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.59574.log: /var/log/ceph/ceph-client.admin.35001.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59574.log.gz 2024-05-08T18:34:15.505 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35001.log.gz 2024-05-08T18:34:15.505 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59834.log 2024-05-08T18:34:15.505 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54721.log 2024-05-08T18:34:15.505 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.53611.log: /var/log/ceph/ceph-client.admin.59834.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53611.log.gz 2024-05-08T18:34:15.505 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59834.log.gz 2024-05-08T18:34:15.505 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30483.log 2024-05-08T18:34:15.505 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57621.log 2024-05-08T18:34:15.505 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.54721.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54721.log.gz 2024-05-08T18:34:15.505 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.30483.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40570.log 2024-05-08T18:34:15.506 INFO:teuthology.orchestra.run.smithi097.stderr: -- replaced with /var/log/ceph/ceph-client.admin.30483.log.gz 2024-05-08T18:34:15.506 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.57621.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57621.log.gz 2024-05-08T18:34:15.506 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46786.log 2024-05-08T18:34:15.506 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58356.log 2024-05-08T18:34:15.506 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.40570.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40570.log.gz 2024-05-08T18:34:15.506 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.46786.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46786.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32570.log 2024-05-08T18:34:15.506 INFO:teuthology.orchestra.run.smithi097.stderr: 2024-05-08T18:34:15.506 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.58356.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58356.log.gz 2024-05-08T18:34:15.506 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45521.log 2024-05-08T18:34:15.506 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35287.log 2024-05-08T18:34:15.506 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.32570.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32570.log.gz 2024-05-08T18:34:15.506 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.45521.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31991.log 2024-05-08T18:34:15.506 INFO:teuthology.orchestra.run.smithi097.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45521.log.gz 2024-05-08T18:34:15.507 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.35287.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35287.log.gz 2024-05-08T18:34:15.507 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57834.log 2024-05-08T18:34:15.507 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57886.log 2024-05-08T18:34:15.507 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.31991.log: /var/log/ceph/ceph-client.admin.57834.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31991.log.gz 2024-05-08T18:34:15.507 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57834.log.gz 2024-05-08T18:34:15.507 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30945.log 2024-05-08T18:34:15.507 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.20294.log 2024-05-08T18:34:15.507 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.57886.log: /var/log/ceph/ceph-client.admin.30945.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57886.log.gz 2024-05-08T18:34:15.507 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30945.log.gz 2024-05-08T18:34:15.507 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51651.log 2024-05-08T18:34:15.507 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57808.log 2024-05-08T18:34:15.507 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph.tmp-client.admin.20294.log: /var/log/ceph/ceph-client.admin.51651.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.20294.log.gz 2024-05-08T18:34:15.507 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51651.log.gz 2024-05-08T18:34:15.507 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30695.log 2024-05-08T18:34:15.508 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.57808.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57808.log.gz 2024-05-08T18:34:15.508 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52885.log 2024-05-08T18:34:15.508 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53920.log 2024-05-08T18:34:15.508 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.30695.log: /var/log/ceph/ceph-client.admin.52885.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30695.log.gz 2024-05-08T18:34:15.508 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52885.log.gz 2024-05-08T18:34:15.508 INFO:teuthology.orchestra.run.smithi097.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59964.log 2024-05-08T18:34:15.508 INFO:teuthology.orchestra.run.smithi097.stderr:/var/log/ceph/ceph-client.admin.53920.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53920.log.gz/var/log/ceph/ceph-client.admin.59964.log: 2024-05-08T18:34:15.508 INFO:teuthology.orchestra.run.smithi097.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59964.log.gz 2024-05-08T18:34:15.569 INFO:teuthology.orchestra.run.smithi151.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-05-08T18:34:15.678 INFO:teuthology.orchestra.run.smithi097.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-05-08T18:34:15.702 INFO:teuthology.orchestra.run.smithi097.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-05-08T18:34:15.887 INFO:teuthology.orchestra.run.smithi151.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-05-08T18:34:15.935 INFO:teuthology.orchestra.run.smithi097.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-05-08T18:34:16.029 INFO:teuthology.orchestra.run.smithi151.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-05-08T18:34:16.029 INFO:teuthology.orchestra.run.smithi151.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-05-08T18:34:16.033 INFO:teuthology.orchestra.run.smithi097.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-05-08T18:34:16.044 INFO:teuthology.orchestra.run.smithi151.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-05-08T18:34:16.046 INFO:teuthology.orchestra.run.smithi151.stderr: 2024-05-08T18:34:16.046 INFO:teuthology.orchestra.run.smithi151.stderr:real 0m0.678s 2024-05-08T18:34:16.046 INFO:teuthology.orchestra.run.smithi151.stderr:user 0m2.494s 2024-05-08T18:34:16.046 INFO:teuthology.orchestra.run.smithi151.stderr:sys 0m0.121s 2024-05-08T18:34:16.059 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-05-08T18:34:16.123 INFO:teuthology.orchestra.run.smithi097.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-05-08T18:34:16.225 INFO:teuthology.orchestra.run.smithi097.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-05-08T18:34:16.226 INFO:teuthology.orchestra.run.smithi097.stderr: 2024-05-08T18:34:16.226 INFO:teuthology.orchestra.run.smithi097.stderr:real 0m0.900s 2024-05-08T18:34:16.227 INFO:teuthology.orchestra.run.smithi097.stderr:user 0m3.500s 2024-05-08T18:34:16.227 INFO:teuthology.orchestra.run.smithi097.stderr:sys 0m0.237s 2024-05-08T18:34:16.227 INFO:tasks.ceph:Archiving logs... 2024-05-08T18:34:16.227 DEBUG:teuthology.misc:Transferring archived files from smithi097:/var/log/ceph to /home/teuthworker/archive/ivancich-2024-05-08_17:43:43-rgw-wip-eric-testing-1-distro-default-smithi/7697884/remote/smithi097/log 2024-05-08T18:34:16.228 DEBUG:teuthology.orchestra.run.smithi097:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-08T18:34:16.879 DEBUG:teuthology.misc:Transferring archived files from smithi151:/var/log/ceph to /home/teuthworker/archive/ivancich-2024-05-08_17:43:43-rgw-wip-eric-testing-1-distro-default-smithi/7697884/remote/smithi151/log 2024-05-08T18:34:16.880 DEBUG:teuthology.orchestra.run.smithi151:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-08T18:34:17.200 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-08T18:34:17.209 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-08T18:34:17.210 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-08T18:34:17.212 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-08T18:34:17.291 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-08T18:34:17.301 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-08T18:34:17.301 DEBUG:teuthology.orchestra.run.smithi097:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T18:34:17.304 DEBUG:teuthology.orchestra.run.smithi151:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T18:34:17.313 INFO:teuthology.orchestra.run.smithi097.stdout: remote refid st t when poll reach delay offset jitter 2024-05-08T18:34:17.313 INFO:teuthology.orchestra.run.smithi097.stdout:============================================================================== 2024-05-08T18:34:17.314 INFO:teuthology.orchestra.run.smithi097.stdout:+hv01.front.sepi 67.205.162.81 3 u 59 64 177 0.060 +1.273 1.943 2024-05-08T18:34:17.314 INFO:teuthology.orchestra.run.smithi097.stdout:+hv02.front.sepi 63.231.80.2 3 u 63 64 177 0.070 -2.402 2.130 2024-05-08T18:34:17.314 INFO:teuthology.orchestra.run.smithi097.stdout:*hv03.front.sepi 74.6.168.72 3 u 63 64 177 0.084 -3.585 2.529 2024-05-08T18:34:17.314 INFO:teuthology.orchestra.run.smithi097.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-08T18:34:17.316 INFO:teuthology.orchestra.run.smithi151.stdout: remote refid st t when poll reach delay offset jitter 2024-05-08T18:34:17.317 INFO:teuthology.orchestra.run.smithi151.stdout:============================================================================== 2024-05-08T18:34:17.317 INFO:teuthology.orchestra.run.smithi151.stdout:+hv01.front.sepi 67.205.162.81 3 u 59 64 177 0.078 +2.254 0.665 2024-05-08T18:34:17.317 INFO:teuthology.orchestra.run.smithi151.stdout:+hv02.front.sepi 63.231.80.2 3 u 60 64 177 0.087 -1.083 1.366 2024-05-08T18:34:17.317 INFO:teuthology.orchestra.run.smithi151.stdout:*hv03.front.sepi 74.6.168.72 3 u 3 64 377 0.106 -0.455 1.072 2024-05-08T18:34:17.317 INFO:teuthology.orchestra.run.smithi151.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-08T18:34:17.318 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-08T18:34:17.328 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-08T18:34:17.328 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-08T18:34:17.337 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-08T18:34:17.346 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-08T18:34:17.355 INFO:teuthology.task.internal:Duration was 884.475212 seconds 2024-05-08T18:34:17.356 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-08T18:34:17.365 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-08T18:34:17.365 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-08T18:34:17.368 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-08T18:34:17.406 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-08T18:34:17.407 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi097.front.sepia.ceph.com 2024-05-08T18:34:17.407 DEBUG:teuthology.orchestra.run.smithi097:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-08T18:34:17.457 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi151.front.sepia.ceph.com 2024-05-08T18:34:17.457 DEBUG:teuthology.orchestra.run.smithi151:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-08T18:34:17.467 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-08T18:34:17.467 DEBUG:teuthology.orchestra.run.smithi097:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-08T18:34:17.500 DEBUG:teuthology.orchestra.run.smithi151:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-08T18:34:17.539 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-08T18:34:17.539 DEBUG:teuthology.orchestra.run.smithi097:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-08T18:34:17.568 DEBUG:teuthology.orchestra.run.smithi151:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-08T18:34:17.644 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-08T18:34:17.654 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-08T18:34:17.655 DEBUG:teuthology.orchestra.run.smithi097:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-08T18:34:17.667 DEBUG:teuthology.orchestra.run.smithi151:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-08T18:34:17.678 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-08T18:34:17.688 DEBUG:teuthology.orchestra.run.smithi097:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-08T18:34:17.712 DEBUG:teuthology.orchestra.run.smithi151:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-08T18:34:17.720 INFO:teuthology.orchestra.run.smithi097.stdout:kernel.core_pattern = core 2024-05-08T18:34:17.728 INFO:teuthology.orchestra.run.smithi151.stdout:kernel.core_pattern = core 2024-05-08T18:34:17.823 DEBUG:teuthology.orchestra.run.smithi097:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-08T18:34:17.827 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T18:34:17.828 DEBUG:teuthology.orchestra.run.smithi151:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-08T18:34:17.868 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T18:34:17.868 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-08T18:34:17.879 INFO:teuthology.task.internal:Transferring archived files... 2024-05-08T18:34:17.880 DEBUG:teuthology.misc:Transferring archived files from smithi097:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/ivancich-2024-05-08_17:43:43-rgw-wip-eric-testing-1-distro-default-smithi/7697884/remote/smithi097 2024-05-08T18:34:17.880 DEBUG:teuthology.orchestra.run.smithi097:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-08T18:34:17.901 DEBUG:teuthology.misc:Transferring archived files from smithi151:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/ivancich-2024-05-08_17:43:43-rgw-wip-eric-testing-1-distro-default-smithi/7697884/remote/smithi151 2024-05-08T18:34:17.901 DEBUG:teuthology.orchestra.run.smithi151:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-08T18:34:17.931 INFO:teuthology.task.internal:Removing archive directory... 2024-05-08T18:34:17.932 DEBUG:teuthology.orchestra.run.smithi097:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-08T18:34:17.941 DEBUG:teuthology.orchestra.run.smithi151:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-08T18:34:17.976 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-08T18:34:17.988 INFO:teuthology.task.internal:Not uploading archives. 2024-05-08T18:34:17.988 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-08T18:34:17.998 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-08T18:34:17.998 DEBUG:teuthology.orchestra.run.smithi097:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-08T18:34:18.000 DEBUG:teuthology.orchestra.run.smithi151:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-08T18:34:18.004 INFO:teuthology.orchestra.run.smithi097.stdout: 658633 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 8 18:34 /home/ubuntu/cephtest 2024-05-08T18:34:18.025 INFO:teuthology.orchestra.run.smithi151.stdout: 658623 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 8 18:34 /home/ubuntu/cephtest 2024-05-08T18:34:18.026 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-08T18:34:18.036 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-08T18:34:18.058 INFO:teuthology.run:Summary data: description: rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_user_quota} duration: 884.4752118587494 flavor: default owner: scheduled_ivancich@teuthology success: true 2024-05-08T18:34:18.058 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-08T18:34:18.139 INFO:teuthology.run:pass